{"video_id": 51, "content_group": "96831778e4c998c17fa9bfe1908583909c286ba0a757ceeb0015a1f601ae35bd", "question": {"question_id": "sample_51_a1411_q0", "video_id": 51, "video_path": "./videos/sample_51_real.mp4", "annotation_index": 1411, "question_index": 0, "question": "What is being shown just now?", "options": ["A. Three colorful discs on a grey surface.", "B. Hands holding a stack of acrylic blanks.", "C. The phrase \"SIX months\" on a red disc.", "D. A light pink background with decorative leaves."], "answer": "B", "time_stamp_s": 18, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_51_a1411_q0", "video_id": 51, "time_stamp_s": 18, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "05f717bfb39c037f20fc1a9da5cfc7a0d52f6f9821fe065e979120078168c369", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0], "recent_frames_sha256": "67ee6935507be6b5a7b1849bf0300c026e14df7a88c088f5446e679d6092931b", "num_recent_frames": 19, "tq": 715515.10135061, "t1": 715515.730438744, "ta": 715515.730438744, "te": 715515.767799435, "first_response_s": 0.6290881339227781, "answer_total_s": 0.6664488249225542, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_51_a1411_q0", "video_id": 51, "time_stamp_s": 18, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d91cf4aa047863b5e7f6be8c5e7597920bb6498315c240749d3da069bdd333f9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0], "recent_frames_sha256": "67ee6935507be6b5a7b1849bf0300c026e14df7a88c088f5446e679d6092931b", "num_recent_frames": 19, "tq": 715564.323274675, "t1": 715570.027434431, "ta": 715570.027434431, "te": 715570.329131914, "first_response_s": 5.704159755958244, "answer_total_s": 6.00585723889526, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 51, "content_group": "96831778e4c998c17fa9bfe1908583909c286ba0a757ceeb0015a1f601ae35bd", "question": {"question_id": "sample_51_a1412_q0", "video_id": 51, "video_path": "./videos/sample_51_real.mp4", "annotation_index": 1412, "question_index": 0, "question": "What are the hands doing right now?", "options": ["A. Holding a black bottle cap over the paper.", "B. Tilting the dish slightly and applying pink liquid with a brush.", "C. Mixing in another color from one of the bottles.", "D. Swirling the brush inside a gold-toned bottle."], "answer": "C", "time_stamp_s": 92, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_51_a1412_q0", "video_id": 51, "time_stamp_s": 92, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3425b6492cc9708b69d0b3d847b552231f9ff8a9053e120532c9e06281849e89", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0], "recent_frames_sha256": "364750c2ef05c4a46effcb0a2ad3e9c53f1f2c6955c909e39a37ec46a48e7d7d", "num_recent_frames": 30, "tq": 715515.782751899, "t1": 715528.066299407, "ta": 715528.066299407, "te": 715528.10475253, "first_response_s": 12.283547508064657, "answer_total_s": 12.322000631014816, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_51_a1412_q0", "video_id": 51, "time_stamp_s": 92, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dcbe25b101af77eceb9831553ab710a51c11ad1763a26c7cc317a6c51de20207", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold a stack of white 4\" acrylic blanks, labeled as material needed.  \n- A blue cutting machine is shown, with a hand opening its lid, indicating its use in the project.  \n- Craft vinyl rolls and a sealer (Pate Tone and Mod Podge) are displayed, with text noting them as favorites.\n[30-60s] - A hand holds a white container labeled \"Mod Podge\" and a pink spray can labeled \"Mod Podge\" with text indicating \"Sealer\" and \"Matte Finish\".  \n- The hand then holds a set of alcohol ink bottles and a straw, with text labels identifying them as \"Alcohol Inks\" and \"Straw\".  \n- A white surface displays a collection of alcohol ink bottles, a blending solution bottle, and a straw, with text labels identifying each item.\n[60-90s] - A hand in a black glove holds a clear plastic cup, tilting it to pour red liquid from a bottle into the cup.  \n- The cup is then stirred with a white stick, mixing the red liquid thoroughly.  \n- The red liquid becomes uniformly mixed, forming a vibrant pinkish-red color in the cup.", "history_tokens": 256, "history_utf8_bytes": 1022, "recent_frame_times_s": [63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0], "recent_frames_sha256": "364750c2ef05c4a46effcb0a2ad3e9c53f1f2c6955c909e39a37ec46a48e7d7d", "num_recent_frames": 30, "tq": 715593.039785378, "t1": 715593.772531491, "ta": 715593.772531491, "te": 715593.815282065, "first_response_s": 0.7327461129752919, "answer_total_s": 0.7754966869251803, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 51, "content_group": "96831778e4c998c17fa9bfe1908583909c286ba0a757ceeb0015a1f601ae35bd", "question": {"question_id": "sample_51_a1413_q0", "video_id": 51, "video_path": "./videos/sample_51_real.mp4", "annotation_index": 1413, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Applying blue ink on a disc using a brush.", "B. Mixing different inks in the three bottles.", "C. Drawing circles on paper with a pencil.", "D. Spreading glue on a piece of paper."], "answer": "A", "time_stamp_s": 180, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_51_a1413_q0", "video_id": 51, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8eb8373a44c49196e6d73f1546144d72a0e3a511b714e87d019078b5ba19fa55", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "f1140a957095f6ca84fd39124faa83a5401fd886c2d519c3bf9a9d9461f4bce0", "num_recent_frames": 30, "tq": 715528.115113736, "t1": 715539.888573112, "ta": 715539.888573112, "te": 715539.926731666, "first_response_s": 11.77345937595237, "answer_total_s": 11.811617929954082, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_51_a1413_q0", "video_id": 51, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "91385654a9e18febee01f5484327d3923c9daa91003d81fca883f3d101636035", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold a stack of white 4\" acrylic blanks, labeled as material needed.  \n- A blue cutting machine is shown, with a hand opening its lid, indicating its use in the project.  \n- Craft vinyl rolls and a sealer (Pate Tone and Mod Podge) are displayed, with text noting them as favorites.\n[30-60s] - A hand holds a white container labeled \"Mod Podge\" and a pink spray can labeled \"Mod Podge\" with text indicating \"Sealer\" and \"Matte Finish\".  \n- The hand then holds a set of alcohol ink bottles and a straw, with text labels identifying them as \"Alcohol Inks\" and \"Straw\".  \n- A white surface displays a collection of alcohol ink bottles, a blending solution bottle, and a straw, with text labels identifying each item.\n[60-90s] - A hand in a black glove holds a clear plastic cup, tilting it to pour red liquid from a bottle into the cup.  \n- The cup is then stirred with a white stick, mixing the red liquid thoroughly.  \n- The red liquid becomes uniformly mixed, forming a vibrant pinkish-red color in the cup.\n[90-120s] - Hands in black gloves stir red liquid in a circular dish with a white brush.  \n- A gold-colored liquid is added from a bottle, creating swirling patterns as it mixes with the red.  \n- The dish remains centered on a white sheet, with three bottles (two white, one red) positioned above it.\n[120-150s] - A hand in a black glove holds a red and gold painted ornament, rotating it to show the design.  \n- The hand uses a brush to apply more paint to the ornament's surface.  \n- A clear plastic cup with a purple liquid is held and tilted, suggesting preparation for mixing or application.\n[150-180s] - Hands in black gloves manipulate a clear plastic cup filled with purple paint, using a white stick to stir and spread the paint on a white surface.  \n- A small bottle of white paint is visible on the white surface, positioned to the right of the cup.  \n- The cup is held steady by one hand while the other hand uses the stick to mix and spread the paint, creating a swirling effect.", "history_tokens": 492, "history_utf8_bytes": 2015, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "f1140a957095f6ca84fd39124faa83a5401fd886c2d519c3bf9a9d9461f4bce0", "num_recent_frames": 30, "tq": 715622.995375202, "t1": 715624.806312965, "ta": 715624.806312965, "te": 715624.969616134, "first_response_s": 1.810937762958929, "answer_total_s": 1.9742409319151193, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 51, "content_group": "96831778e4c998c17fa9bfe1908583909c286ba0a757ceeb0015a1f601ae35bd", "question": {"question_id": "sample_51_a1414_q0", "video_id": 51, "video_path": "./videos/sample_51_real.mp4", "annotation_index": 1414, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Rotating the circular object under the light.", "B. Cleaning the brushes with water.", "C. Adding final touches to the circular object with a steady brushstroke.", "D. Placing a golden cap on an ink bottle."], "answer": "C", "time_stamp_s": 259, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_51_a1414_q0", "video_id": 51, "time_stamp_s": 259, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8fba9a9bcd17d3da68fececb75bc7977818f84dd1adb1974002547a04a875b77", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0], "recent_frames_sha256": "e3bd546bead0cb597380514f3219801e818f8d5a68201eb190ecd6256157cc1e", "num_recent_frames": 30, "tq": 715539.937786797, "t1": 715552.096254854, "ta": 715552.096254854, "te": 715552.134361427, "first_response_s": 12.158468057052232, "answer_total_s": 12.196574630099349, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_51_a1414_q0", "video_id": 51, "time_stamp_s": 259, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b98cecf0bd3d9930f5cd5fef7570d738577d3fcc6eec19da080b2233d907073e", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold a stack of white 4\" acrylic blanks, labeled as material needed.  \n- A blue cutting machine is shown, with a hand opening its lid, indicating its use in the project.  \n- Craft vinyl rolls and a sealer (Pate Tone and Mod Podge) are displayed, with text noting them as favorites.\n[30-60s] - A hand holds a white container labeled \"Mod Podge\" and a pink spray can labeled \"Mod Podge\" with text indicating \"Sealer\" and \"Matte Finish\".  \n- The hand then holds a set of alcohol ink bottles and a straw, with text labels identifying them as \"Alcohol Inks\" and \"Straw\".  \n- A white surface displays a collection of alcohol ink bottles, a blending solution bottle, and a straw, with text labels identifying each item.\n[60-90s] - A hand in a black glove holds a clear plastic cup, tilting it to pour red liquid from a bottle into the cup.  \n- The cup is then stirred with a white stick, mixing the red liquid thoroughly.  \n- The red liquid becomes uniformly mixed, forming a vibrant pinkish-red color in the cup.\n[90-120s] - Hands in black gloves stir red liquid in a circular dish with a white brush.  \n- A gold-colored liquid is added from a bottle, creating swirling patterns as it mixes with the red.  \n- The dish remains centered on a white sheet, with three bottles (two white, one red) positioned above it.\n[120-150s] - A hand in a black glove holds a red and gold painted ornament, rotating it to show the design.  \n- The hand uses a brush to apply more paint to the ornament's surface.  \n- A clear plastic cup with a purple liquid is held and tilted, suggesting preparation for mixing or application.\n[150-180s] - Hands in black gloves manipulate a clear plastic cup filled with purple paint, using a white stick to stir and spread the paint on a white surface.  \n- A small bottle of white paint is visible on the white surface, positioned to the right of the cup.  \n- The cup is held steady by one hand while the other hand uses the stick to mix and spread the paint, creating a swirling effect.\n[180-210s] - Artist uses a brush to apply gold paint onto a purple sphere, creating swirling patterns.  \n- The sphere is held steady by gloved hands while paint is applied in circular motions.  \n- Paint splatters appear on the white surface beneath the sphere, indicating active painting.\n[210-240s] - A hand in a black glove holds a purple and gold painted object while using a tool to manipulate its surface.  \n- The hand then switches to a blue paint, applying it to the same object with a tool, creating a swirling pattern.  \n- The object is rotated and adjusted as paint is applied, with paint bottles visible on the white surface nearby.", "history_tokens": 639, "history_utf8_bytes": 2659, "recent_frame_times_s": [230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0], "recent_frames_sha256": "e3bd546bead0cb597380514f3219801e818f8d5a68201eb190ecd6256157cc1e", "num_recent_frames": 30, "tq": 715671.844869531, "t1": 715678.176670063, "ta": 715678.176670063, "te": 715678.400133369, "first_response_s": 6.331800532061607, "answer_total_s": 6.5552638380322605, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 51, "content_group": "96831778e4c998c17fa9bfe1908583909c286ba0a757ceeb0015a1f601ae35bd", "question": {"question_id": "sample_51_a1415_q0", "video_id": 51, "video_path": "./videos/sample_51_real.mp4", "annotation_index": 1415, "question_index": 0, "question": "What is the left hand doing right now?", "options": ["A. Holding the pick tool.", "B. Peeling back the plastic cover from the green disk.", "C. Rotating the green disk.", "D. Holding the red disk."], "answer": "D", "time_stamp_s": 340, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_51_a1415_q0", "video_id": 51, "time_stamp_s": 340, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b3643064cd7cfc3b8762b9965bb8e348b7b2c8b8a9608f7d4909ef1bb24c88a2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0], "recent_frames_sha256": "de9e03cabe7f12ede672d5f1dcdc4a37aef8d447e57e000b4979b4515c9aeb28", "num_recent_frames": 30, "tq": 715552.143513217, "t1": 715564.271178549, "ta": 715564.271178549, "te": 715564.314262964, "first_response_s": 12.127665332052857, "answer_total_s": 12.17074974696152, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_51_a1415_q0", "video_id": 51, "time_stamp_s": 340, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1911f0425d213d294f72a3cf95dd5cab80dc73a3990fd3c9ce25ee517e6375c2", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold a stack of white 4\" acrylic blanks, labeled as material needed.  \n- A blue cutting machine is shown, with a hand opening its lid, indicating its use in the project.  \n- Craft vinyl rolls and a sealer (Pate Tone and Mod Podge) are displayed, with text noting them as favorites.\n[30-60s] - A hand holds a white container labeled \"Mod Podge\" and a pink spray can labeled \"Mod Podge\" with text indicating \"Sealer\" and \"Matte Finish\".  \n- The hand then holds a set of alcohol ink bottles and a straw, with text labels identifying them as \"Alcohol Inks\" and \"Straw\".  \n- A white surface displays a collection of alcohol ink bottles, a blending solution bottle, and a straw, with text labels identifying each item.\n[60-90s] - A hand in a black glove holds a clear plastic cup, tilting it to pour red liquid from a bottle into the cup.  \n- The cup is then stirred with a white stick, mixing the red liquid thoroughly.  \n- The red liquid becomes uniformly mixed, forming a vibrant pinkish-red color in the cup.\n[90-120s] - Hands in black gloves stir red liquid in a circular dish with a white brush.  \n- A gold-colored liquid is added from a bottle, creating swirling patterns as it mixes with the red.  \n- The dish remains centered on a white sheet, with three bottles (two white, one red) positioned above it.\n[120-150s] - A hand in a black glove holds a red and gold painted ornament, rotating it to show the design.  \n- The hand uses a brush to apply more paint to the ornament's surface.  \n- A clear plastic cup with a purple liquid is held and tilted, suggesting preparation for mixing or application.\n[150-180s] - Hands in black gloves manipulate a clear plastic cup filled with purple paint, using a white stick to stir and spread the paint on a white surface.  \n- A small bottle of white paint is visible on the white surface, positioned to the right of the cup.  \n- The cup is held steady by one hand while the other hand uses the stick to mix and spread the paint, creating a swirling effect.\n[180-210s] - Artist uses a brush to apply gold paint onto a purple sphere, creating swirling patterns.  \n- The sphere is held steady by gloved hands while paint is applied in circular motions.  \n- Paint splatters appear on the white surface beneath the sphere, indicating active painting.\n[210-240s] - A hand in a black glove holds a purple and gold painted object while using a tool to manipulate its surface.  \n- The hand then switches to a blue paint, applying it to the same object with a tool, creating a swirling pattern.  \n- The object is rotated and adjusted as paint is applied, with paint bottles visible on the white surface nearby.\n[240-270s] - A gloved hand holds a blue, textured object while using a tool to apply gold flakes onto its surface.  \n- Three small paint bottles (white, gold, and dark blue) are arranged on a white sheet behind the object.  \n- The object is rotated and manipulated to evenly distribute the gold flakes across its surface.\n[270-300s] - Hand in black gloves uses a tool to manipulate a circular, blue-and-gold painted object.  \n- A can of Mod Podge spray is held, positioned above a tray of similar painted circles.  \n- The tray of painted circles rests on a gravel surface, with the spray can being prepared for application.\n[300-330s] - Hands peel off a white paper layer from a cut-out design, revealing a grid-patterned backing.  \n- A white cylindrical object rests on a gray surface, positioned behind three circular coasters.  \n- The person holds a white tool with a curved tip, preparing to interact with the coaster or design.", "history_tokens": 860, "history_utf8_bytes": 3592, "recent_frame_times_s": [311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0], "recent_frames_sha256": "de9e03cabe7f12ede672d5f1dcdc4a37aef8d447e57e000b4979b4515c9aeb28", "num_recent_frames": 30, "tq": 715703.566042439, "t1": 715711.654130862, "ta": 715711.654130862, "te": 715711.690749343, "first_response_s": 8.088088423013687, "answer_total_s": 8.12470690405462, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 52, "content_group": "3d29636015b2e7e3c733b669c69ee4ddaa2b823eb29a9a633ab2d7292e29f5fa", "question": {"question_id": "sample_52_a1745_q0", "video_id": 52, "video_path": "./videos/sample_52_real.mp4", "annotation_index": 1745, "question_index": 0, "question": "What is the screen displaying right now?", "options": ["A. A detailed close-up of milestone discs.", "B. The words “Baby Milestone Disc” centered on a black screen.", "C. Two highlighted milestone discs.", "D. A light gray background with a title and note."], "answer": "B", "time_stamp_s": 15, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_52_a1745_q0", "video_id": 52, "time_stamp_s": 15, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "44245d1722fcafe455e9ab2cb00eff2ba516fb040fac0fa94187e96ce7822fea", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0], "recent_frames_sha256": "b3353d2e0131ca18811373caba41315ebaced3d28efe241a2380934c61879b99", "num_recent_frames": 16, "tq": 717811.60955742, "t1": 717823.440897305, "ta": 717823.440897305, "te": 717823.479337785, "first_response_s": 11.83133988501504, "answer_total_s": 11.869780365028419, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_52_a1745_q0", "video_id": 52, "time_stamp_s": 15, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bab602b284411cd5abe92a580ccad76602b6d872f4ac1df2f420f657713da22d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0], "recent_frames_sha256": "b3353d2e0131ca18811373caba41315ebaced3d28efe241a2380934c61879b99", "num_recent_frames": 16, "tq": 717883.526185585, "t1": 717884.138961281, "ta": 717884.138961281, "te": 717884.180870088, "first_response_s": 0.6127756960922852, "answer_total_s": 0.6546845030970871, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 52, "content_group": "3d29636015b2e7e3c733b669c69ee4ddaa2b823eb29a9a633ab2d7292e29f5fa", "question": {"question_id": "sample_52_a1746_q0", "video_id": 52, "video_path": "./videos/sample_52_real.mp4", "annotation_index": 1746, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Switch to painting a round object with white paint.", "B. Apply orange paint onto an object with a foam brush.", "C. Dip the foam brush into the green paint can.", "D. Place the foam brush aside."], "answer": "A", "time_stamp_s": 107, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_52_a1746_q0", "video_id": 52, "time_stamp_s": 107, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2cf86f079e04bd05f1726f8a4025c6e02d72ee611dd60d187879ce151a941568", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0], "recent_frames_sha256": "6f3daa214c2df29013ed9a57f442937563b1a3bdd5dfb6040e8c8dfb3a95c369", "num_recent_frames": 30, "tq": 717823.496052783, "t1": 717861.655079343, "ta": 717861.655079343, "te": 717861.841581743, "first_response_s": 38.15902656002436, "answer_total_s": 38.345528959995136, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_52_a1746_q0", "video_id": 52, "time_stamp_s": 107, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7d814fcf9711442395cdd07b78674c77ab019f0e627f14681f86dbdb1c3939ff", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold and display white 4\" acrylic discs against a plain background.  \n- Text overlay identifies the items as \"4\" (10cm) Acrylic Blanks.\"  \n- Discs are shown stacked and individually, with no visible markings or designs yet.\n[30-60s] - Hands hold three white paint pots with colored swatches and a tube of acrylic paint labeled \"Daler Rowney.\"  \n- A sponge and brush are displayed alongside the paint pots, with text indicating \"A sponge or brush.\"  \n- A cutting machine is shown with a hand opening its lid, labeled \"Cutting machine.\"\n[60-90s] - A hand holds a clear circular disc with a film partially peeled off one side, preparing for painting.  \n- A brush with an orange handle is used to apply dark paint to the disc's surface.  \n- Paint containers in various colors (brown, beige, orange, green) are arranged in a row above the disc.", "history_tokens": 211, "history_utf8_bytes": 855, "recent_frame_times_s": [78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0], "recent_frames_sha256": "6f3daa214c2df29013ed9a57f442937563b1a3bdd5dfb6040e8c8dfb3a95c369", "num_recent_frames": 30, "tq": 717902.803781552, "t1": 717909.387145085, "ta": 717909.387145085, "te": 717909.579642956, "first_response_s": 6.5833635330200195, "answer_total_s": 6.775861404021271, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 52, "content_group": "3d29636015b2e7e3c733b669c69ee4ddaa2b823eb29a9a633ab2d7292e29f5fa", "question": {"question_id": "sample_52_a1747_q0", "video_id": 52, "video_path": "./videos/sample_52_real.mp4", "annotation_index": 1747, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Smoothing a design onto an brown disc.", "B. Peeling back a transparent sheet from the table.", "C. Holding a white roll of vinyl with intricate patterns.", "D. Aligning a transparent sheet with grid lines."], "answer": "A", "time_stamp_s": 219, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_52_a1747_q0", "video_id": 52, "time_stamp_s": 219, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e2c6f5e1cc375159a3923eaacb97ae3472b51880ee38f0421b6174b77384e4f0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0], "recent_frames_sha256": "5c1369ae8a1814ba86d5f7880633108a3f4b55ae9fa9c0faf74c34bac08e6c78", "num_recent_frames": 30, "tq": 717861.855088394, "t1": 717870.162362062, "ta": 717870.162362062, "te": 717870.393729626, "first_response_s": 8.3072736680042, "answer_total_s": 8.538641231949441, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_52_a1747_q0", "video_id": 52, "time_stamp_s": 219, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9cbd8eca0fba64d7b6b2a4c11b1c806d1535657133bb65ea945b13424cf75fa9", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold and display white 4\" acrylic discs against a plain background.  \n- Text overlay identifies the items as \"4\" (10cm) Acrylic Blanks.\"  \n- Discs are shown stacked and individually, with no visible markings or designs yet.\n[30-60s] - Hands hold three white paint pots with colored swatches and a tube of acrylic paint labeled \"Daler Rowney.\"  \n- A sponge and brush are displayed alongside the paint pots, with text indicating \"A sponge or brush.\"  \n- A cutting machine is shown with a hand opening its lid, labeled \"Cutting machine.\"\n[60-90s] - A hand holds a clear circular disc with a film partially peeled off one side, preparing for painting.  \n- A brush with an orange handle is used to apply dark paint to the disc's surface.  \n- Paint containers in various colors (brown, beige, orange, green) are arranged in a row above the disc.\n[90-120s] - Person applies light green paint to a circular object using a foam brush, moving in a circular motion.  \n- Paint containers are arranged in a row above the work area, showing various colors including brown, beige, orange, and green.  \n- Text overlay indicates \"Let dry for 30 minutes\" as the person finishes painting the object.\n[120-150s] - A Cricut machine is shown cutting vinyl from a white sheet, with the text \"Cut out Vinyl\" visible on the sheet.  \n- The vinyl sheet is then peeled away from the machine, revealing a clean cut.  \n- Hands are seen using scissors to trim the excess vinyl from the cut piece.\n[150-180s] - Hands apply a white transfer sheet to a white plastic cup, aligning it with the cup's curved surface.  \n- A stack of circular, colored transfer sheets (orange, green, beige) is held, indicating multiple color options for the design.  \n- A white Cricut tool is used to press or smooth the transfer sheet onto the cup, ensuring proper adhesion.\n[180-210s] - Hands use a white Cricut tool to trace a circular pattern on a brown plate, then switch to a green plate for similar tracing.  \n- A white cylindrical object and a yellow-and-white Cricut tool are positioned to the left and right, respectively, on the gray surface.  \n- After tracing, the hands place a white grid-patterned sheet over the plates, preparing for further crafting.", "history_tokens": 542, "history_utf8_bytes": 2228, "recent_frame_times_s": [190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0], "recent_frames_sha256": "5c1369ae8a1814ba86d5f7880633108a3f4b55ae9fa9c0faf74c34bac08e6c78", "num_recent_frames": 30, "tq": 717938.983580131, "t1": 717940.798892206, "ta": 717940.798892206, "te": 717941.044356915, "first_response_s": 1.8153120750794187, "answer_total_s": 2.0607767840847373, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 52, "content_group": "3d29636015b2e7e3c733b669c69ee4ddaa2b823eb29a9a633ab2d7292e29f5fa", "question": {"question_id": "sample_52_a1748_q0", "video_id": 52, "video_path": "./videos/sample_52_real.mp4", "annotation_index": 1748, "question_index": 0, "question": "What did the person just do?", "options": ["A. Lift the Cricut tool and prepare to deliver the cut paper.", "B. Secure the cardstock to the mat.", "C. Insert the Cricut tool into the machine.", "D. Begin cutting the cardstock with the machine."], "answer": "A", "time_stamp_s": 318, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_52_a1748_q0", "video_id": 52, "time_stamp_s": 318, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4a329e86839f868e176c157b976a0d3eed507f4e0d04b60b3e1e69e576a5dd18", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0], "recent_frames_sha256": "68820a01996abdfef594b395748579a2f5eff751dc97776baa2c7b82e1d7dcb5", "num_recent_frames": 30, "tq": 717870.406355531, "t1": 717877.12159255, "ta": 717877.12159255, "te": 717877.159753538, "first_response_s": 6.715237019001506, "answer_total_s": 6.753398007014766, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_52_a1748_q0", "video_id": 52, "time_stamp_s": 318, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1e05be99c12ea94512eab24b2818c99322c474ce3b7fe3c7ae9f5c31606d011c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold and display white 4\" acrylic discs against a plain background.  \n- Text overlay identifies the items as \"4\" (10cm) Acrylic Blanks.\"  \n- Discs are shown stacked and individually, with no visible markings or designs yet.\n[30-60s] - Hands hold three white paint pots with colored swatches and a tube of acrylic paint labeled \"Daler Rowney.\"  \n- A sponge and brush are displayed alongside the paint pots, with text indicating \"A sponge or brush.\"  \n- A cutting machine is shown with a hand opening its lid, labeled \"Cutting machine.\"\n[60-90s] - A hand holds a clear circular disc with a film partially peeled off one side, preparing for painting.  \n- A brush with an orange handle is used to apply dark paint to the disc's surface.  \n- Paint containers in various colors (brown, beige, orange, green) are arranged in a row above the disc.\n[90-120s] - Person applies light green paint to a circular object using a foam brush, moving in a circular motion.  \n- Paint containers are arranged in a row above the work area, showing various colors including brown, beige, orange, and green.  \n- Text overlay indicates \"Let dry for 30 minutes\" as the person finishes painting the object.\n[120-150s] - A Cricut machine is shown cutting vinyl from a white sheet, with the text \"Cut out Vinyl\" visible on the sheet.  \n- The vinyl sheet is then peeled away from the machine, revealing a clean cut.  \n- Hands are seen using scissors to trim the excess vinyl from the cut piece.\n[150-180s] - Hands apply a white transfer sheet to a white plastic cup, aligning it with the cup's curved surface.  \n- A stack of circular, colored transfer sheets (orange, green, beige) is held, indicating multiple color options for the design.  \n- A white Cricut tool is used to press or smooth the transfer sheet onto the cup, ensuring proper adhesion.\n[180-210s] - Hands use a white Cricut tool to trace a circular pattern on a brown plate, then switch to a green plate for similar tracing.  \n- A white cylindrical object and a yellow-and-white Cricut tool are positioned to the left and right, respectively, on the gray surface.  \n- After tracing, the hands place a white grid-patterned sheet over the plates, preparing for further crafting.\n[210-240s] - Hands peel off a clear plastic sheet from a circular \"Earth side\" sticker, revealing the design underneath.  \n- A stack of circular coasters and a white cylindrical object are positioned to the left and right, respectively.  \n- The sticker is lifted and rotated to display its design, which features white decorative patterns around the text.\n[240-270s] - Hands peel transparent protective film off circular \"12 months\" stickers, revealing white decorative borders.  \n- Stickers are arranged in a stack, with \"12 months\" prominently displayed on top.  \n- A roll of white ribbon and a stack of other month stickers (e.g., \"1 month,\" \"2 months\") are visible nearby.\n[270-300s] - A collection of circular, color-coded \"month\" stickers (e.g., \"1 month\", \"2 months\") with decorative borders are displayed on a flat surface.  \n- A brown cardboard box labeled \"Baby's First Year\" is shown alongside a circular sticker with \"Earth side\" text, indicating a gift box component.  \n- Hands open the box to reveal the stickers wrapped in clear plastic, suggesting they are part of a printable or craft kit.", "history_tokens": 802, "history_utf8_bytes": 3335, "recent_frame_times_s": [289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0], "recent_frames_sha256": "68820a01996abdfef594b395748579a2f5eff751dc97776baa2c7b82e1d7dcb5", "num_recent_frames": 30, "tq": 717970.489518792, "t1": 717979.032945268, "ta": 717979.032945268, "te": 717979.436060009, "first_response_s": 8.54342647595331, "answer_total_s": 8.946541216922924, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 52, "content_group": "3d29636015b2e7e3c733b669c69ee4ddaa2b823eb29a9a633ab2d7292e29f5fa", "question": {"question_id": "sample_52_a1749_q0", "video_id": 52, "video_path": "./videos/sample_52_real.mp4", "annotation_index": 1749, "question_index": 0, "question": "What did the hands do just now with the vinyl sticker?", "options": ["A. Lifting the cleared vinyl decal from the backing paper.", "B. Securing the sides of the cardboard box.", "C. Peeling away excess material from the vinyl sticker.", "D. Rotating the box to ensure the base is sealed."], "answer": "A", "time_stamp_s": 419, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_52_a1749_q0", "video_id": 52, "time_stamp_s": 419, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "429c076fbeb8c1b26a148825805c6417f61cb13930264ce200b8c43a1a781190", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0], "recent_frames_sha256": "856bd28b69ccbeb69ec2cbbac164ec126576780f652458d6106b45d9fec816b4", "num_recent_frames": 30, "tq": 717877.170808738, "t1": 717883.465420767, "ta": 717883.465420767, "te": 717883.504823025, "first_response_s": 6.294612028985284, "answer_total_s": 6.334014286985621, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_52_a1749_q0", "video_id": 52, "time_stamp_s": 419, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8478fe8963c5ad3312dbe020e2c507245cd96f84b35e62486fd760a0bec64435", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold and display white 4\" acrylic discs against a plain background.  \n- Text overlay identifies the items as \"4\" (10cm) Acrylic Blanks.\"  \n- Discs are shown stacked and individually, with no visible markings or designs yet.\n[30-60s] - Hands hold three white paint pots with colored swatches and a tube of acrylic paint labeled \"Daler Rowney.\"  \n- A sponge and brush are displayed alongside the paint pots, with text indicating \"A sponge or brush.\"  \n- A cutting machine is shown with a hand opening its lid, labeled \"Cutting machine.\"\n[60-90s] - A hand holds a clear circular disc with a film partially peeled off one side, preparing for painting.  \n- A brush with an orange handle is used to apply dark paint to the disc's surface.  \n- Paint containers in various colors (brown, beige, orange, green) are arranged in a row above the disc.\n[90-120s] - Person applies light green paint to a circular object using a foam brush, moving in a circular motion.  \n- Paint containers are arranged in a row above the work area, showing various colors including brown, beige, orange, and green.  \n- Text overlay indicates \"Let dry for 30 minutes\" as the person finishes painting the object.\n[120-150s] - A Cricut machine is shown cutting vinyl from a white sheet, with the text \"Cut out Vinyl\" visible on the sheet.  \n- The vinyl sheet is then peeled away from the machine, revealing a clean cut.  \n- Hands are seen using scissors to trim the excess vinyl from the cut piece.\n[150-180s] - Hands apply a white transfer sheet to a white plastic cup, aligning it with the cup's curved surface.  \n- A stack of circular, colored transfer sheets (orange, green, beige) is held, indicating multiple color options for the design.  \n- A white Cricut tool is used to press or smooth the transfer sheet onto the cup, ensuring proper adhesion.\n[180-210s] - Hands use a white Cricut tool to trace a circular pattern on a brown plate, then switch to a green plate for similar tracing.  \n- A white cylindrical object and a yellow-and-white Cricut tool are positioned to the left and right, respectively, on the gray surface.  \n- After tracing, the hands place a white grid-patterned sheet over the plates, preparing for further crafting.\n[210-240s] - Hands peel off a clear plastic sheet from a circular \"Earth side\" sticker, revealing the design underneath.  \n- A stack of circular coasters and a white cylindrical object are positioned to the left and right, respectively.  \n- The sticker is lifted and rotated to display its design, which features white decorative patterns around the text.\n[240-270s] - Hands peel transparent protective film off circular \"12 months\" stickers, revealing white decorative borders.  \n- Stickers are arranged in a stack, with \"12 months\" prominently displayed on top.  \n- A roll of white ribbon and a stack of other month stickers (e.g., \"1 month,\" \"2 months\") are visible nearby.\n[270-300s] - A collection of circular, color-coded \"month\" stickers (e.g., \"1 month\", \"2 months\") with decorative borders are displayed on a flat surface.  \n- A brown cardboard box labeled \"Baby's First Year\" is shown alongside a circular sticker with \"Earth side\" text, indicating a gift box component.  \n- Hands open the box to reveal the stickers wrapped in clear plastic, suggesting they are part of a printable or craft kit.\n[300-330s] - A hand holds a package labeled \"Kraft Brown Cardstock\" with \"Clear Path Pavers\" branding, wrapped in plastic.  \n- The package is placed into a Cricut cutting machine, which is then closed and prepared for cutting.  \n- The machine's cutting blade is positioned above the cardstock, ready to cut along pre-drawn lines.\n[330-360s] - Hands manipulate a small brown cardboard piece, folding it into a rectangular shape with flaps.  \n- A bottle of glue is brought into view, positioned near the folded cardboard piece.  \n- The hands hold the cardboard piece steady while preparing to apply glue to its edges.\n[360-390s] - Hands apply glue to a cardboard flap using a white glue bottle.  \n- Cardboard pieces are arranged in a flat, interlocking pattern on a white surface.  \n- Glued flap is pressed onto adjacent cardboard to form a box structure.", "history_tokens": 1009, "history_utf8_bytes": 4189, "recent_frame_times_s": [390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0], "recent_frames_sha256": "856bd28b69ccbeb69ec2cbbac164ec126576780f652458d6106b45d9fec816b4", "num_recent_frames": 30, "tq": 718002.857224835, "t1": 718004.440231309, "ta": 718004.440231309, "te": 718004.705132218, "first_response_s": 1.583006474073045, "answer_total_s": 1.8479073829948902, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 53, "content_group": "bb465296d5d7b37faf8fb09d3bce7c92d10cd9e8187b9c0a1b46ebe32a139f52", "question": {"question_id": "sample_53_a1589_q0", "video_id": 53, "video_path": "./videos/sample_53_real.mp4", "annotation_index": 1589, "question_index": 0, "question": "What is being done with the cutting mat right now?", "options": ["A. Removing the cutting mat from the cutting machine.", "B. Cutting the pink paper on the mat manually.", "C. Decorating the cutting mat with stickers.", "D. Placing the cutting mat into the cutting machine."], "answer": "D", "time_stamp_s": 21, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_53_a1589_q0", "video_id": 53, "time_stamp_s": 21, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ec8b1b3104e6ebb85b7e46f275cc77a4517e54eedaad2534c252898343dc20a9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0], "recent_frames_sha256": "32d73f69e8b5848b01e770321faabbae7e95c63395bb98bbe328e916a76610db", "num_recent_frames": 22, "tq": 718334.77151618, "t1": 718343.09864222, "ta": 718343.09864222, "te": 718343.136703656, "first_response_s": 8.327126040006988, "answer_total_s": 8.365187476039864, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_53_a1589_q0", "video_id": 53, "time_stamp_s": 21, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c6dda24bc2014d0c7c153a95cb2170c7d0f7c59b4516d718fd370aeda580bffe", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0], "recent_frames_sha256": "32d73f69e8b5848b01e770321faabbae7e95c63395bb98bbe328e916a76610db", "num_recent_frames": 22, "tq": 718390.547090474, "t1": 718396.707160487, "ta": 718396.707160487, "te": 718396.746174137, "first_response_s": 6.160070012905635, "answer_total_s": 6.199083662941121, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 53, "content_group": "bb465296d5d7b37faf8fb09d3bce7c92d10cd9e8187b9c0a1b46ebe32a139f52", "question": {"question_id": "sample_53_a1590_q0", "video_id": 53, "video_path": "./videos/sample_53_real.mp4", "annotation_index": 1590, "question_index": 0, "question": "What action is being performed right now?", "options": ["A. Cutting the insert and window pieces with scissors.", "B. Peeling off the protective sheet from the acetate.", "C. Operating the Cricut Maker 3 cutting machine.", "D. Arranging the cut pieces and beads on a gray surface."], "answer": "D", "time_stamp_s": 60, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_53_a1590_q0", "video_id": 53, "time_stamp_s": 60, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0ebd9520223ddbdcaec9f984e3296a08ea8d0f9bf3aaaaee58c6fd8b5f40e5c2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [31.0, 32.0, 33.0, 34.0, 35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0], "recent_frames_sha256": "99711d55432ba7d77a6fb4962f7ba7cfd980ff98a370dd15643ed8795ddfd94e", "num_recent_frames": 30, "tq": 718343.151939401, "t1": 718358.056504987, "ta": 718358.056504987, "te": 718358.094018253, "first_response_s": 14.904565585893579, "answer_total_s": 14.942078851978295, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_53_a1590_q0", "video_id": 53, "time_stamp_s": 60, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9573a468f38e2710ffa1a3dadaac89dd962019e506ed3096240e99a2e9edb438", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand places a pink cardboard box into a Cricut machine, preparing for cutting.  \n- The scoring wheel is manually adjusted and then used to score fold lines on the pink material.  \n- The Cricut machine's blade moves along the material, scoring lines as indicated by on-screen text.\n[30-60s] - A hand removes a fine-point blade from a Cricut machine, revealing the blade's position above a pink acetate sheet.  \n- The Cricut machine is shown with the blade lowered, preparing to cut the acetate.  \n- The acetate sheet is peeled from its protective layer, revealing a printed design for a box cut.", "history_tokens": 147, "history_utf8_bytes": 606, "recent_frame_times_s": [31.0, 32.0, 33.0, 34.0, 35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0], "recent_frames_sha256": "99711d55432ba7d77a6fb4962f7ba7cfd980ff98a370dd15643ed8795ddfd94e", "num_recent_frames": 30, "tq": 718413.775926594, "t1": 718421.400263057, "ta": 718421.400263057, "te": 718421.641468298, "first_response_s": 7.62433646293357, "answer_total_s": 7.8655417039990425, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 53, "content_group": "bb465296d5d7b37faf8fb09d3bce7c92d10cd9e8187b9c0a1b46ebe32a139f52", "question": {"question_id": "sample_53_a1591_q0", "video_id": 53, "video_path": "./videos/sample_53_real.mp4", "annotation_index": 1591, "question_index": 0, "question": "What are the hands holding right now?", "options": ["A. The pink sheet of paper.", "B. The clear plastic sheet.", "C. The decorative beads.", "D. The pen and keychain."], "answer": "D", "time_stamp_s": 86, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_53_a1591_q0", "video_id": 53, "time_stamp_s": 86, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b454f55707f0e50214a0b4c0c7c600d2364eaf4fa08942200b4fc7efa9848c62", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0], "recent_frames_sha256": "8fc4f9e9a47916efcbc320e8341ee532a60ba739e358097d0cd3e909425ab8f4", "num_recent_frames": 30, "tq": 718358.107876048, "t1": 718370.156606245, "ta": 718370.156606245, "te": 718370.194819445, "first_response_s": 12.048730197013356, "answer_total_s": 12.086943397065625, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_53_a1591_q0", "video_id": 53, "time_stamp_s": 86, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8a04783c79d79d41da035c81299d025ec6da25450af567038cff8f570e237baf", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand places a pink cardboard box into a Cricut machine, preparing for cutting.  \n- The scoring wheel is manually adjusted and then used to score fold lines on the pink material.  \n- The Cricut machine's blade moves along the material, scoring lines as indicated by on-screen text.\n[30-60s] - A hand removes a fine-point blade from a Cricut machine, revealing the blade's position above a pink acetate sheet.  \n- The Cricut machine is shown with the blade lowered, preparing to cut the acetate.  \n- The acetate sheet is peeled from its protective layer, revealing a printed design for a box cut.", "history_tokens": 147, "history_utf8_bytes": 606, "recent_frame_times_s": [57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0], "recent_frames_sha256": "8fc4f9e9a47916efcbc320e8341ee532a60ba739e358097d0cd3e909425ab8f4", "num_recent_frames": 30, "tq": 718421.669611247, "t1": 718427.49835742, "ta": 718427.49835742, "te": 718427.53673018, "first_response_s": 5.82874617294874, "answer_total_s": 5.867118933005258, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 53, "content_group": "bb465296d5d7b37faf8fb09d3bce7c92d10cd9e8187b9c0a1b46ebe32a139f52", "question": {"question_id": "sample_53_a1592_q0", "video_id": 53, "video_path": "./videos/sample_53_real.mp4", "annotation_index": 1592, "question_index": 0, "question": "What did the hands do just now?", "options": ["A. Cut a new piece of paper.", "B. Fold another frame without glue.", "C. Decorate the paper frame with beads.", "D. Smooth out the acetate window on the paper frame."], "answer": "D", "time_stamp_s": 143, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_53_a1592_q0", "video_id": 53, "time_stamp_s": 143, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1bd4300b148c503e00a718a5e7761b9f231137ca816516758fe8f96ff789c33d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0], "recent_frames_sha256": "31247f9ecb56860c9efa8516349f07ca3842370b61bb52ff4b4d2ea62895c07c", "num_recent_frames": 30, "tq": 718370.210028576, "t1": 718382.792363958, "ta": 718382.792363958, "te": 718382.841169749, "first_response_s": 12.582335382001474, "answer_total_s": 12.631141173071228, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_53_a1592_q0", "video_id": 53, "time_stamp_s": 143, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b8df97f3017af347dafa093b2fd564b5ca9f5e632af730cc9dc44a6266d0ca02", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand places a pink cardboard box into a Cricut machine, preparing for cutting.  \n- The scoring wheel is manually adjusted and then used to score fold lines on the pink material.  \n- The Cricut machine's blade moves along the material, scoring lines as indicated by on-screen text.\n[30-60s] - A hand removes a fine-point blade from a Cricut machine, revealing the blade's position above a pink acetate sheet.  \n- The Cricut machine is shown with the blade lowered, preparing to cut the acetate.  \n- The acetate sheet is peeled from its protective layer, revealing a printed design for a box cut.\n[60-90s] - Hands peel off a transparent protective sheet from a clear acetate piece.  \n- Acetate is then aligned and positioned over a pink cardboard box template.  \n- Keychain and pen are inserted into the acetate, ready for assembly.\n[90-120s] - Hands hold a gold pen with decorative beads and a white pom-pom, positioned near a pink paper template.  \n- Pink paper template is folded along score lines to form a box shape, with hands pressing creases firmly.  \n- Decorated pen is placed beside the folded paper, indicating it may be the item to be stored in the box.", "history_tokens": 284, "history_utf8_bytes": 1175, "recent_frame_times_s": [114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0], "recent_frames_sha256": "31247f9ecb56860c9efa8516349f07ca3842370b61bb52ff4b4d2ea62895c07c", "num_recent_frames": 30, "tq": 718444.277731036, "t1": 718451.814707941, "ta": 718451.814707941, "te": 718452.163372718, "first_response_s": 7.536976905073971, "answer_total_s": 7.8856416820781305, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 53, "content_group": "bb465296d5d7b37faf8fb09d3bce7c92d10cd9e8187b9c0a1b46ebe32a139f52", "question": {"question_id": "sample_53_a1593_q0", "video_id": 53, "video_path": "./videos/sample_53_real.mp4", "annotation_index": 1593, "question_index": 0, "question": "What did the hands do just now?", "options": ["A. Folded the pink paper object and pressed the glue.", "B. Applied glue along the edges of the pink paper object.", "C. Decorated the pink paper object with the beaded pen.", "D. Put the pen and keychain into the pink box."], "answer": "D", "time_stamp_s": 184, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_53_a1593_q0", "video_id": 53, "time_stamp_s": 184, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "01d2778cedef5afc72dd4e721c310e96fd4e012ba8d2b1aed686f74ab7b7dc98", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0], "recent_frames_sha256": "1b0edc38d72a607cb3a25a6fa10f97f7a0a62c60b96af199905195acc78eac40", "num_recent_frames": 30, "tq": 718382.853394122, "t1": 718390.500461205, "ta": 718390.500461205, "te": 718390.538110778, "first_response_s": 7.64706708304584, "answer_total_s": 7.6847166559891775, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_53_a1593_q0", "video_id": 53, "time_stamp_s": 184, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0c81d69821082c6b1164953d1c7a0790fb2d059affbb724c80bcc3fdd65ca4a2", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand places a pink cardboard box into a Cricut machine, preparing for cutting.  \n- The scoring wheel is manually adjusted and then used to score fold lines on the pink material.  \n- The Cricut machine's blade moves along the material, scoring lines as indicated by on-screen text.\n[30-60s] - A hand removes a fine-point blade from a Cricut machine, revealing the blade's position above a pink acetate sheet.  \n- The Cricut machine is shown with the blade lowered, preparing to cut the acetate.  \n- The acetate sheet is peeled from its protective layer, revealing a printed design for a box cut.\n[60-90s] - Hands peel off a transparent protective sheet from a clear acetate piece.  \n- Acetate is then aligned and positioned over a pink cardboard box template.  \n- Keychain and pen are inserted into the acetate, ready for assembly.\n[90-120s] - Hands hold a gold pen with decorative beads and a white pom-pom, positioned near a pink paper template.  \n- Pink paper template is folded along score lines to form a box shape, with hands pressing creases firmly.  \n- Decorated pen is placed beside the folded paper, indicating it may be the item to be stored in the box.\n[120-150s] - Hands apply glue to the inner edges of a pink paper box's acetate window.  \n- A bottle of glue is held in one hand while the other hand presses the acetate into place.  \n- The acetate window is aligned with the box's opening, with the glue being applied along its bottom edge.\n[150-180s] - Hands apply glue to the side flap of a pink paper box.  \n- Glue is applied along the edge of the flap, preparing for folding.  \n- The box remains open, with its side flap being glued down.", "history_tokens": 414, "history_utf8_bytes": 1667, "recent_frame_times_s": [155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0], "recent_frames_sha256": "1b0edc38d72a607cb3a25a6fa10f97f7a0a62c60b96af199905195acc78eac40", "num_recent_frames": 30, "tq": 718469.388728056, "t1": 718469.978701399, "ta": 718469.978701399, "te": 718470.277013295, "first_response_s": 0.5899733430705965, "answer_total_s": 0.8882852389942855, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 54, "content_group": "1bd7f83a8f34bac0055496768bf4d37eb30dd5977a72c66adb900b484827dbfb", "question": {"question_id": "sample_54_a488_q0", "video_id": 54, "video_path": "./videos/sample_54_real.mp4", "annotation_index": 488, "question_index": 0, "question": "What are the hands doing right now?", "options": ["A. Painting the ornament.", "B. Hanging the ornament on a tree.", "C. Mixing resin components.", "D. Holding and adjusting a mask."], "answer": "D", "time_stamp_s": 19, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_54_a488_q0", "video_id": 54, "time_stamp_s": 19, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d13a501a6ac27f3dcc0733d7d9fca438a33932fbfe73287ee3aaee4a4e8eadd9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018], "recent_frames_sha256": "951f73b092374f24b45a35b6c19576da2e7030c0fea3b4c221e369dfe5a77779", "num_recent_frames": 19, "tq": 715405.24281015, "t1": 715411.001028481, "ta": 715411.001028481, "te": 715411.224139312, "first_response_s": 5.758218331029639, "answer_total_s": 5.98132916202303, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_54_a488_q0", "video_id": 54, "time_stamp_s": 19, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "56d07c2c69ddb02fd1400250ee7eca0e4e1eed1b56a19c2c232bf20993769f1b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018], "recent_frames_sha256": "951f73b092374f24b45a35b6c19576da2e7030c0fea3b4c221e369dfe5a77779", "num_recent_frames": 19, "tq": 715288.862746772, "t1": 715295.276806683, "ta": 715295.276806683, "te": 715295.484588093, "first_response_s": 6.414059911039658, "answer_total_s": 6.621841321000829, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 54, "content_group": "1bd7f83a8f34bac0055496768bf4d37eb30dd5977a72c66adb900b484827dbfb", "question": {"question_id": "sample_54_a489_q0", "video_id": 54, "video_path": "./videos/sample_54_real.mp4", "annotation_index": 489, "question_index": 0, "question": "What is the gloved hand doing right now?", "options": ["A. Shaking a beaker filled with golden liquid.", "B. Stirring the resin with a wooden stick.", "C. Holding a pair of tweezers.", "D. Pouring resin with pink mica into the white circular object."], "answer": "D", "time_stamp_s": 113, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_54_a489_q0", "video_id": 54, "time_stamp_s": 113, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7728f55d27b57ae5334d0c11573db0baaa0642facc7f0e0d73907fbce4cbb8e6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [83.04129166666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.01758333333333, 102.01858333333334, 103.01958333333333, 104.02058333333333, 105.02158333333334, 106.02258333333333, 107.02358333333333, 108.02458333333334, 109.02558333333333, 110.02658333333333, 111.02758333333334, 112.02858333333333], "recent_frames_sha256": "22fb7e3ae3fd8821059c8d3cc926727b06eb77ab06425762d3e703c546ca17ca", "num_recent_frames": 30, "tq": 715411.242549654, "t1": 715418.010670198, "ta": 715418.010670198, "te": 715418.048041616, "first_response_s": 6.768120544031262, "answer_total_s": 6.805491962004453, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_54_a489_q0", "video_id": 54, "time_stamp_s": 113, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "efb097ef17913f76e63cd4d779829b6e1e0b39c44489a4d512f1fcd4112ccbe3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A respirator mask with two filters is held by hands, labeled as \"A Respirator Mask\" at 0:16.  \n- A box of \"Strong & Tough\" nitrile gloves, labeled \"X-Large,\" is displayed at 0:23.  \n- The video transitions to a black screen with text \"Ombre Resin Ornament\" at 0:04.\n[30-60s] - Hands hold a box labeled \"INFI-TOUCH GLOVES\" with a black glove visible on top.  \n- Two bottles of epoxy resin (purple and teal) are displayed, labeled \"1:1 ratio\" on screen.  \n- A box of \"RIYA MICA POWDER\" is opened, revealing multiple small packets of colored powders.\n[60-90s] - A hand holds a clear jar labeled \"Gold Leaf Flakes\" with visible golden flakes inside.  \n- The jar is positioned against a plain gray background, with text overlay identifying its contents.  \n- The hand remains steady, showcasing the product from a frontal angle.", "history_tokens": 236, "history_utf8_bytes": 832, "recent_frame_times_s": [83.04129166666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.01758333333333, 102.01858333333334, 103.01958333333333, 104.02058333333333, 105.02158333333334, 106.02258333333333, 107.02358333333333, 108.02458333333334, 109.02558333333333, 110.02658333333333, 111.02758333333334, 112.02858333333333], "recent_frames_sha256": "22fb7e3ae3fd8821059c8d3cc926727b06eb77ab06425762d3e703c546ca17ca", "num_recent_frames": 30, "tq": 715318.966840398, "t1": 715320.190721521, "ta": 715320.190721521, "te": 715320.386717607, "first_response_s": 1.2238811230054125, "answer_total_s": 1.419877209002152, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 54, "content_group": "1bd7f83a8f34bac0055496768bf4d37eb30dd5977a72c66adb900b484827dbfb", "question": {"question_id": "sample_54_a490_q0", "video_id": 54, "video_path": "./videos/sample_54_real.mp4", "annotation_index": 490, "question_index": 0, "question": "What did the right hand do just now?", "options": ["A. Adjusted the position of the ornament.", "B. Lifted the ornament to inspect it.", "C. Held the ornament securely.", "D. Steadily moved the stick to distribute the resin."], "answer": "D", "time_stamp_s": 209, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_54_a490_q0", "video_id": 54, "time_stamp_s": 209, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a36958956b0295de0fe501f054c904497af2147c513347ee7f57e8852895deec", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.03416666666666, 202.03516666666667, 203.03616666666667, 204.03716666666668, 205.03816666666665, 206.03916666666666, 207.04016666666666, 208.04116666666667], "recent_frames_sha256": "769dddffd8332324c2afe98d6297c8c2993f7d3b834ffa000b8afda2b9848ee1", "num_recent_frames": 30, "tq": 715418.068568848, "t1": 715428.653179004, "ta": 715428.653179004, "te": 715428.691020017, "first_response_s": 10.584610156016424, "answer_total_s": 10.622451169067062, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_54_a490_q0", "video_id": 54, "time_stamp_s": 209, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "159e1ba4c0ad1d10e7073e4d9a828ae27cb1a2ce503c60faa0ab288844307041", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A respirator mask with two filters is held by hands, labeled as \"A Respirator Mask\" at 0:16.  \n- A box of \"Strong & Tough\" nitrile gloves, labeled \"X-Large,\" is displayed at 0:23.  \n- The video transitions to a black screen with text \"Ombre Resin Ornament\" at 0:04.\n[30-60s] - Hands hold a box labeled \"INFI-TOUCH GLOVES\" with a black glove visible on top.  \n- Two bottles of epoxy resin (purple and teal) are displayed, labeled \"1:1 ratio\" on screen.  \n- A box of \"RIYA MICA POWDER\" is opened, revealing multiple small packets of colored powders.\n[60-90s] - A hand holds a clear jar labeled \"Gold Leaf Flakes\" with visible golden flakes inside.  \n- The jar is positioned against a plain gray background, with text overlay identifying its contents.  \n- The hand remains steady, showcasing the product from a frontal angle.\n[90-120s] - A hand holds a clear plastic cup containing pink resin and pink mica, using a wooden stick to stir the mixture.  \n- The resin is poured from the cup into a white funnel placed over a clear plastic container.  \n- The resin mixture is stirred continuously with a wooden stick while being poured into the container.\n[120-150s] - A hand in black gloves holds a clear plastic cup containing a pink liquid, positioned over a white mold on a brown surface.  \n- Another hand uses a wooden stick to stir the pink liquid inside the cup.  \n- A text overlay reads \"Resin with Gold Mica\" as the person pours a golden liquid from a cup into the pink liquid.\n[150-180s] - A hand in a black glove holds a clear plastic cup, tilting it to pour a golden liquid into a pink resin mixture in a white mold.  \n- The other hand uses a wooden stick to gently stir the mixture, ensuring even distribution of the golden liquid.  \n- The mold rests on a brown surface, with a small container of pink resin and a stick nearby, indicating ongoing crafting.", "history_tokens": 481, "history_utf8_bytes": 1871, "recent_frame_times_s": [179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.03416666666666, 202.03516666666667, 203.03616666666667, 204.03716666666668, 205.03816666666665, 206.03916666666666, 207.04016666666666, 208.04116666666667], "recent_frames_sha256": "769dddffd8332324c2afe98d6297c8c2993f7d3b834ffa000b8afda2b9848ee1", "num_recent_frames": 30, "tq": 715346.3527147, "t1": 715353.374962573, "ta": 715353.374962573, "te": 715353.695504222, "first_response_s": 7.022247873013839, "answer_total_s": 7.342789521906525, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 54, "content_group": "1bd7f83a8f34bac0055496768bf4d37eb30dd5977a72c66adb900b484827dbfb", "question": {"question_id": "sample_54_a491_q0", "video_id": 54, "video_path": "./videos/sample_54_real.mp4", "annotation_index": 491, "question_index": 0, "question": "How is the glittery substance being applied to the circular object right now?", "options": ["A. Using a paintbrush.", "B. Pouring it directly from the cup.", "C. Applying it with fingers.", "D. Spreading it with a wooden stick."], "answer": "D", "time_stamp_s": 310, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_54_a491_q0", "video_id": 54, "time_stamp_s": 310, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "95bdb88e0c70e89f85c69ae2b61f69fb29bceca612b9a422c9c1b50b11be35a7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [280.02975, 281.03075, 282.03175, 283.03275, 284.03375, 285.03475, 286.03575, 287.03675, 288.03775, 289.03875, 290.03975, 291.04075, 292.0000416666667, 293.00104166666665, 294.0020416666667, 295.00304166666666, 296.0040416666667, 297.00504166666667, 298.00604166666665, 299.0070416666667, 300.00804166666666, 301.0090416666667, 302.01004166666667, 303.01104166666664, 304.0120416666667, 305.01304166666665, 306.0140416666667, 307.01504166666666, 308.0160416666667, 309.01704166666667], "recent_frames_sha256": "e178500ddc7e7e74db12285a9c2eb3bd79c147630cd136b6c0df0a546a841658", "num_recent_frames": 30, "tq": 715428.702816365, "t1": 715439.237563698, "ta": 715439.237563698, "te": 715439.275540683, "first_response_s": 10.534747332916595, "answer_total_s": 10.572724317898974, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_54_a491_q0", "video_id": 54, "time_stamp_s": 310, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "593abc731b68ae4db7bf555276977b83820885353c030c9591977c67ba857c28", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A respirator mask with two filters is held by hands, labeled as \"A Respirator Mask\" at 0:16.  \n- A box of \"Strong & Tough\" nitrile gloves, labeled \"X-Large,\" is displayed at 0:23.  \n- The video transitions to a black screen with text \"Ombre Resin Ornament\" at 0:04.\n[30-60s] - Hands hold a box labeled \"INFI-TOUCH GLOVES\" with a black glove visible on top.  \n- Two bottles of epoxy resin (purple and teal) are displayed, labeled \"1:1 ratio\" on screen.  \n- A box of \"RIYA MICA POWDER\" is opened, revealing multiple small packets of colored powders.\n[60-90s] - A hand holds a clear jar labeled \"Gold Leaf Flakes\" with visible golden flakes inside.  \n- The jar is positioned against a plain gray background, with text overlay identifying its contents.  \n- The hand remains steady, showcasing the product from a frontal angle.\n[90-120s] - A hand holds a clear plastic cup containing pink resin and pink mica, using a wooden stick to stir the mixture.  \n- The resin is poured from the cup into a white funnel placed over a clear plastic container.  \n- The resin mixture is stirred continuously with a wooden stick while being poured into the container.\n[120-150s] - A hand in black gloves holds a clear plastic cup containing a pink liquid, positioned over a white mold on a brown surface.  \n- Another hand uses a wooden stick to stir the pink liquid inside the cup.  \n- A text overlay reads \"Resin with Gold Mica\" as the person pours a golden liquid from a cup into the pink liquid.\n[150-180s] - A hand in a black glove holds a clear plastic cup, tilting it to pour a golden liquid into a pink resin mixture in a white mold.  \n- The other hand uses a wooden stick to gently stir the mixture, ensuring even distribution of the golden liquid.  \n- The mold rests on a brown surface, with a small container of pink resin and a stick nearby, indicating ongoing crafting.\n[180-210s] - A gloved hand holds a small, round, pink-and-white object with a wooden stick inserted into it.  \n- The stick is used to gently stir or spread a golden-brown substance across the surface of the pink liquid.  \n- The object rests on a brown mat, with a small cup of pink liquid and another cup of golden liquid nearby.\n[210-240s] - Hands in black gloves hold a wooden stick and stir resin with gold leaf flakes in a circular container.  \n- A small cup of clear liquid and a pink liquid cup are positioned to the left and right, respectively, on a brown mat.  \n- The resin mixture shows a pink top layer and a gold leaf layer beneath, with the stick moving in a circular motion to blend.\n[240-270s] - Hands in black gloves pour fine gold glitter from a pink-topped container into a small clear cup.  \n- The cup is held steady while the glitter is transferred, with a wooden stick used to assist in the pouring.  \n- A partially filled cup with pink and gold layers sits on a brown mat, with a small silver cap nearby.\n[270-300s] - Left hand holds a clear cup containing a greenish-brown powder, positioned near a circular mold with pink and beige layers.  \n- Right hand uses a thin wooden stick to gently apply the powder to the mold’s beige section, moving from left to right.  \n- A small white cap and scattered purple beads lie on the brown mat beside the mold, indicating additional crafting materials.", "history_tokens": 816, "history_utf8_bytes": 3289, "recent_frame_times_s": [280.02975, 281.03075, 282.03175, 283.03275, 284.03375, 285.03475, 286.03575, 287.03675, 288.03775, 289.03875, 290.03975, 291.04075, 292.0000416666667, 293.00104166666665, 294.0020416666667, 295.00304166666666, 296.0040416666667, 297.00504166666667, 298.00604166666665, 299.0070416666667, 300.00804166666666, 301.0090416666667, 302.01004166666667, 303.01104166666664, 304.0120416666667, 305.01304166666665, 306.0140416666667, 307.01504166666666, 308.0160416666667, 309.01704166666667], "recent_frames_sha256": "e178500ddc7e7e74db12285a9c2eb3bd79c147630cd136b6c0df0a546a841658", "num_recent_frames": 30, "tq": 715380.589949893, "t1": 715381.833266126, "ta": 715381.833266126, "te": 715382.024409856, "first_response_s": 1.2433162330416963, "answer_total_s": 1.4344599629985169, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 54, "content_group": "1bd7f83a8f34bac0055496768bf4d37eb30dd5977a72c66adb900b484827dbfb", "question": {"question_id": "sample_54_a492_q0", "video_id": 54, "video_path": "./videos/sample_54_real.mp4", "annotation_index": 492, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Placing the ornament on the mat.", "B. Peeling off tape from the ornament.", "C. Tying a knot in the string attached to the ornament.", "D. Giving the string one final tug to secure it."], "answer": "D", "time_stamp_s": 407, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_54_a492_q0", "video_id": 54, "time_stamp_s": 407, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "907138a24abe1ed8f92d7e3f6669428f7b2cb18cbc0a6658aa6303f68704483b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [377.001625, 378.002625, 379.003625, 380.004625, 381.005625, 382.006625, 383.007625, 384.008625, 385.009625, 386.010625, 387.011625, 388.012625, 389.013625, 390.014625, 391.015625, 392.016625, 393.017625, 394.018625, 395.019625, 396.020625, 397.021625, 398.022625, 399.023625, 400.024625, 401.025625, 402.026625, 403.027625, 404.028625, 405.029625, 406.030625], "recent_frames_sha256": "dc20e2018f3230c78fb2738d662dcc6bc73b3080bff3a3ac137fb24287e13475", "num_recent_frames": 30, "tq": 715439.285700548, "t1": 715450.551922149, "ta": 715450.551922149, "te": 715450.589660193, "first_response_s": 11.266221601050347, "answer_total_s": 11.30395964498166, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_54_a492_q0", "video_id": 54, "time_stamp_s": 407, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "afe363a7430c968deb28cbd3b70900855422790f685cbe75c83b1b3019b20e49", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Hands hold a box labeled \"INFI-TOUCH GLOVES\" with a black glove visible on top.  \n- Two bottles of epoxy resin (purple and teal) are displayed, labeled \"1:1 ratio\" on screen.  \n- A box of \"RIYA MICA POWDER\" is opened, revealing multiple small packets of colored powders.\n[60-90s] - A hand holds a clear jar labeled \"Gold Leaf Flakes\" with visible golden flakes inside.  \n- The jar is positioned against a plain gray background, with text overlay identifying its contents.  \n- The hand remains steady, showcasing the product from a frontal angle.\n[90-120s] - A hand holds a clear plastic cup containing pink resin and pink mica, using a wooden stick to stir the mixture.  \n- The resin is poured from the cup into a white funnel placed over a clear plastic container.  \n- The resin mixture is stirred continuously with a wooden stick while being poured into the container.\n[120-150s] - A hand in black gloves holds a clear plastic cup containing a pink liquid, positioned over a white mold on a brown surface.  \n- Another hand uses a wooden stick to stir the pink liquid inside the cup.  \n- A text overlay reads \"Resin with Gold Mica\" as the person pours a golden liquid from a cup into the pink liquid.\n[150-180s] - A hand in a black glove holds a clear plastic cup, tilting it to pour a golden liquid into a pink resin mixture in a white mold.  \n- The other hand uses a wooden stick to gently stir the mixture, ensuring even distribution of the golden liquid.  \n- The mold rests on a brown surface, with a small container of pink resin and a stick nearby, indicating ongoing crafting.\n[180-210s] - A gloved hand holds a small, round, pink-and-white object with a wooden stick inserted into it.  \n- The stick is used to gently stir or spread a golden-brown substance across the surface of the pink liquid.  \n- The object rests on a brown mat, with a small cup of pink liquid and another cup of golden liquid nearby.\n[210-240s] - Hands in black gloves hold a wooden stick and stir resin with gold leaf flakes in a circular container.  \n- A small cup of clear liquid and a pink liquid cup are positioned to the left and right, respectively, on a brown mat.  \n- The resin mixture shows a pink top layer and a gold leaf layer beneath, with the stick moving in a circular motion to blend.\n[240-270s] - Hands in black gloves pour fine gold glitter from a pink-topped container into a small clear cup.  \n- The cup is held steady while the glitter is transferred, with a wooden stick used to assist in the pouring.  \n- A partially filled cup with pink and gold layers sits on a brown mat, with a small silver cap nearby.\n[270-300s] - Left hand holds a clear cup containing a greenish-brown powder, positioned near a circular mold with pink and beige layers.  \n- Right hand uses a thin wooden stick to gently apply the powder to the mold’s beige section, moving from left to right.  \n- A small white cap and scattered purple beads lie on the brown mat beside the mold, indicating additional crafting materials.\n[300-330s] - A hand in a black glove holds a small cup containing a golden liquid, positioned near a circular mold with pink and gold layers.  \n- Another hand uses a wooden stick to gently manipulate the mold's surface, possibly to adjust or smooth the layers.  \n- The mold rests on a brown sheet, with small metallic beads scattered nearby, suggesting a crafting or resin pouring activity.\n[330-360s] - A green cutting mat is being ejected from a Cricut machine onto a grid-patterned surface.  \n- Hands fold a white paper strip, then roll it into a cylindrical shape.  \n- The rolled paper is covered with a textured, golden-brown material, forming a decorative object.\n[360-390s] - A hand holds a round, glittery ornament with a purple and gold gradient, featuring a metallic loop at the top.  \n- The ornament is placed on a gray grid mat, with a white rectangular sticker positioned above it.  \n- Hands then pick up the sticker, fold it, and apply it to the ornament’s surface, aligning the text “Merry Christmas” with the ornament’s center.", "history_tokens": 971, "history_utf8_bytes": 4065, "recent_frame_times_s": [377.001625, 378.002625, 379.003625, 380.004625, 381.005625, 382.006625, 383.007625, 384.008625, 385.009625, 386.010625, 387.011625, 388.012625, 389.013625, 390.014625, 391.015625, 392.016625, 393.017625, 394.018625, 395.019625, 396.020625, 397.021625, 398.022625, 399.023625, 400.024625, 401.025625, 402.026625, 403.027625, 404.028625, 405.029625, 406.030625], "recent_frames_sha256": "dc20e2018f3230c78fb2738d662dcc6bc73b3080bff3a3ac137fb24287e13475", "num_recent_frames": 30, "tq": 715402.224759908, "t1": 715404.907398866, "ta": 715404.907398866, "te": 715405.185817151, "first_response_s": 2.682638957980089, "answer_total_s": 2.961057242937386, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 55, "content_group": "e2b425afaac6d841c347c5edc44cdc69befec1170f3c7b0c93cb0ddc73f9886b", "question": {"question_id": "sample_55_a1686_q0", "video_id": 55, "video_path": "./videos/sample_55_real.mp4", "annotation_index": 1686, "question_index": 0, "question": "What did the hands do just now?", "options": ["A. Picked up the gold star.", "B. Folded a pink star.", "C. Arranged the stars in a line.", "D. Removed the silver star."], "answer": "A", "time_stamp_s": 15, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_55_a1686_q0", "video_id": 55, "time_stamp_s": 15, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fc2ead5f301817ca2423a1416f042172b0269998ba134133620e03a7f5c25fe2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014], "recent_frames_sha256": "830ec513a85cdef83c837e114433240019e83933bf74f1d09e95d6eff01e6b73", "num_recent_frames": 15, "tq": 715817.398299477, "t1": 715829.153205709, "ta": 715829.153205709, "te": 715829.19140249, "first_response_s": 11.754906232003123, "answer_total_s": 11.793103013071232, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_55_a1686_q0", "video_id": 55, "time_stamp_s": 15, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "51501cd9836b44bd76a5e8b8b5e2ddbddc8d0cf0671512db9fecb9b4af5952ed", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014], "recent_frames_sha256": "830ec513a85cdef83c837e114433240019e83933bf74f1d09e95d6eff01e6b73", "num_recent_frames": 15, "tq": 715625.022851955, "t1": 715667.005795935, "ta": 715667.005795935, "te": 715667.044138394, "first_response_s": 41.982943980023265, "answer_total_s": 42.02128643891774, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 55, "content_group": "e2b425afaac6d841c347c5edc44cdc69befec1170f3c7b0c93cb0ddc73f9886b", "question": {"question_id": "sample_55_a1687_q0", "video_id": 55, "video_path": "./videos/sample_55_real.mp4", "annotation_index": 1687, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Folding the paper along the creases.", "B. Cutting the paper.", "C. Painting the paper.", "D. Decorating the paper with colors."], "answer": "A", "time_stamp_s": 139, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_55_a1687_q0", "video_id": 55, "time_stamp_s": 139, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7046de800a3109a1d205d8aa831d4482f19b7480a6ac0154eeee2804237b82ab", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334], "recent_frames_sha256": "67b9e146e2bbe313d902d0912db836ed7732ece5d0304e36883242979dc9328f", "num_recent_frames": 30, "tq": 715829.20527502, "t1": 715836.547113761, "ta": 715836.547113761, "te": 715836.584440827, "first_response_s": 7.341838740976527, "answer_total_s": 7.379165807040408, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_55_a1687_q0", "video_id": 55, "time_stamp_s": 139, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b8d60c95e75f958e992850d7fd36da57839f988fd8123d36f8a0961459e58bdb", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands hold and rotate three glittery 3D paper stars (silver, gold, pink) over a grid mat.  \n- Two identical gold glitter paper squares (6x6\" or 145x145mm) are displayed, then one is folded flat.  \n- A pair of hands presses down on the folded paper square to flatten it.\n[30-60s] - Hands press down on a glittery gold paper, aligning it over a white paper base on a grid mat.  \n- The paper is folded diagonally to form a triangle, then unfolded to reveal creases.  \n- A ruler and blue pen are used to mark a line along the folded edge, preparing for further cutting or folding.\n[60-90s] - Hands use a blue pen and ruler to draw a vertical line across a white square, aligning with pre-existing cross marks.  \n- The ruler is repositioned to draw a horizontal line intersecting the vertical line, forming a crosshair pattern on the square.  \n- The square is then folded along the drawn lines, creating a creased, folded paper with four triangular sections.\n[90-120s] - Hands fold a white square paper along pre-drawn lines, creating creases.  \n- A brown, textured paper is inserted into the folded white paper's corners, aligning with the creases.  \n- The paper is manipulated to form a three-dimensional structure, with the brown paper visible at the edges.", "history_tokens": 317, "history_utf8_bytes": 1265, "recent_frame_times_s": [109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334], "recent_frames_sha256": "67b9e146e2bbe313d902d0912db836ed7732ece5d0304e36883242979dc9328f", "num_recent_frames": 30, "tq": 715696.634528556, "t1": 715699.318214045, "ta": 715699.318214045, "te": 715699.356721955, "first_response_s": 2.68368548899889, "answer_total_s": 2.722193398978561, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 55, "content_group": "e2b425afaac6d841c347c5edc44cdc69befec1170f3c7b0c93cb0ddc73f9886b", "question": {"question_id": "sample_55_a1688_q0", "video_id": 55, "video_path": "./videos/sample_55_real.mp4", "annotation_index": 1688, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Applying glue to the hollow center edges of the star.", "B. Rotating the star ornament to show its side profile.", "C. Holding one star in front of another.", "D. Placing the star ornament flat on the grid mat."], "answer": "A", "time_stamp_s": 247, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_55_a1688_q0", "video_id": 55, "time_stamp_s": 247, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7c794333b627acab827a470979acbb6c9ecc6571c7879648b9f5eeeb5319dd6a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [217.00011666666666, 218.00111666666666, 219.00211666666667, 220.00311666666667, 221.00411666666668, 222.00511666666668, 223.00611666666666, 224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332], "recent_frames_sha256": "145f791dacdd1c3cf8ec0bfbf40b54e5b875302369eddfa08e16dea3976d9cc4", "num_recent_frames": 30, "tq": 715836.59208933, "t1": 715850.30387441, "ta": 715850.30387441, "te": 715850.342187713, "first_response_s": 13.711785080027767, "answer_total_s": 13.750098383054137, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_55_a1688_q0", "video_id": 55, "time_stamp_s": 247, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9a936af6a1299307c6d85a37733dd12aa59414438e6aa93e7be42757a604ed21", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands hold and rotate three glittery 3D paper stars (silver, gold, pink) over a grid mat.  \n- Two identical gold glitter paper squares (6x6\" or 145x145mm) are displayed, then one is folded flat.  \n- A pair of hands presses down on the folded paper square to flatten it.\n[30-60s] - Hands press down on a glittery gold paper, aligning it over a white paper base on a grid mat.  \n- The paper is folded diagonally to form a triangle, then unfolded to reveal creases.  \n- A ruler and blue pen are used to mark a line along the folded edge, preparing for further cutting or folding.\n[60-90s] - Hands use a blue pen and ruler to draw a vertical line across a white square, aligning with pre-existing cross marks.  \n- The ruler is repositioned to draw a horizontal line intersecting the vertical line, forming a crosshair pattern on the square.  \n- The square is then folded along the drawn lines, creating a creased, folded paper with four triangular sections.\n[90-120s] - Hands fold a white square paper along pre-drawn lines, creating creases.  \n- A brown, textured paper is inserted into the folded white paper's corners, aligning with the creases.  \n- The paper is manipulated to form a three-dimensional structure, with the brown paper visible at the edges.\n[120-150s] - Hands press and fold a white paper triangle into a star shape, aligning edges with gold glitter paper.\n- The star’s pointed tips are being tucked inward, creating a layered, three-dimensional effect.\n- The paper’s gold glitter sections are visible on the outer edges, contrasting with the white inner sections.\n[150-180s] - Hands apply glue to the inner edge of a star-shaped paper piece.  \n- Glue is dispensed from a blue-tipped bottle onto the paper's fold.  \n- The star is manipulated to align and press the glued section into place.\n[180-210s] - Hands manipulate a gold-patterned paper strip, aligning it with a white paper structure.  \n- A glue bottle is used to apply adhesive to the white paper's edges, securing the gold strip.  \n- The white paper structure is adjusted to ensure the gold strip is properly attached and aligned.\n[210-240s] - Hands manipulate a golden, star-shaped paper object, adjusting its folds.  \n- A white paper square is positioned beneath the star, with glue applied to its surface.  \n- The star is pressed onto the white paper, securing it with glue.", "history_tokens": 579, "history_utf8_bytes": 2366, "recent_frame_times_s": [217.00011666666666, 218.00111666666666, 219.00211666666667, 220.00311666666667, 221.00411666666668, 222.00511666666668, 223.00611666666666, 224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332], "recent_frames_sha256": "145f791dacdd1c3cf8ec0bfbf40b54e5b875302369eddfa08e16dea3976d9cc4", "num_recent_frames": 30, "tq": 715730.235397095, "t1": 715738.032316579, "ta": 715738.032316579, "te": 715738.253855938, "first_response_s": 7.7969194840407, "answer_total_s": 8.01845884299837, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 55, "content_group": "e2b425afaac6d841c347c5edc44cdc69befec1170f3c7b0c93cb0ddc73f9886b", "question": {"question_id": "sample_55_a1689_q0", "video_id": 55, "video_path": "./videos/sample_55_real.mp4", "annotation_index": 1689, "question_index": 0, "question": "What are the hands doing right now?", "options": ["A. Making creases on a triangular shape.", "B. Unfolding a piece of paper.", "C. Cutting out shapes from a paper.", "D. Painting on the paper."], "answer": "A", "time_stamp_s": 378, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_55_a1689_q0", "video_id": 55, "time_stamp_s": 378, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "490334f2f1a32b8814be208f2d45aa52002c7571f7ce10b3c109d6fd40e89aab", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667], "recent_frames_sha256": "76d62a71dd24fa4115fe6ed0c0bef612db14c7df75929274cf0e65e65f85b535", "num_recent_frames": 30, "tq": 715850.348248752, "t1": 715861.161626773, "ta": 715861.161626773, "te": 715861.199137111, "first_response_s": 10.81337802100461, "answer_total_s": 10.850888359011151, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_55_a1689_q0", "video_id": 55, "time_stamp_s": 378, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9e08504102c729bcb99ba7741e97d0d38758fd039f0577146db5fa2f5c4e3fd9", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands hold and rotate three glittery 3D paper stars (silver, gold, pink) over a grid mat.  \n- Two identical gold glitter paper squares (6x6\" or 145x145mm) are displayed, then one is folded flat.  \n- A pair of hands presses down on the folded paper square to flatten it.\n[30-60s] - Hands press down on a glittery gold paper, aligning it over a white paper base on a grid mat.  \n- The paper is folded diagonally to form a triangle, then unfolded to reveal creases.  \n- A ruler and blue pen are used to mark a line along the folded edge, preparing for further cutting or folding.\n[60-90s] - Hands use a blue pen and ruler to draw a vertical line across a white square, aligning with pre-existing cross marks.  \n- The ruler is repositioned to draw a horizontal line intersecting the vertical line, forming a crosshair pattern on the square.  \n- The square is then folded along the drawn lines, creating a creased, folded paper with four triangular sections.\n[90-120s] - Hands fold a white square paper along pre-drawn lines, creating creases.  \n- A brown, textured paper is inserted into the folded white paper's corners, aligning with the creases.  \n- The paper is manipulated to form a three-dimensional structure, with the brown paper visible at the edges.\n[120-150s] - Hands press and fold a white paper triangle into a star shape, aligning edges with gold glitter paper.\n- The star’s pointed tips are being tucked inward, creating a layered, three-dimensional effect.\n- The paper’s gold glitter sections are visible on the outer edges, contrasting with the white inner sections.\n[150-180s] - Hands apply glue to the inner edge of a star-shaped paper piece.  \n- Glue is dispensed from a blue-tipped bottle onto the paper's fold.  \n- The star is manipulated to align and press the glued section into place.\n[180-210s] - Hands manipulate a gold-patterned paper strip, aligning it with a white paper structure.  \n- A glue bottle is used to apply adhesive to the white paper's edges, securing the gold strip.  \n- The white paper structure is adjusted to ensure the gold strip is properly attached and aligned.\n[210-240s] - Hands manipulate a golden, star-shaped paper object, adjusting its folds.  \n- A white paper square is positioned beneath the star, with glue applied to its surface.  \n- The star is pressed onto the white paper, securing it with glue.\n[240-270s] - Hands apply glue to the center of a glittery gold star model.  \n- Glue is dispensed from a white bottle with blue labeling.  \n- The star is held steady while glue is applied to its central point.\n[270-300s] - Hands hold a glittery gold 3D paper star, rotating it to display its facets.  \n- A second hand enters, placing a pink glittery star beside the gold one.  \n- A third star, silver glittery, is added to the scene, forming a trio of colorful stars on a grid mat.\n[300-330s] - A hand holds a stack of light blue, textured paper labeled \"120gsm (80lb)\" over a grid mat.  \n- The paper is unfolded to reveal its full size, then cut into six 9x9cm squares.  \n- The squares are arranged in a 2x3 grid on the mat, with dimensions clearly displayed above them.\n[330-360s] - Hands use orange-handled scissors to cut along the folded edge of a light blue paper triangle.  \n- The cut paper triangle is then unfolded to reveal a new shape.  \n- A square piece of light blue glitter paper remains on the grid mat to the left.", "history_tokens": 860, "history_utf8_bytes": 3396, "recent_frame_times_s": [348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667], "recent_frames_sha256": "76d62a71dd24fa4115fe6ed0c0bef612db14c7df75929274cf0e65e65f85b535", "num_recent_frames": 30, "tq": 715772.365378258, "t1": 715780.969493707, "ta": 715780.969493707, "te": 715781.196293474, "first_response_s": 8.604115448892117, "answer_total_s": 8.830915215890855, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 55, "content_group": "e2b425afaac6d841c347c5edc44cdc69befec1170f3c7b0c93cb0ddc73f9886b", "question": {"question_id": "sample_55_a1690_q0", "video_id": 55, "video_path": "./videos/sample_55_real.mp4", "annotation_index": 1690, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Adjusting the blue paper strip for a tight fit.", "B. Applying glue to the paper pieces.", "C. Cutting a new strip of paper.", "D. Stacking finished paper structures to the side."], "answer": "A", "time_stamp_s": 496, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_55_a1690_q0", "video_id": 55, "time_stamp_s": 496, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4be1d03d0ec264610473595731c1dcab381864af5f407e9c066bf86a0d5ac098", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [466.01555, 467.01655, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335], "recent_frames_sha256": "379a807a1f1b041aecb0264b10492faf6f3d538ca58eb88586fd977068384fd2", "num_recent_frames": 30, "tq": 715861.207166357, "t1": 715872.406232951, "ta": 715872.406232951, "te": 715872.4463978, "first_response_s": 11.199066594010219, "answer_total_s": 11.239231443032622, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_55_a1690_q0", "video_id": 55, "time_stamp_s": 496, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3124e768479d0500254902a380105d79882d40502b931380b651ca7d0c7f928d", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Hands use a blue pen and ruler to draw a vertical line across a white square, aligning with pre-existing cross marks.  \n- The ruler is repositioned to draw a horizontal line intersecting the vertical line, forming a crosshair pattern on the square.  \n- The square is then folded along the drawn lines, creating a creased, folded paper with four triangular sections.\n[90-120s] - Hands fold a white square paper along pre-drawn lines, creating creases.  \n- A brown, textured paper is inserted into the folded white paper's corners, aligning with the creases.  \n- The paper is manipulated to form a three-dimensional structure, with the brown paper visible at the edges.\n[120-150s] - Hands press and fold a white paper triangle into a star shape, aligning edges with gold glitter paper.\n- The star’s pointed tips are being tucked inward, creating a layered, three-dimensional effect.\n- The paper’s gold glitter sections are visible on the outer edges, contrasting with the white inner sections.\n[150-180s] - Hands apply glue to the inner edge of a star-shaped paper piece.  \n- Glue is dispensed from a blue-tipped bottle onto the paper's fold.  \n- The star is manipulated to align and press the glued section into place.\n[180-210s] - Hands manipulate a gold-patterned paper strip, aligning it with a white paper structure.  \n- A glue bottle is used to apply adhesive to the white paper's edges, securing the gold strip.  \n- The white paper structure is adjusted to ensure the gold strip is properly attached and aligned.\n[210-240s] - Hands manipulate a golden, star-shaped paper object, adjusting its folds.  \n- A white paper square is positioned beneath the star, with glue applied to its surface.  \n- The star is pressed onto the white paper, securing it with glue.\n[240-270s] - Hands apply glue to the center of a glittery gold star model.  \n- Glue is dispensed from a white bottle with blue labeling.  \n- The star is held steady while glue is applied to its central point.\n[270-300s] - Hands hold a glittery gold 3D paper star, rotating it to display its facets.  \n- A second hand enters, placing a pink glittery star beside the gold one.  \n- A third star, silver glittery, is added to the scene, forming a trio of colorful stars on a grid mat.\n[300-330s] - A hand holds a stack of light blue, textured paper labeled \"120gsm (80lb)\" over a grid mat.  \n- The paper is unfolded to reveal its full size, then cut into six 9x9cm squares.  \n- The squares are arranged in a 2x3 grid on the mat, with dimensions clearly displayed above them.\n[330-360s] - Hands use orange-handled scissors to cut along the folded edge of a light blue paper triangle.  \n- The cut paper triangle is then unfolded to reveal a new shape.  \n- A square piece of light blue glitter paper remains on the grid mat to the left.\n[360-390s] - Hands hold a light blue paper triangle, preparing to cut with orange-handled scissors.  \n- A stack of white paper squares is positioned to the right, with one being manipulated.  \n- The blue paper is folded and cut, while the white paper is stacked and arranged nearby.\n[390-420s] - Hands apply glue to a white paper square using a purple glue gun.  \n- A stack of similar white squares lies to the left on a grid mat.  \n- The hands then press the glued square onto a teal paper square, aligning edges.\n[420-450s] - Hands manipulate a light blue paper square, folding it into a looped structure.  \n- A purple tool is used to press or fold the paper, indicating a crafting step.  \n- The paper square is positioned on a grid-patterned mat, with other folded paper pieces nearby.\n[450-480s] - Hands manipulate a teal paper piece, folding it into a square shape.  \n- A purple glue gun is used to apply adhesive to the paper's edge.  \n- A completed white paper structure rests on the grid mat in the upper left.", "history_tokens": 955, "history_utf8_bytes": 3828, "recent_frame_times_s": [466.01555, 467.01655, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335], "recent_frames_sha256": "379a807a1f1b041aecb0264b10492faf6f3d538ca58eb88586fd977068384fd2", "num_recent_frames": 30, "tq": 715810.727570028, "t1": 715817.351336095, "ta": 715817.351336095, "te": 715817.389505967, "first_response_s": 6.623766066972166, "answer_total_s": 6.661935938987881, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 56, "content_group": "ea4fb50b65070461377ee58023e60be223a5f5fd391dee6cb11c3c9e2e896718", "question": {"question_id": "sample_56_a1728_q0", "video_id": 56, "video_path": "./videos/sample_56_real.mp4", "annotation_index": 1728, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Holding a decorative paper pad.", "B. Displaying some patterned paper.", "C. Cutting patterned paper.", "D. Writing on the cardstock."], "answer": "B", "time_stamp_s": 19, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_56_a1728_q0", "video_id": 56, "time_stamp_s": 19, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "be53821cc071bb2f976202f8b82733278cd7fa877ff0dc6ba4aeb877a4fd42b8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "d7fed3604310ed6341478823469b79ed407a959610d6397989ff7cbdd9deb560", "num_recent_frames": 20, "tq": 716906.339378377, "t1": 716912.761676153, "ta": 716912.761676153, "te": 716912.990924321, "first_response_s": 6.422297776094638, "answer_total_s": 6.6515459440415725, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_56_a1728_q0", "video_id": 56, "time_stamp_s": 19, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "61759f836eb291344f955b4e412505aa7c0afd61e3f81fbffce615eed9f0b4f6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "d7fed3604310ed6341478823469b79ed407a959610d6397989ff7cbdd9deb560", "num_recent_frames": 20, "tq": 716954.656291528, "t1": 716967.030433825, "ta": 716967.030433825, "te": 716967.265067114, "first_response_s": 12.374142296961509, "answer_total_s": 12.608775586006232, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 56, "content_group": "ea4fb50b65070461377ee58023e60be223a5f5fd391dee6cb11c3c9e2e896718", "question": {"question_id": "sample_56_a1729_q0", "video_id": 56, "video_path": "./videos/sample_56_real.mp4", "annotation_index": 1729, "question_index": 0, "question": "What is the machine doing right now?", "options": ["A. Being turned on.", "B. Loading the material into the tray.", "C. The scoring stylus is being inserted.", "D. Performing the cutting operation."], "answer": "C", "time_stamp_s": 200, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_56_a1729_q0", "video_id": 56, "time_stamp_s": 200, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "eda68459af21f18e6a4fd35f04d8ba8b89cfc22184fc2bcd88370197c30b6989", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0], "recent_frames_sha256": "e58756f07c77cda2126b4026ebb0d94aaa816b555a8ab592042c803c9b32a2d6", "num_recent_frames": 30, "tq": 716913.014694062, "t1": 716921.157571683, "ta": 716921.157571683, "te": 716921.197597676, "first_response_s": 8.142877621110529, "answer_total_s": 8.182903614011593, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_56_a1729_q0", "video_id": 56, "time_stamp_s": 200, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ccfa1a59b7b19b3f9a0f568ba73c369c1741733361b77767791b09ba18fd717d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold a large white cardstock sheet over a cutting mat, with text indicating it's best at 110lb/300gsm.\n- Patterned papers are displayed on the mat, with text noting their optional use for a decorative touch.\n- A package of acetate sheets is shown, labeled for use as a window on the front of the ornament box.\n[30-60s] - A hand holds a package of \"LOWELL A4 Gloss Laminating Pouches\" over a grid mat, with text overlay suggesting acetate sheets or pouch cutting for a window design.  \n- The video transitions to a screen showing a digital design interface with options to upload an SVG file, indicated by a file explorer window selecting a file named \"Information.svg\".  \n- The interface displays a \"Drag & drop the here\" prompt, with a text overlay instructing viewers to upload the SVG file from a link in the bio.\n[60-90s] - User selects \"UnGroup\" from context menu to separate layered elements in the design grid.  \n- Red circle highlights a specific green rectangular layer, indicating selection for further editing.  \n- Layers panel on right shows individual components now separated, ready for individual manipulation.\n[90-120s] - The user selects and modifies a green box template, changing its score lines from \"cut\" to \"score\" for precise folding.\n- The user right-clicks and attaches the cut and score layers for each section, preparing the template for cutting and assembly.\n- The interface displays multiple box templates with different colored sections, indicating various design options for customization.\n[120-150s] - User selects \"Cut\" and \"Score\" layers for each section of the box design via right-click context menu.\n- Design layers (including circular cutouts and flaps) are visually separated and ready for attachment.\n- Interface shows layer names like \"Cut\" and \"Score\" in the right panel, indicating preparation for cutting and scoring.\n[150-180s] - Template preview shows a circular design and rectangular cutouts on a grid, with a \"1.5\" dimension label visible.  \n- User interface displays \"Click 'make it' and arrange according to your template and paper\" as a prompt.  \n- The \"make it\" button is highlighted in green, indicating readiness for user interaction.", "history_tokens": 501, "history_utf8_bytes": 2205, "recent_frame_times_s": [171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0], "recent_frames_sha256": "e58756f07c77cda2126b4026ebb0d94aaa816b555a8ab592042c803c9b32a2d6", "num_recent_frames": 30, "tq": 717007.420055658, "t1": 717008.796485214, "ta": 717008.796485214, "te": 717008.836404277, "first_response_s": 1.3764295560540631, "answer_total_s": 1.4163486190373078, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 56, "content_group": "ea4fb50b65070461377ee58023e60be223a5f5fd391dee6cb11c3c9e2e896718", "question": {"question_id": "sample_56_a1730_q0", "video_id": 56, "video_path": "./videos/sample_56_real.mp4", "annotation_index": 1730, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Folding another piece of white paper from the table.", "B. Rotating and closely examining the folded piece of paper.", "C. Removing hands from the white paper on the table.", "D. Picking up the pink floral-patterned paper."], "answer": "B", "time_stamp_s": 371, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_56_a1730_q0", "video_id": 56, "time_stamp_s": 371, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "52846e582716f0e1e0903c23821401ba7d6abc1e3d18d2dadf354c81ff836ee0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0], "recent_frames_sha256": "325547c7a7f49ca90a2d9609c7a4d09379d11cd79aec0abe626be5e376580d3d", "num_recent_frames": 30, "tq": 716921.227058286, "t1": 716935.17222729, "ta": 716935.17222729, "te": 716935.209594958, "first_response_s": 13.945169004029594, "answer_total_s": 13.982536672032438, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_56_a1730_q0", "video_id": 56, "time_stamp_s": 371, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9c945d2c3af138d62b9567c55ccde21f14470de48b98f44e15ab84baa6e2192f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold a large white cardstock sheet over a cutting mat, with text indicating it's best at 110lb/300gsm.\n- Patterned papers are displayed on the mat, with text noting their optional use for a decorative touch.\n- A package of acetate sheets is shown, labeled for use as a window on the front of the ornament box.\n[30-60s] - A hand holds a package of \"LOWELL A4 Gloss Laminating Pouches\" over a grid mat, with text overlay suggesting acetate sheets or pouch cutting for a window design.  \n- The video transitions to a screen showing a digital design interface with options to upload an SVG file, indicated by a file explorer window selecting a file named \"Information.svg\".  \n- The interface displays a \"Drag & drop the here\" prompt, with a text overlay instructing viewers to upload the SVG file from a link in the bio.\n[60-90s] - User selects \"UnGroup\" from context menu to separate layered elements in the design grid.  \n- Red circle highlights a specific green rectangular layer, indicating selection for further editing.  \n- Layers panel on right shows individual components now separated, ready for individual manipulation.\n[90-120s] - The user selects and modifies a green box template, changing its score lines from \"cut\" to \"score\" for precise folding.\n- The user right-clicks and attaches the cut and score layers for each section, preparing the template for cutting and assembly.\n- The interface displays multiple box templates with different colored sections, indicating various design options for customization.\n[120-150s] - User selects \"Cut\" and \"Score\" layers for each section of the box design via right-click context menu.\n- Design layers (including circular cutouts and flaps) are visually separated and ready for attachment.\n- Interface shows layer names like \"Cut\" and \"Score\" in the right panel, indicating preparation for cutting and scoring.\n[150-180s] - Template preview shows a circular design and rectangular cutouts on a grid, with a \"1.5\" dimension label visible.  \n- User interface displays \"Click 'make it' and arrange according to your template and paper\" as a prompt.  \n- The \"make it\" button is highlighted in green, indicating readiness for user interaction.\n[180-210s] - A white sheet of paper is placed on a blue cutting mat inside a Cricut machine.  \n- A scoring stylus is inserted into the machine's scoring mechanism, positioned above the paper.  \n- The machine's scoring tool moves horizontally across the paper, indicating the scoring process is underway.\n[210-240s] - A Cricut machine is shown with a blue mat and white paper loaded, and the cutting blade is positioned above the paper.\n- The machine's drawer is partially open, revealing the paper and mat underneath.\n- A hand is visible near the machine's control buttons, suggesting interaction or adjustment.\n[240-270s] - A Cricut machine is shown with a blue mat and patterned paper loaded into its cutting area.  \n- The paper, featuring snowflake designs, is being fed through the machine as the cutting blade moves across it.  \n- A hand is seen removing the cut-out paper from the machine’s output tray after the cutting process.\n[270-300s] - A hand guides a blue Cricut mat into the machine's cutting bed.  \n- The mat, featuring a grid pattern, is positioned under the machine's cutting blade assembly.  \n- The machine's blade assembly moves horizontally across the mat, indicating active cutting.\n[300-330s] - A hand places a blue Cricut mat onto a cutting mat, positioning it under a Cricut machine.  \n- The hand then arranges multiple white paper cutouts with circular and rectangular shapes on the cutting mat.  \n- The hand picks up a patterned paper square, showing its design before placing it on the mat.\n[330-360s] - Hands hold a small, patterned paper square, then place it on a cutting mat beside white paper templates.  \n- A white paper template with a circular cutout is picked up and manipulated, showing its fold lines.  \n- The hands fold the white template along pre-scored lines, preparing it for assembly.", "history_tokens": 935, "history_utf8_bytes": 4037, "recent_frame_times_s": [342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0], "recent_frames_sha256": "325547c7a7f49ca90a2d9609c7a4d09379d11cd79aec0abe626be5e376580d3d", "num_recent_frames": 30, "tq": 717064.497405928, "t1": 717066.009951477, "ta": 717066.009951477, "te": 717066.048267121, "first_response_s": 1.5125455490779132, "answer_total_s": 1.5508611929835752, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 56, "content_group": "ea4fb50b65070461377ee58023e60be223a5f5fd391dee6cb11c3c9e2e896718", "question": {"question_id": "sample_56_a1731_q0", "video_id": 56, "video_path": "./videos/sample_56_real.mp4", "annotation_index": 1731, "question_index": 0, "question": "What are the hands doing right now?", "options": ["A. Tracing the inner perimeter of the circular cutout.", "B. Folding a rectangular piece of cardstock.", "C. Reaching for a piece of patterned paper.", "D. Adjusting a bottle of quick-dry adhesive."], "answer": "A", "time_stamp_s": 559, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_56_a1731_q0", "video_id": 56, "time_stamp_s": 559, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "be73fe0bff2edc15eeab167ac1734c67378a6683b314bb3dcd2f987b51d09f81", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0], "recent_frames_sha256": "30bcc1981323234c4de5abacc9ef6af79cfc9e64105ccac5ac2d80c54a1c4343", "num_recent_frames": 30, "tq": 716935.241306547, "t1": 716947.504275046, "ta": 716947.504275046, "te": 716947.540657955, "first_response_s": 12.262968499097042, "answer_total_s": 12.299351408029906, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_56_a1731_q0", "video_id": 56, "time_stamp_s": 559, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "af085f904418273f6ac4811d464a2e5315088254c66f42a766392ae92c95f55a", "condition_order": ["recent", "notes"], "memory": "[150-180s] - Template preview shows a circular design and rectangular cutouts on a grid, with a \"1.5\" dimension label visible.  \n- User interface displays \"Click 'make it' and arrange according to your template and paper\" as a prompt.  \n- The \"make it\" button is highlighted in green, indicating readiness for user interaction.\n[180-210s] - A white sheet of paper is placed on a blue cutting mat inside a Cricut machine.  \n- A scoring stylus is inserted into the machine's scoring mechanism, positioned above the paper.  \n- The machine's scoring tool moves horizontally across the paper, indicating the scoring process is underway.\n[210-240s] - A Cricut machine is shown with a blue mat and white paper loaded, and the cutting blade is positioned above the paper.\n- The machine's drawer is partially open, revealing the paper and mat underneath.\n- A hand is visible near the machine's control buttons, suggesting interaction or adjustment.\n[240-270s] - A Cricut machine is shown with a blue mat and patterned paper loaded into its cutting area.  \n- The paper, featuring snowflake designs, is being fed through the machine as the cutting blade moves across it.  \n- A hand is seen removing the cut-out paper from the machine’s output tray after the cutting process.\n[270-300s] - A hand guides a blue Cricut mat into the machine's cutting bed.  \n- The mat, featuring a grid pattern, is positioned under the machine's cutting blade assembly.  \n- The machine's blade assembly moves horizontally across the mat, indicating active cutting.\n[300-330s] - A hand places a blue Cricut mat onto a cutting mat, positioning it under a Cricut machine.  \n- The hand then arranges multiple white paper cutouts with circular and rectangular shapes on the cutting mat.  \n- The hand picks up a patterned paper square, showing its design before placing it on the mat.\n[330-360s] - Hands hold a small, patterned paper square, then place it on a cutting mat beside white paper templates.  \n- A white paper template with a circular cutout is picked up and manipulated, showing its fold lines.  \n- The hands fold the white template along pre-scored lines, preparing it for assembly.\n[360-390s] - Hands fold a white paper piece with a circular cutout, aligning flaps to form a box structure.  \n- The paper box is manipulated to show its 3D shape, with the circular opening facing upward.  \n- A glue bottle is picked up, positioned near the paper box, indicating preparation for adhesive application.\n[390-420s] - Hands apply glue from a bottle to the edges of a white paper piece with a circular cutout.  \n- The paper piece is then folded along pre-scored lines to form a 3D structure.  \n- A patterned paper sheet remains stationary in the upper right corner of the workspace.\n[420-450s] - Hands hold a white paper box, rotating it to show its hollow interior and square shape.  \n- The box is positioned on a gray grid mat with white and patterned paper scraps nearby.  \n- A purple ribbon-wrapped object is placed atop the box, indicating it's being prepared for presentation or use.\n[450-480s] - Hands hold a purple ornament with a bow, positioning it over a white paper box with a circular cutout.  \n- The ornament is carefully placed into the box's opening, then lifted out, revealing the box's interior.  \n- The box is then set aside, and the hands begin to align and fold another white paper piece with a circular cutout.\n[480-510s] - Hands fold a white paper piece into a rectangular box shape, aligning flaps.  \n- A circular cutout piece is placed beside the box, indicating it's part of the assembly.  \n- Other pre-folded white box components are scattered on the grid mat, suggesting ongoing construction.\n[510-540s] - Hands manipulate a white paper template with a circular cutout, aligning it with other flat-pack box components on a grid mat.  \n- The template is folded along pre-scored lines to form a rectangular base with a central hole, then positioned over an adjacent box flap.  \n- Multiple assembled and unassembled white box templates are scattered around the workspace, indicating an ongoing DIY packaging project.", "history_tokens": 973, "history_utf8_bytes": 4111, "recent_frame_times_s": [530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0], "recent_frames_sha256": "30bcc1981323234c4de5abacc9ef6af79cfc9e64105ccac5ac2d80c54a1c4343", "num_recent_frames": 30, "tq": 717126.083570412, "t1": 717134.685649512, "ta": 717134.685649512, "te": 717134.996370567, "first_response_s": 8.602079099975526, "answer_total_s": 8.912800154997967, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 56, "content_group": "ea4fb50b65070461377ee58023e60be223a5f5fd391dee6cb11c3c9e2e896718", "question": {"question_id": "sample_56_a1732_q0", "video_id": 56, "video_path": "./videos/sample_56_real.mp4", "annotation_index": 1732, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Assembling the final components of the box.", "B. Applying glue to the cardstock.", "C. Cutting out snowflake patterns.", "D. Placing the completed box aside."], "answer": "A", "time_stamp_s": 740, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_56_a1732_q0", "video_id": 56, "time_stamp_s": 740, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "18bd16bb3e5548dd75688ba89b3bc75a9e925ccadc029921e8cf62cea5e3caac", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [711.0, 712.0, 713.0, 714.0, 715.0, 716.0, 717.0, 718.0, 719.0, 720.0, 721.0, 722.0, 723.0, 724.0, 725.0, 726.0, 727.0, 728.0, 729.0, 730.0, 731.0, 732.0, 733.0, 734.0, 735.0, 736.0, 737.0, 738.0, 739.0, 740.0], "recent_frames_sha256": "36592b99010e12babe564faea3428bb3e4add77ced48b89f1b76338145ce0203", "num_recent_frames": 30, "tq": 716947.559121266, "t1": 716954.598322122, "ta": 716954.598322122, "te": 716954.635669278, "first_response_s": 7.039200856001116, "answer_total_s": 7.0765480119735, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_56_a1732_q0", "video_id": 56, "time_stamp_s": 740, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bdec4ab570381480b7815e03e220ca49f7f08f2e1406483c074ac36ad810b0ca", "condition_order": ["recent", "notes"], "memory": "[300-330s] - A hand places a blue Cricut mat onto a cutting mat, positioning it under a Cricut machine.  \n- The hand then arranges multiple white paper cutouts with circular and rectangular shapes on the cutting mat.  \n- The hand picks up a patterned paper square, showing its design before placing it on the mat.\n[330-360s] - Hands hold a small, patterned paper square, then place it on a cutting mat beside white paper templates.  \n- A white paper template with a circular cutout is picked up and manipulated, showing its fold lines.  \n- The hands fold the white template along pre-scored lines, preparing it for assembly.\n[360-390s] - Hands fold a white paper piece with a circular cutout, aligning flaps to form a box structure.  \n- The paper box is manipulated to show its 3D shape, with the circular opening facing upward.  \n- A glue bottle is picked up, positioned near the paper box, indicating preparation for adhesive application.\n[390-420s] - Hands apply glue from a bottle to the edges of a white paper piece with a circular cutout.  \n- The paper piece is then folded along pre-scored lines to form a 3D structure.  \n- A patterned paper sheet remains stationary in the upper right corner of the workspace.\n[420-450s] - Hands hold a white paper box, rotating it to show its hollow interior and square shape.  \n- The box is positioned on a gray grid mat with white and patterned paper scraps nearby.  \n- A purple ribbon-wrapped object is placed atop the box, indicating it's being prepared for presentation or use.\n[450-480s] - Hands hold a purple ornament with a bow, positioning it over a white paper box with a circular cutout.  \n- The ornament is carefully placed into the box's opening, then lifted out, revealing the box's interior.  \n- The box is then set aside, and the hands begin to align and fold another white paper piece with a circular cutout.\n[480-510s] - Hands fold a white paper piece into a rectangular box shape, aligning flaps.  \n- A circular cutout piece is placed beside the box, indicating it's part of the assembly.  \n- Other pre-folded white box components are scattered on the grid mat, suggesting ongoing construction.\n[510-540s] - Hands manipulate a white paper template with a circular cutout, aligning it with other flat-pack box components on a grid mat.  \n- The template is folded along pre-scored lines to form a rectangular base with a central hole, then positioned over an adjacent box flap.  \n- Multiple assembled and unassembled white box templates are scattered around the workspace, indicating an ongoing DIY packaging project.\n[540-570s] - Hands hold a white paper template with a circular cutout, positioning it over a grid mat.  \n- A bottle of glue is brought into view, poised to apply adhesive to the template's edge.  \n- Other paper pieces and patterned cards are visible in the background, suggesting a crafting setup.\n[570-600s] - Hands position a white paper piece with a circular cutout onto a flat surface.  \n- Glue bottle is picked up and applied to the back of the paper piece.  \n- The paper piece is then aligned with another white paper component on the work surface.\n[600-630s] - Hands position white paper box flaps on a grid mat, aligning edges for assembly.  \n- Glue bottle is picked up, preparing to apply adhesive to the box's edges.  \n- A stack of patterned paper with snowflake designs rests in the upper right corner.\n[630-660s] - Hands fold white paper box flaps, aligning edges for assembly.  \n- A circular cutout is visible on the right side of the box template.  \n- Patterned paper squares rest in the upper right corner of the mat.\n[660-690s] - Hands manipulate a white cardboard box template, aligning flaps for assembly.  \n- A stack of patterned paper is positioned to the right, ready for use.  \n- A pre-cut circular hole is visible in the center of the box template.\n[690-720s] - Hands apply glue to a snowflake-patterned paper piece, positioning it over a white box flap.  \n- Glue bottle is held steadily while the paper is pressed onto the box, aligning with adjacent patterned sections.  \n- The box template remains flat on a grid mat, with other patterned papers visible nearby.", "history_tokens": 1008, "history_utf8_bytes": 4164, "recent_frame_times_s": [711.0, 712.0, 713.0, 714.0, 715.0, 716.0, 717.0, 718.0, 719.0, 720.0, 721.0, 722.0, 723.0, 724.0, 725.0, 726.0, 727.0, 728.0, 729.0, 730.0, 731.0, 732.0, 733.0, 734.0, 735.0, 736.0, 737.0, 738.0, 739.0, 740.0], "recent_frames_sha256": "36592b99010e12babe564faea3428bb3e4add77ced48b89f1b76338145ce0203", "num_recent_frames": 30, "tq": 717212.023236792, "t1": 717213.01731775, "ta": 717213.01731775, "te": 717213.40812459, "first_response_s": 0.9940809580730274, "answer_total_s": 1.3848877979908139, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 57, "content_group": "335b17ff6812d2ba0e32af501bf8cb77c678a85620cfb00037e5817c5f560c52", "question": {"question_id": "sample_57_a1720_q0", "video_id": 57, "video_path": "./videos/sample_57_real.mp4", "annotation_index": 1720, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Filling an ornament with a blue liquid.", "B. Rotating a spherical plastic bottle.", "C. Wiping an ornament with a paper towel.", "D. Holding a pink ornament with a funnel."], "answer": "B", "time_stamp_s": 26, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_57_a1720_q0", "video_id": 57, "time_stamp_s": 26, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ddda149dce04afe1545ed1296309e026973dbd00512584b0a5fe1cb783f62525", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0], "recent_frames_sha256": "595d11ce570c58956656fec9d076d07753c069bd9e9a6bfd7a8eacc49c22d879", "num_recent_frames": 27, "tq": 716625.673910085, "t1": 716635.301797114, "ta": 716635.301797114, "te": 716635.339077505, "first_response_s": 9.627887028967962, "answer_total_s": 9.665167420054786, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_57_a1720_q0", "video_id": 57, "time_stamp_s": 26, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3a0b05ec10c1cbf975864cc45a86888286f0c059120e19b26653ec45c50169d5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0], "recent_frames_sha256": "595d11ce570c58956656fec9d076d07753c069bd9e9a6bfd7a8eacc49c22d879", "num_recent_frames": 27, "tq": 716408.225284727, "t1": 716422.717396094, "ta": 716422.717396094, "te": 716422.918758096, "first_response_s": 14.492111366940662, "answer_total_s": 14.693473368999548, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 57, "content_group": "335b17ff6812d2ba0e32af501bf8cb77c678a85620cfb00037e5817c5f560c52", "question": {"question_id": "sample_57_a1721_q0", "video_id": 57, "video_path": "./videos/sample_57_real.mp4", "annotation_index": 1721, "question_index": 0, "question": "What did the person just do?", "options": ["A. Open a clear plastic globe.", "B. Rotate the ornament slightly.", "C. Remove the syringe from the ornament.", "D. Pick up a glitter glue tube."], "answer": "C", "time_stamp_s": 183, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_57_a1721_q0", "video_id": 57, "time_stamp_s": 183, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ba73f9f0265f1d051fe3fd8c87f3fbc8a21070ee24054ce50e86448ca274ec10", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0], "recent_frames_sha256": "b9ecec3fc7f02a69cf2e51dbf705d2aa4fa86076355292e958e63c820b7666db", "num_recent_frames": 30, "tq": 716635.358723411, "t1": 716644.22991376, "ta": 716644.22991376, "te": 716644.451078873, "first_response_s": 8.87119034898933, "answer_total_s": 9.092355462023988, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_57_a1721_q0", "video_id": 57, "time_stamp_s": 183, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e3e2659663447456bc4e65d82c5e6ba613b276b93a9d76d2d216da5c4e1eca5a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Three glitter baubles with names \"Willow,\" \"Morgan,\" and \"Connor\" are displayed on a green background.  \n- Materials for DIY glitter baubles, including clear plastic ornaments, glitter tubes, and a funnel, are laid out on a white surface.  \n- A person wearing black gloves holds a purple glitter bauble and a clear plastic ornament, preparing to fill the ornament.\n[30-60s] - A digital design interface displays text and a \"Willow\" word with a preview of a cut-out shape.  \n- Hands hold a blue ornament with \"Willow\" engraved, then rotate it to show the design.  \n- Three clear ornaments with white dots and a small blue funnel are arranged on a white surface.\n[60-90s] - Three clear plastic cups are arranged on a white textured surface, with a blue funnel and three glitter tubes (pink, purple, blue) nearby.  \n- A hand holds a clear plastic cup, positioned against a backdrop of green pine branches on a grid-patterned surface.  \n- A gold-colored ring is placed on the white surface, near the plastic cups and funnel, suggesting it may be part of the crafting setup.\n[90-120s] - A hand in black gloves holds a can of \"Satin\" paint, labeled \"Polycrylic Protective Coating,\" and uses a tool to open its lid.  \n- The can is positioned on a white textured surface alongside three clear plastic balls, a blue funnel, and three tubes of glitter.  \n- The can's lid is removed, revealing the paint inside, and the hand prepares to use it, likely for coating the plastic balls.\n[120-150s] - Hands in black gloves stir white paint in a gold container with a yellow brush.  \n- Three clear plastic ornaments sit on a white textured surface to the left.  \n- Three glitter tubes (pink, purple, blue) are arranged vertically to the right.\n[150-180s] - Hands in black gloves hold a syringe filled with clear liquid, preparing to inject it into a transparent spherical object.  \n- The syringe is positioned over a clear plastic sphere, with the needle aimed at its opening.  \n- Three identical clear spheres are arranged on the white textured surface, with colored tubes and a blue funnel nearby.", "history_tokens": 494, "history_utf8_bytes": 2092, "recent_frame_times_s": [154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0], "recent_frames_sha256": "b9ecec3fc7f02a69cf2e51dbf705d2aa4fa86076355292e958e63c820b7666db", "num_recent_frames": 30, "tq": 716469.963550478, "t1": 716475.163733318, "ta": 716475.163733318, "te": 716475.201816906, "first_response_s": 5.20018283999525, "answer_total_s": 5.238266428001225, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 57, "content_group": "335b17ff6812d2ba0e32af501bf8cb77c678a85620cfb00037e5817c5f560c52", "question": {"question_id": "sample_57_a1722_q0", "video_id": 57, "video_path": "./videos/sample_57_real.mp4", "annotation_index": 1722, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Filling an ornament with a blue liquid.", "B. Pouring the object inside the blue ball into the funnel.", "C. Wiping an ornament with a paper towel.", "D. Holding a pink ornament with a funnel."], "answer": "B", "time_stamp_s": 339, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_57_a1722_q0", "video_id": 57, "time_stamp_s": 339, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5b8281bd497be5bdbeb51742efab88d1bf60013685861a73831b0fe5bd887341", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0], "recent_frames_sha256": "1be31767028f8e38b44234a29c74f3e923104353ee04c0504606c620298d67b6", "num_recent_frames": 30, "tq": 716644.475198012, "t1": 716650.681614875, "ta": 716650.681614875, "te": 716650.718986415, "first_response_s": 6.206416863016784, "answer_total_s": 6.243788402993232, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_57_a1722_q0", "video_id": 57, "time_stamp_s": 339, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "799a7ff55885e179d70bd56f07adc33fc5dcab35545d7c8eee23e76ed4e68318", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Three glitter baubles with names \"Willow,\" \"Morgan,\" and \"Connor\" are displayed on a green background.  \n- Materials for DIY glitter baubles, including clear plastic ornaments, glitter tubes, and a funnel, are laid out on a white surface.  \n- A person wearing black gloves holds a purple glitter bauble and a clear plastic ornament, preparing to fill the ornament.\n[30-60s] - A digital design interface displays text and a \"Willow\" word with a preview of a cut-out shape.  \n- Hands hold a blue ornament with \"Willow\" engraved, then rotate it to show the design.  \n- Three clear ornaments with white dots and a small blue funnel are arranged on a white surface.\n[60-90s] - Three clear plastic cups are arranged on a white textured surface, with a blue funnel and three glitter tubes (pink, purple, blue) nearby.  \n- A hand holds a clear plastic cup, positioned against a backdrop of green pine branches on a grid-patterned surface.  \n- A gold-colored ring is placed on the white surface, near the plastic cups and funnel, suggesting it may be part of the crafting setup.\n[90-120s] - A hand in black gloves holds a can of \"Satin\" paint, labeled \"Polycrylic Protective Coating,\" and uses a tool to open its lid.  \n- The can is positioned on a white textured surface alongside three clear plastic balls, a blue funnel, and three tubes of glitter.  \n- The can's lid is removed, revealing the paint inside, and the hand prepares to use it, likely for coating the plastic balls.\n[120-150s] - Hands in black gloves stir white paint in a gold container with a yellow brush.  \n- Three clear plastic ornaments sit on a white textured surface to the left.  \n- Three glitter tubes (pink, purple, blue) are arranged vertically to the right.\n[150-180s] - Hands in black gloves hold a syringe filled with clear liquid, preparing to inject it into a transparent spherical object.  \n- The syringe is positioned over a clear plastic sphere, with the needle aimed at its opening.  \n- Three identical clear spheres are arranged on the white textured surface, with colored tubes and a blue funnel nearby.\n[180-210s] - Gloved hands hold a translucent sphere, rotating it to show its surface.  \n- A gold-colored circular object is introduced and positioned near the sphere.  \n- The sphere is manipulated to align with the gold object, suggesting preparation for attachment or measurement.\n[210-240s] - Gloved hands manipulate a clear plastic sphere, positioning it over a gold-colored circular object.  \n- A syringe is used to inject a white substance into the sphere, which is then sealed with the gold object.  \n- Three empty spheres and three colored tubes (pink, purple, blue) are arranged on a white textured surface nearby.\n[240-270s] - Gloved hands hold a small blue cone and a clear plastic sphere, positioning the cone near the sphere's opening.  \n- A pink tube is picked up and placed beside the sphere, with a blue tube also visible nearby.  \n- The hands manipulate the cone and sphere, preparing to pour liquid from the tubes into the sphere.\n[270-300s] - Gloved hands hold a purple bottle and pour its contents into a clear glass cup.  \n- A purple sphere with white spots is held and rotated by gloved hands, positioned over a white paper towel.  \n- The purple bottle is capped and set aside, while the clear glass cup remains stationary on the paper towel.\n[300-330s] - A purple spherical object is held by gloved hands, then placed on a white paper towel surface.  \n- A clear plastic cup is positioned nearby, and a pink tube is introduced into the frame.  \n- The gloved hands manipulate the purple sphere, revealing a hole at its top, and then place it beside the cup.", "history_tokens": 863, "history_utf8_bytes": 3670, "recent_frame_times_s": [310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0], "recent_frames_sha256": "1be31767028f8e38b44234a29c74f3e923104353ee04c0504606c620298d67b6", "num_recent_frames": 30, "tq": 716518.869449875, "t1": 716526.492888081, "ta": 716526.492888081, "te": 716526.768867365, "first_response_s": 7.623438206035644, "answer_total_s": 7.899417489999905, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 57, "content_group": "335b17ff6812d2ba0e32af501bf8cb77c678a85620cfb00037e5817c5f560c52", "question": {"question_id": "sample_57_a1723_q0", "video_id": 57, "video_path": "./videos/sample_57_real.mp4", "annotation_index": 1723, "question_index": 0, "question": "What did the outline of the word \"Willow\" transform to just now?", "options": ["A. Dark blue.", "B. Light purple.", "C. Bright yellow.", "D. Deep red."], "answer": "B", "time_stamp_s": 483, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_57_a1723_q0", "video_id": 57, "time_stamp_s": 483, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "99ac2c0a6a716ce84be8ccc79fad373f2534cf8453e4ad48137a9da0415229b7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [454.0, 455.0, 456.0, 457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0], "recent_frames_sha256": "0f93eb00d26aae6f2985d7ecac9bfc15d73a2a698b070702800b2675d421167e", "num_recent_frames": 30, "tq": 716650.742060493, "t1": 716657.489963305, "ta": 716657.489963305, "te": 716657.527375213, "first_response_s": 6.747902811970562, "answer_total_s": 6.785314720007591, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_57_a1723_q0", "video_id": 57, "time_stamp_s": 483, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7f27456ea68f6cb6dcd4ebbed56d9ffbfa9668855e9a4f9cf5db226ca18172f8", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A hand in black gloves holds a can of \"Satin\" paint, labeled \"Polycrylic Protective Coating,\" and uses a tool to open its lid.  \n- The can is positioned on a white textured surface alongside three clear plastic balls, a blue funnel, and three tubes of glitter.  \n- The can's lid is removed, revealing the paint inside, and the hand prepares to use it, likely for coating the plastic balls.\n[120-150s] - Hands in black gloves stir white paint in a gold container with a yellow brush.  \n- Three clear plastic ornaments sit on a white textured surface to the left.  \n- Three glitter tubes (pink, purple, blue) are arranged vertically to the right.\n[150-180s] - Hands in black gloves hold a syringe filled with clear liquid, preparing to inject it into a transparent spherical object.  \n- The syringe is positioned over a clear plastic sphere, with the needle aimed at its opening.  \n- Three identical clear spheres are arranged on the white textured surface, with colored tubes and a blue funnel nearby.\n[180-210s] - Gloved hands hold a translucent sphere, rotating it to show its surface.  \n- A gold-colored circular object is introduced and positioned near the sphere.  \n- The sphere is manipulated to align with the gold object, suggesting preparation for attachment or measurement.\n[210-240s] - Gloved hands manipulate a clear plastic sphere, positioning it over a gold-colored circular object.  \n- A syringe is used to inject a white substance into the sphere, which is then sealed with the gold object.  \n- Three empty spheres and three colored tubes (pink, purple, blue) are arranged on a white textured surface nearby.\n[240-270s] - Gloved hands hold a small blue cone and a clear plastic sphere, positioning the cone near the sphere's opening.  \n- A pink tube is picked up and placed beside the sphere, with a blue tube also visible nearby.  \n- The hands manipulate the cone and sphere, preparing to pour liquid from the tubes into the sphere.\n[270-300s] - Gloved hands hold a purple bottle and pour its contents into a clear glass cup.  \n- A purple sphere with white spots is held and rotated by gloved hands, positioned over a white paper towel.  \n- The purple bottle is capped and set aside, while the clear glass cup remains stationary on the paper towel.\n[300-330s] - A purple spherical object is held by gloved hands, then placed on a white paper towel surface.  \n- A clear plastic cup is positioned nearby, and a pink tube is introduced into the frame.  \n- The gloved hands manipulate the purple sphere, revealing a hole at its top, and then place it beside the cup.\n[330-360s] - Gloved hands pour blue liquid into a clear spherical ornament, then place it beside two others (purple and pink glitter).  \n- The blue ornament is rotated to show its filled interior, then set down next to the purple one.  \n- All three ornaments (blue, purple, and pink) are held together, displaying their filled states.\n[360-390s] - A blank grid interface with a cursor centered on the screen, indicating readiness for text input.  \n- The left sidebar displays tool icons, while the right sidebar shows a \"Text\" panel with options for formatting.  \n- The top menu bar includes tabs like \"File,\" \"Edit,\" and \"View,\" with \"Text\" highlighted, suggesting text-related functions are active.\n[390-420s] - A dark gray square is drawn on the grid, with resize handles visible at its corners and mid-sides.\n- The square is resized by dragging its top-right handle, reducing its width while maintaining its height.\n- A white \"W\" text object appears below the square, positioned near its bottom-left corner.\n[420-450s] - A black \"W\" letter is selected and resized within a design grid, with handles visible for manipulation.  \n- The text \"Willow\" appears below the \"W\" in a serif font, with selection handles indicating it is editable.  \n- A text box containing instructional text about \"Willow\" is positioned above the \"W,\" partially overlapping the design area.\n[450-480s] - A black, stylized \"W\" icon is positioned above the word \"Willow\" on a grid workspace.  \n- The word \"Willow\" is written in a cursive font, with blue circular handles indicating editable points.  \n- The \"W\" icon is slightly larger than the text and appears to be a separate element, possibly a logo or design component.", "history_tokens": 1016, "history_utf8_bytes": 4289, "recent_frame_times_s": [454.0, 455.0, 456.0, 457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0], "recent_frames_sha256": "0f93eb00d26aae6f2985d7ecac9bfc15d73a2a698b070702800b2675d421167e", "num_recent_frames": 30, "tq": 716574.438402429, "t1": 716575.902052358, "ta": 716575.902052358, "te": 716576.27635105, "first_response_s": 1.463649929035455, "answer_total_s": 1.8379486210178584, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 57, "content_group": "335b17ff6812d2ba0e32af501bf8cb77c678a85620cfb00037e5817c5f560c52", "question": {"question_id": "sample_57_a1724_q0", "video_id": 57, "video_path": "./videos/sample_57_real.mp4", "annotation_index": 1724, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Holding a blue ornament next to the grid-patterned adhesive sheet.", "B. Smoothing out the sticker of a capital letter \"N.\".", "C. Applying a decal with intricate cursive writing to the blue ornament.", "D. Peeling the metallic cap off the blue ornament."], "answer": "C", "time_stamp_s": 660, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_57_a1724_q0", "video_id": 57, "time_stamp_s": 660, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fad6d50bdb34f8d87c16418612f7a6f1eb91d9eb03e3f574bf8d13e100b7e579", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [631.0, 632.0, 633.0, 634.0, 635.0, 636.0, 637.0, 638.0, 639.0, 640.0, 641.0, 642.0, 643.0, 644.0, 645.0, 646.0, 647.0, 648.0, 649.0, 650.0, 651.0, 652.0, 653.0, 654.0, 655.0, 656.0, 657.0, 658.0, 659.0, 660.0], "recent_frames_sha256": "de0f1ed860b1cace6fc907ea40c5a7f137b938821bb5bd7a8bfefb227d621301", "num_recent_frames": 30, "tq": 716657.553662662, "t1": 716664.873498208, "ta": 716664.873498208, "te": 716664.91250181, "first_response_s": 7.319835545960814, "answer_total_s": 7.358839147957042, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_57_a1724_q0", "video_id": 57, "time_stamp_s": 660, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c1603f40da7c851005dd053acb52d58a153e1841892bd0be765a286dd25e6921", "condition_order": ["notes", "recent"], "memory": "[300-330s] - A purple spherical object is held by gloved hands, then placed on a white paper towel surface.  \n- A clear plastic cup is positioned nearby, and a pink tube is introduced into the frame.  \n- The gloved hands manipulate the purple sphere, revealing a hole at its top, and then place it beside the cup.\n[330-360s] - Gloved hands pour blue liquid into a clear spherical ornament, then place it beside two others (purple and pink glitter).  \n- The blue ornament is rotated to show its filled interior, then set down next to the purple one.  \n- All three ornaments (blue, purple, and pink) are held together, displaying their filled states.\n[360-390s] - A blank grid interface with a cursor centered on the screen, indicating readiness for text input.  \n- The left sidebar displays tool icons, while the right sidebar shows a \"Text\" panel with options for formatting.  \n- The top menu bar includes tabs like \"File,\" \"Edit,\" and \"View,\" with \"Text\" highlighted, suggesting text-related functions are active.\n[390-420s] - A dark gray square is drawn on the grid, with resize handles visible at its corners and mid-sides.\n- The square is resized by dragging its top-right handle, reducing its width while maintaining its height.\n- A white \"W\" text object appears below the square, positioned near its bottom-left corner.\n[420-450s] - A black \"W\" letter is selected and resized within a design grid, with handles visible for manipulation.  \n- The text \"Willow\" appears below the \"W\" in a serif font, with selection handles indicating it is editable.  \n- A text box containing instructional text about \"Willow\" is positioned above the \"W,\" partially overlapping the design area.\n[450-480s] - A black, stylized \"W\" icon is positioned above the word \"Willow\" on a grid workspace.  \n- The word \"Willow\" is written in a cursive font, with blue circular handles indicating editable points.  \n- The \"W\" icon is slightly larger than the text and appears to be a separate element, possibly a logo or design component.\n[480-510s] - A black \"W\" icon is positioned above the word \"Willow\" in a design software interface.  \n- The \"Willow\" text is styled in a cursive font with a purple gradient fill.  \n- The \"W\" icon is selected and appears to be being resized or repositioned, as indicated by the handles around its edges.\n[510-540s] - A stylized \"W\" with cursive text is selected and colored purple in the design software.  \n- The user selects \"On Mat\" as the project type, triggering a loading screen indicating the project is being prepared for the machine.  \n- The screen transitions to a \"Connect to your device\" prompt, requiring user interaction to proceed.\n[540-570s] - A pair of hands places a pink paper rectangle and a white paper rectangle onto a green Cricut mat.  \n- The mat is then inserted into a blue and white Cricut cutting machine, which begins to cut the paper.  \n- After cutting, the hands remove the mat and paper from the machine, revealing the cut shapes.\n[570-600s] - Hands peel off a transparent adhesive strip from a white paper strip, revealing a blue letter 'N' underneath.  \n- The hands then fold the paper strip into a small, rectangular shape, aligning the edges.  \n- A blue, glittery ornament is picked up and held in the hands, positioned near the folded paper.\n[600-630s] - Hands position a blue ornament with a silver cap on a grid mat, preparing for decoration.  \n- A white grid-patterned paper with a blue 'N' is held above the ornament, indicating it will be used as a stencil.  \n- The hands carefully align the stencil over the ornament’s surface, ready for application.\n[630-660s] - Hands apply a white transfer sheet to a blue ornament, smoothing it over the surface.  \n- The ornament, now displaying a white \"N\" and \"M\" design, is held steady as the transfer is pressed into place.  \n- A small white paper sheet is picked up and positioned near the ornament, likely for reference or cleanup.", "history_tokens": 958, "history_utf8_bytes": 3930, "recent_frame_times_s": [631.0, 632.0, 633.0, 634.0, 635.0, 636.0, 637.0, 638.0, 639.0, 640.0, 641.0, 642.0, 643.0, 644.0, 645.0, 646.0, 647.0, 648.0, 649.0, 650.0, 651.0, 652.0, 653.0, 654.0, 655.0, 656.0, 657.0, 658.0, 659.0, 660.0], "recent_frames_sha256": "de0f1ed860b1cace6fc907ea40c5a7f137b938821bb5bd7a8bfefb227d621301", "num_recent_frames": 30, "tq": 716624.097280581, "t1": 716625.504516169, "ta": 716625.504516169, "te": 716625.66037371, "first_response_s": 1.4072355879470706, "answer_total_s": 1.5630931289633736, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 58, "content_group": "ebf2e85a08ce5a13ca80ec48411b28320350bd5fb98a464cd94adbe8e4777df8", "question": {"question_id": "sample_58_a76_q0", "video_id": 58, "video_path": "./videos/sample_58_real.mp4", "annotation_index": 76, "question_index": 0, "question": "What are the hands doing right now?", "options": ["A. Arranging flowers on a table.", "B. Rotating a decorative paper wreath.", "C. Painting a wreath.", "D. Holding a black screen."], "answer": "B", "time_stamp_s": 8, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_58_a76_q0", "video_id": 58, "time_stamp_s": 8, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "542c77abcdfa3c995efeabeb08729f163894b884580357e6c5958aa420b342fa", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007], "recent_frames_sha256": "3aa15ef0506ff54557d4d69c7699f7167688fc85f02ce0be340755c53a71514e", "num_recent_frames": 8, "tq": 717909.621356152, "t1": 717910.220387385, "ta": 717910.220387385, "te": 717910.259549551, "first_response_s": 0.5990312329959124, "answer_total_s": 0.6381933989468962, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_58_a76_q0", "video_id": 58, "time_stamp_s": 8, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f5f3e00ed4fe773d509a32476f3764442fb825e279991883f19fe589a8eadc69", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007], "recent_frames_sha256": "3aa15ef0506ff54557d4d69c7699f7167688fc85f02ce0be340755c53a71514e", "num_recent_frames": 8, "tq": 717958.447744278, "t1": 717965.571328207, "ta": 717965.571328207, "te": 717965.611126124, "first_response_s": 7.123583929031156, "answer_total_s": 7.163381846039556, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 58, "content_group": "ebf2e85a08ce5a13ca80ec48411b28320350bd5fb98a464cd94adbe8e4777df8", "question": {"question_id": "sample_58_a77_q0", "video_id": 58, "video_path": "./videos/sample_58_real.mp4", "annotation_index": 77, "question_index": 0, "question": "What is the machine doing right now?", "options": ["A. Pausing the cutting process.", "B. Initiating a new cutting sequence.", "C. Moving the cutting mat.", "D. Changing the blade."], "answer": "B", "time_stamp_s": 138, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_58_a77_q0", "video_id": 58, "time_stamp_s": 138, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7b7b9b7ff7a62997b0784d5c14659cb4a78f9cca9aa0c7758fb51c122d7ae8db", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334], "recent_frames_sha256": "c266d6df30385a452d87d8dcb1590c361aaa06ce1790a1f52ce1d063fef3413d", "num_recent_frames": 30, "tq": 717910.273861564, "t1": 717920.531632451, "ta": 717920.531632451, "te": 717920.572815181, "first_response_s": 10.257770886993967, "answer_total_s": 10.29895361699164, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_58_a77_q0", "video_id": 58, "time_stamp_s": 138, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "91e99e384523a175a0884a1e9d61c9e2c3f260d32c3bd5b768c164a8c72b6ca0", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold a completed paper Christmas wreath with red and white poinsettias and green leaves on a grid mat.  \n- Black screen displays text: \"DIY Paper Christmas Wreath\" followed by cut file formats available for die cutting machines and print/hand cut.  \n- Hands present a package of colorful paper, labeled \"100 sheets\" and \"65 lb / 175 gsm,\" on the same grid mat.\n[30-60s] - Hands place a stack of colored papers (green, red, cream) on a grid mat.  \n- A green Cricut mat is positioned on the Cricut machine's bed.  \n- The Cricut machine's cutting head moves horizontally across the green mat.\n[60-90s] - Cricut machine head moves horizontally across green material, cutting a circular shape.  \n- Green material is partially cut, revealing a circular outline as the machine progresses.  \n- Machine head continues cutting, with the green material being fed forward as the cutting path advances.\n[90-120s] - The Cricut machine's cutting head moves horizontally across a red sheet of material, then transitions to a green border.  \n- The machine's carriage slides along the track, adjusting its position as it processes different materials.  \n- The material changes from red to beige, indicating a switch in the cutting surface or layer during the operation.", "history_tokens": 303, "history_utf8_bytes": 1267, "recent_frame_times_s": [108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334], "recent_frames_sha256": "c266d6df30385a452d87d8dcb1590c361aaa06ce1790a1f52ce1d063fef3413d", "num_recent_frames": 30, "tq": 718002.833216587, "t1": 718004.440231309, "ta": 718004.440231309, "te": 718004.705132218, "first_response_s": 1.607014722074382, "answer_total_s": 1.8719156309962273, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 58, "content_group": "ebf2e85a08ce5a13ca80ec48411b28320350bd5fb98a464cd94adbe8e4777df8", "question": {"question_id": "sample_58_a78_q0", "video_id": 58, "video_path": "./videos/sample_58_real.mp4", "annotation_index": 78, "question_index": 0, "question": "What are the hands doing right now?", "options": ["A. Assembling cream-colored paper petals together.", "B. Adding dimension by scoring the red petals.", "C. Sorting finished cream-colored flowers.", "D. Disposing of unwanted petals."], "answer": "B", "time_stamp_s": 260, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_58_a78_q0", "video_id": 58, "time_stamp_s": 260, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7a3a538c44110e8d959915a593b0fa3b2f9cdb174f04f28f31cea4d4137c172d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875], "recent_frames_sha256": "933feedd0a0f8c9a9729c5896e4d297dd85c4a720aada325721180e237f60057", "num_recent_frames": 30, "tq": 717920.586716232, "t1": 717932.472296064, "ta": 717932.472296064, "te": 717932.512156972, "first_response_s": 11.885579832014628, "answer_total_s": 11.925440739956684, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_58_a78_q0", "video_id": 58, "time_stamp_s": 260, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a479271a07731ae39c3e615591863c3f7dec62927b2464769f6faafdc6cda93f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold a completed paper Christmas wreath with red and white poinsettias and green leaves on a grid mat.  \n- Black screen displays text: \"DIY Paper Christmas Wreath\" followed by cut file formats available for die cutting machines and print/hand cut.  \n- Hands present a package of colorful paper, labeled \"100 sheets\" and \"65 lb / 175 gsm,\" on the same grid mat.\n[30-60s] - Hands place a stack of colored papers (green, red, cream) on a grid mat.  \n- A green Cricut mat is positioned on the Cricut machine's bed.  \n- The Cricut machine's cutting head moves horizontally across the green mat.\n[60-90s] - Cricut machine head moves horizontally across green material, cutting a circular shape.  \n- Green material is partially cut, revealing a circular outline as the machine progresses.  \n- Machine head continues cutting, with the green material being fed forward as the cutting path advances.\n[90-120s] - The Cricut machine's cutting head moves horizontally across a red sheet of material, then transitions to a green border.  \n- The machine's carriage slides along the track, adjusting its position as it processes different materials.  \n- The material changes from red to beige, indicating a switch in the cutting surface or layer during the operation.\n[120-150s] - Cricut machine moves horizontally across a green-bordered mat, cutting a beige material.  \n- A text overlay appears, explaining the card was split due to stock shortage.  \n- The machine's cutting head is positioned above the material, ready for operation.\n[150-180s] - Hands use a blue pen to score lines on a green paper flower, creating creases for folding.  \n- The scored green flower is then folded along the creases to form a three-dimensional shape.  \n- Other pre-folded paper flowers (white, green, red) are arranged on a grid mat in the background.\n[180-210s] - Hands manipulate a green paper flower, adjusting its petals.  \n- Green paper flower is positioned centrally on a grid mat, surrounded by other colored paper flowers.  \n- Other paper flowers (white, red) are arranged in groups to the left and right of the green one.\n[210-240s] - Hands manipulate a green paper flower, adjusting its petals.  \n- White paper flowers are arranged on the left, red ones on the right.  \n- A blue pen is used to mark or trace on a white paper flower.", "history_tokens": 563, "history_utf8_bytes": 2328, "recent_frame_times_s": [230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875], "recent_frames_sha256": "933feedd0a0f8c9a9729c5896e4d297dd85c4a720aada325721180e237f60057", "num_recent_frames": 30, "tq": 718027.255327363, "t1": 718029.511899397, "ta": 718029.511899397, "te": 718029.704772428, "first_response_s": 2.256572033977136, "answer_total_s": 2.4494450649945065, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 58, "content_group": "ebf2e85a08ce5a13ca80ec48411b28320350bd5fb98a464cd94adbe8e4777df8", "question": {"question_id": "sample_58_a79_q0", "video_id": 58, "video_path": "./videos/sample_58_real.mp4", "annotation_index": 79, "question_index": 0, "question": "What are the person's hands doing right now?", "options": ["A. Cutting paper into flower shapes.", "B. Placing a finished flower with others.", "C. Assembling a new set of flower petals.", "D. Drawing a design on the cutting mat."], "answer": "B", "time_stamp_s": 362, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_58_a79_q0", "video_id": 58, "time_stamp_s": 362, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "dbf435f81fec7731ea6520eb742071e3324f7d9b58760257961e757d8f52239b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [332.01501666666667, 333.01601666666664, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065], "recent_frames_sha256": "619cb8fe45cab89771293280e1641209f63c36d214ec630598632fc0509dc5ca", "num_recent_frames": 30, "tq": 717932.526109938, "t1": 717946.442119438, "ta": 717946.442119438, "te": 717946.480127291, "first_response_s": 13.916009499924257, "answer_total_s": 13.954017353011295, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_58_a79_q0", "video_id": 58, "time_stamp_s": 362, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "919a2c9fa6c3b86f73ce7daa0415b9b1c4d08b8208c5cae2b48caf5b3c04d09e", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold a completed paper Christmas wreath with red and white poinsettias and green leaves on a grid mat.  \n- Black screen displays text: \"DIY Paper Christmas Wreath\" followed by cut file formats available for die cutting machines and print/hand cut.  \n- Hands present a package of colorful paper, labeled \"100 sheets\" and \"65 lb / 175 gsm,\" on the same grid mat.\n[30-60s] - Hands place a stack of colored papers (green, red, cream) on a grid mat.  \n- A green Cricut mat is positioned on the Cricut machine's bed.  \n- The Cricut machine's cutting head moves horizontally across the green mat.\n[60-90s] - Cricut machine head moves horizontally across green material, cutting a circular shape.  \n- Green material is partially cut, revealing a circular outline as the machine progresses.  \n- Machine head continues cutting, with the green material being fed forward as the cutting path advances.\n[90-120s] - The Cricut machine's cutting head moves horizontally across a red sheet of material, then transitions to a green border.  \n- The machine's carriage slides along the track, adjusting its position as it processes different materials.  \n- The material changes from red to beige, indicating a switch in the cutting surface or layer during the operation.\n[120-150s] - Cricut machine moves horizontally across a green-bordered mat, cutting a beige material.  \n- A text overlay appears, explaining the card was split due to stock shortage.  \n- The machine's cutting head is positioned above the material, ready for operation.\n[150-180s] - Hands use a blue pen to score lines on a green paper flower, creating creases for folding.  \n- The scored green flower is then folded along the creases to form a three-dimensional shape.  \n- Other pre-folded paper flowers (white, green, red) are arranged on a grid mat in the background.\n[180-210s] - Hands manipulate a green paper flower, adjusting its petals.  \n- Green paper flower is positioned centrally on a grid mat, surrounded by other colored paper flowers.  \n- Other paper flowers (white, red) are arranged in groups to the left and right of the green one.\n[210-240s] - Hands manipulate a green paper flower, adjusting its petals.  \n- White paper flowers are arranged on the left, red ones on the right.  \n- A blue pen is used to mark or trace on a white paper flower.\n[240-270s] - Hands manipulate a white paper flower, adjusting its petals.  \n- Red paper flowers are arranged on a grid mat, with one being traced with a blue pen.  \n- A ring is visible on the left hand, and the right hand holds a pen while tracing.\n[270-300s] - Hands apply glue to a red paper petal, positioning it over a partially assembled flower.  \n- Glue bottle is held near the petal, with text overlay suggesting hot glue as an alternative.  \n- Three completed red paper flowers are visible on the grid mat in the background.\n[300-330s] - Hands manipulate a red paper flower, adjusting its petals.  \n- A glue bottle is brought into view, positioned near the flower for application.  \n- Three completed red paper flowers are arranged on a grid mat in the background.\n[330-360s] - Hands apply glue to the center of a red paper flower, preparing to attach a green leaf.  \n- Green paper leaves are positioned below the red flowers, ready for assembly.  \n- Glue is applied to the base of a green leaf, indicating attachment to a red flower.", "history_tokens": 818, "history_utf8_bytes": 3371, "recent_frame_times_s": [332.01501666666667, 333.01601666666664, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065], "recent_frames_sha256": "619cb8fe45cab89771293280e1641209f63c36d214ec630598632fc0509dc5ca", "num_recent_frames": 30, "tq": 718057.33952427, "t1": 718058.851668002, "ta": 718058.851668002, "te": 718059.124262861, "first_response_s": 1.5121437319321558, "answer_total_s": 1.784738590940833, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 58, "content_group": "ebf2e85a08ce5a13ca80ec48411b28320350bd5fb98a464cd94adbe8e4777df8", "question": {"question_id": "sample_58_a80_q0", "video_id": 58, "video_path": "./videos/sample_58_real.mp4", "annotation_index": 80, "question_index": 0, "question": "What are the person's hands doing right now?", "options": ["A. Spraying water on the flowers.", "B. Rearranging flowers and leaves on the wreath.", "C. Cutting the flowers with scissors.", "D. Painting the flowers on the wreath."], "answer": "B", "time_stamp_s": 502, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_58_a80_q0", "video_id": 58, "time_stamp_s": 502, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "503e4a55563d498e151d2878fce196aca3d5038e3e6bb8ea75db8ed66868ceed", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336, 498.01418333333334, 499.0151833333333, 500.01618333333334, 501.0005], "recent_frames_sha256": "5654d28f13876ecbc2bbc6624ca026ae3223482a01e71e2221f84ff97c97ec60", "num_recent_frames": 30, "tq": 717946.488718154, "t1": 717958.403686846, "ta": 717958.403686846, "te": 717958.440936518, "first_response_s": 11.914968691999093, "answer_total_s": 11.95221836399287, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_58_a80_q0", "video_id": 58, "time_stamp_s": 502, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7386598d5ec4f55099e1d222c18cd8ee4361e1a70a127caec8d759f128c5d260", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Hands place a stack of colored papers (green, red, cream) on a grid mat.  \n- A green Cricut mat is positioned on the Cricut machine's bed.  \n- The Cricut machine's cutting head moves horizontally across the green mat.\n[60-90s] - Cricut machine head moves horizontally across green material, cutting a circular shape.  \n- Green material is partially cut, revealing a circular outline as the machine progresses.  \n- Machine head continues cutting, with the green material being fed forward as the cutting path advances.\n[90-120s] - The Cricut machine's cutting head moves horizontally across a red sheet of material, then transitions to a green border.  \n- The machine's carriage slides along the track, adjusting its position as it processes different materials.  \n- The material changes from red to beige, indicating a switch in the cutting surface or layer during the operation.\n[120-150s] - Cricut machine moves horizontally across a green-bordered mat, cutting a beige material.  \n- A text overlay appears, explaining the card was split due to stock shortage.  \n- The machine's cutting head is positioned above the material, ready for operation.\n[150-180s] - Hands use a blue pen to score lines on a green paper flower, creating creases for folding.  \n- The scored green flower is then folded along the creases to form a three-dimensional shape.  \n- Other pre-folded paper flowers (white, green, red) are arranged on a grid mat in the background.\n[180-210s] - Hands manipulate a green paper flower, adjusting its petals.  \n- Green paper flower is positioned centrally on a grid mat, surrounded by other colored paper flowers.  \n- Other paper flowers (white, red) are arranged in groups to the left and right of the green one.\n[210-240s] - Hands manipulate a green paper flower, adjusting its petals.  \n- White paper flowers are arranged on the left, red ones on the right.  \n- A blue pen is used to mark or trace on a white paper flower.\n[240-270s] - Hands manipulate a white paper flower, adjusting its petals.  \n- Red paper flowers are arranged on a grid mat, with one being traced with a blue pen.  \n- A ring is visible on the left hand, and the right hand holds a pen while tracing.\n[270-300s] - Hands apply glue to a red paper petal, positioning it over a partially assembled flower.  \n- Glue bottle is held near the petal, with text overlay suggesting hot glue as an alternative.  \n- Three completed red paper flowers are visible on the grid mat in the background.\n[300-330s] - Hands manipulate a red paper flower, adjusting its petals.  \n- A glue bottle is brought into view, positioned near the flower for application.  \n- Three completed red paper flowers are arranged on a grid mat in the background.\n[330-360s] - Hands apply glue to the center of a red paper flower, preparing to attach a green leaf.  \n- Green paper leaves are positioned below the red flowers, ready for assembly.  \n- Glue is applied to the base of a green leaf, indicating attachment to a red flower.\n[360-390s] - Hands position three red paper poinsettias with green leaves on a grid mat, adjusting their placement.  \n- A package of \"Metcalf Studios\" gold metallic studs is held, indicating upcoming embellishment.  \n- Scissors are used to cut open the stud package, preparing for application to the poinsettias.\n[390-420s] - Hands position two red paper poinsettias side by side on a grid mat.  \n- White paper poinsettias are arranged in a row, then green paper leaves are added beneath them.  \n- Final arrangement shows four white poinsettias with green leaves, symmetrically placed on the mat.\n[420-450s] - Hands apply glue to a green paper strip, then press it onto a circular wooden frame.  \n- A hanging loop is attached to the top of the wooden frame.  \n- The green paper strip is being wrapped around the frame, starting from the bottom.\n[450-480s] - Hands position a green paper ring over a wooden hoop, aligning them for decoration.  \n- Red and white paper poinsettia flowers are placed around the green ring, starting from the top.  \n- A green paper leaf is added beneath a white flower, completing the initial floral arrangement.", "history_tokens": 1000, "history_utf8_bytes": 4135, "recent_frame_times_s": [472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336, 498.01418333333334, 499.0151833333333, 500.01618333333334, 501.0005], "recent_frames_sha256": "5654d28f13876ecbc2bbc6624ca026ae3223482a01e71e2221f84ff97c97ec60", "num_recent_frames": 30, "tq": 718096.366114604, "t1": 718107.821308526, "ta": 718107.821308526, "te": 718107.866676963, "first_response_s": 11.455193921923637, "answer_total_s": 11.50056235899683, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 59, "content_group": "55098fb5e59797d6b55cb572f70fc92d49447339a3134a36d62831a2aab014e7", "question": {"question_id": "sample_59_a2140_q0", "video_id": 59, "video_path": "./videos/sample_59_real.mp4", "annotation_index": 2140, "question_index": 0, "question": "What is the hand doing right now?", "options": ["A. Cutting the paper.", "B. Displaying some heavy weight cardstock.", "C. Holding a pen.", "D. Arranging flowers."], "answer": "B", "time_stamp_s": 23, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_59_a2140_q0", "video_id": 59, "time_stamp_s": 23, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d4538efccaf5226fc7ccc4c4eb3fa9b2eab4ef0eb303e213390bbfbaa655e73b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0], "recent_frames_sha256": "37df0fb618af38a29a5d163201cd02326060b2724121f86f6974d1b0670f98db", "num_recent_frames": 24, "tq": 710586.527366178, "t1": 710594.013953991, "ta": 710594.013953991, "te": 710594.051128997, "first_response_s": 7.486587813007645, "answer_total_s": 7.52376281900797, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_59_a2140_q0", "video_id": 59, "time_stamp_s": 23, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "47f09a9f2248bb68a2c8b639c21207e4575023f2d371f2f5cb0716bf89597ab1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0], "recent_frames_sha256": "37df0fb618af38a29a5d163201cd02326060b2724121f86f6974d1b0670f98db", "num_recent_frames": 24, "tq": 710639.984061582, "t1": 710641.294178942, "ta": 710641.294178942, "te": 710641.481047162, "first_response_s": 1.3101173599716276, "answer_total_s": 1.4969855799572542, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 59, "content_group": "55098fb5e59797d6b55cb572f70fc92d49447339a3134a36d62831a2aab014e7", "question": {"question_id": "sample_59_a2141_q0", "video_id": 59, "video_path": "./videos/sample_59_real.mp4", "annotation_index": 2141, "question_index": 0, "question": "What action is being performed just now?", "options": ["A. Displaying different material options.", "B. Highlighting the \"On Mat\" option.", "C. Clicking the continue button.", "D. Changing the project type to \"Multiple Ways.\"."], "answer": "C", "time_stamp_s": 83, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_59_a2141_q0", "video_id": 59, "time_stamp_s": 83, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "76a7f96ec59e6bc16abcc23ac922b128816c219903b2e092f98e1d2c35fa4c9b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0], "recent_frames_sha256": "51d945ff7733ed1769e98634b8400fb189838552c23dc3f07f08782b04e05108", "num_recent_frames": 30, "tq": 710594.06944756, "t1": 710602.675086981, "ta": 710602.675086981, "te": 710602.932788287, "first_response_s": 8.60563942103181, "answer_total_s": 8.863340727053583, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_59_a2141_q0", "video_id": 59, "time_stamp_s": 83, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4d87d5d7aaab66a04bda00c776c1b14757ee6920aef10574fe8755c14d11f464", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold two \"Happy Mother's Day\" cake toppers adorned with pink flowers, positioned against a plain background.  \n- A text overlay appears, listing \"Heavy weight cardstock\" as a material used, with various colored cardstocks displayed.  \n- Hands then present two wooden skewers, labeled as \"Wood skewers, acrylic rods or straws,\" for the cake topper assembly.\n[30-60s] - Hands hold three wooden skewers, acrylic rods, or straws against a plain background.  \n- Hands display a bottle of craft glue and a red hot glue gun, labeled \"Craft Glue.\"  \n- Hands show a roll of white foam strips and a foam dot, labeled \"Foam strips and dots,\" followed by a roll of double-sided tape labeled \"Optional: Double sided tape.\"", "history_tokens": 175, "history_utf8_bytes": 725, "recent_frame_times_s": [54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0], "recent_frames_sha256": "51d945ff7733ed1769e98634b8400fb189838552c23dc3f07f08782b04e05108", "num_recent_frames": 30, "tq": 710659.404453239, "t1": 710667.356426825, "ta": 710667.356426825, "te": 710667.63792948, "first_response_s": 7.951973585993983, "answer_total_s": 8.23347624100279, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 59, "content_group": "55098fb5e59797d6b55cb572f70fc92d49447339a3134a36d62831a2aab014e7", "question": {"question_id": "sample_59_a2142_q0", "video_id": 59, "video_path": "./videos/sample_59_real.mp4", "annotation_index": 2142, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Cutting strips of double-sided tape.", "B. Positioning the paper onto the mat.", "C. Sliding the cutting mat into a Cricut cutting machine.", "D. Peeling a strip of tape using scissors."], "answer": "C", "time_stamp_s": 183, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_59_a2142_q0", "video_id": 59, "time_stamp_s": 183, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "63a4e8ccc7d9f9c85fbbca00a3b3dcf118806c6b923923c93935e3df6ea2a5ab", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0], "recent_frames_sha256": "c36c23e8163244161d87a08edd5f610ee1384390e1cfb85350ea52a7ab2d2287", "num_recent_frames": 30, "tq": 710602.951068081, "t1": 710617.062615597, "ta": 710617.062615597, "te": 710617.100178418, "first_response_s": 14.111547516076826, "answer_total_s": 14.14911033702083, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_59_a2142_q0", "video_id": 59, "time_stamp_s": 183, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ea815f13480cee326dba82545b1b8aca0265d518d9e17956103de0f516658a50", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold two \"Happy Mother's Day\" cake toppers adorned with pink flowers, positioned against a plain background.  \n- A text overlay appears, listing \"Heavy weight cardstock\" as a material used, with various colored cardstocks displayed.  \n- Hands then present two wooden skewers, labeled as \"Wood skewers, acrylic rods or straws,\" for the cake topper assembly.\n[30-60s] - Hands hold three wooden skewers, acrylic rods, or straws against a plain background.  \n- Hands display a bottle of craft glue and a red hot glue gun, labeled \"Craft Glue.\"  \n- Hands show a roll of white foam strips and a foam dot, labeled \"Foam strips and dots,\" followed by a roll of double-sided tape labeled \"Optional: Double sided tape.\"\n[60-90s] - User right-clicks on a layered design to ungroup elements, revealing separate components like text and floral shapes.  \n- The interface displays a list of layers on the right, indicating the ungrouping action has separated the design into individual elements.  \n- A pop-up window appears, prompting the user to select which files to import for the project, with options to import all or none.\n[90-120s] - User selects \"Medium Cardstock\" with more pressure for standard cardstock, indicated by a red arrow pointing to the option.\n- User then switches to \"Foil Poster Board\" with more pressure for chrome cardstock, as shown by a new selection in the dropdown menu.\n- The screen displays a list of paper types under \"All Paper Types\" with \"Foil Poster Board\" highlighted in the selection.\n[120-150s] - A white sheet of chrome cardstock is held flat on a gray surface.  \n- Hands use scissors to cut a strip from a roll of double-sided tape.  \n- The tape is positioned near the top edge of the cardstock, preparing for letter attachment.\n[150-180s] - Hands position a white sheet of paper onto a green Cricut mat, aligning it with the mat's grid lines.  \n- The paper is then placed onto a Cricut cutting machine, which is positioned above the mat.  \n- A roll of tape is visible to the left, and scissors are on the right, indicating tools for the crafting process.", "history_tokens": 501, "history_utf8_bytes": 2097, "recent_frame_times_s": [154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0], "recent_frames_sha256": "c36c23e8163244161d87a08edd5f610ee1384390e1cfb85350ea52a7ab2d2287", "num_recent_frames": 30, "tq": 710697.801101761, "t1": 710704.543464276, "ta": 710704.543464276, "te": 710704.583454713, "first_response_s": 6.742362514953129, "answer_total_s": 6.782352951937355, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 59, "content_group": "55098fb5e59797d6b55cb572f70fc92d49447339a3134a36d62831a2aab014e7", "question": {"question_id": "sample_59_a2143_q0", "video_id": 59, "video_path": "./videos/sample_59_real.mp4", "annotation_index": 2143, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Peeling off the protective layer from the foam tape.", "B. Using the white-handled craft scissors to cut the foam tape.", "C. Writing \"Happy Mother's Day\" on a cutout.", "D. Arranging small paper cutouts on the surface."], "answer": "A", "time_stamp_s": 259, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_59_a2143_q0", "video_id": 59, "time_stamp_s": 259, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e13cd8acc2ca1d0326e0c3cf97b75e65ada5f5b9f9dea8b8da5cd97fc8f00d3e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0], "recent_frames_sha256": "ecab78b9f2595c114b00d93a1df823f1e5a37444da8b4373a520ec67ab6a4e8e", "num_recent_frames": 30, "tq": 710617.112527432, "t1": 710628.667230143, "ta": 710628.667230143, "te": 710628.705328576, "first_response_s": 11.554702710942365, "answer_total_s": 11.592801143997349, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_59_a2143_q0", "video_id": 59, "time_stamp_s": 259, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d2e8928f0a23e5599e8c989439f8093ada844ff6f75fb0d38daa12c1eef3cda2", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold two \"Happy Mother's Day\" cake toppers adorned with pink flowers, positioned against a plain background.  \n- A text overlay appears, listing \"Heavy weight cardstock\" as a material used, with various colored cardstocks displayed.  \n- Hands then present two wooden skewers, labeled as \"Wood skewers, acrylic rods or straws,\" for the cake topper assembly.\n[30-60s] - Hands hold three wooden skewers, acrylic rods, or straws against a plain background.  \n- Hands display a bottle of craft glue and a red hot glue gun, labeled \"Craft Glue.\"  \n- Hands show a roll of white foam strips and a foam dot, labeled \"Foam strips and dots,\" followed by a roll of double-sided tape labeled \"Optional: Double sided tape.\"\n[60-90s] - User right-clicks on a layered design to ungroup elements, revealing separate components like text and floral shapes.  \n- The interface displays a list of layers on the right, indicating the ungrouping action has separated the design into individual elements.  \n- A pop-up window appears, prompting the user to select which files to import for the project, with options to import all or none.\n[90-120s] - User selects \"Medium Cardstock\" with more pressure for standard cardstock, indicated by a red arrow pointing to the option.\n- User then switches to \"Foil Poster Board\" with more pressure for chrome cardstock, as shown by a new selection in the dropdown menu.\n- The screen displays a list of paper types under \"All Paper Types\" with \"Foil Poster Board\" highlighted in the selection.\n[120-150s] - A white sheet of chrome cardstock is held flat on a gray surface.  \n- Hands use scissors to cut a strip from a roll of double-sided tape.  \n- The tape is positioned near the top edge of the cardstock, preparing for letter attachment.\n[150-180s] - Hands position a white sheet of paper onto a green Cricut mat, aligning it with the mat's grid lines.  \n- The paper is then placed onto a Cricut cutting machine, which is positioned above the mat.  \n- A roll of tape is visible to the left, and scissors are on the right, indicating tools for the crafting process.\n[180-210s] - A hand holds a bottle of glue labeled \"Glue Stick\" near cut-out paper pieces.  \n- Cut-out paper elements, including floral designs and text, are arranged on a flat surface.  \n- A hand moves a large gold-colored paper cutout, revealing its shape and design.\n[210-240s] - Hands apply glue to a gold paper cutout, positioning it over another piece.  \n- A roll of foam tape is introduced, labeled for 3D effect, and prepared for use.  \n- Cutout pieces are arranged on a flat surface, with decorative elements nearby.", "history_tokens": 636, "history_utf8_bytes": 2623, "recent_frame_times_s": [230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0], "recent_frames_sha256": "ecab78b9f2595c114b00d93a1df823f1e5a37444da8b4373a520ec67ab6a4e8e", "num_recent_frames": 30, "tq": 710718.702834358, "t1": 710719.699960262, "ta": 710719.699960262, "te": 710720.071405716, "first_response_s": 0.9971259040758014, "answer_total_s": 1.3685713580343872, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 59, "content_group": "55098fb5e59797d6b55cb572f70fc92d49447339a3134a36d62831a2aab014e7", "question": {"question_id": "sample_59_a2144_q0", "video_id": 59, "video_path": "./videos/sample_59_real.mp4", "annotation_index": 2144, "question_index": 0, "question": "What are the hands doing right now?", "options": ["A. Placing a new cutout on the surface.", "B. Adding more circular sequins.", "C. Making final adjustments to the placed flowers.", "D. Writing \"Happy Mother's Day\" on the cutout."], "answer": "C", "time_stamp_s": 341, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_59_a2144_q0", "video_id": 59, "time_stamp_s": 341, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0163677856cb3283f47384ba6a32a85d7f96e23003bcb69eb8f9d5a462270faf", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0], "recent_frames_sha256": "4b79629cbe6fcdd0e3ca4335c61c9147da20934900eac432d9c99a0830e875c9", "num_recent_frames": 30, "tq": 710628.723863187, "t1": 710639.937519071, "ta": 710639.937519071, "te": 710639.976036738, "first_response_s": 11.213655884028412, "answer_total_s": 11.252173551009037, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_59_a2144_q0", "video_id": 59, "time_stamp_s": 341, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "08cbc10806e4ea9d4a0be1f226b9b7b5e087fde01b4f05d8258f3f3115950481", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold two \"Happy Mother's Day\" cake toppers adorned with pink flowers, positioned against a plain background.  \n- A text overlay appears, listing \"Heavy weight cardstock\" as a material used, with various colored cardstocks displayed.  \n- Hands then present two wooden skewers, labeled as \"Wood skewers, acrylic rods or straws,\" for the cake topper assembly.\n[30-60s] - Hands hold three wooden skewers, acrylic rods, or straws against a plain background.  \n- Hands display a bottle of craft glue and a red hot glue gun, labeled \"Craft Glue.\"  \n- Hands show a roll of white foam strips and a foam dot, labeled \"Foam strips and dots,\" followed by a roll of double-sided tape labeled \"Optional: Double sided tape.\"\n[60-90s] - User right-clicks on a layered design to ungroup elements, revealing separate components like text and floral shapes.  \n- The interface displays a list of layers on the right, indicating the ungrouping action has separated the design into individual elements.  \n- A pop-up window appears, prompting the user to select which files to import for the project, with options to import all or none.\n[90-120s] - User selects \"Medium Cardstock\" with more pressure for standard cardstock, indicated by a red arrow pointing to the option.\n- User then switches to \"Foil Poster Board\" with more pressure for chrome cardstock, as shown by a new selection in the dropdown menu.\n- The screen displays a list of paper types under \"All Paper Types\" with \"Foil Poster Board\" highlighted in the selection.\n[120-150s] - A white sheet of chrome cardstock is held flat on a gray surface.  \n- Hands use scissors to cut a strip from a roll of double-sided tape.  \n- The tape is positioned near the top edge of the cardstock, preparing for letter attachment.\n[150-180s] - Hands position a white sheet of paper onto a green Cricut mat, aligning it with the mat's grid lines.  \n- The paper is then placed onto a Cricut cutting machine, which is positioned above the mat.  \n- A roll of tape is visible to the left, and scissors are on the right, indicating tools for the crafting process.\n[180-210s] - A hand holds a bottle of glue labeled \"Glue Stick\" near cut-out paper pieces.  \n- Cut-out paper elements, including floral designs and text, are arranged on a flat surface.  \n- A hand moves a large gold-colored paper cutout, revealing its shape and design.\n[210-240s] - Hands apply glue to a gold paper cutout, positioning it over another piece.  \n- A roll of foam tape is introduced, labeled for 3D effect, and prepared for use.  \n- Cutout pieces are arranged on a flat surface, with decorative elements nearby.\n[240-270s] - Hands hold and align two golden die-cut pieces, preparing to assemble them.  \n- A roll of white adhesive tape is introduced, positioned near the die-cut pieces.  \n- The die-cut pieces are brought together, suggesting an assembly step in a crafting project.\n[270-300s] - Hands position and align \"Happy Mother's Day\" die-cut letters on a flat surface.  \n- A white marker is used to trace or outline the letters, indicating preparation for coloring or detailing.  \n- Decorative elements like pink clouds and brown circles are scattered nearby, suggesting upcoming embellishment.\n[300-330s] - Hands hold a white perforated sheet labeled \"Foam dots\" and peel off a dot.  \n- A \"Happy Mother's Day\" die-cut piece is positioned over a larger gold die-cut background.  \n- Small pink and brown foam dots are arranged near the right side of the assembled card.", "history_tokens": 840, "history_utf8_bytes": 3487, "recent_frame_times_s": [312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0], "recent_frames_sha256": "4b79629cbe6fcdd0e3ca4335c61c9147da20934900eac432d9c99a0830e875c9", "num_recent_frames": 30, "tq": 710748.590454782, "t1": 710755.225679432, "ta": 710755.225679432, "te": 710755.430330491, "first_response_s": 6.635224650031887, "answer_total_s": 6.83987570903264, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 60, "content_group": "f7fbfb1a0d7a73f3d0afd7b5aa59f042ecd81c45e0354e8eb228788466b7340b", "question": {"question_id": "sample_60_a566_q0", "video_id": 60, "video_path": "./videos/sample_60_real.mp4", "annotation_index": 566, "question_index": 0, "question": "What phrase appears right now?", "options": ["A. \"Links to the materials I used are in the video description.\".", "B. \"Merry Christmas and Happy New Year.\".", "C. \"Alcohol Ink Ornaments.\".", "D. \"Handmade Ornaments by Design.\"."], "answer": "C", "time_stamp_s": 14, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_60_a566_q0", "video_id": 60, "time_stamp_s": 14, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2f727a4078183a522995282f811ced83b93b77baaebc59b6443ad4b4f7a29b89", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0], "recent_frames_sha256": "ac3e21a05d60653fda83c0da0518175b709532c6ccf958aeb7f68def9dc02c33", "num_recent_frames": 15, "tq": 715206.335071724, "t1": 715217.222261554, "ta": 715217.222261554, "te": 715217.266714214, "first_response_s": 10.887189829954877, "answer_total_s": 10.931642489973456, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_60_a566_q0", "video_id": 60, "time_stamp_s": 14, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1ab99a594d817a8817c581ce1f5a1696464348cb9167b72be973de73bad8b93d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0], "recent_frames_sha256": "ac3e21a05d60653fda83c0da0518175b709532c6ccf958aeb7f68def9dc02c33", "num_recent_frames": 15, "tq": 715261.13123071, "t1": 715266.898204004, "ta": 715266.898204004, "te": 715267.177435023, "first_response_s": 5.766973294084892, "answer_total_s": 6.0462043130537495, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 60, "content_group": "f7fbfb1a0d7a73f3d0afd7b5aa59f042ecd81c45e0354e8eb228788466b7340b", "question": {"question_id": "sample_60_a567_q0", "video_id": 60, "video_path": "./videos/sample_60_real.mp4", "annotation_index": 567, "question_index": 0, "question": "What are the gloved hands doing just now?", "options": ["A. Cutting the ornament into pieces.", "B. Dispensing fluid into the ornament.", "C. Painting the ornament.", "D. Measuring the ornament with a ruler."], "answer": "B", "time_stamp_s": 139, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_60_a567_q0", "video_id": 60, "time_stamp_s": 139, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1a0d03173c333e4818373246d973aa981aabfd161a4691e94a5a87a9384fe322", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0], "recent_frames_sha256": "45d29de4e1b8fbc64170f7c665632c2db614a79456f5a5247cbc1c1a1c56b4d9", "num_recent_frames": 30, "tq": 715217.284064669, "t1": 715224.747961907, "ta": 715224.747961907, "te": 715224.785131959, "first_response_s": 7.4638972379034385, "answer_total_s": 7.501067289966159, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_60_a567_q0", "video_id": 60, "time_stamp_s": 139, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "187936b931f261460b4a35844c8b5f2c29457d2806c82f7f159788918f6e5855", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands in black gloves hold a can of Cabotlane Clear, preparing to open it.  \n- A clear plastic cup is placed on a white paper towel surface, ready to receive the liquid.  \n- The can is opened, and a metal spoon is used to scoop out the clear liquid into the cup.\n[30-60s] - Gloved hands use a syringe to slowly inject liquid into a clear glass bauble, with a text overlay indicating \"30ml\" for this size.  \n- The bauble is held steady while the syringe is inserted into its opening, and liquid is carefully dispensed.  \n- A small clear cup is positioned nearby, possibly for waste or overflow, while the bauble remains upright on a white textured surface.\n[60-90s] - A gloved hand holds a clear spherical container, which is being filled with a white liquid from a syringe.  \n- The syringe is inserted into the container's opening, and liquid is slowly injected, causing the sphere to expand.  \n- A small cup is positioned nearby, likely for waste or additional liquid, while the container rests on a white textured surface.\n[90-120s] - Gloved hands hold a translucent blue sphere over a gold-rimmed pot, with a clear cup nearby.  \n- The sphere is tilted to pour excess liquid back into the pot, ensuring full coverage.  \n- The sphere is then inverted to drain liquid from its top into the pot, with a text overlay indicating drainage duration.", "history_tokens": 323, "history_utf8_bytes": 1354, "recent_frame_times_s": [110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0], "recent_frames_sha256": "45d29de4e1b8fbc64170f7c665632c2db614a79456f5a5247cbc1c1a1c56b4d9", "num_recent_frames": 30, "tq": 715301.743429187, "t1": 715308.157793478, "ta": 715308.157793478, "te": 715308.364600173, "first_response_s": 6.414364291005768, "answer_total_s": 6.621170985978097, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 60, "content_group": "f7fbfb1a0d7a73f3d0afd7b5aa59f042ecd81c45e0354e8eb228788466b7340b", "question": {"question_id": "sample_60_a568_q0", "video_id": 60, "video_path": "./videos/sample_60_real.mp4", "annotation_index": 568, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Holding a clear round ornament with golden streaks.", "B. Applying additional golden ink to the ornament.", "C. Mixing purple and blue ink in a container.", "D. Holding an empty transparent container in their right hand."], "answer": "B", "time_stamp_s": 259, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_60_a568_q0", "video_id": 60, "time_stamp_s": 259, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0d2c645b7ea5534399be6084420729af152131f0cca1f0b31d32494f2c608872", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0], "recent_frames_sha256": "d90669409aaeb201aeec179629e3db3b536afa64b82de61c0b7bbbacf13ffea6", "num_recent_frames": 30, "tq": 715224.799857355, "t1": 715236.436739087, "ta": 715236.436739087, "te": 715236.474735733, "first_response_s": 11.636881732032634, "answer_total_s": 11.67487837804947, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_60_a568_q0", "video_id": 60, "time_stamp_s": 259, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "75b01a93a6b9bd5e56d9d0adfb487667aa88696516571afd7b1e2bf4db77fbf8", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands in black gloves hold a can of Cabotlane Clear, preparing to open it.  \n- A clear plastic cup is placed on a white paper towel surface, ready to receive the liquid.  \n- The can is opened, and a metal spoon is used to scoop out the clear liquid into the cup.\n[30-60s] - Gloved hands use a syringe to slowly inject liquid into a clear glass bauble, with a text overlay indicating \"30ml\" for this size.  \n- The bauble is held steady while the syringe is inserted into its opening, and liquid is carefully dispensed.  \n- A small clear cup is positioned nearby, possibly for waste or overflow, while the bauble remains upright on a white textured surface.\n[60-90s] - A gloved hand holds a clear spherical container, which is being filled with a white liquid from a syringe.  \n- The syringe is inserted into the container's opening, and liquid is slowly injected, causing the sphere to expand.  \n- A small cup is positioned nearby, likely for waste or additional liquid, while the container rests on a white textured surface.\n[90-120s] - Gloved hands hold a translucent blue sphere over a gold-rimmed pot, with a clear cup nearby.  \n- The sphere is tilted to pour excess liquid back into the pot, ensuring full coverage.  \n- The sphere is then inverted to drain liquid from its top into the pot, with a text overlay indicating drainage duration.\n[120-150s] - A gloved hand holds a syringe filled with a white substance, positioning it over a gold-rimmed container.  \n- The syringe is used to dispense the white substance into the container, which is placed on a white textured surface.  \n- A clear glass dome is held by the other gloved hand, positioned above the container, ready to be filled or sealed.\n[150-180s] - A gloved hand holds a translucent, spherical object with a blue tint, rotating it slowly to show its surface.  \n- The object is positioned above a clear plastic cup resting on a gold-rimmed container.  \n- The hand adjusts the object’s orientation, revealing a small opening or cap on its side.\n[180-210s] - Gloved hands hold a clear plastic sphere, tilting it to pour liquid from a purple bottle into the sphere.  \n- The sphere gradually fills with pink and purple liquid, creating a swirling pattern.  \n- A small white cup and two other bottles (blue and gold) are visible on the white textured surface nearby.\n[210-240s] - Hands in black gloves hold a translucent, swirling pink and blue sphere while applying liquid from a blue-tipped bottle.  \n- A small white cup and two capped bottles (one gold, one purple) are positioned on a white paper towel to the right.  \n- The sphere is rotated slightly as liquid is dispensed, causing color patterns to shift and blend within its interior.", "history_tokens": 646, "history_utf8_bytes": 2716, "recent_frame_times_s": [230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0], "recent_frames_sha256": "d90669409aaeb201aeec179629e3db3b536afa64b82de61c0b7bbbacf13ffea6", "num_recent_frames": 30, "tq": 715331.246492002, "t1": 715333.732495421, "ta": 715333.732495421, "te": 715333.939663923, "first_response_s": 2.486003418918699, "answer_total_s": 2.6931719209533185, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 60, "content_group": "f7fbfb1a0d7a73f3d0afd7b5aa59f042ecd81c45e0354e8eb228788466b7340b", "question": {"question_id": "sample_60_a569_q0", "video_id": 60, "video_path": "./videos/sample_60_real.mp4", "annotation_index": 569, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Applying a clear coat to the ornament.", "B. Inspecting the ornament for any areas that might need further enhancement.", "C. Holding the bauble unpainted.", "D. Removing paint from the mat."], "answer": "B", "time_stamp_s": 379, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_60_a569_q0", "video_id": 60, "time_stamp_s": 379, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "02499b1906004f6056b56e025d31213593d01399c6167065c1c9b6f390419fa3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0], "recent_frames_sha256": "267a576b84949122df335e3525d19c018e3f3f13711011ed25008ef9607bf576", "num_recent_frames": 30, "tq": 715236.487471268, "t1": 715248.094340173, "ta": 715248.094340173, "te": 715248.13349058, "first_response_s": 11.606868904898874, "answer_total_s": 11.646019311971031, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_60_a569_q0", "video_id": 60, "time_stamp_s": 379, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "cc0ee33f73136d22c648c18b0a948078d765c78d6afc09aef3b06eca8b879c1e", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands in black gloves hold a can of Cabotlane Clear, preparing to open it.  \n- A clear plastic cup is placed on a white paper towel surface, ready to receive the liquid.  \n- The can is opened, and a metal spoon is used to scoop out the clear liquid into the cup.\n[30-60s] - Gloved hands use a syringe to slowly inject liquid into a clear glass bauble, with a text overlay indicating \"30ml\" for this size.  \n- The bauble is held steady while the syringe is inserted into its opening, and liquid is carefully dispensed.  \n- A small clear cup is positioned nearby, possibly for waste or overflow, while the bauble remains upright on a white textured surface.\n[60-90s] - A gloved hand holds a clear spherical container, which is being filled with a white liquid from a syringe.  \n- The syringe is inserted into the container's opening, and liquid is slowly injected, causing the sphere to expand.  \n- A small cup is positioned nearby, likely for waste or additional liquid, while the container rests on a white textured surface.\n[90-120s] - Gloved hands hold a translucent blue sphere over a gold-rimmed pot, with a clear cup nearby.  \n- The sphere is tilted to pour excess liquid back into the pot, ensuring full coverage.  \n- The sphere is then inverted to drain liquid from its top into the pot, with a text overlay indicating drainage duration.\n[120-150s] - A gloved hand holds a syringe filled with a white substance, positioning it over a gold-rimmed container.  \n- The syringe is used to dispense the white substance into the container, which is placed on a white textured surface.  \n- A clear glass dome is held by the other gloved hand, positioned above the container, ready to be filled or sealed.\n[150-180s] - A gloved hand holds a translucent, spherical object with a blue tint, rotating it slowly to show its surface.  \n- The object is positioned above a clear plastic cup resting on a gold-rimmed container.  \n- The hand adjusts the object’s orientation, revealing a small opening or cap on its side.\n[180-210s] - Gloved hands hold a clear plastic sphere, tilting it to pour liquid from a purple bottle into the sphere.  \n- The sphere gradually fills with pink and purple liquid, creating a swirling pattern.  \n- A small white cup and two other bottles (blue and gold) are visible on the white textured surface nearby.\n[210-240s] - Hands in black gloves hold a translucent, swirling pink and blue sphere while applying liquid from a blue-tipped bottle.  \n- A small white cup and two capped bottles (one gold, one purple) are positioned on a white paper towel to the right.  \n- The sphere is rotated slightly as liquid is dispensed, causing color patterns to shift and blend within its interior.\n[240-270s] - Hands in black gloves hold a colorful, translucent sphere while applying purple paint from a small bottle.  \n- A white paper towel lies beneath the sphere, with two additional paint bottles (blue and beige) and a small white cup nearby.  \n- The sphere’s surface shows swirling patterns of blue, purple, and pink, with paint being applied to enhance its design.\n[270-300s] - Gloved hands apply purple liquid from a small bottle onto a colorful, translucent sphere.  \n- The sphere rests on a white paper towel, with other small bottles and a cup nearby.  \n- The sphere’s surface shows swirling patterns of blue, pink, and gold as the liquid is applied.\n[300-330s] - Hands in black gloves hold a glitter-filled bottle, labeled \"fine white glitter,\" and unscrew its cap.  \n- The bottle is tilted, revealing swirling purple, pink, and gold glitter inside.  \n- A white paper towel is used to wipe the bottle’s surface after it’s opened.\n[330-360s] - Gloved hands hold a decorated glass sphere, rotating it to display its colorful, glittery surface.  \n- A clear plastic cup and glue bottle are positioned nearby on a white textured surface.  \n- The sphere is then filled with blue liquid from a small bottle, causing the color to swirl inside.", "history_tokens": 941, "history_utf8_bytes": 3974, "recent_frame_times_s": [350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0], "recent_frames_sha256": "267a576b84949122df335e3525d19c018e3f3f13711011ed25008ef9607bf576", "num_recent_frames": 30, "tq": 715364.588110918, "t1": 715370.45506939, "ta": 715370.45506939, "te": 715370.643393659, "first_response_s": 5.866958472062834, "answer_total_s": 6.0552827410865575, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 60, "content_group": "f7fbfb1a0d7a73f3d0afd7b5aa59f042ecd81c45e0354e8eb228788466b7340b", "question": {"question_id": "sample_60_a570_q0", "video_id": 60, "video_path": "./videos/sample_60_real.mp4", "annotation_index": 570, "question_index": 0, "question": "What is the person using right now?", "options": ["A. A pair of scissors.", "B. A white tool labeled 'cricut'.", "C. A ruler.", "D. A pen."], "answer": "B", "time_stamp_s": 480, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_60_a570_q0", "video_id": 60, "time_stamp_s": 480, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "aa5f9fe2294c5e6a1b9e45b3102b9aefac4465bc13666a72057c781cc747d9c1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [451.0, 452.0, 453.0, 454.0, 455.0, 456.0, 457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0], "recent_frames_sha256": "f7b6ff42c41fb0618be243025a889947cc05e2ba4d86caa7064c64e2dad527e7", "num_recent_frames": 30, "tq": 715248.144807927, "t1": 715261.07844818, "ta": 715261.07844818, "te": 715261.118916999, "first_response_s": 12.933640253031626, "answer_total_s": 12.974109072005376, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_60_a570_q0", "video_id": 60, "time_stamp_s": 480, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "181636032a11dcf4bdfe78d1193373042d217dfc28208bd0bc03b9c3591ca651", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Gloved hands hold a translucent blue sphere over a gold-rimmed pot, with a clear cup nearby.  \n- The sphere is tilted to pour excess liquid back into the pot, ensuring full coverage.  \n- The sphere is then inverted to drain liquid from its top into the pot, with a text overlay indicating drainage duration.\n[120-150s] - A gloved hand holds a syringe filled with a white substance, positioning it over a gold-rimmed container.  \n- The syringe is used to dispense the white substance into the container, which is placed on a white textured surface.  \n- A clear glass dome is held by the other gloved hand, positioned above the container, ready to be filled or sealed.\n[150-180s] - A gloved hand holds a translucent, spherical object with a blue tint, rotating it slowly to show its surface.  \n- The object is positioned above a clear plastic cup resting on a gold-rimmed container.  \n- The hand adjusts the object’s orientation, revealing a small opening or cap on its side.\n[180-210s] - Gloved hands hold a clear plastic sphere, tilting it to pour liquid from a purple bottle into the sphere.  \n- The sphere gradually fills with pink and purple liquid, creating a swirling pattern.  \n- A small white cup and two other bottles (blue and gold) are visible on the white textured surface nearby.\n[210-240s] - Hands in black gloves hold a translucent, swirling pink and blue sphere while applying liquid from a blue-tipped bottle.  \n- A small white cup and two capped bottles (one gold, one purple) are positioned on a white paper towel to the right.  \n- The sphere is rotated slightly as liquid is dispensed, causing color patterns to shift and blend within its interior.\n[240-270s] - Hands in black gloves hold a colorful, translucent sphere while applying purple paint from a small bottle.  \n- A white paper towel lies beneath the sphere, with two additional paint bottles (blue and beige) and a small white cup nearby.  \n- The sphere’s surface shows swirling patterns of blue, purple, and pink, with paint being applied to enhance its design.\n[270-300s] - Gloved hands apply purple liquid from a small bottle onto a colorful, translucent sphere.  \n- The sphere rests on a white paper towel, with other small bottles and a cup nearby.  \n- The sphere’s surface shows swirling patterns of blue, pink, and gold as the liquid is applied.\n[300-330s] - Hands in black gloves hold a glitter-filled bottle, labeled \"fine white glitter,\" and unscrew its cap.  \n- The bottle is tilted, revealing swirling purple, pink, and gold glitter inside.  \n- A white paper towel is used to wipe the bottle’s surface after it’s opened.\n[330-360s] - Gloved hands hold a decorated glass sphere, rotating it to display its colorful, glittery surface.  \n- A clear plastic cup and glue bottle are positioned nearby on a white textured surface.  \n- The sphere is then filled with blue liquid from a small bottle, causing the color to swirl inside.\n[360-390s] - Hands in black gloves apply a liquid from a small bottle onto a blue and gold glass sphere.  \n- The sphere is rotated to evenly distribute the liquid across its surface.  \n- After application, the sphere is placed on a white paper towel to dry.\n[390-420s] - A gloved hand holds a blue and gold glass sphere while another gloved hand uses a blue-capped tube to apply a substance to its surface.  \n- The sphere is then wiped with a white paper towel, revealing a glossy finish.  \n- A second, similarly decorated sphere (pink and purple) is introduced, held side-by-side with the first.\n[420-450s] - A blue and white Cricut machine is positioned above a green cutting mat on a grid surface.  \n- Hands place white vinyl sheets onto the mat, preparing them for cutting.  \n- The machine's cutting blade is visible, poised to cut the vinyl sheets.\n[450-480s] - A person uses a white pen to draw a line on a white paper sheet.  \n- The paper is folded, revealing a green cutting mat underneath.  \n- The person holds the paper with both hands, preparing for further manipulation.", "history_tokens": 960, "history_utf8_bytes": 4022, "recent_frame_times_s": [451.0, 452.0, 453.0, 454.0, 455.0, 456.0, 457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0], "recent_frames_sha256": "f7b6ff42c41fb0618be243025a889947cc05e2ba4d86caa7064c64e2dad527e7", "num_recent_frames": 30, "tq": 715397.551609988, "t1": 715404.907398866, "ta": 715404.907398866, "te": 715405.185817151, "first_response_s": 7.35578887804877, "answer_total_s": 7.634207163006067, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 61, "content_group": "02bc44272f6351d1f630f0dcb8e84398ce4b46792f1911c8983f3492b5e5f083", "question": {"question_id": "sample_61_a1640_q0", "video_id": 61, "video_path": "./videos/sample_61_real.mp4", "annotation_index": 1640, "question_index": 0, "question": "What is being shown right now?", "options": ["A. A collection of colorful notebooks.", "B. Personalized agate coasters with names on them.", "C. A stack of books with gilded edges.", "D. A digital workspace interface."], "answer": "B", "time_stamp_s": 5, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_61_a1640_q0", "video_id": 61, "time_stamp_s": 5, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "308fdb3bf5af57ed2ef7e81953f782da9696f250f802befebdb81b3f02fc9f5b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004], "recent_frames_sha256": "b19b1f150a40df8e069378dd9a398556cc59a81c5a3e0b290a2c0d9bf5dd9317", "num_recent_frames": 5, "tq": 718298.982763583, "t1": 718300.097115546, "ta": 718300.097115546, "te": 718300.137629983, "first_response_s": 1.1143519630422816, "answer_total_s": 1.1548664000583813, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_61_a1640_q0", "video_id": 61, "time_stamp_s": 5, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9cfec846b5f9d6dd1f59328214927ff71378972ebbe895d7f80d40bcdb29ad93", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004], "recent_frames_sha256": "b19b1f150a40df8e069378dd9a398556cc59a81c5a3e0b290a2c0d9bf5dd9317", "num_recent_frames": 5, "tq": 718159.820310575, "t1": 718171.725021004, "ta": 718171.725021004, "te": 718171.951945163, "first_response_s": 11.904710429022089, "answer_total_s": 12.13163458800409, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 61, "content_group": "02bc44272f6351d1f630f0dcb8e84398ce4b46792f1911c8983f3492b5e5f083", "question": {"question_id": "sample_61_a1641_q0", "video_id": 61, "video_path": "./videos/sample_61_real.mp4", "annotation_index": 1641, "question_index": 0, "question": "What is the cursor doing right now?", "options": ["A. Pasting the name \"Brad\".", "B. Highlighting the name \"Emily\".", "C. Dragging \"Melissa\" upward.", "D. Right-clicking on the pink square."], "answer": "C", "time_stamp_s": 114, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_61_a1641_q0", "video_id": 61, "time_stamp_s": 114, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4c6bd108bf1f4d43f7f53fb741a3bdf130090f59bb6bd676f7385dd3dce50c2c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129], "recent_frames_sha256": "3892d78d5dfbb8386aa54e17ab943561a8fe5a9b493cc1f3c6accbd0c6bb008c", "num_recent_frames": 30, "tq": 718300.166018123, "t1": 718314.777912527, "ta": 718314.777912527, "te": 718314.817485175, "first_response_s": 14.611894403933547, "answer_total_s": 14.651467051939107, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_61_a1641_q0", "video_id": 61, "time_stamp_s": 114, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "97ff0c18604381eddd1d4323c6bcaa06433bb573796ab06342838a83628f4dc5", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Agate coasters with gold-embossed names (Melissa, Emily, Brad, Thomas) are displayed on a grid-patterned surface.  \n- A digital design interface opens, showing a blank canvas with a toolbar for selecting shapes and tools.  \n- A black square shape is dragged onto the canvas, positioned centrally with resize handles visible.\n[30-60s] - A black square is selected and its fill color is changed to pink via the color picker.  \n- The text \"Thomas\" is typed and positioned over the pink square, with its font style adjusted to a cursive script.  \n- The text \"Thomas\" is then resized and repositioned to appear centered over the pink square.\n[60-90s] - The text \"Thomas\" is selected and duplicated, appearing as a second instance of the same word.  \n- The duplicated \"Thomas\" is positioned slightly above and to the right of the original, creating a layered effect.  \n- The user then selects the \"Brad\" text, which is positioned below the duplicated \"Thomas,\" indicating a new text element is being added or adjusted.", "history_tokens": 238, "history_utf8_bytes": 1022, "recent_frame_times_s": [84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129], "recent_frames_sha256": "3892d78d5dfbb8386aa54e17ab943561a8fe5a9b493cc1f3c6accbd0c6bb008c", "num_recent_frames": 30, "tq": 718202.734736941, "t1": 718210.288159411, "ta": 718210.288159411, "te": 718210.329516989, "first_response_s": 7.553422469994985, "answer_total_s": 7.594780047889799, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 61, "content_group": "02bc44272f6351d1f630f0dcb8e84398ce4b46792f1911c8983f3492b5e5f083", "question": {"question_id": "sample_61_a1642_q0", "video_id": 61, "video_path": "./videos/sample_61_real.mp4", "annotation_index": 1642, "question_index": 0, "question": "What is the cursor doing just now?", "options": ["A. Highlighting the word \"Thomas\".", "B. Adjusting the placement of \"Brad\".", "C. Interacting with the word \"Melissa\".", "D. Making changes to the word \"Emily\"."], "answer": "B", "time_stamp_s": 210, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_61_a1642_q0", "video_id": 61, "time_stamp_s": 210, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2f5d028d9b630180f921b7ba12f78944901d76eaf985eafe6e7cae6a87587a31", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088], "recent_frames_sha256": "67a2b5faa045bafa1d23ef7dda2af6b3ecb83258e4b54f258be68aa64d497f86", "num_recent_frames": 30, "tq": 718314.839177489, "t1": 718326.750269897, "ta": 718326.750269897, "te": 718326.791026949, "first_response_s": 11.911092408001423, "answer_total_s": 11.951849459903315, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_61_a1642_q0", "video_id": 61, "time_stamp_s": 210, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1ee3edf6453220d1078f41a931acb8c811143e7d2d520c27af722b53cc1f8ee4", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Agate coasters with gold-embossed names (Melissa, Emily, Brad, Thomas) are displayed on a grid-patterned surface.  \n- A digital design interface opens, showing a blank canvas with a toolbar for selecting shapes and tools.  \n- A black square shape is dragged onto the canvas, positioned centrally with resize handles visible.\n[30-60s] - A black square is selected and its fill color is changed to pink via the color picker.  \n- The text \"Thomas\" is typed and positioned over the pink square, with its font style adjusted to a cursive script.  \n- The text \"Thomas\" is then resized and repositioned to appear centered over the pink square.\n[60-90s] - The text \"Thomas\" is selected and duplicated, appearing as a second instance of the same word.  \n- The duplicated \"Thomas\" is positioned slightly above and to the right of the original, creating a layered effect.  \n- The user then selects the \"Brad\" text, which is positioned below the duplicated \"Thomas,\" indicating a new text element is being added or adjusted.\n[90-120s] - A pink rectangle is positioned on the left side of the screen, with text \"Thomas\" and \"Brad\" appearing to its right.\n- The text \"Emily\" is added below the pink rectangle, followed by \"Melissa\" appearing above \"Emily\" and to the left of \"Thomas.\"\n- The text \"Emily\" and \"Melissa\" are adjusted in position, with \"Melissa\" moving slightly to the left and \"Emily\" remaining below the pink rectangle.\n[120-150s] - \"Emily\" text is selected and resized, appearing smaller than the original \"Emily\" text.  \n- \"Emily\" text is moved slightly to the right and downward relative to its initial position.  \n- \"Emily\" text is duplicated, creating a second instance that is positioned below the first.\n[150-180s] - The text \"Thomas\" is selected and resized, with its bounding box visible around it.  \n- The \"T\" letter is highlighted and appears to be being manipulated or adjusted.  \n- The \"Emily\" text remains unchanged and is positioned to the left of the \"Thomas\" text.\n[180-210s] - The \"Melissa Brad\" text is positioned to the left of the \"Thomas Emily\" text, with \"Brad\" below \"Melissa\" and \"Emily\" below \"Thomas\".\n- A pink rectangular shape is placed over \"Melissa Brad\", partially obscuring the text.\n- The user selects the \"Move\" option from the context menu, indicating an intention to reposition the pink rectangle.", "history_tokens": 573, "history_utf8_bytes": 2345, "recent_frame_times_s": [180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088], "recent_frames_sha256": "67a2b5faa045bafa1d23ef7dda2af6b3ecb83258e4b54f258be68aa64d497f86", "num_recent_frames": 30, "tq": 718237.629712067, "t1": 718238.863989258, "ta": 718238.863989258, "te": 718239.057082017, "first_response_s": 1.2342771909898147, "answer_total_s": 1.4273699499899521, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 61, "content_group": "02bc44272f6351d1f630f0dcb8e84398ce4b46792f1911c8983f3492b5e5f083", "question": {"question_id": "sample_61_a1643_q0", "video_id": 61, "video_path": "./videos/sample_61_real.mp4", "annotation_index": 1643, "question_index": 0, "question": "What is the hand doing right now?", "options": ["A. Cutting another piece of gold foil.", "B. Pressing down on the gold foil.", "C. Folding the \"Cricut\" sheet.", "D. Peeling back the \"Cricut\" sheet."], "answer": "D", "time_stamp_s": 317, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_61_a1643_q0", "video_id": 61, "time_stamp_s": 317, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c9d256214a9c4c0a264f4eafe82189df85a539c444c921d6881ea639850d18e5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [287.0033833333333, 288.00438333333335, 289.0053833333333, 290.00638333333336, 291.00738333333334, 292.0083833333333, 293.00938333333335, 294.0103833333333, 295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333, 300.01638333333335, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157], "recent_frames_sha256": "7975c0d084cc9e43091b829786b505009b37e12b853f8d0b5004cb7e1b6501da", "num_recent_frames": 30, "tq": 718326.808901295, "t1": 718334.707208479, "ta": 718334.707208479, "te": 718334.746334539, "first_response_s": 7.89830718410667, "answer_total_s": 7.93743324407842, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_61_a1643_q0", "video_id": 61, "time_stamp_s": 317, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d56cbc2c73b698f8794c367f5c9fdb244b242bfa917507d616156da96e0a7bf0", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Agate coasters with gold-embossed names (Melissa, Emily, Brad, Thomas) are displayed on a grid-patterned surface.  \n- A digital design interface opens, showing a blank canvas with a toolbar for selecting shapes and tools.  \n- A black square shape is dragged onto the canvas, positioned centrally with resize handles visible.\n[30-60s] - A black square is selected and its fill color is changed to pink via the color picker.  \n- The text \"Thomas\" is typed and positioned over the pink square, with its font style adjusted to a cursive script.  \n- The text \"Thomas\" is then resized and repositioned to appear centered over the pink square.\n[60-90s] - The text \"Thomas\" is selected and duplicated, appearing as a second instance of the same word.  \n- The duplicated \"Thomas\" is positioned slightly above and to the right of the original, creating a layered effect.  \n- The user then selects the \"Brad\" text, which is positioned below the duplicated \"Thomas,\" indicating a new text element is being added or adjusted.\n[90-120s] - A pink rectangle is positioned on the left side of the screen, with text \"Thomas\" and \"Brad\" appearing to its right.\n- The text \"Emily\" is added below the pink rectangle, followed by \"Melissa\" appearing above \"Emily\" and to the left of \"Thomas.\"\n- The text \"Emily\" and \"Melissa\" are adjusted in position, with \"Melissa\" moving slightly to the left and \"Emily\" remaining below the pink rectangle.\n[120-150s] - \"Emily\" text is selected and resized, appearing smaller than the original \"Emily\" text.  \n- \"Emily\" text is moved slightly to the right and downward relative to its initial position.  \n- \"Emily\" text is duplicated, creating a second instance that is positioned below the first.\n[150-180s] - The text \"Thomas\" is selected and resized, with its bounding box visible around it.  \n- The \"T\" letter is highlighted and appears to be being manipulated or adjusted.  \n- The \"Emily\" text remains unchanged and is positioned to the left of the \"Thomas\" text.\n[180-210s] - The \"Melissa Brad\" text is positioned to the left of the \"Thomas Emily\" text, with \"Brad\" below \"Melissa\" and \"Emily\" below \"Thomas\".\n- A pink rectangular shape is placed over \"Melissa Brad\", partially obscuring the text.\n- The user selects the \"Move\" option from the context menu, indicating an intention to reposition the pink rectangle.\n[210-240s] - Text \"Melissa Thomas Emily Brad\" is displayed on a grid workspace with a pink rectangular label containing \"Brad\" centered below the names.\n- The text elements are selected and moved, with \"Brad\" being repositioned to the left of \"Thomas Emily\" and \"Melissa\" appearing above \"Brad\".\n- The interface shows a \"Get material\" section with options like \"Add to cart\" and \"Print\" visible on the right side of the screen.\n[240-270s] - User selects \"Adhesive Foil\" as the material type in the customization interface.  \n- Tool selection dropdown appears with \"Press Go\" option visible under \"Tools and mat loaded.\"  \n- Interface displays three tool icons: \"No tools loaded,\" \"Tool 1,\" and \"Tool 2,\" with \"Tool 1\" currently selected.\n[270-300s] - Hands position a large gold foil sheet on a purple Cricut mat, preparing it for cutting.  \n- The Cricut machine begins cutting the foil, with the blade moving across the surface to trace a floral design.  \n- After cutting, hands use scissors to trim the foil along the cut edges, separating it into usable pieces.", "history_tokens": 838, "history_utf8_bytes": 3410, "recent_frame_times_s": [287.0033833333333, 288.00438333333335, 289.0053833333333, 290.00638333333336, 291.00738333333334, 292.0083833333333, 293.00938333333335, 294.0103833333333, 295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333, 300.01638333333335, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157], "recent_frames_sha256": "7975c0d084cc9e43091b829786b505009b37e12b853f8d0b5004cb7e1b6501da", "num_recent_frames": 30, "tq": 718262.355258988, "t1": 718272.473742546, "ta": 718272.473742546, "te": 718272.512022071, "first_response_s": 10.118483558064327, "answer_total_s": 10.156763083068654, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 61, "content_group": "02bc44272f6351d1f630f0dcb8e84398ce4b46792f1911c8983f3492b5e5f083", "question": {"question_id": "sample_61_a1644_q0", "video_id": 61, "video_path": "./videos/sample_61_real.mp4", "annotation_index": 1644, "question_index": 0, "question": "What did the hands do just now with the \"Brad\" name piece?", "options": ["A. Held it up to the light.", "B. Placed and smoothed it down onto the surface.", "C. Removed a protective layer.", "D. Dropped it onto the floor."], "answer": "B", "time_stamp_s": 403, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_61_a1644_q0", "video_id": 61, "time_stamp_s": 403, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f83dee764da297e8707e6bfc88fd6779f9a8e5420e342224c1760c44f378c914", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.00028333333336, 385.00128333333333, 386.0022833333333, 387.00328333333334, 388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016], "recent_frames_sha256": "3f20c3f2bc5a2b824514f93d3c2c95b6193bf86efae9c2b6f3ce390143c844aa", "num_recent_frames": 30, "tq": 718334.767372914, "t1": 718343.09864222, "ta": 718343.09864222, "te": 718343.136703656, "first_response_s": 8.331269306014292, "answer_total_s": 8.369330742047168, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_61_a1644_q0", "video_id": 61, "time_stamp_s": 403, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "01bc6eb42c48ac68a424824708c1f765edb4471ea9e57dca4f9f905ff5494fcd", "condition_order": ["notes", "recent"], "memory": "[30-60s] - A black square is selected and its fill color is changed to pink via the color picker.  \n- The text \"Thomas\" is typed and positioned over the pink square, with its font style adjusted to a cursive script.  \n- The text \"Thomas\" is then resized and repositioned to appear centered over the pink square.\n[60-90s] - The text \"Thomas\" is selected and duplicated, appearing as a second instance of the same word.  \n- The duplicated \"Thomas\" is positioned slightly above and to the right of the original, creating a layered effect.  \n- The user then selects the \"Brad\" text, which is positioned below the duplicated \"Thomas,\" indicating a new text element is being added or adjusted.\n[90-120s] - A pink rectangle is positioned on the left side of the screen, with text \"Thomas\" and \"Brad\" appearing to its right.\n- The text \"Emily\" is added below the pink rectangle, followed by \"Melissa\" appearing above \"Emily\" and to the left of \"Thomas.\"\n- The text \"Emily\" and \"Melissa\" are adjusted in position, with \"Melissa\" moving slightly to the left and \"Emily\" remaining below the pink rectangle.\n[120-150s] - \"Emily\" text is selected and resized, appearing smaller than the original \"Emily\" text.  \n- \"Emily\" text is moved slightly to the right and downward relative to its initial position.  \n- \"Emily\" text is duplicated, creating a second instance that is positioned below the first.\n[150-180s] - The text \"Thomas\" is selected and resized, with its bounding box visible around it.  \n- The \"T\" letter is highlighted and appears to be being manipulated or adjusted.  \n- The \"Emily\" text remains unchanged and is positioned to the left of the \"Thomas\" text.\n[180-210s] - The \"Melissa Brad\" text is positioned to the left of the \"Thomas Emily\" text, with \"Brad\" below \"Melissa\" and \"Emily\" below \"Thomas\".\n- A pink rectangular shape is placed over \"Melissa Brad\", partially obscuring the text.\n- The user selects the \"Move\" option from the context menu, indicating an intention to reposition the pink rectangle.\n[210-240s] - Text \"Melissa Thomas Emily Brad\" is displayed on a grid workspace with a pink rectangular label containing \"Brad\" centered below the names.\n- The text elements are selected and moved, with \"Brad\" being repositioned to the left of \"Thomas Emily\" and \"Melissa\" appearing above \"Brad\".\n- The interface shows a \"Get material\" section with options like \"Add to cart\" and \"Print\" visible on the right side of the screen.\n[240-270s] - User selects \"Adhesive Foil\" as the material type in the customization interface.  \n- Tool selection dropdown appears with \"Press Go\" option visible under \"Tools and mat loaded.\"  \n- Interface displays three tool icons: \"No tools loaded,\" \"Tool 1,\" and \"Tool 2,\" with \"Tool 1\" currently selected.\n[270-300s] - Hands position a large gold foil sheet on a purple Cricut mat, preparing it for cutting.  \n- The Cricut machine begins cutting the foil, with the blade moving across the surface to trace a floral design.  \n- After cutting, hands use scissors to trim the foil along the cut edges, separating it into usable pieces.\n[300-330s] - Hands position a white grid-patterned roll on a cutting mat, preparing to cut.  \n- A pair of scissors cuts through the roll, separating a gold foil piece from the white backing.  \n- The gold foil piece is peeled away from the white backing, revealing the word \"Emily\" printed on it.\n[330-360s] - Hands peel off a gold foil sticker labeled \"Emil\" from a white backing sheet.  \n- A second sticker, labeled \"Miles,\" is peeled off and placed beside the first.  \n- A third sticker, labeled \"Thanks,\" is peeled off and positioned near the others on the grid surface.\n[360-390s] - Hands hold a white card with \"Meliss\" written in gold foil, positioning it on a grid mat.  \n- A Cricut marker is used to trace or refine the lettering on the card.  \n- Other cards with names like \"Eric\" and \"Thomas\" are visible nearby on the mat.", "history_tokens": 980, "history_utf8_bytes": 3909, "recent_frame_times_s": [373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.00028333333336, 385.00128333333333, 386.0022833333333, 387.00328333333334, 388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016], "recent_frames_sha256": "3f20c3f2bc5a2b824514f93d3c2c95b6193bf86efae9c2b6f3ce390143c844aa", "num_recent_frames": 30, "tq": 718297.196848826, "t1": 718298.793441624, "ta": 718298.793441624, "te": 718298.945733494, "first_response_s": 1.5965927980141714, "answer_total_s": 1.7488846679916605, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 62, "content_group": "a7b55c26bc8bca7257ded63b076814f10bc226c15b7277374056075b5d8400c7", "question": {"question_id": "sample_62_a1764_q0", "video_id": 62, "video_path": "./videos/sample_62_real.mp4", "annotation_index": 1764, "question_index": 0, "question": "What is being displayed right now?", "options": ["A. Round, glittery discs with names.", "B. Text \"How To Resin Over Vinyl\".", "C. A black screen with text.", "D. Circular donut keychains with names."], "answer": "D", "time_stamp_s": 19, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_62_a1764_q0", "video_id": 62, "time_stamp_s": 19, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "895e23cc60030051136fb86445ebd13cafe0e908d24fac0ccd0c0779a00fa58d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "b400fcab41a19fa532357ff6ca1c45b326807add444e3b193faff3eac866bb3f", "num_recent_frames": 20, "tq": 718537.500626132, "t1": 718546.01730977, "ta": 718546.01730977, "te": 718546.055029487, "first_response_s": 8.51668363797944, "answer_total_s": 8.554403354995884, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_62_a1764_q0", "video_id": 62, "time_stamp_s": 19, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dabb11ef1d869740caccf8d9d8b69e7d3f424f583e9825e3b3205193b38f7086", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "b400fcab41a19fa532357ff6ca1c45b326807add444e3b193faff3eac866bb3f", "num_recent_frames": 20, "tq": 718582.372203323, "t1": 718595.773688455, "ta": 718595.773688455, "te": 718595.814742536, "first_response_s": 13.401485132053494, "answer_total_s": 13.44253921310883, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 62, "content_group": "a7b55c26bc8bca7257ded63b076814f10bc226c15b7277374056075b5d8400c7", "question": {"question_id": "sample_62_a1765_q0", "video_id": 62, "video_path": "./videos/sample_62_real.mp4", "annotation_index": 1765, "question_index": 0, "question": "What did the person do just now?", "options": ["A. Presented a respiratory mask from various angles.", "B. Directed a heat tool at a canvas.", "C. Disassembled the resin kit.", "D. Held and examined two round items."], "answer": "D", "time_stamp_s": 143, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_62_a1765_q0", "video_id": 62, "time_stamp_s": 143, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4f540752e08667119cdd02ec8f21504ed9bef9b4c0c0aeaf30234f0ab773515b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0], "recent_frames_sha256": "26695aa5895f32b3247a54f8c8093cd834498668f50410b24199d906d40ee12b", "num_recent_frames": 30, "tq": 718546.076293199, "t1": 718553.814152024, "ta": 718553.814152024, "te": 718553.851947962, "first_response_s": 7.737858825013973, "answer_total_s": 7.775654762983322, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_62_a1765_q0", "video_id": 62, "time_stamp_s": 143, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c451a15172e615cb9a33b8e13ab37c6071b98b9177086b051fe4ca4bd274acc3", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A collection of colorful, glittery circular resin keychains with names like \"Aria\" and \"Jade\" displayed on a white surface.  \n- Two finished keychains with donut designs and tassels are shown, held in a hand against a grid background.  \n- Text overlay appears at the end, indicating a link to materials and templates in the description.\n[30-60s] - Two keychains with names \"Aria\" and \"Jade\" are displayed, featuring glittery donut designs and tassels.  \n- A blue cutting mat is placed on a grid surface, preparing for crafting.  \n- A box labeled \"2 Part (1:1) Epoxy Resin\" is held, indicating materials for the project.\n[60-90s] - Hands hold two clear bottles labeled \"Part A Resin\" and \"Part B Hardener\" with red arrows pointing to them.  \n- The product box for \"Hobby Boss Resin\" is visible in the background on a blue mat.  \n- The hands position the bottles in front of the box, preparing for use.\n[90-120s] - A hand holds a pink-capped glitter tube labeled \"Glitter\" over a blue mat, with a box of \"Color Reveal\" and a small cup nearby.  \n- The hand then places the glitter tube beside a stack of colored paper sheets (black, yellow, pink, purple) and a wooden stick.  \n- A pair of black nitrile gloves is placed to the left, followed by a respirator mask being held in both hands.", "history_tokens": 342, "history_utf8_bytes": 1295, "recent_frame_times_s": [114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0], "recent_frames_sha256": "26695aa5895f32b3247a54f8c8093cd834498668f50410b24199d906d40ee12b", "num_recent_frames": 30, "tq": 718624.11614779, "t1": 718625.976922331, "ta": 718625.976922331, "te": 718626.34994934, "first_response_s": 1.8607745410408825, "answer_total_s": 2.2338015499990433, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 62, "content_group": "a7b55c26bc8bca7257ded63b076814f10bc226c15b7277374056075b5d8400c7", "question": {"question_id": "sample_62_a1766_q0", "video_id": 62, "video_path": "./videos/sample_62_real.mp4", "annotation_index": 1766, "question_index": 0, "question": "What is both hands securing right now?", "options": ["A. A transparent sheet onto a blue object.", "B. A white piece onto a purple circular object.", "C. A yellow and white crafting tool onto a white speckled piece.", "D. A transparent tape printed with many patterns on it."], "answer": "D", "time_stamp_s": 260, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_62_a1766_q0", "video_id": 62, "time_stamp_s": 260, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a1706947d9a1d57da09149b9a9a05bf491070721e3f8fa9fd259a3548839847d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0], "recent_frames_sha256": "9a95b07f89385b7e77e06cf8eb1293db22f1c85185d4557ba8a8162f56ba7ea4", "num_recent_frames": 30, "tq": 718553.868659145, "t1": 718566.19860015, "ta": 718566.19860015, "te": 718566.23599514, "first_response_s": 12.329941004980356, "answer_total_s": 12.367335995077156, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_62_a1766_q0", "video_id": 62, "time_stamp_s": 260, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c9f4a3165c7eb5dcae00a07bd1666da259f42850fc84735c55627ada4450c405", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A collection of colorful, glittery circular resin keychains with names like \"Aria\" and \"Jade\" displayed on a white surface.  \n- Two finished keychains with donut designs and tassels are shown, held in a hand against a grid background.  \n- Text overlay appears at the end, indicating a link to materials and templates in the description.\n[30-60s] - Two keychains with names \"Aria\" and \"Jade\" are displayed, featuring glittery donut designs and tassels.  \n- A blue cutting mat is placed on a grid surface, preparing for crafting.  \n- A box labeled \"2 Part (1:1) Epoxy Resin\" is held, indicating materials for the project.\n[60-90s] - Hands hold two clear bottles labeled \"Part A Resin\" and \"Part B Hardener\" with red arrows pointing to them.  \n- The product box for \"Hobby Boss Resin\" is visible in the background on a blue mat.  \n- The hands position the bottles in front of the box, preparing for use.\n[90-120s] - A hand holds a pink-capped glitter tube labeled \"Glitter\" over a blue mat, with a box of \"Color Reveal\" and a small cup nearby.  \n- The hand then places the glitter tube beside a stack of colored paper sheets (black, yellow, pink, purple) and a wooden stick.  \n- A pair of black nitrile gloves is placed to the left, followed by a respirator mask being held in both hands.\n[120-150s] - Hands hold a respirator mask with two white filters, positioned over a blue mat with gloves and a cup nearby.  \n- A hand uses a heat gun on a canvas with a rainbow heart design, melting a white substance in the center.  \n- Hands display two white circular filters next to a \"Color Reveal\" kit, a black glove, and a wooden stick on a blue mat.\n[150-180s] - A green Cricut mat is placed under a white paper sheet inside a blue Cricut machine, with the machine's cutting blade positioned above.  \n- The machine begins to cut the paper, with the blade moving downward and the paper being fed through the machine.  \n- A small white card with the word \"Jule\" is held by hands, positioned near the machine, with other colored paper sheets and a purple marker nearby.\n[180-210s] - Hands apply glue from a yellow and white glue stick to a purple circular sticker.  \n- The sticker is then pressed onto a white circular base, aligning it centrally.  \n- The hands adjust the sticker’s position on the base, ensuring proper adhesion.\n[210-240s] - Hands hold a purple circular object, rotating it to show its design.  \n- A white marker is used to trace or mark the purple object.  \n- A white and yellow cutting machine is positioned nearby on the grid mat.", "history_tokens": 650, "history_utf8_bytes": 2553, "recent_frame_times_s": [231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0], "recent_frames_sha256": "9a95b07f89385b7e77e06cf8eb1293db22f1c85185d4557ba8a8162f56ba7ea4", "num_recent_frames": 30, "tq": 718654.632065759, "t1": 718661.421396851, "ta": 718661.421396851, "te": 718661.570166757, "first_response_s": 6.78933109191712, "answer_total_s": 6.938100997940637, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 62, "content_group": "a7b55c26bc8bca7257ded63b076814f10bc226c15b7277374056075b5d8400c7", "question": {"question_id": "sample_62_a1767_q0", "video_id": 62, "video_path": "./videos/sample_62_real.mp4", "annotation_index": 1767, "question_index": 0, "question": "What action is the person performing right now?", "options": ["A. Measuring ingredients in two cups.", "B. Pouring liquid into a third container.", "C. Wearing black gloves.", "D. Consistently stirring the liquid."], "answer": "D", "time_stamp_s": 379, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_62_a1767_q0", "video_id": 62, "time_stamp_s": 379, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "04e2bcbc683458b6e0576334efb272101ab19b522f684e71bddb23c0ba73577d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0], "recent_frames_sha256": "6d9c86949299de68dc6f3fdb4a93ce5338d0a11eb4b3ad8e728db98544d17e78", "num_recent_frames": 30, "tq": 718566.259552118, "t1": 718574.673086064, "ta": 718574.673086064, "te": 718574.710602686, "first_response_s": 8.413533946033567, "answer_total_s": 8.451050568022765, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_62_a1767_q0", "video_id": 62, "time_stamp_s": 379, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5cbac2c90d4d8455f984e933d7e87a96b92fa73248dd3b98445e5611b7ff4e62", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A collection of colorful, glittery circular resin keychains with names like \"Aria\" and \"Jade\" displayed on a white surface.  \n- Two finished keychains with donut designs and tassels are shown, held in a hand against a grid background.  \n- Text overlay appears at the end, indicating a link to materials and templates in the description.\n[30-60s] - Two keychains with names \"Aria\" and \"Jade\" are displayed, featuring glittery donut designs and tassels.  \n- A blue cutting mat is placed on a grid surface, preparing for crafting.  \n- A box labeled \"2 Part (1:1) Epoxy Resin\" is held, indicating materials for the project.\n[60-90s] - Hands hold two clear bottles labeled \"Part A Resin\" and \"Part B Hardener\" with red arrows pointing to them.  \n- The product box for \"Hobby Boss Resin\" is visible in the background on a blue mat.  \n- The hands position the bottles in front of the box, preparing for use.\n[90-120s] - A hand holds a pink-capped glitter tube labeled \"Glitter\" over a blue mat, with a box of \"Color Reveal\" and a small cup nearby.  \n- The hand then places the glitter tube beside a stack of colored paper sheets (black, yellow, pink, purple) and a wooden stick.  \n- A pair of black nitrile gloves is placed to the left, followed by a respirator mask being held in both hands.\n[120-150s] - Hands hold a respirator mask with two white filters, positioned over a blue mat with gloves and a cup nearby.  \n- A hand uses a heat gun on a canvas with a rainbow heart design, melting a white substance in the center.  \n- Hands display two white circular filters next to a \"Color Reveal\" kit, a black glove, and a wooden stick on a blue mat.\n[150-180s] - A green Cricut mat is placed under a white paper sheet inside a blue Cricut machine, with the machine's cutting blade positioned above.  \n- The machine begins to cut the paper, with the blade moving downward and the paper being fed through the machine.  \n- A small white card with the word \"Jule\" is held by hands, positioned near the machine, with other colored paper sheets and a purple marker nearby.\n[180-210s] - Hands apply glue from a yellow and white glue stick to a purple circular sticker.  \n- The sticker is then pressed onto a white circular base, aligning it centrally.  \n- The hands adjust the sticker’s position on the base, ensuring proper adhesion.\n[210-240s] - Hands hold a purple circular object, rotating it to show its design.  \n- A white marker is used to trace or mark the purple object.  \n- A white and yellow cutting machine is positioned nearby on the grid mat.\n[240-270s] - Hands manipulate a small, clear plastic container with a purple lid, positioning it centrally on the grid mat.  \n- A white rectangular card labeled \"Jade\" is placed to the left, while a yellow and white device rests to the right.  \n- A small, white, curved object is held near the container, suggesting preparation for application or adjustment.\n[270-300s] - Hands manipulate a circular, patterned sticker, rotating it to show design.\n- A white rectangular label with \"Jade\" text is positioned to the left, near a roll of white tape.\n- A Cricut cutting machine and a small gray tool are visible on the right side of the grid mat.\n[300-330s] - Hands position a white rectangular card near a circular pink sticker labeled \"Jade\" and a white/yellow package.  \n- The hands then pick up the circular sticker, rotating it to show its design and text.  \n- The sticker is held up for clear viewing, with the background grid mat and crafting tools visible.\n[330-360s] - Hands in black gloves hold a clear plastic measuring cup, rotating it to show measurement markings.  \n- Two bottles of liquid, labeled \"Gel\" and \"Resin,\" are placed on the blue mat beside the cup.  \n- The measuring cup is positioned near the bottles, suggesting preparation for mixing.", "history_tokens": 952, "history_utf8_bytes": 3813, "recent_frame_times_s": [350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0], "recent_frames_sha256": "6d9c86949299de68dc6f3fdb4a93ce5338d0a11eb4b3ad8e728db98544d17e78", "num_recent_frames": 30, "tq": 718685.646738743, "t1": 718687.565771037, "ta": 718687.565771037, "te": 718687.975526645, "first_response_s": 1.9190322940703481, "answer_total_s": 2.3287879020208493, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 62, "content_group": "a7b55c26bc8bca7257ded63b076814f10bc226c15b7277374056075b5d8400c7", "question": {"question_id": "sample_62_a1768_q0", "video_id": 62, "video_path": "./videos/sample_62_real.mp4", "annotation_index": 1768, "question_index": 0, "question": "What did the person do with the lighter just now?", "options": ["A. Ignited a match.", "B. Removed the popsicle stick from the container.", "C. Adjusted the measurement markings on the container.", "D. Brought the flame close to a gold glitter-covered top."], "answer": "D", "time_stamp_s": 488, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_62_a1768_q0", "video_id": 62, "time_stamp_s": 488, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d680f0ddae471af91bbcf771b721f3e62db787cf81fb083efd07024dd68b7cdc", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0], "recent_frames_sha256": "a4ee7a84c1bacfbaf29ade6559d0bd464c6dc11dcd5a4aa16a21683b4347c492", "num_recent_frames": 30, "tq": 718574.725824168, "t1": 718582.325185908, "ta": 718582.325185908, "te": 718582.36348895, "first_response_s": 7.5993617400527, "answer_total_s": 7.637664781999774, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_62_a1768_q0", "video_id": 62, "time_stamp_s": 488, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e64ddf7f9bf4497ee24074358b922c0a6bbe70a38b1fd725df1dc46ae64c50a9", "condition_order": ["recent", "notes"], "memory": "[90-120s] - A hand holds a pink-capped glitter tube labeled \"Glitter\" over a blue mat, with a box of \"Color Reveal\" and a small cup nearby.  \n- The hand then places the glitter tube beside a stack of colored paper sheets (black, yellow, pink, purple) and a wooden stick.  \n- A pair of black nitrile gloves is placed to the left, followed by a respirator mask being held in both hands.\n[120-150s] - Hands hold a respirator mask with two white filters, positioned over a blue mat with gloves and a cup nearby.  \n- A hand uses a heat gun on a canvas with a rainbow heart design, melting a white substance in the center.  \n- Hands display two white circular filters next to a \"Color Reveal\" kit, a black glove, and a wooden stick on a blue mat.\n[150-180s] - A green Cricut mat is placed under a white paper sheet inside a blue Cricut machine, with the machine's cutting blade positioned above.  \n- The machine begins to cut the paper, with the blade moving downward and the paper being fed through the machine.  \n- A small white card with the word \"Jule\" is held by hands, positioned near the machine, with other colored paper sheets and a purple marker nearby.\n[180-210s] - Hands apply glue from a yellow and white glue stick to a purple circular sticker.  \n- The sticker is then pressed onto a white circular base, aligning it centrally.  \n- The hands adjust the sticker’s position on the base, ensuring proper adhesion.\n[210-240s] - Hands hold a purple circular object, rotating it to show its design.  \n- A white marker is used to trace or mark the purple object.  \n- A white and yellow cutting machine is positioned nearby on the grid mat.\n[240-270s] - Hands manipulate a small, clear plastic container with a purple lid, positioning it centrally on the grid mat.  \n- A white rectangular card labeled \"Jade\" is placed to the left, while a yellow and white device rests to the right.  \n- A small, white, curved object is held near the container, suggesting preparation for application or adjustment.\n[270-300s] - Hands manipulate a circular, patterned sticker, rotating it to show design.\n- A white rectangular label with \"Jade\" text is positioned to the left, near a roll of white tape.\n- A Cricut cutting machine and a small gray tool are visible on the right side of the grid mat.\n[300-330s] - Hands position a white rectangular card near a circular pink sticker labeled \"Jade\" and a white/yellow package.  \n- The hands then pick up the circular sticker, rotating it to show its design and text.  \n- The sticker is held up for clear viewing, with the background grid mat and crafting tools visible.\n[330-360s] - Hands in black gloves hold a clear plastic measuring cup, rotating it to show measurement markings.  \n- Two bottles of liquid, labeled \"Gel\" and \"Resin,\" are placed on the blue mat beside the cup.  \n- The measuring cup is positioned near the bottles, suggesting preparation for mixing.\n[360-390s] - Hands in black gloves pour clear liquid from a bottle into a small cup.  \n- A wooden stick is used to stir the liquid inside the cup.  \n- A second small cup is placed nearby, containing a pinkish substance.\n[390-420s] - Hands in black gloves place a pink-capped bottle beside a small cup containing a wooden stick.  \n- The gloved hands then use the wooden stick to stir a golden glittery substance inside the cup.  \n- A white plastic cup with a pink lid is positioned to the left of the cup being stirred.\n[420-450s] - A gloved hand uses tweezers to apply gold glitter onto a pink substance in a clear container.  \n- The glitter is carefully spread in a curved shape across the surface of the pink material.  \n- The container sits on a blue grid mat, with measurement markings visible on its side.\n[450-480s] - A gloved hand holds a wooden stick with gold glitter, applying it to the top of a clear plastic cup.  \n- The cup contains a pink substance beneath the glitter, with measurement markings visible on its side.  \n- At 459 seconds, a flame is introduced to the glitter-covered surface, indicating a heating action.", "history_tokens": 990, "history_utf8_bytes": 4036, "recent_frame_times_s": [459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0], "recent_frames_sha256": "a4ee7a84c1bacfbaf29ade6559d0bd464c6dc11dcd5a4aa16a21683b4347c492", "num_recent_frames": 30, "tq": 718721.368618505, "t1": 718722.368464475, "ta": 718722.368464475, "te": 718722.516546076, "first_response_s": 0.9998459700727835, "answer_total_s": 1.1479275710880756, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 63, "content_group": "d3b9f623354d44b49c306dd532116e28bd5e320687a4514eff314efdd2f089a7", "question": {"question_id": "sample_63_a1021_q0", "video_id": 63, "video_path": "./videos/sample_63_real.mp4", "annotation_index": 1021, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Pouring Epoxy Resin Part A into a plastic cup.", "B. Mixing flower petals in a container.", "C. Writing names on the keychains.", "D. Organizing the hexagonal shapes."], "answer": "A", "time_stamp_s": 20, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_63_a1021_q0", "video_id": 63, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "02bb735334ffa8ace1411b5036168c53be1a23fed39ee3d4d236102a4770cc8a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "b9fdfe501ba21f440a064e064a508f3fae14bcc2d2976817f0f7eb6a0e1eb142", "num_recent_frames": 21, "tq": 715691.913206573, "t1": 715697.784182685, "ta": 715697.784182685, "te": 715697.968296485, "first_response_s": 5.870976111968048, "answer_total_s": 6.055089912028052, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_63_a1021_q0", "video_id": 63, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "86361a9c3847f8511c53835bf3daf48988e35b0503bc6d6ff372af5e0f105c72", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "b9fdfe501ba21f440a064e064a508f3fae14bcc2d2976817f0f7eb6a0e1eb142", "num_recent_frames": 21, "tq": 715745.459358496, "t1": 715752.019430933, "ta": 715752.019430933, "te": 715752.255979725, "first_response_s": 6.560072437045164, "answer_total_s": 6.796621229033917, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 63, "content_group": "d3b9f623354d44b49c306dd532116e28bd5e320687a4514eff314efdd2f089a7", "question": {"question_id": "sample_63_a1022_q0", "video_id": 63, "video_path": "./videos/sample_63_real.mp4", "annotation_index": 1022, "question_index": 0, "question": "What is currently placed under the hexagonal label?", "options": ["A. A small clear container.", "B. A transparent plastic box with colorful items.", "C. A mixing stick.", "D. Tweezers."], "answer": "A", "time_stamp_s": 119, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_63_a1022_q0", "video_id": 63, "time_stamp_s": 119, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9727fc9ac82fc59e7e8d6ff6c8b15dd3c4e5d260e0ed0ee01c0a08b092937ca5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0], "recent_frames_sha256": "1e2269da8825614985143eb9709b5f0a9452dbc3a1ff1d5c63b4232bd0dd7516", "num_recent_frames": 30, "tq": 715697.999574285, "t1": 715704.417071724, "ta": 715704.417071724, "te": 715704.564879631, "first_response_s": 6.417497438960709, "answer_total_s": 6.5653053460409865, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_63_a1022_q0", "video_id": 63, "time_stamp_s": 119, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "272fc546c43f4b16283930ecb205322f43e6c3dcb5f9d823e15134118fc9aa01", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Two PU DUO Epoxy Resin bottles (A and B) are held by gloved hands over a blue mat.  \n- A small clear cup is positioned below the bottles, ready to receive resin.  \n- Gloved hands begin pouring part A resin into the cup, with part B resin visible nearby.\n[30-60s] - Hands in black gloves pour white liquid from a bottle into a small clear cup.  \n- Four white hexagonal cutouts and a small cap are arranged on a blue cutting mat.  \n- After pouring, the hands use a small tool to stir the liquid in the cup.\n[60-90s] - Hands in black gloves hold two clear plastic containers filled with colorful beads and small decorative items.  \n- The containers are positioned horizontally on a blue cutting mat, with white hexagonal pieces and a small cup of glue nearby.  \n- One hand uses tweezers to pick up a small item from the lower container, preparing for placement on a hexagonal piece.", "history_tokens": 217, "history_utf8_bytes": 889, "recent_frame_times_s": [90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0], "recent_frames_sha256": "1e2269da8825614985143eb9709b5f0a9452dbc3a1ff1d5c63b4232bd0dd7516", "num_recent_frames": 30, "tq": 715778.654940486, "t1": 715780.969493707, "ta": 715780.969493707, "te": 715781.196293474, "first_response_s": 2.3145532209891826, "answer_total_s": 2.5413529879879206, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 63, "content_group": "d3b9f623354d44b49c306dd532116e28bd5e320687a4514eff314efdd2f089a7", "question": {"question_id": "sample_63_a1023_q0", "video_id": 63, "video_path": "./videos/sample_63_real.mp4", "annotation_index": 1023, "question_index": 0, "question": "What is the left gloved hand doing right now?", "options": ["A. Holding a clear cup with liquid.", "B. Using a wooden stick to manipulate decorations.", "C. Placing another hexagon-shaped piece on the workspace.", "D. Making precise adjustments with a pen-like tool."], "answer": "A", "time_stamp_s": 205, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_63_a1023_q0", "video_id": 63, "time_stamp_s": 205, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f7741dc110b2b9bf1100721f3cda00f256403ff4650dbc8662f3fadc8289b094", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0], "recent_frames_sha256": "151b588e6d12b56492fd06d6e4a8fa711ac2da4adbc7341e31096fae5deba4ab", "num_recent_frames": 30, "tq": 715704.580746707, "t1": 715718.320813692, "ta": 715718.320813692, "te": 715718.504858677, "first_response_s": 13.740066984901205, "answer_total_s": 13.924111970001832, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_63_a1023_q0", "video_id": 63, "time_stamp_s": 205, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3e870ee209abf902f013f7f06fdbf8cea295e2355266948694332e3a26cfe6d2", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Two PU DUO Epoxy Resin bottles (A and B) are held by gloved hands over a blue mat.  \n- A small clear cup is positioned below the bottles, ready to receive resin.  \n- Gloved hands begin pouring part A resin into the cup, with part B resin visible nearby.\n[30-60s] - Hands in black gloves pour white liquid from a bottle into a small clear cup.  \n- Four white hexagonal cutouts and a small cap are arranged on a blue cutting mat.  \n- After pouring, the hands use a small tool to stir the liquid in the cup.\n[60-90s] - Hands in black gloves hold two clear plastic containers filled with colorful beads and small decorative items.  \n- The containers are positioned horizontally on a blue cutting mat, with white hexagonal pieces and a small cup of glue nearby.  \n- One hand uses tweezers to pick up a small item from the lower container, preparing for placement on a hexagonal piece.\n[90-120s] - Hands in black gloves use tweezers to extract small, colorful beads from a transparent, multi-compartment plastic organizer.  \n- A clear plastic cup with a wooden stick is positioned to the left, likely for applying adhesive.  \n- White hexagonal templates are arranged on the blue cutting mat, awaiting embellishment with the beads.\n[120-150s] - Hands in black gloves apply a clear liquid from a small cup onto a white hexagonal piece using a wooden stick.  \n- The hexagonal piece is rotated and manipulated to ensure even coating.  \n- A small pile of colorful floral embellishments and tools (tweezers, craft knife) remain on the blue mat nearby.\n[150-180s] - Hand wearing black glove uses tweezers to place small green and blue decorative pieces onto a hexagonal white base.  \n- A clear plastic container with colorful craft items is positioned above the workspace, while a glass jar with a wooden stick sits to the left.  \n- The hexagonal base is centered on a blue cutting mat, surrounded by other unadorned hexagons and crafting tools.", "history_tokens": 461, "history_utf8_bytes": 1942, "recent_frame_times_s": [176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0], "recent_frames_sha256": "151b588e6d12b56492fd06d6e4a8fa711ac2da4adbc7341e31096fae5deba4ab", "num_recent_frames": 30, "tq": 715802.72759448, "t1": 715804.318693306, "ta": 715804.318693306, "te": 715804.508195709, "first_response_s": 1.5910988259129226, "answer_total_s": 1.7806012289365754, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 63, "content_group": "d3b9f623354d44b49c306dd532116e28bd5e320687a4514eff314efdd2f089a7", "question": {"question_id": "sample_63_a1024_q0", "video_id": 63, "video_path": "./videos/sample_63_real.mp4", "annotation_index": 1024, "question_index": 0, "question": "What is the gloved hand doing right now?", "options": ["A. Pouring liquid into a hexagonal piece.", "B. Scraping the surface of the hexagonal piece.", "C. Adjusting floral and foliage decorations.", "D. Holding the paintbrush with a pink handle."], "answer": "A", "time_stamp_s": 310, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_63_a1024_q0", "video_id": 63, "time_stamp_s": 310, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ab155e2f0f1ca08c444b15142edcaed1cd1f5225281f6027f293d46fb318ae0f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0], "recent_frames_sha256": "6277dfe4317c9ee32a10c33c2bdb2e514ed883f0326e0ae2faaf1ac478da0ee3", "num_recent_frames": 30, "tq": 715718.521685389, "t1": 715730.901248203, "ta": 715730.901248203, "te": 715731.08572732, "first_response_s": 12.379562814021483, "answer_total_s": 12.56404193106573, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_63_a1024_q0", "video_id": 63, "time_stamp_s": 310, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "63e6a5c560f6c49f9a98947c986afc7b22f008dce1ac20107bb8ca0a7ac0bd3c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Two PU DUO Epoxy Resin bottles (A and B) are held by gloved hands over a blue mat.  \n- A small clear cup is positioned below the bottles, ready to receive resin.  \n- Gloved hands begin pouring part A resin into the cup, with part B resin visible nearby.\n[30-60s] - Hands in black gloves pour white liquid from a bottle into a small clear cup.  \n- Four white hexagonal cutouts and a small cap are arranged on a blue cutting mat.  \n- After pouring, the hands use a small tool to stir the liquid in the cup.\n[60-90s] - Hands in black gloves hold two clear plastic containers filled with colorful beads and small decorative items.  \n- The containers are positioned horizontally on a blue cutting mat, with white hexagonal pieces and a small cup of glue nearby.  \n- One hand uses tweezers to pick up a small item from the lower container, preparing for placement on a hexagonal piece.\n[90-120s] - Hands in black gloves use tweezers to extract small, colorful beads from a transparent, multi-compartment plastic organizer.  \n- A clear plastic cup with a wooden stick is positioned to the left, likely for applying adhesive.  \n- White hexagonal templates are arranged on the blue cutting mat, awaiting embellishment with the beads.\n[120-150s] - Hands in black gloves apply a clear liquid from a small cup onto a white hexagonal piece using a wooden stick.  \n- The hexagonal piece is rotated and manipulated to ensure even coating.  \n- A small pile of colorful floral embellishments and tools (tweezers, craft knife) remain on the blue mat nearby.\n[150-180s] - Hand wearing black glove uses tweezers to place small green and blue decorative pieces onto a hexagonal white base.  \n- A clear plastic container with colorful craft items is positioned above the workspace, while a glass jar with a wooden stick sits to the left.  \n- The hexagonal base is centered on a blue cutting mat, surrounded by other unadorned hexagons and crafting tools.\n[180-210s] - Hands in black gloves use a wooden stick to transfer small, colorful beads from a container into a hexagonal mold.  \n- A clear liquid is held in a small cup, positioned near the mold, suggesting it will be used for sealing or setting.  \n- The workspace includes a blue cutting mat, additional hexagonal molds, and a palette of assorted beads and tools.\n[210-240s] - Hands in black gloves apply glue from a small cup to a white hexagonal tag using a brush.  \n- A pair of tweezers is used to pick up and place small decorative elements (like beads or sequins) onto the glued tag.  \n- The tag is positioned on a blue cutting mat, surrounded by crafting supplies including a container of colorful beads, a paintbrush, and another finished tag.\n[240-270s] - Hands in black gloves apply green paint to a hexagonal tag using a brush.  \n- A clear plastic cup with a wooden stirrer and a palette of colorful paints are positioned nearby.  \n- A pink-handled tool and a small container of green paint are visible on the blue mat.\n[270-300s] - Hands in black gloves use tweezers to pick up small green leaf pieces from a clear plastic container.  \n- A small glass cup with a wooden stirrer is positioned to the left, while a pink-handled scraper lies to the right.  \n- Several hexagonal decorative pieces with floral designs are scattered across the blue mat, some already adorned with tiny flowers and leaves.", "history_tokens": 794, "history_utf8_bytes": 3354, "recent_frame_times_s": [281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0], "recent_frames_sha256": "6277dfe4317c9ee32a10c33c2bdb2e514ed883f0326e0ae2faaf1ac478da0ee3", "num_recent_frames": 30, "tq": 715848.014322714, "t1": 715849.805868445, "ta": 715849.805868445, "te": 715850.006745586, "first_response_s": 1.7915457310155034, "answer_total_s": 1.9924228721065447, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 63, "content_group": "d3b9f623354d44b49c306dd532116e28bd5e320687a4514eff314efdd2f089a7", "question": {"question_id": "sample_63_a1025_q0", "video_id": 63, "video_path": "./videos/sample_63_real.mp4", "annotation_index": 1025, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Attaching the name to the transparent hexagonal object.", "B. Adjusting the hexagonal piece with their left hand.", "C. Applying pressure on the green marking with their left hand.", "D. Using a purple tool to press onto the hexagonal piece."], "answer": "A", "time_stamp_s": 442, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_63_a1025_q0", "video_id": 63, "time_stamp_s": 442, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "aa85336a773d828ee665de39bf787cc095d629513e36326275176eeadd0c9f89", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0, 421.0, 422.0, 423.0, 424.0, 425.0, 426.0, 427.0, 428.0, 429.0, 430.0, 431.0, 432.0, 433.0, 434.0, 435.0, 436.0, 437.0, 438.0, 439.0, 440.0, 441.0, 442.0], "recent_frames_sha256": "7e8838e5607a5ce459815337cbc04016cf1f1465a8fc3d3e66e5d0777c16e5ed", "num_recent_frames": 30, "tq": 715731.099760902, "t1": 715745.29033752, "ta": 715745.29033752, "te": 715745.437517745, "first_response_s": 14.19057661795523, "answer_total_s": 14.337756842956878, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_63_a1025_q0", "video_id": 63, "time_stamp_s": 442, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6178dc0fe287a58035276e5542b5d54b09f9bd06336098e79e607c8083f39bf7", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Hands in black gloves hold two clear plastic containers filled with colorful beads and small decorative items.  \n- The containers are positioned horizontally on a blue cutting mat, with white hexagonal pieces and a small cup of glue nearby.  \n- One hand uses tweezers to pick up a small item from the lower container, preparing for placement on a hexagonal piece.\n[90-120s] - Hands in black gloves use tweezers to extract small, colorful beads from a transparent, multi-compartment plastic organizer.  \n- A clear plastic cup with a wooden stick is positioned to the left, likely for applying adhesive.  \n- White hexagonal templates are arranged on the blue cutting mat, awaiting embellishment with the beads.\n[120-150s] - Hands in black gloves apply a clear liquid from a small cup onto a white hexagonal piece using a wooden stick.  \n- The hexagonal piece is rotated and manipulated to ensure even coating.  \n- A small pile of colorful floral embellishments and tools (tweezers, craft knife) remain on the blue mat nearby.\n[150-180s] - Hand wearing black glove uses tweezers to place small green and blue decorative pieces onto a hexagonal white base.  \n- A clear plastic container with colorful craft items is positioned above the workspace, while a glass jar with a wooden stick sits to the left.  \n- The hexagonal base is centered on a blue cutting mat, surrounded by other unadorned hexagons and crafting tools.\n[180-210s] - Hands in black gloves use a wooden stick to transfer small, colorful beads from a container into a hexagonal mold.  \n- A clear liquid is held in a small cup, positioned near the mold, suggesting it will be used for sealing or setting.  \n- The workspace includes a blue cutting mat, additional hexagonal molds, and a palette of assorted beads and tools.\n[210-240s] - Hands in black gloves apply glue from a small cup to a white hexagonal tag using a brush.  \n- A pair of tweezers is used to pick up and place small decorative elements (like beads or sequins) onto the glued tag.  \n- The tag is positioned on a blue cutting mat, surrounded by crafting supplies including a container of colorful beads, a paintbrush, and another finished tag.\n[240-270s] - Hands in black gloves apply green paint to a hexagonal tag using a brush.  \n- A clear plastic cup with a wooden stirrer and a palette of colorful paints are positioned nearby.  \n- A pink-handled tool and a small container of green paint are visible on the blue mat.\n[270-300s] - Hands in black gloves use tweezers to pick up small green leaf pieces from a clear plastic container.  \n- A small glass cup with a wooden stirrer is positioned to the left, while a pink-handled scraper lies to the right.  \n- Several hexagonal decorative pieces with floral designs are scattered across the blue mat, some already adorned with tiny flowers and leaves.\n[300-330s] - Hands in black gloves hold a clear plastic cup with a white substance and a long tool, positioning it over a blue mat.  \n- A hexagonal white piece is placed on the mat, and the gloved hand uses the tool to apply the white substance to it.  \n- A small container of colorful decorative items is visible nearby, suggesting crafting or assembly work.\n[330-360s] - Hands in black gloves use tweezers to place a small green leaf onto a hexagonal miniature base.  \n- A clear glass cup with a wooden stick inside is positioned near the miniature bases.  \n- A pink-handled tool and a flat spatula are placed to the right of the workspace.\n[360-390s] - A teal Cricut machine is shown with a green cutting mat inside, actively cutting paper.\n- Hands appear, removing the cut paper pieces and arranging them on the mat.\n- Several cut-out shapes, including hexagons and rectangles, are placed on the mat alongside a small green container.\n[390-420s] - Hands hold a small, clear plastic piece with a green and red patterned insert, positioning it over a hexagonal base.  \n- A white marker is used to trace or mark the plastic piece while it's being aligned.  \n- The plastic piece is then placed onto a hexagonal base, which is part of a set of similar pieces on a grid mat.", "history_tokens": 967, "history_utf8_bytes": 4112, "recent_frame_times_s": [413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0, 421.0, 422.0, 423.0, 424.0, 425.0, 426.0, 427.0, 428.0, 429.0, 430.0, 431.0, 432.0, 433.0, 434.0, 435.0, 436.0, 437.0, 438.0, 439.0, 440.0, 441.0, 442.0], "recent_frames_sha256": "7e8838e5607a5ce459815337cbc04016cf1f1465a8fc3d3e66e5d0777c16e5ed", "num_recent_frames": 30, "tq": 715883.403724608, "t1": 715891.64618968, "ta": 715891.64618968, "te": 715892.024500763, "first_response_s": 8.242465071962215, "answer_total_s": 8.620776155032218, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 64, "content_group": "ef29b28ca3e39099814e0e3539f4c0e4409226a921a9c151b09f3839345b0665", "question": {"question_id": "sample_64_a478_q0", "video_id": 64, "video_path": "./videos/sample_64_real.mp4", "annotation_index": 478, "question_index": 0, "question": "What are the hands doing right now?", "options": ["A. Writing the name \"Alli\" on a keychain.", "B. Holding the box closed.", "C. Removing the keychain from the packaging.", "D. Placing the keychain into the packaging."], "answer": "D", "time_stamp_s": 16, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_64_a478_q0", "video_id": 64, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9545cd714655c7fc4ed423fd5bb4b4237a28c1483b389b8888c69b78dc0da2c8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0], "recent_frames_sha256": "279c63eabeb86a3094cdc13581b98e032b73bb109cc58b468b6f4f6c6987a7e4", "num_recent_frames": 17, "tq": 717066.092753447, "t1": 717066.371896605, "ta": 717066.371896605, "te": 717066.409797955, "first_response_s": 0.2791431579971686, "answer_total_s": 0.3170445079449564, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_64_a478_q0", "video_id": 64, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "002f409e8269d5fe1a9fb747342b71b6103e7695c6499428eb7d53798feff463", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0], "recent_frames_sha256": "279c63eabeb86a3094cdc13581b98e032b73bb109cc58b468b6f4f6c6987a7e4", "num_recent_frames": 17, "tq": 717114.891587302, "t1": 717115.584135863, "ta": 717115.584135863, "te": 717116.057062247, "first_response_s": 0.6925485610263422, "answer_total_s": 1.165474944980815, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 64, "content_group": "ef29b28ca3e39099814e0e3539f4c0e4409226a921a9c151b09f3839345b0665", "question": {"question_id": "sample_64_a479_q0", "video_id": 64, "video_path": "./videos/sample_64_real.mp4", "annotation_index": 479, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Picking up a light pink cardboard piece.", "B. Applying adhesive to a cardboard piece.", "C. Pressing down a transparent plastic sheet.", "D. Holding a cylindrical bottle."], "answer": "C", "time_stamp_s": 117, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_64_a479_q0", "video_id": 64, "time_stamp_s": 117, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fd97c36536612587bba534554aecff70ac8d8e265516d494de35af6e54b99315", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0], "recent_frames_sha256": "7b1f3fee46a44afc317074c6fd31f15ef5c6e5f42a06fe1c023f5a0af6bf64da", "num_recent_frames": 30, "tq": 717066.41760685, "t1": 717077.748678961, "ta": 717077.748678961, "te": 717077.785745252, "first_response_s": 11.331072110915557, "answer_total_s": 11.368138402001932, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_64_a479_q0", "video_id": 64, "time_stamp_s": 117, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "21600c37a84a6767b2d6994e819a5e9667d5122d73856871c690e3345cc74c92", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Six keychains in colorful boxes are displayed, each with unique designs like \"Mia,\" \"Nina,\" and \"Wendy.\"  \n- A hand opens a pink box, revealing a keychain with a pink and white polka-dot design and a tassel.  \n- Text overlay lists materials needed for making a keychain display box, including cardstock, tape, and scissors.\n[30-60s] - A hand holds and fans out a stack of colorful, textured cardstock sheets, showcasing their variety and thickness.  \n- The hand then transitions to holding and displaying pre-cut pink paper templates, which appear to be die-cut for a craft project.  \n- The templates are laid flat on a gray surface, and hands begin to assemble them by aligning and folding edges, indicating the start of a crafting process.\n[60-90s] - Hands manipulate a pink paper template with pre-scored folds, preparing for assembly.  \n- A completed pink box with two circular cutouts is visible to the right, indicating progress.  \n- A transparent plastic sheet is positioned to the left, likely for a next step in the assembly process.", "history_tokens": 245, "history_utf8_bytes": 1052, "recent_frame_times_s": [88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0], "recent_frames_sha256": "7b1f3fee46a44afc317074c6fd31f15ef5c6e5f42a06fe1c023f5a0af6bf64da", "num_recent_frames": 30, "tq": 717172.543038069, "t1": 717173.33826478, "ta": 717173.33826478, "te": 717173.377816879, "first_response_s": 0.7952267109649256, "answer_total_s": 0.8347788099199533, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 64, "content_group": "ef29b28ca3e39099814e0e3539f4c0e4409226a921a9c151b09f3839345b0665", "question": {"question_id": "sample_64_a480_q0", "video_id": 64, "video_path": "./videos/sample_64_real.mp4", "annotation_index": 480, "question_index": 0, "question": "What is the cursor doing right now?", "options": ["A. Clicking the \"Undo\" button.", "B. Selecting multiple icons.", "C. Opening a subfolder.", "D. Deleting a document."], "answer": "B", "time_stamp_s": 224, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_64_a480_q0", "video_id": 64, "time_stamp_s": 224, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9f7c93715988e081ddfe4e80766fdf87a33c541ad92bb28953cec4a0d4d5081d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0], "recent_frames_sha256": "72adb555ae5533339a759b87b8ddcb116dbaf22367297e95e8be1316ca1feb4f", "num_recent_frames": 30, "tq": 717077.793762889, "t1": 717089.674977891, "ta": 717089.674977891, "te": 717089.712239627, "first_response_s": 11.881215002038516, "answer_total_s": 11.918476738035679, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_64_a480_q0", "video_id": 64, "time_stamp_s": 224, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "85edba2583a8c25931ee0847f3cf68751dfb531a004359859f33183520a3fe8c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Six keychains in colorful boxes are displayed, each with unique designs like \"Mia,\" \"Nina,\" and \"Wendy.\"  \n- A hand opens a pink box, revealing a keychain with a pink and white polka-dot design and a tassel.  \n- Text overlay lists materials needed for making a keychain display box, including cardstock, tape, and scissors.\n[30-60s] - A hand holds and fans out a stack of colorful, textured cardstock sheets, showcasing their variety and thickness.  \n- The hand then transitions to holding and displaying pre-cut pink paper templates, which appear to be die-cut for a craft project.  \n- The templates are laid flat on a gray surface, and hands begin to assemble them by aligning and folding edges, indicating the start of a crafting process.\n[60-90s] - Hands manipulate a pink paper template with pre-scored folds, preparing for assembly.  \n- A completed pink box with two circular cutouts is visible to the right, indicating progress.  \n- A transparent plastic sheet is positioned to the left, likely for a next step in the assembly process.\n[90-120s] - Hands apply adhesive from a bottle labeled \"Quick Dry Adhesive\" to the inner edges of a pink paper frame.  \n- The adhesive is applied along the perimeter of the frame's opening, preparing for assembly.  \n- A clear plastic sheet is positioned nearby, likely for later use in the box construction.\n[120-150s] - Hands apply glue to a pink paper flap, preparing to attach it to a box structure.  \n- The box is partially assembled, with a clear window panel already inserted into its frame.  \n- A separate pink flap with two circular cutouts lies nearby, suggesting it’s part of the box’s lid assembly.\n[150-180s] - Hands open a pink box, revealing a keychain with a pink circular charm and black polka dots.  \n- The keychain is placed inside the box, which has a clear window and a small white tag attached.  \n- The box is closed, and the keychain remains visible through the transparent window.\n[180-210s] - A pink keychain with a black and white polka dot design and the word \"LOVE\" is displayed in a pink box on a gray background.  \n- The screen transitions to a black background with white text reading \"The Design Space Tutorial.\"  \n- The video then shows a blank spreadsheet interface with a toolbar and grid, indicating the start of a tutorial.", "history_tokens": 546, "history_utf8_bytes": 2316, "recent_frame_times_s": [195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0], "recent_frames_sha256": "72adb555ae5533339a759b87b8ddcb116dbaf22367297e95e8be1316ca1feb4f", "num_recent_frames": 30, "tq": 717203.029026599, "t1": 717204.492895719, "ta": 717204.492895719, "te": 717204.755299172, "first_response_s": 1.4638691199943423, "answer_total_s": 1.7262725729960948, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 64, "content_group": "ef29b28ca3e39099814e0e3539f4c0e4409226a921a9c151b09f3839345b0665", "question": {"question_id": "sample_64_a481_q0", "video_id": 64, "video_path": "./videos/sample_64_real.mp4", "annotation_index": 481, "question_index": 0, "question": "What did the cursor indicate just now?", "options": ["A. Selecting shapes on the canvas.", "B. Displaying a pop-up menu.", "C. Moving to the Layers panel on the right.", "D. Highlighting text input fields."], "answer": "C", "time_stamp_s": 309, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_64_a481_q0", "video_id": 64, "time_stamp_s": 309, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "38e357411611feec6f377771f1e6f1dcdb6d627355edc48cd7a1f0967929c689", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0], "recent_frames_sha256": "71a3c88b589f66511bc46de40a65d86e7539b27f17efc6fb711d0547b9727ecd", "num_recent_frames": 30, "tq": 717089.721050946, "t1": 717102.537675502, "ta": 717102.537675502, "te": 717102.579919137, "first_response_s": 12.81662455596961, "answer_total_s": 12.858868190902285, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_64_a481_q0", "video_id": 64, "time_stamp_s": 309, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d3540c47beb343994b9d09bf13d1804841947fade1398eefd7b3f7e4f957194b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Six keychains in colorful boxes are displayed, each with unique designs like \"Mia,\" \"Nina,\" and \"Wendy.\"  \n- A hand opens a pink box, revealing a keychain with a pink and white polka-dot design and a tassel.  \n- Text overlay lists materials needed for making a keychain display box, including cardstock, tape, and scissors.\n[30-60s] - A hand holds and fans out a stack of colorful, textured cardstock sheets, showcasing their variety and thickness.  \n- The hand then transitions to holding and displaying pre-cut pink paper templates, which appear to be die-cut for a craft project.  \n- The templates are laid flat on a gray surface, and hands begin to assemble them by aligning and folding edges, indicating the start of a crafting process.\n[60-90s] - Hands manipulate a pink paper template with pre-scored folds, preparing for assembly.  \n- A completed pink box with two circular cutouts is visible to the right, indicating progress.  \n- A transparent plastic sheet is positioned to the left, likely for a next step in the assembly process.\n[90-120s] - Hands apply adhesive from a bottle labeled \"Quick Dry Adhesive\" to the inner edges of a pink paper frame.  \n- The adhesive is applied along the perimeter of the frame's opening, preparing for assembly.  \n- A clear plastic sheet is positioned nearby, likely for later use in the box construction.\n[120-150s] - Hands apply glue to a pink paper flap, preparing to attach it to a box structure.  \n- The box is partially assembled, with a clear window panel already inserted into its frame.  \n- A separate pink flap with two circular cutouts lies nearby, suggesting it’s part of the box’s lid assembly.\n[150-180s] - Hands open a pink box, revealing a keychain with a pink circular charm and black polka dots.  \n- The keychain is placed inside the box, which has a clear window and a small white tag attached.  \n- The box is closed, and the keychain remains visible through the transparent window.\n[180-210s] - A pink keychain with a black and white polka dot design and the word \"LOVE\" is displayed in a pink box on a gray background.  \n- The screen transitions to a black background with white text reading \"The Design Space Tutorial.\"  \n- The video then shows a blank spreadsheet interface with a toolbar and grid, indicating the start of a tutorial.\n[210-240s] - User navigates to \"S3 Files\" folder in Finder, revealing subfolders like \"For iCloud\" and \"You Don't Have a Printing Tool.\"  \n- User opens \"For iCloud\" folder, then selects and opens a file named \"S3 Files\" within it.  \n- The screen transitions to Adobe InDesign, displaying two pink shopping bag templates with a red arrow pointing to the left bag.\n[240-270s] - Two pink paper bag designs with handles are displayed on a grid, with a pink arrow pointing to the left bag.  \n- The screen transitions to a file explorer showing \"SVG Files\" with folders labeled \"For Cloud Day\" and \"You don't have a Scoring Tool.\"  \n- A message appears indicating \"You have a Scoring Tool\" with multiple SVG files listed, including \"Kitchen Box 1A.svg\" and \"Kitchen Box 1B.svg.\"\n[270-300s] - A red arrow points to a \"Marathon Size 11\" file icon in a Finder window, indicating selection for a specific cardstock size.  \n- Text overlay labels \"A\" as A4 or 8.5x11\" and \"B\" as A3 or Tabloid Size Cardstock, suggesting size options for a design tool.  \n- The screen transitions to a design software interface showing a pink card template with measurement labels and a sidebar listing design elements.", "history_tokens": 852, "history_utf8_bytes": 3506, "recent_frame_times_s": [280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0], "recent_frames_sha256": "71a3c88b589f66511bc46de40a65d86e7539b27f17efc6fb711d0547b9727ecd", "num_recent_frames": 30, "tq": 717231.46102952, "t1": 717238.104210869, "ta": 717238.104210869, "te": 717238.142661636, "first_response_s": 6.643181348918006, "answer_total_s": 6.681632115971297, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 64, "content_group": "ef29b28ca3e39099814e0e3539f4c0e4409226a921a9c151b09f3839345b0665", "question": {"question_id": "sample_64_a482_q0", "video_id": 64, "video_path": "./videos/sample_64_real.mp4", "annotation_index": 482, "question_index": 0, "question": "What action did the user perform just now?", "options": ["A. Selected the \"Score\" tool.", "B. Added a new shape to the design.", "C. Chose the \"Medium Cardstock - 80 lb (216 gsm)\" as the base material.", "D. Connected the Maker 3."], "answer": "C", "time_stamp_s": 420, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_64_a482_q0", "video_id": 64, "time_stamp_s": 420, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "930214f19fbe48d7c6662a46871fe6eb7ee08ce093e397659235cd6cdc63003c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0], "recent_frames_sha256": "248430bc13f1834baf375fd02d49496a05b490d7a10836a85912522d786b79a3", "num_recent_frames": 30, "tq": 717102.591048981, "t1": 717114.694029945, "ta": 717114.694029945, "te": 717114.883211557, "first_response_s": 12.1029809640022, "answer_total_s": 12.29216257610824, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_64_a482_q0", "video_id": 64, "time_stamp_s": 420, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2467da03b955500feca6af22c447ee96ca64a75592046bbfe4a29ece89290feb", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Hands apply adhesive from a bottle labeled \"Quick Dry Adhesive\" to the inner edges of a pink paper frame.  \n- The adhesive is applied along the perimeter of the frame's opening, preparing for assembly.  \n- A clear plastic sheet is positioned nearby, likely for later use in the box construction.\n[120-150s] - Hands apply glue to a pink paper flap, preparing to attach it to a box structure.  \n- The box is partially assembled, with a clear window panel already inserted into its frame.  \n- A separate pink flap with two circular cutouts lies nearby, suggesting it’s part of the box’s lid assembly.\n[150-180s] - Hands open a pink box, revealing a keychain with a pink circular charm and black polka dots.  \n- The keychain is placed inside the box, which has a clear window and a small white tag attached.  \n- The box is closed, and the keychain remains visible through the transparent window.\n[180-210s] - A pink keychain with a black and white polka dot design and the word \"LOVE\" is displayed in a pink box on a gray background.  \n- The screen transitions to a black background with white text reading \"The Design Space Tutorial.\"  \n- The video then shows a blank spreadsheet interface with a toolbar and grid, indicating the start of a tutorial.\n[210-240s] - User navigates to \"S3 Files\" folder in Finder, revealing subfolders like \"For iCloud\" and \"You Don't Have a Printing Tool.\"  \n- User opens \"For iCloud\" folder, then selects and opens a file named \"S3 Files\" within it.  \n- The screen transitions to Adobe InDesign, displaying two pink shopping bag templates with a red arrow pointing to the left bag.\n[240-270s] - Two pink paper bag designs with handles are displayed on a grid, with a pink arrow pointing to the left bag.  \n- The screen transitions to a file explorer showing \"SVG Files\" with folders labeled \"For Cloud Day\" and \"You don't have a Scoring Tool.\"  \n- A message appears indicating \"You have a Scoring Tool\" with multiple SVG files listed, including \"Kitchen Box 1A.svg\" and \"Kitchen Box 1B.svg.\"\n[270-300s] - A red arrow points to a \"Marathon Size 11\" file icon in a Finder window, indicating selection for a specific cardstock size.  \n- Text overlay labels \"A\" as A4 or 8.5x11\" and \"B\" as A3 or Tabloid Size Cardstock, suggesting size options for a design tool.  \n- The screen transitions to a design software interface showing a pink card template with measurement labels and a sidebar listing design elements.\n[300-330s] - User selects 'Keychain-box-1a.svg' from the 'Layers' dropdown menu, indicated by red arrows pointing to the file names.  \n- The selected file is then dragged and dropped onto the design grid, positioning it over existing pink shapes.  \n- The 'Layers' panel on the right shows multiple instances of 'Keychain-box-1a.svg' with 'Reset Cut' options, suggesting layer management for cutting paths.\n[330-360s] - A red arrow points to a pink rectangular shape in the design grid.  \n- The \"Design\" menu is open, with \"Export to Silhouette\" highlighted.  \n- A \"Print\" button is visible at the bottom right, with a red arrow pointing to it.\n[360-390s] - A pop-up window appears asking to select a paper type for the project, offering options like \"Without Mat,\" \"On Mat,\" and \"Multiple Sheets.\"  \n- The user selects \"On Mat\" and the screen transitions to display a grid layout with a pink design area.  \n- The design is then scaled and positioned on the mat, with the mat's grid lines visible for alignment.\n[390-420s] - The Cricut Design Space interface displays a pink mat on a cutting mat grid, with a \"Select\" button visible on the left panel.  \n- The user clicks \"Select\" under \"Mat Size\" to choose a mat, then selects \"Medium Mat\" from the dropdown list.  \n- The screen transitions to a \"Select Your Material\" page, showing material options like \"Cricut Explore\" and \"Cricut Maker,\" with \"Cricut Explore\" highlighted.", "history_tokens": 970, "history_utf8_bytes": 3880, "recent_frame_times_s": [391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0], "recent_frames_sha256": "248430bc13f1834baf375fd02d49496a05b490d7a10836a85912522d786b79a3", "num_recent_frames": 30, "tq": 717268.022055268, "t1": 717269.319723183, "ta": 717269.319723183, "te": 717269.550075583, "first_response_s": 1.2976679150015116, "answer_total_s": 1.5280203149886802, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 65, "content_group": "403f182ec0d5de4f8fb7e9c6eaead4d0f60d913d76d69a1b9fc7bd71ef216052", "question": {"question_id": "sample_65_a912_q0", "video_id": 65, "video_path": "./videos/sample_65_real.mp4", "annotation_index": 912, "question_index": 0, "question": "What is being shown on the screen right now?", "options": ["A. A dark background displaying \"Leopard Glitter Keychains.\".", "B. Instructions for using a cutting machine.", "C. The Cricut Joy software interface with design options.", "D. A hand holding glittery leopard print keychains."], "answer": "D", "time_stamp_s": 5, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_65_a912_q0", "video_id": 65, "time_stamp_s": 5, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d20a745a060c1f2f818d155d230ff0616b20731a0cbefda369e2f4341608ddb7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "275e73e73dad5ea246e62002c4e028dd1c4dda9ca9becad747a7831476dc169d", "num_recent_frames": 6, "tq": 710018.720577017, "t1": 710020.638007857, "ta": 710020.638007857, "te": 710020.793197314, "first_response_s": 1.9174308399669826, "answer_total_s": 2.072620296967216, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_65_a912_q0", "video_id": 65, "time_stamp_s": 5, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "465b6838e4f33a061c50a68e1039be1ab08219fbaf6859e9b6d4825faa5ded18", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "275e73e73dad5ea246e62002c4e028dd1c4dda9ca9becad747a7831476dc169d", "num_recent_frames": 6, "tq": 710052.906344939, "t1": 710064.477424292, "ta": 710064.477424292, "te": 710064.703391504, "first_response_s": 11.571079352986999, "answer_total_s": 11.797046564985067, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 65, "content_group": "403f182ec0d5de4f8fb7e9c6eaead4d0f60d913d76d69a1b9fc7bd71ef216052", "question": {"question_id": "sample_65_a913_q0", "video_id": 65, "video_path": "./videos/sample_65_real.mp4", "annotation_index": 913, "question_index": 0, "question": "What action is being performed right now?", "options": ["A. Loading a sheet into the machine.", "B. Pulling out a sheet from the machine.", "C. Labeling the material.", "D. Cutting the material vertically."], "answer": "D", "time_stamp_s": 120, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_65_a913_q0", "video_id": 65, "time_stamp_s": 120, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "971e24cfcf3895330ef0601b6ac8cc51a0b9df114ad3ce92ba07f4fdb20394c9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0], "recent_frames_sha256": "cd4a7128c6ed8b468ffe87bf1cda6fa177778634710981de495c85fca4dac2f4", "num_recent_frames": 30, "tq": 710020.825884837, "t1": 710028.895189787, "ta": 710028.895189787, "te": 710029.118923049, "first_response_s": 8.069304950069636, "answer_total_s": 8.293038211995736, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_65_a913_q0", "video_id": 65, "time_stamp_s": 120, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0ce73c10ec12cfaa438e94936feeca9cb2c5bd7bfea53797e243c12b1f6d85cd", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand holds three leopard-print glitter keychains with tassels, labeled \"Cafe,\" \"Mama,\" and \"Jill.\"  \n- On-screen text instructs to upload a cut file to a Cricut Joy cutting machine.  \n- Software interface shows a leopard pattern being scaled to match an acrylic disc size.\n[30-60s] - A solid black circle is positioned on the left side of the canvas, with a dotted pattern circle to its right.  \n- The user selects the solid black circle and moves it to the left, leaving space for text.  \n- Text \"Jun\" appears in a cursive font, positioned to the right of the solid black circle.\n[60-90s] - A circular design with the word \"Jax\" is positioned on the left side of the canvas, with a patterned circle to its right.  \n- The design is resized and repositioned slightly, with the patterned circle appearing to be a separate element.  \n- The interface shows a \"Premium Vinyl\" setting, indicating preparation for vinyl cutting.\n[90-120s] - A person inserts a black vinyl sheet into a blue Cricut cutting machine, which begins to cut the material.  \n- The machine's cutting blade moves along the vinyl, slicing through it as the sheet is fed forward.  \n- After cutting, the person removes the vinyl sheet from the machine, revealing the cut design.", "history_tokens": 305, "history_utf8_bytes": 1253, "recent_frame_times_s": [91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0], "recent_frames_sha256": "cd4a7128c6ed8b468ffe87bf1cda6fa177778634710981de495c85fca4dac2f4", "num_recent_frames": 30, "tq": 710100.552509631, "t1": 710101.486293464, "ta": 710101.486293464, "te": 710101.671633212, "first_response_s": 0.933783832937479, "answer_total_s": 1.1191235809819773, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 65, "content_group": "403f182ec0d5de4f8fb7e9c6eaead4d0f60d913d76d69a1b9fc7bd71ef216052", "question": {"question_id": "sample_65_a914_q0", "video_id": 65, "video_path": "./videos/sample_65_real.mp4", "annotation_index": 914, "question_index": 0, "question": "What are the hands doing right now?", "options": ["A. Drawing on a piece of paper.", "B. Washing the stencil.", "C. Lifting the stencil off the mat.", "D. Applying a label to a stencil."], "answer": "D", "time_stamp_s": 193, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_65_a914_q0", "video_id": 65, "time_stamp_s": 193, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0f7b4161389d299ff160f539104cd92a17a514ef99d9b62d5e1f53a9f8a9ab4c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0], "recent_frames_sha256": "2a19b7748533cd79c79e7643c44e8e1a2d2fb7ea5ef336d6b0fb19b6543320bd", "num_recent_frames": 30, "tq": 710029.156704593, "t1": 710036.058577866, "ta": 710036.058577866, "te": 710036.498330462, "first_response_s": 6.901873272960074, "answer_total_s": 7.341625869041309, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_65_a914_q0", "video_id": 65, "time_stamp_s": 193, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "04348e984caa3ec23c48bcf39e43e8f8b6051355dabbb44c005fb3126dbed00d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand holds three leopard-print glitter keychains with tassels, labeled \"Cafe,\" \"Mama,\" and \"Jill.\"  \n- On-screen text instructs to upload a cut file to a Cricut Joy cutting machine.  \n- Software interface shows a leopard pattern being scaled to match an acrylic disc size.\n[30-60s] - A solid black circle is positioned on the left side of the canvas, with a dotted pattern circle to its right.  \n- The user selects the solid black circle and moves it to the left, leaving space for text.  \n- Text \"Jun\" appears in a cursive font, positioned to the right of the solid black circle.\n[60-90s] - A circular design with the word \"Jax\" is positioned on the left side of the canvas, with a patterned circle to its right.  \n- The design is resized and repositioned slightly, with the patterned circle appearing to be a separate element.  \n- The interface shows a \"Premium Vinyl\" setting, indicating preparation for vinyl cutting.\n[90-120s] - A person inserts a black vinyl sheet into a blue Cricut cutting machine, which begins to cut the material.  \n- The machine's cutting blade moves along the vinyl, slicing through it as the sheet is fed forward.  \n- After cutting, the person removes the vinyl sheet from the machine, revealing the cut design.\n[120-150s] - Hands use a white marker to trace a circular pattern onto a black rectangular piece.  \n- A white circular stencil is placed over the traced area, aligning with the pattern.  \n- The black piece is then folded along a crease, revealing a white interior with a circular cutout design.\n[150-180s] - Hands use a white tool to peel off a protective layer from a clear stamp.  \n- A black-and-white patterned stamp is lifted from a white backing sheet.  \n- The stamp is positioned over a circular transparent template on the grid mat.", "history_tokens": 435, "history_utf8_bytes": 1793, "recent_frame_times_s": [164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0], "recent_frames_sha256": "2a19b7748533cd79c79e7643c44e8e1a2d2fb7ea5ef336d6b0fb19b6543320bd", "num_recent_frames": 30, "tq": 710121.928250059, "t1": 710123.587533304, "ta": 710123.587533304, "te": 710123.812087844, "first_response_s": 1.6592832449823618, "answer_total_s": 1.883837784989737, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 65, "content_group": "403f182ec0d5de4f8fb7e9c6eaead4d0f60d913d76d69a1b9fc7bd71ef216052", "question": {"question_id": "sample_65_a915_q0", "video_id": 65, "video_path": "./videos/sample_65_real.mp4", "annotation_index": 915, "question_index": 0, "question": "What is the right hand doing right now?", "options": ["A. Applying a layer of red glitter.", "B. Holding a pair of cups.", "C. Removing glitter from the object.", "D. Spreading golden glitter evenly over the white round object."], "answer": "D", "time_stamp_s": 317, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_65_a915_q0", "video_id": 65, "time_stamp_s": 317, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2a850a8e2d3ee4665d47fac4584e4fa8cc52a15ad42f62bc3222fde1dafddddb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0], "recent_frames_sha256": "a68e534dbb58b9f148725a5027cff1e3d5490b1e93b6c3c4f52101a2a3897e70", "num_recent_frames": 30, "tq": 710036.511595443, "t1": 710046.708072352, "ta": 710046.708072352, "te": 710046.745267796, "first_response_s": 10.196476908982731, "answer_total_s": 10.233672352973372, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_65_a915_q0", "video_id": 65, "time_stamp_s": 317, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a8767d1fd8094799166ccc579ff094ace095da669502e6ea3270d8a84bddcf77", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand holds three leopard-print glitter keychains with tassels, labeled \"Cafe,\" \"Mama,\" and \"Jill.\"  \n- On-screen text instructs to upload a cut file to a Cricut Joy cutting machine.  \n- Software interface shows a leopard pattern being scaled to match an acrylic disc size.\n[30-60s] - A solid black circle is positioned on the left side of the canvas, with a dotted pattern circle to its right.  \n- The user selects the solid black circle and moves it to the left, leaving space for text.  \n- Text \"Jun\" appears in a cursive font, positioned to the right of the solid black circle.\n[60-90s] - A circular design with the word \"Jax\" is positioned on the left side of the canvas, with a patterned circle to its right.  \n- The design is resized and repositioned slightly, with the patterned circle appearing to be a separate element.  \n- The interface shows a \"Premium Vinyl\" setting, indicating preparation for vinyl cutting.\n[90-120s] - A person inserts a black vinyl sheet into a blue Cricut cutting machine, which begins to cut the material.  \n- The machine's cutting blade moves along the vinyl, slicing through it as the sheet is fed forward.  \n- After cutting, the person removes the vinyl sheet from the machine, revealing the cut design.\n[120-150s] - Hands use a white marker to trace a circular pattern onto a black rectangular piece.  \n- A white circular stencil is placed over the traced area, aligning with the pattern.  \n- The black piece is then folded along a crease, revealing a white interior with a circular cutout design.\n[150-180s] - Hands use a white tool to peel off a protective layer from a clear stamp.  \n- A black-and-white patterned stamp is lifted from a white backing sheet.  \n- The stamp is positioned over a circular transparent template on the grid mat.\n[180-210s] - Hands open a small, clear plastic container labeled \"Dye Ink\" and remove a circular stamp with a black pattern.  \n- The stamp is held up to show its detailed design, then placed on the grid mat beside two identical white paper templates.  \n- The person’s hands adjust the position of the stamp and templates on the mat, preparing for the next step.\n[210-240s] - Hands in maroon sleeves manipulate a small, patterned object on a grid mat.  \n- Two circular, black-and-white patterned items are positioned above the object.  \n- A black-gloved hand holds a bottle labeled \"Part A\" of epoxy resin, poised to pour into a small cup.\n[240-270s] - A gloved hand holds a clear plastic bottle, tilting it to pour liquid into a small cup on a blue mat.\n- The hand then places the bottle down and begins mixing the contents of the cup with a wooden stick.\n- A small container with a yellowish substance and a wooden stick is visible nearby on the mat.\n[270-300s] - Hands in black gloves hold a small, round, clear container with a patterned vinyl insert.\n- The container is placed on a white paper towel on a blue mat, with a small cup of resin and a wooden stick nearby.\n- The person uses the wooden stick to apply resin to the vinyl side of the container.", "history_tokens": 745, "history_utf8_bytes": 3053, "recent_frame_times_s": [288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0], "recent_frames_sha256": "a68e534dbb58b9f148725a5027cff1e3d5490b1e93b6c3c4f52101a2a3897e70", "num_recent_frames": 30, "tq": 710155.785333681, "t1": 710163.04838702, "ta": 710163.04838702, "te": 710163.498883204, "first_response_s": 7.263053338974714, "answer_total_s": 7.713549522915855, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 65, "content_group": "403f182ec0d5de4f8fb7e9c6eaead4d0f60d913d76d69a1b9fc7bd71ef216052", "question": {"question_id": "sample_65_a916_q0", "video_id": 65, "video_path": "./videos/sample_65_real.mp4", "annotation_index": 916, "question_index": 0, "question": "What is the hands doing right now?", "options": ["A. Pulling the adhesive backing upwards.", "B. Adjusting the paper's position on the coaster.", "C. Inspecting the adhesive surface on the paper.", "D. Placing the adhesive-applied paper against the golden round object."], "answer": "D", "time_stamp_s": 416, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_65_a916_q0", "video_id": 65, "time_stamp_s": 416, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "82c3cac040799f6c560ce7b0622fc865ffa68018fdadcc582c6dbcc45270dc08", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0], "recent_frames_sha256": "20f63e141c57d088e85e5ad280cb6bcdd835699f5d9dd57187cf7efb720cdeec", "num_recent_frames": 30, "tq": 710046.759461218, "t1": 710052.855213154, "ta": 710052.855213154, "te": 710052.89195796, "first_response_s": 6.095751935965382, "answer_total_s": 6.132496741949581, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_65_a916_q0", "video_id": 65, "time_stamp_s": 416, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f06e96894359651cf276ddbb1c0741a7172093636162bfce7eca88c71949e68e", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand holds three leopard-print glitter keychains with tassels, labeled \"Cafe,\" \"Mama,\" and \"Jill.\"  \n- On-screen text instructs to upload a cut file to a Cricut Joy cutting machine.  \n- Software interface shows a leopard pattern being scaled to match an acrylic disc size.\n[30-60s] - A solid black circle is positioned on the left side of the canvas, with a dotted pattern circle to its right.  \n- The user selects the solid black circle and moves it to the left, leaving space for text.  \n- Text \"Jun\" appears in a cursive font, positioned to the right of the solid black circle.\n[60-90s] - A circular design with the word \"Jax\" is positioned on the left side of the canvas, with a patterned circle to its right.  \n- The design is resized and repositioned slightly, with the patterned circle appearing to be a separate element.  \n- The interface shows a \"Premium Vinyl\" setting, indicating preparation for vinyl cutting.\n[90-120s] - A person inserts a black vinyl sheet into a blue Cricut cutting machine, which begins to cut the material.  \n- The machine's cutting blade moves along the vinyl, slicing through it as the sheet is fed forward.  \n- After cutting, the person removes the vinyl sheet from the machine, revealing the cut design.\n[120-150s] - Hands use a white marker to trace a circular pattern onto a black rectangular piece.  \n- A white circular stencil is placed over the traced area, aligning with the pattern.  \n- The black piece is then folded along a crease, revealing a white interior with a circular cutout design.\n[150-180s] - Hands use a white tool to peel off a protective layer from a clear stamp.  \n- A black-and-white patterned stamp is lifted from a white backing sheet.  \n- The stamp is positioned over a circular transparent template on the grid mat.\n[180-210s] - Hands open a small, clear plastic container labeled \"Dye Ink\" and remove a circular stamp with a black pattern.  \n- The stamp is held up to show its detailed design, then placed on the grid mat beside two identical white paper templates.  \n- The person’s hands adjust the position of the stamp and templates on the mat, preparing for the next step.\n[210-240s] - Hands in maroon sleeves manipulate a small, patterned object on a grid mat.  \n- Two circular, black-and-white patterned items are positioned above the object.  \n- A black-gloved hand holds a bottle labeled \"Part A\" of epoxy resin, poised to pour into a small cup.\n[240-270s] - A gloved hand holds a clear plastic bottle, tilting it to pour liquid into a small cup on a blue mat.\n- The hand then places the bottle down and begins mixing the contents of the cup with a wooden stick.\n- A small container with a yellowish substance and a wooden stick is visible nearby on the mat.\n[270-300s] - Hands in black gloves hold a small, round, clear container with a patterned vinyl insert.\n- The container is placed on a white paper towel on a blue mat, with a small cup of resin and a wooden stick nearby.\n- The person uses the wooden stick to apply resin to the vinyl side of the container.\n[300-330s] - Hands in black gloves carefully apply gold glitter using a wooden stick to a small, clear resin dome on a white paper towel.  \n- The resin dome is positioned on the paper towel, and the glitter is being spread evenly across its surface.  \n- A glass of water and two small containers with glitter (gold and red) are visible in the background, along with a wooden stick resting in one of the glitter containers.\n[330-360s] - Hands in black gloves hold a wooden stick with gold glitter, positioning it over a white paper towel on a blue mat.  \n- A small container of red glitter is visible nearby, with a wooden stick resting inside it.  \n- The person adjusts the stick’s position slightly, preparing to apply the glitter to the paper towel.\n[360-390s] - Hands in black gloves apply a reddish-brown glitter to a small circular object using a wooden stick.  \n- Two small containers of glitter (one reddish-brown, one green) and a white paper towel are visible on a blue mat.  \n- A glass of water with a wooden stick and two small jars of glitter are positioned in the top left corner.", "history_tokens": 1001, "history_utf8_bytes": 4149, "recent_frame_times_s": [387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0], "recent_frames_sha256": "20f63e141c57d088e85e5ad280cb6bcdd835699f5d9dd57187cf7efb720cdeec", "num_recent_frames": 30, "tq": 710186.161310588, "t1": 710187.481614602, "ta": 710187.481614602, "te": 710187.815963848, "first_response_s": 1.3203040140215307, "answer_total_s": 1.6546532600186765, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 66, "content_group": "8b9a7fdc984e30c2208e730da3a7e68845f5ab733b8bba8def21228ef634dbae", "question": {"question_id": "sample_66_a1146_q0", "video_id": 66, "video_path": "./videos/sample_66_real.mp4", "annotation_index": 1146, "question_index": 0, "question": "What is the camera focusing on right now?", "options": ["A. The entire collection of bookmarks.", "B. A pink bookmark with the name \"Kristi.\".", "C. A balck bookmark with the name \"Jamantha.\".", "D. A beige bookmark with no name."], "answer": "C", "time_stamp_s": 12, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_66_a1146_q0", "video_id": 66, "time_stamp_s": 12, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bd51734bc3a6bfb6b2990167726989bd86cf6dc1494899a6f4fbe8ddaeef8e8d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0], "recent_frames_sha256": "58157cdee831b17eb416ccf65fd393aaa3aa707c1236921508c23fe38ddcc27b", "num_recent_frames": 13, "tq": 710227.892966935, "t1": 710229.033619576, "ta": 710229.033619576, "te": 710229.073084919, "first_response_s": 1.140652641071938, "answer_total_s": 1.1801179840695113, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_66_a1146_q0", "video_id": 66, "time_stamp_s": 12, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e935a2a802f9a66eebc22a378b847d02719cc997c12a8f7c58dc9a5c07b1858c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0], "recent_frames_sha256": "58157cdee831b17eb416ccf65fd393aaa3aa707c1236921508c23fe38ddcc27b", "num_recent_frames": 13, "tq": 710260.658110988, "t1": 710272.511965524, "ta": 710272.511965524, "te": 710272.548976078, "first_response_s": 11.85385453607887, "answer_total_s": 11.890865090070292, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 66, "content_group": "8b9a7fdc984e30c2208e730da3a7e68845f5ab733b8bba8def21228ef634dbae", "question": {"question_id": "sample_66_a1147_q0", "video_id": 66, "video_path": "./videos/sample_66_real.mp4", "annotation_index": 1147, "question_index": 0, "question": "What are the hands in black gloves doing right now?", "options": ["A. Displaying the \"RIYA Milk Tea Gold\" mica powder packet.", "B. Opening another mica powder packet.", "C. Stirring the mixture in a small container.", "D. Cleaning the white plate."], "answer": "C", "time_stamp_s": 139, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_66_a1147_q0", "video_id": 66, "time_stamp_s": 139, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "beeba15c198596f449feb8b09f3f80097b29f91b78dd389bd06f28e59c8603d7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0], "recent_frames_sha256": "2035824a669484d170596aa7e7e31fd3403bf23549d148b3e6330e0fa65f7fb7", "num_recent_frames": 30, "tq": 710229.094025966, "t1": 710235.191555613, "ta": 710235.191555613, "te": 710235.23045464, "first_response_s": 6.097529646940529, "answer_total_s": 6.136428673984483, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_66_a1147_q0", "video_id": 66, "time_stamp_s": 139, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bf83452c3436fad00e17b061e4b02164970d98469e6039faa622ad41cb0f1a15", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Two bottles of 2-part epoxy resin (teal and purple) are held by gloved hands, labeled as \"RESIN\" and \"HARDENER\".  \n- A hand pours the teal resin from its bottle, with small packets of pigment (pink, black, gold) visible in the background.  \n- The text overlay identifies the materials as \"2 part Epoxy Resin\" and directs viewers to the video description for links.\n[30-60s] - Gloved hands hold a teal-labeled bottle, tilting it to dispense liquid into a clear container.\n- Three small packets (black, pink, beige) are positioned in the background, labeled \"WIS\" and \"WIS PRO\".\n- The container is placed on a flat surface, with the bottle's cap removed and set aside.\n[60-90s] - Hands in black gloves hold a clear plastic cup, positioning it over two small empty cups.  \n- A wooden stick is picked up and placed into the cup, preparing for mixing.  \n- Text overlay indicates \"Mix for 3 minutes\" as the mixing process begins.\n[90-120s] - Hands in black gloves pour white powder from a clear cup into a small container using a wooden stick.  \n- Gold flakes are poured from a jar into a separate small container, with the label \"Gold flakes\" appearing on screen.  \n- Three small clear containers are arranged on a white plate, with one already containing gold flakes and another holding white powder.", "history_tokens": 321, "history_utf8_bytes": 1306, "recent_frame_times_s": [110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0], "recent_frames_sha256": "2035824a669484d170596aa7e7e31fd3403bf23549d148b3e6330e0fa65f7fb7", "num_recent_frames": 30, "tq": 710308.494837651, "t1": 710315.369030264, "ta": 710315.369030264, "te": 710315.559540493, "first_response_s": 6.874192612944171, "answer_total_s": 7.0647028419189155, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 66, "content_group": "8b9a7fdc984e30c2208e730da3a7e68845f5ab733b8bba8def21228ef634dbae", "question": {"question_id": "sample_66_a1148_q0", "video_id": 66, "video_path": "./videos/sample_66_real.mp4", "annotation_index": 1148, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Pouring a pinkish mixture into a mold's middle compartment.", "B. Adjusting the mixture in the middle compartment with a wooden stick.", "C. Pouring the gold mixture into the top compartment and adjusting the flakes.", "D. Holding the transparent cup without pouring."], "answer": "C", "time_stamp_s": 259, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_66_a1148_q0", "video_id": 66, "time_stamp_s": 259, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a290d860812b16f56bbdd4d09e8038da5572886f1abef1fff75c34eecbde8f47", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0], "recent_frames_sha256": "0c1e9c5fe25411436549ad6981232120e62a433e258421e9e34d6eb675e48747", "num_recent_frames": 30, "tq": 710235.251592634, "t1": 710246.444775297, "ta": 710246.444775297, "te": 710246.515528338, "first_response_s": 11.19318266294431, "answer_total_s": 11.263935704017058, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_66_a1148_q0", "video_id": 66, "time_stamp_s": 259, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6e97108e54ad6cd16f3f35b18a9dbf5fa1f176e9f8d752e0033529d5734caba0", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Two bottles of 2-part epoxy resin (teal and purple) are held by gloved hands, labeled as \"RESIN\" and \"HARDENER\".  \n- A hand pours the teal resin from its bottle, with small packets of pigment (pink, black, gold) visible in the background.  \n- The text overlay identifies the materials as \"2 part Epoxy Resin\" and directs viewers to the video description for links.\n[30-60s] - Gloved hands hold a teal-labeled bottle, tilting it to dispense liquid into a clear container.\n- Three small packets (black, pink, beige) are positioned in the background, labeled \"WIS\" and \"WIS PRO\".\n- The container is placed on a flat surface, with the bottle's cap removed and set aside.\n[60-90s] - Hands in black gloves hold a clear plastic cup, positioning it over two small empty cups.  \n- A wooden stick is picked up and placed into the cup, preparing for mixing.  \n- Text overlay indicates \"Mix for 3 minutes\" as the mixing process begins.\n[90-120s] - Hands in black gloves pour white powder from a clear cup into a small container using a wooden stick.  \n- Gold flakes are poured from a jar into a separate small container, with the label \"Gold flakes\" appearing on screen.  \n- Three small clear containers are arranged on a white plate, with one already containing gold flakes and another holding white powder.\n[120-150s] - Hands in black gloves pour a beige liquid from a container into a small cup using a wooden stick.  \n- A pink packet labeled \"RIYA Glitter Pack\" is held up, showing its contents.  \n- Two small white cups with white powder are visible on the right side of the frame.\n[150-180s] - Hands in black gloves pour pink liquid from a small container into a white paper plate using a wooden stick.  \n- A clear plastic cup with a wooden stick inside is positioned on the plate, and the pink liquid is being transferred into it.  \n- A black bag labeled \"RIYA\" is held by the gloved hands, suggesting it contains a substance to be added to the mixture.\n[180-210s] - Hands in black gloves pour gold glitter from a clear container into a transparent mold using a wooden stick.  \n- The mold is placed on a pink mat inside a black tray, with two identical molds already partially filled with glitter.  \n- Glitter is transferred in small portions, with the stick guiding the flow into the mold's designated section.\n[210-240s] - Hands in black gloves pour golden liquid from a small cup into a clear rectangular mold, using a wooden stick to guide the flow.  \n- The mold is placed on a pink mat inside a black tray, with two other identical molds already containing golden particles.  \n- A plastic cup with remaining golden particles and a wooden stick is visible in the upper right corner of the frame.", "history_tokens": 646, "history_utf8_bytes": 2704, "recent_frame_times_s": [230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0], "recent_frames_sha256": "0c1e9c5fe25411436549ad6981232120e62a433e258421e9e34d6eb675e48747", "num_recent_frames": 30, "tq": 710347.320217232, "t1": 710354.510104545, "ta": 710354.510104545, "te": 710354.771616787, "first_response_s": 7.189887313055806, "answer_total_s": 7.451399554964155, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 66, "content_group": "8b9a7fdc984e30c2208e730da3a7e68845f5ab733b8bba8def21228ef634dbae", "question": {"question_id": "sample_66_a1149_q0", "video_id": 66, "video_path": "./videos/sample_66_real.mp4", "annotation_index": 1149, "question_index": 0, "question": "What is happening with the gold sheet right now?", "options": ["A. The gold sheet is being painted.", "B. The cutting tool is engraving letters.", "C. The engravings are being cleaned.", "D. The sheet is being folded."], "answer": "C", "time_stamp_s": 386, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_66_a1149_q0", "video_id": 66, "time_stamp_s": 386, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5b1df43e378cd201feba7d30ab3035d3ee2c234d268f3958a73dfa2ff340bb8c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0], "recent_frames_sha256": "a6342e48d2d55593ff6c43465791b219bf51732abd3d147a99d0f2cfce5042ed", "num_recent_frames": 30, "tq": 710246.554113114, "t1": 710253.673043745, "ta": 710253.673043745, "te": 710253.711404037, "first_response_s": 7.118930630967952, "answer_total_s": 7.157290922943503, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_66_a1149_q0", "video_id": 66, "time_stamp_s": 386, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ca4ef3b9ba751c7b3ec8c081d22bb2ec4130152bb40d494261c6c536ef748991", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Two bottles of 2-part epoxy resin (teal and purple) are held by gloved hands, labeled as \"RESIN\" and \"HARDENER\".  \n- A hand pours the teal resin from its bottle, with small packets of pigment (pink, black, gold) visible in the background.  \n- The text overlay identifies the materials as \"2 part Epoxy Resin\" and directs viewers to the video description for links.\n[30-60s] - Gloved hands hold a teal-labeled bottle, tilting it to dispense liquid into a clear container.\n- Three small packets (black, pink, beige) are positioned in the background, labeled \"WIS\" and \"WIS PRO\".\n- The container is placed on a flat surface, with the bottle's cap removed and set aside.\n[60-90s] - Hands in black gloves hold a clear plastic cup, positioning it over two small empty cups.  \n- A wooden stick is picked up and placed into the cup, preparing for mixing.  \n- Text overlay indicates \"Mix for 3 minutes\" as the mixing process begins.\n[90-120s] - Hands in black gloves pour white powder from a clear cup into a small container using a wooden stick.  \n- Gold flakes are poured from a jar into a separate small container, with the label \"Gold flakes\" appearing on screen.  \n- Three small clear containers are arranged on a white plate, with one already containing gold flakes and another holding white powder.\n[120-150s] - Hands in black gloves pour a beige liquid from a container into a small cup using a wooden stick.  \n- A pink packet labeled \"RIYA Glitter Pack\" is held up, showing its contents.  \n- Two small white cups with white powder are visible on the right side of the frame.\n[150-180s] - Hands in black gloves pour pink liquid from a small container into a white paper plate using a wooden stick.  \n- A clear plastic cup with a wooden stick inside is positioned on the plate, and the pink liquid is being transferred into it.  \n- A black bag labeled \"RIYA\" is held by the gloved hands, suggesting it contains a substance to be added to the mixture.\n[180-210s] - Hands in black gloves pour gold glitter from a clear container into a transparent mold using a wooden stick.  \n- The mold is placed on a pink mat inside a black tray, with two identical molds already partially filled with glitter.  \n- Glitter is transferred in small portions, with the stick guiding the flow into the mold's designated section.\n[210-240s] - Hands in black gloves pour golden liquid from a small cup into a clear rectangular mold, using a wooden stick to guide the flow.  \n- The mold is placed on a pink mat inside a black tray, with two other identical molds already containing golden particles.  \n- A plastic cup with remaining golden particles and a wooden stick is visible in the upper right corner of the frame.\n[240-270s] - Gloved hands hold a wooden stick, stirring pink resin in a small container.  \n- Three rectangular molds on a pink mat contain resin and gold flakes; one is being stirred while others remain static.  \n- A clear plastic container with gold flakes and a wooden stick is positioned to the right, ready for use.\n[270-300s] - Gloved hand holds a wooden stick, poised to apply black resin to a rectangular mold filled with gold flakes.  \n- Black resin is dispensed from a small bottle into the mold, with the stick used to spread it evenly.  \n- The mold is positioned on a pink mat inside a black tray, alongside two other molds containing pink and gold resin.\n[300-330s] - Hands in black gloves pour golden glitter mixture into a clear container using a wooden stick.  \n- Three rectangular molds on a pink mat hold partially filled resin with glitter; top mold contains black resin with gold glitter.  \n- A clear plastic cup with remaining glitter mixture is held by the left hand, positioned near the molds.\n[330-360s] - Hands in black gloves pour gold glitter into a clear rectangular mold on a pink mat.  \n- A small cup of clear liquid is used to pour into another mold, followed by a dark liquid.  \n- A heat gun is used to apply heat to the molds, likely to cure the resin.", "history_tokens": 947, "history_utf8_bytes": 3989, "recent_frame_times_s": [357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0], "recent_frames_sha256": "a6342e48d2d55593ff6c43465791b219bf51732abd3d147a99d0f2cfce5042ed", "num_recent_frames": 30, "tq": 710390.381404927, "t1": 710397.758740816, "ta": 710397.758740816, "te": 710398.021240747, "first_response_s": 7.377335889032111, "answer_total_s": 7.639835819951259, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 66, "content_group": "8b9a7fdc984e30c2208e730da3a7e68845f5ab733b8bba8def21228ef634dbae", "question": {"question_id": "sample_66_a1150_q0", "video_id": 66, "video_path": "./videos/sample_66_real.mp4", "annotation_index": 1150, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Writing on a gray grid mat.", "B. Supplementing the edges of the black nameplate with gold.", "C. Picking up another name tag.", "D. Inspecting the marker closely."], "answer": "B", "time_stamp_s": 499, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_66_a1150_q0", "video_id": 66, "time_stamp_s": 499, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0b98f4c71ca8caaf49022285e45b6d5791d2d80448d3395c586301c4b83168a2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0], "recent_frames_sha256": "3bfe15a3268451bc575910a44e8f0c6c56c8222f9976e1d8ffdd11ee6fee6d43", "num_recent_frames": 30, "tq": 710253.72424417, "t1": 710260.612368492, "ta": 710260.612368492, "te": 710260.649826804, "first_response_s": 6.88812432193663, "answer_total_s": 6.925582633935846, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_66_a1150_q0", "video_id": 66, "time_stamp_s": 499, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a90c83e944e9198fa65efbe66dcf85494e46dde37e625c0d398ba720dc6ff023", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Hands in black gloves pour white powder from a clear cup into a small container using a wooden stick.  \n- Gold flakes are poured from a jar into a separate small container, with the label \"Gold flakes\" appearing on screen.  \n- Three small clear containers are arranged on a white plate, with one already containing gold flakes and another holding white powder.\n[120-150s] - Hands in black gloves pour a beige liquid from a container into a small cup using a wooden stick.  \n- A pink packet labeled \"RIYA Glitter Pack\" is held up, showing its contents.  \n- Two small white cups with white powder are visible on the right side of the frame.\n[150-180s] - Hands in black gloves pour pink liquid from a small container into a white paper plate using a wooden stick.  \n- A clear plastic cup with a wooden stick inside is positioned on the plate, and the pink liquid is being transferred into it.  \n- A black bag labeled \"RIYA\" is held by the gloved hands, suggesting it contains a substance to be added to the mixture.\n[180-210s] - Hands in black gloves pour gold glitter from a clear container into a transparent mold using a wooden stick.  \n- The mold is placed on a pink mat inside a black tray, with two identical molds already partially filled with glitter.  \n- Glitter is transferred in small portions, with the stick guiding the flow into the mold's designated section.\n[210-240s] - Hands in black gloves pour golden liquid from a small cup into a clear rectangular mold, using a wooden stick to guide the flow.  \n- The mold is placed on a pink mat inside a black tray, with two other identical molds already containing golden particles.  \n- A plastic cup with remaining golden particles and a wooden stick is visible in the upper right corner of the frame.\n[240-270s] - Gloved hands hold a wooden stick, stirring pink resin in a small container.  \n- Three rectangular molds on a pink mat contain resin and gold flakes; one is being stirred while others remain static.  \n- A clear plastic container with gold flakes and a wooden stick is positioned to the right, ready for use.\n[270-300s] - Gloved hand holds a wooden stick, poised to apply black resin to a rectangular mold filled with gold flakes.  \n- Black resin is dispensed from a small bottle into the mold, with the stick used to spread it evenly.  \n- The mold is positioned on a pink mat inside a black tray, alongside two other molds containing pink and gold resin.\n[300-330s] - Hands in black gloves pour golden glitter mixture into a clear container using a wooden stick.  \n- Three rectangular molds on a pink mat hold partially filled resin with glitter; top mold contains black resin with gold glitter.  \n- A clear plastic cup with remaining glitter mixture is held by the left hand, positioned near the molds.\n[330-360s] - Hands in black gloves pour gold glitter into a clear rectangular mold on a pink mat.  \n- A small cup of clear liquid is used to pour into another mold, followed by a dark liquid.  \n- A heat gun is used to apply heat to the molds, likely to cure the resin.\n[360-390s] - A Cricut machine cuts gold foil with a teal ink bottle nearby.  \n- Hands peel off a gold foil sticker from a white backing sheet.  \n- A white Cricut pen traces gold foil designs on a white cardstock.\n[390-420s] - Hands peel off a white sticker from a pink resin bar, revealing gold leaf embedded within.  \n- The sticker is carefully removed, leaving the resin bar with a decorative gold leaf pattern.  \n- The resin bar is held and displayed, showing the completed design with gold leaf and text.\n[420-450s] - Hands position a small white label with \"Bride\" text above a set of three decorated name tags.  \n- A black name tag with \"Maitre\" is being adjusted, with gold leaf accents visible on its surface.  \n- The label \"Bride\" is placed on the top row, aligning with the other name tags in a horizontal arrangement.\n[450-480s] - Hands peel off a white backing from a small, rectangular, pinkish label with gold glitter.  \n- The label is then held up, revealing a gold-inked name \"Liam\" on its surface.  \n- A gold marker with a purple label is picked up, positioned near the labels.", "history_tokens": 990, "history_utf8_bytes": 4150, "recent_frame_times_s": [470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0], "recent_frames_sha256": "3bfe15a3268451bc575910a44e8f0c6c56c8222f9976e1d8ffdd11ee6fee6d43", "num_recent_frames": 30, "tq": 710428.304997652, "t1": 710436.659464711, "ta": 710436.659464711, "te": 710436.869009727, "first_response_s": 8.354467059019953, "answer_total_s": 8.56401207507588, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 67, "content_group": "500a8d47fb67da70cafab1c8233d8250e98ccc34d3fa0a6434298e555b63cad7", "question": {"question_id": "sample_67_a571_q0", "video_id": 67, "video_path": "./videos/sample_67_real.mp4", "annotation_index": 571, "question_index": 0, "question": "What did the cursor do just now?", "options": ["A. Click on the 'Edit' button.", "B. Click on the 'Upload Image' button.", "C. Drag a file into the upload area.", "D. Select a pattern fill option."], "answer": "B", "time_stamp_s": 8, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_67_a571_q0", "video_id": 67, "time_stamp_s": 8, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d064a0922bdca09bc45d01d920b716aeba9e5feba477076e7833175686e4999a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0], "recent_frames_sha256": "2b0d45a9450b8a893c7b129ee9f70b91060cc54c5ddc33c1a713a777927e4d86", "num_recent_frames": 9, "tq": 710436.91665737, "t1": 710443.754010078, "ta": 710443.754010078, "te": 710443.793767014, "first_response_s": 6.837352707982063, "answer_total_s": 6.8771096440032125, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_67_a571_q0", "video_id": 67, "time_stamp_s": 8, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7d0b3f3d771e3fdd4e652f0f7cd0a0fad0c1a1e0d05be5757feb4f24ef4515ed", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0], "recent_frames_sha256": "2b0d45a9450b8a893c7b129ee9f70b91060cc54c5ddc33c1a713a777927e4d86", "num_recent_frames": 9, "tq": 710486.883076332, "t1": 710499.005872963, "ta": 710499.005872963, "te": 710499.225027274, "first_response_s": 12.122796630952507, "answer_total_s": 12.341950941947289, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 67, "content_group": "500a8d47fb67da70cafab1c8233d8250e98ccc34d3fa0a6434298e555b63cad7", "question": {"question_id": "sample_67_a572_q0", "video_id": 67, "video_path": "./videos/sample_67_real.mp4", "annotation_index": 572, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Adjusting the positioning of the soccer ball outline.", "B. Reorganizing the \"Home\" name tag.", "C. Tearing off the paper from the back of the white ring.", "D. Weeding the \"Tracy\" decal."], "answer": "C", "time_stamp_s": 139, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_67_a572_q0", "video_id": 67, "time_stamp_s": 139, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c2a211cf7ddf960e96c7badc133b72fd64ccf2c95a9c1b2e17f85e7fbfbae6d0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0], "recent_frames_sha256": "e79fcf493a3600dc2ee00d35745fcf6fee5dfd331ab6cb21c8f25a74ec36f90b", "num_recent_frames": 30, "tq": 710443.818840838, "t1": 710456.66247623, "ta": 710456.66247623, "te": 710456.700402172, "first_response_s": 12.843635391909629, "answer_total_s": 12.881561334012076, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_67_a572_q0", "video_id": 67, "time_stamp_s": 139, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5b5999a8f8479c592de079f3a474d6daa78f1a03b3fd25e7e56436fdc48f4c7b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cricut Design Space interface displays uploaded images including various sports balls.  \n- User selects and imports an SVG file, with a note indicating the file is linked in the description.  \n- Screen transitions to show the sports ball images arranged on a grid, ready for editing or cutting.\n[30-60s] - Cricut machine head moves horizontally over a blue mat with colored paper pieces.  \n- A hand adjusts the mat’s position, revealing a black rectangle and red/orange squares.  \n- The machine head pauses above a yellow, blue, and pink square, then moves to the right.\n[60-90s] - A hand uses a white marker to trace a circular pattern on a white sheet of material.  \n- The hand then rolls the white sheet into a cylindrical shape, securing it with a black clip.  \n- The rolled sheet is positioned on a grid mat, with colored sheets (orange, yellow, red) nearby.\n[90-120s] - Hands use a white marker to trace a black circular design on a white sticker sheet.  \n- A roll of white material and colored sheets (orange, pink, yellow) are arranged nearby on a grid mat.  \n- The person places a red marker on a white sticker with a circular design, then moves to a yellow sticker with a tennis ball design.", "history_tokens": 285, "history_utf8_bytes": 1213, "recent_frame_times_s": [110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0], "recent_frames_sha256": "e79fcf493a3600dc2ee00d35745fcf6fee5dfd331ab6cb21c8f25a74ec36f90b", "num_recent_frames": 30, "tq": 710529.935914269, "t1": 710536.804283843, "ta": 710536.804283843, "te": 710537.066413937, "first_response_s": 6.868369574076496, "answer_total_s": 7.130499668070115, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 67, "content_group": "500a8d47fb67da70cafab1c8233d8250e98ccc34d3fa0a6434298e555b63cad7", "question": {"question_id": "sample_67_a573_q0", "video_id": 67, "video_path": "./videos/sample_67_real.mp4", "annotation_index": 573, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Removing the transparent covering from the \"JOSH\" item.", "B. Holding the white circular item aloft for inspection.", "C. Removing the thin film from the surface of the green tennis ball icon.", "D. Reaching for another adhesive design."], "answer": "C", "time_stamp_s": 276, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_67_a573_q0", "video_id": 67, "time_stamp_s": 276, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a8ec610cf05f9e08ac6fb352da44330c8a2cb90c264f6c2fdc4daf4d03d9a9af", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0], "recent_frames_sha256": "7efd2ac97de5cb7622659d164254b1a4deedd47fc85a4e63ac83ba0b87f6a797", "num_recent_frames": 30, "tq": 710456.719592269, "t1": 710464.279491253, "ta": 710464.279491253, "te": 710464.317938597, "first_response_s": 7.559898983919993, "answer_total_s": 7.598346328013577, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_67_a573_q0", "video_id": 67, "time_stamp_s": 276, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e3b440bdeeccc694bc837e1ac4cf274356c48f5214d6353b600248a87194b96b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cricut Design Space interface displays uploaded images including various sports balls.  \n- User selects and imports an SVG file, with a note indicating the file is linked in the description.  \n- Screen transitions to show the sports ball images arranged on a grid, ready for editing or cutting.\n[30-60s] - Cricut machine head moves horizontally over a blue mat with colored paper pieces.  \n- A hand adjusts the mat’s position, revealing a black rectangle and red/orange squares.  \n- The machine head pauses above a yellow, blue, and pink square, then moves to the right.\n[60-90s] - A hand uses a white marker to trace a circular pattern on a white sheet of material.  \n- The hand then rolls the white sheet into a cylindrical shape, securing it with a black clip.  \n- The rolled sheet is positioned on a grid mat, with colored sheets (orange, yellow, red) nearby.\n[90-120s] - Hands use a white marker to trace a black circular design on a white sticker sheet.  \n- A roll of white material and colored sheets (orange, pink, yellow) are arranged nearby on a grid mat.  \n- The person places a red marker on a white sticker with a circular design, then moves to a yellow sticker with a tennis ball design.\n[120-150s] - Hands manipulate a circular sticker with a basketball design, placing it near a red circular sticker.  \n- A white plastic tool is used to adjust or press down the circular sticker.  \n- Stickers labeled \"Mary\" and \"Honey\" are positioned nearby, with a stack of white paper sheets in the background.\n[150-180s] - Hands hold a black circular cutout with a grid pattern, positioning it over a white circular base.  \n- A needle is used to pierce the black cutout, then the hands manipulate the cutout to align it with the white base.  \n- The black cutout is then placed onto the white base, with the hands adjusting its position for alignment.\n[180-210s] - Hands manipulate a black circular cutout with a basketball design, positioning it near an orange circular piece.  \n- Orange circle is placed onto a white square backing, then the square is folded over the circle.  \n- A white paper with \"Mary\" printed on it is visible in the background, alongside other paper items.\n[210-240s] - Hands hold a small orange circular object, likely a sticker or craft item, and rotate it to show its design.  \n- A white marker is used to draw a basketball graphic on the orange circle.  \n- The hands then place a small white paper strip over the basketball design, possibly to mask or protect it.\n[240-270s] - Hands hold a small, round, orange basketball sticker with \"Jasen\" printed on it, positioned centrally on a grid mat.  \n- A Cricut tool is used to carefully peel off a clear protective layer from the sticker.  \n- A yellow tennis ball is placed on the mat, and the hands begin to peel off its adhesive backing, preparing it for attachment.", "history_tokens": 678, "history_utf8_bytes": 2856, "recent_frame_times_s": [247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0], "recent_frames_sha256": "7efd2ac97de5cb7622659d164254b1a4deedd47fc85a4e63ac83ba0b87f6a797", "num_recent_frames": 30, "tq": 710572.108618634, "t1": 710573.673709786, "ta": 710573.673709786, "te": 710573.973406701, "first_response_s": 1.565091151976958, "answer_total_s": 1.8647880669450387, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 67, "content_group": "500a8d47fb67da70cafab1c8233d8250e98ccc34d3fa0a6434298e555b63cad7", "question": {"question_id": "sample_67_a574_q0", "video_id": 67, "video_path": "./videos/sample_67_real.mp4", "annotation_index": 574, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Tearing the name \"JOSH\" sticker.", "B. Applying the \"Nathan\" name card to the baseball sticker.", "C. Cutting a new circular sticker.", "D. Reaching for the \"Ryan\" sticker."], "answer": "B", "time_stamp_s": 376, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_67_a574_q0", "video_id": 67, "time_stamp_s": 376, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "aae3c722c0c5cd1fb116b9f7c406c181664dfe3cc0c683d524df56b73f25832b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0], "recent_frames_sha256": "e7bfca75ac0b7ad2d11fe33dd5050279ca132b85ee30cae9a1bddbba311e2320", "num_recent_frames": 30, "tq": 710464.335309199, "t1": 710476.08777841, "ta": 710476.08777841, "te": 710476.125246674, "first_response_s": 11.752469210885465, "answer_total_s": 11.789937474997714, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_67_a574_q0", "video_id": 67, "time_stamp_s": 376, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "953e7226ff3b55cd091962cbabebc41b4044407b0869ef52c72a36df12ff59ba", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cricut Design Space interface displays uploaded images including various sports balls.  \n- User selects and imports an SVG file, with a note indicating the file is linked in the description.  \n- Screen transitions to show the sports ball images arranged on a grid, ready for editing or cutting.\n[30-60s] - Cricut machine head moves horizontally over a blue mat with colored paper pieces.  \n- A hand adjusts the mat’s position, revealing a black rectangle and red/orange squares.  \n- The machine head pauses above a yellow, blue, and pink square, then moves to the right.\n[60-90s] - A hand uses a white marker to trace a circular pattern on a white sheet of material.  \n- The hand then rolls the white sheet into a cylindrical shape, securing it with a black clip.  \n- The rolled sheet is positioned on a grid mat, with colored sheets (orange, yellow, red) nearby.\n[90-120s] - Hands use a white marker to trace a black circular design on a white sticker sheet.  \n- A roll of white material and colored sheets (orange, pink, yellow) are arranged nearby on a grid mat.  \n- The person places a red marker on a white sticker with a circular design, then moves to a yellow sticker with a tennis ball design.\n[120-150s] - Hands manipulate a circular sticker with a basketball design, placing it near a red circular sticker.  \n- A white plastic tool is used to adjust or press down the circular sticker.  \n- Stickers labeled \"Mary\" and \"Honey\" are positioned nearby, with a stack of white paper sheets in the background.\n[150-180s] - Hands hold a black circular cutout with a grid pattern, positioning it over a white circular base.  \n- A needle is used to pierce the black cutout, then the hands manipulate the cutout to align it with the white base.  \n- The black cutout is then placed onto the white base, with the hands adjusting its position for alignment.\n[180-210s] - Hands manipulate a black circular cutout with a basketball design, positioning it near an orange circular piece.  \n- Orange circle is placed onto a white square backing, then the square is folded over the circle.  \n- A white paper with \"Mary\" printed on it is visible in the background, alongside other paper items.\n[210-240s] - Hands hold a small orange circular object, likely a sticker or craft item, and rotate it to show its design.  \n- A white marker is used to draw a basketball graphic on the orange circle.  \n- The hands then place a small white paper strip over the basketball design, possibly to mask or protect it.\n[240-270s] - Hands hold a small, round, orange basketball sticker with \"Jasen\" printed on it, positioned centrally on a grid mat.  \n- A Cricut tool is used to carefully peel off a clear protective layer from the sticker.  \n- A yellow tennis ball is placed on the mat, and the hands begin to peel off its adhesive backing, preparing it for attachment.\n[270-300s] - Hands hold a yellow tennis ball, manipulating it with fingers while a silver marker is nearby.  \n- A white paper with \"Bryan\" printed on it is being folded and adjusted by the hands.  \n- Other items, including a basketball sticker, a \"Jesuit\" sticker, and a \"Mary\" sticker, remain stationary on the grid surface.\n[300-330s] - Hands position a yellow tennis ball sticker with \"Ryan\" printed on it, centering it on a grid mat.  \n- A circular transparent sticker is picked up and placed near the tennis ball sticker.  \n- A white paper cutout with a curved line is held and positioned beside the circular sticker.\n[330-360s] - Hands manipulate a white circular sticker, positioning it centrally on a grid surface.  \n- A baseball-shaped sticker is picked up and aligned with the circular sticker, preparing for attachment.  \n- Stickers labeled \"Hagan\" and \"Harg\" are visible nearby, suggesting a collection or assembly process.", "history_tokens": 903, "history_utf8_bytes": 3792, "recent_frame_times_s": [347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0], "recent_frames_sha256": "e7bfca75ac0b7ad2d11fe33dd5050279ca132b85ee30cae9a1bddbba311e2320", "num_recent_frames": 30, "tq": 710599.683929904, "t1": 710601.489333855, "ta": 710601.489333855, "te": 710601.65017011, "first_response_s": 1.8054039509734139, "answer_total_s": 1.966240206034854, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 67, "content_group": "500a8d47fb67da70cafab1c8233d8250e98ccc34d3fa0a6434298e555b63cad7", "question": {"question_id": "sample_67_a575_q0", "video_id": 67, "video_path": "./videos/sample_67_real.mp4", "annotation_index": 575, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Pouring the liquid into the cup.", "B. Placing the cap back on the first bottle.", "C. Pouring the white granules from the pink bottle slowly into the cup.", "D. Holding the cup and bottle separately."], "answer": "C", "time_stamp_s": 499, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_67_a575_q0", "video_id": 67, "time_stamp_s": 499, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "81409aa877d36cd9d9fca4dc5a5cb2c2e1ac3ac7ed2b86bf7eddde320cdd36bc", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0], "recent_frames_sha256": "2f0abe4aaae6bfa88a4274a31d4ef0fc46c3f2b06b99a96e3c6c1c417803cf61", "num_recent_frames": 30, "tq": 710476.141785152, "t1": 710486.827788571, "ta": 710486.827788571, "te": 710486.864698887, "first_response_s": 10.686003418988548, "answer_total_s": 10.722913734964095, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_67_a575_q0", "video_id": 67, "time_stamp_s": 499, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d96341dcdfcbb61fbe33dc5f569c7588f0a4c68593bf9f1b46c28efe79df6d1b", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Hands use a white marker to trace a black circular design on a white sticker sheet.  \n- A roll of white material and colored sheets (orange, pink, yellow) are arranged nearby on a grid mat.  \n- The person places a red marker on a white sticker with a circular design, then moves to a yellow sticker with a tennis ball design.\n[120-150s] - Hands manipulate a circular sticker with a basketball design, placing it near a red circular sticker.  \n- A white plastic tool is used to adjust or press down the circular sticker.  \n- Stickers labeled \"Mary\" and \"Honey\" are positioned nearby, with a stack of white paper sheets in the background.\n[150-180s] - Hands hold a black circular cutout with a grid pattern, positioning it over a white circular base.  \n- A needle is used to pierce the black cutout, then the hands manipulate the cutout to align it with the white base.  \n- The black cutout is then placed onto the white base, with the hands adjusting its position for alignment.\n[180-210s] - Hands manipulate a black circular cutout with a basketball design, positioning it near an orange circular piece.  \n- Orange circle is placed onto a white square backing, then the square is folded over the circle.  \n- A white paper with \"Mary\" printed on it is visible in the background, alongside other paper items.\n[210-240s] - Hands hold a small orange circular object, likely a sticker or craft item, and rotate it to show its design.  \n- A white marker is used to draw a basketball graphic on the orange circle.  \n- The hands then place a small white paper strip over the basketball design, possibly to mask or protect it.\n[240-270s] - Hands hold a small, round, orange basketball sticker with \"Jasen\" printed on it, positioned centrally on a grid mat.  \n- A Cricut tool is used to carefully peel off a clear protective layer from the sticker.  \n- A yellow tennis ball is placed on the mat, and the hands begin to peel off its adhesive backing, preparing it for attachment.\n[270-300s] - Hands hold a yellow tennis ball, manipulating it with fingers while a silver marker is nearby.  \n- A white paper with \"Bryan\" printed on it is being folded and adjusted by the hands.  \n- Other items, including a basketball sticker, a \"Jesuit\" sticker, and a \"Mary\" sticker, remain stationary on the grid surface.\n[300-330s] - Hands position a yellow tennis ball sticker with \"Ryan\" printed on it, centering it on a grid mat.  \n- A circular transparent sticker is picked up and placed near the tennis ball sticker.  \n- A white paper cutout with a curved line is held and positioned beside the circular sticker.\n[330-360s] - Hands manipulate a white circular sticker, positioning it centrally on a grid surface.  \n- A baseball-shaped sticker is picked up and aligned with the circular sticker, preparing for attachment.  \n- Stickers labeled \"Hagan\" and \"Harg\" are visible nearby, suggesting a collection or assembly process.\n[360-390s] - Hands position a white baseball-shaped sticker with \"Dodgers\" text, aligning it under a purple and white cutting machine.  \n- A white paper cutout is placed beneath the baseball sticker, likely for alignment or support during cutting.  \n- The cutting machine is positioned to the right, with its lid open, ready for operation.\n[390-420s] - Hands hold a white circular object and a marker, preparing to write on it.  \n- A small white sticker with a black-and-white soccer ball design is placed beside the circular object.  \n- The circular object is positioned centrally on a grid mat, surrounded by other stickers and paper items.\n[420-450s] - Hands position a circular sticker with black and white pattern near a white rectangular sticker labeled \"Nancy\".\n- The sticker is then pressed onto the white sticker, aligning it centrally.\n- The sticker is slightly adjusted to ensure proper adhesion before being set in place.\n[450-480s] - Hands hold a circular transparent sticker with a black volleyball design, positioning it on a grid surface.  \n- A white rectangular sticker with pink cursive text \"Macy\" is picked up and aligned with the volleyball sticker.  \n- The \"Macy\" sticker is pressed onto the volleyball sticker, securing it in place.", "history_tokens": 985, "history_utf8_bytes": 4172, "recent_frame_times_s": [470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0], "recent_frames_sha256": "2f0abe4aaae6bfa88a4274a31d4ef0fc46c3f2b06b99a96e3c6c1c417803cf61", "num_recent_frames": 30, "tq": 710634.378660169, "t1": 710641.294178942, "ta": 710641.294178942, "te": 710641.481047162, "first_response_s": 6.9155187730211765, "answer_total_s": 7.102386993006803, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 68, "content_group": "38682db4bf80d5f2268336ac6c42908e5f76a360133e7a87235dd4c744a90063", "question": {"question_id": "sample_68_a375_q0", "video_id": 68, "video_path": "./videos/sample_68_real.mp4", "annotation_index": 375, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Zooming in on the plastic containers.", "B. Cutting along the line dividing the brown object.", "C. Peeling off a section of the brown object.", "D. Arranging flowers in the containers."], "answer": "C", "time_stamp_s": 19, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_68_a375_q0", "video_id": 68, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5ba4d58a043c939641b90eebc429040236c84c851fb5cbd66f8b12ccaed4b62a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "f5ac47241f6499118c94fc2d5d2aa70ce7d5acbdd6cd412c4cf56510b779153c", "num_recent_frames": 20, "tq": 719382.591777306, "t1": 719383.676776047, "ta": 719383.676776047, "te": 719383.717149073, "first_response_s": 1.0849987409310415, "answer_total_s": 1.1253717669751495, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_68_a375_q0", "video_id": 68, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "439d9267ef1832f1102d082a82112871899bdbc5ac1c546318b92850a4ee4a7b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "f5ac47241f6499118c94fc2d5d2aa70ce7d5acbdd6cd412c4cf56510b779153c", "num_recent_frames": 20, "tq": 719250.573475451, "t1": 719261.368619554, "ta": 719261.368619554, "te": 719261.557378473, "first_response_s": 10.795144103001803, "answer_total_s": 10.98390302201733, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 68, "content_group": "38682db4bf80d5f2268336ac6c42908e5f76a360133e7a87235dd4c744a90063", "question": {"question_id": "sample_68_a376_q0", "video_id": 68, "video_path": "./videos/sample_68_real.mp4", "annotation_index": 376, "question_index": 0, "question": "What is the gloved hand doing right now?", "options": ["A. Adjusting the heat on the stove top.", "B. Painting the coaster into a solid color.", "C. Adjusting the position of the flower on the brown ring.", "D. Picking up the coaster."], "answer": "C", "time_stamp_s": 120, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_68_a376_q0", "video_id": 68, "time_stamp_s": 120, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d640ff606e6f8b6ee6878c1de6bfae3d24a2316b983fe9fd480742b9a57e7179", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0], "recent_frames_sha256": "6e1bc209175c8910bf3fbe0fea82c75323bc18311b8c9fd319e33fa3d7de9adb", "num_recent_frames": 30, "tq": 719383.745200376, "t1": 719395.929816793, "ta": 719395.929816793, "te": 719396.15752306, "first_response_s": 12.184616416925564, "answer_total_s": 12.412322683958337, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_68_a376_q0", "video_id": 68, "time_stamp_s": 120, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0f829f2ad1dbe99777a55370ab89d6b86fd2d8b76e324ab600b297b307d972d9", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands in black gloves hold two clear plastic containers filled with colorful resin pieces above a blue mat.  \n- A circular brown base is positioned on the mat, with a white marker used to draw lines on its surface.  \n- A small cup containing resin is placed on the base, with a stirring tool inserted into it, indicating resin mixing preparation.\n[30-60s] - Hands in black gloves spread resin evenly across a circular mold using a wooden tool.  \n- Two plastic trays with colorful resin components and a cup of resin are positioned on the blue mat.  \n- The resin surface is smoothed and leveled as the tool moves across the mold.\n[60-90s] - Hands use tweezers to place small, colorful flower-shaped pieces onto a circular gold surface.  \n- A palette of watercolor paints and a container with a brush are positioned to the left.  \n- A thin stick and a metal tool are held in the right hand, ready for use.\n[90-120s] - A hand uses tweezers to position a small, colorful flower-shaped object on a circular gold-colored palette.  \n- The palette holds several other similarly styled floral and leaf-shaped objects, arranged in a circular pattern.  \n- A container of assorted colored liquids and a small cup with a wooden stirrer are visible in the background.", "history_tokens": 284, "history_utf8_bytes": 1263, "recent_frame_times_s": [91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0], "recent_frames_sha256": "6e1bc209175c8910bf3fbe0fea82c75323bc18311b8c9fd319e33fa3d7de9adb", "num_recent_frames": 30, "tq": 719291.96994165, "t1": 719293.427592353, "ta": 719293.427592353, "te": 719293.46563426, "first_response_s": 1.4576507029123604, "answer_total_s": 1.4956926099257544, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 68, "content_group": "38682db4bf80d5f2268336ac6c42908e5f76a360133e7a87235dd4c744a90063", "question": {"question_id": "sample_68_a377_q0", "video_id": 68, "video_path": "./videos/sample_68_real.mp4", "annotation_index": 377, "question_index": 0, "question": "What is the black-gloved hand doing right now?", "options": ["A. Repositioning the white ceramic bowl.", "B. Stirring the paintbrush in the bowl.", "C. Adjusting the flowers with a bamboo stick.", "D. Adjusting the blue cutting mat."], "answer": "C", "time_stamp_s": 206, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_68_a377_q0", "video_id": 68, "time_stamp_s": 206, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ca28b81ecd3dc674c007d2b37760f3fb3cb98e8fe312a6bec9ca142ea13e3eb1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0], "recent_frames_sha256": "9e52030bf932fe4495676ecb6c362b3790390e2c9172215bf106e372dbb8f400", "num_recent_frames": 30, "tq": 719396.180107062, "t1": 719402.983737386, "ta": 719402.983737386, "te": 719403.020583063, "first_response_s": 6.803630323964171, "answer_total_s": 6.8404760010307655, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_68_a377_q0", "video_id": 68, "time_stamp_s": 206, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8b2846f08397f340026e6b66baddda7c4e485f1394585d5d8e4fd9e137289579", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands in black gloves hold two clear plastic containers filled with colorful resin pieces above a blue mat.  \n- A circular brown base is positioned on the mat, with a white marker used to draw lines on its surface.  \n- A small cup containing resin is placed on the base, with a stirring tool inserted into it, indicating resin mixing preparation.\n[30-60s] - Hands in black gloves spread resin evenly across a circular mold using a wooden tool.  \n- Two plastic trays with colorful resin components and a cup of resin are positioned on the blue mat.  \n- The resin surface is smoothed and leveled as the tool moves across the mold.\n[60-90s] - Hands use tweezers to place small, colorful flower-shaped pieces onto a circular gold surface.  \n- A palette of watercolor paints and a container with a brush are positioned to the left.  \n- A thin stick and a metal tool are held in the right hand, ready for use.\n[90-120s] - A hand uses tweezers to position a small, colorful flower-shaped object on a circular gold-colored palette.  \n- The palette holds several other similarly styled floral and leaf-shaped objects, arranged in a circular pattern.  \n- A container of assorted colored liquids and a small cup with a wooden stirrer are visible in the background.\n[120-150s] - Gloved hand uses tweezers to pick up a small, white, cylindrical object from a transparent plastic case.  \n- The case, containing multiple compartments with colored items, is held open and positioned to the left of a circular palette with decorative elements.  \n- A container with a wooden stirrer and a blue liquid is visible in the top-left corner, while the palette rests centrally on a blue grid surface.\n[150-180s] - A hand in black gloves uses tweezers to pick up a small, colorful flower-shaped object from a circular palette.  \n- The palette, placed on a blue grid mat, holds multiple flower-shaped objects in various colors.  \n- A container of watercolor paints and a small cup with a wooden stirrer are visible to the left of the palette.", "history_tokens": 460, "history_utf8_bytes": 2025, "recent_frame_times_s": [177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0], "recent_frames_sha256": "9e52030bf932fe4495676ecb6c362b3790390e2c9172215bf106e372dbb8f400", "num_recent_frames": 30, "tq": 719310.246957988, "t1": 719317.803401794, "ta": 719317.803401794, "te": 719318.019391793, "first_response_s": 7.556443806039169, "answer_total_s": 7.772433804930188, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 68, "content_group": "38682db4bf80d5f2268336ac6c42908e5f76a360133e7a87235dd4c744a90063", "question": {"question_id": "sample_68_a378_q0", "video_id": 68, "video_path": "./videos/sample_68_real.mp4", "annotation_index": 378, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Pouring resin into the circular mold.", "B. Mixing colors in a bowl.", "C. Arranging flowers on a table.", "D. Stacking plastic cups."], "answer": "A", "time_stamp_s": 295, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_68_a378_q0", "video_id": 68, "time_stamp_s": 295, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "21114bad29782e4078b349d20063c239fb075f522de22d95d92f6c723135ab80", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0], "recent_frames_sha256": "0057507052eb70fa81a96cdaad775655b9a8eb601c4641e8b6263129336bf5a1", "num_recent_frames": 30, "tq": 719403.038693767, "t1": 719410.20769029, "ta": 719410.20769029, "te": 719410.245209479, "first_response_s": 7.16899652290158, "answer_total_s": 7.206515711965039, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_68_a378_q0", "video_id": 68, "time_stamp_s": 295, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5e0c65d34c33259d525f253fe1f2fb04d0b259ac9cfd8619254edbd2ef79d0a6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands in black gloves hold two clear plastic containers filled with colorful resin pieces above a blue mat.  \n- A circular brown base is positioned on the mat, with a white marker used to draw lines on its surface.  \n- A small cup containing resin is placed on the base, with a stirring tool inserted into it, indicating resin mixing preparation.\n[30-60s] - Hands in black gloves spread resin evenly across a circular mold using a wooden tool.  \n- Two plastic trays with colorful resin components and a cup of resin are positioned on the blue mat.  \n- The resin surface is smoothed and leveled as the tool moves across the mold.\n[60-90s] - Hands use tweezers to place small, colorful flower-shaped pieces onto a circular gold surface.  \n- A palette of watercolor paints and a container with a brush are positioned to the left.  \n- A thin stick and a metal tool are held in the right hand, ready for use.\n[90-120s] - A hand uses tweezers to position a small, colorful flower-shaped object on a circular gold-colored palette.  \n- The palette holds several other similarly styled floral and leaf-shaped objects, arranged in a circular pattern.  \n- A container of assorted colored liquids and a small cup with a wooden stirrer are visible in the background.\n[120-150s] - Gloved hand uses tweezers to pick up a small, white, cylindrical object from a transparent plastic case.  \n- The case, containing multiple compartments with colored items, is held open and positioned to the left of a circular palette with decorative elements.  \n- A container with a wooden stirrer and a blue liquid is visible in the top-left corner, while the palette rests centrally on a blue grid surface.\n[150-180s] - A hand in black gloves uses tweezers to pick up a small, colorful flower-shaped object from a circular palette.  \n- The palette, placed on a blue grid mat, holds multiple flower-shaped objects in various colors.  \n- A container of watercolor paints and a small cup with a wooden stirrer are visible to the left of the palette.\n[180-210s] - A hand in a black glove uses tweezers to pick up a small, clear plastic container from a palette.  \n- The hand then places the container onto the blue grid mat, positioning it near the palette.  \n- A wooden stick is used to gently tap or adjust a small object on the palette, possibly to reposition or stabilize it.\n[210-240s] - A gloved hand stirs paint on a circular palette with a stick, mixing colors.  \n- A small container with a wooden spoon and a blue liquid is positioned to the left.  \n- A metallic ring is placed on the blue mat to the right of the palette.\n[240-270s] - Hands in black gloves manipulate a thin stick over a circular tray holding colorful pressed flowers and small decorative items.\n- A small container with a wooden spoon and a crumpled gold foil wrapper are positioned to the left of the tray.\n- A silver ring lies to the right of the tray, remaining stationary throughout the segment.", "history_tokens": 682, "history_utf8_bytes": 2952, "recent_frame_times_s": [266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0], "recent_frames_sha256": "0057507052eb70fa81a96cdaad775655b9a8eb601c4641e8b6263129336bf5a1", "num_recent_frames": 30, "tq": 719335.597665167, "t1": 719336.634913304, "ta": 719336.634913304, "te": 719336.675912446, "first_response_s": 1.0372481370577589, "answer_total_s": 1.078247279045172, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 68, "content_group": "38682db4bf80d5f2268336ac6c42908e5f76a360133e7a87235dd4c744a90063", "question": {"question_id": "sample_68_a379_q0", "video_id": 68, "video_path": "./videos/sample_68_real.mp4", "annotation_index": 379, "question_index": 0, "question": "What action is being performed with the hands right now?", "options": ["A. Painting the circular object.", "B. Peeling off a gold-colored material.", "C. Polishing the circular object.", "D. Cutting the circular object into pieces."], "answer": "B", "time_stamp_s": 403, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_68_a379_q0", "video_id": 68, "time_stamp_s": 403, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6a3596fddf878187a6cb6645e3a134a680acc26eeb0a38ead854faed72b27edf", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0], "recent_frames_sha256": "dbe28ebcb83ed0a50eaab8ef9c369089e867ed659692ed772656db02873cac4e", "num_recent_frames": 30, "tq": 719410.26286177, "t1": 719418.155260233, "ta": 719418.155260233, "te": 719418.193786197, "first_response_s": 7.892398462980054, "answer_total_s": 7.9309244269970804, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_68_a379_q0", "video_id": 68, "time_stamp_s": 403, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "70c689447950c37612b282579ad684ec92a9ed06678d0bd734619823c7ef3b6b", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands in black gloves hold two clear plastic containers filled with colorful resin pieces above a blue mat.  \n- A circular brown base is positioned on the mat, with a white marker used to draw lines on its surface.  \n- A small cup containing resin is placed on the base, with a stirring tool inserted into it, indicating resin mixing preparation.\n[30-60s] - Hands in black gloves spread resin evenly across a circular mold using a wooden tool.  \n- Two plastic trays with colorful resin components and a cup of resin are positioned on the blue mat.  \n- The resin surface is smoothed and leveled as the tool moves across the mold.\n[60-90s] - Hands use tweezers to place small, colorful flower-shaped pieces onto a circular gold surface.  \n- A palette of watercolor paints and a container with a brush are positioned to the left.  \n- A thin stick and a metal tool are held in the right hand, ready for use.\n[90-120s] - A hand uses tweezers to position a small, colorful flower-shaped object on a circular gold-colored palette.  \n- The palette holds several other similarly styled floral and leaf-shaped objects, arranged in a circular pattern.  \n- A container of assorted colored liquids and a small cup with a wooden stirrer are visible in the background.\n[120-150s] - Gloved hand uses tweezers to pick up a small, white, cylindrical object from a transparent plastic case.  \n- The case, containing multiple compartments with colored items, is held open and positioned to the left of a circular palette with decorative elements.  \n- A container with a wooden stirrer and a blue liquid is visible in the top-left corner, while the palette rests centrally on a blue grid surface.\n[150-180s] - A hand in black gloves uses tweezers to pick up a small, colorful flower-shaped object from a circular palette.  \n- The palette, placed on a blue grid mat, holds multiple flower-shaped objects in various colors.  \n- A container of watercolor paints and a small cup with a wooden stirrer are visible to the left of the palette.\n[180-210s] - A hand in a black glove uses tweezers to pick up a small, clear plastic container from a palette.  \n- The hand then places the container onto the blue grid mat, positioning it near the palette.  \n- A wooden stick is used to gently tap or adjust a small object on the palette, possibly to reposition or stabilize it.\n[210-240s] - A gloved hand stirs paint on a circular palette with a stick, mixing colors.  \n- A small container with a wooden spoon and a blue liquid is positioned to the left.  \n- A metallic ring is placed on the blue mat to the right of the palette.\n[240-270s] - Hands in black gloves manipulate a thin stick over a circular tray holding colorful pressed flowers and small decorative items.\n- A small container with a wooden spoon and a crumpled gold foil wrapper are positioned to the left of the tray.\n- A silver ring lies to the right of the tray, remaining stationary throughout the segment.\n[270-300s] - Gloved hands hold a small, gold-wrapped object near a circular resin-coated plate with embedded flowers and leaves.  \n- A clear plastic cup with a wooden stirrer is positioned to the left, containing a light blue liquid.  \n- The right hand uses a tool to manipulate a thin, metallic ring near the plate, while the left hand prepares to place the gold-wrapped object onto the plate.\n[300-330s] - Hands in black gloves hold a clear plastic cup and a wooden stick, applying liquid to a circular, colorful resin-coated object.  \n- The resin object, embedded with various colored stones and glitter, rests on a blue grid mat.  \n- The wooden stick is used to spread the liquid evenly across the surface of the resin object.\n[330-360s] - Hands in black gloves hold a clear plastic cup and a small tool, positioning them over a circular, decorated object on a blue grid mat.  \n- The tool is used to gently manipulate or adjust the decorative elements on the circular object, which features colorful beads and metallic accents.  \n- The cup remains stationary, suggesting it may be used for pouring or holding liquid, though no liquid is visible in the cup at this moment.\n[360-390s] - Hands in black gloves apply a clear liquid from a cup onto a circular, decorated object using a brush.  \n- The object, featuring colorful gem-like embellishments, rests on a blue grid mat.  \n- After application, the object is removed from the frame, leaving the mat with the decorated item.", "history_tokens": 1021, "history_utf8_bytes": 4432, "recent_frame_times_s": [374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0], "recent_frames_sha256": "dbe28ebcb83ed0a50eaab8ef9c369089e867ed659692ed772656db02873cac4e", "num_recent_frames": 30, "tq": 719375.140742167, "t1": 719382.525390135, "ta": 719382.525390135, "te": 719382.563013385, "first_response_s": 7.3846479679923505, "answer_total_s": 7.422271218034439, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 70, "content_group": "24e89eecdbea079631c8aaca0d6489ded998e50a23a7042ccd55bb3d19588765", "question": {"question_id": "sample_70_a707_q0", "video_id": 70, "video_path": "./videos/sample_70_real.mp4", "annotation_index": 707, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Displaying the round wooden board engraved with \"Johnson\" on it.", "B. Engraving the word \"JOHNSON\" on the board.", "C. Changing the perspective of the view.", "D. Cleaning the cutting board with a cloth."], "answer": "A", "time_stamp_s": 20, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_70_a707_q0", "video_id": 70, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bf1ad8f857ccc0410d8a286d29ebaf1d8f11502952926219781c7f3297bdf511", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "c001762e43df70c36186678908aa3b75ad07867ac4d24c2c888f8f628332855e", "num_recent_frames": 21, "tq": 710018.721653163, "t1": 710020.638007857, "ta": 710020.638007857, "te": 710020.793197314, "first_response_s": 1.916354694054462, "answer_total_s": 2.0715441510546952, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_70_a707_q0", "video_id": 70, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8e122fe80df4530928f37a27b94a3a05fde7ab891656e9b25fe7543d565bc2ac", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "c001762e43df70c36186678908aa3b75ad07867ac4d24c2c888f8f628332855e", "num_recent_frames": 21, "tq": 710052.9081255, "t1": 710064.477424292, "ta": 710064.477424292, "te": 710064.703391504, "first_response_s": 11.569298792048357, "answer_total_s": 11.795266004046425, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 70, "content_group": "24e89eecdbea079631c8aaca0d6489ded998e50a23a7042ccd55bb3d19588765", "question": {"question_id": "sample_70_a708_q0", "video_id": 70, "video_path": "./videos/sample_70_real.mp4", "annotation_index": 708, "question_index": 0, "question": "What is happening to the computer screen design interface right now?", "options": ["A. The two black horizontal lines turned red.", "B. The design interface is closing suddenly.", "C. New icons are appearing in the toolbar.", "D. The mandala artwork is being deleted."], "answer": "A", "time_stamp_s": 161, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_70_a708_q0", "video_id": 70, "time_stamp_s": 161, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "51092e96d10532236145fc3ab7a31b1ec1d387995f7fb295d6ea73b35bf3f49a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0], "recent_frames_sha256": "a78b950d84c8ec37670c2c5ccda8a5550aba4bc42b767c018bc44a8184c65b3a", "num_recent_frames": 30, "tq": 710020.827649948, "t1": 710028.895189787, "ta": 710028.895189787, "te": 710029.118923049, "first_response_s": 8.067539839074016, "answer_total_s": 8.291273101000115, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_70_a708_q0", "video_id": 70, "time_stamp_s": 161, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5b75efeb61413f72be06f0618acf741565ae850dc908b3b1d20b01535899aa6d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A wooden cutting board with engraved \"JOHNSON\" and mandala design is held by hands over a grid mat.  \n- The video transitions to a screen showing \"Split Monogram Mandala\" text on a black background.  \n- A digital design software interface opens, displaying a grid and various icons under \"Mandala\" category.\n[30-60s] - User scrolls through a grid of 100+ design templates, selecting intricate mandala patterns.  \n- A detailed black-and-white mandala is selected and displayed in full view on the canvas.  \n- A selection tool is activated, with a crosshair cursor centered over the mandala, indicating readiness for editing or scaling.\n[60-90s] - A black rectangular overlay is centered over the mandala design, obscuring part of the image.  \n- The overlay remains static, covering the central area of the mandala without changing position or size.  \n- The \"Mandala\" text is visible within the overlay, indicating the design's name or label.\n[90-120s] - A black rectangular design with intricate patterns is selected and resized on a grid interface.  \n- The user clicks and drags the design to position it over a larger mandala drawing.  \n- A black rectangular selection box appears around the mandala, indicating it is being manipulated or prepared for further editing.\n[120-150s] - A black horizontal line is dragged across the center of a mandala design, splitting it into two halves.  \n- The line is adjusted to align precisely with the mandala’s symmetry, creating a clean division.  \n- The design remains static on the grid, with no visible changes to the mandala’s structure or color.", "history_tokens": 371, "history_utf8_bytes": 1604, "recent_frame_times_s": [132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0], "recent_frames_sha256": "a78b950d84c8ec37670c2c5ccda8a5550aba4bc42b767c018bc44a8184c65b3a", "num_recent_frames": 30, "tq": 710105.753782233, "t1": 710117.079628138, "ta": 710117.079628138, "te": 710117.123380268, "first_response_s": 11.32584590499755, "answer_total_s": 11.369598035002127, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 70, "content_group": "24e89eecdbea079631c8aaca0d6489ded998e50a23a7042ccd55bb3d19588765", "question": {"question_id": "sample_70_a709_q0", "video_id": 70, "video_path": "./videos/sample_70_real.mp4", "annotation_index": 709, "question_index": 0, "question": "What action is the viewer taking right now?", "options": ["A. Adjusting the font of the center.", "B. Adjusting the grid layout.", "C. Selecting a new tool.", "D. Zooming in on the mandala design."], "answer": "A", "time_stamp_s": 223, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_70_a709_q0", "video_id": 70, "time_stamp_s": 223, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9b52ac71527df1318f82fc86e400cbb377fed9bf0b39a632ff53c7716f3ce2eb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0], "recent_frames_sha256": "d062c44f3796854bbaf3ebbfc4d3594ca6c0d1c0ff2ff5d9c7446e382af1077c", "num_recent_frames": 30, "tq": 710029.158353277, "t1": 710036.058577866, "ta": 710036.058577866, "te": 710036.498330462, "first_response_s": 6.900224588927813, "answer_total_s": 7.339977185009047, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_70_a709_q0", "video_id": 70, "time_stamp_s": 223, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "88477cad27f77de64d1a037c98f2d649f071d68da8400f93ba9b249eb81fc03d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A wooden cutting board with engraved \"JOHNSON\" and mandala design is held by hands over a grid mat.  \n- The video transitions to a screen showing \"Split Monogram Mandala\" text on a black background.  \n- A digital design software interface opens, displaying a grid and various icons under \"Mandala\" category.\n[30-60s] - User scrolls through a grid of 100+ design templates, selecting intricate mandala patterns.  \n- A detailed black-and-white mandala is selected and displayed in full view on the canvas.  \n- A selection tool is activated, with a crosshair cursor centered over the mandala, indicating readiness for editing or scaling.\n[60-90s] - A black rectangular overlay is centered over the mandala design, obscuring part of the image.  \n- The overlay remains static, covering the central area of the mandala without changing position or size.  \n- The \"Mandala\" text is visible within the overlay, indicating the design's name or label.\n[90-120s] - A black rectangular design with intricate patterns is selected and resized on a grid interface.  \n- The user clicks and drags the design to position it over a larger mandala drawing.  \n- A black rectangular selection box appears around the mandala, indicating it is being manipulated or prepared for further editing.\n[120-150s] - A black horizontal line is dragged across the center of a mandala design, splitting it into two halves.  \n- The line is adjusted to align precisely with the mandala’s symmetry, creating a clean division.  \n- The design remains static on the grid, with no visible changes to the mandala’s structure or color.\n[150-180s] - Red horizontal lines are drawn across the mandala design, dividing it into sections.  \n- The lines appear to be aligned with the mandala’s symmetry, suggesting a design or measurement tool is being used.  \n- The mandala remains static while the lines are being added, indicating a drawing or editing process in progress.\n[180-210s] - A black-and-white mandala design is centered on a grid, with a red horizontal line drawn across its middle.  \n- The red line is positioned to divide the mandala into two symmetrical halves, with the top and bottom portions of the design visible above and below the line.  \n- The design remains static, with no visible movement or interaction with other elements in the interface.", "history_tokens": 534, "history_utf8_bytes": 2333, "recent_frame_times_s": [194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0], "recent_frames_sha256": "d062c44f3796854bbaf3ebbfc4d3594ca6c0d1c0ff2ff5d9c7446e382af1077c", "num_recent_frames": 30, "tq": 710135.757162365, "t1": 710142.017189018, "ta": 710142.017189018, "te": 710142.055238216, "first_response_s": 6.2600266529479995, "answer_total_s": 6.298075850936584, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 70, "content_group": "24e89eecdbea079631c8aaca0d6489ded998e50a23a7042ccd55bb3d19588765", "question": {"question_id": "sample_70_a710_q0", "video_id": 70, "video_path": "./videos/sample_70_real.mp4", "annotation_index": 710, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Peeling off the stickers on the picture one by one.", "B. Adjusting tape.", "C. Using a lint roller.", "D. Cutting the paper."], "answer": "A", "time_stamp_s": 379, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_70_a710_q0", "video_id": 70, "time_stamp_s": 379, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0ed1f3d4969e5fa72d7b2649cba3f10a0d8041c2b3b6a1788c8365443eab2996", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0], "recent_frames_sha256": "47436ac5b996a6ade543cb920aca54559689dafd1fa5b36f4935a13248ca0fb5", "num_recent_frames": 30, "tq": 710036.513146599, "t1": 710046.708072352, "ta": 710046.708072352, "te": 710046.745267796, "first_response_s": 10.194925752934068, "answer_total_s": 10.232121196924709, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_70_a710_q0", "video_id": 70, "time_stamp_s": 379, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9e6a6aa16123400a80fe783202063c62d41c951ab4d4841c1f59836e60d3b97c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A wooden cutting board with engraved \"JOHNSON\" and mandala design is held by hands over a grid mat.  \n- The video transitions to a screen showing \"Split Monogram Mandala\" text on a black background.  \n- A digital design software interface opens, displaying a grid and various icons under \"Mandala\" category.\n[30-60s] - User scrolls through a grid of 100+ design templates, selecting intricate mandala patterns.  \n- A detailed black-and-white mandala is selected and displayed in full view on the canvas.  \n- A selection tool is activated, with a crosshair cursor centered over the mandala, indicating readiness for editing or scaling.\n[60-90s] - A black rectangular overlay is centered over the mandala design, obscuring part of the image.  \n- The overlay remains static, covering the central area of the mandala without changing position or size.  \n- The \"Mandala\" text is visible within the overlay, indicating the design's name or label.\n[90-120s] - A black rectangular design with intricate patterns is selected and resized on a grid interface.  \n- The user clicks and drags the design to position it over a larger mandala drawing.  \n- A black rectangular selection box appears around the mandala, indicating it is being manipulated or prepared for further editing.\n[120-150s] - A black horizontal line is dragged across the center of a mandala design, splitting it into two halves.  \n- The line is adjusted to align precisely with the mandala’s symmetry, creating a clean division.  \n- The design remains static on the grid, with no visible changes to the mandala’s structure or color.\n[150-180s] - Red horizontal lines are drawn across the mandala design, dividing it into sections.  \n- The lines appear to be aligned with the mandala’s symmetry, suggesting a design or measurement tool is being used.  \n- The mandala remains static while the lines are being added, indicating a drawing or editing process in progress.\n[180-210s] - A black-and-white mandala design is centered on a grid, with a red horizontal line drawn across its middle.  \n- The red line is positioned to divide the mandala into two symmetrical halves, with the top and bottom portions of the design visible above and below the line.  \n- The design remains static, with no visible movement or interaction with other elements in the interface.\n[210-240s] - The text \"JOHNSON\" is typed into the active text box, centered horizontally between two mandala designs.  \n- The text box is selected, with its bounding box highlighted, indicating it is ready for further editing or positioning.  \n- The \"Text\" menu is open, showing options for text formatting and alignment, suggesting the user is adjusting text properties.\n[240-270s] - The \"Johnson\" text is centered within a mandala design on a digital design interface.  \n- The design is displayed on a grid, indicating it is being prepared for cutting or printing.  \n- The interface shows \"Cricut Design Space\" with options for \"Print\" and \"Cut\" visible on the screen.\n[270-300s] - User selects \"Adhesive Foil\" from a dropdown menu under \"All Materials\" section.  \n- Interface transitions to a \"Custom material set for Adhesive Foil\" screen with icons for tools and material.  \n- Screen displays a \"Loading\" animation over a grid background as the system processes the selection.\n[300-330s] - A \"Cutting\" animation appears on a digital interface, indicating the machine is preparing to cut.  \n- A green cutting mat is placed on a grid surface, with a dark, reflective sheet being positioned on top.  \n- The Cricut machine's cutting head descends toward the mat, ready to begin the cutting process.\n[330-360s] - A Cricut machine is shown with a dark gray cutting mat and a green mat underneath, positioned on a grid-patterned surface.\n- A person's hands are seen holding a white sheet of paper and placing a black stencil design onto it.\n- The stencil is aligned with the paper, and the person uses a white marker to trace or mark the design on the paper.", "history_tokens": 933, "history_utf8_bytes": 3990, "recent_frame_times_s": [350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0], "recent_frames_sha256": "47436ac5b996a6ade543cb920aca54559689dafd1fa5b36f4935a13248ca0fb5", "num_recent_frames": 30, "tq": 710180.283608444, "t1": 710187.481614602, "ta": 710187.481614602, "te": 710187.815963848, "first_response_s": 7.198006157996133, "answer_total_s": 7.532355403993279, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 70, "content_group": "24e89eecdbea079631c8aaca0d6489ded998e50a23a7042ccd55bb3d19588765", "question": {"question_id": "sample_70_a711_q0", "video_id": 70, "video_path": "./videos/sample_70_real.mp4", "annotation_index": 711, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Cutting off the top portion of the paper.", "B. Folding the paper along the edge of the design.", "C. Lifting a pair of black-handled scissors.", "D. Aligning the ruler with the grid lines on the cutting mat."], "answer": "A", "time_stamp_s": 493, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "handcraft", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_70_a711_q0", "video_id": 70, "time_stamp_s": 493, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b0d90a7495519403c989f965c162d27f90af6cce4cf118e019fb0a9c733125b9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0], "recent_frames_sha256": "d94985ea273eb14626b3c3bb4aa3c7ce806e78b5b1906e797dfdfa9fecbf6620", "num_recent_frames": 30, "tq": 710046.761283099, "t1": 710052.855213154, "ta": 710052.855213154, "te": 710052.89195796, "first_response_s": 6.093930055038072, "answer_total_s": 6.130674861022271, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_70_a711_q0", "video_id": 70, "time_stamp_s": 493, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2dff2059dd82de9ea1c3d6fa721f9bdabc1a005d0e36d948390f9993f8aabdd2", "condition_order": ["recent", "notes"], "memory": "[90-120s] - A black rectangular design with intricate patterns is selected and resized on a grid interface.  \n- The user clicks and drags the design to position it over a larger mandala drawing.  \n- A black rectangular selection box appears around the mandala, indicating it is being manipulated or prepared for further editing.\n[120-150s] - A black horizontal line is dragged across the center of a mandala design, splitting it into two halves.  \n- The line is adjusted to align precisely with the mandala’s symmetry, creating a clean division.  \n- The design remains static on the grid, with no visible changes to the mandala’s structure or color.\n[150-180s] - Red horizontal lines are drawn across the mandala design, dividing it into sections.  \n- The lines appear to be aligned with the mandala’s symmetry, suggesting a design or measurement tool is being used.  \n- The mandala remains static while the lines are being added, indicating a drawing or editing process in progress.\n[180-210s] - A black-and-white mandala design is centered on a grid, with a red horizontal line drawn across its middle.  \n- The red line is positioned to divide the mandala into two symmetrical halves, with the top and bottom portions of the design visible above and below the line.  \n- The design remains static, with no visible movement or interaction with other elements in the interface.\n[210-240s] - The text \"JOHNSON\" is typed into the active text box, centered horizontally between two mandala designs.  \n- The text box is selected, with its bounding box highlighted, indicating it is ready for further editing or positioning.  \n- The \"Text\" menu is open, showing options for text formatting and alignment, suggesting the user is adjusting text properties.\n[240-270s] - The \"Johnson\" text is centered within a mandala design on a digital design interface.  \n- The design is displayed on a grid, indicating it is being prepared for cutting or printing.  \n- The interface shows \"Cricut Design Space\" with options for \"Print\" and \"Cut\" visible on the screen.\n[270-300s] - User selects \"Adhesive Foil\" from a dropdown menu under \"All Materials\" section.  \n- Interface transitions to a \"Custom material set for Adhesive Foil\" screen with icons for tools and material.  \n- Screen displays a \"Loading\" animation over a grid background as the system processes the selection.\n[300-330s] - A \"Cutting\" animation appears on a digital interface, indicating the machine is preparing to cut.  \n- A green cutting mat is placed on a grid surface, with a dark, reflective sheet being positioned on top.  \n- The Cricut machine's cutting head descends toward the mat, ready to begin the cutting process.\n[330-360s] - A Cricut machine is shown with a dark gray cutting mat and a green mat underneath, positioned on a grid-patterned surface.\n- A person's hands are seen holding a white sheet of paper and placing a black stencil design onto it.\n- The stencil is aligned with the paper, and the person uses a white marker to trace or mark the design on the paper.\n[360-390s] - Hands trace a decorative outline with a white marker on a paper stencil placed on a cutting mat.  \n- A blue-handled lint roller rests on the mat to the right of the stencil.  \n- The stencil features the word \"JOHNSON\" centered above a floral design, with the person adjusting its position.\n[390-420s] - Hands use a white marker to trace along the outline of a mandala design on paper.  \n- A blue-handled roller with a metallic surface rests on the grid mat to the right.  \n- The paper is secured with gold-colored clips at the top and bottom edges.\n[420-450s] - Hands use a white marker to trace a mandala design on paper, with \"JOHNSON\" printed centrally.  \n- A blue-handled roller with a patterned surface rests on the grid mat to the right.  \n- Gold-colored clips secure the paper to the mat, holding it steady during tracing.\n[450-480s] - Hands adjust a transparent stencil with \"JOHNSON\" text over a grid mat, aligning it with a mandala design.  \n- A wooden cutting board is placed on the mat, positioned beneath the stencil.  \n- The stencil is lifted, revealing the mandala design printed on paper, now centered over the cutting board.", "history_tokens": 1001, "history_utf8_bytes": 4194, "recent_frame_times_s": [464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0], "recent_frames_sha256": "d94985ea273eb14626b3c3bb4aa3c7ce806e78b5b1906e797dfdfa9fecbf6620", "num_recent_frames": 30, "tq": 710211.261426261, "t1": 710213.774600515, "ta": 710213.774600515, "te": 710213.812400719, "first_response_s": 2.5131742539815605, "answer_total_s": 2.550974457990378, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 71, "content_group": "9d88840756d683071f8d851c3b5d7da1bcc6b010116706c11bcfb702cd48d07d", "question": {"question_id": "sample_71_a443_q0", "video_id": 71, "video_path": "./videos/sample_71_real.mp4", "annotation_index": 443, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 0.", "B. 1.", "C. 3.", "D. 4."], "answer": "A", "time_stamp_s": 18, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_71_a443_q0", "video_id": 71, "time_stamp_s": 18, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "802c4554a0b45477b8c317b29c1cd217cf221c0c00364e409881226d256c37bb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "561726aef13da3607184c1c35ade51002a8479cd27db7f3d996f6199ce1cbe35", "num_recent_frames": 18, "tq": 716222.052736125, "t1": 716230.151177161, "ta": 716230.151177161, "te": 716230.188444333, "first_response_s": 8.098441036068834, "answer_total_s": 8.13570820807945, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_71_a443_q0", "video_id": 71, "time_stamp_s": 18, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "19b8d29cad60e39a12cd4f523183a815386f62be31d27907e50f69edba81ee69", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "561726aef13da3607184c1c35ade51002a8479cd27db7f3d996f6199ce1cbe35", "num_recent_frames": 18, "tq": 716289.589105943, "t1": 716296.249202568, "ta": 716296.249202568, "te": 716296.432933078, "first_response_s": 6.660096624982543, "answer_total_s": 6.843827135046013, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 71, "content_group": "9d88840756d683071f8d851c3b5d7da1bcc6b010116706c11bcfb702cd48d07d", "question": {"question_id": "sample_71_a443_q1", "video_id": 71, "video_path": "./videos/sample_71_real.mp4", "annotation_index": 443, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 0.", "B. 1.", "C. 3.", "D. 4."], "answer": "A", "time_stamp_s": 58, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_71_a443_q1", "video_id": 71, "time_stamp_s": 58, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2013ff5a7e6ccd451a4cd6fd565acba14a0b7ccedf9788ea1d110755903468a2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336], "recent_frames_sha256": "d8354b2219870e0990dbcf8cbaf86e572f054a14dbc9dd4f236927777c8f9ba0", "num_recent_frames": 30, "tq": 716230.219532343, "t1": 716237.689663401, "ta": 716237.689663401, "te": 716237.727166292, "first_response_s": 7.470131058013067, "answer_total_s": 7.507633949047886, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_71_a443_q1", "video_id": 71, "time_stamp_s": 58, "ground_truth": "A", "raw_output": "A. 0.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "1422600a51d9321326e465f1be42c2f300665f7cc2fc7578caeb43ebc7404e97", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man stands beside a whiteboard displaying \"UNIT 5 SUMMATIVE PROJECT\" with project requirements, gesturing toward the content.  \n- The whiteboard lists tasks like creating a 2-minute music video with specific elements such as transitions, sound effects, and character use.  \n- The man, identified as \"Mr. Marklevitz Film Teacher\" via on-screen text, uses hand gestures to emphasize points while speaking.", "history_tokens": 94, "history_utf8_bytes": 415, "recent_frame_times_s": [28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336], "recent_frames_sha256": "d8354b2219870e0990dbcf8cbaf86e572f054a14dbc9dd4f236927777c8f9ba0", "num_recent_frames": 30, "tq": 716306.979953852, "t1": 716307.999101184, "ta": 716307.999101184, "te": 716308.183499262, "first_response_s": 1.0191473319428042, "answer_total_s": 1.2035454099532217, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 71, "content_group": "9d88840756d683071f8d851c3b5d7da1bcc6b010116706c11bcfb702cd48d07d", "question": {"question_id": "sample_71_a444_q0", "video_id": 71, "video_path": "./videos/sample_71_real.mp4", "annotation_index": 444, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 0.", "B. 1.", "C. 3.", "D. 4."], "answer": "A", "time_stamp_s": 138, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_71_a444_q0", "video_id": 71, "time_stamp_s": 138, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3262653ce011a79c16ce81768bc688146f69f98f1de81abf23005be82f739f53", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334], "recent_frames_sha256": "17f4f8d6157ccd432fe38bf385a19e5a6f0bedfa56a65a53c66d48db33893842", "num_recent_frames": 30, "tq": 716237.754549911, "t1": 716274.369340982, "ta": 716274.369340982, "te": 716274.40698839, "first_response_s": 36.61479107104242, "answer_total_s": 36.652438479010016, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_71_a444_q0", "video_id": 71, "time_stamp_s": 138, "ground_truth": "A", "raw_output": "A. 0.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "f5fb219a4767030b526d3f5e6d0a76639c758e68004e6d1e76199f1f8ce77102", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man stands beside a whiteboard displaying \"UNIT 5 SUMMATIVE PROJECT\" with project requirements, gesturing toward the content.  \n- The whiteboard lists tasks like creating a 2-minute music video with specific elements such as transitions, sound effects, and character use.  \n- The man, identified as \"Mr. Marklevitz Film Teacher\" via on-screen text, uses hand gestures to emphasize points while speaking.\n[30-60s] - A man in a gray shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"UNIT 5 SUMMATIVE PROJECT\" with bullet points about creating a 2-minute music video.  \n- The man’s gestures and body language suggest he is explaining or emphasizing the project requirements.\n[60-90s] - Teacher gestures toward whiteboard with both hands while speaking.  \n- Whiteboard displays \"UNIT 5 SUMMATIVE PROJECT\" and project requirements in colored markers.  \n- Teacher stands to the right of the whiteboard, facing the camera.\n[90-120s] - A man in a gray shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"UNIT 5 SUMMATIVE PROJECT\" and lists requirements for a 2-minute music video.  \n- The man occasionally points to specific sections on the whiteboard as he explains the project.", "history_tokens": 301, "history_utf8_bytes": 1291, "recent_frame_times_s": [108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334], "recent_frames_sha256": "17f4f8d6157ccd432fe38bf385a19e5a6f0bedfa56a65a53c66d48db33893842", "num_recent_frames": 30, "tq": 716331.809461413, "t1": 716343.677704849, "ta": 716343.677704849, "te": 716343.90011759, "first_response_s": 11.868243436096236, "answer_total_s": 12.090656177024357, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 71, "content_group": "9d88840756d683071f8d851c3b5d7da1bcc6b010116706c11bcfb702cd48d07d", "question": {"question_id": "sample_71_a444_q1", "video_id": 71, "video_path": "./videos/sample_71_real.mp4", "annotation_index": 444, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 0.", "B. 1.", "C. 3.", "D. 4."], "answer": "A", "time_stamp_s": 178, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_71_a444_q1", "video_id": 71, "time_stamp_s": 178, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6bf2cec38948433a5b0314eaf8dd0e518c849b9043920ea22bf86f20180f8a71", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666], "recent_frames_sha256": "f84f4c5cc1f4af310f8158977025ea10fc5f8bd72c43bba9c300da62c772c557", "num_recent_frames": 30, "tq": 716274.42827962, "t1": 716282.480212286, "ta": 716282.480212286, "te": 716282.518962215, "first_response_s": 8.051932665985078, "answer_total_s": 8.090682595036924, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_71_a444_q1", "video_id": 71, "time_stamp_s": 178, "ground_truth": "A", "raw_output": "A. 0.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "90acc134ae5437d874d161e6173ec61c03da3e5a7f049804925bd96fbf7caaa1", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man stands beside a whiteboard displaying \"UNIT 5 SUMMATIVE PROJECT\" with project requirements, gesturing toward the content.  \n- The whiteboard lists tasks like creating a 2-minute music video with specific elements such as transitions, sound effects, and character use.  \n- The man, identified as \"Mr. Marklevitz Film Teacher\" via on-screen text, uses hand gestures to emphasize points while speaking.\n[30-60s] - A man in a gray shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"UNIT 5 SUMMATIVE PROJECT\" with bullet points about creating a 2-minute music video.  \n- The man’s gestures and body language suggest he is explaining or emphasizing the project requirements.\n[60-90s] - Teacher gestures toward whiteboard with both hands while speaking.  \n- Whiteboard displays \"UNIT 5 SUMMATIVE PROJECT\" and project requirements in colored markers.  \n- Teacher stands to the right of the whiteboard, facing the camera.\n[90-120s] - A man in a gray shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"UNIT 5 SUMMATIVE PROJECT\" and lists requirements for a 2-minute music video.  \n- The man occasionally points to specific sections on the whiteboard as he explains the project.\n[120-150s] - A man in a gray shirt gestures with both hands while speaking, standing to the right of a whiteboard.  \n- The whiteboard displays \"UNIT 5 SUMMATIVE PROJECT\" with bullet points in red, green, and blue markers.  \n- The man’s body is slightly angled toward the whiteboard, indicating he is explaining its content.", "history_tokens": 382, "history_utf8_bytes": 1617, "recent_frame_times_s": [148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666], "recent_frames_sha256": "f84f4c5cc1f4af310f8158977025ea10fc5f8bd72c43bba9c300da62c772c557", "num_recent_frames": 30, "tq": 716356.545242377, "t1": 716357.431066829, "ta": 716357.431066829, "te": 716357.623203632, "first_response_s": 0.885824452037923, "answer_total_s": 1.0779612549813464, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 71, "content_group": "9d88840756d683071f8d851c3b5d7da1bcc6b010116706c11bcfb702cd48d07d", "question": {"question_id": "sample_71_a445_q0", "video_id": 71, "video_path": "./videos/sample_71_real.mp4", "annotation_index": 445, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 0.", "B. 1.", "C. 3.", "D. 4."], "answer": "A", "time_stamp_s": 318, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_71_a445_q0", "video_id": 71, "time_stamp_s": 318, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b02256cb5fddb9a4b117d1d0d8176b52f9547025d57ffe3454da8dc4beee47a5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167], "recent_frames_sha256": "5b3008fb719b2d692ed4b8c52cb76cd935595c3b744cc74a037be020cf857595", "num_recent_frames": 30, "tq": 716282.540583327, "t1": 716289.539297829, "ta": 716289.539297829, "te": 716289.576695907, "first_response_s": 6.998714502085932, "answer_total_s": 7.036112580099143, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_71_a445_q0", "video_id": 71, "time_stamp_s": 318, "ground_truth": "A", "raw_output": "A. 0.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "babc3587935f6eadb037614c3d7847d8caf37f73c75febf9b432a00bd16d87fd", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man stands beside a whiteboard displaying \"UNIT 5 SUMMATIVE PROJECT\" with project requirements, gesturing toward the content.  \n- The whiteboard lists tasks like creating a 2-minute music video with specific elements such as transitions, sound effects, and character use.  \n- The man, identified as \"Mr. Marklevitz Film Teacher\" via on-screen text, uses hand gestures to emphasize points while speaking.\n[30-60s] - A man in a gray shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"UNIT 5 SUMMATIVE PROJECT\" with bullet points about creating a 2-minute music video.  \n- The man’s gestures and body language suggest he is explaining or emphasizing the project requirements.\n[60-90s] - Teacher gestures toward whiteboard with both hands while speaking.  \n- Whiteboard displays \"UNIT 5 SUMMATIVE PROJECT\" and project requirements in colored markers.  \n- Teacher stands to the right of the whiteboard, facing the camera.\n[90-120s] - A man in a gray shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"UNIT 5 SUMMATIVE PROJECT\" and lists requirements for a 2-minute music video.  \n- The man occasionally points to specific sections on the whiteboard as he explains the project.\n[120-150s] - A man in a gray shirt gestures with both hands while speaking, standing to the right of a whiteboard.  \n- The whiteboard displays \"UNIT 5 SUMMATIVE PROJECT\" with bullet points in red, green, and blue markers.  \n- The man’s body is slightly angled toward the whiteboard, indicating he is explaining its content.\n[150-180s] - A man in a gray shirt gestures toward a whiteboard displaying \"UNIT 5 SUMMATIVE PROJECT\" with project requirements.  \n- The whiteboard lists tasks like creating a 2-minute music video, including transitions, and using effective use of characterisation.  \n- The man’s hands move expressively as he explains the project, with his body slightly angled toward the board.\n[180-210s] - A man in a gray shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"UNIT 5 SUMMATIVE PROJECT\" and lists requirements for a 2-minute music video.  \n- The man’s hands move expressively as he explains the project details, with no visible changes in his position or the board’s content.\n[210-240s] - A man in a gray shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"UNIT 5 SUMMATIVE PROJECT\" and lists requirements for a 2-minute music video.  \n- The man’s hands move expressively as he points to different sections of the whiteboard.\n[240-270s] - A man in a gray shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"UNIT 5 SUMMATIVE PROJECT\" and instructions for creating a 2-minute music video.  \n- The man’s hands move expressively as he explains the project requirements, emphasizing key points.\n[270-300s] - A man in a gray shirt gestures with both hands while speaking, standing to the right of a whiteboard.  \n- The whiteboard displays \"UNIT 5 SUMMATIVE PROJECT\" with bullet points about creating a 2-minute music video.  \n- The man’s hands move expressively as he points to different sections of the whiteboard.", "history_tokens": 791, "history_utf8_bytes": 3303, "recent_frame_times_s": [288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167], "recent_frames_sha256": "5b3008fb719b2d692ed4b8c52cb76cd935595c3b744cc74a037be020cf857595", "num_recent_frames": 30, "tq": 716400.950183007, "t1": 716407.998515499, "ta": 716407.998515499, "te": 716408.203395126, "first_response_s": 7.048332492006011, "answer_total_s": 7.253212118986994, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 72, "content_group": "5d93211e5093674904532848551b3ef3c6b49bd35ac9129222e1e8b32e21e23f", "question": {"question_id": "sample_72_a947_q0", "video_id": 72, "video_path": "./videos/sample_72_real.mp4", "annotation_index": 947, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 1.", "B. 3.", "C. 4.", "D. 0."], "answer": "A", "time_stamp_s": 192, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_72_a947_q0", "video_id": 72, "time_stamp_s": 192, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "30dfbd1cb9c696c3efcdea80d4213bb881f98f37fb41f01a6d2ec74a25e989cf", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [162.036875, 163.037875, 164.038875, 165.039875, 166.040875, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667], "recent_frames_sha256": "063ef065f8df6cb6ea68af71485f80dc64cdfdc8d1ca296ff4b3ea870361262a", "num_recent_frames": 30, "tq": 719782.940963176, "t1": 719784.977271291, "ta": 719784.977271291, "te": 719785.009917434, "first_response_s": 2.036308114998974, "answer_total_s": 2.0689542579930276, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_72_a947_q0", "video_id": 72, "time_stamp_s": 192, "ground_truth": "A", "raw_output": "B. 3.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "d3f4b9b04175b8e0667cce9e805a3ea5fcd07f315c3289306d5f26c43def0ac6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.1: NARRATIVE STRUCTURE\" with bullet points about story elements like \"STORY,\" \"PLOT,\" and \"DEVELOPMENT.\"  \n- The man's face and upper body are visible, and he appears to be teaching or explaining the content on the board.\n[30-60s] - A man stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"LESSON 1.1: NARRATIVE STRUCTURE\" with bullet points about story elements.  \n- The man’s right hand points to the whiteboard as he explains the content.\n[60-90s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"LESSON 1.1: NARRATIVE STRUCTURE\" with bullet points about story elements like \"STORY,\" \"PLOT,\" and \"DEVELOPMENT.\"  \n- The man occasionally points to specific sections on the whiteboard, emphasizing key terms.\n[90-120s] - A man in a gray hoodie stands beside a whiteboard, gesturing toward its content while speaking.  \n- The whiteboard displays \"LESSON 1.1: NARRATIVE STRUCTURE\" with sections labeled \"STORY,\" \"PLOT,\" \"DEVELOPMENT,\" and \"VIEWING.\"  \n- The man occasionally points to specific parts of the whiteboard, emphasizing key terms like \"3-STRUCTURE\" and \"STORY.\"\n[120-150s] - A man in a light-colored shirt gestures toward a whiteboard displaying \"Lesson 1.1: Narrative Structure\" with key terms like \"Stoic,\" \"Plot,\" and \"Character.\"  \n- The whiteboard lists narrative elements such as \"3-Part Structure\" and \"Character Arc,\" with annotations in red and blue markers.  \n- The man points to the whiteboard while speaking, indicating educational content on narrative storytelling.\n[150-180s] - Elderly woman with white hair and blue eyes gazes upward, her face showing wrinkles and tear tracks, against a dimly lit blue background.\n- The camera pans to reveal the sunken Titanic wreck, its rusted hull and skeletal superstructure visible underwater, with faint light filtering through the deep blue water.\n- A transition to a bright, sunny day shows the Titanic ship in full view, docked at a port, with passengers on deck and a clear sky above.", "history_tokens": 567, "history_utf8_bytes": 2258, "recent_frame_times_s": [162.036875, 163.037875, 164.038875, 165.039875, 166.040875, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667], "recent_frames_sha256": "063ef065f8df6cb6ea68af71485f80dc64cdfdc8d1ca296ff4b3ea870361262a", "num_recent_frames": 30, "tq": 719668.524051428, "t1": 719669.327448723, "ta": 719669.327448723, "te": 719669.675282804, "first_response_s": 0.8033972950652242, "answer_total_s": 1.1512313759885728, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 72, "content_group": "5d93211e5093674904532848551b3ef3c6b49bd35ac9129222e1e8b32e21e23f", "question": {"question_id": "sample_72_a947_q1", "video_id": 72, "video_path": "./videos/sample_72_real.mp4", "annotation_index": 947, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 1.", "B. 2.", "C. 4.", "D. 0."], "answer": "B", "time_stamp_s": 208, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_72_a947_q1", "video_id": 72, "time_stamp_s": 208, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "248892a62df79e91a4853209d49099c9d9d52976d683b0cf62f70de3423163b2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.03416666666666, 202.03516666666667, 203.03616666666667, 204.03716666666668, 205.03816666666665, 206.03916666666666, 207.04016666666666], "recent_frames_sha256": "a53609e69076bd5fc2d3fd8dd02da2e4175b683c627bc86c9a778f8b3b38485b", "num_recent_frames": 30, "tq": 719785.015663543, "t1": 719787.931620516, "ta": 719787.931620516, "te": 719787.964333818, "first_response_s": 2.915956972981803, "answer_total_s": 2.948670274927281, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_72_a947_q1", "video_id": 72, "time_stamp_s": 208, "ground_truth": "B", "raw_output": "B. 2.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "33f24efae286b2239967055664fc9b0cc915a0e9b81d6acc51bd4af5fca898a4", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.1: NARRATIVE STRUCTURE\" with bullet points about story elements like \"STORY,\" \"PLOT,\" and \"DEVELOPMENT.\"  \n- The man's face and upper body are visible, and he appears to be teaching or explaining the content on the board.\n[30-60s] - A man stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"LESSON 1.1: NARRATIVE STRUCTURE\" with bullet points about story elements.  \n- The man’s right hand points to the whiteboard as he explains the content.\n[60-90s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"LESSON 1.1: NARRATIVE STRUCTURE\" with bullet points about story elements like \"STORY,\" \"PLOT,\" and \"DEVELOPMENT.\"  \n- The man occasionally points to specific sections on the whiteboard, emphasizing key terms.\n[90-120s] - A man in a gray hoodie stands beside a whiteboard, gesturing toward its content while speaking.  \n- The whiteboard displays \"LESSON 1.1: NARRATIVE STRUCTURE\" with sections labeled \"STORY,\" \"PLOT,\" \"DEVELOPMENT,\" and \"VIEWING.\"  \n- The man occasionally points to specific parts of the whiteboard, emphasizing key terms like \"3-STRUCTURE\" and \"STORY.\"\n[120-150s] - A man in a light-colored shirt gestures toward a whiteboard displaying \"Lesson 1.1: Narrative Structure\" with key terms like \"Stoic,\" \"Plot,\" and \"Character.\"  \n- The whiteboard lists narrative elements such as \"3-Part Structure\" and \"Character Arc,\" with annotations in red and blue markers.  \n- The man points to the whiteboard while speaking, indicating educational content on narrative storytelling.\n[150-180s] - Elderly woman with white hair and blue eyes gazes upward, her face showing wrinkles and tear tracks, against a dimly lit blue background.\n- The camera pans to reveal the sunken Titanic wreck, its rusted hull and skeletal superstructure visible underwater, with faint light filtering through the deep blue water.\n- A transition to a bright, sunny day shows the Titanic ship in full view, docked at a port, with passengers on deck and a clear sky above.", "history_tokens": 567, "history_utf8_bytes": 2258, "recent_frame_times_s": [178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.03416666666666, 202.03516666666667, 203.03616666666667, 204.03716666666668, 205.03816666666665, 206.03916666666666, 207.04016666666666], "recent_frames_sha256": "a53609e69076bd5fc2d3fd8dd02da2e4175b683c627bc86c9a778f8b3b38485b", "num_recent_frames": 30, "tq": 719669.690026911, "t1": 719682.533197729, "ta": 719682.533197729, "te": 719682.774054086, "first_response_s": 12.843170818057843, "answer_total_s": 13.084027174976654, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 72, "content_group": "5d93211e5093674904532848551b3ef3c6b49bd35ac9129222e1e8b32e21e23f", "question": {"question_id": "sample_72_a948_q0", "video_id": 72, "video_path": "./videos/sample_72_real.mp4", "annotation_index": 948, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 1.", "B. 3.", "C. 4.", "D. 0."], "answer": "B", "time_stamp_s": 262, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_72_a948_q0", "video_id": 72, "time_stamp_s": 262, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4d57c3db13c095be684c8fab881f17a95df0ce31effa8e3b228ca422977286b8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [232.02345833333334, 233.02445833333334, 234.02545833333335, 235.02645833333332, 236.02745833333333, 237.02845833333333, 238.02945833333334, 239.03045833333334, 240.03145833333335, 241.03245833333332, 242.03345833333333, 243.03445833333333, 244.03545833333334, 245.03645833333334, 246.03745833333332, 247.03845833333332, 248.03945833333333, 249.04045833333333, 250.04145833333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075], "recent_frames_sha256": "584308bba2a21b62168079a5c1a0812284858d99bee632df4b3b3ba2921b5bc7", "num_recent_frames": 30, "tq": 719787.970059377, "t1": 719790.673466874, "ta": 719790.673466874, "te": 719790.708612292, "first_response_s": 2.70340749702882, "answer_total_s": 2.73855291493237, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_72_a948_q0", "video_id": 72, "time_stamp_s": 262, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "cdedaf8c9795f2b6cd166d902fc86d0b69baf2e28298c84651306ffc73e2cf7e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.1: NARRATIVE STRUCTURE\" with bullet points about story elements like \"STORY,\" \"PLOT,\" and \"DEVELOPMENT.\"  \n- The man's face and upper body are visible, and he appears to be teaching or explaining the content on the board.\n[30-60s] - A man stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"LESSON 1.1: NARRATIVE STRUCTURE\" with bullet points about story elements.  \n- The man’s right hand points to the whiteboard as he explains the content.\n[60-90s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"LESSON 1.1: NARRATIVE STRUCTURE\" with bullet points about story elements like \"STORY,\" \"PLOT,\" and \"DEVELOPMENT.\"  \n- The man occasionally points to specific sections on the whiteboard, emphasizing key terms.\n[90-120s] - A man in a gray hoodie stands beside a whiteboard, gesturing toward its content while speaking.  \n- The whiteboard displays \"LESSON 1.1: NARRATIVE STRUCTURE\" with sections labeled \"STORY,\" \"PLOT,\" \"DEVELOPMENT,\" and \"VIEWING.\"  \n- The man occasionally points to specific parts of the whiteboard, emphasizing key terms like \"3-STRUCTURE\" and \"STORY.\"\n[120-150s] - A man in a light-colored shirt gestures toward a whiteboard displaying \"Lesson 1.1: Narrative Structure\" with key terms like \"Stoic,\" \"Plot,\" and \"Character.\"  \n- The whiteboard lists narrative elements such as \"3-Part Structure\" and \"Character Arc,\" with annotations in red and blue markers.  \n- The man points to the whiteboard while speaking, indicating educational content on narrative storytelling.\n[150-180s] - Elderly woman with white hair and blue eyes gazes upward, her face showing wrinkles and tear tracks, against a dimly lit blue background.\n- The camera pans to reveal the sunken Titanic wreck, its rusted hull and skeletal superstructure visible underwater, with faint light filtering through the deep blue water.\n- A transition to a bright, sunny day shows the Titanic ship in full view, docked at a port, with passengers on deck and a clear sky above.\n[180-210s] - A man in a gray shirt gestures toward a whiteboard with \"LESSON 1.1: NARRATIVE STRUCTURE\" written on it, pointing to key terms like \"STORY,\" \"PLOT,\" and \"DEVELOPMENT.\"\n- The whiteboard lists narrative elements including \"STORY: THE TALE OF EVENTS PRESENT IN A NARRATIVE,\" \"PLOT: THE ORDER IN WHICH EVENTS OCCUR,\" and \"DEVELOPMENT: THE BUILDING OF THE STORY.\"\n- The scene transitions to a movie clip from \"Jurassic Park (1993)\" showing a woman and a boy looking at a\n[210-240s] - A man in a light-colored shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"LESSON 1.1: NARRATIVE STRUCTURE\" with bullet points about story elements, plot structure, and viewing.  \n- The man smiles and appears to be teaching, with a dark background behind him.", "history_tokens": 789, "history_utf8_bytes": 3064, "recent_frame_times_s": [232.02345833333334, 233.02445833333334, 234.02545833333335, 235.02645833333332, 236.02745833333333, 237.02845833333333, 238.02945833333334, 239.03045833333334, 240.03145833333335, 241.03245833333332, 242.03345833333333, 243.03445833333333, 244.03545833333334, 245.03645833333334, 246.03745833333332, 247.03845833333332, 248.03945833333333, 249.04045833333333, 250.04145833333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075], "recent_frames_sha256": "584308bba2a21b62168079a5c1a0812284858d99bee632df4b3b3ba2921b5bc7", "num_recent_frames": 30, "tq": 719695.148588129, "t1": 719700.689246896, "ta": 719700.689246896, "te": 719700.726929026, "first_response_s": 5.540658766985871, "answer_total_s": 5.578340896987356, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 72, "content_group": "5d93211e5093674904532848551b3ef3c6b49bd35ac9129222e1e8b32e21e23f", "question": {"question_id": "sample_72_a949_q0", "video_id": 72, "video_path": "./videos/sample_72_real.mp4", "annotation_index": 949, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 1.", "B. 3.", "C. 4.", "D. 5."], "answer": "C", "time_stamp_s": 318, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_72_a949_q0", "video_id": 72, "time_stamp_s": 318, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d6a3a8b5f337582f0612d14cc8aa355a00f17e757628d30cb088c2c403267390", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [288.03775, 289.03875, 290.03975, 291.04075, 292.0000416666667, 293.00104166666665, 294.0020416666667, 295.00304166666666, 296.0040416666667, 297.00504166666667, 298.00604166666665, 299.0070416666667, 300.00804166666666, 301.0090416666667, 302.01004166666667, 303.01104166666664, 304.0120416666667, 305.01304166666665, 306.0140416666667, 307.01504166666666, 308.0160416666667, 309.01704166666667, 310.01804166666665, 311.0190416666667, 312.02004166666666, 313.0210416666667, 314.02204166666667, 315.02304166666664, 316.0240416666667, 317.02504166666665], "recent_frames_sha256": "95f53a07ba31e2df632cf46d513c74b73b2760c37a1aa3af13539b330093a32e", "num_recent_frames": 30, "tq": 719790.714091435, "t1": 719791.229128524, "ta": 719791.229128524, "te": 719791.266277393, "first_response_s": 0.5150370890041813, "answer_total_s": 0.5521859580185264, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_72_a949_q0", "video_id": 72, "time_stamp_s": 318, "ground_truth": "C", "raw_output": "B. 3.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "41520422d373b15abe79eb80e83f976dc50e0f0fedd57fa4035b21babf5de77e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.1: NARRATIVE STRUCTURE\" with bullet points about story elements like \"STORY,\" \"PLOT,\" and \"DEVELOPMENT.\"  \n- The man's face and upper body are visible, and he appears to be teaching or explaining the content on the board.\n[30-60s] - A man stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"LESSON 1.1: NARRATIVE STRUCTURE\" with bullet points about story elements.  \n- The man’s right hand points to the whiteboard as he explains the content.\n[60-90s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"LESSON 1.1: NARRATIVE STRUCTURE\" with bullet points about story elements like \"STORY,\" \"PLOT,\" and \"DEVELOPMENT.\"  \n- The man occasionally points to specific sections on the whiteboard, emphasizing key terms.\n[90-120s] - A man in a gray hoodie stands beside a whiteboard, gesturing toward its content while speaking.  \n- The whiteboard displays \"LESSON 1.1: NARRATIVE STRUCTURE\" with sections labeled \"STORY,\" \"PLOT,\" \"DEVELOPMENT,\" and \"VIEWING.\"  \n- The man occasionally points to specific parts of the whiteboard, emphasizing key terms like \"3-STRUCTURE\" and \"STORY.\"\n[120-150s] - A man in a light-colored shirt gestures toward a whiteboard displaying \"Lesson 1.1: Narrative Structure\" with key terms like \"Stoic,\" \"Plot,\" and \"Character.\"  \n- The whiteboard lists narrative elements such as \"3-Part Structure\" and \"Character Arc,\" with annotations in red and blue markers.  \n- The man points to the whiteboard while speaking, indicating educational content on narrative storytelling.\n[150-180s] - Elderly woman with white hair and blue eyes gazes upward, her face showing wrinkles and tear tracks, against a dimly lit blue background.\n- The camera pans to reveal the sunken Titanic wreck, its rusted hull and skeletal superstructure visible underwater, with faint light filtering through the deep blue water.\n- A transition to a bright, sunny day shows the Titanic ship in full view, docked at a port, with passengers on deck and a clear sky above.\n[180-210s] - A man in a gray shirt gestures toward a whiteboard with \"LESSON 1.1: NARRATIVE STRUCTURE\" written on it, pointing to key terms like \"STORY,\" \"PLOT,\" and \"DEVELOPMENT.\"\n- The whiteboard lists narrative elements including \"STORY: THE TALE OF EVENTS PRESENT IN A NARRATIVE,\" \"PLOT: THE ORDER IN WHICH EVENTS OCCUR,\" and \"DEVELOPMENT: THE BUILDING OF THE STORY.\"\n- The scene transitions to a movie clip from \"Jurassic Park (1993)\" showing a woman and a boy looking at a\n[210-240s] - A man in a light-colored shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"LESSON 1.1: NARRATIVE STRUCTURE\" with bullet points about story elements, plot structure, and viewing.  \n- The man smiles and appears to be teaching, with a dark background behind him.\n[240-270s] - A man in a red patterned robe sits on a gold leather couch, holding a phone to his ear while reading a newspaper.  \n- Another man in a light blue shirt and cap sits on a couch, holding a phone with a coiled cord, in a room with wood-paneled walls and a lamp.  \n- A third man in a white shirt stands in front of a whiteboard labeled \"LESSON 1.1: NARRATIVE STRUCTURE,\" gesturing with his hands while speaking.\n[270-300s] - A man in a suit points a gun at another man who is lying on the floor.  \n- The man in the suit is standing behind the man on the floor, with a surprised expression.  \n- A man in a suit and tie is standing in the background, looking at the scene.", "history_tokens": 972, "history_utf8_bytes": 3744, "recent_frame_times_s": [288.03775, 289.03875, 290.03975, 291.04075, 292.0000416666667, 293.00104166666665, 294.0020416666667, 295.00304166666666, 296.0040416666667, 297.00504166666667, 298.00604166666665, 299.0070416666667, 300.00804166666666, 301.0090416666667, 302.01004166666667, 303.01104166666664, 304.0120416666667, 305.01304166666665, 306.0140416666667, 307.01504166666666, 308.0160416666667, 309.01704166666667, 310.01804166666665, 311.0190416666667, 312.02004166666666, 313.0210416666667, 314.02204166666667, 315.02304166666664, 316.0240416666667, 317.02504166666665], "recent_frames_sha256": "95f53a07ba31e2df632cf46d513c74b73b2760c37a1aa3af13539b330093a32e", "num_recent_frames": 30, "tq": 719711.88070215, "t1": 719712.908195081, "ta": 719712.908195081, "te": 719713.135636506, "first_response_s": 1.0274929309962317, "answer_total_s": 1.2549343559658155, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 72, "content_group": "5d93211e5093674904532848551b3ef3c6b49bd35ac9129222e1e8b32e21e23f", "question": {"question_id": "sample_72_a950_q0", "video_id": 72, "video_path": "./videos/sample_72_real.mp4", "annotation_index": 950, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 10.", "B. 11.", "C. 12.", "D. 13."], "answer": "D", "time_stamp_s": 810, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_72_a950_q0", "video_id": 72, "time_stamp_s": 810, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8c06a6bd612e0c2e7606a6ab9038e7e8cd7e1fe836897af76f63b7cce24b23d9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [780.02925, 781.03025, 782.03125, 783.03225, 784.03325, 785.03425, 786.03525, 787.03625, 788.03725, 789.03825, 790.03925, 791.04025, 792.04125, 793.0005416666667, 794.0015416666666, 795.0025416666666, 796.0035416666667, 797.0045416666667, 798.0055416666667, 799.0065416666666, 800.0075416666666, 801.0085416666667, 802.0095416666667, 803.0105416666667, 804.0115416666666, 805.0125416666667, 806.0135416666667, 807.0145416666667, 808.0155416666666, 809.0165416666666], "recent_frames_sha256": "beabe8be85cc433a743318e2ef54f7952cd0139a4728f708ed23328e7abc0b90", "num_recent_frames": 30, "tq": 719791.272841861, "t1": 719791.604879744, "ta": 719791.604879744, "te": 719791.643623401, "first_response_s": 0.33203788299579173, "answer_total_s": 0.37078153993934393, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_72_a950_q0", "video_id": 72, "time_stamp_s": 810, "ground_truth": "D", "raw_output": "C. 12.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "76999a300eebf6cb0bc44275114011accdf3cb50bd021c871db1b57219827688", "condition_order": ["notes", "recent"], "memory": "[510-540s] - A man in a grey shirt stands between two whiteboards, gesturing toward them while speaking.  \n- The whiteboards display \"ACT 1 SET-UP,\" \"ACT 1 CONFRONTATION,\" and \"ACT 1 RESOLUTION\" with bullet points in red and blue text.  \n- The man’s hands move expressively as he references the content on the boards, indicating he is explaining or teaching.\n[540-570s] - Buzz Lightyear is surrounded by green aliens in a red container, appearing to be in a game or trap.  \n- Woody, in a cowboy outfit, is seen inside a transparent box, seemingly trapped or confined.  \n- The aliens are actively moving around Buzz, with some reaching toward him, indicating a dynamic interaction.\n[570-600s] - Man in gray shirt gestures toward three whiteboards displaying \"Act 1 Setup,\" \"Act 1 Confrontation,\" and \"Act 1 Resolution\" with red and blue text.  \n- Whiteboards are mounted on easels, positioned side by side, with the man standing between them, pointing at different sections.  \n- Background shows darkened room with faint lighting, possibly a studio or classroom setting.\n[600-630s] - Man in gray shirt gestures toward two whiteboards displaying \"ACT 1 SET-UP,\" \"ACT 2 CONFRONTATION,\" and \"ACT 3 RESOLUTION\" with handwritten notes.  \n- Whiteboards are mounted on wooden easels, with red and blue text detailing plot points for each act.  \n- Man stands centrally, facing camera, with slight hand movements as he speaks.\n[630-660s] - Man in grey shirt gestures toward three blueboards displaying Act 1 breakdowns (Setup, Confrontation, Resolution) with handwritten notes.\n- Blueboards are mounted on a wooden easel, positioned side-by-side, with text in red and blue ink.\n- Background shows a dark room with a faintly visible window and ceiling fixture.\n[660-690s] - Toy Story characters (Buzz Lightyear and Woody) are shown riding a toy car on a suburban street, with the car speeding past houses and trees.  \n- The scene transitions to a close-up of the car's green steering wheel and dashboard, highlighting its toy design.  \n- A man stands in front of two whiteboards labeled \"ACT 1 SET-UP,\" \"ACT 1 CONFRONTATION,\" and \"ACT 1 RESOLUTION,\" gesturing while explaining the plot structure.\n[690-720s] - Man in gray polo shirt gestures toward three whiteboards displaying \"Act 1: Set-Up,\" \"Act 2: Confrontation,\" and \"Act 3: Resolution\" with colored text.  \n- Whiteboards are mounted on easels, with text detailing plot points for each act, such as \"OPENING: RUBY'S WOODEN WINDOW\" and \"ACT 3: RESOLUTION - RUBY'S WOODEN WINDOW.\"  \n- Man stands in front of the boards, facing the camera, with a dark background and a faintly visible \"Toy Story (1995)\" title at the bottom of\n[720-750s] - Woody, in a cowboy hat, is shown with a surprised expression, standing near a house with trees in the background.\n- Buzz Lightyear, in his space ranger suit, is seen riding a green toy car with red wheels, appearing to be in motion.\n- A hand is visible holding a lit match, positioned near Woody, suggesting an impending action or event.\n[750-780s] - A man in a grey shirt stands in front of three whiteboards, gesturing with his hands while speaking.  \n- The whiteboards display structured outlines for \"Act 1: Set-Up,\" \"Act 2: Confrontation,\" and \"Act 3: Resolution,\" each with bullet points in blue and red text.  \n- The background is dark, with a faintly visible window and some indistinct objects behind the man.\n[780-810s] - A man stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Narrative Structure\" with bullet points including \"Story,\" \"Plot,\" and \"Exposition.\"  \n- The man occasionally looks at the whiteboard and then back at the camera, maintaining a teaching posture.", "history_tokens": 944, "history_utf8_bytes": 3729, "recent_frame_times_s": [780.02925, 781.03025, 782.03125, 783.03225, 784.03325, 785.03425, 786.03525, 787.03625, 788.03725, 789.03825, 790.03925, 791.04025, 792.04125, 793.0005416666667, 794.0015416666666, 795.0025416666666, 796.0035416666667, 797.0045416666667, 798.0055416666667, 799.0065416666666, 800.0075416666666, 801.0085416666667, 802.0095416666667, 803.0105416666667, 804.0115416666666, 805.0125416666667, 806.0135416666667, 807.0145416666667, 808.0155416666666, 809.0165416666666], "recent_frames_sha256": "beabe8be85cc433a743318e2ef54f7952cd0139a4728f708ed23328e7abc0b90", "num_recent_frames": 30, "tq": 719782.515182368, "t1": 719782.737023876, "ta": 719782.737023876, "te": 719782.93211194, "first_response_s": 0.22184150805696845, "answer_total_s": 0.4169295720057562, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 73, "content_group": "d065cc132db1470b1a96370c7945d978d32f2e0d522b7126b7a777616a863c6f", "question": {"question_id": "sample_73_a460_q0", "video_id": 73, "video_path": "./videos/sample_73_real.mp4", "annotation_index": 460, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "A", "time_stamp_s": 192, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_73_a460_q0", "video_id": 73, "time_stamp_s": 192, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9064cec271734a854664093e81aa0cb9402ab5d3da39528a5e0e2e0f7437263a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [162.036875, 163.037875, 164.038875, 165.039875, 166.040875, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667], "recent_frames_sha256": "c329c5d9a52c1f059ada012a9002f117fb82b9a0c9a62d1c7e3013842bf51472", "num_recent_frames": 30, "tq": 718107.917149873, "t1": 718119.288091172, "ta": 718119.288091172, "te": 718119.325769373, "first_response_s": 11.370941299013793, "answer_total_s": 11.408619499998167, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_73_a460_q0", "video_id": 73, "time_stamp_s": 192, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b1833e7995fa9864d61fcc9c0f56b3109b763d353ed7aef69e11d08fa01d18f8", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light-colored shirt stands beside a whiteboard, gesturing toward its content while speaking.  \n- The whiteboard displays \"LESSON 1.2: THE HERO'S JOURNEY\" with bullet points about the hero's journey template and viewing assignment.  \n- The man occasionally points to specific sections of the whiteboard, indicating key elements of the lesson.\n[30-60s] - Man gestures with hands while standing in front of a whiteboard displaying \"Lesson 1.2: The Hero's Journey\" with bullet points.  \n- Whiteboard contains sections like \"Hero's Journey,\" \"Stages,\" and \"Viewing: Roman Holiday (1953).\"  \n- Man’s hands move expressively as he speaks, indicating emphasis on the content written on the board.\n[60-90s] - A man in a light gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.2: THE HERO'S JOURNEY\" with bullet points about the hero's journey and viewing a film.  \n- The man occasionally points to the whiteboard text, emphasizing key points of the lesson.\n[90-120s] - A man in a blue shirt writes on a whiteboard, labeling sections of a circle with numbers and words like \"YOU,\" \"NEED,\" \"GO,\" and \"FIND.\"\n- The whiteboard displays a diagram with labeled sections, including \"KNOWN\" and \"UNKNOWN,\" with text describing concepts like \"LIFE HELPS\" and \"KNOWLEDGE.\"\n- A scene from \"Toy Story (1995)\" shows Woody lying on a blue surface with two blue boxes nearby.\n[120-150s] - A man in a light gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays a diagram with sections labeled \"KNOWN\" and \"UNKNOWN,\" along with handwritten notes in various colors.  \n- The man occasionally points to different parts of the whiteboard as he explains the content.\n[150-180s] - A man in a light gray polo shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays a circular diagram divided into \"KNOWN\" and \"UNKNOWN\" sections, with numbered points and handwritten notes.  \n- The background shows a dimly lit room with a wooden easel and a dark curtain, suggesting an indoor setting.", "history_tokens": 536, "history_utf8_bytes": 2171, "recent_frame_times_s": [162.036875, 163.037875, 164.038875, 165.039875, 166.040875, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667], "recent_frames_sha256": "c329c5d9a52c1f059ada012a9002f117fb82b9a0c9a62d1c7e3013842bf51472", "num_recent_frames": 30, "tq": 717946.093703419, "t1": 717947.971450774, "ta": 717947.971450774, "te": 717948.126925361, "first_response_s": 1.877747355028987, "answer_total_s": 2.033221942023374, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 73, "content_group": "d065cc132db1470b1a96370c7945d978d32f2e0d522b7126b7a777616a863c6f", "question": {"question_id": "sample_73_a461_q0", "video_id": 73, "video_path": "./videos/sample_73_real.mp4", "annotation_index": 461, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 1.", "B. 4.", "C. 2.", "D. 0."], "answer": "B", "time_stamp_s": 271, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_73_a461_q0", "video_id": 73, "time_stamp_s": 271, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "91679903ffca1fcddd6a6bfc0e6e5981ce4dd08bf4ce6be6ad94a171ccdf4b56", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [241.03245833333332, 242.03345833333333, 243.03445833333333, 244.03545833333334, 245.03645833333334, 246.03745833333332, 247.03845833333332, 248.03945833333333, 249.04045833333333, 250.04145833333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.01675, 268.01775, 269.01875, 270.01975], "recent_frames_sha256": "cc1413214f42b9dbd8362743c01cc31cf906dba8d756bb04c4177ed13dc29527", "num_recent_frames": 30, "tq": 718119.334232594, "t1": 718133.356903115, "ta": 718133.356903115, "te": 718133.395226514, "first_response_s": 14.022670521051623, "answer_total_s": 14.060993919963948, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_73_a461_q0", "video_id": 73, "time_stamp_s": 271, "ground_truth": "B", "raw_output": "C. 2.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "a8376ad2f2330c225e67e399c63e49a1b79887e28cb735332e265ad8bf118f81", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light-colored shirt stands beside a whiteboard, gesturing toward its content while speaking.  \n- The whiteboard displays \"LESSON 1.2: THE HERO'S JOURNEY\" with bullet points about the hero's journey template and viewing assignment.  \n- The man occasionally points to specific sections of the whiteboard, indicating key elements of the lesson.\n[30-60s] - Man gestures with hands while standing in front of a whiteboard displaying \"Lesson 1.2: The Hero's Journey\" with bullet points.  \n- Whiteboard contains sections like \"Hero's Journey,\" \"Stages,\" and \"Viewing: Roman Holiday (1953).\"  \n- Man’s hands move expressively as he speaks, indicating emphasis on the content written on the board.\n[60-90s] - A man in a light gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.2: THE HERO'S JOURNEY\" with bullet points about the hero's journey and viewing a film.  \n- The man occasionally points to the whiteboard text, emphasizing key points of the lesson.\n[90-120s] - A man in a blue shirt writes on a whiteboard, labeling sections of a circle with numbers and words like \"YOU,\" \"NEED,\" \"GO,\" and \"FIND.\"\n- The whiteboard displays a diagram with labeled sections, including \"KNOWN\" and \"UNKNOWN,\" with text describing concepts like \"LIFE HELPS\" and \"KNOWLEDGE.\"\n- A scene from \"Toy Story (1995)\" shows Woody lying on a blue surface with two blue boxes nearby.\n[120-150s] - A man in a light gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays a diagram with sections labeled \"KNOWN\" and \"UNKNOWN,\" along with handwritten notes in various colors.  \n- The man occasionally points to different parts of the whiteboard as he explains the content.\n[150-180s] - A man in a light gray polo shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays a circular diagram divided into \"KNOWN\" and \"UNKNOWN\" sections, with numbered points and handwritten notes.  \n- The background shows a dimly lit room with a wooden easel and a dark curtain, suggesting an indoor setting.\n[180-210s] - A man in a light gray shirt stands in front of a whiteboard, gesturing toward a diagram labeled \"KNOWN\" and \"UNKNOWN\" with numbered sections.  \n- The whiteboard contains handwritten text in various colors, including phrases like \"LIFE MELTS AWAY\" and \"CHAMPIONSHIP SONGS.\"  \n- The man appears to be explaining or presenting the content on the whiteboard, with his hands moving to emphasize points.\n[210-240s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays a diagram with sections labeled \"KNOWN\" and \"UNKNOWN,\" along with numbered points and text in various colors.  \n- The man occasionally shifts his stance and gestures toward different parts of the whiteboard as he explains the content.\n[240-270s] - Man in gray shirt gestures toward a whiteboard with a Venn diagram labeled \"KNOWN\" and \"UNKNOWN,\" pointing to numbered sections with text.  \n- Whiteboard contains handwritten notes in red, green, and blue ink, including phrases like \"LIFE MESS\" and \"UNKNOWN.\"  \n- Background shows a dimly lit room with a wooden easel and a dark, possibly industrial setting behind the man.", "history_tokens": 817, "history_utf8_bytes": 3350, "recent_frame_times_s": [241.03245833333332, 242.03345833333333, 243.03445833333333, 244.03545833333334, 245.03645833333334, 246.03745833333332, 247.03845833333332, 248.03945833333333, 249.04045833333333, 250.04145833333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.01675, 268.01775, 269.01875, 270.01975], "recent_frames_sha256": "cc1413214f42b9dbd8362743c01cc31cf906dba8d756bb04c4177ed13dc29527", "num_recent_frames": 30, "tq": 717977.149657876, "t1": 717979.032945268, "ta": 717979.032945268, "te": 717979.436060009, "first_response_s": 1.8832873919745907, "answer_total_s": 2.286402132944204, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 73, "content_group": "d065cc132db1470b1a96370c7945d978d32f2e0d522b7126b7a777616a863c6f", "question": {"question_id": "sample_73_a462_q0", "video_id": 73, "video_path": "./videos/sample_73_real.mp4", "annotation_index": 462, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 1.", "B. 3.", "C. 2.", "D. 5."], "answer": "D", "time_stamp_s": 318, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_73_a462_q0", "video_id": 73, "time_stamp_s": 318, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1c0e4e31bd9c0e93f12cc414312bc7ee0b87098a82a29557a1c7718c3553ee78", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [288.03775, 289.03875, 290.03975, 291.04075, 292.0000416666667, 293.00104166666665, 294.0020416666667, 295.00304166666666, 296.0040416666667, 297.00504166666667, 298.00604166666665, 299.0070416666667, 300.00804166666666, 301.0090416666667, 302.01004166666667, 303.01104166666664, 304.0120416666667, 305.01304166666665, 306.0140416666667, 307.01504166666666, 308.0160416666667, 309.01704166666667, 310.01804166666665, 311.0190416666667, 312.02004166666666, 313.0210416666667, 314.02204166666667, 315.02304166666664, 316.0240416666667, 317.02504166666665], "recent_frames_sha256": "bb16fb8a2fdd5cfecfdaea52e2028956b0722bbac1b34ae3840f0f149ce3b461", "num_recent_frames": 30, "tq": 718133.403815985, "t1": 718143.929230778, "ta": 718143.929230778, "te": 718143.968393106, "first_response_s": 10.525414793053642, "answer_total_s": 10.564577121054754, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_73_a462_q0", "video_id": 73, "time_stamp_s": 318, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "505035c8f152742e7333e24df8d45140af7229801938b5cb03fd2287a2679072", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light-colored shirt stands beside a whiteboard, gesturing toward its content while speaking.  \n- The whiteboard displays \"LESSON 1.2: THE HERO'S JOURNEY\" with bullet points about the hero's journey template and viewing assignment.  \n- The man occasionally points to specific sections of the whiteboard, indicating key elements of the lesson.\n[30-60s] - Man gestures with hands while standing in front of a whiteboard displaying \"Lesson 1.2: The Hero's Journey\" with bullet points.  \n- Whiteboard contains sections like \"Hero's Journey,\" \"Stages,\" and \"Viewing: Roman Holiday (1953).\"  \n- Man’s hands move expressively as he speaks, indicating emphasis on the content written on the board.\n[60-90s] - A man in a light gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.2: THE HERO'S JOURNEY\" with bullet points about the hero's journey and viewing a film.  \n- The man occasionally points to the whiteboard text, emphasizing key points of the lesson.\n[90-120s] - A man in a blue shirt writes on a whiteboard, labeling sections of a circle with numbers and words like \"YOU,\" \"NEED,\" \"GO,\" and \"FIND.\"\n- The whiteboard displays a diagram with labeled sections, including \"KNOWN\" and \"UNKNOWN,\" with text describing concepts like \"LIFE HELPS\" and \"KNOWLEDGE.\"\n- A scene from \"Toy Story (1995)\" shows Woody lying on a blue surface with two blue boxes nearby.\n[120-150s] - A man in a light gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays a diagram with sections labeled \"KNOWN\" and \"UNKNOWN,\" along with handwritten notes in various colors.  \n- The man occasionally points to different parts of the whiteboard as he explains the content.\n[150-180s] - A man in a light gray polo shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays a circular diagram divided into \"KNOWN\" and \"UNKNOWN\" sections, with numbered points and handwritten notes.  \n- The background shows a dimly lit room with a wooden easel and a dark curtain, suggesting an indoor setting.\n[180-210s] - A man in a light gray shirt stands in front of a whiteboard, gesturing toward a diagram labeled \"KNOWN\" and \"UNKNOWN\" with numbered sections.  \n- The whiteboard contains handwritten text in various colors, including phrases like \"LIFE MELTS AWAY\" and \"CHAMPIONSHIP SONGS.\"  \n- The man appears to be explaining or presenting the content on the whiteboard, with his hands moving to emphasize points.\n[210-240s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays a diagram with sections labeled \"KNOWN\" and \"UNKNOWN,\" along with numbered points and text in various colors.  \n- The man occasionally shifts his stance and gestures toward different parts of the whiteboard as he explains the content.\n[240-270s] - Man in gray shirt gestures toward a whiteboard with a Venn diagram labeled \"KNOWN\" and \"UNKNOWN,\" pointing to numbered sections with text.  \n- Whiteboard contains handwritten notes in red, green, and blue ink, including phrases like \"LIFE MESS\" and \"UNKNOWN.\"  \n- Background shows a dimly lit room with a wooden easel and a dark, possibly industrial setting behind the man.\n[270-300s] - Man in gray shirt gestures toward a whiteboard with a Venn diagram labeled \"KNOWN\" and \"UNKNOWN.\"  \n- Whiteboard contains handwritten text, including phrases like \"Life has a way of...\" and \"We don't know everything.\"  \n- Background shows a dark room with a blackboard and a wooden easel holding the whiteboard.", "history_tokens": 897, "history_utf8_bytes": 3675, "recent_frame_times_s": [288.03775, 289.03875, 290.03975, 291.04075, 292.0000416666667, 293.00104166666665, 294.0020416666667, 295.00304166666666, 296.0040416666667, 297.00504166666667, 298.00604166666665, 299.0070416666667, 300.00804166666666, 301.0090416666667, 302.01004166666667, 303.01104166666664, 304.0120416666667, 305.01304166666665, 306.0140416666667, 307.01504166666666, 308.0160416666667, 309.01704166666667, 310.01804166666665, 311.0190416666667, 312.02004166666666, 313.0210416666667, 314.02204166666667, 315.02304166666664, 316.0240416666667, 317.02504166666665], "recent_frames_sha256": "bb16fb8a2fdd5cfecfdaea52e2028956b0722bbac1b34ae3840f0f149ce3b461", "num_recent_frames": 30, "tq": 717990.931446768, "t1": 717991.450531217, "ta": 717991.450531217, "te": 717991.488798222, "first_response_s": 0.5190844490425661, "answer_total_s": 0.5573514540446922, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 73, "content_group": "d065cc132db1470b1a96370c7945d978d32f2e0d522b7126b7a777616a863c6f", "question": {"question_id": "sample_73_a463_q0", "video_id": 73, "video_path": "./videos/sample_73_real.mp4", "annotation_index": 463, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 1.", "B. 3.", "C. 7.", "D. 5."], "answer": "C", "time_stamp_s": 438, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_73_a463_q0", "video_id": 73, "time_stamp_s": 438, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6b90fbe92f3a95f151b63cca360402ddbc96f7e011b4495620b3a8c730cada69", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [408.032625, 409.033625, 410.034625, 411.035625, 412.036625, 413.037625, 414.038625, 415.039625, 416.040625, 417.041625, 418.0009166666667, 419.00191666666666, 420.0029166666667, 421.00391666666667, 422.00491666666665, 423.0059166666667, 424.00691666666665, 425.0079166666667, 426.00891666666666, 427.00991666666664, 428.0109166666667, 429.01191666666665, 430.0129166666667, 431.01391666666666, 432.0149166666667, 433.01591666666667, 434.01691666666665, 435.0179166666667, 436.01891666666666, 437.0199166666667], "recent_frames_sha256": "eb6d8193a4e5d5b92ed7c78f553b0ed60d0baad4cd96e896d43aed3db18be1de", "num_recent_frames": 30, "tq": 718143.97779409, "t1": 718151.897138074, "ta": 718151.897138074, "te": 718151.93624282, "first_response_s": 7.919343983987346, "answer_total_s": 7.958448729943484, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_73_a463_q0", "video_id": 73, "time_stamp_s": 438, "ground_truth": "C", "raw_output": "B. 3.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "f1982b934f8b5769629fba88a59bb5de3fa88b53264a3338c1069eecdfe6ca46", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A man in a blue shirt writes on a whiteboard, labeling sections of a circle with numbers and words like \"YOU,\" \"NEED,\" \"GO,\" and \"FIND.\"\n- The whiteboard displays a diagram with labeled sections, including \"KNOWN\" and \"UNKNOWN,\" with text describing concepts like \"LIFE HELPS\" and \"KNOWLEDGE.\"\n- A scene from \"Toy Story (1995)\" shows Woody lying on a blue surface with two blue boxes nearby.\n[120-150s] - A man in a light gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays a diagram with sections labeled \"KNOWN\" and \"UNKNOWN,\" along with handwritten notes in various colors.  \n- The man occasionally points to different parts of the whiteboard as he explains the content.\n[150-180s] - A man in a light gray polo shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays a circular diagram divided into \"KNOWN\" and \"UNKNOWN\" sections, with numbered points and handwritten notes.  \n- The background shows a dimly lit room with a wooden easel and a dark curtain, suggesting an indoor setting.\n[180-210s] - A man in a light gray shirt stands in front of a whiteboard, gesturing toward a diagram labeled \"KNOWN\" and \"UNKNOWN\" with numbered sections.  \n- The whiteboard contains handwritten text in various colors, including phrases like \"LIFE MELTS AWAY\" and \"CHAMPIONSHIP SONGS.\"  \n- The man appears to be explaining or presenting the content on the whiteboard, with his hands moving to emphasize points.\n[210-240s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays a diagram with sections labeled \"KNOWN\" and \"UNKNOWN,\" along with numbered points and text in various colors.  \n- The man occasionally shifts his stance and gestures toward different parts of the whiteboard as he explains the content.\n[240-270s] - Man in gray shirt gestures toward a whiteboard with a Venn diagram labeled \"KNOWN\" and \"UNKNOWN,\" pointing to numbered sections with text.  \n- Whiteboard contains handwritten notes in red, green, and blue ink, including phrases like \"LIFE MESS\" and \"UNKNOWN.\"  \n- Background shows a dimly lit room with a wooden easel and a dark, possibly industrial setting behind the man.\n[270-300s] - Man in gray shirt gestures toward a whiteboard with a Venn diagram labeled \"KNOWN\" and \"UNKNOWN.\"  \n- Whiteboard contains handwritten text, including phrases like \"Life has a way of...\" and \"We don't know everything.\"  \n- Background shows a dark room with a blackboard and a wooden easel holding the whiteboard.\n[300-330s] - Man gestures toward a whiteboard with a circular diagram divided into \"Known\" and \"Unknown\" sections, each containing numbered points and text.  \n- The whiteboard displays handwritten notes in red, green, and black markers, including phrases like \"Life helps us understand\" and \"They don't know everything.\"  \n- The man stands to the right of the whiteboard, facing slightly toward the camera, with his hands moving to emphasize points on the diagram.\n[330-360s] - A young man in a light-colored sweater types on a typewriter at a desk under a desk lamp.  \n- A newspaper titled \"TONG SONG\" with the headline \"Stillwater Rimes Deep\" is shown on a street corner.  \n- The scene transitions back to the man at the typewriter, with the newspaper visible in the background.\n[360-390s] - Man gestures toward a whiteboard with a circular diagram divided into \"Known\" and \"Unknown\" sections, each containing numbered points and text.  \n- He points to the \"Known\" section, which includes phrases like \"Life is a series of choices\" and \"You can't know everything.\"  \n- His hands move to emphasize the contrast between the \"Known\" and \"Unknown\" areas, indicating their relationship in the diagram.\n[390-420s] - A man in a brown jacket sits in a chair, holding a microphone, facing another person.  \n- The other person, wearing a white shirt, is partially visible from the back, holding a microphone.  \n- The setting appears to be a room with bookshelves and a window with curtains in the background.", "history_tokens": 993, "history_utf8_bytes": 4120, "recent_frame_times_s": [408.032625, 409.033625, 410.034625, 411.035625, 412.036625, 413.037625, 414.038625, 415.039625, 416.040625, 417.041625, 418.0009166666667, 419.00191666666666, 420.0029166666667, 421.00391666666667, 422.00491666666665, 423.0059166666667, 424.00691666666665, 425.0079166666667, 426.00891666666666, 427.00991666666664, 428.0109166666667, 429.01191666666665, 430.0129166666667, 431.01391666666666, 432.0149166666667, 433.01591666666667, 434.01691666666665, 435.0179166666667, 436.01891666666666, 437.0199166666667], "recent_frames_sha256": "eb6d8193a4e5d5b92ed7c78f553b0ed60d0baad4cd96e896d43aed3db18be1de", "num_recent_frames": 30, "tq": 718022.802804531, "t1": 718029.511899397, "ta": 718029.511899397, "te": 718029.704772428, "first_response_s": 6.7090948660625145, "answer_total_s": 6.901967897079885, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 73, "content_group": "d065cc132db1470b1a96370c7945d978d32f2e0d522b7126b7a777616a863c6f", "question": {"question_id": "sample_73_a464_q0", "video_id": 73, "video_path": "./videos/sample_73_real.mp4", "annotation_index": 464, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 10.", "B. 11.", "C. 9.", "D. 12."], "answer": "B", "time_stamp_s": 741, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_73_a464_q0", "video_id": 73, "time_stamp_s": 741, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bc43de95a5086a3a637d79185de98bb602734d4df46c5c05db578a3c406e3d26", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [711.0019583333333, 712.0029583333334, 713.0039583333333, 714.0049583333333, 715.0059583333333, 716.0069583333334, 717.0079583333334, 718.0089583333333, 719.0099583333333, 720.0109583333333, 721.0119583333334, 722.0129583333334, 723.0139583333333, 724.0149583333333, 725.0159583333333, 726.0169583333334, 727.0179583333334, 728.0189583333333, 729.0199583333333, 730.0209583333333, 731.0219583333334, 732.0229583333333, 733.0239583333333, 734.0249583333333, 735.0259583333333, 736.0269583333334, 737.0279583333333, 738.0289583333333, 739.0299583333333, 740.0309583333334], "recent_frames_sha256": "c3b3ef0f161353c2ea3b3b358931bd769b0e3a9cab967f36f565091cae738f6f", "num_recent_frames": 30, "tq": 718151.944904954, "t1": 718159.759847457, "ta": 718159.759847457, "te": 718159.797575703, "first_response_s": 7.814942502998747, "answer_total_s": 7.8526707489509135, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_73_a464_q0", "video_id": 73, "time_stamp_s": 741, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bc69ac7b51a517f43b68d2a18fc8d8809baf47eebfd97f77dc8e29da6c5aa73d", "condition_order": ["notes", "recent"], "memory": "[390-420s] - A man in a brown jacket sits in a chair, holding a microphone, facing another person.  \n- The other person, wearing a white shirt, is partially visible from the back, holding a microphone.  \n- The setting appears to be a room with bookshelves and a window with curtains in the background.\n[420-450s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"LESSON 1.2: THE HERO'S JOURNEY\" with bullet points about the hero's journey template.  \n- The man holds a whiteboard marker in his right hand and occasionally points to the board.\n[450-480s] - A man in a light-colored suit gestures while speaking to a woman in a checkered coat and beret.  \n- The woman holds a pistol and stands beside a man in a dark suit and hat, both facing away from the camera.  \n- A third man in a dark suit and hat stands behind them, partially obscured by the woman.\n[480-510s] - A man in a white hat holds a revolver, with a woman in a white dress beside him, both in a tense moment.  \n- The woman's hand is near the revolver, suggesting interaction or preparation for action.  \n- The scene is overlaid with text identifying the film \"Bonnie and Clyde (1947)\" at the bottom.\n[510-540s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"LESSON 1.2: THE HERO'S JOURNEY\" with bullet points about the hero's journey template.  \n- A movie clip from \"Almost Famous (2000)\" shows a girl with curly hair talking to a boy in a park setting.\n[540-570s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.2: THE HERO'S JOURNEY\" with bullet points about the hero's journey template.  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.\n[570-600s] - Man in light gray shirt gestures with hands while standing in front of a whiteboard.  \n- Whiteboard displays \"LESSON 1.2: THE HERO'S JOURNEY\" with bullet points about the hero's journey template.  \n- Man points to text on the whiteboard, specifically highlighting \"HERO'S JOURNEY: COMMON STORY TEMPLATE\" and \"A SIDDHES: THE PRINCIPLE STORY.\"\n[600-630s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.2: THE HERO'S JOURNEY\" with bullet points about the hero's journey, including \"HERO'S JOURNEY: COMMON SENSE TEMPLATE\" and \"A STORIES: THE PRINCIPLE STORY.\"  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.\n[630-660s] - A man in a light gray shirt stands in front of a whiteboard, gesturing with his right hand while speaking.  \n- The whiteboard displays \"LESSON 1.2: THE HERO'S JOURNEY\" and lists key components of the hero's journey template.  \n- The man’s left hand is slightly raised, palm facing outward, as if emphasizing a point during his explanation.\n[660-690s] - A man in a gray shirt gestures toward a whiteboard displaying \"LESSON 1.2: THE HERO'S JOURNEY\" with bullet points about the hero's journey template.  \n- The whiteboard lists elements like \"THE HERO'S JOURNEY: COMMON STORY TEMPLATE\" and \"A STORIES: THE PRINCIPLE STORY,\" with \"VIEWING: Roman Holiday (1951)\" at the bottom.  \n- The man points to different sections of the whiteboard while speaking, indicating key components of the hero's journey.\n[690-720s] - Three individuals stand before a large, carved stone face, with the central figure in a suit gesturing toward it.  \n- A woman in a light-colored blouse and dark skirt stands to the left, facing the stone face.  \n- The scene is in black and white, with text overlay identifying the film as \"Roman Holiday (1953).\"", "history_tokens": 1002, "history_utf8_bytes": 3836, "recent_frame_times_s": [711.0019583333333, 712.0029583333334, 713.0039583333333, 714.0049583333333, 715.0059583333333, 716.0069583333334, 717.0079583333334, 718.0089583333333, 719.0099583333333, 720.0109583333333, 721.0119583333334, 722.0129583333334, 723.0139583333333, 724.0149583333333, 725.0159583333333, 726.0169583333334, 727.0179583333334, 728.0189583333333, 729.0199583333333, 730.0209583333333, 731.0219583333334, 732.0229583333333, 733.0239583333333, 734.0249583333333, 735.0259583333333, 736.0269583333334, 737.0279583333333, 738.0289583333333, 739.0299583333333, 740.0309583333334], "recent_frames_sha256": "c3b3ef0f161353c2ea3b3b358931bd769b0e3a9cab967f36f565091cae738f6f", "num_recent_frames": 30, "tq": 718105.667287297, "t1": 718107.821308526, "ta": 718107.821308526, "te": 718107.866676963, "first_response_s": 2.1540212290128693, "answer_total_s": 2.199389666086063, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 74, "content_group": "695c4f7de4e4cf29b5931ef84e7d0a2ed1e408dc78cdc74d0c54a00fab288db5", "question": {"question_id": "sample_74_a2102_q0", "video_id": 74, "video_path": "./videos/sample_74_real.mp4", "annotation_index": 2102, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "A", "time_stamp_s": 198, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_74_a2102_q0", "video_id": 74, "time_stamp_s": 198, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d775633ad0beafa09ea2fe4a8135d130d2e216c8a9dc150865745f6eab5adb99", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667], "recent_frames_sha256": "b8d37aadf0d26d2518ea88f827f1f278db5d15ad8f6007b3a0102ea6d64cddf9", "num_recent_frames": 30, "tq": 715333.977016223, "t1": 715340.573009883, "ta": 715340.573009883, "te": 715340.614191602, "first_response_s": 6.595993660041131, "answer_total_s": 6.637175378971733, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_74_a2102_q0", "video_id": 74, "time_stamp_s": 198, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fbeb8b4b1fabac1cee43a1accd0ee54a9dbffeb066e0bdb87b8dec171b1424f4", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1: Stories, Scenes, and Screenplay\" with sections on \"Narrative Structure,\" \"Screenplay Structure,\" and \"Viewing: Running the Story.\"  \n- The man's name, \"Mr. Markelvitz Film Teacher,\" appears at the bottom of the screen.\n[30-60s] - A man in a gray shirt gestures toward a whiteboard displaying \"Lesson 1: 3 - Stories, Scenes, & Screenplay\" with handwritten notes.  \n- The whiteboard includes sections like \"MINI-LESSON,\" \"SCREENPLAY STRUCTURE,\" and \"SCENE,\" with highlighted terms in red and blue.  \n- The man’s hands move to emphasize different parts of the whiteboard content, indicating active explanation.\n[60-90s] - Man gestures with hands while speaking, standing in front of a whiteboard with lesson content.  \n- Whiteboard displays text including \"MINI-LESSON: STORIES, PLAYS WITH MULTIPLE\" and \"SCREENPLAY STRUCTURE\" sections.  \n- Man’s facial expression and hand movements suggest active explanation of the material.\n[90-120s] - A man in a gray shirt gestures with both hands while standing in front of a whiteboard.  \n- The whiteboard displays text about \"Lesson 1: Stories, Scenes, and Screenplay\" with sections for \"Screenplay Structure\" and \"Viewing: Running the Story.\"  \n- The man points to different parts of the whiteboard as he speaks, indicating key elements like \"Scene,\" \"Dialogue,\" and \"Event.\"\n[120-150s] - A man in a gray shirt gestures toward a whiteboard with lesson notes on storytelling and screenplay structure.  \n- The whiteboard displays terms like \"MINI-LESSON,\" \"SCENE,\" \"ACTION,\" \"DIALOGUE,\" and \"EVENT,\" with definitions and examples.  \n- The scene transitions to a movie clip from \"Dazed and Confused (1993)\" showing characters in a car and a group of young men in a colorful room.\n[150-180s] - A man in a black Adidas t-shirt walks alongside another person near a chain-link fence, carrying a stack of books.  \n- A nighttime scene shows a person in a camouflage jacket standing at a doorway, holding a phone.  \n- A group of people sit outdoors at night, facing a lit-up structure with fireworks in the background.", "history_tokens": 549, "history_utf8_bytes": 2209, "recent_frame_times_s": [168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667], "recent_frames_sha256": "b8d37aadf0d26d2518ea88f827f1f278db5d15ad8f6007b3a0102ea6d64cddf9", "num_recent_frames": 30, "tq": 715229.679232761, "t1": 715235.475585196, "ta": 715235.475585196, "te": 715235.714677287, "first_response_s": 5.796352435019799, "answer_total_s": 6.035444526001811, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 74, "content_group": "695c4f7de4e4cf29b5931ef84e7d0a2ed1e408dc78cdc74d0c54a00fab288db5", "question": {"question_id": "sample_74_a2103_q0", "video_id": 74, "video_path": "./videos/sample_74_real.mp4", "annotation_index": 2103, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 4.", "B. 5.", "C. 3.", "D. 2."], "answer": "B", "time_stamp_s": 271, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_74_a2103_q0", "video_id": 74, "time_stamp_s": 271, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "160e0fa5cb9e5c9f6451712a41e15667994265d8f6a69540a69f06e82abf9bae", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [241.03245833333332, 242.03345833333333, 243.03445833333333, 244.03545833333334, 245.03645833333334, 246.03745833333332, 247.03845833333332, 248.03945833333333, 249.04045833333333, 250.04145833333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.01675, 268.01775, 269.01875, 270.01975], "recent_frames_sha256": "f400b169d82b3b0436a6eae2dc4bd2f959f9fbcbfc394450fc5a3e2c7fd4fe73", "num_recent_frames": 30, "tq": 715340.633915706, "t1": 715347.197305383, "ta": 715347.197305383, "te": 715347.381142609, "first_response_s": 6.563389677088708, "answer_total_s": 6.747226903098635, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_74_a2103_q0", "video_id": 74, "time_stamp_s": 271, "ground_truth": "B", "raw_output": "A. 4.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "65e417733aba209e8b5ffdcc4d56fdf7e9f6b6d1219b7319e2f2b1ffcd180513", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1: Stories, Scenes, and Screenplay\" with sections on \"Narrative Structure,\" \"Screenplay Structure,\" and \"Viewing: Running the Story.\"  \n- The man's name, \"Mr. Markelvitz Film Teacher,\" appears at the bottom of the screen.\n[30-60s] - A man in a gray shirt gestures toward a whiteboard displaying \"Lesson 1: 3 - Stories, Scenes, & Screenplay\" with handwritten notes.  \n- The whiteboard includes sections like \"MINI-LESSON,\" \"SCREENPLAY STRUCTURE,\" and \"SCENE,\" with highlighted terms in red and blue.  \n- The man’s hands move to emphasize different parts of the whiteboard content, indicating active explanation.\n[60-90s] - Man gestures with hands while speaking, standing in front of a whiteboard with lesson content.  \n- Whiteboard displays text including \"MINI-LESSON: STORIES, PLAYS WITH MULTIPLE\" and \"SCREENPLAY STRUCTURE\" sections.  \n- Man’s facial expression and hand movements suggest active explanation of the material.\n[90-120s] - A man in a gray shirt gestures with both hands while standing in front of a whiteboard.  \n- The whiteboard displays text about \"Lesson 1: Stories, Scenes, and Screenplay\" with sections for \"Screenplay Structure\" and \"Viewing: Running the Story.\"  \n- The man points to different parts of the whiteboard as he speaks, indicating key elements like \"Scene,\" \"Dialogue,\" and \"Event.\"\n[120-150s] - A man in a gray shirt gestures toward a whiteboard with lesson notes on storytelling and screenplay structure.  \n- The whiteboard displays terms like \"MINI-LESSON,\" \"SCENE,\" \"ACTION,\" \"DIALOGUE,\" and \"EVENT,\" with definitions and examples.  \n- The scene transitions to a movie clip from \"Dazed and Confused (1993)\" showing characters in a car and a group of young men in a colorful room.\n[150-180s] - A man in a black Adidas t-shirt walks alongside another person near a chain-link fence, carrying a stack of books.  \n- A nighttime scene shows a person in a camouflage jacket standing at a doorway, holding a phone.  \n- A group of people sit outdoors at night, facing a lit-up structure with fireworks in the background.\n[180-210s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1: Stories, Scenes, and Screenplay\" with sections for \"Screenplay Structure\" and \"Viewing: Dazed and Confused (1993).\"  \n- Clips from the movie \"Dazed and Confused (1993)\" are shown, including scenes of students running and interacting in a school setting.\n[210-240s] - A man in a gray shirt gestures toward a whiteboard displaying \"Lesson 1: 3 - Stories, Scenes & Screenplay\" with sections for \"Scene,\" \"Action,\" \"Dialogue,\" and \"Event.\"\n- The video transitions to a car interior at night, showing three characters (two women and one man) looking out the rear window, with the title \"Dazed and Confused (1993)\" displayed.\n- A close-up shot shows a woman with curly hair smiling while leaning forward, followed by a scene of a woman in a room looking out a window with blinds.\n[240-270s] - A woman in a blue shirt stands between two people, facing them, with a row of light blue lockers behind her.  \n- A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text including \"LESSON 1: 3 - STORIES, PLAYS WITH MULTIPLE\" and \"SCREENPLAY STRUCTURE\" with sections for \"SCENE,\" \"ACTION,\" \"DIALOGUE,\" and \"EVENT.\"", "history_tokens": 903, "history_utf8_bytes": 3541, "recent_frame_times_s": [241.03245833333332, 242.03345833333333, 243.03445833333333, 244.03545833333334, 245.03645833333334, 246.03745833333332, 247.03845833333332, 248.03945833333333, 249.04045833333333, 250.04145833333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.01675, 268.01775, 269.01875, 270.01975], "recent_frames_sha256": "f400b169d82b3b0436a6eae2dc4bd2f959f9fbcbfc394450fc5a3e2c7fd4fe73", "num_recent_frames": 30, "tq": 715260.147130766, "t1": 715266.898204004, "ta": 715266.898204004, "te": 715267.177435023, "first_response_s": 6.751073238090612, "answer_total_s": 7.03030425705947, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 74, "content_group": "695c4f7de4e4cf29b5931ef84e7d0a2ed1e408dc78cdc74d0c54a00fab288db5", "question": {"question_id": "sample_74_a2104_q0", "video_id": 74, "video_path": "./videos/sample_74_real.mp4", "annotation_index": 2104, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 1.", "B. 3.", "C. 2.", "D. 5."], "answer": "D", "time_stamp_s": 318, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_74_a2104_q0", "video_id": 74, "time_stamp_s": 318, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f7796cd266e9eb2958aa88d75b8318fbcb57b74980b84e824071594ce63dafb9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [288.03775, 289.03875, 290.03975, 291.04075, 292.0000416666667, 293.00104166666665, 294.0020416666667, 295.00304166666666, 296.0040416666667, 297.00504166666667, 298.00604166666665, 299.0070416666667, 300.00804166666666, 301.0090416666667, 302.01004166666667, 303.01104166666664, 304.0120416666667, 305.01304166666665, 306.0140416666667, 307.01504166666666, 308.0160416666667, 309.01704166666667, 310.01804166666665, 311.0190416666667, 312.02004166666666, 313.0210416666667, 314.02204166666667, 315.02304166666664, 316.0240416666667, 317.02504166666665], "recent_frames_sha256": "f71f0e25cf310d38d2de3192c34e0fdcff3a459ed4d748ce173d7894a72c1d1d", "num_recent_frames": 30, "tq": 715347.397682135, "t1": 715359.32239296, "ta": 715359.32239296, "te": 715359.363141871, "first_response_s": 11.924710824969225, "answer_total_s": 11.965459736064076, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_74_a2104_q0", "video_id": 74, "time_stamp_s": 318, "ground_truth": "D", "raw_output": "C. 2.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "43b9f1b148d78071a5c6d5a0e325436824edecb9bedde0ccc16eedf94ca4b440", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1: Stories, Scenes, and Screenplay\" with sections on \"Narrative Structure,\" \"Screenplay Structure,\" and \"Viewing: Running the Story.\"  \n- The man's name, \"Mr. Markelvitz Film Teacher,\" appears at the bottom of the screen.\n[30-60s] - A man in a gray shirt gestures toward a whiteboard displaying \"Lesson 1: 3 - Stories, Scenes, & Screenplay\" with handwritten notes.  \n- The whiteboard includes sections like \"MINI-LESSON,\" \"SCREENPLAY STRUCTURE,\" and \"SCENE,\" with highlighted terms in red and blue.  \n- The man’s hands move to emphasize different parts of the whiteboard content, indicating active explanation.\n[60-90s] - Man gestures with hands while speaking, standing in front of a whiteboard with lesson content.  \n- Whiteboard displays text including \"MINI-LESSON: STORIES, PLAYS WITH MULTIPLE\" and \"SCREENPLAY STRUCTURE\" sections.  \n- Man’s facial expression and hand movements suggest active explanation of the material.\n[90-120s] - A man in a gray shirt gestures with both hands while standing in front of a whiteboard.  \n- The whiteboard displays text about \"Lesson 1: Stories, Scenes, and Screenplay\" with sections for \"Screenplay Structure\" and \"Viewing: Running the Story.\"  \n- The man points to different parts of the whiteboard as he speaks, indicating key elements like \"Scene,\" \"Dialogue,\" and \"Event.\"\n[120-150s] - A man in a gray shirt gestures toward a whiteboard with lesson notes on storytelling and screenplay structure.  \n- The whiteboard displays terms like \"MINI-LESSON,\" \"SCENE,\" \"ACTION,\" \"DIALOGUE,\" and \"EVENT,\" with definitions and examples.  \n- The scene transitions to a movie clip from \"Dazed and Confused (1993)\" showing characters in a car and a group of young men in a colorful room.\n[150-180s] - A man in a black Adidas t-shirt walks alongside another person near a chain-link fence, carrying a stack of books.  \n- A nighttime scene shows a person in a camouflage jacket standing at a doorway, holding a phone.  \n- A group of people sit outdoors at night, facing a lit-up structure with fireworks in the background.\n[180-210s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1: Stories, Scenes, and Screenplay\" with sections for \"Screenplay Structure\" and \"Viewing: Dazed and Confused (1993).\"  \n- Clips from the movie \"Dazed and Confused (1993)\" are shown, including scenes of students running and interacting in a school setting.\n[210-240s] - A man in a gray shirt gestures toward a whiteboard displaying \"Lesson 1: 3 - Stories, Scenes & Screenplay\" with sections for \"Scene,\" \"Action,\" \"Dialogue,\" and \"Event.\"\n- The video transitions to a car interior at night, showing three characters (two women and one man) looking out the rear window, with the title \"Dazed and Confused (1993)\" displayed.\n- A close-up shot shows a woman with curly hair smiling while leaning forward, followed by a scene of a woman in a room looking out a window with blinds.\n[240-270s] - A woman in a blue shirt stands between two people, facing them, with a row of light blue lockers behind her.  \n- A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text including \"LESSON 1: 3 - STORIES, PLAYS WITH MULTIPLE\" and \"SCREENPLAY STRUCTURE\" with sections for \"SCENE,\" \"ACTION,\" \"DIALOGUE,\" and \"EVENT.\"\n[270-300s] - A man in a gray shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text about \"Lesson 1: 3 - Stories, Scenes, and Screenwriting,\" including definitions and categories like \"Scene,\" \"Action,\" \"Dialogue,\" and \"Event.\"  \n- The man’s hands move expressively as he points to different sections of the whiteboard, indicating emphasis on the content.", "history_tokens": 1004, "history_utf8_bytes": 3958, "recent_frame_times_s": [288.03775, 289.03875, 290.03975, 291.04075, 292.0000416666667, 293.00104166666665, 294.0020416666667, 295.00304166666666, 296.0040416666667, 297.00504166666667, 298.00604166666665, 299.0070416666667, 300.00804166666666, 301.0090416666667, 302.01004166666667, 303.01104166666664, 304.0120416666667, 305.01304166666665, 306.0140416666667, 307.01504166666666, 308.0160416666667, 309.01704166666667, 310.01804166666665, 311.0190416666667, 312.02004166666666, 313.0210416666667, 314.02204166666667, 315.02304166666664, 316.0240416666667, 317.02504166666665], "recent_frames_sha256": "f71f0e25cf310d38d2de3192c34e0fdcff3a459ed4d748ce173d7894a72c1d1d", "num_recent_frames": 30, "tq": 715273.417503347, "t1": 715274.45918541, "ta": 715274.45918541, "te": 715274.662686484, "first_response_s": 1.0416820630198345, "answer_total_s": 1.2451831370126456, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 74, "content_group": "695c4f7de4e4cf29b5931ef84e7d0a2ed1e408dc78cdc74d0c54a00fab288db5", "question": {"question_id": "sample_74_a2105_q0", "video_id": 74, "video_path": "./videos/sample_74_real.mp4", "annotation_index": 2105, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 1.", "B. 3.", "C. 5.", "D. 7."], "answer": "C", "time_stamp_s": 438, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_74_a2105_q0", "video_id": 74, "time_stamp_s": 438, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "58453ff3bc554febce434a806c2f717c588a965dffa5cc9f5b33a5535f29c3e8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [408.032625, 409.033625, 410.034625, 411.035625, 412.036625, 413.037625, 414.038625, 415.039625, 416.040625, 417.041625, 418.0009166666667, 419.00191666666666, 420.0029166666667, 421.00391666666667, 422.00491666666665, 423.0059166666667, 424.00691666666665, 425.0079166666667, 426.00891666666666, 427.00991666666664, 428.0109166666667, 429.01191666666665, 430.0129166666667, 431.01391666666666, 432.0149166666667, 433.01591666666667, 434.01691666666665, 435.0179166666667, 436.01891666666666, 437.0199166666667], "recent_frames_sha256": "8389eaf22d4ac610a48cc4caca107d96d18ba38a698c7151e45413ca33853b52", "num_recent_frames": 30, "tq": 715359.376031391, "t1": 715371.406688103, "ta": 715371.406688103, "te": 715371.636911716, "first_response_s": 12.030656712013297, "answer_total_s": 12.260880324989557, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_74_a2105_q0", "video_id": 74, "time_stamp_s": 438, "ground_truth": "C", "raw_output": "B. 3.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "6b178e78afc489e08d1c1300da0eebca78d9c0cc6e906943af412129153b90f9", "condition_order": ["notes", "recent"], "memory": "[120-150s] - A man in a gray shirt gestures toward a whiteboard with lesson notes on storytelling and screenplay structure.  \n- The whiteboard displays terms like \"MINI-LESSON,\" \"SCENE,\" \"ACTION,\" \"DIALOGUE,\" and \"EVENT,\" with definitions and examples.  \n- The scene transitions to a movie clip from \"Dazed and Confused (1993)\" showing characters in a car and a group of young men in a colorful room.\n[150-180s] - A man in a black Adidas t-shirt walks alongside another person near a chain-link fence, carrying a stack of books.  \n- A nighttime scene shows a person in a camouflage jacket standing at a doorway, holding a phone.  \n- A group of people sit outdoors at night, facing a lit-up structure with fireworks in the background.\n[180-210s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1: Stories, Scenes, and Screenplay\" with sections for \"Screenplay Structure\" and \"Viewing: Dazed and Confused (1993).\"  \n- Clips from the movie \"Dazed and Confused (1993)\" are shown, including scenes of students running and interacting in a school setting.\n[210-240s] - A man in a gray shirt gestures toward a whiteboard displaying \"Lesson 1: 3 - Stories, Scenes & Screenplay\" with sections for \"Scene,\" \"Action,\" \"Dialogue,\" and \"Event.\"\n- The video transitions to a car interior at night, showing three characters (two women and one man) looking out the rear window, with the title \"Dazed and Confused (1993)\" displayed.\n- A close-up shot shows a woman with curly hair smiling while leaning forward, followed by a scene of a woman in a room looking out a window with blinds.\n[240-270s] - A woman in a blue shirt stands between two people, facing them, with a row of light blue lockers behind her.  \n- A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text including \"LESSON 1: 3 - STORIES, PLAYS WITH MULTIPLE\" and \"SCREENPLAY STRUCTURE\" with sections for \"SCENE,\" \"ACTION,\" \"DIALOGUE,\" and \"EVENT.\"\n[270-300s] - A man in a gray shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text about \"Lesson 1: 3 - Stories, Scenes, and Screenwriting,\" including definitions and categories like \"Scene,\" \"Action,\" \"Dialogue,\" and \"Event.\"  \n- The man’s hands move expressively as he points to different sections of the whiteboard, indicating emphasis on the content.\n[300-330s] - Rick and Carl are seated at the bar, both looking over ledgers; Carl is visibly busy.\n- Rick is engaged in conversation with Carl, asking about the bar's status and Carl responds with a timeline for closure.\n- The scene is set in the main room of \"IRP. RICK'S CAFE\" at night, with a static camera angle focused on the bar area.\n[330-360s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1: Stories, Plays with Multiple Characters\" and includes sections for \"Scene,\" \"Action,\" \"Dialogue,\" and \"Event.\"  \n- The background is dark, with a faintly visible \"CUT TO\" label in the upper right corner of the screen.\n[360-390s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1: 3 - Stories, Scenes, & Screenplay\" with sections for \"Scene,\" \"Action,\" \"Dialogue,\" and \"Event.\"  \n- The man occasionally points to different parts of the whiteboard as he explains the content.\n[390-420s] - A man in a gray shirt gestures with both hands while standing in front of a whiteboard.  \n- The whiteboard displays text about \"Lesson 1: 3-Storytelling, Scenes, & Screenwriting\" with sections for \"Screenwriting Structure\" and \"Viewing: Running the Story.\"  \n- The man points to different parts of the whiteboard as he speaks, indicating key concepts.", "history_tokens": 1009, "history_utf8_bytes": 3918, "recent_frame_times_s": [408.032625, 409.033625, 410.034625, 411.035625, 412.036625, 413.037625, 414.038625, 415.039625, 416.040625, 417.041625, 418.0009166666667, 419.00191666666666, 420.0029166666667, 421.00391666666667, 422.00491666666665, 423.0059166666667, 424.00691666666665, 425.0079166666667, 426.00891666666666, 427.00991666666664, 428.0109166666667, 429.01191666666665, 430.0129166666667, 431.01391666666666, 432.0149166666667, 433.01591666666667, 434.01691666666665, 435.0179166666667, 436.01891666666666, 437.0199166666667], "recent_frames_sha256": "8389eaf22d4ac610a48cc4caca107d96d18ba38a698c7151e45413ca33853b52", "num_recent_frames": 30, "tq": 715306.350747512, "t1": 715308.157793478, "ta": 715308.157793478, "te": 715308.364600173, "first_response_s": 1.807045966037549, "answer_total_s": 2.013852661009878, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 74, "content_group": "695c4f7de4e4cf29b5931ef84e7d0a2ed1e408dc78cdc74d0c54a00fab288db5", "question": {"question_id": "sample_74_a2106_q0", "video_id": 74, "video_path": "./videos/sample_74_real.mp4", "annotation_index": 2106, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 5.", "B. 6.", "C. 7.", "D. 8."], "answer": "B", "time_stamp_s": 491, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_74_a2106_q0", "video_id": 74, "time_stamp_s": 491, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0cfaee50bf4d636dc4d8f1ae63bcc612e3de11075d55185354ebfe7d1ec518fa", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [461.00220833333333, 462.00320833333336, 463.00420833333334, 464.0052083333333, 465.00620833333335, 466.0072083333333, 467.00820833333336, 468.00920833333333, 469.0102083333333, 470.01120833333334, 471.0122083333333, 472.01320833333335, 473.01420833333333, 474.0152083333333, 475.01620833333334, 476.0172083333333, 477.01820833333335, 478.0192083333333, 479.02020833333336, 480.02120833333333, 481.0222083333333, 482.02320833333334, 483.0242083333333, 484.02520833333335, 485.02620833333333, 486.0272083333333, 487.02820833333334, 488.0292083333333, 489.03020833333335, 490.0312083333333], "recent_frames_sha256": "c24b0a70702fa0170b204a79f7d052121192464797342ed62b4b02b2f4b91071", "num_recent_frames": 30, "tq": 715371.649785196, "t1": 715382.87623093, "ta": 715382.87623093, "te": 715382.916206524, "first_response_s": 11.226445734035224, "answer_total_s": 11.266421328065917, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_74_a2106_q0", "video_id": 74, "time_stamp_s": 491, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2b2e2f471b019abe6c6792fe7a53b133d18d0694fa81500657214c21568b90f8", "condition_order": ["notes", "recent"], "memory": "[180-210s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1: Stories, Scenes, and Screenplay\" with sections for \"Screenplay Structure\" and \"Viewing: Dazed and Confused (1993).\"  \n- Clips from the movie \"Dazed and Confused (1993)\" are shown, including scenes of students running and interacting in a school setting.\n[210-240s] - A man in a gray shirt gestures toward a whiteboard displaying \"Lesson 1: 3 - Stories, Scenes & Screenplay\" with sections for \"Scene,\" \"Action,\" \"Dialogue,\" and \"Event.\"\n- The video transitions to a car interior at night, showing three characters (two women and one man) looking out the rear window, with the title \"Dazed and Confused (1993)\" displayed.\n- A close-up shot shows a woman with curly hair smiling while leaning forward, followed by a scene of a woman in a room looking out a window with blinds.\n[240-270s] - A woman in a blue shirt stands between two people, facing them, with a row of light blue lockers behind her.  \n- A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text including \"LESSON 1: 3 - STORIES, PLAYS WITH MULTIPLE\" and \"SCREENPLAY STRUCTURE\" with sections for \"SCENE,\" \"ACTION,\" \"DIALOGUE,\" and \"EVENT.\"\n[270-300s] - A man in a gray shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text about \"Lesson 1: 3 - Stories, Scenes, and Screenwriting,\" including definitions and categories like \"Scene,\" \"Action,\" \"Dialogue,\" and \"Event.\"  \n- The man’s hands move expressively as he points to different sections of the whiteboard, indicating emphasis on the content.\n[300-330s] - Rick and Carl are seated at the bar, both looking over ledgers; Carl is visibly busy.\n- Rick is engaged in conversation with Carl, asking about the bar's status and Carl responds with a timeline for closure.\n- The scene is set in the main room of \"IRP. RICK'S CAFE\" at night, with a static camera angle focused on the bar area.\n[330-360s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1: Stories, Plays with Multiple Characters\" and includes sections for \"Scene,\" \"Action,\" \"Dialogue,\" and \"Event.\"  \n- The background is dark, with a faintly visible \"CUT TO\" label in the upper right corner of the screen.\n[360-390s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1: 3 - Stories, Scenes, & Screenplay\" with sections for \"Scene,\" \"Action,\" \"Dialogue,\" and \"Event.\"  \n- The man occasionally points to different parts of the whiteboard as he explains the content.\n[390-420s] - A man in a gray shirt gestures with both hands while standing in front of a whiteboard.  \n- The whiteboard displays text about \"Lesson 1: 3-Storytelling, Scenes, & Screenwriting\" with sections for \"Screenwriting Structure\" and \"Viewing: Running the Story.\"  \n- The man points to different parts of the whiteboard as he speaks, indicating key concepts.\n[420-450s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1: 3 - Stories, Scenes, & Screenplay\" with sections for \"Screenplay Structure\" and \"Viewing: Running into the Woods.\"  \n- The man occasionally points to different parts of the whiteboard as he explains the content.\n[450-480s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1: Stories, Scenes, and Screenplay\" with sections for \"Screenplay Structure\" and \"Viewing: Hannah and Her Sisters (1986).\"  \n- The background is dark, with a faintly visible bookshelf or wall behind the man.", "history_tokens": 1017, "history_utf8_bytes": 3919, "recent_frame_times_s": [461.00220833333333, 462.00320833333336, 463.00420833333334, 464.0052083333333, 465.00620833333335, 466.0072083333333, 467.00820833333336, 468.00920833333333, 469.0102083333333, 470.01120833333334, 471.0122083333333, 472.01320833333335, 473.01420833333333, 474.0152083333333, 475.01620833333334, 476.0172083333333, 477.01820833333335, 478.0192083333333, 479.02020833333336, 480.02120833333333, 481.0222083333333, 482.02320833333334, 483.0242083333333, 484.02520833333335, 485.02620833333333, 486.0272083333333, 487.02820833333334, 488.0292083333333, 489.03020833333335, 490.0312083333333], "recent_frames_sha256": "c24b0a70702fa0170b204a79f7d052121192464797342ed62b4b02b2f4b91071", "num_recent_frames": 30, "tq": 715326.70308937, "t1": 715333.732495421, "ta": 715333.732495421, "te": 715333.939663923, "first_response_s": 7.029406050918624, "answer_total_s": 7.236574552953243, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 75, "content_group": "e9393012863c7e4e411faed8568360c95d77f5773b70b798f86ece75d61e18a1", "question": {"question_id": "sample_75_a1054_q0", "video_id": 75, "video_path": "./videos/sample_75_real.mp4", "annotation_index": 1054, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 18, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_75_a1054_q0", "video_id": 75, "time_stamp_s": 18, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "191b7637ce6c8c71123edbfc4fa6369efa9effa314d8b5d8caa2c3473a6a00a4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "726443b538e2d06f7e8fba7aba84cd13c725fb3b8d1817d374d2018028939541", "num_recent_frames": 18, "tq": 717862.860672722, "t1": 717870.162362062, "ta": 717870.162362062, "te": 717870.393729626, "first_response_s": 7.3016893400345, "answer_total_s": 7.533056903979741, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_75_a1054_q0", "video_id": 75, "time_stamp_s": 18, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "214d9d247bac655a309a1503674528bf8e5486d385a1d20ff685752f70f336a7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "726443b538e2d06f7e8fba7aba84cd13c725fb3b8d1817d374d2018028939541", "num_recent_frames": 18, "tq": 717706.998357807, "t1": 717718.39654139, "ta": 717718.39654139, "te": 717718.435583993, "first_response_s": 11.398183582932688, "answer_total_s": 11.437226185924374, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 75, "content_group": "e9393012863c7e4e411faed8568360c95d77f5773b70b798f86ece75d61e18a1", "question": {"question_id": "sample_75_a1055_q0", "video_id": 75, "video_path": "./videos/sample_75_real.mp4", "annotation_index": 1055, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "B", "time_stamp_s": 203, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_75_a1055_q0", "video_id": 75, "time_stamp_s": 203, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e5ce5cab5b576fbd6e28a0e5c246c62aa59ce5d4bc728bd44aa5d84b8181b22c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.03416666666666, 202.03516666666667], "recent_frames_sha256": "589276f9858b765981f83713ef7d230212abe6f49c33d941b6d36bdb1c411bd6", "num_recent_frames": 30, "tq": 717870.418621199, "t1": 717877.12159255, "ta": 717877.12159255, "te": 717877.159753538, "first_response_s": 6.7029713509837165, "answer_total_s": 6.741132338996977, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_75_a1055_q0", "video_id": 75, "time_stamp_s": 203, "ground_truth": "B", "raw_output": "B. 3.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "2fa7db72af1a02b08825eefd204ee0f3dbeb564df13454560feade2207d68bbf", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light-colored shirt stands in front of a whiteboard with \"LESSON 1.4: CHARACTERS, TYPES, & MOTIVATIONS\" written on it, gesturing while speaking.  \n- The whiteboard lists topics like \"BASIC TYPES,\" \"CHARACTER TYPES,\" and \"EXAMPLES,\" with handwritten notes in various colors.  \n- At 0:22, a clip from \"Scary Movie (2000)\" shows a woman running through a doorway, followed by a scene with two yellow signs reading \"SAFETY\" and \"DEATH.\"\n[30-60s] - A man in a gray shirt gestures toward a whiteboard with lesson notes on \"Chronicle Types & Motivations\" while speaking.  \n- The whiteboard displays sections like \"Background,\" \"Examples,\" and \"Lab Assignment,\" with handwritten text in blue, red, and black markers.  \n- The scene transitions to a movie clip from \"Hamlet (1990)\" showing a man in a white robe in a dimly lit room, followed by a scene of a group of people in armor fighting in a stone courtyard.\n[60-90s] - Man gestures toward whiteboard with both hands while speaking.  \n- Whiteboard displays lesson title and bullet points about character types and motivations.  \n- Man occasionally shifts stance but remains in front of the whiteboard.\n[90-120s] - A man in a gray shirt gestures with both hands while standing in front of a whiteboard.  \n- The whiteboard displays text in various colors, including \"LESSON 1.4: ORGANIC TYPES & MOTIVATIONS\" and \"EXAMPLE: INTELLIGENT, INTELLIGENT, INTELLIGENT.\"  \n- The man occasionally points to different sections of the whiteboard as he speaks.\n[120-150s] - Man gestures with hands while speaking, standing in front of a whiteboard with lesson content.  \n- Whiteboard displays \"Lesson 1.4: Character Types & Motivations\" with bullet points about character types and examples.  \n- Man’s hands move to emphasize points on the whiteboard, which includes text like \"EXAMPLE: REBECCA\" and \"VIEWING: SOAR LIKE THE TIGER.\"\n[150-180s] - A man in a light-colored shirt stands beside a whiteboard, gesturing toward written lesson content.  \n- The whiteboard displays lesson details, including \"Lesson 1.4: Character Types & Motivations\" and examples like \"Benevolent,\" \"Villain,\" and \"Survivor.\"  \n- A film clip of \"The Good, The Bad and The Ugly (1966)\" shows a vast cemetery with scattered gravestones and distant hills under a bright sky.", "history_tokens": 602, "history_utf8_bytes": 2300, "recent_frame_times_s": [173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.03416666666666, 202.03516666666667], "recent_frames_sha256": "589276f9858b765981f83713ef7d230212abe6f49c33d941b6d36bdb1c411bd6", "num_recent_frames": 30, "tq": 717762.551878803, "t1": 717764.57368037, "ta": 717764.57368037, "te": 717764.881507818, "first_response_s": 2.0218015670543537, "answer_total_s": 2.329629015061073, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 75, "content_group": "e9393012863c7e4e411faed8568360c95d77f5773b70b798f86ece75d61e18a1", "question": {"question_id": "sample_75_a1056_q0", "video_id": 75, "video_path": "./videos/sample_75_real.mp4", "annotation_index": 1056, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 4.", "B. 5.", "C. 3.", "D. 2."], "answer": "B", "time_stamp_s": 271, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_75_a1056_q0", "video_id": 75, "time_stamp_s": 271, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "81855699c6b95a8fa306f9cf09af2ff61ed29330f6d86c91305a6d4ad593e0dc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [241.03245833333332, 242.03345833333333, 243.03445833333333, 244.03545833333334, 245.03645833333334, 246.03745833333332, 247.03845833333332, 248.03945833333333, 249.04045833333333, 250.04145833333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.01675, 268.01775, 269.01875, 270.01975], "recent_frames_sha256": "402cc0a42043de6a8734a212bcd424e18b2948a8cd413a643402cf3dc8020be1", "num_recent_frames": 30, "tq": 717877.182315943, "t1": 717883.465420767, "ta": 717883.465420767, "te": 717883.504823025, "first_response_s": 6.283104824018665, "answer_total_s": 6.322507082019001, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_75_a1056_q0", "video_id": 75, "time_stamp_s": 271, "ground_truth": "B", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "d568341af1a97c042e089e7e9f0fa496dcbf1a2e5d5bec14829e312a2bfb9dc9", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light-colored shirt stands in front of a whiteboard with \"LESSON 1.4: CHARACTERS, TYPES, & MOTIVATIONS\" written on it, gesturing while speaking.  \n- The whiteboard lists topics like \"BASIC TYPES,\" \"CHARACTER TYPES,\" and \"EXAMPLES,\" with handwritten notes in various colors.  \n- At 0:22, a clip from \"Scary Movie (2000)\" shows a woman running through a doorway, followed by a scene with two yellow signs reading \"SAFETY\" and \"DEATH.\"\n[30-60s] - A man in a gray shirt gestures toward a whiteboard with lesson notes on \"Chronicle Types & Motivations\" while speaking.  \n- The whiteboard displays sections like \"Background,\" \"Examples,\" and \"Lab Assignment,\" with handwritten text in blue, red, and black markers.  \n- The scene transitions to a movie clip from \"Hamlet (1990)\" showing a man in a white robe in a dimly lit room, followed by a scene of a group of people in armor fighting in a stone courtyard.\n[60-90s] - Man gestures toward whiteboard with both hands while speaking.  \n- Whiteboard displays lesson title and bullet points about character types and motivations.  \n- Man occasionally shifts stance but remains in front of the whiteboard.\n[90-120s] - A man in a gray shirt gestures with both hands while standing in front of a whiteboard.  \n- The whiteboard displays text in various colors, including \"LESSON 1.4: ORGANIC TYPES & MOTIVATIONS\" and \"EXAMPLE: INTELLIGENT, INTELLIGENT, INTELLIGENT.\"  \n- The man occasionally points to different sections of the whiteboard as he speaks.\n[120-150s] - Man gestures with hands while speaking, standing in front of a whiteboard with lesson content.  \n- Whiteboard displays \"Lesson 1.4: Character Types & Motivations\" with bullet points about character types and examples.  \n- Man’s hands move to emphasize points on the whiteboard, which includes text like \"EXAMPLE: REBECCA\" and \"VIEWING: SOAR LIKE THE TIGER.\"\n[150-180s] - A man in a light-colored shirt stands beside a whiteboard, gesturing toward written lesson content.  \n- The whiteboard displays lesson details, including \"Lesson 1.4: Character Types & Motivations\" and examples like \"Benevolent,\" \"Villain,\" and \"Survivor.\"  \n- A film clip of \"The Good, The Bad and The Ugly (1966)\" shows a vast cemetery with scattered gravestones and distant hills under a bright sky.\n[180-210s] - A man in a brown leather jacket stands in a cemetery, surrounded by gravestones and sparse trees under a clear sky.  \n- The scene transitions to a man in a black hat and dark coat, holding a revolver, standing in a similar cemetery with distant hills.  \n- A third man, wearing a green shirt and dark pants, appears in a different cemetery setting, with a tree and hills in the background.\n[210-240s] - A man with a beard and hat, holding a cigarette, is shown in a close-up shot with a blurred natural background.  \n- A teacher stands in front of a whiteboard, gesturing while explaining lesson content about narrative types and motivations.  \n- A scene from the movie \"Inside Uweyn Davis (2013)\" shows a man holding a cat on a train, followed by a chaotic scene with people moving and feet on the floor.\n[240-270s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1.4: Character Types & Motivations,\" including bullet points and examples.  \n- The background is dark, with a faintly visible ceiling and wall structure behind the man.", "history_tokens": 881, "history_utf8_bytes": 3443, "recent_frame_times_s": [241.03245833333332, 242.03345833333333, 243.03445833333333, 244.03545833333334, 245.03645833333334, 246.03745833333332, 247.03845833333332, 248.03945833333333, 249.04045833333333, 250.04145833333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.01675, 268.01775, 269.01875, 270.01975], "recent_frames_sha256": "402cc0a42043de6a8734a212bcd424e18b2948a8cd413a643402cf3dc8020be1", "num_recent_frames": 30, "tq": 717789.995131118, "t1": 717791.795795649, "ta": 717791.795795649, "te": 717792.00041583, "first_response_s": 1.8006645310670137, "answer_total_s": 2.0052847120678052, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 75, "content_group": "e9393012863c7e4e411faed8568360c95d77f5773b70b798f86ece75d61e18a1", "question": {"question_id": "sample_75_a1057_q0", "video_id": 75, "video_path": "./videos/sample_75_real.mp4", "annotation_index": 1057, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 1.", "B. 3.", "C. 2.", "D. 5."], "answer": "D", "time_stamp_s": 318, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_75_a1057_q0", "video_id": 75, "time_stamp_s": 318, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "743c49644286bc6cb804d9a0541b255a2b7bc40f5aa56f69dacb237798e17306", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [288.03775, 289.03875, 290.03975, 291.04075, 292.0000416666667, 293.00104166666665, 294.0020416666667, 295.00304166666666, 296.0040416666667, 297.00504166666667, 298.00604166666665, 299.0070416666667, 300.00804166666666, 301.0090416666667, 302.01004166666667, 303.01104166666664, 304.0120416666667, 305.01304166666665, 306.0140416666667, 307.01504166666666, 308.0160416666667, 309.01704166666667, 310.01804166666665, 311.0190416666667, 312.02004166666666, 313.0210416666667, 314.02204166666667, 315.02304166666664, 316.0240416666667, 317.02504166666665], "recent_frames_sha256": "8a2fa9f4e1ad4ea5691ead5ea7c0c2bf126392f33939badaeb2436c5f448a37b", "num_recent_frames": 30, "tq": 717883.53872367, "t1": 717890.291748168, "ta": 717890.291748168, "te": 717890.329085743, "first_response_s": 6.753024498000741, "answer_total_s": 6.790362073108554, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_75_a1057_q0", "video_id": 75, "time_stamp_s": 318, "ground_truth": "D", "raw_output": "B. 3.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "6496a8b63da253bb0ae4787d3a2ae24afdb4f8970e1b551a41a2481b28b4b15e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light-colored shirt stands in front of a whiteboard with \"LESSON 1.4: CHARACTERS, TYPES, & MOTIVATIONS\" written on it, gesturing while speaking.  \n- The whiteboard lists topics like \"BASIC TYPES,\" \"CHARACTER TYPES,\" and \"EXAMPLES,\" with handwritten notes in various colors.  \n- At 0:22, a clip from \"Scary Movie (2000)\" shows a woman running through a doorway, followed by a scene with two yellow signs reading \"SAFETY\" and \"DEATH.\"\n[30-60s] - A man in a gray shirt gestures toward a whiteboard with lesson notes on \"Chronicle Types & Motivations\" while speaking.  \n- The whiteboard displays sections like \"Background,\" \"Examples,\" and \"Lab Assignment,\" with handwritten text in blue, red, and black markers.  \n- The scene transitions to a movie clip from \"Hamlet (1990)\" showing a man in a white robe in a dimly lit room, followed by a scene of a group of people in armor fighting in a stone courtyard.\n[60-90s] - Man gestures toward whiteboard with both hands while speaking.  \n- Whiteboard displays lesson title and bullet points about character types and motivations.  \n- Man occasionally shifts stance but remains in front of the whiteboard.\n[90-120s] - A man in a gray shirt gestures with both hands while standing in front of a whiteboard.  \n- The whiteboard displays text in various colors, including \"LESSON 1.4: ORGANIC TYPES & MOTIVATIONS\" and \"EXAMPLE: INTELLIGENT, INTELLIGENT, INTELLIGENT.\"  \n- The man occasionally points to different sections of the whiteboard as he speaks.\n[120-150s] - Man gestures with hands while speaking, standing in front of a whiteboard with lesson content.  \n- Whiteboard displays \"Lesson 1.4: Character Types & Motivations\" with bullet points about character types and examples.  \n- Man’s hands move to emphasize points on the whiteboard, which includes text like \"EXAMPLE: REBECCA\" and \"VIEWING: SOAR LIKE THE TIGER.\"\n[150-180s] - A man in a light-colored shirt stands beside a whiteboard, gesturing toward written lesson content.  \n- The whiteboard displays lesson details, including \"Lesson 1.4: Character Types & Motivations\" and examples like \"Benevolent,\" \"Villain,\" and \"Survivor.\"  \n- A film clip of \"The Good, The Bad and The Ugly (1966)\" shows a vast cemetery with scattered gravestones and distant hills under a bright sky.\n[180-210s] - A man in a brown leather jacket stands in a cemetery, surrounded by gravestones and sparse trees under a clear sky.  \n- The scene transitions to a man in a black hat and dark coat, holding a revolver, standing in a similar cemetery with distant hills.  \n- A third man, wearing a green shirt and dark pants, appears in a different cemetery setting, with a tree and hills in the background.\n[210-240s] - A man with a beard and hat, holding a cigarette, is shown in a close-up shot with a blurred natural background.  \n- A teacher stands in front of a whiteboard, gesturing while explaining lesson content about narrative types and motivations.  \n- A scene from the movie \"Inside Uweyn Davis (2013)\" shows a man holding a cat on a train, followed by a chaotic scene with people moving and feet on the floor.\n[240-270s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1.4: Character Types & Motivations,\" including bullet points and examples.  \n- The background is dark, with a faintly visible ceiling and wall structure behind the man.\n[270-300s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text in various colors, including \"Lesson 1.4: Narrative Types & Motivations\" and \"BANTHILLER: WHY CHARACTERS BEHAVE THE WAY THEY DO.\"  \n- The man occasionally points to sections of the whiteboard, emphasizing key points.", "history_tokens": 976, "history_utf8_bytes": 3802, "recent_frame_times_s": [288.03775, 289.03875, 290.03975, 291.04075, 292.0000416666667, 293.00104166666665, 294.0020416666667, 295.00304166666666, 296.0040416666667, 297.00504166666667, 298.00604166666665, 299.0070416666667, 300.00804166666666, 301.0090416666667, 302.01004166666667, 303.01104166666664, 304.0120416666667, 305.01304166666665, 306.0140416666667, 307.01504166666666, 308.0160416666667, 309.01704166666667, 310.01804166666665, 311.0190416666667, 312.02004166666666, 313.0210416666667, 314.02204166666667, 315.02304166666664, 316.0240416666667, 317.02504166666665], "recent_frames_sha256": "8a2fa9f4e1ad4ea5691ead5ea7c0c2bf126392f33939badaeb2436c5f448a37b", "num_recent_frames": 30, "tq": 717804.345818433, "t1": 717806.125178634, "ta": 717806.125178634, "te": 717806.495973214, "first_response_s": 1.779360200976953, "answer_total_s": 2.150154781062156, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 75, "content_group": "e9393012863c7e4e411faed8568360c95d77f5773b70b798f86ece75d61e18a1", "question": {"question_id": "sample_75_a1058_q0", "video_id": 75, "video_path": "./videos/sample_75_real.mp4", "annotation_index": 1058, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 1.", "B. 3.", "C. 5.", "D. 7."], "answer": "D", "time_stamp_s": 397, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_75_a1058_q0", "video_id": 75, "time_stamp_s": 397, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "dea1d863ab9bf7a0b3f6da3f0a67ac1659861f7ded1fc94d42c8e497c7d717bc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [367.03333333333336, 368.03433333333334, 369.0353333333333, 370.03633333333335, 371.0373333333333, 372.03833333333336, 373.03933333333333, 374.0403333333333, 375.04133333333334, 376.000625, 377.001625, 378.002625, 379.003625, 380.004625, 381.005625, 382.006625, 383.007625, 384.008625, 385.009625, 386.010625, 387.011625, 388.012625, 389.013625, 390.014625, 391.015625, 392.016625, 393.017625, 394.018625, 395.019625, 396.020625], "recent_frames_sha256": "32261d73423925792ec11801af86cbac8c3ee659f89e6854c72e496d9cc11e7f", "num_recent_frames": 30, "tq": 717890.354341934, "t1": 717897.509137915, "ta": 717897.509137915, "te": 717897.548548545, "first_response_s": 7.154795981012285, "answer_total_s": 7.1942066110204905, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_75_a1058_q0", "video_id": 75, "time_stamp_s": 397, "ground_truth": "D", "raw_output": "B. 3.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "a98fc0066b1e8581a18e67e938b3e9ded3a8f79687c83199379343ed3a3f6e12", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Man gestures toward whiteboard with both hands while speaking.  \n- Whiteboard displays lesson title and bullet points about character types and motivations.  \n- Man occasionally shifts stance but remains in front of the whiteboard.\n[90-120s] - A man in a gray shirt gestures with both hands while standing in front of a whiteboard.  \n- The whiteboard displays text in various colors, including \"LESSON 1.4: ORGANIC TYPES & MOTIVATIONS\" and \"EXAMPLE: INTELLIGENT, INTELLIGENT, INTELLIGENT.\"  \n- The man occasionally points to different sections of the whiteboard as he speaks.\n[120-150s] - Man gestures with hands while speaking, standing in front of a whiteboard with lesson content.  \n- Whiteboard displays \"Lesson 1.4: Character Types & Motivations\" with bullet points about character types and examples.  \n- Man’s hands move to emphasize points on the whiteboard, which includes text like \"EXAMPLE: REBECCA\" and \"VIEWING: SOAR LIKE THE TIGER.\"\n[150-180s] - A man in a light-colored shirt stands beside a whiteboard, gesturing toward written lesson content.  \n- The whiteboard displays lesson details, including \"Lesson 1.4: Character Types & Motivations\" and examples like \"Benevolent,\" \"Villain,\" and \"Survivor.\"  \n- A film clip of \"The Good, The Bad and The Ugly (1966)\" shows a vast cemetery with scattered gravestones and distant hills under a bright sky.\n[180-210s] - A man in a brown leather jacket stands in a cemetery, surrounded by gravestones and sparse trees under a clear sky.  \n- The scene transitions to a man in a black hat and dark coat, holding a revolver, standing in a similar cemetery with distant hills.  \n- A third man, wearing a green shirt and dark pants, appears in a different cemetery setting, with a tree and hills in the background.\n[210-240s] - A man with a beard and hat, holding a cigarette, is shown in a close-up shot with a blurred natural background.  \n- A teacher stands in front of a whiteboard, gesturing while explaining lesson content about narrative types and motivations.  \n- A scene from the movie \"Inside Uweyn Davis (2013)\" shows a man holding a cat on a train, followed by a chaotic scene with people moving and feet on the floor.\n[240-270s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1.4: Character Types & Motivations,\" including bullet points and examples.  \n- The background is dark, with a faintly visible ceiling and wall structure behind the man.\n[270-300s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text in various colors, including \"Lesson 1.4: Narrative Types & Motivations\" and \"BANTHILLER: WHY CHARACTERS BEHAVE THE WAY THEY DO.\"  \n- The man occasionally points to sections of the whiteboard, emphasizing key points.\n[300-330s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1.4: Character Types & Motivations,\" including sections on \"Background,\" \"Character Types,\" and \"Lab Assignment.\"  \n- The man occasionally points to specific parts of the whiteboard, indicating key points in the lesson.\n[330-360s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Character Types & Motivations\" with sections like \"Introverted,\" \"Extroverted,\" and \"Examples.\"  \n- A black-and-white film clip titled \"Some Like It Hot (1959)\" appears at the bottom of the screen, showing two men in a phone booth.\n[360-390s] - Two women in 1920s attire stand near a curtained doorway, one gesturing while the other looks on.  \n- A third woman with short blonde hair enters, holding a cigarette, and turns to face the other two.  \n- The scene is set in a dimly lit interior with wooden paneling, suggesting a private or formal setting.", "history_tokens": 1005, "history_utf8_bytes": 3955, "recent_frame_times_s": [367.03333333333336, 368.03433333333334, 369.0353333333333, 370.03633333333335, 371.0373333333333, 372.03833333333336, 373.03933333333333, 374.0403333333333, 375.04133333333334, 376.000625, 377.001625, 378.002625, 379.003625, 380.004625, 381.005625, 382.006625, 383.007625, 384.008625, 385.009625, 386.010625, 387.011625, 388.012625, 389.013625, 390.014625, 391.015625, 392.016625, 393.017625, 394.018625, 395.019625, 396.020625], "recent_frames_sha256": "32261d73423925792ec11801af86cbac8c3ee659f89e6854c72e496d9cc11e7f", "num_recent_frames": 30, "tq": 717830.724699746, "t1": 717862.585664809, "ta": 717862.585664809, "te": 717862.847489839, "first_response_s": 31.86096506298054, "answer_total_s": 32.12279009295162, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 76, "content_group": "724305225469be02498095cc4bd4c4074b02beea2ae4a17969b18a4c94ed42fc", "question": {"question_id": "sample_76_a2196_q0", "video_id": 76, "video_path": "./videos/sample_76_real.mp4", "annotation_index": 2196, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 0.", "B. 2.", "C. 3.", "D. 4."], "answer": "A", "time_stamp_s": 18, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_76_a2196_q0", "video_id": 76, "time_stamp_s": 18, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "52e496b2425250d94bb51e5f20829f415d80bd1b3e6284e3c0a307921c2498c2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "a20a37e0231d5588a4e85945f046a512948fa6bc9feb34e2410c75588b0cd738", "num_recent_frames": 18, "tq": 719472.679887106, "t1": 719473.324782666, "ta": 719473.324782666, "te": 719473.362736733, "first_response_s": 0.6448955601081252, "answer_total_s": 0.6828496271045879, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_76_a2196_q0", "video_id": 76, "time_stamp_s": 18, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "921126934ef950015596c8f393f747532fba1310a1bbeac637c47382e9754c1c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "a20a37e0231d5588a4e85945f046a512948fa6bc9feb34e2410c75588b0cd738", "num_recent_frames": 18, "tq": 719342.875788299, "t1": 719344.300385304, "ta": 719344.300385304, "te": 719344.526554723, "first_response_s": 1.4245970050105825, "answer_total_s": 1.650766424019821, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 76, "content_group": "724305225469be02498095cc4bd4c4074b02beea2ae4a17969b18a4c94ed42fc", "question": {"question_id": "sample_76_a2197_q0", "video_id": 76, "video_path": "./videos/sample_76_real.mp4", "annotation_index": 2197, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 2.", "C. 4.", "D. 0."], "answer": "A", "time_stamp_s": 203, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_76_a2197_q0", "video_id": 76, "time_stamp_s": 203, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ee6fb4e53274ee6813a0807d72b34e2bfc1713e6352244cea2f0864eda23d6b9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.03416666666666, 202.03516666666667], "recent_frames_sha256": "42711bcb73bf6d3c2e74ce8e831cfd7c68d37b2ee04322cfdb5e439407e5de0b", "num_recent_frames": 30, "tq": 719473.375467487, "t1": 719484.200269945, "ta": 719484.200269945, "te": 719484.238100616, "first_response_s": 10.82480245793704, "answer_total_s": 10.862633128999732, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_76_a2197_q0", "video_id": 76, "time_stamp_s": 203, "ground_truth": "A", "raw_output": "B. 2.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "fe610fc1e4b1a3fd1c9a6c541c412b4ab934c56f0de5174cc27147039ac7d76f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.5: NARRATIVE TIME\" with bullet points about story elements and viewing \"12 Angry Men (1957).\"  \n- The man's hands move expressively as he explains the content, occasionally pointing to the whiteboard.\n[30-60s] - A man in a grey shirt gestures toward a whiteboard displaying \"LESSON 1.5: NARRATIVE TIME\" with handwritten notes.  \n- The whiteboard lists topics like \"STORY: CINEMATIC TIME\" and \"VIEWING: 12 AUGUST 2023\" in red and blue markers.  \n- The scene transitions to a movie clip from \"Pulp Fiction (1994)\" showing a gun being held and a man in a suit pointing a gun.\n[60-90s] - A man in a suit gestures toward a whiteboard displaying \"LESSON 1.5 NARRATIVE TIME\" with bullet points about story structure and viewing \"Pulp Fiction (1994)\".\n- A young boy with short hair sits in a dimly lit room, looking thoughtfully forward, with a blurred background suggesting an indoor setting.\n- The whiteboard text includes \"VIEWING: 12. Pulp Fiction (1994)\" and lists narrative time concepts like \"ELLIPSIS\" and \"WHEN THE PAST IS NOT TOLD.\"\n[90-120s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.5: NARRATIVE TIME\" with bullet points about story elements and viewing a film.  \n- The man’s hands move expressively as he explains the content, indicating active teaching.\n[120-150s] - Man in brown jacket adjusts motorcycle handlebars while woman in denim jacket observes nearby.  \n- Whiteboard displays lesson title \"Narrative Time\" with bullet points about story elements and viewing \"Pulp Fiction\" (1994).  \n- Scene transitions from instructor gesturing to film clip of characters interacting with motorcycle outdoors.\n[150-180s] - Man gestures toward whiteboard with right hand while speaking.  \n- Whiteboard displays \"LESSON 1.5: NARRATIVE TIME\" and related text.  \n- Man’s left hand occasionally moves to emphasize points on the board.", "history_tokens": 550, "history_utf8_bytes": 2104, "recent_frame_times_s": [173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.03416666666666, 202.03516666666667], "recent_frames_sha256": "42711bcb73bf6d3c2e74ce8e831cfd7c68d37b2ee04322cfdb5e439407e5de0b", "num_recent_frames": 30, "tq": 719388.074118558, "t1": 719394.370705077, "ta": 719394.370705077, "te": 719394.601553242, "first_response_s": 6.296586518990807, "answer_total_s": 6.5274346839869395, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 76, "content_group": "724305225469be02498095cc4bd4c4074b02beea2ae4a17969b18a4c94ed42fc", "question": {"question_id": "sample_76_a2198_q0", "video_id": 76, "video_path": "./videos/sample_76_real.mp4", "annotation_index": 2198, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 4.", "B. 5.", "C. 3.", "D. 2."], "answer": "A", "time_stamp_s": 271, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_76_a2198_q0", "video_id": 76, "time_stamp_s": 271, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a3c2dd17201a98014dd4e80887dc51ca08514e14e72201442de5b23188471bbc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [241.03245833333332, 242.03345833333333, 243.03445833333333, 244.03545833333334, 245.03645833333334, 246.03745833333332, 247.03845833333332, 248.03945833333333, 249.04045833333333, 250.04145833333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.01675, 268.01775, 269.01875, 270.01975], "recent_frames_sha256": "ff189e8b40b4f467fbb6604482d37bfec05ba456510b9b40af25482dce5f451d", "num_recent_frames": 30, "tq": 719484.248826552, "t1": 719492.803552596, "ta": 719492.803552596, "te": 719492.840979724, "first_response_s": 8.554726044065319, "answer_total_s": 8.592153172008693, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_76_a2198_q0", "video_id": 76, "time_stamp_s": 271, "ground_truth": "A", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "43ca1a800fbde0ca2e0b40472b36e9a8eb90b0f4326f23a51f7958a37bb134af", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.5: NARRATIVE TIME\" with bullet points about story elements and viewing \"12 Angry Men (1957).\"  \n- The man's hands move expressively as he explains the content, occasionally pointing to the whiteboard.\n[30-60s] - A man in a grey shirt gestures toward a whiteboard displaying \"LESSON 1.5: NARRATIVE TIME\" with handwritten notes.  \n- The whiteboard lists topics like \"STORY: CINEMATIC TIME\" and \"VIEWING: 12 AUGUST 2023\" in red and blue markers.  \n- The scene transitions to a movie clip from \"Pulp Fiction (1994)\" showing a gun being held and a man in a suit pointing a gun.\n[60-90s] - A man in a suit gestures toward a whiteboard displaying \"LESSON 1.5 NARRATIVE TIME\" with bullet points about story structure and viewing \"Pulp Fiction (1994)\".\n- A young boy with short hair sits in a dimly lit room, looking thoughtfully forward, with a blurred background suggesting an indoor setting.\n- The whiteboard text includes \"VIEWING: 12. Pulp Fiction (1994)\" and lists narrative time concepts like \"ELLIPSIS\" and \"WHEN THE PAST IS NOT TOLD.\"\n[90-120s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.5: NARRATIVE TIME\" with bullet points about story elements and viewing a film.  \n- The man’s hands move expressively as he explains the content, indicating active teaching.\n[120-150s] - Man in brown jacket adjusts motorcycle handlebars while woman in denim jacket observes nearby.  \n- Whiteboard displays lesson title \"Narrative Time\" with bullet points about story elements and viewing \"Pulp Fiction\" (1994).  \n- Scene transitions from instructor gesturing to film clip of characters interacting with motorcycle outdoors.\n[150-180s] - Man gestures toward whiteboard with right hand while speaking.  \n- Whiteboard displays \"LESSON 1.5: NARRATIVE TIME\" and related text.  \n- Man’s left hand occasionally moves to emphasize points on the board.\n[180-210s] - Man gestures toward whiteboard with right hand while speaking.  \n- Whiteboard displays \"LESSON 1.5: NARRATIVE TIME\" and related notes in red and blue text.  \n- Man points to \"VIEWING: 12. HUGO MELN (1953)\" at bottom of whiteboard.\n[210-240s] - A man in a grey shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Narrative Time\" with bullet points and a viewing note for \"Pulp Fiction (1994).\"  \n- The scene transitions to clips from \"Pulp Fiction (1994),\" showing a man in a police uniform and another in a boxing gym, with the film title displayed at the bottom.\n[240-270s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.5: NARRATIVE TIME\" with bullet points about story elements and viewing \"12 Angry Men (1957).\"  \n- The man’s hands move expressively as he explains the content, indicating active engagement with the material.", "history_tokens": 830, "history_utf8_bytes": 3118, "recent_frame_times_s": [241.03245833333332, 242.03345833333333, 243.03445833333333, 244.03545833333334, 245.03645833333334, 246.03745833333332, 247.03845833333332, 248.03945833333333, 249.04045833333333, 250.04145833333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.01675, 268.01775, 269.01875, 270.01975], "recent_frames_sha256": "ff189e8b40b4f467fbb6604482d37bfec05ba456510b9b40af25482dce5f451d", "num_recent_frames": 30, "tq": 719415.282928538, "t1": 719417.002035664, "ta": 719417.002035664, "te": 719417.201737663, "first_response_s": 1.7191071260022, "answer_total_s": 1.9188091249670833, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 76, "content_group": "724305225469be02498095cc4bd4c4074b02beea2ae4a17969b18a4c94ed42fc", "question": {"question_id": "sample_76_a2199_q0", "video_id": 76, "video_path": "./videos/sample_76_real.mp4", "annotation_index": 2199, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 4.", "B. 1.", "C. 3.", "D. 2."], "answer": "A", "time_stamp_s": 318, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_76_a2199_q0", "video_id": 76, "time_stamp_s": 318, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ebcd817b4cc1b528d962c033468bc40f2f314cf1b50228fb2da582002f19a897", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [288.03775, 289.03875, 290.03975, 291.04075, 292.0000416666667, 293.00104166666665, 294.0020416666667, 295.00304166666666, 296.0040416666667, 297.00504166666667, 298.00604166666665, 299.0070416666667, 300.00804166666666, 301.0090416666667, 302.01004166666667, 303.01104166666664, 304.0120416666667, 305.01304166666665, 306.0140416666667, 307.01504166666666, 308.0160416666667, 309.01704166666667, 310.01804166666665, 311.0190416666667, 312.02004166666666, 313.0210416666667, 314.02204166666667, 315.02304166666664, 316.0240416666667, 317.02504166666665], "recent_frames_sha256": "6bb1060da9eceaf18b112a350310ba0a53330b71d74fd9f234bb1d9b1248a463", "num_recent_frames": 30, "tq": 719492.849504724, "t1": 719505.494806388, "ta": 719505.494806388, "te": 719505.532388857, "first_response_s": 12.645301664015278, "answer_total_s": 12.682884132955223, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_76_a2199_q0", "video_id": 76, "time_stamp_s": 318, "ground_truth": "A", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "ec08858eb1f9eb98e174bb0c18f8ebb7cf869eef7b676fc575efac9ed0e3d643", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.5: NARRATIVE TIME\" with bullet points about story elements and viewing \"12 Angry Men (1957).\"  \n- The man's hands move expressively as he explains the content, occasionally pointing to the whiteboard.\n[30-60s] - A man in a grey shirt gestures toward a whiteboard displaying \"LESSON 1.5: NARRATIVE TIME\" with handwritten notes.  \n- The whiteboard lists topics like \"STORY: CINEMATIC TIME\" and \"VIEWING: 12 AUGUST 2023\" in red and blue markers.  \n- The scene transitions to a movie clip from \"Pulp Fiction (1994)\" showing a gun being held and a man in a suit pointing a gun.\n[60-90s] - A man in a suit gestures toward a whiteboard displaying \"LESSON 1.5 NARRATIVE TIME\" with bullet points about story structure and viewing \"Pulp Fiction (1994)\".\n- A young boy with short hair sits in a dimly lit room, looking thoughtfully forward, with a blurred background suggesting an indoor setting.\n- The whiteboard text includes \"VIEWING: 12. Pulp Fiction (1994)\" and lists narrative time concepts like \"ELLIPSIS\" and \"WHEN THE PAST IS NOT TOLD.\"\n[90-120s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.5: NARRATIVE TIME\" with bullet points about story elements and viewing a film.  \n- The man’s hands move expressively as he explains the content, indicating active teaching.\n[120-150s] - Man in brown jacket adjusts motorcycle handlebars while woman in denim jacket observes nearby.  \n- Whiteboard displays lesson title \"Narrative Time\" with bullet points about story elements and viewing \"Pulp Fiction\" (1994).  \n- Scene transitions from instructor gesturing to film clip of characters interacting with motorcycle outdoors.\n[150-180s] - Man gestures toward whiteboard with right hand while speaking.  \n- Whiteboard displays \"LESSON 1.5: NARRATIVE TIME\" and related text.  \n- Man’s left hand occasionally moves to emphasize points on the board.\n[180-210s] - Man gestures toward whiteboard with right hand while speaking.  \n- Whiteboard displays \"LESSON 1.5: NARRATIVE TIME\" and related notes in red and blue text.  \n- Man points to \"VIEWING: 12. HUGO MELN (1953)\" at bottom of whiteboard.\n[210-240s] - A man in a grey shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Narrative Time\" with bullet points and a viewing note for \"Pulp Fiction (1994).\"  \n- The scene transitions to clips from \"Pulp Fiction (1994),\" showing a man in a police uniform and another in a boxing gym, with the film title displayed at the bottom.\n[240-270s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.5: NARRATIVE TIME\" with bullet points about story elements and viewing \"12 Angry Men (1957).\"  \n- The man’s hands move expressively as he explains the content, indicating active engagement with the material.\n[270-300s] - A man in a light gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.5: NARRATIVE TIME\" with bullet points about story elements and viewing information.  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.", "history_tokens": 914, "history_utf8_bytes": 3466, "recent_frame_times_s": [288.03775, 289.03875, 290.03975, 291.04075, 292.0000416666667, 293.00104166666665, 294.0020416666667, 295.00304166666666, 296.0040416666667, 297.00504166666667, 298.00604166666665, 299.0070416666667, 300.00804166666666, 301.0090416666667, 302.01004166666667, 303.01104166666664, 304.0120416666667, 305.01304166666665, 306.0140416666667, 307.01504166666666, 308.0160416666667, 309.01704166666667, 310.01804166666665, 311.0190416666667, 312.02004166666666, 313.0210416666667, 314.02204166666667, 315.02304166666664, 316.0240416666667, 317.02504166666665], "recent_frames_sha256": "6bb1060da9eceaf18b112a350310ba0a53330b71d74fd9f234bb1d9b1248a463", "num_recent_frames": 30, "tq": 719429.376930964, "t1": 719430.293615734, "ta": 719430.293615734, "te": 719430.494599411, "first_response_s": 0.9166847700253129, "answer_total_s": 1.117668447084725, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 76, "content_group": "724305225469be02498095cc4bd4c4074b02beea2ae4a17969b18a4c94ed42fc", "question": {"question_id": "sample_76_a2200_q0", "video_id": 76, "video_path": "./videos/sample_76_real.mp4", "annotation_index": 2200, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 5.", "B. 1.", "C. 3.", "D. 7."], "answer": "A", "time_stamp_s": 427, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_76_a2200_q0", "video_id": 76, "time_stamp_s": 427, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "19f148b8d7943a8151cd61d741bf4ff80de82cfc1dbd793b3f435548994161cd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [397.021625, 398.022625, 399.023625, 400.024625, 401.025625, 402.026625, 403.027625, 404.028625, 405.029625, 406.030625, 407.031625, 408.032625, 409.033625, 410.034625, 411.035625, 412.036625, 413.037625, 414.038625, 415.039625, 416.040625, 417.041625, 418.0009166666667, 419.00191666666666, 420.0029166666667, 421.00391666666667, 422.00491666666665, 423.0059166666667, 424.00691666666665, 425.0079166666667, 426.00891666666666], "recent_frames_sha256": "e16105d7fddd2a28289ffd7bd2cd492a5f448a402a92ea6135704460e40b02d9", "num_recent_frames": 30, "tq": 719505.540278888, "t1": 719517.636954471, "ta": 719517.636954471, "te": 719517.674716429, "first_response_s": 12.096675583044998, "answer_total_s": 12.134437541011721, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_76_a2200_q0", "video_id": 76, "time_stamp_s": 427, "ground_truth": "A", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "4484068742036c921de8381235d751604b4b1bade9a6b0b6ac28b15267cff2e9", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.5: NARRATIVE TIME\" with bullet points about story elements and viewing a film.  \n- The man’s hands move expressively as he explains the content, indicating active teaching.\n[120-150s] - Man in brown jacket adjusts motorcycle handlebars while woman in denim jacket observes nearby.  \n- Whiteboard displays lesson title \"Narrative Time\" with bullet points about story elements and viewing \"Pulp Fiction\" (1994).  \n- Scene transitions from instructor gesturing to film clip of characters interacting with motorcycle outdoors.\n[150-180s] - Man gestures toward whiteboard with right hand while speaking.  \n- Whiteboard displays \"LESSON 1.5: NARRATIVE TIME\" and related text.  \n- Man’s left hand occasionally moves to emphasize points on the board.\n[180-210s] - Man gestures toward whiteboard with right hand while speaking.  \n- Whiteboard displays \"LESSON 1.5: NARRATIVE TIME\" and related notes in red and blue text.  \n- Man points to \"VIEWING: 12. HUGO MELN (1953)\" at bottom of whiteboard.\n[210-240s] - A man in a grey shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Narrative Time\" with bullet points and a viewing note for \"Pulp Fiction (1994).\"  \n- The scene transitions to clips from \"Pulp Fiction (1994),\" showing a man in a police uniform and another in a boxing gym, with the film title displayed at the bottom.\n[240-270s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.5: NARRATIVE TIME\" with bullet points about story elements and viewing \"12 Angry Men (1957).\"  \n- The man’s hands move expressively as he explains the content, indicating active engagement with the material.\n[270-300s] - A man in a light gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 1.5: NARRATIVE TIME\" with bullet points about story elements and viewing information.  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.\n[300-330s] - A man in a gray shirt gestures with both hands while speaking, standing in front of a whiteboard.  \n- The whiteboard displays text including \"LESSON 1.5: NARRATIVE TIME\" and \"VIEWING: 12. ANGUS MANN (1953).\"  \n- The man’s hands move expressively as he points to different sections of the whiteboard.\n[330-360s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 1.5: Narrative Time,\" including key terms and viewing information.  \n- The background is dark, with a faintly visible patterned wall behind the man.\n[360-390s] - A man in a light-colored shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Narrative Time\" with bullet points and a viewing reference to \"12 Angry Men (1957).\"  \n- The man occasionally points to the whiteboard, emphasizing specific sections of the text.\n[390-420s] - A man in a light-colored suit and tie stands at the center of a room, facing a group of seated men.  \n- The seated men, dressed in formal attire, are gathered around a large cardboard box, with some leaning forward and others looking up.  \n- The scene is in black and white, with the text \"12 Angry Men (1957)\" displayed at the bottom of the screen.", "history_tokens": 932, "history_utf8_bytes": 3595, "recent_frame_times_s": [397.021625, 398.022625, 399.023625, 400.024625, 401.025625, 402.026625, 403.027625, 404.028625, 405.029625, 406.030625, 407.031625, 408.032625, 409.033625, 410.034625, 411.035625, 412.036625, 413.037625, 414.038625, 415.039625, 416.040625, 417.041625, 418.0009166666667, 419.00191666666666, 420.0029166666667, 421.00391666666667, 422.00491666666665, 423.0059166666667, 424.00691666666665, 425.0079166666667, 426.00891666666666], "recent_frames_sha256": "e16105d7fddd2a28289ffd7bd2cd492a5f448a402a92ea6135704460e40b02d9", "num_recent_frames": 30, "tq": 719460.865403584, "t1": 719472.419808576, "ta": 719472.419808576, "te": 719472.658774651, "first_response_s": 11.55440499202814, "answer_total_s": 11.79337106703315, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 77, "content_group": "05db0389505da9e2c6ce3582f4c0b42906698cd38787a8a6ffbf281fdbdbc022", "question": {"question_id": "sample_77_a1100_q0", "video_id": 77, "video_path": "./videos/sample_77_real.mp4", "annotation_index": 1100, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 0.", "D. 4."], "answer": "C", "time_stamp_s": 18, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_77_a1100_q0", "video_id": 77, "time_stamp_s": 18, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "25e37f4ab893f08f8e56c9d50df5467409be7b92bae51c457bd39cad0b17ee05", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "2ea9905c2496516d9d06d48f8621abc66f14a47dd83f9352d9c03f7ead4ee0c8", "num_recent_frames": 18, "tq": 717779.078033373, "t1": 717779.693097086, "ta": 717779.693097086, "te": 717779.882814078, "first_response_s": 0.6150637130485848, "answer_total_s": 0.8047807050170377, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_77_a1100_q0", "video_id": 77, "time_stamp_s": 18, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "7269c35a1b4efdf3930ca4be4b1af60a6e286ba31eb79b16eeb127bbc11f5359", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "2ea9905c2496516d9d06d48f8621abc66f14a47dd83f9352d9c03f7ead4ee0c8", "num_recent_frames": 18, "tq": 717823.491867818, "t1": 717825.630089623, "ta": 717825.630089623, "te": 717826.067311884, "first_response_s": 2.138221804983914, "answer_total_s": 2.575444065965712, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 77, "content_group": "05db0389505da9e2c6ce3582f4c0b42906698cd38787a8a6ffbf281fdbdbc022", "question": {"question_id": "sample_77_a1101_q0", "video_id": 77, "video_path": "./videos/sample_77_real.mp4", "annotation_index": 1101, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 4.", "C. 6.", "D. 0."], "answer": "C", "time_stamp_s": 208, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_77_a1101_q0", "video_id": 77, "time_stamp_s": 208, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "28b059c66d1b81e02c386a04c9f941075050bafcc6ec9cb6472adb9b050413dd", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068], "recent_frames_sha256": "ab87b4f02387996c5aabc51252765b3f5fabdb749e8b1f364e622d472d326182", "num_recent_frames": 30, "tq": 717779.899984064, "t1": 717792.669805237, "ta": 717792.669805237, "te": 717792.71049268, "first_response_s": 12.769821172929369, "answer_total_s": 12.810508615919389, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_77_a1101_q0", "video_id": 77, "time_stamp_s": 208, "ground_truth": "C", "raw_output": "B. 4.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "d8a60abd626ee13a09b21f5f37a237b04e216d905477f3c74de46742d4f90d76", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a blue shirt stands beside a whiteboard displaying \"Lesson 2.1: Hair, Costumes, Makeup\" with bullet points about film scenes, costume design, and communication in film.\n- The man gestures toward the whiteboard while speaking, indicating he is teaching or explaining the content.\n- At 0:27, a movie clip from \"Harry Potter and the Philosopher's Stone (2001)\" shows a steam train approaching a station, with smoke and lights visible.\n[30-60s] - A man in a dark coat stands beside a steam locomotive labeled \"Pomona's\" with smoke billowing from its engine.  \n- A woman in a white dress walks away from a desk, carrying a lamp, in a room with framed pictures on the wall.  \n- A woman in a brown dress stands near a window, holding a bouquet of red roses, in a room with a cluttered table and a lamp.\n[60-90s] - A man in a blue shirt gestures toward a whiteboard with lesson notes on hair, costumes, and makeup.  \n- The whiteboard lists topics like \"Hair Cosmetics,\" \"Makeup,\" and \"Communicating Characters.\"  \n- The man points to specific lines on the board while speaking, indicating instructional content.\n[90-120s] - A man in a purple suit and green shirt with a painted smile faces Batman in a dimly lit room.  \n- A man in a green vest and gray shirt with a painted smile is shown in a split-screen comparison with another Joker.  \n- A man in a dark suit is seen lying on the ground against a brick wall, with a shadowy figure standing nearby.\n[120-150s] - Man in blue shirt gestures toward whiteboard with lesson notes on stage.  \n- Woman in dark hat and coat leans against wall, smiling, in dimly lit market scene.  \n- Market scene shows people walking, carts, and baskets; man in suit walks past woman.\n[150-180s] - A man in a blue shirt gestures toward a whiteboard displaying lesson notes on hair, makeup, and costume design.  \n- The whiteboard lists key topics including \"Setting,\" \"Designing Hair Costumes,\" and \"Communicating Characters.\"  \n- A film clip of \"My Fair Lady\" (1964) plays in the background, showing elegantly dressed people dancing in a ballroom.", "history_tokens": 521, "history_utf8_bytes": 2087, "recent_frame_times_s": [178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068], "recent_frames_sha256": "ab87b4f02387996c5aabc51252765b3f5fabdb749e8b1f364e622d472d326182", "num_recent_frames": 30, "tq": 717902.783182421, "t1": 717909.387145085, "ta": 717909.387145085, "te": 717909.579642956, "first_response_s": 6.603962664026767, "answer_total_s": 6.796460535028018, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 77, "content_group": "05db0389505da9e2c6ce3582f4c0b42906698cd38787a8a6ffbf281fdbdbc022", "question": {"question_id": "sample_77_a1102_q0", "video_id": 77, "video_path": "./videos/sample_77_real.mp4", "annotation_index": 1102, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 8.", "B. 7.", "C. 9.", "D. 10."], "answer": "C", "time_stamp_s": 271, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_77_a1102_q0", "video_id": 77, "time_stamp_s": 271, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4901093dfa1fae00e266b7838880c1d2a4f5d68da1242a79b00bdb4714b1bf2d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665], "recent_frames_sha256": "2a516647ec9790322f4fba0b27eafaade3562296f4b880bca8e321b5c656f223", "num_recent_frames": 30, "tq": 717792.722168127, "t1": 717805.020906341, "ta": 717805.020906341, "te": 717805.059490532, "first_response_s": 12.298738214070909, "answer_total_s": 12.337322405073792, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_77_a1102_q0", "video_id": 77, "time_stamp_s": 271, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6e1f05b894a402a3eb78a11aa6ccd56bbf30c5efcf48f8630281791e1c7261fb", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a blue shirt stands beside a whiteboard displaying \"Lesson 2.1: Hair, Costumes, Makeup\" with bullet points about film scenes, costume design, and communication in film.\n- The man gestures toward the whiteboard while speaking, indicating he is teaching or explaining the content.\n- At 0:27, a movie clip from \"Harry Potter and the Philosopher's Stone (2001)\" shows a steam train approaching a station, with smoke and lights visible.\n[30-60s] - A man in a dark coat stands beside a steam locomotive labeled \"Pomona's\" with smoke billowing from its engine.  \n- A woman in a white dress walks away from a desk, carrying a lamp, in a room with framed pictures on the wall.  \n- A woman in a brown dress stands near a window, holding a bouquet of red roses, in a room with a cluttered table and a lamp.\n[60-90s] - A man in a blue shirt gestures toward a whiteboard with lesson notes on hair, costumes, and makeup.  \n- The whiteboard lists topics like \"Hair Cosmetics,\" \"Makeup,\" and \"Communicating Characters.\"  \n- The man points to specific lines on the board while speaking, indicating instructional content.\n[90-120s] - A man in a purple suit and green shirt with a painted smile faces Batman in a dimly lit room.  \n- A man in a green vest and gray shirt with a painted smile is shown in a split-screen comparison with another Joker.  \n- A man in a dark suit is seen lying on the ground against a brick wall, with a shadowy figure standing nearby.\n[120-150s] - Man in blue shirt gestures toward whiteboard with lesson notes on stage.  \n- Woman in dark hat and coat leans against wall, smiling, in dimly lit market scene.  \n- Market scene shows people walking, carts, and baskets; man in suit walks past woman.\n[150-180s] - A man in a blue shirt gestures toward a whiteboard displaying lesson notes on hair, makeup, and costume design.  \n- The whiteboard lists key topics including \"Setting,\" \"Designing Hair Costumes,\" and \"Communicating Characters.\"  \n- A film clip of \"My Fair Lady\" (1964) plays in the background, showing elegantly dressed people dancing in a ballroom.\n[180-210s] - A man in a light blue shirt and tie stands at a chalkboard, gesturing while speaking to students.  \n- Students are seated in front of him, facing the chalkboard, with one student’s back to the camera.  \n- The chalkboard displays partially erased writing, including the word \"History\" and a question mark.\n[210-240s] - A man in a suit stands in a classroom, gesturing while speaking to students seated at desks.  \n- A whiteboard behind him displays lesson notes on \"Hair Cosmetics & Makeup\" with bullet points.  \n- The scene transitions to a close-up of a man in a blue shirt against a green chalkboard, labeled \"Election (1999).\"\n[240-270s] - A man in a blue shirt stands in front of a whiteboard with lesson notes, gesturing with his hands while speaking.  \n- The whiteboard displays lesson content including \"Hair, Costumes, Makeup\" and \"Communicating Characters.\"  \n- The scene transitions to another man in a classroom setting, wearing a scarf and bow tie, gesturing toward a wall-mounted chart.", "history_tokens": 772, "history_utf8_bytes": 3102, "recent_frame_times_s": [241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665], "recent_frames_sha256": "2a516647ec9790322f4fba0b27eafaade3562296f4b880bca8e321b5c656f223", "num_recent_frames": 30, "tq": 717931.94188473, "t1": 717940.798892206, "ta": 717940.798892206, "te": 717941.044356915, "first_response_s": 8.857007476035506, "answer_total_s": 9.102472185040824, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 77, "content_group": "05db0389505da9e2c6ce3582f4c0b42906698cd38787a8a6ffbf281fdbdbc022", "question": {"question_id": "sample_77_a1103_q0", "video_id": 77, "video_path": "./videos/sample_77_real.mp4", "annotation_index": 1103, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 10.", "B. 7.", "C. 9.", "D. 8."], "answer": "C", "time_stamp_s": 318, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_77_a1103_q0", "video_id": 77, "time_stamp_s": 318, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a3619fd6a70b53cd767ae046cf4bcf93e9a085058c67cafb8171f98c293af4d5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167], "recent_frames_sha256": "51847e481b8f66feea391633dd4f4f6189a0685258ce44d62310532d836397fc", "num_recent_frames": 30, "tq": 717805.071391547, "t1": 717811.55502436, "ta": 717811.55502436, "te": 717811.593489378, "first_response_s": 6.4836328129749745, "answer_total_s": 6.522097831009887, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_77_a1103_q0", "video_id": 77, "time_stamp_s": 318, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "809d982e340bdffb49dea826f982492375b51f319dfe9475c43ca1c760bd1fb8", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a blue shirt stands beside a whiteboard displaying \"Lesson 2.1: Hair, Costumes, Makeup\" with bullet points about film scenes, costume design, and communication in film.\n- The man gestures toward the whiteboard while speaking, indicating he is teaching or explaining the content.\n- At 0:27, a movie clip from \"Harry Potter and the Philosopher's Stone (2001)\" shows a steam train approaching a station, with smoke and lights visible.\n[30-60s] - A man in a dark coat stands beside a steam locomotive labeled \"Pomona's\" with smoke billowing from its engine.  \n- A woman in a white dress walks away from a desk, carrying a lamp, in a room with framed pictures on the wall.  \n- A woman in a brown dress stands near a window, holding a bouquet of red roses, in a room with a cluttered table and a lamp.\n[60-90s] - A man in a blue shirt gestures toward a whiteboard with lesson notes on hair, costumes, and makeup.  \n- The whiteboard lists topics like \"Hair Cosmetics,\" \"Makeup,\" and \"Communicating Characters.\"  \n- The man points to specific lines on the board while speaking, indicating instructional content.\n[90-120s] - A man in a purple suit and green shirt with a painted smile faces Batman in a dimly lit room.  \n- A man in a green vest and gray shirt with a painted smile is shown in a split-screen comparison with another Joker.  \n- A man in a dark suit is seen lying on the ground against a brick wall, with a shadowy figure standing nearby.\n[120-150s] - Man in blue shirt gestures toward whiteboard with lesson notes on stage.  \n- Woman in dark hat and coat leans against wall, smiling, in dimly lit market scene.  \n- Market scene shows people walking, carts, and baskets; man in suit walks past woman.\n[150-180s] - A man in a blue shirt gestures toward a whiteboard displaying lesson notes on hair, makeup, and costume design.  \n- The whiteboard lists key topics including \"Setting,\" \"Designing Hair Costumes,\" and \"Communicating Characters.\"  \n- A film clip of \"My Fair Lady\" (1964) plays in the background, showing elegantly dressed people dancing in a ballroom.\n[180-210s] - A man in a light blue shirt and tie stands at a chalkboard, gesturing while speaking to students.  \n- Students are seated in front of him, facing the chalkboard, with one student’s back to the camera.  \n- The chalkboard displays partially erased writing, including the word \"History\" and a question mark.\n[210-240s] - A man in a suit stands in a classroom, gesturing while speaking to students seated at desks.  \n- A whiteboard behind him displays lesson notes on \"Hair Cosmetics & Makeup\" with bullet points.  \n- The scene transitions to a close-up of a man in a blue shirt against a green chalkboard, labeled \"Election (1999).\"\n[240-270s] - A man in a blue shirt stands in front of a whiteboard with lesson notes, gesturing with his hands while speaking.  \n- The whiteboard displays lesson content including \"Hair, Costumes, Makeup\" and \"Communicating Characters.\"  \n- The scene transitions to another man in a classroom setting, wearing a scarf and bow tie, gesturing toward a wall-mounted chart.\n[270-300s] - A man in a blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 2.1: Hair, Costumes, Makeup\" with bullet points detailing topics like setting, costume design, and communication.  \n- The man points to different sections of the whiteboard as he explains the content, maintaining eye contact with the camera.", "history_tokens": 864, "history_utf8_bytes": 3495, "recent_frame_times_s": [288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167], "recent_frames_sha256": "51847e481b8f66feea391633dd4f4f6189a0685258ce44d62310532d836397fc", "num_recent_frames": 30, "tq": 717946.104950603, "t1": 717947.971450774, "ta": 717947.971450774, "te": 717948.126925361, "first_response_s": 1.866500171017833, "answer_total_s": 2.0219747580122203, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 77, "content_group": "05db0389505da9e2c6ce3582f4c0b42906698cd38787a8a6ffbf281fdbdbc022", "question": {"question_id": "sample_77_a1104_q0", "video_id": 77, "video_path": "./videos/sample_77_real.mp4", "annotation_index": 1104, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 13.", "B. 10.", "C. 12.", "D. 11."], "answer": "C", "time_stamp_s": 427, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_77_a1104_q0", "video_id": 77, "time_stamp_s": 427, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fd50e0c7f757cac5efc5bd57d066cb38716b9541f65bb5c65df714fb998bc77a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [397.02996666666667, 398.03096666666664, 399.0319666666667, 400.03296666666665, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256], "recent_frames_sha256": "d4d3cd129650c170ae059ac91df654213c64fa5da966b6dd536b7ab0474ef138", "num_recent_frames": 30, "tq": 717811.606508077, "t1": 717823.440897305, "ta": 717823.440897305, "te": 717823.479337785, "first_response_s": 11.83438922802452, "answer_total_s": 11.872829708037898, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_77_a1104_q0", "video_id": 77, "time_stamp_s": 427, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2fe8d1bb69b5d7ed23c8fa594d65e1eecb7a5abc4185df25ac4d42783c6e6187", "condition_order": ["recent", "notes"], "memory": "[60-90s] - A man in a blue shirt gestures toward a whiteboard with lesson notes on hair, costumes, and makeup.  \n- The whiteboard lists topics like \"Hair Cosmetics,\" \"Makeup,\" and \"Communicating Characters.\"  \n- The man points to specific lines on the board while speaking, indicating instructional content.\n[90-120s] - A man in a purple suit and green shirt with a painted smile faces Batman in a dimly lit room.  \n- A man in a green vest and gray shirt with a painted smile is shown in a split-screen comparison with another Joker.  \n- A man in a dark suit is seen lying on the ground against a brick wall, with a shadowy figure standing nearby.\n[120-150s] - Man in blue shirt gestures toward whiteboard with lesson notes on stage.  \n- Woman in dark hat and coat leans against wall, smiling, in dimly lit market scene.  \n- Market scene shows people walking, carts, and baskets; man in suit walks past woman.\n[150-180s] - A man in a blue shirt gestures toward a whiteboard displaying lesson notes on hair, makeup, and costume design.  \n- The whiteboard lists key topics including \"Setting,\" \"Designing Hair Costumes,\" and \"Communicating Characters.\"  \n- A film clip of \"My Fair Lady\" (1964) plays in the background, showing elegantly dressed people dancing in a ballroom.\n[180-210s] - A man in a light blue shirt and tie stands at a chalkboard, gesturing while speaking to students.  \n- Students are seated in front of him, facing the chalkboard, with one student’s back to the camera.  \n- The chalkboard displays partially erased writing, including the word \"History\" and a question mark.\n[210-240s] - A man in a suit stands in a classroom, gesturing while speaking to students seated at desks.  \n- A whiteboard behind him displays lesson notes on \"Hair Cosmetics & Makeup\" with bullet points.  \n- The scene transitions to a close-up of a man in a blue shirt against a green chalkboard, labeled \"Election (1999).\"\n[240-270s] - A man in a blue shirt stands in front of a whiteboard with lesson notes, gesturing with his hands while speaking.  \n- The whiteboard displays lesson content including \"Hair, Costumes, Makeup\" and \"Communicating Characters.\"  \n- The scene transitions to another man in a classroom setting, wearing a scarf and bow tie, gesturing toward a wall-mounted chart.\n[270-300s] - A man in a blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 2.1: Hair, Costumes, Makeup\" with bullet points detailing topics like setting, costume design, and communication.  \n- The man points to different sections of the whiteboard as he explains the content, maintaining eye contact with the camera.\n[300-330s] - A man in a blue shirt stands beside a whiteboard, gesturing toward its content with his right hand.  \n- The whiteboard displays text for \"Lesson 2.1: Hair, Costumes, Makeup,\" including bullet points about setting, costume design, and communication.  \n- The man’s left hand is slightly raised, palm facing outward, as if emphasizing a point while speaking.\n[330-360s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 2.1: Hair, Costumes, Makeup\" with bullet points detailing scene setup, costume design, and communication exercises.  \n- The man occasionally points to specific sections of the whiteboard as he explains the content.\n[360-390s] - A man in a blue shirt gestures toward a whiteboard displaying lesson notes on makeup and costume design.  \n- A dark hallway scene shows a figure in a black shirt entering, with the text \"Halloween II (1981)\" at the bottom.  \n- A blonde woman walks outdoors, looking down, with the same \"Halloween (1978)\" text overlay.\n[390-420s] - A woman in a blue shirt stands beside a whiteboard, gesturing toward its content.  \n- The whiteboard displays lesson notes on makeup, costume, and communication for a film production.  \n- A black-and-white film clip titled \"The Elephant Man (1980)\" plays, showing a man in a suit walking down stairs and looking out a window.", "history_tokens": 1010, "history_utf8_bytes": 4093, "recent_frame_times_s": [397.02996666666667, 398.03096666666664, 399.0319666666667, 400.03296666666665, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256], "recent_frames_sha256": "d4d3cd129650c170ae059ac91df654213c64fa5da966b6dd536b7ab0474ef138", "num_recent_frames": 30, "tq": 717985.365129788, "t1": 717991.450531217, "ta": 717991.450531217, "te": 717991.488798222, "first_response_s": 6.0854014289798215, "answer_total_s": 6.123668433981948, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 78, "content_group": "9040691da8201e0b25cc33dc8ec114014555c114d6622c9e5d58e414b389cc3a", "question": {"question_id": "sample_78_a1534_q0", "video_id": 78, "video_path": "./videos/sample_78_real.mp4", "annotation_index": 1534, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 0.", "D. 4."], "answer": "C", "time_stamp_s": 18, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_78_a1534_q0", "video_id": 78, "time_stamp_s": 18, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "5e7f5a4cc2cb64688e16ad253e8c3ae005cabec6cddde5d2876e279254d668f3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "80a53abcada1eed6823be1cf154048f49c5e8d11673a91af2a8cf0f8a47d387c", "num_recent_frames": 18, "tq": 716787.867033651, "t1": 716797.455964624, "ta": 716797.455964624, "te": 716797.645120121, "first_response_s": 9.588930972968228, "answer_total_s": 9.778086469974369, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_78_a1534_q0", "video_id": 78, "time_stamp_s": 18, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "e9a82eb2fb6648a18ca10574af0ddbbeb92275322c9dc5e90f8225571634da48", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "80a53abcada1eed6823be1cf154048f49c5e8d11673a91af2a8cf0f8a47d387c", "num_recent_frames": 18, "tq": 716676.765195792, "t1": 716677.018303511, "ta": 716677.018303511, "te": 716677.205494128, "first_response_s": 0.2531077190069482, "answer_total_s": 0.44029833609238267, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 78, "content_group": "9040691da8201e0b25cc33dc8ec114014555c114d6622c9e5d58e414b389cc3a", "question": {"question_id": "sample_78_a1535_q0", "video_id": 78, "video_path": "./videos/sample_78_real.mp4", "annotation_index": 1535, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 4.", "C. 3.", "D. 0."], "answer": "C", "time_stamp_s": 185, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_78_a1535_q0", "video_id": 78, "time_stamp_s": 185, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "acac8851d4edd66dd46916a5fe93af37fc9081d61192049367686c01b8c8f2f4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667], "recent_frames_sha256": "5703e8ded28bfdc2de9cf1939e753baab380e29ac205af388aa7d79667c46b4a", "num_recent_frames": 30, "tq": 716797.651252528, "t1": 716806.270165896, "ta": 716806.270165896, "te": 716806.307505999, "first_response_s": 8.618913368089125, "answer_total_s": 8.656253471039236, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_78_a1535_q0", "video_id": 78, "time_stamp_s": 185, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f20093b354f2f52fd8fd0e2ce1874c2c44798138177a6594b7d6e8e165afef10", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a blue shirt stands beside a whiteboard, gesturing toward written lesson content titled \"LESSON 7.7: PROPS.\"  \n- The whiteboard displays text in various colors, including sections labeled \"PROPS\" and \"PROPS: BUILT-UP USED BY ROOMS DURING A...\" with additional bullet points.  \n- The man occasionally points to specific parts of the whiteboard while speaking, indicating instructional content.\n[30-60s] - A man in a blue shirt stands beside a whiteboard, gesturing toward written lesson content.  \n- The whiteboard displays \"LESSON 7.7: PROPS\" with bullet points about film props and their use in filmmaking.  \n- The scene transitions to a black-and-white film clip titled \"Citizen Kane (1941)\" showing a close-up of a glass sphere containing a broken object.\n[60-90s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 7.7: PROPS\" with bullet points about props in film and theater.  \n- The background is dimly lit, with hanging lights visible above the man's head.\n[90-120s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 7.7: PROPS\" with bullet points about propellers and their use in marine applications.  \n- A film clip titled \"Jaws (1975)\" shows a yellow submarine-like object being thrown into the ocean, surfacing, and moving away from a ship.\n[120-150s] - A man in a red polo shirt sits at a desk, typing on a keyboard while holding a green card.  \n- A bald man in a suit is seen inside a car, looking out the window.  \n- A side-view mirror reflects a man on a bicycle passing by a park bench where people are seated.\n[150-180s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 7.7: PROPS\" with bullet points about props in film and TV.  \n- The man’s body is slightly angled toward the camera, with his arms open as if explaining the content.", "history_tokens": 531, "history_utf8_bytes": 2065, "recent_frame_times_s": [155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667], "recent_frames_sha256": "5703e8ded28bfdc2de9cf1939e753baab380e29ac205af388aa7d79667c46b4a", "num_recent_frames": 30, "tq": 716722.209077938, "t1": 716730.096313892, "ta": 716730.096313892, "te": 716730.143182197, "first_response_s": 7.887235954054631, "answer_total_s": 7.934104259009473, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 78, "content_group": "9040691da8201e0b25cc33dc8ec114014555c114d6622c9e5d58e414b389cc3a", "question": {"question_id": "sample_78_a1536_q0", "video_id": 78, "video_path": "./videos/sample_78_real.mp4", "annotation_index": 1536, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 5.", "B. 6.", "C. 4.", "D. 3."], "answer": "C", "time_stamp_s": 242, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_78_a1536_q0", "video_id": 78, "time_stamp_s": 242, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b0cc32fdf38b91d3c7b24c179edcc26ebe30ca6b30edefe4764948e4dbece350", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332], "recent_frames_sha256": "a0ef8ee1cd62511515064c0f7deb813ce3af34da9a6806b3f45cac3e16b2d753", "num_recent_frames": 30, "tq": 716806.313859768, "t1": 716816.834975072, "ta": 716816.834975072, "te": 716816.872888889, "first_response_s": 10.521115303970873, "answer_total_s": 10.559029121068306, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_78_a1536_q0", "video_id": 78, "time_stamp_s": 242, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4cbdc55c38209404e4da06b2a8b0f5bdefcc8d750763113532fcb1dad3457bc6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a blue shirt stands beside a whiteboard, gesturing toward written lesson content titled \"LESSON 7.7: PROPS.\"  \n- The whiteboard displays text in various colors, including sections labeled \"PROPS\" and \"PROPS: BUILT-UP USED BY ROOMS DURING A...\" with additional bullet points.  \n- The man occasionally points to specific parts of the whiteboard while speaking, indicating instructional content.\n[30-60s] - A man in a blue shirt stands beside a whiteboard, gesturing toward written lesson content.  \n- The whiteboard displays \"LESSON 7.7: PROPS\" with bullet points about film props and their use in filmmaking.  \n- The scene transitions to a black-and-white film clip titled \"Citizen Kane (1941)\" showing a close-up of a glass sphere containing a broken object.\n[60-90s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 7.7: PROPS\" with bullet points about props in film and theater.  \n- The background is dimly lit, with hanging lights visible above the man's head.\n[90-120s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 7.7: PROPS\" with bullet points about propellers and their use in marine applications.  \n- A film clip titled \"Jaws (1975)\" shows a yellow submarine-like object being thrown into the ocean, surfacing, and moving away from a ship.\n[120-150s] - A man in a red polo shirt sits at a desk, typing on a keyboard while holding a green card.  \n- A bald man in a suit is seen inside a car, looking out the window.  \n- A side-view mirror reflects a man on a bicycle passing by a park bench where people are seated.\n[150-180s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 7.7: PROPS\" with bullet points about props in film and TV.  \n- The man’s body is slightly angled toward the camera, with his arms open as if explaining the content.\n[180-210s] - A man in a blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 7.7: PROPS\" with bullet points about film props and their use in \"The Shawshank Redemption (1994).\"  \n- A film clip shows a man in a prison cell writing with a pen, with bars visible in the background.\n[210-240s] - A man in a blue shirt stands beside a whiteboard, gesturing toward text about \"Lesson 2.7: Props\" with his hands.  \n- The whiteboard displays lesson content, including a highlighted section on \"Props\" and a list of items like \"Bottle,\" \"Cup,\" and \"Tape.\"  \n- The man occasionally points to specific lines on the board while speaking, indicating emphasis on the written material.", "history_tokens": 726, "history_utf8_bytes": 2812, "recent_frame_times_s": [212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332], "recent_frames_sha256": "a0ef8ee1cd62511515064c0f7deb813ce3af34da9a6806b3f45cac3e16b2d753", "num_recent_frames": 30, "tq": 716746.1827876, "t1": 716753.536102002, "ta": 716753.536102002, "te": 716753.576706814, "first_response_s": 7.353314402047545, "answer_total_s": 7.3939192140242085, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 78, "content_group": "9040691da8201e0b25cc33dc8ec114014555c114d6622c9e5d58e414b389cc3a", "question": {"question_id": "sample_78_a1537_q0", "video_id": 78, "video_path": "./videos/sample_78_real.mp4", "annotation_index": 1537, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 5."], "answer": "C", "time_stamp_s": 301, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_78_a1537_q0", "video_id": 78, "time_stamp_s": 301, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "196279ab69a7096898bd322bab432731966fe7b5f0ae1b1543e819f7ff8e4991", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "a1bbb7cdce6dd880ef35d76a6dd43153097f856e9c1a50480353edc36893e7f1", "num_recent_frames": 30, "tq": 716816.880514409, "t1": 716826.472370153, "ta": 716826.472370153, "te": 716826.508957267, "first_response_s": 9.591855743899941, "answer_total_s": 9.62844285799656, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_78_a1537_q0", "video_id": 78, "time_stamp_s": 301, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "46e3bb872436f673f7463f5e0d697cd407c2c24813f255e7c0202b318294b899", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a blue shirt stands beside a whiteboard, gesturing toward written lesson content titled \"LESSON 7.7: PROPS.\"  \n- The whiteboard displays text in various colors, including sections labeled \"PROPS\" and \"PROPS: BUILT-UP USED BY ROOMS DURING A...\" with additional bullet points.  \n- The man occasionally points to specific parts of the whiteboard while speaking, indicating instructional content.\n[30-60s] - A man in a blue shirt stands beside a whiteboard, gesturing toward written lesson content.  \n- The whiteboard displays \"LESSON 7.7: PROPS\" with bullet points about film props and their use in filmmaking.  \n- The scene transitions to a black-and-white film clip titled \"Citizen Kane (1941)\" showing a close-up of a glass sphere containing a broken object.\n[60-90s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 7.7: PROPS\" with bullet points about props in film and theater.  \n- The background is dimly lit, with hanging lights visible above the man's head.\n[90-120s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 7.7: PROPS\" with bullet points about propellers and their use in marine applications.  \n- A film clip titled \"Jaws (1975)\" shows a yellow submarine-like object being thrown into the ocean, surfacing, and moving away from a ship.\n[120-150s] - A man in a red polo shirt sits at a desk, typing on a keyboard while holding a green card.  \n- A bald man in a suit is seen inside a car, looking out the window.  \n- A side-view mirror reflects a man on a bicycle passing by a park bench where people are seated.\n[150-180s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 7.7: PROPS\" with bullet points about props in film and TV.  \n- The man’s body is slightly angled toward the camera, with his arms open as if explaining the content.\n[180-210s] - A man in a blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 7.7: PROPS\" with bullet points about film props and their use in \"The Shawshank Redemption (1994).\"  \n- A film clip shows a man in a prison cell writing with a pen, with bars visible in the background.\n[210-240s] - A man in a blue shirt stands beside a whiteboard, gesturing toward text about \"Lesson 2.7: Props\" with his hands.  \n- The whiteboard displays lesson content, including a highlighted section on \"Props\" and a list of items like \"Bottle,\" \"Cup,\" and \"Tape.\"  \n- The man occasionally points to specific lines on the board while speaking, indicating emphasis on the written material.\n[240-270s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for \"LESSON 2.7: PROPS\" with bullet points about props in film production.  \n- The man occasionally points to specific sections of the whiteboard as he explains the content.\n[270-300s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for \"Lesson 2.7: Props,\" including bullet points about props used in a scene.  \n- The man occasionally points to specific sections of the whiteboard as he explains the content.", "history_tokens": 884, "history_utf8_bytes": 3448, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "a1bbb7cdce6dd880ef35d76a6dd43153097f856e9c1a50480353edc36893e7f1", "num_recent_frames": 30, "tq": 716770.547708358, "t1": 716776.195015014, "ta": 716776.195015014, "te": 716776.234452752, "first_response_s": 5.647306655999273, "answer_total_s": 5.686744394013658, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 78, "content_group": "9040691da8201e0b25cc33dc8ec114014555c114d6622c9e5d58e414b389cc3a", "question": {"question_id": "sample_78_a1537_q1", "video_id": 78, "video_path": "./videos/sample_78_real.mp4", "annotation_index": 1537, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 5."], "answer": "C", "time_stamp_s": 333, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_78_a1537_q1", "video_id": 78, "time_stamp_s": 333, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6a923f3474e5c6bec04629191a59c0a2afec2e299a85adb0a45bc0c49a72858d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317], "recent_frames_sha256": "7b7f49b8fbf9e43ddba46a96bcf04d7e0b5a258b2d848bca133a5301a84f738c", "num_recent_frames": 30, "tq": 716826.51589877, "t1": 716837.59856814, "ta": 716837.59856814, "te": 716837.63931634, "first_response_s": 11.0826693699928, "answer_total_s": 11.123417570022866, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_78_a1537_q1", "video_id": 78, "time_stamp_s": 333, "ground_truth": "C", "raw_output": "B. 3.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "21ee8a917a72f2b9e978f6f6d4f3a5de15f2b1d9f79ec89eee436fc5b3a69e4c", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a blue shirt stands beside a whiteboard, gesturing toward written lesson content titled \"LESSON 7.7: PROPS.\"  \n- The whiteboard displays text in various colors, including sections labeled \"PROPS\" and \"PROPS: BUILT-UP USED BY ROOMS DURING A...\" with additional bullet points.  \n- The man occasionally points to specific parts of the whiteboard while speaking, indicating instructional content.\n[30-60s] - A man in a blue shirt stands beside a whiteboard, gesturing toward written lesson content.  \n- The whiteboard displays \"LESSON 7.7: PROPS\" with bullet points about film props and their use in filmmaking.  \n- The scene transitions to a black-and-white film clip titled \"Citizen Kane (1941)\" showing a close-up of a glass sphere containing a broken object.\n[60-90s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 7.7: PROPS\" with bullet points about props in film and theater.  \n- The background is dimly lit, with hanging lights visible above the man's head.\n[90-120s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 7.7: PROPS\" with bullet points about propellers and their use in marine applications.  \n- A film clip titled \"Jaws (1975)\" shows a yellow submarine-like object being thrown into the ocean, surfacing, and moving away from a ship.\n[120-150s] - A man in a red polo shirt sits at a desk, typing on a keyboard while holding a green card.  \n- A bald man in a suit is seen inside a car, looking out the window.  \n- A side-view mirror reflects a man on a bicycle passing by a park bench where people are seated.\n[150-180s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 7.7: PROPS\" with bullet points about props in film and TV.  \n- The man’s body is slightly angled toward the camera, with his arms open as if explaining the content.\n[180-210s] - A man in a blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 7.7: PROPS\" with bullet points about film props and their use in \"The Shawshank Redemption (1994).\"  \n- A film clip shows a man in a prison cell writing with a pen, with bars visible in the background.\n[210-240s] - A man in a blue shirt stands beside a whiteboard, gesturing toward text about \"Lesson 2.7: Props\" with his hands.  \n- The whiteboard displays lesson content, including a highlighted section on \"Props\" and a list of items like \"Bottle,\" \"Cup,\" and \"Tape.\"  \n- The man occasionally points to specific lines on the board while speaking, indicating emphasis on the written material.\n[240-270s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for \"LESSON 2.7: PROPS\" with bullet points about props in film production.  \n- The man occasionally points to specific sections of the whiteboard as he explains the content.\n[270-300s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for \"Lesson 2.7: Props,\" including bullet points about props used in a scene.  \n- The man occasionally points to specific sections of the whiteboard as he explains the content.\n[300-330s] - A man in a blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for \"Lesson 2.7: Props,\" including bullet points about props used in a scene.  \n- The man occasionally shifts his stance and gestures toward the whiteboard, emphasizing the content.", "history_tokens": 961, "history_utf8_bytes": 3767, "recent_frame_times_s": [303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317], "recent_frames_sha256": "7b7f49b8fbf9e43ddba46a96bcf04d7e0b5a258b2d848bca133a5301a84f738c", "num_recent_frames": 30, "tq": 716786.862921585, "t1": 716787.648257342, "ta": 716787.648257342, "te": 716787.844569263, "first_response_s": 0.7853357570711523, "answer_total_s": 0.981647678068839, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 79, "content_group": "81664f62ee734b9d9f989a2ebb6605e5196f42526cea2a5cee3a96ea56271c42", "question": {"question_id": "sample_79_a1077_q0", "video_id": 79, "video_path": "./videos/sample_79_real.mp4", "annotation_index": 1077, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 0.", "D. 4."], "answer": "C", "time_stamp_s": 18, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_79_a1077_q0", "video_id": 79, "time_stamp_s": 18, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7aa4deda45091777c5d2c33dec81a5baf4613ab3af78390bc5c9aa911a0154ba", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "11d22fd9d5d7aa165b01b7781f2a43e0c9e83aa1422fb9b29a894a306578b839", "num_recent_frames": 18, "tq": 715667.061958609, "t1": 715672.498010905, "ta": 715672.498010905, "te": 715672.536636053, "first_response_s": 5.436052295961417, "answer_total_s": 5.474677443969995, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_79_a1077_q0", "video_id": 79, "time_stamp_s": 18, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "54e7e7debd0d8e7d409cf3d188bce041e3ad562833566d2e1e98e1703b090faa", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "11d22fd9d5d7aa165b01b7781f2a43e0c9e83aa1422fb9b29a894a306578b839", "num_recent_frames": 18, "tq": 715718.514173524, "t1": 715724.98066641, "ta": 715724.98066641, "te": 715725.23956413, "first_response_s": 6.466492885956541, "answer_total_s": 6.725390605977736, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 79, "content_group": "81664f62ee734b9d9f989a2ebb6605e5196f42526cea2a5cee3a96ea56271c42", "question": {"question_id": "sample_79_a1078_q0", "video_id": 79, "video_path": "./videos/sample_79_real.mp4", "annotation_index": 1078, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 4.", "C. 2.", "D. 0."], "answer": "C", "time_stamp_s": 185, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_79_a1078_q0", "video_id": 79, "time_stamp_s": 185, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e38091e5a115e5efc2031ddce5a82badd18bbaabeb18b822f641e5371fd94b53", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667], "recent_frames_sha256": "542d98a21b19b068c83bd0fb748cf64d404072140cb640391fbbbc9702686f74", "num_recent_frames": 30, "tq": 715672.55143572, "t1": 715683.778555871, "ta": 715683.778555871, "te": 715683.816753163, "first_response_s": 11.2271201510448, "answer_total_s": 11.265317443059757, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_79_a1078_q0", "video_id": 79, "time_stamp_s": 185, "ground_truth": "C", "raw_output": "A. 3.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "866a59fee9d306695c0911eb865da52bd6629e40c31fb15eddfc11d860e2c236", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard, gesturing toward its content while speaking.  \n- The whiteboard displays \"LESSON 2.5: SET IN MALL\" and lists film-related instructions, including \"SET PLACEMENT, CAMERA, AND LIGHTING\" and \"VIEWING: SPLIT-SURF CINEMA.\"  \n- The man occasionally points to specific sections of the whiteboard, indicating key points in the lesson.\n[30-60s] - Man in light blue shirt gestures toward whiteboard with lesson details.  \n- Whiteboard displays \"LESSON 2: SET-UP\" with bullet points about film analysis.  \n- Scene transitions to \"The Age of Innocence (1993)\" with period-dressed characters in an opulent interior.\n[60-90s] - A man in a dark suit walks past a large, ornate portrait of a woman in a white dress, framed in gold, as others observe the scene.  \n- The setting is an opulent room with red walls, decorative moldings, and a potted plant near the portrait.  \n- The camera pans slightly to reveal more guests in formal attire mingling in the dimly lit, richly decorated space.\n[90-120s] - A woman in a light blue shirt stands beside a whiteboard, gesturing with her hands while speaking.  \n- The whiteboard displays text for \"Lesson 7.3: SET IN NEAT\" with bullet points about setting up a neat workspace and viewing a \"SETTLE-SURE\" chart.  \n- Her body orientation shifts slightly as she gestures, indicating emphasis on different parts of the whiteboard content.\n[120-150s] - A woman in a red sweater sits on a stone ledge beside a calm body of water, looking down with her hands clasped.  \n- Behind her, lush greenery and a large house with arched windows are visible, suggesting a serene, possibly rural setting.  \n- The text \"Two for the Road (1967)\" appears at the bottom of the screen, indicating the film being referenced.\n[150-180s] - A man in a suit and a woman in a light-colored dress walk side by side, looking at a map or document, with tall buildings framing them.  \n- The scene transitions to a man standing in front of a whiteboard, gesturing with his hands while speaking, with text on the board listing lesson objectives.  \n- The whiteboard displays lesson details, including \"SET 1: SET 1: SET 1\" and \"VIEWING: BATTLE SUE CUBA,\" indicating an educational context.", "history_tokens": 569, "history_utf8_bytes": 2244, "recent_frame_times_s": [155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667], "recent_frames_sha256": "542d98a21b19b068c83bd0fb748cf64d404072140cb640391fbbbc9702686f74", "num_recent_frames": 30, "tq": 715772.376904098, "t1": 715780.969493707, "ta": 715780.969493707, "te": 715781.196293474, "first_response_s": 8.592589608975686, "answer_total_s": 8.819389375974424, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 79, "content_group": "81664f62ee734b9d9f989a2ebb6605e5196f42526cea2a5cee3a96ea56271c42", "question": {"question_id": "sample_79_a1079_q0", "video_id": 79, "video_path": "./videos/sample_79_real.mp4", "annotation_index": 1079, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 5.", "B. 6.", "C. 3.", "D. 4."], "answer": "C", "time_stamp_s": 242, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_79_a1079_q0", "video_id": 79, "time_stamp_s": 242, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "13f589f846860b0130edd84f9d48c8a694f1f8580dedd94a010a51d3370292e8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332], "recent_frames_sha256": "0c59a04d29680b2e730eee9ca257c8135e828a50cf2776014358130d1b158978", "num_recent_frames": 30, "tq": 715683.831674638, "t1": 715697.784182685, "ta": 715697.784182685, "te": 715697.968296485, "first_response_s": 13.95250804699026, "answer_total_s": 14.136621847050264, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_79_a1079_q0", "video_id": 79, "time_stamp_s": 242, "ground_truth": "C", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "39bf2f7091049f24338cdc0d57d32a960c95fea56c61bded36740cc458314e61", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard, gesturing toward its content while speaking.  \n- The whiteboard displays \"LESSON 2.5: SET IN MALL\" and lists film-related instructions, including \"SET PLACEMENT, CAMERA, AND LIGHTING\" and \"VIEWING: SPLIT-SURF CINEMA.\"  \n- The man occasionally points to specific sections of the whiteboard, indicating key points in the lesson.\n[30-60s] - Man in light blue shirt gestures toward whiteboard with lesson details.  \n- Whiteboard displays \"LESSON 2: SET-UP\" with bullet points about film analysis.  \n- Scene transitions to \"The Age of Innocence (1993)\" with period-dressed characters in an opulent interior.\n[60-90s] - A man in a dark suit walks past a large, ornate portrait of a woman in a white dress, framed in gold, as others observe the scene.  \n- The setting is an opulent room with red walls, decorative moldings, and a potted plant near the portrait.  \n- The camera pans slightly to reveal more guests in formal attire mingling in the dimly lit, richly decorated space.\n[90-120s] - A woman in a light blue shirt stands beside a whiteboard, gesturing with her hands while speaking.  \n- The whiteboard displays text for \"Lesson 7.3: SET IN NEAT\" with bullet points about setting up a neat workspace and viewing a \"SETTLE-SURE\" chart.  \n- Her body orientation shifts slightly as she gestures, indicating emphasis on different parts of the whiteboard content.\n[120-150s] - A woman in a red sweater sits on a stone ledge beside a calm body of water, looking down with her hands clasped.  \n- Behind her, lush greenery and a large house with arched windows are visible, suggesting a serene, possibly rural setting.  \n- The text \"Two for the Road (1967)\" appears at the bottom of the screen, indicating the film being referenced.\n[150-180s] - A man in a suit and a woman in a light-colored dress walk side by side, looking at a map or document, with tall buildings framing them.  \n- The scene transitions to a man standing in front of a whiteboard, gesturing with his hands while speaking, with text on the board listing lesson objectives.  \n- The whiteboard displays lesson details, including \"SET 1: SET 1: SET 1\" and \"VIEWING: BATTLE SUE CUBA,\" indicating an educational context.\n[180-210s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 2.5: SET IN DIALOGUE,\" including bullet points about dialogue structure and viewing techniques.  \n- The background is dark, with a single light source illuminating the man and the whiteboard.\n[210-240s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 7.5: SET IN MOTION,\" including objectives and viewing instructions.  \n- The scene transitions to a clip from \"2001: A Space Odyssey (1968),\" showing a man floating in a futuristic spacecraft interior.", "history_tokens": 747, "history_utf8_bytes": 2954, "recent_frame_times_s": [212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332], "recent_frames_sha256": "0c59a04d29680b2e730eee9ca257c8135e828a50cf2776014358130d1b158978", "num_recent_frames": 30, "tq": 715796.730552697, "t1": 715804.318693306, "ta": 715804.318693306, "te": 715804.508195709, "first_response_s": 7.588140608975664, "answer_total_s": 7.7776430119993165, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 79, "content_group": "81664f62ee734b9d9f989a2ebb6605e5196f42526cea2a5cee3a96ea56271c42", "question": {"question_id": "sample_79_a1080_q0", "video_id": 79, "video_path": "./videos/sample_79_real.mp4", "annotation_index": 1080, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 5.", "C. 3.", "D. 4."], "answer": "C", "time_stamp_s": 301, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_79_a1080_q0", "video_id": 79, "time_stamp_s": 301, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "250405581e3108926bf8bdee008ecbbf43f6255d439db701808eddfa247d0450", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "61e37982e52aeaca99da2237a92e12354bad295bf712bfdaa11a5761e931c242", "num_recent_frames": 30, "tq": 715697.992162387, "t1": 715704.417071724, "ta": 715704.417071724, "te": 715704.564879631, "first_response_s": 6.4249093369580805, "answer_total_s": 6.572717244038358, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_79_a1080_q0", "video_id": 79, "time_stamp_s": 301, "ground_truth": "C", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "16de5f0ff87abe7d6f30954cf43fd529176d1c14a05fa8289e9f58e9275de7ce", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard, gesturing toward its content while speaking.  \n- The whiteboard displays \"LESSON 2.5: SET IN MALL\" and lists film-related instructions, including \"SET PLACEMENT, CAMERA, AND LIGHTING\" and \"VIEWING: SPLIT-SURF CINEMA.\"  \n- The man occasionally points to specific sections of the whiteboard, indicating key points in the lesson.\n[30-60s] - Man in light blue shirt gestures toward whiteboard with lesson details.  \n- Whiteboard displays \"LESSON 2: SET-UP\" with bullet points about film analysis.  \n- Scene transitions to \"The Age of Innocence (1993)\" with period-dressed characters in an opulent interior.\n[60-90s] - A man in a dark suit walks past a large, ornate portrait of a woman in a white dress, framed in gold, as others observe the scene.  \n- The setting is an opulent room with red walls, decorative moldings, and a potted plant near the portrait.  \n- The camera pans slightly to reveal more guests in formal attire mingling in the dimly lit, richly decorated space.\n[90-120s] - A woman in a light blue shirt stands beside a whiteboard, gesturing with her hands while speaking.  \n- The whiteboard displays text for \"Lesson 7.3: SET IN NEAT\" with bullet points about setting up a neat workspace and viewing a \"SETTLE-SURE\" chart.  \n- Her body orientation shifts slightly as she gestures, indicating emphasis on different parts of the whiteboard content.\n[120-150s] - A woman in a red sweater sits on a stone ledge beside a calm body of water, looking down with her hands clasped.  \n- Behind her, lush greenery and a large house with arched windows are visible, suggesting a serene, possibly rural setting.  \n- The text \"Two for the Road (1967)\" appears at the bottom of the screen, indicating the film being referenced.\n[150-180s] - A man in a suit and a woman in a light-colored dress walk side by side, looking at a map or document, with tall buildings framing them.  \n- The scene transitions to a man standing in front of a whiteboard, gesturing with his hands while speaking, with text on the board listing lesson objectives.  \n- The whiteboard displays lesson details, including \"SET 1: SET 1: SET 1\" and \"VIEWING: BATTLE SUE CUBA,\" indicating an educational context.\n[180-210s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 2.5: SET IN DIALOGUE,\" including bullet points about dialogue structure and viewing techniques.  \n- The background is dark, with a single light source illuminating the man and the whiteboard.\n[210-240s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 7.5: SET IN MOTION,\" including objectives and viewing instructions.  \n- The scene transitions to a clip from \"2001: A Space Odyssey (1968),\" showing a man floating in a futuristic spacecraft interior.\n[240-270s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 7.3: SET IN DIALOG,\" including bullet points about setting dialogue and viewing \"Bottle Juice\" in a CBR.  \n- The man’s hands move expressively as he explains the content, occasionally pointing to the whiteboard.\n[270-300s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for \"Lesson 7.5: Set Design,\" including objectives and viewing instructions.  \n- The background is dimly lit, with a darkened room and a visible projector screen behind the man.", "history_tokens": 920, "history_utf8_bytes": 3650, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "61e37982e52aeaca99da2237a92e12354bad295bf712bfdaa11a5761e931c242", "num_recent_frames": 30, "tq": 715822.326499269, "t1": 715830.668152942, "ta": 715830.668152942, "te": 715831.233189022, "first_response_s": 8.341653672978282, "answer_total_s": 8.906689753057435, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 79, "content_group": "81664f62ee734b9d9f989a2ebb6605e5196f42526cea2a5cee3a96ea56271c42", "question": {"question_id": "sample_79_a1080_q1", "video_id": 79, "video_path": "./videos/sample_79_real.mp4", "annotation_index": 1080, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 5."], "answer": "C", "time_stamp_s": 333, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_79_a1080_q1", "video_id": 79, "time_stamp_s": 333, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d79bf014e8b8fe3643d698ebc956db4b9959ce72347f1eeaaa98dac5496145c7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317], "recent_frames_sha256": "68f30c907bac9fc8c4c8b5210e1069eefa721f673805ae6d22d842c5c1ba05c2", "num_recent_frames": 30, "tq": 715704.573744981, "t1": 715718.320813692, "ta": 715718.320813692, "te": 715718.504858677, "first_response_s": 13.747068710974418, "answer_total_s": 13.931113696075045, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_79_a1080_q1", "video_id": 79, "time_stamp_s": 333, "ground_truth": "C", "raw_output": "C. 4.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "42bc6fabf5ecbaa837caf896b8589cd0715c7fdebeb5758d834883280d45ccb7", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard, gesturing toward its content while speaking.  \n- The whiteboard displays \"LESSON 2.5: SET IN MALL\" and lists film-related instructions, including \"SET PLACEMENT, CAMERA, AND LIGHTING\" and \"VIEWING: SPLIT-SURF CINEMA.\"  \n- The man occasionally points to specific sections of the whiteboard, indicating key points in the lesson.\n[30-60s] - Man in light blue shirt gestures toward whiteboard with lesson details.  \n- Whiteboard displays \"LESSON 2: SET-UP\" with bullet points about film analysis.  \n- Scene transitions to \"The Age of Innocence (1993)\" with period-dressed characters in an opulent interior.\n[60-90s] - A man in a dark suit walks past a large, ornate portrait of a woman in a white dress, framed in gold, as others observe the scene.  \n- The setting is an opulent room with red walls, decorative moldings, and a potted plant near the portrait.  \n- The camera pans slightly to reveal more guests in formal attire mingling in the dimly lit, richly decorated space.\n[90-120s] - A woman in a light blue shirt stands beside a whiteboard, gesturing with her hands while speaking.  \n- The whiteboard displays text for \"Lesson 7.3: SET IN NEAT\" with bullet points about setting up a neat workspace and viewing a \"SETTLE-SURE\" chart.  \n- Her body orientation shifts slightly as she gestures, indicating emphasis on different parts of the whiteboard content.\n[120-150s] - A woman in a red sweater sits on a stone ledge beside a calm body of water, looking down with her hands clasped.  \n- Behind her, lush greenery and a large house with arched windows are visible, suggesting a serene, possibly rural setting.  \n- The text \"Two for the Road (1967)\" appears at the bottom of the screen, indicating the film being referenced.\n[150-180s] - A man in a suit and a woman in a light-colored dress walk side by side, looking at a map or document, with tall buildings framing them.  \n- The scene transitions to a man standing in front of a whiteboard, gesturing with his hands while speaking, with text on the board listing lesson objectives.  \n- The whiteboard displays lesson details, including \"SET 1: SET 1: SET 1\" and \"VIEWING: BATTLE SUE CUBA,\" indicating an educational context.\n[180-210s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 2.5: SET IN DIALOGUE,\" including bullet points about dialogue structure and viewing techniques.  \n- The background is dark, with a single light source illuminating the man and the whiteboard.\n[210-240s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 7.5: SET IN MOTION,\" including objectives and viewing instructions.  \n- The scene transitions to a clip from \"2001: A Space Odyssey (1968),\" showing a man floating in a futuristic spacecraft interior.\n[240-270s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 7.3: SET IN DIALOG,\" including bullet points about setting dialogue and viewing \"Bottle Juice\" in a CBR.  \n- The man’s hands move expressively as he explains the content, occasionally pointing to the whiteboard.\n[270-300s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for \"Lesson 7.5: Set Design,\" including objectives and viewing instructions.  \n- The background is dimly lit, with a darkened room and a visible projector screen behind the man.\n[300-330s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 7.5: Set Design,\" including instructions and a \"Viewing: Bottle, Juice, Candy\" note.  \n- The background is dark, with a single overhead light illuminating the man and the whiteboard.", "history_tokens": 1007, "history_utf8_bytes": 3989, "recent_frame_times_s": [303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317], "recent_frames_sha256": "68f30c907bac9fc8c4c8b5210e1069eefa721f673805ae6d22d842c5c1ba05c2", "num_recent_frames": 30, "tq": 715842.302862347, "t1": 715849.805868445, "ta": 715849.805868445, "te": 715850.006745586, "first_response_s": 7.50300609797705, "answer_total_s": 7.703883239068091, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 81, "content_group": "2a22382518af46149f5adbd8f6c9f58c70842abca8b5dcf126112cd656de5132", "question": {"question_id": "sample_81_a1199_q0", "video_id": 81, "video_path": "./videos/sample_81_real.mp4", "annotation_index": 1199, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 18, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_81_a1199_q0", "video_id": 81, "time_stamp_s": 18, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3d68f326d9af614b32021b5462239f9cba02e216eb40a7960612c2efd97d7e7a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "5f5a891e7f6447b08cdaceba0f0b942307286e5ddc6f84ec0d4a8d7dac59a0b6", "num_recent_frames": 18, "tq": 715382.064535578, "t1": 715382.87623093, "ta": 715382.87623093, "te": 715382.916206524, "first_response_s": 0.8116953519638628, "answer_total_s": 0.851670945994556, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_81_a1199_q0", "video_id": 81, "time_stamp_s": 18, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d10b89a3dde840bdf96f078f776d7ab83586600fffae29d293433fa0e4f07560", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "5f5a891e7f6447b08cdaceba0f0b942307286e5ddc6f84ec0d4a8d7dac59a0b6", "num_recent_frames": 18, "tq": 715418.062863922, "t1": 715423.400664121, "ta": 715423.400664121, "te": 715423.660331196, "first_response_s": 5.337800199049525, "answer_total_s": 5.597467274055816, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 81, "content_group": "2a22382518af46149f5adbd8f6c9f58c70842abca8b5dcf126112cd656de5132", "question": {"question_id": "sample_81_a1200_q0", "video_id": 81, "video_path": "./videos/sample_81_real.mp4", "annotation_index": 1200, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 6.", "B. 5.", "C. 4.", "D. 0."], "answer": "A", "time_stamp_s": 226, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_81_a1200_q0", "video_id": 81, "time_stamp_s": 226, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f96bee72886c5be3379175ecb8880df3e6711d2006cfc8f2686f493572788f84", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248], "recent_frames_sha256": "953e06827ea914f82661e138a721065a625652381488134a8e43aa16d8c53dc9", "num_recent_frames": 30, "tq": 715382.937152863, "t1": 715393.112077452, "ta": 715393.112077452, "te": 715393.150181042, "first_response_s": 10.174924588995054, "answer_total_s": 10.213028179015964, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_81_a1200_q0", "video_id": 81, "time_stamp_s": 226, "ground_truth": "A", "raw_output": "C. 4.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "816ffbe967672530a964b975e85ef16ed6fb9aedd9bf0776e937588775714f89", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays lesson content including \"LESSON 7: FILM CRAFT\" and bullet points about film techniques.  \n- The man occasionally points to the whiteboard, emphasizing specific points in the lesson.\n[30-60s] - A man in a light blue shirt stands beside a whiteboard, gesturing toward its content.  \n- The whiteboard displays lesson details, including \"Lesson 7: Pickle\" and bullet points about \"The Unbearable Lightness of Being\" and \"The King of Comedy.\"  \n- The man smiles and waves at the camera, indicating a welcoming or instructional tone.\n[60-90s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays lesson notes on \"The Godfather\" with bullet points about character traits and plot elements.  \n- The background is dark, with a faintly visible light source behind the man, suggesting a studio or classroom setting.\n[90-120s] - A man in a suit stands at a desk with a nameplate reading \"GRAD DUPREE\" in a dimly lit office, gesturing while speaking.  \n- Another man in a suit sits in a chair in a similarly lit room, with a potted plant and framed picture on the wall behind him.  \n- The scene transitions between the two men, showing them in different office settings, with the first man speaking at his desk and the second seated in a chair.\n[120-150s] - A man in a suit stands at a desk, gesturing while speaking to a seated woman in a light-colored dress.  \n- The setting is a dimly lit room with arched windows, decorative plants, and a large table with various items.  \n- The scene is in black and white, with text overlay identifying it as \"Citizen Kane (1941).\"\n[150-180s] - A man in a light shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text including \"LESSON 7: S. P. L. C. A. M. E. R.\" and \"BIRTHRIGHT OF PETER AND JAMES.\"  \n- The background features dark, indistinct shapes and lighting, suggesting an indoor setting.\n[180-210s] - Central figure in brown coat and hat looks forward with serious expression, standing on wooden platform.  \n- Two other men flank him, one on left adjusting hat, another on right facing away, both on same platform.  \n- Background shows train cars and distant figures on platform, under clear sky.", "history_tokens": 594, "history_utf8_bytes": 2395, "recent_frame_times_s": [196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248], "recent_frames_sha256": "953e06827ea914f82661e138a721065a625652381488134a8e43aa16d8c53dc9", "num_recent_frames": 30, "tq": 715473.408491473, "t1": 715478.653455999, "ta": 715478.653455999, "te": 715478.986568223, "first_response_s": 5.244964526034892, "answer_total_s": 5.578076750040054, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 81, "content_group": "2a22382518af46149f5adbd8f6c9f58c70842abca8b5dcf126112cd656de5132", "question": {"question_id": "sample_81_a1201_q0", "video_id": 81, "video_path": "./videos/sample_81_real.mp4", "annotation_index": 1201, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 6.", "D. 4."], "answer": "C", "time_stamp_s": 242, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_81_a1201_q0", "video_id": 81, "time_stamp_s": 242, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e0e7c606dc3cbc8ec198535385ec8cf8d2dcd208081705604f7be14966fa4d64", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332], "recent_frames_sha256": "196454bbccc0f986ae0530818d94859c76c5a943f7fc1d6efca43800b443d3ab", "num_recent_frames": 30, "tq": 715393.172410017, "t1": 715403.043713549, "ta": 715403.043713549, "te": 715403.08136513, "first_response_s": 9.871303532039747, "answer_total_s": 9.90895511303097, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_81_a1201_q0", "video_id": 81, "time_stamp_s": 242, "ground_truth": "C", "raw_output": "B. 3.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "41b98a495533dcabb67556514cfd656939d54bc6026f75edb899c5ca107df277", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays lesson content including \"LESSON 7: FILM CRAFT\" and bullet points about film techniques.  \n- The man occasionally points to the whiteboard, emphasizing specific points in the lesson.\n[30-60s] - A man in a light blue shirt stands beside a whiteboard, gesturing toward its content.  \n- The whiteboard displays lesson details, including \"Lesson 7: Pickle\" and bullet points about \"The Unbearable Lightness of Being\" and \"The King of Comedy.\"  \n- The man smiles and waves at the camera, indicating a welcoming or instructional tone.\n[60-90s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays lesson notes on \"The Godfather\" with bullet points about character traits and plot elements.  \n- The background is dark, with a faintly visible light source behind the man, suggesting a studio or classroom setting.\n[90-120s] - A man in a suit stands at a desk with a nameplate reading \"GRAD DUPREE\" in a dimly lit office, gesturing while speaking.  \n- Another man in a suit sits in a chair in a similarly lit room, with a potted plant and framed picture on the wall behind him.  \n- The scene transitions between the two men, showing them in different office settings, with the first man speaking at his desk and the second seated in a chair.\n[120-150s] - A man in a suit stands at a desk, gesturing while speaking to a seated woman in a light-colored dress.  \n- The setting is a dimly lit room with arched windows, decorative plants, and a large table with various items.  \n- The scene is in black and white, with text overlay identifying it as \"Citizen Kane (1941).\"\n[150-180s] - A man in a light shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text including \"LESSON 7: S. P. L. C. A. M. E. R.\" and \"BIRTHRIGHT OF PETER AND JAMES.\"  \n- The background features dark, indistinct shapes and lighting, suggesting an indoor setting.\n[180-210s] - Central figure in brown coat and hat looks forward with serious expression, standing on wooden platform.  \n- Two other men flank him, one on left adjusting hat, another on right facing away, both on same platform.  \n- Background shows train cars and distant figures on platform, under clear sky.\n[210-240s] - A man in a cowboy hat and light-colored coat stands on a wooden platform, holding a rifle, with a horse and saddle nearby.  \n- The scene transitions to a man in a dark coat and hat running across the wooden platform, with a horse and rider in the background.  \n- A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.", "history_tokens": 686, "history_utf8_bytes": 2773, "recent_frame_times_s": [212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332], "recent_frames_sha256": "196454bbccc0f986ae0530818d94859c76c5a943f7fc1d6efca43800b443d3ab", "num_recent_frames": 30, "tq": 715490.456339129, "t1": 715491.733990585, "ta": 715491.733990585, "te": 715491.922206508, "first_response_s": 1.2776514559518546, "answer_total_s": 1.465867378981784, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 81, "content_group": "2a22382518af46149f5adbd8f6c9f58c70842abca8b5dcf126112cd656de5132", "question": {"question_id": "sample_81_a1202_q0", "video_id": 81, "video_path": "./videos/sample_81_real.mp4", "annotation_index": 1202, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 7.", "C. 6.", "D. 8."], "answer": "B", "time_stamp_s": 301, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_81_a1202_q0", "video_id": 81, "time_stamp_s": 301, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "915be67b8fcd1aa26bb434ddcab9f2e6cb90a87285bd9a11bffcc60c438f203a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "52f00a101d3eccb4ae79e98a1fe8db1c157c5c5080d8defa7fdeae2d4525af6c", "num_recent_frames": 30, "tq": 715403.097289889, "t1": 715411.001028481, "ta": 715411.001028481, "te": 715411.224139312, "first_response_s": 7.903738592052832, "answer_total_s": 8.126849423046224, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_81_a1202_q0", "video_id": 81, "time_stamp_s": 301, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "624507e621157d226dd3aaa6b824838dbf78740f39a90522ad089ee007fb61e3", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays lesson content including \"LESSON 7: FILM CRAFT\" and bullet points about film techniques.  \n- The man occasionally points to the whiteboard, emphasizing specific points in the lesson.\n[30-60s] - A man in a light blue shirt stands beside a whiteboard, gesturing toward its content.  \n- The whiteboard displays lesson details, including \"Lesson 7: Pickle\" and bullet points about \"The Unbearable Lightness of Being\" and \"The King of Comedy.\"  \n- The man smiles and waves at the camera, indicating a welcoming or instructional tone.\n[60-90s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays lesson notes on \"The Godfather\" with bullet points about character traits and plot elements.  \n- The background is dark, with a faintly visible light source behind the man, suggesting a studio or classroom setting.\n[90-120s] - A man in a suit stands at a desk with a nameplate reading \"GRAD DUPREE\" in a dimly lit office, gesturing while speaking.  \n- Another man in a suit sits in a chair in a similarly lit room, with a potted plant and framed picture on the wall behind him.  \n- The scene transitions between the two men, showing them in different office settings, with the first man speaking at his desk and the second seated in a chair.\n[120-150s] - A man in a suit stands at a desk, gesturing while speaking to a seated woman in a light-colored dress.  \n- The setting is a dimly lit room with arched windows, decorative plants, and a large table with various items.  \n- The scene is in black and white, with text overlay identifying it as \"Citizen Kane (1941).\"\n[150-180s] - A man in a light shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text including \"LESSON 7: S. P. L. C. A. M. E. R.\" and \"BIRTHRIGHT OF PETER AND JAMES.\"  \n- The background features dark, indistinct shapes and lighting, suggesting an indoor setting.\n[180-210s] - Central figure in brown coat and hat looks forward with serious expression, standing on wooden platform.  \n- Two other men flank him, one on left adjusting hat, another on right facing away, both on same platform.  \n- Background shows train cars and distant figures on platform, under clear sky.\n[210-240s] - A man in a cowboy hat and light-colored coat stands on a wooden platform, holding a rifle, with a horse and saddle nearby.  \n- The scene transitions to a man in a dark coat and hat running across the wooden platform, with a horse and rider in the background.  \n- A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.\n[240-270s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text including \"LESSON 7: S. PLOUGH\" and bullet points about \"BLESSED THE UNBORN\" and \"BIRTHDAY OF JESUS.\"  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.\n[270-300s] - Man in light shirt gestures toward whiteboard with lesson notes on \"Blessing the Unblessed\" and \"His Girl Friday (1940)\".\n- Whiteboard displays bullet points including \"Blessing the Unblessed\" and \"His Girl Friday (1940)\" with related text.\n- Black-and-white film clip of \"His Girl Friday (1940)\" shows a man and woman in a 1940s office setting, interacting near a desk and radio.", "history_tokens": 899, "history_utf8_bytes": 3516, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "52f00a101d3eccb4ae79e98a1fe8db1c157c5c5080d8defa7fdeae2d4525af6c", "num_recent_frames": 30, "tq": 715509.609015211, "t1": 715515.039850006, "ta": 715515.039850006, "te": 715515.077786046, "first_response_s": 5.4308347949991, "answer_total_s": 5.468770834966563, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 81, "content_group": "2a22382518af46149f5adbd8f6c9f58c70842abca8b5dcf126112cd656de5132", "question": {"question_id": "sample_81_a1202_q1", "video_id": 81, "video_path": "./videos/sample_81_real.mp4", "annotation_index": 1202, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 5.", "B. 8.", "C. 6.", "D. 7."], "answer": "D", "time_stamp_s": 333, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_81_a1202_q1", "video_id": 81, "time_stamp_s": 333, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7d19229ef0bc9afbcde3fbfdf69323f9304e1b0502ff3bde9c9501099bcee39a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317], "recent_frames_sha256": "9d218cc31c560902512b70d23b70552dbb0edab5391cb11549edeb153ed3301d", "num_recent_frames": 30, "tq": 715411.237646315, "t1": 715418.010670198, "ta": 715418.010670198, "te": 715418.048041616, "first_response_s": 6.773023882997222, "answer_total_s": 6.810395300970413, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_81_a1202_q1", "video_id": 81, "time_stamp_s": 333, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "57effd0511b79ee2ec5a91b331c69a4fc16e1f505c3ff22399dd48b12b9d6866", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays lesson content including \"LESSON 7: FILM CRAFT\" and bullet points about film techniques.  \n- The man occasionally points to the whiteboard, emphasizing specific points in the lesson.\n[30-60s] - A man in a light blue shirt stands beside a whiteboard, gesturing toward its content.  \n- The whiteboard displays lesson details, including \"Lesson 7: Pickle\" and bullet points about \"The Unbearable Lightness of Being\" and \"The King of Comedy.\"  \n- The man smiles and waves at the camera, indicating a welcoming or instructional tone.\n[60-90s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays lesson notes on \"The Godfather\" with bullet points about character traits and plot elements.  \n- The background is dark, with a faintly visible light source behind the man, suggesting a studio or classroom setting.\n[90-120s] - A man in a suit stands at a desk with a nameplate reading \"GRAD DUPREE\" in a dimly lit office, gesturing while speaking.  \n- Another man in a suit sits in a chair in a similarly lit room, with a potted plant and framed picture on the wall behind him.  \n- The scene transitions between the two men, showing them in different office settings, with the first man speaking at his desk and the second seated in a chair.\n[120-150s] - A man in a suit stands at a desk, gesturing while speaking to a seated woman in a light-colored dress.  \n- The setting is a dimly lit room with arched windows, decorative plants, and a large table with various items.  \n- The scene is in black and white, with text overlay identifying it as \"Citizen Kane (1941).\"\n[150-180s] - A man in a light shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text including \"LESSON 7: S. P. L. C. A. M. E. R.\" and \"BIRTHRIGHT OF PETER AND JAMES.\"  \n- The background features dark, indistinct shapes and lighting, suggesting an indoor setting.\n[180-210s] - Central figure in brown coat and hat looks forward with serious expression, standing on wooden platform.  \n- Two other men flank him, one on left adjusting hat, another on right facing away, both on same platform.  \n- Background shows train cars and distant figures on platform, under clear sky.\n[210-240s] - A man in a cowboy hat and light-colored coat stands on a wooden platform, holding a rifle, with a horse and saddle nearby.  \n- The scene transitions to a man in a dark coat and hat running across the wooden platform, with a horse and rider in the background.  \n- A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.\n[240-270s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text including \"LESSON 7: S. PLOUGH\" and bullet points about \"BLESSED THE UNBORN\" and \"BIRTHDAY OF JESUS.\"  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.\n[270-300s] - Man in light shirt gestures toward whiteboard with lesson notes on \"Blessing the Unblessed\" and \"His Girl Friday (1940)\".\n- Whiteboard displays bullet points including \"Blessing the Unblessed\" and \"His Girl Friday (1940)\" with related text.\n- Black-and-white film clip of \"His Girl Friday (1940)\" shows a man and woman in a 1940s office setting, interacting near a desk and radio.\n[300-330s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his right hand while speaking.  \n- The whiteboard displays \"LESSON 7: S. PLOUGH\" and lists topics like \"BIBLE: THE INDEPENDENT\" and \"SOME PEOPLE THINK.\"  \n- The man occasionally shifts his stance, pointing to different sections of the whiteboard with his left hand.", "history_tokens": 992, "history_utf8_bytes": 3866, "recent_frame_times_s": [303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317], "recent_frames_sha256": "9d218cc31c560902512b70d23b70552dbb0edab5391cb11549edeb153ed3301d", "num_recent_frames": 30, "tq": 715525.19571049, "t1": 715528.880485598, "ta": 715528.880485598, "te": 715528.920077054, "first_response_s": 3.6847751080058515, "answer_total_s": 3.7243665639543906, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 82, "content_group": "152cd489f4bf5fd5c8f7a64ff4705fa1e83a01384e6236f51facb837af6c9a7e", "question": {"question_id": "sample_82_a1123_q0", "video_id": 82, "video_path": "./videos/sample_82_real.mp4", "annotation_index": 1123, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 0.", "B. 2.", "C. 3.", "D. 4."], "answer": "A", "time_stamp_s": 18, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_82_a1123_q0", "video_id": 82, "time_stamp_s": 18, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ed52ea024fa4eff6079fb02d4e15c2e7e7d7a69d942483d25a03056d2945866b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "177ea71fbc1dc1f574ec26b380e91acb2dfc9455f25e5dc8ddcbf98281deba7d", "num_recent_frames": 18, "tq": 718900.530405467, "t1": 718906.048738458, "ta": 718906.048738458, "te": 718906.086142028, "first_response_s": 5.518332990934141, "answer_total_s": 5.555736560956575, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_82_a1123_q0", "video_id": 82, "time_stamp_s": 18, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bfb68291b3a6ac2fc094ec31269e4aa9db01cd82686e011d11485af8b2dae982", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "177ea71fbc1dc1f574ec26b380e91acb2dfc9455f25e5dc8ddcbf98281deba7d", "num_recent_frames": 18, "tq": 718779.516561179, "t1": 718787.111146201, "ta": 718787.111146201, "te": 718787.151749914, "first_response_s": 7.59458502207417, "answer_total_s": 7.635188735090196, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 82, "content_group": "152cd489f4bf5fd5c8f7a64ff4705fa1e83a01384e6236f51facb837af6c9a7e", "question": {"question_id": "sample_82_a1124_q0", "video_id": 82, "video_path": "./videos/sample_82_real.mp4", "annotation_index": 1124, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 5.", "B. 6.", "C. 4.", "D. 0."], "answer": "A", "time_stamp_s": 187, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_82_a1124_q0", "video_id": 82, "time_stamp_s": 187, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5a90d96c8d17f07e0f11e247b58a9c0d83668539ed970a02ba4e81389686d9c6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668], "recent_frames_sha256": "1633d477dc27c34ea4e472d8b0df6e43998756e2e5495fc333f4199ebaa56a73", "num_recent_frames": 30, "tq": 718906.102661579, "t1": 718948.266261113, "ta": 718948.266261113, "te": 718948.46118, "first_response_s": 42.16359953396022, "answer_total_s": 42.35851842095144, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_82_a1124_q0", "video_id": 82, "time_stamp_s": 187, "ground_truth": "A", "raw_output": "C. 4.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "872be388081b910460b288b46c8db781ee0df30a82868e23abe4c589611c364f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man stands beside a whiteboard displaying \"LESSON 11: COMPOSITION I FORMING\" with handwritten notes in red and blue ink.  \n- He gestures with his hands while speaking, occasionally pointing to the whiteboard content.  \n- The text \"Mr. Marklevitz Film Teacher\" appears at the bottom of the screen.\n[30-60s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition: Forming\" and includes phrases like \"Cameo Distances\" and \"The Third Kind (1942).\"  \n- The background is dark with hanging light fixtures, and the man occasionally points to specific parts of the whiteboard.\n[60-90s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition & Forming\" with bullet points and highlighted sections.  \n- The background shows a dimly lit room with hanging lights, suggesting an indoor educational setting.\n[90-120s] - A man in a gray sweater stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition & Forming\" with bullet points and highlighted sections.  \n- The background features hanging light fixtures and a dark setting, suggesting an indoor classroom or lecture environment.\n[120-150s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition & Forming\" with bullet points and highlighted sections.  \n- The man occasionally points to specific parts of the whiteboard as he explains the content.\n[150-180s] - A man in a cowboy hat and vest stands facing another man in a dark coat, both in a dimly lit, black-and-white scene from \"My Darling Clementine\" (1946).  \n- A woman with curly hair and a coat stands close to a man in a cape, looking at him intently, in a scene from \"Don't Look Now\" (1973).  \n- A man in a light-colored shirt and tie stands with another man in a dark shirt and suspenders, both looking at a burning vehicle in a desert setting from \"Repo Man\" (1984).", "history_tokens": 524, "history_utf8_bytes": 2133, "recent_frame_times_s": [157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668], "recent_frames_sha256": "1633d477dc27c34ea4e472d8b0df6e43998756e2e5495fc333f4199ebaa56a73", "num_recent_frames": 30, "tq": 718843.380802055, "t1": 718844.455427858, "ta": 718844.455427858, "te": 718844.894736474, "first_response_s": 1.0746258030412719, "answer_total_s": 1.5139344190247357, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 82, "content_group": "152cd489f4bf5fd5c8f7a64ff4705fa1e83a01384e6236f51facb837af6c9a7e", "question": {"question_id": "sample_82_a1125_q0", "video_id": 82, "video_path": "./videos/sample_82_real.mp4", "annotation_index": 1125, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 6.", "B. 2.", "C. 3.", "D. 4."], "answer": "A", "time_stamp_s": 249, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_82_a1125_q0", "video_id": 82, "time_stamp_s": 249, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5cfb54b2d86286d4b81ae8e20955206b9d0b6e1932b44632205645d10adef459", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333], "recent_frames_sha256": "aa1bf54fdb15f04ad861a771c0c26909be47255a3545b540969d9c2c6ebd6a15", "num_recent_frames": 30, "tq": 718948.4766746, "t1": 718957.394729589, "ta": 718957.394729589, "te": 718957.433479589, "first_response_s": 8.91805498895701, "answer_total_s": 8.956804988905787, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_82_a1125_q0", "video_id": 82, "time_stamp_s": 249, "ground_truth": "A", "raw_output": "D. 4.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "643cc53b9b54eb7e4c1bcc4bd8fd24b4421ce69df6904db94b88827af18d8bc0", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man stands beside a whiteboard displaying \"LESSON 11: COMPOSITION I FORMING\" with handwritten notes in red and blue ink.  \n- He gestures with his hands while speaking, occasionally pointing to the whiteboard content.  \n- The text \"Mr. Marklevitz Film Teacher\" appears at the bottom of the screen.\n[30-60s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition: Forming\" and includes phrases like \"Cameo Distances\" and \"The Third Kind (1942).\"  \n- The background is dark with hanging light fixtures, and the man occasionally points to specific parts of the whiteboard.\n[60-90s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition & Forming\" with bullet points and highlighted sections.  \n- The background shows a dimly lit room with hanging lights, suggesting an indoor educational setting.\n[90-120s] - A man in a gray sweater stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition & Forming\" with bullet points and highlighted sections.  \n- The background features hanging light fixtures and a dark setting, suggesting an indoor classroom or lecture environment.\n[120-150s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition & Forming\" with bullet points and highlighted sections.  \n- The man occasionally points to specific parts of the whiteboard as he explains the content.\n[150-180s] - A man in a cowboy hat and vest stands facing another man in a dark coat, both in a dimly lit, black-and-white scene from \"My Darling Clementine\" (1946).  \n- A woman with curly hair and a coat stands close to a man in a cape, looking at him intently, in a scene from \"Don't Look Now\" (1973).  \n- A man in a light-colored shirt and tie stands with another man in a dark shirt and suspenders, both looking at a burning vehicle in a desert setting from \"Repo Man\" (1984).\n[180-210s] - A man stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text about \"Composition + Forming\" with bullet points and highlighted sections.  \n- The man’s hands move expressively as he points to different parts of the whiteboard.\n[210-240s] - A man stands in front of a whiteboard, gesturing toward text about \"Composition & Forming\" and \"The Third Kind (1973)\".\n- The whiteboard displays lesson content, including \"Clementi's Duet\" and \"The Piano (1993)\" as examples.\n- The scene transitions to close-ups of eyes, a piano key, and a snake in grass, with film titles overlaid.", "history_tokens": 694, "history_utf8_bytes": 2773, "recent_frame_times_s": [219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333], "recent_frames_sha256": "aa1bf54fdb15f04ad861a771c0c26909be47255a3545b540969d9c2c6ebd6a15", "num_recent_frames": 30, "tq": 718859.18733686, "t1": 718861.203088091, "ta": 718861.203088091, "te": 718861.468106654, "first_response_s": 2.015751230996102, "answer_total_s": 2.280769794015214, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 82, "content_group": "152cd489f4bf5fd5c8f7a64ff4705fa1e83a01384e6236f51facb837af6c9a7e", "question": {"question_id": "sample_82_a1126_q0", "video_id": 82, "video_path": "./videos/sample_82_real.mp4", "annotation_index": 1126, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 7.", "B. 2.", "C. 6.", "D. 8."], "answer": "A", "time_stamp_s": 301, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_82_a1126_q0", "video_id": 82, "time_stamp_s": 301, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9d5414526362d3b7780af681ad4cd0846b0dd0f7d3f78254f39aa6a9eb663252", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "7f3effec595c5de44fdc432e0d53b3d8710c34aa56f85ece50245872888e6deb", "num_recent_frames": 30, "tq": 718957.456912337, "t1": 718969.152901651, "ta": 718969.152901651, "te": 718969.19263267, "first_response_s": 11.695989314001054, "answer_total_s": 11.735720333061181, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_82_a1126_q0", "video_id": 82, "time_stamp_s": 301, "ground_truth": "A", "raw_output": "C. 6.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "fc4dc244b21c102cbe1942905714c60d875f4beed33211a69be113cfae0b790a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man stands beside a whiteboard displaying \"LESSON 11: COMPOSITION I FORMING\" with handwritten notes in red and blue ink.  \n- He gestures with his hands while speaking, occasionally pointing to the whiteboard content.  \n- The text \"Mr. Marklevitz Film Teacher\" appears at the bottom of the screen.\n[30-60s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition: Forming\" and includes phrases like \"Cameo Distances\" and \"The Third Kind (1942).\"  \n- The background is dark with hanging light fixtures, and the man occasionally points to specific parts of the whiteboard.\n[60-90s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition & Forming\" with bullet points and highlighted sections.  \n- The background shows a dimly lit room with hanging lights, suggesting an indoor educational setting.\n[90-120s] - A man in a gray sweater stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition & Forming\" with bullet points and highlighted sections.  \n- The background features hanging light fixtures and a dark setting, suggesting an indoor classroom or lecture environment.\n[120-150s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition & Forming\" with bullet points and highlighted sections.  \n- The man occasionally points to specific parts of the whiteboard as he explains the content.\n[150-180s] - A man in a cowboy hat and vest stands facing another man in a dark coat, both in a dimly lit, black-and-white scene from \"My Darling Clementine\" (1946).  \n- A woman with curly hair and a coat stands close to a man in a cape, looking at him intently, in a scene from \"Don't Look Now\" (1973).  \n- A man in a light-colored shirt and tie stands with another man in a dark shirt and suspenders, both looking at a burning vehicle in a desert setting from \"Repo Man\" (1984).\n[180-210s] - A man stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text about \"Composition + Forming\" with bullet points and highlighted sections.  \n- The man’s hands move expressively as he points to different parts of the whiteboard.\n[210-240s] - A man stands in front of a whiteboard, gesturing toward text about \"Composition & Forming\" and \"The Third Kind (1973)\".\n- The whiteboard displays lesson content, including \"Clementi's Duet\" and \"The Piano (1993)\" as examples.\n- The scene transitions to close-ups of eyes, a piano key, and a snake in grass, with film titles overlaid.\n[240-270s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition + Forming\" with various highlighted phrases and bullet points.  \n- The background is dark with hanging light fixtures visible above the man.\n[270-300s] - A man in a gray sweater gestures toward a whiteboard displaying lesson content on composition and forming.  \n- The whiteboard lists key terms like \"COMPOSITION,\" \"FORMING,\" and \"THIRD KIND\" with annotations.  \n- The man stands in a dimly lit room with hanging lights, facing the camera while explaining the material.", "history_tokens": 843, "history_utf8_bytes": 3405, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "7f3effec595c5de44fdc432e0d53b3d8710c34aa56f85ece50245872888e6deb", "num_recent_frames": 30, "tq": 718880.594480527, "t1": 718882.19344091, "ta": 718882.19344091, "te": 718882.383624536, "first_response_s": 1.5989603829802945, "answer_total_s": 1.7891440090024844, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 82, "content_group": "152cd489f4bf5fd5c8f7a64ff4705fa1e83a01384e6236f51facb837af6c9a7e", "question": {"question_id": "sample_82_a1126_q1", "video_id": 82, "video_path": "./videos/sample_82_real.mp4", "annotation_index": 1126, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 9.", "B. 5.", "C. 8.", "D. 6."], "answer": "A", "time_stamp_s": 333, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_82_a1126_q1", "video_id": 82, "time_stamp_s": 333, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2579b92cfda1259610279d92a6e1973a010e1ee005006456857baa03e9990393", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317], "recent_frames_sha256": "98f24d3ef83e4850dbed17afe09f5362dafea0dc47aab864aae96dc1170ae65c", "num_recent_frames": 30, "tq": 718969.216244826, "t1": 718977.639666417, "ta": 718977.639666417, "te": 718977.841230657, "first_response_s": 8.423421591054648, "answer_total_s": 8.624985830974765, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_82_a1126_q1", "video_id": 82, "time_stamp_s": 333, "ground_truth": "A", "raw_output": "B. 5.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "0a2ca5d29aa952f142cab7fc392d083cf3c32e5e013f03e3968b5e50fb90e014", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man stands beside a whiteboard displaying \"LESSON 11: COMPOSITION I FORMING\" with handwritten notes in red and blue ink.  \n- He gestures with his hands while speaking, occasionally pointing to the whiteboard content.  \n- The text \"Mr. Marklevitz Film Teacher\" appears at the bottom of the screen.\n[30-60s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition: Forming\" and includes phrases like \"Cameo Distances\" and \"The Third Kind (1942).\"  \n- The background is dark with hanging light fixtures, and the man occasionally points to specific parts of the whiteboard.\n[60-90s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition & Forming\" with bullet points and highlighted sections.  \n- The background shows a dimly lit room with hanging lights, suggesting an indoor educational setting.\n[90-120s] - A man in a gray sweater stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition & Forming\" with bullet points and highlighted sections.  \n- The background features hanging light fixtures and a dark setting, suggesting an indoor classroom or lecture environment.\n[120-150s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition & Forming\" with bullet points and highlighted sections.  \n- The man occasionally points to specific parts of the whiteboard as he explains the content.\n[150-180s] - A man in a cowboy hat and vest stands facing another man in a dark coat, both in a dimly lit, black-and-white scene from \"My Darling Clementine\" (1946).  \n- A woman with curly hair and a coat stands close to a man in a cape, looking at him intently, in a scene from \"Don't Look Now\" (1973).  \n- A man in a light-colored shirt and tie stands with another man in a dark shirt and suspenders, both looking at a burning vehicle in a desert setting from \"Repo Man\" (1984).\n[180-210s] - A man stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text about \"Composition + Forming\" with bullet points and highlighted sections.  \n- The man’s hands move expressively as he points to different parts of the whiteboard.\n[210-240s] - A man stands in front of a whiteboard, gesturing toward text about \"Composition & Forming\" and \"The Third Kind (1973)\".\n- The whiteboard displays lesson content, including \"Clementi's Duet\" and \"The Piano (1993)\" as examples.\n- The scene transitions to close-ups of eyes, a piano key, and a snake in grass, with film titles overlaid.\n[240-270s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Composition + Forming\" with various highlighted phrases and bullet points.  \n- The background is dark with hanging light fixtures visible above the man.\n[270-300s] - A man in a gray sweater gestures toward a whiteboard displaying lesson content on composition and forming.  \n- The whiteboard lists key terms like \"COMPOSITION,\" \"FORMING,\" and \"THIRD KIND\" with annotations.  \n- The man stands in a dimly lit room with hanging lights, facing the camera while explaining the material.\n[300-330s] - A man in a gray shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text about \"Composition & Forming\" with highlighted phrases like \"CANNOT DISTINGUISH\" and \"THE THIRD KINSHIP.\"  \n- The background features dimly lit ceiling lights and a darkened room, suggesting an indoor educational setting.", "history_tokens": 932, "history_utf8_bytes": 3770, "recent_frame_times_s": [303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317], "recent_frames_sha256": "98f24d3ef83e4850dbed17afe09f5362dafea0dc47aab864aae96dc1170ae65c", "num_recent_frames": 30, "tq": 718893.46232319, "t1": 718900.297333752, "ta": 718900.297333752, "te": 718900.498340101, "first_response_s": 6.835010562092066, "answer_total_s": 7.036016911035404, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 83, "content_group": "2657fd72c1ae359e51b1d3a10072eccf2088d1ec226d1a7af75e051fa96fc3b9", "question": {"question_id": "sample_83_a58_q0", "video_id": 83, "video_path": "./videos/sample_83_real.mp4", "annotation_index": 58, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 1.", "B. 2.", "C. 3.", "D. 4."], "answer": "A", "time_stamp_s": 58, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_83_a58_q0", "video_id": 83, "time_stamp_s": 58, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7b3ab4e1d05a104e6bd7153fd0cdfdedf8663bdf797e1b95734c14d79d8c7f6d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336], "recent_frames_sha256": "afc15109221d7d954c27dba43592547d5c8a012db7e588698f98250a6bcdbd60", "num_recent_frames": 30, "tq": 718421.680926784, "t1": 718422.37148366, "ta": 718422.37148366, "te": 718422.40969982, "first_response_s": 0.6905568758957088, "answer_total_s": 0.7287730359239504, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_83_a58_q0", "video_id": 83, "time_stamp_s": 58, "ground_truth": "A", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "f165717838990ed1fe9b2c512d4f01853d340008b0bcd0822579f9c94431b91e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a grey shirt stands beside a whiteboard displaying \"Lesson 3: Camera Movement\" with bullet points about horizontal, vertical, and alternating movements.  \n- The video transitions to black-and-white clips: \"2001: A Space Odyssey (1968)\" shows a figure running through a futuristic corridor, followed by \"A Trip to the Moon (1902)\" depicting a fantastical lunar landscape.  \n- \"Wings (1927)\" shows a sepia-toned scene of people at an outdoor café, with a man in a hat gesturing while seated at a table.", "history_tokens": 135, "history_utf8_bytes": 520, "recent_frame_times_s": [28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336], "recent_frames_sha256": "afc15109221d7d954c27dba43592547d5c8a012db7e588698f98250a6bcdbd60", "num_recent_frames": 30, "tq": 718311.961529938, "t1": 718313.461055767, "ta": 718313.461055767, "te": 718313.654761956, "first_response_s": 1.4995258289854974, "answer_total_s": 1.6932320179184899, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 83, "content_group": "2657fd72c1ae359e51b1d3a10072eccf2088d1ec226d1a7af75e051fa96fc3b9", "question": {"question_id": "sample_83_a59_q0", "video_id": 83, "video_path": "./videos/sample_83_real.mp4", "annotation_index": 59, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 6.", "B. 5.", "C. 4.", "D. 0."], "answer": "A", "time_stamp_s": 187, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_83_a59_q0", "video_id": 83, "time_stamp_s": 187, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3a41c9a9c88ed56e3a10c7c424974e91ed96b9997e20af6eca9e9cf22d6be2fd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668], "recent_frames_sha256": "4777d37a6276ed3560bdbb82ab6cb32e928943939f97782e4fdfb0e9e01ecab5", "num_recent_frames": 30, "tq": 718422.428764381, "t1": 718432.835648519, "ta": 718432.835648519, "te": 718432.872409701, "first_response_s": 10.406884138006717, "answer_total_s": 10.443645320017822, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_83_a59_q0", "video_id": 83, "time_stamp_s": 187, "ground_truth": "A", "raw_output": "C. 4.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "6b950e79a6c46987ed097c1441199a5bdc86068efd4ccfa743f109151015b9d2", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a grey shirt stands beside a whiteboard displaying \"Lesson 3: Camera Movement\" with bullet points about horizontal, vertical, and alternating movements.  \n- The video transitions to black-and-white clips: \"2001: A Space Odyssey (1968)\" shows a figure running through a futuristic corridor, followed by \"A Trip to the Moon (1902)\" depicting a fantastical lunar landscape.  \n- \"Wings (1927)\" shows a sepia-toned scene of people at an outdoor café, with a man in a hat gesturing while seated at a table.\n[30-60s] - A man in a suit stands on a staircase, holding a paper and addressing a group of women seated below him.  \n- A woman in a light-colored dress sits on a chair, holding a small object while looking at a man who is seated beside her.  \n- A man in a suit and bow tie stands next to a woman in a lace dress, holding a chain or necklace as they appear to be in a formal setting.\n[60-90s] - A man in a grey shirt gestures toward a whiteboard displaying \"LESSON 3.2: CAMERA MOVEMENT\" with bullet points about movement types.  \n- The whiteboard lists terms like \"PROXIMITY, MANEUVERING\" and \"VERTICAL MOVEMENTS\" with examples such as \"Fargo (1996)\" and \"Jaws (1975).\"  \n- The man stands in front of a dark background with hanging lights, occasionally pointing to the board while speaking.\n[90-120s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 3: Camera Movement\" with bullet points on movement types and film examples.  \n- The background is dark with faint lights, and the man occasionally points to the whiteboard content.\n[120-150s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 3: Cervical Movement\" with bullet points and highlighted sections.  \n- The background features dimly lit hanging lights and a darkened room setting.\n[150-180s] - A man in a suit holds a cigarette, looking upward in a dimly lit room.  \n- A woman in a green skirt walks across a room with men seated around her.  \n- A hot air balloon floats over a dark, castle-like structure under a moonlit sky.", "history_tokens": 565, "history_utf8_bytes": 2198, "recent_frame_times_s": [157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668], "recent_frames_sha256": "4777d37a6276ed3560bdbb82ab6cb32e928943939f97782e4fdfb0e9e01ecab5", "num_recent_frames": 30, "tq": 718355.547133996, "t1": 718357.063801637, "ta": 718357.063801637, "te": 718357.406452712, "first_response_s": 1.5166676410008222, "answer_total_s": 1.8593187159858644, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 83, "content_group": "2657fd72c1ae359e51b1d3a10072eccf2088d1ec226d1a7af75e051fa96fc3b9", "question": {"question_id": "sample_83_a60_q0", "video_id": 83, "video_path": "./videos/sample_83_real.mp4", "annotation_index": 60, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 7.", "B. 2.", "C. 3.", "D. 6."], "answer": "A", "time_stamp_s": 242, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_83_a60_q0", "video_id": 83, "time_stamp_s": 242, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "60d5b4417d61658ba3cff49707d7533b1f06d582c219b81cd333f054dbb592ec", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332], "recent_frames_sha256": "7ebcdc9e16a5f58475fc32414269555d6e224028fea67f5960c77f51944d3d75", "num_recent_frames": 30, "tq": 718432.883844227, "t1": 718444.788244509, "ta": 718444.788244509, "te": 718444.826382072, "first_response_s": 11.904400282073766, "answer_total_s": 11.942537844995968, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_83_a60_q0", "video_id": 83, "time_stamp_s": 242, "ground_truth": "A", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "0893a37ddef27a445769dba6acddea3686fb7d7f18617cd6d8310637578bd716", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a grey shirt stands beside a whiteboard displaying \"Lesson 3: Camera Movement\" with bullet points about horizontal, vertical, and alternating movements.  \n- The video transitions to black-and-white clips: \"2001: A Space Odyssey (1968)\" shows a figure running through a futuristic corridor, followed by \"A Trip to the Moon (1902)\" depicting a fantastical lunar landscape.  \n- \"Wings (1927)\" shows a sepia-toned scene of people at an outdoor café, with a man in a hat gesturing while seated at a table.\n[30-60s] - A man in a suit stands on a staircase, holding a paper and addressing a group of women seated below him.  \n- A woman in a light-colored dress sits on a chair, holding a small object while looking at a man who is seated beside her.  \n- A man in a suit and bow tie stands next to a woman in a lace dress, holding a chain or necklace as they appear to be in a formal setting.\n[60-90s] - A man in a grey shirt gestures toward a whiteboard displaying \"LESSON 3.2: CAMERA MOVEMENT\" with bullet points about movement types.  \n- The whiteboard lists terms like \"PROXIMITY, MANEUVERING\" and \"VERTICAL MOVEMENTS\" with examples such as \"Fargo (1996)\" and \"Jaws (1975).\"  \n- The man stands in front of a dark background with hanging lights, occasionally pointing to the board while speaking.\n[90-120s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 3: Camera Movement\" with bullet points on movement types and film examples.  \n- The background is dark with faint lights, and the man occasionally points to the whiteboard content.\n[120-150s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 3: Cervical Movement\" with bullet points and highlighted sections.  \n- The background features dimly lit hanging lights and a darkened room setting.\n[150-180s] - A man in a suit holds a cigarette, looking upward in a dimly lit room.  \n- A woman in a green skirt walks across a room with men seated around her.  \n- A hot air balloon floats over a dark, castle-like structure under a moonlit sky.\n[180-210s] - A man in a gray shirt stands beside a whiteboard, gesturing toward written lesson content on \"Cohesive Movement.\"  \n- The whiteboard lists topics like \"Horizontal Movement,\" \"Vertical Movements,\" and \"Alternating Movements,\" with highlighted terms.  \n- The background features dimly lit stage lights and a darkened room, suggesting a presentation or lecture setting.\n[210-240s] - A man in a dark polo shirt and khaki pants sits on a wooden stool outdoors, with a row of white mailboxes on a stand behind him.  \n- The scene transitions to an indoor setting where a man in a gray shirt stands in front of a whiteboard titled \"LESSON 3: CANNON MOVEMENT,\" gesturing toward the board.  \n- The whiteboard lists key terms like \"PROXIMAL- DISTAL MOVEMENTS,\" \"VERTICAL MOVEMENTS,\" and \"ALTERNATING MOVEMENTS,\" with a note at the bottom reading \"Wanna The House... Honey.\"", "history_tokens": 788, "history_utf8_bytes": 3074, "recent_frame_times_s": [212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332], "recent_frames_sha256": "7ebcdc9e16a5f58475fc32414269555d6e224028fea67f5960c77f51944d3d75", "num_recent_frames": 30, "tq": 718377.636769713, "t1": 718384.484848761, "ta": 718384.484848761, "te": 718384.860995503, "first_response_s": 6.848079047980718, "answer_total_s": 7.22422579000704, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 83, "content_group": "2657fd72c1ae359e51b1d3a10072eccf2088d1ec226d1a7af75e051fa96fc3b9", "question": {"question_id": "sample_83_a61_q0", "video_id": 83, "video_path": "./videos/sample_83_real.mp4", "annotation_index": 61, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 8.", "B. 2.", "C. 7.", "D. 6."], "answer": "A", "time_stamp_s": 301, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_83_a61_q0", "video_id": 83, "time_stamp_s": 301, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8fbc4092f594118e67d0c8bda2584ac440fc542d6f2fdb2b7f4bced2755f288a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "705e0dc68ba895ec6654181bac006244e691916d2a03a1dd379bfa92b9ffa846", "num_recent_frames": 30, "tq": 718444.836053273, "t1": 718452.534318177, "ta": 718452.534318177, "te": 718452.57106667, "first_response_s": 7.698264904087409, "answer_total_s": 7.735013397061266, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_83_a61_q0", "video_id": 83, "time_stamp_s": 301, "ground_truth": "A", "raw_output": "B. 2.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "aeff32c88f38f22885d5ffd03087b9c36655a2da54ec81771d75957b6fe455f5", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a grey shirt stands beside a whiteboard displaying \"Lesson 3: Camera Movement\" with bullet points about horizontal, vertical, and alternating movements.  \n- The video transitions to black-and-white clips: \"2001: A Space Odyssey (1968)\" shows a figure running through a futuristic corridor, followed by \"A Trip to the Moon (1902)\" depicting a fantastical lunar landscape.  \n- \"Wings (1927)\" shows a sepia-toned scene of people at an outdoor café, with a man in a hat gesturing while seated at a table.\n[30-60s] - A man in a suit stands on a staircase, holding a paper and addressing a group of women seated below him.  \n- A woman in a light-colored dress sits on a chair, holding a small object while looking at a man who is seated beside her.  \n- A man in a suit and bow tie stands next to a woman in a lace dress, holding a chain or necklace as they appear to be in a formal setting.\n[60-90s] - A man in a grey shirt gestures toward a whiteboard displaying \"LESSON 3.2: CAMERA MOVEMENT\" with bullet points about movement types.  \n- The whiteboard lists terms like \"PROXIMITY, MANEUVERING\" and \"VERTICAL MOVEMENTS\" with examples such as \"Fargo (1996)\" and \"Jaws (1975).\"  \n- The man stands in front of a dark background with hanging lights, occasionally pointing to the board while speaking.\n[90-120s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 3: Camera Movement\" with bullet points on movement types and film examples.  \n- The background is dark with faint lights, and the man occasionally points to the whiteboard content.\n[120-150s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 3: Cervical Movement\" with bullet points and highlighted sections.  \n- The background features dimly lit hanging lights and a darkened room setting.\n[150-180s] - A man in a suit holds a cigarette, looking upward in a dimly lit room.  \n- A woman in a green skirt walks across a room with men seated around her.  \n- A hot air balloon floats over a dark, castle-like structure under a moonlit sky.\n[180-210s] - A man in a gray shirt stands beside a whiteboard, gesturing toward written lesson content on \"Cohesive Movement.\"  \n- The whiteboard lists topics like \"Horizontal Movement,\" \"Vertical Movements,\" and \"Alternating Movements,\" with highlighted terms.  \n- The background features dimly lit stage lights and a darkened room, suggesting a presentation or lecture setting.\n[210-240s] - A man in a dark polo shirt and khaki pants sits on a wooden stool outdoors, with a row of white mailboxes on a stand behind him.  \n- The scene transitions to an indoor setting where a man in a gray shirt stands in front of a whiteboard titled \"LESSON 3: CANNON MOVEMENT,\" gesturing toward the board.  \n- The whiteboard lists key terms like \"PROXIMAL- DISTAL MOVEMENTS,\" \"VERTICAL MOVEMENTS,\" and \"ALTERNATING MOVEMENTS,\" with a note at the bottom reading \"Wanna The House... Honey.\"\n[240-270s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text including \"LESSON 3.2: CHORUS MOVEMENT\" and various dance-related terms.  \n- The background features dimly lit stage lights and a darkened room, suggesting a presentation or lecture setting.\n[270-300s] - Man gestures toward whiteboard with both hands while speaking.  \n- Whiteboard displays \"LESSON 3: CHOREO MOVEMENT\" and related bullet points.  \n- Background shows dimly lit room with hanging lights and a darkened stage area.", "history_tokens": 934, "history_utf8_bytes": 3645, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "705e0dc68ba895ec6654181bac006244e691916d2a03a1dd379bfa92b9ffa846", "num_recent_frames": 30, "tq": 718401.464626261, "t1": 718408.669609403, "ta": 718408.669609403, "te": 718408.85929898, "first_response_s": 7.204983141971752, "answer_total_s": 7.394672718946822, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 83, "content_group": "2657fd72c1ae359e51b1d3a10072eccf2088d1ec226d1a7af75e051fa96fc3b9", "question": {"question_id": "sample_83_a61_q1", "video_id": 83, "video_path": "./videos/sample_83_real.mp4", "annotation_index": 61, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 9.", "B. 5.", "C. 8.", "D. 6."], "answer": "A", "time_stamp_s": 333, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_83_a61_q1", "video_id": 83, "time_stamp_s": 333, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1b088c14df9974b4e2708afbc90550284177535f02b539a4e94728147f972a41", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317], "recent_frames_sha256": "4bfab972073e952869baa52ffe726ffb7b6c095d6bdeac90f9ec6e25ed8b0e46", "num_recent_frames": 30, "tq": 718452.577415723, "t1": 718464.715394438, "ta": 718464.715394438, "te": 718464.752725876, "first_response_s": 12.137978715007193, "answer_total_s": 12.175310153048486, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_83_a61_q1", "video_id": 83, "time_stamp_s": 333, "ground_truth": "A", "raw_output": "B. 5.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "5d826bc167520d3042928bd01e1e2292cd2ead795bcecfa01d5c3c567a1ab279", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a grey shirt stands beside a whiteboard displaying \"Lesson 3: Camera Movement\" with bullet points about horizontal, vertical, and alternating movements.  \n- The video transitions to black-and-white clips: \"2001: A Space Odyssey (1968)\" shows a figure running through a futuristic corridor, followed by \"A Trip to the Moon (1902)\" depicting a fantastical lunar landscape.  \n- \"Wings (1927)\" shows a sepia-toned scene of people at an outdoor café, with a man in a hat gesturing while seated at a table.\n[30-60s] - A man in a suit stands on a staircase, holding a paper and addressing a group of women seated below him.  \n- A woman in a light-colored dress sits on a chair, holding a small object while looking at a man who is seated beside her.  \n- A man in a suit and bow tie stands next to a woman in a lace dress, holding a chain or necklace as they appear to be in a formal setting.\n[60-90s] - A man in a grey shirt gestures toward a whiteboard displaying \"LESSON 3.2: CAMERA MOVEMENT\" with bullet points about movement types.  \n- The whiteboard lists terms like \"PROXIMITY, MANEUVERING\" and \"VERTICAL MOVEMENTS\" with examples such as \"Fargo (1996)\" and \"Jaws (1975).\"  \n- The man stands in front of a dark background with hanging lights, occasionally pointing to the board while speaking.\n[90-120s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 3: Camera Movement\" with bullet points on movement types and film examples.  \n- The background is dark with faint lights, and the man occasionally points to the whiteboard content.\n[120-150s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 3: Cervical Movement\" with bullet points and highlighted sections.  \n- The background features dimly lit hanging lights and a darkened room setting.\n[150-180s] - A man in a suit holds a cigarette, looking upward in a dimly lit room.  \n- A woman in a green skirt walks across a room with men seated around her.  \n- A hot air balloon floats over a dark, castle-like structure under a moonlit sky.\n[180-210s] - A man in a gray shirt stands beside a whiteboard, gesturing toward written lesson content on \"Cohesive Movement.\"  \n- The whiteboard lists topics like \"Horizontal Movement,\" \"Vertical Movements,\" and \"Alternating Movements,\" with highlighted terms.  \n- The background features dimly lit stage lights and a darkened room, suggesting a presentation or lecture setting.\n[210-240s] - A man in a dark polo shirt and khaki pants sits on a wooden stool outdoors, with a row of white mailboxes on a stand behind him.  \n- The scene transitions to an indoor setting where a man in a gray shirt stands in front of a whiteboard titled \"LESSON 3: CANNON MOVEMENT,\" gesturing toward the board.  \n- The whiteboard lists key terms like \"PROXIMAL- DISTAL MOVEMENTS,\" \"VERTICAL MOVEMENTS,\" and \"ALTERNATING MOVEMENTS,\" with a note at the bottom reading \"Wanna The House... Honey.\"\n[240-270s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text including \"LESSON 3.2: CHORUS MOVEMENT\" and various dance-related terms.  \n- The background features dimly lit stage lights and a darkened room, suggesting a presentation or lecture setting.\n[270-300s] - Man gestures toward whiteboard with both hands while speaking.  \n- Whiteboard displays \"LESSON 3: CHOREO MOVEMENT\" and related bullet points.  \n- Background shows dimly lit room with hanging lights and a darkened stage area.\n[300-330s] - A man in a gray shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"LESSON 32: CHICAGO MOVEMENT\" with bullet points about movement types and techniques.  \n- The background features dimly lit studio lights and a camera setup, suggesting a recording environment.", "history_tokens": 1013, "history_utf8_bytes": 3971, "recent_frame_times_s": [303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317], "recent_frames_sha256": "4bfab972073e952869baa52ffe726ffb7b6c095d6bdeac90f9ec6e25ed8b0e46", "num_recent_frames": 30, "tq": 718413.813652328, "t1": 718421.400263057, "ta": 718421.400263057, "te": 718421.641468298, "first_response_s": 7.586610728991218, "answer_total_s": 7.82781597005669, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 84, "content_group": "f7aa8300f311969d717063457b8852dbb100039789a44972176bd8c0201b3358", "question": {"question_id": "sample_84_a814_q0", "video_id": 84, "video_path": "./videos/sample_84_real.mp4", "annotation_index": 814, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 0.", "B. 2.", "C. 3.", "D. 4."], "answer": "A", "time_stamp_s": 18, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_84_a814_q0", "video_id": 84, "time_stamp_s": 18, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bd060cf8ae53d040e010785722219b839892673c734fec177a7e79e70692361e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "9f2c1cbfebd4803a6745c9352e5cdb4dd0315f4bc212ac49c40769934e308505", "num_recent_frames": 18, "tq": 710142.082215684, "t1": 710150.860437992, "ta": 710150.860437992, "te": 710150.89758305, "first_response_s": 8.77822230802849, "answer_total_s": 8.815367365954444, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_84_a814_q0", "video_id": 84, "time_stamp_s": 18, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e087972dec00ec4ee50a3a170d534fdaac54927276d47ee5d4302e046d2a2cea", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "9f2c1cbfebd4803a6745c9352e5cdb4dd0315f4bc212ac49c40769934e308505", "num_recent_frames": 18, "tq": 710018.721416409, "t1": 710019.571515042, "ta": 710019.571515042, "te": 710019.612949543, "first_response_s": 0.8500986329745501, "answer_total_s": 0.8915331340394914, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 84, "content_group": "f7aa8300f311969d717063457b8852dbb100039789a44972176bd8c0201b3358", "question": {"question_id": "sample_84_a815_q0", "video_id": 84, "video_path": "./videos/sample_84_real.mp4", "annotation_index": 815, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 4.", "B. 5.", "C. 6.", "D. 0."], "answer": "A", "time_stamp_s": 187, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_84_a815_q0", "video_id": 84, "time_stamp_s": 187, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "440a88ba4afa2ff7ddc1c6e1ce94d6257041944e267343e6b503962530c09ed2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668], "recent_frames_sha256": "e48ea84a8992bd39487283f3ce2a7e21486e24cf6615084d0235a5852cea85ea", "num_recent_frames": 30, "tq": 710150.905591674, "t1": 710161.450587526, "ta": 710161.450587526, "te": 710161.482476107, "first_response_s": 10.544995851931162, "answer_total_s": 10.576884432928637, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_84_a815_q0", "video_id": 84, "time_stamp_s": 187, "ground_truth": "A", "raw_output": "A. 4.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "8fc95b384a16b08b44efd24f52fcd6e5b560df4c281d4947cecec7df101dcdfe", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a plaid shirt stands beside a whiteboard, gesturing toward its content, which lists film lesson topics on exposure and focus.  \n- The whiteboard displays text in various colors, including \"LESSON 4.3: EXPOSURE + FOCUS\" and subtopics like \"EXPOSURE: THE RANGE OF LIGHT\" and \"HOW TO ACHIEVE PERFECT EXPOSURE.\"  \n- A film clip titled \"Arrival (2014)\" appears, showing a woman in profile against a dim, outdoor setting, followed by a young man looking upward, both in a dark, atmospheric\n[30-60s] - A man in a plaid shirt gestures toward a whiteboard displaying \"LESSON 3.3: Exposure + Focus\" with bullet points about exposure techniques and film types.  \n- The whiteboard lists film types like \"Kodak Tri-X\" and \"Ilford HP5,\" along with terms like \"High ISO\" and \"Low ISO.\"  \n- The man stands in front of the whiteboard, using hand motions to emphasize points, with a dark background and hanging lights.\n[60-90s] - Man in plaid shirt gestures toward whiteboard with lesson notes on exposure and focus.  \n- Whiteboard displays text including \"EXPOSURE: The Balance of Light\" and \"FOCUS: The Balance of Sharpness.\"  \n- Background shows dark stage with hanging lights, suggesting a presentation or lecture setting.\n[90-120s] - A man in a plaid shirt gestures toward a whiteboard displaying \"LESSON 4.3: EXPOSURE + FOCUS\" with bullet points about exposure and focus techniques.\n- The video cuts to a scene from \"The Dark Knight (2008)\" showing the Joker applying makeup with a brush, his face partially obscured by white paint and red lipstick.\n- The man in the plaid shirt reappears, continuing to gesture and explain the whiteboard content while standing in front of the same whiteboard.\n[120-150s] - Man gestures toward whiteboard with lesson notes on exposure and focus.  \n- Whiteboard displays key terms like \"F-Stops,\" \"Aperture Size,\" and \"F1.4\" to \"F16.\"  \n- Animated graphic shows aperture size changes from F1.4 to F16 with a window view.\n[150-180s] - Man gestures toward whiteboard with both hands while speaking.  \n- Whiteboard displays \"LESSON 4.3: EXPOSURE + FOCUS\" and related photography terms.  \n- Background features dark setting with hanging light bulbs.", "history_tokens": 565, "history_utf8_bytes": 2185, "recent_frame_times_s": [157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668], "recent_frames_sha256": "e48ea84a8992bd39487283f3ce2a7e21486e24cf6615084d0235a5852cea85ea", "num_recent_frames": 30, "tq": 710057.457928996, "t1": 710064.477424292, "ta": 710064.477424292, "te": 710064.703391504, "first_response_s": 7.019495296059176, "answer_total_s": 7.245462508057244, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 84, "content_group": "f7aa8300f311969d717063457b8852dbb100039789a44972176bd8c0201b3358", "question": {"question_id": "sample_84_a816_q0", "video_id": 84, "video_path": "./videos/sample_84_real.mp4", "annotation_index": 816, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 5.", "B. 2.", "C. 3.", "D. 6."], "answer": "A", "time_stamp_s": 242, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_84_a816_q0", "video_id": 84, "time_stamp_s": 242, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8bfec6349985aa8360715a6e4353333b6fb0d6b04fab0dfc4ea6f360031f8276", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332], "recent_frames_sha256": "4f36c17f871cdfcb995bc7c632fcfb53d7d8d97383039f91c4bd6575f335b0ba", "num_recent_frames": 30, "tq": 710161.490969401, "t1": 710169.217550288, "ta": 710169.217550288, "te": 710169.254643513, "first_response_s": 7.726580886985175, "answer_total_s": 7.763674112036824, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_84_a816_q0", "video_id": 84, "time_stamp_s": 242, "ground_truth": "A", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "6f0776f61ff3fa354e149d42ebaa7b2604bc995cfaf453148ac8e972087f4e68", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a plaid shirt stands beside a whiteboard, gesturing toward its content, which lists film lesson topics on exposure and focus.  \n- The whiteboard displays text in various colors, including \"LESSON 4.3: EXPOSURE + FOCUS\" and subtopics like \"EXPOSURE: THE RANGE OF LIGHT\" and \"HOW TO ACHIEVE PERFECT EXPOSURE.\"  \n- A film clip titled \"Arrival (2014)\" appears, showing a woman in profile against a dim, outdoor setting, followed by a young man looking upward, both in a dark, atmospheric\n[30-60s] - A man in a plaid shirt gestures toward a whiteboard displaying \"LESSON 3.3: Exposure + Focus\" with bullet points about exposure techniques and film types.  \n- The whiteboard lists film types like \"Kodak Tri-X\" and \"Ilford HP5,\" along with terms like \"High ISO\" and \"Low ISO.\"  \n- The man stands in front of the whiteboard, using hand motions to emphasize points, with a dark background and hanging lights.\n[60-90s] - Man in plaid shirt gestures toward whiteboard with lesson notes on exposure and focus.  \n- Whiteboard displays text including \"EXPOSURE: The Balance of Light\" and \"FOCUS: The Balance of Sharpness.\"  \n- Background shows dark stage with hanging lights, suggesting a presentation or lecture setting.\n[90-120s] - A man in a plaid shirt gestures toward a whiteboard displaying \"LESSON 4.3: EXPOSURE + FOCUS\" with bullet points about exposure and focus techniques.\n- The video cuts to a scene from \"The Dark Knight (2008)\" showing the Joker applying makeup with a brush, his face partially obscured by white paint and red lipstick.\n- The man in the plaid shirt reappears, continuing to gesture and explain the whiteboard content while standing in front of the same whiteboard.\n[120-150s] - Man gestures toward whiteboard with lesson notes on exposure and focus.  \n- Whiteboard displays key terms like \"F-Stops,\" \"Aperture Size,\" and \"F1.4\" to \"F16.\"  \n- Animated graphic shows aperture size changes from F1.4 to F16 with a window view.\n[150-180s] - Man gestures toward whiteboard with both hands while speaking.  \n- Whiteboard displays \"LESSON 4.3: EXPOSURE + FOCUS\" and related photography terms.  \n- Background features dark setting with hanging light bulbs.\n[180-210s] - Man gestures toward whiteboard with lesson notes on exposure and focus.  \n- Whiteboard displays text about \"Exposure: The Balance of Light\" and \"Focus: The Balance of Sharpness.\"  \n- Man stands in front of whiteboard, hands open, as if explaining concepts.\n[210-240s] - A man in a plaid shirt gestures toward a whiteboard displaying \"LESSON 3: EXPOSURE + FOCUS\" with photography terms.  \n- The whiteboard lists exposure concepts like \"Exposure: The Amount of Light\" and \"How to Achieve Proper Exposure.\"  \n- A film clip of \"A Clockwork Orange (1971)\" shows a character in white clothing running through water, holding a stick.", "history_tokens": 732, "history_utf8_bytes": 2825, "recent_frame_times_s": [212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332], "recent_frames_sha256": "4f36c17f871cdfcb995bc7c632fcfb53d7d8d97383039f91c4bd6575f335b0ba", "num_recent_frames": 30, "tq": 710084.008409269, "t1": 710090.072431229, "ta": 710090.072431229, "te": 710090.256376756, "first_response_s": 6.064021960017271, "answer_total_s": 6.247967486968264, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 84, "content_group": "f7aa8300f311969d717063457b8852dbb100039789a44972176bd8c0201b3358", "question": {"question_id": "sample_84_a817_q0", "video_id": 84, "video_path": "./videos/sample_84_real.mp4", "annotation_index": 817, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 5.", "B. 2.", "C. 7.", "D. 6."], "answer": "A", "time_stamp_s": 301, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_84_a817_q0", "video_id": 84, "time_stamp_s": 301, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f7f93496d151b799e0f2c289476c8773be85ae752fdea8f276d8374d383bd718", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "00c6e0d63fc50cba4a8be472b5991e3c8a2b860ca4f8ee53d8a46f309ca66039", "num_recent_frames": 30, "tq": 710169.267212704, "t1": 710181.078727126, "ta": 710181.078727126, "te": 710181.115863814, "first_response_s": 11.811514421948232, "answer_total_s": 11.848651109961793, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_84_a817_q0", "video_id": 84, "time_stamp_s": 301, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a211a8cc31bb8b7e2c2ac77c845bcc060bc2d4d37467754fbc8bc152654d436c", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a plaid shirt stands beside a whiteboard, gesturing toward its content, which lists film lesson topics on exposure and focus.  \n- The whiteboard displays text in various colors, including \"LESSON 4.3: EXPOSURE + FOCUS\" and subtopics like \"EXPOSURE: THE RANGE OF LIGHT\" and \"HOW TO ACHIEVE PERFECT EXPOSURE.\"  \n- A film clip titled \"Arrival (2014)\" appears, showing a woman in profile against a dim, outdoor setting, followed by a young man looking upward, both in a dark, atmospheric\n[30-60s] - A man in a plaid shirt gestures toward a whiteboard displaying \"LESSON 3.3: Exposure + Focus\" with bullet points about exposure techniques and film types.  \n- The whiteboard lists film types like \"Kodak Tri-X\" and \"Ilford HP5,\" along with terms like \"High ISO\" and \"Low ISO.\"  \n- The man stands in front of the whiteboard, using hand motions to emphasize points, with a dark background and hanging lights.\n[60-90s] - Man in plaid shirt gestures toward whiteboard with lesson notes on exposure and focus.  \n- Whiteboard displays text including \"EXPOSURE: The Balance of Light\" and \"FOCUS: The Balance of Sharpness.\"  \n- Background shows dark stage with hanging lights, suggesting a presentation or lecture setting.\n[90-120s] - A man in a plaid shirt gestures toward a whiteboard displaying \"LESSON 4.3: EXPOSURE + FOCUS\" with bullet points about exposure and focus techniques.\n- The video cuts to a scene from \"The Dark Knight (2008)\" showing the Joker applying makeup with a brush, his face partially obscured by white paint and red lipstick.\n- The man in the plaid shirt reappears, continuing to gesture and explain the whiteboard content while standing in front of the same whiteboard.\n[120-150s] - Man gestures toward whiteboard with lesson notes on exposure and focus.  \n- Whiteboard displays key terms like \"F-Stops,\" \"Aperture Size,\" and \"F1.4\" to \"F16.\"  \n- Animated graphic shows aperture size changes from F1.4 to F16 with a window view.\n[150-180s] - Man gestures toward whiteboard with both hands while speaking.  \n- Whiteboard displays \"LESSON 4.3: EXPOSURE + FOCUS\" and related photography terms.  \n- Background features dark setting with hanging light bulbs.\n[180-210s] - Man gestures toward whiteboard with lesson notes on exposure and focus.  \n- Whiteboard displays text about \"Exposure: The Balance of Light\" and \"Focus: The Balance of Sharpness.\"  \n- Man stands in front of whiteboard, hands open, as if explaining concepts.\n[210-240s] - A man in a plaid shirt gestures toward a whiteboard displaying \"LESSON 3: EXPOSURE + FOCUS\" with photography terms.  \n- The whiteboard lists exposure concepts like \"Exposure: The Amount of Light\" and \"How to Achieve Proper Exposure.\"  \n- A film clip of \"A Clockwork Orange (1971)\" shows a character in white clothing running through water, holding a stick.\n[240-270s] - A man in a plaid shirt stands beside a whiteboard, gesturing toward its content.  \n- The whiteboard displays text about \"LESSON 3.3: EXPOSURE + FOCUS,\" including terms like \"EXPOSURE,\" \"FOCUS,\" and \"SHALLOW DEPTH OF FIELD.\"  \n- The man’s hands move expressively as he explains, with his body slightly angled toward the board.\n[270-300s] - Man in plaid shirt gestures toward whiteboard with both hands, pointing to \"EXPOSURE: THE RANKING OF LIGHT\" text.  \n- Whiteboard displays lesson title \"LESSON 3.3: EXPOSURE + FOCUS\" with bullet points about exposure and focus.  \n- Background features dark setting with hanging light bulbs and a wooden easel supporting the whiteboard.", "history_tokens": 918, "history_utf8_bytes": 3514, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "00c6e0d63fc50cba4a8be472b5991e3c8a2b860ca4f8ee53d8a46f309ca66039", "num_recent_frames": 30, "tq": 710105.759449664, "t1": 710117.079628138, "ta": 710117.079628138, "te": 710117.123380268, "first_response_s": 11.320178473950364, "answer_total_s": 11.363930603954941, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 84, "content_group": "f7aa8300f311969d717063457b8852dbb100039789a44972176bd8c0201b3358", "question": {"question_id": "sample_84_a817_q1", "video_id": 84, "video_path": "./videos/sample_84_real.mp4", "annotation_index": 817, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 7.", "B. 5.", "C. 8.", "D. 6."], "answer": "A", "time_stamp_s": 360, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_84_a817_q1", "video_id": 84, "time_stamp_s": 360, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "481cda010e45221e7abddcdfe6a538fa4d12c6f21d9662385c0d1a9e75dd4af5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [330.0297, 331.0307, 332.0317, 333.0327, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333], "recent_frames_sha256": "5c8ab27a405e6faae4061e1962866df0f2907446d37096627c6efc52f7e2a34a", "num_recent_frames": 30, "tq": 710181.125433958, "t1": 710194.019113721, "ta": 710194.019113721, "te": 710194.056734203, "first_response_s": 12.893679762957618, "answer_total_s": 12.931300244992599, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_84_a817_q1", "video_id": 84, "time_stamp_s": 360, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9b35f21cca93e3ae9e8db535f8ebf3d43e107f147149947c23cf431ca8f4f4ab", "condition_order": ["notes", "recent"], "memory": "[30-60s] - A man in a plaid shirt gestures toward a whiteboard displaying \"LESSON 3.3: Exposure + Focus\" with bullet points about exposure techniques and film types.  \n- The whiteboard lists film types like \"Kodak Tri-X\" and \"Ilford HP5,\" along with terms like \"High ISO\" and \"Low ISO.\"  \n- The man stands in front of the whiteboard, using hand motions to emphasize points, with a dark background and hanging lights.\n[60-90s] - Man in plaid shirt gestures toward whiteboard with lesson notes on exposure and focus.  \n- Whiteboard displays text including \"EXPOSURE: The Balance of Light\" and \"FOCUS: The Balance of Sharpness.\"  \n- Background shows dark stage with hanging lights, suggesting a presentation or lecture setting.\n[90-120s] - A man in a plaid shirt gestures toward a whiteboard displaying \"LESSON 4.3: EXPOSURE + FOCUS\" with bullet points about exposure and focus techniques.\n- The video cuts to a scene from \"The Dark Knight (2008)\" showing the Joker applying makeup with a brush, his face partially obscured by white paint and red lipstick.\n- The man in the plaid shirt reappears, continuing to gesture and explain the whiteboard content while standing in front of the same whiteboard.\n[120-150s] - Man gestures toward whiteboard with lesson notes on exposure and focus.  \n- Whiteboard displays key terms like \"F-Stops,\" \"Aperture Size,\" and \"F1.4\" to \"F16.\"  \n- Animated graphic shows aperture size changes from F1.4 to F16 with a window view.\n[150-180s] - Man gestures toward whiteboard with both hands while speaking.  \n- Whiteboard displays \"LESSON 4.3: EXPOSURE + FOCUS\" and related photography terms.  \n- Background features dark setting with hanging light bulbs.\n[180-210s] - Man gestures toward whiteboard with lesson notes on exposure and focus.  \n- Whiteboard displays text about \"Exposure: The Balance of Light\" and \"Focus: The Balance of Sharpness.\"  \n- Man stands in front of whiteboard, hands open, as if explaining concepts.\n[210-240s] - A man in a plaid shirt gestures toward a whiteboard displaying \"LESSON 3: EXPOSURE + FOCUS\" with photography terms.  \n- The whiteboard lists exposure concepts like \"Exposure: The Amount of Light\" and \"How to Achieve Proper Exposure.\"  \n- A film clip of \"A Clockwork Orange (1971)\" shows a character in white clothing running through water, holding a stick.\n[240-270s] - A man in a plaid shirt stands beside a whiteboard, gesturing toward its content.  \n- The whiteboard displays text about \"LESSON 3.3: EXPOSURE + FOCUS,\" including terms like \"EXPOSURE,\" \"FOCUS,\" and \"SHALLOW DEPTH OF FIELD.\"  \n- The man’s hands move expressively as he explains, with his body slightly angled toward the board.\n[270-300s] - Man in plaid shirt gestures toward whiteboard with both hands, pointing to \"EXPOSURE: THE RANKING OF LIGHT\" text.  \n- Whiteboard displays lesson title \"LESSON 3.3: EXPOSURE + FOCUS\" with bullet points about exposure and focus.  \n- Background features dark setting with hanging light bulbs and a wooden easel supporting the whiteboard.\n[300-330s] - A man in a plaid shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text about \"Exposure + Focus\" with bullet points and color-coded sections.  \n- The background features dimly lit hanging bulbs and a darkened stage setting.\n[330-360s] - A man in a suit walks briskly past a parked white van on a city street.  \n- A group of people in formal attire gathers near a modern glass building entrance.  \n- A woman in a light-colored dress exits a bus, holding a white handbag, as another person in a dark suit follows her.", "history_tokens": 928, "history_utf8_bytes": 3594, "recent_frame_times_s": [330.0297, 331.0307, 332.0317, 333.0327, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333], "recent_frames_sha256": "5c8ab27a405e6faae4061e1962866df0f2907446d37096627c6efc52f7e2a34a", "num_recent_frames": 30, "tq": 710135.764790696, "t1": 710142.017189018, "ta": 710142.017189018, "te": 710142.055238216, "first_response_s": 6.25239832198713, "answer_total_s": 6.290447519975714, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 86, "content_group": "f5670a2af314a193baf195645c45d2ef03cee641d125973262b2f0b5dea97593", "question": {"question_id": "sample_86_a2018_q0", "video_id": 86, "video_path": "./videos/sample_86_real.mp4", "annotation_index": 2018, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 18, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_86_a2018_q0", "video_id": 86, "time_stamp_s": 18, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "177bb2bcfab7614cd4c6545cd3f5fd4bebe00bd1f7e5e0e3dbb1b15d4a5b5c52", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "bd0d610c8a3963831617ea181d3497d33eeff7474d52da9414a6e6eeb7d94933", "num_recent_frames": 18, "tq": 717213.432839482, "t1": 717219.193325713, "ta": 717219.193325713, "te": 717219.380760166, "first_response_s": 5.7604862310690805, "answer_total_s": 5.9479206840042025, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_86_a2018_q0", "video_id": 86, "time_stamp_s": 18, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "64e263e029ca05c330a039eb40e2ce8630159d989bb1f453203973a584dc4914", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "bd0d610c8a3963831617ea181d3497d33eeff7474d52da9414a6e6eeb7d94933", "num_recent_frames": 18, "tq": 717270.525389877, "t1": 717278.321657743, "ta": 717278.321657743, "te": 717278.525938338, "first_response_s": 7.796267865924165, "answer_total_s": 8.000548460986465, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 86, "content_group": "f5670a2af314a193baf195645c45d2ef03cee641d125973262b2f0b5dea97593", "question": {"question_id": "sample_86_a2019_q0", "video_id": 86, "video_path": "./videos/sample_86_real.mp4", "annotation_index": 2019, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 5.", "C. 6.", "D. 0."], "answer": "A", "time_stamp_s": 222, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_86_a2019_q0", "video_id": 86, "time_stamp_s": 222, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8b721f71342c4a3d9c3c72f12f10f480f9ffb0d341adff8a2ebf46d19845f6c6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208], "recent_frames_sha256": "2137c557797ac839bd9a9b5d06894d17ded7d94c8dfe5d578d156df116bf3efc", "num_recent_frames": 30, "tq": 717219.407669708, "t1": 717232.381694242, "ta": 717232.381694242, "te": 717232.423085841, "first_response_s": 12.974024533992633, "answer_total_s": 13.015416132984683, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_86_a2019_q0", "video_id": 86, "time_stamp_s": 222, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5565ec0a4f148c9c4f2ccae1dfa73a24e7909aede9c2104ba97c468743f4ddac", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"LESSON 4: TYPES OF SOUND\" with categorized sound types in red, blue, and black text.  \n- The man occasionally points to different sections of the whiteboard as he explains the content.\n[30-60s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 4: Types of Sound,\" including categories like \"Sound Perception,\" \"On-Screen Sound,\" and \"Nondescript Sound.\"  \n- The background features stage lights, and the man occasionally points to different sections of the whiteboard.\n[60-90s] - A man in a grey shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 4: TYPES OF SOUND\" with various sound categories listed.  \n- The background features three hanging light bulbs above the man’s head.\n[90-120s] - A man in a gray suit stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 4: TYPES OF SOUND\" with various subheadings in colored markers.  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.\n[120-150s] - A man in a grey shirt gestures toward a whiteboard with \"LESSON 4: TYPES OF SOUND\" written in red, pointing to different sound categories like \"SOUND PRESENTATION\" and \"ON-SCREEN SOUND.\"\n- The man stands in front of a dark background with three hanging light bulbs, using hand movements to emphasize points on the whiteboard.\n- The whiteboard lists sound types with definitions, including \"SOUND PRESENTATION,\" \"ON-SCREEN SOUND,\" \"OFF-SCREEN SOUND,\" and \"NONTHEATRE SOUND,\" each with brief descriptions.\n[150-180s] - A man in a plaid suit gestures while speaking to a woman with curly blonde hair seated across from him at a restaurant table.  \n- The woman, wearing a black blazer and white scarf, listens attentively, occasionally nodding or reacting to the conversation.  \n- The scene transitions to a whiteboard with text, indicating a shift to an educational or instructional setting.\n[180-210s] - A man in a plaid jacket and dark shirt is seated at a restaurant table, looking toward a woman.  \n- A woman with short, styled hair, wearing a green top, is seated across from him, smiling and speaking.  \n- The background shows other diners at tables with white tablecloths, blurred in the scene.", "history_tokens": 607, "history_utf8_bytes": 2508, "recent_frame_times_s": [192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208], "recent_frames_sha256": "2137c557797ac839bd9a9b5d06894d17ded7d94c8dfe5d578d156df116bf3efc", "num_recent_frames": 30, "tq": 717341.078303319, "t1": 717342.904094589, "ta": 717342.904094589, "te": 717343.350649344, "first_response_s": 1.8257912698900327, "answer_total_s": 2.2723460249835625, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 86, "content_group": "f5670a2af314a193baf195645c45d2ef03cee641d125973262b2f0b5dea97593", "question": {"question_id": "sample_86_a2020_q0", "video_id": 86, "video_path": "./videos/sample_86_real.mp4", "annotation_index": 2020, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 4.", "C. 3.", "D. 6."], "answer": "C", "time_stamp_s": 242, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_86_a2020_q0", "video_id": 86, "time_stamp_s": 242, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "76a449a2429106f6d8fea03893c9ba8015d60350b7e78721b10d3f08b817a9fe", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332], "recent_frames_sha256": "d4f6af32f11fcff406086a50d50ad5798f20af19cfcc9014e3119b393b20053d", "num_recent_frames": 30, "tq": 717232.444049812, "t1": 717243.512540984, "ta": 717243.512540984, "te": 717243.551081207, "first_response_s": 11.068491171929054, "answer_total_s": 11.107031394960359, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_86_a2020_q0", "video_id": 86, "time_stamp_s": 242, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "77f934edd901edfba9fed6af1dea41664d1b5e78c3d875494308aaeb39da1b46", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"LESSON 4: TYPES OF SOUND\" with categorized sound types in red, blue, and black text.  \n- The man occasionally points to different sections of the whiteboard as he explains the content.\n[30-60s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 4: Types of Sound,\" including categories like \"Sound Perception,\" \"On-Screen Sound,\" and \"Nondescript Sound.\"  \n- The background features stage lights, and the man occasionally points to different sections of the whiteboard.\n[60-90s] - A man in a grey shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 4: TYPES OF SOUND\" with various sound categories listed.  \n- The background features three hanging light bulbs above the man’s head.\n[90-120s] - A man in a gray suit stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 4: TYPES OF SOUND\" with various subheadings in colored markers.  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.\n[120-150s] - A man in a grey shirt gestures toward a whiteboard with \"LESSON 4: TYPES OF SOUND\" written in red, pointing to different sound categories like \"SOUND PRESENTATION\" and \"ON-SCREEN SOUND.\"\n- The man stands in front of a dark background with three hanging light bulbs, using hand movements to emphasize points on the whiteboard.\n- The whiteboard lists sound types with definitions, including \"SOUND PRESENTATION,\" \"ON-SCREEN SOUND,\" \"OFF-SCREEN SOUND,\" and \"NONTHEATRE SOUND,\" each with brief descriptions.\n[150-180s] - A man in a plaid suit gestures while speaking to a woman with curly blonde hair seated across from him at a restaurant table.  \n- The woman, wearing a black blazer and white scarf, listens attentively, occasionally nodding or reacting to the conversation.  \n- The scene transitions to a whiteboard with text, indicating a shift to an educational or instructional setting.\n[180-210s] - A man in a plaid jacket and dark shirt is seated at a restaurant table, looking toward a woman.  \n- A woman with short, styled hair, wearing a green top, is seated across from him, smiling and speaking.  \n- The background shows other diners at tables with white tablecloths, blurred in the scene.\n[210-240s] - A man in a grey shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 4: TYPES OF SOUND\" with various bullet points about sound types.  \n- The man’s hands move expressively as he explains the content, indicating active teaching.", "history_tokens": 685, "history_utf8_bytes": 2827, "recent_frame_times_s": [212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332], "recent_frames_sha256": "d4f6af32f11fcff406086a50d50ad5798f20af19cfcc9014e3119b393b20053d", "num_recent_frames": 30, "tq": 717353.562846191, "t1": 717354.611577407, "ta": 717354.611577407, "te": 717354.907406571, "first_response_s": 1.0487312159966677, "answer_total_s": 1.344560379977338, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 86, "content_group": "f5670a2af314a193baf195645c45d2ef03cee641d125973262b2f0b5dea97593", "question": {"question_id": "sample_86_a2021_q0", "video_id": 86, "video_path": "./videos/sample_86_real.mp4", "annotation_index": 2021, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 5.", "C. 4.", "D. 6."], "answer": "C", "time_stamp_s": 301, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_86_a2021_q0", "video_id": 86, "time_stamp_s": 301, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "91a005a6d5eda0322c3069acb73aadb27cf3fcb16a7bac0ca48b4efc683efe99", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "6a01a667cd5a2cfaf3ae638a47905f0335adf805364f2cd38189a9aa88a8500f", "num_recent_frames": 30, "tq": 717243.561714406, "t1": 717255.358890924, "ta": 717255.358890924, "te": 717255.39610456, "first_response_s": 11.797176518011838, "answer_total_s": 11.83439015399199, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_86_a2021_q0", "video_id": 86, "time_stamp_s": 301, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "168f4c884fa06e3f9feb8e149436e387062d33968efd6c786687ddd9f89de1fe", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"LESSON 4: TYPES OF SOUND\" with categorized sound types in red, blue, and black text.  \n- The man occasionally points to different sections of the whiteboard as he explains the content.\n[30-60s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 4: Types of Sound,\" including categories like \"Sound Perception,\" \"On-Screen Sound,\" and \"Nondescript Sound.\"  \n- The background features stage lights, and the man occasionally points to different sections of the whiteboard.\n[60-90s] - A man in a grey shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 4: TYPES OF SOUND\" with various sound categories listed.  \n- The background features three hanging light bulbs above the man’s head.\n[90-120s] - A man in a gray suit stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 4: TYPES OF SOUND\" with various subheadings in colored markers.  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.\n[120-150s] - A man in a grey shirt gestures toward a whiteboard with \"LESSON 4: TYPES OF SOUND\" written in red, pointing to different sound categories like \"SOUND PRESENTATION\" and \"ON-SCREEN SOUND.\"\n- The man stands in front of a dark background with three hanging light bulbs, using hand movements to emphasize points on the whiteboard.\n- The whiteboard lists sound types with definitions, including \"SOUND PRESENTATION,\" \"ON-SCREEN SOUND,\" \"OFF-SCREEN SOUND,\" and \"NONTHEATRE SOUND,\" each with brief descriptions.\n[150-180s] - A man in a plaid suit gestures while speaking to a woman with curly blonde hair seated across from him at a restaurant table.  \n- The woman, wearing a black blazer and white scarf, listens attentively, occasionally nodding or reacting to the conversation.  \n- The scene transitions to a whiteboard with text, indicating a shift to an educational or instructional setting.\n[180-210s] - A man in a plaid jacket and dark shirt is seated at a restaurant table, looking toward a woman.  \n- A woman with short, styled hair, wearing a green top, is seated across from him, smiling and speaking.  \n- The background shows other diners at tables with white tablecloths, blurred in the scene.\n[210-240s] - A man in a grey shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 4: TYPES OF SOUND\" with various bullet points about sound types.  \n- The man’s hands move expressively as he explains the content, indicating active teaching.\n[240-270s] - A man in a gray shirt gestures toward a whiteboard displaying \"LESSON 4: TYPES OF SOUND\" with handwritten notes.  \n- The whiteboard lists sound types like \"SOUND PRESENTATION,\" \"ON-SCREEN SOUNDS,\" and \"MIND-BENDING SOUND\" with colored text.  \n- The man stands in a dimly lit room with hanging lights, facing the camera while explaining the content.\n[270-300s] - A man in a dark shirt gestures with both hands while standing in front of a whiteboard.  \n- The whiteboard displays \"LESSON 4: TYPES OF SOUND\" with various sound categories listed in colored text.  \n- The man’s hands move expressively as he speaks, indicating he is explaining the content on the board.", "history_tokens": 858, "history_utf8_bytes": 3507, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "6a01a667cd5a2cfaf3ae638a47905f0335adf805364f2cd38189a9aa88a8500f", "num_recent_frames": 30, "tq": 717372.83595172, "t1": 717378.745998193, "ta": 717378.745998193, "te": 717378.783352599, "first_response_s": 5.91004647302907, "answer_total_s": 5.947400878998451, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 86, "content_group": "f5670a2af314a193baf195645c45d2ef03cee641d125973262b2f0b5dea97593", "question": {"question_id": "sample_86_a2022_q0", "video_id": 86, "video_path": "./videos/sample_86_real.mp4", "annotation_index": 2022, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 4.", "B. 8.", "C. 6.", "D. 5."], "answer": "D", "time_stamp_s": 379, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_86_a2022_q0", "video_id": 86, "time_stamp_s": 379, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fffaf17436672a181d1927828e3db7ea4c78b88131fdfbea8c5ef27e5c69b769", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666], "recent_frames_sha256": "1878195c539198433c79edc301dbabeff0b4fe971f1c062f0840b076749bc007", "num_recent_frames": 30, "tq": 717255.408230405, "t1": 717270.477955794, "ta": 717270.477955794, "te": 717270.515374649, "first_response_s": 15.069725389010273, "answer_total_s": 15.107144244015217, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_86_a2022_q0", "video_id": 86, "time_stamp_s": 379, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "273baaaf9c625aff383929196395e25854a739bffd7e49521bf79dab46449e29", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"LESSON 4: TYPES OF SOUND\" with categorized sound types in red, blue, and black text.  \n- The man occasionally points to different sections of the whiteboard as he explains the content.\n[30-60s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 4: Types of Sound,\" including categories like \"Sound Perception,\" \"On-Screen Sound,\" and \"Nondescript Sound.\"  \n- The background features stage lights, and the man occasionally points to different sections of the whiteboard.\n[60-90s] - A man in a grey shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 4: TYPES OF SOUND\" with various sound categories listed.  \n- The background features three hanging light bulbs above the man’s head.\n[90-120s] - A man in a gray suit stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 4: TYPES OF SOUND\" with various subheadings in colored markers.  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.\n[120-150s] - A man in a grey shirt gestures toward a whiteboard with \"LESSON 4: TYPES OF SOUND\" written in red, pointing to different sound categories like \"SOUND PRESENTATION\" and \"ON-SCREEN SOUND.\"\n- The man stands in front of a dark background with three hanging light bulbs, using hand movements to emphasize points on the whiteboard.\n- The whiteboard lists sound types with definitions, including \"SOUND PRESENTATION,\" \"ON-SCREEN SOUND,\" \"OFF-SCREEN SOUND,\" and \"NONTHEATRE SOUND,\" each with brief descriptions.\n[150-180s] - A man in a plaid suit gestures while speaking to a woman with curly blonde hair seated across from him at a restaurant table.  \n- The woman, wearing a black blazer and white scarf, listens attentively, occasionally nodding or reacting to the conversation.  \n- The scene transitions to a whiteboard with text, indicating a shift to an educational or instructional setting.\n[180-210s] - A man in a plaid jacket and dark shirt is seated at a restaurant table, looking toward a woman.  \n- A woman with short, styled hair, wearing a green top, is seated across from him, smiling and speaking.  \n- The background shows other diners at tables with white tablecloths, blurred in the scene.\n[210-240s] - A man in a grey shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 4: TYPES OF SOUND\" with various bullet points about sound types.  \n- The man’s hands move expressively as he explains the content, indicating active teaching.\n[240-270s] - A man in a gray shirt gestures toward a whiteboard displaying \"LESSON 4: TYPES OF SOUND\" with handwritten notes.  \n- The whiteboard lists sound types like \"SOUND PRESENTATION,\" \"ON-SCREEN SOUNDS,\" and \"MIND-BENDING SOUND\" with colored text.  \n- The man stands in a dimly lit room with hanging lights, facing the camera while explaining the content.\n[270-300s] - A man in a dark shirt gestures with both hands while standing in front of a whiteboard.  \n- The whiteboard displays \"LESSON 4: TYPES OF SOUND\" with various sound categories listed in colored text.  \n- The man’s hands move expressively as he speaks, indicating he is explaining the content on the board.\n[300-330s] - A man in a gray shirt gestures with both hands while standing in front of a whiteboard.  \n- The whiteboard displays \"LESSON 4: TYPES OF SOUND\" with various sound categories listed in colored text.  \n- The man’s hands move expressively as he speaks, indicating he is explaining the content on the board.\n[330-360s] - A man in a grey shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 4: TYPES OF SOUND\" with various sound categories listed in red and black text.  \n- The background features three hanging light fixtures above the man, illuminating the scene.", "history_tokens": 1014, "history_utf8_bytes": 4146, "recent_frame_times_s": [349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666], "recent_frames_sha256": "1878195c539198433c79edc301dbabeff0b4fe971f1c062f0840b076749bc007", "num_recent_frames": 30, "tq": 717395.577729965, "t1": 717402.743923882, "ta": 717402.743923882, "te": 717402.781608952, "first_response_s": 7.166193917044438, "answer_total_s": 7.203878986998461, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 87, "content_group": "9bf624f8562d9fc77a19994540c1661f51bf9416a790fce3477b510a7d72fd3f", "question": {"question_id": "sample_87_a96_q0", "video_id": 87, "video_path": "./videos/sample_87_real.mp4", "annotation_index": 96, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 16, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_87_a96_q0", "video_id": 87, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "109435a5c6ccd0737958277c53c3d51782164bed3b94132638755d925fca0bf1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "d00902d5e326c51443623e34d2f894453410a1294ff91642cee625d5a7f7e1bd", "num_recent_frames": 16, "tq": 715911.743263997, "t1": 715912.482594413, "ta": 715912.482594413, "te": 715912.519277332, "first_response_s": 0.7393304159631953, "answer_total_s": 0.7760133349802345, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_87_a96_q0", "video_id": 87, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d0f4cbf8c95d960c9337536019a799761bc30ce076f0b577abd9661e6f4afaf5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "d00902d5e326c51443623e34d2f894453410a1294ff91642cee625d5a7f7e1bd", "num_recent_frames": 16, "tq": 715953.180801049, "t1": 715954.376440917, "ta": 715954.376440917, "te": 715954.413194926, "first_response_s": 1.1956398680340499, "answer_total_s": 1.2323938769986853, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 87, "content_group": "9bf624f8562d9fc77a19994540c1661f51bf9416a790fce3477b510a7d72fd3f", "question": {"question_id": "sample_87_a97_q0", "video_id": 87, "video_path": "./videos/sample_87_real.mp4", "annotation_index": 97, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 4.", "B. 5.", "C. 6.", "D. 0."], "answer": "A", "time_stamp_s": 184, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_87_a97_q0", "video_id": 87, "time_stamp_s": 184, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "94f61e98690d5616713b7d3d07175378ec90b62a103ad075176871fc261ac6fb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666], "recent_frames_sha256": "3bba71ef04ef9160f6f500371817ca5e199f28addd4532c22fad09d9c5645883", "num_recent_frames": 30, "tq": 715912.535762953, "t1": 715923.331123032, "ta": 715923.331123032, "te": 715923.368685668, "first_response_s": 10.795360079035163, "answer_total_s": 10.83292271499522, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_87_a97_q0", "video_id": 87, "time_stamp_s": 184, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ddacb569c90d2db3f264ef0d89f98b2b0d96c1bfd2e1a67cd8cc8eb6400ebe5a", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a grey shirt stands in front of a whiteboard, gesturing while teaching about voice track in film production.\n- The whiteboard lists lesson objectives, including dialogue, narration, and recording techniques, with specific tasks like setting levels and choosing scenes.\n- Quick cuts show black-and-white film clips from \"2001: A Space Odyssey,\" \"Raging Bull,\" and \"Last Year at Marienbad,\" illustrating the topic's context.\n[30-60s] - Man in suit gestures with hands while standing in front of a whiteboard with lesson notes.  \n- Whiteboard displays lesson 4.2 titled \"Voice Track\" with bullet points on dialogue, narration, and recording.  \n- Man points to \"RECORDING\" section while speaking, indicating focus on voice track techniques.\n[60-90s] - A man in a hat and coat gestures toward a woman in a lace collar, appearing to speak to her.  \n- The woman looks at the man with a serious expression, her hand near her face.  \n- The scene is in black and white, with a blurred background suggesting an outdoor setting.\n[90-120s] - A man in a dark jacket stands in a sunlit field, looking intently forward with a serious expression.  \n- A group of people, including children, are seated in a wagon, traveling across a vast, open field under a cloudy sky.  \n- A steam train with smoke billowing from its engine moves across a golden field, with distant mountains visible under a dramatic sky.\n[120-150s] - A man in a brown coat is shown in a dimly lit, neon-lit environment, looking intently at a screen or device.  \n- The scene transitions to a man in a suit standing in front of a whiteboard, gesturing with his hands as he speaks.  \n- The whiteboard displays lesson notes for \"Voice Track\" with bullet points about dialogue, recording, and assignment details.\n[150-180s] - A man in a grey shirt gestures toward a whiteboard with lesson details on voice track and recording.  \n- A woman in a grey jacket demonstrates attaching a lavalier microphone to her clothing.  \n- Close-up shows hands handling a small black lavalier mic with a wire, preparing for use.", "history_tokens": 494, "history_utf8_bytes": 2075, "recent_frame_times_s": [154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666], "recent_frames_sha256": "3bba71ef04ef9160f6f500371817ca5e199f28addd4532c22fad09d9c5645883", "num_recent_frames": 30, "tq": 715999.76573246, "t1": 716001.858740793, "ta": 716001.858740793, "te": 716001.898709892, "first_response_s": 2.093008333002217, "answer_total_s": 2.132977431989275, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 87, "content_group": "9bf624f8562d9fc77a19994540c1661f51bf9416a790fce3477b510a7d72fd3f", "question": {"question_id": "sample_87_a98_q0", "video_id": 87, "video_path": "./videos/sample_87_real.mp4", "annotation_index": 98, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 4.", "C. 3.", "D. 6."], "answer": "B", "time_stamp_s": 251, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_87_a98_q0", "video_id": 87, "time_stamp_s": 251, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "229dcbc273e2c162bc02a6a1dce5be61ea14148dfd19040e31090094a3a1d5b7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334], "recent_frames_sha256": "111f457945ce46a070846ade07689d3219905ca8d9e00f8701b086cdf1d27177", "num_recent_frames": 30, "tq": 715923.386930806, "t1": 715930.639161457, "ta": 715930.639161457, "te": 715930.676759459, "first_response_s": 7.252230650978163, "answer_total_s": 7.289828652981669, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_87_a98_q0", "video_id": 87, "time_stamp_s": 251, "ground_truth": "B", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "fedca9cf3961f195cd6ae9f0a14181cd87ff573613fa279d3223fb5181f61195", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a grey shirt stands in front of a whiteboard, gesturing while teaching about voice track in film production.\n- The whiteboard lists lesson objectives, including dialogue, narration, and recording techniques, with specific tasks like setting levels and choosing scenes.\n- Quick cuts show black-and-white film clips from \"2001: A Space Odyssey,\" \"Raging Bull,\" and \"Last Year at Marienbad,\" illustrating the topic's context.\n[30-60s] - Man in suit gestures with hands while standing in front of a whiteboard with lesson notes.  \n- Whiteboard displays lesson 4.2 titled \"Voice Track\" with bullet points on dialogue, narration, and recording.  \n- Man points to \"RECORDING\" section while speaking, indicating focus on voice track techniques.\n[60-90s] - A man in a hat and coat gestures toward a woman in a lace collar, appearing to speak to her.  \n- The woman looks at the man with a serious expression, her hand near her face.  \n- The scene is in black and white, with a blurred background suggesting an outdoor setting.\n[90-120s] - A man in a dark jacket stands in a sunlit field, looking intently forward with a serious expression.  \n- A group of people, including children, are seated in a wagon, traveling across a vast, open field under a cloudy sky.  \n- A steam train with smoke billowing from its engine moves across a golden field, with distant mountains visible under a dramatic sky.\n[120-150s] - A man in a brown coat is shown in a dimly lit, neon-lit environment, looking intently at a screen or device.  \n- The scene transitions to a man in a suit standing in front of a whiteboard, gesturing with his hands as he speaks.  \n- The whiteboard displays lesson notes for \"Voice Track\" with bullet points about dialogue, recording, and assignment details.\n[150-180s] - A man in a grey shirt gestures toward a whiteboard with lesson details on voice track and recording.  \n- A woman in a grey jacket demonstrates attaching a lavalier microphone to her clothing.  \n- Close-up shows hands handling a small black lavalier mic with a wire, preparing for use.\n[180-210s] - Man gestures with hands while standing in front of a whiteboard displaying \"Lesson 4.2: Voice Track\" and related notes.  \n- Whiteboard contains bullet points about dialogue, narration, recording, and a specific assignment involving a scene from \"SUNSET BAND (1990).\"  \n- Man holds a marker and points to the whiteboard, indicating sections of the lesson content.\n[210-240s] - A man in a grey suit holds a microphone and gestures toward a whiteboard displaying \"Lesson 4.2: Voice Track\" with lesson objectives.  \n- The whiteboard lists tasks like \"Dialogue + Narration,\" \"Recording,\" and \"Set Levels,\" with a note about choosing a scene from \"SUNSET BAND (1990).\"  \n- The scene transitions to a man in a black cap and headphones holding a bat, followed by a TMZ logo and a man in a striped shirt sitting at a desk.", "history_tokens": 704, "history_utf8_bytes": 2902, "recent_frame_times_s": [221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334], "recent_frames_sha256": "111f457945ce46a070846ade07689d3219905ca8d9e00f8701b086cdf1d27177", "num_recent_frames": 30, "tq": 716018.409447178, "t1": 716020.209208873, "ta": 716020.209208873, "te": 716020.395699577, "first_response_s": 1.7997616949724033, "answer_total_s": 1.9862523990450427, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 87, "content_group": "9bf624f8562d9fc77a19994540c1661f51bf9416a790fce3477b510a7d72fd3f", "question": {"question_id": "sample_87_a99_q0", "video_id": 87, "video_path": "./videos/sample_87_real.mp4", "annotation_index": 99, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 5.", "C. 4.", "D. 6."], "answer": "C", "time_stamp_s": 301, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_87_a99_q0", "video_id": 87, "time_stamp_s": 301, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "23311bec79203d726c4df885f698b4c6aae5bbb9c141ab983f2e80b59851c62d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "70f70f5fb646eaec59b4e23e2a2e58b96113dd139b1e4211afaa9263c558d8e6", "num_recent_frames": 30, "tq": 715930.69925388, "t1": 715942.759714661, "ta": 715942.759714661, "te": 715942.797306233, "first_response_s": 12.06046078109648, "answer_total_s": 12.0980523530161, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_87_a99_q0", "video_id": 87, "time_stamp_s": 301, "ground_truth": "C", "raw_output": "C. 4.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "b1547c89c01ef402af8b87fd8570ac8fc2540b4b8259176a84a09fc40ec8198c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a grey shirt stands in front of a whiteboard, gesturing while teaching about voice track in film production.\n- The whiteboard lists lesson objectives, including dialogue, narration, and recording techniques, with specific tasks like setting levels and choosing scenes.\n- Quick cuts show black-and-white film clips from \"2001: A Space Odyssey,\" \"Raging Bull,\" and \"Last Year at Marienbad,\" illustrating the topic's context.\n[30-60s] - Man in suit gestures with hands while standing in front of a whiteboard with lesson notes.  \n- Whiteboard displays lesson 4.2 titled \"Voice Track\" with bullet points on dialogue, narration, and recording.  \n- Man points to \"RECORDING\" section while speaking, indicating focus on voice track techniques.\n[60-90s] - A man in a hat and coat gestures toward a woman in a lace collar, appearing to speak to her.  \n- The woman looks at the man with a serious expression, her hand near her face.  \n- The scene is in black and white, with a blurred background suggesting an outdoor setting.\n[90-120s] - A man in a dark jacket stands in a sunlit field, looking intently forward with a serious expression.  \n- A group of people, including children, are seated in a wagon, traveling across a vast, open field under a cloudy sky.  \n- A steam train with smoke billowing from its engine moves across a golden field, with distant mountains visible under a dramatic sky.\n[120-150s] - A man in a brown coat is shown in a dimly lit, neon-lit environment, looking intently at a screen or device.  \n- The scene transitions to a man in a suit standing in front of a whiteboard, gesturing with his hands as he speaks.  \n- The whiteboard displays lesson notes for \"Voice Track\" with bullet points about dialogue, recording, and assignment details.\n[150-180s] - A man in a grey shirt gestures toward a whiteboard with lesson details on voice track and recording.  \n- A woman in a grey jacket demonstrates attaching a lavalier microphone to her clothing.  \n- Close-up shows hands handling a small black lavalier mic with a wire, preparing for use.\n[180-210s] - Man gestures with hands while standing in front of a whiteboard displaying \"Lesson 4.2: Voice Track\" and related notes.  \n- Whiteboard contains bullet points about dialogue, narration, recording, and a specific assignment involving a scene from \"SUNSET BAND (1990).\"  \n- Man holds a marker and points to the whiteboard, indicating sections of the lesson content.\n[210-240s] - A man in a grey suit holds a microphone and gestures toward a whiteboard displaying \"Lesson 4.2: Voice Track\" with lesson objectives.  \n- The whiteboard lists tasks like \"Dialogue + Narration,\" \"Recording,\" and \"Set Levels,\" with a note about choosing a scene from \"SUNSET BAND (1990).\"  \n- The scene transitions to a man in a black cap and headphones holding a bat, followed by a TMZ logo and a man in a striped shirt sitting at a desk.\n[240-270s] - A man in a blue t-shirt with \"the rent\" logo is holding a microphone rig, wearing headphones, and looking toward the camera.  \n- A whiteboard behind him lists \"Lesson 4.2: Voice Track\" with bullet points about dialogue, recording, and assignment details.  \n- The man gestures with his hands while speaking, indicating he is explaining the lesson content.\n[270-300s] - A man in a gray sweater gestures with both hands while standing in front of a whiteboard.  \n- The whiteboard displays lesson plans for \"Voice Track\" with bullet points about dialogue, narration, and recording.  \n- The man occasionally points to specific sections on the whiteboard as he speaks.", "history_tokens": 863, "history_utf8_bytes": 3578, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "70f70f5fb646eaec59b4e23e2a2e58b96113dd139b1e4211afaa9263c558d8e6", "num_recent_frames": 30, "tq": 716037.154546011, "t1": 716043.961974015, "ta": 716043.961974015, "te": 716044.241724866, "first_response_s": 6.807428003987297, "answer_total_s": 7.0871788549702615, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 87, "content_group": "9bf624f8562d9fc77a19994540c1661f51bf9416a790fce3477b510a7d72fd3f", "question": {"question_id": "sample_87_a100_q0", "video_id": 87, "video_path": "./videos/sample_87_real.mp4", "annotation_index": 100, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 4.", "B. 8.", "C. 6.", "D. 5."], "answer": "D", "time_stamp_s": 379, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_87_a100_q0", "video_id": 87, "time_stamp_s": 379, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e72b502365765fd5c77151f6b1524ac4ec1bd0fa21e3c3deb97085f620e1a4d9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666], "recent_frames_sha256": "a2866d880daba8ddd01e207bd461a082840eb81a4397923280351aa8ce2a492b", "num_recent_frames": 30, "tq": 715942.810333923, "t1": 715953.1303115, "ta": 715953.1303115, "te": 715953.16821528, "first_response_s": 10.319977577077225, "answer_total_s": 10.35788135707844, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_87_a100_q0", "video_id": 87, "time_stamp_s": 379, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "75c1350b55a15581bcbd3049e46b0a027eaea3144fd8aaf3bf21e04f5e0a0097", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Man in suit gestures with hands while standing in front of a whiteboard with lesson notes.  \n- Whiteboard displays lesson 4.2 titled \"Voice Track\" with bullet points on dialogue, narration, and recording.  \n- Man points to \"RECORDING\" section while speaking, indicating focus on voice track techniques.\n[60-90s] - A man in a hat and coat gestures toward a woman in a lace collar, appearing to speak to her.  \n- The woman looks at the man with a serious expression, her hand near her face.  \n- The scene is in black and white, with a blurred background suggesting an outdoor setting.\n[90-120s] - A man in a dark jacket stands in a sunlit field, looking intently forward with a serious expression.  \n- A group of people, including children, are seated in a wagon, traveling across a vast, open field under a cloudy sky.  \n- A steam train with smoke billowing from its engine moves across a golden field, with distant mountains visible under a dramatic sky.\n[120-150s] - A man in a brown coat is shown in a dimly lit, neon-lit environment, looking intently at a screen or device.  \n- The scene transitions to a man in a suit standing in front of a whiteboard, gesturing with his hands as he speaks.  \n- The whiteboard displays lesson notes for \"Voice Track\" with bullet points about dialogue, recording, and assignment details.\n[150-180s] - A man in a grey shirt gestures toward a whiteboard with lesson details on voice track and recording.  \n- A woman in a grey jacket demonstrates attaching a lavalier microphone to her clothing.  \n- Close-up shows hands handling a small black lavalier mic with a wire, preparing for use.\n[180-210s] - Man gestures with hands while standing in front of a whiteboard displaying \"Lesson 4.2: Voice Track\" and related notes.  \n- Whiteboard contains bullet points about dialogue, narration, recording, and a specific assignment involving a scene from \"SUNSET BAND (1990).\"  \n- Man holds a marker and points to the whiteboard, indicating sections of the lesson content.\n[210-240s] - A man in a grey suit holds a microphone and gestures toward a whiteboard displaying \"Lesson 4.2: Voice Track\" with lesson objectives.  \n- The whiteboard lists tasks like \"Dialogue + Narration,\" \"Recording,\" and \"Set Levels,\" with a note about choosing a scene from \"SUNSET BAND (1990).\"  \n- The scene transitions to a man in a black cap and headphones holding a bat, followed by a TMZ logo and a man in a striped shirt sitting at a desk.\n[240-270s] - A man in a blue t-shirt with \"the rent\" logo is holding a microphone rig, wearing headphones, and looking toward the camera.  \n- A whiteboard behind him lists \"Lesson 4.2: Voice Track\" with bullet points about dialogue, recording, and assignment details.  \n- The man gestures with his hands while speaking, indicating he is explaining the lesson content.\n[270-300s] - A man in a gray sweater gestures with both hands while standing in front of a whiteboard.  \n- The whiteboard displays lesson plans for \"Voice Track\" with bullet points about dialogue, narration, and recording.  \n- The man occasionally points to specific sections on the whiteboard as he speaks.\n[300-330s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays lesson details, including \"Lesson 4.2: Voice Track\" and \"Assignment: Choose a scene from an existing film to record and edit.\"  \n- The man occasionally points to specific sections on the whiteboard, emphasizing key points.\n[330-360s] - A man in a black shirt is seated at a table, engaged in conversation with another person whose back is to the camera.  \n- A large camera rig is positioned to the left, capturing the scene, with crew members visible nearby.  \n- The setting appears to be a dimly lit, smoky room with blue and purple stage lighting, suggesting a film or TV production environment.", "history_tokens": 938, "history_utf8_bytes": 3871, "recent_frame_times_s": [349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666], "recent_frames_sha256": "a2866d880daba8ddd01e207bd461a082840eb81a4397923280351aa8ce2a492b", "num_recent_frames": 30, "tq": 716064.046278265, "t1": 716071.212883655, "ta": 716071.212883655, "te": 716071.251951165, "first_response_s": 7.166605390026234, "answer_total_s": 7.205672900076024, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 88, "content_group": "833213c73ad12b091dc5ed84f72666a23c0c64279ea53a2b8113bb003dc8587e", "question": {"question_id": "sample_88_a870_q0", "video_id": 88, "video_path": "./videos/sample_88_real.mp4", "annotation_index": 870, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 16, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_88_a870_q0", "video_id": 88, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "92893001d2bd4c8e5d2967a4df45da0773292d879454e093f282480a042f490c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "2d74f474cbbcfd3a9ecbd150a5c96a669cebfb24b421e55464ed5f0cde2ac933", "num_recent_frames": 16, "tq": 718313.68323852, "t1": 718314.777912527, "ta": 718314.777912527, "te": 718314.817485175, "first_response_s": 1.0946740069193766, "answer_total_s": 1.1342466549249366, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_88_a870_q0", "video_id": 88, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "50d3e8967dc9b032bb82e3feeadde02922a7e2449f34c0145f09eea2c9a58044", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "2d74f474cbbcfd3a9ecbd150a5c96a669cebfb24b421e55464ed5f0cde2ac933", "num_recent_frames": 16, "tq": 718171.992943604, "t1": 718185.151312913, "ta": 718185.151312913, "te": 718185.190327211, "first_response_s": 13.158369309036061, "answer_total_s": 13.197383607039228, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 88, "content_group": "833213c73ad12b091dc5ed84f72666a23c0c64279ea53a2b8113bb003dc8587e", "question": {"question_id": "sample_88_a871_q0", "video_id": 88, "video_path": "./videos/sample_88_real.mp4", "annotation_index": 871, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 4.", "B. 5.", "C. 6.", "D. 0."], "answer": "A", "time_stamp_s": 188, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_88_a871_q0", "video_id": 88, "time_stamp_s": 188, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1a29c009605e9854a30ebee0f69da7bba7b07e5bbeadba51ecfb3a8915ca4ceb", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665], "recent_frames_sha256": "25c893313ef6ad0ce35d5346b2c39ac885d831936db244a08ed49ec48da07880", "num_recent_frames": 30, "tq": 718314.841041331, "t1": 718326.750269897, "ta": 718326.750269897, "te": 718326.791026949, "first_response_s": 11.909228566102684, "answer_total_s": 11.949985618004575, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_88_a871_q0", "video_id": 88, "time_stamp_s": 188, "ground_truth": "A", "raw_output": "A. 4.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "0bf2dea8b066d5c1aa23a5548ae1681f4ab6e52a9116faecb9b0f3bdb03bc3fb", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a blue shirt stands beside a whiteboard titled \"LESSON 4.3: SOUND EFFECTS,\" gesturing with his hands while speaking.  \n- The whiteboard lists key points about sound effects in film, including their use to enhance realism, create atmosphere, and convey emotion.  \n- Text at the bottom of the screen identifies the man as \"Mr. Marklevitz Film Teacher.\"\n[30-60s] - Man in plaid suit and tie sips from a glass while seated at a table.  \n- Woman with curly blonde hair sits beside him, looking down at her hands.  \n- Both are in a restaurant setting with other patrons and tables visible in the background.\n[60-90s] - A woman with short brown hair and a green top is seated, looking at a man across a table in a restaurant setting.  \n- The man, wearing a gray blazer over a black shirt, is seated opposite her, facing her with a slight smile.  \n- In the background, other diners are visible, including a woman with long blonde hair and glasses adjusting her glasses.\n[90-120s] - A man in a light blue shirt and striped tie gestures with both hands while speaking, standing to the right of a whiteboard.  \n- The whiteboard displays \"LESSON 4.3: SOUND EFFECTS\" with bullet points about sound effects in film, including \"Informational,\" \"Emotional,\" and \"Action.\"  \n- The man occasionally points to the whiteboard with his right hand while maintaining eye contact with the camera.\n[120-150s] - Three children in a car, with one boy in the front seat holding a green object, looking forward.  \n- Two clear plastic cups filled with water are visible on the car's dashboard.  \n- The scene is dimly lit, suggesting nighttime or low-light conditions.\n[150-180s] - A man in a blue shirt gestures toward a whiteboard titled \"LESSON 4.3: SOUND EFFECTS\" while standing in front of it.  \n- The whiteboard lists sound effects used in film, including \"SFX,\" \"SFX,\" \"SFX,\" and \"SFX,\" with examples like \"Distant thunder\" and \"Creature roar.\"  \n- The man points to the whiteboard as he speaks, emphasizing the role of sound effects in creating atmosphere and enhancing scenes.", "history_tokens": 512, "history_utf8_bytes": 2073, "recent_frame_times_s": [158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665], "recent_frames_sha256": "25c893313ef6ad0ce35d5346b2c39ac885d831936db244a08ed49ec48da07880", "num_recent_frames": 30, "tq": 718231.589086382, "t1": 718238.863989258, "ta": 718238.863989258, "te": 718239.057082017, "first_response_s": 7.274902876000851, "answer_total_s": 7.467995635000989, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 88, "content_group": "833213c73ad12b091dc5ed84f72666a23c0c64279ea53a2b8113bb003dc8587e", "question": {"question_id": "sample_88_a872_q0", "video_id": 88, "video_path": "./videos/sample_88_real.mp4", "annotation_index": 872, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 4.", "C. 3.", "D. 6."], "answer": "B", "time_stamp_s": 251, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_88_a872_q0", "video_id": 88, "time_stamp_s": 251, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9c613903b3c20ca8fce5a602d1be7b49787fcedaf3b1012436b6af64b2b9e398", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334], "recent_frames_sha256": "14bd6997e328e661c768c0bc71da56e897046cd70e8a0a8f07f296af6c55d657", "num_recent_frames": 30, "tq": 718326.810843336, "t1": 718334.707208479, "ta": 718334.707208479, "te": 718334.746334539, "first_response_s": 7.8963651430094615, "answer_total_s": 7.935491202981211, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_88_a872_q0", "video_id": 88, "time_stamp_s": 251, "ground_truth": "B", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "ef800a9623f7c26ac12848e2e256dc4d19c744bd2d0085747ce96b9103a934cd", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a blue shirt stands beside a whiteboard titled \"LESSON 4.3: SOUND EFFECTS,\" gesturing with his hands while speaking.  \n- The whiteboard lists key points about sound effects in film, including their use to enhance realism, create atmosphere, and convey emotion.  \n- Text at the bottom of the screen identifies the man as \"Mr. Marklevitz Film Teacher.\"\n[30-60s] - Man in plaid suit and tie sips from a glass while seated at a table.  \n- Woman with curly blonde hair sits beside him, looking down at her hands.  \n- Both are in a restaurant setting with other patrons and tables visible in the background.\n[60-90s] - A woman with short brown hair and a green top is seated, looking at a man across a table in a restaurant setting.  \n- The man, wearing a gray blazer over a black shirt, is seated opposite her, facing her with a slight smile.  \n- In the background, other diners are visible, including a woman with long blonde hair and glasses adjusting her glasses.\n[90-120s] - A man in a light blue shirt and striped tie gestures with both hands while speaking, standing to the right of a whiteboard.  \n- The whiteboard displays \"LESSON 4.3: SOUND EFFECTS\" with bullet points about sound effects in film, including \"Informational,\" \"Emotional,\" and \"Action.\"  \n- The man occasionally points to the whiteboard with his right hand while maintaining eye contact with the camera.\n[120-150s] - Three children in a car, with one boy in the front seat holding a green object, looking forward.  \n- Two clear plastic cups filled with water are visible on the car's dashboard.  \n- The scene is dimly lit, suggesting nighttime or low-light conditions.\n[150-180s] - A man in a blue shirt gestures toward a whiteboard titled \"LESSON 4.3: SOUND EFFECTS\" while standing in front of it.  \n- The whiteboard lists sound effects used in film, including \"SFX,\" \"SFX,\" \"SFX,\" and \"SFX,\" with examples like \"Distant thunder\" and \"Creature roar.\"  \n- The man points to the whiteboard as he speaks, emphasizing the role of sound effects in creating atmosphere and enhancing scenes.\n[180-210s] - A man in a blue shirt gestures toward a whiteboard titled \"LESSON 4: SOUND EFFECTS\" while standing in front of it.  \n- The whiteboard lists key points about sound effects, including their use in films and examples like \"SFX\" and \"Foley.\"  \n- The man uses hand motions to emphasize the content on the board, indicating an instructional setting.\n[210-240s] - A man in a light blue shirt and tie stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 4.3: SOUND EFFECTS\" with bullet points about sound effects, including \"Informational,\" \"Emotional,\" and \"Creative.\"  \n- The man’s hands move expressively as he explains, occasionally pointing to the whiteboard content.", "history_tokens": 694, "history_utf8_bytes": 2806, "recent_frame_times_s": [221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334], "recent_frames_sha256": "14bd6997e328e661c768c0bc71da56e897046cd70e8a0a8f07f296af6c55d657", "num_recent_frames": 30, "tq": 718256.820431594, "t1": 718264.409278805, "ta": 718264.409278805, "te": 718264.675837087, "first_response_s": 7.5888472109800205, "answer_total_s": 7.855405492940918, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 88, "content_group": "833213c73ad12b091dc5ed84f72666a23c0c64279ea53a2b8113bb003dc8587e", "question": {"question_id": "sample_88_a873_q0", "video_id": 88, "video_path": "./videos/sample_88_real.mp4", "annotation_index": 873, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 5.", "C. 4.", "D. 6."], "answer": "B", "time_stamp_s": 301, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_88_a873_q0", "video_id": 88, "time_stamp_s": 301, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fe06f71a7ca439ef6945e8dc034acba8e57dddcf4cffc0cd363fe7bf5d14ce43", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "8334f0b95953a359d40d1ca9a5ea3915b7f4ba360df49efbda4cb0ee9965210e", "num_recent_frames": 30, "tq": 718334.769431722, "t1": 718343.09864222, "ta": 718343.09864222, "te": 718343.136703656, "first_response_s": 8.329210498020984, "answer_total_s": 8.36727193405386, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_88_a873_q0", "video_id": 88, "time_stamp_s": 301, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e82c6f373e0ca29506f5d3db725fd16752eccc64609fe6f7d6e45949ba0f103c", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a blue shirt stands beside a whiteboard titled \"LESSON 4.3: SOUND EFFECTS,\" gesturing with his hands while speaking.  \n- The whiteboard lists key points about sound effects in film, including their use to enhance realism, create atmosphere, and convey emotion.  \n- Text at the bottom of the screen identifies the man as \"Mr. Marklevitz Film Teacher.\"\n[30-60s] - Man in plaid suit and tie sips from a glass while seated at a table.  \n- Woman with curly blonde hair sits beside him, looking down at her hands.  \n- Both are in a restaurant setting with other patrons and tables visible in the background.\n[60-90s] - A woman with short brown hair and a green top is seated, looking at a man across a table in a restaurant setting.  \n- The man, wearing a gray blazer over a black shirt, is seated opposite her, facing her with a slight smile.  \n- In the background, other diners are visible, including a woman with long blonde hair and glasses adjusting her glasses.\n[90-120s] - A man in a light blue shirt and striped tie gestures with both hands while speaking, standing to the right of a whiteboard.  \n- The whiteboard displays \"LESSON 4.3: SOUND EFFECTS\" with bullet points about sound effects in film, including \"Informational,\" \"Emotional,\" and \"Action.\"  \n- The man occasionally points to the whiteboard with his right hand while maintaining eye contact with the camera.\n[120-150s] - Three children in a car, with one boy in the front seat holding a green object, looking forward.  \n- Two clear plastic cups filled with water are visible on the car's dashboard.  \n- The scene is dimly lit, suggesting nighttime or low-light conditions.\n[150-180s] - A man in a blue shirt gestures toward a whiteboard titled \"LESSON 4.3: SOUND EFFECTS\" while standing in front of it.  \n- The whiteboard lists sound effects used in film, including \"SFX,\" \"SFX,\" \"SFX,\" and \"SFX,\" with examples like \"Distant thunder\" and \"Creature roar.\"  \n- The man points to the whiteboard as he speaks, emphasizing the role of sound effects in creating atmosphere and enhancing scenes.\n[180-210s] - A man in a blue shirt gestures toward a whiteboard titled \"LESSON 4: SOUND EFFECTS\" while standing in front of it.  \n- The whiteboard lists key points about sound effects, including their use in films and examples like \"SFX\" and \"Foley.\"  \n- The man uses hand motions to emphasize the content on the board, indicating an instructional setting.\n[210-240s] - A man in a light blue shirt and tie stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 4.3: SOUND EFFECTS\" with bullet points about sound effects, including \"Informational,\" \"Emotional,\" and \"Creative.\"  \n- The man’s hands move expressively as he explains, occasionally pointing to the whiteboard content.\n[240-270s] - A man in a light-colored shirt stands near a brick wall at night, looking down and then to the side.  \n- The scene transitions to a street view at night, showing parked cars and distant streetlights.  \n- A person walks away from the camera down the street, carrying a bag.\n[270-300s] - A man in a light-colored shirt stands near a doorway at night, looking upward with a somber expression.  \n- The scene transitions to a classroom setting where a man in a blue shirt stands in front of a whiteboard titled \"LESSON 4: SOUND EFFECTS.\"  \n- The whiteboard lists objectives such as \"Create Personality\" and \"Use Sound Effects to Enhance Storytelling,\" with text in red, blue, and green markers.", "history_tokens": 868, "history_utf8_bytes": 3509, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "8334f0b95953a359d40d1ca9a5ea3915b7f4ba360df49efbda4cb0ee9965210e", "num_recent_frames": 30, "tq": 718277.684579402, "t1": 718285.059532794, "ta": 718285.059532794, "te": 718285.359480755, "first_response_s": 7.374953392078169, "answer_total_s": 7.674901353078894, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 88, "content_group": "833213c73ad12b091dc5ed84f72666a23c0c64279ea53a2b8113bb003dc8587e", "question": {"question_id": "sample_88_a874_q0", "video_id": 88, "video_path": "./videos/sample_88_real.mp4", "annotation_index": 874, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 4.", "B. 8.", "C. 6.", "D. 7."], "answer": "D", "time_stamp_s": 379, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_88_a874_q0", "video_id": 88, "time_stamp_s": 379, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "cd87fc1725129433961a7f5015e074d0fc971fd4fd7b5b2f9e23486cb544a2ac", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666], "recent_frames_sha256": "c5628bc2086b9f4a884a614d7cabb7fecc200d337e9fcd32e8e23eb6fc04f677", "num_recent_frames": 30, "tq": 718343.148085028, "t1": 718358.056504987, "ta": 718358.056504987, "te": 718358.094018253, "first_response_s": 14.908419958897866, "answer_total_s": 14.945933224982582, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_88_a874_q0", "video_id": 88, "time_stamp_s": 379, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6b04622b639a272a6012aaf4671a095006fbc78ed601f823869620295a18da52", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Man in plaid suit and tie sips from a glass while seated at a table.  \n- Woman with curly blonde hair sits beside him, looking down at her hands.  \n- Both are in a restaurant setting with other patrons and tables visible in the background.\n[60-90s] - A woman with short brown hair and a green top is seated, looking at a man across a table in a restaurant setting.  \n- The man, wearing a gray blazer over a black shirt, is seated opposite her, facing her with a slight smile.  \n- In the background, other diners are visible, including a woman with long blonde hair and glasses adjusting her glasses.\n[90-120s] - A man in a light blue shirt and striped tie gestures with both hands while speaking, standing to the right of a whiteboard.  \n- The whiteboard displays \"LESSON 4.3: SOUND EFFECTS\" with bullet points about sound effects in film, including \"Informational,\" \"Emotional,\" and \"Action.\"  \n- The man occasionally points to the whiteboard with his right hand while maintaining eye contact with the camera.\n[120-150s] - Three children in a car, with one boy in the front seat holding a green object, looking forward.  \n- Two clear plastic cups filled with water are visible on the car's dashboard.  \n- The scene is dimly lit, suggesting nighttime or low-light conditions.\n[150-180s] - A man in a blue shirt gestures toward a whiteboard titled \"LESSON 4.3: SOUND EFFECTS\" while standing in front of it.  \n- The whiteboard lists sound effects used in film, including \"SFX,\" \"SFX,\" \"SFX,\" and \"SFX,\" with examples like \"Distant thunder\" and \"Creature roar.\"  \n- The man points to the whiteboard as he speaks, emphasizing the role of sound effects in creating atmosphere and enhancing scenes.\n[180-210s] - A man in a blue shirt gestures toward a whiteboard titled \"LESSON 4: SOUND EFFECTS\" while standing in front of it.  \n- The whiteboard lists key points about sound effects, including their use in films and examples like \"SFX\" and \"Foley.\"  \n- The man uses hand motions to emphasize the content on the board, indicating an instructional setting.\n[210-240s] - A man in a light blue shirt and tie stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 4.3: SOUND EFFECTS\" with bullet points about sound effects, including \"Informational,\" \"Emotional,\" and \"Creative.\"  \n- The man’s hands move expressively as he explains, occasionally pointing to the whiteboard content.\n[240-270s] - A man in a light-colored shirt stands near a brick wall at night, looking down and then to the side.  \n- The scene transitions to a street view at night, showing parked cars and distant streetlights.  \n- A person walks away from the camera down the street, carrying a bag.\n[270-300s] - A man in a light-colored shirt stands near a doorway at night, looking upward with a somber expression.  \n- The scene transitions to a classroom setting where a man in a blue shirt stands in front of a whiteboard titled \"LESSON 4: SOUND EFFECTS.\"  \n- The whiteboard lists objectives such as \"Create Personality\" and \"Use Sound Effects to Enhance Storytelling,\" with text in red, blue, and green markers.\n[300-330s] - A man in a light blue shirt and tie gestures toward a whiteboard titled \"LESSON 4.3: SOUND EFFECTS\" while speaking.  \n- The whiteboard lists sound effects used in film, including \"Informational Sounds,\" \"Ambience,\" and \"Cinematic Sound.\"  \n- The man points to the whiteboard with his right hand, emphasizing the content as he explains.\n[330-360s] - A man in a suit stands in a dimly lit room, holding a small object, with a checkered floor and furniture visible.  \n- The scene transitions to a black-and-white alleyway where a person walks away from the camera, passing brick buildings and a staircase.  \n- The video cuts to a dark interior space with a man standing in the doorway, facing the camera, as the room’s lighting dims further.", "history_tokens": 965, "history_utf8_bytes": 3893, "recent_frame_times_s": [349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666], "recent_frames_sha256": "c5628bc2086b9f4a884a614d7cabb7fecc200d337e9fcd32e8e23eb6fc04f677", "num_recent_frames": 30, "tq": 718305.824744685, "t1": 718313.461055767, "ta": 718313.461055767, "te": 718313.654761956, "first_response_s": 7.636311082052998, "answer_total_s": 7.830017270985991, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 89, "content_group": "a2d6bd157bb956e443071d820750e7958506aa82f49b9640ade6605aa7409b53", "question": {"question_id": "sample_89_a137_q0", "video_id": 89, "video_path": "./videos/sample_89_real.mp4", "annotation_index": 137, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 16, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_89_a137_q0", "video_id": 89, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "eb53ed5304b74a826d860c6426b5e65d924c5c42c9a55953ce0c7d5cc8884da6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "e61cc198cd139de449a5e8355ec80d61c5e1c621b60aeb5311e5b5022c8ebe8a", "num_recent_frames": 16, "tq": 718371.336314603, "t1": 718382.792363958, "ta": 718382.792363958, "te": 718382.841169749, "first_response_s": 11.456049354979768, "answer_total_s": 11.504855146049522, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_89_a137_q0", "video_id": 89, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "13be72044339f1f9cf1a89b4e7f328c2e21949fbcbf5972864d98ed2b3c1db6c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "e61cc198cd139de449a5e8355ec80d61c5e1c621b60aeb5311e5b5022c8ebe8a", "num_recent_frames": 16, "tq": 718232.48383182, "t1": 718238.863989258, "ta": 718238.863989258, "te": 718239.057082017, "first_response_s": 6.38015743799042, "answer_total_s": 6.573250196990557, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 89, "content_group": "a2d6bd157bb956e443071d820750e7958506aa82f49b9640ade6605aa7409b53", "question": {"question_id": "sample_89_a138_q0", "video_id": 89, "video_path": "./videos/sample_89_real.mp4", "annotation_index": 138, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 5.", "C. 6.", "D. 0."], "answer": "A", "time_stamp_s": 214, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_89_a138_q0", "video_id": 89, "time_stamp_s": 214, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b3953cb1fb16be19fcf2d7569e138eb13eb1dde58f9588a06d88798ca7766bc7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128], "recent_frames_sha256": "a4a10a2399db440ddfd94dac599d3a946de638967a9159f061ceeb795ea3b741", "num_recent_frames": 30, "tq": 718382.864920098, "t1": 718390.500461205, "ta": 718390.500461205, "te": 718390.538110778, "first_response_s": 7.635541107039899, "answer_total_s": 7.673190679983236, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_89_a138_q0", "video_id": 89, "time_stamp_s": 214, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4fb1ec698d4b75a3c5d3c95b040dcb5fb6f4ae415f482615a59d8554b6c5ef4d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard titled \"LESSON 144 MUSIC\" with handwritten notes on film scoring techniques.  \n- He gestures with both hands toward the whiteboard, which includes sections on \"SOUND\" and \"SCORE\" with specific film examples.  \n- The whiteboard is mounted on an easel, and the man appears to be explaining the content, with text at the bottom identifying him as \"Mr. Markelvitz Film Teacher.\"\n[30-60s] - A man in a dark suit and white shirt stands beside a whiteboard, gesturing toward it while speaking.  \n- The whiteboard displays text titled \"LESSON 144 MUSIC\" with bullet points about music theory, including \"SOFT,\" \"VIOLENT,\" and \"SCORING.\"  \n- The man’s hands move to emphasize points on the board, indicating he is explaining the content.\n[60-90s] - A man in a brown shirt is seen browsing through a display of colorful shoes in a store, with his hand reaching toward a pair of red shoes.  \n- The camera focuses on the man's face as he looks at the shoes, showing a close-up of his facial expression.  \n- The scene transitions to a man in a dark shirt speaking directly to the camera, with a dark curtain background.\n[90-120s] - A man in a light blue shirt stands beside a whiteboard, gesturing toward written lesson content on music theory.  \n- The whiteboard displays \"LESSON 14 MUSIC\" and details about \"How Does Music Affect Emotions?\" with bullet points on scales, chords, and emotional responses.  \n- The scene transitions to a dimly lit recording studio where a man in a leather jacket plays piano while another man in a cap sits nearby, with text overlay identifying the song as \"This is Spinal Tap (1984).\"\n[120-150s] - Man in leather jacket plays piano with focused hands, occasionally glancing at companion.  \n- Companion in cap and jeans sits beside piano, observing and resting hand on keys.  \n- Scene transitions to man in light shirt holding whiteboard with lesson notes, gesturing to text.\n[150-180s] - A man in a light-colored shirt and tie gestures while standing beside a whiteboard with lesson notes.  \n- A young boy with blond hair smiles outdoors, partially obscured by tree branches.  \n- A close-up shows a boy in a uniform with a swastika armband, carrying a satchel over his shoulder.\n[180-210s] - A man in a light-colored shirt and tie stands in front of a whiteboard titled \"LESSON 144 MUSIC,\" gesturing with his hands while speaking.  \n- The whiteboard lists musical terms and instructions, including \"How Does Music Affect Emotions?\" and \"VIOLENT (EMOTIONAL) EMOTIONS.\"  \n- The man smiles and appears to be teaching, with a classroom setting implied by the whiteboard and audience in the background.", "history_tokens": 660, "history_utf8_bytes": 2685, "recent_frame_times_s": [184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128], "recent_frames_sha256": "a4a10a2399db440ddfd94dac599d3a946de638967a9159f061ceeb795ea3b741", "num_recent_frames": 30, "tq": 718292.48269558, "t1": 718298.793441624, "ta": 718298.793441624, "te": 718298.945733494, "first_response_s": 6.310746044036932, "answer_total_s": 6.463037914014421, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 89, "content_group": "a2d6bd157bb956e443071d820750e7958506aa82f49b9640ade6605aa7409b53", "question": {"question_id": "sample_89_a139_q0", "video_id": 89, "video_path": "./videos/sample_89_real.mp4", "annotation_index": 139, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 4.", "C. 3.", "D. 6."], "answer": "B", "time_stamp_s": 261, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_89_a139_q0", "video_id": 89, "time_stamp_s": 261, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b1fc20a2264c70b7a850a969c49267028681f5b1d47adf26bbe2146a5be7c8d8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333], "recent_frames_sha256": "76f26c340b14d0079b2f057efa43381d2b4d2b1a743481c0ca558e2207453c55", "num_recent_frames": 30, "tq": 718390.552733005, "t1": 718402.269641055, "ta": 718402.269641055, "te": 718402.590154953, "first_response_s": 11.71690805000253, "answer_total_s": 12.037421947927214, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_89_a139_q0", "video_id": 89, "time_stamp_s": 261, "ground_truth": "B", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "6884e04e9176d583e70679f6ad1aa2d9fdd6adae2300e887326b238e10f6b4e3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard titled \"LESSON 144 MUSIC\" with handwritten notes on film scoring techniques.  \n- He gestures with both hands toward the whiteboard, which includes sections on \"SOUND\" and \"SCORE\" with specific film examples.  \n- The whiteboard is mounted on an easel, and the man appears to be explaining the content, with text at the bottom identifying him as \"Mr. Markelvitz Film Teacher.\"\n[30-60s] - A man in a dark suit and white shirt stands beside a whiteboard, gesturing toward it while speaking.  \n- The whiteboard displays text titled \"LESSON 144 MUSIC\" with bullet points about music theory, including \"SOFT,\" \"VIOLENT,\" and \"SCORING.\"  \n- The man’s hands move to emphasize points on the board, indicating he is explaining the content.\n[60-90s] - A man in a brown shirt is seen browsing through a display of colorful shoes in a store, with his hand reaching toward a pair of red shoes.  \n- The camera focuses on the man's face as he looks at the shoes, showing a close-up of his facial expression.  \n- The scene transitions to a man in a dark shirt speaking directly to the camera, with a dark curtain background.\n[90-120s] - A man in a light blue shirt stands beside a whiteboard, gesturing toward written lesson content on music theory.  \n- The whiteboard displays \"LESSON 14 MUSIC\" and details about \"How Does Music Affect Emotions?\" with bullet points on scales, chords, and emotional responses.  \n- The scene transitions to a dimly lit recording studio where a man in a leather jacket plays piano while another man in a cap sits nearby, with text overlay identifying the song as \"This is Spinal Tap (1984).\"\n[120-150s] - Man in leather jacket plays piano with focused hands, occasionally glancing at companion.  \n- Companion in cap and jeans sits beside piano, observing and resting hand on keys.  \n- Scene transitions to man in light shirt holding whiteboard with lesson notes, gesturing to text.\n[150-180s] - A man in a light-colored shirt and tie gestures while standing beside a whiteboard with lesson notes.  \n- A young boy with blond hair smiles outdoors, partially obscured by tree branches.  \n- A close-up shows a boy in a uniform with a swastika armband, carrying a satchel over his shoulder.\n[180-210s] - A man in a light-colored shirt and tie stands in front of a whiteboard titled \"LESSON 144 MUSIC,\" gesturing with his hands while speaking.  \n- The whiteboard lists musical terms and instructions, including \"How Does Music Affect Emotions?\" and \"VIOLENT (EMOTIONAL) EMOTIONS.\"  \n- The man smiles and appears to be teaching, with a classroom setting implied by the whiteboard and audience in the background.\n[210-240s] - A man in a light blue shirt gestures toward a whiteboard displaying \"LESSON 144 MUSIC\" and related musical theory notes.  \n- The man smiles and appears to be explaining the content on the board, which includes terms like \"VOLUNTEER,\" \"SCORE,\" and \"FILL.\"  \n- The scene transitions to a dimly lit pool hall with people playing pool, including a man in a beige jacket and another in a dark jacket, with a \"Mean Streets (1973)\" title overlay.", "history_tokens": 779, "history_utf8_bytes": 3138, "recent_frame_times_s": [231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333], "recent_frames_sha256": "76f26c340b14d0079b2f057efa43381d2b4d2b1a743481c0ca558e2207453c55", "num_recent_frames": 30, "tq": 718305.863938314, "t1": 718313.461055767, "ta": 718313.461055767, "te": 718313.654761956, "first_response_s": 7.597117452998646, "answer_total_s": 7.790823641931638, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 89, "content_group": "a2d6bd157bb956e443071d820750e7958506aa82f49b9640ade6605aa7409b53", "question": {"question_id": "sample_89_a140_q0", "video_id": 89, "video_path": "./videos/sample_89_real.mp4", "annotation_index": 140, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 5.", "C. 4.", "D. 6."], "answer": "B", "time_stamp_s": 319, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_89_a140_q0", "video_id": 89, "time_stamp_s": 319, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0fe0ae518708a35691e42ae87bf4063578bb08069f999551dcf9a193ae74f3b2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177], "recent_frames_sha256": "e10b2115be78a0f6757a12934c5c4132d9b54d2776d1556a731740b658eb9a57", "num_recent_frames": 30, "tq": 718402.603043486, "t1": 718414.465833676, "ta": 718414.465833676, "te": 718414.505505494, "first_response_s": 11.862790190032683, "answer_total_s": 11.90246200794354, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_89_a140_q0", "video_id": 89, "time_stamp_s": 319, "ground_truth": "B", "raw_output": "C. 4.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "fb74b929cf8726681ee1df94ad890b378a907a1e458b3431dd042aba5bdbe097", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard titled \"LESSON 144 MUSIC\" with handwritten notes on film scoring techniques.  \n- He gestures with both hands toward the whiteboard, which includes sections on \"SOUND\" and \"SCORE\" with specific film examples.  \n- The whiteboard is mounted on an easel, and the man appears to be explaining the content, with text at the bottom identifying him as \"Mr. Markelvitz Film Teacher.\"\n[30-60s] - A man in a dark suit and white shirt stands beside a whiteboard, gesturing toward it while speaking.  \n- The whiteboard displays text titled \"LESSON 144 MUSIC\" with bullet points about music theory, including \"SOFT,\" \"VIOLENT,\" and \"SCORING.\"  \n- The man’s hands move to emphasize points on the board, indicating he is explaining the content.\n[60-90s] - A man in a brown shirt is seen browsing through a display of colorful shoes in a store, with his hand reaching toward a pair of red shoes.  \n- The camera focuses on the man's face as he looks at the shoes, showing a close-up of his facial expression.  \n- The scene transitions to a man in a dark shirt speaking directly to the camera, with a dark curtain background.\n[90-120s] - A man in a light blue shirt stands beside a whiteboard, gesturing toward written lesson content on music theory.  \n- The whiteboard displays \"LESSON 14 MUSIC\" and details about \"How Does Music Affect Emotions?\" with bullet points on scales, chords, and emotional responses.  \n- The scene transitions to a dimly lit recording studio where a man in a leather jacket plays piano while another man in a cap sits nearby, with text overlay identifying the song as \"This is Spinal Tap (1984).\"\n[120-150s] - Man in leather jacket plays piano with focused hands, occasionally glancing at companion.  \n- Companion in cap and jeans sits beside piano, observing and resting hand on keys.  \n- Scene transitions to man in light shirt holding whiteboard with lesson notes, gesturing to text.\n[150-180s] - A man in a light-colored shirt and tie gestures while standing beside a whiteboard with lesson notes.  \n- A young boy with blond hair smiles outdoors, partially obscured by tree branches.  \n- A close-up shows a boy in a uniform with a swastika armband, carrying a satchel over his shoulder.\n[180-210s] - A man in a light-colored shirt and tie stands in front of a whiteboard titled \"LESSON 144 MUSIC,\" gesturing with his hands while speaking.  \n- The whiteboard lists musical terms and instructions, including \"How Does Music Affect Emotions?\" and \"VIOLENT (EMOTIONAL) EMOTIONS.\"  \n- The man smiles and appears to be teaching, with a classroom setting implied by the whiteboard and audience in the background.\n[210-240s] - A man in a light blue shirt gestures toward a whiteboard displaying \"LESSON 144 MUSIC\" and related musical theory notes.  \n- The man smiles and appears to be explaining the content on the board, which includes terms like \"VOLUNTEER,\" \"SCORE,\" and \"FILL.\"  \n- The scene transitions to a dimly lit pool hall with people playing pool, including a man in a beige jacket and another in a dark jacket, with a \"Mean Streets (1973)\" title overlay.\n[240-270s] - A man in a blue shirt is seen grappling with another man in a brown jacket, both engaged in a physical altercation near a pool table.  \n- The scene transitions to a classroom setting where a man in a white shirt stands beside a whiteboard titled \"LESSON 4 MUSIC,\" gesturing toward the content.  \n- The whiteboard displays text about \"How Does Music Affect Memory?\" with bullet points and highlighted sections, indicating an educational context.\n[270-300s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 4: MUSIC\" with bullet points about music theory.  \n- The background is dark, with a faint glow illuminating the man and the whiteboard.", "history_tokens": 958, "history_utf8_bytes": 3895, "recent_frame_times_s": [289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177], "recent_frames_sha256": "e10b2115be78a0f6757a12934c5c4132d9b54d2776d1556a731740b658eb9a57", "num_recent_frames": 30, "tq": 718333.834714318, "t1": 718342.227724995, "ta": 718342.227724995, "te": 718342.419156274, "first_response_s": 8.393010676954873, "answer_total_s": 8.58444195589982, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 89, "content_group": "a2d6bd157bb956e443071d820750e7958506aa82f49b9640ade6605aa7409b53", "question": {"question_id": "sample_89_a141_q0", "video_id": 89, "video_path": "./videos/sample_89_real.mp4", "annotation_index": 141, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 4.", "B. 8.", "C. 6.", "D. 7."], "answer": "C", "time_stamp_s": 379, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_89_a141_q0", "video_id": 89, "time_stamp_s": 379, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2ea4d47ecce15506939b839151093d49570db9e2b810f2bfb30693a4f243d5db", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666], "recent_frames_sha256": "8d5f3b2199d69137eacbc1f089475fdd269cda259a8aabfb627a83d9bcd269b9", "num_recent_frames": 30, "tq": 718414.515474415, "t1": 718422.37148366, "ta": 718422.37148366, "te": 718422.40969982, "first_response_s": 7.856009244918823, "answer_total_s": 7.894225404947065, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_89_a141_q0", "video_id": 89, "time_stamp_s": 379, "ground_truth": "C", "raw_output": "A. 4.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "08c2478c10fa5dbef2ab1d5397578cac4cc626dc9bb895dbf020710001d6906b", "condition_order": ["notes", "recent"], "memory": "[30-60s] - A man in a dark suit and white shirt stands beside a whiteboard, gesturing toward it while speaking.  \n- The whiteboard displays text titled \"LESSON 144 MUSIC\" with bullet points about music theory, including \"SOFT,\" \"VIOLENT,\" and \"SCORING.\"  \n- The man’s hands move to emphasize points on the board, indicating he is explaining the content.\n[60-90s] - A man in a brown shirt is seen browsing through a display of colorful shoes in a store, with his hand reaching toward a pair of red shoes.  \n- The camera focuses on the man's face as he looks at the shoes, showing a close-up of his facial expression.  \n- The scene transitions to a man in a dark shirt speaking directly to the camera, with a dark curtain background.\n[90-120s] - A man in a light blue shirt stands beside a whiteboard, gesturing toward written lesson content on music theory.  \n- The whiteboard displays \"LESSON 14 MUSIC\" and details about \"How Does Music Affect Emotions?\" with bullet points on scales, chords, and emotional responses.  \n- The scene transitions to a dimly lit recording studio where a man in a leather jacket plays piano while another man in a cap sits nearby, with text overlay identifying the song as \"This is Spinal Tap (1984).\"\n[120-150s] - Man in leather jacket plays piano with focused hands, occasionally glancing at companion.  \n- Companion in cap and jeans sits beside piano, observing and resting hand on keys.  \n- Scene transitions to man in light shirt holding whiteboard with lesson notes, gesturing to text.\n[150-180s] - A man in a light-colored shirt and tie gestures while standing beside a whiteboard with lesson notes.  \n- A young boy with blond hair smiles outdoors, partially obscured by tree branches.  \n- A close-up shows a boy in a uniform with a swastika armband, carrying a satchel over his shoulder.\n[180-210s] - A man in a light-colored shirt and tie stands in front of a whiteboard titled \"LESSON 144 MUSIC,\" gesturing with his hands while speaking.  \n- The whiteboard lists musical terms and instructions, including \"How Does Music Affect Emotions?\" and \"VIOLENT (EMOTIONAL) EMOTIONS.\"  \n- The man smiles and appears to be teaching, with a classroom setting implied by the whiteboard and audience in the background.\n[210-240s] - A man in a light blue shirt gestures toward a whiteboard displaying \"LESSON 144 MUSIC\" and related musical theory notes.  \n- The man smiles and appears to be explaining the content on the board, which includes terms like \"VOLUNTEER,\" \"SCORE,\" and \"FILL.\"  \n- The scene transitions to a dimly lit pool hall with people playing pool, including a man in a beige jacket and another in a dark jacket, with a \"Mean Streets (1973)\" title overlay.\n[240-270s] - A man in a blue shirt is seen grappling with another man in a brown jacket, both engaged in a physical altercation near a pool table.  \n- The scene transitions to a classroom setting where a man in a white shirt stands beside a whiteboard titled \"LESSON 4 MUSIC,\" gesturing toward the content.  \n- The whiteboard displays text about \"How Does Music Affect Memory?\" with bullet points and highlighted sections, indicating an educational context.\n[270-300s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 4: MUSIC\" with bullet points about music theory.  \n- The background is dark, with a faint glow illuminating the man and the whiteboard.\n[300-330s] - Two individuals, one in orange shirt and another in blue shirt, are running away from a large dinosaur in a grassy field.  \n- The dinosaur's massive leg and body dominate the frame, towering over the humans.  \n- A red truck is parked nearby, with one person standing beside it as the other runs toward the dinosaur.\n[330-360s] - A man with a white beard and glasses holds a glass vial containing a preserved insect, looking intently at it.  \n- The vial is positioned near the man’s face, with the insect visible inside the amber-colored liquid.  \n- Other passengers, including a woman and a man, are seated nearby, looking out the window or toward the man, suggesting a shared moment in a vehicle.", "history_tokens": 1020, "history_utf8_bytes": 4168, "recent_frame_times_s": [349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666], "recent_frames_sha256": "8d5f3b2199d69137eacbc1f089475fdd269cda259a8aabfb627a83d9bcd269b9", "num_recent_frames": 30, "tq": 718363.887094711, "t1": 718370.98923859, "ta": 718370.98923859, "te": 718371.325567544, "first_response_s": 7.102143879048526, "answer_total_s": 7.43847283301875, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 90, "content_group": "337f25840fa93dcb34005372c909453d67abce902c3301014b661bbcb2ad3ba3", "question": {"question_id": "sample_90_a1031_q0", "video_id": 90, "video_path": "./videos/sample_90_real.mp4", "annotation_index": 1031, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 16, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_90_a1031_q0", "video_id": 90, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3850151de76e8278585fcac13ff411b2a5efbd4d46df7bcedfd57a05bc7d3599", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "aa0755c5376e532113a32c0fba97d6476b615a7022c7614de35e877ccdb029d3", "num_recent_frames": 16, "tq": 716274.430939384, "t1": 716282.480212286, "ta": 716282.480212286, "te": 716282.518962215, "first_response_s": 8.049272901960649, "answer_total_s": 8.088022831012495, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_90_a1031_q0", "video_id": 90, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "53420f08f4cc08c6b1176a2ece976404c9a9abec94328b003ae0ba8b44092002", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "aa0755c5376e532113a32c0fba97d6476b615a7022c7614de35e877ccdb029d3", "num_recent_frames": 16, "tq": 716321.174126676, "t1": 716327.050103108, "ta": 716327.050103108, "te": 716327.087847047, "first_response_s": 5.875976431998424, "answer_total_s": 5.913720370968804, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 90, "content_group": "337f25840fa93dcb34005372c909453d67abce902c3301014b661bbcb2ad3ba3", "question": {"question_id": "sample_90_a1032_q0", "video_id": 90, "video_path": "./videos/sample_90_real.mp4", "annotation_index": 1032, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 5.", "C. 6.", "D. 0."], "answer": "B", "time_stamp_s": 224, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_90_a1032_q0", "video_id": 90, "time_stamp_s": 224, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c627f859a5673b73c10cd55a5f02ff6522a080f75c1dabc09755f28efb370184", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228], "recent_frames_sha256": "26f10cffc646d15ccc2cc8ad47e4a993c5bd63bc0a0d90d776ce5f72d004d17f", "num_recent_frames": 30, "tq": 716282.544127632, "t1": 716289.539297829, "ta": 716289.539297829, "te": 716289.576695907, "first_response_s": 6.995170196983963, "answer_total_s": 7.032568274997175, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_90_a1032_q0", "video_id": 90, "time_stamp_s": 224, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7b8f9699a938ea9aec6aec5ce7aa004086c7518fdf60b0c39d5e874841b3d923", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for \"Lesson 4.5: Sound Design & Editing,\" including topics like \"Sound Editing,\" \"Recording & Editing,\" and \"Lab Assignment: No Lab.\"  \n- The man's hands move expressively as he explains the content, occasionally pointing to different sections of the whiteboard.\n[30-60s] - A man in a blue shirt stands beside a whiteboard, gesturing with open hands while presenting lesson details.  \n- The whiteboard lists topics like \"Sound Editing,\" \"Sound Design,\" and \"Audio Levels,\" with a note indicating \"No Lab\" and \"Viewing: Free Choice.\"  \n- A scene from \"Spider-Man: Far From Home (2019)\" shows two characters walking on a bridge at night, with ornate architecture and streetlights in the background.\n[60-90s] - A man in a gray shirt gestures toward a whiteboard listing \"Lesson 5: Sound Design & Editing\" with bullet points about sound editing, balancing, and lab assignments.  \n- A scene from \"Spider-Man: Far From Home (2019)\" shows a character in a dark suit standing on a street at night, with smoke and blue lighting effects.  \n- The same man continues speaking, gesturing with his hands while standing beside the whiteboard, which includes text like \"LAB ASSIGNMENT: NO LAB\" and \"VIEWING: FREE CHOICE.\"\n[90-120s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays lesson details for \"Sound Mixing & Editing,\" including topics like sound editing, recording, and balancing.  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.\n[120-150s] - A golden retriever in a pink cape and crown stands on hay, facing forward with a calm expression.  \n- Two small ponies, one with a purple halter and the other with a red halter, are positioned near a wooden fence, looking toward the camera.  \n- The scene transitions between the dog and ponies, with the dog appearing in various shots, sometimes standing alone and sometimes near the hay pile.\n[150-180s] - A man in a grey shirt gestures toward a whiteboard displaying \"Lesson 11: Sound Design & Editing\" with bullet points about sound editing, mixing, and lab assignments.  \n- The whiteboard lists \"Sound Editing: Recording & Editing\" and \"Sound Mixing: Mastering & Balancing\" with \"Lab Assignment: No Lab\" and \"Viewing: Dune (2021)\" at the bottom.  \n- The scene transitions to a desert setting from \"Dune (2021)\" showing characters in rugged attire, some seated and others standing, with rocky terrain in the background.\n[180-210s] - A man in a brown cloak is engaged in a physical altercation with another individual, wielding a blade.  \n- A woman in dark attire stands nearby, observing the fight with a serious expression.  \n- The setting is a rugged, arid landscape with rocky formations in the background.", "history_tokens": 703, "history_utf8_bytes": 2925, "recent_frame_times_s": [194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228], "recent_frames_sha256": "26f10cffc646d15ccc2cc8ad47e4a993c5bd63bc0a0d90d776ce5f72d004d17f", "num_recent_frames": 30, "tq": 716380.950352013, "t1": 716382.222837489, "ta": 716382.222837489, "te": 716382.260556569, "first_response_s": 1.272485475987196, "answer_total_s": 1.3102045559789985, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 90, "content_group": "337f25840fa93dcb34005372c909453d67abce902c3301014b661bbcb2ad3ba3", "question": {"question_id": "sample_90_a1033_q0", "video_id": 90, "video_path": "./videos/sample_90_real.mp4", "annotation_index": 1033, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 4.", "C. 3.", "D. 6."], "answer": "D", "time_stamp_s": 254, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_90_a1033_q0", "video_id": 90, "time_stamp_s": 254, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ce9ceaf7503a61b6eb371bd937ef88df43f6d391a975139f0b18d3ad5f7547ad", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332], "recent_frames_sha256": "79fb637ecaf564c2d8673f520be8d5fe376a4b1dafab48957b29a57d4f5ead32", "num_recent_frames": 30, "tq": 716289.592593306, "t1": 716302.302538897, "ta": 716302.302538897, "te": 716302.339993312, "first_response_s": 12.7099455910502, "answer_total_s": 12.747400006046519, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_90_a1033_q0", "video_id": 90, "time_stamp_s": 254, "ground_truth": "D", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "65ba7a55aa8f6d69ca010bfb4df2d167636f8b6bb2f3840340d814de1c981c82", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for \"Lesson 4.5: Sound Design & Editing,\" including topics like \"Sound Editing,\" \"Recording & Editing,\" and \"Lab Assignment: No Lab.\"  \n- The man's hands move expressively as he explains the content, occasionally pointing to different sections of the whiteboard.\n[30-60s] - A man in a blue shirt stands beside a whiteboard, gesturing with open hands while presenting lesson details.  \n- The whiteboard lists topics like \"Sound Editing,\" \"Sound Design,\" and \"Audio Levels,\" with a note indicating \"No Lab\" and \"Viewing: Free Choice.\"  \n- A scene from \"Spider-Man: Far From Home (2019)\" shows two characters walking on a bridge at night, with ornate architecture and streetlights in the background.\n[60-90s] - A man in a gray shirt gestures toward a whiteboard listing \"Lesson 5: Sound Design & Editing\" with bullet points about sound editing, balancing, and lab assignments.  \n- A scene from \"Spider-Man: Far From Home (2019)\" shows a character in a dark suit standing on a street at night, with smoke and blue lighting effects.  \n- The same man continues speaking, gesturing with his hands while standing beside the whiteboard, which includes text like \"LAB ASSIGNMENT: NO LAB\" and \"VIEWING: FREE CHOICE.\"\n[90-120s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays lesson details for \"Sound Mixing & Editing,\" including topics like sound editing, recording, and balancing.  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.\n[120-150s] - A golden retriever in a pink cape and crown stands on hay, facing forward with a calm expression.  \n- Two small ponies, one with a purple halter and the other with a red halter, are positioned near a wooden fence, looking toward the camera.  \n- The scene transitions between the dog and ponies, with the dog appearing in various shots, sometimes standing alone and sometimes near the hay pile.\n[150-180s] - A man in a grey shirt gestures toward a whiteboard displaying \"Lesson 11: Sound Design & Editing\" with bullet points about sound editing, mixing, and lab assignments.  \n- The whiteboard lists \"Sound Editing: Recording & Editing\" and \"Sound Mixing: Mastering & Balancing\" with \"Lab Assignment: No Lab\" and \"Viewing: Dune (2021)\" at the bottom.  \n- The scene transitions to a desert setting from \"Dune (2021)\" showing characters in rugged attire, some seated and others standing, with rocky terrain in the background.\n[180-210s] - A man in a brown cloak is engaged in a physical altercation with another individual, wielding a blade.  \n- A woman in dark attire stands nearby, observing the fight with a serious expression.  \n- The setting is a rugged, arid landscape with rocky formations in the background.\n[210-240s] - A man in a grey shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays lesson details for \"Sound Mixing & Editing,\" including topics like \"Sound Editing,\" \"Sound Design,\" and \"Lab Assignment: No Lab.\"  \n- A scene from \"Dune (2021)\" is briefly shown, featuring a group of people in desert attire, with one person in the foreground looking down.", "history_tokens": 806, "history_utf8_bytes": 3336, "recent_frame_times_s": [224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332], "recent_frames_sha256": "79fb637ecaf564c2d8673f520be8d5fe376a4b1dafab48957b29a57d4f5ead32", "num_recent_frames": 30, "tq": 716393.71123649, "t1": 716394.427977422, "ta": 716394.427977422, "te": 716394.613918452, "first_response_s": 0.716740931966342, "answer_total_s": 0.9026819620048627, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 90, "content_group": "337f25840fa93dcb34005372c909453d67abce902c3301014b661bbcb2ad3ba3", "question": {"question_id": "sample_90_a1034_q0", "video_id": 90, "video_path": "./videos/sample_90_real.mp4", "annotation_index": 1034, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 8.", "C. 4.", "D. 6."], "answer": "B", "time_stamp_s": 327, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_90_a1034_q0", "video_id": 90, "time_stamp_s": 327, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "de3d0e21d2f41e7d02fb56bf84306fd17c3bd19a5588bc74067b78e93d643417", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257], "recent_frames_sha256": "4d915dfceed9ee9c10d07f26eba4b29ee5fd636e94416b9bea0d601ed6f9f026", "num_recent_frames": 30, "tq": 716302.357361437, "t1": 716313.671154489, "ta": 716313.671154489, "te": 716313.708688021, "first_response_s": 11.313793051987886, "answer_total_s": 11.351326584001072, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_90_a1034_q0", "video_id": 90, "time_stamp_s": 327, "ground_truth": "B", "raw_output": "C. 4.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "ea7edd164ef41e2d661fa2f7a193656d4e56c856f83191a1abd7aa51eab0c482", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for \"Lesson 4.5: Sound Design & Editing,\" including topics like \"Sound Editing,\" \"Recording & Editing,\" and \"Lab Assignment: No Lab.\"  \n- The man's hands move expressively as he explains the content, occasionally pointing to different sections of the whiteboard.\n[30-60s] - A man in a blue shirt stands beside a whiteboard, gesturing with open hands while presenting lesson details.  \n- The whiteboard lists topics like \"Sound Editing,\" \"Sound Design,\" and \"Audio Levels,\" with a note indicating \"No Lab\" and \"Viewing: Free Choice.\"  \n- A scene from \"Spider-Man: Far From Home (2019)\" shows two characters walking on a bridge at night, with ornate architecture and streetlights in the background.\n[60-90s] - A man in a gray shirt gestures toward a whiteboard listing \"Lesson 5: Sound Design & Editing\" with bullet points about sound editing, balancing, and lab assignments.  \n- A scene from \"Spider-Man: Far From Home (2019)\" shows a character in a dark suit standing on a street at night, with smoke and blue lighting effects.  \n- The same man continues speaking, gesturing with his hands while standing beside the whiteboard, which includes text like \"LAB ASSIGNMENT: NO LAB\" and \"VIEWING: FREE CHOICE.\"\n[90-120s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays lesson details for \"Sound Mixing & Editing,\" including topics like sound editing, recording, and balancing.  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.\n[120-150s] - A golden retriever in a pink cape and crown stands on hay, facing forward with a calm expression.  \n- Two small ponies, one with a purple halter and the other with a red halter, are positioned near a wooden fence, looking toward the camera.  \n- The scene transitions between the dog and ponies, with the dog appearing in various shots, sometimes standing alone and sometimes near the hay pile.\n[150-180s] - A man in a grey shirt gestures toward a whiteboard displaying \"Lesson 11: Sound Design & Editing\" with bullet points about sound editing, mixing, and lab assignments.  \n- The whiteboard lists \"Sound Editing: Recording & Editing\" and \"Sound Mixing: Mastering & Balancing\" with \"Lab Assignment: No Lab\" and \"Viewing: Dune (2021)\" at the bottom.  \n- The scene transitions to a desert setting from \"Dune (2021)\" showing characters in rugged attire, some seated and others standing, with rocky terrain in the background.\n[180-210s] - A man in a brown cloak is engaged in a physical altercation with another individual, wielding a blade.  \n- A woman in dark attire stands nearby, observing the fight with a serious expression.  \n- The setting is a rugged, arid landscape with rocky formations in the background.\n[210-240s] - A man in a grey shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays lesson details for \"Sound Mixing & Editing,\" including topics like \"Sound Editing,\" \"Sound Design,\" and \"Lab Assignment: No Lab.\"  \n- A scene from \"Dune (2021)\" is briefly shown, featuring a group of people in desert attire, with one person in the foreground looking down.\n[240-270s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text about \"Lesson 5: Sound Mixing & Editing,\" including topics like \"Sound Editing,\" \"Audio Levels,\" and \"Lab Assignment: No Lab.\"  \n- The background is dark, with the man and whiteboard as the central focus, suggesting an instructional or classroom setting.\n[270-300s] - A man in a light shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays lesson details: \"Sound Mixing & Editing,\" \"Sound Editing: Recording & Editing,\" and \"Lab Assignment: No Lab.\"  \n- The scene transitions to black-and-white clips from \"Malcolm & Marie (2021)\" showing a man sitting, a hand holding a knife, and a woman crouching in a room.", "history_tokens": 1007, "history_utf8_bytes": 4145, "recent_frame_times_s": [297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257], "recent_frames_sha256": "4d915dfceed9ee9c10d07f26eba4b29ee5fd636e94416b9bea0d601ed6f9f026", "num_recent_frames": 30, "tq": 716414.781104399, "t1": 716422.717396094, "ta": 716422.717396094, "te": 716422.918758096, "first_response_s": 7.936291694990359, "answer_total_s": 8.137653697049245, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 90, "content_group": "337f25840fa93dcb34005372c909453d67abce902c3301014b661bbcb2ad3ba3", "question": {"question_id": "sample_90_a1035_q0", "video_id": 90, "video_path": "./videos/sample_90_real.mp4", "annotation_index": 1035, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 4.", "B. 8.", "C. 10.", "D. 7."], "answer": "C", "time_stamp_s": 384, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_90_a1035_q0", "video_id": 90, "time_stamp_s": 384, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7cc092b3bc418f873165a06d6a5c8403a58d27193fb97f07a47b4fab4c4fe87b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666], "recent_frames_sha256": "34bbf43947c4cbcc33f3e2f321d477ab967cc7e4c5d52dd87b229cf495e6bf81", "num_recent_frames": 30, "tq": 716313.726633262, "t1": 716321.129359339, "ta": 716321.129359339, "te": 716321.166591904, "first_response_s": 7.402726077008992, "answer_total_s": 7.439958642004058, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_90_a1035_q0", "video_id": 90, "time_stamp_s": 384, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "18b838277611fe8296e313a53d3ea84d8215d1a812080fb04c838b15ea0de6fe", "condition_order": ["recent", "notes"], "memory": "[60-90s] - A man in a gray shirt gestures toward a whiteboard listing \"Lesson 5: Sound Design & Editing\" with bullet points about sound editing, balancing, and lab assignments.  \n- A scene from \"Spider-Man: Far From Home (2019)\" shows a character in a dark suit standing on a street at night, with smoke and blue lighting effects.  \n- The same man continues speaking, gesturing with his hands while standing beside the whiteboard, which includes text like \"LAB ASSIGNMENT: NO LAB\" and \"VIEWING: FREE CHOICE.\"\n[90-120s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays lesson details for \"Sound Mixing & Editing,\" including topics like sound editing, recording, and balancing.  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.\n[120-150s] - A golden retriever in a pink cape and crown stands on hay, facing forward with a calm expression.  \n- Two small ponies, one with a purple halter and the other with a red halter, are positioned near a wooden fence, looking toward the camera.  \n- The scene transitions between the dog and ponies, with the dog appearing in various shots, sometimes standing alone and sometimes near the hay pile.\n[150-180s] - A man in a grey shirt gestures toward a whiteboard displaying \"Lesson 11: Sound Design & Editing\" with bullet points about sound editing, mixing, and lab assignments.  \n- The whiteboard lists \"Sound Editing: Recording & Editing\" and \"Sound Mixing: Mastering & Balancing\" with \"Lab Assignment: No Lab\" and \"Viewing: Dune (2021)\" at the bottom.  \n- The scene transitions to a desert setting from \"Dune (2021)\" showing characters in rugged attire, some seated and others standing, with rocky terrain in the background.\n[180-210s] - A man in a brown cloak is engaged in a physical altercation with another individual, wielding a blade.  \n- A woman in dark attire stands nearby, observing the fight with a serious expression.  \n- The setting is a rugged, arid landscape with rocky formations in the background.\n[210-240s] - A man in a grey shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays lesson details for \"Sound Mixing & Editing,\" including topics like \"Sound Editing,\" \"Sound Design,\" and \"Lab Assignment: No Lab.\"  \n- A scene from \"Dune (2021)\" is briefly shown, featuring a group of people in desert attire, with one person in the foreground looking down.\n[240-270s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text about \"Lesson 5: Sound Mixing & Editing,\" including topics like \"Sound Editing,\" \"Audio Levels,\" and \"Lab Assignment: No Lab.\"  \n- The background is dark, with the man and whiteboard as the central focus, suggesting an instructional or classroom setting.\n[270-300s] - A man in a light shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays lesson details: \"Sound Mixing & Editing,\" \"Sound Editing: Recording & Editing,\" and \"Lab Assignment: No Lab.\"  \n- The scene transitions to black-and-white clips from \"Malcolm & Marie (2021)\" showing a man sitting, a hand holding a knife, and a woman crouching in a room.\n[300-330s] - A man in a light-colored shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays lesson details on sound mixing and editing, including topics like sound editing, balancing, and lab assignment.  \n- The background is dark, with the man and whiteboard as the central focus, suggesting an instructional setting.\n[330-360s] - A man in a vest and shirt stands in a dimly lit theater, watching a performer.  \n- A female performer in a purple costume executes an acrobatic flip on a trapeze, suspended above the audience.  \n- The performer’s face is close-up, showing intense focus, with a spotlight illuminating her.", "history_tokens": 962, "history_utf8_bytes": 3975, "recent_frame_times_s": [354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666], "recent_frames_sha256": "34bbf43947c4cbcc33f3e2f321d477ab967cc7e4c5d52dd87b229cf495e6bf81", "num_recent_frames": 30, "tq": 716441.85605079, "t1": 716448.797322794, "ta": 716448.797322794, "te": 716448.998387333, "first_response_s": 6.941272003925405, "answer_total_s": 7.142336542950943, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 91, "content_group": "5a2a029713c4ee1b8e8b9499d9eb7e0fcf8762c030c2e33500d252894b3724e5", "question": {"question_id": "sample_91_a47_q0", "video_id": 91, "video_path": "./videos/sample_91_real.mp4", "annotation_index": 47, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 16, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_91_a47_q0", "video_id": 91, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6f3e9de8cbe9b365f9b445c7a994ce239491ae4a3ea3598920cae42414745718", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "ba5f0b240fc879adbfe75a20c9e78df71de5005f93169d8385c78e2d8a9b6e91", "num_recent_frames": 16, "tq": 710123.848261245, "t1": 710131.785699863, "ta": 710131.785699863, "te": 710131.8183813, "first_response_s": 7.937438618042506, "answer_total_s": 7.970120055018924, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_91_a47_q0", "video_id": 91, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "686d07f46c4d7c2c8cd9c7e3d6995ba01f9baa80f2196517f39be1c89f449697", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "ba5f0b240fc879adbfe75a20c9e78df71de5005f93169d8385c78e2d8a9b6e91", "num_recent_frames": 16, "tq": 710018.720986188, "t1": 710019.571515042, "ta": 710019.571515042, "te": 710019.612949543, "first_response_s": 0.8505288539454341, "answer_total_s": 0.8919633550103754, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 91, "content_group": "5a2a029713c4ee1b8e8b9499d9eb7e0fcf8762c030c2e33500d252894b3724e5", "question": {"question_id": "sample_91_a47_q1", "video_id": 91, "video_path": "./videos/sample_91_real.mp4", "annotation_index": 47, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 37, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_91_a47_q1", "video_id": 91, "time_stamp_s": 37, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a2332f3ed7ee453775c6e289d3eb50ed62cf7cd4404c22c49088fec65b2b2023", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019, 20.02, 21.021, 22.022, 23.023, 24.024, 25.025, 26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335], "recent_frames_sha256": "c0a0cd043c21cd9de1914315419b0aaf463a7bf8abfb168ad734f3c5a3fa1797", "num_recent_frames": 30, "tq": 710131.823474124, "t1": 710140.448371047, "ta": 710140.448371047, "te": 710140.481391719, "first_response_s": 8.624896923080087, "answer_total_s": 8.6579175950028, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_91_a47_q1", "video_id": 91, "time_stamp_s": 37, "ground_truth": "D", "raw_output": "D. 0.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "d7b74fed86e9e71f53c2a519e482a88972d7dd3d9de168f91bcfbce204130979", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 5: Editing Space, Time, & Rhythm,\" with bullet points in various colors.  \n- The man’s hands move expressively as he explains the content, occasionally pointing to the board.", "history_tokens": 80, "history_utf8_bytes": 328, "recent_frame_times_s": [7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019, 20.02, 21.021, 22.022, 23.023, 24.024, 25.025, 26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335], "recent_frames_sha256": "c0a0cd043c21cd9de1914315419b0aaf463a7bf8abfb168ad734f3c5a3fa1797", "num_recent_frames": 30, "tq": 710027.711811998, "t1": 710034.726869074, "ta": 710034.726869074, "te": 710034.889220956, "first_response_s": 7.01505707600154, "answer_total_s": 7.177408957970329, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 91, "content_group": "5a2a029713c4ee1b8e8b9499d9eb7e0fcf8762c030c2e33500d252894b3724e5", "question": {"question_id": "sample_91_a48_q0", "video_id": 91, "video_path": "./videos/sample_91_real.mp4", "annotation_index": 48, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 5.", "C. 6.", "D. 0."], "answer": "B", "time_stamp_s": 196, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_91_a48_q0", "video_id": 91, "time_stamp_s": 196, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ff2d489013214e53c8ca066c6b29f34c90f4e3a237b6a5b338ca2c16404ace56", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666], "recent_frames_sha256": "7677ebe4d90e72d0a20e65b7979dfe2ac384e7b4d6516a5da09028168e3f1e2f", "num_recent_frames": 30, "tq": 710140.486646729, "t1": 710150.860437992, "ta": 710150.860437992, "te": 710150.89758305, "first_response_s": 10.3737912629731, "answer_total_s": 10.410936320899054, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_91_a48_q0", "video_id": 91, "time_stamp_s": 196, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "89e97b46733354e916dc2941912fe87193d9c3ef8749886f53c6fe08b3f92160", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 5: Editing Space, Time, & Rhythm,\" with bullet points in various colors.  \n- The man’s hands move expressively as he explains the content, occasionally pointing to the board.\n[30-60s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 5: Editing Space True Edition,\" including bullet points on spatial relationships and editing techniques.  \n- The scene transitions to a movie clip from \"Office Space (1999)\" showing two men at a desk and another man seated at a desk with a framed picture behind him.\n[60-90s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text including \"LESSON 5: EDITING SPACE TRUE RHYTHM\" and various bullet points.  \n- The scene transitions to a movie clip showing three men seated around a table in an office setting.\n[90-120s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 5: Echoing Space True Edition,\" including bullet points about spatial relationships, rhythm, and viewing.  \n- The man’s hands move expressively as he explains the content, with no visible changes in his position or the board’s text.\n[120-150s] - A black vintage car, labeled \"The Godfather (1972),\" is parked at a stone gate entrance, surrounded by overgrown vegetation.  \n- A man in a dark suit walks down stone steps toward the car, pausing to look around, with a bicycle visible nearby.  \n- The man turns his head to look back toward the car, suggesting he is approaching or about to enter it.\n[150-180s] - A man in a brown suit and tie stands near stone steps, looking toward the camera.  \n- A whiteboard with lesson content is visible behind him, featuring text in red, blue, and black.  \n- The scene transitions to a blurry view of a gas station with a magnifying glass effect, labeled \"The Jerk (1979).\"", "history_tokens": 526, "history_utf8_bytes": 2144, "recent_frame_times_s": [166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666], "recent_frames_sha256": "7677ebe4d90e72d0a20e65b7979dfe2ac384e7b4d6516a5da09028168e3f1e2f", "num_recent_frames": 30, "tq": 710069.449412338, "t1": 710075.038524745, "ta": 710075.038524745, "te": 710075.07519213, "first_response_s": 5.589112407062203, "answer_total_s": 5.625779792084359, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 91, "content_group": "5a2a029713c4ee1b8e8b9499d9eb7e0fcf8762c030c2e33500d252894b3724e5", "question": {"question_id": "sample_91_a49_q0", "video_id": 91, "video_path": "./videos/sample_91_real.mp4", "annotation_index": 49, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 4.", "C. 3.", "D. 6."], "answer": "D", "time_stamp_s": 254, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_91_a49_q0", "video_id": 91, "time_stamp_s": 254, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c876438cc939ba36435df50f67e1a3d50d9a236b79e547f3ca060ec1ccc18680", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332], "recent_frames_sha256": "3b1dd0d4086dbe0a8f01b1656a6c88350d6e5dacd15cb5476f2e9dbe5f1e210f", "num_recent_frames": 30, "tq": 710150.90389223, "t1": 710161.450587526, "ta": 710161.450587526, "te": 710161.482476107, "first_response_s": 10.546695295954123, "answer_total_s": 10.578583876951598, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_91_a49_q0", "video_id": 91, "time_stamp_s": 254, "ground_truth": "D", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "4c13ea040fe4d840e63e0b7b782709d5915c2d942801f4462c09c20a1d77a43e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 5: Editing Space, Time, & Rhythm,\" with bullet points in various colors.  \n- The man’s hands move expressively as he explains the content, occasionally pointing to the board.\n[30-60s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 5: Editing Space True Edition,\" including bullet points on spatial relationships and editing techniques.  \n- The scene transitions to a movie clip from \"Office Space (1999)\" showing two men at a desk and another man seated at a desk with a framed picture behind him.\n[60-90s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text including \"LESSON 5: EDITING SPACE TRUE RHYTHM\" and various bullet points.  \n- The scene transitions to a movie clip showing three men seated around a table in an office setting.\n[90-120s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 5: Echoing Space True Edition,\" including bullet points about spatial relationships, rhythm, and viewing.  \n- The man’s hands move expressively as he explains the content, with no visible changes in his position or the board’s text.\n[120-150s] - A black vintage car, labeled \"The Godfather (1972),\" is parked at a stone gate entrance, surrounded by overgrown vegetation.  \n- A man in a dark suit walks down stone steps toward the car, pausing to look around, with a bicycle visible nearby.  \n- The man turns his head to look back toward the car, suggesting he is approaching or about to enter it.\n[150-180s] - A man in a brown suit and tie stands near stone steps, looking toward the camera.  \n- A whiteboard with lesson content is visible behind him, featuring text in red, blue, and black.  \n- The scene transitions to a blurry view of a gas station with a magnifying glass effect, labeled \"The Jerk (1979).\"\n[180-210s] - A man in a white uniform and cap stands at a gas station, holding a clipboard and looking at a fuel pump display.  \n- Behind him, a red Coca-Cola cooler and a row of pink \"EZ-SERVE\" motor oil cans are visible on the counter.  \n- The man gestures with his hands while speaking, indicating he is explaining or presenting something.\n[210-240s] - A man in a blue shirt gestures toward a whiteboard displaying \"Lesson 5: Editing—Space, Time, Rhythm\" with bullet points about spatial relationships and editing techniques.  \n- A film clip from \"The Jerk (1979)\" shows a man aiming a rifle outdoors, followed by scenes of a man in a white uniform moving cans in a garage and outside a store.  \n- The whiteboard text includes phrases like \"CREATE A HARMONIC RHYTHMIC MOTION\" and \"VIEWING: BONNIE & CLYDE (1967)\" in colored markers.", "history_tokens": 748, "history_utf8_bytes": 2982, "recent_frame_times_s": [224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332], "recent_frames_sha256": "3b1dd0d4086dbe0a8f01b1656a6c88350d6e5dacd15cb5476f2e9dbe5f1e210f", "num_recent_frames": 30, "tq": 710095.934390594, "t1": 710101.486293464, "ta": 710101.486293464, "te": 710101.671633212, "first_response_s": 5.551902869949117, "answer_total_s": 5.737242617993616, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 91, "content_group": "5a2a029713c4ee1b8e8b9499d9eb7e0fcf8762c030c2e33500d252894b3724e5", "question": {"question_id": "sample_91_a50_q0", "video_id": 91, "video_path": "./videos/sample_91_real.mp4", "annotation_index": 50, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 9.", "C. 8.", "D. 6."], "answer": "B", "time_stamp_s": 313, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_91_a50_q0", "video_id": 91, "time_stamp_s": 313, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "00dff400cae425ab0064e7abf979ff2b3f998736dc0296ff48bec5f11416ef69", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117], "recent_frames_sha256": "429a8a22393ca858724ce84fd9c19fc3fa87085fd4892c20eef1b5c7e61bab74", "num_recent_frames": 30, "tq": 710161.489309825, "t1": 710169.217550288, "ta": 710169.217550288, "te": 710169.254643513, "first_response_s": 7.728240462951362, "answer_total_s": 7.765333688003011, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_91_a50_q0", "video_id": 91, "time_stamp_s": 313, "ground_truth": "B", "raw_output": "D. 6.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "08f06c7600f7c53c014b3cc566f537f2bb2b19f143f079e53bc30f0859813841", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 5: Editing Space, Time, & Rhythm,\" with bullet points in various colors.  \n- The man’s hands move expressively as he explains the content, occasionally pointing to the board.\n[30-60s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Lesson 5: Editing Space True Edition,\" including bullet points on spatial relationships and editing techniques.  \n- The scene transitions to a movie clip from \"Office Space (1999)\" showing two men at a desk and another man seated at a desk with a framed picture behind him.\n[60-90s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text including \"LESSON 5: EDITING SPACE TRUE RHYTHM\" and various bullet points.  \n- The scene transitions to a movie clip showing three men seated around a table in an office setting.\n[90-120s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 5: Echoing Space True Edition,\" including bullet points about spatial relationships, rhythm, and viewing.  \n- The man’s hands move expressively as he explains the content, with no visible changes in his position or the board’s text.\n[120-150s] - A black vintage car, labeled \"The Godfather (1972),\" is parked at a stone gate entrance, surrounded by overgrown vegetation.  \n- A man in a dark suit walks down stone steps toward the car, pausing to look around, with a bicycle visible nearby.  \n- The man turns his head to look back toward the car, suggesting he is approaching or about to enter it.\n[150-180s] - A man in a brown suit and tie stands near stone steps, looking toward the camera.  \n- A whiteboard with lesson content is visible behind him, featuring text in red, blue, and black.  \n- The scene transitions to a blurry view of a gas station with a magnifying glass effect, labeled \"The Jerk (1979).\"\n[180-210s] - A man in a white uniform and cap stands at a gas station, holding a clipboard and looking at a fuel pump display.  \n- Behind him, a red Coca-Cola cooler and a row of pink \"EZ-SERVE\" motor oil cans are visible on the counter.  \n- The man gestures with his hands while speaking, indicating he is explaining or presenting something.\n[210-240s] - A man in a blue shirt gestures toward a whiteboard displaying \"Lesson 5: Editing—Space, Time, Rhythm\" with bullet points about spatial relationships and editing techniques.  \n- A film clip from \"The Jerk (1979)\" shows a man aiming a rifle outdoors, followed by scenes of a man in a white uniform moving cans in a garage and outside a store.  \n- The whiteboard text includes phrases like \"CREATE A HARMONIC RHYTHMIC MOTION\" and \"VIEWING: BONNIE & CLYDE (1967)\" in colored markers.\n[240-270s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 5: Echoing Space True Rhythm,\" including bullet points about spatial relationships and viewing.  \n- The background features dark, circular lights above the whiteboard, creating a focused, studio-like setting.\n[270-300s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 5: Ending-Space True Rhythm,\" including bullet points about spatial relationships and rhythm.  \n- A black-and-white photo of a man in a suit appears briefly on screen, followed by a photo of a woman reclining in an ornate chair.", "history_tokens": 927, "history_utf8_bytes": 3730, "recent_frame_times_s": [283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117], "recent_frames_sha256": "429a8a22393ca858724ce84fd9c19fc3fa87085fd4892c20eef1b5c7e61bab74", "num_recent_frames": 30, "tq": 710121.881130069, "t1": 710123.587533304, "ta": 710123.587533304, "te": 710123.812087844, "first_response_s": 1.7064032349735498, "answer_total_s": 1.930957774980925, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 92, "content_group": "8b3bbc1455763601f9e3f28b6f77d7fe363cb163c66920ccef104ec30902404b", "question": {"question_id": "sample_92_a576_q0", "video_id": 92, "video_path": "./videos/sample_92_real.mp4", "annotation_index": 576, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 16, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_92_a576_q0", "video_id": 92, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "69af32b720379d5a45dd6ffc8a50e6e2e3b470d8a47f2f288aff9f0c72a001a2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "7caba9b0784b89c658539f7836f1526b41b222a9d2f7104868c1004a618f2e50", "num_recent_frames": 16, "tq": 717779.069580356, "t1": 717779.693097086, "ta": 717779.693097086, "te": 717779.882814078, "first_response_s": 0.6235167300328612, "answer_total_s": 0.8132337220013142, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_92_a576_q0", "video_id": 92, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2d11c8b78cb9a94eca8ea4221a792deff78f2d4f0362c8a5271fa2ab5da376e3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "7caba9b0784b89c658539f7836f1526b41b222a9d2f7104868c1004a618f2e50", "num_recent_frames": 16, "tq": 717662.767611728, "t1": 717675.83029602, "ta": 717675.83029602, "te": 717676.032081146, "first_response_s": 13.06268429197371, "answer_total_s": 13.264469417976215, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 92, "content_group": "8b3bbc1455763601f9e3f28b6f77d7fe363cb163c66920ccef104ec30902404b", "question": {"question_id": "sample_92_a576_q1", "video_id": 92, "video_path": "./videos/sample_92_real.mp4", "annotation_index": 576, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 1."], "answer": "D", "time_stamp_s": 45, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_92_a576_q1", "video_id": 92, "time_stamp_s": 45, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d85e8e8bd64d8522ee711222f54151971035b4f28adf7c0ed086376a4d2626b3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [15.015, 16.016, 17.017, 18.018, 19.019, 20.02, 21.021, 22.022, 23.023, 24.024, 25.025, 26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333], "recent_frames_sha256": "4de9ed6ab1f0590cd8441b90fed1aad526cdbe2ee01fea290561ba6b2ca58197", "num_recent_frames": 30, "tq": 717779.897854713, "t1": 717792.669805237, "ta": 717792.669805237, "te": 717792.71049268, "first_response_s": 12.77195052395109, "answer_total_s": 12.81263796694111, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_92_a576_q1", "video_id": 92, "time_stamp_s": 45, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "aa0ee04e8bc7d73a9a250af669bc95b3604918572bed1b347a96ad0dadc25847", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 5.2: CONTINUITY / DISCONTINUITY\" with bullet points about film techniques like \"Establishing Shot,\" \"Cutting,\" and \"Camera Movement.\"  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.", "history_tokens": 94, "history_utf8_bytes": 381, "recent_frame_times_s": [15.015, 16.016, 17.017, 18.018, 19.019, 20.02, 21.021, 22.022, 23.023, 24.024, 25.025, 26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333], "recent_frames_sha256": "4de9ed6ab1f0590cd8441b90fed1aad526cdbe2ee01fea290561ba6b2ca58197", "num_recent_frames": 30, "tq": 717682.23915639, "t1": 717682.764082348, "ta": 717682.764082348, "te": 717682.843039745, "first_response_s": 0.524925958015956, "answer_total_s": 0.6038833550410345, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 92, "content_group": "8b3bbc1455763601f9e3f28b6f77d7fe363cb163c66920ccef104ec30902404b", "question": {"question_id": "sample_92_a577_q0", "video_id": 92, "video_path": "./videos/sample_92_real.mp4", "annotation_index": 577, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 5.", "C. 6.", "D. 0."], "answer": "B", "time_stamp_s": 212, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_92_a577_q0", "video_id": 92, "time_stamp_s": 212, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c20894d69daec0c4f63befe0c3af2e8e603ea3abb3c76a319d54e83de1a5df5d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108], "recent_frames_sha256": "2c320eeafc75508171f0aef21a8ac80233e123e70d537dcfed8d783a7ef1809f", "num_recent_frames": 30, "tq": 717792.720554665, "t1": 717805.020906341, "ta": 717805.020906341, "te": 717805.059490532, "first_response_s": 12.300351676065475, "answer_total_s": 12.338935867068358, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_92_a577_q0", "video_id": 92, "time_stamp_s": 212, "ground_truth": "B", "raw_output": "A. 3.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "c54bd845d5bc8b1feec14b97d86531f15cca83802af9e5286c66ac8ff92ee3c1", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 5.2: CONTINUITY / DISCONTINUITY\" with bullet points about film techniques like \"Establishing Shot,\" \"Cutting,\" and \"Camera Movement.\"  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.\n[30-60s] - A man in a striped shirt and tie stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 5.2: CONTINUITY / DISCONTINUITY\" with bullet points about film techniques and editing.  \n- The man’s hands move expressively as he explains the content, indicating active teaching or presentation.\n[60-90s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for \"Lesson 5.2: Continuity & Documentary,\" including bullet points about continuity techniques and film styles.  \n- The background features dimly lit hanging lights and a darkened room, suggesting an indoor lecture or presentation setting.\n[90-120s] - A man in a blue shirt gestures toward a whiteboard displaying \"Lesson 5.2: Continuity / Discontinuity\" with bullet points about film techniques.  \n- A scene from \"Barry Lyndon (1975)\" shows three men in 18th-century attire conversing outdoors near trees.  \n- Another scene from the same film depicts a man in a white shirt standing by a lake, facing two men in period costumes, one of whom is adjusting his hat.\n[120-150s] - A man in a plaid shirt and cap swings a bat, with a catcher in a green uniform crouched behind him.  \n- The man in the cap looks upward, possibly tracking a ball, while another figure runs in the background.  \n- A red sign with white text reading \"DOWNTOWN\" is visible behind the batter, indicating a rural or small-town setting.\n[150-180s] - A man in a blue shirt gestures toward a whiteboard displaying \"Lesson 5.2: Continuity / Discontinuity\" with bullet points about continuity editing techniques.\n- An animated diagram shows two figures in a circle with arrows indicating camera movements and transitions between scenes, including red boxes labeled \"1\" to \"3\" representing different camera positions.\n- The diagram illustrates how scenes are connected through camera angles and transitions, with figures appearing in various frames and positions across the screen.\n[180-210s] - A classroom scene from \"Mean Girls (2004)\" shows two girls conversing at a table, with other students in the background.  \n- The camera transitions to a whiteboard with \"Lesson 5.2: Continuity / Focal Length\" text, indicating a film or photography lesson.  \n- A man stands in front of the whiteboard, gesturing while speaking, with a diagram of a camera setup labeled \"Shot 1\" and \"Shot 2\" visible.", "history_tokens": 682, "history_utf8_bytes": 2835, "recent_frame_times_s": [182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108], "recent_frames_sha256": "2c320eeafc75508171f0aef21a8ac80233e123e70d537dcfed8d783a7ef1809f", "num_recent_frames": 30, "tq": 717725.33267241, "t1": 717731.83772679, "ta": 717731.83772679, "te": 717732.02770021, "first_response_s": 6.505054380046204, "answer_total_s": 6.695027800044045, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 92, "content_group": "8b3bbc1455763601f9e3f28b6f77d7fe363cb163c66920ccef104ec30902404b", "question": {"question_id": "sample_92_a578_q0", "video_id": 92, "video_path": "./videos/sample_92_real.mp4", "annotation_index": 578, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 4.", "C. 3.", "D. 6."], "answer": "D", "time_stamp_s": 250, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_92_a578_q0", "video_id": 92, "time_stamp_s": 250, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1b71cb8cea96fcdb1f761668402531d101dccafc90b4d50a0ec0b4f1812929ff", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333], "recent_frames_sha256": "a5546ec981dcac8cf5d7e0fac42df80101551c8d43bfc06228133744439bd1c3", "num_recent_frames": 30, "tq": 717805.069502465, "t1": 717811.55502436, "ta": 717811.55502436, "te": 717811.593489378, "first_response_s": 6.4855218949960545, "answer_total_s": 6.523986913030967, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_92_a578_q0", "video_id": 92, "time_stamp_s": 250, "ground_truth": "D", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "d3ed0d9bb19fe0e057d6f0123da923c9f9c3de5f2ee0464c2da4b3599d0cccb9", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 5.2: CONTINUITY / DISCONTINUITY\" with bullet points about film techniques like \"Establishing Shot,\" \"Cutting,\" and \"Camera Movement.\"  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.\n[30-60s] - A man in a striped shirt and tie stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 5.2: CONTINUITY / DISCONTINUITY\" with bullet points about film techniques and editing.  \n- The man’s hands move expressively as he explains the content, indicating active teaching or presentation.\n[60-90s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for \"Lesson 5.2: Continuity & Documentary,\" including bullet points about continuity techniques and film styles.  \n- The background features dimly lit hanging lights and a darkened room, suggesting an indoor lecture or presentation setting.\n[90-120s] - A man in a blue shirt gestures toward a whiteboard displaying \"Lesson 5.2: Continuity / Discontinuity\" with bullet points about film techniques.  \n- A scene from \"Barry Lyndon (1975)\" shows three men in 18th-century attire conversing outdoors near trees.  \n- Another scene from the same film depicts a man in a white shirt standing by a lake, facing two men in period costumes, one of whom is adjusting his hat.\n[120-150s] - A man in a plaid shirt and cap swings a bat, with a catcher in a green uniform crouched behind him.  \n- The man in the cap looks upward, possibly tracking a ball, while another figure runs in the background.  \n- A red sign with white text reading \"DOWNTOWN\" is visible behind the batter, indicating a rural or small-town setting.\n[150-180s] - A man in a blue shirt gestures toward a whiteboard displaying \"Lesson 5.2: Continuity / Discontinuity\" with bullet points about continuity editing techniques.\n- An animated diagram shows two figures in a circle with arrows indicating camera movements and transitions between scenes, including red boxes labeled \"1\" to \"3\" representing different camera positions.\n- The diagram illustrates how scenes are connected through camera angles and transitions, with figures appearing in various frames and positions across the screen.\n[180-210s] - A classroom scene from \"Mean Girls (2004)\" shows two girls conversing at a table, with other students in the background.  \n- The camera transitions to a whiteboard with \"Lesson 5.2: Continuity / Focal Length\" text, indicating a film or photography lesson.  \n- A man stands in front of the whiteboard, gesturing while speaking, with a diagram of a camera setup labeled \"Shot 1\" and \"Shot 2\" visible.\n[210-240s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 5.2: Continuity / Discontinuity,\" including subheadings and bullet points.  \n- The background features dimly lit ceiling lights and a darkened room setting.", "history_tokens": 762, "history_utf8_bytes": 3147, "recent_frame_times_s": [220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333], "recent_frames_sha256": "a5546ec981dcac8cf5d7e0fac42df80101551c8d43bfc06228133744439bd1c3", "num_recent_frames": 30, "tq": 717743.802509098, "t1": 717750.788741721, "ta": 717750.788741721, "te": 717750.979019662, "first_response_s": 6.986232622992247, "answer_total_s": 7.1765105640515685, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 92, "content_group": "8b3bbc1455763601f9e3f28b6f77d7fe363cb163c66920ccef104ec30902404b", "question": {"question_id": "sample_92_a579_q0", "video_id": 92, "video_path": "./videos/sample_92_real.mp4", "annotation_index": 579, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 9.", "C. 8.", "D. 6."], "answer": "B", "time_stamp_s": 317, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_92_a579_q0", "video_id": 92, "time_stamp_s": 317, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7a394fefbe23628a660cf015cb393ac469bdd7ca56c19ed828b5184dca68c06c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157], "recent_frames_sha256": "5f55769f7287d90f3fb45c86e1cf782abd1bb875dd029f669f8e845e2bafe3d5", "num_recent_frames": 30, "tq": 717811.60447119, "t1": 717823.440897305, "ta": 717823.440897305, "te": 717823.479337785, "first_response_s": 11.836426115012728, "answer_total_s": 11.874866595026106, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_92_a579_q0", "video_id": 92, "time_stamp_s": 317, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f82e08d86bbcb5f3f635997d1d5d37aa9a466dc479d579fc3a60e0866910b23d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 5.2: CONTINUITY / DISCONTINUITY\" with bullet points about film techniques like \"Establishing Shot,\" \"Cutting,\" and \"Camera Movement.\"  \n- The man occasionally points to specific sections on the whiteboard as he explains the content.\n[30-60s] - A man in a striped shirt and tie stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 5.2: CONTINUITY / DISCONTINUITY\" with bullet points about film techniques and editing.  \n- The man’s hands move expressively as he explains the content, indicating active teaching or presentation.\n[60-90s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for \"Lesson 5.2: Continuity & Documentary,\" including bullet points about continuity techniques and film styles.  \n- The background features dimly lit hanging lights and a darkened room, suggesting an indoor lecture or presentation setting.\n[90-120s] - A man in a blue shirt gestures toward a whiteboard displaying \"Lesson 5.2: Continuity / Discontinuity\" with bullet points about film techniques.  \n- A scene from \"Barry Lyndon (1975)\" shows three men in 18th-century attire conversing outdoors near trees.  \n- Another scene from the same film depicts a man in a white shirt standing by a lake, facing two men in period costumes, one of whom is adjusting his hat.\n[120-150s] - A man in a plaid shirt and cap swings a bat, with a catcher in a green uniform crouched behind him.  \n- The man in the cap looks upward, possibly tracking a ball, while another figure runs in the background.  \n- A red sign with white text reading \"DOWNTOWN\" is visible behind the batter, indicating a rural or small-town setting.\n[150-180s] - A man in a blue shirt gestures toward a whiteboard displaying \"Lesson 5.2: Continuity / Discontinuity\" with bullet points about continuity editing techniques.\n- An animated diagram shows two figures in a circle with arrows indicating camera movements and transitions between scenes, including red boxes labeled \"1\" to \"3\" representing different camera positions.\n- The diagram illustrates how scenes are connected through camera angles and transitions, with figures appearing in various frames and positions across the screen.\n[180-210s] - A classroom scene from \"Mean Girls (2004)\" shows two girls conversing at a table, with other students in the background.  \n- The camera transitions to a whiteboard with \"Lesson 5.2: Continuity / Focal Length\" text, indicating a film or photography lesson.  \n- A man stands in front of the whiteboard, gesturing while speaking, with a diagram of a camera setup labeled \"Shot 1\" and \"Shot 2\" visible.\n[210-240s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for \"Lesson 5.2: Continuity / Discontinuity,\" including subheadings and bullet points.  \n- The background features dimly lit ceiling lights and a darkened room setting.\n[240-270s] - A man in a blue shirt stands beside a whiteboard, gesturing toward lesson content on continuity and discontinuity.  \n- The whiteboard displays text about film techniques, including \"Establishing Shot,\" \"Action,\" and \"Editing.\"  \n- A film clip from \"The Royal Tenenbaums (2001)\" shows a man with sunglasses adjusting his hair in a bathroom.\n[270-300s] - A man in a blue shirt stands beside a whiteboard with \"Lesson 5.2: Continuity / Discontinuity\" written on it, gesturing with his hands.  \n- The whiteboard lists topics like \"Continuity Editing\" and \"Discontinuity Editing,\" with bullet points detailing their characteristics.  \n- A black-and-white film clip titled \"The Astronomer's Dream (1898)\" plays in the background, showing a woman in a white dress dancing near a telescope.", "history_tokens": 964, "history_utf8_bytes": 3943, "recent_frame_times_s": [287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157], "recent_frames_sha256": "5f55769f7287d90f3fb45c86e1cf782abd1bb875dd029f669f8e845e2bafe3d5", "num_recent_frames": 30, "tq": 717770.938912414, "t1": 717778.814259359, "ta": 717778.814259359, "te": 717779.043319657, "first_response_s": 7.875346945016645, "answer_total_s": 8.104407242964953, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 93, "content_group": "b7d81e435294db5484b0df9adf370869d4d8453d1c0e3d8be3e16b07e9575575", "question": {"question_id": "sample_93_a1059_q0", "video_id": 93, "video_path": "./videos/sample_93_real.mp4", "annotation_index": 1059, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 16, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_93_a1059_q0", "video_id": 93, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "20da008b95f04914894a0f7f3eb730d9c00e566f4cf3705fe334ca6e2121f3db", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "abbc5fae019d03b929cbd54bbc387bf207e4e1f31d325588800b31a5379aaf96", "num_recent_frames": 16, "tq": 716281.256321677, "t1": 716282.480212286, "ta": 716282.480212286, "te": 716282.518962215, "first_response_s": 1.2238906089914963, "answer_total_s": 1.2626405380433425, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_93_a1059_q0", "video_id": 93, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "45e64692c5a96aaa7ee01b5a6fcb55240353759c55c8387120482d78b61a2466", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "abbc5fae019d03b929cbd54bbc387bf207e4e1f31d325588800b31a5379aaf96", "num_recent_frames": 16, "tq": 716148.013379819, "t1": 716161.972618466, "ta": 716161.972618466, "te": 716162.011461301, "first_response_s": 13.959238647017628, "answer_total_s": 13.99808148201555, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 93, "content_group": "b7d81e435294db5484b0df9adf370869d4d8453d1c0e3d8be3e16b07e9575575", "question": {"question_id": "sample_93_a1060_q0", "video_id": 93, "video_path": "./videos/sample_93_real.mp4", "annotation_index": 1060, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 1."], "answer": "D", "time_stamp_s": 74, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_93_a1060_q0", "video_id": 93, "time_stamp_s": 74, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "636a0374cdd6372928c5214e118b1d53069b0053117e95d215ebe7b24996b535", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666], "recent_frames_sha256": "55cbc511e133c198ec697e870a12034ff69a1a1690b06a218ad2c631dd07571a", "num_recent_frames": 30, "tq": 716282.54630938, "t1": 716289.539297829, "ta": 716289.539297829, "te": 716289.576695907, "first_response_s": 6.9929884490557015, "answer_total_s": 7.030386527068913, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_93_a1060_q0", "video_id": 93, "time_stamp_s": 74, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ab8c05fd88c1de8abb333b21e5a4aea12a9d4d797cefc2a97d4b9765a4748e4d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 5.3: FORMAL EDITING\" with bullet points about cross-cutting and editing techniques.  \n- The man occasionally points to specific sections of the whiteboard as he explains the content.\n[30-60s] - A man in a light blue shirt stands beside a whiteboard, gesturing toward text about \"Framell Editing\" and \"Cross Cutting.\"\n- The whiteboard displays lesson details, including \"Green Screen\" and \"Cross Cutting\" terms, with handwritten notes in various colors.\n- The scene transitions to a street with cars and pedestrians, showing a clip from \"Reservoir Dogs (1992)\" with a yellow taxi and a man running.", "history_tokens": 182, "history_utf8_bytes": 757, "recent_frame_times_s": [44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666], "recent_frames_sha256": "55cbc511e133c198ec697e870a12034ff69a1a1690b06a218ad2c631dd07571a", "num_recent_frames": 30, "tq": 716174.296213582, "t1": 716175.694180624, "ta": 716175.694180624, "te": 716175.732272991, "first_response_s": 1.3979670419357717, "answer_total_s": 1.4360594089375809, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 93, "content_group": "b7d81e435294db5484b0df9adf370869d4d8453d1c0e3d8be3e16b07e9575575", "question": {"question_id": "sample_93_a1061_q0", "video_id": 93, "video_path": "./videos/sample_93_real.mp4", "annotation_index": 1061, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 4.", "C. 6.", "D. 0."], "answer": "B", "time_stamp_s": 206, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_93_a1061_q0", "video_id": 93, "time_stamp_s": 206, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7232ecb13dfe7ea211ed053477a9c7a0324cde60ec5b0af80da0c54b1b7e194c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "5b9c2939f1d995f43e9d218898358730b7b6a67ff93ab84bc482a968b351ba53", "num_recent_frames": 30, "tq": 716289.594549121, "t1": 716302.302538897, "ta": 716302.302538897, "te": 716302.339993312, "first_response_s": 12.707989776041359, "answer_total_s": 12.745444191037677, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_93_a1061_q0", "video_id": 93, "time_stamp_s": 206, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b8a74989ccc1ff03740fba3c54379dbfb82a21117027d43964a4eef69480ce46", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 5.3: FORMAL EDITING\" with bullet points about cross-cutting and editing techniques.  \n- The man occasionally points to specific sections of the whiteboard as he explains the content.\n[30-60s] - A man in a light blue shirt stands beside a whiteboard, gesturing toward text about \"Framell Editing\" and \"Cross Cutting.\"\n- The whiteboard displays lesson details, including \"Green Screen\" and \"Cross Cutting\" terms, with handwritten notes in various colors.\n- The scene transitions to a street with cars and pedestrians, showing a clip from \"Reservoir Dogs (1992)\" with a yellow taxi and a man running.\n[60-90s] - A man in a plaid shirt and dark vest runs alongside another man in a dark suit, both moving quickly down a sidewalk.  \n- A red car speeds past them on the street, its motion blurred, indicating high speed.  \n- The scene is set in an urban environment with storefronts and parked cars visible in the background.\n[90-120s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 5.3: PARETO EDITING\" with bullet points about cross-cutting, editing process, and related terms.  \n- The setting appears to be a dimly lit room with hanging lights, and the man is positioned centrally in the frame.\n[120-150s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text about \"Lesson 5.3: Punctuation Editing,\" including sections on \"Cross Cuttings\" and \"Punctuation Actions.\"  \n- The man’s hands move expressively as he explains the content, occasionally pointing to different parts of the whiteboard.\n[150-180s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Framell Editing\" and \"Cross Cuttings,\" with highlighted sections in green and red.  \n- A black-and-white film clip titled \"Strangers on a Train (1951)\" plays in the background, showing feet and legs of passengers on a train.", "history_tokens": 542, "history_utf8_bytes": 2215, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "5b9c2939f1d995f43e9d218898358730b7b6a67ff93ab84bc482a968b351ba53", "num_recent_frames": 30, "tq": 716206.516485397, "t1": 716213.446515203, "ta": 716213.446515203, "te": 716213.63702759, "first_response_s": 6.930029805982485, "answer_total_s": 7.120542192948051, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 93, "content_group": "b7d81e435294db5484b0df9adf370869d4d8453d1c0e3d8be3e16b07e9575575", "question": {"question_id": "sample_93_a1062_q0", "video_id": 93, "video_path": "./videos/sample_93_real.mp4", "annotation_index": 1062, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 4.", "C. 3.", "D. 5."], "answer": "D", "time_stamp_s": 247, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_93_a1062_q0", "video_id": 93, "time_stamp_s": 247, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c0252548d9ae6991e7966641d7815b75547ad1c375bc5d972c38371e36e1f10e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332], "recent_frames_sha256": "84bbd7e1ca27f1bb2c4ee51b6b69a283960f7c577773c6bb9b740a8b25063374", "num_recent_frames": 30, "tq": 716302.359326891, "t1": 716313.671154489, "ta": 716313.671154489, "te": 716313.708688021, "first_response_s": 11.311827598023228, "answer_total_s": 11.349361130036414, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_93_a1062_q0", "video_id": 93, "time_stamp_s": 247, "ground_truth": "D", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "9916d84ebf48d2b6e8155422e616f0e0be038a092f0085dfac6b45407b4cc9b9", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 5.3: FORMAL EDITING\" with bullet points about cross-cutting and editing techniques.  \n- The man occasionally points to specific sections of the whiteboard as he explains the content.\n[30-60s] - A man in a light blue shirt stands beside a whiteboard, gesturing toward text about \"Framell Editing\" and \"Cross Cutting.\"\n- The whiteboard displays lesson details, including \"Green Screen\" and \"Cross Cutting\" terms, with handwritten notes in various colors.\n- The scene transitions to a street with cars and pedestrians, showing a clip from \"Reservoir Dogs (1992)\" with a yellow taxi and a man running.\n[60-90s] - A man in a plaid shirt and dark vest runs alongside another man in a dark suit, both moving quickly down a sidewalk.  \n- A red car speeds past them on the street, its motion blurred, indicating high speed.  \n- The scene is set in an urban environment with storefronts and parked cars visible in the background.\n[90-120s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 5.3: PARETO EDITING\" with bullet points about cross-cutting, editing process, and related terms.  \n- The setting appears to be a dimly lit room with hanging lights, and the man is positioned centrally in the frame.\n[120-150s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text about \"Lesson 5.3: Punctuation Editing,\" including sections on \"Cross Cuttings\" and \"Punctuation Actions.\"  \n- The man’s hands move expressively as he explains the content, occasionally pointing to different parts of the whiteboard.\n[150-180s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Framell Editing\" and \"Cross Cuttings,\" with highlighted sections in green and red.  \n- A black-and-white film clip titled \"Strangers on a Train (1951)\" plays in the background, showing feet and legs of passengers on a train.\n[180-210s] - A woman in a dark dress gestures toward two children in a room with ornate furniture and curtains.  \n- A man in a suit stands near a door, interacting with another man seated on the ground, while a third man walks away.  \n- A horse-drawn carriage travels along a dirt road flanked by bare trees, with a figure standing beside it.\n[210-240s] - A man in a light blue shirt stands beside a whiteboard titled \"LESSON 5.3: FINAL CUT EDITING,\" gesturing toward the board while speaking.  \n- The whiteboard lists topics like \"CROSS CUTTINGS,\" \"MONTAGE,\" and \"GREEN SCREEN,\" with some text in red and green.  \n- A cartoon scene from \"Family Guy\" plays on a TV screen, showing a tiger and a man in a jungle setting, with the title \"Family Guy: I Never Met the Dead Man (1999)\" displayed at the bottom.", "history_tokens": 754, "history_utf8_bytes": 3021, "recent_frame_times_s": [217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332], "recent_frames_sha256": "84bbd7e1ca27f1bb2c4ee51b6b69a283960f7c577773c6bb9b740a8b25063374", "num_recent_frames": 30, "tq": 716227.716340222, "t1": 716228.635984255, "ta": 716228.635984255, "te": 716228.859041539, "first_response_s": 0.9196440329542384, "answer_total_s": 1.1427013169741258, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 93, "content_group": "b7d81e435294db5484b0df9adf370869d4d8453d1c0e3d8be3e16b07e9575575", "question": {"question_id": "sample_93_a1063_q0", "video_id": 93, "video_path": "./videos/sample_93_real.mp4", "annotation_index": 1063, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 7.", "C. 8.", "D. 6."], "answer": "B", "time_stamp_s": 331, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_93_a1063_q0", "video_id": 93, "time_stamp_s": 331, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2f69bbff18752288d2259cb870478187fe4540ac063840a96205a9e7ab601f83", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297], "recent_frames_sha256": "ad486e19586954c5dddb744196ae23ea475b5f1beb2f1829819c06d5ae526859", "num_recent_frames": 30, "tq": 716313.728267752, "t1": 716321.129359339, "ta": 716321.129359339, "te": 716321.166591904, "first_response_s": 7.40109158703126, "answer_total_s": 7.4383241520263255, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_93_a1063_q0", "video_id": 93, "time_stamp_s": 331, "ground_truth": "B", "raw_output": "D. 6.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "75c2a65149581e8c33b00c96b7fed08cf02af7473c27c2464f0c5b891f055412", "condition_order": ["notes", "recent"], "memory": "[30-60s] - A man in a light blue shirt stands beside a whiteboard, gesturing toward text about \"Framell Editing\" and \"Cross Cutting.\"\n- The whiteboard displays lesson details, including \"Green Screen\" and \"Cross Cutting\" terms, with handwritten notes in various colors.\n- The scene transitions to a street with cars and pedestrians, showing a clip from \"Reservoir Dogs (1992)\" with a yellow taxi and a man running.\n[60-90s] - A man in a plaid shirt and dark vest runs alongside another man in a dark suit, both moving quickly down a sidewalk.  \n- A red car speeds past them on the street, its motion blurred, indicating high speed.  \n- The scene is set in an urban environment with storefronts and parked cars visible in the background.\n[90-120s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 5.3: PARETO EDITING\" with bullet points about cross-cutting, editing process, and related terms.  \n- The setting appears to be a dimly lit room with hanging lights, and the man is positioned centrally in the frame.\n[120-150s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text about \"Lesson 5.3: Punctuation Editing,\" including sections on \"Cross Cuttings\" and \"Punctuation Actions.\"  \n- The man’s hands move expressively as he explains the content, occasionally pointing to different parts of the whiteboard.\n[150-180s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Framell Editing\" and \"Cross Cuttings,\" with highlighted sections in green and red.  \n- A black-and-white film clip titled \"Strangers on a Train (1951)\" plays in the background, showing feet and legs of passengers on a train.\n[180-210s] - A woman in a dark dress gestures toward two children in a room with ornate furniture and curtains.  \n- A man in a suit stands near a door, interacting with another man seated on the ground, while a third man walks away.  \n- A horse-drawn carriage travels along a dirt road flanked by bare trees, with a figure standing beside it.\n[210-240s] - A man in a light blue shirt stands beside a whiteboard titled \"LESSON 5.3: FINAL CUT EDITING,\" gesturing toward the board while speaking.  \n- The whiteboard lists topics like \"CROSS CUTTINGS,\" \"MONTAGE,\" and \"GREEN SCREEN,\" with some text in red and green.  \n- A cartoon scene from \"Family Guy\" plays on a TV screen, showing a tiger and a man in a jungle setting, with the title \"Family Guy: I Never Met the Dead Man (1999)\" displayed at the bottom.\n[240-270s] - A man in a light blue shirt gestures toward a whiteboard displaying \"Lesson 9.3: Freelance Editing\" with bullet points about cross-cutting and editing actions.\n- The scene transitions to clips from \"Fight Club (1999)\" showing a man in a fur coat speaking, followed by a man in a dark room with a lamp, and then a nighttime street scene with a man running.\n- The video cuts to a dimly lit room with two men seated across from each other, one in a dark suit and the other in a dark shirt, with a phone visible on a table.\n[270-300s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 5: FINANCIAL EDITING\" with bullet points about cross-cutting and other editing techniques.  \n- The background features a dark room with hanging lights, and the man is positioned centrally in the frame.\n[300-330s] - Two young men converse in a dimly lit room, one leaning forward while the other sits back, both focused on a document.\n- A man in a suit sits at a desk, reviewing papers, with a camera on a tripod visible behind him.\n- The scene transitions to a formal meeting with multiple men in suits seated around a long table, engaged in discussion.", "history_tokens": 978, "history_utf8_bytes": 3929, "recent_frame_times_s": [301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297], "recent_frames_sha256": "ad486e19586954c5dddb744196ae23ea475b5f1beb2f1829819c06d5ae526859", "num_recent_frames": 30, "tq": 716279.215719519, "t1": 716281.00709964, "ta": 716281.00709964, "te": 716281.20983267, "first_response_s": 1.7913801210233942, "answer_total_s": 1.9941131511004642, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 95, "content_group": "fb76d111b69fd9a748819f865a2cc420951e83afb7295e03dc94b652d98a482d", "question": {"question_id": "sample_95_a1842_q0", "video_id": 95, "video_path": "./videos/sample_95_real.mp4", "annotation_index": 1842, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 16, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_95_a1842_q0", "video_id": 95, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "008b48130fe422b6bd1199706b186936c05a8508fa5e99afa730801ec6082965", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "e27887e381d9da46d7902eedaf88e12f5ce96e84351c71ae0686988539ce7e38", "num_recent_frames": 16, "tq": 710213.842039988, "t1": 710221.362050748, "ta": 710221.362050748, "te": 710221.402792724, "first_response_s": 7.520010759937577, "answer_total_s": 7.560752735938877, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_95_a1842_q0", "video_id": 95, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "504296676daa15ca5f810715015df7c2d222c8c808cd5897726c18dbdbdf8132", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "e27887e381d9da46d7902eedaf88e12f5ce96e84351c71ae0686988539ce7e38", "num_recent_frames": 16, "tq": 710253.720215021, "t1": 710260.01909596, "ta": 710260.01909596, "te": 710260.057784677, "first_response_s": 6.298880938906223, "answer_total_s": 6.337569655966945, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 95, "content_group": "fb76d111b69fd9a748819f865a2cc420951e83afb7295e03dc94b652d98a482d", "question": {"question_id": "sample_95_a1843_q0", "video_id": 95, "video_path": "./videos/sample_95_real.mp4", "annotation_index": 1843, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 1."], "answer": "D", "time_stamp_s": 89, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_95_a1843_q0", "video_id": 95, "time_stamp_s": 89, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "961ac2aa60bf9342e990fa399cbbf98c3d19c1854e156303adf958927c18fe65", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.01726666666667, 85.01826666666666, 86.01926666666667, 87.02026666666667, 88.02126666666666], "recent_frames_sha256": "ad9118306b7b6b9d0b6e46810685fe1f163eab63352b52b505352b54b5dd9269", "num_recent_frames": 30, "tq": 710221.43613224, "t1": 710229.033619576, "ta": 710229.033619576, "te": 710229.073084919, "first_response_s": 7.597487336024642, "answer_total_s": 7.636952679022215, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_95_a1843_q0", "video_id": 95, "time_stamp_s": 89, "ground_truth": "D", "raw_output": "B. 3.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "f6520f70e7a5a268a34a6d5a34e70af66ba8b2c7e69b12732b391acdb0c9f453", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 6: DOCUMENTARY ELEMENTS\" with sections on \"INSTRUCTIONAL,\" \"HISTORICAL,\" and \"ELEMENTS,\" including lists like \"INTERVIEWS,\" \"R-ROLL,\" and \"DOCUMENTARY ELEMENTS.\"  \n- The man's name, \"Mr. Marklevitz Film Teacher,\" is visible at the bottom right of the screen.\n[30-60s] - Man in blue shirt gestures toward whiteboard with text about documentary elements.  \n- Whiteboard displays lesson title, instructional vs. narrative elements, and film examples.  \n- Black-and-white film clip of blacksmiths hammering metal appears at 0:52.", "history_tokens": 177, "history_utf8_bytes": 679, "recent_frame_times_s": [59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.01726666666667, 85.01826666666666, 86.01926666666667, 87.02026666666667, 88.02126666666666], "recent_frames_sha256": "ad9118306b7b6b9d0b6e46810685fe1f163eab63352b52b505352b54b5dd9269", "num_recent_frames": 30, "tq": 710284.126545902, "t1": 710291.251893003, "ta": 710291.251893003, "te": 710291.451039305, "first_response_s": 7.125347101013176, "answer_total_s": 7.3244934029644355, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 95, "content_group": "fb76d111b69fd9a748819f865a2cc420951e83afb7295e03dc94b652d98a482d", "question": {"question_id": "sample_95_a1844_q0", "video_id": 95, "video_path": "./videos/sample_95_real.mp4", "annotation_index": 1844, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 4.", "C. 6.", "D. 0."], "answer": "B", "time_stamp_s": 238, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_95_a1844_q0", "video_id": 95, "time_stamp_s": 238, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "da87e790f674521eb2e4556448e12ca1e51b468dae16417a8d39269ae4283476", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333], "recent_frames_sha256": "c6424e2aa0327070a67eed3854c77686e84ee4387fb13f1034ebe3787ca2d00b", "num_recent_frames": 30, "tq": 710229.083283203, "t1": 710235.191555613, "ta": 710235.191555613, "te": 710235.23045464, "first_response_s": 6.1082724099978805, "answer_total_s": 6.147171437041834, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_95_a1844_q0", "video_id": 95, "time_stamp_s": 238, "ground_truth": "B", "raw_output": "B. 4.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "87f573e11e2fa2a13467b2d01e808abdaa9cdbe1bf2b426ae263048bd1f44732", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 6: DOCUMENTARY ELEMENTS\" with sections on \"INSTRUCTIONAL,\" \"HISTORICAL,\" and \"ELEMENTS,\" including lists like \"INTERVIEWS,\" \"R-ROLL,\" and \"DOCUMENTARY ELEMENTS.\"  \n- The man's name, \"Mr. Marklevitz Film Teacher,\" is visible at the bottom right of the screen.\n[30-60s] - Man in blue shirt gestures toward whiteboard with text about documentary elements.  \n- Whiteboard displays lesson title, instructional vs. narrative elements, and film examples.  \n- Black-and-white film clip of blacksmiths hammering metal appears at 0:52.\n[60-90s] - Workers in dark attire exit a factory building, some carrying bags, moving toward the right side of the frame.  \n- A group of people stands near a doorway, observing the workers as they leave.  \n- The scene is in black and white, with a large industrial building in the background.\n[90-120s] - A man in a blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about documentary film elements, including \"INSTRUCTIONAL,\" \"HISTORICAL,\" and \"ENTERTAINMENT.\"  \n- The man points to the whiteboard, emphasizing the listed elements and their definitions.\n[120-150s] - A man in a blue shirt gestures toward a whiteboard displaying \"LESSON 6: DOCUMENTARY ELEMENTS\" with listed film elements.  \n- A woman in a red \"Tampa\" jersey smiles while holding a baseball glove on a field.  \n- Two men stand under a sign reading \"ANIMATION SHOW\" with \"TROLL 2 (1990)\" text overlayed on a scene of a child behind a fence.\n[150-180s] - A man in a blue shirt gestures toward a whiteboard displaying \"LESSON 6.1: DOCUMENTARY ELEMENTS\" with bullet points about documentary film elements.  \n- A montage of clips from \"Is Everybody Happy? (2010)\" shows live music performances, a jail cell, a man outside a building labeled \"BANTAM RECORDS,\" and a recording studio.  \n- The man in the blue shirt is seen speaking and gesturing, while the documentary clips play in the background.\n[180-210s] - A man in a light blue shirt gestures with both hands while standing beside a whiteboard displaying lesson content.  \n- The whiteboard lists \"LESSON 6: DOCUMENTARY ELEMENTS\" and details about documentary film types and elements.  \n- The man's gestures suggest he is explaining or emphasizing points from the lesson material.", "history_tokens": 613, "history_utf8_bytes": 2437, "recent_frame_times_s": [208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333], "recent_frames_sha256": "c6424e2aa0327070a67eed3854c77686e84ee4387fb13f1034ebe3787ca2d00b", "num_recent_frames": 30, "tq": 710331.287281545, "t1": 710342.448997139, "ta": 710342.448997139, "te": 710342.852057736, "first_response_s": 11.161715594003908, "answer_total_s": 11.564776191022247, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 95, "content_group": "fb76d111b69fd9a748819f865a2cc420951e83afb7295e03dc94b652d98a482d", "question": {"question_id": "sample_95_a1845_q0", "video_id": 95, "video_path": "./videos/sample_95_real.mp4", "annotation_index": 1845, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 4.", "C. 3.", "D. 7."], "answer": "B", "time_stamp_s": 258, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_95_a1845_q0", "video_id": 95, "time_stamp_s": 258, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "37e617bdda14bb4dde100dce2e357d2a996aebcdc85c1bfb978bbb74bec5e41c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334], "recent_frames_sha256": "3846dfef5f3424fa44c79cd81a5a0baa6390dd0ae6e57349635a915bfd09c038", "num_recent_frames": 30, "tq": 710235.241014097, "t1": 710246.444775297, "ta": 710246.444775297, "te": 710246.515528338, "first_response_s": 11.203761199954897, "answer_total_s": 11.274514241027646, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_95_a1845_q0", "video_id": 95, "time_stamp_s": 258, "ground_truth": "B", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "b803ea460681122f154528bcd904846876f1615c624d4aea5795225ccbdb561f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 6: DOCUMENTARY ELEMENTS\" with sections on \"INSTRUCTIONAL,\" \"HISTORICAL,\" and \"ELEMENTS,\" including lists like \"INTERVIEWS,\" \"R-ROLL,\" and \"DOCUMENTARY ELEMENTS.\"  \n- The man's name, \"Mr. Marklevitz Film Teacher,\" is visible at the bottom right of the screen.\n[30-60s] - Man in blue shirt gestures toward whiteboard with text about documentary elements.  \n- Whiteboard displays lesson title, instructional vs. narrative elements, and film examples.  \n- Black-and-white film clip of blacksmiths hammering metal appears at 0:52.\n[60-90s] - Workers in dark attire exit a factory building, some carrying bags, moving toward the right side of the frame.  \n- A group of people stands near a doorway, observing the workers as they leave.  \n- The scene is in black and white, with a large industrial building in the background.\n[90-120s] - A man in a blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about documentary film elements, including \"INSTRUCTIONAL,\" \"HISTORICAL,\" and \"ENTERTAINMENT.\"  \n- The man points to the whiteboard, emphasizing the listed elements and their definitions.\n[120-150s] - A man in a blue shirt gestures toward a whiteboard displaying \"LESSON 6: DOCUMENTARY ELEMENTS\" with listed film elements.  \n- A woman in a red \"Tampa\" jersey smiles while holding a baseball glove on a field.  \n- Two men stand under a sign reading \"ANIMATION SHOW\" with \"TROLL 2 (1990)\" text overlayed on a scene of a child behind a fence.\n[150-180s] - A man in a blue shirt gestures toward a whiteboard displaying \"LESSON 6.1: DOCUMENTARY ELEMENTS\" with bullet points about documentary film elements.  \n- A montage of clips from \"Is Everybody Happy? (2010)\" shows live music performances, a jail cell, a man outside a building labeled \"BANTAM RECORDS,\" and a recording studio.  \n- The man in the blue shirt is seen speaking and gesturing, while the documentary clips play in the background.\n[180-210s] - A man in a light blue shirt gestures with both hands while standing beside a whiteboard displaying lesson content.  \n- The whiteboard lists \"LESSON 6: DOCUMENTARY ELEMENTS\" and details about documentary film types and elements.  \n- The man's gestures suggest he is explaining or emphasizing points from the lesson material.\n[210-240s] - A man in a blue shirt adjusts his hair with both hands, appearing focused or distressed.  \n- Another man in a grey sweatshirt leans against a white pole, holding a small object, with a house and grass in the background.  \n- A third man in a white shirt speaks in a dimly lit room with a mesh background, suggesting an interview or interrogation setting.", "history_tokens": 699, "history_utf8_bytes": 2804, "recent_frame_times_s": [228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334], "recent_frames_sha256": "3846dfef5f3424fa44c79cd81a5a0baa6390dd0ae6e57349635a915bfd09c038", "num_recent_frames": 30, "tq": 710347.339802521, "t1": 710354.510104545, "ta": 710354.510104545, "te": 710354.771616787, "first_response_s": 7.170302023994736, "answer_total_s": 7.4318142659030855, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 95, "content_group": "fb76d111b69fd9a748819f865a2cc420951e83afb7295e03dc94b652d98a482d", "question": {"question_id": "sample_95_a1846_q0", "video_id": 95, "video_path": "./videos/sample_95_real.mp4", "annotation_index": 1846, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 4.", "C. 9.", "D. 6."], "answer": "B", "time_stamp_s": 340, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_95_a1846_q0", "video_id": 95, "time_stamp_s": 340, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a06b118e3a927e273bf10d92dd0cd0185977985ac50bb113c322c3b62ea641e7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317, 333.0327, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334], "recent_frames_sha256": "3dc1f83c8476ebad8e6bbae560be20f93f016fc4399edce2f60662292f4f0950", "num_recent_frames": 30, "tq": 710246.545913228, "t1": 710253.673043745, "ta": 710253.673043745, "te": 710253.711404037, "first_response_s": 7.127130517037585, "answer_total_s": 7.165490809013136, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_95_a1846_q0", "video_id": 95, "time_stamp_s": 340, "ground_truth": "B", "raw_output": "B. 4.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "13034e3ea06c218d036ee3e8aa8a479715e60968f12f189768255bd437eddcdc", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text titled \"LESSON 6: DOCUMENTARY ELEMENTS\" with sections on \"INSTRUCTIONAL,\" \"HISTORICAL,\" and \"ELEMENTS,\" including lists like \"INTERVIEWS,\" \"R-ROLL,\" and \"DOCUMENTARY ELEMENTS.\"  \n- The man's name, \"Mr. Marklevitz Film Teacher,\" is visible at the bottom right of the screen.\n[30-60s] - Man in blue shirt gestures toward whiteboard with text about documentary elements.  \n- Whiteboard displays lesson title, instructional vs. narrative elements, and film examples.  \n- Black-and-white film clip of blacksmiths hammering metal appears at 0:52.\n[60-90s] - Workers in dark attire exit a factory building, some carrying bags, moving toward the right side of the frame.  \n- A group of people stands near a doorway, observing the workers as they leave.  \n- The scene is in black and white, with a large industrial building in the background.\n[90-120s] - A man in a blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about documentary film elements, including \"INSTRUCTIONAL,\" \"HISTORICAL,\" and \"ENTERTAINMENT.\"  \n- The man points to the whiteboard, emphasizing the listed elements and their definitions.\n[120-150s] - A man in a blue shirt gestures toward a whiteboard displaying \"LESSON 6: DOCUMENTARY ELEMENTS\" with listed film elements.  \n- A woman in a red \"Tampa\" jersey smiles while holding a baseball glove on a field.  \n- Two men stand under a sign reading \"ANIMATION SHOW\" with \"TROLL 2 (1990)\" text overlayed on a scene of a child behind a fence.\n[150-180s] - A man in a blue shirt gestures toward a whiteboard displaying \"LESSON 6.1: DOCUMENTARY ELEMENTS\" with bullet points about documentary film elements.  \n- A montage of clips from \"Is Everybody Happy? (2010)\" shows live music performances, a jail cell, a man outside a building labeled \"BANTAM RECORDS,\" and a recording studio.  \n- The man in the blue shirt is seen speaking and gesturing, while the documentary clips play in the background.\n[180-210s] - A man in a light blue shirt gestures with both hands while standing beside a whiteboard displaying lesson content.  \n- The whiteboard lists \"LESSON 6: DOCUMENTARY ELEMENTS\" and details about documentary film types and elements.  \n- The man's gestures suggest he is explaining or emphasizing points from the lesson material.\n[210-240s] - A man in a blue shirt adjusts his hair with both hands, appearing focused or distressed.  \n- Another man in a grey sweatshirt leans against a white pole, holding a small object, with a house and grass in the background.  \n- A third man in a white shirt speaks in a dimly lit room with a mesh background, suggesting an interview or interrogation setting.\n[240-270s] - A man in a blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"LESSON 6: DOCUMENTARY ELEMENTS\" and lists categories like \"INSTRUCTIONAL,\" \"HISTORICAL,\" and \"ENTERTAINMENT.\"  \n- The man’s hands move expressively as he points to different sections of the whiteboard, indicating emphasis on the listed elements.\n[270-300s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text about documentary film elements, including categories like \"INSTRUCTIONAL,\" \"HISTORICAL,\" and \"ENTERTAINMENT.\"  \n- The man’s hands move expressively as he explains the content, indicating active engagement with the material.\n[300-330s] - A man in a blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text about documentary film elements, including \"INSTRUCTIONAL,\" \"HISTORICAL,\" and \"ENTERTAINMENT.\"  \n- The man’s hands move expressively as he points to different sections of the whiteboard.", "history_tokens": 972, "history_utf8_bytes": 3903, "recent_frame_times_s": [310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317, 333.0327, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334], "recent_frames_sha256": "3dc1f83c8476ebad8e6bbae560be20f93f016fc4399edce2f60662292f4f0950", "num_recent_frames": 30, "tq": 710377.148773654, "t1": 710384.968350946, "ta": 710384.968350946, "te": 710385.330086008, "first_response_s": 7.819577291957103, "answer_total_s": 8.181312353932299, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 96, "content_group": "d9f0a49331a9fb904285a073af642abf9b974fa48bc4b0e2932ee5de1cd0fd4e", "question": {"question_id": "sample_96_a1630_q0", "video_id": 96, "video_path": "./videos/sample_96_real.mp4", "annotation_index": 1630, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 16, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_96_a1630_q0", "video_id": 96, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c4ea3944e8ef67481ccf8c000fb6e5316d8120d8ca3b9b179d35023c83a7fe7b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "04b9e550ba4ad62ce612d107b7fd42af3a0103a6b8a92fa759548b105075a21a", "num_recent_frames": 16, "tq": 710499.267738773, "t1": 710499.828418774, "ta": 710499.828418774, "te": 710499.865578617, "first_response_s": 0.5606800009263679, "answer_total_s": 0.5978398439474404, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_96_a1630_q0", "video_id": 96, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ccd8a72d5897dc289ca0eb0a281c3e12244f4d376427cef98531658627b1ebc0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "04b9e550ba4ad62ce612d107b7fd42af3a0103a6b8a92fa759548b105075a21a", "num_recent_frames": 16, "tq": 710366.387315967, "t1": 710372.735037934, "ta": 710372.735037934, "te": 710372.88997889, "first_response_s": 6.347721967031248, "answer_total_s": 6.502662922954187, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 96, "content_group": "d9f0a49331a9fb904285a073af642abf9b974fa48bc4b0e2932ee5de1cd0fd4e", "question": {"question_id": "sample_96_a1631_q0", "video_id": 96, "video_path": "./videos/sample_96_real.mp4", "annotation_index": 1631, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 1."], "answer": "D", "time_stamp_s": 60, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_96_a1631_q0", "video_id": 96, "time_stamp_s": 60, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b85fa741a232f9998f76fe27486ffb3602f3be343d297019dd062fa9465c3961", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333], "recent_frames_sha256": "9d39503c29faebbd9bcd9fe9d6711d92f86df632554ace8c45f651fc34eff2dc", "num_recent_frames": 30, "tq": 710499.885278348, "t1": 710511.837895583, "ta": 710511.837895583, "te": 710511.87816997, "first_response_s": 11.952617235016078, "answer_total_s": 11.992891622008756, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_96_a1631_q0", "video_id": 96, "time_stamp_s": 60, "ground_truth": "D", "raw_output": "B. 3.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "5216c5ee122a406f583cd89b10e6a9c66647a5cb6369520b83577e8585d3680d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 6.2: PLANNING A DOCUMENTARY\" with sections on choosing a purpose, audience, and elements like \"INTRODUCE,\" \"EXPLAIN,\" and \"CONCLUDE.\"  \n- The man's gestures and body language suggest he is explaining or teaching the content on the board.\n[30-60s] - A man in a blue shirt gestures toward a whiteboard displaying \"Lesson 6.2: Planning a Documentary\" with bullet points on purpose, audience, and objectives.  \n- The video transitions to a scene from \"Grizzly Man (2005)\" showing a man walking through tall grass.  \n- A scene from \"The Thin Blue Line (1988)\" features a man in a white shirt sitting in a dimly lit room with a mesh background.", "history_tokens": 203, "history_utf8_bytes": 782, "recent_frame_times_s": [30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333], "recent_frames_sha256": "9d39503c29faebbd9bcd9fe9d6711d92f86df632554ace8c45f651fc34eff2dc", "num_recent_frames": 30, "tq": 710390.402801086, "t1": 710397.758740816, "ta": 710397.758740816, "te": 710398.021240747, "first_response_s": 7.355939730070531, "answer_total_s": 7.618439660989679, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 96, "content_group": "d9f0a49331a9fb904285a073af642abf9b974fa48bc4b0e2932ee5de1cd0fd4e", "question": {"question_id": "sample_96_a1632_q0", "video_id": 96, "video_path": "./videos/sample_96_real.mp4", "annotation_index": 1632, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 4.", "C. 6.", "D. 0."], "answer": "A", "time_stamp_s": 195, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_96_a1632_q0", "video_id": 96, "time_stamp_s": 195, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9e2619484bb2d6e06c7acb0d61c014eee69be3b12a4bd3166cd62a56cad895e1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666], "recent_frames_sha256": "b599e4e9352e3aec1a428fa5aff5e9544ab42d3aad8429997e5a4ee5cf81f410", "num_recent_frames": 30, "tq": 710511.890816064, "t1": 710524.738928983, "ta": 710524.738928983, "te": 710524.778348638, "first_response_s": 12.848112919018604, "answer_total_s": 12.887532574008219, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_96_a1632_q0", "video_id": 96, "time_stamp_s": 195, "ground_truth": "A", "raw_output": "B. 4.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "7a36df3a6bd672a3e27fa343218b62aa119fa2fedd560e03f580e7359d8ce4b2", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 6.2: PLANNING A DOCUMENTARY\" with sections on choosing a purpose, audience, and elements like \"INTRODUCE,\" \"EXPLAIN,\" and \"CONCLUDE.\"  \n- The man's gestures and body language suggest he is explaining or teaching the content on the board.\n[30-60s] - A man in a blue shirt gestures toward a whiteboard displaying \"Lesson 6.2: Planning a Documentary\" with bullet points on purpose, audience, and objectives.  \n- The video transitions to a scene from \"Grizzly Man (2005)\" showing a man walking through tall grass.  \n- A scene from \"The Thin Blue Line (1988)\" features a man in a white shirt sitting in a dimly lit room with a mesh background.\n[60-90s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text in various colors, including \"LESSON 6.2: PLANNING A DOCUMENTARY\" and sections like \"CHOOSE A PURPOSE\" and \"CHOOSE A THEME.\"  \n- The background is dark, with a faintly visible wooden easel supporting the whiteboard.\n[90-120s] - A large aqueduct with multiple arches spans a street, with vehicles and pedestrians below.  \n- A train travels across a metal bridge with curved railings, set against a rocky cliffside.  \n- A man in a hat sits on a stone seawall, watching waves crash against it, with a coastal town in the background.\n[120-150s] - A man in a blue shirt gestures toward a whiteboard displaying \"Lesson 6.2: Planning a Documentary\" with bullet points about purpose, audience, and type.\n- Black-and-white archival footage shows soldiers loading parcels onto a truck, with text overlay \"Parcels for the Front (1915)\".\n- Another black-and-white clip shows a man holding a box labeled \"SOUP\" with text \"One Hundred Percent American (1918)\".\n[150-180s] - A man in a suit gestures toward a figure in a Liberty costume standing under a \"LIBERTY\" tent.  \n- Another man in a suit gestures toward a figure in an \"INDUSTRY\" tent, where a man in a suit is bent over a machine.  \n- A man in uniform raises his right arm in a salute, with a large crowd and flags visible in the background.", "history_tokens": 572, "history_utf8_bytes": 2210, "recent_frame_times_s": [165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666], "recent_frames_sha256": "b599e4e9352e3aec1a428fa5aff5e9544ab42d3aad8429997e5a4ee5cf81f410", "num_recent_frames": 30, "tq": 710428.317597943, "t1": 710436.659464711, "ta": 710436.659464711, "te": 710436.869009727, "first_response_s": 8.341866767965257, "answer_total_s": 8.551411784021184, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 96, "content_group": "d9f0a49331a9fb904285a073af642abf9b974fa48bc4b0e2932ee5de1cd0fd4e", "question": {"question_id": "sample_96_a1633_q0", "video_id": 96, "video_path": "./videos/sample_96_real.mp4", "annotation_index": 1633, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 5.", "C. 3.", "D. 7."], "answer": "B", "time_stamp_s": 268, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_96_a1633_q0", "video_id": 96, "time_stamp_s": 268, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fcad0f334942e7150987645c7852ce89d94e35cee31e38c7df7e154d9c52e5bf", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667], "recent_frames_sha256": "9ec43b69dbef534be059c5f2e72d7999422bd4877140ec349f77ee72fcdab471", "num_recent_frames": 30, "tq": 710524.792562573, "t1": 710537.692957544, "ta": 710537.692957544, "te": 710537.730173792, "first_response_s": 12.900394971016794, "answer_total_s": 12.937611219007522, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_96_a1633_q0", "video_id": 96, "time_stamp_s": 268, "ground_truth": "B", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "eb8f70f8e589ed596aa43e21fe0f0fbfffd63551ed1078fa9ea0dc2f6376ebe4", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 6.2: PLANNING A DOCUMENTARY\" with sections on choosing a purpose, audience, and elements like \"INTRODUCE,\" \"EXPLAIN,\" and \"CONCLUDE.\"  \n- The man's gestures and body language suggest he is explaining or teaching the content on the board.\n[30-60s] - A man in a blue shirt gestures toward a whiteboard displaying \"Lesson 6.2: Planning a Documentary\" with bullet points on purpose, audience, and objectives.  \n- The video transitions to a scene from \"Grizzly Man (2005)\" showing a man walking through tall grass.  \n- A scene from \"The Thin Blue Line (1988)\" features a man in a white shirt sitting in a dimly lit room with a mesh background.\n[60-90s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text in various colors, including \"LESSON 6.2: PLANNING A DOCUMENTARY\" and sections like \"CHOOSE A PURPOSE\" and \"CHOOSE A THEME.\"  \n- The background is dark, with a faintly visible wooden easel supporting the whiteboard.\n[90-120s] - A large aqueduct with multiple arches spans a street, with vehicles and pedestrians below.  \n- A train travels across a metal bridge with curved railings, set against a rocky cliffside.  \n- A man in a hat sits on a stone seawall, watching waves crash against it, with a coastal town in the background.\n[120-150s] - A man in a blue shirt gestures toward a whiteboard displaying \"Lesson 6.2: Planning a Documentary\" with bullet points about purpose, audience, and type.\n- Black-and-white archival footage shows soldiers loading parcels onto a truck, with text overlay \"Parcels for the Front (1915)\".\n- Another black-and-white clip shows a man holding a box labeled \"SOUP\" with text \"One Hundred Percent American (1918)\".\n[150-180s] - A man in a suit gestures toward a figure in a Liberty costume standing under a \"LIBERTY\" tent.  \n- Another man in a suit gestures toward a figure in an \"INDUSTRY\" tent, where a man in a suit is bent over a machine.  \n- A man in uniform raises his right arm in a salute, with a large crowd and flags visible in the background.\n[180-210s] - A man in a light-colored shirt walks away from the camera, passing a piano and other instruments on stage.  \n- A musician with curly hair is seen from behind, moving toward the piano.  \n- A close-up shows a man with glasses playing a keyboard, with microphones positioned nearby.\n[210-240s] - A man in a blue shirt gestures toward a whiteboard displaying \"Lesson 6.2: Planning a Documentary\" with sections on purpose, audience, and objectives.  \n- The whiteboard lists categories like \"INFORM,\" \"EDUCATE,\" \"ENTERTAIN,\" and \"CHOOSE A PURPOSE\" with subpoints such as \"EXPERIMENTAL,\" \"DOCUMENTARY,\" and \"VISUAL.\"  \n- The man stands in front of the whiteboard, using hand motions to emphasize points while speaking.", "history_tokens": 756, "history_utf8_bytes": 2935, "recent_frame_times_s": [238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667], "recent_frames_sha256": "9ec43b69dbef534be059c5f2e72d7999422bd4877140ec349f77ee72fcdab471", "num_recent_frames": 30, "tq": 710455.730513089, "t1": 710463.462759465, "ta": 710463.462759465, "te": 710463.741539588, "first_response_s": 7.732246375991963, "answer_total_s": 8.011026498978026, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 96, "content_group": "d9f0a49331a9fb904285a073af642abf9b974fa48bc4b0e2932ee5de1cd0fd4e", "question": {"question_id": "sample_96_a1634_q0", "video_id": 96, "video_path": "./videos/sample_96_real.mp4", "annotation_index": 1634, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 4.", "C. 9.", "D. 6."], "answer": "D", "time_stamp_s": 340, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_96_a1634_q0", "video_id": 96, "time_stamp_s": 340, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "32fec77813a5a93e29e6bf298782449e80a246985716039641abd92bc649bd2b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317, 333.0327, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334], "recent_frames_sha256": "64474e365e183fd84bd6f89a91822fd5d222f163ac7e2b5d3a28ecf0e8b83124", "num_recent_frames": 30, "tq": 710537.745130324, "t1": 710551.630842852, "ta": 710551.630842852, "te": 710551.66759958, "first_response_s": 13.885712528019212, "answer_total_s": 13.922469255980104, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_96_a1634_q0", "video_id": 96, "time_stamp_s": 340, "ground_truth": "D", "raw_output": "B. 4.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "598a0d8c8c5119d310d95d78c51247b142c668f5825cfd7b4a32ed046113cbf5", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"LESSON 6.2: PLANNING A DOCUMENTARY\" with sections on choosing a purpose, audience, and elements like \"INTRODUCE,\" \"EXPLAIN,\" and \"CONCLUDE.\"  \n- The man's gestures and body language suggest he is explaining or teaching the content on the board.\n[30-60s] - A man in a blue shirt gestures toward a whiteboard displaying \"Lesson 6.2: Planning a Documentary\" with bullet points on purpose, audience, and objectives.  \n- The video transitions to a scene from \"Grizzly Man (2005)\" showing a man walking through tall grass.  \n- A scene from \"The Thin Blue Line (1988)\" features a man in a white shirt sitting in a dimly lit room with a mesh background.\n[60-90s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text in various colors, including \"LESSON 6.2: PLANNING A DOCUMENTARY\" and sections like \"CHOOSE A PURPOSE\" and \"CHOOSE A THEME.\"  \n- The background is dark, with a faintly visible wooden easel supporting the whiteboard.\n[90-120s] - A large aqueduct with multiple arches spans a street, with vehicles and pedestrians below.  \n- A train travels across a metal bridge with curved railings, set against a rocky cliffside.  \n- A man in a hat sits on a stone seawall, watching waves crash against it, with a coastal town in the background.\n[120-150s] - A man in a blue shirt gestures toward a whiteboard displaying \"Lesson 6.2: Planning a Documentary\" with bullet points about purpose, audience, and type.\n- Black-and-white archival footage shows soldiers loading parcels onto a truck, with text overlay \"Parcels for the Front (1915)\".\n- Another black-and-white clip shows a man holding a box labeled \"SOUP\" with text \"One Hundred Percent American (1918)\".\n[150-180s] - A man in a suit gestures toward a figure in a Liberty costume standing under a \"LIBERTY\" tent.  \n- Another man in a suit gestures toward a figure in an \"INDUSTRY\" tent, where a man in a suit is bent over a machine.  \n- A man in uniform raises his right arm in a salute, with a large crowd and flags visible in the background.\n[180-210s] - A man in a light-colored shirt walks away from the camera, passing a piano and other instruments on stage.  \n- A musician with curly hair is seen from behind, moving toward the piano.  \n- A close-up shows a man with glasses playing a keyboard, with microphones positioned nearby.\n[210-240s] - A man in a blue shirt gestures toward a whiteboard displaying \"Lesson 6.2: Planning a Documentary\" with sections on purpose, audience, and objectives.  \n- The whiteboard lists categories like \"INFORM,\" \"EDUCATE,\" \"ENTERTAIN,\" and \"CHOOSE A PURPOSE\" with subpoints such as \"EXPERIMENTAL,\" \"DOCUMENTARY,\" and \"VISUAL.\"  \n- The man stands in front of the whiteboard, using hand motions to emphasize points while speaking.\n[240-270s] - A man in a suit stands in a crowded room, facing a large audience, with his back to the camera.  \n- The audience, composed of many people in formal attire, is seated and standing, some clapping or looking toward the man.  \n- A text overlay at the bottom reads \"Primary (1960),\" indicating the historical context of the scene.\n[270-300s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text titled \"LESSON 6.2: Planning a Documentary,\" with sections on choosing a purpose, audience, and type.  \n- The man’s hands move expressively as he explains, occasionally pointing to different parts of the whiteboard.\n[300-330s] - A man in a light blue shirt stands beside a whiteboard, gesturing toward its content.  \n- The whiteboard displays \"LESSON 6.2: Planning a Documentary\" with bullet points about choosing a purpose and audience.  \n- The scene transitions to black-and-white clips from \"High School (1968)\" showing students and teachers in vintage settings.", "history_tokens": 1017, "history_utf8_bytes": 3991, "recent_frame_times_s": [310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317, 333.0327, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334], "recent_frames_sha256": "64474e365e183fd84bd6f89a91822fd5d222f163ac7e2b5d3a28ecf0e8b83124", "num_recent_frames": 30, "tq": 710486.323459511, "t1": 710499.005872963, "ta": 710499.005872963, "te": 710499.225027274, "first_response_s": 12.682413451955654, "answer_total_s": 12.901567762950435, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 97, "content_group": "72964b486ad0252d88bdd3cb155f3d8d8051be6aa8e966a21c327326bd663cc0", "question": {"question_id": "sample_97_a142_q0", "video_id": 97, "video_path": "./videos/sample_97_real.mp4", "annotation_index": 142, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 16, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_97_a142_q0", "video_id": 97, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ced0e118f6338a6df612f10550656a50986fd33602ba20e3f8de0d5d2c97b5dc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "57c844288ddbf3d1175f983548a694e0207bff474be47f7357f2ef7b7e31e7f1", "num_recent_frames": 16, "tq": 719417.244334284, "t1": 719418.155260233, "ta": 719418.155260233, "te": 719418.193786197, "first_response_s": 0.9109259489923716, "answer_total_s": 0.9494519130093977, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_97_a142_q0", "video_id": 97, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e55ce9acc8277c95dcc107826d0bf58d7e44eb86a444d41c9b2e1f939afb40b4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "57c844288ddbf3d1175f983548a694e0207bff474be47f7357f2ef7b7e31e7f1", "num_recent_frames": 16, "tq": 719342.875994515, "t1": 719344.300385304, "ta": 719344.300385304, "te": 719344.526554723, "first_response_s": 1.424390789004974, "answer_total_s": 1.6505602080142125, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 97, "content_group": "72964b486ad0252d88bdd3cb155f3d8d8051be6aa8e966a21c327326bd663cc0", "question": {"question_id": "sample_97_a142_q1", "video_id": 97, "video_path": "./videos/sample_97_real.mp4", "annotation_index": 142, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 50, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_97_a142_q1", "video_id": 97, "time_stamp_s": 50, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "66e974c9c9061bcde330123ff1a13d97d1c788ce48da4d8a8786ba566f4a0985", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [20.02, 21.021, 22.022, 23.023, 24.024, 25.025, 26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334], "recent_frames_sha256": "5cbffa35a2a788cb9ed737e3e7cfd4b1a8c6f38075a84f8b84dd65c81b11d748", "num_recent_frames": 30, "tq": 719418.220616656, "t1": 719431.320251391, "ta": 719431.320251391, "te": 719431.358589141, "first_response_s": 13.099634735030122, "answer_total_s": 13.137972485041246, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_97_a142_q1", "video_id": 97, "time_stamp_s": 50, "ground_truth": "D", "raw_output": "D. 0.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "03c34af4a775a1652870ba23c606d826a802b0b7d75b78582b5b1cdc3a0116d5", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man stands in front of a whiteboard titled \"Lesson 6: Basics of Animation,\" gesturing with his hands while speaking.  \n- The whiteboard lists key animation concepts such as \"Animation: Photographic Success\" and \"Persistence of Vision.\"  \n- The man is positioned slightly to the right of the whiteboard, with his body angled toward the camera, appearing to explain the content.", "history_tokens": 88, "history_utf8_bytes": 388, "recent_frame_times_s": [20.02, 21.021, 22.022, 23.023, 24.024, 25.025, 26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334], "recent_frames_sha256": "5cbffa35a2a788cb9ed737e3e7cfd4b1a8c6f38075a84f8b84dd65c81b11d748", "num_recent_frames": 30, "tq": 719355.858336634, "t1": 719356.271466132, "ta": 719356.271466132, "te": 719356.465741907, "first_response_s": 0.41312949801795185, "answer_total_s": 0.6074052730109543, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 97, "content_group": "72964b486ad0252d88bdd3cb155f3d8d8051be6aa8e966a21c327326bd663cc0", "question": {"question_id": "sample_97_a143_q0", "video_id": 97, "video_path": "./videos/sample_97_real.mp4", "annotation_index": 143, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 60, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_97_a143_q0", "video_id": 97, "time_stamp_s": 60, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ec441739cb9062ae042934560e0007210d7ee29fc1a60dd4e141d754e270e624", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333], "recent_frames_sha256": "4d077bc42e55d267e78422dae51c9f8f7a3d3004c79dbeec1a6583950625a7a1", "num_recent_frames": 30, "tq": 719431.37980122, "t1": 719442.104264881, "ta": 719442.104264881, "te": 719442.142619544, "first_response_s": 10.724463660968468, "answer_total_s": 10.762818324030377, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_97_a143_q0", "video_id": 97, "time_stamp_s": 60, "ground_truth": "D", "raw_output": "D. 0.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "2d2fcd6361f675e316d1fb702efcc1e59f99639645cdebd38c194dbadaee8ad0", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man stands in front of a whiteboard titled \"Lesson 6: Basics of Animation,\" gesturing with his hands while speaking.  \n- The whiteboard lists key animation concepts such as \"Animation: Photographic Success\" and \"Persistence of Vision.\"  \n- The man is positioned slightly to the right of the whiteboard, with his body angled toward the camera, appearing to explain the content.\n[30-60s] - A man in a gray shirt stands beside a whiteboard, gesturing toward its content with his right hand.  \n- The whiteboard displays text titled \"LESSON 6: BASICS OF ANIMATION\" with bullet points about animation, photography, and persistence of vision.  \n- The man’s left hand rests near his waist, and he occasionally shifts his stance while speaking.", "history_tokens": 173, "history_utf8_bytes": 749, "recent_frame_times_s": [30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333], "recent_frames_sha256": "4d077bc42e55d267e78422dae51c9f8f7a3d3004c79dbeec1a6583950625a7a1", "num_recent_frames": 30, "tq": 719368.845104087, "t1": 719370.151655767, "ta": 719370.151655767, "te": 719370.342457786, "first_response_s": 1.306551679968834, "answer_total_s": 1.497353698941879, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 97, "content_group": "72964b486ad0252d88bdd3cb155f3d8d8051be6aa8e966a21c327326bd663cc0", "question": {"question_id": "sample_97_a144_q0", "video_id": 97, "video_path": "./videos/sample_97_real.mp4", "annotation_index": 144, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 4.", "C. 6.", "D. 0."], "answer": "A", "time_stamp_s": 209, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_97_a144_q0", "video_id": 97, "time_stamp_s": 209, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "42f49308f3fe52935084c752cc452d77616091e019f9c3792dadeb5960d81d99", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078], "recent_frames_sha256": "b4fa6c85fd112acf06d00e53dc8e4d378f52a1247498c96763ce81dc1e2260e0", "num_recent_frames": 30, "tq": 719442.153934518, "t1": 719449.594874622, "ta": 719449.594874622, "te": 719449.633309596, "first_response_s": 7.440940103959292, "answer_total_s": 7.479375077993609, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_97_a144_q0", "video_id": 97, "time_stamp_s": 209, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "07ea2b74738ac926b55dbcfa27b0b8bafe8830f5430018edc374784f7d090199", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man stands in front of a whiteboard titled \"Lesson 6: Basics of Animation,\" gesturing with his hands while speaking.  \n- The whiteboard lists key animation concepts such as \"Animation: Photographic Success\" and \"Persistence of Vision.\"  \n- The man is positioned slightly to the right of the whiteboard, with his body angled toward the camera, appearing to explain the content.\n[30-60s] - A man in a gray shirt stands beside a whiteboard, gesturing toward its content with his right hand.  \n- The whiteboard displays text titled \"LESSON 6: BASICS OF ANIMATION\" with bullet points about animation, photography, and persistence of vision.  \n- The man’s left hand rests near his waist, and he occasionally shifts his stance while speaking.\n[60-90s] - A hand draws a stick figure on a translucent sheet placed over a lightbox, using a pen.  \n- The stick figure is drawn with a circular head, two lines for arms, and two lines for legs.  \n- The drawing is completed and then the sheet is shown being held in a stack of white paper.\n[90-120s] - A man in a red shirt stands in a dimly lit room, holding a glowing, curved object that emits light.  \n- A young girl sits at a table nearby, observing the man’s actions.  \n- A close-up shot shows a spinning metallic device with a red thread, held by a hand.\n[120-150s] - A man in a gray shirt stands beside a whiteboard, gesturing toward its content with his hands.  \n- The whiteboard displays text titled \"LESSON 6: BASICS OF ANIMATION,\" including bullet points about animation, persistence of vision, and a single photographic image.  \n- The man’s gestures and body language suggest he is explaining or emphasizing the points written on the board.\n[150-180s] - A man in a dark shirt gestures toward a whiteboard displaying \"Lesson 6: Basics of Animation\" with bullet points on motion, persistence of vision, and frame rates.\n- The man points to the whiteboard while speaking, emphasizing concepts like \"24 frames per second\" and \"16 seconds\" for a single photographic image.\n- The scene transitions to a sepia-toned animation sequence showing a person in a robe climbing a ladder, followed by a horse racing illustration.", "history_tokens": 516, "history_utf8_bytes": 2179, "recent_frame_times_s": [179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078], "recent_frames_sha256": "b4fa6c85fd112acf06d00e53dc8e4d378f52a1247498c96763ce81dc1e2260e0", "num_recent_frames": 30, "tq": 719401.781687945, "t1": 719403.807212873, "ta": 719403.807212873, "te": 719403.956558471, "first_response_s": 2.025524928001687, "answer_total_s": 2.1748705259524286, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 97, "content_group": "72964b486ad0252d88bdd3cb155f3d8d8051be6aa8e966a21c327326bd663cc0", "question": {"question_id": "sample_97_a145_q0", "video_id": 97, "video_path": "./videos/sample_97_real.mp4", "annotation_index": 145, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 5.", "C. 3.", "D. 7."], "answer": "B", "time_stamp_s": 254, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_97_a145_q0", "video_id": 97, "time_stamp_s": 254, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d7b778259bd876dc8255c9be335d2ffab3c428e2248b0cd3ef54bf3844d86869", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332], "recent_frames_sha256": "2299c173890f9c033c7aace2d03f405c5011574f3f1b08a0362e4afcd85fef28", "num_recent_frames": 30, "tq": 719449.647978338, "t1": 719461.549372456, "ta": 719461.549372456, "te": 719461.586816198, "first_response_s": 11.901394118089229, "answer_total_s": 11.938837860012427, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_97_a145_q0", "video_id": 97, "time_stamp_s": 254, "ground_truth": "B", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "43e9d454b02f78473d50e163f94b6eb3845b33f7ab436fafd8436870e2adbbe1", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man stands in front of a whiteboard titled \"Lesson 6: Basics of Animation,\" gesturing with his hands while speaking.  \n- The whiteboard lists key animation concepts such as \"Animation: Photographic Success\" and \"Persistence of Vision.\"  \n- The man is positioned slightly to the right of the whiteboard, with his body angled toward the camera, appearing to explain the content.\n[30-60s] - A man in a gray shirt stands beside a whiteboard, gesturing toward its content with his right hand.  \n- The whiteboard displays text titled \"LESSON 6: BASICS OF ANIMATION\" with bullet points about animation, photography, and persistence of vision.  \n- The man’s left hand rests near his waist, and he occasionally shifts his stance while speaking.\n[60-90s] - A hand draws a stick figure on a translucent sheet placed over a lightbox, using a pen.  \n- The stick figure is drawn with a circular head, two lines for arms, and two lines for legs.  \n- The drawing is completed and then the sheet is shown being held in a stack of white paper.\n[90-120s] - A man in a red shirt stands in a dimly lit room, holding a glowing, curved object that emits light.  \n- A young girl sits at a table nearby, observing the man’s actions.  \n- A close-up shot shows a spinning metallic device with a red thread, held by a hand.\n[120-150s] - A man in a gray shirt stands beside a whiteboard, gesturing toward its content with his hands.  \n- The whiteboard displays text titled \"LESSON 6: BASICS OF ANIMATION,\" including bullet points about animation, persistence of vision, and a single photographic image.  \n- The man’s gestures and body language suggest he is explaining or emphasizing the points written on the board.\n[150-180s] - A man in a dark shirt gestures toward a whiteboard displaying \"Lesson 6: Basics of Animation\" with bullet points on motion, persistence of vision, and frame rates.\n- The man points to the whiteboard while speaking, emphasizing concepts like \"24 frames per second\" and \"16 seconds\" for a single photographic image.\n- The scene transitions to a sepia-toned animation sequence showing a person in a robe climbing a ladder, followed by a horse racing illustration.\n[180-210s] - A man in a dark vest and yellow pants rides a brown horse in mid-gallop, with a stable building in the background.  \n- A whiteboard displays \"Lesson 6: Basics of Animation\" with bullet points about animation, persistence of vision, and film development.  \n- The scene transitions to a sepia-toned image of a long, white building with a row of windows, followed by a sequence of horse-and-jockey motion pictures.\n[210-240s] - A man stands beside a whiteboard, gesturing toward its content while speaking.  \n- The whiteboard displays text about \"Lesson 6: Basics of Animation,\" including definitions and key terms.  \n- A black-and-white image of \"The Horse in Motion (1878)\" is shown on screen, depicting a horse and rider in motion.", "history_tokens": 701, "history_utf8_bytes": 2924, "recent_frame_times_s": [224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332], "recent_frames_sha256": "2299c173890f9c033c7aace2d03f405c5011574f3f1b08a0362e4afcd85fef28", "num_recent_frames": 30, "tq": 719415.299767913, "t1": 719417.002035664, "ta": 719417.002035664, "te": 719417.201737663, "first_response_s": 1.7022677510976791, "answer_total_s": 1.9019697500625625, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 99, "content_group": "bb2113dc9b7537512d565ce510db508a6557931965acf034f071d69ec2e6ef49", "question": {"question_id": "sample_99_a942_q0", "video_id": 99, "video_path": "./videos/sample_99_real.mp4", "annotation_index": 942, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 16, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_99_a942_q0", "video_id": 99, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fe9535a3f1a6750f09c479a1213603c25104864c88fc5a342e0a0767291b4f85", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "5b89523ce67d73f143a470828176ba3fc04b07eb66dbe1f91f0d9d2ad824fd18", "num_recent_frames": 16, "tq": 719034.591993007, "t1": 719046.337429882, "ta": 719046.337429882, "te": 719046.374654269, "first_response_s": 11.745436875033192, "answer_total_s": 11.782661261968315, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_99_a942_q0", "video_id": 99, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9e07bb8902997193134322bb317641bcf8785ca08c86588d324a61445ccec1e9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "5b89523ce67d73f143a470828176ba3fc04b07eb66dbe1f91f0d9d2ad824fd18", "num_recent_frames": 16, "tq": 719130.589202335, "t1": 719131.334933819, "ta": 719131.334933819, "te": 719131.372820489, "first_response_s": 0.7457314840285107, "answer_total_s": 0.7836181540042162, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 99, "content_group": "bb2113dc9b7537512d565ce510db508a6557931965acf034f071d69ec2e6ef49", "question": {"question_id": "sample_99_a942_q1", "video_id": 99, "video_path": "./videos/sample_99_real.mp4", "annotation_index": 942, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 1.", "B. 3.", "C. 4.", "D. 0."], "answer": "A", "time_stamp_s": 56, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_99_a942_q1", "video_id": 99, "time_stamp_s": 56, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ac1cb2e5712a34c2812269fa88227ea3c953b5d522e6481380fb27c50ac42f63", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334], "recent_frames_sha256": "93325308450a181bdf09419381e7b601e14017f9b41986e0d08764ae14d04434", "num_recent_frames": 30, "tq": 719046.387448173, "t1": 719089.190447965, "ta": 719089.190447965, "te": 719089.228117682, "first_response_s": 42.80299979203846, "answer_total_s": 42.84066950902343, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_99_a942_q1", "video_id": 99, "time_stamp_s": 56, "ground_truth": "A", "raw_output": "C. 4.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "a2fca6ce79911eccb436edef57da8d490015679979efedf5db76eb5569416f26", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a suit stands beside a whiteboard displaying lesson content on experimental films and surrealist art.  \n- He gestures with his hands while speaking, indicating he is explaining the material.  \n- The whiteboard includes text about surrealist films, their characteristics, and viewing instructions for a specific video.", "history_tokens": 69, "history_utf8_bytes": 336, "recent_frame_times_s": [26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334], "recent_frames_sha256": "93325308450a181bdf09419381e7b601e14017f9b41986e0d08764ae14d04434", "num_recent_frames": 30, "tq": 719141.475348098, "t1": 719155.09806883, "ta": 719155.09806883, "te": 719155.485258681, "first_response_s": 13.622720732004382, "answer_total_s": 14.009910583030432, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 99, "content_group": "bb2113dc9b7537512d565ce510db508a6557931965acf034f071d69ec2e6ef49", "question": {"question_id": "sample_99_a943_q0", "video_id": 99, "video_path": "./videos/sample_99_real.mp4", "annotation_index": 943, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 1."], "answer": "A", "time_stamp_s": 86, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_99_a943_q0", "video_id": 99, "time_stamp_s": 86, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9450b2925218b1a4d63007b7fe963f99f4972235d2f886234695549db0f89502", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.01726666666667, 85.01826666666666], "recent_frames_sha256": "9d4aeeb633535e22a5d2ef16e283690f7783c2db8a0e152cabac9d5673da0f0d", "num_recent_frames": 30, "tq": 719089.238745317, "t1": 719099.904372561, "ta": 719099.904372561, "te": 719100.098499327, "first_response_s": 10.665627244045027, "answer_total_s": 10.859754009987228, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_99_a943_q0", "video_id": 99, "time_stamp_s": 86, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f9051dff8670b79a15c881a6e377480d897351bce39813d7a0d88f5237485492", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a suit stands beside a whiteboard displaying lesson content on experimental films and surrealist art.  \n- He gestures with his hands while speaking, indicating he is explaining the material.  \n- The whiteboard includes text about surrealist films, their characteristics, and viewing instructions for a specific video.\n[30-60s] - A man in a suit gestures while speaking, standing beside a whiteboard with lesson notes on experimental films.\n- A black-and-white scene shows a woman with dark hair, eyes closed, in a dimly lit room, possibly a mirror reflection.\n- A woman in a light-colored dress stands in a store aisle, gesturing with her hands while speaking to someone off-camera.", "history_tokens": 153, "history_utf8_bytes": 701, "recent_frame_times_s": [56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.01726666666667, 85.01826666666666], "recent_frames_sha256": "9d4aeeb633535e22a5d2ef16e283690f7783c2db8a0e152cabac9d5673da0f0d", "num_recent_frames": 30, "tq": 719165.351426113, "t1": 719166.121901921, "ta": 719166.121901921, "te": 719166.159366913, "first_response_s": 0.7704758079489693, "answer_total_s": 0.8079407999757677, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 99, "content_group": "bb2113dc9b7537512d565ce510db508a6557931965acf034f071d69ec2e6ef49", "question": {"question_id": "sample_99_a944_q0", "video_id": 99, "video_path": "./videos/sample_99_real.mp4", "annotation_index": 944, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 4.", "C. 6.", "D. 0."], "answer": "B", "time_stamp_s": 206, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_99_a944_q0", "video_id": 99, "time_stamp_s": 206, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "49553d46dadcd1111984ed396320d14cfacde076bc8e2f7b88a2efecac70f80e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "9dee0d13babe0999ddbd4a040140126f9f83399c8f651432e04c5b4a075010f7", "num_recent_frames": 30, "tq": 719100.109770114, "t1": 719111.519579865, "ta": 719111.519579865, "te": 719111.557698529, "first_response_s": 11.409809751086868, "answer_total_s": 11.44792841502931, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_99_a944_q0", "video_id": 99, "time_stamp_s": 206, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "04e7e0c43adf147ae8e6306731e925ff59373ad1ff0d8df964c1c234f3316e81", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a suit stands beside a whiteboard displaying lesson content on experimental films and surrealist art.  \n- He gestures with his hands while speaking, indicating he is explaining the material.  \n- The whiteboard includes text about surrealist films, their characteristics, and viewing instructions for a specific video.\n[30-60s] - A man in a suit gestures while speaking, standing beside a whiteboard with lesson notes on experimental films.\n- A black-and-white scene shows a woman with dark hair, eyes closed, in a dimly lit room, possibly a mirror reflection.\n- A woman in a light-colored dress stands in a store aisle, gesturing with her hands while speaking to someone off-camera.\n[60-90s] - A man in a dark suit stands in a dimly lit room, gesturing with his hands while speaking.  \n- Behind him, a whiteboard displays text about \"Experimental Films\" and \"Surrealism,\" with some words highlighted in blue.  \n- The man’s expression is animated, suggesting he is explaining or teaching the content on the board.\n[90-120s] - A man in a dark suit gestures while standing in front of a whiteboard with text about experimental films and surrealist art.\n- The whiteboard displays lesson details, including \"Lesson 6.5 Experimental Films Surrealism\" and references to \"Un Chien Andalou\" and \"The Disintegration of the Persistence of Memory.\"\n- A black-and-white film clip of \"Meshes of the Afternoon\" (1943) is shown, featuring a figure in a dark cloak walking past a wall with shadows.\n[120-150s] - A man in a suit stands in a doorway, hand on wall, facing away from camera.  \n- A hand holds a small, dark, irregularly shaped object, possibly a wound or artifact.  \n- A black-and-white film clip shows a woman with dark hair and makeup, holding a brush near her face.\n[150-180s] - A man in a suit gestures while standing beside a whiteboard displaying lesson content.  \n- The whiteboard lists topics like \"Experimental Films\" and \"Surrealism,\" with a note about viewing \"Orpheus (1950).\"  \n- The man’s hands move expressively as he speaks, indicating emphasis on the lesson material.", "history_tokens": 507, "history_utf8_bytes": 2102, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "9dee0d13babe0999ddbd4a040140126f9f83399c8f651432e04c5b4a075010f7", "num_recent_frames": 30, "tq": 719206.651665253, "t1": 719208.500523847, "ta": 719208.500523847, "te": 719208.542483767, "first_response_s": 1.8488585939630866, "answer_total_s": 1.8908185140462592, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 99, "content_group": "bb2113dc9b7537512d565ce510db508a6557931965acf034f071d69ec2e6ef49", "question": {"question_id": "sample_99_a945_q0", "video_id": 99, "video_path": "./videos/sample_99_real.mp4", "annotation_index": 945, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 8.", "C. 3.", "D. 7."], "answer": "D", "time_stamp_s": 281, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_99_a945_q0", "video_id": 99, "time_stamp_s": 281, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c7ed7fa28ad3fae7856b017450bc2da21955a20a6d6fdcf9722b9df4bdc66e78", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665], "recent_frames_sha256": "169c623e17247185db9cd630a85afbb1092813db263577e85cc43a9fba388f68", "num_recent_frames": 30, "tq": 719111.570103042, "t1": 719121.811939565, "ta": 719121.811939565, "te": 719121.849475228, "first_response_s": 10.241836523055099, "answer_total_s": 10.27937218605075, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_99_a945_q0", "video_id": 99, "time_stamp_s": 281, "ground_truth": "D", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "baad84a5c187a0575750c4434765f6d3b3c34ba1db5b33da9780a950517c5a52", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a suit stands beside a whiteboard displaying lesson content on experimental films and surrealist art.  \n- He gestures with his hands while speaking, indicating he is explaining the material.  \n- The whiteboard includes text about surrealist films, their characteristics, and viewing instructions for a specific video.\n[30-60s] - A man in a suit gestures while speaking, standing beside a whiteboard with lesson notes on experimental films.\n- A black-and-white scene shows a woman with dark hair, eyes closed, in a dimly lit room, possibly a mirror reflection.\n- A woman in a light-colored dress stands in a store aisle, gesturing with her hands while speaking to someone off-camera.\n[60-90s] - A man in a dark suit stands in a dimly lit room, gesturing with his hands while speaking.  \n- Behind him, a whiteboard displays text about \"Experimental Films\" and \"Surrealism,\" with some words highlighted in blue.  \n- The man’s expression is animated, suggesting he is explaining or teaching the content on the board.\n[90-120s] - A man in a dark suit gestures while standing in front of a whiteboard with text about experimental films and surrealist art.\n- The whiteboard displays lesson details, including \"Lesson 6.5 Experimental Films Surrealism\" and references to \"Un Chien Andalou\" and \"The Disintegration of the Persistence of Memory.\"\n- A black-and-white film clip of \"Meshes of the Afternoon\" (1943) is shown, featuring a figure in a dark cloak walking past a wall with shadows.\n[120-150s] - A man in a suit stands in a doorway, hand on wall, facing away from camera.  \n- A hand holds a small, dark, irregularly shaped object, possibly a wound or artifact.  \n- A black-and-white film clip shows a woman with dark hair and makeup, holding a brush near her face.\n[150-180s] - A man in a suit gestures while standing beside a whiteboard displaying lesson content.  \n- The whiteboard lists topics like \"Experimental Films\" and \"Surrealism,\" with a note about viewing \"Orpheus (1950).\"  \n- The man’s hands move expressively as he speaks, indicating emphasis on the lesson material.\n[180-210s] - A man in a suit stands beside a whiteboard displaying \"Lesson 6.5 Experimental Films Surrealism\" with bullet points about its characteristics.  \n- The man gestures with his hands while speaking, indicating he is explaining the content on the board.  \n- The whiteboard text includes references to \"non-narrative,\" \"no acting,\" and \"emotional experiences,\" with a quote from William Moritz displayed on a screen.\n[210-240s] - A man in a suit stands beside a whiteboard displaying \"Lesson 6.5 Experimental Films\" with bullet points about surrealism and experimental video.\n- The video transitions to black-and-white clips: \"Man with a Movie Camera (1929)\" shows city streets and a cup, while \"Boraka (1992)\" features a crowd and a man with a white mark on his forehead.\n- A scene from \"Koyaanisqatsi (1982)\" shows people walking in a subway with red lighting, followed by a crowd in a dark setting.\n[240-270s] - A man in a suit stands beside a whiteboard with text about experimental films and surrealist art, gesturing while speaking.\n- The whiteboard displays lesson details, including \"Lesson 6.5 Experimental Films\" and \"Surrealism: An art movement which sought to rebel against the rational world.\"\n- A black-and-white image of the Empire State Building at night appears on screen, labeled \"Empire (1945)\" beneath it.", "history_tokens": 841, "history_utf8_bytes": 3435, "recent_frame_times_s": [251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665], "recent_frames_sha256": "169c623e17247185db9cd630a85afbb1092813db263577e85cc43a9fba388f68", "num_recent_frames": 30, "tq": 719237.665202279, "t1": 719244.442685422, "ta": 719244.442685422, "te": 719244.664715695, "first_response_s": 6.777483143028803, "answer_total_s": 6.999513415968977, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 99, "content_group": "bb2113dc9b7537512d565ce510db508a6557931965acf034f071d69ec2e6ef49", "question": {"question_id": "sample_99_a946_q0", "video_id": 99, "video_path": "./videos/sample_99_real.mp4", "annotation_index": 946, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 8.", "C. 3.", "D. 7."], "answer": "B", "time_stamp_s": 324, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_99_a946_q0", "video_id": 99, "time_stamp_s": 324, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a9e19077abe7b637cb8f7cb8fc5605305feecb481a04fc3e1b9c15b737b965ca", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227], "recent_frames_sha256": "64c110c2fdd687b70de3f461b3df3fc0e3ae0cf916674c9320f2e62f44e3d5c2", "num_recent_frames": 30, "tq": 719121.857232916, "t1": 719130.543791253, "ta": 719130.543791253, "te": 719130.581115893, "first_response_s": 8.686558336950839, "answer_total_s": 8.723882976919413, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_99_a946_q0", "video_id": 99, "time_stamp_s": 324, "ground_truth": "B", "raw_output": "C. 3.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "a7c1ed74fb9dbbe91708d0eb16ad7c089c5f71a93c3a7ca414e7105ec96a8ad9", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a suit stands beside a whiteboard displaying lesson content on experimental films and surrealist art.  \n- He gestures with his hands while speaking, indicating he is explaining the material.  \n- The whiteboard includes text about surrealist films, their characteristics, and viewing instructions for a specific video.\n[30-60s] - A man in a suit gestures while speaking, standing beside a whiteboard with lesson notes on experimental films.\n- A black-and-white scene shows a woman with dark hair, eyes closed, in a dimly lit room, possibly a mirror reflection.\n- A woman in a light-colored dress stands in a store aisle, gesturing with her hands while speaking to someone off-camera.\n[60-90s] - A man in a dark suit stands in a dimly lit room, gesturing with his hands while speaking.  \n- Behind him, a whiteboard displays text about \"Experimental Films\" and \"Surrealism,\" with some words highlighted in blue.  \n- The man’s expression is animated, suggesting he is explaining or teaching the content on the board.\n[90-120s] - A man in a dark suit gestures while standing in front of a whiteboard with text about experimental films and surrealist art.\n- The whiteboard displays lesson details, including \"Lesson 6.5 Experimental Films Surrealism\" and references to \"Un Chien Andalou\" and \"The Disintegration of the Persistence of Memory.\"\n- A black-and-white film clip of \"Meshes of the Afternoon\" (1943) is shown, featuring a figure in a dark cloak walking past a wall with shadows.\n[120-150s] - A man in a suit stands in a doorway, hand on wall, facing away from camera.  \n- A hand holds a small, dark, irregularly shaped object, possibly a wound or artifact.  \n- A black-and-white film clip shows a woman with dark hair and makeup, holding a brush near her face.\n[150-180s] - A man in a suit gestures while standing beside a whiteboard displaying lesson content.  \n- The whiteboard lists topics like \"Experimental Films\" and \"Surrealism,\" with a note about viewing \"Orpheus (1950).\"  \n- The man’s hands move expressively as he speaks, indicating emphasis on the lesson material.\n[180-210s] - A man in a suit stands beside a whiteboard displaying \"Lesson 6.5 Experimental Films Surrealism\" with bullet points about its characteristics.  \n- The man gestures with his hands while speaking, indicating he is explaining the content on the board.  \n- The whiteboard text includes references to \"non-narrative,\" \"no acting,\" and \"emotional experiences,\" with a quote from William Moritz displayed on a screen.\n[210-240s] - A man in a suit stands beside a whiteboard displaying \"Lesson 6.5 Experimental Films\" with bullet points about surrealism and experimental video.\n- The video transitions to black-and-white clips: \"Man with a Movie Camera (1929)\" shows city streets and a cup, while \"Boraka (1992)\" features a crowd and a man with a white mark on his forehead.\n- A scene from \"Koyaanisqatsi (1982)\" shows people walking in a subway with red lighting, followed by a crowd in a dark setting.\n[240-270s] - A man in a suit stands beside a whiteboard with text about experimental films and surrealist art, gesturing while speaking.\n- The whiteboard displays lesson details, including \"Lesson 6.5 Experimental Films\" and \"Surrealism: An art movement which sought to rebel against the rational world.\"\n- A black-and-white image of the Empire State Building at night appears on screen, labeled \"Empire (1945)\" beneath it.\n[270-300s] - A man in a dark suit stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about \"Experimental Films\" and \"Surrealism,\" including a viewing instruction for a 2001 film.  \n- The background is dimly lit, with a dark, possibly studio-like setting and some out-of-focus equipment visible.", "history_tokens": 929, "history_utf8_bytes": 3781, "recent_frame_times_s": [294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227], "recent_frames_sha256": "64c110c2fdd687b70de3f461b3df3fc0e3ae0cf916674c9320f2e62f44e3d5c2", "num_recent_frames": 30, "tq": 719255.705852375, "t1": 719261.368619554, "ta": 719261.368619554, "te": 719261.557378473, "first_response_s": 5.662767178961076, "answer_total_s": 5.851526097976603, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 100, "content_group": "4160057bc0572cde4296a2708004ae1ae4e61510753dadd70659ef83ee801d23", "question": {"question_id": "sample_100_a1213_q0", "video_id": 100, "video_path": "./videos/sample_100_real.mp4", "annotation_index": 1213, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 0.", "D. 4."], "answer": "C", "time_stamp_s": 16, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_100_a1213_q0", "video_id": 100, "time_stamp_s": 16, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d2a40c587d5c7ac4ad031f2d440ff29f17cc398bdd66559a2d43cd51516050ed", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "72d16c5a3a84d2167a8159e985e7f19badab9c8aef1050bb179ee60ea59c7918", "num_recent_frames": 16, "tq": 710787.540690973, "t1": 710788.341240065, "ta": 710788.341240065, "te": 710788.63829983, "first_response_s": 0.8005490920040756, "answer_total_s": 1.0976088569732383, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_100_a1213_q0", "video_id": 100, "time_stamp_s": 16, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f7d7753142c9a5dc0c5ab1fd5c36a139b69b6e8bbcddf21341a161f8066b11b5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "72d16c5a3a84d2167a8159e985e7f19badab9c8aef1050bb179ee60ea59c7918", "num_recent_frames": 16, "tq": 715224.794394266, "t1": 715235.475585196, "ta": 715235.475585196, "te": 715235.714677287, "first_response_s": 10.68119093007408, "answer_total_s": 10.920283021056093, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 100, "content_group": "4160057bc0572cde4296a2708004ae1ae4e61510753dadd70659ef83ee801d23", "question": {"question_id": "sample_100_a1213_q1", "video_id": 100, "video_path": "./videos/sample_100_real.mp4", "annotation_index": 1213, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 1.", "B. 3.", "C. 0.", "D. 4."], "answer": "C", "time_stamp_s": 56, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_100_a1213_q1", "video_id": 100, "time_stamp_s": 56, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "22871c5f1df26d952a3fb61a1115f4d619e621c59f9f59f6193608636a981000", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.034, 35.035, 36.036, 37.037, 38.038, 39.039, 40.04, 41.041, 42.00029166666667, 43.00129166666667, 44.002291666666665, 45.00329166666667, 46.00429166666667, 47.005291666666665, 48.00629166666667, 49.00729166666667, 50.008291666666665, 51.00929166666667, 52.01029166666667, 53.011291666666665, 54.01229166666667, 55.01329166666667], "recent_frames_sha256": "c27d8ea98862c644e24b7719ab398acbed34380cadfbe52a4cb8af81a54cbbff", "num_recent_frames": 30, "tq": 710788.655219708, "t1": 710799.689047812, "ta": 710799.689047812, "te": 710799.72729261, "first_response_s": 11.033828104031272, "answer_total_s": 11.072072901995853, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_100_a1213_q1", "video_id": 100, "time_stamp_s": 56, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "148aded6bc0238d2426421a4e900871ddf6c6c82df063a88cb2a874202c007fd", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"UNIT 1: SUMMATIVE PROJECT\" including instructions to \"WRITE, FILM, + EDIT A SHORT VIDEO\" and \"TELL A COMPLETE STORY.\"  \n- The man's name, \"Mr. Marklevitz Film Teacher,\" appears at the bottom of the screen.", "history_tokens": 96, "history_utf8_bytes": 351, "recent_frame_times_s": [26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.034, 35.035, 36.036, 37.037, 38.038, 39.039, 40.04, 41.041, 42.00029166666667, 43.00129166666667, 44.002291666666665, 45.00329166666667, 46.00429166666667, 47.005291666666665, 48.00629166666667, 49.00729166666667, 50.008291666666665, 51.00929166666667, 52.01029166666667, 53.011291666666665, 54.01229166666667, 55.01329166666667], "recent_frames_sha256": "c27d8ea98862c644e24b7719ab398acbed34380cadfbe52a4cb8af81a54cbbff", "num_recent_frames": 30, "tq": 715241.214845815, "t1": 715247.199529736, "ta": 715247.199529736, "te": 715247.392849093, "first_response_s": 5.9846839209785685, "answer_total_s": 6.17800327797886, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 100, "content_group": "4160057bc0572cde4296a2708004ae1ae4e61510753dadd70659ef83ee801d23", "question": {"question_id": "sample_100_a1214_q0", "video_id": 100, "video_path": "./videos/sample_100_real.mp4", "annotation_index": 1214, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 4.", "C. 0.", "D. 1."], "answer": "C", "time_stamp_s": 86, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_100_a1214_q0", "video_id": 100, "time_stamp_s": 86, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d2cc4fd839a986e2c5bdf614ebb01249d395807bee0fb7ed66083cc5caf107e3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [56.014291666666665, 57.01529166666667, 58.01629166666667, 59.017291666666665, 60.01829166666667, 61.01929166666667, 62.020291666666665, 63.02129166666667, 64.02229166666666, 65.02329166666667, 66.02429166666667, 67.02529166666666, 68.02629166666667, 69.02729166666667, 70.02829166666666, 71.02929166666667, 72.03029166666667, 73.03129166666666, 74.03229166666667, 75.03329166666667, 76.03429166666666, 77.03529166666667, 78.03629166666667, 79.03729166666666, 80.03829166666667, 81.03929166666667, 82.04029166666666, 83.04129166666667, 84.00058333333334, 85.00158333333333], "recent_frames_sha256": "34708e3b973dba0aefc548b49019edd5ac2afdceb5ec6637b69591afa2654f9c", "num_recent_frames": 30, "tq": 715187.139241225, "t1": 715194.488397776, "ta": 715194.488397776, "te": 715194.526287389, "first_response_s": 7.349156551063061, "answer_total_s": 7.387046164018102, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_100_a1214_q0", "video_id": 100, "time_stamp_s": 86, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "565c2a5d5a72221a69e186fa265f93032129236fc33d0373c6e845797099b2f4", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"UNIT 1: SUMMATIVE PROJECT\" including instructions to \"WRITE, FILM, + EDIT A SHORT VIDEO\" and \"TELL A COMPLETE STORY.\"  \n- The man's name, \"Mr. Marklevitz Film Teacher,\" appears at the bottom of the screen.\n[30-60s] - A man in a gray shirt gestures with both hands while speaking, standing to the right of a whiteboard.  \n- The whiteboard displays \"UNIT 1: SUMMATIVE PROJECT\" with instructions in colored markers, including \"WRITE, FILM, & EDIT A SHORT VIDEO\" and \"TELL A COMPLETE STORY.\"  \n- The man occasionally points to the whiteboard with his right hand while maintaining eye contact with the camera.", "history_tokens": 192, "history_utf8_bytes": 750, "recent_frame_times_s": [56.014291666666665, 57.01529166666667, 58.01629166666667, 59.017291666666665, 60.01829166666667, 61.01929166666667, 62.020291666666665, 63.02129166666667, 64.02229166666666, 65.02329166666667, 66.02429166666667, 67.02529166666666, 68.02629166666667, 69.02729166666667, 70.02829166666666, 71.02929166666667, 72.03029166666667, 73.03129166666666, 74.03229166666667, 75.03329166666667, 76.03429166666666, 77.03529166666667, 78.03629166666667, 79.03729166666666, 80.03829166666667, 81.03929166666667, 82.04029166666666, 83.04129166666667, 84.00058333333334, 85.00158333333333], "recent_frames_sha256": "34708e3b973dba0aefc548b49019edd5ac2afdceb5ec6637b69591afa2654f9c", "num_recent_frames": 30, "tq": 715260.119286581, "t1": 715266.898204004, "ta": 715266.898204004, "te": 715267.177435023, "first_response_s": 6.778917423100211, "answer_total_s": 7.0581484420690686, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 100, "content_group": "4160057bc0572cde4296a2708004ae1ae4e61510753dadd70659ef83ee801d23", "question": {"question_id": "sample_100_a1215_q0", "video_id": 100, "video_path": "./videos/sample_100_real.mp4", "annotation_index": 1215, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 4.", "C. 0.", "D. 6."], "answer": "C", "time_stamp_s": 206, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_100_a1215_q0", "video_id": 100, "time_stamp_s": 206, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "4f6150c750d3112f4b228576efba60e02d2b028164140cd47a557c50972a59fd", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.03416666666666, 202.03516666666667, 203.03616666666667, 204.03716666666668, 205.03816666666665], "recent_frames_sha256": "4fb014f5401f41b7c5d6b8ed7b7b61c4d873adcba3575e1d7f95079724df4d44", "num_recent_frames": 30, "tq": 715194.538305782, "t1": 715206.11277631, "ta": 715206.11277631, "te": 715206.317823757, "first_response_s": 11.574470527935773, "answer_total_s": 11.779517974937335, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_100_a1215_q0", "video_id": 100, "time_stamp_s": 206, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "b15079193f14b8c7b79849495a39da706581cab69d7ae3aea9ada26c39695f7b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"UNIT 1: SUMMATIVE PROJECT\" including instructions to \"WRITE, FILM, + EDIT A SHORT VIDEO\" and \"TELL A COMPLETE STORY.\"  \n- The man's name, \"Mr. Marklevitz Film Teacher,\" appears at the bottom of the screen.\n[30-60s] - A man in a gray shirt gestures with both hands while speaking, standing to the right of a whiteboard.  \n- The whiteboard displays \"UNIT 1: SUMMATIVE PROJECT\" with instructions in colored markers, including \"WRITE, FILM, & EDIT A SHORT VIDEO\" and \"TELL A COMPLETE STORY.\"  \n- The man occasionally points to the whiteboard with his right hand while maintaining eye contact with the camera.\n[60-90s] - A man in a gray shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text in various colors, including \"UNIT 1: SUMMATIVE PROJECT\" and bullet points about writing, filming, and editing a short video.  \n- The background features dark, possibly studio-like lighting with visible equipment racks.\n[90-120s] - A man in a gray shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"UNIT 1: SUMMATIVE PROJECT\" with bullet points about writing, filming, and editing a short video.  \n- The man occasionally points to the whiteboard, emphasizing key points like \"HAVE A R-STORY\" and \"REMEMBER TO USE EVIDENCE.\"\n[120-150s] - A man in a gray shirt gestures toward a whiteboard displaying \"UNIT 1: SUMMATIVE PROJECT\" with instructions for writing, filming, and editing a short video.  \n- The whiteboard lists key requirements: \"Have a R-Story,\" \"Characters are clearly identified,\" and \"Test a 3-minute story,\" with a reminder to \"Use FLOWERS.\"  \n- The man stands in front of the whiteboard, using hand motions to emphasize points while speaking.\n[150-180s] - Man gestures toward whiteboard with right hand while speaking.  \n- Whiteboard displays \"UNIT 1: SUMMATIVE PROJECT\" and instructions for writing, filming, editing short videos.  \n- Man wears gray button-up shirt and stands in front of a dark background with visible studio lights.", "history_tokens": 543, "history_utf8_bytes": 2188, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.03416666666666, 202.03516666666667, 203.03616666666667, 204.03716666666668, 205.03816666666665], "recent_frames_sha256": "4fb014f5401f41b7c5d6b8ed7b7b61c4d873adcba3575e1d7f95079724df4d44", "num_recent_frames": 30, "tq": 715294.697538824, "t1": 715295.276806683, "ta": 715295.276806683, "te": 715295.484588093, "first_response_s": 0.579267858993262, "answer_total_s": 0.7870492689544335, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 100, "content_group": "4160057bc0572cde4296a2708004ae1ae4e61510753dadd70659ef83ee801d23", "question": {"question_id": "sample_100_a1216_q0", "video_id": 100, "video_path": "./videos/sample_100_real.mp4", "annotation_index": 1216, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 8.", "C. 0.", "D. 3."], "answer": "C", "time_stamp_s": 281, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_100_a1216_q0", "video_id": 100, "time_stamp_s": 281, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "993c29e1bb4b18234901c36896b1513888f36cd7931ec886f6018a0ca32a594e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.01675, 268.01775, 269.01875, 270.01975, 271.02075, 272.02175, 273.02275, 274.02375, 275.02475, 276.02575, 277.02675, 278.02775, 279.02875, 280.02975], "recent_frames_sha256": "c1ec97c62f362617886f89d5247d5cfc2d4ef1c6a7441ae229b30fba3b4797f7", "num_recent_frames": 30, "tq": 715206.330590126, "t1": 715217.222261554, "ta": 715217.222261554, "te": 715217.266714214, "first_response_s": 10.891671427991241, "answer_total_s": 10.93612408800982, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_100_a1216_q0", "video_id": 100, "time_stamp_s": 281, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "aa0e8835f238d1447060a40c44d9673b3a6ecb5ec70aa933b59b05bffeee9bd1", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"UNIT 1: SUMMATIVE PROJECT\" including instructions to \"WRITE, FILM, + EDIT A SHORT VIDEO\" and \"TELL A COMPLETE STORY.\"  \n- The man's name, \"Mr. Marklevitz Film Teacher,\" appears at the bottom of the screen.\n[30-60s] - A man in a gray shirt gestures with both hands while speaking, standing to the right of a whiteboard.  \n- The whiteboard displays \"UNIT 1: SUMMATIVE PROJECT\" with instructions in colored markers, including \"WRITE, FILM, & EDIT A SHORT VIDEO\" and \"TELL A COMPLETE STORY.\"  \n- The man occasionally points to the whiteboard with his right hand while maintaining eye contact with the camera.\n[60-90s] - A man in a gray shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text in various colors, including \"UNIT 1: SUMMATIVE PROJECT\" and bullet points about writing, filming, and editing a short video.  \n- The background features dark, possibly studio-like lighting with visible equipment racks.\n[90-120s] - A man in a gray shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"UNIT 1: SUMMATIVE PROJECT\" with bullet points about writing, filming, and editing a short video.  \n- The man occasionally points to the whiteboard, emphasizing key points like \"HAVE A R-STORY\" and \"REMEMBER TO USE EVIDENCE.\"\n[120-150s] - A man in a gray shirt gestures toward a whiteboard displaying \"UNIT 1: SUMMATIVE PROJECT\" with instructions for writing, filming, and editing a short video.  \n- The whiteboard lists key requirements: \"Have a R-Story,\" \"Characters are clearly identified,\" and \"Test a 3-minute story,\" with a reminder to \"Use FLOWERS.\"  \n- The man stands in front of the whiteboard, using hand motions to emphasize points while speaking.\n[150-180s] - Man gestures toward whiteboard with right hand while speaking.  \n- Whiteboard displays \"UNIT 1: SUMMATIVE PROJECT\" and instructions for writing, filming, editing short videos.  \n- Man wears gray button-up shirt and stands in front of a dark background with visible studio lights.\n[180-210s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text in various colors, including \"UNIT 1: SUMMATIVE PROJECT\" and instructions for writing, filming, and editing a short video.  \n- The background features dark, possibly studio-like settings with visible equipment or lighting rigs.\n[210-240s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text in various colors, including \"UNIT 1: SUMMATIVE PROJECT\" and instructions for a project.  \n- The background features dark, possibly studio-like settings with visible equipment.\n[240-270s] - A man in a gray shirt gestures toward a whiteboard displaying \"UNIT 1: SUMMATIVE PROJECT\" with instructions for writing, filming, or editing a short video.  \n- The whiteboard lists key requirements: \"Tell a complete story,\" \"Have a B-story,\" and \"Remember to use themes.\"  \n- The man points to the text while speaking, emphasizing the project's components and guidelines.", "history_tokens": 798, "history_utf8_bytes": 3262, "recent_frame_times_s": [251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.01675, 268.01775, 269.01875, 270.01975, 271.02075, 272.02175, 273.02275, 274.02375, 275.02475, 276.02575, 277.02675, 278.02775, 279.02875, 280.02975], "recent_frames_sha256": "c1ec97c62f362617886f89d5247d5cfc2d4ef1c6a7441ae229b30fba3b4797f7", "num_recent_frames": 30, "tq": 715318.972128311, "t1": 715320.190721521, "ta": 715320.190721521, "te": 715320.386717607, "first_response_s": 1.2185932099819183, "answer_total_s": 1.414589295978658, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 100, "content_group": "4160057bc0572cde4296a2708004ae1ae4e61510753dadd70659ef83ee801d23", "question": {"question_id": "sample_100_a1217_q0", "video_id": 100, "video_path": "./videos/sample_100_real.mp4", "annotation_index": 1217, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 0.", "D. 7."], "answer": "C", "time_stamp_s": 324, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_100_a1217_q0", "video_id": 100, "time_stamp_s": 324, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b2bf7e2b9f7abbd028dd1b5fe91e364036e673d59c1686af0fb4787e19196369", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [294.0020416666667, 295.00304166666666, 296.0040416666667, 297.00504166666667, 298.00604166666665, 299.0070416666667, 300.00804166666666, 301.0090416666667, 302.01004166666667, 303.01104166666664, 304.0120416666667, 305.01304166666665, 306.0140416666667, 307.01504166666666, 308.0160416666667, 309.01704166666667, 310.01804166666665, 311.0190416666667, 312.02004166666666, 313.0210416666667, 314.02204166666667, 315.02304166666664, 316.0240416666667, 317.02504166666665, 318.0260416666667, 319.02704166666666, 320.02804166666664, 321.02904166666667, 322.03004166666665, 323.0310416666667], "recent_frames_sha256": "af4356c7101f9f66e6bab396af6e7743c8042f1dd912fbacc9e69d62bcdec8ad", "num_recent_frames": 30, "tq": 715217.277842729, "t1": 715224.747961907, "ta": 715224.747961907, "te": 715224.785131959, "first_response_s": 7.4701191779458895, "answer_total_s": 7.50728923000861, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_100_a1217_q0", "video_id": 100, "time_stamp_s": 324, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "046c9d251b30741236288324615f5113e1603d3f2b72c43c4980ef2f8bd7cbc0", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"UNIT 1: SUMMATIVE PROJECT\" including instructions to \"WRITE, FILM, + EDIT A SHORT VIDEO\" and \"TELL A COMPLETE STORY.\"  \n- The man's name, \"Mr. Marklevitz Film Teacher,\" appears at the bottom of the screen.\n[30-60s] - A man in a gray shirt gestures with both hands while speaking, standing to the right of a whiteboard.  \n- The whiteboard displays \"UNIT 1: SUMMATIVE PROJECT\" with instructions in colored markers, including \"WRITE, FILM, & EDIT A SHORT VIDEO\" and \"TELL A COMPLETE STORY.\"  \n- The man occasionally points to the whiteboard with his right hand while maintaining eye contact with the camera.\n[60-90s] - A man in a gray shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text in various colors, including \"UNIT 1: SUMMATIVE PROJECT\" and bullet points about writing, filming, and editing a short video.  \n- The background features dark, possibly studio-like lighting with visible equipment racks.\n[90-120s] - A man in a gray shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"UNIT 1: SUMMATIVE PROJECT\" with bullet points about writing, filming, and editing a short video.  \n- The man occasionally points to the whiteboard, emphasizing key points like \"HAVE A R-STORY\" and \"REMEMBER TO USE EVIDENCE.\"\n[120-150s] - A man in a gray shirt gestures toward a whiteboard displaying \"UNIT 1: SUMMATIVE PROJECT\" with instructions for writing, filming, and editing a short video.  \n- The whiteboard lists key requirements: \"Have a R-Story,\" \"Characters are clearly identified,\" and \"Test a 3-minute story,\" with a reminder to \"Use FLOWERS.\"  \n- The man stands in front of the whiteboard, using hand motions to emphasize points while speaking.\n[150-180s] - Man gestures toward whiteboard with right hand while speaking.  \n- Whiteboard displays \"UNIT 1: SUMMATIVE PROJECT\" and instructions for writing, filming, editing short videos.  \n- Man wears gray button-up shirt and stands in front of a dark background with visible studio lights.\n[180-210s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text in various colors, including \"UNIT 1: SUMMATIVE PROJECT\" and instructions for writing, filming, and editing a short video.  \n- The background features dark, possibly studio-like settings with visible equipment or lighting rigs.\n[210-240s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text in various colors, including \"UNIT 1: SUMMATIVE PROJECT\" and instructions for a project.  \n- The background features dark, possibly studio-like settings with visible equipment.\n[240-270s] - A man in a gray shirt gestures toward a whiteboard displaying \"UNIT 1: SUMMATIVE PROJECT\" with instructions for writing, filming, or editing a short video.  \n- The whiteboard lists key requirements: \"Tell a complete story,\" \"Have a B-story,\" and \"Remember to use themes.\"  \n- The man points to the text while speaking, emphasizing the project's components and guidelines.\n[270-300s] - A man in a gray shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text in various colors, including \"UNIT 1: SUMMATIVE PROJECT\" and instructions for writing, filming, and editing a short video.  \n- The background features dark, out-of-focus equipment, suggesting a studio or classroom setting.", "history_tokens": 883, "history_utf8_bytes": 3622, "recent_frame_times_s": [294.0020416666667, 295.00304166666666, 296.0040416666667, 297.00504166666667, 298.00604166666665, 299.0070416666667, 300.00804166666666, 301.0090416666667, 302.01004166666667, 303.01104166666664, 304.0120416666667, 305.01304166666665, 306.0140416666667, 307.01504166666666, 308.0160416666667, 309.01704166666667, 310.01804166666665, 311.0190416666667, 312.02004166666666, 313.0210416666667, 314.02204166666667, 315.02304166666664, 316.0240416666667, 317.02504166666665, 318.0260416666667, 319.02704166666666, 320.02804166666664, 321.02904166666667, 322.03004166666665, 323.0310416666667], "recent_frames_sha256": "af4356c7101f9f66e6bab396af6e7743c8042f1dd912fbacc9e69d62bcdec8ad", "num_recent_frames": 30, "tq": 715331.219491193, "t1": 715333.732495421, "ta": 715333.732495421, "te": 715333.939663923, "first_response_s": 2.5130042280070484, "answer_total_s": 2.720172730041668, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 101, "content_group": "ea7b39efd8c75408d3b1aae9c32c1b8eeefe5416176c55ec426267e0482618df", "question": {"question_id": "sample_101_a1759_q0", "video_id": 101, "video_path": "./videos/sample_101_real.mp4", "annotation_index": 1759, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 0.", "D. 4."], "answer": "C", "time_stamp_s": 16, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_101_a1759_q0", "video_id": 101, "time_stamp_s": 16, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "e1b00ee9607022937c1bb6b142f5ca77deed244b5ecb963c208f2bbb40b349d6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "a8aef0856470eab9f96b2c9e4b261c7a655cb424384c77d2b6e35fea968c12d9", "num_recent_frames": 16, "tq": 715691.905251621, "t1": 715697.784182685, "ta": 715697.784182685, "te": 715697.968296485, "first_response_s": 5.878931063925847, "answer_total_s": 6.063044863985851, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_101_a1759_q0", "video_id": 101, "time_stamp_s": 16, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "45392fb8f4bc3536742256a26ed8aa68199cf62084f4d2bd4d6ead09fb103769", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "a8aef0856470eab9f96b2c9e4b261c7a655cb424384c77d2b6e35fea968c12d9", "num_recent_frames": 16, "tq": 715528.94126046, "t1": 715540.402417391, "ta": 715540.402417391, "te": 715540.55534945, "first_response_s": 11.461156931007281, "answer_total_s": 11.614088990027085, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 101, "content_group": "ea7b39efd8c75408d3b1aae9c32c1b8eeefe5416176c55ec426267e0482618df", "question": {"question_id": "sample_101_a1759_q1", "video_id": 101, "video_path": "./videos/sample_101_real.mp4", "annotation_index": 1759, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 1.", "B. 3.", "C. 0.", "D. 4."], "answer": "C", "time_stamp_s": 56, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_101_a1759_q1", "video_id": 101, "time_stamp_s": 56, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5c003a1f1b40af85a08683b8c91de15219c6d41b49ec27d731748cf939412e5d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334], "recent_frames_sha256": "1f7cc01f110fd09d160cc82892a4eea0f5afd9a94c3d8586b289ee2c2024ce78", "num_recent_frames": 30, "tq": 715697.995814725, "t1": 715704.417071724, "ta": 715704.417071724, "te": 715704.564879631, "first_response_s": 6.421256998903118, "answer_total_s": 6.569064905983396, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_101_a1759_q1", "video_id": 101, "time_stamp_s": 56, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "a4c31892031f34a70cb9e56942941e892d12082d6710921da91b69d9448e0778", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard displaying \"UNIT 2: Summative Project\" with project requirements.  \n- He gestures with both hands while speaking, indicating the project's components like \"Explain your product\" and \"Create a 30-second commercial.\"  \n- The whiteboard includes bullet points such as \"Must include: 1. Product, 2. Price, 3. A persuasive message, 4. A character, 5. A setting, 6. A call to action.\"", "history_tokens": 118, "history_utf8_bytes": 443, "recent_frame_times_s": [26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334], "recent_frames_sha256": "1f7cc01f110fd09d160cc82892a4eea0f5afd9a94c3d8586b289ee2c2024ce78", "num_recent_frames": 30, "tq": 715551.403101257, "t1": 715558.737168978, "ta": 715558.737168978, "te": 715559.004500252, "first_response_s": 7.3340677209198475, "answer_total_s": 7.601398994913325, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 101, "content_group": "ea7b39efd8c75408d3b1aae9c32c1b8eeefe5416176c55ec426267e0482618df", "question": {"question_id": "sample_101_a1760_q0", "video_id": 101, "video_path": "./videos/sample_101_real.mp4", "annotation_index": 1760, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 4.", "C. 0.", "D. 1."], "answer": "C", "time_stamp_s": 86, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_101_a1760_q0", "video_id": 101, "time_stamp_s": 86, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "c0f6da8fe7db76e9e8541f854bedfef2545941dd25c00692e20c3dd056730430", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.01726666666667, 85.01826666666666], "recent_frames_sha256": "e62c88d189763d36e841de9d030f0d6138cb672843fd094e546810937e29cf1d", "num_recent_frames": 30, "tq": 715704.577312656, "t1": 715718.320813692, "ta": 715718.320813692, "te": 715718.504858677, "first_response_s": 13.743501035962254, "answer_total_s": 13.92754602106288, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_101_a1760_q0", "video_id": 101, "time_stamp_s": 86, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "2ca77d3901c0d34952eb1c35dfa6b7198e173fa3f918e5108e922e56bfbeec6e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard displaying \"UNIT 2: Summative Project\" with project requirements.  \n- He gestures with both hands while speaking, indicating the project's components like \"Explain your product\" and \"Create a 30-second commercial.\"  \n- The whiteboard includes bullet points such as \"Must include: 1. Product, 2. Price, 3. A persuasive message, 4. A character, 5. A setting, 6. A call to action.\"\n[30-60s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for a \"Unit 2: Summative Project\" involving creating a 30-second commercial.  \n- The man’s hands move expressively as he explains the project requirements, which include elements like a product, a character, and a setting.", "history_tokens": 208, "history_utf8_bytes": 815, "recent_frame_times_s": [56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.01726666666667, 85.01826666666666], "recent_frames_sha256": "e62c88d189763d36e841de9d030f0d6138cb672843fd094e546810937e29cf1d", "num_recent_frames": 30, "tq": 715568.78165585, "t1": 715570.027434431, "ta": 715570.027434431, "te": 715570.329131914, "first_response_s": 1.245778581011109, "answer_total_s": 1.5474760639481246, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 101, "content_group": "ea7b39efd8c75408d3b1aae9c32c1b8eeefe5416176c55ec426267e0482618df", "question": {"question_id": "sample_101_a1761_q0", "video_id": 101, "video_path": "./videos/sample_101_real.mp4", "annotation_index": 1761, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 4.", "C. 0.", "D. 6."], "answer": "C", "time_stamp_s": 206, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_101_a1761_q0", "video_id": 101, "time_stamp_s": 206, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "cf60186173dd04feb462c214373317639d153c12ef53c78aed89d11a20bd2704", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "c8259e673f3133c485e164a1de00c6bcf6a84e8502466b0f0ec1fca085e21766", "num_recent_frames": 30, "tq": 715718.518095966, "t1": 715730.901248203, "ta": 715730.901248203, "te": 715731.08572732, "first_response_s": 12.383152237045579, "answer_total_s": 12.567631354089826, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_101_a1761_q0", "video_id": 101, "time_stamp_s": 206, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "8dabc62a163dc73052d17198e228e0e21e707971a8ff1ac2cf77680e61f4243a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard displaying \"UNIT 2: Summative Project\" with project requirements.  \n- He gestures with both hands while speaking, indicating the project's components like \"Explain your product\" and \"Create a 30-second commercial.\"  \n- The whiteboard includes bullet points such as \"Must include: 1. Product, 2. Price, 3. A persuasive message, 4. A character, 5. A setting, 6. A call to action.\"\n[30-60s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for a \"Unit 2: Summative Project\" involving creating a 30-second commercial.  \n- The man’s hands move expressively as he explains the project requirements, which include elements like a product, a character, and a setting.\n[60-90s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text: \"UNIT 2: Summative Project\" and instructions for creating a 30-second commercial.  \n- The man’s hands move expressively as he explains the project requirements, with no visible changes in his position or the board’s content.\n[90-120s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"Unit 2: Summative Project\" involving creating a 30-second commercial.  \n- The man holds a blue book or notebook in his left hand, occasionally referencing it while speaking.\n[120-150s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text including \"UNIT 2: Summative Project\" and instructions for a 30-second commercial.  \n- The man occasionally points to different sections of the whiteboard as he explains the project requirements.\n[150-180s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"Unit 2: Summative Project\" with bullet points about creating a 30-second commercial.  \n- The man occasionally points to the whiteboard, emphasizing specific project requirements.", "history_tokens": 537, "history_utf8_bytes": 2183, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "c8259e673f3133c485e164a1de00c6bcf6a84e8502466b0f0ec1fca085e21766", "num_recent_frames": 30, "tq": 715604.319200134, "t1": 715612.399032491, "ta": 715612.399032491, "te": 715612.712896724, "first_response_s": 8.079832357005216, "answer_total_s": 8.39369658997748, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 101, "content_group": "ea7b39efd8c75408d3b1aae9c32c1b8eeefe5416176c55ec426267e0482618df", "question": {"question_id": "sample_101_a1762_q0", "video_id": 101, "video_path": "./videos/sample_101_real.mp4", "annotation_index": 1762, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 8.", "C. 0.", "D. 3."], "answer": "C", "time_stamp_s": 281, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_101_a1762_q0", "video_id": 101, "time_stamp_s": 281, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0ee560526d95e15c127c2b420dc7816804f61c541e90d2c7964ef764160891a8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665], "recent_frames_sha256": "37936815c6a3e98279583662c4041e41fec93cf598e290ca87ce91ef534ddd8b", "num_recent_frames": 30, "tq": 715731.09618836, "t1": 715745.29033752, "ta": 715745.29033752, "te": 715745.437517745, "first_response_s": 14.194149159942754, "answer_total_s": 14.341329384944402, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_101_a1762_q0", "video_id": 101, "time_stamp_s": 281, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "15d7bb67f4ff03207b5571aec8d442a418ab52020f786833e4b88a13852ead11", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard displaying \"UNIT 2: Summative Project\" with project requirements.  \n- He gestures with both hands while speaking, indicating the project's components like \"Explain your product\" and \"Create a 30-second commercial.\"  \n- The whiteboard includes bullet points such as \"Must include: 1. Product, 2. Price, 3. A persuasive message, 4. A character, 5. A setting, 6. A call to action.\"\n[30-60s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for a \"Unit 2: Summative Project\" involving creating a 30-second commercial.  \n- The man’s hands move expressively as he explains the project requirements, which include elements like a product, a character, and a setting.\n[60-90s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text: \"UNIT 2: Summative Project\" and instructions for creating a 30-second commercial.  \n- The man’s hands move expressively as he explains the project requirements, with no visible changes in his position or the board’s content.\n[90-120s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"Unit 2: Summative Project\" involving creating a 30-second commercial.  \n- The man holds a blue book or notebook in his left hand, occasionally referencing it while speaking.\n[120-150s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text including \"UNIT 2: Summative Project\" and instructions for a 30-second commercial.  \n- The man occasionally points to different sections of the whiteboard as he explains the project requirements.\n[150-180s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"Unit 2: Summative Project\" with bullet points about creating a 30-second commercial.  \n- The man occasionally points to the whiteboard, emphasizing specific project requirements.\n[180-210s] - Man in light blue shirt gestures with hands while standing beside a whiteboard displaying \"UNIT 2: Summative Project\" and project requirements.  \n- Whiteboard lists key project elements: \"CREATE A 30 SECOND COMMERCIAL,\" \"MUST INCLUDE,\" and \"REQUIREMENTS.\"  \n- Man occasionally points to specific text on the whiteboard, emphasizing project details.\n[210-240s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"Unit 2: Summative Project\" involving a 30-second commercial for a \"Mystery Project.\"  \n- The man occasionally points to specific sections of the whiteboard, emphasizing key requirements like \"Must Include\" and \"Must Be 30 Seconds.\"\n[240-270s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"Unit 2: Summative Project\" involving a 30-second commercial.  \n- The man occasionally shifts his stance and gestures toward the whiteboard, emphasizing points.", "history_tokens": 798, "history_utf8_bytes": 3237, "recent_frame_times_s": [251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665], "recent_frames_sha256": "37936815c6a3e98279583662c4041e41fec93cf598e290ca87ce91ef534ddd8b", "num_recent_frames": 30, "tq": 715671.821113421, "t1": 715678.176670063, "ta": 715678.176670063, "te": 715678.400133369, "first_response_s": 6.35555664205458, "answer_total_s": 6.579019948025234, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 101, "content_group": "ea7b39efd8c75408d3b1aae9c32c1b8eeefe5416176c55ec426267e0482618df", "question": {"question_id": "sample_101_a1763_q0", "video_id": 101, "video_path": "./videos/sample_101_real.mp4", "annotation_index": 1763, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 0.", "D. 7."], "answer": "C", "time_stamp_s": 304, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_101_a1763_q0", "video_id": 101, "time_stamp_s": 304, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "93c943ba4b6aea97f54db9da9eb565c4068c952e88a7c295424fd7549cf9d9db", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027], "recent_frames_sha256": "f797a51957c4dc89c81b7e113d3ef2983d827442635a57dc6a5d6f292e6436f0", "num_recent_frames": 30, "tq": 715745.455254834, "t1": 715753.04296662, "ta": 715753.04296662, "te": 715753.080506796, "first_response_s": 7.587711785919964, "answer_total_s": 7.625251961988397, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_101_a1763_q0", "video_id": 101, "time_stamp_s": 304, "ground_truth": "C", "raw_output": "C. 0.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "c1672d12ffb01f506ded819c64679b48da26ded8b44031164ba7834164259739", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a light blue shirt stands beside a whiteboard displaying \"UNIT 2: Summative Project\" with project requirements.  \n- He gestures with both hands while speaking, indicating the project's components like \"Explain your product\" and \"Create a 30-second commercial.\"  \n- The whiteboard includes bullet points such as \"Must include: 1. Product, 2. Price, 3. A persuasive message, 4. A character, 5. A setting, 6. A call to action.\"\n[30-60s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for a \"Unit 2: Summative Project\" involving creating a 30-second commercial.  \n- The man’s hands move expressively as he explains the project requirements, which include elements like a product, a character, and a setting.\n[60-90s] - A man in a light blue shirt stands beside a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text: \"UNIT 2: Summative Project\" and instructions for creating a 30-second commercial.  \n- The man’s hands move expressively as he explains the project requirements, with no visible changes in his position or the board’s content.\n[90-120s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"Unit 2: Summative Project\" involving creating a 30-second commercial.  \n- The man holds a blue book or notebook in his left hand, occasionally referencing it while speaking.\n[120-150s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text including \"UNIT 2: Summative Project\" and instructions for a 30-second commercial.  \n- The man occasionally points to different sections of the whiteboard as he explains the project requirements.\n[150-180s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"Unit 2: Summative Project\" with bullet points about creating a 30-second commercial.  \n- The man occasionally points to the whiteboard, emphasizing specific project requirements.\n[180-210s] - Man in light blue shirt gestures with hands while standing beside a whiteboard displaying \"UNIT 2: Summative Project\" and project requirements.  \n- Whiteboard lists key project elements: \"CREATE A 30 SECOND COMMERCIAL,\" \"MUST INCLUDE,\" and \"REQUIREMENTS.\"  \n- Man occasionally points to specific text on the whiteboard, emphasizing project details.\n[210-240s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"Unit 2: Summative Project\" involving a 30-second commercial for a \"Mystery Project.\"  \n- The man occasionally points to specific sections of the whiteboard, emphasizing key requirements like \"Must Include\" and \"Must Be 30 Seconds.\"\n[240-270s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"Unit 2: Summative Project\" involving a 30-second commercial.  \n- The man occasionally shifts his stance and gestures toward the whiteboard, emphasizing points.\n[270-300s] - A man in a light blue shirt stands beside a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"Unit 2: Summative Project\" with bullet points about creating a 30-second commercial.  \n- The man’s hands move expressively as he points to different sections of the whiteboard.", "history_tokens": 881, "history_utf8_bytes": 3566, "recent_frame_times_s": [274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027], "recent_frames_sha256": "f797a51957c4dc89c81b7e113d3ef2983d827442635a57dc6a5d6f292e6436f0", "num_recent_frames": 30, "tq": 715689.986297636, "t1": 715691.669053876, "ta": 715691.669053876, "te": 715691.863138813, "first_response_s": 1.6827562400139868, "answer_total_s": 1.8768411769997329, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 102, "content_group": "fd0a08af04a3e9541eb32a591f51cfd4987a48c3a51b87b829dd635d64e71d7c", "question": {"question_id": "sample_102_a81_q0", "video_id": 102, "video_path": "./videos/sample_102_real.mp4", "annotation_index": 81, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 16, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_102_a81_q0", "video_id": 102, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "556058567e7e971b1d8d1f59486ac6badb3a3a08640f32ba9ce845d7836a29bc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "e96d6a2a02c4d98dd388aca78b01cb10b636ecb868427680dbd433aeb2817bfb", "num_recent_frames": 16, "tq": 715941.657311339, "t1": 715942.759714661, "ta": 715942.759714661, "te": 715942.797306233, "first_response_s": 1.1024033220019192, "answer_total_s": 1.1399948939215392, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_102_a81_q0", "video_id": 102, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "408cab3d1b8a1f042715f1bed3b8b46a3aad623a8ad7c6c5f357606bea660a78", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "e96d6a2a02c4d98dd388aca78b01cb10b636ecb868427680dbd433aeb2817bfb", "num_recent_frames": 16, "tq": 715829.205538966, "t1": 715830.668152942, "ta": 715830.668152942, "te": 715831.233189022, "first_response_s": 1.4626139759784564, "answer_total_s": 2.0276500560576096, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 102, "content_group": "fd0a08af04a3e9541eb32a591f51cfd4987a48c3a51b87b829dd635d64e71d7c", "question": {"question_id": "sample_102_a81_q1", "video_id": 102, "video_path": "./videos/sample_102_real.mp4", "annotation_index": 81, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 1.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 56, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_102_a81_q1", "video_id": 102, "time_stamp_s": 56, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "35c1e3b3f751d0d46a32139b74be8e99c1086d5e2f38f94ea98a08da1e84d64f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334], "recent_frames_sha256": "8a449fccbacb2aa89f30c10cc99a2af7e4e6231a40d4a2a959ae7760d54acd5b", "num_recent_frames": 30, "tq": 715942.824202087, "t1": 715953.1303115, "ta": 715953.1303115, "te": 715953.16821528, "first_response_s": 10.30610941303894, "answer_total_s": 10.344013193040155, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_102_a81_q1", "video_id": 102, "time_stamp_s": 56, "ground_truth": "D", "raw_output": "D. 0.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "6c27d4c0dad3735aa7cf05391e8842e1fec53ca23b7e016fcfa865f3206800fc", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"UNIT 3: SUMMATIVE PROJECT,\" including instructions to create a 1-3 minute silent film with specific requirements.  \n- The man occasionally points to different sections of the whiteboard as he explains the project guidelines.", "history_tokens": 85, "history_utf8_bytes": 370, "recent_frame_times_s": [26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334], "recent_frames_sha256": "8a449fccbacb2aa89f30c10cc99a2af7e4e6231a40d4a2a959ae7760d54acd5b", "num_recent_frames": 30, "tq": 715842.319437636, "t1": 715849.805868445, "ta": 715849.805868445, "te": 715850.006745586, "first_response_s": 7.486430809018202, "answer_total_s": 7.687307950109243, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 102, "content_group": "fd0a08af04a3e9541eb32a591f51cfd4987a48c3a51b87b829dd635d64e71d7c", "question": {"question_id": "sample_102_a82_q0", "video_id": 102, "video_path": "./videos/sample_102_real.mp4", "annotation_index": 82, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 0.", "B. 3.", "C. 4.", "D. 1."], "answer": "A", "time_stamp_s": 86, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_102_a82_q0", "video_id": 102, "time_stamp_s": 86, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3d533a31e689eee2a205e3119d94745ca643eb6c826052b0a78f6f8a581d0a60", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.01726666666667, 85.01826666666666], "recent_frames_sha256": "89e01684e007e0cb78d846706aab35b3dff6572a0fccdcb7cc3c5b45febe0b77", "num_recent_frames": 30, "tq": 715953.187969414, "t1": 715959.902661174, "ta": 715959.902661174, "te": 715959.940713461, "first_response_s": 6.714691759902053, "answer_total_s": 6.752744046971202, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_102_a82_q0", "video_id": 102, "time_stamp_s": 86, "ground_truth": "A", "raw_output": "A. 0.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "fb7354e85782cc5ebf27829c45f821d671847f8ccd6427a278455e96de5a1652", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"UNIT 3: SUMMATIVE PROJECT,\" including instructions to create a 1-3 minute silent film with specific requirements.  \n- The man occasionally points to different sections of the whiteboard as he explains the project guidelines.\n[30-60s] - Man gestures with hands while speaking, standing in front of a whiteboard displaying project guidelines.  \n- Whiteboard contains text: \"UNIT 3: SUMMATIVE PROJECT\" and instructions for creating a 1-3 minute silent film.  \n- Man’s hands move expressively as he explains project requirements, including minimum 30 seconds, at least three character roles, and use of one or more effects.", "history_tokens": 177, "history_utf8_bytes": 767, "recent_frame_times_s": [56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.01726666666667, 85.01826666666666], "recent_frames_sha256": "89e01684e007e0cb78d846706aab35b3dff6572a0fccdcb7cc3c5b45febe0b77", "num_recent_frames": 30, "tq": 715860.715455853, "t1": 715866.719221053, "ta": 715866.719221053, "te": 715866.904577165, "first_response_s": 6.003765199915506, "answer_total_s": 6.189121311996132, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 102, "content_group": "fd0a08af04a3e9541eb32a591f51cfd4987a48c3a51b87b829dd635d64e71d7c", "question": {"question_id": "sample_102_a83_q0", "video_id": 102, "video_path": "./videos/sample_102_real.mp4", "annotation_index": 83, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 4.", "C. 6.", "D. 0."], "answer": "D", "time_stamp_s": 206, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_102_a83_q0", "video_id": 102, "time_stamp_s": 206, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "28d9dcedeff6ca5bc9d9e32ff82133fab62670e6af8680e4b7c0dcce081fb31c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "fbc12064388fc7379047fba041e344c475585858673e2167ea41f28d6cba5fa2", "num_recent_frames": 30, "tq": 715959.955523397, "t1": 715971.471530428, "ta": 715971.471530428, "te": 715971.509086628, "first_response_s": 11.516007031081244, "answer_total_s": 11.553563231020235, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_102_a83_q0", "video_id": 102, "time_stamp_s": 206, "ground_truth": "D", "raw_output": "D. 0.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "f7778d9d640ae009c0794d4888c3d8790ba87efb8dc5ce4f68e4d4dfd2662920", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"UNIT 3: SUMMATIVE PROJECT,\" including instructions to create a 1-3 minute silent film with specific requirements.  \n- The man occasionally points to different sections of the whiteboard as he explains the project guidelines.\n[30-60s] - Man gestures with hands while speaking, standing in front of a whiteboard displaying project guidelines.  \n- Whiteboard contains text: \"UNIT 3: SUMMATIVE PROJECT\" and instructions for creating a 1-3 minute silent film.  \n- Man’s hands move expressively as he explains project requirements, including minimum 30 seconds, at least three character roles, and use of one or more effects.\n[60-90s] - Man gestures toward whiteboard with both hands while speaking.  \n- Whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" and project requirements.  \n- Man stands in front of whiteboard, slightly shifting posture while explaining.\n[90-120s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" with bullet points about creating a 1-3 minute silent film.  \n- The man occasionally points to the whiteboard, emphasizing specific project requirements.\n[120-150s] - Man gestures with hands while speaking, standing in front of a whiteboard.  \n- Whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" with bullet points about creating a 1-3 minute silent film.  \n- Man occasionally points to the whiteboard while explaining the project requirements.\n[150-180s] - Man gestures with hands while speaking, standing in front of a whiteboard.  \n- Whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" with bullet points about creating a 1-3 minute silent film.  \n- Background features dark setting with hanging lights above the whiteboard.", "history_tokens": 449, "history_utf8_bytes": 1888, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "fbc12064388fc7379047fba041e344c475585858673e2167ea41f28d6cba5fa2", "num_recent_frames": 30, "tq": 715898.059706965, "t1": 715899.759756712, "ta": 715899.759756712, "te": 715899.945680315, "first_response_s": 1.7000497470144182, "answer_total_s": 1.8859733500285074, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 102, "content_group": "fd0a08af04a3e9541eb32a591f51cfd4987a48c3a51b87b829dd635d64e71d7c", "question": {"question_id": "sample_102_a84_q0", "video_id": 102, "video_path": "./videos/sample_102_real.mp4", "annotation_index": 84, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 8.", "C. 3.", "D. 0."], "answer": "D", "time_stamp_s": 281, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_102_a84_q0", "video_id": 102, "time_stamp_s": 281, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "feb2f25687e77093cfdeb5f64d9cae54ff15121a3d90aae0201917d8d441da9a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665], "recent_frames_sha256": "bcd1abf85bf4e78f90342a974c4895cca1f90f06c6be0023db33c31fab7dfc04", "num_recent_frames": 30, "tq": 715971.524917058, "t1": 715977.773582386, "ta": 715977.773582386, "te": 715977.811378836, "first_response_s": 6.248665328021161, "answer_total_s": 6.286461778101511, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_102_a84_q0", "video_id": 102, "time_stamp_s": 281, "ground_truth": "D", "raw_output": "D. 0.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "fdaca2d72484afb90a3437622b3c7932c8ec203e774c68d57a56a1d1775b5933", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"UNIT 3: SUMMATIVE PROJECT,\" including instructions to create a 1-3 minute silent film with specific requirements.  \n- The man occasionally points to different sections of the whiteboard as he explains the project guidelines.\n[30-60s] - Man gestures with hands while speaking, standing in front of a whiteboard displaying project guidelines.  \n- Whiteboard contains text: \"UNIT 3: SUMMATIVE PROJECT\" and instructions for creating a 1-3 minute silent film.  \n- Man’s hands move expressively as he explains project requirements, including minimum 30 seconds, at least three character roles, and use of one or more effects.\n[60-90s] - Man gestures toward whiteboard with both hands while speaking.  \n- Whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" and project requirements.  \n- Man stands in front of whiteboard, slightly shifting posture while explaining.\n[90-120s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" with bullet points about creating a 1-3 minute silent film.  \n- The man occasionally points to the whiteboard, emphasizing specific project requirements.\n[120-150s] - Man gestures with hands while speaking, standing in front of a whiteboard.  \n- Whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" with bullet points about creating a 1-3 minute silent film.  \n- Man occasionally points to the whiteboard while explaining the project requirements.\n[150-180s] - Man gestures with hands while speaking, standing in front of a whiteboard.  \n- Whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" with bullet points about creating a 1-3 minute silent film.  \n- Background features dark setting with hanging lights above the whiteboard.\n[180-210s] - A man in a gray shirt gestures with both hands while speaking, standing to the right of a whiteboard.  \n- The whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" with bullet points about creating a 1-3 minute silent film.  \n- The man’s hands move expressively as he explains the project requirements, occasionally pointing to the whiteboard.\n[210-240s] - A man in a gray shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" with bullet points about creating a 1-3 minute silent film.  \n- The man’s hands move expressively as he explains the project requirements, emphasizing key points.\n[240-270s] - A man in a gray shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" with bullet points about creating a 1-3 minute silent film.  \n- The man’s hands move expressively as he explains the project requirements, maintaining eye contact with the camera.", "history_tokens": 704, "history_utf8_bytes": 2920, "recent_frame_times_s": [251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665], "recent_frames_sha256": "bcd1abf85bf4e78f90342a974c4895cca1f90f06c6be0023db33c31fab7dfc04", "num_recent_frames": 30, "tq": 715922.547057309, "t1": 715929.505013855, "ta": 715929.505013855, "te": 715929.696439998, "first_response_s": 6.9579565461026505, "answer_total_s": 7.149382689036429, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 102, "content_group": "fd0a08af04a3e9541eb32a591f51cfd4987a48c3a51b87b829dd635d64e71d7c", "question": {"question_id": "sample_102_a85_q0", "video_id": 102, "video_path": "./videos/sample_102_real.mp4", "annotation_index": 85, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 0.", "C. 3.", "D. 7."], "answer": "B", "time_stamp_s": 304, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_102_a85_q0", "video_id": 102, "time_stamp_s": 304, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d558c96034fbf0a11a217694a23b0a00b834e8652167407ddda80ab06af1bf42", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027], "recent_frames_sha256": "a0474ca7035914b0c63eb36873930411fe0858d0d704c32f85c0a70372ac12a7", "num_recent_frames": 30, "tq": 715977.821550888, "t1": 715988.305252893, "ta": 715988.305252893, "te": 715988.342657609, "first_response_s": 10.483702005003579, "answer_total_s": 10.521106721018441, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_102_a85_q0", "video_id": 102, "time_stamp_s": 304, "ground_truth": "B", "raw_output": "B. 0.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "2951d94b2f3e2dc68fa778a7654362191dcfd46464dd1542cd3d2a5e65b0b65f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"UNIT 3: SUMMATIVE PROJECT,\" including instructions to create a 1-3 minute silent film with specific requirements.  \n- The man occasionally points to different sections of the whiteboard as he explains the project guidelines.\n[30-60s] - Man gestures with hands while speaking, standing in front of a whiteboard displaying project guidelines.  \n- Whiteboard contains text: \"UNIT 3: SUMMATIVE PROJECT\" and instructions for creating a 1-3 minute silent film.  \n- Man’s hands move expressively as he explains project requirements, including minimum 30 seconds, at least three character roles, and use of one or more effects.\n[60-90s] - Man gestures toward whiteboard with both hands while speaking.  \n- Whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" and project requirements.  \n- Man stands in front of whiteboard, slightly shifting posture while explaining.\n[90-120s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" with bullet points about creating a 1-3 minute silent film.  \n- The man occasionally points to the whiteboard, emphasizing specific project requirements.\n[120-150s] - Man gestures with hands while speaking, standing in front of a whiteboard.  \n- Whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" with bullet points about creating a 1-3 minute silent film.  \n- Man occasionally points to the whiteboard while explaining the project requirements.\n[150-180s] - Man gestures with hands while speaking, standing in front of a whiteboard.  \n- Whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" with bullet points about creating a 1-3 minute silent film.  \n- Background features dark setting with hanging lights above the whiteboard.\n[180-210s] - A man in a gray shirt gestures with both hands while speaking, standing to the right of a whiteboard.  \n- The whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" with bullet points about creating a 1-3 minute silent film.  \n- The man’s hands move expressively as he explains the project requirements, occasionally pointing to the whiteboard.\n[210-240s] - A man in a gray shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" with bullet points about creating a 1-3 minute silent film.  \n- The man’s hands move expressively as he explains the project requirements, emphasizing key points.\n[240-270s] - A man in a gray shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" with bullet points about creating a 1-3 minute silent film.  \n- The man’s hands move expressively as he explains the project requirements, maintaining eye contact with the camera.\n[270-300s] - A man in a gray shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays \"UNIT 3: SUMMATIVE PROJECT\" with bullet points about creating a 1-3 minute silent film.  \n- The man’s hands move expressively as he explains the project requirements, emphasizing key points.", "history_tokens": 787, "history_utf8_bytes": 3251, "recent_frame_times_s": [274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027], "recent_frames_sha256": "a0474ca7035914b0c63eb36873930411fe0858d0d704c32f85c0a70372ac12a7", "num_recent_frames": 30, "tq": 715934.845374991, "t1": 715941.364100068, "ta": 715941.364100068, "te": 715941.623529864, "first_response_s": 6.518725077039562, "answer_total_s": 6.778154873056337, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 103, "content_group": "9140715aed5d3b2d283db6c1b40097f014f701c3dfd65a235e3697322dd2e43b", "question": {"question_id": "sample_103_a1156_q0", "video_id": 103, "video_path": "./videos/sample_103_real.mp4", "annotation_index": 1156, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 16, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_103_a1156_q0", "video_id": 103, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6a64e7e74de680263102a487d69cf01afd9b8816dbddfc9a2862990e095d78f4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "abb752e01353fa6ec968675b5d3aafb714423dcc37374bb9892aeece65b758b2", "num_recent_frames": 16, "tq": 716108.900953244, "t1": 716114.593629251, "ta": 716114.593629251, "te": 716114.631277624, "first_response_s": 5.692676007049158, "answer_total_s": 5.730324380099773, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_103_a1156_q0", "video_id": 103, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3c820e8ec76fbb1a02250d91b8fea40d5b3ade7de795631b4c55262e0dfd9cff", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "abb752e01353fa6ec968675b5d3aafb714423dcc37374bb9892aeece65b758b2", "num_recent_frames": 16, "tq": 716176.585854451, "t1": 716182.548078556, "ta": 716182.548078556, "te": 716182.698342072, "first_response_s": 5.962224104907364, "answer_total_s": 6.112487620906904, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 103, "content_group": "9140715aed5d3b2d283db6c1b40097f014f701c3dfd65a235e3697322dd2e43b", "question": {"question_id": "sample_103_a1156_q1", "video_id": 103, "video_path": "./videos/sample_103_real.mp4", "annotation_index": 1156, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 1.", "B. 3.", "C. 4.", "D. 0."], "answer": "D", "time_stamp_s": 56, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_103_a1156_q1", "video_id": 103, "time_stamp_s": 56, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1af45121245ba95531bcd3225bba67a67469c53a2253ea1086d8c57825e6fcd2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334], "recent_frames_sha256": "8203401517d94583b94060f3c8494ab65d66d9bf256f31058a39a4eca2ded55e", "num_recent_frames": 30, "tq": 716114.64191849, "t1": 716126.312393098, "ta": 716126.312393098, "te": 716126.349781441, "first_response_s": 11.67047460807953, "answer_total_s": 11.707862951094285, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_103_a1156_q1", "video_id": 103, "time_stamp_s": 56, "ground_truth": "D", "raw_output": "D. 0.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "6c0b1515a0bca27705eda7d1887a6b795ce8b3ae6f8ede8df6a11fa2b88798ac", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a film class project, including instructions and criteria for recreating a 1.5-minute scene.  \n- The man occasionally points to specific sections on the whiteboard as he explains the project requirements.", "history_tokens": 78, "history_utf8_bytes": 347, "recent_frame_times_s": [26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334], "recent_frames_sha256": "8203401517d94583b94060f3c8494ab65d66d9bf256f31058a39a4eca2ded55e", "num_recent_frames": 30, "tq": 716194.207064613, "t1": 716201.065702254, "ta": 716201.065702254, "te": 716201.33895287, "first_response_s": 6.858637640951201, "answer_total_s": 7.131888256990351, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 103, "content_group": "9140715aed5d3b2d283db6c1b40097f014f701c3dfd65a235e3697322dd2e43b", "question": {"question_id": "sample_103_a1157_q0", "video_id": 103, "video_path": "./videos/sample_103_real.mp4", "annotation_index": 1157, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 0.", "B. 3.", "C. 4.", "D. 1."], "answer": "A", "time_stamp_s": 86, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_103_a1157_q0", "video_id": 103, "time_stamp_s": 86, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a0cf62e0c425ab9bc117a22d5f8ebe7b0257a089e9ed492f11ab7153f9565d32", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.01726666666667, 85.01826666666666], "recent_frames_sha256": "7374e10d2ee5428d5a04b00c965a2c36803d824f2ca7b2ce52102fff990162c6", "num_recent_frames": 30, "tq": 716126.362235441, "t1": 716140.255339434, "ta": 716140.255339434, "te": 716140.292392924, "first_response_s": 13.893103993032128, "answer_total_s": 13.9301574829733, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_103_a1157_q0", "video_id": 103, "time_stamp_s": 86, "ground_truth": "A", "raw_output": "A. 0.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "6523024cc6ae317657f9ac2f94d394e0160fb056036dc78279a556902d4f9458", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a film class project, including instructions and criteria for recreating a 1.5-minute scene.  \n- The man occasionally points to specific sections on the whiteboard as he explains the project requirements.\n[30-60s] - Teacher gestures with hands while standing beside a whiteboard displaying project guidelines.  \n- Whiteboard lists requirements for recreating a 1.5-minute scene from a film or TV show, including voice tracks, sound effects, and audio.  \n- Teacher’s attire includes a light-colored button-up shirt, and he appears to be explaining the project details.", "history_tokens": 157, "history_utf8_bytes": 712, "recent_frame_times_s": [56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.01726666666667, 85.01826666666666], "recent_frames_sha256": "7374e10d2ee5428d5a04b00c965a2c36803d824f2ca7b2ce52102fff990162c6", "num_recent_frames": 30, "tq": 716206.536368545, "t1": 716213.446515203, "ta": 716213.446515203, "te": 716213.63702759, "first_response_s": 6.910146657959558, "answer_total_s": 7.1006590449251235, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 103, "content_group": "9140715aed5d3b2d283db6c1b40097f014f701c3dfd65a235e3697322dd2e43b", "question": {"question_id": "sample_103_a1157_q1", "video_id": 103, "video_path": "./videos/sample_103_real.mp4", "annotation_index": 1157, "question_index": 1, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 0.", "B. 3.", "C. 4.", "D. 1."], "answer": "A", "time_stamp_s": 115, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_103_a1157_q1", "video_id": 103, "time_stamp_s": 115, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d9c01f303ea2095e5312ce2b7e7fc6dab474e6a8a74ab907b0e8cd17e6ddb2cd", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [85.01826666666666, 86.01926666666667, 87.02026666666667, 88.02126666666666, 89.02226666666667, 90.02326666666667, 91.02426666666666, 92.02526666666667, 93.02626666666667, 94.02726666666666, 95.02826666666667, 96.02926666666667, 97.03026666666666, 98.03126666666667, 99.03226666666667, 100.03326666666666, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139], "recent_frames_sha256": "c7ccb1e4cc9d445913074f40cbdd33c5d6efe3285d28ab38e2abdac86cc624a1", "num_recent_frames": 30, "tq": 716140.30333067, "t1": 716154.991255448, "ta": 716154.991255448, "te": 716155.028859789, "first_response_s": 14.687924777972512, "answer_total_s": 14.725529119023122, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_103_a1157_q1", "video_id": 103, "time_stamp_s": 115, "ground_truth": "A", "raw_output": "A. 0.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "3a5414b81ea1738893ece61003f7b5ec5a65515e67e1eec0df4369f6e799915b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a film class project, including instructions and criteria for recreating a 1.5-minute scene.  \n- The man occasionally points to specific sections on the whiteboard as he explains the project requirements.\n[30-60s] - Teacher gestures with hands while standing beside a whiteboard displaying project guidelines.  \n- Whiteboard lists requirements for recreating a 1.5-minute scene from a film or TV show, including voice tracks, sound effects, and audio.  \n- Teacher’s attire includes a light-colored button-up shirt, and he appears to be explaining the project details.\n[60-90s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about a \"Unit 4 Summative Project\" involving recreating a 1.5-minute scene from a film or TV show.  \n- The man’s hands move expressively as he explains the project requirements, including script, treatment, and sound effects.", "history_tokens": 248, "history_utf8_bytes": 1080, "recent_frame_times_s": [85.01826666666666, 86.01926666666667, 87.02026666666667, 88.02126666666666, 89.02226666666667, 90.02326666666667, 91.02426666666666, 92.02526666666667, 93.02626666666667, 94.02726666666666, 95.02826666666667, 96.02926666666667, 97.03026666666666, 98.03126666666667, 99.03226666666667, 100.03326666666666, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139], "recent_frames_sha256": "c7ccb1e4cc9d445913074f40cbdd33c5d6efe3285d28ab38e2abdac86cc624a1", "num_recent_frames": 30, "tq": 716220.611376769, "t1": 716228.635984255, "ta": 716228.635984255, "te": 716228.859041539, "first_response_s": 8.024607485975139, "answer_total_s": 8.247664769995026, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 103, "content_group": "9140715aed5d3b2d283db6c1b40097f014f701c3dfd65a235e3697322dd2e43b", "question": {"question_id": "sample_103_a1158_q0", "video_id": 103, "video_path": "./videos/sample_103_real.mp4", "annotation_index": 1158, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 3.", "B. 4.", "C. 6.", "D. 0."], "answer": "D", "time_stamp_s": 206, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_103_a1158_q0", "video_id": 103, "time_stamp_s": 206, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fbdb1ce8d2f83698c17de8a452c1d70b94edf43e587bd6afd4e1530b7e8cf0f2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "a87c5ccd073363e83f31862afa58245901fc0b83c7bf8c3ccca9dcdcc923a12a", "num_recent_frames": 30, "tq": 716155.047654044, "t1": 716162.902221384, "ta": 716162.902221384, "te": 716162.939361924, "first_response_s": 7.854567339993082, "answer_total_s": 7.891707879956812, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_103_a1158_q0", "video_id": 103, "time_stamp_s": 206, "ground_truth": "D", "raw_output": "D. 0.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "655d9c4b2ebce5ffc6b7046758b334f7a42b4518e50589886abd552b867623b5", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a film class project, including instructions and criteria for recreating a 1.5-minute scene.  \n- The man occasionally points to specific sections on the whiteboard as he explains the project requirements.\n[30-60s] - Teacher gestures with hands while standing beside a whiteboard displaying project guidelines.  \n- Whiteboard lists requirements for recreating a 1.5-minute scene from a film or TV show, including voice tracks, sound effects, and audio.  \n- Teacher’s attire includes a light-colored button-up shirt, and he appears to be explaining the project details.\n[60-90s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about a \"Unit 4 Summative Project\" involving recreating a 1.5-minute scene from a film or TV show.  \n- The man’s hands move expressively as he explains the project requirements, including script, treatment, and sound effects.\n[90-120s] - A man in a gray button-up shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for a \"Unit 4 Summative Project\" with bullet points about recreating a 1.5-minute scene from a film or TV show.  \n- The man’s hands move expressively as he explains the project requirements, occasionally pointing to the whiteboard.\n[120-150s] - A man in a gray shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for a \"UNIT 4: SUMMATIVE PROJECT\" with instructions to recreate a 1.5-minute scene from a film or TV show.  \n- The man’s hands move expressively as he explains the project requirements, including voice, sound effects, and script elements.\n[150-180s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"UNIT 4: SUMMATIVE PROJECT\" with instructions to recreate a 1.5-minute scene from a film or TV show.  \n- The man’s hands move expressively as he explains the project requirements, including voice tracks, sound effects, and audio elements.", "history_tokens": 537, "history_utf8_bytes": 2245, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "a87c5ccd073363e83f31862afa58245901fc0b83c7bf8c3ccca9dcdcc923a12a", "num_recent_frames": 30, "tq": 716279.207618677, "t1": 716281.00709964, "ta": 716281.00709964, "te": 716281.20983267, "first_response_s": 1.7994809629162773, "answer_total_s": 2.0022139929933473, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 103, "content_group": "9140715aed5d3b2d283db6c1b40097f014f701c3dfd65a235e3697322dd2e43b", "question": {"question_id": "sample_103_a1159_q0", "video_id": 103, "video_path": "./videos/sample_103_real.mp4", "annotation_index": 1159, "question_index": 0, "question": "How many times in total have movie clips been inserted during this person's explanation so far?", "options": ["A. 2.", "B. 8.", "C. 3.", "D. 0."], "answer": "D", "time_stamp_s": 240, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "introduction_to_film", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_103_a1159_q0", "video_id": 103, "time_stamp_s": 240, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5a503bf4d5aff2b6edd9360d665e0b4051deb3e1e661eac0219172e2154870a7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334], "recent_frames_sha256": "5b5f1b4e016bcae38f0aa6cdd98210a875d421ac988586ca2e8ee3f49e91b4a4", "num_recent_frames": 30, "tq": 716162.951988951, "t1": 716176.539119105, "ta": 716176.539119105, "te": 716176.576655794, "first_response_s": 13.587130154017359, "answer_total_s": 13.624666843097657, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_103_a1159_q0", "video_id": 103, "time_stamp_s": 240, "ground_truth": "D", "raw_output": "D. 0.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "70a93ac86fadaf7ab0e8830ab7cc9e067b3941150c5dfc7f0c33272b6a71c282", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a film class project, including instructions and criteria for recreating a 1.5-minute scene.  \n- The man occasionally points to specific sections on the whiteboard as he explains the project requirements.\n[30-60s] - Teacher gestures with hands while standing beside a whiteboard displaying project guidelines.  \n- Whiteboard lists requirements for recreating a 1.5-minute scene from a film or TV show, including voice tracks, sound effects, and audio.  \n- Teacher’s attire includes a light-colored button-up shirt, and he appears to be explaining the project details.\n[60-90s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text about a \"Unit 4 Summative Project\" involving recreating a 1.5-minute scene from a film or TV show.  \n- The man’s hands move expressively as he explains the project requirements, including script, treatment, and sound effects.\n[90-120s] - A man in a gray button-up shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for a \"Unit 4 Summative Project\" with bullet points about recreating a 1.5-minute scene from a film or TV show.  \n- The man’s hands move expressively as he explains the project requirements, occasionally pointing to the whiteboard.\n[120-150s] - A man in a gray shirt stands in front of a whiteboard, gesturing with both hands while speaking.  \n- The whiteboard displays text for a \"UNIT 4: SUMMATIVE PROJECT\" with instructions to recreate a 1.5-minute scene from a film or TV show.  \n- The man’s hands move expressively as he explains the project requirements, including voice, sound effects, and script elements.\n[150-180s] - A man in a light blue shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"UNIT 4: SUMMATIVE PROJECT\" with instructions to recreate a 1.5-minute scene from a film or TV show.  \n- The man’s hands move expressively as he explains the project requirements, including voice tracks, sound effects, and audio elements.\n[180-210s] - A man in a gray button-up shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"UNIT 4: SUMMATIVE PROJECT\" with instructions to recreate a 1.5-minute scene from a film or TV show.  \n- The man’s hands move expressively as he explains the project requirements, including voice track, sound effects, and audio elements.\n[210-240s] - A man in a gray shirt stands in front of a whiteboard, gesturing with his hands while speaking.  \n- The whiteboard displays text for a \"Unit 4 Summative Project\" with instructions to recreate a 1.5-minute scene from a film or TV show.  \n- The man’s hands move expressively as he explains the project requirements, including voice tracks, sound effects, and music.", "history_tokens": 731, "history_utf8_bytes": 3022, "recent_frame_times_s": [210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334], "recent_frames_sha256": "5b5f1b4e016bcae38f0aa6cdd98210a875d421ac988586ca2e8ee3f49e91b4a4", "num_recent_frames": 30, "tq": 716295.227769447, "t1": 716296.249202568, "ta": 716296.249202568, "te": 716296.432933078, "first_response_s": 1.0214331209426746, "answer_total_s": 1.205163631006144, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 104, "content_group": "3a2172c930e6b35656f0942674aa8dca06fceacfee4f2c43e30a4be364a845cf", "question": {"question_id": "sample_104_a1571_q0", "video_id": 104, "video_path": "./videos/sample_104_real.mp4", "annotation_index": 1571, "question_index": 0, "question": "What is written on the rectangular object that the individual is presenting?", "options": ["A. GTX 1080.", "B. RTX 4090.", "C. RTX 3070.", "D. RX 6900."], "answer": "B", "time_stamp_s": 15, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_104_a1571_q0", "video_id": 104, "time_stamp_s": 15, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5cdfa753a8328d4a3377970074395f874019b7f502761bc5d95135031d597416", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0], "recent_frames_sha256": "daca4f3f5aad7fc31970267889cd603142491e2b595f7e8755e2e13c6365a005", "num_recent_frames": 16, "tq": 715971.527112145, "t1": 715977.773582386, "ta": 715977.773582386, "te": 715977.811378836, "first_response_s": 6.246470240992494, "answer_total_s": 6.284266691072844, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_104_a1571_q0", "video_id": 104, "time_stamp_s": 15, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "38ecfdfb11fd9c847da42cd1623d51c3d1d49ec2eef7c1b6030a66166237eec4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0], "recent_frames_sha256": "daca4f3f5aad7fc31970267889cd603142491e2b595f7e8755e2e13c6365a005", "num_recent_frames": 16, "tq": 716018.97277313, "t1": 716020.209208873, "ta": 716020.209208873, "te": 716020.395699577, "first_response_s": 1.2364357429323718, "answer_total_s": 1.4229264470050111, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 104, "content_group": "3a2172c930e6b35656f0942674aa8dca06fceacfee4f2c43e30a4be364a845cf", "question": {"question_id": "sample_104_a1572_q0", "video_id": 104, "video_path": "./videos/sample_104_real.mp4", "annotation_index": 1572, "question_index": 0, "question": "Just now, which graphics card model has its frame rate exceeding 200 FPS?", "options": ["A. RTX 2080 Ti.", "B. RTX 3090.", "C. RTX 4090.", "D. GTX 1080."], "answer": "C", "time_stamp_s": 240, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [220, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_104_a1572_q0", "video_id": 104, "time_stamp_s": 240, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fd813b0cc00f958b3f91c74c642a2d0147f4c06069731f3f5a682ae91c6d6f10", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0], "recent_frames_sha256": "94593dc51b003cfcad45df0606f5a8682e6d70b719f90183c7d9f0038be6e7ae", "num_recent_frames": 30, "tq": 715977.825905472, "t1": 715988.305252893, "ta": 715988.305252893, "te": 715988.342657609, "first_response_s": 10.479347420972772, "answer_total_s": 10.516752136987634, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_104_a1572_q0", "video_id": 104, "time_stamp_s": 240, "ground_truth": "C", "raw_output": "C. RTX 4090.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "73e7db3d548f3c6e1f68baa0b3c09bff86777d609654a74f0df3fb05dd2123e6", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a black shirt holds an RTX 3090 graphics card, showcasing its design and features.  \n- A split-screen comparison displays the RTX 3090 (left) and RTX 4090 (right) performing in a racing game, with performance metrics overlaid.  \n- Text overlays list technical specs for both RTX 3090 and RTX 4090, including silicon, CUDA cores, boost clock, memory, power, and MSRP.\n[30-60s] - White Lamborghini Huracán drives on a winding road flanked by sunflowers, with performance metrics displayed for GTX 1080 and GTX 1070 GPUs.\n- The car transitions onto a bridge, with distant mountains visible, while GPU performance numbers fluctuate.\n- A split-screen comparison shows Kratos from God of War, with performance stats for GTX 2080 Ti, GTX 2070, and GTX 1070 GPUs, all in a misty forest setting.\n[60-90s] - Kratos' muscular torso and wrapped arm are visible in a forest setting, with slight movement indicating character interaction.  \n- The scene transitions to a rocky, sunlit environment where Kratos' hand touches the ground, suggesting exploration or combat readiness.  \n- Frame-by-frame, the character's posture and environment shift subtly, reflecting gameplay progression across different scenes.\n[90-120s] - Three GPU performance comparisons (RTX 3060 Ti, RTX 3060, RTX 4060) show frame rates increasing from 42 to 50+ FPS in open-world scenes, then dropping to 25–35 FPS in indoor environments.\n- The game transitions from outdoor landscapes to indoor architectural settings, with visible changes in lighting and texture detail across GPU types.\n- Frame rates fluctuate during gameplay, with RTX 4060 consistently showing higher FPS than RTX 3060 Ti in most scenes, especially in complex environments.\n[120-150s] - Split-screen displays show RTX 3060 and RTX 4090 GPU performance in Valorant, with frame rates fluctuating between 200-600 FPS.  \n- The game environment transitions from indoor to outdoor urban settings, featuring detailed architecture and dynamic lighting.  \n- A bar graph compares RTX 4090 vs. RTX 3080 performance across multiple games, highlighting superior frame rates for the 4090 in most titles.\n[150-180s] - A man in a black shirt holds an RTX 4090 graphics card, gesturing toward its design and features.  \n- The background includes a green-lit setup with a black storage unit and acoustic panels.  \n- The man’s hand movements suggest he is explaining or showcasing the card’s attributes.\n[180-210s] - Man in black shirt gestures while speaking in a dark room with green lighting and tech equipment.  \n- Hands hold and rotate an RTX 4090 graphics card against a bright green background.  \n- Close-up of black RTX 4090 box with silver text, followed by split-screen gameplay comparison showing performance metrics.\n[210-240s] - Three side-by-side game scenes show a character walking through industrial corridors, with FPS counters indicating performance differences between GPU models.\n- The scene transitions to a split-screen view of a snowy mountain landscape, comparing performance between an RTX 4070 and an RTX 6700.\n- FPS numbers fluctuate across the frames, with the RTX 4070 consistently showing higher performance than the RTX 6700 in the mountain scene.", "history_tokens": 819, "history_utf8_bytes": 3215, "recent_frame_times_s": [211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0], "recent_frames_sha256": "94593dc51b003cfcad45df0606f5a8682e6d70b719f90183c7d9f0038be6e7ae", "num_recent_frames": 30, "tq": 716088.486850056, "t1": 716095.317713254, "ta": 716095.317713254, "te": 716095.68872223, "first_response_s": 6.830863198032603, "answer_total_s": 7.201872174046002, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 104, "content_group": "3a2172c930e6b35656f0942674aa8dca06fceacfee4f2c43e30a4be364a845cf", "question": {"question_id": "sample_104_a1573_q0", "video_id": 104, "video_path": "./videos/sample_104_real.mp4", "annotation_index": 1573, "question_index": 0, "question": "Which rival drivers are shown in front of the first-person perspective of the \"WILLIAMS\" car right now?", "options": ["A. RUSSELL and ALONSO.", "B. VERSTAPPEN, BOTTAS, RUSSELL, MAGNUSSEN and ALBON.", "C. HAMILTON and LECLERC.", "D. VETTEL and GASLY."], "answer": "B", "time_stamp_s": 457, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [440, 460], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_104_a1573_q0", "video_id": 104, "time_stamp_s": 457, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2d30f369603c7b3543010e7baae4b65d02e9b23f917dacd9aeabfc74057db1d8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [428.0, 429.0, 430.0, 431.0, 432.0, 433.0, 434.0, 435.0, 436.0, 437.0, 438.0, 439.0, 440.0, 441.0, 442.0, 443.0, 444.0, 445.0, 446.0, 447.0, 448.0, 449.0, 450.0, 451.0, 452.0, 453.0, 454.0, 455.0, 456.0, 457.0], "recent_frames_sha256": "9e6fa5dcf27f3f225f8699a7a66a27f68e9f346b14b907f5dee43f4a4ab8095b", "num_recent_frames": 30, "tq": 715988.351483577, "t1": 716000.058235674, "ta": 716000.058235674, "te": 716000.096266263, "first_response_s": 11.7067520970013, "answer_total_s": 11.74478268600069, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_104_a1573_q0", "video_id": 104, "time_stamp_s": 457, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dbfbf294aee4ed709dc4827638c4e85417da246124905dda774a2403142cefed", "condition_order": ["recent", "notes"], "memory": "[210-240s] - Three side-by-side game scenes show a character walking through industrial corridors, with FPS counters indicating performance differences between GPU models.\n- The scene transitions to a split-screen view of a snowy mountain landscape, comparing performance between an RTX 4070 and an RTX 6700.\n- FPS numbers fluctuate across the frames, with the RTX 4070 consistently showing higher performance than the RTX 6700 in the mountain scene.\n[240-270s] - Left screen: \"RTX 4070 1080p\" with \"30 FPS\" and \"1080p 30 FPS\" text, showing a dimly lit bar scene with people seated at tables.  \n- Right screen: \"RTX 4070 1440p\" with \"30 FPS\" and \"1440p 30 FPS\" text, displaying a similar bar scene but with higher resolution and more detail.  \n- Both screens: Text overlays indicate \"Gaming 2027 - 4K 60\n[270-300s] - Three side-by-side screens show different GPU performance metrics for \"Crysis 3\" and \"Microsoft Flight Simulator\" games, with varying frame rates and resolutions.\n- The left screen displays \"NVIDIA GeForce RTX 4060\" at 60 FPS, while the right screen shows \"NVIDIA GeForce RTX 6070\" at 24 FPS, indicating performance differences.\n- The video transitions from urban street scenes to mountainous landscapes, highlighting graphical fidelity and frame rate variations across GPUs.\n[300-330s] - Left screen: GTX 6700 at 1080p, 60 FPS, displaying a snowy mountain landscape with a plane flying overhead.  \n- Right screen: GTX 6700 at 2040p, 60 FPS, showing the same scene with higher resolution and more detailed textures.  \n- Both screens: Display \"Microsoft Flight Simulator\" title, with performance metrics and frame rate indicators visible.\n[330-360s] - Split-screen comparison shows two GPUs: RTX 4060 (left) and RTX 4060 (right) running a racing game, with performance metrics displayed on-screen.\n- The left side displays \"RTX 4060 48 FPS\" and \"48 FPS\" while the right side shows \"RTX 4060 128 FPS\" and \"128 FPS,\" indicating higher frame rates on the right.\n- A man in a black shirt appears in a studio setting, standing in front of a green-lit background with a graphics card visible on a\n[360-390s] - Performance chart displays RTX 4060 scores for Cyberpunk 4K+High, with 108.4 FPS for the first test and 37.0ms latency.\n- Game footage shows a red car driving through a neon-lit city street, with GPU performance metrics (e.g., 123 FPS) displayed on-screen.\n- Split-screen comparison highlights two different visual settings or resolutions, with the left side labeled \"RTX 4060 (BT + DLSS 3 Perf. + FGC)\" and the right side \"RTX 4060 (BT\n[390-420s] - Left screen: GTX 1060 60fps, right screen: GTX 1070 60fps, both showing a futuristic city street with neon signs and a red-lit car driving forward.\n- Both screens display \"4K Ultra HD\" resolution and \"1440p Ultra HD\" resolution respectively, with the left screen showing a slightly lower frame rate than the right.\n- The car's rear lights glow red, and the environment features tall buildings with glowing advertisements and streetlights, creating a vibrant, high-contrast urban scene.\n[420-450s] - Three side-by-side screens show racing game footage with \"RTX 3060\" and \"RTX 4060\" labels, indicating GPU performance comparisons.  \n- The left screen displays a blue car with \"WILLIAMS\" branding, while the right screen shows a red car with \"F1\" branding, both in a race environment.  \n- The cars are positioned on a track with palm trees and grandstands visible, suggesting a sunny, urban racetrack setting.", "history_tokens": 983, "history_utf8_bytes": 3477, "recent_frame_times_s": [428.0, 429.0, 430.0, 431.0, 432.0, 433.0, 434.0, 435.0, 436.0, 437.0, 438.0, 439.0, 440.0, 441.0, 442.0, 443.0, 444.0, 445.0, 446.0, 447.0, 448.0, 449.0, 450.0, 451.0, 452.0, 453.0, 454.0, 455.0, 456.0, 457.0], "recent_frames_sha256": "9e6fa5dcf27f3f225f8699a7a66a27f68e9f346b14b907f5dee43f4a4ab8095b", "num_recent_frames": 30, "tq": 716154.231686606, "t1": 716161.972618466, "ta": 716161.972618466, "te": 716162.011461301, "first_response_s": 7.740931860054843, "answer_total_s": 7.779774695052765, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 104, "content_group": "3a2172c930e6b35656f0942674aa8dca06fceacfee4f2c43e30a4be364a845cf", "question": {"question_id": "sample_104_a1574_q0", "video_id": 104, "video_path": "./videos/sample_104_real.mp4", "annotation_index": 1574, "question_index": 0, "question": "What key statistics about the GPU were shown just now?", "options": ["A. CPU usage and system temperature.", "B. GPU model, temperature readings, clock speed and power.", "C. Memory usage and network speed.", "D. Hard drive space and cooling fan speed."], "answer": "B", "time_stamp_s": 672, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [660, 680], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_104_a1574_q0", "video_id": 104, "time_stamp_s": 672, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f2ca4fcbffe16eec13d10736e7830c18c2c268e4196425d5bbb23dd515049258", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [643.0, 644.0, 645.0, 646.0, 647.0, 648.0, 649.0, 650.0, 651.0, 652.0, 653.0, 654.0, 655.0, 656.0, 657.0, 658.0, 659.0, 660.0, 661.0, 662.0, 663.0, 664.0, 665.0, 666.0, 667.0, 668.0, 669.0, 670.0, 671.0, 672.0], "recent_frames_sha256": "10165adbca3fe139f29c04d53823f7dd4055108b50bb847a6e0218e7d4249d48", "num_recent_frames": 30, "tq": 716000.102982654, "t1": 716007.113236163, "ta": 716007.113236163, "te": 716007.151143875, "first_response_s": 7.010253509040922, "answer_total_s": 7.048161220969632, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_104_a1574_q0", "video_id": 104, "time_stamp_s": 672, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "57cdfaa92778197691ff496c1f2e8698b56f58f1d48dd855953b112b8036fa75", "condition_order": ["recent", "notes"], "memory": "[390-420s] - Left screen: GTX 1060 60fps, right screen: GTX 1070 60fps, both showing a futuristic city street with neon signs and a red-lit car driving forward.\n- Both screens display \"4K Ultra HD\" resolution and \"1440p Ultra HD\" resolution respectively, with the left screen showing a slightly lower frame rate than the right.\n- The car's rear lights glow red, and the environment features tall buildings with glowing advertisements and streetlights, creating a vibrant, high-contrast urban scene.\n[420-450s] - Three side-by-side screens show racing game footage with \"RTX 3060\" and \"RTX 4060\" labels, indicating GPU performance comparisons.  \n- The left screen displays a blue car with \"WILLIAMS\" branding, while the right screen shows a red car with \"F1\" branding, both in a race environment.  \n- The cars are positioned on a track with palm trees and grandstands visible, suggesting a sunny, urban racetrack setting.\n[450-480s] - Split-screen comparison shows two different graphics cards (RTX 4060 vs RTX 4090) rendering a Formula 1 race scene with performance metrics displayed.  \n- A person holds an RTX 4090 GPU, showcasing its design and branding against a dark background with green lighting.  \n- The scene transitions to a split-screen comparison of two different graphics cards (RTX 4060 vs RTX 4090) rendering a first-person shooter game (AVX #1) with performance metrics displayed.\n[480-510s] - Both screens show a first-person shooter game with dual weapons firing blue energy beams at targets.  \n- The game environment transitions from an indoor stone corridor to an outdoor street with buildings and palm trees.  \n- On-screen text indicates \"12.284 ms\" and \"AVX 2.3\" performance metrics, with a red \"18\" score displayed on each side.\n[510-540s] - Player character in both views holds a weapon with glowing blue energy, facing forward in a city street environment.  \n- Both screens show \"APL #3\" and \"100% FPS\" with a \"37\" ammo count, indicating consistent game state.  \n- The environment features orange flames on the right side and a staircase leading up to a building entrance.\n[540-570s] - Split-screen displays show side-by-side gameplay from \"Overwatch 2\" with performance metrics (e.g., 128.4K FPS, 60Hz) and \"AVX 2\" label indicating hardware acceleration.\n- A bar graph compares GPU encoding performance (OBS Encoding + Overwatch 2) across different RTX cards, highlighting frame rates and encoding efficiency.\n- Visuals include in-game scenes with characters firing weapons and dynamic lighting effects, alongside technical overlays showing real-time performance data.\n[570-600s] - OBS Encoder performance graph displayed for RTX 4090, 3090, and 2080 cards, showing frame rates and encoding efficiency.\n- Video editing interface with timeline and preview window, indicating no clips created yet.\n- Davinci Resolve Studio benchmark results shown, comparing RTX 4090, 3090, and 2080 cards for frame rates.\n[600-630s] - A green bar graph displays \"Blender 3.3\" benchmark results for RTX 4090, RTX 3090, and RTX 2080 Ti GPUs.\n- The screen transitions to a \"V-Ray 5 benchmark\" graph showing performance metrics for the same GPU models.\n- A man in a black shirt holds an RTX 4090 graphics card, gesturing while standing in front of a green-lit studio background.\n[630-660s] - A dark sports car is parked on a rural road with a yellow license plate, surrounded by fields and mountains under a clear sky.\n- In an industrial setting, a character stands near large cylindrical structures with a \"Find the Hiding Place of Power\" objective displayed.\n- A first-person view shows a futuristic weapon in a snowy industrial zone with large tanks and blue crates, with performance stats visible in the top-left corner.", "history_tokens": 957, "history_utf8_bytes": 3727, "recent_frame_times_s": [643.0, 644.0, 645.0, 646.0, 647.0, 648.0, 649.0, 650.0, 651.0, 652.0, 653.0, 654.0, 655.0, 656.0, 657.0, 658.0, 659.0, 660.0, 661.0, 662.0, 663.0, 664.0, 665.0, 666.0, 667.0, 668.0, 669.0, 670.0, 671.0, 672.0], "recent_frames_sha256": "10165adbca3fe139f29c04d53823f7dd4055108b50bb847a6e0218e7d4249d48", "num_recent_frames": 30, "tq": 716211.863502192, "t1": 716213.446515203, "ta": 716213.446515203, "te": 716213.63702759, "first_response_s": 1.5830130110261962, "answer_total_s": 1.7735253979917616, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 104, "content_group": "3a2172c930e6b35656f0942674aa8dca06fceacfee4f2c43e30a4be364a845cf", "question": {"question_id": "sample_104_a1575_q0", "video_id": 104, "video_path": "./videos/sample_104_real.mp4", "annotation_index": 1575, "question_index": 0, "question": "What is the visual focus of the scene right now?", "options": ["A. The setup of a gaming console.", "B. Two graphics cards on a white surface.", "C. A close-up of a computer screen.", "D. A group of people discussing."], "answer": "B", "time_stamp_s": 826, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [820, 833], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_104_a1575_q0", "video_id": 104, "time_stamp_s": 826, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "109aae5a384699b8bc31517381eaf1bc290ac6c9465b824fb262d42300f86632", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [797.0, 798.0, 799.0, 800.0, 801.0, 802.0, 803.0, 804.0, 805.0, 806.0, 807.0, 808.0, 809.0, 810.0, 811.0, 812.0, 813.0, 814.0, 815.0, 816.0, 817.0, 818.0, 819.0, 820.0, 821.0, 822.0, 823.0, 824.0, 825.0, 826.0], "recent_frames_sha256": "edc723447925711b0616c881b13688530963ccb65a907d1cb1098fb0ac280929", "num_recent_frames": 30, "tq": 716007.158639748, "t1": 716018.927287673, "ta": 716018.927287673, "te": 716018.964814241, "first_response_s": 11.768647924996912, "answer_total_s": 11.806174493045546, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_104_a1575_q0", "video_id": 104, "time_stamp_s": 826, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "60df8daeca72cda8dd161addcb18a2247557ec2638c62341cc9895cd186c7eb8", "condition_order": ["recent", "notes"], "memory": "[540-570s] - Split-screen displays show side-by-side gameplay from \"Overwatch 2\" with performance metrics (e.g., 128.4K FPS, 60Hz) and \"AVX 2\" label indicating hardware acceleration.\n- A bar graph compares GPU encoding performance (OBS Encoding + Overwatch 2) across different RTX cards, highlighting frame rates and encoding efficiency.\n- Visuals include in-game scenes with characters firing weapons and dynamic lighting effects, alongside technical overlays showing real-time performance data.\n[570-600s] - OBS Encoder performance graph displayed for RTX 4090, 3090, and 2080 cards, showing frame rates and encoding efficiency.\n- Video editing interface with timeline and preview window, indicating no clips created yet.\n- Davinci Resolve Studio benchmark results shown, comparing RTX 4090, 3090, and 2080 cards for frame rates.\n[600-630s] - A green bar graph displays \"Blender 3.3\" benchmark results for RTX 4090, RTX 3090, and RTX 2080 Ti GPUs.\n- The screen transitions to a \"V-Ray 5 benchmark\" graph showing performance metrics for the same GPU models.\n- A man in a black shirt holds an RTX 4090 graphics card, gesturing while standing in front of a green-lit studio background.\n[630-660s] - A dark sports car is parked on a rural road with a yellow license plate, surrounded by fields and mountains under a clear sky.\n- In an industrial setting, a character stands near large cylindrical structures with a \"Find the Hiding Place of Power\" objective displayed.\n- A first-person view shows a futuristic weapon in a snowy industrial zone with large tanks and blue crates, with performance stats visible in the top-left corner.\n[660-690s] - RTX 4090 GPU monitor shows fluctuating temperatures (125°C → 150°C) and power draw (412W → 406W) with a dynamic background of orange geometric patterns.\n- A close-up shot reveals a black GPU with RGB-lit fans and cables, mounted on a stand, under blue ambient lighting, with a monitor displaying game visuals in the background.\n- The GPU's performance metrics, including clock speeds and memory usage, are displayed in a detailed table overlay on the screen.\n[690-720s] - GPU performance metrics (RTX 4090: 158 MHz, 70°C, 2925W, 463.3°) displayed with a monitor overlay on a fiery background.  \n- A bar graph comparing \"God of War\" frame rates (RTX 4090: 158 FPS, RTX 4060: 107 FPS, RTX 3060: 76 FPS) appears on a dark screen.  \n- A person in a black shirt is partially visible, gesturing toward the screen,\n[720-750s] - A man in a black t-shirt speaks to the camera in a dimly lit room with green ambient lighting.  \n- Behind him, a black storage unit with a visible NVIDIA RTX 4090 graphics card and a green LED strip light.  \n- The man gestures with his hands while speaking, occasionally pointing or making open-handed motions.\n[750-780s] - A man in a black t-shirt speaks in a dimly lit room with green ambient lighting and a black storage unit behind him.  \n- A close-up shot shows a black RTX 4090 graphics card with silver accents and a large cooling fan, held by two hands against a bright green background.  \n- The video transitions between the man speaking and the product display, emphasizing the RTX 4090's design and branding.\n[780-810s] - Man in black t-shirt speaks in a dimly lit room with green ambient lighting and a black storage unit to his left.  \n- Split-screen gameplay footage shows two different graphics cards (RTX 3060 and RTX 3090) rendering the same game scenes with performance metrics displayed.  \n- The man reappears, continuing to speak while gesturing with his hands, maintaining the same background setup.", "history_tokens": 957, "history_utf8_bytes": 3593, "recent_frame_times_s": [797.0, 798.0, 799.0, 800.0, 801.0, 802.0, 803.0, 804.0, 805.0, 806.0, 807.0, 808.0, 809.0, 810.0, 811.0, 812.0, 813.0, 814.0, 815.0, 816.0, 817.0, 818.0, 819.0, 820.0, 821.0, 822.0, 823.0, 824.0, 825.0, 826.0], "recent_frames_sha256": "edc723447925711b0616c881b13688530963ccb65a907d1cb1098fb0ac280929", "num_recent_frames": 30, "tq": 716279.198188247, "t1": 716281.00709964, "ta": 716281.00709964, "te": 716281.20983267, "first_response_s": 1.808911392930895, "answer_total_s": 2.011644423007965, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 105, "content_group": "298a15d1e99242f053fdce40415120c91bc8546ea758b6326bbb4e519ae98982", "question": {"question_id": "sample_105_a1907_q0", "video_id": 105, "video_path": "./videos/sample_105_real.mp4", "annotation_index": 1907, "question_index": 0, "question": "What graphics card is mentioned as having 44 shader TFLOPS?", "options": ["A. RTX 4070 Super.", "B. RTX 4080 Super.", "C. RTX 4090.", "D. RTX 4070 Ti Super."], "answer": "D", "time_stamp_s": 20, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_105_a1907_q0", "video_id": 105, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ce83fa57c9640d515990325feb09114dbfdb3d5f86b4036d0f14628764623583", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665], "recent_frames_sha256": "48e8aeda90062072e152064511f1b7d5c248d7e1320b61ff901a9cb7fb48a932", "num_recent_frames": 20, "tq": 718655.333822734, "t1": 718667.157100005, "ta": 718667.157100005, "te": 718667.194920795, "first_response_s": 11.823277271003462, "answer_total_s": 11.861098061082885, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_105_a1907_q0", "video_id": 105, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "26a2d7bda397e8d20ca1625aac1ece81f8369aed1511c555d7052ee21ed49086", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665], "recent_frames_sha256": "48e8aeda90062072e152064511f1b7d5c248d7e1320b61ff901a9cb7fb48a932", "num_recent_frames": 20, "tq": 718703.879978418, "t1": 718716.392139028, "ta": 718716.392139028, "te": 718716.436551591, "first_response_s": 12.51216060994193, "answer_total_s": 12.556573173031211, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 105, "content_group": "298a15d1e99242f053fdce40415120c91bc8546ea758b6326bbb4e519ae98982", "question": {"question_id": "sample_105_a1908_q0", "video_id": 105, "video_path": "./videos/sample_105_real.mp4", "annotation_index": 1908, "question_index": 0, "question": "Which series of graphics cards is being displayed right now?", "options": ["A. GTX 1080 Ti.", "B. RTX 4070 Super.", "C. RX 5700 XT.", "D. RTX 3060."], "answer": "B", "time_stamp_s": 214, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [200, 220], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_105_a1908_q0", "video_id": 105, "time_stamp_s": 214, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c343a11f7c6a8da174c84ce2b4be07d3b0b188b1a679654c1664b93a44ae1bef", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128], "recent_frames_sha256": "42eb4c909efa5c0ed5070c0656fb165bb2af0488c67c87fc9a0aaf5088f5f608", "num_recent_frames": 30, "tq": 718667.211231962, "t1": 718674.983656724, "ta": 718674.983656724, "te": 718675.021226911, "first_response_s": 7.772424762020819, "answer_total_s": 7.809994949027896, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_105_a1908_q0", "video_id": 105, "time_stamp_s": 214, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "75b8a7862bb652f2a9b64e26ecb5a61c85ec6f6429560f6febe5c4823b50dc66", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a white shirt holds an RTX 4070 SUPER graphics card, presenting it to the camera.  \n- Animated graphics showcase RTX 4070 SUPER and RTX 4080 SUPER cards with specs and performance comparisons.  \n- A static shot displays the RTX 4070 SUPER card from multiple angles, highlighting its design and branding.\n[30-60s] - Two black RTX 4060 graphics cards are shown side by side, with one slightly angled to the left, both featuring gold-colored PCIe connectors.  \n- The scene transitions to three RTX 4060 cards displayed vertically against a dark background, with the middle card appearing slightly taller than the others.  \n- A man in a white shirt is seen holding a black RTX 4060 card, with a screen displaying Chinese text about MacBook Pro color options visible behind him.\n[60-90s] - Hands remove a black GPU's side panel, revealing internal circuitry.  \n- Side-by-side comparison displays RTX 4070 and RTX 4070 SUPER cards with labeled specifications.  \n- Close-up shots highlight the chip designs, showing \"RTX 4070\" and \"RTX 4070 SUPER\" labels with distinct core counts.\n[90-120s] - A graphic displays three GPU models (RTX 4070, 4070 SUPER, 4070 Ti) with their specifications and performance metrics, including core counts and memory bandwidth.\n- The central GPU model (RTX 4070 SUPER) is highlighted with a green bar indicating its superior performance compared to the others.\n- A person appears in the background, holding a microphone, suggesting a live presentation or review setting.\n[120-150s] - Three graphics cards (RTX 4070, RTX 4070 SUPER, RTX 4070 Ti) displayed with performance metrics and GPU architecture diagrams.\n- Physical cards shown: two dual-fan models (RTX 4070 SUPER and RTX 4070 Ti) and one triple-fan model (RTX 4070), all with ASUS branding.\n- Close-up shots reveal card designs, cooling fans, and the \"ASUS\" logo on the side of the triple-fan card.\n[150-180s] - A 3D graphics card with three fans is shown rotating on a white surface.  \n- A person in a white shirt stands behind a table with the card, gesturing while speaking.  \n- On-screen graphics display 3DMark Time Spy scores for RTX 4070 Ti, RTX 4070 SUPER, and RTX 4070, with percentage improvements highlighted.\n[180-210s] - A man in a white shirt gestures while speaking, seated at a white table with a black graphics card in front of him.  \n- The background features a blue wall with black shelving units holding various tech items.  \n- A graphics card is displayed on the table, with the man’s hands moving as he explains its features.", "history_tokens": 689, "history_utf8_bytes": 2548, "recent_frame_times_s": [184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128], "recent_frames_sha256": "42eb4c909efa5c0ed5070c0656fb165bb2af0488c67c87fc9a0aaf5088f5f608", "num_recent_frames": 30, "tq": 718773.035957832, "t1": 718773.462231759, "ta": 718773.462231759, "te": 718773.503243432, "first_response_s": 0.42627392697613686, "answer_total_s": 0.4672856000252068, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 105, "content_group": "298a15d1e99242f053fdce40415120c91bc8546ea758b6326bbb4e519ae98982", "question": {"question_id": "sample_105_a1909_q0", "video_id": 105, "video_path": "./videos/sample_105_real.mp4", "annotation_index": 1909, "question_index": 0, "question": "Which graphics card achieves the highest performance in all categories as shown?", "options": ["A. RTX 4070.", "B. RTX 4070 SUPER.", "C. RTX 4070 Ti.", "D. RTX 4060 Ti."], "answer": "C", "time_stamp_s": 420, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [400, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_105_a1909_q0", "video_id": 105, "time_stamp_s": 420, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b77c1a5e462838acb156948f4ae75de99599041084a91bfa1ff6f0ff471f6a08", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0009166666667, 419.00191666666666], "recent_frames_sha256": "f099d750d93fef06247da3be66fe86db2889776fa75028baf229d28fda24319c", "num_recent_frames": 30, "tq": 718675.037925623, "t1": 718686.31317712, "ta": 718686.31317712, "te": 718686.350857059, "first_response_s": 11.275251497048885, "answer_total_s": 11.312931435997598, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_105_a1909_q0", "video_id": 105, "time_stamp_s": 420, "ground_truth": "C", "raw_output": "C. RTX 4070 Ti.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "7575248da2c925a1f8447296173dcdb70e8279cb9abb29616a9ae38125121d46", "condition_order": ["recent", "notes"], "memory": "[120-150s] - Three graphics cards (RTX 4070, RTX 4070 SUPER, RTX 4070 Ti) displayed with performance metrics and GPU architecture diagrams.\n- Physical cards shown: two dual-fan models (RTX 4070 SUPER and RTX 4070 Ti) and one triple-fan model (RTX 4070), all with ASUS branding.\n- Close-up shots reveal card designs, cooling fans, and the \"ASUS\" logo on the side of the triple-fan card.\n[150-180s] - A 3D graphics card with three fans is shown rotating on a white surface.  \n- A person in a white shirt stands behind a table with the card, gesturing while speaking.  \n- On-screen graphics display 3DMark Time Spy scores for RTX 4070 Ti, RTX 4070 SUPER, and RTX 4070, with percentage improvements highlighted.\n[180-210s] - A man in a white shirt gestures while speaking, seated at a white table with a black graphics card in front of him.  \n- The background features a blue wall with black shelving units holding various tech items.  \n- A graphics card is displayed on the table, with the man’s hands moving as he explains its features.\n[210-240s] - A first-person shooter game (CS2) is being played, with performance metrics displayed on the left side of the screen, including GPU usage, frame rate, and temperature.\n- The player navigates through a narrow alleyway in a game environment, moving past buildings and walls, and eventually firing a weapon at an enemy.\n- A bar graph overlay shows performance comparisons between different GPU models (RTX 4070 Ti, RTX 4070 SUPER, RTX 4070) across various settings, with numerical values and percentage changes indicated.\n[240-270s] - Bar graphs display performance metrics for different GPU models in CS2, with values fluctuating over time.\n- Text overlays show specific performance numbers and percentage changes for each GPU model.\n- The screen transitions to a new game title, \"荒野大镖客：救赎2,\" with updated performance data for the same GPU models.\n[270-300s] - Bar graphs display performance metrics for different GPU models in \"Resident Evil 2\" with percentage changes indicated.  \n- Text overlays show real-time frame rates (e.g., 89, 78, 72) for various GPU configurations.  \n- A man in a white shirt gestures while seated at a desk with a graphics card beside him, against a blue background.\n[300-330s] - A group of people sit in a dimly lit, futuristic subway car with large windows showing a glowing cityscape outside.  \n- A hand reaches into the frame, gripping a metallic object, possibly a weapon or tool, with a blurred background suggesting motion.  \n- A desert racing scene unfolds with multiple high-performance cars speeding along a track, including a yellow Porsche and a black sports car, under a clear sky.\n[330-360s] - Bar graphs display performance metrics for RTX 4070 Ti, RTX 4070, and RTX 4060, with percentage changes shown in red or green.\n- Right side shows three distinct GPU performance panels, each with numerical values and labels like \"RTX 4070 Ti\" and \"RTX 4060\".\n- Graphs and panels update dynamically, indicating real-time or comparative performance data for different GPU models.\n[360-390s] - A bar graph displays performance metrics for different GPU models in the game \"The Witcher 3\" with percentages shown for each.\n- A man in a white shirt is seated at a table, gesturing toward a graphics card placed in front of him.\n- The video transitions to a dark, rainy street scene with vintage cars and streetlights, suggesting a cinematic or game environment.\n[390-420s] - Performance chart displays GPU usage, temperature, and frame rates for three RTX cards in \"心灵杀手2\" (2024-07-24) with 1080p resolution.\n- On-screen metrics show GPU usage at 4% for RTX 4070 Ti, 7% for RTX 4070, and 28% for RTX 4060, with temperatures around 70-75°C.\n- A game scene with an FBI agent walking down a wet street appears briefly, overlaid with real-time performance stats including GPU clock", "history_tokens": 1020, "history_utf8_bytes": 3880, "recent_frame_times_s": [390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0009166666667, 419.00191666666666], "recent_frames_sha256": "f099d750d93fef06247da3be66fe86db2889776fa75028baf229d28fda24319c", "num_recent_frames": 30, "tq": 718836.246893914, "t1": 718844.455427858, "ta": 718844.455427858, "te": 718844.894736474, "first_response_s": 8.208533944096416, "answer_total_s": 8.64784256007988, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 105, "content_group": "298a15d1e99242f053fdce40415120c91bc8546ea758b6326bbb4e519ae98982", "question": {"question_id": "sample_105_a1910_q0", "video_id": 105, "video_path": "./videos/sample_105_real.mp4", "annotation_index": 1910, "question_index": 0, "question": "What type of data is shown regarding \"Stable Diffusion AI\" right now?", "options": ["A. User reviews.", "B. Benchmarking data.", "C. Software tutorials.", "D. Game results."], "answer": "B", "time_stamp_s": 620, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [600, 620], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_105_a1910_q0", "video_id": 105, "time_stamp_s": 620, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "beeb06c71c98489dc1ceaf67d4708f1161843ebeb43e261cb2e9dc62bb845ea5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074, 609.0084, 610.0094, 611.0104, 612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0007166666667, 619.0017166666667], "recent_frames_sha256": "0fc3d186c4a1a7ec6f45c2026874bf30d3dc40d3d5d721235a6b0dcfd4efa014", "num_recent_frames": 30, "tq": 718686.360965448, "t1": 718693.264936742, "ta": 718693.264936742, "te": 718693.302788221, "first_response_s": 6.9039712940575555, "answer_total_s": 6.9418227730784565, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_105_a1910_q0", "video_id": 105, "time_stamp_s": 620, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0ac4f8362f3bc7cac1355e8303f7f6905e82df24bcec97cc97d5ff934760e602", "condition_order": ["recent", "notes"], "memory": "[360-390s] - A bar graph displays performance metrics for different GPU models in the game \"The Witcher 3\" with percentages shown for each.\n- A man in a white shirt is seated at a table, gesturing toward a graphics card placed in front of him.\n- The video transitions to a dark, rainy street scene with vintage cars and streetlights, suggesting a cinematic or game environment.\n[390-420s] - Performance chart displays GPU usage, temperature, and frame rates for three RTX cards in \"心灵杀手2\" (2024-07-24) with 1080p resolution.\n- On-screen metrics show GPU usage at 4% for RTX 4070 Ti, 7% for RTX 4070, and 28% for RTX 4060, with temperatures around 70-75°C.\n- A game scene with an FBI agent walking down a wet street appears briefly, overlaid with real-time performance stats including GPU clock\n[420-450s] - Bar graphs display performance metrics for RTX 3070 Ti, RTX 3070, and RTX 3060 in \"心灵杀手2\" with percentages and frame rates.\n- Right side shows detailed GPU performance tables for RTX 3070 Ti, RTX 3070, and RTX 3060, including FPS, memory usage, and temperature.\n- Graphs and tables remain static, with no visible changes or animations during the segment.\n[450-480s] - A man in a white shirt sits at a table with a black graphics card beside him, gesturing while speaking.  \n- The screen displays performance charts for RTX 4070 and RTX 4070 Ti GPUs, showing frame rate improvements at 1440P and 2160P resolutions.  \n- The background features a blue wall with shelves holding various tech items, including gaming accessories.\n[480-510s] - 3DMark Time Spy graph displays GPU performance metrics for RTX 4070, RTX 4070 Super, and RTX 4070 Ti with power consumption data.\n- A system monitoring tool interface shows real-time GPU and VRAM usage, temperature, and power draw for the RTX 4070.\n- The graph highlights a power consumption of 205W for the RTX 4070 Super at 1440P resolution.\n[510-540s] - GPU performance metrics (clock, usage, power, temp) displayed on screen, showing RTX 4070 Ti with higher clock and usage than RTX 4070.\n- A person gestures while speaking, positioned behind a table with a graphics card.\n- A software interface with video playback and settings is visible on a computer screen.\n[540-570s] - Adobe Media Encoder (2023) benchmark results displayed, showing HEVC 4K60 encoding performance with RTX 4070 Ti and RTX 4070 SUPER cards.\n- GPU monitoring tool shows real-time usage for RTX 4070 SUPER and RTX 4070 Ti, highlighting their respective performance under load.\n- Side-by-side comparisons of GPU performance metrics, with annotations indicating \"一个图层, 两倍\" (one layer, double) for RTX 4070 SUPER and \"两个图层, 只用一个\" (two\n[570-600s] - A table displays GPU specifications for RTX 4070 SUPER, RTX 4080, and RTX 4070 Ti, with red annotations highlighting \"一个显存槽, 两个显存槽, 一个显存槽\" (one memory slot, two memory slots, one memory slot) for each model.  \n- The table includes performance metrics like \"显存带宽\" (memory bandwidth) and \"显存容量\" (memory capacity) for each GPU.  \n- A presenter is seated at a desk with a graphics card in front of them, gesturing while speaking,", "history_tokens": 916, "history_utf8_bytes": 3180, "recent_frame_times_s": [590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074, 609.0084, 610.0094, 611.0104, 612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0007166666667, 619.0017166666667], "recent_frames_sha256": "0fc3d186c4a1a7ec6f45c2026874bf30d3dc40d3d5d721235a6b0dcfd4efa014", "num_recent_frames": 30, "tq": 718893.452801269, "t1": 718900.297333752, "ta": 718900.297333752, "te": 718900.498340101, "first_response_s": 6.844532483024523, "answer_total_s": 7.0455388319678605, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 105, "content_group": "298a15d1e99242f053fdce40415120c91bc8546ea758b6326bbb4e519ae98982", "question": {"question_id": "sample_105_a1911_q0", "video_id": 105, "video_path": "./videos/sample_105_real.mp4", "annotation_index": 1911, "question_index": 0, "question": "What models are the two graphics cards labeled right now?", "options": ["A. GTX 3090.", "B. RX 6900.", "C. RTX 4070 and RTX 4070 SUPER.", "D. LIV."], "answer": "C", "time_stamp_s": 735, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [740, 758], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_105_a1911_q0", "video_id": 105, "time_stamp_s": 735, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7dc3f44eaee1426d6d934c546309f8f2d9423cdea91d2b5478604d5ace3b1d20", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [705.0043, 706.0053, 707.0063, 708.0073, 709.0083, 710.0093, 711.0103, 712.0113, 713.0123, 714.0133, 715.0143, 716.0153, 717.0163, 718.0006166666667, 719.0016166666667, 720.0026166666667, 721.0036166666666, 722.0046166666667, 723.0056166666667, 724.0066166666667, 725.0076166666666, 726.0086166666666, 727.0096166666667, 728.0106166666667, 729.0116166666667, 730.0126166666666, 731.0136166666666, 732.0146166666667, 733.0156166666667, 734.0166166666667], "recent_frames_sha256": "30d92a521f2b87e03a1e5d642ec251e5156de3f0c026cb0da71b3b6089e06cf5", "num_recent_frames": 30, "tq": 718693.311345015, "t1": 718703.834480928, "ta": 718703.834480928, "te": 718703.871940505, "first_response_s": 10.523135913070291, "answer_total_s": 10.560595490038395, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_105_a1911_q0", "video_id": 105, "time_stamp_s": 735, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2c14ca8b8ae41f326ab93d79993ceef42871e8131c2aca059237b13450896030", "condition_order": ["recent", "notes"], "memory": "[480-510s] - 3DMark Time Spy graph displays GPU performance metrics for RTX 4070, RTX 4070 Super, and RTX 4070 Ti with power consumption data.\n- A system monitoring tool interface shows real-time GPU and VRAM usage, temperature, and power draw for the RTX 4070.\n- The graph highlights a power consumption of 205W for the RTX 4070 Super at 1440P resolution.\n[510-540s] - GPU performance metrics (clock, usage, power, temp) displayed on screen, showing RTX 4070 Ti with higher clock and usage than RTX 4070.\n- A person gestures while speaking, positioned behind a table with a graphics card.\n- A software interface with video playback and settings is visible on a computer screen.\n[540-570s] - Adobe Media Encoder (2023) benchmark results displayed, showing HEVC 4K60 encoding performance with RTX 4070 Ti and RTX 4070 SUPER cards.\n- GPU monitoring tool shows real-time usage for RTX 4070 SUPER and RTX 4070 Ti, highlighting their respective performance under load.\n- Side-by-side comparisons of GPU performance metrics, with annotations indicating \"一个图层, 两倍\" (one layer, double) for RTX 4070 SUPER and \"两个图层, 只用一个\" (two\n[570-600s] - A table displays GPU specifications for RTX 4070 SUPER, RTX 4080, and RTX 4070 Ti, with red annotations highlighting \"一个显存槽, 两个显存槽, 一个显存槽\" (one memory slot, two memory slots, one memory slot) for each model.  \n- The table includes performance metrics like \"显存带宽\" (memory bandwidth) and \"显存容量\" (memory capacity) for each GPU.  \n- A presenter is seated at a desk with a graphics card in front of them, gesturing while speaking,\n[600-630s] - User interface displays a form with a red-bordered input field labeled \"Prompt\" and a preview pane showing an anime-style girl in a bear hat against a snowy backdrop.  \n- The form includes sliders for parameters like \"Steps\" and \"CFG Scale,\" with numerical values changing as the user interacts.  \n- The preview image dynamically updates, showing different poses or expressions of the girl as the user adjusts settings.\n[630-660s] - Bar chart displays Stable Diffusion AI image generation performance metrics for RTX 4070, RTX 4070 Ti, and RTX 4090 cards across different resolutions.\n- A presenter stands behind a table with a graphics card, gesturing while speaking.\n- 3DMark Time Spy results show performance scores for RTX 4070 Ti, RTX 4070 SUPER, and RTX 4070 cards, with RTX 4070 Ti leading.\n[660-690s] - A bar chart displays 3DMark Time Spy scores for three RTX 40-series GPUs, with the RTX 4070 Ti leading at 27012, followed by RTX 4070 SUPER at 25447, and RTX 4070 at 19490.\n- A presenter is seated at a desk with a graphics card on the table, gesturing while speaking.\n- A list of RTX 40-series GPU specifications, including CUDA cores and memory, is shown alongside an open computer case with green lighting.\n[690-720s] - Left side displays RTX 40 series GPU specs in Chinese, including models like RTX 4060 Ti SUPER and RTX 4070 Ti SUPER with their respective prices.\n- Right side shows a black PC case with green LED lighting, featuring a visible cooling fan and motherboard.\n- Text labels \"RX 7900GRE\" and \"RX 7900XT\" appear near the PC case, indicating comparison models.", "history_tokens": 929, "history_utf8_bytes": 3231, "recent_frame_times_s": [705.0043, 706.0053, 707.0063, 708.0073, 709.0083, 710.0093, 711.0103, 712.0113, 713.0123, 714.0133, 715.0143, 716.0153, 717.0163, 718.0006166666667, 719.0016166666667, 720.0026166666667, 721.0036166666666, 722.0046166666667, 723.0056166666667, 724.0066166666667, 725.0076166666666, 726.0086166666666, 727.0096166666667, 728.0106166666667, 729.0116166666667, 730.0126166666666, 731.0136166666666, 732.0146166666667, 733.0156166666667, 734.0166166666667], "recent_frames_sha256": "30d92a521f2b87e03a1e5d642ec251e5156de3f0c026cb0da71b3b6089e06cf5", "num_recent_frames": 30, "tq": 718962.361438102, "t1": 718963.41195675, "ta": 718963.41195675, "te": 718963.450476135, "first_response_s": 1.050518648000434, "answer_total_s": 1.0890380330383778, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 106, "content_group": "2f3a45e8a3b97be4ae1644251121bf13c42427edcea9664dbde1b9dfab1b858b", "question": {"question_id": "sample_106_a543_q0", "video_id": 106, "video_path": "./videos/sample_106_real.mp4", "annotation_index": 543, "question_index": 0, "question": "What is the boost clock speed of the RTX 4090 right now?", "options": ["A. 1665 MHz.", "B. 1695 MHz.", "C. 2520 MHz.", "D. 2505 MHz."], "answer": "C", "time_stamp_s": 20, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_106_a543_q0", "video_id": 106, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7517b23a0fa49a56cb09b17d6707ca51e355e558f0a0cb8ebaf238fa4b35d2cc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665], "recent_frames_sha256": "2f7c190eba3ea3acca11a92d2ea4edc381d872381927f4426102df386047f46a", "num_recent_frames": 20, "tq": 717173.389195885, "t1": 717180.495933239, "ta": 717180.495933239, "te": 717180.533791891, "first_response_s": 7.1067373539553955, "answer_total_s": 7.144596005906351, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_106_a543_q0", "video_id": 106, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "399182d3419859f8919373483bd84a950f9f3647f8a0116ec59730070dcd94b8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665], "recent_frames_sha256": "2f7c190eba3ea3acca11a92d2ea4edc381d872381927f4426102df386047f46a", "num_recent_frames": 20, "tq": 716899.400122618, "t1": 716906.157686315, "ta": 716906.157686315, "te": 716906.31602228, "first_response_s": 6.757563697057776, "answer_total_s": 6.915899662068114, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 106, "content_group": "2f3a45e8a3b97be4ae1644251121bf13c42427edcea9664dbde1b9dfab1b858b", "question": {"question_id": "sample_106_a544_q0", "video_id": 106, "video_path": "./videos/sample_106_real.mp4", "annotation_index": 544, "question_index": 0, "question": "Which performance metrics are being shown right now?", "options": ["A. CPU benchmarks for various processors.", "B. FPS results for different games.", "C. CPU clock, CPU Usage, VRAM Usage, GPU Power, GPU Temp, and FPS for 4070TiS.", "D. RAM speed metrics for different memory types."], "answer": "C", "time_stamp_s": 220, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [200, 220], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_106_a544_q0", "video_id": 106, "time_stamp_s": 220, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4cecf7f9d0b847ba85365ea86927b0b0b7aba38945be9013c6ab952f4da67412", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666, 218.00111666666666, 219.00211666666667], "recent_frames_sha256": "51bc64ae7de4231f6dd6a2efe544d3d90f79f4cce69a16e8f50b273ce418423b", "num_recent_frames": 30, "tq": 717180.55064791, "t1": 717191.958927242, "ta": 717191.958927242, "te": 717191.996488366, "first_response_s": 11.408279331983067, "answer_total_s": 11.44584045605734, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_106_a544_q0", "video_id": 106, "time_stamp_s": 220, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "610b9e1bb52c6f965030e831edad028b14da71c7987c5bd10b8b48a52854558d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a black hoodie sits at a white table, holding a small object, with a graphics card to his left and shelves with tech items behind him.  \n- On-screen graphics compare RTX 3060 Ti and RTX 3060 cards, showing specs like CUDA cores, clock speeds, and prices (9999 and 11999 respectively).  \n- A table lists RTX 40 series cards with CUDA cores, clock speeds, and prices, highlighting the RTX 4060 Ti as the most affordable option at 15000 yuan.\n[30-60s] - A graphic displays three GPU models (RTX 4070 Ti, RTX 4070 Ti SUPER, RTX 4080) with their specifications, including core count, memory size, and clock speeds.  \n- The screen transitions to a 3DMark Time Spy Extreme benchmark chart comparing performance scores across the three GPUs.  \n- The RTX 4070 Ti SUPER is highlighted with a green bar, indicating its superior performance compared to the RTX 4070 Ti and RTX 4080.\n[60-90s] - Three graphics cards (RTX 4070 Ti, RTX 4070 Ti SUPER, RTX 4080) are displayed with performance metrics and specifications in a comparative chart.\n- The RTX 4070 Ti SUPER is highlighted with a green bar indicating its superior performance over the RTX 4070 Ti and RTX 4080 in terms of VRAM and clock speeds.\n- A physical RTX 4070 Ti SUPER card is shown with three fans and a black casing, positioned on a white surface against a black background.\n[90-120s] - A person gestures toward a black graphics card with three fans on a white table against a blue background.  \n- Two graphics cards are displayed side-by-side: RTX 4070 and RTX 4080, labeled with Chinese text above each.  \n- Close-up shots show the underside of the RTX 4070 SUPER and RTX 4070 Ti SUPER cards, highlighting their circuit boards and cooling components.\n[120-150s] - RTX 4070 Ti SUPER's PCB shows a central GPU chip with \"NVIDIA\" branding, surrounded by cooling components and labeled \"10H\" and \"2H\" for heat dissipation.\n- The card's rear view displays multiple PCIe connectors and power input ports, with \"RTX 4070 Ti SUPER\" text above.\n- Two cards are shown side-by-side: one with \"ROG\" branding and another with \"华硕 TUF\" branding, both featuring triple-fan cooling systems.\n[150-180s] - A man in a black shirt sits at a white table, holding a graphics card, with a third graphics card standing beside him.  \n- The background features blue walls and shelves with various tech items.  \n- A 3DMark Time Spy chart appears on screen, displaying performance scores for different GPU models.\n[180-210s] - Bar graph displays 3DMark Time Spy Extreme scores for various RTX 40xx GPUs, with RTX 4090 leading at 1801 and RTX 4070 at 1021.\n- RTX 4090 SUPER shows a 14.0% performance drop compared to the standard RTX 4090.\n- RTX 4070 SUPER scores 1021, indicating a 10.2% improvement over the base RTX 4070.", "history_tokens": 817, "history_utf8_bytes": 2773, "recent_frame_times_s": [190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666, 218.00111666666666, 219.00211666666667], "recent_frames_sha256": "51bc64ae7de4231f6dd6a2efe544d3d90f79f4cce69a16e8f50b273ce418423b", "num_recent_frames": 30, "tq": 716960.675752744, "t1": 716967.030433825, "ta": 716967.030433825, "te": 716967.265067114, "first_response_s": 6.354681081022136, "answer_total_s": 6.589314370066859, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 106, "content_group": "2f3a45e8a3b97be4ae1644251121bf13c42427edcea9664dbde1b9dfab1b858b", "question": {"question_id": "sample_106_a545_q0", "video_id": 106, "video_path": "./videos/sample_106_real.mp4", "annotation_index": 545, "question_index": 0, "question": "Which graphics card is labeled in green in the performance comparison right now?", "options": ["A. RTX 3060 Ti.", "B. RTX 4060 Ti.", "C. RTX 4070 Ti SUPER.", "D. RTX 2070."], "answer": "C", "time_stamp_s": 419, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [400, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_106_a545_q0", "video_id": 106, "time_stamp_s": 419, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2fbac4c9af5838bd1d60c024458330f05d551757597c26fb85a01e7ccc8c6a61", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0009166666667], "recent_frames_sha256": "e08dbb80d25f93ac7f5bf830ca3820ab8d4e2a2b1e0db70b57a1aae450d25f19", "num_recent_frames": 30, "tq": 717192.012939821, "t1": 717205.586594219, "ta": 717205.586594219, "te": 717205.622802265, "first_response_s": 13.57365439797286, "answer_total_s": 13.609862443991005, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_106_a545_q0", "video_id": 106, "time_stamp_s": 419, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "abc5d6270be14cd075d7e8df29404357661aa874c1e0335da7689bf08f27e303", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A person gestures toward a black graphics card with three fans on a white table against a blue background.  \n- Two graphics cards are displayed side-by-side: RTX 4070 and RTX 4080, labeled with Chinese text above each.  \n- Close-up shots show the underside of the RTX 4070 SUPER and RTX 4070 Ti SUPER cards, highlighting their circuit boards and cooling components.\n[120-150s] - RTX 4070 Ti SUPER's PCB shows a central GPU chip with \"NVIDIA\" branding, surrounded by cooling components and labeled \"10H\" and \"2H\" for heat dissipation.\n- The card's rear view displays multiple PCIe connectors and power input ports, with \"RTX 4070 Ti SUPER\" text above.\n- Two cards are shown side-by-side: one with \"ROG\" branding and another with \"华硕 TUF\" branding, both featuring triple-fan cooling systems.\n[150-180s] - A man in a black shirt sits at a white table, holding a graphics card, with a third graphics card standing beside him.  \n- The background features blue walls and shelves with various tech items.  \n- A 3DMark Time Spy chart appears on screen, displaying performance scores for different GPU models.\n[180-210s] - Bar graph displays 3DMark Time Spy Extreme scores for various RTX 40xx GPUs, with RTX 4090 leading at 1801 and RTX 4070 at 1021.\n- RTX 4090 SUPER shows a 14.0% performance drop compared to the standard RTX 4090.\n- RTX 4070 SUPER scores 1021, indicating a 10.2% improvement over the base RTX 4070.\n[210-240s] - Game performance metrics (CPU, GPU, FPS) displayed on screen during gameplay.\n- Player character moves through a narrow alleyway, firing a pistol at an enemy.\n- On-screen graph compares GPU performance across different graphics cards, showing frame rate differences.\n[240-270s] - A man in a black shirt gestures toward a graphics card on a white table, with shelves and a blue background visible.  \n- Text overlays identify the graphics card as \"RTX 4080 16G SE\" and \"RTX 4080 12G.\"  \n- A bar chart displays performance metrics for different RTX 4080 models, including frame rates and percentage differences.\n[270-300s] - Man gestures toward a graphics card on a white table, standing against a blue backdrop with shelves holding tech items.  \n- On-screen graphics display performance benchmarks for \"荒野大镖客2\" (Red Dead Redemption 2) comparing RTX 4080, 4070 Ti, and 4070 cards.  \n- Performance charts show frame rate differences, with RTX 4080 leading and RTX 4070 trailing, alongside card specifications.\n[300-330s] - Bar graph displays performance metrics for RTX 4880, RTX 4870 SUPER, and RTX 4870, with percentage improvements highlighted in red.\n- Performance values for each GPU model are shown as horizontal bars, with numerical labels indicating specific performance scores.\n- Right side of screen shows detailed GPU specifications and performance data for each model, including clock speeds and memory bandwidth.\n[330-360s] - Bar graphs display performance metrics for RTX 4800, RTX 4870 SUPER, and RTX 4870, with percentage increases shown for each.\n- Multiple smaller tables on the right side show detailed GPU specifications and performance data.\n- The screen displays Chinese text indicating \"《赛博朋克2077》\" and \"2024-05-20\" as the game and date of testing.\n[360-390s] - A man in a black shirt gestures toward a graphics card on a white table against a blue backdrop.  \n- A bar chart displays performance metrics for different GPU models in the game \"Ashes of the Singularity.\"  \n- A scene from \"The Last of Us Part II\" shows a dark, rainy forest with a fallen tree and glowing lights in the distance.", "history_tokens": 980, "history_utf8_bytes": 3573, "recent_frame_times_s": [389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0009166666667], "recent_frames_sha256": "e08dbb80d25f93ac7f5bf830ca3820ab8d4e2a2b1e0db70b57a1aae450d25f19", "num_recent_frames": 30, "tq": 717013.947700153, "t1": 717019.949628685, "ta": 717019.949628685, "te": 717019.987328497, "first_response_s": 6.001928532030433, "answer_total_s": 6.039628344005905, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 106, "content_group": "2f3a45e8a3b97be4ae1644251121bf13c42427edcea9664dbde1b9dfab1b858b", "question": {"question_id": "sample_106_a546_q0", "video_id": 106, "video_path": "./videos/sample_106_real.mp4", "annotation_index": 546, "question_index": 0, "question": "Which GPU shows the best performance for \"SDXL(512x512)\" right now?", "options": ["A. RTX 4070.", "B. RTX 4070 Ti.", "C. RTX 4080.", "D. SD1.5(512x512)."], "answer": "C", "time_stamp_s": 620, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [600, 620], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_106_a546_q0", "video_id": 106, "time_stamp_s": 620, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2dc3cdc3663a6e1dcfdb80ff1057751dfb7d877f76432b6ad6d8f10f23332311", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074, 609.0084, 610.0094, 611.0104, 612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0007166666667, 619.0017166666667], "recent_frames_sha256": "01473eb8ed5ca7ba3a8315ef3d9e691de454c1a2f22385e33b9fbf4fd596ee2d", "num_recent_frames": 30, "tq": 717205.637611492, "t1": 717219.193325713, "ta": 717219.193325713, "te": 717219.380760166, "first_response_s": 13.555714221089147, "answer_total_s": 13.743148674024269, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_106_a546_q0", "video_id": 106, "time_stamp_s": 620, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d90bad46a2deca1669a75e8c7919b24eb80049a02ad75f8a82c9c0ef613db589", "condition_order": ["notes", "recent"], "memory": "[330-360s] - Bar graphs display performance metrics for RTX 4800, RTX 4870 SUPER, and RTX 4870, with percentage increases shown for each.\n- Multiple smaller tables on the right side show detailed GPU specifications and performance data.\n- The screen displays Chinese text indicating \"《赛博朋克2077》\" and \"2024-05-20\" as the game and date of testing.\n[360-390s] - A man in a black shirt gestures toward a graphics card on a white table against a blue backdrop.  \n- A bar chart displays performance metrics for different GPU models in the game \"Ashes of the Singularity.\"  \n- A scene from \"The Last of Us Part II\" shows a dark, rainy forest with a fallen tree and glowing lights in the distance.\n[390-420s] - Bar graph displays GPU performance metrics for RTX 4800, RTX 4870 Ti SUPER, and RTX 4870 SUPER, with RTX 4870 Ti SUPER showing highest frame rate.\n- Right side shows real-time GPU stats (e.g., GPU Clock, VRAM Usage, Temp) for each card during gameplay.\n- Gameplay footage shows two FBI agents walking on a street, with on-screen stats indicating performance differences between cards.\n[420-450s] - Bar graphs display performance metrics for RTX 4800, 4870 SUPER, 4870 Ti, and 4870, with percentage changes highlighted in red.\n- Right side shows detailed GPU specifications and benchmarks for each model, including clock speeds and memory bandwidth.\n- Performance bars dynamically update, indicating relative gains or losses between GPU models, with specific percentage values annotated.\n[450-480s] - A split-screen comparison shows two gameplay scenes from \"The Last of Us 2\" with performance metrics like FPS, GPU clock, and temperature displayed in top-left corners.  \n- The left side displays 20 FPS with 487.811 GPU clock and 47°C GPU temp, while the right side shows 76 FPS with 477.811 GPU clock and 61°C GPU temp.  \n- A person in a dark jacket with \"FBI\" on the back is visible in both scenes, walking through an urban environment with autumn trees and street signs.\n[480-510s] - A man in a black shirt gestures toward a graphics card on a white table.  \n- A comparison chart displays performance metrics for RTX 4070 Ti SUPER vs. RTX 4070 Ti and RTX 4080.  \n- The chart highlights performance gains in 1440P and 2160P resolutions with green bars indicating percentage improvements.\n[510-540s] - A man in a black shirt gestures while seated at a white table with a black cooling fan to his left.  \n- A graph displays 3DMark Time Spy scores for RTX 4070 Ti, RTX 4070 Ti SUPER, and RTX 4080, with green lines indicating performance trends.  \n- A FurMark benchmark screen shows GPU temperature at 65°C, with a list of system metrics and a live frame from a game on the right.\n[540-570s] - FurMark GPU stress test shows stable 64% utilization with temperature at 45°C, while GPU clock remains at 2088 MHz.  \n- System performance metrics display 1380 MHz memory clock and 1380 MHz GPU clock, with 100% utilization.  \n- A list of running processes is visible on the right, including \"NVIDIA GeForce RTX 4070 Ti SUPER\" and \"NVIDIA GeForce RTX 4070 Ti SUPER\" in the task manager.\n[570-600s] - A man in a black shirt gestures toward a black graphics card with three fans on a white table.  \n- A computer screen displays an image editing interface with a photo of a person in a winter scene, showing adjustable sliders for image manipulation.  \n- The photo on the screen changes to show different winter-themed outfits, including a bear hat and blue hat, as the editing parameters are adjusted.", "history_tokens": 949, "history_utf8_bytes": 3510, "recent_frame_times_s": [590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074, 609.0084, 610.0094, 611.0104, 612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0007166666667, 619.0017166666667], "recent_frames_sha256": "01473eb8ed5ca7ba3a8315ef3d9e691de454c1a2f22385e33b9fbf4fd596ee2d", "num_recent_frames": 30, "tq": 717089.236265003, "t1": 717090.490916818, "ta": 717090.490916818, "te": 717090.644596633, "first_response_s": 1.254651815048419, "answer_total_s": 1.4083316300529987, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 106, "content_group": "2f3a45e8a3b97be4ae1644251121bf13c42427edcea9664dbde1b9dfab1b858b", "question": {"question_id": "sample_106_a547_q0", "video_id": 106, "video_path": "./videos/sample_106_real.mp4", "annotation_index": 547, "question_index": 0, "question": "What emojis are currently displayed around the man and the graphics card?", "options": ["A. \"like,\" \"comment,\" \"follow,\" and \"share\".", "B. \"like,\" \"save,\" \"comment,\" and \"share\".", "C. \"like,\" \"insert coins,\" \"favorite,\" and \"share\".", "D. \"like,\" \"comment,\" \"subscribe,\" and \"share\"."], "answer": "C", "time_stamp_s": 763, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [760, 773], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_106_a547_q0", "video_id": 106, "time_stamp_s": 763, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bffcd5f971a1e7dc9715333047ae23c6045480f75d44b41e24f4034c287b52f8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [733.0156166666667, 734.0166166666667, 735.0009333333334, 736.0019333333333, 737.0029333333333, 738.0039333333333, 739.0049333333334, 740.0059333333334, 741.0069333333333, 742.0079333333333, 743.0089333333333, 744.0099333333334, 745.0109333333334, 746.0119333333333, 747.0129333333333, 748.0139333333333, 749.0149333333334, 750.0159333333334, 751.00025, 752.00125, 753.00225, 754.00325, 755.00425, 756.00525, 757.00625, 758.00725, 759.00825, 760.00925, 761.01025, 762.01125], "recent_frames_sha256": "a9c26a5909b9e063143b6786484574d375c0784828b0587f0461e24e00c4106f", "num_recent_frames": 30, "tq": 717219.403793886, "t1": 717232.381694242, "ta": 717232.381694242, "te": 717232.423085841, "first_response_s": 12.977900356054306, "answer_total_s": 13.019291955046356, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_106_a547_q0", "video_id": 106, "time_stamp_s": 763, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "020a5f25086916ddd73de7dca5af71ec618ccfb02c672df0ffd63fd5bf95311a", "condition_order": ["notes", "recent"], "memory": "[480-510s] - A man in a black shirt gestures toward a graphics card on a white table.  \n- A comparison chart displays performance metrics for RTX 4070 Ti SUPER vs. RTX 4070 Ti and RTX 4080.  \n- The chart highlights performance gains in 1440P and 2160P resolutions with green bars indicating percentage improvements.\n[510-540s] - A man in a black shirt gestures while seated at a white table with a black cooling fan to his left.  \n- A graph displays 3DMark Time Spy scores for RTX 4070 Ti, RTX 4070 Ti SUPER, and RTX 4080, with green lines indicating performance trends.  \n- A FurMark benchmark screen shows GPU temperature at 65°C, with a list of system metrics and a live frame from a game on the right.\n[540-570s] - FurMark GPU stress test shows stable 64% utilization with temperature at 45°C, while GPU clock remains at 2088 MHz.  \n- System performance metrics display 1380 MHz memory clock and 1380 MHz GPU clock, with 100% utilization.  \n- A list of running processes is visible on the right, including \"NVIDIA GeForce RTX 4070 Ti SUPER\" and \"NVIDIA GeForce RTX 4070 Ti SUPER\" in the task manager.\n[570-600s] - A man in a black shirt gestures toward a black graphics card with three fans on a white table.  \n- A computer screen displays an image editing interface with a photo of a person in a winter scene, showing adjustable sliders for image manipulation.  \n- The photo on the screen changes to show different winter-themed outfits, including a bear hat and blue hat, as the editing parameters are adjusted.\n[600-630s] - A bar chart titled \"Stable Diffusion AI 图画测试\" displays performance metrics for various GPU models, including RTX 4080, RTX 4070 Ti, and RTX 4070, with numerical values indicating efficiency or speed.\n- The chart shows three distinct sets of bars, each corresponding to different model configurations (e.g., SD1.5/SDXL/SDXL2.1), with performance values like 126B and 166B labeled at the top.\n- The visual layout includes labeled GPU names and performance percentages, with some bars highlighted\n[630-660s] - A bar chart displays Blender 4.0 rendering performance metrics for various RTX GPUs, with the RTX 4090 leading at 9.48% and RTX 4070 at 8.39%.  \n- A man in a black shirt gestures toward a graphics card placed on a white table against a blue background.  \n- In-game performance metrics (GPU clock, usage, temp) are shown on-screen during gameplay, with values fluctuating between 159 and 165.\n[660-690s] - Game performance metrics (CPU, GPU, FPS) displayed on left side of screen during gameplay.\n- Time Spy benchmark results shown on right side, including score, frame rate, and graph.\n- GPU temperature and clock speed data visible in top-left corner of screen.\n[690-720s] - A 3DMark Time Spy benchmark result of 27,579 is displayed on screen, with a 100% FPS performance indicator. - The screen transitions to show a new score of 28,410, indicating improved performance. - A man in a black shirt appears, gesturing toward a graphics card placed on a white table, with shelves holding other tech items in the background.\n[720-750s] - A table displays RTX 40 series GPU specs, including models, core counts, and memory sizes, with the RTX 4090 highlighted in green.\n- The text \"显存提升巨大\" (Memory boost is huge) appears below the RTX 4090 entry, emphasizing its 24GB VRAM.\n- The text \"CUDA核心数+70%\" (CUDA core count +70%) appears below the RTX 4090, indicating a significant increase in processing power.", "history_tokens": 959, "history_utf8_bytes": 3466, "recent_frame_times_s": [733.0156166666667, 734.0166166666667, 735.0009333333334, 736.0019333333333, 737.0029333333333, 738.0039333333333, 739.0049333333334, 740.0059333333334, 741.0069333333333, 742.0079333333333, 743.0089333333333, 744.0099333333334, 745.0109333333334, 746.0119333333333, 747.0129333333333, 748.0139333333333, 749.0149333333334, 750.0159333333334, 751.00025, 752.00125, 753.00225, 754.00325, 755.00425, 756.00525, 757.00625, 758.00725, 759.00825, 760.00925, 761.01025, 762.01125], "recent_frames_sha256": "a9c26a5909b9e063143b6786484574d375c0784828b0587f0461e24e00c4106f", "num_recent_frames": 30, "tq": 717132.563179235, "t1": 717173.33826478, "ta": 717173.33826478, "te": 717173.377816879, "first_response_s": 40.77508554502856, "answer_total_s": 40.81463764398359, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 107, "content_group": "16aba148bf1611a03e0861e55079130d9979970449be1d52292fe6c3dc261688", "question": {"question_id": "sample_107_a1603_q0", "video_id": 107, "video_path": "./videos/sample_107_real.mp4", "annotation_index": 1603, "question_index": 0, "question": "What text is prominently displayed on the screen right now before the scene transitions to an outline resembling glasses?", "options": ["A. Introducing the future.", "B. Just one more thing...", "C. One last item...", "D. One more thing..."], "answer": "D", "time_stamp_s": 5, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_107_a1603_q0", "video_id": 107, "time_stamp_s": 5, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "23453a13459fe4ace94349f95b8ae1d5fbd7e575ff848631664839530280609b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004], "recent_frames_sha256": "9809767a133dd13f6a9c7a583e4b5ac8b799f3e225553ed7237a3ea5bde237b9", "num_recent_frames": 5, "tq": 716787.867528786, "t1": 716797.455964624, "ta": 716797.455964624, "te": 716797.645120121, "first_response_s": 9.588435837998986, "answer_total_s": 9.777591335005127, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_107_a1603_q0", "video_id": 107, "time_stamp_s": 5, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9e6e9d5df00b1d480b22b910364db6a9ed236f5cc1258e2ce527f91fb4bb27fb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004], "recent_frames_sha256": "9809767a133dd13f6a9c7a583e4b5ac8b799f3e225553ed7237a3ea5bde237b9", "num_recent_frames": 5, "tq": 716837.65029601, "t1": 716844.711355589, "ta": 716844.711355589, "te": 716845.030996997, "first_response_s": 7.061059579020366, "answer_total_s": 7.380700987065211, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 107, "content_group": "16aba148bf1611a03e0861e55079130d9979970449be1d52292fe6c3dc261688", "question": {"question_id": "sample_107_a1604_q0", "video_id": 107, "video_path": "./videos/sample_107_real.mp4", "annotation_index": 1604, "question_index": 0, "question": "What scores are shown for the MacBook Air 13 just now for \"Premiere Pro\" in the \"Adobe(23.4) 视频制作\" results?", "options": ["A. 322.", "B. 835.", "C. 327.", "D. 1042."], "answer": "A", "time_stamp_s": 196, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [180, 200], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_107_a1604_q0", "video_id": 107, "time_stamp_s": 196, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "22821da8bec7d97bfe806112bce17b786dfc3ac456d9f494c53d59bc25e93c3d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333], "recent_frames_sha256": "9635f24a7ca2e1ed77fab7738b73d81cc3cc909dd7bd71419012e7bb1abd8c27", "num_recent_frames": 30, "tq": 716797.653099805, "t1": 716806.270165896, "ta": 716806.270165896, "te": 716806.307505999, "first_response_s": 8.617066091042943, "answer_total_s": 8.654406193993054, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_107_a1604_q0", "video_id": 107, "time_stamp_s": 196, "ground_truth": "A", "raw_output": "A. 322.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "4e6b56c437542f58cecb07967917566db413dcb4757fe963fb7693ce69a119a3", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man walks on a dark stage as \"One more thing...\" text appears, followed by a futuristic headset.  \n- A white screen displays Apple products: MacBook Air 11, iPad Pro, and MacBook Air 13, with images of each device.  \n- A man in a gray shirt sits at a desk with a laptop, gesturing while speaking, surrounded by shelves with tech items.\n[30-60s] - Two MacBook Air models (2022 and 2023) are displayed side-by-side, showing their distinct designs and screen wallpapers.  \n- A top-down view reveals the internal components of the 2023 model, highlighting the M2 chip and battery capacity (66.5 Wh) with text overlays.  \n- The 2023 model's battery is shown as composed of \"4 units\" with \"2 low-voltage units\" indicated, suggesting a design change from the 2022 model.\n[60-90s] - A laptop's internal battery is shown with text indicating \"4 cells\", \"2 low-voltage cells\", and \"66.5 Wh\" capacity.  \n- A man in a gray shirt sits at a desk with a laptop in front of him, gesturing while speaking.  \n- A top-down view displays two laptops side by side, one dark and one light-colored, on a white surface.\n[90-120s] - Two MacBook Air models (15-inch and 13-inch) are displayed side-by-side on a white surface, both showing the same orange abstract wallpaper.  \n- A graph titled \"Cinebench R23 循环压力测试\" appears, comparing performance scores (8201 for 13-inch, 8202 for 15-inch) with a slight upward trend in the 15-inch model's score.  \n- The graph highlights the 15-inch model's score as \"8202\" and the 13-inch model's as \"8001,\"\n[120-150s] - A graph displays CPU performance metrics for MacBook Air 15 and 13, with the 15 model showing 2.76GHz at 20W and 13 model at 2.65GHz at 12W.\n- A 3DMark Wild Life GPU test result appears, showing MacBook Air 15 scoring 8705 (92% higher than 13's 4722).\n- The 15 model's score is annotated with \"12W 14GHz\" and \"12W 14GHz\" in yellow boxes\n[150-180s] - 3DMark Wild Life GPU test results displayed, showing MacBook Air 13 and 15 with performance metrics and GPU scores.\n- 7-Zip compression test results shown, comparing compression and decompression speeds for both MacBook models.\n- DaVinci Resolve export test results presented, indicating H.264 and H.265 encoding performance for each device.", "history_tokens": 663, "history_utf8_bytes": 2247, "recent_frame_times_s": [166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333], "recent_frames_sha256": "9635f24a7ca2e1ed77fab7738b73d81cc3cc909dd7bd71419012e7bb1abd8c27", "num_recent_frames": 30, "tq": 716892.212356947, "t1": 716898.911517205, "ta": 716898.911517205, "te": 716899.348247637, "first_response_s": 6.699160257936455, "answer_total_s": 7.135890690027736, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 107, "content_group": "16aba148bf1611a03e0861e55079130d9979970449be1d52292fe6c3dc261688", "question": {"question_id": "sample_107_a1605_q0", "video_id": 107, "video_path": "./videos/sample_107_real.mp4", "annotation_index": 1605, "question_index": 0, "question": "What word is printed on the sides of the yellow and black backpack right now?", "options": ["A. TECHNO.", "B. FUTURE.", "C. CYBERPUNK.", "D. HACKER."], "answer": "C", "time_stamp_s": 362, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [360, 380], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_107_a1605_q0", "video_id": 107, "time_stamp_s": 362, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "88126320a4e6c2378238d9273803bdcc1a6ba5f35fa89871f5892e5eed9e48a2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [332.01501666666667, 333.01601666666664, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065], "recent_frames_sha256": "04a89ac462af43db0fe71bba32ac8ca2dfda09628df1bd313757fdb8194cad4f", "num_recent_frames": 30, "tq": 716806.315699175, "t1": 716816.834975072, "ta": 716816.834975072, "te": 716816.872888889, "first_response_s": 10.519275896949694, "answer_total_s": 10.557189714047126, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_107_a1605_q0", "video_id": 107, "time_stamp_s": 362, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7a8a55eb8b7b6c36092c5a83aca92f19c205179f442cfc00408a2bf6fb274ecc", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Two MacBook Air models (15-inch and 13-inch) are displayed side-by-side on a white surface, both showing the same orange abstract wallpaper.  \n- A graph titled \"Cinebench R23 循环压力测试\" appears, comparing performance scores (8201 for 13-inch, 8202 for 15-inch) with a slight upward trend in the 15-inch model's score.  \n- The graph highlights the 15-inch model's score as \"8202\" and the 13-inch model's as \"8001,\"\n[120-150s] - A graph displays CPU performance metrics for MacBook Air 15 and 13, with the 15 model showing 2.76GHz at 20W and 13 model at 2.65GHz at 12W.\n- A 3DMark Wild Life GPU test result appears, showing MacBook Air 15 scoring 8705 (92% higher than 13's 4722).\n- The 15 model's score is annotated with \"12W 14GHz\" and \"12W 14GHz\" in yellow boxes\n[150-180s] - 3DMark Wild Life GPU test results displayed, showing MacBook Air 13 and 15 with performance metrics and GPU scores.\n- 7-Zip compression test results shown, comparing compression and decompression speeds for both MacBook models.\n- DaVinci Resolve export test results presented, indicating H.264 and H.265 encoding performance for each device.\n[180-210s] - A man in a gray shirt sits at a desk with a MacBook Air 13 and 15 visible, gesturing while speaking.  \n- A screen displays \"DaVinci Resolve 导出测试\" with performance metrics for H.264 and H.265 encoding on both MacBook models.  \n- The screen transitions to \"Adobe(23.4) 视频制作\" showing Premiere Pro and After Effects performance scores for the same MacBook models.\n[210-240s] - Adobe (23.4) video editing performance chart displayed, comparing MacBook Air 13, 15, and Pro models for Premiere Pro and After Effects.  \n- A MacBook Air 15 is shown with Adobe Premiere Pro and After Effects open, displaying a video editing timeline and preview window.  \n- Blender (3.5.1) rendering test results shown, with scores for MacBook Air 13, 15, and Pro models under BMW and Classroom CPU benchmarks.\n[240-270s] - Three MacBook laptops (Air 13, Air 15, Pro 13) are displayed on a white surface, with the Air 15 centrally positioned.  \n- A man in a gray shirt sits at a desk with a laptop, gesturing while speaking.  \n- The background features shelves with various tech items and a blue wall.\n[270-300s] - A man in a gray shirt sits at a desk with a laptop, gesturing while speaking.  \n- A graphic overlay displays multiple laptops with different time stamps (e.g., 3:33, 12:07, 5:51) and Chinese text about Windows laptop battery issues.  \n- Two laptops (MacBook Air 15 and MacBook Air 13) are shown side by side on a table, both displaying the same desktop interface.\n[300-330s] - A green bar graph displays performance metrics for four MacBook models, with \"MacBook Air 15\" at the top showing 16.34 seconds.  \n- The graph includes labels for \"MacBook Air 13,\" \"MacBook Pro 16,\" and \"MacBook Pro 16\" (with a note \"Pro 16\" in parentheses).  \n- The screen shows Chinese text \"续航测试\" (Battery Life Test) and \"单位: 小时\" (Unit: Hours) beneath the graph.\n[330-360s] - Two laptops (M2 and M2 Max) displayed side-by-side, with M2 Max showing a faster 120Hz ProMotion screen.  \n- A presenter appears, gesturing while seated at a desk with a laptop in front of him.  \n- Close-up shots show the laptops' physical differences, including size, weight, and hinge design.", "history_tokens": 979, "history_utf8_bytes": 3323, "recent_frame_times_s": [332.01501666666667, 333.01601666666664, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065], "recent_frames_sha256": "04a89ac462af43db0fe71bba32ac8ca2dfda09628df1bd313757fdb8194cad4f", "num_recent_frames": 30, "tq": 716940.08871935, "t1": 716946.447545242, "ta": 716946.447545242, "te": 716946.485131011, "first_response_s": 6.358825891977176, "answer_total_s": 6.396411660942249, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 107, "content_group": "16aba148bf1611a03e0861e55079130d9979970449be1d52292fe6c3dc261688", "question": {"question_id": "sample_107_a1606_q0", "video_id": 107, "video_path": "./videos/sample_107_real.mp4", "annotation_index": 1606, "question_index": 0, "question": "Which MacBook model is shown with a geometric design on the screen right now?", "options": ["A. MacBook Air 15.", "B. MacBook Pro 14.", "C. MacBook Pro 16.", "D. MacBook Air 13."], "answer": "B", "time_stamp_s": 547, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [540, 560], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_107_a1606_q0", "video_id": 107, "time_stamp_s": 547, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e05e53918e41c3bbf927b9adedc5127494d74cc1b1b671ceb395a34860c0da00", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [517.0165, 518.0008166666667, 519.0018166666666, 520.0028166666667, 521.0038166666667, 522.0048166666667, 523.0058166666666, 524.0068166666666, 525.0078166666667, 526.0088166666667, 527.0098166666667, 528.0108166666666, 529.0118166666666, 530.0128166666667, 531.0138166666667, 532.0148166666667, 533.0158166666666, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333], "recent_frames_sha256": "5f156895075cfb30d8166b5501dc0c00ff4c1dc86bb03cafad7bce59c78cfaa7", "num_recent_frames": 30, "tq": 716816.882346236, "t1": 716826.472370153, "ta": 716826.472370153, "te": 716826.508957267, "first_response_s": 9.590023916913196, "answer_total_s": 9.626611031009816, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_107_a1606_q0", "video_id": 107, "time_stamp_s": 547, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "224469c61060a9e2fc2547f406ffbb7185344e388c422bc34ee01d53306135b3", "condition_order": ["recent", "notes"], "memory": "[240-270s] - Three MacBook laptops (Air 13, Air 15, Pro 13) are displayed on a white surface, with the Air 15 centrally positioned.  \n- A man in a gray shirt sits at a desk with a laptop, gesturing while speaking.  \n- The background features shelves with various tech items and a blue wall.\n[270-300s] - A man in a gray shirt sits at a desk with a laptop, gesturing while speaking.  \n- A graphic overlay displays multiple laptops with different time stamps (e.g., 3:33, 12:07, 5:51) and Chinese text about Windows laptop battery issues.  \n- Two laptops (MacBook Air 15 and MacBook Air 13) are shown side by side on a table, both displaying the same desktop interface.\n[300-330s] - A green bar graph displays performance metrics for four MacBook models, with \"MacBook Air 15\" at the top showing 16.34 seconds.  \n- The graph includes labels for \"MacBook Air 13,\" \"MacBook Pro 16,\" and \"MacBook Pro 16\" (with a note \"Pro 16\" in parentheses).  \n- The screen shows Chinese text \"续航测试\" (Battery Life Test) and \"单位: 小时\" (Unit: Hours) beneath the graph.\n[330-360s] - Two laptops (M2 and M2 Max) displayed side-by-side, with M2 Max showing a faster 120Hz ProMotion screen.  \n- A presenter appears, gesturing while seated at a desk with a laptop in front of him.  \n- Close-up shots show the laptops' physical differences, including size, weight, and hinge design.\n[360-390s] - A yellow and black backpack with \"Cyberpunk 2077\" branding is opened to reveal a laptop inside.  \n- Two laptops are displayed side by side on a white surface, one silver and one dark blue, both showing a webpage with product images.  \n- A hand places a dark blue laptop into the backpack, then the scene shifts to show both laptops running a music production software side by side.\n[390-420s] - A man in a gray shirt gestures while seated at a desk with a silver laptop in front of him.  \n- Two laptops are displayed side by side: a gold-colored one on the left and a dark blue one on the right, both showing the same webpage.  \n- A dark blue laptop is placed on a digital scale, with hands holding its lid open, indicating a weight measurement.\n[420-450s] - A black Apple laptop rests on a digital scale, displaying a weight of 1.5 kg.  \n- A person in a gray shirt places a silver laptop next to the black one, then lifts the black laptop to show its side profile.  \n- A split-screen view shows the black laptop (1.5 kg), a light blue laptop (1.21 kg), and a dark gray laptop (1.99 kg) on separate scales.\n[450-480s] - A man in a gray shirt sits at a desk with a laptop in front of him, gesturing while speaking.  \n- The laptop is positioned on a white surface, with shelves holding various items visible in the background.  \n- The man's hands are clasped together on the desk, and he appears to be addressing the camera directly.\n[480-510s] - Person in gray shirt holds black laptop, then places it on table beside another laptop.  \n- Two laptops are shown side-by-side, both displaying macOS desktops with distinct wallpapers.  \n- Close-up shot highlights the silver laptop’s keyboard and side ports, with a visible time display on screen.\n[510-540s] - Three Apple laptops (MacBook Air, MacBook Pro) are displayed on a white surface, with the central one in dark blue and flanked by two silver models.  \n- A text overlay in Chinese appears above the laptops, reading \"外放\" (external speakers).  \n- The scene transitions to a man sitting at a desk with a laptop, with shelves and equipment visible in the background.", "history_tokens": 922, "history_utf8_bytes": 3506, "recent_frame_times_s": [517.0165, 518.0008166666667, 519.0018166666666, 520.0028166666667, 521.0038166666667, 522.0048166666667, 523.0058166666666, 524.0068166666666, 525.0078166666667, 526.0088166666667, 527.0098166666667, 528.0108166666666, 529.0118166666666, 530.0128166666667, 531.0138166666667, 532.0148166666667, 533.0158166666666, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333], "recent_frames_sha256": "5f156895075cfb30d8166b5501dc0c00ff4c1dc86bb03cafad7bce59c78cfaa7", "num_recent_frames": 30, "tq": 716989.164770249, "t1": 716996.712720697, "ta": 716996.712720697, "te": 716996.902057228, "first_response_s": 7.547950448002666, "answer_total_s": 7.73728697898332, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 107, "content_group": "16aba148bf1611a03e0861e55079130d9979970449be1d52292fe6c3dc261688", "question": {"question_id": "sample_107_a1607_q0", "video_id": 107, "video_path": "./videos/sample_107_real.mp4", "annotation_index": 1607, "question_index": 0, "question": "What color is the background right now while the man is speaking?", "options": ["A. Red.", "B. Green.", "C. Blue.", "D. Yellow."], "answer": "C", "time_stamp_s": 734, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [720, 739], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_107_a1607_q0", "video_id": 107, "time_stamp_s": 734, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "04a569daf84ff8903d25c1285cce57afb0181d29fc880105803224e10a9b6fe8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [704.0033, 705.0043, 706.0053, 707.0063, 708.0073, 709.0083, 710.0093, 711.0103, 712.0113, 713.0123, 714.0133, 715.0143, 716.0153, 717.0163, 718.0006166666667, 719.0016166666667, 720.0026166666667, 721.0036166666666, 722.0046166666667, 723.0056166666667, 724.0066166666667, 725.0076166666666, 726.0086166666666, 727.0096166666667, 728.0106166666667, 729.0116166666667, 730.0126166666666, 731.0136166666666, 732.0146166666667, 733.0156166666667], "recent_frames_sha256": "076b692a5c6a69a64fc7031a254b6bc7a73a1aa7cb953ed3a48f61cd8ad3725a", "num_recent_frames": 30, "tq": 716826.517823868, "t1": 716837.59856814, "ta": 716837.59856814, "te": 716837.63931634, "first_response_s": 11.08074427198153, "answer_total_s": 11.121492472011596, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_107_a1607_q0", "video_id": 107, "time_stamp_s": 734, "ground_truth": "C", "raw_output": "C. Blue.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "df1e4b7a148c118bf47505e063bf6e47983b7332e6a66d5a5fe9a963f60b3b25", "condition_order": ["recent", "notes"], "memory": "[420-450s] - A black Apple laptop rests on a digital scale, displaying a weight of 1.5 kg.  \n- A person in a gray shirt places a silver laptop next to the black one, then lifts the black laptop to show its side profile.  \n- A split-screen view shows the black laptop (1.5 kg), a light blue laptop (1.21 kg), and a dark gray laptop (1.99 kg) on separate scales.\n[450-480s] - A man in a gray shirt sits at a desk with a laptop in front of him, gesturing while speaking.  \n- The laptop is positioned on a white surface, with shelves holding various items visible in the background.  \n- The man's hands are clasped together on the desk, and he appears to be addressing the camera directly.\n[480-510s] - Person in gray shirt holds black laptop, then places it on table beside another laptop.  \n- Two laptops are shown side-by-side, both displaying macOS desktops with distinct wallpapers.  \n- Close-up shot highlights the silver laptop’s keyboard and side ports, with a visible time display on screen.\n[510-540s] - Three Apple laptops (MacBook Air, MacBook Pro) are displayed on a white surface, with the central one in dark blue and flanked by two silver models.  \n- A text overlay in Chinese appears above the laptops, reading \"外放\" (external speakers).  \n- The scene transitions to a man sitting at a desk with a laptop, with shelves and equipment visible in the background.\n[540-570s] - MacBook Air 15: Displayed with a golden feather pattern on screen, centered on a dark gray background.\n- MacBook Pro 14: Shown with a dark screen featuring abstract blue and purple waves, positioned below the Air 15.\n- MacBook Pro 16: Appears with a dark screen displaying abstract red and black waves, placed below the Pro 14.\n[570-600s] - A MacBook Air 15 is displayed with a golden feather pattern on its screen, labeled \"MacBook Air 15\" in white text.  \n- A MacBook Pro 14 is shown with a dark screen featuring abstract blue and purple hues, labeled \"MacBook Pro 14\" in white text.  \n- A MacBook Pro 16 is presented with a dark screen displaying abstract red and black patterns, labeled \"MacBook Pro 16\" in white text.\n[600-630s] - Three MacBook models (Pro 15, Air 15, Pro 16) are displayed side-by-side on a white surface with labels indicating their model names and years.  \n- A man in a gray shirt sits behind the laptops, gesturing with his hands as if explaining or comparing them.  \n- The background features a dark blue wall with shelves holding various items, including cameras and decorative objects.\n[630-660s] - Three MacBook models (Pro 15 2016, Air 15 2023, Pro 16 2023) are displayed side-by-side with Chinese text labels indicating their features and comparisons.  \n- A presenter appears seated at a desk with a laptop, likely introducing or discussing the models.  \n- The screen transitions to show two laptops (likely the Air 15 and Pro 16) with Chinese text overlays highlighting screen size, battery, and other specifications.\n[660-690s] - A dark gray MacBook is displayed on a white surface with Chinese text overlay indicating \"performance, general needs, large screen, Mac\" requirements.  \n- A product lineup graphic shows multiple Apple devices including a Mac Pro, iMac, and various MacBook models, with a label pointing to the Mac Pro as \"large screen source.\"  \n- A man in a gray shirt sits at a desk with a MacBook in front of him, gesturing while speaking, against a blue wall with shelves holding decorative items.\n[690-720s] - A laptop product page displays pricing details with arrows indicating cost components: \"加购优惠券最高达1500元\" (maximum discount coupon 1500 yuan) and \"屏幕集成外放\" (screen integrated external speaker) with \"同配价格仅500元\" (same configuration price only 500 yuan).  \n- The page shows a \"存储\" (storage) section with \"¥22/GB\" and \"硬盘\" (hard drive) section with \"¥0.5/GB\" pricing options.  \n- A man in a grey shirt sits at a desk with", "history_tokens": 999, "history_utf8_bytes": 3918, "recent_frame_times_s": [704.0033, 705.0043, 706.0053, 707.0063, 708.0073, 709.0083, 710.0093, 711.0103, 712.0113, 713.0123, 714.0133, 715.0143, 716.0153, 717.0163, 718.0006166666667, 719.0016166666667, 720.0026166666667, 721.0036166666666, 722.0046166666667, 723.0056166666667, 724.0066166666667, 725.0076166666666, 726.0086166666666, 727.0096166666667, 728.0106166666667, 729.0116166666667, 730.0126166666666, 731.0136166666666, 732.0146166666667, 733.0156166666667], "recent_frames_sha256": "076b692a5c6a69a64fc7031a254b6bc7a73a1aa7cb953ed3a48f61cd8ad3725a", "num_recent_frames": 30, "tq": 717048.778630379, "t1": 717055.237077749, "ta": 717055.237077749, "te": 717055.38598549, "first_response_s": 6.4584473699796945, "answer_total_s": 6.607355111045763, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 108, "content_group": "36d39bb6af005e0c87fcd0fc17aa30c7f73d8bc491a5c4ae1a443de3beb3c69f", "question": {"question_id": "sample_108_a557_q0", "video_id": 108, "video_path": "./videos/sample_108_real.mp4", "annotation_index": 557, "question_index": 0, "question": "What is the price of the RTX 4080 shown right now?", "options": ["A. 6499元.", "B. 9499元.", "C. 7499元.", "D. 5499元."], "answer": "B", "time_stamp_s": 15, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_108_a557_q0", "video_id": 108, "time_stamp_s": 15, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d30e162ef9b03d68a3f8cbde99bea68d8026424c81451150219e6af97c12045e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014], "recent_frames_sha256": "c137206a7ad4d0bcb2beded05ceba39fd8ed878c83550fc9b6d7609f2e396037", "num_recent_frames": 15, "tq": 715612.783470197, "t1": 715618.009564272, "ta": 715618.009564272, "te": 715618.048549116, "first_response_s": 5.226094075012952, "answer_total_s": 5.265078919008374, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_108_a557_q0", "video_id": 108, "time_stamp_s": 15, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ee6200584440f8c041940e58aa41723c779e9018392067861971a9353c26f86f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014], "recent_frames_sha256": "c137206a7ad4d0bcb2beded05ceba39fd8ed878c83550fc9b6d7609f2e396037", "num_recent_frames": 15, "tq": 715697.990327083, "t1": 715699.318214045, "ta": 715699.318214045, "te": 715699.356721955, "first_response_s": 1.3278869619825855, "answer_total_s": 1.3663948719622567, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 108, "content_group": "36d39bb6af005e0c87fcd0fc17aa30c7f73d8bc491a5c4ae1a443de3beb3c69f", "question": {"question_id": "sample_108_a558_q0", "video_id": 108, "video_path": "./videos/sample_108_real.mp4", "annotation_index": 558, "question_index": 0, "question": "What is highlighted as the top-performing graphics card right now according to the 3DMark Time Spy Extreme scores?", "options": ["A. RTX 3070.", "B. RTX 4090.", "C. RTX 4080.", "D. RTX 3090 Ti."], "answer": "B", "time_stamp_s": 260, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [240, 260], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_108_a558_q0", "video_id": 108, "time_stamp_s": 260, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4e297be0979bd15732d30801584a8330fc016b20e65cebf66a5ea0306643b51a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875], "recent_frames_sha256": "3c7de761aa89c3401d47749e63cf0ef9dc19e9780d46f593646750ccf7eff568", "num_recent_frames": 30, "tq": 715618.059288003, "t1": 715660.762966203, "ta": 715660.762966203, "te": 715660.800471808, "first_response_s": 42.703678200021386, "answer_total_s": 42.74118380493019, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_108_a558_q0", "video_id": 108, "time_stamp_s": 260, "ground_truth": "B", "raw_output": "B. RTX 4090.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "0ffeb7391c22adb4e86042688b6eaa4e4d068d21e8106a0896af4db7740117d2", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a black shirt with a cloud graphic stands behind a white table, gesturing toward two graphics cards: an RTX 3080 (left) and an RTX 3090 (right).  \n- The RTX 3080 is priced at 5499元, while the RTX 3090 is priced at 9499元, displayed as text overlays on screen.  \n- The man points to the RTX 3090, then gestures toward the RTX 3080, indicating a comparison between the two cards.\n[30-60s] - Man gestures toward two graphics cards on a white table, one with three fans and another with a single fan and distinctive X-shaped design.  \n- On-screen text displays \"RTX 4080\" and \"4999元\" (4999 RMB) near the right card, indicating its model and price.  \n- Close-up shots highlight the RTX 4080's branding, cooling fans, and power connector, with text overlay showing \"LARGE TDP: 320W (RTX4080)\".\n[60-90s] - A man in glasses gestures toward two graphics cards on a table, one with three fans and another with a single fan.  \n- The scene transitions to a side-by-side comparison of two RTX 4080 cards, highlighting their physical design differences.  \n- A close-up shot shows a hand using a tool to remove a fan from a graphics card, revealing the internal circuit board.\n[90-120s] - Two RTX 4080 graphics cards are displayed side-by-side, labeled \"GIGABYTE\" and \"SUNNY\" respectively, with distinct PCB layouts and component arrangements.  \n- A presenter appears in a studio setting, holding a graphics card, with shelves of tech gear visible in the background.  \n- The video transitions between static images of the cards and live presenter shots, with a logo and date \"10/21\" appearing briefly.\n[120-150s] - RTX 4080 AD103 chip shown with 378.8 mm² die area, smaller than AD102's 608.5 mm².\n- AD103 GPU board displayed with a fan and heatsink, contrasting with AD102's bare board.\n- AD103 architecture diagram highlights 128 SMs, 24GB GDDR6X, and 21 Gbps bandwidth, versus AD102's 72 SMs, 16GB GDDR6X, and 22 Gbps.\n[150-180s] - Left panel displays RTX 4080 specs with 16 GB GDDR6X memory and 22.4 Gbps speed.  \n- Right panel shows RTX 4090 specs with 24 GB GDDR6X memory and 21 Gbps speed.  \n- Both panels feature chip diagrams with colored bars indicating memory bandwidth and core counts.\n[180-210s] - A graphic displays RTX 4080 and RTX 4090 GPU architectures with their respective core counts and memory specs.\n- A presenter is seated at a desk with two graphics cards, one RTX 4080 and one RTX 4090, positioned side by side.\n- A 3DMark Time Spy benchmark chart appears, showing performance scores for RTX 4090, RTX 4080, and RTX 3090.\n[210-240s] - Bar chart displays 3DMark Time Spy scores for RTX 4090, RTX 4080, and RTX 3090 Ti with green bars indicating higher performance.\n- RTX 4090 score (34737) is highest, followed by RTX 4080 (30880), and RTX 3090 Ti (2147) as lowest.\n- Chart transitions to \"Time Spy Extreme\" mode, showing RTX 4090 score (19648) and RTX ", "history_tokens": 936, "history_utf8_bytes": 2888, "recent_frame_times_s": [230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875], "recent_frames_sha256": "3c7de761aa89c3401d47749e63cf0ef9dc19e9780d46f593646750ccf7eff568", "num_recent_frames": 30, "tq": 715764.970535821, "t1": 715765.932281693, "ta": 715765.932281693, "te": 715766.303399792, "first_response_s": 0.9617458719294518, "answer_total_s": 1.3328639710089192, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 108, "content_group": "36d39bb6af005e0c87fcd0fc17aa30c7f73d8bc491a5c4ae1a443de3beb3c69f", "question": {"question_id": "sample_108_a559_q0", "video_id": 108, "video_path": "./videos/sample_108_real.mp4", "annotation_index": 559, "question_index": 0, "question": "What is the average FPS score of the RTX 4080 at a resolution of 3840x2160 right now?", "options": ["A. 124.", "B. 118.", "C. 100.", "D. 82."], "answer": "C", "time_stamp_s": 489, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [480, 500], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_108_a559_q0", "video_id": 108, "time_stamp_s": 489, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5a59c922b34b67f1f6a302e4647f3d64ab2a28d36e3451047dd4c48134c951d3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [459.00855, 460.00955, 461.01055, 462.01155, 463.01255, 464.01355, 465.01455, 466.01555, 467.01655, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334], "recent_frames_sha256": "ec4c3019844262ad9cc495015a32df5bdfb6e1bd359b8a6fb721aa199798be55", "num_recent_frames": 30, "tq": 715660.811696931, "t1": 715672.498010905, "ta": 715672.498010905, "te": 715672.536636053, "first_response_s": 11.686313973972574, "answer_total_s": 11.724939121981151, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_108_a559_q0", "video_id": 108, "time_stamp_s": 489, "ground_truth": "C", "raw_output": "C. 100.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "6c79aa87853d041f74fe4aa47d25f7698b8ae3c1581e0710714690ae5dc51bca", "condition_order": ["recent", "notes"], "memory": "[210-240s] - Bar chart displays 3DMark Time Spy scores for RTX 4090, RTX 4080, and RTX 3090 Ti with green bars indicating higher performance.\n- RTX 4090 score (34737) is highest, followed by RTX 4080 (30880), and RTX 3090 Ti (2147) as lowest.\n- Chart transitions to \"Time Spy Extreme\" mode, showing RTX 4090 score (19648) and RTX \n[240-270s] - A man in a black shirt holds a white cloth while standing behind a table with two graphics cards.  \n- The man gestures with his hands while speaking, positioned between two graphics cards: a triple-fan model on the left and a single-fan model on the right.  \n- The background features shelves with various tech items, including a glowing orange lamp and a small figurine.\n[270-300s] - A man in a black shirt holds a graphics card while standing between two other graphics cards on a white table.  \n- The background features shelves with various tech items, including a glowing orange lamp and a small figurine.  \n- A graph titled \"3DMark Time Spy Extreme 烤机功耗\" displays performance metrics for three different graphics cards over time.\n[300-330s] - A man in a black shirt with a cloud graphic gestures while seated at a desk with two graphics cards in front of him.  \n- The graphics cards are positioned side by side: one with three fans (ASUS) and another with a single fan and a distinctive \"X\" design (NVIDIA RTX 4080).  \n- The background features shelves with tech gadgets, including a glowing orange lamp and a monitor displaying a game scene.\n[330-360s] - Intel Core i9-13900K processor shown in close-up, centered on a reflective surface.  \n- Motherboard with black design and \"ASUS ROG\" branding, featuring the CPU socket and RAM slots.  \n- Two Corsair T-Force TRIDENT Z5 RGB RAM sticks displayed side-by-side, with silver and black color scheme.\n[360-390s] - Bar graph displays performance metrics for RTX 4090, RTX 4080, and RTX 3090 Ti in Apex Legends, with RTX 4090 leading in FPS.\n- Live gameplay footage on right side shows in-game stats like FPS, temperature, and VRAM usage for each GPU.\n- Presenter holds a graphics card and gestures toward three displayed GPUs on a table, with shelves of tech gear in background.\n[390-420s] - Bar graph displays performance metrics for RTX 4090, RTX 4080, and RTX 3090 Ti in \"守望先锋2\" with 1% and average FPS values.\n- Right side shows real-time GPU stats (Clock, Temp, Power, Util) for each card, fluctuating during the test.\n- Performance bars and stats update dynamically, with RTX 3090 Ti showing a +25% increase in average FPS compared to RTX 4080.\n[420-450s] - Bar graph displays performance metrics for RTX 4090, RTX 4080, and RTX 3090 Ti in \"The Elder Scrolls 2\" with % increase and average FPS values.\n- Right side shows real-time GPU stats (clock, temp, power, VRAM usage) for each card during gameplay.\n- Graph transitions to \"Call of Duty: Modern Warfare 2\" with updated performance data and stats.\n[450-480s] - Bar graph displays FPS comparison between RTX 4090, RTX 4080, and RTX 3090 Ti for \"使命召唤：现代战争2\" with 1% and average values.\n- Right side shows real-time GPU metrics (Clock, Temp, Power, Util) for a game scene, fluctuating between 128-182 FPS.\n- At 458s, a red \"+20%\" label appears next to RTX 4090's average FPS, indicating performance gain over RTX 3090 Ti.", "history_tokens": 966, "history_utf8_bytes": 3309, "recent_frame_times_s": [459.00855, 460.00955, 461.01055, 462.01155, 463.01255, 464.01355, 465.01455, 466.01555, 467.01655, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334], "recent_frames_sha256": "ec4c3019844262ad9cc495015a32df5bdfb6e1bd359b8a6fb721aa199798be55", "num_recent_frames": 30, "tq": 715828.494776035, "t1": 715830.668152942, "ta": 715830.668152942, "te": 715831.233189022, "first_response_s": 2.1733769070124254, "answer_total_s": 2.7384129870915785, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 108, "content_group": "36d39bb6af005e0c87fcd0fc17aa30c7f73d8bc491a5c4ae1a443de3beb3c69f", "question": {"question_id": "sample_108_a560_q0", "video_id": 108, "video_path": "./videos/sample_108_real.mp4", "annotation_index": 560, "question_index": 0, "question": "What is the marked performance percentage of the RTX 4090 right now?", "options": ["A. 100%.", "B. 121%.", "C. 129%.", "D. 166%."], "answer": "D", "time_stamp_s": 721, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [720, 740], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_108_a560_q0", "video_id": 108, "time_stamp_s": 721, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7b243e62ad8055f441b26562ce906cfd7a5de1b2722f405f8febc8ad7a0d6c1c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [691.0069833333333, 692.0079833333333, 693.0089833333334, 694.0099833333334, 695.0109833333333, 696.0119833333333, 697.0129833333333, 698.0139833333334, 699.0149833333334, 700.0159833333333, 701.0003, 702.0013, 703.0023, 704.0033, 705.0043, 706.0053, 707.0063, 708.0073, 709.0083, 710.0093, 711.0103, 712.0113, 713.0123, 714.0133, 715.0143, 716.0153, 717.0163, 718.0006166666667, 719.0016166666667, 720.0026166666667], "recent_frames_sha256": "a2b2ec390d77e9dd775fdd12e7afc1aed0782ca9fc153dbc24cc7b0415ad50d1", "num_recent_frames": 30, "tq": 715672.549243635, "t1": 715683.778555871, "ta": 715683.778555871, "te": 715683.816753163, "first_response_s": 11.229312235955149, "answer_total_s": 11.267509527970105, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_108_a560_q0", "video_id": 108, "time_stamp_s": 721, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fb1cf19b7fbfa6fd0223eee67976a1ce26b9eb5489ec4b8e5c883c7f2f45addd", "condition_order": ["recent", "notes"], "memory": "[480-510s] - Bar chart displays GPU performance metrics for RTX 4090, RTX 4080, and RTX 3090 Ti, with RTX 4090 leading in both 1% and average scores.\n- Right side shows real-time GPU stats for multiple cards, including temperature, power, and VRAM usage, with values fluctuating over time.\n- Green bars on the chart highlight performance improvements or changes, with RTX 3090 Ti showing a +3.7% increase in average score.\n[510-540s] - Left screen displays performance bars for RTX 4070, 4060, and 3090 Ti in \"赛博朋克2077\" with 1% and 10% settings, showing frame rates and average FPS.\n- Right screen shows detailed GPU metrics for RTX 4070, 4060, and 3090 Ti, including power draw, temperature, and memory usage, with values changing over time.\n- Performance data for \"战神4\" appears on the left screen at 5:32, with RTX \n[540-570s] - Bar graphs display performance metrics (1% and average) for RTX 4090, RTX 4080, and RTX 3090 Ti GPUs across different games.\n- Right side shows real-time GPU stats (e.g., Link, Power, Temp, VRAM) for each card, with values fluctuating during the test.\n- Performance percentages for each GPU model change dynamically, indicating varying frame rates or efficiency under load.\n[570-600s] - Bar graphs display performance metrics for RTX 4070, 4080, and 3090 Ti GPUs in \"The Witcher 3: Wild Hunt\" and \"F1 22\" games.  \n- Right side shows detailed frame rate and latency data for each GPU model across different settings.  \n- Graphs update dynamically, showing real-time performance comparisons with numerical values and color-coded bars.\n[600-630s] - Bar graph displays 1% and 100% frame rates for RTX 4090, RTX 4080, and RTX 3090 Ti GPUs in \"极限竞速：地平线5\" benchmark.\n- Right side shows real-time GPU performance metrics including clock speed, temperature, and power draw for each card.\n- Graphs and metrics update dynamically as the video progresses, indicating performance changes during benchmarking.\n[630-660s] - Bar graphs display FPS comparisons between RTX 4070, RTX 4060, and RTX 3060 Ti for \"The Witcher 3: Wild Hunt\" and \"Resident Evil 4\".\n- Performance metrics for each GPU model, including FPS, temperature, and power draw, are shown in a grid format on the right.\n- The graphs and metrics update dynamically, showing real-time performance data for each GPU under test.\n[660-690s] - Bar graphs display performance metrics for RTX 4090, RTX 4080, and RTX 3090 Ti GPUs in \"The Last of Us Part II\" and \"The Witcher 6\" games.\n- GPU performance values fluctuate across frames, with RTX 4090 consistently showing higher scores than RTX 4080 and RTX 3090 Ti.\n- Text labels indicate \"1% 峰值\" (1% peak) and \"平均帧率\" (average frame rate) for each GPU in the game benchmarks.\n[690-720s] - Bar graph displays GPU performance metrics for RTX 4090, RTX 4080, and RTX 3090 Ti, with RTX 4090 leading in both 1% and average FPS.\n- Right side shows real-time game metrics including FPS, temperature, and voltage for each GPU, with values fluctuating slightly.\n- Text overlay indicates \"综合游戏表现\" (Overall Gaming Performance) and specifies the test environment as \"FZ201808 游戏表现\" with RTX 4090 as the reference.", "history_tokens": 949, "history_utf8_bytes": 3182, "recent_frame_times_s": [691.0069833333333, 692.0079833333333, 693.0089833333334, 694.0099833333334, 695.0109833333333, 696.0119833333333, 697.0129833333333, 698.0139833333334, 699.0149833333334, 700.0159833333333, 701.0003, 702.0013, 703.0023, 704.0033, 705.0043, 706.0053, 707.0063, 708.0073, 709.0083, 710.0093, 711.0103, 712.0113, 713.0123, 714.0133, 715.0143, 716.0153, 717.0163, 718.0006166666667, 719.0016166666667, 720.0026166666667], "recent_frames_sha256": "a2b2ec390d77e9dd775fdd12e7afc1aed0782ca9fc153dbc24cc7b0415ad50d1", "num_recent_frames": 30, "tq": 715898.046436269, "t1": 715899.759756712, "ta": 715899.759756712, "te": 715899.945680315, "first_response_s": 1.7133204430574551, "answer_total_s": 1.8992440460715443, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 108, "content_group": "36d39bb6af005e0c87fcd0fc17aa30c7f73d8bc491a5c4ae1a443de3beb3c69f", "question": {"question_id": "sample_108_a560_q1", "video_id": 108, "video_path": "./videos/sample_108_real.mp4", "annotation_index": 560, "question_index": 1, "question": "What is the price of the RTX 4080 graphics card in yuan?", "options": ["A. 5499 yuan.", "B. 9499 yuan.", "C. 11999 yuan.", "D. 12999 yuan."], "answer": "B", "time_stamp_s": 735, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [720, 740], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_108_a560_q1", "video_id": 108, "time_stamp_s": 735, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ebef0fa1b5d9f0bc299d170ee9b6f1a622fee067c1f145969bde1b21055e7045", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [705.0043, 706.0053, 707.0063, 708.0073, 709.0083, 710.0093, 711.0103, 712.0113, 713.0123, 714.0133, 715.0143, 716.0153, 717.0163, 718.0006166666667, 719.0016166666667, 720.0026166666667, 721.0036166666666, 722.0046166666667, 723.0056166666667, 724.0066166666667, 725.0076166666666, 726.0086166666666, 727.0096166666667, 728.0106166666667, 729.0116166666667, 730.0126166666666, 731.0136166666666, 732.0146166666667, 733.0156166666667, 734.0166166666667], "recent_frames_sha256": "b21ed0f559863ce10f6d688003cddac89373bda7a294afa84316d0f827ab4328", "num_recent_frames": 30, "tq": 715683.829619388, "t1": 715697.784182685, "ta": 715697.784182685, "te": 715697.968296485, "first_response_s": 13.954563296982087, "answer_total_s": 14.138677097042091, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_108_a560_q1", "video_id": 108, "time_stamp_s": 735, "ground_truth": "B", "raw_output": "B. 9499 yuan.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "3a446138e626811c831617abc002a2a912efd0bd3f4a8d17eb29cb1344f871ad", "condition_order": ["recent", "notes"], "memory": "[480-510s] - Bar chart displays GPU performance metrics for RTX 4090, RTX 4080, and RTX 3090 Ti, with RTX 4090 leading in both 1% and average scores.\n- Right side shows real-time GPU stats for multiple cards, including temperature, power, and VRAM usage, with values fluctuating over time.\n- Green bars on the chart highlight performance improvements or changes, with RTX 3090 Ti showing a +3.7% increase in average score.\n[510-540s] - Left screen displays performance bars for RTX 4070, 4060, and 3090 Ti in \"赛博朋克2077\" with 1% and 10% settings, showing frame rates and average FPS.\n- Right screen shows detailed GPU metrics for RTX 4070, 4060, and 3090 Ti, including power draw, temperature, and memory usage, with values changing over time.\n- Performance data for \"战神4\" appears on the left screen at 5:32, with RTX \n[540-570s] - Bar graphs display performance metrics (1% and average) for RTX 4090, RTX 4080, and RTX 3090 Ti GPUs across different games.\n- Right side shows real-time GPU stats (e.g., Link, Power, Temp, VRAM) for each card, with values fluctuating during the test.\n- Performance percentages for each GPU model change dynamically, indicating varying frame rates or efficiency under load.\n[570-600s] - Bar graphs display performance metrics for RTX 4070, 4080, and 3090 Ti GPUs in \"The Witcher 3: Wild Hunt\" and \"F1 22\" games.  \n- Right side shows detailed frame rate and latency data for each GPU model across different settings.  \n- Graphs update dynamically, showing real-time performance comparisons with numerical values and color-coded bars.\n[600-630s] - Bar graph displays 1% and 100% frame rates for RTX 4090, RTX 4080, and RTX 3090 Ti GPUs in \"极限竞速：地平线5\" benchmark.\n- Right side shows real-time GPU performance metrics including clock speed, temperature, and power draw for each card.\n- Graphs and metrics update dynamically as the video progresses, indicating performance changes during benchmarking.\n[630-660s] - Bar graphs display FPS comparisons between RTX 4070, RTX 4060, and RTX 3060 Ti for \"The Witcher 3: Wild Hunt\" and \"Resident Evil 4\".\n- Performance metrics for each GPU model, including FPS, temperature, and power draw, are shown in a grid format on the right.\n- The graphs and metrics update dynamically, showing real-time performance data for each GPU under test.\n[660-690s] - Bar graphs display performance metrics for RTX 4090, RTX 4080, and RTX 3090 Ti GPUs in \"The Last of Us Part II\" and \"The Witcher 6\" games.\n- GPU performance values fluctuate across frames, with RTX 4090 consistently showing higher scores than RTX 4080 and RTX 3090 Ti.\n- Text labels indicate \"1% 峰值\" (1% peak) and \"平均帧率\" (average frame rate) for each GPU in the game benchmarks.\n[690-720s] - Bar graph displays GPU performance metrics for RTX 4090, RTX 4080, and RTX 3090 Ti, with RTX 4090 leading in both 1% and average FPS.\n- Right side shows real-time game metrics including FPS, temperature, and voltage for each GPU, with values fluctuating slightly.\n- Text overlay indicates \"综合游戏表现\" (Overall Gaming Performance) and specifies the test environment as \"FZ201808 游戏表现\" with RTX 4090 as the reference.", "history_tokens": 949, "history_utf8_bytes": 3182, "recent_frame_times_s": [705.0043, 706.0053, 707.0063, 708.0073, 709.0083, 710.0093, 711.0103, 712.0113, 713.0123, 714.0133, 715.0143, 716.0153, 717.0163, 718.0006166666667, 719.0016166666667, 720.0026166666667, 721.0036166666666, 722.0046166666667, 723.0056166666667, 724.0066166666667, 725.0076166666666, 726.0086166666666, 727.0096166666667, 728.0106166666667, 729.0116166666667, 730.0126166666666, 731.0136166666666, 732.0146166666667, 733.0156166666667, 734.0166166666667], "recent_frames_sha256": "b21ed0f559863ce10f6d688003cddac89373bda7a294afa84316d0f827ab4328", "num_recent_frames": 30, "tq": 715899.962621039, "t1": 715911.37810449, "ta": 715911.37810449, "te": 715911.714415171, "first_response_s": 11.41548345098272, "answer_total_s": 11.751794131938368, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 109, "content_group": "a8414aae79fb3e4918f75a9649d983f68ad695bdfc36c7caeefef219105ec9c5", "question": {"question_id": "sample_109_a248_q0", "video_id": 109, "video_path": "./videos/sample_109_real.mp4", "annotation_index": 248, "question_index": 0, "question": "What GPU does the AMD Ryzen 7 5700G have right now?", "options": ["A. Vega 6.", "B. Vega 7.", "C. Vega 8.", "D. Vega 9."], "answer": "C", "time_stamp_s": 20, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_109_a248_q0", "video_id": 109, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "107533fef80b4d48033ef6e5722abaf12c0b8629f19d1de375c54a8039f18026", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665], "recent_frames_sha256": "0abbfe5093d77c574329c2b971b4d5f29eabfb22764b0f77cf8c3980bb581e50", "num_recent_frames": 20, "tq": 717329.246367316, "t1": 717329.69934778, "ta": 717329.69934778, "te": 717329.738145124, "first_response_s": 0.45298046397510916, "answer_total_s": 0.49177780805621296, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_109_a248_q0", "video_id": 109, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "356ad29500eb1a39a3303fcc22da688db3fa80631342c4e0b7a224bd871cb51b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665], "recent_frames_sha256": "0abbfe5093d77c574329c2b971b4d5f29eabfb22764b0f77cf8c3980bb581e50", "num_recent_frames": 20, "tq": 717055.402082067, "t1": 717066.009951477, "ta": 717066.009951477, "te": 717066.048267121, "first_response_s": 10.607869410072453, "answer_total_s": 10.646185053978115, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 109, "content_group": "a8414aae79fb3e4918f75a9649d983f68ad695bdfc36c7caeefef219105ec9c5", "question": {"question_id": "sample_109_a249_q0", "video_id": 109, "video_path": "./videos/sample_109_real.mp4", "annotation_index": 249, "question_index": 0, "question": "What is the score of the i7-1165G7 (Iris Xe Graphics) processor right now?", "options": ["A. 862.", "B. 1656.", "C. 1312.", "D. 1429."], "answer": "B", "time_stamp_s": 218, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [200, 220], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_109_a249_q0", "video_id": 109, "time_stamp_s": 218, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "03bf65121a8c666ac16b214e7e04b149afc9d1d1283d97d7b59c1a30e7743fb0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666], "recent_frames_sha256": "976f38ebaaf850d3b467153fe3cb7a771530fdbcb61362a0651d9c89cf5c39c0", "num_recent_frames": 30, "tq": 717329.751601457, "t1": 717341.513751312, "ta": 717341.513751312, "te": 717341.556939178, "first_response_s": 11.762149855028838, "answer_total_s": 11.805337721016258, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_109_a249_q0", "video_id": 109, "time_stamp_s": 218, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ae3722d56892a3978cdc8829d98f5ecf16af66c5940e552c3ede994cd0055ae1", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Two AMD Ryzen CPU boxes (6000 and 5700G) are displayed side-by-side on a white surface, with a blurred background of colorful screens.  \n- A graphic overlay compares the Ryzen 6000 and 5700G, noting Zen 5 CPU and Vega 7/8 GPU differences.  \n- A presenter in a white shirt gestures toward the CPUs while seated at a desk with shelves of tech gear behind him.\n[30-60s] - On-screen graphic compares Ryzen 5700G and 5600G specs, highlighting 8-core/16-thread vs. 6-core/12-thread configurations.\n- A presenter gestures toward two Ryzen product boxes on a table, indicating a comparison or review.\n- The graphic emphasizes 16MB L3 cache for the 5700G and 12MB for the 5600G, with both featuring Radeon Vega 8 graphics.\n[60-90s] - Speaker gestures toward two AMD Ryzen CPU boxes on the table while speaking.  \n- On-screen graphic compares Ryzen 5700G and 5600G specs, highlighting CPU architecture differences.  \n- Speaker clasps hands and continues explaining, with the graphic remaining visible.\n[90-120s] - A comparison chart displays Ryzen 5700G and Ryzen 5600G specifications, highlighting CPU core/thread counts, base/max clocks, cache, and TDP.\n- A presenter holds a motherboard, with AMD Ryzen 7 and Ryzen 5 product boxes visible on the table.\n- The motherboard is identified as \"微星B550M Mortar\" with stylized text overlaying the screen.\n[120-150s] - A man holds a motherboard and gestures toward it while standing behind a table with Ryzen 7 and Ryzen 5 boxes.  \n- He then picks up and displays an AMD cooler, pointing to its features while seated at the same table.  \n- A transparent, X-shaped object is shown on a white surface, followed by a screen displaying a benchmark software interface.\n[150-180s] - Cinebench R23 interface displays CPU and GPU test results with \"Start\" buttons visible.  \n- A man in a white shirt sits at a table with two AMD Ryzen processor boxes in front of him.  \n- The screen transitions from a black display to showing a rendered 3D room scene during benchmark testing.\n[180-210s] - A Cinebench R23 benchmark screen displays CPU and GPU scores for an AMD Ryzen 5 3600, with the CPU score at 1672.8 and GPU score at 1440.0.  \n- A man in a white t-shirt sits at a desk, gesturing toward two AMD Ryzen processor boxes (Ryzen 7 and Ryzen 5) placed on the table in front of him.  \n- The background features dark shelves with various tech items, including a golden trophy and black speakers, against a blue wall.", "history_tokens": 662, "history_utf8_bytes": 2454, "recent_frame_times_s": [188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666], "recent_frames_sha256": "976f38ebaaf850d3b467153fe3cb7a771530fdbcb61362a0651d9c89cf5c39c0", "num_recent_frames": 30, "tq": 717132.524016269, "t1": 717134.685649512, "ta": 717134.685649512, "te": 717134.996370567, "first_response_s": 2.161633242969401, "answer_total_s": 2.472354297991842, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 109, "content_group": "a8414aae79fb3e4918f75a9649d983f68ad695bdfc36c7caeefef219105ec9c5", "question": {"question_id": "sample_109_a250_q0", "video_id": 109, "video_path": "./videos/sample_109_real.mp4", "annotation_index": 250, "question_index": 0, "question": "What graphical setting is mentioned on the menu screen right now?", "options": ["A. Display.", "B. Graphics.", "C. Anti-Aliasing.", "D. FidelityFX Super Resolution 1.0."], "answer": "D", "time_stamp_s": 405, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [400, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_109_a250_q0", "video_id": 109, "time_stamp_s": 405, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "692a8d38df5728e82c138a6892df0d7e20da36666f40a050fb4a7d9dead7f8ca", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.00028333333336, 385.00128333333333, 386.0022833333333, 387.00328333333334, 388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036], "recent_frames_sha256": "c24450fd42d85125fd7a81880f2566ee2df4864ca7db3e14afddf5c9cf777dfd", "num_recent_frames": 30, "tq": 717341.565179481, "t1": 717348.98387418, "ta": 717348.98387418, "te": 717349.021216312, "first_response_s": 7.418694698950276, "answer_total_s": 7.456036830903031, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_109_a250_q0", "video_id": 109, "time_stamp_s": 405, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ee57f230bc924ae3a53a4150e2c958527d6e104705bedbe9bc07efab394ab4bf", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A comparison chart displays Ryzen 5700G and Ryzen 5600G specifications, highlighting CPU core/thread counts, base/max clocks, cache, and TDP.\n- A presenter holds a motherboard, with AMD Ryzen 7 and Ryzen 5 product boxes visible on the table.\n- The motherboard is identified as \"微星B550M Mortar\" with stylized text overlaying the screen.\n[120-150s] - A man holds a motherboard and gestures toward it while standing behind a table with Ryzen 7 and Ryzen 5 boxes.  \n- He then picks up and displays an AMD cooler, pointing to its features while seated at the same table.  \n- A transparent, X-shaped object is shown on a white surface, followed by a screen displaying a benchmark software interface.\n[150-180s] - Cinebench R23 interface displays CPU and GPU test results with \"Start\" buttons visible.  \n- A man in a white shirt sits at a table with two AMD Ryzen processor boxes in front of him.  \n- The screen transitions from a black display to showing a rendered 3D room scene during benchmark testing.\n[180-210s] - A Cinebench R23 benchmark screen displays CPU and GPU scores for an AMD Ryzen 5 3600, with the CPU score at 1672.8 and GPU score at 1440.0.  \n- A man in a white t-shirt sits at a desk, gesturing toward two AMD Ryzen processor boxes (Ryzen 7 and Ryzen 5) placed on the table in front of him.  \n- The background features dark shelves with various tech items, including a golden trophy and black speakers, against a blue wall.\n[210-240s] - TimeSpy graphics performance chart displays Ryzen 7 7700, Ryzen 5 6600, and Ryzen 5 6400 scores with Ryzen 7 7700 leading at 1429.\n- A Ryzen 7 7700 CPU chip is shown, followed by an equal sign and a graphics card, suggesting CPU-GPU pairing.\n- Game titles like \"Grand Theft Auto V\" and \"Apex Legends\" appear behind the Ryzen 7 7700 chip, indicating gaming use cases.\n[240-270s] - Game view transitions from a narrow corridor to an open rooftop with urban buildings in background, showing performance metrics like CPU/GPU power and FPS.\n- A text overlay appears at 251 seconds indicating \"1080P 最低画质\" (1080P lowest quality) while the game briefly crashes, displaying error logs.\n- After crash, the game resumes on a rooftop with wooden crates, showing fluctuating FPS and temperature readings, suggesting performance instability.\n[270-300s] - Game UI displays \"1080P, 低特效\" (1080P, Low Effects) with performance stats: CPU Temp 66°C, GPU Power 39W, 98 FPS.\n- A character casts a glowing purple spell in a vibrant, cherry-blossom-filled battlefield.\n- System settings menu is open, showing \"1080P\" resolution and \"低特效\" (Low Effects) selected, with a slider for \"特效\" (Effects) at 100%.\n[300-330s] - Player's HUD shows CPU at 62°C, GPU at 38W, and frame rate fluctuating between 45-58 FPS.  \n- The game environment transitions from a grassy area near a yellow structure to a vibrant, colorful urban map with pink and green hues.  \n- A text overlay appears at 312 seconds reading \"1080P 最低特效\" (1080P Lowest Effects) over a blurred background.\n[330-360s] - Black SUV drives on urban street with palm trees and buildings, FPS fluctuates between 97-99.\n- Scene transitions to a bridge over a canyon with rocky cliffs and water below, FPS drops to 65.\n- Character in green outfit runs on a traditional Japanese-style bridge, FPS stabilizes at 60.\n[360-390s] - A green-clad character runs across a stone plaza in a vibrant, traditional-style game environment.  \n- On-screen metrics show CPU power at 65%, GPU power at 35%, and 58 FPS, indicating high performance.  \n- The scene transitions to a presenter seated at a desk with AMD Ryzen 7 and 5 processor boxes, gesturing toward them.", "history_tokens": 1012, "history_utf8_bytes": 3673, "recent_frame_times_s": [375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.00028333333336, 385.00128333333333, 386.0022833333333, 387.00328333333334, 388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036], "recent_frames_sha256": "c24450fd42d85125fd7a81880f2566ee2df4864ca7db3e14afddf5c9cf777dfd", "num_recent_frames": 30, "tq": 717218.263696501, "t1": 717225.516713165, "ta": 717225.516713165, "te": 717225.74286491, "first_response_s": 7.253016663948074, "answer_total_s": 7.479168409015983, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 109, "content_group": "a8414aae79fb3e4918f75a9649d983f68ad695bdfc36c7caeefef219105ec9c5", "question": {"question_id": "sample_109_a251_q0", "video_id": 109, "video_path": "./videos/sample_109_real.mp4", "annotation_index": 251, "question_index": 0, "question": "What value was set for the \"GFX Voltage\" just now?", "options": ["A. 1.200V.", "B. 1.500V.", "C. 1.250V.", "D. 1.400V."], "answer": "D", "time_stamp_s": 601, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [600, 620], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_109_a251_q0", "video_id": 109, "time_stamp_s": 601, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5eef0db4f578aa83c61aabd291fe28f65780af89d885690e0b0f2ae4b896d30b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [571.0037666666667, 572.0047666666667, 573.0057666666667, 574.0067666666666, 575.0077666666666, 576.0087666666667, 577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0000833333334, 585.0010833333333, 586.0020833333333, 587.0030833333333, 588.0040833333334, 589.0050833333333, 590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333], "recent_frames_sha256": "ff4f965e5785ce0d8c9c3bfffcdcea1d541b2da9ac7d0001fdd021770479a974", "num_recent_frames": 30, "tq": 717349.029709685, "t1": 717360.010048881, "ta": 717360.010048881, "te": 717360.199554292, "first_response_s": 10.980339196044952, "answer_total_s": 11.16984460700769, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_109_a251_q0", "video_id": 109, "time_stamp_s": 601, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0f35d6c87b1227e595857096b804da706620bc359016b83f9badccfae56b5e1c", "condition_order": ["notes", "recent"], "memory": "[300-330s] - Player's HUD shows CPU at 62°C, GPU at 38W, and frame rate fluctuating between 45-58 FPS.  \n- The game environment transitions from a grassy area near a yellow structure to a vibrant, colorful urban map with pink and green hues.  \n- A text overlay appears at 312 seconds reading \"1080P 最低特效\" (1080P Lowest Effects) over a blurred background.\n[330-360s] - Black SUV drives on urban street with palm trees and buildings, FPS fluctuates between 97-99.\n- Scene transitions to a bridge over a canyon with rocky cliffs and water below, FPS drops to 65.\n- Character in green outfit runs on a traditional Japanese-style bridge, FPS stabilizes at 60.\n[360-390s] - A green-clad character runs across a stone plaza in a vibrant, traditional-style game environment.  \n- On-screen metrics show CPU power at 65%, GPU power at 35%, and 58 FPS, indicating high performance.  \n- The scene transitions to a presenter seated at a desk with AMD Ryzen 7 and 5 processor boxes, gesturing toward them.\n[390-420s] - Snowy outdoor environment transitions to indoor setting with ornate furniture and a chandelier.\n- FPS fluctuates between 30-69, with GPU power rising from 23 to 56 and CPU power from 12 to 19.\n- Player moves from a snow-covered path toward a building entrance, then enters a dimly lit room.\n[420-450s] - Game scene shifts from snowy forest to neon-lit urban street with visible \"VACANCY\" sign.  \n- Car drives through city streets, passing buildings and intersections with changing FPS and power metrics.  \n- On-screen stats show CPU and GPU temperatures/power fluctuating, with FPS dropping to 20 and rising to 27.\n[450-480s] - Game performance metrics (CPU Temp, GPU Power, FPS) fluctuate between 80°C, 27-32W, and 21-248 FPS during gameplay.  \n- A black sedan with \"WORLD\" on its rear is driven through a neon-lit, rainy city street.  \n- At 4:56, the scene transitions to a presenter seated at a desk with AMD Ryzen processor boxes, indicating a hardware review segment.\n[480-510s] - A CPU temperature monitor displays a stable 48°C for the CPU core.  \n- A system performance chart shows consistent CPU and memory usage over time.  \n- A person holds a motherboard while standing behind three Ryzen processor boxes.\n[510-540s] - A man in a white shirt holds a motherboard while standing behind a table with AMD Ryzen 7 and Ryzen 5 boxes.  \n- The screen displays an MSI BIOS interface with settings like \"OC\" and \"M-FLASH\" visible.  \n- Text overlays show \"2300+ MHz\" and \"4600+ MHz\" indicating memory speeds.\n[540-570s] - A memory benchmark window displays DDR4-4600 memory timings with a 1.262V voltage and 1.600V CPU voltage.  \n- The benchmark results show 16GB of RAM with 1600MHz speed and 1.262V voltage, indicating a stable memory configuration.  \n- The user is seen holding a motherboard and Ryzen CPU boxes, suggesting a hardware setup or review context.\n[570-600s] - A man in a white shirt gestures while seated at a desk with two AMD Ryzen boxes in front of him.  \n- A 3DMark benchmark screen displays a graphics score of 1,658 and a CPU score of 11,154, with a red arrow indicating a 200-point increase.  \n- The screen transitions to an AMD Overclocking software interface showing CPU settings, including \"GFX Clock Frequency\" set to \"Auto\" and \"Precision Boost Overdrive\" set to \"[Auto].\"", "history_tokens": 912, "history_utf8_bytes": 3316, "recent_frame_times_s": [571.0037666666667, 572.0047666666667, 573.0057666666667, 574.0067666666666, 575.0077666666666, 576.0087666666667, 577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0000833333334, 585.0010833333333, 586.0020833333333, 587.0030833333333, 588.0040833333334, 589.0050833333333, 590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333], "recent_frames_sha256": "ff4f965e5785ce0d8c9c3bfffcdcea1d541b2da9ac7d0001fdd021770479a974", "num_recent_frames": 30, "tq": 717285.40690097, "t1": 717286.529109804, "ta": 717286.529109804, "te": 717286.5667604, "first_response_s": 1.1222088339272887, "answer_total_s": 1.1598594299284741, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 109, "content_group": "a8414aae79fb3e4918f75a9649d983f68ad695bdfc36c7caeefef219105ec9c5", "question": {"question_id": "sample_109_a252_q0", "video_id": 109, "video_path": "./videos/sample_109_real.mp4", "annotation_index": 252, "question_index": 0, "question": "What is the label on the boxed CPU seen right now?", "options": ["A. Intel Core i7.", "B. AMD Ryzen 5.", "C. NVIDIA GeForce GTX.", "D. Intel Core i5."], "answer": "B", "time_stamp_s": 743, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [740, 746], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_109_a252_q0", "video_id": 109, "time_stamp_s": 743, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "566df4cf8841bcd0813c1b25cf1a13ba211012b6045a9f1b141bb5fa0839201a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [713.0123, 714.0133, 715.0143, 716.0153, 717.0163, 718.0006166666667, 719.0016166666667, 720.0026166666667, 721.0036166666666, 722.0046166666667, 723.0056166666667, 724.0066166666667, 725.0076166666666, 726.0086166666666, 727.0096166666667, 728.0106166666667, 729.0116166666667, 730.0126166666666, 731.0136166666666, 732.0146166666667, 733.0156166666667, 734.0166166666667, 735.0009333333334, 736.0019333333333, 737.0029333333333, 738.0039333333333, 739.0049333333334, 740.0059333333334, 741.0069333333333, 742.0079333333333], "recent_frames_sha256": "af1c4863fec42a6204a9ba61e190b731272fed290a3874c59f48a359502129c7", "num_recent_frames": 30, "tq": 717360.209294938, "t1": 717367.931180482, "ta": 717367.931180482, "te": 717367.971063581, "first_response_s": 7.721885544015095, "answer_total_s": 7.761768642929383, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_109_a252_q0", "video_id": 109, "time_stamp_s": 743, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5ebc3f5fc714de2dcecd19baf86323531e0dc93a7c9cc16e594482b2b829084d", "condition_order": ["notes", "recent"], "memory": "[420-450s] - Game scene shifts from snowy forest to neon-lit urban street with visible \"VACANCY\" sign.  \n- Car drives through city streets, passing buildings and intersections with changing FPS and power metrics.  \n- On-screen stats show CPU and GPU temperatures/power fluctuating, with FPS dropping to 20 and rising to 27.\n[450-480s] - Game performance metrics (CPU Temp, GPU Power, FPS) fluctuate between 80°C, 27-32W, and 21-248 FPS during gameplay.  \n- A black sedan with \"WORLD\" on its rear is driven through a neon-lit, rainy city street.  \n- At 4:56, the scene transitions to a presenter seated at a desk with AMD Ryzen processor boxes, indicating a hardware review segment.\n[480-510s] - A CPU temperature monitor displays a stable 48°C for the CPU core.  \n- A system performance chart shows consistent CPU and memory usage over time.  \n- A person holds a motherboard while standing behind three Ryzen processor boxes.\n[510-540s] - A man in a white shirt holds a motherboard while standing behind a table with AMD Ryzen 7 and Ryzen 5 boxes.  \n- The screen displays an MSI BIOS interface with settings like \"OC\" and \"M-FLASH\" visible.  \n- Text overlays show \"2300+ MHz\" and \"4600+ MHz\" indicating memory speeds.\n[540-570s] - A memory benchmark window displays DDR4-4600 memory timings with a 1.262V voltage and 1.600V CPU voltage.  \n- The benchmark results show 16GB of RAM with 1600MHz speed and 1.262V voltage, indicating a stable memory configuration.  \n- The user is seen holding a motherboard and Ryzen CPU boxes, suggesting a hardware setup or review context.\n[570-600s] - A man in a white shirt gestures while seated at a desk with two AMD Ryzen boxes in front of him.  \n- A 3DMark benchmark screen displays a graphics score of 1,658 and a CPU score of 11,154, with a red arrow indicating a 200-point increase.  \n- The screen transitions to an AMD Overclocking software interface showing CPU settings, including \"GFX Clock Frequency\" set to \"Auto\" and \"Precision Boost Overdrive\" set to \"[Auto].\"\n[600-630s] - A man in a white shirt gestures while seated at a desk with two AMD Ryzen boxes in front of him.  \n- A computer screen displays a benchmark result for \"Time Spy\" with a graphics score of 1869 and CPU score of 10813.  \n- A bar chart compares \"Ryzen 7 3700G\" and \"Ryzen 7 3700\" performance, showing a 21% improvement for the 3700G.\n[630-660s] - Left screen displays \"超频前\" (Before overclocking) with red error text and CPU/GPU stats at 54°C/27°C, 54W/46W, 30 FPS.\n- Right screen shows \"超频后\" (After overclocking) with similar stats but higher GPU power (60W) and FPS (60), indicating performance boost.\n- Game scenes transition from a character running in a colorful village to a car driving through a neon-lit cityscape, with real-time performance metrics overlaid.\n[660-690s] - A Ryzen CPU chip is displayed centrally on a gradient background.  \n- A Radeon graphics card appears to the right of the CPU, separated by a plus sign.  \n- Split-screen gameplay footage shows performance metrics for two CPU configurations: 5700G + 3090 and 5800X + 3090.\n[690-720s] - A close-up shot displays an AMD Ryzen 5 3600 CPU with a price tag of ¥2,599 overlaid.  \n- The same CPU is shown next to an AMD Ryzen 7 2700X, with its price of ¥847 displayed.  \n- The presenter is seated at a desk with two Ryzen CPU boxes, gesturing toward the Ryzen 5 3600 box while speaking.", "history_tokens": 983, "history_utf8_bytes": 3394, "recent_frame_times_s": [713.0123, 714.0133, 715.0143, 716.0153, 717.0163, 718.0006166666667, 719.0016166666667, 720.0026166666667, 721.0036166666666, 722.0046166666667, 723.0056166666667, 724.0066166666667, 725.0076166666666, 726.0086166666666, 727.0096166666667, 728.0106166666667, 729.0116166666667, 730.0126166666666, 731.0136166666666, 732.0146166666667, 733.0156166666667, 734.0166166666667, 735.0009333333334, 736.0019333333333, 737.0029333333333, 738.0039333333333, 739.0049333333334, 740.0059333333334, 741.0069333333333, 742.0079333333333], "recent_frames_sha256": "af1c4863fec42a6204a9ba61e190b731272fed290a3874c59f48a359502129c7", "num_recent_frames": 30, "tq": 717323.713573857, "t1": 717329.194681794, "ta": 717329.194681794, "te": 717329.232645204, "first_response_s": 5.48110793705564, "answer_total_s": 5.519071347080171, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 110, "content_group": "b38d7c5f46b204468aa7be9c7c852f26e2644944391d35cb08bc6b349bcf180b", "question": {"question_id": "sample_110_a1654_q0", "video_id": 110, "video_path": "./videos/sample_110_real.mp4", "annotation_index": 1654, "question_index": 0, "question": "What information is displayed as white text in Chinese on the black screen right now?", "options": ["A. The video was edited using advanced software.", "B. The video was shot entirely on an iPhone.", "C. The video highlights scenic city landscapes.", "D. The video was produced by a famous filmmaker."], "answer": "B", "time_stamp_s": 3, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_110_a1654_q0", "video_id": 110, "time_stamp_s": 3, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "051620519c7466f12d9e1cd0b567a1ddc2420629f2b140671db9051446553293", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002], "recent_frames_sha256": "960b8855ba7b34aae89897fc788bc3aeb38dde825c02c85fc1c765c4f68eb7d3", "num_recent_frames": 3, "tq": 710704.627860061, "t1": 710709.585623714, "ta": 710709.585623714, "te": 710709.627529468, "first_response_s": 4.957763653015718, "answer_total_s": 4.999669407028705, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_110_a1654_q0", "video_id": 110, "time_stamp_s": 3, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "17ea29791a3bc1607e9b5995b2190d478adfab140fc84453029fd1ce24366079", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002], "recent_frames_sha256": "960b8855ba7b34aae89897fc788bc3aeb38dde825c02c85fc1c765c4f68eb7d3", "num_recent_frames": 3, "tq": 710436.917073013, "t1": 710449.07437879, "ta": 710449.07437879, "te": 710449.112230432, "first_response_s": 12.157305776956491, "answer_total_s": 12.195157418958843, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 110, "content_group": "b38d7c5f46b204468aa7be9c7c852f26e2644944391d35cb08bc6b349bcf180b", "question": {"question_id": "sample_110_a1655_q0", "video_id": 110, "video_path": "./videos/sample_110_real.mp4", "annotation_index": 1655, "question_index": 0, "question": "What language are the graph labels showing performance metrics written in right now?", "options": ["A. English.", "B. Japanese.", "C. Korean.", "D. Chinese."], "answer": "D", "time_stamp_s": 259, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [240, 260], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_110_a1655_q0", "video_id": 110, "time_stamp_s": 259, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2ed01d0a6545b71bbce2586d634c256f4a14353299413a1a981f844930a5f541", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775], "recent_frames_sha256": "93c13f478816bd79f915a97885c66a8a8f908047f6f425b33c9fe5c30cead497", "num_recent_frames": 30, "tq": 710709.6489944, "t1": 710720.57827857, "ta": 710720.57827857, "te": 710720.615633766, "first_response_s": 10.92928416992072, "answer_total_s": 10.96663936600089, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_110_a1655_q0", "video_id": 110, "time_stamp_s": 259, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1e79ae83f1bedef18f01f3c09d79d5d992dcd17a0df408f4a645593e63e65253", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A person in a plaid jacket adjusts their shirt near a stained-glass window, then walks up a staircase with a view of a building's facade.  \n- A hand holds an iPhone, capturing the Eiffel Tower from a low angle, with the phone's screen showing the camera interface.  \n- A man in a white t-shirt and glasses picks up a black smartphone from dry grass in a field, then walks away toward a building with greenery around.\n[30-60s] - Two men sit outdoors at a table, one in white t-shirt and blue shorts, the other in green shirt and black shorts, both holding smartphones and bowls of liquid.  \n- The man in green shirt holds a phone displaying a list, while the man in white shirt gestures with his phone toward him.  \n- A red thermos sits on the table between them, and the background features trees and rustic wooden structures.\n[60-90s] - Man in white shirt and blue shorts sits on a stool outdoors, gesturing while speaking, with a red thermos beside him.  \n- Two men sit at a table outdoors, one holding a phone and the other smiling, with bowls of liquid and a red thermos on the table.  \n- A man in a white shirt stands on a dirt bank near a river, gesturing with arms open, with green fields and a river in the background.\n[90-120s] - Man seated on stool, gesturing with hands while speaking, wearing white t-shirt and blue shorts.  \n- Red cylindrical object (possibly a water bottle or container) placed on small table beside him.  \n- Text overlays appear on screen: \"性能\", \"续航\", \"散热\", \"信号\", \"视频拍摄\" in Chinese characters.\n[120-150s] - Man in white t-shirt gestures while holding phone outdoors near greenery and red container.  \n- Apple event slide shows \"A13 Bionic\" chip with presenter standing before it.  \n- Performance comparison chart displays CPU benchmarks for various smartphones.\n[150-180s] - A smartphone screen displays a \"Geekbench 4\" benchmark result chart with various devices ranked by score, including iPad Pro, iPhone 12 Pro Max, and others.\n- The chart uses color-coded bars (blue, green, yellow) to represent different performance metrics for each device.\n- A hand holds the phone, showing the screen to the viewer, with a blue geometric background visible behind the device.\n[180-210s] - A bar chart displays Geekbench 5 scores for various Apple devices, with the iPad Pro 11-inch (2020) leading at 1,800+.\n- The chart shows the iPhone 12 Pro Max (2020) at 1,600+ and the iPhone 12 Pro (2020) at 1,400+.\n- A physical shot of the iPad Pro and iPhone 12 Pro Max is shown, with the iPad Pro on a dark surface and the iPhone beside it.\n[210-240s] - A bar chart displays GFXBENCH 5.0 scores for various smartphones, with the Xiaomi Mi 10 Pro leading at 104.\n- The chart includes scores for devices like the iPhone 11 Pro Max, Samsung Galaxy S20 Ultra, and OnePlus 8 Pro.\n- A man is seated outdoors on a dirt path near water, gesturing with his hands while speaking.", "history_tokens": 747, "history_utf8_bytes": 2919, "recent_frame_times_s": [229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775], "recent_frames_sha256": "93c13f478816bd79f915a97885c66a8a8f908047f6f425b33c9fe5c30cead497", "num_recent_frames": 30, "tq": 710511.163890065, "t1": 710524.184184207, "ta": 710524.184184207, "te": 710524.222235838, "first_response_s": 13.020294141955674, "answer_total_s": 13.05834577290807, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 110, "content_group": "b38d7c5f46b204468aa7be9c7c852f26e2644944391d35cb08bc6b349bcf180b", "question": {"question_id": "sample_110_a1656_q0", "video_id": 110, "video_path": "./videos/sample_110_real.mp4", "annotation_index": 1656, "question_index": 0, "question": "What labels are shown on the display screen right now?", "options": ["A. \"HDR,\" \"Portrait,\" \"Landscape,\" and \"Night\".", "B. \"Pro,\" \"Normal,\" \"Custom,\" and \"Basic\".", "C. \"Ultra wide,\" \"Wide,\" \"Depth,\" and \"Zoom\".", "D. \"Ultra wide,\" \"Wide,\" \"Tele,\" and \"Selfie\"."], "answer": "D", "time_stamp_s": 495, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [480, 500], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_110_a1656_q0", "video_id": 110, "time_stamp_s": 495, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3dd47afbb5564b2acbd97d855cfcf174ef9723b8a01a4c144a269ea380a5ffe9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [465.01455, 466.01555, 467.01655, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333], "recent_frames_sha256": "10e593cea9af4d99bfa9a3060a82b2773ba5aab62975d930c07abf335f96f09c", "num_recent_frames": 30, "tq": 710720.630552868, "t1": 710732.229926621, "ta": 710732.229926621, "te": 710732.270713467, "first_response_s": 11.59937375294976, "answer_total_s": 11.640160599024966, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_110_a1656_q0", "video_id": 110, "time_stamp_s": 495, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4122cfe529ed79c9c6e521924cc8d051d32ec27166070ed8b057f229e29b4b70", "condition_order": ["notes", "recent"], "memory": "[150-180s] - A smartphone screen displays a \"Geekbench 4\" benchmark result chart with various devices ranked by score, including iPad Pro, iPhone 12 Pro Max, and others.\n- The chart uses color-coded bars (blue, green, yellow) to represent different performance metrics for each device.\n- A hand holds the phone, showing the screen to the viewer, with a blue geometric background visible behind the device.\n[180-210s] - A bar chart displays Geekbench 5 scores for various Apple devices, with the iPad Pro 11-inch (2020) leading at 1,800+.\n- The chart shows the iPhone 12 Pro Max (2020) at 1,600+ and the iPhone 12 Pro (2020) at 1,400+.\n- A physical shot of the iPad Pro and iPhone 12 Pro Max is shown, with the iPad Pro on a dark surface and the iPhone beside it.\n[210-240s] - A bar chart displays GFXBENCH 5.0 scores for various smartphones, with the Xiaomi Mi 10 Pro leading at 104.\n- The chart includes scores for devices like the iPhone 11 Pro Max, Samsung Galaxy S20 Ultra, and OnePlus 8 Pro.\n- A man is seated outdoors on a dirt path near water, gesturing with his hands while speaking.\n[240-270s] - Man in white shirt sits on bench beside water, gesturing with hands.  \n- Phone screen shows vibrant game action with colorful UI elements.  \n- Bar chart displays performance metrics for various devices, including \"华为P40 Pro\" and \"iPhone 13 Pro Max\".\n[270-300s] - Bar chart displays performance metrics for various devices running \"Genshin Impact\" with blue bars for \"high\" and green for \"low\" performance levels.\n- A hand holds a smartphone, showing gameplay with a character navigating a forested area, interacting with UI elements like health and ability icons.\n- The chart transitions to \"The Legend of Zelda: Breath of the Wild\" performance test, listing devices and their respective performance scores.\n[300-330s] - Bar chart displays performance scores for various smartphones, with the iPhone 12 Pro Max leading at 300.5 seconds.\n- Graphs show fluctuating performance metrics for different devices over time, including iPhone 12 Pro Max, iPhone 11 Pro Max, and others.\n- Performance scores for devices like iPhone 12 Pro Max and iPhone 11 Pro Max are consistently higher than those for older models like iPhone 6s and iPhone 7.\n[330-360s] - Graph displays performance metrics for multiple iPhone models over 5 minutes, with a highlighted section showing a performance dip for one model.\n- A red box labels \"iPhone 11 Pro Max\" as the model experiencing the performance drop.\n- Two smartphones (iPhone 11 Pro Max and a black gaming phone) are shown side by side on a textured black surface.\n[360-390s] - Laptop displays graphic design software with a blank canvas, positioned left of a hand holding an iPhone.  \n- iPhone screen shows colorful app icons on an orange background, held by a hand against a blue geometric backdrop.  \n- Hand transitions to holding the iPhone while scrolling through a YouTube-like video feed, then switches to showing the phone’s back with two iPhone models (silver and gold) side-by-side.\n[390-420s] - White iPhone X is held horizontally by hands, displaying a vibrant mobile game with dynamic combat visuals.  \n- Gold iPhone is positioned beside the white one, showing its rear camera module and metallic finish.  \n- Game screen transitions between intense action scenes, including explosions and character movements, while hands interact with the touchscreen.\n[420-450s] - A white iPhone X is shown on a black hexagonal surface, with its camera and Apple logo visible.  \n- A hand holds a smartphone displaying a photo gallery, then transitions to a performance chart comparing various iPhone models.  \n- The chart highlights \"Snapseed\" benchmark results, with bars indicating performance levels for different devices.\n[450-480s] - A hand holds a smartphone displaying a photo editing interface with a red circle highlighting a specific area.  \n- The screen transitions to a bar graph comparing camera performance across multiple iPhone models, with the iPhone 12 Pro Max shown as the top performer.  \n- A close-up shot of an A13 chip is shown, with text indicating its model number and manufacturing details.", "history_tokens": 995, "history_utf8_bytes": 4156, "recent_frame_times_s": [465.01455, 466.01555, 467.01655, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333], "recent_frames_sha256": "10e593cea9af4d99bfa9a3060a82b2773ba5aab62975d930c07abf335f96f09c", "num_recent_frames": 30, "tq": 710579.60156614, "t1": 710587.548266091, "ta": 710587.548266091, "te": 710587.695626216, "first_response_s": 7.94669995107688, "answer_total_s": 8.094060076051392, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 110, "content_group": "b38d7c5f46b204468aa7be9c7c852f26e2644944391d35cb08bc6b349bcf180b", "question": {"question_id": "sample_110_a1657_q0", "video_id": 110, "video_path": "./videos/sample_110_real.mp4", "annotation_index": 1657, "question_index": 0, "question": "What app is being used on the smartphone right now?", "options": ["A. FITNESS TRACKER.", "B. SPEEDTEST.", "C. WEATHER FORECAST.", "D. MAPS NAVIGATION."], "answer": "B", "time_stamp_s": 729, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [720, 740], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_110_a1657_q0", "video_id": 110, "time_stamp_s": 729, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e05c9cc8ee589b9bb286222bbad68d897aba116d19bd717c21bc5f53f74c1485", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [699.0149833333334, 700.0159833333333, 701.0003, 702.0013, 703.0023, 704.0033, 705.0043, 706.0053, 707.0063, 708.0073, 709.0083, 710.0093, 711.0103, 712.0113, 713.0123, 714.0133, 715.0143, 716.0153, 717.0163, 718.0006166666667, 719.0016166666667, 720.0026166666667, 721.0036166666666, 722.0046166666667, 723.0056166666667, 724.0066166666667, 725.0076166666666, 726.0086166666666, 727.0096166666667, 728.0106166666667], "recent_frames_sha256": "9efe3ab764defd6450b36db3551d2484888886278b9c2164cce4a630a0dd93bb", "num_recent_frames": 30, "tq": 710732.277047064, "t1": 710743.480899168, "ta": 710743.480899168, "te": 710743.518201238, "first_response_s": 11.203852103906684, "answer_total_s": 11.241154173971154, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_110_a1657_q0", "video_id": 110, "time_stamp_s": 729, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e8af4e485425ff3fe8216ff59710d118ff34a438695e3c63f6dc8510ea001753", "condition_order": ["notes", "recent"], "memory": "[420-450s] - A white iPhone X is shown on a black hexagonal surface, with its camera and Apple logo visible.  \n- A hand holds a smartphone displaying a photo gallery, then transitions to a performance chart comparing various iPhone models.  \n- The chart highlights \"Snapseed\" benchmark results, with bars indicating performance levels for different devices.\n[450-480s] - A hand holds a smartphone displaying a photo editing interface with a red circle highlighting a specific area.  \n- The screen transitions to a bar graph comparing camera performance across multiple iPhone models, with the iPhone 12 Pro Max shown as the top performer.  \n- A close-up shot of an A13 chip is shown, with text indicating its model number and manufacturing details.\n[480-510s] - A person holds a smartphone displaying a live video feed of a man in a suit playing a saxophone in a dimly lit hall with large windows.  \n- The smartphone screen shows a split view with four video feeds, including the saxophonist and two other men in suits, with text labels like \"ultra wide\" and \"wide\" visible.  \n- The smartphone is mounted on a tripod, and the video feed is being recorded, as indicated by a red recording button and a timer counting up from 00:00:02.\n[510-540s] - A man in a white shirt and shorts sits on a bench outdoors, gesturing while speaking, with a red fire extinguisher beside him.  \n- A smartphone screen displays a video of a man in a suit playing saxophone, with a large window backdrop.  \n- A thermal imaging device shows heat patterns on three smartphones, indicating temperature differences.\n[540-570s] - Thermal maps display phone temperatures during light load test, with iPhone 11 Pro Max showing highest heat (49°C) and iPhone X showing lowest (39°C).  \n- Six phones (iPhone 11, iPhone 11 Pro Max, iPhone X, iPhone Xs Max, ROG Phone 2) are arranged in a 2x3 grid, each labeled with its model name.  \n- A title screen in Chinese reads \"轻度负载测试\" (Light Load Test) with a note indicating \"使用Driivs测试评分\" (Using Driivs test score).\n[570-600s] - Thermal maps display heat distribution across six iPhone models during moderate load testing, with color gradients indicating temperature zones.\n- The iPhone 11 Pro Max shows the highest heat concentration near the top center, while the iPhone X exhibits a more uniform heat pattern.\n- A static shot of three iPhones (iPhone 11, iPhone 11 Pro Max, iPhone X) is shown with small figurines beside them, set against a blue geometric background.\n[600-630s] - Thermal maps display phone temperatures during heavy load test, with iPhone 11 Pro Max showing highest heat at 45.0°C.  \n- Text overlay indicates \"重度负载测试\" (Heavy Load Test) and \"45分钟(光明山脉)\" (45 minutes, Guangming Mountain).  \n- Six phone models are compared: iPhone 11, iPhone 11 Pro Max, iPhone X, iPhone Xs, and two unspecified models.\n[630-660s] - Man sits on stool outdoors, holding ice cream, with table beside him holding a red thermos and small bowls.  \n- Scene transitions to close-up of hands playing a mobile game on a smartphone, showing character movement and UI controls.  \n- Three smartphones displayed side-by-side on a dark surface, each showing a racing game with different screen sizes and orientations.\n[660-690s] - Bar chart displays \"续航测试\" (Battery Test) results for various iPhone models, with horizontal bars indicating battery life duration.\n- \"iPhone 12 Pro Max\" has the longest bar, suggesting the highest battery life among listed models.\n- \"iPhone 12 Pro\" and \"iPhone 12\" show progressively shorter bars, indicating reduced battery life compared to the Pro Max.\n[690-720s] - A bar chart displays smartphone performance rankings with \"iPhone 12 Pro Max\" at the top and \"iPhone 12 Pro\" near the bottom.  \n- A man sits on a wooden stool outdoors, holding a white cup, with a red thermos beside him.  \n- The background features a calm river, green vegetation, and distant buildings under a clear sky.", "history_tokens": 962, "history_utf8_bytes": 3979, "recent_frame_times_s": [699.0149833333334, 700.0159833333333, 701.0003, 702.0013, 703.0023, 704.0033, 705.0043, 706.0053, 707.0063, 708.0073, 709.0083, 710.0093, 711.0103, 712.0113, 713.0123, 714.0133, 715.0143, 716.0153, 717.0163, 718.0006166666667, 719.0016166666667, 720.0026166666667, 721.0036166666666, 722.0046166666667, 723.0056166666667, 724.0066166666667, 725.0076166666666, 726.0086166666666, 727.0096166666667, 728.0106166666667], "recent_frames_sha256": "9efe3ab764defd6450b36db3551d2484888886278b9c2164cce4a630a0dd93bb", "num_recent_frames": 30, "tq": 710652.779560606, "t1": 710654.098938518, "ta": 710654.098938518, "te": 710654.137355789, "first_response_s": 1.3193779119756073, "answer_total_s": 1.3577951829647645, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 110, "content_group": "b38d7c5f46b204468aa7be9c7c852f26e2644944391d35cb08bc6b349bcf180b", "question": {"question_id": "sample_110_a1658_q0", "video_id": 110, "video_path": "./videos/sample_110_real.mp4", "annotation_index": 1658, "question_index": 0, "question": "What does the overlay text on the screen right now humorously suggest?", "options": ["A. Someone is praising the person.", "B. Someone is gossiping about the person.", "C. Someone is giving directions to the person.", "D. Someone is warning the person."], "answer": "B", "time_stamp_s": 922, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [920, 930], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_110_a1658_q0", "video_id": 110, "time_stamp_s": 922, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1164867893c73b0069cbac3b971bc2ce7d5ef5f440d37c232355bc8c34eeb110", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [892.0077833333334, 893.0087833333333, 894.0097833333333, 895.0107833333333, 896.0117833333334, 897.0127833333333, 898.0137833333333, 899.0147833333333, 900.0157833333334, 901.0001, 902.0011, 903.0021, 904.0031, 905.0041, 906.0051, 907.0061, 908.0071, 909.0081, 910.0091, 911.0101, 912.0111, 913.0121, 914.0131, 915.0141, 916.0151, 917.0161, 918.0004166666666, 919.0014166666666, 920.0024166666667, 921.0034166666667], "recent_frames_sha256": "7df233ae2d14215b8b4fda1381f7ebed3a453afd05440be4232b4c0e7d8d5df4", "num_recent_frames": 30, "tq": 710743.524900568, "t1": 710756.038871027, "ta": 710756.038871027, "te": 710756.078085563, "first_response_s": 12.513970458996482, "answer_total_s": 12.553184995078482, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_110_a1658_q0", "video_id": 110, "time_stamp_s": 922, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3d8e5257c7137118558c6a2d96fa7e347d296ed0856b6cf569b19d59e29a26cf", "condition_order": ["notes", "recent"], "memory": "[570-600s] - Thermal maps display heat distribution across six iPhone models during moderate load testing, with color gradients indicating temperature zones.\n- The iPhone 11 Pro Max shows the highest heat concentration near the top center, while the iPhone X exhibits a more uniform heat pattern.\n- A static shot of three iPhones (iPhone 11, iPhone 11 Pro Max, iPhone X) is shown with small figurines beside them, set against a blue geometric background.\n[600-630s] - Thermal maps display phone temperatures during heavy load test, with iPhone 11 Pro Max showing highest heat at 45.0°C.  \n- Text overlay indicates \"重度负载测试\" (Heavy Load Test) and \"45分钟(光明山脉)\" (45 minutes, Guangming Mountain).  \n- Six phone models are compared: iPhone 11, iPhone 11 Pro Max, iPhone X, iPhone Xs, and two unspecified models.\n[630-660s] - Man sits on stool outdoors, holding ice cream, with table beside him holding a red thermos and small bowls.  \n- Scene transitions to close-up of hands playing a mobile game on a smartphone, showing character movement and UI controls.  \n- Three smartphones displayed side-by-side on a dark surface, each showing a racing game with different screen sizes and orientations.\n[660-690s] - Bar chart displays \"续航测试\" (Battery Test) results for various iPhone models, with horizontal bars indicating battery life duration.\n- \"iPhone 12 Pro Max\" has the longest bar, suggesting the highest battery life among listed models.\n- \"iPhone 12 Pro\" and \"iPhone 12\" show progressively shorter bars, indicating reduced battery life compared to the Pro Max.\n[690-720s] - A bar chart displays smartphone performance rankings with \"iPhone 12 Pro Max\" at the top and \"iPhone 12 Pro\" near the bottom.  \n- A man sits on a wooden stool outdoors, holding a white cup, with a red thermos beside him.  \n- The background features a calm river, green vegetation, and distant buildings under a clear sky.\n[720-750s] - A person in blue attire is seen working on a stone bridge surrounded by greenery.  \n- A hand holds a smartphone displaying a speed test app, showing network performance metrics.  \n- The phone screen transitions to settings, indicating network configuration options.\n[750-780s] - A hand holds a smartphone displaying a list of apps with \"iPhone 12 Pro Max\" visible in the top-left corner.  \n- The screen transitions to a bar chart comparing \"iPhone 12 Pro Max\" and \"iPhone 12 Pro\" performance metrics, with \"iPhone 12 Pro Max\" showing higher scores.  \n- The phone then displays a \"Lazada.com\" webpage, with the user's finger interacting with the screen to navigate or tap elements.\n[780-810s] - Man in white t-shirt holds black smartphone, gesturing with free hand while speaking.  \n- Background features green fields, trees, and a distant building under overcast sky.  \n- Man occasionally points the phone toward camera, suggesting he is demonstrating or referencing its features.\n[810-840s] - A man in a white t-shirt and glasses stands in a green field, holding a black smartphone and gesturing with his free hand.  \n- The background features rows of lush green crops, trees, and a distant body of water under a soft, hazy sky.  \n- At 824 seconds, Chinese text overlays appear on screen, including icons for \"like,\" \"coins,\" \"favorite,\" and \"share,\" suggesting a social media or video platform context.\n[840-870s] - A man in a light green shirt stands by a riverbank, holding a fishing rod and casting a line into the water.  \n- Another man in a white shirt and blue shorts approaches from the right, bending down to interact with the first man near the river.  \n- The river reflects the surrounding houses and trees, with gentle ripples visible as the first man casts his line.\n[870-900s] - A man in a white shirt and blue shorts stands on a dirt bank beside a calm pond, gesturing toward the water.  \n- A red, ornate pitcher sits on a wooden table near the pond, with a white bowl beside it, as a hand points to the pitcher’s base.  \n- The scene transitions to a long, arched greenhouse with transparent plastic covering, showing sparse vegetation and a dirt path inside.", "history_tokens": 986, "history_utf8_bytes": 4116, "recent_frame_times_s": [892.0077833333334, 893.0087833333333, 894.0097833333333, 895.0107833333333, 896.0117833333334, 897.0127833333333, 898.0137833333333, 899.0147833333333, 900.0157833333334, 901.0001, 902.0011, 903.0021, 904.0031, 905.0041, 906.0051, 907.0061, 908.0071, 909.0081, 910.0091, 911.0101, 912.0111, 913.0121, 914.0131, 915.0141, 916.0151, 917.0161, 918.0004166666666, 919.0014166666666, 920.0024166666667, 921.0034166666667], "recent_frames_sha256": "7df233ae2d14215b8b4fda1381f7ebed3a453afd05440be4232b4c0e7d8d5df4", "num_recent_frames": 30, "tq": 710697.815628899, "t1": 710704.543464276, "ta": 710704.543464276, "te": 710704.583454713, "first_response_s": 6.727835376979783, "answer_total_s": 6.767825813964009, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 111, "content_group": "ccb0637b948d2344702ce2b62679c76742cf37347bd9823a97d6bb06a35d3395", "question": {"question_id": "sample_111_a1691_q0", "video_id": 111, "video_path": "./videos/sample_111_real.mp4", "annotation_index": 1691, "question_index": 0, "question": "What is the main subject of the comparison shown right now?", "options": ["A. The gadgets on the shelves.", "B. The MediaTek 天玑 9000 chip and another chip labeled Snapdragon 8 Gen 1.", "C. The person's hand gestures and facial expressions.", "D. The blue wall with shelves in the background."], "answer": "B", "time_stamp_s": 10, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_111_a1691_q0", "video_id": 111, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "350cf51ae685396583d23cf8c580f5aaea8affe258532e3d9df03812e7709907", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "3468d0540010d209ebcd35a8a79b6cdb9e48333ca9afd3b6339392912d9341d7", "num_recent_frames": 10, "tq": 718817.350379865, "t1": 718828.100636635, "ta": 718828.100636635, "te": 718828.138355632, "first_response_s": 10.750256769941188, "answer_total_s": 10.787975766928867, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_111_a1691_q0", "video_id": 111, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "017f56d373c7309ef63dfed6a82b56fcdf9be6810c7d0db56778f39f4572d05a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "3468d0540010d209ebcd35a8a79b6cdb9e48333ca9afd3b6339392912d9341d7", "num_recent_frames": 10, "tq": 718867.458301052, "t1": 718873.935366946, "ta": 718873.935366946, "te": 718874.333357172, "first_response_s": 6.477065894054249, "answer_total_s": 6.875056119984947, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 111, "content_group": "ccb0637b948d2344702ce2b62679c76742cf37347bd9823a97d6bb06a35d3395", "question": {"question_id": "sample_111_a1692_q0", "video_id": 111, "video_path": "./videos/sample_111_real.mp4", "annotation_index": 1692, "question_index": 0, "question": "What is the label of the highlighted central block in the GPU section right now?", "options": ["A. A510 1.8GHz.", "B. G710MC10.", "C. X2 3.05GHz.", "D. A710 2.85GHz."], "answer": "B", "time_stamp_s": 240, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [220, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_111_a1692_q0", "video_id": 111, "time_stamp_s": 240, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "390134a12d223e615be7e47b5817f9a477d8b5f8fecbfd29cdcb24bb344ebc4f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666, 218.00111666666666, 219.00211666666667, 220.00311666666667, 221.00411666666668, 222.00511666666668, 223.00611666666666, 224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334], "recent_frames_sha256": "4f6479a413d1a26ff324e56a3056fbbf1788d41aefc01b17171600e01da387f8", "num_recent_frames": 30, "tq": 718828.149692343, "t1": 718836.78095463, "ta": 718836.78095463, "te": 718836.822512742, "first_response_s": 8.63126228703186, "answer_total_s": 8.67282039904967, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_111_a1692_q0", "video_id": 111, "time_stamp_s": 240, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c5a5f08270276947840677f259bbf7e780809edb6894a28cfb9aed528ed787ea", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a green jacket gestures while speaking at a desk against a blue backdrop with shelves holding tech items.  \n- A graphic displays the MediaTek Dimensity 9000 chip, followed by a \"vs\" comparison with the Snapdragon 8 Gen 1 chip.  \n- The man continues speaking and gesturing, occasionally pointing to his head or clasping hands, while the chip graphics remain on screen.\n[30-60s] - A black tablet with a pink gradient screen displays app icons and a search bar, positioned upright on a white surface.  \n- The tablet's back panel is shown, revealing a green casing with a camera module and speaker grilles, labeled \"Nexus 7\".  \n- Internal components, including a battery and circuitry, are visible in a disassembled state, with the battery labeled \"Li-ion 3000 mAh\".\n[60-90s] - A smartphone screen displays a search bar with icons below, set against a pink gradient background.  \n- The phone's side profile reveals a USB-C port, a 3.5mm headphone jack, and a microphone hole.  \n- A presenter sits at a desk, gesturing while speaking, with shelves of tech gadgets visible behind him.\n[90-120s] - A diagram displays the MediaTek Dimensity 9000 chip architecture with labeled components like CPU, GPU, and NPU.  \n- A side-by-side comparison chart shows the Snapdragon 8 Gen 1 and MediaTek Dimensity 9000, highlighting their respective core configurations.  \n- The MediaTek chip's core count and architecture details are visually emphasized with color-coded blocks indicating different processing units.\n[120-150s] - A man in a green jacket gestures while speaking, seated at a white table against a blue backdrop.  \n- A smartphone screen displays a vibrant game interface with colorful graphics and UI elements.  \n- On-screen graphics show Qualcomm Snapdragon 8 Gen 1 and MediaTek Dimensity 9000 chip architectures with color-coded performance tiers.\n[150-180s] - A static diagram displays Snapdragon 8 Gen 1 and MediaTek Dimensity 900 chipsets with their respective CPU core configurations.  \n- The diagram highlights the Cortex-X2 architecture, emphasizing its performance and power efficiency gains.  \n- A presenter appears in a studio setting, gesturing toward the screen, indicating a transition to a detailed explanation.\n[180-210s] - A static graphic displays Snapdragon 8 Gen 1 and MediaTek Dimensity 9000 chip architectures with their respective core configurations and manufacturing nodes.  \n- The graphic includes labels in both English and Chinese, indicating \"三星 4nm\" (Samsung 4nm) and \"台积电 4nm\" (TSMC 4nm).  \n- A presenter appears briefly at 190 seconds, gesturing while seated at a desk, but the graphic remains unchanged throughout the segment.\n[210-240s] - A man in a green jacket sits at a desk, gesturing while speaking.  \n- A graphic overlay displays the MediaTek Dimensity 9000 chip architecture, including CPU and GPU components.  \n- The GPU section highlights \"G710MC10\" with text indicating each Shader Core contains two execution units.", "history_tokens": 706, "history_utf8_bytes": 2983, "recent_frame_times_s": [210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666, 218.00111666666666, 219.00211666666667, 220.00311666666667, 221.00411666666668, 222.00511666666668, 223.00611666666666, 224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334], "recent_frames_sha256": "4f6479a413d1a26ff324e56a3056fbbf1788d41aefc01b17171600e01da387f8", "num_recent_frames": 30, "tq": 718967.999485598, "t1": 718976.467692818, "ta": 718976.467692818, "te": 718976.618515463, "first_response_s": 8.46820722008124, "answer_total_s": 8.619029865018092, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 111, "content_group": "ccb0637b948d2344702ce2b62679c76742cf37347bd9823a97d6bb06a35d3395", "question": {"question_id": "sample_111_a1693_q0", "video_id": 111, "video_path": "./videos/sample_111_real.mp4", "annotation_index": 1693, "question_index": 0, "question": "What are the performance values shown for the device labeled 天玑9000 right now?", "options": ["A. 42 and 115.", "B. 43 and 100.", "C. 100 and 42.", "D. 42 and 100."], "answer": "D", "time_stamp_s": 450, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [440, 460], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_111_a1693_q0", "video_id": 111, "time_stamp_s": 450, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c624caa29a7c4923f6bc44dd434a414297ec0f3018ea56cdca4d50d0774d8249", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [420.0029166666667, 421.00391666666667, 422.00491666666665, 423.0059166666667, 424.00691666666665, 425.0079166666667, 426.00891666666666, 427.00991666666664, 428.0109166666667, 429.01191666666665, 430.0129166666667, 431.01391666666666, 432.0149166666667, 433.01591666666667, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333, 439.0052333333333, 440.00623333333334, 441.0072333333333, 442.00823333333335, 443.0092333333333, 444.01023333333336, 445.01123333333334, 446.0122333333333, 447.01323333333335, 448.0142333333333, 449.01523333333336], "recent_frames_sha256": "b1e4e6ab8f7b37c45cc074134ba971f10b8628eb0e71842df9e289a58e397076", "num_recent_frames": 30, "tq": 718836.837343092, "t1": 718849.541327212, "ta": 718849.541327212, "te": 718849.579759804, "first_response_s": 12.703984120045789, "answer_total_s": 12.74241671198979, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_111_a1693_q0", "video_id": 111, "time_stamp_s": 450, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cb7daa881e083018832a3be9e7181e73f5b883e9be5ce909fae49199b2773f06", "condition_order": ["recent", "notes"], "memory": "[150-180s] - A static diagram displays Snapdragon 8 Gen 1 and MediaTek Dimensity 900 chipsets with their respective CPU core configurations.  \n- The diagram highlights the Cortex-X2 architecture, emphasizing its performance and power efficiency gains.  \n- A presenter appears in a studio setting, gesturing toward the screen, indicating a transition to a detailed explanation.\n[180-210s] - A static graphic displays Snapdragon 8 Gen 1 and MediaTek Dimensity 9000 chip architectures with their respective core configurations and manufacturing nodes.  \n- The graphic includes labels in both English and Chinese, indicating \"三星 4nm\" (Samsung 4nm) and \"台积电 4nm\" (TSMC 4nm).  \n- A presenter appears briefly at 190 seconds, gesturing while seated at a desk, but the graphic remains unchanged throughout the segment.\n[210-240s] - A man in a green jacket sits at a desk, gesturing while speaking.  \n- A graphic overlay displays the MediaTek Dimensity 9000 chip architecture, including CPU and GPU components.  \n- The GPU section highlights \"G710MC10\" with text indicating each Shader Core contains two execution units.\n[240-270s] - GPU diagram shows 8 Shader Cores (purple blocks) with \"8 Shader Cores\" label beneath.\n- CPU diagram displays \"MediaTek 麒麟9000\" chip with X2 cores and A710 cores, alongside GPU details.\n- Diagram highlights \"Mali-G710\" with 8 Shader Cores, each containing 2 execution units, and performance density improvement.\n[270-300s] - A man in a green jacket sits at a desk, gesturing while speaking.  \n- A slide appears showing \"Mali-G710\" with bullet points about its features and a diagram of its architecture.  \n- A second slide highlights \"LPDDR5X 7500Mbps\" with specifications for memory and connectivity.\n[300-330s] - A man in a green jacket sits at a desk, gesturing with his hands while speaking.  \n- Behind him, shelves display various electronic devices and decor against a blue backdrop.  \n- The video transitions to a screen displaying MediaTek's product specifications, including \"LPDDR5X 7500Mbps\" and \"Imagiq 790 ISP.\"\n[330-360s] - A man in a green jacket sits at a desk, hands clasped, against a blue backdrop with shelves holding tech items.  \n- A bar chart titled \"Geekbench 5 CPU測試\" appears, showing CPU performance scores with red annotations highlighting specific values.  \n- The chart displays multiple CPU benchmarks, including \"A-11\" and \"Intel Core i7-8700K,\" with numerical scores and percentage comparisons.\n[360-390s] - A man in a green jacket sits at a desk, gesturing while speaking.  \n- Behind him, shelves display various tech gadgets and decor.  \n- A GEEKBENCH 5 CPU test chart is visible on screen, showing performance metrics for different processors.\n[390-420s] - Static bar chart displays Geekbench 5 CPU test results with three columns: \"单核 (单核) (单核)\" (Single-core), \"多核 (多核) (多核)\" (Multi-core), and \"性能比 (性能比)\" (Performance Ratio), each showing numerical scores and percentage comparisons.\n- Bars are color-coded: teal for \"单核\" (Single-core), orange for \"多核\" (Multi-core), and red for \"性能比\" (Performance Ratio), with specific values like 100% baseline and 11.1 for \"多核\" (Multi-core)\n[420-450s] - A bar chart displays Geekbench 5 CPU test results with three columns: \"单核 (单核)\" (Single-core), \"多核 (多核)\" (Multi-core), and \"平均功耗 (W)\" (Average Power Consumption), showing comparative scores for various processors.\n- The chart includes specific scores for A11, A12, A13, and A14 processors, with A14 achieving the highest multi-core score of 100%.\n- The chart is presented on a dark background with white and colored bars, and the text is in Chinese, indicating a focus on performance metrics", "history_tokens": 971, "history_utf8_bytes": 3736, "recent_frame_times_s": [420.0029166666667, 421.00391666666667, 422.00491666666665, 423.0059166666667, 424.00691666666665, 425.0079166666667, 426.00891666666666, 427.00991666666664, 428.0109166666667, 429.01191666666665, 430.0129166666667, 431.01391666666666, 432.0149166666667, 433.01591666666667, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333, 439.0052333333333, 440.00623333333334, 441.0072333333333, 442.00823333333335, 443.0092333333333, 444.01023333333336, 445.01123333333334, 446.0122333333333, 447.01323333333335, 448.0142333333333, 449.01523333333336], "recent_frames_sha256": "b1e4e6ab8f7b37c45cc074134ba971f10b8628eb0e71842df9e289a58e397076", "num_recent_frames": 30, "tq": 719025.533034674, "t1": 719033.323021859, "ta": 719033.323021859, "te": 719033.671160443, "first_response_s": 7.789987185038626, "answer_total_s": 8.13812576897908, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 111, "content_group": "ccb0637b948d2344702ce2b62679c76742cf37347bd9823a97d6bb06a35d3395", "question": {"question_id": "sample_111_a1694_q0", "video_id": 111, "video_path": "./videos/sample_111_real.mp4", "annotation_index": 1694, "question_index": 0, "question": "What is the average frame rate and power consumption for the 骁龙8 Gen1 device right now?", "options": ["A. 59 fps/3.9W.", "B. 59 fps/4.8W.", "C. 58 fps/6.3W.", "D. 48 fps/5.1W."], "answer": "C", "time_stamp_s": 680, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [660, 680], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_111_a1694_q0", "video_id": 111, "time_stamp_s": 680, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "82282775d73af19b6c3b2a46f40511464337b8a91b865c0b7524d579b1033ce4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [650.0160333333333, 651.00035, 652.00135, 653.00235, 654.00335, 655.00435, 656.00535, 657.00635, 658.00735, 659.00835, 660.00935, 661.01035, 662.01135, 663.01235, 664.01335, 665.01435, 666.01535, 667.01635, 668.0006666666667, 669.0016666666667, 670.0026666666666, 671.0036666666666, 672.0046666666667, 673.0056666666667, 674.0066666666667, 675.0076666666666, 676.0086666666666, 677.0096666666667, 678.0106666666667, 679.0116666666667], "recent_frames_sha256": "9e5144a8e6c9576f3dc9ea05db263789e3ec10538f3569a5704813cf84408faa", "num_recent_frames": 30, "tq": 718849.591760317, "t1": 718859.766596775, "ta": 718859.766596775, "te": 718859.918810825, "first_response_s": 10.174836458056234, "answer_total_s": 10.327050507999957, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_111_a1694_q0", "video_id": 111, "time_stamp_s": 680, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7bb35c4540939ca1ac39b94e83fb44852cbd388153f899f0dcb48bc653d44c72", "condition_order": ["recent", "notes"], "memory": "[360-390s] - A man in a green jacket sits at a desk, gesturing while speaking.  \n- Behind him, shelves display various tech gadgets and decor.  \n- A GEEKBENCH 5 CPU test chart is visible on screen, showing performance metrics for different processors.\n[390-420s] - Static bar chart displays Geekbench 5 CPU test results with three columns: \"单核 (单核) (单核)\" (Single-core), \"多核 (多核) (多核)\" (Multi-core), and \"性能比 (性能比)\" (Performance Ratio), each showing numerical scores and percentage comparisons.\n- Bars are color-coded: teal for \"单核\" (Single-core), orange for \"多核\" (Multi-core), and red for \"性能比\" (Performance Ratio), with specific values like 100% baseline and 11.1 for \"多核\" (Multi-core)\n[420-450s] - A bar chart displays Geekbench 5 CPU test results with three columns: \"单核 (单核)\" (Single-core), \"多核 (多核)\" (Multi-core), and \"平均功耗 (W)\" (Average Power Consumption), showing comparative scores for various processors.\n- The chart includes specific scores for A11, A12, A13, and A14 processors, with A14 achieving the highest multi-core score of 100%.\n- The chart is presented on a dark background with white and colored bars, and the text is in Chinese, indicating a focus on performance metrics\n[450-480s] - A bar chart displays GPU performance scores for various models, including A75, A74, and A7400, with numerical values and percentages.\n- The chart is labeled in Chinese, with \"GFXBench Aztez Rui\" as the test name and \"OpenCL 3.1 (fps)\" as the metric.\n- A red box highlights the \"A7400\" entry, which shows a score of 100 at 100% performance.\n[480-510s] - A man in a green jacket sits at a desk, gesturing while speaking.  \n- A Gfxbench Aztec Ruin test chart appears, highlighting performance metrics for various processors.  \n- A close-up of a MediaTek Dimensity 9000 chip is shown, with its branding clearly visible.\n[510-540s] - MediaTek Dimensity 9000 chip displayed with \"GPU 800-900MHz\" label beneath it.  \n- Samsung Exynos 2100 and Qualcomm Snapdragon 8 Gen 2 chips appear side-by-side with MediaTek chip.  \n- G-FBench Aztec Ruin test results shown with MediaTek chip scoring 42 in GPU performance.\n[540-570s] - A man in a green jacket sits at a desk, gesturing while speaking.  \n- A smartphone screen shows a game being played with two hands holding the device.  \n- A table displays phone models and their \"染污率\" (contamination rate) values for \"原神\" (Genshin Impact) with two columns labeled \"中\" (medium) and \"高\" (high).\n[570-600s] - A table displays \"《原神》渲染分辨率\" with columns for \"中\" and \"高\" settings, listing various device models and their corresponding frame rates.\n- A graph titled \"《原神》游戏实时帧率\" shows fluctuating frame rates over time, with multiple colored lines representing different settings or devices.\n- A box overlay at the bottom left provides \"各设备帧率平均值\" with specific numerical values for different devices under \"中\" and \"高\" settings.\n[600-630s] - Top graph displays fluctuating FPS data for 《原神》 with green, purple, and red lines indicating different metrics over time.\n- Bottom graph shows CPU usage for \"天选K1000\" with blue and purple lines tracking performance.\n- Both graphs are overlaid on a dark background with Chinese text labels and numerical values for performance metrics.\n[630-660s] - Graph displays fluctuating frame rates for 《原神》 across 20 minutes, with multiple colored lines representing different metrics.\n- Text boxes show average frame rates (e.g., 30fps, 60fps) and specific 15-30 minute intervals.\n- A legend on the right identifies line colors corresponding to different performance metrics like CPU, GPU, and memory usage.", "history_tokens": 996, "history_utf8_bytes": 3742, "recent_frame_times_s": [650.0160333333333, 651.00035, 652.00135, 653.00235, 654.00335, 655.00435, 656.00535, 657.00635, 658.00735, 659.00835, 660.00935, 661.01035, 662.01135, 663.01235, 664.01335, 665.01435, 666.01535, 667.01635, 668.0006666666667, 669.0016666666667, 670.0026666666666, 671.0036666666666, 672.0046666666667, 673.0056666666667, 674.0066666666667, 675.0076666666666, 676.0086666666666, 677.0096666666667, 678.0106666666667, 679.0116666666667], "recent_frames_sha256": "9e5144a8e6c9576f3dc9ea05db263789e3ec10538f3569a5704813cf84408faa", "num_recent_frames": 30, "tq": 719116.625147734, "t1": 719123.640863854, "ta": 719123.640863854, "te": 719123.682525952, "first_response_s": 7.015716120018624, "answer_total_s": 7.0573782180435956, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 111, "content_group": "ccb0637b948d2344702ce2b62679c76742cf37347bd9823a97d6bb06a35d3395", "question": {"question_id": "sample_111_a1695_q0", "video_id": 111, "video_path": "./videos/sample_111_real.mp4", "annotation_index": 1695, "question_index": 0, "question": "Which symbol is NOT displayed across the screen right now?", "options": ["A. Thumbs-up icon.", "B. forward icon.", "C. Star.", "D. Heart."], "answer": "D", "time_stamp_s": 842, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [840, 845], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_111_a1695_q0", "video_id": 111, "time_stamp_s": 842, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "35c711efb29fdf1c60c5285943d1c2f0e5aaaeb55158b3d6eab1482b6c9c43da", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [812.0112, 813.0122, 814.0132, 815.0142, 816.0152, 817.0162, 818.0005166666666, 819.0015166666667, 820.0025166666667, 821.0035166666667, 822.0045166666666, 823.0055166666667, 824.0065166666667, 825.0075166666667, 826.0085166666667, 827.0095166666666, 828.0105166666667, 829.0115166666667, 830.0125166666667, 831.0135166666666, 832.0145166666666, 833.0155166666667, 834.0165166666667, 835.0008333333334, 836.0018333333334, 837.0028333333333, 838.0038333333333, 839.0048333333333, 840.0058333333334, 841.0068333333334], "recent_frames_sha256": "8cd42e82ee38195170f76939eea74529ebda9af45208a5fda46c542e9e3801c3", "num_recent_frames": 30, "tq": 718859.929379939, "t1": 718867.294727521, "ta": 718867.294727521, "te": 718867.447225894, "first_response_s": 7.365347582031973, "answer_total_s": 7.517845954978839, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_111_a1695_q0", "video_id": 111, "time_stamp_s": 842, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c20c8ef97de356dd70fb912b0ad1de2f8d24b8d0bf30ee5e44677bf6ad932aad", "condition_order": ["recent", "notes"], "memory": "[540-570s] - A man in a green jacket sits at a desk, gesturing while speaking.  \n- A smartphone screen shows a game being played with two hands holding the device.  \n- A table displays phone models and their \"染污率\" (contamination rate) values for \"原神\" (Genshin Impact) with two columns labeled \"中\" (medium) and \"高\" (high).\n[570-600s] - A table displays \"《原神》渲染分辨率\" with columns for \"中\" and \"高\" settings, listing various device models and their corresponding frame rates.\n- A graph titled \"《原神》游戏实时帧率\" shows fluctuating frame rates over time, with multiple colored lines representing different settings or devices.\n- A box overlay at the bottom left provides \"各设备帧率平均值\" with specific numerical values for different devices under \"中\" and \"高\" settings.\n[600-630s] - Top graph displays fluctuating FPS data for 《原神》 with green, purple, and red lines indicating different metrics over time.\n- Bottom graph shows CPU usage for \"天选K1000\" with blue and purple lines tracking performance.\n- Both graphs are overlaid on a dark background with Chinese text labels and numerical values for performance metrics.\n[630-660s] - Graph displays fluctuating frame rates for 《原神》 across 20 minutes, with multiple colored lines representing different metrics.\n- Text boxes show average frame rates (e.g., 30fps, 60fps) and specific 15-30 minute intervals.\n- A legend on the right identifies line colors corresponding to different performance metrics like CPU, GPU, and memory usage.\n[660-690s] - A graph displays fluctuating lines in purple, red, and green, representing game frame rates over time, with a title in Chinese and a timestamp of 20:09:09.\n- A small box on the left lists \"帧率平均值\" (average frame rate) with values like 59fps, 60fps, and 61fps, alongside \"帧率波动\" (frame rate fluctuation) values.\n- The graph's x-axis spans from 0 to 30, while the y-axis ranges from 0 to 50, indicating frame rate measurements.\n[690-720s] - A man in a green jacket sits at a desk, hands clasped, against a blue backdrop with shelves holding various objects.  \n- A graph titled \"《王者荣耀》游戏实时帧率\" appears, showing fluctuating frame rates with statistics for \"最低帧率\" (min), \"最高帧率\" (max), and \"平均帧率\" (avg).  \n- The graph displays data points over a time axis, with a red line indicating frame rate variations and a box showing numerical frame rate metrics.\n[720-750s] - A man in a green jacket sits at a desk, gesturing while speaking, with shelves holding tech items behind him.  \n- On-screen text displays specifications for \"麒麟9000\" and \"天玑9000\" processors, including clock speeds and chip sizes.  \n- A graph titled \"《王者荣耀》游戏实时帧率\" shows fluctuating frame rates, with a box indicating average frame rates for both processors.\n[750-780s] - A graph displays fluctuating performance metrics (purple, green, red lines) for \"The Legend of Zelda: Tears of the Kingdom\" with timestamps 10:00 to 10:00, showing stable frame rates around 60 FPS.  \n- A man in a green jacket sits at a desk, gesturing with hands while speaking, against a blue background with shelves holding tech items.  \n- A promotional image for the \"Redmi K50\" smartphone highlights its \"Snapdragon 8 Gen 1\" chip, with text indicating \"First Launch\" and \"Ultra-Performance.\"\n[780-810s] - A man in a green jacket and glasses sits at a desk, gesturing with his hands while speaking.  \n- Behind him, shelves display various tech gadgets and decor against a blue wall.  \n- The man’s hands move expressively as he talks, indicating active communication.\n[810-840s] - Speaker gestures with hands while seated at a white table against a blue backdrop.  \n- Background shelves display various tech gadgets and decor items.  \n- Green smartphone back panel with camera module and \"PANASONIC\" branding is shown briefly.", "history_tokens": 986, "history_utf8_bytes": 3927, "recent_frame_times_s": [812.0112, 813.0122, 814.0132, 815.0142, 816.0152, 817.0162, 818.0005166666666, 819.0015166666667, 820.0025166666667, 821.0035166666667, 822.0045166666666, 823.0055166666667, 824.0065166666667, 825.0075166666667, 826.0085166666667, 827.0095166666666, 828.0105166666667, 829.0115166666667, 830.0125166666667, 831.0135166666666, 832.0145166666666, 833.0155166666667, 834.0165166666667, 835.0008333333334, 836.0018333333334, 837.0028333333333, 838.0038333333333, 839.0048333333333, 840.0058333333334, 841.0068333333334], "recent_frames_sha256": "8cd42e82ee38195170f76939eea74529ebda9af45208a5fda46c542e9e3801c3", "num_recent_frames": 30, "tq": 719171.303953971, "t1": 719178.228163334, "ta": 719178.228163334, "te": 719178.267583976, "first_response_s": 6.924209362943657, "answer_total_s": 6.963630005018786, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 112, "content_group": "614aee17550e376de17c6491d70af9ea2e854b4a2cb3fafea7ae8f4da8ffc4f1", "question": {"question_id": "sample_112_a347_q0", "video_id": 112, "video_path": "./videos/sample_112_real.mp4", "annotation_index": 347, "question_index": 0, "question": "Which graphics cards are being compared right now?", "options": ["A. RTX 3080 Ti and RTX 3070 Ti.", "B. RTX 3060 and RTX 3070 Ti.", "C. RTX 3080 Ti and RTX 3090.", "D. RTX 3070 and RTX 3080 Ti."], "answer": "A", "time_stamp_s": 20, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_112_a347_q0", "video_id": 112, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a1768476f170271ac5f6ef9206c82b98419716b51b03cf09ad6029271a726191", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665], "recent_frames_sha256": "d4fcbe0a2c2961880b8aebe8e732e2ba7be9170141f99f2869c9be28d8408ea5", "num_recent_frames": 20, "tq": 716237.754959686, "t1": 716274.369340982, "ta": 716274.369340982, "te": 716274.40698839, "first_response_s": 36.61438129609451, "answer_total_s": 36.652028704062104, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_112_a347_q0", "video_id": 112, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5d622bb1c0df6c7ab6e9bd806be251a06392cfb5ea8575259224a99ff098f642", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665], "recent_frames_sha256": "d4fcbe0a2c2961880b8aebe8e732e2ba7be9170141f99f2869c9be28d8408ea5", "num_recent_frames": 20, "tq": 716313.72489252, "t1": 716320.193731459, "ta": 716320.193731459, "te": 716320.416698296, "first_response_s": 6.468838938977569, "answer_total_s": 6.6918057759758085, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 112, "content_group": "614aee17550e376de17c6491d70af9ea2e854b4a2cb3fafea7ae8f4da8ffc4f1", "question": {"question_id": "sample_112_a348_q0", "video_id": 112, "video_path": "./videos/sample_112_real.mp4", "annotation_index": 348, "question_index": 0, "question": "Which graphics cards are being compared right now?", "options": ["A. RTX 3080 Ti and RTX 3080.", "B. RTX 3060 and RTX 3070 Ti.", "C. RTX 3080 Ti and RTX 3090.", "D. RTX 3070 and RTX 3080 Ti."], "answer": "A", "time_stamp_s": 191, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [180, 200], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_112_a348_q0", "video_id": 112, "time_stamp_s": 191, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "eaac08ed53fca55fa57ac774a78faed103da850a5edfaf6471b2feb9e07da010", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334], "recent_frames_sha256": "2d790a8f4087900ae40dcbf9396384848b2f190d62574d04fbe8f7fbd90e6bd8", "num_recent_frames": 30, "tq": 716274.430422107, "t1": 716282.480212286, "ta": 716282.480212286, "te": 716282.518962215, "first_response_s": 8.049790179007687, "answer_total_s": 8.088540108059533, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_112_a348_q0", "video_id": 112, "time_stamp_s": 191, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2a5b651bde30ee4f07dd04c998e046781af53779f937f3f0c00f43ed5aa4fe47", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a blue shirt sits at a desk with a Razer laptop, gesturing while speaking.  \n- Animated graphics display GPU chip comparisons, including GA104, GA102, and RTX 3080/3070 models.  \n- Product specs for RTX 3080 Ti and RTX 3070 Ti laptops are shown with gaming visuals on screen.\n[30-60s] - Man holds a graphics card while seated at a desk with a laptop.  \n- Close-up shows hands using a caliper to measure a CPU on a motherboard.  \n- On-screen graphics compare chip sizes: GA104 (392 mm²), GA103 (496 mm²), and RTX 3080 Ti mobile (628 mm²).\n[60-90s] - A man in a denim jacket sits at a desk with a black laptop featuring a green Razer logo, speaking to the camera.  \n- Behind him, shelves display various tech gadgets, including a camera and a headset, against a dark blue backdrop.  \n- On-screen text appears in Chinese, indicating \"RTX 3080 Ti 移动版\" (RTX 3080 Ti Mobile Edition) and other graphics chip specifications.\n[90-120s] - Three GPU chip diagrams (GA104, GA103, GA102) are displayed with color-coded blocks indicating core counts and memory sizes.\n- Below each diagram, specifications for different GPU models (RTX 3070, RTX 3070 Ti, RTX 3080, RTX 3080 Ti) are listed, including core count, memory size, and clock speeds.\n- A bar chart titled \"3DMark Time Spy\" appears, showing performance scores for the RTX 3070, RTX 3070 Ti\n[120-150s] - A man in a blue shirt sits at a desk with a Razer laptop, gesturing while speaking.  \n- A slide displays GPU architecture comparisons (G92, G94, G96) with performance metrics for various RTX models.  \n- The slide highlights performance differences in 3DMark Time Spy scores, with RTX 3070 and RTX 3080 shown as top performers.\n[150-180s] - Laptop screen displays colorful geometric patterns with a dark background, indicating active display output.  \n- A man in a denim shirt sits at a desk, interacting with a black laptop featuring a green logo, positioned in front of him.  \n- The laptop's internal components are shown being handled, with hands lifting a heat sink assembly from the chassis.", "history_tokens": 601, "history_utf8_bytes": 2069, "recent_frame_times_s": [161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334], "recent_frames_sha256": "2d790a8f4087900ae40dcbf9396384848b2f190d62574d04fbe8f7fbd90e6bd8", "num_recent_frames": 30, "tq": 716376.0979809, "t1": 716382.222837489, "ta": 716382.222837489, "te": 716382.260556569, "first_response_s": 6.124856589012779, "answer_total_s": 6.162575669004582, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 112, "content_group": "614aee17550e376de17c6491d70af9ea2e854b4a2cb3fafea7ae8f4da8ffc4f1", "question": {"question_id": "sample_112_a349_q0", "video_id": 112, "video_path": "./videos/sample_112_real.mp4", "annotation_index": 349, "question_index": 0, "question": "What metrics are displayed on the benchmarking screen for each graphics card right now?", "options": ["A. FPS, clock speed, temperature, power, and CPU usage.", "B. Memory usage, CPU temperature, and power draw.", "C. Ping rate, jitter, and packet loss.", "D. Frame time, GPU load, and VRAM usage."], "answer": "A", "time_stamp_s": 360, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [360, 380], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_112_a349_q0", "video_id": 112, "time_stamp_s": 360, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e24e0b6c498e715a6896175216d8e4eff309e2bd4884dc017c2e80db3cdda3ea", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [330.01301666666666, 331.0140166666667, 332.01501666666667, 333.01601666666664, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865], "recent_frames_sha256": "8dfc09e0bd360cac085d04c60fe4abbaee82469843c3deea995eda221f0193c4", "num_recent_frames": 30, "tq": 716282.542222168, "t1": 716289.539297829, "ta": 716289.539297829, "te": 716289.576695907, "first_response_s": 6.997075661085546, "answer_total_s": 7.0344737390987575, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_112_a349_q0", "video_id": 112, "time_stamp_s": 360, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9ea781e2726e4d9fb95147f8c16bb552d08d6569bace6351124b83093c64f9a5", "condition_order": ["recent", "notes"], "memory": "[120-150s] - A man in a blue shirt sits at a desk with a Razer laptop, gesturing while speaking.  \n- A slide displays GPU architecture comparisons (G92, G94, G96) with performance metrics for various RTX models.  \n- The slide highlights performance differences in 3DMark Time Spy scores, with RTX 3070 and RTX 3080 shown as top performers.\n[150-180s] - Laptop screen displays colorful geometric patterns with a dark background, indicating active display output.  \n- A man in a denim shirt sits at a desk, interacting with a black laptop featuring a green logo, positioned in front of him.  \n- The laptop's internal components are shown being handled, with hands lifting a heat sink assembly from the chassis.\n[180-210s] - A bar chart displays 3DMark Time Spy scores for RTX 3080 Ti (13,688) and RTX 3080 (12,363), with labels in Chinese.  \n- A graph overlay shows GPU clock speeds and performance metrics for both cards, with RTX 3080 Ti at 1515 MHz and RTX 3080 at 1650 MHz.  \n- Text annotations indicate performance gains (+20.8%) and losses (-8.2%) for the RTX 3080 Ti\n[210-240s] - Two GPU performance graphs displayed side-by-side, comparing RTX 3080 Ti and RTX 3080 with frequency and score metrics.\n- RTX 3080 Ti shows higher clock speeds (1515 MHz vs 1650 MHz) and scores (13399 vs 12363) with performance gains noted.\n- Graphs include fluctuating lines indicating performance over time, with annotations for specific metrics like \"帧数\" (frame count) and \"帧率\" (frame rate).\n[240-270s] - A man in a denim jacket sits at a desk with a black Razer laptop, gesturing while speaking.  \n- A bar chart displays 3DMark DXR results, showing RTX 3080 Ti (13,399 fps) and RTX 3080 (12,263 fps) with a 22% performance gap.  \n- A comparison chart of GPU architectures (GA104, GA103, GA102) highlights core counts, shader units, and memory bandwidth for RTX 3070, 308\n[270-300s] - Game performance metrics displayed: RTX 3060 Ti at 68 FPS, RTX 3080 at 64 FPS, with 2K/4K DLSS and AK-47SS settings.\n- On-screen overlay shows system stats: clock 10:58, temperature 38°C, power 137W, CPU at 52%.\n- Scene transitions to a racing game with a gold car on a track, showing position 80 and a scoreboard indicating 12/12 laps.\n[300-330s] - Bar graph displays average frame rates for RTX 3080 Ti and RTX 3080 GPUs in \"Elden Ring\" at 2K and 4K resolutions.\n- Text labels indicate \"2K\" and \"4K\" resolution settings with corresponding frame rate bars.\n- Small inset images show game performance metrics for different GPU models, including FPS and CPU usage.\n[330-360s] - A man in a denim jacket sits at a desk with a Razer laptop, facing the camera.  \n- A bar graph displays \"《光环：无限》游戏平均帧率\" with RTX 3060 Ti and RTX 3060 performance metrics.  \n- A futuristic scene with a glowing ring and a soldier appears, accompanied by system stats like \"Lock 186C\", \"Temp 97\", and \"CPU 52.1%\".", "history_tokens": 913, "history_utf8_bytes": 2895, "recent_frame_times_s": [330.01301666666666, 331.0140166666667, 332.01501666666667, 333.01601666666664, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865], "recent_frames_sha256": "8dfc09e0bd360cac085d04c60fe4abbaee82469843c3deea995eda221f0193c4", "num_recent_frames": 30, "tq": 716433.508216261, "t1": 716434.790716855, "ta": 716434.790716855, "te": 716434.982734884, "first_response_s": 1.2825005939230323, "answer_total_s": 1.4745186229702085, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 112, "content_group": "614aee17550e376de17c6491d70af9ea2e854b4a2cb3fafea7ae8f4da8ffc4f1", "question": {"question_id": "sample_112_a350_q0", "video_id": 112, "video_path": "./videos/sample_112_real.mp4", "annotation_index": 350, "question_index": 0, "question": "What frame rate does the RTX 3080 Ti with Intel i9 12900K and 32G DDR5 4800 achieve for \"God of War 4\" at 4K+DLSS right now?", "options": ["A. 101 fps.", "B. 135 fps.", "C. 91 fps.", "D. 87 fps."], "answer": "A", "time_stamp_s": 560, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [540, 560], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_112_a350_q0", "video_id": 112, "time_stamp_s": 560, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8cdba708d70ed06a8020269eebb4535703a5c86bc9a26924b0904eedc5605364", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [530.0128166666667, 531.0138166666667, 532.0148166666667, 533.0158166666666, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.00045, 552.00145, 553.00245, 554.00345, 555.00445, 556.00545, 557.00645, 558.00745, 559.00845], "recent_frames_sha256": "02a69aeb662897fd8a305ac6a2142baff237d38a7aec07b2b29e226f37608f37", "num_recent_frames": 30, "tq": 716289.590932745, "t1": 716302.302538897, "ta": 716302.302538897, "te": 716302.339993312, "first_response_s": 12.711606152006425, "answer_total_s": 12.749060567002743, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_112_a350_q0", "video_id": 112, "time_stamp_s": 560, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "64a23f2e11a250d316701c750196cf68bae4ba51bd31be79dc4459dcbfdf5d2a", "condition_order": ["recent", "notes"], "memory": "[270-300s] - Game performance metrics displayed: RTX 3060 Ti at 68 FPS, RTX 3080 at 64 FPS, with 2K/4K DLSS and AK-47SS settings.\n- On-screen overlay shows system stats: clock 10:58, temperature 38°C, power 137W, CPU at 52%.\n- Scene transitions to a racing game with a gold car on a track, showing position 80 and a scoreboard indicating 12/12 laps.\n[300-330s] - Bar graph displays average frame rates for RTX 3080 Ti and RTX 3080 GPUs in \"Elden Ring\" at 2K and 4K resolutions.\n- Text labels indicate \"2K\" and \"4K\" resolution settings with corresponding frame rate bars.\n- Small inset images show game performance metrics for different GPU models, including FPS and CPU usage.\n[330-360s] - A man in a denim jacket sits at a desk with a Razer laptop, facing the camera.  \n- A bar graph displays \"《光环：无限》游戏平均帧率\" with RTX 3060 Ti and RTX 3060 performance metrics.  \n- A futuristic scene with a glowing ring and a soldier appears, accompanied by system stats like \"Lock 186C\", \"Temp 97\", and \"CPU 52.1%\".\n[360-390s] - A man in a denim jacket sits at a desk with a laptop, facing the camera, in a studio setting.  \n- Game footage shows a character in \"God of War\" navigating a river and entering a cave, with on-screen stats like FPS, temperature, and power usage.  \n- A bar chart compares frame rates for \"God of War\" on RTX 3060 Ti and RTX 3060 cards under 3K and 4K resolutions.\n[390-420s] - Bar graph displays average frame rates for \"God of War 4\" with RTX 3060 Ti (93 FPS) and RTX 3060 (87 FPS) under 2Kx1080 resolution with and without DLSS.  \n- Right panel shows real-time GPU/CPU stats: RTX 3060 Ti at 1455 MHz clock, 68°C temp, 26.9W power, 29 FPS.  \n- Game footage transitions to \"God of War 4\" gameplay with visible UI elements like \"Temp,\"\n[420-450s] - A man in a denim shirt sits at a desk with a Razer laptop, gesturing while speaking.  \n- The background features dark blue shelves with various decorative items, including a lamp and small figurines.  \n- A green Razer logo is visible on the closed laptop lid in front of the man.\n[450-480s] - Two black laptop power adapters are shown side-by-side, displaying technical labels and certification marks.  \n- A dark gray Acer gaming laptop is displayed from the back, featuring a glowing logo and blue LED accents along the edges.  \n- A man in a denim jacket sits at a desk with a closed Razer laptop in front of him, gesturing while speaking.\n[480-510s] - A man in a denim shirt smiles while seated at a desk with a black Razer laptop in front of him.  \n- The video transitions to a close-up of a laptop's motherboard, highlighting the CPU chip with a red outline.  \n- A screen displays SPECviewperf 13 test results comparing RTX 3060 Ti and RTX 3060 GPUs across various software applications.\n[510-540s] - A laptop with a green Razer logo is open on a white table, positioned left of a presenter.  \n- The presenter holds a graphics card in his right hand, gesturing toward the laptop.  \n- A bar chart displays 3DMark Time Spy scores for RTX 3060 Ti, RTX 3060, and RTX 3060 (with 3060 Ti leading).", "history_tokens": 929, "history_utf8_bytes": 3084, "recent_frame_times_s": [530.0128166666667, 531.0138166666667, 532.0148166666667, 533.0158166666666, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.00045, 552.00145, 553.00245, 554.00345, 555.00445, 556.00545, 557.00645, 558.00745, 559.00845], "recent_frames_sha256": "02a69aeb662897fd8a305ac6a2142baff237d38a7aec07b2b29e226f37608f37", "num_recent_frames": 30, "tq": 716486.045668725, "t1": 716487.514245025, "ta": 716487.514245025, "te": 716487.740948395, "first_response_s": 1.468576299957931, "answer_total_s": 1.6952796699479222, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 112, "content_group": "614aee17550e376de17c6491d70af9ea2e854b4a2cb3fafea7ae8f4da8ffc4f1", "question": {"question_id": "sample_112_a351_q0", "video_id": 112, "video_path": "./videos/sample_112_real.mp4", "annotation_index": 351, "question_index": 0, "question": "What appears in the overlay graphics on the screen right now?", "options": ["A. User interaction options.", "B. Weather icons.", "C. Application logos.", "D. Navigation tools."], "answer": "A", "time_stamp_s": 673, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [660, 677], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_112_a351_q0", "video_id": 112, "time_stamp_s": 673, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2246cf7c034455220cf392829f4265d8f45c1465bc53eac120e7170a4bd7f50c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [643.0090333333334, 644.0100333333334, 645.0110333333333, 646.0120333333333, 647.0130333333333, 648.0140333333334, 649.0150333333333, 650.0160333333333, 651.00035, 652.00135, 653.00235, 654.00335, 655.00435, 656.00535, 657.00635, 658.00735, 659.00835, 660.00935, 661.01035, 662.01135, 663.01235, 664.01335, 665.01435, 666.01535, 667.01635, 668.0006666666667, 669.0016666666667, 670.0026666666666, 671.0036666666666, 672.0046666666667], "recent_frames_sha256": "a24ca853dd793ba2b053e8c922781511e090837109c100f5a2150570dffc6341", "num_recent_frames": 30, "tq": 716302.355738847, "t1": 716313.671154489, "ta": 716313.671154489, "te": 716313.708688021, "first_response_s": 11.315415641991422, "answer_total_s": 11.352949174004607, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_112_a351_q0", "video_id": 112, "time_stamp_s": 673, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ac7bb3468b96c13493be854893dd9484b13f8d7b94eb77c7c27c1becf8e1c38d", "condition_order": ["recent", "notes"], "memory": "[360-390s] - A man in a denim jacket sits at a desk with a laptop, facing the camera, in a studio setting.  \n- Game footage shows a character in \"God of War\" navigating a river and entering a cave, with on-screen stats like FPS, temperature, and power usage.  \n- A bar chart compares frame rates for \"God of War\" on RTX 3060 Ti and RTX 3060 cards under 3K and 4K resolutions.\n[390-420s] - Bar graph displays average frame rates for \"God of War 4\" with RTX 3060 Ti (93 FPS) and RTX 3060 (87 FPS) under 2Kx1080 resolution with and without DLSS.  \n- Right panel shows real-time GPU/CPU stats: RTX 3060 Ti at 1455 MHz clock, 68°C temp, 26.9W power, 29 FPS.  \n- Game footage transitions to \"God of War 4\" gameplay with visible UI elements like \"Temp,\"\n[420-450s] - A man in a denim shirt sits at a desk with a Razer laptop, gesturing while speaking.  \n- The background features dark blue shelves with various decorative items, including a lamp and small figurines.  \n- A green Razer logo is visible on the closed laptop lid in front of the man.\n[450-480s] - Two black laptop power adapters are shown side-by-side, displaying technical labels and certification marks.  \n- A dark gray Acer gaming laptop is displayed from the back, featuring a glowing logo and blue LED accents along the edges.  \n- A man in a denim jacket sits at a desk with a closed Razer laptop in front of him, gesturing while speaking.\n[480-510s] - A man in a denim shirt smiles while seated at a desk with a black Razer laptop in front of him.  \n- The video transitions to a close-up of a laptop's motherboard, highlighting the CPU chip with a red outline.  \n- A screen displays SPECviewperf 13 test results comparing RTX 3060 Ti and RTX 3060 GPUs across various software applications.\n[510-540s] - A laptop with a green Razer logo is open on a white table, positioned left of a presenter.  \n- The presenter holds a graphics card in his right hand, gesturing toward the laptop.  \n- A bar chart displays 3DMark Time Spy scores for RTX 3060 Ti, RTX 3060, and RTX 3060 (with 3060 Ti leading).\n[540-570s] - Bar chart displays average frame rates for games on different RTX 30xx GPUs with 2K/4K resolutions and DLSS settings.  \n- A man in a blue shirt holds a laptop and a monitor, standing behind a desk with a laptop and a monitor.  \n- Laptop screen shows a cityscape, with a monitor displaying a game scene, both positioned on a dark surface.\n[570-600s] - Graph displays GPU performance comparison across various models, with highlighted points for 3060 Ti and 3080 Ti.\n- A presenter is seated at a desk with a laptop and graphics card, gesturing while speaking.\n- Close-up of a laptop's internal circuit board shows two large CPU chips and surrounding components.\n[600-630s] - A graph displays \"桌面端移动端显卡性能对比\" with green dots indicating performance metrics across various GPU models (e.g., 1050, 1060, 1070, 1080, 1090, 1100) on a dark background.  \n- A man in a denim shirt sits at a desk with a black laptop featuring a green logo, gesturing while speaking.  \n- Text overlays appear on the screen, including \"3060 3070\" and \"3070 以上桌面卡性能强\n[630-660s] - Man gestures while seated at desk with laptop and graphics card in hand.  \n- Laptop displays green Razer logo; graphics card is held in right hand.  \n- Background shows shelves with tech items against blue wall.", "history_tokens": 958, "history_utf8_bytes": 3370, "recent_frame_times_s": [643.0090333333334, 644.0100333333334, 645.0110333333333, 646.0120333333333, 647.0130333333333, 648.0140333333334, 649.0150333333333, 650.0160333333333, 651.00035, 652.00135, 653.00235, 654.00335, 655.00435, 656.00535, 657.00635, 658.00735, 659.00835, 660.00935, 661.01035, 662.01135, 663.01235, 664.01335, 665.01435, 666.01535, 667.01635, 668.0006666666667, 669.0016666666667, 670.0026666666666, 671.0036666666666, 672.0046666666667], "recent_frames_sha256": "a24ca853dd793ba2b053e8c922781511e090837109c100f5a2150570dffc6341", "num_recent_frames": 30, "tq": 716524.772837878, "t1": 716526.492888081, "ta": 716526.492888081, "te": 716526.768867365, "first_response_s": 1.7200502030318603, "answer_total_s": 1.9960294869961217, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 113, "content_group": "71f39111a8116c6d3b671c57a535c6e47fc0c0474936e6315d406440267c99e0", "question": {"question_id": "sample_113_a1621_q0", "video_id": 113, "video_path": "./videos/sample_113_real.mp4", "annotation_index": 1621, "question_index": 0, "question": "What item is the person holding close to the camera right now?", "options": ["A. A framed picture.", "B. A black device.", "C. A navy blue t-shirt.", "D. A smartphone."], "answer": "D", "time_stamp_s": 7, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_113_a1621_q0", "video_id": 113, "time_stamp_s": 7, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0b69bdba51e320c2ea2283260500f503e6a90587309e764a0553f826fea45a59", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006], "recent_frames_sha256": "e4bfbbb4e01040f235b4fb932128d4839010ce8f864dc8a9d4ead7336d1551ea", "num_recent_frames": 7, "tq": 716689.7656706, "t1": 716690.841588157, "ta": 716690.841588157, "te": 716690.881257151, "first_response_s": 1.07591755699832, "answer_total_s": 1.1155865510227159, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_113_a1621_q0", "video_id": 113, "time_stamp_s": 7, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a5104cdf3f545135885b24bedb1c9fa103b5e0e2401085908d4e192480823810", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006], "recent_frames_sha256": "e4bfbbb4e01040f235b4fb932128d4839010ce8f864dc8a9d4ead7336d1551ea", "num_recent_frames": 7, "tq": 716487.780936179, "t1": 716500.375996317, "ta": 716500.375996317, "te": 716500.413976226, "first_response_s": 12.59506013803184, "answer_total_s": 12.633040047017857, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 113, "content_group": "71f39111a8116c6d3b671c57a535c6e47fc0c0474936e6315d406440267c99e0", "question": {"question_id": "sample_113_a1622_q0", "video_id": 113, "video_path": "./videos/sample_113_real.mp4", "annotation_index": 1622, "question_index": 0, "question": "What is the CPU multi-core score shown in the video for the A15?", "options": ["A. 4317.", "B. 1741.", "C. 4211.", "D. 4908."], "answer": "D", "time_stamp_s": 180, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [160, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_113_a1622_q0", "video_id": 113, "time_stamp_s": 180, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cef7cd1df662f1c4d580122649bb85d891727fe95d4b463c720e3a9500913c09", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667], "recent_frames_sha256": "8f28d49667e54f40412e8d0defc7f47a90eb12453a0b9a43af60e146c2db6c6c", "num_recent_frames": 30, "tq": 716690.915649705, "t1": 716702.503403554, "ta": 716702.503403554, "te": 716702.544085926, "first_response_s": 11.587753848987631, "answer_total_s": 11.628436221042648, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_113_a1622_q0", "video_id": 113, "time_stamp_s": 180, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a6d57c9922cf0c6bf8cd50cefca4c0eb1dd725489faec92d3d3c4ce00972f7d6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Man in dark blue shirt holds and gestures with a silver smartphone, occasionally pointing to its features.  \n- On-screen graphic displays Snapdragon chip logos, highlighting the \"8+ Gen 1\" model prominently.  \n- The man remains seated at a white table with a cup of noodles beside him, against a blue backdrop with shelves.\n[30-60s] - Man holds smartphone and remote control, gesturing toward phone while speaking.  \n- Phone screen displays \"Snapdragon\" app icon with \"8+\" text, indicating processor model.  \n- Phone back panel shows camera module, multiple sensor holes, and a slot for a SIM card or memory card.\n[60-90s] - Phone's rear panel shows a camera module and a USB-C port with gold-colored text indicating \"HUAWEI P40 Pro\" and \"HUAWEI P40 Pro 5G\".  \n- The phone's back panel has multiple circular cutouts and a rectangular slot for the USB-C port.  \n- The phone is held upright against a dark background, with the camera module positioned in the top left corner.\n[90-120s] - A hand interacts with a smartphone, toggling a setting labeled \"超级\" (Super) on a dark interface.  \n- The screen transitions to display a grid of Snapdragon chip icons, with \"888+\" highlighted in red and labeled \"超频\" (Overclocking) and \"工艺\" (Process).  \n- A person in a blue shirt sits at a desk, holding a smartphone and a can of \"Coca-Cola\" while gesturing toward the device.\n[120-150s] - CPU performance graph displays multiple chip models (Snapdragon 8 Gen 1, Adreno 730, Cortex-A710, etc.) with energy efficiency metrics.\n- Snapdragon 8 Gen 1 chip architecture is shown with 8 cores (2x A710, 6x A710) and Adreno 730 GPU, alongside MediaTek Dimensity 9000+.\n- Adreno 730 GPU clock speed is highlighted as 900MHz, with a purple bar indicating its position in the performance comparison.\n[150-180s] - A graphic displays Snapdragon 8+ Gen 1 and MediaTek Dimensity 1000+ chip architectures with their respective core configurations and clock speeds.  \n- A vertical bar chart shows Geekbench 5 CPU scores for various processors, including A13, A14, and Snapdragon 8+ Gen 1, with numerical values and rankings.  \n- A man in a blue shirt sits at a desk with a drink and pen, appearing to present or review the information.", "history_tokens": 582, "history_utf8_bytes": 2227, "recent_frame_times_s": [150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667], "recent_frames_sha256": "8f28d49667e54f40412e8d0defc7f47a90eb12453a0b9a43af60e146c2db6c6c", "num_recent_frames": 30, "tq": 716550.793775398, "t1": 716552.095795839, "ta": 716552.095795839, "te": 716552.244182087, "first_response_s": 1.302020440925844, "answer_total_s": 1.4504066889639944, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 113, "content_group": "71f39111a8116c6d3b671c57a535c6e47fc0c0474936e6315d406440267c99e0", "question": {"question_id": "sample_113_a1623_q0", "video_id": 113, "video_path": "./videos/sample_113_real.mp4", "annotation_index": 1623, "question_index": 0, "question": "What title is displayed at the top center of the black background right now?", "options": ["A. 3DMark Benchmark Results.", "B. Processor Performance Test.", "C. 3DMark Extreme Test.", "D. 3DMark Wild Extreme Stress 測試."], "answer": "D", "time_stamp_s": 327, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [320, 340], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_113_a1623_q0", "video_id": 113, "time_stamp_s": 327, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "14f311c86134d77b6028e4082f8507ab53976a30b2211669da7cb5d6e803101b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [297.0133833333333, 298.01438333333334, 299.0153833333333, 300.01638333333335, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0000166666667, 318.00101666666666, 319.0020166666667, 320.00301666666667, 321.00401666666664, 322.0050166666667, 323.00601666666665, 324.0070166666667, 325.00801666666666, 326.00901666666664], "recent_frames_sha256": "2c2b1fd4d2462c5385fba09d5897c6e98f2414b6dd2eb956d3bff4aa2ada7169", "num_recent_frames": 30, "tq": 716702.569783293, "t1": 716709.823734225, "ta": 716709.823734225, "te": 716709.862098664, "first_response_s": 7.253950932063162, "answer_total_s": 7.292315371101722, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_113_a1623_q0", "video_id": 113, "time_stamp_s": 327, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "42d0b54351fed236d6ab2861df169491894914e938cf7a304dfc52ed6bf1fe13", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Man holds smartphone and remote control, gesturing toward phone while speaking.  \n- Phone screen displays \"Snapdragon\" app icon with \"8+\" text, indicating processor model.  \n- Phone back panel shows camera module, multiple sensor holes, and a slot for a SIM card or memory card.\n[60-90s] - Phone's rear panel shows a camera module and a USB-C port with gold-colored text indicating \"HUAWEI P40 Pro\" and \"HUAWEI P40 Pro 5G\".  \n- The phone's back panel has multiple circular cutouts and a rectangular slot for the USB-C port.  \n- The phone is held upright against a dark background, with the camera module positioned in the top left corner.\n[90-120s] - A hand interacts with a smartphone, toggling a setting labeled \"超级\" (Super) on a dark interface.  \n- The screen transitions to display a grid of Snapdragon chip icons, with \"888+\" highlighted in red and labeled \"超频\" (Overclocking) and \"工艺\" (Process).  \n- A person in a blue shirt sits at a desk, holding a smartphone and a can of \"Coca-Cola\" while gesturing toward the device.\n[120-150s] - CPU performance graph displays multiple chip models (Snapdragon 8 Gen 1, Adreno 730, Cortex-A710, etc.) with energy efficiency metrics.\n- Snapdragon 8 Gen 1 chip architecture is shown with 8 cores (2x A710, 6x A710) and Adreno 730 GPU, alongside MediaTek Dimensity 9000+.\n- Adreno 730 GPU clock speed is highlighted as 900MHz, with a purple bar indicating its position in the performance comparison.\n[150-180s] - A graphic displays Snapdragon 8+ Gen 1 and MediaTek Dimensity 1000+ chip architectures with their respective core configurations and clock speeds.  \n- A vertical bar chart shows Geekbench 5 CPU scores for various processors, including A13, A14, and Snapdragon 8+ Gen 1, with numerical values and rankings.  \n- A man in a blue shirt sits at a desk with a drink and pen, appearing to present or review the information.\n[180-210s] - A bar chart displays Geekbench 5 CPU test scores for various processors, including A13, A14, and Snapdragon 888, with scores shown for single-core, multi-core, and energy efficiency.\n- The chart highlights performance differences, with the Snapdragon 888 showing lower scores compared to the A14 and A13.\n- A line graph titled \"CPU 大核能耗比\" (CPU Large Core Power Efficiency Ratio) is shown, plotting performance against power consumption for different processors.\n[210-240s] - A bar chart displays Geekbench 5 CPU test results for various processors, including A15, A14, and Snapdragon 870 Pro, with scores and power consumption metrics.  \n- A line graph titled \"CPU 能耗比\" (CPU Power Efficiency) shows performance vs. power consumption curves for different processors, with labels indicating specific models.  \n- A person in a dark shirt holds a smartphone, gesturing while speaking, positioned in front of a blue backdrop with shelves holding decorative items.\n[240-270s] - A graph titled \"CPU 能耗比\" displays multiple colored lines representing different processors' power consumption versus clock speed, with a red dot indicating a specific data point.  \n- The graph includes labels for various processors like \"骁龙888\" and \"骁龙870,\" with a legend on the right side.  \n- The scene transitions to a person sitting at a desk, holding a phone and gesturing while speaking, with a bottle of water and small objects on the table.\n[270-300s] - Graph displays GPU power consumption vs. clock speed for multiple models including Volta, Pascal, and A100.\n- A label \"A100\" appears on the graph, indicating its position among the plotted lines.\n- The graph's title \"GPU 能耗比\" (GPU Power Efficiency) is visible, with a subtitle \"GPUTech 1.0\" and \"A100 100000000000000000000000000000000000000000", "history_tokens": 990, "history_utf8_bytes": 3720, "recent_frame_times_s": [297.0133833333333, 298.01438333333334, 299.0153833333333, 300.01638333333335, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0000166666667, 318.00101666666666, 319.0020166666667, 320.00301666666667, 321.00401666666664, 322.0050166666667, 323.00601666666665, 324.0070166666667, 325.00801666666666, 326.00901666666664], "recent_frames_sha256": "2c2b1fd4d2462c5385fba09d5897c6e98f2414b6dd2eb956d3bff4aa2ada7169", "num_recent_frames": 30, "tq": 716592.935803026, "t1": 716598.911502488, "ta": 716598.911502488, "te": 716598.948861257, "first_response_s": 5.975699461996555, "answer_total_s": 6.013058231095783, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 113, "content_group": "71f39111a8116c6d3b671c57a535c6e47fc0c0474936e6315d406440267c99e0", "question": {"question_id": "sample_113_a1624_q0", "video_id": 113, "video_path": "./videos/sample_113_real.mp4", "annotation_index": 1624, "question_index": 0, "question": "What is the title of the bar chart being displayed right now?", "options": ["A. 游戏设备对比.", "B. 帧率和温度关系.", "C. 不同设备的功耗比较.", "D. 《原神》游戏实时帧率."], "answer": "D", "time_stamp_s": 499, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [480, 500], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_113_a1624_q0", "video_id": 113, "time_stamp_s": 499, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3471b35bde7eba862d7ab6a6ac25aeb47a6a75f9c4d33e522e0b317cee6598d3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336, 498.01418333333334], "recent_frames_sha256": "0f3b7cab6bc5f45e2274d843852c2718c4e36c616367575b6c48e656ca76a844", "num_recent_frames": 30, "tq": 716709.877805995, "t1": 716717.158709966, "ta": 716717.158709966, "te": 716717.197284865, "first_response_s": 7.280903970939107, "answer_total_s": 7.319478869903833, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_113_a1624_q0", "video_id": 113, "time_stamp_s": 499, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3e5131ff602832c15d83e8b5f66b041270c5efd631358f1d41d17e3bf18f068a", "condition_order": ["notes", "recent"], "memory": "[210-240s] - A bar chart displays Geekbench 5 CPU test results for various processors, including A15, A14, and Snapdragon 870 Pro, with scores and power consumption metrics.  \n- A line graph titled \"CPU 能耗比\" (CPU Power Efficiency) shows performance vs. power consumption curves for different processors, with labels indicating specific models.  \n- A person in a dark shirt holds a smartphone, gesturing while speaking, positioned in front of a blue backdrop with shelves holding decorative items.\n[240-270s] - A graph titled \"CPU 能耗比\" displays multiple colored lines representing different processors' power consumption versus clock speed, with a red dot indicating a specific data point.  \n- The graph includes labels for various processors like \"骁龙888\" and \"骁龙870,\" with a legend on the right side.  \n- The scene transitions to a person sitting at a desk, holding a phone and gesturing while speaking, with a bottle of water and small objects on the table.\n[270-300s] - Graph displays GPU power consumption vs. clock speed for multiple models including Volta, Pascal, and A100.\n- A label \"A100\" appears on the graph, indicating its position among the plotted lines.\n- The graph's title \"GPU 能耗比\" (GPU Power Efficiency) is visible, with a subtitle \"GPUTech 1.0\" and \"A100 100000000000000000000000000000000000000000\n[300-330s] - Graph displays GPU power consumption (W) versus clock speed (GHz) for various GPUs, including A13, A14, and others, with lines indicating performance trends.\n- A13 and A14 are highlighted with distinct colored lines, showing their power consumption profiles across different clock speeds.\n- The graph includes labels for \"A13,\" \"A14,\" and other GPU models, with data points indicating specific power consumption values at various clock speeds.\n[330-360s] - A man in a dark blue shirt holds a smartphone, gesturing while speaking, seated at a white table with a cup and small objects nearby.  \n- The background features dark shelves with decorative items, including a helmet and glowing objects, under blue lighting.  \n- A graphic overlay displays \"3DMark Wild Extreme Stress\" results, showing performance metrics for various devices like A15, A14, and Snapdragon 8 Gen 2.\n[360-390s] - A person in a dark blue shirt holds a phone and a box of snacks, gesturing while speaking.  \n- The phone screen displays a mobile game with a character walking through a vibrant, nighttime village scene.  \n- A table overlay shows performance metrics for different phone models running \"The God of War\" game at medium and high resolutions.\n[390-420s] - A graph displays fluctuating frame rates for \"The Legend of Zelda: Breath of the Wild\" with a mean of 59.7 fps.\n- CPU usage is shown as a separate graph with peaks and troughs, indicating system load during gameplay.\n- GPU usage is presented as a bar chart, highlighting specific performance metrics for different hardware components.\n[420-450s] - A graph displays fluctuating purple lines representing frame rates over time, with a horizontal dotted line indicating a target or average value.\n- A bar chart below shows \"最高帧数\" (highest frame rate) for different devices, with red bars indicating performance levels.\n- The graph's x-axis spans from 10:00 to 20:00, and a specific timestamp \"10:00\" is marked on the graph.\n[450-480s] - Thermal imaging display shows six smartphones under stress test, with heat maps indicating temperature distribution across their bodies.\n- Text overlay specifies \"30分钟原神后机身最高温度\" and conditions: \"25°C 3000mW WiFi 高画质\".\n- Devices include \"骁龙8 Gen 1\", \"骁龙8 Gen 2\", \"天玑9000\", \"骁龙870\", \"骁龙888\", and \"天玑8100\", each with distinct heat patterns.", "history_tokens": 957, "history_utf8_bytes": 3724, "recent_frame_times_s": [469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336, 498.01418333333334], "recent_frames_sha256": "0f3b7cab6bc5f45e2274d843852c2718c4e36c616367575b6c48e656ca76a844", "num_recent_frames": 30, "tq": 716643.17848659, "t1": 716649.193790664, "ta": 716649.193790664, "te": 716649.342148431, "first_response_s": 6.015304073924199, "answer_total_s": 6.163661840953864, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 113, "content_group": "71f39111a8116c6d3b671c57a535c6e47fc0c0474936e6315d406440267c99e0", "question": {"question_id": "sample_113_a1625_q0", "video_id": 113, "video_path": "./videos/sample_113_real.mp4", "annotation_index": 1625, "question_index": 0, "question": "What type of products are predominantly displayed on the shopping application right now?", "options": ["A. Clothes.", "B. Books.", "C. Furniture.", "D. Electronics."], "answer": "D", "time_stamp_s": 631, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [620, 638], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_113_a1625_q0", "video_id": 113, "time_stamp_s": 631, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "05a8105deb7c499b3f2cec9544e888ac6652a7da9799ca2742286337a68e25fc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074, 609.0084, 610.0094, 611.0104, 612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0007166666667, 619.0017166666667, 620.0027166666666, 621.0037166666667, 622.0047166666667, 623.0057166666667, 624.0067166666666, 625.0077166666666, 626.0087166666667, 627.0097166666667, 628.0107166666667, 629.0117166666666, 630.0127166666666], "recent_frames_sha256": "e058d0388f2f2534e72c94f73b1c5f16eee6bc0b1d045659983d2ad20d0f1c46", "num_recent_frames": 30, "tq": 716717.210029987, "t1": 716728.794286291, "ta": 716728.794286291, "te": 716728.833828607, "first_response_s": 11.58425630396232, "answer_total_s": 11.623798619955778, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_113_a1625_q0", "video_id": 113, "time_stamp_s": 631, "ground_truth": "D", "raw_output": "D. Electronics.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "3c67933e82298b96b5763cf2f9a0f4f0531c809667a8cbad5112a915566492ee", "condition_order": ["notes", "recent"], "memory": "[330-360s] - A man in a dark blue shirt holds a smartphone, gesturing while speaking, seated at a white table with a cup and small objects nearby.  \n- The background features dark shelves with decorative items, including a helmet and glowing objects, under blue lighting.  \n- A graphic overlay displays \"3DMark Wild Extreme Stress\" results, showing performance metrics for various devices like A15, A14, and Snapdragon 8 Gen 2.\n[360-390s] - A person in a dark blue shirt holds a phone and a box of snacks, gesturing while speaking.  \n- The phone screen displays a mobile game with a character walking through a vibrant, nighttime village scene.  \n- A table overlay shows performance metrics for different phone models running \"The God of War\" game at medium and high resolutions.\n[390-420s] - A graph displays fluctuating frame rates for \"The Legend of Zelda: Breath of the Wild\" with a mean of 59.7 fps.\n- CPU usage is shown as a separate graph with peaks and troughs, indicating system load during gameplay.\n- GPU usage is presented as a bar chart, highlighting specific performance metrics for different hardware components.\n[420-450s] - A graph displays fluctuating purple lines representing frame rates over time, with a horizontal dotted line indicating a target or average value.\n- A bar chart below shows \"最高帧数\" (highest frame rate) for different devices, with red bars indicating performance levels.\n- The graph's x-axis spans from 10:00 to 20:00, and a specific timestamp \"10:00\" is marked on the graph.\n[450-480s] - Thermal imaging display shows six smartphones under stress test, with heat maps indicating temperature distribution across their bodies.\n- Text overlay specifies \"30分钟原神后机身最高温度\" and conditions: \"25°C 3000mW WiFi 高画质\".\n- Devices include \"骁龙8 Gen 1\", \"骁龙8 Gen 2\", \"天玑9000\", \"骁龙870\", \"骁龙888\", and \"天玑8100\", each with distinct heat patterns.\n[480-510s] - A graph displays real-time frame rates for \"The Legend of Zelda: Breath of the Wild\" on a dark background, with fluctuating lines in multiple colors.\n- A bar chart below shows average 4K frame rates for various devices, including \"NVIDIA GeForce RTX 3080\" and \"AMD Radeon RX 6800 XT.\"\n- The graph's x-axis spans from 00:00 to 00:30, with a vertical line indicating a frame rate dip around 00:15.\n[510-540s] - A graph displays fluctuating purple lines representing real-time frame rates for \"The Legend of Zelda: Breath of the Wild\" on a mobile device, with a peak of 60 FPS and a drop to 20 FPS around 20:00.\n- A man in a dark blue shirt sits at a white table, holding a black smartphone and gesturing with his hands while speaking.\n- The screen shows a mobile game interface with colorful character icons and a map, indicating active gameplay with two hands manipulating the device.\n[540-570s] - A hand holds a smartphone displaying a mobile game with two fingers actively tapping on the screen to control characters.  \n- The game interface shows a battle scene with multiple characters, health bars, and skill icons, indicating active gameplay.  \n- A bar graph overlay appears, listing various phone models with their respective power consumption metrics for the game.\n[570-600s] - A presenter holds a white smartphone, gesturing while speaking.  \n- A cup with a straw and a small object (possibly a phone accessory) rests on the table beside them.  \n- The background features shelves with decorative items, including a helmet and a glowing object.\n[600-630s] - A man in a dark blue shirt holds a smartphone and a small container with a straw, seated at a white table.  \n- Behind him, shelves display various tech gadgets, including helmets and a glowing orange object.  \n- A product listing for \"显卡史书\" (GPU History Book) appears on the right side of the screen, showing multiple graphics cards.", "history_tokens": 953, "history_utf8_bytes": 3844, "recent_frame_times_s": [601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074, 609.0084, 610.0094, 611.0104, 612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0007166666667, 619.0017166666667, 620.0027166666666, 621.0037166666667, 622.0047166666667, 623.0057166666667, 624.0067166666666, 625.0077166666666, 626.0087166666667, 627.0097166666667, 628.0107166666667, 629.0117166666666, 630.0127166666666], "recent_frames_sha256": "e058d0388f2f2534e72c94f73b1c5f16eee6bc0b1d045659983d2ad20d0f1c46", "num_recent_frames": 30, "tq": 716681.925635733, "t1": 716689.559747183, "ta": 716689.559747183, "te": 716689.749085339, "first_response_s": 7.6341114500537515, "answer_total_s": 7.823449606075883, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 114, "content_group": "450779ce97a5628c4dc4b86d2aa2810df74f1a501e3a73ab5bba6f5dbcd637c9", "question": {"question_id": "sample_114_a1466_q0", "video_id": 114, "video_path": "./videos/sample_114_real.mp4", "annotation_index": 1466, "question_index": 0, "question": "What label is prominently visible on the computer case right now?", "options": ["A. ASUS.", "B. Corsair.", "C. Cooler Master.", "D. NZXT."], "answer": "D", "time_stamp_s": 6, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_114_a1466_q0", "video_id": 114, "time_stamp_s": 6, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "63afa5bd409104d95d4f5f9145baafe21eff928c797a6b9521dec6b0d8d20bd9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0], "recent_frames_sha256": "020acdc05b0fd1daae55010d5fce4f47fd50e13abf4cce3d582067747902fbb4", "num_recent_frames": 7, "tq": 718197.213242719, "t1": 718198.086542919, "ta": 718198.086542919, "te": 718198.12635034, "first_response_s": 0.8733002000954002, "answer_total_s": 0.9131076210178435, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_114_a1466_q0", "video_id": 114, "time_stamp_s": 6, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f90ede19201416d1dbcb457c92368e22c1d9f31a31befbb7543cc5867bdb604e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0], "recent_frames_sha256": "020acdc05b0fd1daae55010d5fce4f47fd50e13abf4cce3d582067747902fbb4", "num_recent_frames": 7, "tq": 717932.526519705, "t1": 717940.798892206, "ta": 717940.798892206, "te": 717941.044356915, "first_response_s": 8.272372501087375, "answer_total_s": 8.517837210092694, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 114, "content_group": "450779ce97a5628c4dc4b86d2aa2810df74f1a501e3a73ab5bba6f5dbcd637c9", "question": {"question_id": "sample_114_a1467_q0", "video_id": 114, "video_path": "./videos/sample_114_real.mp4", "annotation_index": 1467, "question_index": 0, "question": "What label is visible on the memory bank just now?", "options": ["A. Essential.", "B. Major.", "C. Primary.", "D. Crucial."], "answer": "D", "time_stamp_s": 247, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [220, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_114_a1467_q0", "video_id": 114, "time_stamp_s": 247, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e451407975220f3d72f483d91edd244e75445326420fe317098d489161f3963e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0], "recent_frames_sha256": "babaf3ce8b056773b768f7ee1cd8b55ee6c7c22106835806bddfe6e1a6609e5a", "num_recent_frames": 30, "tq": 718198.1469708, "t1": 718208.384130818, "ta": 718208.384130818, "te": 718208.421270709, "first_response_s": 10.237160017946735, "answer_total_s": 10.27429990901146, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_114_a1467_q0", "video_id": 114, "time_stamp_s": 247, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ba443416162722b82ba12887e722a5305d74d886d8559ffcc7e6610639c7ba5d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A person opens a NZXT computer case, revealing internal components with glowing blue lights.  \n- A man in a black shirt gestures toward purple product boxes on a table, likely discussing hardware.  \n- A close-up shows a motherboard with \"GEFORCE RTX\" branding, indicating a graphics card setup.\n[30-60s] - Hands hold a blue Intel Core i5 box, then open it to reveal a CPU in plastic.  \n- CPU is lifted from packaging, showing its metallic surface and \"Intel\" branding.  \n- Performance charts for various CPUs (including i5-13600K) are displayed on screen, with i5-13600K leading in scores.\n[60-90s] - Hands hold a CPU in clear plastic packaging, with a blue box and utility knife nearby.  \n- The motherboard box is opened, revealing the MSI Z690 TOMAHAWK WiFi DDR4 board.  \n- The motherboard is lifted and rotated to display its rear I/O ports, including HDMI, USB, and audio jacks.\n[90-120s] - Hands hold and rotate a black motherboard, showcasing its components.  \n- CPU is lifted from its packaging and positioned over the motherboard’s socket.  \n- Motherboard is placed flat on a wooden surface, with tools and packaging visible nearby.\n[120-150s] - Hands rotate the NZXT Kraken Z53 RGB box, revealing its blue and white design with product imagery.  \n- Box is opened by lifting a flap, exposing internal packaging and contents.  \n- A motherboard and utility knife are visible on the wooden table beside the box.\n[150-180s] - Hands open a blue NZXT Kraken Z33 RGB box, revealing a plastic-wrapped component.  \n- A circular black fan mounting bracket is held up, positioned above a motherboard.  \n- A Corsair Vengeance LPX Pro RAM box is displayed, with hands preparing to open it using a utility knife.\n[180-210s] - Hands hold a black RAM module, showing its dual-channel design and heat spreader.  \n- RAM is positioned above a motherboard with CPU socket and PCIe slots visible.  \n- RAM is inserted into the motherboard’s DIMM slots, aligning with the slot’s edge.\n[210-240s] - Hands hold and rotate an Intel P3 M.2 SSD box above a motherboard.\n- Hands remove the SSD from its transparent plastic packaging.\n- SSD is held and examined, showing its label and M.2 form factor.", "history_tokens": 551, "history_utf8_bytes": 2195, "recent_frame_times_s": [218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0], "recent_frames_sha256": "babaf3ce8b056773b768f7ee1cd8b55ee6c7c22106835806bddfe6e1a6609e5a", "num_recent_frames": 30, "tq": 718010.784773302, "t1": 718016.606865697, "ta": 718016.606865697, "te": 718016.644330794, "first_response_s": 5.822092394926585, "answer_total_s": 5.859557491960004, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 114, "content_group": "450779ce97a5628c4dc4b86d2aa2810df74f1a501e3a73ab5bba6f5dbcd637c9", "question": {"question_id": "sample_114_a1468_q0", "video_id": 114, "video_path": "./videos/sample_114_real.mp4", "annotation_index": 1468, "question_index": 0, "question": "Which brand name appears on the black fans inside the computer case right now?", "options": ["A. Corsair.", "B. Cooler Master.", "C. Thermaltake.", "D. NZXT."], "answer": "D", "time_stamp_s": 459, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [440, 460], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_114_a1468_q0", "video_id": 114, "time_stamp_s": 459, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8cefcf42e26a524adf3c79cd30cfa0893a58eea358793d942e15a3078b380b6f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [430.0, 431.0, 432.0, 433.0, 434.0, 435.0, 436.0, 437.0, 438.0, 439.0, 440.0, 441.0, 442.0, 443.0, 444.0, 445.0, 446.0, 447.0, 448.0, 449.0, 450.0, 451.0, 452.0, 453.0, 454.0, 455.0, 456.0, 457.0, 458.0, 459.0], "recent_frames_sha256": "58da2da717cc408f0b8abde1f3bf1e7731d97b40dd5bcc916789bd7a7ad95848", "num_recent_frames": 30, "tq": 718208.438588388, "t1": 718217.329653284, "ta": 718217.329653284, "te": 718217.371909578, "first_response_s": 8.89106489601545, "answer_total_s": 8.93332118995022, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_114_a1468_q0", "video_id": 114, "time_stamp_s": 459, "ground_truth": "D", "raw_output": "D. NZXT.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "24279d89e238e1bf84158b638cfa2aa162431c6b1ab2fdb2b265d0233acd9932", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Hands hold a blue Intel Core i5 box, then open it to reveal a CPU in plastic.  \n- CPU is lifted from packaging, showing its metallic surface and \"Intel\" branding.  \n- Performance charts for various CPUs (including i5-13600K) are displayed on screen, with i5-13600K leading in scores.\n[60-90s] - Hands hold a CPU in clear plastic packaging, with a blue box and utility knife nearby.  \n- The motherboard box is opened, revealing the MSI Z690 TOMAHAWK WiFi DDR4 board.  \n- The motherboard is lifted and rotated to display its rear I/O ports, including HDMI, USB, and audio jacks.\n[90-120s] - Hands hold and rotate a black motherboard, showcasing its components.  \n- CPU is lifted from its packaging and positioned over the motherboard’s socket.  \n- Motherboard is placed flat on a wooden surface, with tools and packaging visible nearby.\n[120-150s] - Hands rotate the NZXT Kraken Z53 RGB box, revealing its blue and white design with product imagery.  \n- Box is opened by lifting a flap, exposing internal packaging and contents.  \n- A motherboard and utility knife are visible on the wooden table beside the box.\n[150-180s] - Hands open a blue NZXT Kraken Z33 RGB box, revealing a plastic-wrapped component.  \n- A circular black fan mounting bracket is held up, positioned above a motherboard.  \n- A Corsair Vengeance LPX Pro RAM box is displayed, with hands preparing to open it using a utility knife.\n[180-210s] - Hands hold a black RAM module, showing its dual-channel design and heat spreader.  \n- RAM is positioned above a motherboard with CPU socket and PCIe slots visible.  \n- RAM is inserted into the motherboard’s DIMM slots, aligning with the slot’s edge.\n[210-240s] - Hands hold and rotate an Intel P3 M.2 SSD box above a motherboard.\n- Hands remove the SSD from its transparent plastic packaging.\n- SSD is held and examined, showing its label and M.2 form factor.\n[240-270s] - Hands insert RAM stick into motherboard slot, securing it with a tool.  \n- Motherboard is lifted and rotated to show its underside and component layout.  \n- Black computer case is held and positioned, ready for installation.\n[270-300s] - Hands hold black mesh front panel of computer case, pointing to perforated design and side-mounted USB ports.  \n- Person begins to slide panel away from case, revealing internal chassis structure and mounting points.  \n- Panel is partially detached, showing the case’s interior layout including drive bays and cable management areas.\n[300-330s] - Hands hold a black computer case, rotating it to show its mesh back panel and internal fan.  \n- The case is placed on a wooden surface, revealing its interior structure and mounting points.  \n- A small cardboard box labeled \"MS SERIES\" is held up, indicating it contains components for the build.\n[330-360s] - Hands remove a black fan from the PC case's interior, revealing the motherboard and components behind it.  \n- A hand unscrews a component (likely a drive or bracket) from the motherboard area, indicating hardware removal or adjustment.  \n- The scene transitions to a box labeled \"KRAKEN Z53 RGB,\" suggesting the next step involves unboxing or installing a new cooling system.\n[360-390s] - Hands remove a black perforated rear panel from a PC case, revealing internal components.  \n- The case interior shows a motherboard with CPU socket, RAM slots, and drive bays.  \n- A black fan with a cable is picked up, likely for installation.\n[390-420s] - Hands hold and manipulate a small black component, likely a GPU bracket or mounting piece, over a wooden surface.  \n- A black NZXT-branded PC case is visible in the background, with its interior partially exposed.  \n- The hands then place the component onto the case’s interior, near the motherboard and cooling system.\n[420-450s] - Hands install a black liquid cooling radiator onto the motherboard, securing it with cables.  \n- A black mesh panel is lifted and positioned over the top of the PC case.  \n- Several boxed AER RGB 2 fans are displayed on the table, indicating upcoming component installation.", "history_tokens": 978, "history_utf8_bytes": 4056, "recent_frame_times_s": [430.0, 431.0, 432.0, 433.0, 434.0, 435.0, 436.0, 437.0, 438.0, 439.0, 440.0, 441.0, 442.0, 443.0, 444.0, 445.0, 446.0, 447.0, 448.0, 449.0, 450.0, 451.0, 452.0, 453.0, 454.0, 455.0, 456.0, 457.0, 458.0, 459.0], "recent_frames_sha256": "58da2da717cc408f0b8abde1f3bf1e7731d97b40dd5bcc916789bd7a7ad95848", "num_recent_frames": 30, "tq": 718072.329742215, "t1": 718079.748833107, "ta": 718079.748833107, "te": 718079.939788476, "first_response_s": 7.41909089195542, "answer_total_s": 7.610046260990202, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 114, "content_group": "450779ce97a5628c4dc4b86d2aa2810df74f1a501e3a73ab5bba6f5dbcd637c9", "question": {"question_id": "sample_114_a1469_q0", "video_id": 114, "video_path": "./videos/sample_114_real.mp4", "annotation_index": 1469, "question_index": 0, "question": "Which CPU's performance are displayed right now?", "options": ["A. RTX 4070 Ti SUPER.", "B. RTX 4090.", "C. RTX 4080.", "D. RTX 4070Ti."], "answer": "D", "time_stamp_s": 680, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [660, 680], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_114_a1469_q0", "video_id": 114, "time_stamp_s": 680, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "46df6a0b546e136a830eb14909648a2a1416f73a9b1fb33e8b8fc4828560f3a0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [651.0, 652.0, 653.0, 654.0, 655.0, 656.0, 657.0, 658.0, 659.0, 660.0, 661.0, 662.0, 663.0, 664.0, 665.0, 666.0, 667.0, 668.0, 669.0, 670.0, 671.0, 672.0, 673.0, 674.0, 675.0, 676.0, 677.0, 678.0, 679.0, 680.0], "recent_frames_sha256": "25a8d5f8cb087c121c7b2db313c1a53c61f007b2ed8684cd6c2d366c989f5ffb", "num_recent_frames": 30, "tq": 718217.393082684, "t1": 718224.372761554, "ta": 718224.372761554, "te": 718224.411837914, "first_response_s": 6.9796788699459285, "answer_total_s": 7.018755230004899, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_114_a1469_q0", "video_id": 114, "time_stamp_s": 680, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "daf579bf23420ebb4fe1c9439c00ce37abed53d2c2545a392b3e27da5215e8cb", "condition_order": ["notes", "recent"], "memory": "[330-360s] - Hands remove a black fan from the PC case's interior, revealing the motherboard and components behind it.  \n- A hand unscrews a component (likely a drive or bracket) from the motherboard area, indicating hardware removal or adjustment.  \n- The scene transitions to a box labeled \"KRAKEN Z53 RGB,\" suggesting the next step involves unboxing or installing a new cooling system.\n[360-390s] - Hands remove a black perforated rear panel from a PC case, revealing internal components.  \n- The case interior shows a motherboard with CPU socket, RAM slots, and drive bays.  \n- A black fan with a cable is picked up, likely for installation.\n[390-420s] - Hands hold and manipulate a small black component, likely a GPU bracket or mounting piece, over a wooden surface.  \n- A black NZXT-branded PC case is visible in the background, with its interior partially exposed.  \n- The hands then place the component onto the case’s interior, near the motherboard and cooling system.\n[420-450s] - Hands install a black liquid cooling radiator onto the motherboard, securing it with cables.  \n- A black mesh panel is lifted and positioned over the top of the PC case.  \n- Several boxed AER RGB 2 fans are displayed on the table, indicating upcoming component installation.\n[450-480s] - Hands hold a packaged \"AER RGB 2\" fan, with multiple identical packages visible on the table.  \n- A black computer case is shown with two installed fans on the rear panel, and hands gesture toward them.  \n- The case is flipped over to reveal its interior, where hands begin manipulating cables and components.\n[480-510s] - Hands hold a yellow box labeled \"Corsair RM850x\" with a black power supply unit image.  \n- A utility knife is placed beside the box on the wooden surface.  \n- The box is opened to reveal the black power supply unit wrapped in plastic.\n[510-540s] - Hands connect black power cables to a black power supply unit (PSU) with visible branding.  \n- PSU is then positioned and inserted into the rear of a black computer case, with a yellow power button being pressed.  \n- Internal view shows the PSU connected to the motherboard and other components, with cables routed neatly inside the case.\n[540-570s] - Hands hold and rotate a Gigabyte GeForce RTX 4070 Ti graphics card box, showing front and side views.  \n- Card is unboxed, revealing a triple-fan design with \"GIGABYTE\" and \"GEFORCE RTX\" branding.  \n- Card's underside displays \"GEFORCE RTX 4070 Ti\" and \"GIGABYTE\" text, with visible cooling fins and connectors.\n[570-600s] - Bar graph displays RTX 4070 Ti vs. 3080 performance in various games, with 3080 showing higher scores in most titles.\n- RTX 4070 Ti vs. 7900 XT comparison graph shows 7900 XT outperforming in most games, with 4070 Ti lagging behind.\n- Power consumption chart compares 4070 Ti and 7900 XT, indicating 4070 Ti uses less power than 7900 XT.\n[600-630s] - A bar chart displays power consumption metrics for three graphics cards: \"Total system power draw @ full\", \"GIGABYTE GeForce RTX 3080 Ti\", \"NVIDIA GeForce RTX 3080\", and \"AMD Radeon RX 6800 XT\".\n- A pair of hands holds a GIGABYTE GeForce RTX graphics card, rotating it to show its front and back, with three fans visible on the front.\n- The hands then insert the graphics card into a computer case, aligning it with the PCIe slot and securing it in place.\n[630-660s] - Hands unscrew and remove a side panel of a black computer case, revealing internal components including a GeForce RTX graphics card.  \n- The case is then fully opened, exposing a well-organized interior with cooling fans and a liquid cooling system.  \n- The case is shown from multiple angles, highlighting its sleek design and illuminated blue LED lighting on fans and tubing.", "history_tokens": 958, "history_utf8_bytes": 3727, "recent_frame_times_s": [651.0, 652.0, 653.0, 654.0, 655.0, 656.0, 657.0, 658.0, 659.0, 660.0, 661.0, 662.0, 663.0, 664.0, 665.0, 666.0, 667.0, 668.0, 669.0, 670.0, 671.0, 672.0, 673.0, 674.0, 675.0, 676.0, 677.0, 678.0, 679.0, 680.0], "recent_frames_sha256": "25a8d5f8cb087c121c7b2db313c1a53c61f007b2ed8684cd6c2d366c989f5ffb", "num_recent_frames": 30, "tq": 718137.97542225, "t1": 718145.089504227, "ta": 718145.089504227, "te": 718145.128240516, "first_response_s": 7.114081977051683, "answer_total_s": 7.152818265953101, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 114, "content_group": "450779ce97a5628c4dc4b86d2aa2810df74f1a501e3a73ab5bba6f5dbcd637c9", "question": {"question_id": "sample_114_a1470_q0", "video_id": 114, "video_path": "./videos/sample_114_real.mp4", "annotation_index": 1470, "question_index": 0, "question": "What words can be seen inside the computer case now", "options": ["A. GPU.", "B. RTX 4070 Ti SUPER.", "C. FAN.", "D. GIGABYTE."], "answer": "D", "time_stamp_s": 856, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [840, 856], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_114_a1470_q0", "video_id": 114, "time_stamp_s": 856, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "848c91f7a94a064b341559e343ee75a8a09a73ac4f6c239249d9d14a02e502b7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [827.0, 828.0, 829.0, 830.0, 831.0, 832.0, 833.0, 834.0, 835.0, 836.0, 837.0, 838.0, 839.0, 840.0, 841.0, 842.0, 843.0, 844.0, 845.0, 846.0, 847.0, 848.0, 849.0, 850.0, 851.0, 852.0, 853.0, 854.0, 855.0, 856.0], "recent_frames_sha256": "27af538187f0aa742eadf4358b3cc67eca283866555968e9f24cb6838e1bed8f", "num_recent_frames": 30, "tq": 718224.426124436, "t1": 718232.424358944, "ta": 718232.424358944, "te": 718232.460224012, "first_response_s": 7.998234507977031, "answer_total_s": 8.034099576063454, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_114_a1470_q0", "video_id": 114, "time_stamp_s": 856, "ground_truth": "D", "raw_output": "D. GIGABYTE.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "80f763a785f2b160f46921da2dfee18bf3783195509011647ce708bb7d16a2a2", "condition_order": ["notes", "recent"], "memory": "[540-570s] - Hands hold and rotate a Gigabyte GeForce RTX 4070 Ti graphics card box, showing front and side views.  \n- Card is unboxed, revealing a triple-fan design with \"GIGABYTE\" and \"GEFORCE RTX\" branding.  \n- Card's underside displays \"GEFORCE RTX 4070 Ti\" and \"GIGABYTE\" text, with visible cooling fins and connectors.\n[570-600s] - Bar graph displays RTX 4070 Ti vs. 3080 performance in various games, with 3080 showing higher scores in most titles.\n- RTX 4070 Ti vs. 7900 XT comparison graph shows 7900 XT outperforming in most games, with 4070 Ti lagging behind.\n- Power consumption chart compares 4070 Ti and 7900 XT, indicating 4070 Ti uses less power than 7900 XT.\n[600-630s] - A bar chart displays power consumption metrics for three graphics cards: \"Total system power draw @ full\", \"GIGABYTE GeForce RTX 3080 Ti\", \"NVIDIA GeForce RTX 3080\", and \"AMD Radeon RX 6800 XT\".\n- A pair of hands holds a GIGABYTE GeForce RTX graphics card, rotating it to show its front and back, with three fans visible on the front.\n- The hands then insert the graphics card into a computer case, aligning it with the PCIe slot and securing it in place.\n[630-660s] - Hands unscrew and remove a side panel of a black computer case, revealing internal components including a GeForce RTX graphics card.  \n- The case is then fully opened, exposing a well-organized interior with cooling fans and a liquid cooling system.  \n- The case is shown from multiple angles, highlighting its sleek design and illuminated blue LED lighting on fans and tubing.\n[660-690s] - Person's hand opens a black computer case, revealing internal components under blue lighting.  \n- The case features a transparent side panel displaying glowing circular LED lights and a \"GIGABYTE\" logo.  \n- Inside, a \"GEFORCE RTX\" graphics card is visible, with cables coiled near the bottom.\n[690-720s] - A large, detailed eye with a dark pupil and orange-brown iris dominates the center of the screen, surrounded by a tunnel of stacked, glowing orange blocks.\n- The scene transitions to a first-person view in a sci-fi environment with a futuristic weapon aimed at a distant, glowing blue structure under a sky with floating islands.\n- A character named \"Frost Marshal\" stands in a large, industrial facility with bright orange lighting, holding a weapon, as the camera pans to show a building exterior with palm trees and a clear blue sky.\n[720-750s] - A gaming PC with a visible \"GIGABYTE\" branded motherboard and \"GEFORCE RTX\" GPU, illuminated by blue LED lighting, is displayed on a table.  \n- Close-up shots reveal a liquid-cooled system with glowing blue tubes and a circular radiator fan, emphasizing the PC's cooling setup.  \n- The video transitions to gameplay footage of Overwatch, showing a player character firing a weapon in a bright, sunlit map environment.\n[750-780s] - A hand removes a fan from a black computer case, revealing its internal components.  \n- The case's side panel is transparent, showing blue-lit cooling fans and a circular water cooling loop.  \n- A screwdriver and fan mounting bracket lie on the table beside the open case.\n[780-810s] - Hand removes a black panel from the PC's rear, revealing internal components and cables.\n- PC case is shown with blue LED lighting around fans and a globe-shaped component inside.\n- On-screen software interface displays RGB color options for customizing the PC's lighting.\n[810-840s] - A computer case with blue LED lighting and a circular display showing \"38\" is visible, with a software interface overlay displaying system metrics and a circular graphic.  \n- The software interface shows a \"38\" temperature reading and a circular graphic that changes from orange to white, indicating a dynamic visual effect.  \n- A person in a black shirt is seen in the background, seated at a desk with a camera setup, while the computer case remains prominently displayed on a table.", "history_tokens": 975, "history_utf8_bytes": 3893, "recent_frame_times_s": [827.0, 828.0, 829.0, 830.0, 831.0, 832.0, 833.0, 834.0, 835.0, 836.0, 837.0, 838.0, 839.0, 840.0, 841.0, 842.0, 843.0, 844.0, 845.0, 846.0, 847.0, 848.0, 849.0, 850.0, 851.0, 852.0, 853.0, 854.0, 855.0, 856.0], "recent_frames_sha256": "27af538187f0aa742eadf4358b3cc67eca283866555968e9f24cb6838e1bed8f", "num_recent_frames": 30, "tq": 718195.881286454, "t1": 718196.919270125, "ta": 718196.919270125, "te": 718197.188089094, "first_response_s": 1.037983670947142, "answer_total_s": 1.306802639970556, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 115, "content_group": "ab32cbc35dceae58fba905d4f44668cd3284912e6a84723f560551096b37b4d7", "question": {"question_id": "sample_115_a127_q0", "video_id": 115, "video_path": "./videos/sample_115_real.mp4", "annotation_index": 127, "question_index": 0, "question": "Which graphics card performs better in this game?", "options": ["A. RTX 4090.", "B. RTX 3080.", "C. RTX 3090.", "D. RTX 4080."], "answer": "A", "time_stamp_s": 13, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_115_a127_q0", "video_id": 115, "time_stamp_s": 13, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "33bb0d6817541ea39a389ad9595187b96daf556f9bca0d2bf19ae3d1873a8383", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0], "recent_frames_sha256": "a86db6d8eb95f933add27d528e8647b911581b74f3ae068a443c14c5f586dd57", "num_recent_frames": 14, "tq": 719208.582156047, "t1": 719209.032103149, "ta": 719209.032103149, "te": 719209.068993317, "first_response_s": 0.44994710199534893, "answer_total_s": 0.4868372699711472, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_115_a127_q0", "video_id": 115, "time_stamp_s": 13, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bf90df5e78860f8869bf13b019cffb3beb574fb1b6d0db77e20914002613a8de", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0], "recent_frames_sha256": "a86db6d8eb95f933add27d528e8647b911581b74f3ae068a443c14c5f586dd57", "num_recent_frames": 14, "tq": 718997.256762637, "t1": 719005.306542453, "ta": 719005.306542453, "te": 719005.34472596, "first_response_s": 8.049779816064984, "answer_total_s": 8.087963323108852, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 115, "content_group": "ab32cbc35dceae58fba905d4f44668cd3284912e6a84723f560551096b37b4d7", "question": {"question_id": "sample_115_a128_q0", "video_id": 115, "video_path": "./videos/sample_115_real.mp4", "annotation_index": 128, "question_index": 0, "question": "What price is shown for the GeForce RTX 4060 Family graphics card right now?", "options": ["A. AUD $545.", "B. AUD $499.", "C. USD $545.", "D. USD $499."], "answer": "A", "time_stamp_s": 163, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [160, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_115_a128_q0", "video_id": 115, "time_stamp_s": 163, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d84046545a1bc1789afee2e436cd81a1ac3d16ef27e8bcbb2ee0caf0186de390", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0], "recent_frames_sha256": "9cdb90593f2511f02e864d0a3ae9c15f4bebb702584b555c19e4a843d91da24f", "num_recent_frames": 30, "tq": 719209.080133713, "t1": 719219.582636201, "ta": 719219.582636201, "te": 719219.619556043, "first_response_s": 10.502502488088794, "answer_total_s": 10.53942232998088, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_115_a128_q0", "video_id": 115, "time_stamp_s": 163, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cfbd67bf077ca64a47c2b739e31e3903e123bd6e4540298cc91d5da3e87df98b", "condition_order": ["notes", "recent"], "memory": "[0-30s] - RTX 4090 graphics card displayed on a stool against purple lighting, then shown in a split-screen comparison with RTX 3090 in a game.  \n- A man holds an RTX 4090 card on a table, with its box beside him, while a bar graph compares performance across games.  \n- Three RTX 4090 cards are arranged side-by-side on a table, with the man gesturing toward them while seated.\n[30-60s] - Man gestures toward two black boxes on a table, one labeled \"RTX 4060 Ti\" and the other \"RTX 4060 Ti\" with a smaller box beside it.  \n- He opens the larger box, revealing a black and silver graphics card with \"RTX 4060 Ti\" printed on it, placed on a black stand with white lines.  \n- The graphics card is shown in detail, with its fan and cooling design visible, alongside multiple identical cards arranged in a row on a white surface.\n[60-90s] - A man in an olive green shirt holds a GeForce RTX 4080 Ti graphics card, gesturing toward it while seated at a wooden table.  \n- The graphics card is positioned centrally on the table, with its box and power supply unit visible nearby.  \n- The man’s hands are actively manipulating the card, showcasing its design and features to the camera.\n[90-120s] - A man holds an NVIDIA GeForce RTX 4090 Ti graphics card, positioned centrally on a wooden table with its box to the right.  \n- A TechPowerUp webpage displays specifications for the RTX 4090 Ti, including its 16GB GDDR6X memory and 160W power draw.  \n- A comparative chart shows the RTX 4090 Ti's performance metrics against other RTX 40-series cards, with the 4090 Ti at the top of the performance scale.\n[120-150s] - A man in an olive shirt holds a black rectangular box labeled \"ROG STRIX\" and opens it to reveal a graphics card with dual fans.  \n- The graphics card is lifted from its foam-lined box, showing its black design and dual cooling fans.  \n- The man places the card on the table, facing the camera, while another similar box rests to his left.", "history_tokens": 523, "history_utf8_bytes": 1950, "recent_frame_times_s": [134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0], "recent_frames_sha256": "9cdb90593f2511f02e864d0a3ae9c15f4bebb702584b555c19e4a843d91da24f", "num_recent_frames": 30, "tq": 719039.950734748, "t1": 719045.821756909, "ta": 719045.821756909, "te": 719045.860518555, "first_response_s": 5.871022160979919, "answer_total_s": 5.909783807001077, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 115, "content_group": "ab32cbc35dceae58fba905d4f44668cd3284912e6a84723f560551096b37b4d7", "question": {"question_id": "sample_115_a129_q0", "video_id": 115, "video_path": "./videos/sample_115_real.mp4", "annotation_index": 129, "question_index": 0, "question": "What graphical setting is added to the right view that is not included in the left view right now?", "options": ["A. Frame Generation.", "B. DLSS 3 Perf.", "C. RT Psycho.", "D. RTX 4090."], "answer": "A", "time_stamp_s": 326, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [320, 340], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_115_a129_q0", "video_id": 115, "time_stamp_s": 326, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5ec6d87a66f24e1c2731dfb64ee8e38d543a4a78daabecec3937434e6969daf8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0], "recent_frames_sha256": "6a93d6f494dbb07305ebc9c874a9acb50a01751f51c412e7558051f14a04e57b", "num_recent_frames": 30, "tq": 719219.632134765, "t1": 719231.105444316, "ta": 719231.105444316, "te": 719231.145711964, "first_response_s": 11.473309551016428, "answer_total_s": 11.513577198958956, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_115_a129_q0", "video_id": 115, "time_stamp_s": 326, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "821b37f50f065665fce00e0b87b680d70862ab6512a424f29f47b93d41ac53f2", "condition_order": ["notes", "recent"], "memory": "[0-30s] - RTX 4090 graphics card displayed on a stool against purple lighting, then shown in a split-screen comparison with RTX 3090 in a game.  \n- A man holds an RTX 4090 card on a table, with its box beside him, while a bar graph compares performance across games.  \n- Three RTX 4090 cards are arranged side-by-side on a table, with the man gesturing toward them while seated.\n[30-60s] - Man gestures toward two black boxes on a table, one labeled \"RTX 4060 Ti\" and the other \"RTX 4060 Ti\" with a smaller box beside it.  \n- He opens the larger box, revealing a black and silver graphics card with \"RTX 4060 Ti\" printed on it, placed on a black stand with white lines.  \n- The graphics card is shown in detail, with its fan and cooling design visible, alongside multiple identical cards arranged in a row on a white surface.\n[60-90s] - A man in an olive green shirt holds a GeForce RTX 4080 Ti graphics card, gesturing toward it while seated at a wooden table.  \n- The graphics card is positioned centrally on the table, with its box and power supply unit visible nearby.  \n- The man’s hands are actively manipulating the card, showcasing its design and features to the camera.\n[90-120s] - A man holds an NVIDIA GeForce RTX 4090 Ti graphics card, positioned centrally on a wooden table with its box to the right.  \n- A TechPowerUp webpage displays specifications for the RTX 4090 Ti, including its 16GB GDDR6X memory and 160W power draw.  \n- A comparative chart shows the RTX 4090 Ti's performance metrics against other RTX 40-series cards, with the 4090 Ti at the top of the performance scale.\n[120-150s] - A man in an olive shirt holds a black rectangular box labeled \"ROG STRIX\" and opens it to reveal a graphics card with dual fans.  \n- The graphics card is lifted from its foam-lined box, showing its black design and dual cooling fans.  \n- The man places the card on the table, facing the camera, while another similar box rests to his left.\n[150-180s] - Hand removes a GPU's cooling fan cover, revealing internal components.  \n- Two GPUs displayed side-by-side: one black with dual fans, the other silver with a distinctive cross-shaped design.  \n- Close-up of a Radeon GPU's rear, showing power connectors and branding.\n[180-210s] - A comparison chart displays GPU specs for RX 6600 and RX 6700 models, highlighting differences in compute units, memory, and power consumption.\n- A man in a green shirt opens black boxes on a table, revealing two graphics cards with dual-fan coolers.\n- The chart shows performance metrics for various games, with RX 6700 generally outperforming RX 6600 across all listed titles.\n[210-240s] - A bar chart displays RTX 4080 vs. 3080 performance metrics for various games, with RTX 4080 showing higher FPS in most cases.\n- A scatter plot compares NVIDIA A6000 vs. 3080 Ti, showing performance points for different games with varying FPS values.\n- The visual layout includes game titles along the x-axis and FPS values on the y-axis, with green dots indicating performance data points.\n[240-270s] - Graph displays NVIDIA RTX 4090 vs. 3090 Ti performance metrics with green dots indicating average FPS across various games.  \n- A man in an olive shirt gestures while holding two graphics cards on a wooden table.  \n- Close-up shot shows a hand removing a black GPU from its box, revealing a gold-colored PCIe slot.\n[270-300s] - A dark screen displays a performance chart for NVIDIA RTX 4060 Ti, showing average FPS across various games with green markers indicating frame rates.\n- A \"LOW VIDEO MEMORY\" error message appears on a blurred background, advising users to lower video quality or close applications, with options to \"OK\" or \"DON'T SHOW MESSAGE AGAIN.\"\n- The error message is prominently displayed in a purple box with a pink button, suggesting a system warning related to insufficient video memory.", "history_tokens": 989, "history_utf8_bytes": 3847, "recent_frame_times_s": [297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0], "recent_frames_sha256": "6a93d6f494dbb07305ebc9c874a9acb50a01751f51c412e7558051f14a04e57b", "num_recent_frames": 30, "tq": 719116.615922369, "t1": 719123.640863854, "ta": 719123.640863854, "te": 719123.682525952, "first_response_s": 7.02494148502592, "answer_total_s": 7.066603583050892, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 115, "content_group": "ab32cbc35dceae58fba905d4f44668cd3284912e6a84723f560551096b37b4d7", "question": {"question_id": "sample_115_a130_q0", "video_id": 115, "video_path": "./videos/sample_115_real.mp4", "annotation_index": 130, "question_index": 0, "question": "What comparison is displayed on the screen right now?", "options": ["A. 4070Ti vs 4070 in various games.", "B. Cooling efficiency of RTX 4070 against previous models.", "C. 4070 in different regions.", "D. 4070."], "answer": "A", "time_stamp_s": 488, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [480, 500], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_115_a130_q0", "video_id": 115, "time_stamp_s": 488, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a5ac3830d03fd4457e0a2afee60e4f90ce37123c8395b77fc0b3dab09131052d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0], "recent_frames_sha256": "f25c0b1c5462e159657079ed31d42a2ca514481e67dbdf673e299e0efca29e49", "num_recent_frames": 30, "tq": 719231.159726723, "t1": 719238.326433088, "ta": 719238.326433088, "te": 719238.365138416, "first_response_s": 7.166706365067512, "answer_total_s": 7.205411692964844, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_115_a130_q0", "video_id": 115, "time_stamp_s": 488, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "79cee8faaa48a7f6889bffb9f81755a703b94a4a3e91c22e1f9b4e6c5d9d40b6", "condition_order": ["notes", "recent"], "memory": "[180-210s] - A comparison chart displays GPU specs for RX 6600 and RX 6700 models, highlighting differences in compute units, memory, and power consumption.\n- A man in a green shirt opens black boxes on a table, revealing two graphics cards with dual-fan coolers.\n- The chart shows performance metrics for various games, with RX 6700 generally outperforming RX 6600 across all listed titles.\n[210-240s] - A bar chart displays RTX 4080 vs. 3080 performance metrics for various games, with RTX 4080 showing higher FPS in most cases.\n- A scatter plot compares NVIDIA A6000 vs. 3080 Ti, showing performance points for different games with varying FPS values.\n- The visual layout includes game titles along the x-axis and FPS values on the y-axis, with green dots indicating performance data points.\n[240-270s] - Graph displays NVIDIA RTX 4090 vs. 3090 Ti performance metrics with green dots indicating average FPS across various games.  \n- A man in an olive shirt gestures while holding two graphics cards on a wooden table.  \n- Close-up shot shows a hand removing a black GPU from its box, revealing a gold-colored PCIe slot.\n[270-300s] - A dark screen displays a performance chart for NVIDIA RTX 4060 Ti, showing average FPS across various games with green markers indicating frame rates.\n- A \"LOW VIDEO MEMORY\" error message appears on a blurred background, advising users to lower video quality or close applications, with options to \"OK\" or \"DON'T SHOW MESSAGE AGAIN.\"\n- The error message is prominently displayed in a purple box with a pink button, suggesting a system warning related to insufficient video memory.\n[300-330s] - A person holds an RTX 4090 Ti GPU, showcasing its black and silver design with a prominent fan.  \n- The GPU is placed on a wooden surface, with a green-lit background enhancing its visual appeal.  \n- The person gestures toward the GPU while speaking, indicating a presentation or review context.\n[330-360s] - Man in olive shirt gestures toward three graphics cards on a table, with one card being lifted to show its design.  \n- A bar graph overlay displays performance metrics for different GPU models in Cyberpunk 2077, including frame rates and percentage gains.  \n- The scene transitions to a top-down view of hands placing a black NVIDIA RTX 4090 card on a wooden surface, flanked by other cards.\n[360-390s] - A bar chart displays relative performance metrics for various games and applications, including Forza Horizon 5, The Witcher 3, Portal with RTX, and Blender, with DLSS + RT enabled.  \n- A graph compares frame generation performance across different GPUs, highlighting NVIDIA RTX 4090 Ti's superiority over RTX 3090 Ti and other models.  \n- A close-up shot shows a GeForce RTX 4060 Ti graphics card, emphasizing its sleek design and branding.\n[390-420s] - A man in a green shirt holds a black graphics card while seated at a table with other components.  \n- An on-screen graph displays performance metrics for the NVIDIA GeForce RTX 3080 Ti, showing average FPS across various games.  \n- The graph includes data points for games like \"Cyberpunk 2077\" and \"Dying Light 2,\" with FPS values plotted against game titles.\n[420-450s] - A man in an olive green shirt gestures while seated at a table with three graphics cards and their boxes.  \n- Close-up shots show hands handling a black NOCTEYE graphics card, highlighting its red LED lighting and metallic design.  \n- A screen displays a Steam survey graph indicating 77% of gamers play at 1080p or less, with text overlay stating \"4 out of 5 most popular GPUs are 60 Hz.\"\n[450-480s] - A hand holds an RTX 4060 Ti graphics card, showcasing its design and branding.  \n- The card is placed on a white surface with green lighting in the background.  \n- A man sits at a table with three graphics cards and their boxes, gesturing toward them.", "history_tokens": 960, "history_utf8_bytes": 3827, "recent_frame_times_s": [459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0], "recent_frames_sha256": "f25c0b1c5462e159657079ed31d42a2ca514481e67dbdf673e299e0efca29e49", "num_recent_frames": 30, "tq": 719171.295270275, "t1": 719178.228163334, "ta": 719178.228163334, "te": 719178.267583976, "first_response_s": 6.932893058983609, "answer_total_s": 6.972313701058738, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 115, "content_group": "ab32cbc35dceae58fba905d4f44668cd3284912e6a84723f560551096b37b4d7", "question": {"question_id": "sample_115_a131_q0", "video_id": 115, "video_path": "./videos/sample_115_real.mp4", "annotation_index": 131, "question_index": 0, "question": "What is the message printed on the box underneath the GeForce RTX graphics card right now?", "options": ["A. INSPIRED BY GAMERS, BUILT BY NVIDIA.", "B. DESIGNED FOR GAMERS, MADE BY NVIDIA.", "C. CREATED FOR GAMERS, MADE BY NVIDIA.", "D. DESIGNED FOR GAMERS, BUILT BY NVIDIA."], "answer": "A", "time_stamp_s": 580, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [580, 586], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_115_a131_q0", "video_id": 115, "time_stamp_s": 580, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "97bc18a33c72b487171fc90f54e8609daad0166fb221784dd46172cdcf9468ca", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0, 561.0, 562.0, 563.0, 564.0, 565.0, 566.0, 567.0, 568.0, 569.0, 570.0, 571.0, 572.0, 573.0, 574.0, 575.0, 576.0, 577.0, 578.0, 579.0, 580.0], "recent_frames_sha256": "b30c71fe6f3818f21a930174b6920087f43ff543fcfcea7e20acfa4674d0bbe6", "num_recent_frames": 30, "tq": 719238.376488581, "t1": 719250.523404462, "ta": 719250.523404462, "te": 719250.561332177, "first_response_s": 12.146915881079622, "answer_total_s": 12.184843596071005, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_115_a131_q0", "video_id": 115, "time_stamp_s": 580, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bb63026ba1bdf4b1a7d9233da4fc6ca76fe76fc9b70002c1c48e06ec41ad5e52", "condition_order": ["notes", "recent"], "memory": "[240-270s] - Graph displays NVIDIA RTX 4090 vs. 3090 Ti performance metrics with green dots indicating average FPS across various games.  \n- A man in an olive shirt gestures while holding two graphics cards on a wooden table.  \n- Close-up shot shows a hand removing a black GPU from its box, revealing a gold-colored PCIe slot.\n[270-300s] - A dark screen displays a performance chart for NVIDIA RTX 4060 Ti, showing average FPS across various games with green markers indicating frame rates.\n- A \"LOW VIDEO MEMORY\" error message appears on a blurred background, advising users to lower video quality or close applications, with options to \"OK\" or \"DON'T SHOW MESSAGE AGAIN.\"\n- The error message is prominently displayed in a purple box with a pink button, suggesting a system warning related to insufficient video memory.\n[300-330s] - A person holds an RTX 4090 Ti GPU, showcasing its black and silver design with a prominent fan.  \n- The GPU is placed on a wooden surface, with a green-lit background enhancing its visual appeal.  \n- The person gestures toward the GPU while speaking, indicating a presentation or review context.\n[330-360s] - Man in olive shirt gestures toward three graphics cards on a table, with one card being lifted to show its design.  \n- A bar graph overlay displays performance metrics for different GPU models in Cyberpunk 2077, including frame rates and percentage gains.  \n- The scene transitions to a top-down view of hands placing a black NVIDIA RTX 4090 card on a wooden surface, flanked by other cards.\n[360-390s] - A bar chart displays relative performance metrics for various games and applications, including Forza Horizon 5, The Witcher 3, Portal with RTX, and Blender, with DLSS + RT enabled.  \n- A graph compares frame generation performance across different GPUs, highlighting NVIDIA RTX 4090 Ti's superiority over RTX 3090 Ti and other models.  \n- A close-up shot shows a GeForce RTX 4060 Ti graphics card, emphasizing its sleek design and branding.\n[390-420s] - A man in a green shirt holds a black graphics card while seated at a table with other components.  \n- An on-screen graph displays performance metrics for the NVIDIA GeForce RTX 3080 Ti, showing average FPS across various games.  \n- The graph includes data points for games like \"Cyberpunk 2077\" and \"Dying Light 2,\" with FPS values plotted against game titles.\n[420-450s] - A man in an olive green shirt gestures while seated at a table with three graphics cards and their boxes.  \n- Close-up shots show hands handling a black NOCTEYE graphics card, highlighting its red LED lighting and metallic design.  \n- A screen displays a Steam survey graph indicating 77% of gamers play at 1080p or less, with text overlay stating \"4 out of 5 most popular GPUs are 60 Hz.\"\n[450-480s] - A hand holds an RTX 4060 Ti graphics card, showcasing its design and branding.  \n- The card is placed on a white surface with green lighting in the background.  \n- A man sits at a table with three graphics cards and their boxes, gesturing toward them.\n[480-510s] - Man in olive shirt gestures toward three graphics card boxes on a wooden table.  \n- Close-up shows hands lifting a black \"GIGABYTE\" graphics card from its box, revealing its dual-fan design.  \n- The man continues speaking while gesturing between the three boxes, including one labeled \"RTX 4070\".\n[510-540s] - Man in olive shirt gestures toward four graphics card boxes on a wooden table.  \n- On-screen graphics show performance charts for \"PC Gaming 2020\" and \"F1 22\" with bar graphs comparing GPU models.  \n- A close-up shot displays two physical graphics cards on the table, one with black fans and another with white fans.\n[540-570s] - Man gestures toward four black boxes on a table, likely containing graphics cards.  \n- Close-up shot of a black NVIDIA RTX 3060 graphics card with orange accents.  \n- eBay search results display multiple RTX 3060 graphics cards with varying prices and seller ratings.", "history_tokens": 985, "history_utf8_bytes": 3953, "recent_frame_times_s": [551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0, 561.0, 562.0, 563.0, 564.0, 565.0, 566.0, 567.0, 568.0, 569.0, 570.0, 571.0, 572.0, 573.0, 574.0, 575.0, 576.0, 577.0, 578.0, 579.0, 580.0], "recent_frames_sha256": "b30c71fe6f3818f21a930174b6920087f43ff543fcfcea7e20acfa4674d0bbe6", "num_recent_frames": 30, "tq": 719206.667600985, "t1": 719208.500523847, "ta": 719208.500523847, "te": 719208.542483767, "first_response_s": 1.8329228619113564, "answer_total_s": 1.874882781994529, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 116, "content_group": "c5ae8a8f58fc4d598d7582058618c24a0a4a855998fad00758cbff5e74c6ec53", "question": {"question_id": "sample_116_a685_q0", "video_id": 116, "video_path": "./videos/sample_116_real.mp4", "annotation_index": 685, "question_index": 0, "question": "What action are the hands performing right now?", "options": ["A. Positioning the graphics card inside the case.", "B. Lifting a black mesh panel.", "C. Installing a light olive green t-shirt.", "D. Talking at a white table."], "answer": "A", "time_stamp_s": 15, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_116_a685_q0", "video_id": 116, "time_stamp_s": 15, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "297e01f583dce33e5b8d487ea38dddb8865a7bdba191aa1a393d542916654d13", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0], "recent_frames_sha256": "ccef731e886f53196b9fe38c725553520bcae8fcf43d3b40837a03a160dc4d31", "num_recent_frames": 16, "tq": 718767.210945706, "t1": 718768.205037737, "ta": 718768.205037737, "te": 718768.244618101, "first_response_s": 0.9940920310327783, "answer_total_s": 1.033672395045869, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_116_a685_q0", "video_id": 116, "time_stamp_s": 15, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "58ede890960b0e8c5ff2ee378de1feac5006e617262408f5614eb432509eec96", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0], "recent_frames_sha256": "ccef731e886f53196b9fe38c725553520bcae8fcf43d3b40837a03a160dc4d31", "num_recent_frames": 16, "tq": 718574.731834656, "t1": 718581.573959082, "ta": 718581.573959082, "te": 718581.611786722, "first_response_s": 6.842124426038936, "answer_total_s": 6.879952065995894, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 116, "content_group": "c5ae8a8f58fc4d598d7582058618c24a0a4a855998fad00758cbff5e74c6ec53", "question": {"question_id": "sample_116_a686_q0", "video_id": 116, "video_path": "./videos/sample_116_real.mp4", "annotation_index": 686, "question_index": 0, "question": "Which logo is illuminated in white on the dark mesh panel right now?", "options": ["A. GEFORCE GT.", "B. GTX ROG.", "C. GEFORCE RTX.", "D. GEFORCE ROG."], "answer": "C", "time_stamp_s": 183, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [180, 200], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_116_a686_q0", "video_id": 116, "time_stamp_s": 183, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "966f52ac402fa52ff545608ae642fa5a5594b15616c603e9905e621f2b705c0b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0], "recent_frames_sha256": "042cc62cd2a09eef4bcf470fdf91f02de1f876772eaf1d7bd67b8ecc5deeb636", "num_recent_frames": 30, "tq": 718768.274229758, "t1": 718779.456426325, "ta": 718779.456426325, "te": 718779.494961618, "first_response_s": 11.182196567067876, "answer_total_s": 11.220731860026717, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_116_a686_q0", "video_id": 116, "time_stamp_s": 183, "ground_truth": "C", "raw_output": "C. GEFORCE RTX.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "e04f23dffb7bc05daee20a4412c60201bb3efa5dfae1d267f94baa683fad8aae", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a green t-shirt sits at a white table with a black graphics card beside him, speaking to the camera.  \n- Hands are shown installing a black water cooling block into a PC case, followed by attaching two black fans to the case's front panel.  \n- Two PC cases are displayed side-by-side on a white surface: one black with blue internal lighting and the other silver with a mesh front panel.\n[30-60s] - Man in olive shirt gestures while seated at white table with black PC component beside him.  \n- Close-up of black PC case front panel showing ports under purple lighting.  \n- Hands hold open PC case, revealing internal components and motherboard layout.\n[60-90s] - Man in olive shirt gestures while seated at white table with graphics card on table.  \n- Graphics card is black with three fans, held and rotated for display.  \n- Scene transitions to hands installing components into a black PC case.\n[90-120s] - A man in a green shirt sits at a white table, gesturing while speaking, with a black GeForce RTX graphics card on the table beside him.  \n- The scene transitions to a black computer case with a transparent side panel, showcasing internal blue-lit fans and components.  \n- The case is positioned on a white surface, with the lighting highlighting its sleek design and internal illumination.\n[120-150s] - Text overlay lists advantages of ATX form factor, including memory support, liquid cooling, part pricing, and PCIe slot availability.\n- Close-up shot shows a black radiator with circular vents and a logo, mounted inside a computer chassis.\n- Wide shot displays a tall, transparent computer case on a white surface, with yellow and blue lighting in the background.\n[150-180s] - A hand interacts with a black computer case, opening its side panel to reveal internal components.  \n- The case features a transparent side panel with an illuminated \"NVIDIA\" logo and a glowing orange fan.  \n- The interior shows a perforated metal panel, a power supply unit, and neatly arranged cables.", "history_tokens": 447, "history_utf8_bytes": 2012, "recent_frame_times_s": [154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0], "recent_frames_sha256": "042cc62cd2a09eef4bcf470fdf91f02de1f876772eaf1d7bd67b8ecc5deeb636", "num_recent_frames": 30, "tq": 718630.825781378, "t1": 718638.135959571, "ta": 718638.135959571, "te": 718638.501530116, "first_response_s": 7.310178193030879, "answer_total_s": 7.6757487379945815, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 116, "content_group": "c5ae8a8f58fc4d598d7582058618c24a0a4a855998fad00758cbff5e74c6ec53", "question": {"question_id": "sample_116_a687_q0", "video_id": 116, "video_path": "./videos/sample_116_real.mp4", "annotation_index": 687, "question_index": 0, "question": "What color is the light glowing from one of the components right now?", "options": ["A. Red.", "B. Green.", "C. Blue.", "D. Yellow."], "answer": "C", "time_stamp_s": 385, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [360, 380], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_116_a687_q0", "video_id": 116, "time_stamp_s": 385, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a7381dc8ef2b11d574d566ac51831869a33c79f99fb0b3598aca0c31d62aa737", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0], "recent_frames_sha256": "409f92ac8d419921bc2beb2c6eec50809094b2b8da3a08908d5786a3ad715a0d", "num_recent_frames": 30, "tq": 718779.515985418, "t1": 718794.066454276, "ta": 718794.066454276, "te": 718794.107435015, "first_response_s": 14.550468857982196, "answer_total_s": 14.591449597035535, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_116_a687_q0", "video_id": 116, "time_stamp_s": 385, "ground_truth": "C", "raw_output": "C. Blue.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "80eedcb874a90e937f093f7a98550caafbea9ac15adb1c4dc12c1e2526a33825", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a green t-shirt sits at a white table with a black graphics card beside him, speaking to the camera.  \n- Hands are shown installing a black water cooling block into a PC case, followed by attaching two black fans to the case's front panel.  \n- Two PC cases are displayed side-by-side on a white surface: one black with blue internal lighting and the other silver with a mesh front panel.\n[30-60s] - Man in olive shirt gestures while seated at white table with black PC component beside him.  \n- Close-up of black PC case front panel showing ports under purple lighting.  \n- Hands hold open PC case, revealing internal components and motherboard layout.\n[60-90s] - Man in olive shirt gestures while seated at white table with graphics card on table.  \n- Graphics card is black with three fans, held and rotated for display.  \n- Scene transitions to hands installing components into a black PC case.\n[90-120s] - A man in a green shirt sits at a white table, gesturing while speaking, with a black GeForce RTX graphics card on the table beside him.  \n- The scene transitions to a black computer case with a transparent side panel, showcasing internal blue-lit fans and components.  \n- The case is positioned on a white surface, with the lighting highlighting its sleek design and internal illumination.\n[120-150s] - Text overlay lists advantages of ATX form factor, including memory support, liquid cooling, part pricing, and PCIe slot availability.\n- Close-up shot shows a black radiator with circular vents and a logo, mounted inside a computer chassis.\n- Wide shot displays a tall, transparent computer case on a white surface, with yellow and blue lighting in the background.\n[150-180s] - A hand interacts with a black computer case, opening its side panel to reveal internal components.  \n- The case features a transparent side panel with an illuminated \"NVIDIA\" logo and a glowing orange fan.  \n- The interior shows a perforated metal panel, a power supply unit, and neatly arranged cables.\n[180-210s] - Hands install a motherboard into a black computer case, aligning it with mounting points.  \n- A graphics card with three fans is inserted into the case, positioned above the motherboard.  \n- A thermal performance chart for NVIDIA RTX 30-series GPUs is displayed, showing temperature data for various models.\n[210-240s] - A black computer case with a transparent side panel is shown on a table, illuminated by blue lighting.  \n- A hand removes the top panel of the case, revealing internal components and a fan.  \n- A man in a green shirt sits at a table beside the case, gesturing toward it while speaking.\n[240-270s] - Man in olive shirt gestures toward silver PC case on white table.  \n- White Xbox controller placed on black textured surface with green background.  \n- PC case interior reveals GeForce RTX graphics card and cooling system.\n[270-300s] - Hands install a black fan into a PC case, aligning it with mounting points.  \n- A large graphics card with three fans is lifted and positioned for installation.  \n- The assembled PC case is shown with RGB-lit fans and a mouse nearby, indicating completion.\n[300-330s] - Man in olive shirt gestures toward black PC case on white table.  \n- PC case has transparent side panel revealing internal blue liquid cooling system.  \n- Interior view shows blue tubing, metallic fittings, and a large reservoir with visible pump.\n[330-360s] - Hands use a screwdriver to remove a screw from the side panel of a black computer case.  \n- A clear, blue liquid-filled cooling block with a \"K\" logo is visible inside the case, connected to tubing.  \n- The camera pans to show the internal components, including a fan and blue coolant tubing, as the case is being assembled or disassembled.", "history_tokens": 854, "history_utf8_bytes": 3753, "recent_frame_times_s": [356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0], "recent_frames_sha256": "409f92ac8d419921bc2beb2c6eec50809094b2b8da3a08908d5786a3ad715a0d", "num_recent_frames": 30, "tq": 718680.736512857, "t1": 718687.565771037, "ta": 718687.565771037, "te": 718687.975526645, "first_response_s": 6.829258179990575, "answer_total_s": 7.239013787941076, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 116, "content_group": "c5ae8a8f58fc4d598d7582058618c24a0a4a855998fad00758cbff5e74c6ec53", "question": {"question_id": "sample_116_a688_q0", "video_id": 116, "video_path": "./videos/sample_116_real.mp4", "annotation_index": 688, "question_index": 0, "question": "What brand name is shown on the GPU right now?", "options": ["A. ASUS.", "B. CORSAIR.", "C. MSI.", "D. EVGA."], "answer": "C", "time_stamp_s": 553, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [540, 560], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_116_a688_q0", "video_id": 116, "time_stamp_s": 553, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "34adb4b2e7343a4652349ffec2375cfbafee428cf72b94b40f7671a603fa265d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0], "recent_frames_sha256": "5ab5cfef6d6c6fd3726c9437b47484da2e44a4b9a27c25f4e90d435327a19413", "num_recent_frames": 30, "tq": 718794.117990036, "t1": 718805.135476807, "ta": 718805.135476807, "te": 718805.172921163, "first_response_s": 11.01748677098658, "answer_total_s": 11.0549311270006, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_116_a688_q0", "video_id": 116, "time_stamp_s": 553, "ground_truth": "C", "raw_output": "A. ASUS.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "72a1a713fd315737d7d0303ed509520295b28779235bd85ed16d8d4f966a5241", "condition_order": ["notes", "recent"], "memory": "[120-150s] - Text overlay lists advantages of ATX form factor, including memory support, liquid cooling, part pricing, and PCIe slot availability.\n- Close-up shot shows a black radiator with circular vents and a logo, mounted inside a computer chassis.\n- Wide shot displays a tall, transparent computer case on a white surface, with yellow and blue lighting in the background.\n[150-180s] - A hand interacts with a black computer case, opening its side panel to reveal internal components.  \n- The case features a transparent side panel with an illuminated \"NVIDIA\" logo and a glowing orange fan.  \n- The interior shows a perforated metal panel, a power supply unit, and neatly arranged cables.\n[180-210s] - Hands install a motherboard into a black computer case, aligning it with mounting points.  \n- A graphics card with three fans is inserted into the case, positioned above the motherboard.  \n- A thermal performance chart for NVIDIA RTX 30-series GPUs is displayed, showing temperature data for various models.\n[210-240s] - A black computer case with a transparent side panel is shown on a table, illuminated by blue lighting.  \n- A hand removes the top panel of the case, revealing internal components and a fan.  \n- A man in a green shirt sits at a table beside the case, gesturing toward it while speaking.\n[240-270s] - Man in olive shirt gestures toward silver PC case on white table.  \n- White Xbox controller placed on black textured surface with green background.  \n- PC case interior reveals GeForce RTX graphics card and cooling system.\n[270-300s] - Hands install a black fan into a PC case, aligning it with mounting points.  \n- A large graphics card with three fans is lifted and positioned for installation.  \n- The assembled PC case is shown with RGB-lit fans and a mouse nearby, indicating completion.\n[300-330s] - Man in olive shirt gestures toward black PC case on white table.  \n- PC case has transparent side panel revealing internal blue liquid cooling system.  \n- Interior view shows blue tubing, metallic fittings, and a large reservoir with visible pump.\n[330-360s] - Hands use a screwdriver to remove a screw from the side panel of a black computer case.  \n- A clear, blue liquid-filled cooling block with a \"K\" logo is visible inside the case, connected to tubing.  \n- The camera pans to show the internal components, including a fan and blue coolant tubing, as the case is being assembled or disassembled.\n[360-390s] - A man in a green t-shirt sits at a white table, gesturing toward a black computer case positioned to his left.  \n- The computer case is shown from multiple angles, revealing internal components like fans and a liquid cooling system with blue lighting.  \n- A hand is seen manipulating the case’s interior, adjusting or demonstrating its internal structure and cable management.\n[390-420s] - Man in olive shirt gestures while seated at white table beside black PC case.  \n- PC case shown from rear, revealing internal components including fans, GPU, and cooling system.  \n- Interior view highlights green-lit components, notably an RTX GPU and liquid cooling setup.\n[420-450s] - A black computer case with a visible GPU labeled \"GEFORCE RTX\" is shown in a dimly lit setting.  \n- A thermal performance chart for the RTX 3060 is displayed, showing temperature readings for various games.  \n- A hand points to the rear panel of the case, indicating its ventilation or mounting features.\n[450-480s] - Man in olive shirt gestures toward black PC case on white table.  \n- PC case is transparent, revealing internal components like GPU and cooling fans.  \n- Video transitions to close-up of hands opening the PC case, showing internal hardware.\n[480-510s] - A black PC case with internal RGB lighting is shown from a side angle, revealing its internal components and blue LED illumination.  \n- The case is then opened from the front, exposing the internal hardware and cables, with a hand visible removing the front panel.  \n- Three different PC cases are displayed side by side on a white surface, including a black tower with a mesh front panel and a transparent side panel.\n[510-540s] - Hands remove a black motherboard from its packaging and place it into a PC case.  \n- The case is opened to reveal internal components, including a CPU, RAM, and a power supply unit.  \n- A side panel of the case is shown with RGB lighting visible through the transparent side, and the \"HEXT\" logo is displayed on the front.", "history_tokens": 1023, "history_utf8_bytes": 4453, "recent_frame_times_s": [524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0], "recent_frames_sha256": "5ab5cfef6d6c6fd3726c9437b47484da2e44a4b9a27c25f4e90d435327a19413", "num_recent_frames": 30, "tq": 718734.711623337, "t1": 718735.420999038, "ta": 718735.420999038, "te": 718735.569425869, "first_response_s": 0.709375701029785, "answer_total_s": 0.8578025320312008, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 116, "content_group": "c5ae8a8f58fc4d598d7582058618c24a0a4a855998fad00758cbff5e74c6ec53", "question": {"question_id": "sample_116_a689_q0", "video_id": 116, "video_path": "./videos/sample_116_real.mp4", "annotation_index": 689, "question_index": 0, "question": "What items are beside the computer case right now?", "options": ["A. A screwdriver and mouse.", "B. A pair of pliers and a keyboard.", "C. A keyboard.", "D. A set of cables."], "answer": "A", "time_stamp_s": 661, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [660, 680], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_116_a689_q0", "video_id": 116, "time_stamp_s": 661, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e22f72ab97881ad5b6dc0cb36d04673ee6162cefc0b013a2a34b1fbf74fca33e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [632.0, 633.0, 634.0, 635.0, 636.0, 637.0, 638.0, 639.0, 640.0, 641.0, 642.0, 643.0, 644.0, 645.0, 646.0, 647.0, 648.0, 649.0, 650.0, 651.0, 652.0, 653.0, 654.0, 655.0, 656.0, 657.0, 658.0, 659.0, 660.0, 661.0], "recent_frames_sha256": "8408f869f00d439a129782656565632826e70f3f9b53f0bd2979fc854d23bd13", "num_recent_frames": 30, "tq": 718805.182556648, "t1": 718817.299697634, "ta": 718817.299697634, "te": 718817.337400759, "first_response_s": 12.117140985908918, "answer_total_s": 12.154844110948034, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_116_a689_q0", "video_id": 116, "time_stamp_s": 661, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9b1fb954f6c4367cbdc9b536eaf9c7ac2cf99a281d9c98f89a3a6c774c227b4b", "condition_order": ["notes", "recent"], "memory": "[270-300s] - Hands install a black fan into a PC case, aligning it with mounting points.  \n- A large graphics card with three fans is lifted and positioned for installation.  \n- The assembled PC case is shown with RGB-lit fans and a mouse nearby, indicating completion.\n[300-330s] - Man in olive shirt gestures toward black PC case on white table.  \n- PC case has transparent side panel revealing internal blue liquid cooling system.  \n- Interior view shows blue tubing, metallic fittings, and a large reservoir with visible pump.\n[330-360s] - Hands use a screwdriver to remove a screw from the side panel of a black computer case.  \n- A clear, blue liquid-filled cooling block with a \"K\" logo is visible inside the case, connected to tubing.  \n- The camera pans to show the internal components, including a fan and blue coolant tubing, as the case is being assembled or disassembled.\n[360-390s] - A man in a green t-shirt sits at a white table, gesturing toward a black computer case positioned to his left.  \n- The computer case is shown from multiple angles, revealing internal components like fans and a liquid cooling system with blue lighting.  \n- A hand is seen manipulating the case’s interior, adjusting or demonstrating its internal structure and cable management.\n[390-420s] - Man in olive shirt gestures while seated at white table beside black PC case.  \n- PC case shown from rear, revealing internal components including fans, GPU, and cooling system.  \n- Interior view highlights green-lit components, notably an RTX GPU and liquid cooling setup.\n[420-450s] - A black computer case with a visible GPU labeled \"GEFORCE RTX\" is shown in a dimly lit setting.  \n- A thermal performance chart for the RTX 3060 is displayed, showing temperature readings for various games.  \n- A hand points to the rear panel of the case, indicating its ventilation or mounting features.\n[450-480s] - Man in olive shirt gestures toward black PC case on white table.  \n- PC case is transparent, revealing internal components like GPU and cooling fans.  \n- Video transitions to close-up of hands opening the PC case, showing internal hardware.\n[480-510s] - A black PC case with internal RGB lighting is shown from a side angle, revealing its internal components and blue LED illumination.  \n- The case is then opened from the front, exposing the internal hardware and cables, with a hand visible removing the front panel.  \n- Three different PC cases are displayed side by side on a white surface, including a black tower with a mesh front panel and a transparent side panel.\n[510-540s] - Hands remove a black motherboard from its packaging and place it into a PC case.  \n- The case is opened to reveal internal components, including a CPU, RAM, and a power supply unit.  \n- A side panel of the case is shown with RGB lighting visible through the transparent side, and the \"HEXT\" logo is displayed on the front.\n[540-570s] - A hand holds a black ASUS ROG graphics card, positioning it above a partially assembled PC chassis with screws scattered nearby.  \n- The PC chassis, with visible internal components like a CPU cooler and RAM, is shown from the side with cables connected to its rear.  \n- A close-up reveals a Nixx CPU cooler with RGB lighting, mounted on the motherboard, alongside other RGB-lit components.\n[570-600s] - A black computer case is shown with internal components and RGB lighting visible through its transparent side panel.  \n- Hands lift the case to display its interior, revealing a power supply unit, motherboard, and other hardware.  \n- A man in a green shirt sits at a table beside the case, gesturing toward it while speaking.\n[600-630s] - A hand interacts with a black computer case, adjusting its top panel.  \n- The case features a glowing, colorful vertical strip on its front, likely an LED display.  \n- The case is positioned on a white surface against a plain background.\n[630-660s] - A black computer case with glowing blue arrows on its front panel sits on a desk, positioned in front of a monitor displaying a blue sky.  \n- A hand removes a top-mounted fan assembly from the case, revealing internal components and wiring.  \n- Three different-sized power supply units (T1, A4-H20, M1) are displayed side-by-side with their respective prices and capacities labeled above them.", "history_tokens": 994, "history_utf8_bytes": 4304, "recent_frame_times_s": [632.0, 633.0, 634.0, 635.0, 636.0, 637.0, 638.0, 639.0, 640.0, 641.0, 642.0, 643.0, 644.0, 645.0, 646.0, 647.0, 648.0, 649.0, 650.0, 651.0, 652.0, 653.0, 654.0, 655.0, 656.0, 657.0, 658.0, 659.0, 660.0, 661.0], "recent_frames_sha256": "8408f869f00d439a129782656565632826e70f3f9b53f0bd2979fc854d23bd13", "num_recent_frames": 30, "tq": 718765.369321807, "t1": 718767.124132666, "ta": 718767.124132666, "te": 718767.165838117, "first_response_s": 1.7548108589835465, "answer_total_s": 1.7965163099579513, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 117, "content_group": "5593d24a9070737d22ad923ee7b8cdb30e08916d2ec82ff1a7af511f0dcd9c78", "question": {"question_id": "sample_117_a2238_q0", "video_id": 117, "video_path": "./videos/sample_117_real.mp4", "annotation_index": 2238, "question_index": 0, "question": "What specific text is etched on the graphics card shown right now?", "options": ["A. RTX 3060 Ti.", "B. RTX 4070 Ti.", "C. RTX 4080 SUPER.", "D. RTX 5000 ULTRA."], "answer": "C", "time_stamp_s": 7, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_117_a2238_q0", "video_id": 117, "time_stamp_s": 7, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3ae2cff694fd336567aff6ac470fc5a4ff27fc933d3a8f12f210fbb8ed4e1edd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006], "recent_frames_sha256": "7db80b475138b9ae79efb11d479c3a218f7c14f901a865bed21eb9ed80f6eb69", "num_recent_frames": 7, "tq": 716611.018565584, "t1": 716616.336737922, "ta": 716616.336737922, "te": 716616.373622434, "first_response_s": 5.318172338069417, "answer_total_s": 5.355056850006804, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_117_a2238_q0", "video_id": 117, "time_stamp_s": 7, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "09746c35d6eec10a5197235a4e772f5ddb6d6716216a989d35c7be3756ae8943", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006], "recent_frames_sha256": "7db80b475138b9ae79efb11d479c3a218f7c14f901a865bed21eb9ed80f6eb69", "num_recent_frames": 7, "tq": 716369.316222261, "t1": 716382.222837489, "ta": 716382.222837489, "te": 716382.260556569, "first_response_s": 12.906615227926522, "answer_total_s": 12.944334307918325, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 117, "content_group": "5593d24a9070737d22ad923ee7b8cdb30e08916d2ec82ff1a7af511f0dcd9c78", "question": {"question_id": "sample_117_a2239_q0", "video_id": 117, "video_path": "./videos/sample_117_real.mp4", "annotation_index": 2239, "question_index": 0, "question": "What is the highlighted label on the graphics chip right now?", "options": ["A. AD103-400A1.", "B. AD104-300B1.", "C. TS MC223A2.", "D. AD102-500A3."], "answer": "A", "time_stamp_s": 212, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [200, 220], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_117_a2239_q0", "video_id": 117, "time_stamp_s": 212, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3c5f72676b0684822526a7cde6baae6fe62dfcbaf67a48760a2453e6d956d970", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108], "recent_frames_sha256": "eef3edde1616973fda345f1534f74c4d9ddb5ad0e33472dce90c9a8d30905c2a", "num_recent_frames": 30, "tq": 716616.387612264, "t1": 716624.777529607, "ta": 716624.777529607, "te": 716624.815778621, "first_response_s": 8.389917342923582, "answer_total_s": 8.428166356985457, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_117_a2239_q0", "video_id": 117, "time_stamp_s": 212, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b68f2ea1b1fd97072ea909b99d03d73f5ee33017202e5ab93f12b00a4cc7603c", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a black shirt gestures while seated at a table with three graphics cards displayed beside him.  \n- A close-up shot highlights an RTX 4080 graphics card, showing its branding and design.  \n- An on-screen graphic displays RTX 40 series specifications, including performance metrics and price comparisons, alongside a PC case with green lighting.\n[30-60s] - A table displays RTX 40 series GPU specs, including CUDA cores, memory, and price, with arrows indicating price trends.  \n- A man in a black shirt gestures toward three stacked graphics cards on a table.  \n- A split-screen graphic compares RTX 4080, 4080 SUPER, and 4090 chip architectures and specifications.\n[60-90s] - RTX 4080 SUPER's core count (9772) and memory bandwidth (722 GB/s) are highlighted with green bars, indicating higher specs than RTX 4080.\n- RTX 4090's core count (16384) and memory bandwidth (722 GB/s) are shown, with a green bar for memory bandwidth, suggesting superior performance.\n- The comparison chart displays RTX 4080 SUPER and RTX 4090 side by side, emphasizing their core and memory differences.\n[90-120s] - Three RTX 4080 graphics cards displayed side-by-side, labeled \"Founders Edition,\" \"RTX 4080 Ti,\" and \"RTX 4080,\" with distinct cooling designs and fan configurations.  \n- Close-up shots highlight the RTX 4080 SUPER's sleek black casing, angular design, and dual-fan cooling system, emphasizing its premium build.  \n- Internal circuit board views show the \"Founders Edition\" RTX 4080 SUPER and RTX 4080 side-by-side, revealing similar architecture with slight differences in component layout.\n[120-150s] - Left card: \"RTX 4080 SUPER\" with 11GB VRAM and 2x 8GB GDDR6X memory chips.\n- Right card: \"RTX 4080\" with 13GB VRAM and 3x 8GB GDDR6X memory chips.\n- Green arrow points from left to right, indicating a comparison or upgrade path.\n[150-180s] - RTX 4080 Super and RTX 4080 graphics cards displayed side-by-side, highlighting design differences.  \n- A comparison table shows specifications, with \"最大出力\" (Max Output) highlighted for both models.  \n- The RTX 4080 Super features a larger PCB and more connectors, indicating enhanced capabilities.\n[180-210s] - Two graphics cards labeled \"RTX 4080 SUPER\" and \"RTX 4080\" are displayed side by side, showing their circuit boards with central chips.  \n- The \"RTX 4080 SUPER\" card has a larger, more complex circuit board with additional components compared to the \"RTX 4080\" card.  \n- A close-up of the \"RTX 4080 SUPER\" chip reveals text indicating \"NVIDIA\" and \"ADLA-4080 SUPER\" on its surface.", "history_tokens": 742, "history_utf8_bytes": 2562, "recent_frame_times_s": [182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108], "recent_frames_sha256": "eef3edde1616973fda345f1534f74c4d9ddb5ad0e33472dce90c9a8d30905c2a", "num_recent_frames": 30, "tq": 716441.87039168, "t1": 716448.797322794, "ta": 716448.797322794, "te": 716448.998387333, "first_response_s": 6.926931113936007, "answer_total_s": 7.127995652961545, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 117, "content_group": "5593d24a9070737d22ad923ee7b8cdb30e08916d2ec82ff1a7af511f0dcd9c78", "question": {"question_id": "sample_117_a2240_q0", "video_id": 117, "video_path": "./videos/sample_117_real.mp4", "annotation_index": 2240, "question_index": 0, "question": "What resolution setting is highlighted right now?", "options": ["A. 2560x1440.", "B. 1920x1080.", "C. 3840x2160.", "D. 3200x1800."], "answer": "C", "time_stamp_s": 412, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [400, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_117_a2240_q0", "video_id": 117, "time_stamp_s": 412, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "52f5ba5d134e0f176d7007ec037600d877d8c4d3da649aba7e9d19b22d3268a5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [382.0149666666667, 383.01596666666666, 384.00028333333336, 385.00128333333333, 386.0022833333333, 387.00328333333334, 388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106], "recent_frames_sha256": "0dd4d146bed3ef03c32094bd0799317c567d44bae5e62a074122e750d2cafcc9", "num_recent_frames": 30, "tq": 716624.830401517, "t1": 716635.301797114, "ta": 716635.301797114, "te": 716635.339077505, "first_response_s": 10.471395596978255, "answer_total_s": 10.508675988065079, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_117_a2240_q0", "video_id": 117, "time_stamp_s": 412, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3abcb594eb5503883269333f04cacfa0525163325f1a4220a3bb42ee3446cb2f", "condition_order": ["notes", "recent"], "memory": "[120-150s] - Left card: \"RTX 4080 SUPER\" with 11GB VRAM and 2x 8GB GDDR6X memory chips.\n- Right card: \"RTX 4080\" with 13GB VRAM and 3x 8GB GDDR6X memory chips.\n- Green arrow points from left to right, indicating a comparison or upgrade path.\n[150-180s] - RTX 4080 Super and RTX 4080 graphics cards displayed side-by-side, highlighting design differences.  \n- A comparison table shows specifications, with \"最大出力\" (Max Output) highlighted for both models.  \n- The RTX 4080 Super features a larger PCB and more connectors, indicating enhanced capabilities.\n[180-210s] - Two graphics cards labeled \"RTX 4080 SUPER\" and \"RTX 4080\" are displayed side by side, showing their circuit boards with central chips.  \n- The \"RTX 4080 SUPER\" card has a larger, more complex circuit board with additional components compared to the \"RTX 4080\" card.  \n- A close-up of the \"RTX 4080 SUPER\" chip reveals text indicating \"NVIDIA\" and \"ADLA-4080 SUPER\" on its surface.\n[210-240s] - A green-bordered chip labeled \"RTX 4080 SUPER\" is displayed with \"NVIDIA\" and \"AD104-408A1\" visible on its surface.  \n- A small black box with \"RTX 4080\" and \"4090\" text appears to the right, connected by a green line to the chip.  \n- The chip's label changes to \"NVIDIA RTX 4080 SUPER\" with \"AD104-408A1\" and \"FIND THE FOUNDER'S\" text below, indicating a product\n[240-270s] - Two graphics cards, labeled \"Founders Edition\" for RTX 4080 SUPER and RTX 4080, are shown side-by-side with their respective chipsets highlighted.  \n- The RTX 4080 SUPER features a larger, more complex PCB with 12 VRMs, while the RTX 4080 has 15 VRMs, indicating higher power delivery capability.  \n- The video transitions to show physical cards with three fans each, followed by a top-down view of the PCBs, emphasizing their design differences.\n[270-300s] - A hand uses tweezers to remove a small component from a GPU's heat sink.  \n- Three GeForce RTX graphics cards are displayed on a table, with one card being actively handled.  \n- The cards feature multiple fans and cooling fins, with one card showing red and blue accents.\n[300-330s] - Two graphics cards displayed side-by-side: left is \"RTX 4080 SUPER\" with green connectors, right is \"RTX 4080\" with green connectors.  \n- Both cards show \"18 根\" (18 pins) and \"3 根\" (3 pins) labels beneath them, indicating connector counts.  \n- The cards are positioned on a white surface with a clean, minimalistic background.\n[330-360s] - A black graphics card with \"RTX 4070\" label is shown in a close-up, angled view.  \n- A larger graphics card with three fans and colorful accents (black, red, blue) is displayed next to a smaller, single-fan cooler.  \n- A man in a black shirt sits at a desk, gesturing toward the graphics cards while speaking.\n[360-390s] - Bar graph displays 3DMark Time Spy Extreme scores for RTX 4090, RTX 4080 SUPER, and RTX 4070 SUPER, with RTX 4090 leading at 17446.\n- Bar graph transitions to 3DMark DXR scores, showing RTX 4090 at 137.02, RTX 4080 SUPER at 68.18, and RTX 4070 SUPER at 54.23.\n- A man in a black shirt appears", "history_tokens": 973, "history_utf8_bytes": 3051, "recent_frame_times_s": [382.0149666666667, 383.01596666666666, 384.00028333333336, 385.00128333333333, 386.0022833333333, 387.00328333333334, 388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106], "recent_frames_sha256": "0dd4d146bed3ef03c32094bd0799317c567d44bae5e62a074122e750d2cafcc9", "num_recent_frames": 30, "tq": 716494.38794759, "t1": 716500.375996317, "ta": 716500.375996317, "te": 716500.413976226, "first_response_s": 5.988048727042042, "answer_total_s": 6.026028636028059, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 117, "content_group": "5593d24a9070737d22ad923ee7b8cdb30e08916d2ec82ff1a7af511f0dcd9c78", "question": {"question_id": "sample_117_a2241_q0", "video_id": 117, "video_path": "./videos/sample_117_real.mp4", "annotation_index": 2241, "question_index": 0, "question": "What performance gain does the NVIDIA RTX 4080 SUPER achieve in ray-traced games at 2160P resolution right now?", "options": ["A. +2.93%.", "B. +3.21%.", "C. +3.11%.", "D. -3%."], "answer": "C", "time_stamp_s": 620, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [600, 620], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_117_a2241_q0", "video_id": 117, "time_stamp_s": 620, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "299e47fe06d35c9dd447eb8f8a92e0cce33685b9005d8c1aa65e71da0ba2c135", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074, 609.0084, 610.0094, 611.0104, 612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0007166666667, 619.0017166666667], "recent_frames_sha256": "189dc838a9a12f5a047a4a5e38f64bf7567c150ce995f021f9ca180104dd32ba", "num_recent_frames": 30, "tq": 716635.348879653, "t1": 716644.22991376, "ta": 716644.22991376, "te": 716644.451078873, "first_response_s": 8.881034106947482, "answer_total_s": 9.10219921998214, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_117_a2241_q0", "video_id": 117, "time_stamp_s": 620, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "07ae09e34121b7f9683a8ca9140c9d1719d09bf0f7ae0b101e25b679eae44897", "condition_order": ["notes", "recent"], "memory": "[360-390s] - Bar graph displays 3DMark Time Spy Extreme scores for RTX 4090, RTX 4080 SUPER, and RTX 4070 SUPER, with RTX 4090 leading at 17446.\n- Bar graph transitions to 3DMark DXR scores, showing RTX 4090 at 137.02, RTX 4080 SUPER at 68.18, and RTX 4070 SUPER at 54.23.\n- A man in a black shirt appears\n[390-420s] - A man in a black shirt gestures toward three graphics cards on a white table.  \n- On-screen graphics show CS2 performance benchmarks comparing RTX 4070, 4080 SUPER, and 4090 SUPER.  \n- Performance metrics fluctuate, with RTX 4080 SUPER consistently outperforming the RTX 4070.\n[420-450s] - Bar graph displays frame rates for RTX 4070, 4080 SUPER, and 4090 SUPER, with RTX 4080 SUPER showing +4% improvement over RTX 4070.\n- Right side shows three smaller panels comparing frame rates for each card under different settings, with RTX 4090 SUPER achieving 285 FPS.\n- Graph bars dynamically highlight performance differences, with RTX 4080 SUPER's bar extending to 202 FPS and RTX 4090 SUPER's to 285 FPS\n[450-480s] - Bar chart displays performance comparison for \"赛博朋克2077\" with RTX 4090, RTX 4800 SUPER, and RTX 4070 Ti SUPER cards.\n- Performance metrics show RTX 4090 leading, followed by RTX 4800 SUPER, with RTX 4070 Ti SUPER lagging behind.\n- A red annotation highlights a +2% performance gain for RTX 4800 SUPER over RTX 4070 Ti SUPER.\n[480-510s] - Bar graphs display performance metrics for RTX 4090, RTX 4080 SUPER, and RTX 4070 Ti SUPER across different games, with percentage improvements highlighted.\n- Text overlays indicate specific game titles like \"《赛博朋克2077》\" and \"《赛博朋克2077》\" with performance gains such as \"+3% (FPS)\" and \"+2% (FPS)\".\n- Right side of screen shows detailed GPU specifications and pricing for RTX 4090, RTX 4080 SUPER, and RTX \n[510-540s] - A bar chart displays performance metrics for different GPU models in \"赛博朋克2077\" with numerical values and percentage changes.\n- A presenter sits at a desk with multiple graphics cards, gesturing while speaking.\n- A split-screen shows software interfaces with performance data and a graph, alongside a dark forest scene with glowing objects.\n[540-570s] - Bar graph displays frame rate comparisons for three GPU models: RTX 4090, RTX 4800 SUPER, and RTX 4070 Ti SUPER, with RTX 4800 SUPER showing +4% FPS gain over RTX 4090.\n- Text annotations fluctuate between \"+4% (FPS)\" and \"+2% (FPS)\" near the RTX 4800 SUPER bar, indicating dynamic performance metrics.\n- Right side of screen shows detailed GPU specifications and performance stats for each model, including clock speeds and memory bandwidth.\n[570-600s] - Bar graphs display performance metrics for RTX 4090, RTX 4080 SUPER, and RTX 4080 cards across 1440p and 2160p resolutions.  \n- Performance gains are highlighted with green bars and percentage increases (e.g., +2.93% for 1440p).  \n- A red text overlay indicates \"3% (PS) PS\" for RTX 4080 SUPER at 2160p.", "history_tokens": 965, "history_utf8_bytes": 2944, "recent_frame_times_s": [590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074, 609.0084, 610.0094, 611.0104, 612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0007166666667, 619.0017166666667], "recent_frames_sha256": "189dc838a9a12f5a047a4a5e38f64bf7567c150ce995f021f9ca180104dd32ba", "num_recent_frames": 30, "tq": 716561.783182349, "t1": 716563.388972381, "ta": 716563.388972381, "te": 716563.538593962, "first_response_s": 1.60579003195744, "answer_total_s": 1.7554116129176691, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 117, "content_group": "5593d24a9070737d22ad923ee7b8cdb30e08916d2ec82ff1a7af511f0dcd9c78", "question": {"question_id": "sample_117_a2242_q0", "video_id": 117, "video_path": "./videos/sample_117_real.mp4", "annotation_index": 2242, "question_index": 0, "question": "What is the label on the rightmost graphics card right now?", "options": ["A. GeForce RTX 4090.", "B. GeForce GTX 4090 SUPER.", "C. GeForce RTX 4080.", "D. GTX 4090."], "answer": "C", "time_stamp_s": 763, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [760, 779], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_117_a2242_q0", "video_id": 117, "time_stamp_s": 763, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "524c3ef30a1618a2cf5a65168b7ac5394a6ec684ec470a72f3954bb9772a2c07", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [733.0156166666667, 734.0166166666667, 735.0009333333334, 736.0019333333333, 737.0029333333333, 738.0039333333333, 739.0049333333334, 740.0059333333334, 741.0069333333333, 742.0079333333333, 743.0089333333333, 744.0099333333334, 745.0109333333334, 746.0119333333333, 747.0129333333333, 748.0139333333333, 749.0149333333334, 750.0159333333334, 751.00025, 752.00125, 753.00225, 754.00325, 755.00425, 756.00525, 757.00625, 758.00725, 759.00825, 760.00925, 761.01025, 762.01125], "recent_frames_sha256": "c10d2aaefe995d0cf72426eb0307a012e3f7c613e5c8688ea4a7f313a40ea051", "num_recent_frames": 30, "tq": 716644.471360104, "t1": 716650.681614875, "ta": 716650.681614875, "te": 716650.718986415, "first_response_s": 6.210254770936444, "answer_total_s": 6.247626310912892, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_117_a2242_q0", "video_id": 117, "time_stamp_s": 763, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "20d49ac536ebfd7ec101f2b9c7c9950fc2513526820dca84a625bc6a8e2583e5", "condition_order": ["notes", "recent"], "memory": "[510-540s] - A bar chart displays performance metrics for different GPU models in \"赛博朋克2077\" with numerical values and percentage changes.\n- A presenter sits at a desk with multiple graphics cards, gesturing while speaking.\n- A split-screen shows software interfaces with performance data and a graph, alongside a dark forest scene with glowing objects.\n[540-570s] - Bar graph displays frame rate comparisons for three GPU models: RTX 4090, RTX 4800 SUPER, and RTX 4070 Ti SUPER, with RTX 4800 SUPER showing +4% FPS gain over RTX 4090.\n- Text annotations fluctuate between \"+4% (FPS)\" and \"+2% (FPS)\" near the RTX 4800 SUPER bar, indicating dynamic performance metrics.\n- Right side of screen shows detailed GPU specifications and performance stats for each model, including clock speeds and memory bandwidth.\n[570-600s] - Bar graphs display performance metrics for RTX 4090, RTX 4080 SUPER, and RTX 4080 cards across 1440p and 2160p resolutions.  \n- Performance gains are highlighted with green bars and percentage increases (e.g., +2.93% for 1440p).  \n- A red text overlay indicates \"3% (PS) PS\" for RTX 4080 SUPER at 2160p.\n[600-630s] - A graphic displays RTX 4080 SUPER vs. RTX 4080 and RTX 4090 performance metrics for 1440P and 2160P resolutions, with green bars indicating frame rate gains.  \n- The graphic shows RTX 4080 SUPER outperforming RTX 4080 by 3% at 1440P and 3% at 2160P, and RTX 4090 outperforming RTX 4080 by 20%-40% at\n[630-660s] - A man in a black sweater gestures while seated at a white table, with three graphics cards displayed to his left.  \n- A close-up shot of a black NVIDIA GeForce RTX 3080 graphics card is shown, featuring a single fan and a matte finish.  \n- A graph titled \"3DMark Time Spy 拆机功耗\" displays performance metrics for RTX 3060, RTX 3080 SUPER, and RTX 4090, with data points indicating power consumption over time.\n[660-690s] - A man in a black shirt with a white graphic sits at a white table, gesturing toward three graphics cards stacked on the left.  \n- Behind him, a blue wall features two black shelving units with various tech items.  \n- A bar chart titled \"Stable Diffusion AI 图画测试\" appears on screen, comparing performance metrics across different GPU models.\n[690-720s] - Bar chart displays Stable Diffusion AI rendering performance across multiple GPU models, with NVIDIA RTX 4090 showing highest scores.\n- Man in black shirt gestures toward stacked graphics cards on a white table against a blue backdrop.\n- Game performance metrics (GPU usage, frame rate, temperature) shown in overlay during gameplay, with FPS fluctuating between 173 and 215.\n[720-750s] - Man gestures toward three graphics cards on a white table, with a blue background and shelves behind him.  \n- On-screen graphic displays RTX 40 series specs, including models like RTX 4080, 4090, and 4070, with performance and price data.  \n- A graph titled \"3DMark Time Spy Extreme\" compares performance metrics across RTX 3080, 3090, and RTX 4080/4090 models.", "history_tokens": 892, "history_utf8_bytes": 3002, "recent_frame_times_s": [733.0156166666667, 734.0166166666667, 735.0009333333334, 736.0019333333333, 737.0029333333333, 738.0039333333333, 739.0049333333334, 740.0059333333334, 741.0069333333333, 742.0079333333333, 743.0089333333333, 744.0099333333334, 745.0109333333334, 746.0119333333333, 747.0129333333333, 748.0139333333333, 749.0149333333334, 750.0159333333334, 751.00025, 752.00125, 753.00225, 754.00325, 755.00425, 756.00525, 757.00625, 758.00725, 759.00825, 760.00925, 761.01025, 762.01125], "recent_frames_sha256": "c10d2aaefe995d0cf72426eb0307a012e3f7c613e5c8688ea4a7f313a40ea051", "num_recent_frames": 30, "tq": 716608.491941516, "t1": 716610.687784095, "ta": 716610.687784095, "te": 716610.969059585, "first_response_s": 2.1958425788907334, "answer_total_s": 2.47711806895677, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 118, "content_group": "24f40b416dadabc6161192b99f501d3543a561b7061df8a01ac0fbc24ca9d437", "question": {"question_id": "sample_118_a761_q0", "video_id": 118, "video_path": "./videos/sample_118_real.mp4", "annotation_index": 761, "question_index": 0, "question": "What label is visible on the computer component inside the electronic device right now?", "options": ["A. GEFORCE RTX.", "B. FIRE GTX.", "C. GEFORCE GTX.", "D. G*FORCE GTX."], "answer": "A", "time_stamp_s": 6, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_118_a761_q0", "video_id": 118, "time_stamp_s": 6, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "70896ec7e5b4f2f6600a7f09a0795d4e4e25a04316b928cda60d9cf0036ff5e1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0], "recent_frames_sha256": "0b4cc277f70ee4e62eff58410aa730cf6d8a6d80dae4d7f12337eb68a37acfde", "num_recent_frames": 7, "tq": 715491.948694811, "t1": 715492.549179781, "ta": 715492.549179781, "te": 715492.586781921, "first_response_s": 0.6004849700257182, "answer_total_s": 0.6380871100118384, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_118_a761_q0", "video_id": 118, "time_stamp_s": 6, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "63f64365bb1828f2f3480228ea128221567e05745950e2588dbfac527d695e17", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0], "recent_frames_sha256": "0b4cc277f70ee4e62eff58410aa730cf6d8a6d80dae4d7f12337eb68a37acfde", "num_recent_frames": 7, "tq": 715321.371316375, "t1": 715333.732495421, "ta": 715333.732495421, "te": 715333.939663923, "first_response_s": 12.36117904598359, "answer_total_s": 12.56834754801821, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 118, "content_group": "24f40b416dadabc6161192b99f501d3543a561b7061df8a01ac0fbc24ca9d437", "question": {"question_id": "sample_118_a762_q0", "video_id": 118, "video_path": "./videos/sample_118_real.mp4", "annotation_index": 762, "question_index": 0, "question": "What brand of heatsink is being installed onto the motherboard's CPU right now?", "options": ["A. Noctua.", "B. Cooler Master.", "C. Corsair.", "D. Be Quiet!."], "answer": "B", "time_stamp_s": 167, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [160, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_118_a762_q0", "video_id": 118, "time_stamp_s": 167, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3d9d0086f09e9b8a287ea6581b8290953b34ad8f907c03488952348c459ec115", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0], "recent_frames_sha256": "27965e61d3b682690828d81af917c17892ae7e055c18a53ea83103be793398a0", "num_recent_frames": 30, "tq": 715492.600269294, "t1": 715504.042247013, "ta": 715504.042247013, "te": 715504.07978043, "first_response_s": 11.441977718961425, "answer_total_s": 11.479511135956272, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_118_a762_q0", "video_id": 118, "time_stamp_s": 167, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3de2539c2296165d7189fab77f307549b1627806719f8862c168a7aa5b825f00", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a black shirt holds a blue CPU box, gesturing toward it while standing beside other computer component boxes.  \n- A silver computer case is placed on a wooden table, with a hand reaching toward its side panel.  \n- Hands open a blue CPU box, revealing a small, square CPU chip, then hold it up for display.\n[30-60s] - A hand holds an Intel Core i5 processor, showing its label and blue packaging.  \n- Another hand displays an AMD Ryzen 7 processor box, highlighting its branding and \"AM4\" socket info.  \n- Close-ups show the Ryzen 7 chip mounted on a motherboard with orange lighting, and the Intel chip held against a wooden surface.\n[60-90s] - Hands open a blue box labeled \"Z390-ITX A4\" to reveal a motherboard and a small blue Intel Core i5 chip.  \n- The motherboard is lifted and rotated to display its components, including RAM slots and USB ports.  \n- A hand uses a tool to carefully place the Intel Core i5 chip into the motherboard's CPU socket.\n[90-120s] - A hand holds a blue and silver SSD labeled \"Crucial\" with visible text and a barcode.  \n- The SSD is positioned over a motherboard, with the hand preparing to install it.  \n- The SSD is carefully aligned and inserted into a slot on the motherboard, with a screwdriver used to secure it.\n[120-150s] - Hands remove RAM sticks from their packaging, revealing \"TRENDZ\" branding.  \n- RAM sticks are installed into motherboard slots, with one stick placed first, followed by a second.  \n- A black CPU cooler is held and examined, with its fan and mounting hardware visible.", "history_tokens": 381, "history_utf8_bytes": 1552, "recent_frame_times_s": [138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0], "recent_frames_sha256": "27965e61d3b682690828d81af917c17892ae7e055c18a53ea83103be793398a0", "num_recent_frames": 30, "tq": 715369.171294408, "t1": 715370.45506939, "ta": 715370.45506939, "te": 715370.643393659, "first_response_s": 1.2837749819736928, "answer_total_s": 1.4720992509974167, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 118, "content_group": "24f40b416dadabc6161192b99f501d3543a561b7061df8a01ac0fbc24ca9d437", "question": {"question_id": "sample_118_a763_q0", "video_id": 118, "video_path": "./videos/sample_118_real.mp4", "annotation_index": 763, "question_index": 0, "question": "What product image is shown on the webpage right now?", "options": ["A. White CPU cooler.", "B. Black fan cooler.", "C. RGB lighting.", "D. Transparent case fan."], "answer": "B", "time_stamp_s": 320, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [320, 340], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_118_a763_q0", "video_id": 118, "time_stamp_s": 320, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "65469a63709757c6a2ad2a476cb4fbf6da4da4eae29110351915debd088e39c8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0], "recent_frames_sha256": "27b3e046b2f48ee45864a784fd1615e0e35dcba3b00d58e9bb7cd9b9f9a3e9ff", "num_recent_frames": 30, "tq": 715504.09115297, "t1": 715515.730438744, "ta": 715515.730438744, "te": 715515.767799435, "first_response_s": 11.639285773970187, "answer_total_s": 11.676646464969963, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_118_a763_q0", "video_id": 118, "time_stamp_s": 320, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e9397acb66e182cd6943220c9fd3e69f3d47199a930d247fc8b0f9d4b6ec8b4f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a black shirt holds a blue CPU box, gesturing toward it while standing beside other computer component boxes.  \n- A silver computer case is placed on a wooden table, with a hand reaching toward its side panel.  \n- Hands open a blue CPU box, revealing a small, square CPU chip, then hold it up for display.\n[30-60s] - A hand holds an Intel Core i5 processor, showing its label and blue packaging.  \n- Another hand displays an AMD Ryzen 7 processor box, highlighting its branding and \"AM4\" socket info.  \n- Close-ups show the Ryzen 7 chip mounted on a motherboard with orange lighting, and the Intel chip held against a wooden surface.\n[60-90s] - Hands open a blue box labeled \"Z390-ITX A4\" to reveal a motherboard and a small blue Intel Core i5 chip.  \n- The motherboard is lifted and rotated to display its components, including RAM slots and USB ports.  \n- A hand uses a tool to carefully place the Intel Core i5 chip into the motherboard's CPU socket.\n[90-120s] - A hand holds a blue and silver SSD labeled \"Crucial\" with visible text and a barcode.  \n- The SSD is positioned over a motherboard, with the hand preparing to install it.  \n- The SSD is carefully aligned and inserted into a slot on the motherboard, with a screwdriver used to secure it.\n[120-150s] - Hands remove RAM sticks from their packaging, revealing \"TRENDZ\" branding.  \n- RAM sticks are installed into motherboard slots, with one stick placed first, followed by a second.  \n- A black CPU cooler is held and examined, with its fan and mounting hardware visible.\n[150-180s] - Hands place CPU cooler onto motherboard, aligning it with the socket.  \n- Cooler is secured with screws using a screwdriver, then positioned over the CPU.  \n- White computer case is lifted and placed on the table, showing its interior and ventilation design.\n[180-210s] - Hands open a white computer case, revealing internal mounting brackets and cables.  \n- A screwdriver is used to remove a side panel, exposing the case's interior structure.  \n- A cardboard box labeled \"ASUS ROG STRIX\" is placed beside the case, suggesting component packaging.\n[210-240s] - Hands manipulate a small black component near the motherboard area inside an open white computer case.  \n- A screwdriver is used to adjust or secure a component on the case’s rear panel, near the power supply.  \n- The case’s interior is partially assembled, with cables and a cooling system visible, and the user handles a black cable near the motherboard.\n[240-270s] - Hands remove plastic wrap from a Corsair SP750 power supply box.\n- Power supply unit is extracted from its packaging and connected to the computer case's rear panel.\n- Cables are routed and secured inside the case, with attention to cable management and placement near the motherboard.\n[270-300s] - Hands adjust black cooling fan and cable connections inside white PC case.  \n- Person repositions motherboard and CPU cooler assembly near case’s rear panel.  \n- PC case is lifted slightly, revealing internal components and wiring layout.", "history_tokens": 718, "history_utf8_bytes": 3041, "recent_frame_times_s": [291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0], "recent_frames_sha256": "27b3e046b2f48ee45864a784fd1615e0e35dcba3b00d58e9bb7cd9b9f9a3e9ff", "num_recent_frames": 30, "tq": 715410.027495805, "t1": 715416.962732609, "ta": 715416.962732609, "te": 715417.000175803, "first_response_s": 6.935236803954467, "answer_total_s": 6.972679997910745, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 118, "content_group": "24f40b416dadabc6161192b99f501d3543a561b7061df8a01ac0fbc24ca9d437", "question": {"question_id": "sample_118_a764_q0", "video_id": 118, "video_path": "./videos/sample_118_real.mp4", "annotation_index": 764, "question_index": 0, "question": "What setting is being selected in the voltage settings interface right now?", "options": ["A. Auto Mode.", "B. Fixed Mode.", "C. Offset Mode.", "D. Manual Mode."], "answer": "C", "time_stamp_s": 498, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [480, 500], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_118_a764_q0", "video_id": 118, "time_stamp_s": 498, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ca01579ed273b88dcf98812ae306ab098beae784a2aa510eb4256ad7c4b33c90", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0], "recent_frames_sha256": "5cd786de9c2614515019f7396d506aa2cb8fafd498d94449ea17c77d38cf139d", "num_recent_frames": 30, "tq": 715515.781134539, "t1": 715528.066299407, "ta": 715528.066299407, "te": 715528.10475253, "first_response_s": 12.285164867993444, "answer_total_s": 12.323617990943603, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_118_a764_q0", "video_id": 118, "time_stamp_s": 498, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1b6a7fb18fb3adef0dbc69df7737266caf6ba6dc8ba4027da4b56ad67e260b99", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Hands open a blue box labeled \"Z390-ITX A4\" to reveal a motherboard and a small blue Intel Core i5 chip.  \n- The motherboard is lifted and rotated to display its components, including RAM slots and USB ports.  \n- A hand uses a tool to carefully place the Intel Core i5 chip into the motherboard's CPU socket.\n[90-120s] - A hand holds a blue and silver SSD labeled \"Crucial\" with visible text and a barcode.  \n- The SSD is positioned over a motherboard, with the hand preparing to install it.  \n- The SSD is carefully aligned and inserted into a slot on the motherboard, with a screwdriver used to secure it.\n[120-150s] - Hands remove RAM sticks from their packaging, revealing \"TRENDZ\" branding.  \n- RAM sticks are installed into motherboard slots, with one stick placed first, followed by a second.  \n- A black CPU cooler is held and examined, with its fan and mounting hardware visible.\n[150-180s] - Hands place CPU cooler onto motherboard, aligning it with the socket.  \n- Cooler is secured with screws using a screwdriver, then positioned over the CPU.  \n- White computer case is lifted and placed on the table, showing its interior and ventilation design.\n[180-210s] - Hands open a white computer case, revealing internal mounting brackets and cables.  \n- A screwdriver is used to remove a side panel, exposing the case's interior structure.  \n- A cardboard box labeled \"ASUS ROG STRIX\" is placed beside the case, suggesting component packaging.\n[210-240s] - Hands manipulate a small black component near the motherboard area inside an open white computer case.  \n- A screwdriver is used to adjust or secure a component on the case’s rear panel, near the power supply.  \n- The case’s interior is partially assembled, with cables and a cooling system visible, and the user handles a black cable near the motherboard.\n[240-270s] - Hands remove plastic wrap from a Corsair SP750 power supply box.\n- Power supply unit is extracted from its packaging and connected to the computer case's rear panel.\n- Cables are routed and secured inside the case, with attention to cable management and placement near the motherboard.\n[270-300s] - Hands adjust black cooling fan and cable connections inside white PC case.  \n- Person repositions motherboard and CPU cooler assembly near case’s rear panel.  \n- PC case is lifted slightly, revealing internal components and wiring layout.\n[300-330s] - Hands position a black Cooler Master fan into the white computer case's front panel area.  \n- A black power cable is routed and secured near the fan's mounting point.  \n- The case's interior shows a partially assembled system with a motherboard, CPU cooler, and other components.\n[330-360s] - Person removes side panel of white computer case, revealing internal components and cables.  \n- Person holds and displays a black GeForce RTX 3080 graphics card box, then opens it to reveal the card.  \n- Two GeForce RTX 3080 cards are held side-by-side on a wooden surface, showing their design and cooling fans.\n[360-390s] - Hands hold and rotate an RTX 3090 graphics card, showcasing its design and fan.  \n- Card is positioned over an open computer case, preparing for installation.  \n- Price listings for RTX 3090 models are displayed on a screen, indicating retail options.\n[390-420s] - A hand holds a black power cable near a white PC case with internal components visible.  \n- The PC case is then closed and placed on a wooden table, showing its front perforated panel.  \n- A monitor displays a game, with a hand on a mousepad beside the PC, indicating setup or use.\n[420-450s] - A desktop monitor displays a Windows update progress bar with a blue background and green progress indicator.  \n- A white computer case with visible internal components is positioned to the right of the monitor.  \n- A pop-up window appears on the screen, prompting the user to \"Click here to install\" a driver update.\n[450-480s] - A software interface displays a \"Set Smart\" dialog box with options for configuring fan curves, including a \"Save\" button.  \n- The main dashboard shows multiple fan control panels with real-time data like RPM and temperature, alongside a graph for curve adjustments.  \n- The user navigates through the interface, transitioning from the fan control dashboard to a live gaming setup with a monitor and PC case visible.", "history_tokens": 1020, "history_utf8_bytes": 4328, "recent_frame_times_s": [469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0], "recent_frames_sha256": "5cd786de9c2614515019f7396d506aa2cb8fafd498d94449ea17c77d38cf139d", "num_recent_frames": 30, "tq": 715461.41681077, "t1": 715468.17711533, "ta": 715468.17711533, "te": 715468.215849514, "first_response_s": 6.760304559953511, "answer_total_s": 6.799038743949495, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 118, "content_group": "24f40b416dadabc6161192b99f501d3543a561b7061df8a01ac0fbc24ca9d437", "question": {"question_id": "sample_118_a765_q0", "video_id": 118, "video_path": "./videos/sample_118_real.mp4", "annotation_index": 765, "question_index": 0, "question": "What hardware performance metric is visible at the top of the screen right now?", "options": ["A. CPU clock speed.", "B. Temperature, power, framerate for cpu and gpu.", "C. Network speed.", "D. Memory usage."], "answer": "B", "time_stamp_s": 581, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [580, 599], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_118_a765_q0", "video_id": 118, "time_stamp_s": 581, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "95234f579bbaceff27079c905853990b26e27b744fff9789d8b13bcc6a21d37c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0, 561.0, 562.0, 563.0, 564.0, 565.0, 566.0, 567.0, 568.0, 569.0, 570.0, 571.0, 572.0, 573.0, 574.0, 575.0, 576.0, 577.0, 578.0, 579.0, 580.0, 581.0], "recent_frames_sha256": "037e8e3b55d7ad43af7271820a25e77510708be64b141f8dda2f962fc40ba3af", "num_recent_frames": 30, "tq": 715528.113248199, "t1": 715539.888573112, "ta": 715539.888573112, "te": 715539.926731666, "first_response_s": 11.775324912974611, "answer_total_s": 11.813483466976322, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_118_a765_q0", "video_id": 118, "time_stamp_s": 581, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a5f66f51e97e11933d43b33819f7d1e85f661633ac8aae0a1ce24d22ae56ae51", "condition_order": ["notes", "recent"], "memory": "[180-210s] - Hands open a white computer case, revealing internal mounting brackets and cables.  \n- A screwdriver is used to remove a side panel, exposing the case's interior structure.  \n- A cardboard box labeled \"ASUS ROG STRIX\" is placed beside the case, suggesting component packaging.\n[210-240s] - Hands manipulate a small black component near the motherboard area inside an open white computer case.  \n- A screwdriver is used to adjust or secure a component on the case’s rear panel, near the power supply.  \n- The case’s interior is partially assembled, with cables and a cooling system visible, and the user handles a black cable near the motherboard.\n[240-270s] - Hands remove plastic wrap from a Corsair SP750 power supply box.\n- Power supply unit is extracted from its packaging and connected to the computer case's rear panel.\n- Cables are routed and secured inside the case, with attention to cable management and placement near the motherboard.\n[270-300s] - Hands adjust black cooling fan and cable connections inside white PC case.  \n- Person repositions motherboard and CPU cooler assembly near case’s rear panel.  \n- PC case is lifted slightly, revealing internal components and wiring layout.\n[300-330s] - Hands position a black Cooler Master fan into the white computer case's front panel area.  \n- A black power cable is routed and secured near the fan's mounting point.  \n- The case's interior shows a partially assembled system with a motherboard, CPU cooler, and other components.\n[330-360s] - Person removes side panel of white computer case, revealing internal components and cables.  \n- Person holds and displays a black GeForce RTX 3080 graphics card box, then opens it to reveal the card.  \n- Two GeForce RTX 3080 cards are held side-by-side on a wooden surface, showing their design and cooling fans.\n[360-390s] - Hands hold and rotate an RTX 3090 graphics card, showcasing its design and fan.  \n- Card is positioned over an open computer case, preparing for installation.  \n- Price listings for RTX 3090 models are displayed on a screen, indicating retail options.\n[390-420s] - A hand holds a black power cable near a white PC case with internal components visible.  \n- The PC case is then closed and placed on a wooden table, showing its front perforated panel.  \n- A monitor displays a game, with a hand on a mousepad beside the PC, indicating setup or use.\n[420-450s] - A desktop monitor displays a Windows update progress bar with a blue background and green progress indicator.  \n- A white computer case with visible internal components is positioned to the right of the monitor.  \n- A pop-up window appears on the screen, prompting the user to \"Click here to install\" a driver update.\n[450-480s] - A software interface displays a \"Set Smart\" dialog box with options for configuring fan curves, including a \"Save\" button.  \n- The main dashboard shows multiple fan control panels with real-time data like RPM and temperature, alongside a graph for curve adjustments.  \n- The user navigates through the interface, transitioning from the fan control dashboard to a live gaming setup with a monitor and PC case visible.\n[480-510s] - MSI Afterburner interface displays real-time GPU performance metrics alongside a graph tracking voltage or temperature trends.  \n- A dropdown menu in the software highlights \"Stable Node\" settings, with \"Offset Mode\" selected and \"Auto\" configured for voltage regulation.  \n- A hand holds an Intel CPU, showcasing its physical form, while the background transitions between purple and orange lighting, indicating a hardware setup or testing environment.\n[510-540s] - Monitor displays ASUS ROG system settings with \"Power\" tab active, showing GPU usage and temperature metrics.  \n- Screen transitions to a racing game (F1) running on the same monitor, indicating performance testing.  \n- A man gestures toward a white PC case while seated at a desk, with a streaming platform interface visible on the monitor.\n[540-570s] - Bar graph displays 1440p gaming performance with \"Overwatch 2\" at 108.3 FPS and \"DOOM Eternal\" at 108.0 FPS.  \n- \"GEFORCE RTX\" logo is illuminated on a graphics card in a dimly lit setup with RGB lighting.  \n- A person plays a first-person shooter game on a monitor, with a white PC case visible beside them.", "history_tokens": 1006, "history_utf8_bytes": 4300, "recent_frame_times_s": [552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0, 561.0, 562.0, 563.0, 564.0, 565.0, 566.0, 567.0, 568.0, 569.0, 570.0, 571.0, 572.0, 573.0, 574.0, 575.0, 576.0, 577.0, 578.0, 579.0, 580.0, 581.0], "recent_frames_sha256": "037e8e3b55d7ad43af7271820a25e77510708be64b141f8dda2f962fc40ba3af", "num_recent_frames": 30, "tq": 715490.480947743, "t1": 715491.733990585, "ta": 715491.733990585, "te": 715491.922206508, "first_response_s": 1.2530428419122472, "answer_total_s": 1.4412587649421766, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 119, "content_group": "26928e096cdb6143ba8b3a00cccbdd920c3f8af1416b937797c20a39b3b79f55", "question": {"question_id": "sample_119_a1517_q0", "video_id": 119, "video_path": "./videos/sample_119_real.mp4", "annotation_index": 1517, "question_index": 0, "question": "What element is illuminated in the close-up view of the computer part right now?", "options": ["A. A red circuit board.", "B. A ROG logo.", "C. A MSI logo.", "D. Computer cables."], "answer": "B", "time_stamp_s": 6, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_119_a1517_q0", "video_id": 119, "time_stamp_s": 6, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b27581753cc06140c74e31c2742c494c4df9194eeee8acb2f30eb9642e5450a7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0], "recent_frames_sha256": "446bbee2e78782304e361269f5461fce36fcc0206ec52dac94255cf391895246", "num_recent_frames": 7, "tq": 716281.259432186, "t1": 716282.480212286, "ta": 716282.480212286, "te": 716282.518962215, "first_response_s": 1.2207800999749452, "answer_total_s": 1.2595300290267915, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_119_a1517_q0", "video_id": 119, "time_stamp_s": 6, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6478aa6e84551e3c791cdad9c9324d0bd8225f6609cae58789e5a5b85315737e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0], "recent_frames_sha256": "446bbee2e78782304e361269f5461fce36fcc0206ec52dac94255cf391895246", "num_recent_frames": 7, "tq": 716133.573312288, "t1": 716147.672905931, "ta": 716147.672905931, "te": 716147.974766901, "first_response_s": 14.099593642982654, "answer_total_s": 14.40145461296197, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 119, "content_group": "26928e096cdb6143ba8b3a00cccbdd920c3f8af1416b937797c20a39b3b79f55", "question": {"question_id": "sample_119_a1518_q0", "video_id": 119, "video_path": "./videos/sample_119_real.mp4", "annotation_index": 1518, "question_index": 0, "question": "What component is being detached from the GPU just now?", "options": ["A. A fan module.", "B. A copper heat sink.", "C. A plastic cover.", "D. A backplate."], "answer": "B", "time_stamp_s": 112, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [100, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_119_a1518_q0", "video_id": 119, "time_stamp_s": 112, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c419cd6a5f9ccd9ba08be06219e678fa91f63479204a663588e87f698f0dfcbd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0], "recent_frames_sha256": "b9dc7fcc0290f92dc0047b69d78661381756342280763648430499600e19bb34", "num_recent_frames": 30, "tq": 716282.548131522, "t1": 716289.539297829, "ta": 716289.539297829, "te": 716289.576695907, "first_response_s": 6.991166307008825, "answer_total_s": 7.028564385022037, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_119_a1518_q0", "video_id": 119, "time_stamp_s": 112, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8b211669c2ac61550fa6f7b23dd8a0306b78fb5a50c1dc2cd2c9daea7265b4ca", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A person holds and rotates a black, angular computer component with RGB lighting and an ASUS ROG logo, showcasing its design and internal components.  \n- The component is placed on a desk, revealing its structure, including a visible motherboard and cooling system, with cables and fans nearby.  \n- Close-up shots highlight the component's sleek, modern build, emphasizing its branding and aesthetic details under dim lighting.\n[30-60s] - A man in a grey shirt holds and gestures toward a black and silver ROG Matrix graphics card with a visible fan and cable.  \n- The man opens a black box to reveal the graphics card and its components, including a black metal frame and two white circular fans.  \n- The graphics card is placed on a table next to its packaging, with the man pointing at it while speaking.\n[60-90s] - Person holds a black graphics card with a large fan and attached cooling pipe, positioned on a white surface.  \n- A second, smaller cooling unit with two fans is visible to the right, suggesting a setup for a water-cooling system.  \n- The person gestures toward the graphics card while speaking, indicating features or assembly steps.", "history_tokens": 250, "history_utf8_bytes": 1163, "recent_frame_times_s": [83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0], "recent_frames_sha256": "b9dc7fcc0290f92dc0047b69d78661381756342280763648430499600e19bb34", "num_recent_frames": 30, "tq": 716174.279677343, "t1": 716175.694180624, "ta": 716175.694180624, "te": 716175.732272991, "first_response_s": 1.4145032810047269, "answer_total_s": 1.452595648006536, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 119, "content_group": "26928e096cdb6143ba8b3a00cccbdd920c3f8af1416b937797c20a39b3b79f55", "question": {"question_id": "sample_119_a1519_q0", "video_id": 119, "video_path": "./videos/sample_119_real.mp4", "annotation_index": 1519, "question_index": 0, "question": "Which colors are the RGB lighting alternating between on the \"Matrix\" component right now?", "options": ["A. Red, green, and blue.", "B. Blue, purple, and green.", "C. Red, blue, and purple.", "D. Red, purple, and green."], "answer": "C", "time_stamp_s": 203, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [200, 220], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_119_a1519_q0", "video_id": 119, "time_stamp_s": 203, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8322bd8ce562cb0adc214fd58874a8f520fe21393c40f2422845d9ef97cb5844", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0], "recent_frames_sha256": "aa19da80a9a87e2d998b3205905c2233ab70c41e699dbe6c0fb0cdb502f2d05d", "num_recent_frames": 30, "tq": 716289.596110581, "t1": 716302.302538897, "ta": 716302.302538897, "te": 716302.339993312, "first_response_s": 12.70642831607256, "answer_total_s": 12.74388273106888, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_119_a1519_q0", "video_id": 119, "time_stamp_s": 203, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3b87779b237288d9cb82550f037164021efde24efa81dcacfef415cc413145f6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A person holds and rotates a black, angular computer component with RGB lighting and an ASUS ROG logo, showcasing its design and internal components.  \n- The component is placed on a desk, revealing its structure, including a visible motherboard and cooling system, with cables and fans nearby.  \n- Close-up shots highlight the component's sleek, modern build, emphasizing its branding and aesthetic details under dim lighting.\n[30-60s] - A man in a grey shirt holds and gestures toward a black and silver ROG Matrix graphics card with a visible fan and cable.  \n- The man opens a black box to reveal the graphics card and its components, including a black metal frame and two white circular fans.  \n- The graphics card is placed on a table next to its packaging, with the man pointing at it while speaking.\n[60-90s] - Person holds a black graphics card with a large fan and attached cooling pipe, positioned on a white surface.  \n- A second, smaller cooling unit with two fans is visible to the right, suggesting a setup for a water-cooling system.  \n- The person gestures toward the graphics card while speaking, indicating features or assembly steps.\n[90-120s] - Person removes a black plastic casing from a graphics card, revealing internal components.  \n- Graphics card is lifted to show its underside, highlighting the copper heat sink and green cooling fan.  \n- Card is rotated to display its top side, showing the GPU chip and surrounding circuitry.\n[120-150s] - A person holds a graphics card PCB, showing its internal components including a central chip and surrounding circuitry.  \n- The same PCB is later shown being compared to an ROG Strix card, with text indicating \"btw 95% same PCB as ROG Strix.\"  \n- A man presents a black, rectangular chassis with \"GEFORCE RTX\" branding, holding it while gesturing toward its design.\n[150-180s] - A hand lifts a black rectangular device with a screen and buttons, revealing its internal components.  \n- The device is placed on a dark surface, with a coiled black cable nearby and a red accent in the background.  \n- The screen displays text labels (e.g., \"H1\", \"R1\", \"T1\", \"R2\", \"I1\", \"X1\") and is framed by glowing RGB lighting.", "history_tokens": 510, "history_utf8_bytes": 2192, "recent_frame_times_s": [174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0], "recent_frames_sha256": "aa19da80a9a87e2d998b3205905c2233ab70c41e699dbe6c0fb0cdb502f2d05d", "num_recent_frames": 30, "tq": 716194.250501204, "t1": 716201.065702254, "ta": 716201.065702254, "te": 716201.33895287, "first_response_s": 6.815201049903408, "answer_total_s": 7.088451665942557, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 119, "content_group": "26928e096cdb6143ba8b3a00cccbdd920c3f8af1416b937797c20a39b3b79f55", "question": {"question_id": "sample_119_a1520_q0", "video_id": 119, "video_path": "./videos/sample_119_real.mp4", "annotation_index": 1520, "question_index": 0, "question": "What graphics card models are shown on the benchmarking results right now?", "options": ["A. 4080 FE, 4090 Suprim X, 4090 Matrix.", "B. 4090 FE, 4080 Suprim X, 4090 Matrix.", "C. 4090 FE, 4090 Suprim X, 4080 Matrix.", "D. 4090 FE, 4090 Suprim X, 4090 Matrix."], "answer": "D", "time_stamp_s": 309, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [300, 320], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_119_a1520_q0", "video_id": 119, "time_stamp_s": 309, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c7e310b76d7aba9ba5646822ab39e3d452674e356b2883be2c62dbd0b2ec3c51", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0], "recent_frames_sha256": "0f6470986d79ab64a3928ac7c43567cd419d6a08c48b71aaaf72b937b01ba9f9", "num_recent_frames": 30, "tq": 716302.360984382, "t1": 716313.671154489, "ta": 716313.671154489, "te": 716313.708688021, "first_response_s": 11.310170107055455, "answer_total_s": 11.34770363906864, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_119_a1520_q0", "video_id": 119, "time_stamp_s": 309, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d073692dd31aca2d63d3a4ef019be73bc14c5dd5f478459aa7f2fec24a8be9af", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A person holds and rotates a black, angular computer component with RGB lighting and an ASUS ROG logo, showcasing its design and internal components.  \n- The component is placed on a desk, revealing its structure, including a visible motherboard and cooling system, with cables and fans nearby.  \n- Close-up shots highlight the component's sleek, modern build, emphasizing its branding and aesthetic details under dim lighting.\n[30-60s] - A man in a grey shirt holds and gestures toward a black and silver ROG Matrix graphics card with a visible fan and cable.  \n- The man opens a black box to reveal the graphics card and its components, including a black metal frame and two white circular fans.  \n- The graphics card is placed on a table next to its packaging, with the man pointing at it while speaking.\n[60-90s] - Person holds a black graphics card with a large fan and attached cooling pipe, positioned on a white surface.  \n- A second, smaller cooling unit with two fans is visible to the right, suggesting a setup for a water-cooling system.  \n- The person gestures toward the graphics card while speaking, indicating features or assembly steps.\n[90-120s] - Person removes a black plastic casing from a graphics card, revealing internal components.  \n- Graphics card is lifted to show its underside, highlighting the copper heat sink and green cooling fan.  \n- Card is rotated to display its top side, showing the GPU chip and surrounding circuitry.\n[120-150s] - A person holds a graphics card PCB, showing its internal components including a central chip and surrounding circuitry.  \n- The same PCB is later shown being compared to an ROG Strix card, with text indicating \"btw 95% same PCB as ROG Strix.\"  \n- A man presents a black, rectangular chassis with \"GEFORCE RTX\" branding, holding it while gesturing toward its design.\n[150-180s] - A hand lifts a black rectangular device with a screen and buttons, revealing its internal components.  \n- The device is placed on a dark surface, with a coiled black cable nearby and a red accent in the background.  \n- The screen displays text labels (e.g., \"H1\", \"R1\", \"T1\", \"R2\", \"I1\", \"X1\") and is framed by glowing RGB lighting.\n[180-210s] - Person holds and rotates a black GPU cooler with three fans, showing its side profile and tubing connections.  \n- The cooler is then placed on a white surface next to a separate graphics card.  \n- A monitor displays the \"Cyberpunk 2077\" game menu, indicating a gaming setup context.\n[210-240s] - GPU thermals chart displays temperature readings for various components during Cyberpunk 4K Ultra 30-min test, including GPU, memory, and power phases.\n- Temperature values fluctuate across different settings (e.g., 4090 Matrix, 4090 Super Liquid, 4090 FE) with distinct thermal profiles for each component.\n- Visuals show bar graphs with color-coded temperature ranges, indicating performance under load for each GPU variant.\n[240-270s] - GPU clock bars display 4090 Matrix at 2,468 MHz, 4090 Super Liquid at 2,775 MHz, and 4090 FE at 2,745 MHz.\n- Three side-by-side panels show real-time stats: 4090 TiFS (86°C, 1445 MHz, 377.5W), 4090 Super X (68°C, 1341 MHz, 424.4W), and 4090 Matrix (51°C\n[270-300s] - A computer setup with a \"Noctua\" branded cooling system and RGB lighting is displayed under a spotlight.  \n- Text overlay shows performance metrics for different GPUs: \"FE - 40.5dBA / 1650rpm\", \"Supermicro Liquid X - 38.6dBA / 1330rpm\", and \"Matrox - 38.7dBA / 1220rpm\".  \n- A monitor on the right displays a video game scene with a city street environment.", "history_tokens": 950, "history_utf8_bytes": 3569, "recent_frame_times_s": [280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0], "recent_frames_sha256": "0f6470986d79ab64a3928ac7c43567cd419d6a08c48b71aaaf72b937b01ba9f9", "num_recent_frames": 30, "tq": 716236.294362149, "t1": 716238.228689679, "ta": 716238.228689679, "te": 716238.266344152, "first_response_s": 1.9343275299761444, "answer_total_s": 1.971982003073208, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 119, "content_group": "26928e096cdb6143ba8b3a00cccbdd920c3f8af1416b937797c20a39b3b79f55", "question": {"question_id": "sample_119_a1521_q0", "video_id": 119, "video_path": "./videos/sample_119_real.mp4", "annotation_index": 1521, "question_index": 0, "question": "What is the likely purpose of the person's gestures right now?", "options": ["A. Asking a question.", "B. Explaining a concept.", "C. Writing something down.", "D. Watching a demonstration."], "answer": "B", "time_stamp_s": 387, "task_type": "Causal Reasoning", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [380, 388], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_119_a1521_q0", "video_id": 119, "time_stamp_s": 387, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5a13f4594d9a957755689f3d1fb8ee8dd9bfd495de2491b499e0e1f5c3420a9e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0], "recent_frames_sha256": "d64b6bfc4d60137c831f3599ccc2c0568fe82ea3d349fb8f687d5b4751b96565", "num_recent_frames": 30, "tq": 716313.730433748, "t1": 716321.129359339, "ta": 716321.129359339, "te": 716321.166591904, "first_response_s": 7.398925591027364, "answer_total_s": 7.4361581560224295, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_119_a1521_q0", "video_id": 119, "time_stamp_s": 387, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ba341bf5d743483cce81fe23ddfeeb34bbe29c7e858eebac4eb60398af406761", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Person holds a black graphics card with a large fan and attached cooling pipe, positioned on a white surface.  \n- A second, smaller cooling unit with two fans is visible to the right, suggesting a setup for a water-cooling system.  \n- The person gestures toward the graphics card while speaking, indicating features or assembly steps.\n[90-120s] - Person removes a black plastic casing from a graphics card, revealing internal components.  \n- Graphics card is lifted to show its underside, highlighting the copper heat sink and green cooling fan.  \n- Card is rotated to display its top side, showing the GPU chip and surrounding circuitry.\n[120-150s] - A person holds a graphics card PCB, showing its internal components including a central chip and surrounding circuitry.  \n- The same PCB is later shown being compared to an ROG Strix card, with text indicating \"btw 95% same PCB as ROG Strix.\"  \n- A man presents a black, rectangular chassis with \"GEFORCE RTX\" branding, holding it while gesturing toward its design.\n[150-180s] - A hand lifts a black rectangular device with a screen and buttons, revealing its internal components.  \n- The device is placed on a dark surface, with a coiled black cable nearby and a red accent in the background.  \n- The screen displays text labels (e.g., \"H1\", \"R1\", \"T1\", \"R2\", \"I1\", \"X1\") and is framed by glowing RGB lighting.\n[180-210s] - Person holds and rotates a black GPU cooler with three fans, showing its side profile and tubing connections.  \n- The cooler is then placed on a white surface next to a separate graphics card.  \n- A monitor displays the \"Cyberpunk 2077\" game menu, indicating a gaming setup context.\n[210-240s] - GPU thermals chart displays temperature readings for various components during Cyberpunk 4K Ultra 30-min test, including GPU, memory, and power phases.\n- Temperature values fluctuate across different settings (e.g., 4090 Matrix, 4090 Super Liquid, 4090 FE) with distinct thermal profiles for each component.\n- Visuals show bar graphs with color-coded temperature ranges, indicating performance under load for each GPU variant.\n[240-270s] - GPU clock bars display 4090 Matrix at 2,468 MHz, 4090 Super Liquid at 2,775 MHz, and 4090 FE at 2,745 MHz.\n- Three side-by-side panels show real-time stats: 4090 TiFS (86°C, 1445 MHz, 377.5W), 4090 Super X (68°C, 1341 MHz, 424.4W), and 4090 Matrix (51°C\n[270-300s] - A computer setup with a \"Noctua\" branded cooling system and RGB lighting is displayed under a spotlight.  \n- Text overlay shows performance metrics for different GPUs: \"FE - 40.5dBA / 1650rpm\", \"Supermicro Liquid X - 38.6dBA / 1330rpm\", and \"Matrox - 38.7dBA / 1220rpm\".  \n- A monitor on the right displays a video game scene with a city street environment.\n[300-330s] - Three side-by-side digital displays show real-time GPU performance metrics (temperature, fan speed, power draw) for different models: 4090, 4090 Super, and 4090 Matrix.  \n- The displays are mounted on a dark background with illuminated signage and palm trees visible in the scene.  \n- The metrics fluctuate slightly over time, indicating active GPU usage.\n[330-360s] - A man in a gray shirt gestures toward a black, rectangular GPU cooler with visible tubing and branding.  \n- The cooler is positioned on a wooden table, with a dark background and ambient lighting.  \n- Close-up shots highlight the cooler’s sleek design, including engraved text and a red accent on the tubing.", "history_tokens": 941, "history_utf8_bytes": 3444, "recent_frame_times_s": [358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0], "recent_frames_sha256": "d64b6bfc4d60137c831f3599ccc2c0568fe82ea3d349fb8f687d5b4751b96565", "num_recent_frames": 30, "tq": 716279.223061722, "t1": 716281.00709964, "ta": 716281.00709964, "te": 716281.20983267, "first_response_s": 1.784037917968817, "answer_total_s": 1.986770948045887, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 121, "content_group": "dcb137c361d7b97e4842a7dcb101604980c4848c18c50c2a0e3670978f54eebf", "question": {"question_id": "sample_121_a699_q0", "video_id": 121, "video_path": "./videos/sample_121_real.mp4", "annotation_index": 699, "question_index": 0, "question": "What label on the graphics card is visible right now?", "options": ["A. RTX 4090.", "B. AMD RADEON.", "C. INTEL ARC.", "D. NVIDIA TESLA."], "answer": "A", "time_stamp_s": 11, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_121_a699_q0", "video_id": 121, "time_stamp_s": 11, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "294d0b06782e852f3a47bb87308c8e665149c22e959d9f1bfc1690ef430bda62", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0], "recent_frames_sha256": "22ec6c1f2adb30ffa018c07dd8adf668cd45a674482603c3843900c11142760d", "num_recent_frames": 12, "tq": 717343.38848145, "t1": 717348.98387418, "ta": 717348.98387418, "te": 717349.021216312, "first_response_s": 5.5953927299706265, "answer_total_s": 5.632734861923382, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_121_a699_q0", "video_id": 121, "time_stamp_s": 11, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d7790d7ab47e06a7585d7221caf6b42b310bbd6d9c5148c618f5d696d7d583d9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0], "recent_frames_sha256": "22ec6c1f2adb30ffa018c07dd8adf668cd45a674482603c3843900c11142760d", "num_recent_frames": 12, "tq": 717103.744666638, "t1": 717115.584135863, "ta": 717115.584135863, "te": 717116.057062247, "first_response_s": 11.839469225029461, "answer_total_s": 12.312395608983934, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 121, "content_group": "dcb137c361d7b97e4842a7dcb101604980c4848c18c50c2a0e3670978f54eebf", "question": {"question_id": "sample_121_a700_q0", "video_id": 121, "video_path": "./videos/sample_121_real.mp4", "annotation_index": 700, "question_index": 0, "question": "What license plate is displayed on the left car's rear right now?", "options": ["A. RTX1MUM.", "B. OPT1MUM.", "C. DLX3080.", "D. CAR4080."], "answer": "B", "time_stamp_s": 200, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [180, 200], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_121_a700_q0", "video_id": 121, "time_stamp_s": 200, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ff91c28a3dddeeccb06f01bf435ed031e1ab6a6dd8147d4cbcbf7302ebbdcf61", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0], "recent_frames_sha256": "93a041ae4e4c0bc0b2dde9bb8ac5e10df7ff616d95dac857ff0e77bb0fac3619", "num_recent_frames": 30, "tq": 717349.035078967, "t1": 717360.010048881, "ta": 717360.010048881, "te": 717360.199554292, "first_response_s": 10.974969914066605, "answer_total_s": 11.164475325029343, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_121_a700_q0", "video_id": 121, "time_stamp_s": 200, "ground_truth": "B", "raw_output": "B. OPT1MUM.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "a42bb69d470d3bf0f96061e3a25de39c1259faca252d1e2f4c962dbbd2317340", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Man holds and rotates an RTX 3080 graphics card, showcasing its design and fan assembly.  \n- He opens the card's packaging, revealing the card inside a sleek black box with \"RTX 3080\" branding.  \n- The card is displayed against a backdrop with green lighting, with a \"GEFORCE RTX 3080\" box visible on a shelf behind him.\n[30-60s] - A man holds an RTX 4080 graphics card, gesturing while speaking in a green-lit studio.  \n- Close-up shots show the RTX 4080's fan and cooling system, with a split-screen view of its installation in a PC.  \n- The card's design features a black and green color scheme with the \"RTX 4080\" branding visible on its side.\n[60-90s] - Two NVIDIA RTX graphics cards (RTX 3080 and RTX 4080) are displayed side-by-side on a blue surface, with the RTX 4080 appearing slightly larger and featuring a blue accent.  \n- A close-up shot shows a high-end RTX 4080 GPU mounted on a motherboard with a large custom water cooling system, including a radiator and tubing.  \n- A black screen displays a comparison chart with specifications for both RTX 3080 and RTX 4080, including silicon manufacturer, CUDA cores, boost clock, memory\n[90-120s] - A comparison chart displays specifications for RTX 3080 and RTX 4080 GPUs, including silicon manufacturer, boost clock, memory, and MSRP.\n- The chart transitions to a visual of two NVIDIA GPUs side-by-side, with the RTX 3080 on the left and RTX 4080 on the right, both featuring black cooling fans.\n- A bar graph highlights the increase in CUDA cores and boost clock from RTX 3080 to RTX 4080, with the RTX 4080 showing higher values.\n[120-150s] - A man in a black shirt holds a black graphics card with \"NVIDIA\" branding, gesturing with his hands while speaking.  \n- In the background, a \"GEFORCE RTX 3080\" box is visible on a shelf, alongside green vertical LED lighting.  \n- The man’s hands are positioned around the graphics card, showcasing its design and features.\n[150-180s] - A man holds an AMD Radeon RX 580 graphics card, positioned centrally in the frame.  \n- Close-up shot of a computer's motherboard with a BeQuiet! 1000W 80+ Platinum power supply unit, showing its LED indicator.  \n- Text overlay lists components: AMD Ryzen 5800X3D, MSI X570 Carbon, G-Skill 3200 CL16, 360mm AIO, 4TB M.2 NVMe, and BeQuiet! 1000W 80+ Platinum.", "history_tokens": 683, "history_utf8_bytes": 2310, "recent_frame_times_s": [171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0], "recent_frames_sha256": "93a041ae4e4c0bc0b2dde9bb8ac5e10df7ff616d95dac857ff0e77bb0fac3619", "num_recent_frames": 30, "tq": 717198.236845083, "t1": 717204.492895719, "ta": 717204.492895719, "te": 717204.755299172, "first_response_s": 6.256050636060536, "answer_total_s": 6.518454089062288, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 121, "content_group": "dcb137c361d7b97e4842a7dcb101604980c4848c18c50c2a0e3670978f54eebf", "question": {"question_id": "sample_121_a701_q0", "video_id": 121, "video_path": "./videos/sample_121_real.mp4", "annotation_index": 701, "question_index": 0, "question": "Which graphical overlay is NOT shown right now?", "options": ["A. RTX 2080 S.", "B. RTX 3080.", "C. RTX 3070.", "D. RTX 4080."], "answer": "C", "time_stamp_s": 380, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [360, 380], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_121_a701_q0", "video_id": 121, "time_stamp_s": 380, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ff6d477ce4dadc8e624235548562af7a1f9db2049ad21f24af11c35f7c1e7fcb", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0], "recent_frames_sha256": "50f901a8351ccb94c0d7ac71f96e276bd2290d1e4d06648dac9d51e6d20ac8bf", "num_recent_frames": 30, "tq": 717360.215365089, "t1": 717367.931180482, "ta": 717367.931180482, "te": 717367.971063581, "first_response_s": 7.71581539302133, "answer_total_s": 7.755698491935618, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_121_a701_q0", "video_id": 121, "time_stamp_s": 380, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bdfe88132a140436577b7151dcd013fb8aeab6bed853f2d1a028b1db695152dc", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A comparison chart displays specifications for RTX 3080 and RTX 4080 GPUs, including silicon manufacturer, boost clock, memory, and MSRP.\n- The chart transitions to a visual of two NVIDIA GPUs side-by-side, with the RTX 3080 on the left and RTX 4080 on the right, both featuring black cooling fans.\n- A bar graph highlights the increase in CUDA cores and boost clock from RTX 3080 to RTX 4080, with the RTX 4080 showing higher values.\n[120-150s] - A man in a black shirt holds a black graphics card with \"NVIDIA\" branding, gesturing with his hands while speaking.  \n- In the background, a \"GEFORCE RTX 3080\" box is visible on a shelf, alongside green vertical LED lighting.  \n- The man’s hands are positioned around the graphics card, showcasing its design and features.\n[150-180s] - A man holds an AMD Radeon RX 580 graphics card, positioned centrally in the frame.  \n- Close-up shot of a computer's motherboard with a BeQuiet! 1000W 80+ Platinum power supply unit, showing its LED indicator.  \n- Text overlay lists components: AMD Ryzen 5800X3D, MSI X570 Carbon, G-Skill 3200 CL16, 360mm AIO, 4TB M.2 NVMe, and BeQuiet! 1000W 80+ Platinum.\n[180-210s] - Three GPU performance comparisons displayed side-by-side: GTX 980, RTX 6000, and RTX 8000, each showing frame rates (e.g., 24, 123, 158 FPS) with distinct visual rendering quality.\n- The white sports car (license plate \"YH110P\") drives on a rural road, passing through a bridge and encountering traffic, with consistent camera angle from behind.\n- Environmental details like sunflowers, trees, and distant mountains remain static, while the car’s position and speed vary slightly across the frames.\n[210-240s] - Three side-by-side game frames show a white Lamborghini driving on a road, with performance metrics displayed above each frame.\n- The middle frame shows a character (Kratos) in a forest, with performance metrics indicating higher FPS than the left and right frames.\n- The character's arm and hand are visible in close-up, with detailed textures and motion, suggesting a focus on graphical fidelity.\n[240-270s] - Three side-by-side game frames show Kratos in a forest setting, with performance metrics (FPS) displayed above each panel.\n- The middle panel (RTX 3090) shows 117 FPS, while the right panel (RTX 4080) shows 148 FPS, indicating higher performance on the 4080.\n- The scene transitions to a dark, tunnel-like environment with a \"Dying Light 2\" title overlay, showing FPS values for each GPU.\n[270-300s] - Bar graph displays GPU performance comparison between RTX 4080 and 3080 for various games and benchmarks.\n- Green bars represent RTX 4080 performance, while gray bars show 3080 performance, with numerical values indicating frame rates.\n- The graph remains static, showing no changes or animations during the observed segment.\n[300-330s] - Bar graph displays GPU performance comparison between RTX 4090 and RTX 4080 across various games.\n- \"Doom Eternal\" shows highest performance with RTX 4090 at 100%.\n- \"Cyberpunk 2077\" and \"Dying Light 2\" show lower performance percentages for RTX 4090.\n[330-360s] - A person holds an RTX 4080 graphics card, rotating it to display its design and fan.  \n- A split-screen comparison shows three different GPU models (RTX 3060 Ti, RTX 3060, RTX 4080) rendering a game scene with varying frame rates.  \n- The RTX 4080 consistently achieves the highest frame rate (60+ FPS) across multiple game scenes, outperforming the others.", "history_tokens": 990, "history_utf8_bytes": 3458, "recent_frame_times_s": [351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0], "recent_frames_sha256": "50f901a8351ccb94c0d7ac71f96e276bd2290d1e4d06648dac9d51e6d20ac8bf", "num_recent_frames": 30, "tq": 717248.876554895, "t1": 717250.193414806, "ta": 717250.193414806, "te": 717250.23148005, "first_response_s": 1.3168599110795185, "answer_total_s": 1.3549251550575718, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 121, "content_group": "dcb137c361d7b97e4842a7dcb101604980c4848c18c50c2a0e3670978f54eebf", "question": {"question_id": "sample_121_a702_q0", "video_id": 121, "video_path": "./videos/sample_121_real.mp4", "annotation_index": 702, "question_index": 0, "question": "What is the V-Ray 5 benchmark score for the RTX 3080 right now?", "options": ["A. 2314.", "B. 2691.", "C. 1308.", "D. 3972."], "answer": "A", "time_stamp_s": 559, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [540, 560], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_121_a702_q0", "video_id": 121, "time_stamp_s": 559, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "492dfbf02f064f2c042c411712c9cf1f1c612400dbd50e5fc264fae2a8b26621", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0], "recent_frames_sha256": "92e29d69f962b750e54ceffad8897bf91177d5c69310efab5bea902833ba9832", "num_recent_frames": 30, "tq": 717367.990938634, "t1": 717379.704790005, "ta": 717379.704790005, "te": 717379.74745209, "first_response_s": 11.71385137096513, "answer_total_s": 11.756513455999084, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_121_a702_q0", "video_id": 121, "time_stamp_s": 559, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a0871e23b6c5e3b2fab24dc31ac45f21d7ac64184745018bedb56c702bb53333", "condition_order": ["notes", "recent"], "memory": "[270-300s] - Bar graph displays GPU performance comparison between RTX 4080 and 3080 for various games and benchmarks.\n- Green bars represent RTX 4080 performance, while gray bars show 3080 performance, with numerical values indicating frame rates.\n- The graph remains static, showing no changes or animations during the observed segment.\n[300-330s] - Bar graph displays GPU performance comparison between RTX 4090 and RTX 4080 across various games.\n- \"Doom Eternal\" shows highest performance with RTX 4090 at 100%.\n- \"Cyberpunk 2077\" and \"Dying Light 2\" show lower performance percentages for RTX 4090.\n[330-360s] - A person holds an RTX 4080 graphics card, rotating it to display its design and fan.  \n- A split-screen comparison shows three different GPU models (RTX 3060 Ti, RTX 3060, RTX 4080) rendering a game scene with varying frame rates.  \n- The RTX 4080 consistently achieves the highest frame rate (60+ FPS) across multiple game scenes, outperforming the others.\n[360-390s] - Three side-by-side game frames show a character walking through a dimly lit corridor, with FPS counters indicating performance differences across three GPU models: RTX 3060 S (39-41 FPS), RTX 3060 (48-50 FPS), and RTX 4060 (65-68 FPS).\n- The character moves forward, passing through hallways and stairs, with lighting and environmental details changing as they progress.\n- A close-up shot of an RTX 4060 graphics card is displayed on a rotating stand, illuminated by blue lighting, with\n[390-420s] - Split-screen comparison shows two identical game scenes rendered at different frame rates (60 FPS vs. 120 FPS) with distinct visual artifacts in the 60 FPS side.  \n- Both sides display a red car driving through a neon-lit urban environment with overhead structures and billboards, but the 60 FPS side exhibits motion blur and lower detail.  \n- Text overlays indicate \"RTX 4090\" and \"RTX 4080\" GPU models, with frame rate metrics (e.g., 60 FPS, 120 FPS) and \"Frame Generation\" label visible\n[420-450s] - Left screen: RTX 4090 (36% FPS) with \"37.7ms\" latency, showing a red car driving through a neon-lit city street at night.  \n- Right screen: RTX 4090 (36% FPS) with \"28.0ms\" latency, displaying the same red car in a similar urban environment.  \n- Both screens: Green bars indicate performance metrics, with \"Cyberpunk 2077\" and \"4K\" text visible, suggesting high-resolution gaming.\n[450-480s] - Left screen: GTX 970 at 451.5 seconds shows a red car driving through a city tunnel with \"451.5 FPS\" displayed.\n- Right screen: GTX 970 at 451.5 seconds shows a red car driving through a city tunnel with \"451.5 FPS\" displayed.\n- Both screens transition to a split-screen comparison of a red car driving through a city street with \"451.5 FPS\" displayed on the left and \"451.5 FPS\" displayed on the right.\n[480-510s] - Player character holds a weapon with blue energy effects, facing forward in a corridor with orange walls.  \n- Both screens show identical gameplay, with a \"98\" health indicator and \"ATLAS\" label on the character.  \n- The environment features graffiti, windows, and a glowing blue circular icon on the floor.\n[510-540s] - Split-screen gameplay shows two identical scenes with \"NVIDIA RTX 3060\" and \"AMD RX 6800\" labels, indicating a performance comparison.\n- A character in a futuristic suit fires a weapon with blue energy effects, moving through a vibrant, sunlit urban environment.\n- Performance graphs for \"Davinci Resolve Studio 18\" and \"Blender 3.3\" appear, displaying frame times for different GPU models, with the RTX 3060 AY1 leading in both tests.", "history_tokens": 1020, "history_utf8_bytes": 3558, "recent_frame_times_s": [530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0], "recent_frames_sha256": "92e29d69f962b750e54ceffad8897bf91177d5c69310efab5bea902833ba9832", "num_recent_frames": 30, "tq": 717297.644806535, "t1": 717298.437176907, "ta": 717298.437176907, "te": 717298.474953951, "first_response_s": 0.7923703719861805, "answer_total_s": 0.830147415981628, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 121, "content_group": "dcb137c361d7b97e4842a7dcb101604980c4848c18c50c2a0e3670978f54eebf", "question": {"question_id": "sample_121_a703_q0", "video_id": 121, "video_path": "./videos/sample_121_real.mp4", "annotation_index": 703, "question_index": 0, "question": "What brand and model of the graphics card box is visible on the man's hand right now?", "options": ["A. Radeon RX 590.", "B. GeForce GTX 1080.", "C. GeForce RTX 4080.", "D. Radeon RX 6700."], "answer": "C", "time_stamp_s": 705, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [700, 705], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_121_a703_q0", "video_id": 121, "time_stamp_s": 705, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a9207f4e889ad7f5bbde9670d3bfe26893ec5124dae4d75d76b553f27e048bff", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [676.0, 677.0, 678.0, 679.0, 680.0, 681.0, 682.0, 683.0, 684.0, 685.0, 686.0, 687.0, 688.0, 689.0, 690.0, 691.0, 692.0, 693.0, 694.0, 695.0, 696.0, 697.0, 698.0, 699.0, 700.0, 701.0, 702.0, 703.0, 704.0, 705.0], "recent_frames_sha256": "749abbef1fe41afa736898a96a345cd2e47b88cbe6562036b02356cbb2d323e8", "num_recent_frames": 30, "tq": 717379.764258836, "t1": 717391.143639569, "ta": 717391.143639569, "te": 717391.181074947, "first_response_s": 11.379380733007565, "answer_total_s": 11.416816110955551, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_121_a703_q0", "video_id": 121, "time_stamp_s": 705, "ground_truth": "C", "raw_output": "C. GeForce RTX 4080.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "719ef4f0471a8e11d39f331546a716c7c14a6c2e2413f5ab35bd341701c446a2", "condition_order": ["notes", "recent"], "memory": "[420-450s] - Left screen: RTX 4090 (36% FPS) with \"37.7ms\" latency, showing a red car driving through a neon-lit city street at night.  \n- Right screen: RTX 4090 (36% FPS) with \"28.0ms\" latency, displaying the same red car in a similar urban environment.  \n- Both screens: Green bars indicate performance metrics, with \"Cyberpunk 2077\" and \"4K\" text visible, suggesting high-resolution gaming.\n[450-480s] - Left screen: GTX 970 at 451.5 seconds shows a red car driving through a city tunnel with \"451.5 FPS\" displayed.\n- Right screen: GTX 970 at 451.5 seconds shows a red car driving through a city tunnel with \"451.5 FPS\" displayed.\n- Both screens transition to a split-screen comparison of a red car driving through a city street with \"451.5 FPS\" displayed on the left and \"451.5 FPS\" displayed on the right.\n[480-510s] - Player character holds a weapon with blue energy effects, facing forward in a corridor with orange walls.  \n- Both screens show identical gameplay, with a \"98\" health indicator and \"ATLAS\" label on the character.  \n- The environment features graffiti, windows, and a glowing blue circular icon on the floor.\n[510-540s] - Split-screen gameplay shows two identical scenes with \"NVIDIA RTX 3060\" and \"AMD RX 6800\" labels, indicating a performance comparison.\n- A character in a futuristic suit fires a weapon with blue energy effects, moving through a vibrant, sunlit urban environment.\n- Performance graphs for \"Davinci Resolve Studio 18\" and \"Blender 3.3\" appear, displaying frame times for different GPU models, with the RTX 3060 AY1 leading in both tests.\n[540-570s] - Bar chart displays Blender 3.3 performance metrics for various GPU models, with RTX 3090 highlighted in green.\n- V-Ray 5 benchmark results for GPUs are shown, with RTX 3090 again highlighted in green, indicating superior performance.\n- The chart labels indicate GPU models and their respective scores, with RTX 3090 consistently showing the highest performance across both benchmarks.\n[570-600s] - A close-up shot of an RTX 4080 GPU fan, showing its sleek black design and metallic accents.  \n- A performance monitor overlay displays real-time stats: temperature (72°C), clock speed (2760 MHz), and power draw (299.1W).  \n- The background features a dynamic, fiery, circular visual effect with geometric patterns.\n[600-630s] - Man in black shirt holds NVIDIA RTX 3060 graphics card, gesturing with hands while speaking.  \n- Background features green-lit wall and a black storage unit with \"RTX 3060\" box visible.  \n- Card's design shows \"RTX 3060\" branding and dual-fan cooling system.\n[630-660s] - A man in a black shirt holds an NVIDIA RTX 3090 graphics card, gesturing toward its design and features.  \n- Three side-by-side gameplay screens show performance comparisons: RTX 3090 (29% faster), RTX 3080 (18% faster), and RTX 3070 (12% faster) in a first-person shooter.  \n- The gameplay scenes transition between different environments, including a wooden interior and a desert setting, with visible in-game UI elements.\n[660-690s] - Three side-by-side game frames show palm trees and cityscape with RTX 3060 S (54 FPS), RTX 3060 (88 FPS), and RTX 4080 (141 FPS) performance labels.  \n- Scene transitions to a first-person shooter with a bow and arrow, displaying FPS metrics for each GPU.  \n- Final frame shows a black RTX 4080 graphics card on a pedestal with blue lighting, positioned against a dark background.", "history_tokens": 960, "history_utf8_bytes": 3412, "recent_frame_times_s": [676.0, 677.0, 678.0, 679.0, 680.0, 681.0, 682.0, 683.0, 684.0, 685.0, 686.0, 687.0, 688.0, 689.0, 690.0, 691.0, 692.0, 693.0, 694.0, 695.0, 696.0, 697.0, 698.0, 699.0, 700.0, 701.0, 702.0, 703.0, 704.0, 705.0], "recent_frames_sha256": "749abbef1fe41afa736898a96a345cd2e47b88cbe6562036b02356cbb2d323e8", "num_recent_frames": 30, "tq": 717341.101579389, "t1": 717342.904094589, "ta": 717342.904094589, "te": 717343.350649344, "first_response_s": 1.8025151999900118, "answer_total_s": 2.2490699550835416, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 122, "content_group": "38b1e41815b65c6c079d84cf23fd188550473cb5082bf299930aa99e4258d959", "question": {"question_id": "sample_122_a503_q0", "video_id": 122, "video_path": "./videos/sample_122_real.mp4", "annotation_index": 503, "question_index": 0, "question": "What text is prominently shown on the packaging of the darker graphics card right now?", "options": ["A. DESIGNED BY GAMERS, BUILT BY NVIDIA.", "B. CREATED BY GAMERS, DEVELOPED BY NVIDIA.", "C. INSPIRED BY GAMERS. BUILT BY NVIDIA.", "D. ENGINEERED BY GAMERS, MADE BY NVIDIA."], "answer": "C", "time_stamp_s": 15, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_122_a503_q0", "video_id": 122, "time_stamp_s": 15, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8eb65621efcb4c163c92f6e2dc976626c1d450fad72c9e5a912bb96da2498c99", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0], "recent_frames_sha256": "1c5280df776fa7e165ea5b50cd200e52aaafa6d73fa313544d75cc2e58ece842", "num_recent_frames": 16, "tq": 716845.055225567, "t1": 716849.770599123, "ta": 716849.770599123, "te": 716849.808522727, "first_response_s": 4.715373556013219, "answer_total_s": 4.753297160030343, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_122_a503_q0", "video_id": 122, "time_stamp_s": 15, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2778f459e831ae1ef66f33e9d0055e0255571a0b6434307d2128d47cbc47081b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0], "recent_frames_sha256": "1c5280df776fa7e165ea5b50cd200e52aaafa6d73fa313544d75cc2e58ece842", "num_recent_frames": 16, "tq": 716892.910061223, "t1": 716898.911517205, "ta": 716898.911517205, "te": 716899.348247637, "first_response_s": 6.001455981982872, "answer_total_s": 6.438186414074153, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 122, "content_group": "38b1e41815b65c6c079d84cf23fd188550473cb5082bf299930aa99e4258d959", "question": {"question_id": "sample_122_a504_q0", "video_id": 122, "video_path": "./videos/sample_122_real.mp4", "annotation_index": 504, "question_index": 0, "question": "What titles are not listed on the comparison chart shown right now?", "options": ["A. GTA V.", "B. Shadow of the Tomb Raider.", "C. Forza Horizon 5.", "D. God of War."], "answer": "A", "time_stamp_s": 96, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [80, 100], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_122_a504_q0", "video_id": 122, "time_stamp_s": 96, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "86eb9e997f9d2896a92a270fcd33098e05e0055bfe5a2c626c92c6f3872cbb1c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0], "recent_frames_sha256": "20cb429e26a671ca06cffe5d3dd7cd5e5bbe848294703ecd56de36df61c83d44", "num_recent_frames": 30, "tq": 716849.822069249, "t1": 716856.673103556, "ta": 716856.673103556, "te": 716856.711143109, "first_response_s": 6.85103430703748, "answer_total_s": 6.8890738600166515, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_122_a504_q0", "video_id": 122, "time_stamp_s": 96, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1f08c1159078c93996b01235bba80f9e9aca42c6a18be6e3a7b2dc2255464df7", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man gestures toward a white NVIDIA GeForce RTX 3070 graphics card on a table, with a \"$300\" text overlay.  \n- He then places a black RTX 4060 card beside it, comparing their designs and packaging.  \n- A side-by-side comparison graphic displays specs like silicon, CUDA cores, memory, and MSRP for both cards.\n[30-60s] - A comparison chart displays specifications for RTX 3070 and RTX 4060 GPUs, including silicon vendor, CUDA cores, boost clock, memory, and power draw.  \n- A hand holds two graphics cards, one RTX 3070 and one RTX 4060, against a desk background.  \n- A performance graph compares average FPS across various games for RTX 3070 vs. RTX 4060, with data points plotted for each title.\n[60-90s] - Green bars on a dark background show performance metrics for various games, with numerical values indicating frame rates.\n- Labels beneath the bars identify specific games such as \"Dota 2,\" \"F1 22,\" and \"GTA V.\"\n- The chart displays \"average fps\" at the top, with values ranging from 60 to 100+ for different titles.", "history_tokens": 292, "history_utf8_bytes": 1038, "recent_frame_times_s": [67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0], "recent_frames_sha256": "20cb429e26a671ca06cffe5d3dd7cd5e5bbe848294703ecd56de36df61c83d44", "num_recent_frames": 30, "tq": 716927.126059328, "t1": 716927.73396992, "ta": 716927.73396992, "te": 716927.919647285, "first_response_s": 0.6079105919925496, "answer_total_s": 0.7935879570432007, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 122, "content_group": "38b1e41815b65c6c079d84cf23fd188550473cb5082bf299930aa99e4258d959", "question": {"question_id": "sample_122_a505_q0", "video_id": 122, "video_path": "./videos/sample_122_real.mp4", "annotation_index": 505, "question_index": 0, "question": "What is the brand name of the graphics card shown right now?", "options": ["A. NVIDIA.", "B. GE FORCE.", "C. AMD.", "D. RADEON."], "answer": "C", "time_stamp_s": 180, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [160, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_122_a505_q0", "video_id": 122, "time_stamp_s": 180, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ecd0c1aa568552361bdeed03b5e5b0f95dfd4df3eaf37236f8edb83a63dfad8d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "2fab80529a2bc5bb0923b079dbc9168258ccf20b8dfdc1ef78bb9ecdcd43d000", "num_recent_frames": 30, "tq": 716856.725543389, "t1": 716869.198862648, "ta": 716869.198862648, "te": 716869.238896237, "first_response_s": 12.47331925900653, "answer_total_s": 12.513352848007344, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_122_a505_q0", "video_id": 122, "time_stamp_s": 180, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c44bb00edfde1082b6c418d0e3882de60bfa61f4f63e21a4644bba1cbe9a2513", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man gestures toward a white NVIDIA GeForce RTX 3070 graphics card on a table, with a \"$300\" text overlay.  \n- He then places a black RTX 4060 card beside it, comparing their designs and packaging.  \n- A side-by-side comparison graphic displays specs like silicon, CUDA cores, memory, and MSRP for both cards.\n[30-60s] - A comparison chart displays specifications for RTX 3070 and RTX 4060 GPUs, including silicon vendor, CUDA cores, boost clock, memory, and power draw.  \n- A hand holds two graphics cards, one RTX 3070 and one RTX 4060, against a desk background.  \n- A performance graph compares average FPS across various games for RTX 3070 vs. RTX 4060, with data points plotted for each title.\n[60-90s] - Green bars on a dark background show performance metrics for various games, with numerical values indicating frame rates.\n- Labels beneath the bars identify specific games such as \"Dota 2,\" \"F1 22,\" and \"GTA V.\"\n- The chart displays \"average fps\" at the top, with values ranging from 60 to 100+ for different titles.\n[90-120s] - A bar graph displays GPU performance metrics for various models, with RTX 4090 at the top.  \n- A man gestures toward two graphics cards on a table, one black and one white, while speaking.  \n- Close-up shots show the white graphics card with three fans, placed on a desk with a monitor and keyboard in the background.\n[120-150s] - A man holds and displays a silver, triple-fan graphics card, then places it on a table beside a black, dual-fan card.  \n- The man picks up a black, rectangular device with a visible GPU slot, showing its side profile and branding.  \n- A performance chart compares NVIDIA RTX 4090 Ti and 3090 Ti, highlighting frame rate differences across games like F1 23, Far Cry 6, and Cyberpunk 2077.\n[150-180s] - A man holds a black graphics card with dual fans, gesturing toward it while seated at a desk.  \n- Another graphics card, labeled \"GeForce RTX,\" is visible on the desk to his right.  \n- A hand lifts a third graphics card, showing its side profile with a red accent line, against a white surface.", "history_tokens": 567, "history_utf8_bytes": 2077, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "2fab80529a2bc5bb0923b079dbc9168258ccf20b8dfdc1ef78bb9ecdcd43d000", "num_recent_frames": 30, "tq": 716952.14549857, "t1": 716953.436541533, "ta": 716953.436541533, "te": 716953.661245674, "first_response_s": 1.29104296292644, "answer_total_s": 1.515747103956528, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 122, "content_group": "38b1e41815b65c6c079d84cf23fd188550473cb5082bf299930aa99e4258d959", "question": {"question_id": "sample_122_a506_q0", "video_id": 122, "video_path": "./videos/sample_122_real.mp4", "annotation_index": 506, "question_index": 0, "question": "What is the design feature of the graphics card on the right right now?", "options": ["A. It has dual fans with a sleek design.", "B. It has three fans with a geometric, aggressive design.", "C. It features a single large fan in the center.", "D. It is completely fanless with a passive cooling system."], "answer": "B", "time_stamp_s": 251, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [240, 260], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_122_a506_q0", "video_id": 122, "time_stamp_s": 251, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5820c5bc66b4217c70ed4668cb2299150a722c31c68ef34d995a984d958be9b5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0], "recent_frames_sha256": "a85c896a4b0eeb234824a30fdeffee04b6300f6bac45792b854b680e7053dd10", "num_recent_frames": 30, "tq": 716869.251091917, "t1": 716882.66372491, "ta": 716882.66372491, "te": 716882.886682224, "first_response_s": 13.412632992956787, "answer_total_s": 13.63559030694887, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_122_a506_q0", "video_id": 122, "time_stamp_s": 251, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e2d8125ef203c55bda62da9d6ded88fba91664445e57d1637a5729e4a566e0d0", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man gestures toward a white NVIDIA GeForce RTX 3070 graphics card on a table, with a \"$300\" text overlay.  \n- He then places a black RTX 4060 card beside it, comparing their designs and packaging.  \n- A side-by-side comparison graphic displays specs like silicon, CUDA cores, memory, and MSRP for both cards.\n[30-60s] - A comparison chart displays specifications for RTX 3070 and RTX 4060 GPUs, including silicon vendor, CUDA cores, boost clock, memory, and power draw.  \n- A hand holds two graphics cards, one RTX 3070 and one RTX 4060, against a desk background.  \n- A performance graph compares average FPS across various games for RTX 3070 vs. RTX 4060, with data points plotted for each title.\n[60-90s] - Green bars on a dark background show performance metrics for various games, with numerical values indicating frame rates.\n- Labels beneath the bars identify specific games such as \"Dota 2,\" \"F1 22,\" and \"GTA V.\"\n- The chart displays \"average fps\" at the top, with values ranging from 60 to 100+ for different titles.\n[90-120s] - A bar graph displays GPU performance metrics for various models, with RTX 4090 at the top.  \n- A man gestures toward two graphics cards on a table, one black and one white, while speaking.  \n- Close-up shots show the white graphics card with three fans, placed on a desk with a monitor and keyboard in the background.\n[120-150s] - A man holds and displays a silver, triple-fan graphics card, then places it on a table beside a black, dual-fan card.  \n- The man picks up a black, rectangular device with a visible GPU slot, showing its side profile and branding.  \n- A performance chart compares NVIDIA RTX 4090 Ti and 3090 Ti, highlighting frame rate differences across games like F1 23, Far Cry 6, and Cyberpunk 2077.\n[150-180s] - A man holds a black graphics card with dual fans, gesturing toward it while seated at a desk.  \n- Another graphics card, labeled \"GeForce RTX,\" is visible on the desk to his right.  \n- A hand lifts a third graphics card, showing its side profile with a red accent line, against a white surface.\n[180-210s] - A hand places a black and silver graphics card onto a wooden table, positioning it near a white and black card.  \n- The white card has three fans and a metallic frame, while the black card has a matte finish and a single fan.  \n- Both cards are shown side by side, with the white card slightly elevated and angled toward the camera.\n[210-240s] - Hand holds a black and silver GeForce RTX graphics card, rotating it to show its side profile and branding.  \n- The card is positioned over a partially assembled PC motherboard with RGB lighting.  \n- A top-down view shows two graphics cards side-by-side on a wooden surface, with hands gesturing toward them.", "history_tokens": 723, "history_utf8_bytes": 2745, "recent_frame_times_s": [222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0], "recent_frames_sha256": "a85c896a4b0eeb234824a30fdeffee04b6300f6bac45792b854b680e7053dd10", "num_recent_frames": 30, "tq": 716972.898849436, "t1": 716978.700155784, "ta": 716978.700155784, "te": 716978.733485343, "first_response_s": 5.801306348061189, "answer_total_s": 5.834635907085612, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 122, "content_group": "38b1e41815b65c6c079d84cf23fd188550473cb5082bf299930aa99e4258d959", "question": {"question_id": "sample_122_a507_q0", "video_id": 122, "video_path": "./videos/sample_122_real.mp4", "annotation_index": 507, "question_index": 0, "question": "How many fans does the graphics card on the right have right now?", "options": ["A. One.", "B. Two.", "C. Three.", "D. Four."], "answer": "C", "time_stamp_s": 286, "task_type": "Counting", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [280, 287], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_122_a507_q0", "video_id": 122, "time_stamp_s": 286, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "32a87e7c98a5e6807510831f20d16147d7062e3e45e9cd8bc02b1464d941bb20", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0], "recent_frames_sha256": "10679bde055a293e67f3add41fc49d21986e8a52f282b3c0566665746b24d371", "num_recent_frames": 30, "tq": 716882.900612468, "t1": 716892.861659332, "ta": 716892.861659332, "te": 716892.900131825, "first_response_s": 9.961046863929369, "answer_total_s": 9.999519356992096, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_122_a507_q0", "video_id": 122, "time_stamp_s": 286, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7885e55fb7453ff5e6ddf94233c69f7af3733ffd94d04acc0d506ab6b7efd369", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man gestures toward a white NVIDIA GeForce RTX 3070 graphics card on a table, with a \"$300\" text overlay.  \n- He then places a black RTX 4060 card beside it, comparing their designs and packaging.  \n- A side-by-side comparison graphic displays specs like silicon, CUDA cores, memory, and MSRP for both cards.\n[30-60s] - A comparison chart displays specifications for RTX 3070 and RTX 4060 GPUs, including silicon vendor, CUDA cores, boost clock, memory, and power draw.  \n- A hand holds two graphics cards, one RTX 3070 and one RTX 4060, against a desk background.  \n- A performance graph compares average FPS across various games for RTX 3070 vs. RTX 4060, with data points plotted for each title.\n[60-90s] - Green bars on a dark background show performance metrics for various games, with numerical values indicating frame rates.\n- Labels beneath the bars identify specific games such as \"Dota 2,\" \"F1 22,\" and \"GTA V.\"\n- The chart displays \"average fps\" at the top, with values ranging from 60 to 100+ for different titles.\n[90-120s] - A bar graph displays GPU performance metrics for various models, with RTX 4090 at the top.  \n- A man gestures toward two graphics cards on a table, one black and one white, while speaking.  \n- Close-up shots show the white graphics card with three fans, placed on a desk with a monitor and keyboard in the background.\n[120-150s] - A man holds and displays a silver, triple-fan graphics card, then places it on a table beside a black, dual-fan card.  \n- The man picks up a black, rectangular device with a visible GPU slot, showing its side profile and branding.  \n- A performance chart compares NVIDIA RTX 4090 Ti and 3090 Ti, highlighting frame rate differences across games like F1 23, Far Cry 6, and Cyberpunk 2077.\n[150-180s] - A man holds a black graphics card with dual fans, gesturing toward it while seated at a desk.  \n- Another graphics card, labeled \"GeForce RTX,\" is visible on the desk to his right.  \n- A hand lifts a third graphics card, showing its side profile with a red accent line, against a white surface.\n[180-210s] - A hand places a black and silver graphics card onto a wooden table, positioning it near a white and black card.  \n- The white card has three fans and a metallic frame, while the black card has a matte finish and a single fan.  \n- Both cards are shown side by side, with the white card slightly elevated and angled toward the camera.\n[210-240s] - Hand holds a black and silver GeForce RTX graphics card, rotating it to show its side profile and branding.  \n- The card is positioned over a partially assembled PC motherboard with RGB lighting.  \n- A top-down view shows two graphics cards side-by-side on a wooden surface, with hands gesturing toward them.\n[240-270s] - Man gestures with hands while seated at a table with two graphics cards in front of him.  \n- Graphics cards are positioned side by side on a wooden surface; one is black with dual fans, the other is silver with triple fans.  \n- A third graphics card box is visible to the right, partially out of frame.", "history_tokens": 799, "history_utf8_bytes": 3061, "recent_frame_times_s": [257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0], "recent_frames_sha256": "10679bde055a293e67f3add41fc49d21986e8a52f282b3c0566665746b24d371", "num_recent_frames": 30, "tq": 716989.182966246, "t1": 716996.712720697, "ta": 716996.712720697, "te": 716996.902057228, "first_response_s": 7.529754451010376, "answer_total_s": 7.71909098199103, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 123, "content_group": "102e5741eace0998ed3a106594e4a2e368b240263867bd716e8f3002ed6cd684", "question": {"question_id": "sample_123_a2114_q0", "video_id": 123, "video_path": "./videos/sample_123_real.mp4", "annotation_index": 2114, "question_index": 0, "question": "What text appears next to the graphics card on the desk right now?", "options": ["A. RTX 4060.", "B. GTX 3050.", "C. RTX 3090.", "D. GTX 1080."], "answer": "A", "time_stamp_s": 8, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_123_a2114_q0", "video_id": 123, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "05421ad139db7ce1a3e8454d0aad0c17f3691a1271a624b2128230c15e9296ac", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007], "recent_frames_sha256": "fe4cb649388ab68d7b6ceea6c4d36ee924102f5f5191bafee20a6fe1f96152d1", "num_recent_frames": 8, "tq": 718608.543268491, "t1": 718609.141671204, "ta": 718609.141671204, "te": 718609.182247998, "first_response_s": 0.5984027129597962, "answer_total_s": 0.6389795069117099, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_123_a2114_q0", "video_id": 123, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "417fc2dee0cd6cef621521e49262c29eea90f06ef22fed4ebb5d0d99e2ff0008", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007], "recent_frames_sha256": "fe4cb649388ab68d7b6ceea6c4d36ee924102f5f5191bafee20a6fe1f96152d1", "num_recent_frames": 8, "tq": 718439.040859392, "t1": 718451.814707941, "ta": 718451.814707941, "te": 718452.163372718, "first_response_s": 12.773848548997194, "answer_total_s": 13.122513326001354, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 123, "content_group": "102e5741eace0998ed3a106594e4a2e368b240263867bd716e8f3002ed6cd684", "question": {"question_id": "sample_123_a2115_q0", "video_id": 123, "video_path": "./videos/sample_123_real.mp4", "annotation_index": 2115, "question_index": 0, "question": "According to the comparison chart, what is the memory size of the RTX 3060 and the RTX 4060 right now?", "options": ["A. 12GB for RTX 3060, 8GB for RTX 4060.", "B. 8GB for RTX 3060, 12GB for RTX 4060.", "C. 10GB for RTX 3060, 8GB for RTX 4060.", "D. 16GB for RTX 3060, 10GB for RTX 4060."], "answer": "A", "time_stamp_s": 150, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [140, 160], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_123_a2115_q0", "video_id": 123, "time_stamp_s": 150, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c93344843812aa0708d6743031616d349855a476534abda1bb59a20b35064dfe", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334], "recent_frames_sha256": "8b6a70116a7634dc83408d8036cf0ff9fb1085d511b675c3be8044b9df98f4df", "num_recent_frames": 30, "tq": 718609.197264618, "t1": 718619.020521106, "ta": 718619.020521106, "te": 718619.060111751, "first_response_s": 9.823256487958133, "answer_total_s": 9.86284713295754, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_123_a2115_q0", "video_id": 123, "time_stamp_s": 150, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "898781ec371794e0014edc6c22c619c566630b79f1913836513f815f569f025c", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a beige shirt gestures toward an ASUS RTX 4060 Ti graphics card placed on a white table.  \n- The card is shown in close-up, revealing dual fans, the ASUS logo, and a gold PCIe connector.  \n- Two identical RTX 4060 Ti cards are displayed side by side, with text overlay indicating their model name.\n[30-60s] - A man in a light-colored shirt gestures while seated at a white table with a graphics card in front of him.  \n- The graphics card is shown from multiple angles, revealing its dual-fan cooling system and \"GEFORCE RTX\" branding.  \n- Close-up shots display the card's internal components, including the GPU chip and circuitry, alongside its PCIe connector.\n[60-90s] - Green text overlay displays \"158.7mm\" near the central GPU chip, indicating its dimension.\n- A man appears in a semi-transparent overlay, positioned to the right of the GPU board.\n- The camera pans slightly to show the full GPU board, including its connectors and surrounding components.\n[90-120s] - A man in a beige shirt gestures while speaking, seated at a white table with a graphics card in front of him.  \n- Close-up shots show the graphics card's circuit board, highlighting its blue GPU chip and surrounding components.  \n- A comparison chart displays specifications for RTX 4060, RTX 4060 Mini, and RTX 4070, with data presented in a grid format.\n[120-150s] - A man in glasses and a light-colored shirt is seated at a white table, gesturing with his hands while speaking.  \n- A black graphics card rests on the table in front of him, with shelves holding various items behind him.  \n- The screen displays a performance comparison chart for RTX 4060, RTX 4060 8GB, and RTX 4070, including metrics like core clock, boost clock, and memory clock.", "history_tokens": 445, "history_utf8_bytes": 1745, "recent_frame_times_s": [120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334], "recent_frames_sha256": "8b6a70116a7634dc83408d8036cf0ff9fb1085d511b675c3be8044b9df98f4df", "num_recent_frames": 30, "tq": 718492.506332259, "t1": 718494.325067827, "ta": 718494.325067827, "te": 718494.565280037, "first_response_s": 1.81873556796927, "answer_total_s": 2.0589477779576555, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 123, "content_group": "102e5741eace0998ed3a106594e4a2e368b240263867bd716e8f3002ed6cd684", "question": {"question_id": "sample_123_a2116_q0", "video_id": 123, "video_path": "./videos/sample_123_real.mp4", "annotation_index": 2116, "question_index": 0, "question": "According to the performance test titled \"3DMark Time Spy Extreme 图形分\", which graphics card scored the highest?", "options": ["A. RTX 4060 Ti.", "B. RTX 4060.", "C. RTX 3060.", "D. RTX 3060 Ti."], "answer": "A", "time_stamp_s": 300, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [280, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_123_a2116_q0", "video_id": 123, "time_stamp_s": 300, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9da811c764b2ac46a93dddad0a60989ccac59605e75c21f2689f3589e197cc55", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.00038333333333, 285.0013833333333, 286.00238333333334, 287.0033833333333, 288.00438333333335, 289.0053833333333, 290.00638333333336, 291.00738333333334, 292.0083833333333, 293.00938333333335, 294.0103833333333, 295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333], "recent_frames_sha256": "34708a0da99c9abb6da405df8d4f4978b6ca0987c3961967050a50d14b4d9f04", "num_recent_frames": 30, "tq": 718619.075348068, "t1": 718631.513195687, "ta": 718631.513195687, "te": 718631.550499094, "first_response_s": 12.437847618944943, "answer_total_s": 12.475151025922969, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_123_a2116_q0", "video_id": 123, "time_stamp_s": 300, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9cba5b8ceb74db7b07e220c4adf42160f1616da9184cb0a34a2e80ef898f246f", "condition_order": ["notes", "recent"], "memory": "[30-60s] - A man in a light-colored shirt gestures while seated at a white table with a graphics card in front of him.  \n- The graphics card is shown from multiple angles, revealing its dual-fan cooling system and \"GEFORCE RTX\" branding.  \n- Close-up shots display the card's internal components, including the GPU chip and circuitry, alongside its PCIe connector.\n[60-90s] - Green text overlay displays \"158.7mm\" near the central GPU chip, indicating its dimension.\n- A man appears in a semi-transparent overlay, positioned to the right of the GPU board.\n- The camera pans slightly to show the full GPU board, including its connectors and surrounding components.\n[90-120s] - A man in a beige shirt gestures while speaking, seated at a white table with a graphics card in front of him.  \n- Close-up shots show the graphics card's circuit board, highlighting its blue GPU chip and surrounding components.  \n- A comparison chart displays specifications for RTX 4060, RTX 4060 Mini, and RTX 4070, with data presented in a grid format.\n[120-150s] - A man in glasses and a light-colored shirt is seated at a white table, gesturing with his hands while speaking.  \n- A black graphics card rests on the table in front of him, with shelves holding various items behind him.  \n- The screen displays a performance comparison chart for RTX 4060, RTX 4060 8GB, and RTX 4070, including metrics like core clock, boost clock, and memory clock.\n[150-180s] - GPU comparison screen displays RTX 3060, 4060, and 4060 Ti specs with performance metrics like CUDA cores and memory bandwidth.\n- CUDA core count bar graph highlights RTX 4060 with +89% over RTX 3060 and RTX 4060 Ti with -14% over RTX 3060.\n- ADI07 and ADI08 chip diagrams show GPU architecture differences, including L2 Cache and GPC/GPU unit layouts.\n[180-210s] - ADI07 and ADI08 chip diagrams show evolving L2 cache sizes from 128KB to 16KB, with ADI08 having a larger L2 cache.\n- The diagram highlights a shift in SM/PCP ratios, with ADI08 showing 12 SM/6 PCP compared to ADI07's 8 SM/6 PCP.\n- The bottom panel displays GPU specifications, including core counts and memory bandwidth, with RTX 4060 Ti having 224 cores and 32 GB of memory bandwidth.\n[210-240s] - A man in a beige shirt gestures while seated at a white table, with a black graphics card in front of him.  \n- An overlay graphic displays GPU specifications for RTX 3060, RTX 4060, and RTX 4060 Ti, including core counts and memory sizes.  \n- The background features a blue wall with black shelving units holding various tech items.\n[240-270s] - A bar chart displays 3DMark Time Spy scores for four GPU models: RTX 4060, RTX 3060, RTX 4060 Ti, and RTX 3060 Ti, with RTX 4060 Ti leading.\n- A line graph shows power consumption trends for the same GPUs, with RTX 4060 Ti and RTX 3060 Ti having higher power usage than the others.\n- The presenter is seated at a desk, gesturing toward the graphics card and charts, indicating a comparison of performance and power efficiency\n[270-300s] - Bar graph displays 3DMark Time Spy Extreme scores for various RTX 40xx and 30xx GPU models under DirectX 12, with RTX 4060 Ti leading at 5007.\n- A presenter sits at a desk with a graphics card in front of them, hands clasped, against a blue background with shelves holding tech items.\n- The screen transitions to a new bar graph showing DXR Feature Test scores, with RTX 4060 Ti scoring 17.2, followed by RTX 3060 Ti at 17.1", "history_tokens": 991, "history_utf8_bytes": 3417, "recent_frame_times_s": [270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.00038333333333, 285.0013833333333, 286.00238333333334, 287.0033833333333, 288.00438333333335, 289.0053833333333, 290.00638333333336, 291.00738333333334, 292.0083833333333, 293.00938333333335, 294.0103833333333, 295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333], "recent_frames_sha256": "34708a0da99c9abb6da405df8d4f4978b6ca0987c3961967050a50d14b4d9f04", "num_recent_frames": 30, "tq": 718534.579258738, "t1": 718536.296207599, "ta": 718536.296207599, "te": 718536.337138616, "first_response_s": 1.7169488610234112, "answer_total_s": 1.7578798780450597, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 123, "content_group": "102e5741eace0998ed3a106594e4a2e368b240263867bd716e8f3002ed6cd684", "question": {"question_id": "sample_123_a2117_q0", "video_id": 123, "video_path": "./videos/sample_123_real.mp4", "annotation_index": 2117, "question_index": 0, "question": "Which game's performance metrics are consistently shown for the RTX 3060 Ti, RTX 3060, and RTX 4060 at a 1920x1080 resolution right now?", "options": ["A. 霍格沃兹之旅.", "B. 地平线5.", "C. Apex Legends.", "D. Call of Duty."], "answer": "A", "time_stamp_s": 440, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [420, 440], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_123_a2117_q0", "video_id": 123, "time_stamp_s": 440, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c7f1a8accc5ab88324e54510c4f62b0f23143cf61798c240c87b44db8c2f2ca8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0009166666667, 419.00191666666666, 420.0029166666667, 421.00391666666667, 422.00491666666665, 423.0059166666667, 424.00691666666665, 425.0079166666667, 426.00891666666666, 427.00991666666664, 428.0109166666667, 429.01191666666665, 430.0129166666667, 431.01391666666666, 432.0149166666667, 433.01591666666667, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333, 439.0052333333333], "recent_frames_sha256": "6190fe59ff8d776c5f84031c76c1978d051dadb85e76a77c91fff80d9f7ade58", "num_recent_frames": 30, "tq": 718631.561257777, "t1": 718644.322199263, "ta": 718644.322199263, "te": 718644.360037536, "first_response_s": 12.76094148599077, "answer_total_s": 12.798779758973978, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_123_a2117_q0", "video_id": 123, "time_stamp_s": 440, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6dc23c5e84e4970b79ebbf8cb272626707398f52baaf62a2b96b4f1f27967abe", "condition_order": ["notes", "recent"], "memory": "[180-210s] - ADI07 and ADI08 chip diagrams show evolving L2 cache sizes from 128KB to 16KB, with ADI08 having a larger L2 cache.\n- The diagram highlights a shift in SM/PCP ratios, with ADI08 showing 12 SM/6 PCP compared to ADI07's 8 SM/6 PCP.\n- The bottom panel displays GPU specifications, including core counts and memory bandwidth, with RTX 4060 Ti having 224 cores and 32 GB of memory bandwidth.\n[210-240s] - A man in a beige shirt gestures while seated at a white table, with a black graphics card in front of him.  \n- An overlay graphic displays GPU specifications for RTX 3060, RTX 4060, and RTX 4060 Ti, including core counts and memory sizes.  \n- The background features a blue wall with black shelving units holding various tech items.\n[240-270s] - A bar chart displays 3DMark Time Spy scores for four GPU models: RTX 4060, RTX 3060, RTX 4060 Ti, and RTX 3060 Ti, with RTX 4060 Ti leading.\n- A line graph shows power consumption trends for the same GPUs, with RTX 4060 Ti and RTX 3060 Ti having higher power usage than the others.\n- The presenter is seated at a desk, gesturing toward the graphics card and charts, indicating a comparison of performance and power efficiency\n[270-300s] - Bar graph displays 3DMark Time Spy Extreme scores for various RTX 40xx and 30xx GPU models under DirectX 12, with RTX 4060 Ti leading at 5007.\n- A presenter sits at a desk with a graphics card in front of them, hands clasped, against a blue background with shelves holding tech items.\n- The screen transitions to a new bar graph showing DXR Feature Test scores, with RTX 4060 Ti scoring 17.2, followed by RTX 3060 Ti at 17.1\n[300-330s] - Bar graphs display GPU performance metrics (e.g., 61, 72, 78) for RTX 4060, 4060 Ti, 3060, and 3060 Ti models.\n- Temperature readings (e.g., 72°C, 78°C) are shown alongside each GPU model in green and blue boxes.\n- Performance scores (e.g., 93, 77) are highlighted in green boxes for RTX 4060 Ti and RTX 3060 Ti models.\n[330-360s] - Performance metrics for RTX 4060 Ti, RTX 3060 Ti, and RTX 3060 are displayed with fluctuating FPS and temperature values across multiple frames.\n- The RTX 4060 Ti consistently shows higher FPS than RTX 3060 Ti and RTX 3060, with temperature readings around 70-80°C.\n- The RTX 3060 Ti and RTX 3060 exhibit lower FPS and higher temperature spikes, with RTX 3060 Ti reaching up to 10\n[360-390s] - Bar graphs display performance metrics for various GPU models (RTX 3060, 3060 Ti, 3060 Ti, 3060 Ti) with numerical values for each category.\n- Right side shows detailed performance data for each GPU model, including FPS, memory usage, and temperature readings.\n- The screen content remains static, with no visible changes or transitions during the observed time.\n[390-420s] - Bar graphs display performance metrics for RTX 4060, 3060, and 3060 Ti cards in \"CS:GO\" and \"WWE 2K24\" games.\n- GPU temperature and clock speeds are shown in green boxes for each card model.\n- Performance bars for each card show increasing values from 3060 to 3060 Ti, with a 23% performance gain noted.", "history_tokens": 981, "history_utf8_bytes": 3045, "recent_frame_times_s": [410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0009166666667, 419.00191666666666, 420.0029166666667, 421.00391666666667, 422.00491666666665, 423.0059166666667, 424.00691666666665, 425.0079166666667, 426.00891666666666, 427.00991666666664, 428.0109166666667, 429.01191666666665, 430.0129166666667, 431.01391666666666, 432.0149166666667, 433.01591666666667, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333, 439.0052333333333], "recent_frames_sha256": "6190fe59ff8d776c5f84031c76c1978d051dadb85e76a77c91fff80d9f7ade58", "num_recent_frames": 30, "tq": 718565.348868784, "t1": 718567.490237637, "ta": 718567.490237637, "te": 718567.527613279, "first_response_s": 2.141368852928281, "answer_total_s": 2.1787444949150085, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 123, "content_group": "102e5741eace0998ed3a106594e4a2e368b240263867bd716e8f3002ed6cd684", "question": {"question_id": "sample_123_a2118_q0", "video_id": 123, "video_path": "./videos/sample_123_real.mp4", "annotation_index": 2118, "question_index": 0, "question": "What benchmark score is being displayed for the time spy?", "options": ["A. 13,001.", "B. 10,000.", "C. 11,380.", "D. 13,300."], "answer": "A", "time_stamp_s": 571, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "evaluation_of_electronic_products", "reference_interval_s": [560, 580], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_123_a2118_q0", "video_id": 123, "time_stamp_s": 571, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2071cba94bdc542d17795f099350016f97bd59e0feb8627a39ac350efd8f631b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.00045, 552.00145, 553.00245, 554.00345, 555.00445, 556.00545, 557.00645, 558.00745, 559.00845, 560.00945, 561.01045, 562.01145, 563.01245, 564.01345, 565.01445, 566.01545, 567.01645, 568.0007666666667, 569.0017666666666, 570.0027666666666], "recent_frames_sha256": "90247bf60b9ca487a0604e6db184d97374bb91fb362826f0846b3c666886d5f9", "num_recent_frames": 30, "tq": 718644.371010887, "t1": 718655.280668726, "ta": 718655.280668726, "te": 718655.318712799, "first_response_s": 10.909657838987187, "answer_total_s": 10.947701912024058, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_123_a2118_q0", "video_id": 123, "time_stamp_s": 571, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1e2c6342cd0950cbd56a9f73c697f3b855526846b3bbb4f5b1ab876485c50c38", "condition_order": ["notes", "recent"], "memory": "[330-360s] - Performance metrics for RTX 4060 Ti, RTX 3060 Ti, and RTX 3060 are displayed with fluctuating FPS and temperature values across multiple frames.\n- The RTX 4060 Ti consistently shows higher FPS than RTX 3060 Ti and RTX 3060, with temperature readings around 70-80°C.\n- The RTX 3060 Ti and RTX 3060 exhibit lower FPS and higher temperature spikes, with RTX 3060 Ti reaching up to 10\n[360-390s] - Bar graphs display performance metrics for various GPU models (RTX 3060, 3060 Ti, 3060 Ti, 3060 Ti) with numerical values for each category.\n- Right side shows detailed performance data for each GPU model, including FPS, memory usage, and temperature readings.\n- The screen content remains static, with no visible changes or transitions during the observed time.\n[390-420s] - Bar graphs display performance metrics for RTX 4060, 3060, and 3060 Ti cards in \"CS:GO\" and \"WWE 2K24\" games.\n- GPU temperature and clock speeds are shown in green boxes for each card model.\n- Performance bars for each card show increasing values from 3060 to 3060 Ti, with a 23% performance gain noted.\n[420-450s] - Bar graphs display frame rates for RTX 4060 Ti, RTX 4060, and RTX 3060 Ti across different games, with RTX 4060 Ti consistently leading.\n- Game-specific performance metrics (e.g., 1080p, 1440p) are shown in small boxes alongside each GPU, indicating resolution and settings.\n- Frame rate values fluctuate slightly over time, with RTX 4060 Ti maintaining the highest performance in most scenarios.\n[450-480s] - A bar chart displays performance metrics for various RTX 40xx series graphics cards, including RTX 4060, RTX 4060 Ti, and RTX 4070 Ti, with numerical values and percentages.\n- The chart is overlaid with text in Chinese, indicating the game \"War of the Gods\" and performance benchmarks.\n- A man in a white shirt is seated at a desk, gesturing with his hands while speaking, with a graphics card placed on the desk in front of him.\n[480-510s] - A man in a beige shirt gestures while speaking, positioned behind a white table with a black graphics card on it.  \n- On-screen text displays performance metrics for RTX 3060 Ti and RTX 4060 Ti, including price comparisons and \"AI Content Creation\" labels.  \n- A green-lit computer case with internal components is visible to the right, with text highlighting \"RTX 3060 Ti\" and \"RTX 4060 Ti\" specifications.\n[510-540s] - A man in a beige sweater sits at a white table with a black graphics card in front of him, gesturing while speaking.  \n- On-screen text displays \"Blender(3.5) 渲染测试\" with performance bars for RTX 4060, RTX 3060, and RTX 3060 Ti.  \n- Subsequent frames show similar test titles (Octane, Unity, Virtual Reality) with corresponding performance metrics and bar graphs.\n[540-570s] - A man in a light-colored shirt sits at a white table, gesturing toward a black graphics card on the table.  \n- A screen displays a benchmark chart with \"RTX 4060\" and \"RTX 3060\" scores, showing 18 and 22 respectively.  \n- A Time Spy benchmark result shows 13,001 score, 20.390 FPS, and a 13% improvement over the previous test.", "history_tokens": 926, "history_utf8_bytes": 3086, "recent_frame_times_s": [541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.00045, 552.00145, 553.00245, 554.00345, 555.00445, 556.00545, 557.00645, 558.00745, 559.00845, 560.00945, 561.01045, 562.01145, 563.01245, 564.01345, 565.01445, 566.01545, 567.01645, 568.0007666666667, 569.0017666666666, 570.0027666666666], "recent_frames_sha256": "90247bf60b9ca487a0604e6db184d97374bb91fb362826f0846b3c666886d5f9", "num_recent_frames": 30, "tq": 718607.382234326, "t1": 718608.374465802, "ta": 718608.374465802, "te": 718608.524943876, "first_response_s": 0.9922314760042354, "answer_total_s": 1.1427095499821007, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 124, "content_group": "2f229725ea0a06f73089f97bad7344a73c6aa8f09146a3e305daa237af9bccd4", "question": {"question_id": "sample_124_a1457_q0", "video_id": 124, "video_path": "./videos/sample_124_real.mp4", "annotation_index": 1457, "question_index": 0, "question": "What is the man in the video doing so far?", "options": ["A. Speaking and gesturing while seated.", "B. Cooking in a dimly lit kitchen.", "C. Reading a book quietly.", "D. Writing notes on a paper."], "answer": "A", "time_stamp_s": 19, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_124_a1457_q0", "video_id": 124, "time_stamp_s": 19, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a44ce69d5d75d1b929eba9e661eea1ecdb2ebdb54eeae4df02a9528bfce1c600", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "1979a2f168614e0ff7cb9afcc654daa009ba7adaf22dbb2e37258e300e8b5710", "num_recent_frames": 20, "tq": 717204.796743904, "t1": 717205.586594219, "ta": 717205.586594219, "te": 717205.622802265, "first_response_s": 0.7898503149626777, "answer_total_s": 0.8260583609808236, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_124_a1457_q0", "video_id": 124, "time_stamp_s": 19, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "21fe03041e2cc73ace16f900baf1271db598d1588b9e7e2d6c4292461fc3d345", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "1979a2f168614e0ff7cb9afcc654daa009ba7adaf22dbb2e37258e300e8b5710", "num_recent_frames": 20, "tq": 717255.406417203, "t1": 717269.319723183, "ta": 717269.319723183, "te": 717269.550075583, "first_response_s": 13.913305980036967, "answer_total_s": 14.143658380024135, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 124, "content_group": "2f229725ea0a06f73089f97bad7344a73c6aa8f09146a3e305daa237af9bccd4", "question": {"question_id": "sample_124_a1458_q0", "video_id": 124, "video_path": "./videos/sample_124_real.mp4", "annotation_index": 1458, "question_index": 0, "question": "What brand is mentioned on the white bottle labeled \"GAC 100\"?", "options": ["A. GOLDEN.", "B. SILVER.", "C. BRONZE.", "D. PLATINUM."], "answer": "A", "time_stamp_s": 160, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_124_a1458_q0", "video_id": 124, "time_stamp_s": 160, "ground_truth": "A", "raw_output": "A. GOLDEN.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "6df7f37415ce971743bf1aa4dcbd1593d47ee685670e61208a96361dbdb622a3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0], "recent_frames_sha256": "059c8e121ba3349a8995854ccb7b9cd3f3b44370ec5be2e76d5e0ca27e01ff72", "num_recent_frames": 30, "tq": 717205.639181172, "t1": 717219.193325713, "ta": 717219.193325713, "te": 717219.380760166, "first_response_s": 13.554144541034475, "answer_total_s": 13.741578993969597, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_124_a1458_q0", "video_id": 124, "time_stamp_s": 160, "ground_truth": "A", "raw_output": "A. GOLDEN.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "c9fd494b2169931ddfca458472055561d46c13abd410a57ea283216a73bc7b92", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man with a beard and beanie speaks to the camera, gesturing with his right hand while wearing a Mickey Mouse t-shirt under a hoodie.  \n- He briefly holds up a light blue denim jacket with his left hand, then lowers it.  \n- The background features a desk with a potted plant, a glowing blue light, and a camera on a tripod to the right.\n[30-60s] - A hand places a bottle of Golden GAC paint on a table beside a pair of denim jeans.  \n- The hand then adjusts the jeans, revealing their texture and stitching details.  \n- A roll of masking tape and various brushes are visible on the table, suggesting a crafting or painting activity.\n[60-90s] - Person uses stylus on tablet to draw pixelated alien on denim jacket image.  \n- Alien design is drawn over a black rectangular background on the tablet screen.  \n- Person then draws a rectangular outline on the jacket image, preparing for another design.\n[90-120s] - A hand uses a stylus to interact with a digital screen displaying a denim jacket with a graphic patch, adjusting or selecting elements.  \n- The screen shows a layer menu with options like \"Layer 1\" and \"Layer 2,\" indicating digital editing in progress.  \n- A physical denim jacket is later shown with a ruler and pencil, suggesting a transition to real-world measurement or design work.\n[120-150s] - A person's hands are seen applying yellow painter's tape to outline a rectangular area on a pair of denim jeans.  \n- A bottle labeled \"GAC 100\" is shown, indicating it contains acrylic primer, and a small amount is dispensed onto a clear plastic plate.  \n- The tape is pressed firmly onto the denim, forming a defined rectangular shape for a design or repair area.", "history_tokens": 395, "history_utf8_bytes": 1686, "recent_frame_times_s": [131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0], "recent_frames_sha256": "059c8e121ba3349a8995854ccb7b9cd3f3b44370ec5be2e76d5e0ca27e01ff72", "num_recent_frames": 30, "tq": 717304.309958897, "t1": 717317.077599627, "ta": 717317.077599627, "te": 717317.435409453, "first_response_s": 12.767640730016865, "answer_total_s": 13.125450556050055, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 124, "content_group": "2f229725ea0a06f73089f97bad7344a73c6aa8f09146a3e305daa237af9bccd4", "question": {"question_id": "sample_124_a1458_q1", "video_id": 124, "video_path": "./videos/sample_124_real.mp4", "annotation_index": 1458, "question_index": 1, "question": "Why is the yellow tape used on the denim fabric?", "options": ["A. To secure the fabric to the table.", "B. To create a border for the white liquid application.", "C. To measure the fabric size.", "D. To mark the sections for different colors."], "answer": "B", "time_stamp_s": 179, "task_type": "Causal Reasoning", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_124_a1458_q1", "video_id": 124, "time_stamp_s": 179, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cd9ac39999bc935cf5b9b41a99cf23ed4538313ee567d75351acfb6527e6621d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0], "recent_frames_sha256": "028697c488a3a093bf5dd286fa9d3f9b0760730a7f26341b85e8b48735e0793d", "num_recent_frames": 30, "tq": 717219.405760455, "t1": 717232.381694242, "ta": 717232.381694242, "te": 717232.423085841, "first_response_s": 12.975933787063695, "answer_total_s": 13.017325386055745, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_124_a1458_q1", "video_id": 124, "time_stamp_s": 179, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2a1d0ceaa5d5bb3c49482fe7263b83ee989e46b735e331c4284325ab81e5c082", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man with a beard and beanie speaks to the camera, gesturing with his right hand while wearing a Mickey Mouse t-shirt under a hoodie.  \n- He briefly holds up a light blue denim jacket with his left hand, then lowers it.  \n- The background features a desk with a potted plant, a glowing blue light, and a camera on a tripod to the right.\n[30-60s] - A hand places a bottle of Golden GAC paint on a table beside a pair of denim jeans.  \n- The hand then adjusts the jeans, revealing their texture and stitching details.  \n- A roll of masking tape and various brushes are visible on the table, suggesting a crafting or painting activity.\n[60-90s] - Person uses stylus on tablet to draw pixelated alien on denim jacket image.  \n- Alien design is drawn over a black rectangular background on the tablet screen.  \n- Person then draws a rectangular outline on the jacket image, preparing for another design.\n[90-120s] - A hand uses a stylus to interact with a digital screen displaying a denim jacket with a graphic patch, adjusting or selecting elements.  \n- The screen shows a layer menu with options like \"Layer 1\" and \"Layer 2,\" indicating digital editing in progress.  \n- A physical denim jacket is later shown with a ruler and pencil, suggesting a transition to real-world measurement or design work.\n[120-150s] - A person's hands are seen applying yellow painter's tape to outline a rectangular area on a pair of denim jeans.  \n- A bottle labeled \"GAC 100\" is shown, indicating it contains acrylic primer, and a small amount is dispensed onto a clear plastic plate.  \n- The tape is pressed firmly onto the denim, forming a defined rectangular shape for a design or repair area.", "history_tokens": 395, "history_utf8_bytes": 1686, "recent_frame_times_s": [150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0], "recent_frames_sha256": "028697c488a3a093bf5dd286fa9d3f9b0760730a7f26341b85e8b48735e0793d", "num_recent_frames": 30, "tq": 717317.447419723, "t1": 717329.194681794, "ta": 717329.194681794, "te": 717329.232645204, "first_response_s": 11.747262071003206, "answer_total_s": 11.785225481027737, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 124, "content_group": "2f229725ea0a06f73089f97bad7344a73c6aa8f09146a3e305daa237af9bccd4", "question": {"question_id": "sample_124_a1459_q0", "video_id": 124, "video_path": "./videos/sample_124_real.mp4", "annotation_index": 1459, "question_index": 0, "question": "Why does the artist add layers of white paint to the portrait?", "options": ["A. To create highlights and enhance dimensionality.", "B. To cover mistakes made earlier.", "C. To change the color of the background.", "D. To outline the figure in the portrait."], "answer": "A", "time_stamp_s": 297, "task_type": "Causal Reasoning", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_124_a1459_q0", "video_id": 124, "time_stamp_s": 297, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5fe81da9a865867226a967d395080933ea32f460678f1da39560fc0339b518bd", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0], "recent_frames_sha256": "d309328971903a148d0ec46133469a89431d5ddab75dc07b476a14cc344d4504", "num_recent_frames": 30, "tq": 717232.442236747, "t1": 717243.512540984, "ta": 717243.512540984, "te": 717243.551081207, "first_response_s": 11.070304236956872, "answer_total_s": 11.108844459988177, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_124_a1459_q0", "video_id": 124, "time_stamp_s": 297, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8d9b8d74f23442e2764589b0d6849f673ebf7e1e73bcdaee119f63622b1cdb99", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man with a beard and beanie speaks to the camera, gesturing with his right hand while wearing a Mickey Mouse t-shirt under a hoodie.  \n- He briefly holds up a light blue denim jacket with his left hand, then lowers it.  \n- The background features a desk with a potted plant, a glowing blue light, and a camera on a tripod to the right.\n[30-60s] - A hand places a bottle of Golden GAC paint on a table beside a pair of denim jeans.  \n- The hand then adjusts the jeans, revealing their texture and stitching details.  \n- A roll of masking tape and various brushes are visible on the table, suggesting a crafting or painting activity.\n[60-90s] - Person uses stylus on tablet to draw pixelated alien on denim jacket image.  \n- Alien design is drawn over a black rectangular background on the tablet screen.  \n- Person then draws a rectangular outline on the jacket image, preparing for another design.\n[90-120s] - A hand uses a stylus to interact with a digital screen displaying a denim jacket with a graphic patch, adjusting or selecting elements.  \n- The screen shows a layer menu with options like \"Layer 1\" and \"Layer 2,\" indicating digital editing in progress.  \n- A physical denim jacket is later shown with a ruler and pencil, suggesting a transition to real-world measurement or design work.\n[120-150s] - A person's hands are seen applying yellow painter's tape to outline a rectangular area on a pair of denim jeans.  \n- A bottle labeled \"GAC 100\" is shown, indicating it contains acrylic primer, and a small amount is dispensed onto a clear plastic plate.  \n- The tape is pressed firmly onto the denim, forming a defined rectangular shape for a design or repair area.\n[150-180s] - A hand applies white paint to a clear plastic dish on denim fabric using a brush.  \n- The same hand then uses a brush to spread paint over a taped rectangular area on the denim.  \n- A hand holds a hairdryer, directing heat toward the taped area on the denim.\n[180-210s] - Hand applies white paint with a brush over a taped denim area, covering a rectangular section.  \n- After painting, hand uses a blue sponge to smooth or blend the paint surface.  \n- The taped area remains centered on the denim, with paint now fully covering the outlined region.\n[210-240s] - Hand uses brush to apply black paint over a sketch on fabric, filling in the hooded figure's outline.  \n- Paint is applied in broad strokes, gradually covering the white background within a taped-off area.  \n- The figure's facial features and hood are being filled in, with the paint spreading slightly beyond the initial sketch lines.\n[240-270s] - Hand holds brush, applying dark pigment to denim surface.  \n- Brush strokes blend black and white areas, refining portrait details.  \n- Tape outlines the painting area, securing the design on denim.", "history_tokens": 659, "history_utf8_bytes": 2810, "recent_frame_times_s": [268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0], "recent_frames_sha256": "d309328971903a148d0ec46133469a89431d5ddab75dc07b476a14cc344d4504", "num_recent_frames": 30, "tq": 717359.314131856, "t1": 717366.951180644, "ta": 717366.951180644, "te": 717366.98971785, "first_response_s": 7.637048788019456, "answer_total_s": 7.67558599403128, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 124, "content_group": "2f229725ea0a06f73089f97bad7344a73c6aa8f09146a3e305daa237af9bccd4", "question": {"question_id": "sample_124_a1460_q0", "video_id": 124, "video_path": "./videos/sample_124_real.mp4", "annotation_index": 1460, "question_index": 0, "question": "Which of the following best summarizes the painting shown in the clip?", "options": ["A. A young warrior playing a musical instrument.", "B. A landscape with a forest and a gardener.", "C. An abstract painting with vibrant colors.", "D. An elderly man with a blue sword-like object."], "answer": "D", "time_stamp_s": 429, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_124_a1460_q0", "video_id": 124, "time_stamp_s": 429, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9840a30eebbd4258a48fbacb9b67e5fd46c2f83565b3d0e96e8c56915ff127ba", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0, 421.0, 422.0, 423.0, 424.0, 425.0, 426.0, 427.0, 428.0, 429.0], "recent_frames_sha256": "7653b832f5102f41132ff37ad9a4cf0d2ff8c8aa0724c47aa2db2e8ea539ce9e", "num_recent_frames": 30, "tq": 717243.559676637, "t1": 717255.358890924, "ta": 717255.358890924, "te": 717255.39610456, "first_response_s": 11.799214286962524, "answer_total_s": 11.836427922942676, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_124_a1460_q0", "video_id": 124, "time_stamp_s": 429, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a51e002ab61baeae67457efe5938703c5e3850441bea1eae129d2ba6f4b85c61", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man with a beard and beanie speaks to the camera, gesturing with his right hand while wearing a Mickey Mouse t-shirt under a hoodie.  \n- He briefly holds up a light blue denim jacket with his left hand, then lowers it.  \n- The background features a desk with a potted plant, a glowing blue light, and a camera on a tripod to the right.\n[30-60s] - A hand places a bottle of Golden GAC paint on a table beside a pair of denim jeans.  \n- The hand then adjusts the jeans, revealing their texture and stitching details.  \n- A roll of masking tape and various brushes are visible on the table, suggesting a crafting or painting activity.\n[60-90s] - Person uses stylus on tablet to draw pixelated alien on denim jacket image.  \n- Alien design is drawn over a black rectangular background on the tablet screen.  \n- Person then draws a rectangular outline on the jacket image, preparing for another design.\n[90-120s] - A hand uses a stylus to interact with a digital screen displaying a denim jacket with a graphic patch, adjusting or selecting elements.  \n- The screen shows a layer menu with options like \"Layer 1\" and \"Layer 2,\" indicating digital editing in progress.  \n- A physical denim jacket is later shown with a ruler and pencil, suggesting a transition to real-world measurement or design work.\n[120-150s] - A person's hands are seen applying yellow painter's tape to outline a rectangular area on a pair of denim jeans.  \n- A bottle labeled \"GAC 100\" is shown, indicating it contains acrylic primer, and a small amount is dispensed onto a clear plastic plate.  \n- The tape is pressed firmly onto the denim, forming a defined rectangular shape for a design or repair area.\n[150-180s] - A hand applies white paint to a clear plastic dish on denim fabric using a brush.  \n- The same hand then uses a brush to spread paint over a taped rectangular area on the denim.  \n- A hand holds a hairdryer, directing heat toward the taped area on the denim.\n[180-210s] - Hand applies white paint with a brush over a taped denim area, covering a rectangular section.  \n- After painting, hand uses a blue sponge to smooth or blend the paint surface.  \n- The taped area remains centered on the denim, with paint now fully covering the outlined region.\n[210-240s] - Hand uses brush to apply black paint over a sketch on fabric, filling in the hooded figure's outline.  \n- Paint is applied in broad strokes, gradually covering the white background within a taped-off area.  \n- The figure's facial features and hood are being filled in, with the paint spreading slightly beyond the initial sketch lines.\n[240-270s] - Hand holds brush, applying dark pigment to denim surface.  \n- Brush strokes blend black and white areas, refining portrait details.  \n- Tape outlines the painting area, securing the design on denim.\n[270-300s] - Hand holding brush applies white paint to canvas, blending into dark background.\n- Brush strokes refine facial features, including eyes and beard, with precise movements.\n- Canvas shows emerging portrait with distinct color blocks and textured brushwork.\n[300-330s] - Hand holds brush, applying white paint to denim jacket's portrait area.  \n- Brush strokes blend white paint over dark blue background, refining portrait details.  \n- Yellow tape borders the painted area, indicating a defined workspace.\n[330-360s] - Hand holds brush, applying paint to a Star Wars character portrait on denim.  \n- Portrait is taped to denim with yellow tape, showing partial completion.  \n- Brush strokes focus on the blue lightsaber’s glow, blending with dark background.\n[360-390s] - A hand peels off yellow tape from a printed image of a Jedi on a denim jacket.  \n- The jacket is then worn, showing the image prominently on the back.  \n- The person turns to display the jacket from the back, revealing the image centered on the back panel.\n[390-420s] - A denim jacket with a printed image of a hooded figure (likely a Jedi) is shown from the back, with the image centered on the jacket's back panel.  \n- The image features a detailed depiction of a bearded man in a dark robe, holding a glowing blue lightsaber, with a white, fluffy object (possibly a creature or prop) beside him.  \n- The jacket is worn by a person standing in a dimly lit room with a desk, plants, and various items in the background, suggesting a casual or home setting.", "history_tokens": 1018, "history_utf8_bytes": 4353, "recent_frame_times_s": [400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0, 421.0, 422.0, 423.0, 424.0, 425.0, 426.0, 427.0, 428.0, 429.0], "recent_frames_sha256": "7653b832f5102f41132ff37ad9a4cf0d2ff8c8aa0724c47aa2db2e8ea539ce9e", "num_recent_frames": 30, "tq": 717401.194479093, "t1": 717402.743923882, "ta": 717402.743923882, "te": 717402.781608952, "first_response_s": 1.5494447890669107, "answer_total_s": 1.5871298590209335, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 125, "content_group": "6a79da2dd7352dc452787c16d12f78ba8766195d3abb7f638f827fb8218e2f43", "question": {"question_id": "sample_125_a106_q0", "video_id": 125, "video_path": "./videos/sample_125_real.mp4", "annotation_index": 106, "question_index": 0, "question": "What happens right after the scene shifts to a different view showing a blank white canvas?", "options": ["A. A piece of gray fabric is placed over the canvas.", "B. The canvas is painted with light colors.", "C. A new portrait appears on the canvas.", "D. The video zooms out to show the entire table."], "answer": "A", "time_stamp_s": 16, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_125_a106_q0", "video_id": 125, "time_stamp_s": 16, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e31380ab29c710bdd11d20145580938b5f07b69f101c0e788cf6379158b03070", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0], "recent_frames_sha256": "e74f523393453270f0c5cebdb25eeae7a9bee97a782c60d6de7df0d40e6f9707", "num_recent_frames": 17, "tq": 717792.034739933, "t1": 717792.669805237, "ta": 717792.669805237, "te": 717792.71049268, "first_response_s": 0.6350653039989993, "answer_total_s": 0.6757527469890192, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_125_a106_q0", "video_id": 125, "time_stamp_s": 16, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "31ba23e388282fe05012405eae647438034c31ebc55b626b218309feb546e848", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0], "recent_frames_sha256": "e74f523393453270f0c5cebdb25eeae7a9bee97a782c60d6de7df0d40e6f9707", "num_recent_frames": 17, "tq": 717625.004196504, "t1": 717625.942044515, "ta": 717625.942044515, "te": 717626.319519573, "first_response_s": 0.9378480110317469, "answer_total_s": 1.315323068993166, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 125, "content_group": "6a79da2dd7352dc452787c16d12f78ba8766195d3abb7f638f827fb8218e2f43", "question": {"question_id": "sample_125_a107_q0", "video_id": 125, "video_path": "./videos/sample_125_real.mp4", "annotation_index": 107, "question_index": 0, "question": "What color is the circle in the background of the painting?", "options": ["A. Red.", "B. Blue.", "C. Green.", "D. Yellow."], "answer": "D", "time_stamp_s": 199, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_125_a107_q0", "video_id": 125, "time_stamp_s": 199, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ea4cd89c59ea8c4fdf8666a6e698bd1161b34b2a1d43494b79347f6cb5cb6af6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0], "recent_frames_sha256": "b39bb699fade456689e475d831518ed4676501c1d80a2f8f8c5d9f2b5f1b87a7", "num_recent_frames": 30, "tq": 717792.723909833, "t1": 717805.020906341, "ta": 717805.020906341, "te": 717805.059490532, "first_response_s": 12.296996508026496, "answer_total_s": 12.335580699029379, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_125_a107_q0", "video_id": 125, "time_stamp_s": 199, "ground_truth": "D", "raw_output": "D. Yellow.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "41508f05935e1669778e92c80c58ea3e28285e2352c8ab9dbc13e5d7ba984b66", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A digital painting of a blonde woman with a starry night sky and pink clouds is displayed on a canvas, with a white moon visible.  \n- The scene transitions to a physical sketching process where a hand uses a blue pen to draw a grayscale portrait of a woman on white paper.  \n- A hand holds the sketching paper steady while the other hand meticulously adds details to the portrait, indicating an ongoing artistic process.\n[30-60s] - A hand holds a blue pen, poised above a sketch of a woman's face, indicating the start of a drawing session.  \n- The hand then uses a black pencil to refine the sketch, adding details to the woman's hair and facial features.  \n- A circular object, possibly a pencil eraser, is briefly pointed at the sketch, suggesting an editing or correction action.\n[60-90s] - A hand holds a black circular object steady while another hand uses a red pencil to trace around it on paper.  \n- The black object is then moved to a wooden board, where yellow tape is applied beneath it.  \n- A silver marker is used to draw a circle around the black object on the taped area.\n[90-120s] - A hand uses a fine-tipped brush to color the eye of a sketch, starting with black and transitioning to blue.  \n- The yellow circular object remains stationary on the left side of the sketch.  \n- The sketch depicts a woman's face with long hair, and the coloring focuses on the eye area.\n[120-150s] - Hand holds brush applying dark pigment to eye socket area near eyebrow.  \n- Brush strokes extend from inner to outer edge of eye socket, blending into brow region.  \n- Painted area transitions from dark to lighter brown tones as brush moves across brow.\n[150-180s] - Hand applies brown pigment to eyebrow area using fine brush.  \n- Broad brush sweeps across neck and shoulder region, blending warm tones.  \n- Background shows yellow circular shape (sun) and faint cloud outlines.", "history_tokens": 435, "history_utf8_bytes": 1889, "recent_frame_times_s": [170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0], "recent_frames_sha256": "b39bb699fade456689e475d831518ed4676501c1d80a2f8f8c5d9f2b5f1b87a7", "num_recent_frames": 30, "tq": 717674.051732799, "t1": 717675.83029602, "ta": 717675.83029602, "te": 717676.032081146, "first_response_s": 1.7785632209852338, "answer_total_s": 1.9803483469877392, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 125, "content_group": "6a79da2dd7352dc452787c16d12f78ba8766195d3abb7f638f827fb8218e2f43", "question": {"question_id": "sample_125_a108_q0", "video_id": 125, "video_path": "./videos/sample_125_real.mp4", "annotation_index": 108, "question_index": 0, "question": "What is the hand doing just now?", "options": ["A. Painting a landscape.", "B. Blending the background colors.", "C. Painting the subject's face.", "D. Adding details to the hair."], "answer": "D", "time_stamp_s": 366, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_125_a108_q0", "video_id": 125, "time_stamp_s": 366, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "71482d70ad6ef72e4cb45d8816336aecbd12deb8522eb97e8446a6f452eb34a2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0], "recent_frames_sha256": "e7367025a0b9a43b2d61e57bd1a39534b37a7379f82143de6db1c5b51224c8db", "num_recent_frames": 30, "tq": 717805.073443664, "t1": 717811.55502436, "ta": 717811.55502436, "te": 717811.593489378, "first_response_s": 6.481580695952289, "answer_total_s": 6.5200457139872015, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_125_a108_q0", "video_id": 125, "time_stamp_s": 366, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a110a26259399774d9c34c84bbd4f153885fa81ab0155eb98454e39c670ebad1", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A digital painting of a blonde woman with a starry night sky and pink clouds is displayed on a canvas, with a white moon visible.  \n- The scene transitions to a physical sketching process where a hand uses a blue pen to draw a grayscale portrait of a woman on white paper.  \n- A hand holds the sketching paper steady while the other hand meticulously adds details to the portrait, indicating an ongoing artistic process.\n[30-60s] - A hand holds a blue pen, poised above a sketch of a woman's face, indicating the start of a drawing session.  \n- The hand then uses a black pencil to refine the sketch, adding details to the woman's hair and facial features.  \n- A circular object, possibly a pencil eraser, is briefly pointed at the sketch, suggesting an editing or correction action.\n[60-90s] - A hand holds a black circular object steady while another hand uses a red pencil to trace around it on paper.  \n- The black object is then moved to a wooden board, where yellow tape is applied beneath it.  \n- A silver marker is used to draw a circle around the black object on the taped area.\n[90-120s] - A hand uses a fine-tipped brush to color the eye of a sketch, starting with black and transitioning to blue.  \n- The yellow circular object remains stationary on the left side of the sketch.  \n- The sketch depicts a woman's face with long hair, and the coloring focuses on the eye area.\n[120-150s] - Hand holds brush applying dark pigment to eye socket area near eyebrow.  \n- Brush strokes extend from inner to outer edge of eye socket, blending into brow region.  \n- Painted area transitions from dark to lighter brown tones as brush moves across brow.\n[150-180s] - Hand applies brown pigment to eyebrow area using fine brush.  \n- Broad brush sweeps across neck and shoulder region, blending warm tones.  \n- Background shows yellow circular shape (sun) and faint cloud outlines.\n[180-210s] - Artist applies light gray wash to hair strands using a brush, blending from the face outward.  \n- A small yellow circle (sun) remains fixed in the upper left corner of the paper.  \n- Brush strokes transition from the cheek to the jawline, softening the hair’s edge against the background.\n[210-240s] - Hand uses brush to apply pink paint to lower face area, blending into existing color.\n- Brush strokes transition from pink to purple, then to white, creating layered texture on canvas.\n- Painting depicts a woman with blonde hair and blue eyes, partially completed with visible brushwork.\n[240-270s] - Artist’s hand applies dark blue paint along the top edge of the canvas, near the subject’s head.  \n- A small yellow circle (possibly a sun) is visible on the left side of the canvas, beneath the blue paint.  \n- The painting depicts a woman with light hair and a turquoise garment, with pink and purple washes in the background.\n[270-300s] - Artist's hand applies white paint to the subject's hair using a brush, blending it with existing strokes.  \n- The background features a deep blue sky with a small yellow sun and pink cloud-like shapes.  \n- A palette and pencils are visible on the left side of the canvas, indicating ongoing painting activity.\n[300-330s] - Artist’s hand holds a fine brush, applying white paint to the subject’s eyebrow area.  \n- Brush strokes are precise, blending white pigment into the skin tones near the eye.  \n- The subject’s face is partially painted, with white hair and blue eyes visible against a dark background.\n[330-360s] - Artist's hand applies white paint to the subject's hair with a fine brush, blending strands near the face.\n- Brush strokes transition from the subject's cheek to the neck area, adding subtle shading and texture.\n- Background features vibrant pink and blue hues, contrasting with the subject's pale hair and skin tones.", "history_tokens": 871, "history_utf8_bytes": 3797, "recent_frame_times_s": [337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0], "recent_frames_sha256": "e7367025a0b9a43b2d61e57bd1a39534b37a7379f82143de6db1c5b51224c8db", "num_recent_frames": 30, "tq": 717725.319070791, "t1": 717731.83772679, "ta": 717731.83772679, "te": 717732.02770021, "first_response_s": 6.518655998981558, "answer_total_s": 6.708629418979399, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 125, "content_group": "6a79da2dd7352dc452787c16d12f78ba8766195d3abb7f638f827fb8218e2f43", "question": {"question_id": "sample_125_a108_q1", "video_id": 125, "video_path": "./videos/sample_125_real.mp4", "annotation_index": 108, "question_index": 1, "question": "What is the hand doing when it shifts focus to the lower part of the painting?", "options": ["A. Adding texture to the hair.", "B. Painting broad strokes with pink and purple hues.", "C. Detailing the woman's face.", "D. Refining the transition between background colors."], "answer": "B", "time_stamp_s": 387, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_125_a108_q1", "video_id": 125, "time_stamp_s": 387, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "22780b7f1f75c8664098aa7c078a48b5523cb6afff0259daf6866a270f0c6071", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0], "recent_frames_sha256": "13758e31f55705472d23db9faa0586eef7ed9d061dfa20ddf7bc8a0bf555f728", "num_recent_frames": 30, "tq": 717811.609113435, "t1": 717823.440897305, "ta": 717823.440897305, "te": 717823.479337785, "first_response_s": 11.831783870002255, "answer_total_s": 11.870224350015633, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_125_a108_q1", "video_id": 125, "time_stamp_s": 387, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "277e51863de4bd79b24e6db871bc273c7554ee5ac230a569559972a2cdd69bd8", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A digital painting of a blonde woman with a starry night sky and pink clouds is displayed on a canvas, with a white moon visible.  \n- The scene transitions to a physical sketching process where a hand uses a blue pen to draw a grayscale portrait of a woman on white paper.  \n- A hand holds the sketching paper steady while the other hand meticulously adds details to the portrait, indicating an ongoing artistic process.\n[30-60s] - A hand holds a blue pen, poised above a sketch of a woman's face, indicating the start of a drawing session.  \n- The hand then uses a black pencil to refine the sketch, adding details to the woman's hair and facial features.  \n- A circular object, possibly a pencil eraser, is briefly pointed at the sketch, suggesting an editing or correction action.\n[60-90s] - A hand holds a black circular object steady while another hand uses a red pencil to trace around it on paper.  \n- The black object is then moved to a wooden board, where yellow tape is applied beneath it.  \n- A silver marker is used to draw a circle around the black object on the taped area.\n[90-120s] - A hand uses a fine-tipped brush to color the eye of a sketch, starting with black and transitioning to blue.  \n- The yellow circular object remains stationary on the left side of the sketch.  \n- The sketch depicts a woman's face with long hair, and the coloring focuses on the eye area.\n[120-150s] - Hand holds brush applying dark pigment to eye socket area near eyebrow.  \n- Brush strokes extend from inner to outer edge of eye socket, blending into brow region.  \n- Painted area transitions from dark to lighter brown tones as brush moves across brow.\n[150-180s] - Hand applies brown pigment to eyebrow area using fine brush.  \n- Broad brush sweeps across neck and shoulder region, blending warm tones.  \n- Background shows yellow circular shape (sun) and faint cloud outlines.\n[180-210s] - Artist applies light gray wash to hair strands using a brush, blending from the face outward.  \n- A small yellow circle (sun) remains fixed in the upper left corner of the paper.  \n- Brush strokes transition from the cheek to the jawline, softening the hair’s edge against the background.\n[210-240s] - Hand uses brush to apply pink paint to lower face area, blending into existing color.\n- Brush strokes transition from pink to purple, then to white, creating layered texture on canvas.\n- Painting depicts a woman with blonde hair and blue eyes, partially completed with visible brushwork.\n[240-270s] - Artist’s hand applies dark blue paint along the top edge of the canvas, near the subject’s head.  \n- A small yellow circle (possibly a sun) is visible on the left side of the canvas, beneath the blue paint.  \n- The painting depicts a woman with light hair and a turquoise garment, with pink and purple washes in the background.\n[270-300s] - Artist's hand applies white paint to the subject's hair using a brush, blending it with existing strokes.  \n- The background features a deep blue sky with a small yellow sun and pink cloud-like shapes.  \n- A palette and pencils are visible on the left side of the canvas, indicating ongoing painting activity.\n[300-330s] - Artist’s hand holds a fine brush, applying white paint to the subject’s eyebrow area.  \n- Brush strokes are precise, blending white pigment into the skin tones near the eye.  \n- The subject’s face is partially painted, with white hair and blue eyes visible against a dark background.\n[330-360s] - Artist's hand applies white paint to the subject's hair with a fine brush, blending strands near the face.\n- Brush strokes transition from the subject's cheek to the neck area, adding subtle shading and texture.\n- Background features vibrant pink and blue hues, contrasting with the subject's pale hair and skin tones.", "history_tokens": 871, "history_utf8_bytes": 3797, "recent_frame_times_s": [358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0], "recent_frames_sha256": "13758e31f55705472d23db9faa0586eef7ed9d061dfa20ddf7bc8a0bf555f728", "num_recent_frames": 30, "tq": 717732.047052867, "t1": 717739.323958688, "ta": 717739.323958688, "te": 717739.361801263, "first_response_s": 7.276905820937827, "answer_total_s": 7.314748395932838, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 125, "content_group": "6a79da2dd7352dc452787c16d12f78ba8766195d3abb7f638f827fb8218e2f43", "question": {"question_id": "sample_125_a109_q0", "video_id": 125, "video_path": "./videos/sample_125_real.mp4", "annotation_index": 109, "question_index": 0, "question": "Which of the following best summarizes the painting shown in the video?", "options": ["A. A detailed painting of a woman with blonde hair on a dark blue background with a full moon and clouds.", "B. A landscape painting with mountains and rivers.", "C. An abstract painting with vibrant colors and shapes.", "D. A close-up portrait of an elderly man."], "answer": "A", "time_stamp_s": 560, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_125_a109_q0", "video_id": 125, "time_stamp_s": 560, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5c5f4176af9175d10b77a48bd380d0770313411b32b24838c8d80647fe1211be", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0], "recent_frames_sha256": "454a0c2e9e2dd0d13b25826d9cb2767863c8f803fd112327f6d3036a4ba10418", "num_recent_frames": 30, "tq": 717823.494201237, "t1": 717861.655079343, "ta": 717861.655079343, "te": 717861.841581743, "first_response_s": 38.16087810602039, "answer_total_s": 38.34738050599117, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_125_a109_q0", "video_id": 125, "time_stamp_s": 560, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "522e1dcd43b9958ca5155572cd9fce6b33c561b20f5c61d1bf93b2b793d90e70", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A hand uses a fine-tipped brush to color the eye of a sketch, starting with black and transitioning to blue.  \n- The yellow circular object remains stationary on the left side of the sketch.  \n- The sketch depicts a woman's face with long hair, and the coloring focuses on the eye area.\n[120-150s] - Hand holds brush applying dark pigment to eye socket area near eyebrow.  \n- Brush strokes extend from inner to outer edge of eye socket, blending into brow region.  \n- Painted area transitions from dark to lighter brown tones as brush moves across brow.\n[150-180s] - Hand applies brown pigment to eyebrow area using fine brush.  \n- Broad brush sweeps across neck and shoulder region, blending warm tones.  \n- Background shows yellow circular shape (sun) and faint cloud outlines.\n[180-210s] - Artist applies light gray wash to hair strands using a brush, blending from the face outward.  \n- A small yellow circle (sun) remains fixed in the upper left corner of the paper.  \n- Brush strokes transition from the cheek to the jawline, softening the hair’s edge against the background.\n[210-240s] - Hand uses brush to apply pink paint to lower face area, blending into existing color.\n- Brush strokes transition from pink to purple, then to white, creating layered texture on canvas.\n- Painting depicts a woman with blonde hair and blue eyes, partially completed with visible brushwork.\n[240-270s] - Artist’s hand applies dark blue paint along the top edge of the canvas, near the subject’s head.  \n- A small yellow circle (possibly a sun) is visible on the left side of the canvas, beneath the blue paint.  \n- The painting depicts a woman with light hair and a turquoise garment, with pink and purple washes in the background.\n[270-300s] - Artist's hand applies white paint to the subject's hair using a brush, blending it with existing strokes.  \n- The background features a deep blue sky with a small yellow sun and pink cloud-like shapes.  \n- A palette and pencils are visible on the left side of the canvas, indicating ongoing painting activity.\n[300-330s] - Artist’s hand holds a fine brush, applying white paint to the subject’s eyebrow area.  \n- Brush strokes are precise, blending white pigment into the skin tones near the eye.  \n- The subject’s face is partially painted, with white hair and blue eyes visible against a dark background.\n[330-360s] - Artist's hand applies white paint to the subject's hair with a fine brush, blending strands near the face.\n- Brush strokes transition from the subject's cheek to the neck area, adding subtle shading and texture.\n- Background features vibrant pink and blue hues, contrasting with the subject's pale hair and skin tones.\n[360-390s] - Hand holds brush, applying white paint to blonde hair strands near the subject's forehead.\n- Brush strokes transition from white to pinkish-purple hues on the canvas's lower section.\n- Pink and blue paint areas blend visibly beneath the subject's hair, suggesting atmospheric background work.\n[390-420s] - Artist’s hand applies white paint to the subject’s hair using a brush, blending it with existing strokes.  \n- The canvas shows a portrait with a dark blue background and pink-purple clouds, partially completed.  \n- A palette with paint colors is visible to the right, indicating ongoing painting activity.\n[420-450s] - Artist applies white paint to the subject's hair using a flat brush, blending strokes for texture.  \n- Pink cloud-like shapes are visible in the background, contrasting with the dark blue sky.  \n- A palette with mixed colors rests to the right, indicating ongoing painting activity.\n[450-480s] - Artist applies paint to the subject's hair with a brush, blending tones for depth.  \n- Pink clouds are visible beneath the subject’s head, contrasting with the dark blue sky.  \n- A palette and additional brushes are positioned to the right of the canvas.\n[480-510s] - Hand uses brush to apply white paint to a dark blue canvas area.  \n- Brush strokes are deliberate, spreading paint in a circular pattern.  \n- White paint forms a small, distinct circle on the dark surface.\n[510-540s] - A paintbrush applies white paint to a dark surface, forming a circular shape.  \n- A hand holds a small, metallic tool near the painted circle, poised for interaction.  \n- The tool is positioned above the paint, suggesting an impending action like piercing or marking.", "history_tokens": 1004, "history_utf8_bytes": 4394, "recent_frame_times_s": [531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0], "recent_frames_sha256": "454a0c2e9e2dd0d13b25826d9cb2767863c8f803fd112327f6d3036a4ba10418", "num_recent_frames": 30, "tq": 717789.954146362, "t1": 717791.795795649, "ta": 717791.795795649, "te": 717792.00041583, "first_response_s": 1.8416492870310321, "answer_total_s": 2.0462694680318236, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 126, "content_group": "6fab3004a54a99cb7150251a6dbfa7ccbf32052996aacc1d425f168d4b41f1c1", "question": {"question_id": "sample_126_a474_q0", "video_id": 126, "video_path": "./videos/sample_126_real.mp4", "annotation_index": 474, "question_index": 0, "question": "What is the artist doing with the gold leaf in the video?", "options": ["A. Applying it to a painted surface.", "B. Cutting it into smaller pieces.", "C. Mixing it with paint.", "D. Discarding it."], "answer": "A", "time_stamp_s": 8, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_126_a474_q0", "video_id": 126, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f19d521ee59160bbffdbf9cd67b374394721fa1e28ba4cb3c78bb8272c22a5ca", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0], "recent_frames_sha256": "d0812a0266fc077049d5975860f2eb2ceb61ec5e667ed7ee5fb549c744bdee34", "num_recent_frames": 9, "tq": 718226.058542387, "t1": 718232.424358944, "ta": 718232.424358944, "te": 718232.460224012, "first_response_s": 6.365816556965001, "answer_total_s": 6.401681625051424, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_126_a474_q0", "video_id": 126, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6b5c38e35b620f4efb2ad8c8263ea243fdd00985511f13a116c4e4ff3f582e08", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0], "recent_frames_sha256": "d0812a0266fc077049d5975860f2eb2ceb61ec5e667ed7ee5fb549c744bdee34", "num_recent_frames": 9, "tq": 718059.171276634, "t1": 718067.24589388, "ta": 718067.24589388, "te": 718067.562926191, "first_response_s": 8.074617246049456, "answer_total_s": 8.39164955704473, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 126, "content_group": "6fab3004a54a99cb7150251a6dbfa7ccbf32052996aacc1d425f168d4b41f1c1", "question": {"question_id": "sample_126_a475_q0", "video_id": 126, "video_path": "./videos/sample_126_real.mp4", "annotation_index": 475, "question_index": 0, "question": "What is the sequence of actions just performed by the artist?", "options": ["A. Painting the background, then the nose, followed by the cheek, and finally the forehead.", "B. Painting the nose, then the cheek, followed by the forehead.", "C. Painting the forehead, then the nose, followed by the cheek.", "D. Painting the cheek, then the forehead, followed by the nose."], "answer": "B", "time_stamp_s": 180, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_126_a475_q0", "video_id": 126, "time_stamp_s": 180, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "57e4774715fa438801d748c4cc70514b2985787a103ab9535aec5e90d0fc9d3d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "f9981b4f1d805f161044698a4bfaba6ea3ba2713b88cf0f2adaa2fa2b136238a", "num_recent_frames": 30, "tq": 718232.483317982, "t1": 718244.693205446, "ta": 718244.693205446, "te": 718244.732610065, "first_response_s": 12.20988746394869, "answer_total_s": 12.249292082968168, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_126_a475_q0", "video_id": 126, "time_stamp_s": 180, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d3682b11f53fbfcc679aac5ab6ade448e421bddd3adc707aa71cb3bf3b3c6677", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hand applies gold paint to a white canvas using a brush, then uses a hairdryer to dry the surface.  \n- A hand uses a pencil to sketch on a wooden board, then applies gold leaf to a painted area.  \n- A hand holds a gold leaf sheet over a black cloth, with gold leaf flakes visible on the surface.\n[30-60s] - Hand uses a white marker to trace a printed image onto a wooden board.  \n- Tape is applied over the traced outline, then carefully cut with a craft knife to reveal the design.  \n- A pencil is used to refine the traced lines on the wood after the tape is removed.\n[60-90s] - Hand holds brush, applying dark brown pigment to wooden surface near sketch outline.  \n- Brush strokes vary in pressure, creating textured, uneven application of pigment.  \n- Sketch lines on wood remain faintly visible beneath the applied pigment.\n[90-120s] - Artist applies dark brown paint to a wooden surface, building up hair and facial features from sketch lines.\n- Brush strokes transition from concentrated areas near the ear to broader sections covering the head and neck.\n- Text overlay \"SKIN COLOR(S)\" appears briefly, indicating the current painting phase.\n[120-150s] - A hand holds a paintbrush applying dark brown pigment to a wooden surface, near a sculpted ear.  \n- The brush strokes are deliberate, blending pigment into the wood grain, with stray hairs visible on the surface.  \n- A partially painted ear model rests on the wood, showing defined contours and shading.\n[150-180s] - Artist’s hand applies brown paint to the canvas, blending it into the ear and hair area.  \n- Brush strokes transition from darker to lighter shades, defining facial contours.  \n- Painted ear and hair show emerging depth, with brush moving along the cheekbone line.", "history_tokens": 403, "history_utf8_bytes": 1755, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "f9981b4f1d805f161044698a4bfaba6ea3ba2713b88cf0f2adaa2fa2b136238a", "num_recent_frames": 30, "tq": 718118.392725314, "t1": 718132.502641781, "ta": 718132.502641781, "te": 718132.652739478, "first_response_s": 14.10991646698676, "answer_total_s": 14.26001416402869, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 126, "content_group": "6fab3004a54a99cb7150251a6dbfa7ccbf32052996aacc1d425f168d4b41f1c1", "question": {"question_id": "sample_126_a476_q0", "video_id": 126, "video_path": "./videos/sample_126_real.mp4", "annotation_index": 476, "question_index": 0, "question": "What did the artist do just now?", "options": ["A. Sketching the ear.", "B. Applying meticulous strokes to the ear area.", "C. Cleaning the paintbrush.", "D. Painting the background."], "answer": "B", "time_stamp_s": 338, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_126_a476_q0", "video_id": 126, "time_stamp_s": 338, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "92bc1cdd7fe5679a69bc58f0460ecd8a4291163ed2e5695dfd455fa556deafac", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0], "recent_frames_sha256": "c06a985a89ff12538ce53896630f15075ea39494a3bb8a43b5ff75fccc169915", "num_recent_frames": 30, "tq": 718244.743648944, "t1": 718257.407500373, "ta": 718257.407500373, "te": 718257.445123991, "first_response_s": 12.66385142900981, "answer_total_s": 12.70147504704073, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_126_a476_q0", "video_id": 126, "time_stamp_s": 338, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a638d225b1c149e7575c3beaf559a86959d9d36b64a6033b0e3b80a1ec3972fe", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hand applies gold paint to a white canvas using a brush, then uses a hairdryer to dry the surface.  \n- A hand uses a pencil to sketch on a wooden board, then applies gold leaf to a painted area.  \n- A hand holds a gold leaf sheet over a black cloth, with gold leaf flakes visible on the surface.\n[30-60s] - Hand uses a white marker to trace a printed image onto a wooden board.  \n- Tape is applied over the traced outline, then carefully cut with a craft knife to reveal the design.  \n- A pencil is used to refine the traced lines on the wood after the tape is removed.\n[60-90s] - Hand holds brush, applying dark brown pigment to wooden surface near sketch outline.  \n- Brush strokes vary in pressure, creating textured, uneven application of pigment.  \n- Sketch lines on wood remain faintly visible beneath the applied pigment.\n[90-120s] - Artist applies dark brown paint to a wooden surface, building up hair and facial features from sketch lines.\n- Brush strokes transition from concentrated areas near the ear to broader sections covering the head and neck.\n- Text overlay \"SKIN COLOR(S)\" appears briefly, indicating the current painting phase.\n[120-150s] - A hand holds a paintbrush applying dark brown pigment to a wooden surface, near a sculpted ear.  \n- The brush strokes are deliberate, blending pigment into the wood grain, with stray hairs visible on the surface.  \n- A partially painted ear model rests on the wood, showing defined contours and shading.\n[150-180s] - Artist’s hand applies brown paint to the canvas, blending it into the ear and hair area.  \n- Brush strokes transition from darker to lighter shades, defining facial contours.  \n- Painted ear and hair show emerging depth, with brush moving along the cheekbone line.\n[180-210s] - Hand holds brush applying brown paint to ear and neck area of portrait.  \n- Brush strokes blend into existing warm-toned background, enhancing depth.  \n- Portrait’s side profile shows progressive layering of paint on wooden surface.\n[210-240s] - Painter applies brush strokes to ear and hair area, blending colors for depth.  \n- Text overlay reads \"LEAFY YELLOWS & BACKGROUND BLUES\" over the portrait.  \n- Brush moves across canvas, adding texture and tone to the subject’s profile.\n[240-270s] - Artist applies orange paint to the subject's hair using a brush, blending it into existing yellow areas.  \n- The painting is on a wooden surface, with visible sketch lines and partially completed sections.  \n- Tools and brushes are arranged on the right side of the canvas, indicating an active painting session.\n[270-300s] - Artist's hand uses a brush to apply white paint to the subject's ear, enhancing its contours.  \n- A green-handled brush is used to refine the ear's inner details, showing careful attention to texture.  \n- The painting features warm tones with scattered yellow and orange leaf-like shapes around the subject's head.\n[300-330s] - A hand holds a green-handled brush, applying paint to the inner curve of an ear in a portrait.  \n- The ear is rendered in warm tones, contrasting with surrounding dark hair and yellow background.  \n- Brush strokes are precise, focusing on defining the ear’s contours and shadows.", "history_tokens": 739, "history_utf8_bytes": 3204, "recent_frame_times_s": [309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0], "recent_frames_sha256": "c06a985a89ff12538ce53896630f15075ea39494a3bb8a43b5ff75fccc169915", "num_recent_frames": 30, "tq": 718170.329387929, "t1": 718171.725021004, "ta": 718171.725021004, "te": 718171.951945163, "first_response_s": 1.3956330749206245, "answer_total_s": 1.6225572339026257, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 126, "content_group": "6fab3004a54a99cb7150251a6dbfa7ccbf32052996aacc1d425f168d4b41f1c1", "question": {"question_id": "sample_126_a477_q0", "video_id": 126, "video_path": "./videos/sample_126_real.mp4", "annotation_index": 477, "question_index": 0, "question": "Where are the other brushes and pencils located in relation to the artwork?", "options": ["A. On a shelf above the artwork.", "B. Scattered around the artwork on the table.", "C. Inside a drawer next to the table.", "D. Held in the artist's other hand."], "answer": "B", "time_stamp_s": 490, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_126_a477_q0", "video_id": 126, "time_stamp_s": 490, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0cf7459e12e7925b8a07358b240830c77e9ae0870a40ba40e1bece2a3e6edf44", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0], "recent_frames_sha256": "5123b3e286ebcd7fa4e548d8a44da9eac30be117ca76dea9143232dd03421751", "num_recent_frames": 30, "tq": 718257.455092616, "t1": 718265.321666095, "ta": 718265.321666095, "te": 718265.361342985, "first_response_s": 7.866573479026556, "answer_total_s": 7.906250368920155, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_126_a477_q0", "video_id": 126, "time_stamp_s": 490, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fa83cd038987f386e376e012780646b5726b714d4dff2c903c6545db47020e37", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Hand uses a white marker to trace a printed image onto a wooden board.  \n- Tape is applied over the traced outline, then carefully cut with a craft knife to reveal the design.  \n- A pencil is used to refine the traced lines on the wood after the tape is removed.\n[60-90s] - Hand holds brush, applying dark brown pigment to wooden surface near sketch outline.  \n- Brush strokes vary in pressure, creating textured, uneven application of pigment.  \n- Sketch lines on wood remain faintly visible beneath the applied pigment.\n[90-120s] - Artist applies dark brown paint to a wooden surface, building up hair and facial features from sketch lines.\n- Brush strokes transition from concentrated areas near the ear to broader sections covering the head and neck.\n- Text overlay \"SKIN COLOR(S)\" appears briefly, indicating the current painting phase.\n[120-150s] - A hand holds a paintbrush applying dark brown pigment to a wooden surface, near a sculpted ear.  \n- The brush strokes are deliberate, blending pigment into the wood grain, with stray hairs visible on the surface.  \n- A partially painted ear model rests on the wood, showing defined contours and shading.\n[150-180s] - Artist’s hand applies brown paint to the canvas, blending it into the ear and hair area.  \n- Brush strokes transition from darker to lighter shades, defining facial contours.  \n- Painted ear and hair show emerging depth, with brush moving along the cheekbone line.\n[180-210s] - Hand holds brush applying brown paint to ear and neck area of portrait.  \n- Brush strokes blend into existing warm-toned background, enhancing depth.  \n- Portrait’s side profile shows progressive layering of paint on wooden surface.\n[210-240s] - Painter applies brush strokes to ear and hair area, blending colors for depth.  \n- Text overlay reads \"LEAFY YELLOWS & BACKGROUND BLUES\" over the portrait.  \n- Brush moves across canvas, adding texture and tone to the subject’s profile.\n[240-270s] - Artist applies orange paint to the subject's hair using a brush, blending it into existing yellow areas.  \n- The painting is on a wooden surface, with visible sketch lines and partially completed sections.  \n- Tools and brushes are arranged on the right side of the canvas, indicating an active painting session.\n[270-300s] - Artist's hand uses a brush to apply white paint to the subject's ear, enhancing its contours.  \n- A green-handled brush is used to refine the ear's inner details, showing careful attention to texture.  \n- The painting features warm tones with scattered yellow and orange leaf-like shapes around the subject's head.\n[300-330s] - A hand holds a green-handled brush, applying paint to the inner curve of an ear in a portrait.  \n- The ear is rendered in warm tones, contrasting with surrounding dark hair and yellow background.  \n- Brush strokes are precise, focusing on defining the ear’s contours and shadows.\n[330-360s] - A green-handled brush applies paint to the ear's inner curve, blending tones with visible strokes.  \n- The brush then moves to the nose area, adding subtle shading near the nostril and bridge.  \n- A palette knife is used to spread yellow paint across the canvas, likely for background or base layer.\n[360-390s] - Artist applies yellow paint to a leaf on the canvas using a brush.  \n- Leaves are positioned on the subject’s head and shoulder, with some already painted in orange and yellow.  \n- A palette with mixed paint and a roll of tape are visible nearby on the work surface.\n[390-420s] - Hand uses a fine brush to apply a clear, glossy substance over a leaf-shaped area on a black background.  \n- A text overlay reads \"MAKE IT GOLD\" while the artist works.  \n- The leaf is partially covered with a golden hue, indicating a gilding or highlighting process.\n[420-450s] - Hand applies gold leaf to a painted surface using a brush, spreading it over a black background with orange and yellow leaf shapes.\n- Gold leaf is lifted from its backing paper, revealing its metallic sheen and thin, flexible nature.\n- Brush strokes are deliberate, ensuring even coverage of the gold leaf on the artwork.\n[450-480s] - A black brush scrapes gold leaf fragments from a palette onto a dark surface.  \n- Gold leaf pieces are arranged in leaf-like shapes on a black background.  \n- A hand uses a fine brush to apply orange paint to the hair area of a portrait.", "history_tokens": 1010, "history_utf8_bytes": 4360, "recent_frame_times_s": [461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0], "recent_frames_sha256": "5123b3e286ebcd7fa4e548d8a44da9eac30be117ca76dea9143232dd03421751", "num_recent_frames": 30, "tq": 718216.296659976, "t1": 718218.78657583, "ta": 718218.78657583, "te": 718218.826176454, "first_response_s": 2.4899158539483324, "answer_total_s": 2.5295164779527113, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 126, "content_group": "6fab3004a54a99cb7150251a6dbfa7ccbf32052996aacc1d425f168d4b41f1c1", "question": {"question_id": "sample_126_a477_q1", "video_id": 126, "video_path": "./videos/sample_126_real.mp4", "annotation_index": 477, "question_index": 1, "question": "Which of the following best summarizes the painting shown in the video?", "options": ["A. A detailed painting of a woman with blonde hair on a dark blue background with a full moon and clouds.", "B. A landscape painting with mountains and rivers.", "C. A detailed illustration of a woman's profile with leaves in her hair being painted.", "D. A close-up portrait of an elderly man."], "answer": "C", "time_stamp_s": 500, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_126_a477_q1", "video_id": 126, "time_stamp_s": 500, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "56fcf6efe34226c7e460413775789948ca7b170ab84c23e4c1f36a2439bc46ad", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0], "recent_frames_sha256": "2a9b05577cf058ca00c1edef2555e5a7a8ccba2733fed05e08e082e3f9139f24", "num_recent_frames": 30, "tq": 718265.369858422, "t1": 718278.454053009, "ta": 718278.454053009, "te": 718278.492323398, "first_response_s": 13.084194587077945, "answer_total_s": 13.122464976040646, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_126_a477_q1", "video_id": 126, "time_stamp_s": 500, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "32ab4ca4d6047e3f560f9ceba12eaf16c9129ad660abd7b382d50588c2112ee9", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Hand uses a white marker to trace a printed image onto a wooden board.  \n- Tape is applied over the traced outline, then carefully cut with a craft knife to reveal the design.  \n- A pencil is used to refine the traced lines on the wood after the tape is removed.\n[60-90s] - Hand holds brush, applying dark brown pigment to wooden surface near sketch outline.  \n- Brush strokes vary in pressure, creating textured, uneven application of pigment.  \n- Sketch lines on wood remain faintly visible beneath the applied pigment.\n[90-120s] - Artist applies dark brown paint to a wooden surface, building up hair and facial features from sketch lines.\n- Brush strokes transition from concentrated areas near the ear to broader sections covering the head and neck.\n- Text overlay \"SKIN COLOR(S)\" appears briefly, indicating the current painting phase.\n[120-150s] - A hand holds a paintbrush applying dark brown pigment to a wooden surface, near a sculpted ear.  \n- The brush strokes are deliberate, blending pigment into the wood grain, with stray hairs visible on the surface.  \n- A partially painted ear model rests on the wood, showing defined contours and shading.\n[150-180s] - Artist’s hand applies brown paint to the canvas, blending it into the ear and hair area.  \n- Brush strokes transition from darker to lighter shades, defining facial contours.  \n- Painted ear and hair show emerging depth, with brush moving along the cheekbone line.\n[180-210s] - Hand holds brush applying brown paint to ear and neck area of portrait.  \n- Brush strokes blend into existing warm-toned background, enhancing depth.  \n- Portrait’s side profile shows progressive layering of paint on wooden surface.\n[210-240s] - Painter applies brush strokes to ear and hair area, blending colors for depth.  \n- Text overlay reads \"LEAFY YELLOWS & BACKGROUND BLUES\" over the portrait.  \n- Brush moves across canvas, adding texture and tone to the subject’s profile.\n[240-270s] - Artist applies orange paint to the subject's hair using a brush, blending it into existing yellow areas.  \n- The painting is on a wooden surface, with visible sketch lines and partially completed sections.  \n- Tools and brushes are arranged on the right side of the canvas, indicating an active painting session.\n[270-300s] - Artist's hand uses a brush to apply white paint to the subject's ear, enhancing its contours.  \n- A green-handled brush is used to refine the ear's inner details, showing careful attention to texture.  \n- The painting features warm tones with scattered yellow and orange leaf-like shapes around the subject's head.\n[300-330s] - A hand holds a green-handled brush, applying paint to the inner curve of an ear in a portrait.  \n- The ear is rendered in warm tones, contrasting with surrounding dark hair and yellow background.  \n- Brush strokes are precise, focusing on defining the ear’s contours and shadows.\n[330-360s] - A green-handled brush applies paint to the ear's inner curve, blending tones with visible strokes.  \n- The brush then moves to the nose area, adding subtle shading near the nostril and bridge.  \n- A palette knife is used to spread yellow paint across the canvas, likely for background or base layer.\n[360-390s] - Artist applies yellow paint to a leaf on the canvas using a brush.  \n- Leaves are positioned on the subject’s head and shoulder, with some already painted in orange and yellow.  \n- A palette with mixed paint and a roll of tape are visible nearby on the work surface.\n[390-420s] - Hand uses a fine brush to apply a clear, glossy substance over a leaf-shaped area on a black background.  \n- A text overlay reads \"MAKE IT GOLD\" while the artist works.  \n- The leaf is partially covered with a golden hue, indicating a gilding or highlighting process.\n[420-450s] - Hand applies gold leaf to a painted surface using a brush, spreading it over a black background with orange and yellow leaf shapes.\n- Gold leaf is lifted from its backing paper, revealing its metallic sheen and thin, flexible nature.\n- Brush strokes are deliberate, ensuring even coverage of the gold leaf on the artwork.\n[450-480s] - A black brush scrapes gold leaf fragments from a palette onto a dark surface.  \n- Gold leaf pieces are arranged in leaf-like shapes on a black background.  \n- A hand uses a fine brush to apply orange paint to the hair area of a portrait.", "history_tokens": 1010, "history_utf8_bytes": 4360, "recent_frame_times_s": [471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0], "recent_frames_sha256": "2a9b05577cf058ca00c1edef2555e5a7a8ccba2733fed05e08e082e3f9139f24", "num_recent_frames": 30, "tq": 718218.845399064, "t1": 718225.69619201, "ta": 718225.69619201, "te": 718226.039639936, "first_response_s": 6.850792945944704, "answer_total_s": 7.194240871933289, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 127, "content_group": "41f30c65958cee6f9f680a18704de9411333733e006ce0a7183ad41e165ef78a", "question": {"question_id": "sample_127_a20_q0", "video_id": 127, "video_path": "./videos/sample_127_real.mp4", "annotation_index": 20, "question_index": 0, "question": "What colo was added to the eyes of the sketched portrait?", "options": ["A. Green.", "B. Brown.", "C. Blue.", "D. Hazel."], "answer": "C", "time_stamp_s": 20, "task_type": "Attribute Recognition", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_127_a20_q0", "video_id": 127, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a3be6704bde916db66a0e45c32b46bc03cdda798363d5045f588fd3d168d99ef", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019], "recent_frames_sha256": "9ce9d5746aae560c33cb29e9ce52757a1555b2c9ae2f1a31d8fadf44f3c53201", "num_recent_frames": 20, "tq": 710409.807466652, "t1": 710410.533193654, "ta": 710410.533193654, "te": 710410.573817156, "first_response_s": 0.725727002019994, "answer_total_s": 0.7663505040109158, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_127_a20_q0", "video_id": 127, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2248d9dab74d3dd5ee190a31f9e15b52572df8f78ac7ab0813a257d2049b846a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019], "recent_frames_sha256": "9ce9d5746aae560c33cb29e9ce52757a1555b2c9ae2f1a31d8fadf44f3c53201", "num_recent_frames": 20, "tq": 710221.450601947, "t1": 710227.782350978, "ta": 710227.782350978, "te": 710227.828134234, "first_response_s": 6.331749030970968, "answer_total_s": 6.377532286918722, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 127, "content_group": "41f30c65958cee6f9f680a18704de9411333733e006ce0a7183ad41e165ef78a", "question": {"question_id": "sample_127_a21_q0", "video_id": 127, "video_path": "./videos/sample_127_real.mp4", "annotation_index": 21, "question_index": 0, "question": "What action is the paintbrush performing right now?", "options": ["A. Adding details to the hair.", "B. Coloring the lips.", "C. Adding details to the nose.", "D. Shading the background."], "answer": "C", "time_stamp_s": 229, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_127_a21_q0", "video_id": 127, "time_stamp_s": 229, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7948a4f272ee12abd3a7583e2e083c61a43581c2b9facaf76a9e3a560b5050ce", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278], "recent_frames_sha256": "de4e22839305c7042168ae2f572b555e2a3c107bb936a82aeb476bb54bae062e", "num_recent_frames": 30, "tq": 710410.598897006, "t1": 710423.531331674, "ta": 710423.531331674, "te": 710423.57141571, "first_response_s": 12.932434667949565, "answer_total_s": 12.972518704016693, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_127_a21_q0", "video_id": 127, "time_stamp_s": 229, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9ce581dd7c852673aa51ba573a53bbcfaadbc38783354b149db1944cd1af6215", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A pencil sketch of a woman's face is being colored with a brush, starting with the eyes.  \n- The brush applies blue pigment to the left eye, then moves to the right eye, both with defined eyeliner.  \n- The Squarespace logo is overlaid on the screen during the painting process.\n[30-60s] - Artist applies dark blue pigment along the upper eyelid line of a sketch, extending from the inner corner outward.  \n- Brush strokes transition from the inner to outer edge of the eye, creating a defined winged eyeliner effect.  \n- The painting surface remains static, with the brush moving precisely to enhance the eye's contour.\n[60-90s] - Artist applies dark blue pigment to the upper eyelid area of a sketch, enhancing the eye's depth.  \n- A second brush strokes reddish-brown pigment along the eyebrow line, defining its shape.  \n- The artist begins painting the lips with a reddish-brown hue, starting from the center and extending outward.\n[90-120s] - A paintbrush applies red pigment to the lips, enhancing their color and definition.  \n- The artist’s hand moves steadily, indicating careful application of paint to the canvas.  \n- The canvas features a partially completed portrait with bold eye makeup and defined lips.\n[120-150s] - A paintbrush applies dark pigment to the upper eyelid area of a portrait, enhancing the eye's shadow.\n- The brush then moves to the nose, applying color to the bridge and tip, refining the facial structure.\n- The brush continues to work on the nose, adding subtle shading to define its contours.\n[150-180s] - A paintbrush applies reddish-brown pigment to the right cheek area of a portrait, blending it into the skin tone.  \n- The brush strokes move from the outer edge of the cheek inward, gradually covering the white canvas beneath the outline.  \n- The artist’s hand remains steady, focusing on the transition between the painted and unpainted sections of the face.\n[180-210s] - A paintbrush applies reddish-brown pigment to the canvas, focusing on the woman's cheek area.  \n- The brush moves horizontally across the cheek, blending color with visible strokes.  \n- The woman's face remains partially outlined, with eyes and lips already colored.", "history_tokens": 503, "history_utf8_bytes": 2194, "recent_frame_times_s": [199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278], "recent_frames_sha256": "de4e22839305c7042168ae2f572b555e2a3c107bb936a82aeb476bb54bae062e", "num_recent_frames": 30, "tq": 710278.842426276, "t1": 710291.251893003, "ta": 710291.251893003, "te": 710291.451039305, "first_response_s": 12.409466727054678, "answer_total_s": 12.608613029005937, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 127, "content_group": "41f30c65958cee6f9f680a18704de9411333733e006ce0a7183ad41e165ef78a", "question": {"question_id": "sample_127_a21_q1", "video_id": 127, "video_path": "./videos/sample_127_real.mp4", "annotation_index": 21, "question_index": 1, "question": "Which parts of the face remain unpainted right now?", "options": ["A. Eyes and lips.", "B. Hair and surrounding skin areas.", "C. Nose and lips.", "D. Eyes and nose."], "answer": "B", "time_stamp_s": 240, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_127_a21_q1", "video_id": 127, "time_stamp_s": 240, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d6fdf7a99656b773097744072663fabeecdfc52a7240d61cc2d94435795e9130", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334], "recent_frames_sha256": "392f0837f975806b608ab2538cae130fe532ae873ce5a5a382112557e62b3e44", "num_recent_frames": 30, "tq": 710423.585768196, "t1": 710435.285500089, "ta": 710435.285500089, "te": 710435.325168635, "first_response_s": 11.699731893022545, "answer_total_s": 11.739400438964367, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_127_a21_q1", "video_id": 127, "time_stamp_s": 240, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "636ecbd8d64a475ae14571980d2c8e68ef5c0b5aa2df6274468bedb6bc9162ab", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A pencil sketch of a woman's face is being colored with a brush, starting with the eyes.  \n- The brush applies blue pigment to the left eye, then moves to the right eye, both with defined eyeliner.  \n- The Squarespace logo is overlaid on the screen during the painting process.\n[30-60s] - Artist applies dark blue pigment along the upper eyelid line of a sketch, extending from the inner corner outward.  \n- Brush strokes transition from the inner to outer edge of the eye, creating a defined winged eyeliner effect.  \n- The painting surface remains static, with the brush moving precisely to enhance the eye's contour.\n[60-90s] - Artist applies dark blue pigment to the upper eyelid area of a sketch, enhancing the eye's depth.  \n- A second brush strokes reddish-brown pigment along the eyebrow line, defining its shape.  \n- The artist begins painting the lips with a reddish-brown hue, starting from the center and extending outward.\n[90-120s] - A paintbrush applies red pigment to the lips, enhancing their color and definition.  \n- The artist’s hand moves steadily, indicating careful application of paint to the canvas.  \n- The canvas features a partially completed portrait with bold eye makeup and defined lips.\n[120-150s] - A paintbrush applies dark pigment to the upper eyelid area of a portrait, enhancing the eye's shadow.\n- The brush then moves to the nose, applying color to the bridge and tip, refining the facial structure.\n- The brush continues to work on the nose, adding subtle shading to define its contours.\n[150-180s] - A paintbrush applies reddish-brown pigment to the right cheek area of a portrait, blending it into the skin tone.  \n- The brush strokes move from the outer edge of the cheek inward, gradually covering the white canvas beneath the outline.  \n- The artist’s hand remains steady, focusing on the transition between the painted and unpainted sections of the face.\n[180-210s] - A paintbrush applies reddish-brown pigment to the canvas, focusing on the woman's cheek area.  \n- The brush moves horizontally across the cheek, blending color with visible strokes.  \n- The woman's face remains partially outlined, with eyes and lips already colored.\n[210-240s] - A paintbrush applies red pigment to the subject's cheek area, blending it into the existing skin tones.  \n- The brush moves horizontally across the canvas, indicating a deliberate blending technique.  \n- A text overlay reads \"2. RED DOT MANIA,\" suggesting a step or theme in the painting process.", "history_tokens": 575, "history_utf8_bytes": 2504, "recent_frame_times_s": [210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334], "recent_frames_sha256": "392f0837f975806b608ab2538cae130fe532ae873ce5a5a382112557e62b3e44", "num_recent_frames": 30, "tq": 710296.841111854, "t1": 710298.094722147, "ta": 710298.094722147, "te": 710298.131793145, "first_response_s": 1.2536102930316702, "answer_total_s": 1.290681291022338, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 127, "content_group": "41f30c65958cee6f9f680a18704de9411333733e006ce0a7183ad41e165ef78a", "question": {"question_id": "sample_127_a22_q0", "video_id": 127, "video_path": "./videos/sample_127_real.mp4", "annotation_index": 22, "question_index": 0, "question": "What is the primary focus of the video?", "options": ["A. The artist mixing paints.", "B. The artist adjusting the background.", "C. The detailed painting of a woman's face.", "D. The artist framing the artwork."], "answer": "C", "time_stamp_s": 460, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_127_a22_q0", "video_id": 127, "time_stamp_s": 460, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8875fe74454c3891d7e6226f9186a9dfe98748ac69ebd4330f9d24c6528e41d2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333, 439.0052333333333, 440.00623333333334, 441.0072333333333, 442.00823333333335, 443.0092333333333, 444.01023333333336, 445.01123333333334, 446.0122333333333, 447.01323333333335, 448.0142333333333, 449.01523333333336, 450.01623333333333, 451.0172333333333, 452.01823333333334, 453.0192333333333, 454.02023333333335, 455.0212333333333, 456.02223333333336, 457.02323333333334, 458.0242333333333, 459.02523333333335], "recent_frames_sha256": "d97618195f622ebdb2af0d2cddf951e012c1ef563388faf32b277cc98bb96e0e", "num_recent_frames": 30, "tq": 710435.339155549, "t1": 710443.754010078, "ta": 710443.754010078, "te": 710443.793767014, "first_response_s": 8.414854529080912, "answer_total_s": 8.454611465102062, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_127_a22_q0", "video_id": 127, "time_stamp_s": 460, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "26d2b0f86ac72c4d02385d83d88381b372914d0c93cdc0aabe26b307c148a10a", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Artist applies dark blue pigment along the upper eyelid line of a sketch, extending from the inner corner outward.  \n- Brush strokes transition from the inner to outer edge of the eye, creating a defined winged eyeliner effect.  \n- The painting surface remains static, with the brush moving precisely to enhance the eye's contour.\n[60-90s] - Artist applies dark blue pigment to the upper eyelid area of a sketch, enhancing the eye's depth.  \n- A second brush strokes reddish-brown pigment along the eyebrow line, defining its shape.  \n- The artist begins painting the lips with a reddish-brown hue, starting from the center and extending outward.\n[90-120s] - A paintbrush applies red pigment to the lips, enhancing their color and definition.  \n- The artist’s hand moves steadily, indicating careful application of paint to the canvas.  \n- The canvas features a partially completed portrait with bold eye makeup and defined lips.\n[120-150s] - A paintbrush applies dark pigment to the upper eyelid area of a portrait, enhancing the eye's shadow.\n- The brush then moves to the nose, applying color to the bridge and tip, refining the facial structure.\n- The brush continues to work on the nose, adding subtle shading to define its contours.\n[150-180s] - A paintbrush applies reddish-brown pigment to the right cheek area of a portrait, blending it into the skin tone.  \n- The brush strokes move from the outer edge of the cheek inward, gradually covering the white canvas beneath the outline.  \n- The artist’s hand remains steady, focusing on the transition between the painted and unpainted sections of the face.\n[180-210s] - A paintbrush applies reddish-brown pigment to the canvas, focusing on the woman's cheek area.  \n- The brush moves horizontally across the cheek, blending color with visible strokes.  \n- The woman's face remains partially outlined, with eyes and lips already colored.\n[210-240s] - A paintbrush applies red pigment to the subject's cheek area, blending it into the existing skin tones.  \n- The brush moves horizontally across the canvas, indicating a deliberate blending technique.  \n- A text overlay reads \"2. RED DOT MANIA,\" suggesting a step or theme in the painting process.\n[240-270s] - A paintbrush applies reddish-brown pigment to the subject's lips, enhancing their color and definition.  \n- The brush strokes are deliberate, focusing on the lower lip's contour and center.  \n- The subject's eyes and forehead remain partially painted, with dark eyeshadow and subtle blush visible.\n[270-300s] - Artist applies reddish-brown paint to the lips using a fine brush.  \n- Brush strokes are deliberate, focusing on the lower lip's contour.  \n- White canvas background contrasts with the partially painted facial features.\n[300-330s] - A paintbrush applies reddish-brown pigment to the lower cheek area of a portrait canvas.  \n- The brush strokes are deliberate, moving horizontally across the cheek to blend color.  \n- The portrait features white hair, dark eye makeup, and red lips, with the cheek being the focal point of the current action.\n[330-360s] - Artist applies reddish-brown paint to the subject's lips using a fine brush.  \n- The canvas shows partial color application on the face, with white lines still visible around the eyes and hair.  \n- A hand holding the brush is visible, moving steadily across the canvas.\n[360-390s] - A hand uses a brush to apply white paint to the canvas, covering the subject's face and hair.\n- The brush strokes are deliberate, blending colors to create a smooth transition between the subject's features and background.\n- A text overlay appears, stating \"3. THE ARTIST YOU ARE TRYING TO REACH IS CURRENTLY NOT AVAILABLE,\" indicating a technical issue during the painting process.\n[390-420s] - Painter's hand moves a brush across the canvas, applying paint to the subject's cheek area.  \n- The brush strokes transition from the forehead to the cheek, blending tones with visible pigment application.  \n- A green leafy plant is partially visible in the background, slightly out of focus.\n[420-450s] - A paintbrush applies dark pigment to the subject's right eye, enhancing the eyeliner detail.  \n- The brush then moves to the left eye, applying similar dark pigment for symmetry.  \n- The brush is temporarily lifted, revealing the completed eye area with defined eyeliner.", "history_tokens": 996, "history_utf8_bytes": 4352, "recent_frame_times_s": [430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333, 439.0052333333333, 440.00623333333334, 441.0072333333333, 442.00823333333335, 443.0092333333333, 444.01023333333336, 445.01123333333334, 446.0122333333333, 447.01323333333335, 448.0142333333333, 449.01523333333336, 450.01623333333333, 451.0172333333333, 452.01823333333334, 453.0192333333333, 454.02023333333335, 455.0212333333333, 456.02223333333336, 457.02323333333334, 458.0242333333333, 459.02523333333335], "recent_frames_sha256": "d97618195f622ebdb2af0d2cddf951e012c1ef563388faf32b277cc98bb96e0e", "num_recent_frames": 30, "tq": 710352.466366383, "t1": 710354.510104545, "ta": 710354.510104545, "te": 710354.771616787, "first_response_s": 2.0437381620286033, "answer_total_s": 2.3052504039369524, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 127, "content_group": "41f30c65958cee6f9f680a18704de9411333733e006ce0a7183ad41e165ef78a", "question": {"question_id": "sample_127_a23_q0", "video_id": 127, "video_path": "./videos/sample_127_real.mp4", "annotation_index": 23, "question_index": 0, "question": "What does the painter focus on during the last strokes?", "options": ["A. The eyes and hair.", "B. The lower face.", "C. The background and plant.", "D. The canvas texture."], "answer": "B", "time_stamp_s": 680, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [660, 720], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_127_a23_q0", "video_id": 127, "time_stamp_s": 680, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7e6c9f967a915f9bf014848b58c1d0f0b6bf76feb5e6f353081a2101ed7b9c8f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [650.0160333333333, 651.0170333333333, 652.0180333333333, 653.0190333333334, 654.0200333333333, 655.0210333333333, 656.0220333333333, 657.0230333333334, 658.0240333333334, 659.0250333333333, 660.0260333333333, 661.0270333333333, 662.0280333333334, 663.0290333333334, 664.0300333333333, 665.0310333333333, 666.0320333333333, 667.0330333333334, 668.0006666666667, 669.0016666666667, 670.0026666666666, 671.0036666666666, 672.0046666666667, 673.0056666666667, 674.0066666666667, 675.0076666666666, 676.0086666666666, 677.0096666666667, 678.0106666666667, 679.0116666666667], "recent_frames_sha256": "557b41a92bd759ff055eb435bfa41f48c0e7246eed40ddf2dbbf120c73ed5008", "num_recent_frames": 30, "tq": 710443.815218276, "t1": 710456.66247623, "ta": 710456.66247623, "te": 710456.700402172, "first_response_s": 12.847257953952067, "answer_total_s": 12.885183896054514, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_127_a23_q0", "video_id": 127, "time_stamp_s": 680, "ground_truth": "B", "raw_output": "B. The lower face.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "b1c93b46f6be62f0b768287d02f5a1cd16afb9cb88f439af8b012de7d07d8042", "condition_order": ["notes", "recent"], "memory": "[270-300s] - Artist applies reddish-brown paint to the lips using a fine brush.  \n- Brush strokes are deliberate, focusing on the lower lip's contour.  \n- White canvas background contrasts with the partially painted facial features.\n[300-330s] - A paintbrush applies reddish-brown pigment to the lower cheek area of a portrait canvas.  \n- The brush strokes are deliberate, moving horizontally across the cheek to blend color.  \n- The portrait features white hair, dark eye makeup, and red lips, with the cheek being the focal point of the current action.\n[330-360s] - Artist applies reddish-brown paint to the subject's lips using a fine brush.  \n- The canvas shows partial color application on the face, with white lines still visible around the eyes and hair.  \n- A hand holding the brush is visible, moving steadily across the canvas.\n[360-390s] - A hand uses a brush to apply white paint to the canvas, covering the subject's face and hair.\n- The brush strokes are deliberate, blending colors to create a smooth transition between the subject's features and background.\n- A text overlay appears, stating \"3. THE ARTIST YOU ARE TRYING TO REACH IS CURRENTLY NOT AVAILABLE,\" indicating a technical issue during the painting process.\n[390-420s] - Painter's hand moves a brush across the canvas, applying paint to the subject's cheek area.  \n- The brush strokes transition from the forehead to the cheek, blending tones with visible pigment application.  \n- A green leafy plant is partially visible in the background, slightly out of focus.\n[420-450s] - A paintbrush applies dark pigment to the subject's right eye, enhancing the eyeliner detail.  \n- The brush then moves to the left eye, applying similar dark pigment for symmetry.  \n- The brush is temporarily lifted, revealing the completed eye area with defined eyeliner.\n[450-480s] - A paintbrush applies a light brown stroke to the subject's forehead, blending with existing tones.  \n- The brush then moves to the subject's nose, adding subtle shading to define its contours.  \n- The brush continues to refine the subject's lips, applying a darker hue to enhance definition.\n[480-510s] - A paintbrush moves horizontally across the canvas, applying strokes to the subject's cheek area.  \n- The subject's red hair and teal earrings remain static, framing the face as the brushwork progresses.  \n- The brush tip is visible near the subject’s cheek, indicating active painting of the facial feature.\n[510-540s] - A paintbrush is actively applying strokes to the subject's cheek area in a portrait painting.  \n- The portrait depicts a woman with reddish-brown hair and prominent blue earrings.  \n- The brush moves horizontally across the canvas, blending colors on the cheek.\n[540-570s] - A paintbrush applies subtle strokes to the subject's nose area, enhancing shading and definition.  \n- The brush moves horizontally across the canvas, focusing on refining the nose’s contours.  \n- The subject’s red hair and teal earrings remain static as the painting progresses.\n[570-600s] - A hand holds a paintbrush near a canvas depicting a woman with red hair and bold makeup, with the Squarespace logo overlaid.  \n- The scene transitions to a website homepage for \"ALPAY EFE,\" displaying a grid of abstract and figurative artworks, including a prominent painting of a reclining nude figure.  \n- The website showcases various art styles, including anime characters and collectible figurines, with titles like \"Original Squash Study\" and \"Original Squash Study: Shenlong.\"\n[600-630s] - A digital art portfolio page displays \"ALPAY EFE\" with an \"ORIGINAL GOUACHE STUDY: SHENLONG\" title and a dragon illustration.  \n- The page includes a \"Request a quote\" button and a \"View all\" link, suggesting an online art sales or consultation interface.  \n- The dragon artwork is prominently featured with vibrant colors and dynamic lines, set against a soft peach background.\n[630-660s] - A hand holds a paintbrush, applying strokes to a portrait of a woman with red hair and bold makeup on a yellow canvas.  \n- The brush moves horizontally across the woman’s cheek and jawline, blending colors with visible paint drips.  \n- The portrait’s background remains a solid yellow, with green leaves partially visible to the left.", "history_tokens": 976, "history_utf8_bytes": 4264, "recent_frame_times_s": [650.0160333333333, 651.0170333333333, 652.0180333333333, 653.0190333333334, 654.0200333333333, 655.0210333333333, 656.0220333333333, 657.0230333333334, 658.0240333333334, 659.0250333333333, 660.0260333333333, 661.0270333333333, 662.0280333333334, 663.0290333333334, 664.0300333333333, 665.0310333333333, 666.0320333333333, 667.0330333333334, 668.0006666666667, 669.0016666666667, 670.0026666666666, 671.0036666666666, 672.0046666666667, 673.0056666666667, 674.0066666666667, 675.0076666666666, 676.0086666666666, 677.0096666666667, 678.0106666666667, 679.0116666666667], "recent_frames_sha256": "557b41a92bd759ff055eb435bfa41f48c0e7246eed40ddf2dbbf120c73ed5008", "num_recent_frames": 30, "tq": 710408.040652815, "t1": 710409.513236994, "ta": 710409.513236994, "te": 710409.759063549, "first_response_s": 1.4725841790204868, "answer_total_s": 1.7184107339708135, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 128, "content_group": "21bb8b8bebe313e6117bb6eb744da8897b70395856fe265e6ca4c0d28ef4624f", "question": {"question_id": "sample_128_a1918_q0", "video_id": 128, "video_path": "./videos/sample_128_real.mp4", "annotation_index": 1918, "question_index": 0, "question": "Where is the green potted plant positioned relative to the painting in the initial scene?", "options": ["A. To the right of the painting.", "B. In front of the painting.", "C. To the left of the painting.", "D. Above the painting."], "answer": "C", "time_stamp_s": 6, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_128_a1918_q0", "video_id": 128, "time_stamp_s": 6, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e3590a610f0d7cfd65f91d978ecc7e7d4a39235a7444223e1e3f265e528394e5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0], "recent_frames_sha256": "8edcb8f85dac88db9c488bab976a9fa8a929d649537dce15981ecc731c9c6f7d", "num_recent_frames": 7, "tq": 716882.903187751, "t1": 716892.861659332, "ta": 716892.861659332, "te": 716892.900131825, "first_response_s": 9.95847158099059, "answer_total_s": 9.996944074053317, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_128_a1918_q0", "video_id": 128, "time_stamp_s": 6, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3af0ebab0511b8601728fb93132d5c474cca1198545ec23c3e3cd988ea3b7c5f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0], "recent_frames_sha256": "8edcb8f85dac88db9c488bab976a9fa8a929d649537dce15981ecc731c9c6f7d", "num_recent_frames": 7, "tq": 716935.232070076, "t1": 716946.447545242, "ta": 716946.447545242, "te": 716946.485131011, "first_response_s": 11.215475165983662, "answer_total_s": 11.253060934948735, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 128, "content_group": "21bb8b8bebe313e6117bb6eb744da8897b70395856fe265e6ca4c0d28ef4624f", "question": {"question_id": "sample_128_a1918_q1", "video_id": 128, "video_path": "./videos/sample_128_real.mp4", "annotation_index": 1918, "question_index": 1, "question": "Which of the following best summarizes the scene in the video?", "options": ["A. A detailed exploration of a landscape painting.", "B. The process of painting a landscape with vibrant colors.", "C. A focus on a woman's portrait with a tranquil expression.", "D. An artist discussing the inspiration behind an abstract piece."], "answer": "C", "time_stamp_s": 19, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_128_a1918_q1", "video_id": 128, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0ccb028f6dfb38ddce03cc3ba28cedee345cbdea04a81cc7b6fdb2dc1e16283e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "f52713e1252b9a1c16977bb4812df5d2f867cd5ae7248b4f6e4e6392acfce11f", "num_recent_frames": 20, "tq": 716892.91421238, "t1": 716899.924462559, "ta": 716899.924462559, "te": 716899.961414107, "first_response_s": 7.010250179097056, "answer_total_s": 7.047201727051288, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_128_a1918_q1", "video_id": 128, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2ee2f39736e632e5f03ac4b3b8f48f0b32a94c83a4ba56db3decb858d064bcca", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "f52713e1252b9a1c16977bb4812df5d2f867cd5ae7248b4f6e4e6392acfce11f", "num_recent_frames": 20, "tq": 716946.492442205, "t1": 716953.436541533, "ta": 716953.436541533, "te": 716953.661245674, "first_response_s": 6.944099328015, "answer_total_s": 7.168803469045088, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 128, "content_group": "21bb8b8bebe313e6117bb6eb744da8897b70395856fe265e6ca4c0d28ef4624f", "question": {"question_id": "sample_128_a1919_q0", "video_id": 128, "video_path": "./videos/sample_128_real.mp4", "annotation_index": 1919, "question_index": 0, "question": "What is visible in the left lower corner of the frame after the camera zooms out?", "options": ["A. A decorative statue.", "B. A green plant.", "C. A part of a bookshelf.", "D. A palette of colors."], "answer": "B", "time_stamp_s": 178, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_128_a1919_q0", "video_id": 128, "time_stamp_s": 178, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d0b114dbd4a7d3ab0bfb3735d2c9a39492b42a905d007bb274a352b9a5b67635", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0], "recent_frames_sha256": "cecfde41abe0b45444a24e476aadd185f4f1d3e500b28afc673526bf72fd6083", "num_recent_frames": 30, "tq": 716899.972165453, "t1": 716912.761676153, "ta": 716912.761676153, "te": 716912.990924321, "first_response_s": 12.789510700036772, "answer_total_s": 13.018758867983706, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_128_a1919_q0", "video_id": 128, "time_stamp_s": 178, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6c8ef17a0937202389b1f9685bb5697f384d452eff6b0d4265c6b3a9b1fb70d4", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A completed oil painting of a woman with long dark hair and a purple garment is displayed on an easel.  \n- A person in a grey sweatshirt is seen sketching a similar portrait on a white canvas, using pencil.  \n- The sketch is positioned on an easel, with a potted plant to the left and a lamp with string lights to the right.\n[30-60s] - A hand uses a green-handled brush to apply reddish-purple paint over a sketch of a woman's hair on a white canvas.  \n- The brush strokes are broad and layered, gradually covering the sketch with color.  \n- The background shows a plant, a lamp, and art supplies, indicating an art studio setting.\n[60-90s] - Artist applies orange paint to lips using a brush, starting from the center and extending outward.  \n- Brush strokes are deliberate, blending colors to form the shape of lips.  \n- Background shows partially painted hair in shades of red and brown, with sketch lines visible.\n[90-120s] - Artist applies brownish-orange paint to the subject's lips using a flat brush, enhancing their shape and color.  \n- Brush strokes transition from the lips upward toward the nose and cheek area, blending tones with visible texture.  \n- A watermark \"patreon.com/AlayEfe\" appears briefly on the canvas, indicating the artist's Patreon page.\n[120-150s] - Artist applies white paint to the subject's cheek and jawline, blending with existing peach tones.  \n- Brush strokes move horizontally across the face, smoothing transitions between colors.  \n- Lips remain partially defined with orange-red pigment, contrasting with the lighter cheek area.", "history_tokens": 363, "history_utf8_bytes": 1580, "recent_frame_times_s": [149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0], "recent_frames_sha256": "cecfde41abe0b45444a24e476aadd185f4f1d3e500b28afc673526bf72fd6083", "num_recent_frames": 30, "tq": 716989.168548202, "t1": 716996.712720697, "ta": 716996.712720697, "te": 716996.902057228, "first_response_s": 7.544172495021485, "answer_total_s": 7.733509026002139, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 128, "content_group": "21bb8b8bebe313e6117bb6eb744da8897b70395856fe265e6ca4c0d28ef4624f", "question": {"question_id": "sample_128_a1920_q0", "video_id": 128, "video_path": "./videos/sample_128_real.mp4", "annotation_index": 1920, "question_index": 0, "question": "Which of the following best summarizes the painting shown in the video?", "options": ["A. A woman with open eyes and vibrant colors.", "B. A landscape with intricate textures.", "C. A woman's face with closed eyes and partially painted skin tones.", "D. An abstract painting with geometric shapes."], "answer": "C", "time_stamp_s": 326, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_128_a1920_q0", "video_id": 128, "time_stamp_s": 326, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b60d58379c05a84d591571a5f06aaa6687f93adbe3036ebbb4881e1376c7e2bd", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0], "recent_frames_sha256": "fe3a0fc3247a7076b18f5f580a7ef429cb7b5dc03077250a914e251eb781b90f", "num_recent_frames": 30, "tq": 716913.005068906, "t1": 716921.157571683, "ta": 716921.157571683, "te": 716921.197597676, "first_response_s": 8.152502777054906, "answer_total_s": 8.19252876995597, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_128_a1920_q0", "video_id": 128, "time_stamp_s": 326, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "086cecf7b9462984194d5a6e6abd469291b54c696962a5647027bc6a80703dcf", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A completed oil painting of a woman with long dark hair and a purple garment is displayed on an easel.  \n- A person in a grey sweatshirt is seen sketching a similar portrait on a white canvas, using pencil.  \n- The sketch is positioned on an easel, with a potted plant to the left and a lamp with string lights to the right.\n[30-60s] - A hand uses a green-handled brush to apply reddish-purple paint over a sketch of a woman's hair on a white canvas.  \n- The brush strokes are broad and layered, gradually covering the sketch with color.  \n- The background shows a plant, a lamp, and art supplies, indicating an art studio setting.\n[60-90s] - Artist applies orange paint to lips using a brush, starting from the center and extending outward.  \n- Brush strokes are deliberate, blending colors to form the shape of lips.  \n- Background shows partially painted hair in shades of red and brown, with sketch lines visible.\n[90-120s] - Artist applies brownish-orange paint to the subject's lips using a flat brush, enhancing their shape and color.  \n- Brush strokes transition from the lips upward toward the nose and cheek area, blending tones with visible texture.  \n- A watermark \"patreon.com/AlayEfe\" appears briefly on the canvas, indicating the artist's Patreon page.\n[120-150s] - Artist applies white paint to the subject's cheek and jawline, blending with existing peach tones.  \n- Brush strokes move horizontally across the face, smoothing transitions between colors.  \n- Lips remain partially defined with orange-red pigment, contrasting with the lighter cheek area.\n[150-180s] - Artist's hand holds a brush, applying orange paint to the lips of a portrait.\n- The portrait shows a face with partially painted features, including a nose and lips, against a white background.\n- The brush strokes are deliberate, focusing on the lip area, with visible paint texture and blending.\n[180-210s] - Artist’s hand applies paint with a brush to the subject’s shoulder area, blending tones.  \n- The painting shows a woman with long hair, partially painted in purples and whites.  \n- A green plant is visible to the left, and a lamp is to the right of the canvas.\n[210-240s] - Painter's hand holds a brush, applying paint to the subject's shoulder area on the canvas.  \n- The canvas depicts a woman with long, dark hair and a white garment, partially painted with visible brushstrokes.  \n- A green plant is positioned to the left of the canvas, and a lamp is visible to the right.\n[240-270s] - A paintbrush applies reddish-orange pigment to the upper lip, blending with existing tones.  \n- The brush moves horizontally, smoothing the color transition along the lip’s contour.  \n- The nose and surrounding skin show soft, blended shading beneath the lip area.\n[270-300s] - A paintbrush applies orange pigment to the nose area of a portrait, blending with existing tones.\n- The brush then moves to the cheek, adding subtle shading to define facial contours.\n- The portrait depicts a woman with closed eyes and dark hair, rendered in soft, realistic tones.", "history_tokens": 712, "history_utf8_bytes": 3060, "recent_frame_times_s": [297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0], "recent_frames_sha256": "fe3a0fc3247a7076b18f5f580a7ef429cb7b5dc03077250a914e251eb781b90f", "num_recent_frames": 30, "tq": 717041.288823273, "t1": 717042.557186747, "ta": 717042.557186747, "te": 717042.59870754, "first_response_s": 1.2683634739369154, "answer_total_s": 1.3098842669278383, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 128, "content_group": "21bb8b8bebe313e6117bb6eb744da8897b70395856fe265e6ca4c0d28ef4624f", "question": {"question_id": "sample_128_a1921_q0", "video_id": 128, "video_path": "./videos/sample_128_real.mp4", "annotation_index": 1921, "question_index": 0, "question": "Which of the following best summarizes the content that was just shown in the video?", "options": ["A. Two paintings of a landscape are displayed, followed by a close-up of a bird sculpture.", "B. Two portraits of a woman are shown, with a close-up revealing details of one painting, and then the original view is restored.", "C. A painting of a young man is displayed, followed by a description of the artist's technique.", "D. A video of an artist painting is shown, with a focus on the brush strokes and colors used."], "answer": "B", "time_stamp_s": 500, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_128_a1921_q0", "video_id": 128, "time_stamp_s": 500, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "be6aadd6bcc26542c57ede766b9f4278c9944029959a53bc6250901c2a3ef470", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0], "recent_frames_sha256": "e52766f10732cae90742625f964553246ef186b5bcac6194f739c8828248d929", "num_recent_frames": 30, "tq": 716921.208761305, "t1": 716935.17222729, "ta": 716935.17222729, "te": 716935.209594958, "first_response_s": 13.963465985027142, "answer_total_s": 14.000833653029986, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_128_a1921_q0", "video_id": 128, "time_stamp_s": 500, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1917310bda4c87c729797b6472b9dab8b22cc45b8371afc4291344fff01bf5ca", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Artist applies brownish-orange paint to the subject's lips using a flat brush, enhancing their shape and color.  \n- Brush strokes transition from the lips upward toward the nose and cheek area, blending tones with visible texture.  \n- A watermark \"patreon.com/AlayEfe\" appears briefly on the canvas, indicating the artist's Patreon page.\n[120-150s] - Artist applies white paint to the subject's cheek and jawline, blending with existing peach tones.  \n- Brush strokes move horizontally across the face, smoothing transitions between colors.  \n- Lips remain partially defined with orange-red pigment, contrasting with the lighter cheek area.\n[150-180s] - Artist's hand holds a brush, applying orange paint to the lips of a portrait.\n- The portrait shows a face with partially painted features, including a nose and lips, against a white background.\n- The brush strokes are deliberate, focusing on the lip area, with visible paint texture and blending.\n[180-210s] - Artist’s hand applies paint with a brush to the subject’s shoulder area, blending tones.  \n- The painting shows a woman with long hair, partially painted in purples and whites.  \n- A green plant is visible to the left, and a lamp is to the right of the canvas.\n[210-240s] - Painter's hand holds a brush, applying paint to the subject's shoulder area on the canvas.  \n- The canvas depicts a woman with long, dark hair and a white garment, partially painted with visible brushstrokes.  \n- A green plant is positioned to the left of the canvas, and a lamp is visible to the right.\n[240-270s] - A paintbrush applies reddish-orange pigment to the upper lip, blending with existing tones.  \n- The brush moves horizontally, smoothing the color transition along the lip’s contour.  \n- The nose and surrounding skin show soft, blended shading beneath the lip area.\n[270-300s] - A paintbrush applies orange pigment to the nose area of a portrait, blending with existing tones.\n- The brush then moves to the cheek, adding subtle shading to define facial contours.\n- The portrait depicts a woman with closed eyes and dark hair, rendered in soft, realistic tones.\n[300-330s] - A hand holds a fine brush, applying paint to a portrait's cheek area.  \n- The portrait depicts a woman with closed eyes and dark hair, rendered in soft, blended tones.  \n- The brush strokes are precise, adding subtle shading and highlights to the skin.\n[330-360s] - A hand uses a black marker to refine a pencil sketch of two cartoon characters on paper.  \n- The sketch shows two children interacting, with the artist adding details to their facial features and clothing.  \n- The video interface displays a course title and a list of lessons, including \"Mastering Illustration: Sketching, Inking & Color Essentials (Original).\"\n[360-390s] - Artist uses a brush to apply purple paint to the woman's hair and shoulder area.  \n- The painting shows a woman with long dark hair and a light-colored top, set against a yellow background.  \n- A green plant is visible to the left, and a small figurine is on the right side of the frame.\n[390-420s] - Artist’s gloved hand uses a brush to apply paint to the woman’s upper torso, blending tones on the canvas.  \n- The painting depicts a woman with dark hair and a bra, rendered in soft, warm hues against a light background.  \n- A potted plant is visible to the left, and a small figurine sits on a surface to the right, both static in the background.\n[420-450s] - Artist’s hand holds a thin brush, applying subtle strokes to the woman’s cheek area on the canvas.  \n- The painting depicts a woman with long dark hair and a lace bra, set against a soft pink background.  \n- A potted plant is visible to the left of the canvas, and a small figurine rests on a surface to the right.\n[450-480s] - Left painting: A portrait of a woman with long dark hair, wearing a strapless top, displayed on an easel with a light pink background.  \n- Right painting: A similar portrait of a woman with long dark hair, wearing a strapless top, displayed on an easel with a reddish background.  \n- Both paintings: Show the same subject in a similar pose, with the left painting appearing more detailed and the right painting having a more textured, painterly finish.", "history_tokens": 1000, "history_utf8_bytes": 4238, "recent_frame_times_s": [471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0], "recent_frames_sha256": "e52766f10732cae90742625f964553246ef186b5bcac6194f739c8828248d929", "num_recent_frames": 30, "tq": 717101.989936743, "t1": 717103.568390434, "ta": 717103.568390434, "te": 717103.720781551, "first_response_s": 1.578453690977767, "answer_total_s": 1.7308448079274967, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 129, "content_group": "89b82b0c346ae7dab3aceb0986dd2aed2e4064c425b2005dfb67e12003edd0f3", "question": {"question_id": "sample_129_a974_q0", "video_id": 129, "video_path": "./videos/sample_129_real.mp4", "annotation_index": 974, "question_index": 0, "question": "Which side of the head does the person paint first?", "options": ["A. The top.", "B. The left side.", "C. The right side.", "D. The back."], "answer": "B", "time_stamp_s": 9, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_129_a974_q0", "video_id": 129, "time_stamp_s": 9, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fe2bccaa6264f28003302c5fa8fcc8bacb2072eb6e215fe5b15b61db941740ce", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008], "recent_frames_sha256": "12516679c77169e26c4d661d6d365ab5f4bca81887afe5bbf2ddcde761c2942b", "num_recent_frames": 9, "tq": 717612.487488196, "t1": 717618.272170997, "ta": 717618.272170997, "te": 717618.310378789, "first_response_s": 5.784682800993323, "answer_total_s": 5.822890592971817, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_129_a974_q0", "video_id": 129, "time_stamp_s": 9, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3c97db1b7e312da348342405d901730a967c31e15af4817cc4ef6f316d0bdc2a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008], "recent_frames_sha256": "12516679c77169e26c4d661d6d365ab5f4bca81887afe5bbf2ddcde761c2942b", "num_recent_frames": 9, "tq": 717663.685494956, "t1": 717675.83029602, "ta": 717675.83029602, "te": 717676.032081146, "first_response_s": 12.144801064045168, "answer_total_s": 12.346586190047674, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 129, "content_group": "89b82b0c346ae7dab3aceb0986dd2aed2e4064c425b2005dfb67e12003edd0f3", "question": {"question_id": "sample_129_a975_q0", "video_id": 129, "video_path": "./videos/sample_129_real.mp4", "annotation_index": 975, "question_index": 0, "question": "Which of the following best summarizes the painting process that was just shown in the video?", "options": ["A. Adding final touches to a landscape.", "B. Detailing a person with short brown hair and a red coat.", "C. Painting an abstract art piece.", "D. Working on a cityscape with vibrant colors."], "answer": "B", "time_stamp_s": 159, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_129_a975_q0", "video_id": 129, "time_stamp_s": 159, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a1507be192995fdc25c915180a5eac9a0fa54606aade6112f361279769b24fd6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332], "recent_frames_sha256": "8dae455a64b2df9f6882e550868fc50cc4e5d621e77350ffea30ae2575f11fc0", "num_recent_frames": 30, "tq": 717618.322592993, "t1": 717626.810951799, "ta": 717626.810951799, "te": 717626.850651523, "first_response_s": 8.488358806003816, "answer_total_s": 8.528058529947884, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_129_a975_q0", "video_id": 129, "time_stamp_s": 159, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4200f49bee278f3a86ce05c61b09a853675711f4988357241bcd224722c09416", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Artist applies brown paint to hair outline using a brush, then switches to red paint for facial features.  \n- A \"Squarespace\" logo appears overlaid on the canvas during painting.  \n- The painting is on a white canvas mounted on an easel, with art supplies visible in the background.\n[30-60s] - Artist applies brown paint to hair and cheek area using a flat brush.  \n- Brush strokes are deliberate, covering sketch lines with solid color.  \n- Canvas remains upright on easel, with paint palette visible to left.\n[60-90s] - Artist uses a thin brush to apply brown paint to the subject's hair and cheek area.  \n- The canvas is mounted on an easel, with visible paint splatters along the edges.  \n- Background shows a cluttered studio with a palette and other art supplies.\n[90-120s] - Artist's hand uses a flat brush to apply white paint across the subject's cheek and jawline, blending with existing tones.  \n- The portrait, depicting a man with brown hair and a white shirt, shows progressive shading as the brush moves from left to right.  \n- The canvas is mounted on an easel, with paintbrushes and palette visible in the background workspace.\n[120-150s] - Artist’s hand uses a brush to apply dark strokes to the collar area of the portrait.  \n- The portrait depicts a man with brown hair and a white shirt, partially painted with visible brushstrokes.  \n- The canvas is mounted on an easel, with art supplies and a table visible in the background.", "history_tokens": 345, "history_utf8_bytes": 1461, "recent_frame_times_s": [129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332], "recent_frames_sha256": "8dae455a64b2df9f6882e550868fc50cc4e5d621e77350ffea30ae2575f11fc0", "num_recent_frames": 30, "tq": 717711.523609669, "t1": 717718.39654139, "ta": 717718.39654139, "te": 717718.435583993, "first_response_s": 6.872931721038185, "answer_total_s": 6.91197432402987, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 129, "content_group": "89b82b0c346ae7dab3aceb0986dd2aed2e4064c425b2005dfb67e12003edd0f3", "question": {"question_id": "sample_129_a976_q0", "video_id": 129, "video_path": "./videos/sample_129_real.mp4", "annotation_index": 976, "question_index": 0, "question": "Why is the artist applying touches to the facial features frequently?", "options": ["A. To correct mistakes.", "B. To emphasize expressions.", "C. To add abstract elements.", "D. To change the background color."], "answer": "B", "time_stamp_s": 299, "task_type": "Causal Reasoning", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_129_a976_q0", "video_id": 129, "time_stamp_s": 299, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "694d74c0e30b3cbb89c322af5f1d8fafd000c5d7b530bf794958cf8ba706effa", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667], "recent_frames_sha256": "2c8332db470277c778bcee72e8f5bb7adbe1ed6fd614c27fbe670ee22411f28b", "num_recent_frames": 30, "tq": 717626.857383465, "t1": 717638.386417719, "ta": 717638.386417719, "te": 717638.424172381, "first_response_s": 11.529034253908321, "answer_total_s": 11.56678891601041, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_129_a976_q0", "video_id": 129, "time_stamp_s": 299, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "304ba34fa0075497904cddda1435de1603a7cf889b089d67c9e639b7a800097c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Artist applies brown paint to hair outline using a brush, then switches to red paint for facial features.  \n- A \"Squarespace\" logo appears overlaid on the canvas during painting.  \n- The painting is on a white canvas mounted on an easel, with art supplies visible in the background.\n[30-60s] - Artist applies brown paint to hair and cheek area using a flat brush.  \n- Brush strokes are deliberate, covering sketch lines with solid color.  \n- Canvas remains upright on easel, with paint palette visible to left.\n[60-90s] - Artist uses a thin brush to apply brown paint to the subject's hair and cheek area.  \n- The canvas is mounted on an easel, with visible paint splatters along the edges.  \n- Background shows a cluttered studio with a palette and other art supplies.\n[90-120s] - Artist's hand uses a flat brush to apply white paint across the subject's cheek and jawline, blending with existing tones.  \n- The portrait, depicting a man with brown hair and a white shirt, shows progressive shading as the brush moves from left to right.  \n- The canvas is mounted on an easel, with paintbrushes and palette visible in the background workspace.\n[120-150s] - Artist’s hand uses a brush to apply dark strokes to the collar area of the portrait.  \n- The portrait depicts a man with brown hair and a white shirt, partially painted with visible brushstrokes.  \n- The canvas is mounted on an easel, with art supplies and a table visible in the background.\n[150-180s] - Artist's hand uses a brush to apply paint to the subject's forehead and cheek area.  \n- The portrait shows a man in a red jacket with a black collar, rendered in a painterly style.  \n- Background elements include a green plant to the left and a partially visible blue object to the right.\n[180-210s] - Artist's hand holds a brush, applying paint to the subject's cheek area.  \n- The portrait depicts a man with a red jacket, rendered in a stylized, painterly manner.  \n- A green leafy plant is visible to the left of the canvas, against a pink wall.\n[210-240s] - A hand uses a brush to apply paint to a portrait of a man in a red jacket on a canvas.  \n- The portrait shows the man with a surprised expression, set against a background of warm yellow and red tones.  \n- A green plant is visible to the left of the canvas, and the background features pink and blue geometric shapes.\n[240-270s] - A painting of a woman in a red garment is being worked on, with a brush applying paint to her cheek area.  \n- A small potted plant is visible to the left of the canvas, partially in frame.  \n- The painting's background features abstract, light-colored brushstrokes, contrasting with the subject's darker tones.", "history_tokens": 646, "history_utf8_bytes": 2679, "recent_frame_times_s": [269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667], "recent_frames_sha256": "2c8332db470277c778bcee72e8f5bb7adbe1ed6fd614c27fbe670ee22411f28b", "num_recent_frames": 30, "tq": 717749.508235007, "t1": 717750.788741721, "ta": 717750.788741721, "te": 717750.979019662, "first_response_s": 1.2805067140143365, "answer_total_s": 1.4707846550736576, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 129, "content_group": "89b82b0c346ae7dab3aceb0986dd2aed2e4064c425b2005dfb67e12003edd0f3", "question": {"question_id": "sample_129_a977_q0", "video_id": 129, "video_path": "./videos/sample_129_real.mp4", "annotation_index": 977, "question_index": 0, "question": "Where are the plants located in relation to the painting in the studio?", "options": ["A. To the right side of the painting.", "B. On a table beneath the painting.", "C. On the left side of the painting.", "D. Behind the artist."], "answer": "C", "time_stamp_s": 440, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_129_a977_q0", "video_id": 129, "time_stamp_s": 440, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "490811296c04bce5600cba73a76f6cbc16b3da49da350478bb92cd420c13f844", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256, 427.0266, 428.0276, 429.0286, 430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333, 439.0052333333333], "recent_frames_sha256": "c7d1e89fe54ce110ae7ca6cd89cc38ef0ab9d324818a521a84b23161df16b56d", "num_recent_frames": 30, "tq": 717638.431163357, "t1": 717650.782424919, "ta": 717650.782424919, "te": 717650.821366879, "first_response_s": 12.351261561969295, "answer_total_s": 12.390203522052616, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_129_a977_q0", "video_id": 129, "time_stamp_s": 440, "ground_truth": "C", "raw_output": "C. On the left side of the painting.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "2b35285638fb74eb09ff8d6d85b740c502087e0d34544c5af234f72819c2be07", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Artist applies brown paint to hair and cheek area using a flat brush.  \n- Brush strokes are deliberate, covering sketch lines with solid color.  \n- Canvas remains upright on easel, with paint palette visible to left.\n[60-90s] - Artist uses a thin brush to apply brown paint to the subject's hair and cheek area.  \n- The canvas is mounted on an easel, with visible paint splatters along the edges.  \n- Background shows a cluttered studio with a palette and other art supplies.\n[90-120s] - Artist's hand uses a flat brush to apply white paint across the subject's cheek and jawline, blending with existing tones.  \n- The portrait, depicting a man with brown hair and a white shirt, shows progressive shading as the brush moves from left to right.  \n- The canvas is mounted on an easel, with paintbrushes and palette visible in the background workspace.\n[120-150s] - Artist’s hand uses a brush to apply dark strokes to the collar area of the portrait.  \n- The portrait depicts a man with brown hair and a white shirt, partially painted with visible brushstrokes.  \n- The canvas is mounted on an easel, with art supplies and a table visible in the background.\n[150-180s] - Artist's hand uses a brush to apply paint to the subject's forehead and cheek area.  \n- The portrait shows a man in a red jacket with a black collar, rendered in a painterly style.  \n- Background elements include a green plant to the left and a partially visible blue object to the right.\n[180-210s] - Artist's hand holds a brush, applying paint to the subject's cheek area.  \n- The portrait depicts a man with a red jacket, rendered in a stylized, painterly manner.  \n- A green leafy plant is visible to the left of the canvas, against a pink wall.\n[210-240s] - A hand uses a brush to apply paint to a portrait of a man in a red jacket on a canvas.  \n- The portrait shows the man with a surprised expression, set against a background of warm yellow and red tones.  \n- A green plant is visible to the left of the canvas, and the background features pink and blue geometric shapes.\n[240-270s] - A painting of a woman in a red garment is being worked on, with a brush applying paint to her cheek area.  \n- A small potted plant is visible to the left of the canvas, partially in frame.  \n- The painting's background features abstract, light-colored brushstrokes, contrasting with the subject's darker tones.\n[270-300s] - A hand holds a paintbrush, applying strokes to a portrait of a man with dark hair and a red jacket on a white canvas.  \n- The portrait shows the man with a surprised expression, eyes wide and mouth slightly open, with visible brushwork in the hair and clothing.  \n- A green leafy plant is visible to the left of the canvas, and a colorful wall with pink, beige, and blue sections is in the background.\n[300-330s] - Artist’s gloved hand applies white paint to the canvas, focusing on the subject’s hair and shoulders.  \n- The portrait depicts a man with a red jacket, showing visible brushstrokes and paint blending.  \n- A green plant is positioned to the left of the canvas, with a colorful wall in the background.\n[330-360s] - A hand holds a paintbrush, applying strokes to a portrait of a man with a red jacket on a canvas.  \n- The portrait depicts a man with a surprised expression, detailed hair, and a white shirt under the jacket.  \n- The canvas is positioned upright, with a green plant to the left and a wooden easel or background to the right.\n[360-390s] - A hand holds a paintbrush, applying strokes to a portrait of a man in a red jacket on a canvas.  \n- The portrait depicts a man with a surprised expression, featuring detailed facial features and a textured red jacket.  \n- A green potted plant is visible to the left of the canvas, and a laptop rests on a table beneath it.\n[390-420s] - A hand holds a thin brush near the canvas, poised to apply paint to the portrait of a man in a red jacket.  \n- The portrait, displayed on a white canvas, features a man with tousled hair and a serious expression, set against a colorful background.  \n- A green leafy plant is visible to the left of the canvas, and a laptop rests on a surface beneath it.", "history_tokens": 1008, "history_utf8_bytes": 4159, "recent_frame_times_s": [410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256, 427.0266, 428.0276, 429.0286, 430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333, 439.0052333333333], "recent_frames_sha256": "c7d1e89fe54ce110ae7ca6cd89cc38ef0ab9d324818a521a84b23161df16b56d", "num_recent_frames": 30, "tq": 717797.934780867, "t1": 717806.125178634, "ta": 717806.125178634, "te": 717806.495973214, "first_response_s": 8.190397767000832, "answer_total_s": 8.561192347086035, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 129, "content_group": "89b82b0c346ae7dab3aceb0986dd2aed2e4064c425b2005dfb67e12003edd0f3", "question": {"question_id": "sample_129_a977_q1", "video_id": 129, "video_path": "./videos/sample_129_real.mp4", "annotation_index": 977, "question_index": 1, "question": "Which of the following best summarizes the content that was just shown in the video?", "options": ["A. The artist is setting up the studio before starting to paint.", "B. The artist is making precise adjustments to an already detailed portrait.", "C. The artist is selecting colors and preparing brushes for a new painting.", "D. The artist is cleaning up the studio after completing a painting."], "answer": "B", "time_stamp_s": 440, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_129_a977_q1", "video_id": 129, "time_stamp_s": 440, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0b95d83fd20ad8658ca4fff0ffe11417a78f0d966f622b63b5b39f48540a6031", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256, 427.0266, 428.0276, 429.0286, 430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333, 439.0052333333333], "recent_frames_sha256": "c7d1e89fe54ce110ae7ca6cd89cc38ef0ab9d324818a521a84b23161df16b56d", "num_recent_frames": 30, "tq": 717650.829147185, "t1": 717663.635675557, "ta": 717663.635675557, "te": 717663.674468765, "first_response_s": 12.80652837199159, "answer_total_s": 12.84532158006914, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_129_a977_q1", "video_id": 129, "time_stamp_s": 440, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "728001354bac25b8726f2be3b9751c1c7970d0c7a8382780a70d7de8d3cae81c", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Artist applies brown paint to hair and cheek area using a flat brush.  \n- Brush strokes are deliberate, covering sketch lines with solid color.  \n- Canvas remains upright on easel, with paint palette visible to left.\n[60-90s] - Artist uses a thin brush to apply brown paint to the subject's hair and cheek area.  \n- The canvas is mounted on an easel, with visible paint splatters along the edges.  \n- Background shows a cluttered studio with a palette and other art supplies.\n[90-120s] - Artist's hand uses a flat brush to apply white paint across the subject's cheek and jawline, blending with existing tones.  \n- The portrait, depicting a man with brown hair and a white shirt, shows progressive shading as the brush moves from left to right.  \n- The canvas is mounted on an easel, with paintbrushes and palette visible in the background workspace.\n[120-150s] - Artist’s hand uses a brush to apply dark strokes to the collar area of the portrait.  \n- The portrait depicts a man with brown hair and a white shirt, partially painted with visible brushstrokes.  \n- The canvas is mounted on an easel, with art supplies and a table visible in the background.\n[150-180s] - Artist's hand uses a brush to apply paint to the subject's forehead and cheek area.  \n- The portrait shows a man in a red jacket with a black collar, rendered in a painterly style.  \n- Background elements include a green plant to the left and a partially visible blue object to the right.\n[180-210s] - Artist's hand holds a brush, applying paint to the subject's cheek area.  \n- The portrait depicts a man with a red jacket, rendered in a stylized, painterly manner.  \n- A green leafy plant is visible to the left of the canvas, against a pink wall.\n[210-240s] - A hand uses a brush to apply paint to a portrait of a man in a red jacket on a canvas.  \n- The portrait shows the man with a surprised expression, set against a background of warm yellow and red tones.  \n- A green plant is visible to the left of the canvas, and the background features pink and blue geometric shapes.\n[240-270s] - A painting of a woman in a red garment is being worked on, with a brush applying paint to her cheek area.  \n- A small potted plant is visible to the left of the canvas, partially in frame.  \n- The painting's background features abstract, light-colored brushstrokes, contrasting with the subject's darker tones.\n[270-300s] - A hand holds a paintbrush, applying strokes to a portrait of a man with dark hair and a red jacket on a white canvas.  \n- The portrait shows the man with a surprised expression, eyes wide and mouth slightly open, with visible brushwork in the hair and clothing.  \n- A green leafy plant is visible to the left of the canvas, and a colorful wall with pink, beige, and blue sections is in the background.\n[300-330s] - Artist’s gloved hand applies white paint to the canvas, focusing on the subject’s hair and shoulders.  \n- The portrait depicts a man with a red jacket, showing visible brushstrokes and paint blending.  \n- A green plant is positioned to the left of the canvas, with a colorful wall in the background.\n[330-360s] - A hand holds a paintbrush, applying strokes to a portrait of a man with a red jacket on a canvas.  \n- The portrait depicts a man with a surprised expression, detailed hair, and a white shirt under the jacket.  \n- The canvas is positioned upright, with a green plant to the left and a wooden easel or background to the right.\n[360-390s] - A hand holds a paintbrush, applying strokes to a portrait of a man in a red jacket on a canvas.  \n- The portrait depicts a man with a surprised expression, featuring detailed facial features and a textured red jacket.  \n- A green potted plant is visible to the left of the canvas, and a laptop rests on a table beneath it.\n[390-420s] - A hand holds a thin brush near the canvas, poised to apply paint to the portrait of a man in a red jacket.  \n- The portrait, displayed on a white canvas, features a man with tousled hair and a serious expression, set against a colorful background.  \n- A green leafy plant is visible to the left of the canvas, and a laptop rests on a surface beneath it.", "history_tokens": 1008, "history_utf8_bytes": 4159, "recent_frame_times_s": [410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256, 427.0266, 428.0276, 429.0286, 430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333, 439.0052333333333], "recent_frames_sha256": "c7d1e89fe54ce110ae7ca6cd89cc38ef0ab9d324818a521a84b23161df16b56d", "num_recent_frames": 30, "tq": 717806.513699653, "t1": 717812.389896759, "ta": 717812.389896759, "te": 717812.576987084, "first_response_s": 5.876197105972096, "answer_total_s": 6.063287431024946, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 130, "content_group": "87007d7ae7ef1c4bcb5c5cd8e3882b36071bfd40bee8cac70a8a898ffbde0f5c", "question": {"question_id": "sample_130_a1716_q0", "video_id": 130, "video_path": "./videos/sample_130_real.mp4", "annotation_index": 1716, "question_index": 0, "question": "What is the main activity depicted in the video so far?", "options": ["A. Sketching a helmeted figure.", "B. Painting a landscape.", "C. Arranging art supplies.", "D. Painting a portrait."], "answer": "A", "time_stamp_s": 19, "task_type": "Clips Summarize", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_130_a1716_q0", "video_id": 130, "time_stamp_s": 19, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "46eb345d24fcc50b7a41048fdc44876c12bce803c64fcad2daea6af86cc9cd11", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "b072b25387f4d0a2f57cce5f919b742a25e56a6b3c260ddfab317490b4aefe46", "num_recent_frames": 20, "tq": 715941.654209545, "t1": 715942.759714661, "ta": 715942.759714661, "te": 715942.797306233, "first_response_s": 1.105505116051063, "answer_total_s": 1.143096687970683, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_130_a1716_q0", "video_id": 130, "time_stamp_s": 19, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "97e062c9b3e72cec7766979e48436f256dcc7656977a10aa74b9910dd8e06932", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "b072b25387f4d0a2f57cce5f919b742a25e56a6b3c260ddfab317490b4aefe46", "num_recent_frames": 20, "tq": 715745.462916506, "t1": 715752.019430933, "ta": 715752.019430933, "te": 715752.255979725, "first_response_s": 6.556514427065849, "answer_total_s": 6.793063219054602, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 130, "content_group": "87007d7ae7ef1c4bcb5c5cd8e3882b36071bfd40bee8cac70a8a898ffbde0f5c", "question": {"question_id": "sample_130_a1717_q0", "video_id": 130, "video_path": "./videos/sample_130_real.mp4", "annotation_index": 1717, "question_index": 0, "question": "Which of the following best summarizes the painting process just shown in the video?", "options": ["A. A hand paints a helmet with silver and blue accents, focusing on refining details.", "B. A hand paints a landscape and then switches to a portrait.", "C. A hand starts with abstract strokes and then adds a figure wearing armor.", "D. A hand repaints a completed painting with new colors."], "answer": "A", "time_stamp_s": 180, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_130_a1717_q0", "video_id": 130, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "64325b8803106d19c26b1bc8bdd3dfc6e3fefe217a9338262791bd8173fda7d1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "096cb45a606aac615c3153dad9687f493b44f56f40427d2983d572125c858a21", "num_recent_frames": 30, "tq": 715942.822570338, "t1": 715953.1303115, "ta": 715953.1303115, "te": 715953.16821528, "first_response_s": 10.30774116201792, "answer_total_s": 10.345644942019135, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_130_a1717_q0", "video_id": 130, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dfc9c6392ba63f06bbc76f2fe88e1eae700469247abe491d84ca523dfa2a76e6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Artist applies black paint to canvas with brush, focusing on helmet details.  \n- Artist adjusts easel, revealing sketch of Mandalorian helmet on white canvas.  \n- Workspace includes laptop, mug, and floral arrangement near easel.\n[30-60s] - Hand applies blue paint to canvas using brush, following sketch lines.  \n- Painter wipes excess paint with cloth, smoothing strokes on canvas.  \n- Black paint is applied over sketch lines, contrasting with blue areas.\n[60-90s] - Artist applies dark gray paint with a brush to a section of the canvas, blending it into a pre-drawn outline.  \n- Blue paint is visible on the left side of the canvas, contrasting with the newly applied dark gray.  \n- The brush moves horizontally across the canvas, smoothing the paint and integrating it with adjacent areas.\n[90-120s] - Artist applies black paint to the Mandalorian helmet's visor area using a flat brush.  \n- Blue paint strokes form the background around the helmet's outline.  \n- The canvas is positioned upright on an easel, with paintbrushes and palette visible nearby.\n[120-150s] - Artist's hand applies blue paint to the helmet's upper section using a flat brush.  \n- Brush strokes transition from light to darker blue, blending across the helmet's curved surface.  \n- Palette in background shows mixed dark paint, with brush dipped in it before application.\n[150-180s] - Hand uses brush to apply dark paint along helmet's edge, enhancing contrast with blue background.\n- Brush strokes are deliberate, focusing on defining helmet's contours and reflective surfaces.\n- Painting progresses with visible layering, suggesting depth and texture in the helmet's design.", "history_tokens": 371, "history_utf8_bytes": 1667, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "096cb45a606aac615c3153dad9687f493b44f56f40427d2983d572125c858a21", "num_recent_frames": 30, "tq": 715796.758881303, "t1": 715804.318693306, "ta": 715804.318693306, "te": 715804.508195709, "first_response_s": 7.5598120029317215, "answer_total_s": 7.749314405955374, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 130, "content_group": "87007d7ae7ef1c4bcb5c5cd8e3882b36071bfd40bee8cac70a8a898ffbde0f5c", "question": {"question_id": "sample_130_a1718_q0", "video_id": 130, "video_path": "./videos/sample_130_real.mp4", "annotation_index": 1718, "question_index": 0, "question": "Where is the artist applying pink paint on the helmet right now?", "options": ["A. The upper left portion.", "B. The lower right portion.", "C. The upper right portion.", "D. The lower left portion."], "answer": "C", "time_stamp_s": 499, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_130_a1718_q0", "video_id": 130, "time_stamp_s": 499, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9e0360e599819af12462c16c0e53c3cbcbabca1360962697586d84641b1a60e7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0], "recent_frames_sha256": "9c25fe6384c6ece4a7eca3231511bf6ada65be8b623281f33be24aef715280a0", "num_recent_frames": 30, "tq": 715953.185956679, "t1": 715959.902661174, "ta": 715959.902661174, "te": 715959.940713461, "first_response_s": 6.716704494901933, "answer_total_s": 6.754756781971082, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_130_a1718_q0", "video_id": 130, "time_stamp_s": 499, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fc89f3eb343104129d0cd53b109928a0e4f68f9306f97f634415bc7bb34f1777", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Artist applies dark gray paint with a brush to a section of the canvas, blending it into a pre-drawn outline.  \n- Blue paint is visible on the left side of the canvas, contrasting with the newly applied dark gray.  \n- The brush moves horizontally across the canvas, smoothing the paint and integrating it with adjacent areas.\n[90-120s] - Artist applies black paint to the Mandalorian helmet's visor area using a flat brush.  \n- Blue paint strokes form the background around the helmet's outline.  \n- The canvas is positioned upright on an easel, with paintbrushes and palette visible nearby.\n[120-150s] - Artist's hand applies blue paint to the helmet's upper section using a flat brush.  \n- Brush strokes transition from light to darker blue, blending across the helmet's curved surface.  \n- Palette in background shows mixed dark paint, with brush dipped in it before application.\n[150-180s] - Hand uses brush to apply dark paint along helmet's edge, enhancing contrast with blue background.\n- Brush strokes are deliberate, focusing on defining helmet's contours and reflective surfaces.\n- Painting progresses with visible layering, suggesting depth and texture in the helmet's design.\n[180-210s] - Artist's hand uses a brush to apply metallic paint to the helmet's reflective visor area.  \n- Brush strokes transition from blue to silver, enhancing the helmet's glossy, mirrored surface.  \n- The helmet's design features, including the black visor and emblem, remain visible as the painting progresses.\n[210-240s] - Artist applies blue paint to the helmet's side using a brush, blending it with existing strokes.  \n- Brush strokes show progression from darker to lighter blue, suggesting depth and reflection.  \n- Helmet's reflective surface is partially covered with blue, contrasting with metallic highlights.\n[240-270s] - Artist's hand applies brown paint to the Mandalorian's shoulder armor using a flat brush.  \n- Blue paint strokes form the background behind the helmet, contrasting with the dark armor.  \n- A lit desk lamp illuminates the canvas from the right, casting soft shadows on the painting surface.\n[270-300s] - A woman with purple hair speaks in front of a green plant, gesturing toward a screen displaying color theory concepts.  \n- The screen shows a color wheel labeled \"Hue\" and sliders for \"Saturation\" and \"Value,\" with a \"Color Picker\" interface visible.  \n- The video interface includes a sidebar with lesson titles and a \"Sign In\" button, indicating an online learning platform.\n[300-330s] - A woman with pink hair speaks in front of a green plant and framed art, with a YouTube video interface showing a \"Color Theory for Illustrators\" title and a \"Staff Pick\" label.  \n- A close-up shot shows a paintbrush applying blue paint to a metallic helmet, with the brush moving horizontally across the surface.  \n- The helmet is partially painted, with blue paint visible on the surrounding canvas and the brush strokes showing a blending effect.\n[330-360s] - A paintbrush with a wooden handle applies dark paint to a canvas, blending into existing strokes.  \n- The canvas, mounted on an easel, shows abstract brushwork with visible layers of color.  \n- Blue plastic sheeting is draped around the easel’s sides, likely to protect the surrounding area.\n[360-390s] - A paintbrush with a wooden handle is actively applying orange paint to a canvas.  \n- The canvas features abstract shapes with visible blue and black areas, partially covered by a blue plastic sheet.  \n- The brush moves horizontally along the edge of a reflective, metallic-looking section on the canvas.\n[390-420s] - A hand holds a paintbrush, applying blue paint to a metallic surface of a helmet-like object.  \n- The brush strokes are deliberate, filling in a vertical section of the helmet's edge.  \n- A blue plastic sheet is visible behind the helmet, partially covering the background.\n[420-450s] - Artist's hand holds a brush, applying blue paint to a canvas with abstract shapes.  \n- Brush strokes move horizontally across the canvas, blending colors in a textured area.  \n- A lit lamp in the background casts warm light, illuminating the workspace.\n[450-480s] - Artist's hand applies pink paint to a reflective surface on a canvas using a brush.  \n- The canvas features a partially painted figure with blue, black, and red tones, and the paint is being blended into the existing artwork.  \n- The brush strokes are deliberate, focusing on the reflective area near the figure’s shoulder or chest.", "history_tokens": 1014, "history_utf8_bytes": 4504, "recent_frame_times_s": [470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0], "recent_frames_sha256": "9c25fe6384c6ece4a7eca3231511bf6ada65be8b623281f33be24aef715280a0", "num_recent_frames": 30, "tq": 715883.431976451, "t1": 715891.64618968, "ta": 715891.64618968, "te": 715892.024500763, "first_response_s": 8.214213229017332, "answer_total_s": 8.592524312087335, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 130, "content_group": "87007d7ae7ef1c4bcb5c5cd8e3882b36071bfd40bee8cac70a8a898ffbde0f5c", "question": {"question_id": "sample_130_a1718_q1", "video_id": 130, "video_path": "./videos/sample_130_real.mp4", "annotation_index": 1718, "question_index": 1, "question": "Which of the following best summarizes the artist's activity shown in the video just now?", "options": ["A. The artist is painting a background with pink paint.", "B. The artist is drawing a landscape with various colors.", "C. The artist is sketching an abstract figure with fine details.", "D. The artist is applying blue and brown accents to a white background."], "answer": "A", "time_stamp_s": 500, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_130_a1718_q1", "video_id": 130, "time_stamp_s": 500, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3eac537094835598297f66dfd08d01e9c1267ab765a392706eea47387a4dafc3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0], "recent_frames_sha256": "a465ba8ee319f65e56ff1cf3860cb5af30635dd42cdd548bb5101e5523ed411e", "num_recent_frames": 30, "tq": 715959.953697966, "t1": 715971.471530428, "ta": 715971.471530428, "te": 715971.509086628, "first_response_s": 11.517832462093793, "answer_total_s": 11.555388662032783, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_130_a1718_q1", "video_id": 130, "time_stamp_s": 500, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "47befde9682e0a212b3a366985342e050a6becc3924d7bd92656124294322850", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Artist applies dark gray paint with a brush to a section of the canvas, blending it into a pre-drawn outline.  \n- Blue paint is visible on the left side of the canvas, contrasting with the newly applied dark gray.  \n- The brush moves horizontally across the canvas, smoothing the paint and integrating it with adjacent areas.\n[90-120s] - Artist applies black paint to the Mandalorian helmet's visor area using a flat brush.  \n- Blue paint strokes form the background around the helmet's outline.  \n- The canvas is positioned upright on an easel, with paintbrushes and palette visible nearby.\n[120-150s] - Artist's hand applies blue paint to the helmet's upper section using a flat brush.  \n- Brush strokes transition from light to darker blue, blending across the helmet's curved surface.  \n- Palette in background shows mixed dark paint, with brush dipped in it before application.\n[150-180s] - Hand uses brush to apply dark paint along helmet's edge, enhancing contrast with blue background.\n- Brush strokes are deliberate, focusing on defining helmet's contours and reflective surfaces.\n- Painting progresses with visible layering, suggesting depth and texture in the helmet's design.\n[180-210s] - Artist's hand uses a brush to apply metallic paint to the helmet's reflective visor area.  \n- Brush strokes transition from blue to silver, enhancing the helmet's glossy, mirrored surface.  \n- The helmet's design features, including the black visor and emblem, remain visible as the painting progresses.\n[210-240s] - Artist applies blue paint to the helmet's side using a brush, blending it with existing strokes.  \n- Brush strokes show progression from darker to lighter blue, suggesting depth and reflection.  \n- Helmet's reflective surface is partially covered with blue, contrasting with metallic highlights.\n[240-270s] - Artist's hand applies brown paint to the Mandalorian's shoulder armor using a flat brush.  \n- Blue paint strokes form the background behind the helmet, contrasting with the dark armor.  \n- A lit desk lamp illuminates the canvas from the right, casting soft shadows on the painting surface.\n[270-300s] - A woman with purple hair speaks in front of a green plant, gesturing toward a screen displaying color theory concepts.  \n- The screen shows a color wheel labeled \"Hue\" and sliders for \"Saturation\" and \"Value,\" with a \"Color Picker\" interface visible.  \n- The video interface includes a sidebar with lesson titles and a \"Sign In\" button, indicating an online learning platform.\n[300-330s] - A woman with pink hair speaks in front of a green plant and framed art, with a YouTube video interface showing a \"Color Theory for Illustrators\" title and a \"Staff Pick\" label.  \n- A close-up shot shows a paintbrush applying blue paint to a metallic helmet, with the brush moving horizontally across the surface.  \n- The helmet is partially painted, with blue paint visible on the surrounding canvas and the brush strokes showing a blending effect.\n[330-360s] - A paintbrush with a wooden handle applies dark paint to a canvas, blending into existing strokes.  \n- The canvas, mounted on an easel, shows abstract brushwork with visible layers of color.  \n- Blue plastic sheeting is draped around the easel’s sides, likely to protect the surrounding area.\n[360-390s] - A paintbrush with a wooden handle is actively applying orange paint to a canvas.  \n- The canvas features abstract shapes with visible blue and black areas, partially covered by a blue plastic sheet.  \n- The brush moves horizontally along the edge of a reflective, metallic-looking section on the canvas.\n[390-420s] - A hand holds a paintbrush, applying blue paint to a metallic surface of a helmet-like object.  \n- The brush strokes are deliberate, filling in a vertical section of the helmet's edge.  \n- A blue plastic sheet is visible behind the helmet, partially covering the background.\n[420-450s] - Artist's hand holds a brush, applying blue paint to a canvas with abstract shapes.  \n- Brush strokes move horizontally across the canvas, blending colors in a textured area.  \n- A lit lamp in the background casts warm light, illuminating the workspace.\n[450-480s] - Artist's hand applies pink paint to a reflective surface on a canvas using a brush.  \n- The canvas features a partially painted figure with blue, black, and red tones, and the paint is being blended into the existing artwork.  \n- The brush strokes are deliberate, focusing on the reflective area near the figure’s shoulder or chest.", "history_tokens": 1014, "history_utf8_bytes": 4504, "recent_frame_times_s": [471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0], "recent_frames_sha256": "a465ba8ee319f65e56ff1cf3860cb5af30635dd42cdd548bb5101e5523ed411e", "num_recent_frames": 30, "tq": 715892.060539187, "t1": 715899.759756712, "ta": 715899.759756712, "te": 715899.945680315, "first_response_s": 7.699217524961568, "answer_total_s": 7.885141127975658, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 130, "content_group": "87007d7ae7ef1c4bcb5c5cd8e3882b36071bfd40bee8cac70a8a898ffbde0f5c", "question": {"question_id": "sample_130_a1719_q0", "video_id": 130, "video_path": "./videos/sample_130_real.mp4", "annotation_index": 1719, "question_index": 0, "question": "What objects are scattered behind the easel?", "options": ["A. Pencils and papers.", "B. Paint tubes and brushes.", "C. Books and magazines.", "D. Sculpting tools and clay."], "answer": "B", "time_stamp_s": 642, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [600, 649], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_130_a1719_q0", "video_id": 130, "time_stamp_s": 642, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3fe5fab8b5f2b210c8075b99ef2c3a1c4e481bd5e76ad5e8fbe83a7a5bc0e639", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [613.0, 614.0, 615.0, 616.0, 617.0, 618.0, 619.0, 620.0, 621.0, 622.0, 623.0, 624.0, 625.0, 626.0, 627.0, 628.0, 629.0, 630.0, 631.0, 632.0, 633.0, 634.0, 635.0, 636.0, 637.0, 638.0, 639.0, 640.0, 641.0, 642.0], "recent_frames_sha256": "c503d4be78814f6874ab3a2ab114cebbfaafdf4697149403e29ceccee62d5db8", "num_recent_frames": 30, "tq": 715971.523022276, "t1": 715977.773582386, "ta": 715977.773582386, "te": 715977.811378836, "first_response_s": 6.2505601099692285, "answer_total_s": 6.2883565600495785, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_130_a1719_q0", "video_id": 130, "time_stamp_s": 642, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8efc4a34189abcaf5392862f4e69e7afbec33730d9d0707402ecab490524c2cc", "condition_order": ["notes", "recent"], "memory": "[240-270s] - Artist's hand applies brown paint to the Mandalorian's shoulder armor using a flat brush.  \n- Blue paint strokes form the background behind the helmet, contrasting with the dark armor.  \n- A lit desk lamp illuminates the canvas from the right, casting soft shadows on the painting surface.\n[270-300s] - A woman with purple hair speaks in front of a green plant, gesturing toward a screen displaying color theory concepts.  \n- The screen shows a color wheel labeled \"Hue\" and sliders for \"Saturation\" and \"Value,\" with a \"Color Picker\" interface visible.  \n- The video interface includes a sidebar with lesson titles and a \"Sign In\" button, indicating an online learning platform.\n[300-330s] - A woman with pink hair speaks in front of a green plant and framed art, with a YouTube video interface showing a \"Color Theory for Illustrators\" title and a \"Staff Pick\" label.  \n- A close-up shot shows a paintbrush applying blue paint to a metallic helmet, with the brush moving horizontally across the surface.  \n- The helmet is partially painted, with blue paint visible on the surrounding canvas and the brush strokes showing a blending effect.\n[330-360s] - A paintbrush with a wooden handle applies dark paint to a canvas, blending into existing strokes.  \n- The canvas, mounted on an easel, shows abstract brushwork with visible layers of color.  \n- Blue plastic sheeting is draped around the easel’s sides, likely to protect the surrounding area.\n[360-390s] - A paintbrush with a wooden handle is actively applying orange paint to a canvas.  \n- The canvas features abstract shapes with visible blue and black areas, partially covered by a blue plastic sheet.  \n- The brush moves horizontally along the edge of a reflective, metallic-looking section on the canvas.\n[390-420s] - A hand holds a paintbrush, applying blue paint to a metallic surface of a helmet-like object.  \n- The brush strokes are deliberate, filling in a vertical section of the helmet's edge.  \n- A blue plastic sheet is visible behind the helmet, partially covering the background.\n[420-450s] - Artist's hand holds a brush, applying blue paint to a canvas with abstract shapes.  \n- Brush strokes move horizontally across the canvas, blending colors in a textured area.  \n- A lit lamp in the background casts warm light, illuminating the workspace.\n[450-480s] - Artist's hand applies pink paint to a reflective surface on a canvas using a brush.  \n- The canvas features a partially painted figure with blue, black, and red tones, and the paint is being blended into the existing artwork.  \n- The brush strokes are deliberate, focusing on the reflective area near the figure’s shoulder or chest.\n[480-510s] - Artist applies pink paint to the helmet's side using a brush.  \n- Brush strokes transition from pink to blue, blending colors on the canvas.  \n- Helmet's reflective surface shows visible paint layers and brushwork.\n[510-540s] - Artist's hand uses a brush to apply blue paint to the canvas, focusing on the helmet's reflective surface.  \n- The painting depicts a Mandalorian helmet with metallic sheen, partially completed with pink and blue background tones.  \n- Brush strokes are deliberate, blending colors to enhance the helmet's glossy texture and contours.\n[540-570s] - Artist's hand uses a brush to apply paint to the reflective surface of the Mandalorian helmet's visor.  \n- The canvas shows a partially completed portrait with the helmet as the central focus, surrounded by abstract color blocks.  \n- A lit lamp and art supplies are visible in the background, indicating a studio setting.\n[570-600s] - A person holds a smartphone to photograph a canvas painting of a Mandalorian helmet.  \n- The artist, wearing a plaid shirt, approaches the easel and begins to clean brushes with a cloth.  \n- A second painting of a character in a white suit is visible on a wall in the background.\n[600-630s] - A large painting of a Mandalorian helmet dominates the background, with visible brushstrokes and a pinkish-orange gradient.  \n- A hand holding a paintbrush is seen actively applying paint to the helmet’s visor area.  \n- The foreground displays a wooden easel with paint tubes and brushes, indicating an ongoing art session.", "history_tokens": 965, "history_utf8_bytes": 4221, "recent_frame_times_s": [613.0, 614.0, 615.0, 616.0, 617.0, 618.0, 619.0, 620.0, 621.0, 622.0, 623.0, 624.0, 625.0, 626.0, 627.0, 628.0, 629.0, 630.0, 631.0, 632.0, 633.0, 634.0, 635.0, 636.0, 637.0, 638.0, 639.0, 640.0, 641.0, 642.0], "recent_frames_sha256": "c503d4be78814f6874ab3a2ab114cebbfaafdf4697149403e29ceccee62d5db8", "num_recent_frames": 30, "tq": 715934.837516671, "t1": 715941.364100068, "ta": 715941.364100068, "te": 715941.623529864, "first_response_s": 6.52658339694608, "answer_total_s": 6.786013192962855, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 133, "content_group": "f874abc93aa61893f80d6d84980a705f1f6f6f9156cdac5d31362268d5be71f6", "question": {"question_id": "sample_133_a439_q0", "video_id": 133, "video_path": "./videos/sample_133_real.mp4", "annotation_index": 439, "question_index": 0, "question": "What is the position of the paintbrush relative to the sketchbooks initially?", "options": ["A. In front of the open sketchbook.", "B. Between a sketchbook and a white item.", "C. Behind the closed sketchbook.", "D. To the left of the open sketchbook."], "answer": "B", "time_stamp_s": 20, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_133_a439_q0", "video_id": 133, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "37020ea92b16966d17d7f1f9a8734bc48a257b7ae3f25c1a7308b6d70d28779a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "937904179c6349fb8e74e0f34671458ac15cf581a7bf08bca3e53b028c2c6dde", "num_recent_frames": 21, "tq": 715308.41602429, "t1": 715309.348509805, "ta": 715309.348509805, "te": 715309.388117003, "first_response_s": 0.9324855150189251, "answer_total_s": 0.9720927129965276, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_133_a439_q0", "video_id": 133, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2cfcce234fb76368b0aba40636b20e372a9cd8764ac55c9444e638eafb1e85ff", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "937904179c6349fb8e74e0f34671458ac15cf581a7bf08bca3e53b028c2c6dde", "num_recent_frames": 21, "tq": 715347.39208586, "t1": 715353.374962573, "ta": 715353.374962573, "te": 715353.695504222, "first_response_s": 5.982876713038422, "answer_total_s": 6.303418361931108, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 133, "content_group": "f874abc93aa61893f80d6d84980a705f1f6f6f9156cdac5d31362268d5be71f6", "question": {"question_id": "sample_133_a440_q0", "video_id": 133, "video_path": "./videos/sample_133_real.mp4", "annotation_index": 440, "question_index": 0, "question": "What is the artist focusing on right now?", "options": ["A. Adding a background.", "B. Painting the portrait's face.", "C. Sketching the portrait.", "D. Cleaning the palette."], "answer": "B", "time_stamp_s": 219, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_133_a440_q0", "video_id": 133, "time_stamp_s": 219, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a225040413be183ebf1614c55ec18c81a10279a61b336452ae0fc80cfec10698", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0], "recent_frames_sha256": "477bc815988dbd23a4d7d523a7ecea794a543be06d1497ff646effc7113c0632", "num_recent_frames": 30, "tq": 715309.40669788, "t1": 715321.312372297, "ta": 715321.312372297, "te": 715321.353495506, "first_response_s": 11.905674417037517, "answer_total_s": 11.946797625976615, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_133_a440_q0", "video_id": 133, "time_stamp_s": 219, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2334478f263dbd6ab8400606db11dc08d785c17e7da2cd1359b31294bae7038d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand squeezes white acrylic paint from a bottle onto a notebook page.  \n- A brush is used to spread the paint across the page, then removed.  \n- A blue pen is used to draw on a printed image placed on the notebook.\n[30-60s] - Hand holds brush, applying black ink to sketch of face, starting with hairline and moving downward.  \n- Sketchbook lies open on flat surface; background shows blurred palette with paint colors.  \n- Brush strokes gradually darken facial features, emphasizing contours and depth.\n[60-90s] - Hand holds brush applying teal and orange paint to portrait's neck and cheek area.  \n- Brush strokes show deliberate blending of colors within the outlined sketch.  \n- Painted areas contrast with uncolored sketch lines, indicating ongoing coloring process.\n[90-120s] - Hand holds brush applying orange paint to portrait's cheek area.  \n- Brush then switches to blue paint, applying it to the forehead and eye region.  \n- Green-handled brush used to refine details around the eye and nose.\n[120-150s] - A hand holds a green-handled brush, applying paint to a portrait's forehead area.  \n- The portrait features bold, blocky color sections in teal, orange, and black, with visible sketch lines beneath.  \n- The brush strokes are deliberate, blending colors across the forehead and eye region.\n[150-180s] - A hand holds a paintbrush, applying teal and orange hues to a portrait's cheek and jawline.  \n- The portrait features bold, abstract color blocks with black hair and defined facial lines.  \n- The brush strokes are deliberate, blending colors across the face while maintaining sketch outlines.\n[180-210s] - A hand holds a paintbrush, applying teal and yellow hues to a portrait's cheek and jawline.  \n- The portrait features bold, sketchy outlines and vibrant color blocks, with black hair and a white shirt visible.  \n- A small inset image in the bottom left corner shows a simplified, dark-skinned figure with a surprised expression.", "history_tokens": 451, "history_utf8_bytes": 1965, "recent_frame_times_s": [190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0], "recent_frames_sha256": "477bc815988dbd23a4d7d523a7ecea794a543be06d1497ff646effc7113c0632", "num_recent_frames": 30, "tq": 715402.213635917, "t1": 715404.907398866, "ta": 715404.907398866, "te": 715405.185817151, "first_response_s": 2.693762948969379, "answer_total_s": 2.972181233926676, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 133, "content_group": "f874abc93aa61893f80d6d84980a705f1f6f6f9156cdac5d31362268d5be71f6", "question": {"question_id": "sample_133_a441_q0", "video_id": 133, "video_path": "./videos/sample_133_real.mp4", "annotation_index": 441, "question_index": 0, "question": "Where is the painting set while the artist works on it?", "options": ["A. On an easel.", "B. On the floor.", "C. On a table.", "D. On a wall."], "answer": "C", "time_stamp_s": 420, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_133_a441_q0", "video_id": 133, "time_stamp_s": 420, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7f1da839d2aa009a60d80d4925d2c79d5a721e686cdb531e03db509897eea200", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0], "recent_frames_sha256": "66c2cd70bad1547e9e1c5dc54921907bb65384e88c8d272938618bbfe2eb0440", "num_recent_frames": 30, "tq": 715321.37095748, "t1": 715331.897843944, "ta": 715331.897843944, "te": 715331.938781857, "first_response_s": 10.52688646398019, "answer_total_s": 10.567824376979843, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_133_a441_q0", "video_id": 133, "time_stamp_s": 420, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ed500317cbb1099169ac5a45d319fbc4a56daa5989e5813406bfa58f84ff8781", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand squeezes white acrylic paint from a bottle onto a notebook page.  \n- A brush is used to spread the paint across the page, then removed.  \n- A blue pen is used to draw on a printed image placed on the notebook.\n[30-60s] - Hand holds brush, applying black ink to sketch of face, starting with hairline and moving downward.  \n- Sketchbook lies open on flat surface; background shows blurred palette with paint colors.  \n- Brush strokes gradually darken facial features, emphasizing contours and depth.\n[60-90s] - Hand holds brush applying teal and orange paint to portrait's neck and cheek area.  \n- Brush strokes show deliberate blending of colors within the outlined sketch.  \n- Painted areas contrast with uncolored sketch lines, indicating ongoing coloring process.\n[90-120s] - Hand holds brush applying orange paint to portrait's cheek area.  \n- Brush then switches to blue paint, applying it to the forehead and eye region.  \n- Green-handled brush used to refine details around the eye and nose.\n[120-150s] - A hand holds a green-handled brush, applying paint to a portrait's forehead area.  \n- The portrait features bold, blocky color sections in teal, orange, and black, with visible sketch lines beneath.  \n- The brush strokes are deliberate, blending colors across the forehead and eye region.\n[150-180s] - A hand holds a paintbrush, applying teal and orange hues to a portrait's cheek and jawline.  \n- The portrait features bold, abstract color blocks with black hair and defined facial lines.  \n- The brush strokes are deliberate, blending colors across the face while maintaining sketch outlines.\n[180-210s] - A hand holds a paintbrush, applying teal and yellow hues to a portrait's cheek and jawline.  \n- The portrait features bold, sketchy outlines and vibrant color blocks, with black hair and a white shirt visible.  \n- A small inset image in the bottom left corner shows a simplified, dark-skinned figure with a surprised expression.\n[210-240s] - Artist's hand holds a green-handled brush, applying paint to the subject's eye area.  \n- The portrait features bold, abstract color blocks in blue, yellow, and teal, with black hair outlined in pencil.  \n- Brush strokes are precise, blending colors around the eye and cheekbone, enhancing facial contours.\n[240-270s] - Artist applies teal paint to the subject's hair with a fine brush, enhancing color depth.  \n- Black paint is applied to the subject's collar area, defining the garment's edge.  \n- Brush strokes transition from hair to collar, showing progressive layering of colors.\n[270-300s] - Artist’s hand holds a fine brush, applying dark pigment to the subject’s cheek area.  \n- The portrait features bold, textured strokes in teal, orange, and black, with visible sketch lines beneath.  \n- Brush tip moves precisely, blending pigment into the existing layered colors on the paper.\n[300-330s] - Painter's hand holds a fine brush, applying teal and yellow paint to Barack Obama's portrait's cheek and jawline.\n- The portrait features bold, stylized brushstrokes with a mix of teal, yellow, and black, showing progressive color layering.\n- A small, partially painted version of the portrait appears in the bottom-left corner, likely a reference or sketch.\n[330-360s] - Hand holds brush, applying paint to portrait's cheek area.  \n- Brush strokes blend teal and orange hues on face.  \n- Dark hair strokes remain visible against white paper background.\n[360-390s] - Artist applies light blue paint to the top of the portrait's hair using a brush.  \n- Brush strokes are broad and deliberate, blending color across the hair area.  \n- The portrait is on a white sketchbook page, with other brushes resting nearby.\n[390-420s] - Hand holds brush, applying teal paint in broad strokes over portrait's background.  \n- Brush moves horizontally, blending paint across canvas to create textured wash.  \n- Portrait features remain static as background is being painted.", "history_tokens": 909, "history_utf8_bytes": 3945, "recent_frame_times_s": [391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0], "recent_frames_sha256": "66c2cd70bad1547e9e1c5dc54921907bb65384e88c8d272938618bbfe2eb0440", "num_recent_frames": 30, "tq": 715455.622669086, "t1": 715456.795758668, "ta": 715456.795758668, "te": 715456.832917, "first_response_s": 1.1730895820073783, "answer_total_s": 1.2102479140739888, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 133, "content_group": "f874abc93aa61893f80d6d84980a705f1f6f6f9156cdac5d31362268d5be71f6", "question": {"question_id": "sample_133_a441_q1", "video_id": 133, "video_path": "./videos/sample_133_real.mp4", "annotation_index": 441, "question_index": 1, "question": "Which of the following best summarizes the painting process shown just now?", "options": ["A. A rough sketch of a landscape.", "B. Add background color to the portrait.", "C. An abstract painting with vibrant colors.", "D. A still life painting of fruits and flowers."], "answer": "B", "time_stamp_s": 420, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_133_a441_q1", "video_id": 133, "time_stamp_s": 420, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6a30dfbeeeaae53079ce492e276a2a55578014f251345eaaffdccc982238a74c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0], "recent_frames_sha256": "66c2cd70bad1547e9e1c5dc54921907bb65384e88c8d272938618bbfe2eb0440", "num_recent_frames": 30, "tq": 715331.953801259, "t1": 715340.573009883, "ta": 715340.573009883, "te": 715340.614191602, "first_response_s": 8.619208624004386, "answer_total_s": 8.660390342934988, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_133_a441_q1", "video_id": 133, "time_stamp_s": 420, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1ec24981bec3648d00793032b697fd321cb0319a9c29e95588f5038b0308121e", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand squeezes white acrylic paint from a bottle onto a notebook page.  \n- A brush is used to spread the paint across the page, then removed.  \n- A blue pen is used to draw on a printed image placed on the notebook.\n[30-60s] - Hand holds brush, applying black ink to sketch of face, starting with hairline and moving downward.  \n- Sketchbook lies open on flat surface; background shows blurred palette with paint colors.  \n- Brush strokes gradually darken facial features, emphasizing contours and depth.\n[60-90s] - Hand holds brush applying teal and orange paint to portrait's neck and cheek area.  \n- Brush strokes show deliberate blending of colors within the outlined sketch.  \n- Painted areas contrast with uncolored sketch lines, indicating ongoing coloring process.\n[90-120s] - Hand holds brush applying orange paint to portrait's cheek area.  \n- Brush then switches to blue paint, applying it to the forehead and eye region.  \n- Green-handled brush used to refine details around the eye and nose.\n[120-150s] - A hand holds a green-handled brush, applying paint to a portrait's forehead area.  \n- The portrait features bold, blocky color sections in teal, orange, and black, with visible sketch lines beneath.  \n- The brush strokes are deliberate, blending colors across the forehead and eye region.\n[150-180s] - A hand holds a paintbrush, applying teal and orange hues to a portrait's cheek and jawline.  \n- The portrait features bold, abstract color blocks with black hair and defined facial lines.  \n- The brush strokes are deliberate, blending colors across the face while maintaining sketch outlines.\n[180-210s] - A hand holds a paintbrush, applying teal and yellow hues to a portrait's cheek and jawline.  \n- The portrait features bold, sketchy outlines and vibrant color blocks, with black hair and a white shirt visible.  \n- A small inset image in the bottom left corner shows a simplified, dark-skinned figure with a surprised expression.\n[210-240s] - Artist's hand holds a green-handled brush, applying paint to the subject's eye area.  \n- The portrait features bold, abstract color blocks in blue, yellow, and teal, with black hair outlined in pencil.  \n- Brush strokes are precise, blending colors around the eye and cheekbone, enhancing facial contours.\n[240-270s] - Artist applies teal paint to the subject's hair with a fine brush, enhancing color depth.  \n- Black paint is applied to the subject's collar area, defining the garment's edge.  \n- Brush strokes transition from hair to collar, showing progressive layering of colors.\n[270-300s] - Artist’s hand holds a fine brush, applying dark pigment to the subject’s cheek area.  \n- The portrait features bold, textured strokes in teal, orange, and black, with visible sketch lines beneath.  \n- Brush tip moves precisely, blending pigment into the existing layered colors on the paper.\n[300-330s] - Painter's hand holds a fine brush, applying teal and yellow paint to Barack Obama's portrait's cheek and jawline.\n- The portrait features bold, stylized brushstrokes with a mix of teal, yellow, and black, showing progressive color layering.\n- A small, partially painted version of the portrait appears in the bottom-left corner, likely a reference or sketch.\n[330-360s] - Hand holds brush, applying paint to portrait's cheek area.  \n- Brush strokes blend teal and orange hues on face.  \n- Dark hair strokes remain visible against white paper background.\n[360-390s] - Artist applies light blue paint to the top of the portrait's hair using a brush.  \n- Brush strokes are broad and deliberate, blending color across the hair area.  \n- The portrait is on a white sketchbook page, with other brushes resting nearby.\n[390-420s] - Hand holds brush, applying teal paint in broad strokes over portrait's background.  \n- Brush moves horizontally, blending paint across canvas to create textured wash.  \n- Portrait features remain static as background is being painted.", "history_tokens": 909, "history_utf8_bytes": 3945, "recent_frame_times_s": [391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0], "recent_frames_sha256": "66c2cd70bad1547e9e1c5dc54921907bb65384e88c8d272938618bbfe2eb0440", "num_recent_frames": 30, "tq": 715456.857736614, "t1": 715468.17711533, "ta": 715468.17711533, "te": 715468.215849514, "first_response_s": 11.319378716056235, "answer_total_s": 11.35811290005222, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 133, "content_group": "f874abc93aa61893f80d6d84980a705f1f6f6f9156cdac5d31362268d5be71f6", "question": {"question_id": "sample_133_a442_q0", "video_id": 133, "video_path": "./videos/sample_133_real.mp4", "annotation_index": 442, "question_index": 0, "question": "Which of the following best summarizes the painting process in the video?", "options": ["A. Bold brushstrokes on a colorful landscape.", "B. Fine details on a still life painting.", "C. Detailing a portrait of a man with dark hair and a serious expressions.", "D. Subtle shading on an abstract design."], "answer": "C", "time_stamp_s": 619, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [600, 660], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_133_a442_q0", "video_id": 133, "time_stamp_s": 619, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "508b0c58d0665ed337894c3a500baaad80be56e053b6c38ae386b58049135c57", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [590.0, 591.0, 592.0, 593.0, 594.0, 595.0, 596.0, 597.0, 598.0, 599.0, 600.0, 601.0, 602.0, 603.0, 604.0, 605.0, 606.0, 607.0, 608.0, 609.0, 610.0, 611.0, 612.0, 613.0, 614.0, 615.0, 616.0, 617.0, 618.0, 619.0], "recent_frames_sha256": "2d20f8accd89946db372459656f832b31c7bab5827eab3e3685c51d243521d94", "num_recent_frames": 30, "tq": 715340.627108719, "t1": 715347.197305383, "ta": 715347.197305383, "te": 715347.381142609, "first_response_s": 6.57019666407723, "answer_total_s": 6.7540338900871575, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_133_a442_q0", "video_id": 133, "time_stamp_s": 619, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2d73d3e58dac40ce4516434ec945cd4f82a0b8417cc3c360766e0ddc455bde00", "condition_order": ["recent", "notes"], "memory": "[180-210s] - A hand holds a paintbrush, applying teal and yellow hues to a portrait's cheek and jawline.  \n- The portrait features bold, sketchy outlines and vibrant color blocks, with black hair and a white shirt visible.  \n- A small inset image in the bottom left corner shows a simplified, dark-skinned figure with a surprised expression.\n[210-240s] - Artist's hand holds a green-handled brush, applying paint to the subject's eye area.  \n- The portrait features bold, abstract color blocks in blue, yellow, and teal, with black hair outlined in pencil.  \n- Brush strokes are precise, blending colors around the eye and cheekbone, enhancing facial contours.\n[240-270s] - Artist applies teal paint to the subject's hair with a fine brush, enhancing color depth.  \n- Black paint is applied to the subject's collar area, defining the garment's edge.  \n- Brush strokes transition from hair to collar, showing progressive layering of colors.\n[270-300s] - Artist’s hand holds a fine brush, applying dark pigment to the subject’s cheek area.  \n- The portrait features bold, textured strokes in teal, orange, and black, with visible sketch lines beneath.  \n- Brush tip moves precisely, blending pigment into the existing layered colors on the paper.\n[300-330s] - Painter's hand holds a fine brush, applying teal and yellow paint to Barack Obama's portrait's cheek and jawline.\n- The portrait features bold, stylized brushstrokes with a mix of teal, yellow, and black, showing progressive color layering.\n- A small, partially painted version of the portrait appears in the bottom-left corner, likely a reference or sketch.\n[330-360s] - Hand holds brush, applying paint to portrait's cheek area.  \n- Brush strokes blend teal and orange hues on face.  \n- Dark hair strokes remain visible against white paper background.\n[360-390s] - Artist applies light blue paint to the top of the portrait's hair using a brush.  \n- Brush strokes are broad and deliberate, blending color across the hair area.  \n- The portrait is on a white sketchbook page, with other brushes resting nearby.\n[390-420s] - Hand holds brush, applying teal paint in broad strokes over portrait's background.  \n- Brush moves horizontally, blending paint across canvas to create textured wash.  \n- Portrait features remain static as background is being painted.\n[420-450s] - A hand uses a brush to refine details on a watercolor portrait of a man with teal and brown tones.  \n- The portrait is on a white sketchbook page, positioned on a gray surface.  \n- A white adjustable desk lamp illuminates the artwork, with a laptop and art supplies nearby.\n[450-480s] - A hand adjusts a white and gold desk lamp, moving its arm to illuminate a painting.  \n- The lamp’s base rests on a wooden desk beside a laptop, sketchbook, and art supplies.  \n- A large floral painting is visible in the background, partially obscured by the lamp’s movement.\n[480-510s] - Hand adjusts a white desk lamp's arm, positioning its light source.  \n- A partially completed portrait painting of a man with glasses is visible on an open sketchbook.  \n- A mug with \"THE DUST\" text sits in the background, near a laptop and art supplies.\n[510-540s] - Person adjusts a white desk lamp's arm, repositioning it toward a canvas painting.  \n- The lamp's base and articulated arm are visible, with a metallic ring and a white circular knob on the arm.  \n- A mug, notebook, and art supplies are arranged on the desk near the lamp.\n[540-570s] - A hand adjusts a white, articulated desk lamp's arm to position its light over a painting of flowers.  \n- The lamp's base is on a wooden desk, with art supplies and a tablet nearby.  \n- The lamp's head is being moved to illuminate a canvas with a green background and blue-white floral design.\n[570-600s] - A hand holds a green paintbrush, applying strokes to a portrait of a man with dark hair and a suit, focusing on the face and neck area.\n- The portrait features bold teal and blue brushstrokes in the background, contrasting with the subject's skin tones and clothing.\n- A black container labeled \"PIXIE DUST\" is partially visible in the upper right corner of the frame.", "history_tokens": 986, "history_utf8_bytes": 4143, "recent_frame_times_s": [590.0, 591.0, 592.0, 593.0, 594.0, 595.0, 596.0, 597.0, 598.0, 599.0, 600.0, 601.0, 602.0, 603.0, 604.0, 605.0, 606.0, 607.0, 608.0, 609.0, 610.0, 611.0, 612.0, 613.0, 614.0, 615.0, 616.0, 617.0, 618.0, 619.0], "recent_frames_sha256": "2d20f8accd89946db372459656f832b31c7bab5827eab3e3685c51d243521d94", "num_recent_frames": 30, "tq": 715514.036451442, "t1": 715515.039850006, "ta": 715515.039850006, "te": 715515.077786046, "first_response_s": 1.003398563945666, "answer_total_s": 1.0413346039131284, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 134, "content_group": "6a774856648c0cd0931263f9609119b040371b3a4c1e4f8806801d996999f82d", "question": {"question_id": "sample_134_a787_q0", "video_id": 134, "video_path": "./videos/sample_134_real.mp4", "annotation_index": 787, "question_index": 0, "question": "Which part of the drawing is being detailed by the brush in the first few seconds?", "options": ["A. The left eye.", "B. The right eye.", "C. The nose.", "D. The mouth."], "answer": "A", "time_stamp_s": 20, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_134_a787_q0", "video_id": 134, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d01332aa937a57021f0979348e55f3bd70610659431a040f639f694ef3a8bf85", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019], "recent_frames_sha256": "819f5ad28e43b5f19efcc4b10913e8a3f43bf77f4adcd8c6ca8f0613948a9283", "num_recent_frames": 20, "tq": 719486.443218257, "t1": 719492.803552596, "ta": 719492.803552596, "te": 719492.840979724, "first_response_s": 6.360334338969551, "answer_total_s": 6.397761466912925, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_134_a787_q0", "video_id": 134, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bfb214ee7eedf98371dd61bf85f35baec22e82cd4a31bdcf5eaff152ebb49e45", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019], "recent_frames_sha256": "819f5ad28e43b5f19efcc4b10913e8a3f43bf77f4adcd8c6ca8f0613948a9283", "num_recent_frames": 20, "tq": 719541.646082028, "t1": 719548.637594934, "ta": 719548.637594934, "te": 719548.942106765, "first_response_s": 6.991512905922718, "answer_total_s": 7.296024736948311, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 134, "content_group": "6a774856648c0cd0931263f9609119b040371b3a4c1e4f8806801d996999f82d", "question": {"question_id": "sample_134_a787_q1", "video_id": 134, "video_path": "./videos/sample_134_real.mp4", "annotation_index": 787, "question_index": 1, "question": "Which of the following best summarizes the content just shown in the video?", "options": ["A. A paintbrush outlines and details floral elements.", "B. A detailed drawing of a face is created from scratch.", "C. A paintbrush adds color to the floral headpiece.", "D. A paintbrush outlines and fills in the eyes of a detailed drawing."], "answer": "D", "time_stamp_s": 20, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_134_a787_q1", "video_id": 134, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "30f02938b78c369c9a827588de73125102150cb88e8941c67288be4ee4125849", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019], "recent_frames_sha256": "819f5ad28e43b5f19efcc4b10913e8a3f43bf77f4adcd8c6ca8f0613948a9283", "num_recent_frames": 20, "tq": 719492.855434944, "t1": 719505.494806388, "ta": 719505.494806388, "te": 719505.532388857, "first_response_s": 12.63937144400552, "answer_total_s": 12.676953912945464, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_134_a787_q1", "video_id": 134, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "93f0961358000755ff05cd485336812a6f496f632b67df0732d40965464df6e2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019], "recent_frames_sha256": "819f5ad28e43b5f19efcc4b10913e8a3f43bf77f4adcd8c6ca8f0613948a9283", "num_recent_frames": 20, "tq": 719548.953731931, "t1": 719562.50592482, "ta": 719562.50592482, "te": 719562.879214567, "first_response_s": 13.552192888921127, "answer_total_s": 13.925482635968365, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 134, "content_group": "6a774856648c0cd0931263f9609119b040371b3a4c1e4f8806801d996999f82d", "question": {"question_id": "sample_134_a788_q0", "video_id": 134, "video_path": "./videos/sample_134_real.mp4", "annotation_index": 788, "question_index": 0, "question": "Which of the following best summarizes the painting process just shown in the video?", "options": ["A. An artist begins sketching a woman's face on a new canvas.", "B. An artist is detailing a woman's face, focusing on her eyes, cheeks, and nose.", "C. An artist adds a detailed background to a painting of a woman.", "D. An artist is drawing abstract patterns around a woman's face."], "answer": "B", "time_stamp_s": 200, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_134_a788_q0", "video_id": 134, "time_stamp_s": 200, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "939b3b1c2c7e773d8bab60df1fe06785c99e44957e2f75d959403d1e89d16b60", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665], "recent_frames_sha256": "2fa0fd6a1190cffeecafc3ac4fcd93129641ea7d8d9c3dad4fcd544c1e4d7646", "num_recent_frames": 30, "tq": 719505.54606302, "t1": 719517.636954471, "ta": 719517.636954471, "te": 719517.674716429, "first_response_s": 12.090891450992785, "answer_total_s": 12.128653408959508, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_134_a788_q0", "video_id": 134, "time_stamp_s": 200, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8ddbed50616145f70825a1711a7c6dc881cfd0cfb7887967bb6d088cac8e15d4", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand holds a fine brush, applying dark pigment to the left eye of a Frida Kahlo sketch on canvas.  \n- The brush strokes gradually darken the iris and pupil, enhancing the eye's depth and detail.  \n- The sketch remains static on the canvas as the artist focuses on refining the eye's shading.\n[30-60s] - Artist uses a fine brush to apply dark pigment to the eyes, starting from the inner corners and extending outward.  \n- The same brush then fills in the eyebrows with a solid, dark shade, following the pre-drawn outline.  \n- A separate brush is used to apply a reddish-brown hue to the nose, beginning at the tip and working toward the nostrils.\n[60-90s] - A paintbrush applies dark red pigment to the nose area of a Frida Kahlo portrait sketch.  \n- The brush then moves to the lips, applying a similar red hue to define the mouth shape.  \n- The portrait remains static on canvas, with the artist’s hand and brush in motion.\n[90-120s] - A hand holds a paintbrush applying red pigment to the lips of a Frida Kahlo portrait sketch.  \n- The brush strokes are deliberate, filling in the mouth area with a bold red color.  \n- The artist then shifts focus to the eyebrows, beginning to apply red pigment to the upper brow area.\n[120-150s] - A paintbrush applies red pigment to the upper eyelid area of a sketch, enhancing the eye's color.  \n- The brush then moves to the lower eyelid, continuing the red application for a consistent look.  \n- The brush strokes are deliberate, focusing on the eye region while leaving other facial features untouched.\n[150-180s] - A hand holds a paintbrush applying red pigment to the subject's eyebrows and nose area.  \n- The brush strokes transition from the eyebrows downward toward the nose and then to the lips, which are already painted red.  \n- The canvas shows a partially completed portrait with visible sketch lines around the eyes, ears, and hairline.", "history_tokens": 449, "history_utf8_bytes": 1905, "recent_frame_times_s": [170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665], "recent_frames_sha256": "2fa0fd6a1190cffeecafc3ac4fcd93129641ea7d8d9c3dad4fcd544c1e4d7646", "num_recent_frames": 30, "tq": 719609.309479098, "t1": 719621.555676194, "ta": 719621.555676194, "te": 719621.898151704, "first_response_s": 12.246197096072137, "answer_total_s": 12.588672606041655, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 134, "content_group": "6a774856648c0cd0931263f9609119b040371b3a4c1e4f8806801d996999f82d", "question": {"question_id": "sample_134_a789_q0", "video_id": 134, "video_path": "./videos/sample_134_real.mp4", "annotation_index": 789, "question_index": 0, "question": "Which of the following best summarizes the painting process just shown in the video?", "options": ["A. A landscape being painted with different shades of green.", "B. A portrait of a woman being detailed with various brushes.", "C. An abstract painting with bright colors.", "D. A still life of fruits being created with careful strokes."], "answer": "B", "time_stamp_s": 380, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_134_a789_q0", "video_id": 134, "time_stamp_s": 380, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7f337a96c5b3289f94517689e96ae00322cda0d5999ea07933c0d4cac6ee05f6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667], "recent_frames_sha256": "8780e5673447e30b043f7f0720e649699ced4c0f374d7f1fd2493b4e36e62b70", "num_recent_frames": 30, "tq": 719517.691514685, "t1": 719528.923797589, "ta": 719528.923797589, "te": 719528.961321644, "first_response_s": 11.232282903976738, "answer_total_s": 11.26980695896782, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_134_a789_q0", "video_id": 134, "time_stamp_s": 380, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c3309cc0afdd240f0944224ee3fe492193c7d7433ec406c2c64b727bf0ba3697", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand holds a fine brush, applying dark pigment to the left eye of a Frida Kahlo sketch on canvas.  \n- The brush strokes gradually darken the iris and pupil, enhancing the eye's depth and detail.  \n- The sketch remains static on the canvas as the artist focuses on refining the eye's shading.\n[30-60s] - Artist uses a fine brush to apply dark pigment to the eyes, starting from the inner corners and extending outward.  \n- The same brush then fills in the eyebrows with a solid, dark shade, following the pre-drawn outline.  \n- A separate brush is used to apply a reddish-brown hue to the nose, beginning at the tip and working toward the nostrils.\n[60-90s] - A paintbrush applies dark red pigment to the nose area of a Frida Kahlo portrait sketch.  \n- The brush then moves to the lips, applying a similar red hue to define the mouth shape.  \n- The portrait remains static on canvas, with the artist’s hand and brush in motion.\n[90-120s] - A hand holds a paintbrush applying red pigment to the lips of a Frida Kahlo portrait sketch.  \n- The brush strokes are deliberate, filling in the mouth area with a bold red color.  \n- The artist then shifts focus to the eyebrows, beginning to apply red pigment to the upper brow area.\n[120-150s] - A paintbrush applies red pigment to the upper eyelid area of a sketch, enhancing the eye's color.  \n- The brush then moves to the lower eyelid, continuing the red application for a consistent look.  \n- The brush strokes are deliberate, focusing on the eye region while leaving other facial features untouched.\n[150-180s] - A hand holds a paintbrush applying red pigment to the subject's eyebrows and nose area.  \n- The brush strokes transition from the eyebrows downward toward the nose and then to the lips, which are already painted red.  \n- The canvas shows a partially completed portrait with visible sketch lines around the eyes, ears, and hairline.\n[180-210s] - Artist applies red paint to the subject's cheek using a brush.  \n- Brush strokes are deliberate, blending color into the portrait's skin area.  \n- White areas of the canvas remain untouched, contrasting with the painted sections.\n[210-240s] - Artist applies white paint to Frida Kahlo's forehead using a brush, transitioning from the hairline upward.  \n- The brush strokes are deliberate, covering the forehead area while leaving the eyes and lips untouched.  \n- The canvas shows partial completion with defined facial features and a black garment visible at the neckline.\n[240-270s] - A hand uses a paintbrush to apply pink and red hues to the floral arrangement atop Frida Kahlo’s head in a portrait.  \n- The brush strokes gradually fill in the petals, enhancing the floral design’s vibrancy against the white canvas.  \n- The portrait’s facial features remain static as the artist focuses on the floral embellishment.\n[270-300s] - A hand holds a paintbrush, applying strokes to the canvas depicting Frida Kahlo's portrait.  \n- The brush moves horizontally across the top of Frida’s head, near the floral arrangement.  \n- The painting shows vibrant colors, with the artist refining details around Frida’s face and hair.\n[300-330s] - A brush strokes the cheek area of a Frida Kahlo portrait, adding subtle color variation.  \n- The portrait’s right ear and dangling earring remain static as the brush moves.  \n- The canvas is positioned upright, slightly angled, with blurred greenery in the background.\n[330-360s] - A paintbrush is held horizontally, positioned near the subject's nose, suggesting ongoing painting work.  \n- The portrait depicts Frida Kahlo with dark hair adorned with flowers and dangling earrings, rendered in vivid colors.  \n- The canvas is set against a blurred background with green foliage visible to the left.", "history_tokens": 869, "history_utf8_bytes": 3764, "recent_frame_times_s": [350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667], "recent_frames_sha256": "8780e5673447e30b043f7f0720e649699ced4c0f374d7f1fd2493b4e36e62b70", "num_recent_frames": 30, "tq": 719675.450043104, "t1": 719682.533197729, "ta": 719682.533197729, "te": 719682.774054086, "first_response_s": 7.083154625026509, "answer_total_s": 7.324010981945321, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 134, "content_group": "6a774856648c0cd0931263f9609119b040371b3a4c1e4f8806801d996999f82d", "question": {"question_id": "sample_134_a790_q0", "video_id": 134, "video_path": "./videos/sample_134_real.mp4", "annotation_index": 790, "question_index": 0, "question": "Which of the following best summarizes the content of the video?", "options": ["A. An artist painting a landscape.", "B. An artist creating a portrait with vibrant colors and detailed features.", "C. A woman decorating her hair with flowers.", "D. An artist discussing painting techniques."], "answer": "B", "time_stamp_s": 559, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_134_a790_q0", "video_id": 134, "time_stamp_s": 559, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7a421479e5012e7af8d924676884755f37ae3993049168528d07eba9a4cde4be", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [529.0285, 530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333, 554.0201333333333, 555.0211333333333, 556.0221333333334, 557.0231333333334, 558.0241333333333], "recent_frames_sha256": "286fb719b04164c3ac050c5c96367f01fd86336d66221b4b1ba5207306324a46", "num_recent_frames": 30, "tq": 719528.970155051, "t1": 719541.600147707, "ta": 719541.600147707, "te": 719541.638816267, "first_response_s": 12.629992656060494, "answer_total_s": 12.668661216041073, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_134_a790_q0", "video_id": 134, "time_stamp_s": 559, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f480ae9ef2cc44ee23f87ba1307ec93a157235aeae12255f2db7823b27f6e20f", "condition_order": ["recent", "notes"], "memory": "[120-150s] - A paintbrush applies red pigment to the upper eyelid area of a sketch, enhancing the eye's color.  \n- The brush then moves to the lower eyelid, continuing the red application for a consistent look.  \n- The brush strokes are deliberate, focusing on the eye region while leaving other facial features untouched.\n[150-180s] - A hand holds a paintbrush applying red pigment to the subject's eyebrows and nose area.  \n- The brush strokes transition from the eyebrows downward toward the nose and then to the lips, which are already painted red.  \n- The canvas shows a partially completed portrait with visible sketch lines around the eyes, ears, and hairline.\n[180-210s] - Artist applies red paint to the subject's cheek using a brush.  \n- Brush strokes are deliberate, blending color into the portrait's skin area.  \n- White areas of the canvas remain untouched, contrasting with the painted sections.\n[210-240s] - Artist applies white paint to Frida Kahlo's forehead using a brush, transitioning from the hairline upward.  \n- The brush strokes are deliberate, covering the forehead area while leaving the eyes and lips untouched.  \n- The canvas shows partial completion with defined facial features and a black garment visible at the neckline.\n[240-270s] - A hand uses a paintbrush to apply pink and red hues to the floral arrangement atop Frida Kahlo’s head in a portrait.  \n- The brush strokes gradually fill in the petals, enhancing the floral design’s vibrancy against the white canvas.  \n- The portrait’s facial features remain static as the artist focuses on the floral embellishment.\n[270-300s] - A hand holds a paintbrush, applying strokes to the canvas depicting Frida Kahlo's portrait.  \n- The brush moves horizontally across the top of Frida’s head, near the floral arrangement.  \n- The painting shows vibrant colors, with the artist refining details around Frida’s face and hair.\n[300-330s] - A brush strokes the cheek area of a Frida Kahlo portrait, adding subtle color variation.  \n- The portrait’s right ear and dangling earring remain static as the brush moves.  \n- The canvas is positioned upright, slightly angled, with blurred greenery in the background.\n[330-360s] - A paintbrush is held horizontally, positioned near the subject's nose, suggesting ongoing painting work.  \n- The portrait depicts Frida Kahlo with dark hair adorned with flowers and dangling earrings, rendered in vivid colors.  \n- The canvas is set against a blurred background with green foliage visible to the left.\n[360-390s] - A hand holds a paintbrush, applying strokes to Frida Kahlo’s portrait on canvas.  \n- The brush moves across the subject’s cheek and nose area, adding color or blending.  \n- The portrait features dark hair adorned with flowers, and the background includes blurred greenery.\n[390-420s] - A paintbrush applies pink and white hues to a floral arrangement atop a portrait's head.\n- The brush strokes vary in direction, blending colors across petals and adjusting shading.\n- The portrait’s face remains static as the brushwork progresses on the floral elements.\n[420-450s] - A hand holds a thin brush, applying paint to Frida Kahlo’s portrait’s forehead area.  \n- The brush strokes are precise, blending colors across the forehead and upper cheek region.  \n- The portrait’s floral headpiece remains static, contrasting with the active painting motion.\n[450-480s] - A hand holds a paintbrush near the canvas, poised to apply paint to Frida Kahlo's portrait.  \n- The portrait features pink flowers in Frida's hair and a teal background, with visible brushstrokes.  \n- The canvas is mounted on an easel, with a potted plant to the left and a blurred floral arrangement to the right.\n[480-510s] - A hand holds a paintbrush near the canvas, poised to apply paint to Frida Kahlo’s portrait.  \n- The canvas background transitions from light green to a more vibrant teal hue.  \n- The portrait’s hair and floral crown remain detailed, with pink blossoms prominently displayed.\n[510-540s] - A hand holds a paintbrush near Frida Kahlo’s portrait, applying strokes to her lips.  \n- The portrait features pink flowers in her hair and a light green background.  \n- A plant is visible to the left, and a blurred floral arrangement is to the right.", "history_tokens": 987, "history_utf8_bytes": 4284, "recent_frame_times_s": [529.0285, 530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333, 554.0201333333333, 555.0211333333333, 556.0221333333334, 557.0231333333334, 558.0241333333333], "recent_frames_sha256": "286fb719b04164c3ac050c5c96367f01fd86336d66221b4b1ba5207306324a46", "num_recent_frames": 30, "tq": 719717.281513681, "t1": 719722.365076392, "ta": 719722.365076392, "te": 719722.514665924, "first_response_s": 5.083562710904516, "answer_total_s": 5.233152242959477, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 135, "content_group": "8ba6e598f0af4f2686bac0d0695314a4c1455891cffd34806454b61669114345", "question": {"question_id": "sample_135_a731_q0", "video_id": 135, "video_path": "./videos/sample_135_real.mp4", "annotation_index": 731, "question_index": 0, "question": "Which of the following best summarizes the painting just shown in the video?", "options": ["A. A partially painted left eye with preliminary details.", "B. A complete and detailed right eye, including the upper eyelid line.", "C. A detailed sketch of the entire face with no paint.", "D. An unfinished sketch with some paint on the lips."], "answer": "B", "time_stamp_s": 19, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_135_a731_q0", "video_id": 135, "time_stamp_s": 19, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "902ae20a2f0a299e7da2f58fe3163af9de7fa129c7d9b7ccce0965b3492fb41d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018], "recent_frames_sha256": "51ee0a35c3c35ef81f3d105b5e064bf1cbbefd2cb0c8564596caecc4137ba0a8", "num_recent_frames": 19, "tq": 710409.791488308, "t1": 710410.533193654, "ta": 710410.533193654, "te": 710410.573817156, "first_response_s": 0.7417053460376337, "answer_total_s": 0.7823288480285555, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_135_a731_q0", "video_id": 135, "time_stamp_s": 19, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6359ec890f8d461d7d93152fae3cf7c98829c14a36a22430f83a1bfe04a7a92f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018], "recent_frames_sha256": "51ee0a35c3c35ef81f3d105b5e064bf1cbbefd2cb0c8564596caecc4137ba0a8", "num_recent_frames": 19, "tq": 710227.893294659, "t1": 710233.951134756, "ta": 710233.951134756, "te": 710233.989652649, "first_response_s": 6.057840096997097, "answer_total_s": 6.096357990056276, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 135, "content_group": "8ba6e598f0af4f2686bac0d0695314a4c1455891cffd34806454b61669114345", "question": {"question_id": "sample_135_a732_q0", "video_id": 135, "video_path": "./videos/sample_135_real.mp4", "annotation_index": 732, "question_index": 0, "question": "Which area of the face remains largely unpainted so far?", "options": ["A. The eyes.", "B. The lips.", "C. The eyebrows.", "D. The cheeks and hair."], "answer": "D", "time_stamp_s": 187, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_135_a732_q0", "video_id": 135, "time_stamp_s": 187, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9e39adc3a2a61f6df67a230090a78c562d2ff52b53c827ea578f95806b6cd9b5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668], "recent_frames_sha256": "c0bcc9f0255cd5cda6b04e00905d3d18c818d6608f80ae7d57290506f55c4214", "num_recent_frames": 30, "tq": 710410.596910395, "t1": 710423.531331674, "ta": 710423.531331674, "te": 710423.57141571, "first_response_s": 12.934421279001981, "answer_total_s": 12.97450531506911, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_135_a732_q0", "video_id": 135, "time_stamp_s": 187, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1b7e1934c0b305b369bcb32947f780aae5da5fe2841a60658151848d4002284a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand holds a fine brush, applying black pigment to the right eye of a pencil sketch on paper.  \n- The brush carefully fills in the pupil and then extends to outline the eyeliner, enhancing the eye's definition.  \n- The sketch remains static on textured paper, with the brush moving precisely to refine the eye's appearance.\n[30-60s] - A fine brush applies black pigment to the left eye's upper eyelid, enhancing the eyeliner's definition.  \n- The brush then moves to the right eye, carefully outlining the upper eyelid with similar precision.  \n- Subsequently, the brush is positioned near the nose, preparing to add shading or detail to the facial structure.\n[60-90s] - A fine brush applies dark pigment to the right eye's iris, enhancing its depth.  \n- The brush moves precisely along the eye’s contour, maintaining focus on the pupil and surrounding area.  \n- The hand holding the brush remains steady, indicating controlled application of color.\n[90-120s] - A paintbrush with a maroon handle applies black pigment to the left eye of a sketch on white paper.  \n- The brush moves slightly to refine the eye’s shape and shading, maintaining focus on the pupil and iris area.  \n- The right eye remains uncolored, contrasting with the left eye being actively painted.\n[120-150s] - A paintbrush with a dark bristle tip is positioned near the subject's right eye, poised to apply pigment.  \n- The subject's right eye is partially shaded with dark pigment, while the left eye remains uncolored.  \n- The brush moves slightly, indicating preparation to apply more pigment to the eye area.\n[150-180s] - Artist applies dark pigment to the right eye, blending along the eyelid and outer corner.\n- Brush moves to the left eye, applying similar dark pigment with careful blending.\n- Brush then shifts to the lips, beginning to fill them with a reddish hue.", "history_tokens": 427, "history_utf8_bytes": 1861, "recent_frame_times_s": [157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668], "recent_frames_sha256": "c0bcc9f0255cd5cda6b04e00905d3d18c818d6608f80ae7d57290506f55c4214", "num_recent_frames": 30, "tq": 710284.155127995, "t1": 710291.251893003, "ta": 710291.251893003, "te": 710291.451039305, "first_response_s": 7.096765008056536, "answer_total_s": 7.295911310007796, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 135, "content_group": "8ba6e598f0af4f2686bac0d0695314a4c1455891cffd34806454b61669114345", "question": {"question_id": "sample_135_a733_q0", "video_id": 135, "video_path": "./videos/sample_135_real.mp4", "annotation_index": 733, "question_index": 0, "question": "Which of the following best summarizes the painting proess just shown in the video?", "options": ["A. The artist is preparing a new canvas for painting.", "B. This artist is adding details to the face of the portrait.", "C. The artist is drawing a rough sketch of a landscape.", "D. The artist is cleaning up after completing a painting."], "answer": "B", "time_stamp_s": 380, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_135_a733_q0", "video_id": 135, "time_stamp_s": 380, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "96128b268bcce403d76e245a7b41376bcc4aee5124d801a0811406f4fe739f48", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667], "recent_frames_sha256": "8b8008602775dea353dcd1a35150c794834d2f4a0f660424f5eec2270996ea58", "num_recent_frames": 30, "tq": 710423.583860252, "t1": 710435.285500089, "ta": 710435.285500089, "te": 710435.325168635, "first_response_s": 11.701639837003313, "answer_total_s": 11.741308382945135, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_135_a733_q0", "video_id": 135, "time_stamp_s": 380, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b8add28d421a72b7d0b1c3bbff3640c6cc8a0262904b331eaac9dba4a8d51c0d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand holds a fine brush, applying black pigment to the right eye of a pencil sketch on paper.  \n- The brush carefully fills in the pupil and then extends to outline the eyeliner, enhancing the eye's definition.  \n- The sketch remains static on textured paper, with the brush moving precisely to refine the eye's appearance.\n[30-60s] - A fine brush applies black pigment to the left eye's upper eyelid, enhancing the eyeliner's definition.  \n- The brush then moves to the right eye, carefully outlining the upper eyelid with similar precision.  \n- Subsequently, the brush is positioned near the nose, preparing to add shading or detail to the facial structure.\n[60-90s] - A fine brush applies dark pigment to the right eye's iris, enhancing its depth.  \n- The brush moves precisely along the eye’s contour, maintaining focus on the pupil and surrounding area.  \n- The hand holding the brush remains steady, indicating controlled application of color.\n[90-120s] - A paintbrush with a maroon handle applies black pigment to the left eye of a sketch on white paper.  \n- The brush moves slightly to refine the eye’s shape and shading, maintaining focus on the pupil and iris area.  \n- The right eye remains uncolored, contrasting with the left eye being actively painted.\n[120-150s] - A paintbrush with a dark bristle tip is positioned near the subject's right eye, poised to apply pigment.  \n- The subject's right eye is partially shaded with dark pigment, while the left eye remains uncolored.  \n- The brush moves slightly, indicating preparation to apply more pigment to the eye area.\n[150-180s] - Artist applies dark pigment to the right eye, blending along the eyelid and outer corner.\n- Brush moves to the left eye, applying similar dark pigment with careful blending.\n- Brush then shifts to the lips, beginning to fill them with a reddish hue.\n[180-210s] - A paintbrush applies reddish-brown pigment to the lips, enhancing their definition.  \n- The brush then moves to the cheek area, blending in a soft, warm tone to create a subtle gradient.  \n- The artist’s hand remains steady, carefully controlling the brush to avoid smudging the surrounding lines.\n[210-240s] - Artist applies reddish-brown paint to the subject's cheek and jawline using a fine brush.  \n- Brush strokes transition from the cheek to the chin area, blending colors with visible texture on canvas.  \n- Background remains blurred, focusing attention on the evolving portrait’s facial features.\n[240-270s] - A paintbrush applies reddish-brown pigment to the subject's eyebrow area, enhancing definition.  \n- The brush then moves to the cheek, adding soft pink tones to blend with existing skin hues.  \n- The canvas remains stationary, with the artist’s hand visible as the brush strokes are applied.\n[270-300s] - A hand holds a paintbrush, applying red pigment to the subject's cheek and neck area.  \n- The brush strokes are deliberate, blending the red color into the existing watercolor base.  \n- The canvas remains stationary, with the painting's outline clearly visible against the white background.\n[300-330s] - Artist applies pink paint to the subject's hair using a brush, blending colors for a soft gradient effect.  \n- The canvas is propped upright on an easel, with visible sketch lines defining facial features and hair.  \n- Background shows a cluttered art studio with tools and another painting partially visible on a distant easel.\n[330-360s] - Artist uses fine brush to add dark pigment along the subject's eyebrow line.  \n- Pink hair strands show subtle blending with lighter tones near the forehead.  \n- Brush strokes are precise, focusing on defining facial contours with minimal visible motion.", "history_tokens": 842, "history_utf8_bytes": 3705, "recent_frame_times_s": [350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667], "recent_frames_sha256": "8b8008602775dea353dcd1a35150c794834d2f4a0f660424f5eec2270996ea58", "num_recent_frames": 30, "tq": 710347.307458331, "t1": 710354.510104545, "ta": 710354.510104545, "te": 710354.771616787, "first_response_s": 7.2026462140493095, "answer_total_s": 7.464158455957659, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 135, "content_group": "8ba6e598f0af4f2686bac0d0695314a4c1455891cffd34806454b61669114345", "question": {"question_id": "sample_135_a734_q1", "video_id": 135, "video_path": "./videos/sample_135_real.mp4", "annotation_index": 734, "question_index": 1, "question": "Which statement best summarizes the painting process just shown in the video?", "options": ["A. The artist is rapidly applying layers of paint with a wide brush.", "B. The painter is outdoors, capturing a landscape with vivid colors.", "C. The artist is working methodically on a woman's portrait, focusing on hair details indoors.", "D. The canvas depicts an abstract scene with no distinguishable features."], "answer": "C", "time_stamp_s": 558, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_135_a734_q1", "video_id": 135, "time_stamp_s": 558, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7c0d423bd2487abbccd8b54ee146c53389358aa4b41e167a7803d5fcde7b5c53", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [528.0275, 529.0285, 530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333, 554.0201333333333, 555.0211333333333, 556.0221333333334, 557.0231333333334], "recent_frames_sha256": "e4d72b397c949da6aedd48915c574e7ec36a1c177f63bd2de52f3c6311a11cfb", "num_recent_frames": 30, "tq": 710435.337375533, "t1": 710443.754010078, "ta": 710443.754010078, "te": 710443.793767014, "first_response_s": 8.416634545079432, "answer_total_s": 8.456391481100582, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_135_a734_q1", "video_id": 135, "time_stamp_s": 558, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bc871c83fc2f6fadff6689699562254290652854547203f8ac63976bc375f7d6", "condition_order": ["notes", "recent"], "memory": "[120-150s] - A paintbrush with a dark bristle tip is positioned near the subject's right eye, poised to apply pigment.  \n- The subject's right eye is partially shaded with dark pigment, while the left eye remains uncolored.  \n- The brush moves slightly, indicating preparation to apply more pigment to the eye area.\n[150-180s] - Artist applies dark pigment to the right eye, blending along the eyelid and outer corner.\n- Brush moves to the left eye, applying similar dark pigment with careful blending.\n- Brush then shifts to the lips, beginning to fill them with a reddish hue.\n[180-210s] - A paintbrush applies reddish-brown pigment to the lips, enhancing their definition.  \n- The brush then moves to the cheek area, blending in a soft, warm tone to create a subtle gradient.  \n- The artist’s hand remains steady, carefully controlling the brush to avoid smudging the surrounding lines.\n[210-240s] - Artist applies reddish-brown paint to the subject's cheek and jawline using a fine brush.  \n- Brush strokes transition from the cheek to the chin area, blending colors with visible texture on canvas.  \n- Background remains blurred, focusing attention on the evolving portrait’s facial features.\n[240-270s] - A paintbrush applies reddish-brown pigment to the subject's eyebrow area, enhancing definition.  \n- The brush then moves to the cheek, adding soft pink tones to blend with existing skin hues.  \n- The canvas remains stationary, with the artist’s hand visible as the brush strokes are applied.\n[270-300s] - A hand holds a paintbrush, applying red pigment to the subject's cheek and neck area.  \n- The brush strokes are deliberate, blending the red color into the existing watercolor base.  \n- The canvas remains stationary, with the painting's outline clearly visible against the white background.\n[300-330s] - Artist applies pink paint to the subject's hair using a brush, blending colors for a soft gradient effect.  \n- The canvas is propped upright on an easel, with visible sketch lines defining facial features and hair.  \n- Background shows a cluttered art studio with tools and another painting partially visible on a distant easel.\n[330-360s] - Artist uses fine brush to add dark pigment along the subject's eyebrow line.  \n- Pink hair strands show subtle blending with lighter tones near the forehead.  \n- Brush strokes are precise, focusing on defining facial contours with minimal visible motion.\n[360-390s] - A paintbrush applies strokes to the subject's cheek area, blending pink tones.  \n- The brush moves horizontally across the canvas, refining the facial shading.  \n- The subject’s pink hair and defined eyes remain static as the brushwork progresses.\n[390-420s] - A hand uses a thin brush to apply subtle pink tones to the subject’s hair, blending with existing strokes.  \n- The brush moves horizontally across the hairline, refining the gradient and adding depth to the pink strands.  \n- The canvas remains stationary, with the subject’s face and shoulder visible, showing progress in the painting.\n[420-450s] - A hand holds a thin brush, applying paint to the shoulder area of a portrait with pink hair.  \n- The portrait features a woman with detailed facial features and a visible tattoo on her shoulder.  \n- The background includes a green plant to the left and a wooden easel to the right.\n[450-480s] - A hand uses a fine brush to apply pink paint to the subject's shoulder area.  \n- The brush strokes are deliberate, blending colors to create a soft gradient on the canvas.  \n- The painting's background remains light gray, contrasting with the vibrant pink hair.\n[480-510s] - A hand holds a paintbrush near the canvas, poised to apply paint to the subject's shoulder area.  \n- The canvas features a portrait with pink hair and visible tattoos, set against a neutral background.  \n- A green plant is positioned to the left of the canvas, partially in frame.\n[510-540s] - A hand holds a paintbrush near the canvas, poised to apply paint to the subject's shoulder area.  \n- The canvas displays a portrait with pink hair and a visible tattoo, set against a light gray background.  \n- A green potted plant is visible to the left of the canvas, and a wooden stick rests on the right side of the frame.", "history_tokens": 977, "history_utf8_bytes": 4241, "recent_frame_times_s": [528.0275, 529.0285, 530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333, 554.0201333333333, 555.0211333333333, 556.0221333333334, 557.0231333333334], "recent_frames_sha256": "e4d72b397c949da6aedd48915c574e7ec36a1c177f63bd2de52f3c6311a11cfb", "num_recent_frames": 30, "tq": 710396.20967703, "t1": 710397.758740816, "ta": 710397.758740816, "te": 710398.021240747, "first_response_s": 1.5490637860493734, "answer_total_s": 1.8115637169685215, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 135, "content_group": "8ba6e598f0af4f2686bac0d0695314a4c1455891cffd34806454b61669114345", "question": {"question_id": "sample_135_a734_q0", "video_id": 135, "video_path": "./videos/sample_135_real.mp4", "annotation_index": 734, "question_index": 0, "question": "What is positioned to the left of the canvas?", "options": ["A. A window.", "B. A green plant.", "C. A cup of coffee.", "D. A lamp."], "answer": "B", "time_stamp_s": 560, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_135_a734_q0", "video_id": 135, "time_stamp_s": 560, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3820c13425047be011b0fe38fa5be4196c4ccec111fa3ecd3165fbb71b21f4f5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333, 554.0201333333333, 555.0211333333333, 556.0221333333334, 557.0231333333334, 558.0241333333333, 559.0251333333333], "recent_frames_sha256": "90870fa8d3a9555f5fcf14be55d4051586a9ff1516579402d19202540f07783b", "num_recent_frames": 30, "tq": 710443.813212825, "t1": 710456.66247623, "ta": 710456.66247623, "te": 710456.700402172, "first_response_s": 12.849263404961675, "answer_total_s": 12.887189347064123, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_135_a734_q0", "video_id": 135, "time_stamp_s": 560, "ground_truth": "B", "raw_output": "B. A green plant.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "26ea258830a3892f6357748638af93491221915c07db0a5350b35782395a5604", "condition_order": ["notes", "recent"], "memory": "[120-150s] - A paintbrush with a dark bristle tip is positioned near the subject's right eye, poised to apply pigment.  \n- The subject's right eye is partially shaded with dark pigment, while the left eye remains uncolored.  \n- The brush moves slightly, indicating preparation to apply more pigment to the eye area.\n[150-180s] - Artist applies dark pigment to the right eye, blending along the eyelid and outer corner.\n- Brush moves to the left eye, applying similar dark pigment with careful blending.\n- Brush then shifts to the lips, beginning to fill them with a reddish hue.\n[180-210s] - A paintbrush applies reddish-brown pigment to the lips, enhancing their definition.  \n- The brush then moves to the cheek area, blending in a soft, warm tone to create a subtle gradient.  \n- The artist’s hand remains steady, carefully controlling the brush to avoid smudging the surrounding lines.\n[210-240s] - Artist applies reddish-brown paint to the subject's cheek and jawline using a fine brush.  \n- Brush strokes transition from the cheek to the chin area, blending colors with visible texture on canvas.  \n- Background remains blurred, focusing attention on the evolving portrait’s facial features.\n[240-270s] - A paintbrush applies reddish-brown pigment to the subject's eyebrow area, enhancing definition.  \n- The brush then moves to the cheek, adding soft pink tones to blend with existing skin hues.  \n- The canvas remains stationary, with the artist’s hand visible as the brush strokes are applied.\n[270-300s] - A hand holds a paintbrush, applying red pigment to the subject's cheek and neck area.  \n- The brush strokes are deliberate, blending the red color into the existing watercolor base.  \n- The canvas remains stationary, with the painting's outline clearly visible against the white background.\n[300-330s] - Artist applies pink paint to the subject's hair using a brush, blending colors for a soft gradient effect.  \n- The canvas is propped upright on an easel, with visible sketch lines defining facial features and hair.  \n- Background shows a cluttered art studio with tools and another painting partially visible on a distant easel.\n[330-360s] - Artist uses fine brush to add dark pigment along the subject's eyebrow line.  \n- Pink hair strands show subtle blending with lighter tones near the forehead.  \n- Brush strokes are precise, focusing on defining facial contours with minimal visible motion.\n[360-390s] - A paintbrush applies strokes to the subject's cheek area, blending pink tones.  \n- The brush moves horizontally across the canvas, refining the facial shading.  \n- The subject’s pink hair and defined eyes remain static as the brushwork progresses.\n[390-420s] - A hand uses a thin brush to apply subtle pink tones to the subject’s hair, blending with existing strokes.  \n- The brush moves horizontally across the hairline, refining the gradient and adding depth to the pink strands.  \n- The canvas remains stationary, with the subject’s face and shoulder visible, showing progress in the painting.\n[420-450s] - A hand holds a thin brush, applying paint to the shoulder area of a portrait with pink hair.  \n- The portrait features a woman with detailed facial features and a visible tattoo on her shoulder.  \n- The background includes a green plant to the left and a wooden easel to the right.\n[450-480s] - A hand uses a fine brush to apply pink paint to the subject's shoulder area.  \n- The brush strokes are deliberate, blending colors to create a soft gradient on the canvas.  \n- The painting's background remains light gray, contrasting with the vibrant pink hair.\n[480-510s] - A hand holds a paintbrush near the canvas, poised to apply paint to the subject's shoulder area.  \n- The canvas features a portrait with pink hair and visible tattoos, set against a neutral background.  \n- A green plant is positioned to the left of the canvas, partially in frame.\n[510-540s] - A hand holds a paintbrush near the canvas, poised to apply paint to the subject's shoulder area.  \n- The canvas displays a portrait with pink hair and a visible tattoo, set against a light gray background.  \n- A green potted plant is visible to the left of the canvas, and a wooden stick rests on the right side of the frame.", "history_tokens": 977, "history_utf8_bytes": 4241, "recent_frame_times_s": [530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333, 554.0201333333333, 555.0211333333333, 556.0221333333334, 557.0231333333334, 558.0241333333333, 559.0251333333333], "recent_frames_sha256": "90870fa8d3a9555f5fcf14be55d4051586a9ff1516579402d19202540f07783b", "num_recent_frames": 30, "tq": 710398.072942834, "t1": 710409.513236994, "ta": 710409.513236994, "te": 710409.759063549, "first_response_s": 11.440294160041958, "answer_total_s": 11.686120714992285, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 136, "content_group": "9e3679eb926e4d4a968a557ee5c52b94596aa17b8162f657d72d859c76431632", "question": {"question_id": "sample_136_a1861_q1", "video_id": 136, "video_path": "./videos/sample_136_real.mp4", "annotation_index": 1861, "question_index": 1, "question": "Where is the white palette located relative to the canvas?", "options": ["A. To the left of the canvas.", "B. Above the canvas.", "C. Below the canvas.", "D. To the right of the canvas."], "answer": "D", "time_stamp_s": 8, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_136_a1861_q1", "video_id": 136, "time_stamp_s": 8, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1107b94a0c1783acc1b08e7f2ee98440033b031393ab93752b6d147058265579", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0], "recent_frames_sha256": "bd723b626921a4be350eb1660d4aa5b1f81274862205386dcb2ecd6ebbab1ba6", "num_recent_frames": 9, "tq": 718520.639388288, "t1": 718521.594697035, "ta": 718521.594697035, "te": 718521.633845577, "first_response_s": 0.9553087470121682, "answer_total_s": 0.9944572889944538, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_136_a1861_q1", "video_id": 136, "time_stamp_s": 8, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2a439fa549a2228120c1329b4775b19a57452ac8b31cf3c451f000264b569375", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0], "recent_frames_sha256": "bd723b626921a4be350eb1660d4aa5b1f81274862205386dcb2ecd6ebbab1ba6", "num_recent_frames": 9, "tq": 718566.245307231, "t1": 718567.490237637, "ta": 718567.490237637, "te": 718567.527613279, "first_response_s": 1.2449304059846327, "answer_total_s": 1.2823060479713604, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 136, "content_group": "9e3679eb926e4d4a968a557ee5c52b94596aa17b8162f657d72d859c76431632", "question": {"question_id": "sample_136_a1861_q0", "video_id": 136, "video_path": "./videos/sample_136_real.mp4", "annotation_index": 1861, "question_index": 0, "question": "What are the dimensions of the canvas just shown in the video?", "options": ["A. 25 cm by 20 cm.", "B. 28 cm by 23 cm.", "C. 30 cm by 25 cm.", "D. 32 cm by 28 cm."], "answer": "B", "time_stamp_s": 20, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_136_a1861_q0", "video_id": 136, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a1608f8f9092e35dbeb4c1cfb9da97ba0aee519b9036dbd72601b8c42975a726", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "cb0093121512af4e0bb5aaa8f2f3d0cdecab6cf374fef5aa127d2d81e4364263", "num_recent_frames": 21, "tq": 718521.657048528, "t1": 718537.432234212, "ta": 718537.432234212, "te": 718537.471804474, "first_response_s": 15.775185684091412, "answer_total_s": 15.814755946048535, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_136_a1861_q0", "video_id": 136, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e958735f12c0d26bb9e4bb78e3f7d15817ac40e6b72f002a96ef7dfd23fb5d8b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "cb0093121512af4e0bb5aaa8f2f3d0cdecab6cf374fef5aa127d2d81e4364263", "num_recent_frames": 21, "tq": 718567.558379654, "t1": 718581.573959082, "ta": 718581.573959082, "te": 718581.611786722, "first_response_s": 14.015579428058118, "answer_total_s": 14.053407068015076, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 136, "content_group": "9e3679eb926e4d4a968a557ee5c52b94596aa17b8162f657d72d859c76431632", "question": {"question_id": "sample_136_a1862_q0", "video_id": 136, "video_path": "./videos/sample_136_real.mp4", "annotation_index": 1862, "question_index": 0, "question": "Where is the palette located in relation to the canvas?", "options": ["A. To the left of the canvas.", "B. Above the canvas.", "C. Below the canvas.", "D. To the right of the canvas."], "answer": "D", "time_stamp_s": 179, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_136_a1862_q0", "video_id": 136, "time_stamp_s": 179, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d7108e774a03b867965809c45bcf9022d974978509ed572667e1d82b5d26eb60", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0], "recent_frames_sha256": "fb8fc80c9579ca5d1f88198844b0c605040c35e6baa6e3648a79f9ba825370fb", "num_recent_frames": 30, "tq": 718537.496696061, "t1": 718546.01730977, "ta": 718546.01730977, "te": 718546.055029487, "first_response_s": 8.520613708999008, "answer_total_s": 8.558333426015452, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_136_a1862_q0", "video_id": 136, "time_stamp_s": 179, "ground_truth": "D", "raw_output": "D. To the right of the canvas.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "d607fc8bf757e55eb5531541e8121573923ec98092f05241e01d96249cafb079", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand applies blue paint to a white canvas using a flat brush, starting from the top edge.  \n- The palette shows mixed colors including black, cerulean blue, permanent yellow, and vermilion, with a 25mm flat brush being used.  \n- The canvas is positioned on a wooden surface, with text indicating its dimensions and material.\n[30-60s] - Hand applies light blue paint to canvas using a brush, creating a gradient effect.  \n- Palette with mixed colors (blue, yellow, white) is visible to the right of the canvas.  \n- Brush strokes transition from blue to white, forming a smooth color gradient across the canvas.\n[60-90s] - A hand uses a brush to apply blue paint to a canvas, blending it into a gradient sky.  \n- The palette shows various colors, including blue, yellow, and red, with a 5mm acrylic brush label visible.  \n- The brush strokes create a horizontal line of blue paint across the canvas, transitioning into the orange gradient below.\n[90-120s] - A hand holds a paintbrush, applying dark blue paint in textured strokes across the center of a canvas.  \n- The canvas displays a gradient from light blue at the top to orange at the bottom, with a horizontal band of dark blue paint being added.  \n- A paint palette with various colors (blue, yellow, red, black) is visible to the right of the canvas.\n[120-150s] - Two paintbrushes rest on a canvas depicting a gradient sky with blue, yellow, and orange hues and a dark blue cloud formation.  \n- A palette with mixed paint colors (black, blue, yellow, orange, red) is positioned to the right of the canvas.  \n- The canvas remains stationary, with no visible movement or change in paint application during the segment.", "history_tokens": 397, "history_utf8_bytes": 1684, "recent_frame_times_s": [150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0], "recent_frames_sha256": "fb8fc80c9579ca5d1f88198844b0c605040c35e6baa6e3648a79f9ba825370fb", "num_recent_frames": 30, "tq": 718618.308746092, "t1": 718625.976922331, "ta": 718625.976922331, "te": 718626.34994934, "first_response_s": 7.668176239007153, "answer_total_s": 8.041203247965313, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 136, "content_group": "9e3679eb926e4d4a968a557ee5c52b94596aa17b8162f657d72d859c76431632", "question": {"question_id": "sample_136_a1863_q0", "video_id": 136, "video_path": "./videos/sample_136_real.mp4", "annotation_index": 1863, "question_index": 0, "question": "What does the painter do after shifting to a broader view of the canvas?", "options": ["A. Cleans the brush.", "B. Adds details to the water.", "C. Mixes paint on the palette.", "D. Adjusts the position of the canvas."], "answer": "C", "time_stamp_s": 334, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_136_a1863_q0", "video_id": 136, "time_stamp_s": 334, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4bf1f6f15461f9587746ff8b141a60ae955e1cab8439d1c884d8fcf0f9fa62f2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0], "recent_frames_sha256": "a575cef2abccb85804da9a10d3f619e8aaf28331ffc65ae66bcd37b51cb40c50", "num_recent_frames": 30, "tq": 718546.071246256, "t1": 718553.814152024, "ta": 718553.814152024, "te": 718553.851947962, "first_response_s": 7.742905767983757, "answer_total_s": 7.780701705953106, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_136_a1863_q0", "video_id": 136, "time_stamp_s": 334, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "102307983ce9e78fb2b74528cd234b16e17f206acb4cafa3facc5e6f1ed6e5a5", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand applies blue paint to a white canvas using a flat brush, starting from the top edge.  \n- The palette shows mixed colors including black, cerulean blue, permanent yellow, and vermilion, with a 25mm flat brush being used.  \n- The canvas is positioned on a wooden surface, with text indicating its dimensions and material.\n[30-60s] - Hand applies light blue paint to canvas using a brush, creating a gradient effect.  \n- Palette with mixed colors (blue, yellow, white) is visible to the right of the canvas.  \n- Brush strokes transition from blue to white, forming a smooth color gradient across the canvas.\n[60-90s] - A hand uses a brush to apply blue paint to a canvas, blending it into a gradient sky.  \n- The palette shows various colors, including blue, yellow, and red, with a 5mm acrylic brush label visible.  \n- The brush strokes create a horizontal line of blue paint across the canvas, transitioning into the orange gradient below.\n[90-120s] - A hand holds a paintbrush, applying dark blue paint in textured strokes across the center of a canvas.  \n- The canvas displays a gradient from light blue at the top to orange at the bottom, with a horizontal band of dark blue paint being added.  \n- A paint palette with various colors (blue, yellow, red, black) is visible to the right of the canvas.\n[120-150s] - Two paintbrushes rest on a canvas depicting a gradient sky with blue, yellow, and orange hues and a dark blue cloud formation.  \n- A palette with mixed paint colors (black, blue, yellow, orange, red) is positioned to the right of the canvas.  \n- The canvas remains stationary, with no visible movement or change in paint application during the segment.\n[150-180s] - A paintbrush moves vertically across the canvas, blending orange and yellow hues at the bottom.  \n- The brush then shifts leftward, applying darker tones to the horizon line.  \n- A palette with mixed colors (blue, yellow, red, black) remains stationary to the right.\n[180-210s] - Painter uses a flat brush to blend blue and orange hues on canvas, creating a sky gradient.  \n- Palette with mixed paints (blue, yellow, red, black) is visible to the right of the canvas.  \n- Brush strokes are deliberate, adding texture to the clouds and horizon line.\n[210-240s] - A hand uses a brush to apply dark blue paint to the lower portion of a canvas depicting a sunset sky.  \n- The palette to the right contains various colors, including blue, yellow, and red, with a brush resting on it.  \n- The canvas shows a gradient from orange at the bottom to blue at the top, with dark clouds painted across the middle.\n[240-270s] - Painter's hand uses a brush to blend dark brown paint along the horizon line on canvas.  \n- Palette with various colors (blue, yellow, red, black) is visible to the right of the canvas.  \n- Canvas depicts a sunset scene with orange sky, dark clouds, and a brown horizon.\n[270-300s] - Hand holds brush, applying dark paint to canvas's lower section, forming silhouettes.  \n- Palette with mixed colors (blue, orange, red) visible beside canvas.  \n- Canvas depicts sunset scene with orange sky, dark clouds, and water reflection.\n[300-330s] - A paintbrush applies dark strokes to the lower portion of a canvas depicting a sunset landscape.  \n- The palette to the right holds various paint colors, including blue, yellow, and red, with some wet areas.  \n- The canvas shows a gradient sky transitioning from orange to blue, with silhouettes of land and water.", "history_tokens": 832, "history_utf8_bytes": 3466, "recent_frame_times_s": [305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0], "recent_frames_sha256": "a575cef2abccb85804da9a10d3f619e8aaf28331ffc65ae66bcd37b51cb40c50", "num_recent_frames": 30, "tq": 718666.298547824, "t1": 718673.913528182, "ta": 718673.913528182, "te": 718673.95103407, "first_response_s": 7.614980357931927, "answer_total_s": 7.652486245962791, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 136, "content_group": "9e3679eb926e4d4a968a557ee5c52b94596aa17b8162f657d72d859c76431632", "question": {"question_id": "sample_136_a1864_q0", "video_id": 136, "video_path": "./videos/sample_136_real.mp4", "annotation_index": 1864, "question_index": 0, "question": "Which of the following best summarizes the painting process just shown in the video?", "options": ["A. The artist paints a bright sunny day with flowers and butterflies.", "B. The artist creates a night scene with stars and a moon.", "C. The artist illustrates a winter landscape with snow and ice.", "D. The artist depicts a sunset over water, adding vertical elements like trees or reeds."], "answer": "D", "time_stamp_s": 499, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_136_a1864_q0", "video_id": 136, "time_stamp_s": 499, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9fff1f22b9e580aef005b9a691bc5a070fa7148707e5d191af7bf443911ea4d6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0], "recent_frames_sha256": "1ce38dece1bda0a94275e11b466bc26e14688168a2446356b40e7459df788eab", "num_recent_frames": 30, "tq": 718553.86311496, "t1": 718566.19860015, "ta": 718566.19860015, "te": 718566.23599514, "first_response_s": 12.335485189920291, "answer_total_s": 12.372880180017091, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_136_a1864_q0", "video_id": 136, "time_stamp_s": 499, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8b1f90c28e4bc4ba7e72744c27a885a0a3c32d37104e21ded86ebdb52faeea09", "condition_order": ["recent", "notes"], "memory": "[90-120s] - A hand holds a paintbrush, applying dark blue paint in textured strokes across the center of a canvas.  \n- The canvas displays a gradient from light blue at the top to orange at the bottom, with a horizontal band of dark blue paint being added.  \n- A paint palette with various colors (blue, yellow, red, black) is visible to the right of the canvas.\n[120-150s] - Two paintbrushes rest on a canvas depicting a gradient sky with blue, yellow, and orange hues and a dark blue cloud formation.  \n- A palette with mixed paint colors (black, blue, yellow, orange, red) is positioned to the right of the canvas.  \n- The canvas remains stationary, with no visible movement or change in paint application during the segment.\n[150-180s] - A paintbrush moves vertically across the canvas, blending orange and yellow hues at the bottom.  \n- The brush then shifts leftward, applying darker tones to the horizon line.  \n- A palette with mixed colors (blue, yellow, red, black) remains stationary to the right.\n[180-210s] - Painter uses a flat brush to blend blue and orange hues on canvas, creating a sky gradient.  \n- Palette with mixed paints (blue, yellow, red, black) is visible to the right of the canvas.  \n- Brush strokes are deliberate, adding texture to the clouds and horizon line.\n[210-240s] - A hand uses a brush to apply dark blue paint to the lower portion of a canvas depicting a sunset sky.  \n- The palette to the right contains various colors, including blue, yellow, and red, with a brush resting on it.  \n- The canvas shows a gradient from orange at the bottom to blue at the top, with dark clouds painted across the middle.\n[240-270s] - Painter's hand uses a brush to blend dark brown paint along the horizon line on canvas.  \n- Palette with various colors (blue, yellow, red, black) is visible to the right of the canvas.  \n- Canvas depicts a sunset scene with orange sky, dark clouds, and a brown horizon.\n[270-300s] - Hand holds brush, applying dark paint to canvas's lower section, forming silhouettes.  \n- Palette with mixed colors (blue, orange, red) visible beside canvas.  \n- Canvas depicts sunset scene with orange sky, dark clouds, and water reflection.\n[300-330s] - A paintbrush applies dark strokes to the lower portion of a canvas depicting a sunset landscape.  \n- The palette to the right holds various paint colors, including blue, yellow, and red, with some wet areas.  \n- The canvas shows a gradient sky transitioning from orange to blue, with silhouettes of land and water.\n[330-360s] - Hand uses a liner brush to apply dark blue paint to the canvas, enhancing cloud details against the sunset sky.  \n- Palette with mixed colors (blue, orange, black) is visible to the right, indicating ongoing color blending.  \n- Canvas shows a completed sunset scene with orange sky, dark clouds, and silhouetted landscape, suggesting the painting is nearing completion.\n[360-390s] - Hand holding a fine brush applies subtle strokes to the lower horizon area of a sunset landscape painting.  \n- The brush moves horizontally, blending colors to refine the water’s reflection and shoreline details.  \n- The painting’s sky shows vibrant orange and blue gradients, with dark silhouettes of distant landforms beneath.\n[390-420s] - Hand holds fine brush, applying dark pigment to lower horizon line.  \n- Brush strokes blend into existing orange and yellow sunset gradient.  \n- Canvas shows distinct sky layers with clouds and distant silhouettes.\n[420-450s] - Hand holds brush, applying yellow paint to create sun reflection on water surface.  \n- Brush strokes are deliberate, blending yellow paint to mimic light spreading across the water.  \n- Painting depicts sunset scene with orange sky, dark silhouettes of trees, and a bright sun near horizon.\n[450-480s] - Hand holds brush near canvas, poised to apply paint to the water's reflection area.  \n- Palette with mixed colors (blue, brown, yellow) visible to the right of the canvas.  \n- Canvas depicts sunset scene with sun, clouds, and silhouetted trees across a body of water.", "history_tokens": 959, "history_utf8_bytes": 4052, "recent_frame_times_s": [470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0], "recent_frames_sha256": "1ce38dece1bda0a94275e11b466bc26e14688168a2446356b40e7459df788eab", "num_recent_frames": 30, "tq": 718709.332070991, "t1": 718716.392139028, "ta": 718716.392139028, "te": 718716.436551591, "first_response_s": 7.060068036895245, "answer_total_s": 7.104480599984527, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 139, "content_group": "a439aaef527e34ddf576c53c598938fc0b6b3cba7ced6ed67242163fd2feedb3", "question": {"question_id": "sample_139_a1193_q0", "video_id": 139, "video_path": "./videos/sample_139_real.mp4", "annotation_index": 1193, "question_index": 0, "question": "Which of the following best summarizes the initial sequence of the video?", "options": ["A. A dark screen is followed by a splash screen, then a hand arranges and prepares paint for a painting session.", "B. A splash screen is followed by a dark screen, then a hand arranges brushes for a painting session.", "C. A white canvas is shown first, followed by a splash screen and paint tubes being arranged.", "D. A palette is shown with various colors, followed by a splash screen and a hand preparing brushes."], "answer": "A", "time_stamp_s": 20, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_139_a1193_q0", "video_id": 139, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "72736eea7e501aefbc66b2d015a8ef969ae16882d2fb0503651d490fe9389b90", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "14b2988ddeaab291cba251ea91ff60398b7802b5cbd8dd2e56516fe988ff68a0", "num_recent_frames": 21, "tq": 710772.179195253, "t1": 710777.331248291, "ta": 710777.331248291, "te": 710777.369820701, "first_response_s": 5.15205303800758, "answer_total_s": 5.1906254480127245, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_139_a1193_q0", "video_id": 139, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0b822c00fa048687b20433d1d15a2a2f35c72022129f6d8bb311d7e90f1888b4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "14b2988ddeaab291cba251ea91ff60398b7802b5cbd8dd2e56516fe988ff68a0", "num_recent_frames": 21, "tq": 710617.114686333, "t1": 710622.876575159, "ta": 710622.876575159, "te": 710622.913991854, "first_response_s": 5.7618888260331005, "answer_total_s": 5.799305520951748, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 139, "content_group": "a439aaef527e34ddf576c53c598938fc0b6b3cba7ced6ed67242163fd2feedb3", "question": {"question_id": "sample_139_a1194_q0", "video_id": 139, "video_path": "./videos/sample_139_real.mp4", "annotation_index": 1194, "question_index": 0, "question": "Where is the masking tape positioned on the canvas?", "options": ["A. Along the top edge.", "B. Along the bottom edge.", "C. Aligning with the horizon.", "D. Vertical down the center."], "answer": "C", "time_stamp_s": 164, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_139_a1194_q0", "video_id": 139, "time_stamp_s": 164, "ground_truth": "C", "raw_output": "C. Aligning with the horizon.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "e562d7572031067e7a0b928509d4e34749d08a380529c93e27ccba0e48399de1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0], "recent_frames_sha256": "3ae8c6f656d1277670160df8e8f58eb4791082dbde988ad9247b2459432edc6e", "num_recent_frames": 30, "tq": 710777.391468574, "t1": 710788.341240065, "ta": 710788.341240065, "te": 710788.63829983, "first_response_s": 10.949771491112188, "answer_total_s": 11.24683125608135, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_139_a1194_q0", "video_id": 139, "time_stamp_s": 164, "ground_truth": "C", "raw_output": "B. Along the bottom edge.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "3ce511b062eaaa5e5ba779d9b7c2b0afffd2102384ea620ca4df52b181d34439", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand applies black, cerulean blue, emerald green, vermillion, and permanent yellow paint to a palette.  \n- A 25mm flat brush mixes blue paint on the palette.  \n- The hand then begins painting the top left corner of a 28cm x 23cm cotton canvas with the mixed blue paint.\n[30-60s] - Hand applies blue paint to canvas using brush, starting from top-left corner and spreading horizontally.\n- Paint palette with various colors (blue, green, red, yellow) is visible to the right of the canvas.\n- Brush strokes create a textured, uneven blue band across the top portion of the canvas.\n[60-90s] - Hand holds brush, applying white paint to create cloud shapes on blue sky area.  \n- Brush strokes vary in width and pressure, forming distinct cloud forms.  \n- Paint palette with blue, green, and red pigments visible to the right of canvas.\n[90-120s] - Hand holds a brush applying white paint to create cloud shapes on a blue canvas.  \n- Brush strokes are deliberate, forming fluffy cloud patterns against a gradient sky.  \n- Canvas rests on a wooden surface with a white paper edge visible to the right.\n[120-150s] - A hand uses a brush to apply blue paint across the top of a canvas, creating a sky effect.  \n- Masking tape is placed along the bottom edge of the painted area to define a boundary.  \n- A palette with various colors, including blue, green, and red, is visible to the right of the canvas.", "history_tokens": 345, "history_utf8_bytes": 1406, "recent_frame_times_s": [135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0], "recent_frames_sha256": "3ae8c6f656d1277670160df8e8f58eb4791082dbde988ad9247b2459432edc6e", "num_recent_frames": 30, "tq": 710665.498090627, "t1": 710667.356426825, "ta": 710667.356426825, "te": 710667.63792948, "first_response_s": 1.8583361980272457, "answer_total_s": 2.1398388530360535, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 139, "content_group": "a439aaef527e34ddf576c53c598938fc0b6b3cba7ced6ed67242163fd2feedb3", "question": {"question_id": "sample_139_a1194_q1", "video_id": 139, "video_path": "./videos/sample_139_real.mp4", "annotation_index": 1194, "question_index": 1, "question": "Why did the hand reach towards the palette just now?", "options": ["A. To clean the brush.", "B. To mix and pick up more paint.", "C. To adjust the masking tape.", "D. To start a new painting."], "answer": "B", "time_stamp_s": 180, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_139_a1194_q1", "video_id": 139, "time_stamp_s": 180, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ea2a5e2c4aaecd039124fb2133cbd95c1d20c2b7292fd79af93974bf6bc7b81c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "87d1be65bf2341a7ec4c3217f097889a14e6e5c069a417f9841faeac10496001", "num_recent_frames": 30, "tq": 710788.653511908, "t1": 710799.689047812, "ta": 710799.689047812, "te": 710799.72729261, "first_response_s": 11.035535903996788, "answer_total_s": 11.073780701961368, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_139_a1194_q1", "video_id": 139, "time_stamp_s": 180, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "317e7999052a93755e273631b2f6e8bec69c92525041714971d76701f16ca002", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand applies black, cerulean blue, emerald green, vermillion, and permanent yellow paint to a palette.  \n- A 25mm flat brush mixes blue paint on the palette.  \n- The hand then begins painting the top left corner of a 28cm x 23cm cotton canvas with the mixed blue paint.\n[30-60s] - Hand applies blue paint to canvas using brush, starting from top-left corner and spreading horizontally.\n- Paint palette with various colors (blue, green, red, yellow) is visible to the right of the canvas.\n- Brush strokes create a textured, uneven blue band across the top portion of the canvas.\n[60-90s] - Hand holds brush, applying white paint to create cloud shapes on blue sky area.  \n- Brush strokes vary in width and pressure, forming distinct cloud forms.  \n- Paint palette with blue, green, and red pigments visible to the right of canvas.\n[90-120s] - Hand holds a brush applying white paint to create cloud shapes on a blue canvas.  \n- Brush strokes are deliberate, forming fluffy cloud patterns against a gradient sky.  \n- Canvas rests on a wooden surface with a white paper edge visible to the right.\n[120-150s] - A hand uses a brush to apply blue paint across the top of a canvas, creating a sky effect.  \n- Masking tape is placed along the bottom edge of the painted area to define a boundary.  \n- A palette with various colors, including blue, green, and red, is visible to the right of the canvas.\n[150-180s] - Hand applies turquoise paint to canvas using brush, starting from top edge and moving downward.  \n- Palette shows mixed blue and green paint with a brush resting on it.  \n- Canvas has a taped-off upper section with a sky image, while the lower section is being painted.", "history_tokens": 411, "history_utf8_bytes": 1689, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "87d1be65bf2341a7ec4c3217f097889a14e6e5c069a417f9841faeac10496001", "num_recent_frames": 30, "tq": 710673.031295776, "t1": 710686.01249829, "ta": 710686.01249829, "te": 710686.363187837, "first_response_s": 12.981202514027245, "answer_total_s": 13.33189206093084, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 139, "content_group": "a439aaef527e34ddf576c53c598938fc0b6b3cba7ced6ed67242163fd2feedb3", "question": {"question_id": "sample_139_a1195_q0", "video_id": 139, "video_path": "./videos/sample_139_real.mp4", "annotation_index": 1195, "question_index": 0, "question": "Where is the hand focusing its painting efforts right now?", "options": ["A. On the sandy beach.", "B. On the horizon line.", "C. On the the second wave.", "D. On the fluffy white clouds."], "answer": "C", "time_stamp_s": 338, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_139_a1195_q0", "video_id": 139, "time_stamp_s": 338, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "560f404c79fddf4e1de0885f2cb423b88be2b90f9e55a68614eb6f98ac79cf40", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0], "recent_frames_sha256": "822902d2c7a5487081fea1ce9269198ea8b2c20eabe31180c7a30b1183954c63", "num_recent_frames": 30, "tq": 715186.732825038, "t1": 715194.488397776, "ta": 715194.488397776, "te": 715194.526287389, "first_response_s": 7.755572738009505, "answer_total_s": 7.793462350964546, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_139_a1195_q0", "video_id": 139, "time_stamp_s": 338, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "28c38493d6793e89016080e1eaaced4f4d23bb4d8a1fce888af2804d79195bbd", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand applies black, cerulean blue, emerald green, vermillion, and permanent yellow paint to a palette.  \n- A 25mm flat brush mixes blue paint on the palette.  \n- The hand then begins painting the top left corner of a 28cm x 23cm cotton canvas with the mixed blue paint.\n[30-60s] - Hand applies blue paint to canvas using brush, starting from top-left corner and spreading horizontally.\n- Paint palette with various colors (blue, green, red, yellow) is visible to the right of the canvas.\n- Brush strokes create a textured, uneven blue band across the top portion of the canvas.\n[60-90s] - Hand holds brush, applying white paint to create cloud shapes on blue sky area.  \n- Brush strokes vary in width and pressure, forming distinct cloud forms.  \n- Paint palette with blue, green, and red pigments visible to the right of canvas.\n[90-120s] - Hand holds a brush applying white paint to create cloud shapes on a blue canvas.  \n- Brush strokes are deliberate, forming fluffy cloud patterns against a gradient sky.  \n- Canvas rests on a wooden surface with a white paper edge visible to the right.\n[120-150s] - A hand uses a brush to apply blue paint across the top of a canvas, creating a sky effect.  \n- Masking tape is placed along the bottom edge of the painted area to define a boundary.  \n- A palette with various colors, including blue, green, and red, is visible to the right of the canvas.\n[150-180s] - Hand applies turquoise paint to canvas using brush, starting from top edge and moving downward.  \n- Palette shows mixed blue and green paint with a brush resting on it.  \n- Canvas has a taped-off upper section with a sky image, while the lower section is being painted.\n[180-210s] - Artist's hand uses a brush to blend turquoise paint across the canvas, creating a gradient effect from the horizon to the foreground.\n- The canvas is taped along the top and bottom edges, with a white beach area at the bottom and a blue sky with clouds above.\n- A paint palette with blue, green, and yellow pigments is visible to the right, with a brush resting on it.\n[210-240s] - Artist's hand uses a brush to blend turquoise paint across the canvas, creating ocean waves.  \n- Palette shows blue, red, and yellow paint with a brush actively mixing colors.  \n- Canvas is taped to a wooden surface, with a white border at the bottom.\n[240-270s] - Hand holds brush, applying paint to canvas in horizontal strokes to depict ocean waves.  \n- Canvas taped to wooden surface, with painted sky and turquoise water already visible.  \n- Paint palette with blue and red pigments visible to the right of the canvas.\n[270-300s] - Hand uses a liner brush to add fine white highlights to ocean waves, enhancing texture.  \n- Canvas shows a vibrant turquoise sea with white foam, set against a blue sky with clouds.  \n- Painter’s hand moves steadily, applying paint with precision near the wave crests.\n[300-330s] - A hand holds a red-handled brush, applying paint to a canvas depicting ocean waves and sky.  \n- The canvas is taped to a wooden surface, with visible white tape along the top edge.  \n- The artist’s brush strokes create detailed wave patterns in the turquoise ocean, blending with the white foam at the shoreline.", "history_tokens": 770, "history_utf8_bytes": 3220, "recent_frame_times_s": [309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0], "recent_frames_sha256": "822902d2c7a5487081fea1ce9269198ea8b2c20eabe31180c7a30b1183954c63", "num_recent_frames": 30, "tq": 710725.377511366, "t1": 710731.673352597, "ta": 710731.673352597, "te": 710731.858731501, "first_response_s": 6.295841231010854, "answer_total_s": 6.481220134999603, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 139, "content_group": "a439aaef527e34ddf576c53c598938fc0b6b3cba7ced6ed67242163fd2feedb3", "question": {"question_id": "sample_139_a1196_q0", "video_id": 139, "video_path": "./videos/sample_139_real.mp4", "annotation_index": 1196, "question_index": 0, "question": "Which of the following best summarizes the content just shown in the video?", "options": ["A. A hand painting a vibrant seascape with turquoise waves and white foam.", "B. A close-up of an artist sketching a cityscape.", "C. A detailed view of a forest scene being painted.", "D. An artist mixing colors on a palette."], "answer": "A", "time_stamp_s": 500, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_139_a1196_q0", "video_id": 139, "time_stamp_s": 500, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e07b6a4220c8ecfee1f4d34d34f391edbc8772b66b6b169cc0b487d3bf9754cb", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0], "recent_frames_sha256": "ddae4fa9dfe06b42af25a3ed330778882fb598712f9609e03acf28e19a86a1fa", "num_recent_frames": 30, "tq": 715194.534638702, "t1": 715206.11277631, "ta": 715206.11277631, "te": 715206.317823757, "first_response_s": 11.57813760789577, "answer_total_s": 11.78318505489733, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_139_a1196_q0", "video_id": 139, "time_stamp_s": 500, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5054c4d81e111bfb9dc15ed19cc5f6a39ca4c25587197ca51520c91b4052bd9b", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Hand applies blue paint to canvas using brush, starting from top-left corner and spreading horizontally.\n- Paint palette with various colors (blue, green, red, yellow) is visible to the right of the canvas.\n- Brush strokes create a textured, uneven blue band across the top portion of the canvas.\n[60-90s] - Hand holds brush, applying white paint to create cloud shapes on blue sky area.  \n- Brush strokes vary in width and pressure, forming distinct cloud forms.  \n- Paint palette with blue, green, and red pigments visible to the right of canvas.\n[90-120s] - Hand holds a brush applying white paint to create cloud shapes on a blue canvas.  \n- Brush strokes are deliberate, forming fluffy cloud patterns against a gradient sky.  \n- Canvas rests on a wooden surface with a white paper edge visible to the right.\n[120-150s] - A hand uses a brush to apply blue paint across the top of a canvas, creating a sky effect.  \n- Masking tape is placed along the bottom edge of the painted area to define a boundary.  \n- A palette with various colors, including blue, green, and red, is visible to the right of the canvas.\n[150-180s] - Hand applies turquoise paint to canvas using brush, starting from top edge and moving downward.  \n- Palette shows mixed blue and green paint with a brush resting on it.  \n- Canvas has a taped-off upper section with a sky image, while the lower section is being painted.\n[180-210s] - Artist's hand uses a brush to blend turquoise paint across the canvas, creating a gradient effect from the horizon to the foreground.\n- The canvas is taped along the top and bottom edges, with a white beach area at the bottom and a blue sky with clouds above.\n- A paint palette with blue, green, and yellow pigments is visible to the right, with a brush resting on it.\n[210-240s] - Artist's hand uses a brush to blend turquoise paint across the canvas, creating ocean waves.  \n- Palette shows blue, red, and yellow paint with a brush actively mixing colors.  \n- Canvas is taped to a wooden surface, with a white border at the bottom.\n[240-270s] - Hand holds brush, applying paint to canvas in horizontal strokes to depict ocean waves.  \n- Canvas taped to wooden surface, with painted sky and turquoise water already visible.  \n- Paint palette with blue and red pigments visible to the right of the canvas.\n[270-300s] - Hand uses a liner brush to add fine white highlights to ocean waves, enhancing texture.  \n- Canvas shows a vibrant turquoise sea with white foam, set against a blue sky with clouds.  \n- Painter’s hand moves steadily, applying paint with precision near the wave crests.\n[300-330s] - A hand holds a red-handled brush, applying paint to a canvas depicting ocean waves and sky.  \n- The canvas is taped to a wooden surface, with visible white tape along the top edge.  \n- The artist’s brush strokes create detailed wave patterns in the turquoise ocean, blending with the white foam at the shoreline.\n[330-360s] - Hand holds red-handled brush, applying fine strokes to turquoise ocean waves on canvas.  \n- Canvas taped to wooden surface, with white beach area below the waves.  \n- Paint palette with blue and red pigments visible to the right of the canvas.\n[360-390s] - Hand mixes brown paint on palette using brush.  \n- Canvas shows ocean and sky; hand prepares to apply new layer.  \n- Palette contains mixed blue, red, and brown paints.\n[390-420s] - A hand uses a brush to apply brown paint across the bottom of a canvas depicting a beach scene.  \n- The palette to the right contains mixed blue, orange, and brown paints with a brush resting on it.  \n- A \"20mm Fan Brush\" label appears on the palette, indicating the brush type being used.\n[420-450s] - A hand holds a blue-handled brush, applying white paint to create wave foam on the sandy beach.  \n- The canvas depicts a vibrant ocean scene with turquoise waves and distant hills under a partly cloudy sky.  \n- A paint palette with various colors, including blues, reds, and yellows, is visible to the right of the canvas.\n[450-480s] - A hand holds a blue paintbrush, applying white paint to depict foam on the beach.  \n- The canvas shows a vibrant ocean scene with turquoise waves and a sandy shore.  \n- A paint palette with mixed colors is visible to the right of the canvas.", "history_tokens": 1022, "history_utf8_bytes": 4271, "recent_frame_times_s": [471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0], "recent_frames_sha256": "ddae4fa9dfe06b42af25a3ed330778882fb598712f9609e03acf28e19a86a1fa", "num_recent_frames": 30, "tq": 710770.957343422, "t1": 710771.99833694, "ta": 710771.99833694, "te": 710772.151800993, "first_response_s": 1.0409935179632157, "answer_total_s": 1.1944575710222125, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 140, "content_group": "54e59dbfaf3b76511d1c70e7af3b3c810351c2f36a3c0e57f107cc16b31058ba", "question": {"question_id": "sample_140_a423_q0", "video_id": 140, "video_path": "./videos/sample_140_real.mp4", "annotation_index": 423, "question_index": 0, "question": "Why does the gradient effect become more pronounced?", "options": ["A. Because more dark paint is added.", "B. Because the brushstrokes become vertical.", "C. Because the brushstrokes blend smoothly from pink to white.", "D. Because the person stops adding paint."], "answer": "C", "time_stamp_s": 20, "task_type": "Causal Reasoning", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_140_a423_q0", "video_id": 140, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6175578eafcb4769197788e171ee4dc3a891666eecb55bd32d009a059b9cc68a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "dd22416d32ce6209f0b495a564d9136fb570f202fe2312c8bcc7e404f32bb3c1", "num_recent_frames": 21, "tq": 715254.750075466, "t1": 715261.07844818, "ta": 715261.07844818, "te": 715261.118916999, "first_response_s": 6.3283727139933035, "answer_total_s": 6.368841532967053, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_140_a423_q0", "video_id": 140, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "857e5ab3e5aee84b448f253c9be5c0cab9774971d774df042f20147b6a921bb4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "dd22416d32ce6209f0b495a564d9136fb570f202fe2312c8bcc7e404f32bb3c1", "num_recent_frames": 21, "tq": 710755.496532814, "t1": 710765.663323004, "ta": 710765.663323004, "te": 710765.882755424, "first_response_s": 10.166790190036409, "answer_total_s": 10.386222610017285, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 140, "content_group": "54e59dbfaf3b76511d1c70e7af3b3c810351c2f36a3c0e57f107cc16b31058ba", "question": {"question_id": "sample_140_a423_q1", "video_id": 140, "video_path": "./videos/sample_140_real.mp4", "annotation_index": 423, "question_index": 1, "question": "Which of the following best summarizes the painting process just shown in the video?", "options": ["A. The person paints a gradient from pink to white with smooth horizontal strokes.", "B. The canvas is covered with random colors and patterns.", "C. The palette is used to mix blue and green colors for a landscape.", "D. The person uses a sponge to create a textured effect."], "answer": "A", "time_stamp_s": 20, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_140_a423_q1", "video_id": 140, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "475cf1f192e99230a77148c74205964ac4a801955caa008026b3196149fe67fc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "dd22416d32ce6209f0b495a564d9136fb570f202fe2312c8bcc7e404f32bb3c1", "num_recent_frames": 21, "tq": 715261.1417654, "t1": 715268.117564094, "ta": 715268.117564094, "te": 715268.159261048, "first_response_s": 6.975798694067635, "answer_total_s": 7.017495648004115, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_140_a423_q1", "video_id": 140, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "267b778157c7b334eabceca8adfa2eacc443363b1d1ab04c85a5ce2b42f77139", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "dd22416d32ce6209f0b495a564d9136fb570f202fe2312c8bcc7e404f32bb3c1", "num_recent_frames": 21, "tq": 710765.906780643, "t1": 710771.99833694, "ta": 710771.99833694, "te": 710772.151800993, "first_response_s": 6.0915562969166785, "answer_total_s": 6.245020349975675, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 140, "content_group": "54e59dbfaf3b76511d1c70e7af3b3c810351c2f36a3c0e57f107cc16b31058ba", "question": {"question_id": "sample_140_a424_q0", "video_id": 140, "video_path": "./videos/sample_140_real.mp4", "annotation_index": 424, "question_index": 0, "question": "What action is the artist performing right now?", "options": ["A. Mixing colors on the palette.", "B. Framing the finished painting.", "C. Applying fine details to the grass lawn.", "D. Cleaning the brush with water."], "answer": "C", "time_stamp_s": 139, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_140_a424_q0", "video_id": 140, "time_stamp_s": 139, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b0cb0e24225e9318096afc852198f99384877a337444f9e5319cefe55af68332", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0], "recent_frames_sha256": "f17abf67ad73cdd7b20057c391b19b4a056dfa72e79056377845e1f2e4b9001f", "num_recent_frames": 30, "tq": 715268.175698402, "t1": 715280.812721673, "ta": 715280.812721673, "te": 715280.976882349, "first_response_s": 12.63702327106148, "answer_total_s": 12.80118394701276, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_140_a424_q0", "video_id": 140, "time_stamp_s": 139, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b811cebb42efb6574661a98a101af86e541e730ba0e2500189c4edd8a1983dae", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand applies yellow-pink paint to the top of a canvas, then blends it with white to create a gradient.  \n- Lemon yellow and white are mixed and applied below the pink layer, followed by phthalo blue and black mixed with white for a darker gradient.  \n- Paintbrushes and palette with mixed colors are visible beside the canvas, indicating ongoing painting process.\n[30-60s] - Hand uses brush to apply gray paint, forming a mountain silhouette against a gradient sky.  \n- Paint palette with mixed colors (yellow ochre, lemon yellow, medium green) is visible to the right.  \n- Canvas shows a textured surface with distinct horizontal bands of color.\n[60-90s] - A hand applies medium green paint to the bottom edge of the canvas, creating a horizontal band.  \n- The hand then switches to a different brush and applies yellow ochre to the same area, blending it with the green.  \n- The paint palette to the right shows remaining green and yellow ochre, with a small amount of white paint also visible.\n[90-120s] - Hand uses brush to apply green paint across canvas, blending with existing landscape.\n- Palette with green, yellow, and pink paint visible to the right of the canvas.\n- Text overlay identifies paint colors as \"Sap green,\" \"Yellow ochre,\" and \"Lemon yellow.\"", "history_tokens": 294, "history_utf8_bytes": 1278, "recent_frame_times_s": [110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0], "recent_frames_sha256": "f17abf67ad73cdd7b20057c391b19b4a056dfa72e79056377845e1f2e4b9001f", "num_recent_frames": 30, "tq": 715187.121130624, "t1": 715189.047552545, "ta": 715189.047552545, "te": 715189.091303915, "first_response_s": 1.9264219210017473, "answer_total_s": 1.9701732910471037, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 140, "content_group": "54e59dbfaf3b76511d1c70e7af3b3c810351c2f36a3c0e57f107cc16b31058ba", "question": {"question_id": "sample_140_a425_q0", "video_id": 140, "video_path": "./videos/sample_140_real.mp4", "annotation_index": 425, "question_index": 0, "question": "Which of the following best summarizes the painting just shown in the video?", "options": ["A. A landscape painting with a path leading to a small white house with a red roof.", "B. A portrait of an elderly man being painted with fine details.", "C. A close-up of a flower being painted with vibrant colors.", "D. An abstract painting with various geometric shapes."], "answer": "A", "time_stamp_s": 260, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_140_a425_q0", "video_id": 140, "time_stamp_s": 260, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "888c7674dbd7ddf7f62001eec25620f7fc2d8c2b580c528ee62905108ee32390", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0], "recent_frames_sha256": "2d91af033c7fb42f112c44e8ee7a00bf740d8e3407955d70b13889590d15b93e", "num_recent_frames": 30, "tq": 715280.995376731, "t1": 715288.58785044, "ta": 715288.58785044, "te": 715288.829652904, "first_response_s": 7.592473708908074, "answer_total_s": 7.834276172914542, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_140_a425_q0", "video_id": 140, "time_stamp_s": 260, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4ccaaf9030423f5cb39280e1de355d0df368d745bd86a79b44b5a583ab744919", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand applies yellow-pink paint to the top of a canvas, then blends it with white to create a gradient.  \n- Lemon yellow and white are mixed and applied below the pink layer, followed by phthalo blue and black mixed with white for a darker gradient.  \n- Paintbrushes and palette with mixed colors are visible beside the canvas, indicating ongoing painting process.\n[30-60s] - Hand uses brush to apply gray paint, forming a mountain silhouette against a gradient sky.  \n- Paint palette with mixed colors (yellow ochre, lemon yellow, medium green) is visible to the right.  \n- Canvas shows a textured surface with distinct horizontal bands of color.\n[60-90s] - A hand applies medium green paint to the bottom edge of the canvas, creating a horizontal band.  \n- The hand then switches to a different brush and applies yellow ochre to the same area, blending it with the green.  \n- The paint palette to the right shows remaining green and yellow ochre, with a small amount of white paint also visible.\n[90-120s] - Hand uses brush to apply green paint across canvas, blending with existing landscape.\n- Palette with green, yellow, and pink paint visible to the right of the canvas.\n- Text overlay identifies paint colors as \"Sap green,\" \"Yellow ochre,\" and \"Lemon yellow.\"\n[120-150s] - Hand holds a fine brush, applying green paint to the lower right of the canvas.  \n- Paint palette with green and yellow hues visible to the right of the canvas.  \n- Canvas depicts a landscape with a pink sky, light blue mountain, and green rolling hills.\n[150-180s] - Hand uses brush to apply green paint to canvas, blending into existing landscape.  \n- Paint palette shows mixed greens and pink hues beside the canvas.  \n- Canvas depicts a mountain under a pink sky with green rolling hills.\n[180-210s] - A hand applies burnt umber paint to a canvas, creating a winding path through green grass.  \n- The paint palette beside the canvas contains various colors, including sap green and white.  \n- The canvas depicts a mountain range under a pink and orange sky, with the path leading toward the mountains.\n[210-240s] - Hand applies sap green to grassy area near path using brush.\n- Palette shows sap green, lemon yellow, and white paint.\n- Path and distant mountain remain partially painted as work progresses.", "history_tokens": 534, "history_utf8_bytes": 2302, "recent_frame_times_s": [231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0], "recent_frames_sha256": "2d91af033c7fb42f112c44e8ee7a00bf740d8e3407955d70b13889590d15b93e", "num_recent_frames": 30, "tq": 715222.253453119, "t1": 715223.732193409, "ta": 715223.732193409, "te": 715223.884785692, "first_response_s": 1.4787402900401503, "answer_total_s": 1.6313325730152428, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 140, "content_group": "54e59dbfaf3b76511d1c70e7af3b3c810351c2f36a3c0e57f107cc16b31058ba", "question": {"question_id": "sample_140_a426_q0", "video_id": 140, "video_path": "./videos/sample_140_real.mp4", "annotation_index": 426, "question_index": 0, "question": "What is located below the large dark brown tree in the painting?", "options": ["A. A lake with a boat.", "B. A group of animals.", "C. A river with a bridge.", "D. A grass lawn."], "answer": "D", "time_stamp_s": 380, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_140_a426_q0", "video_id": 140, "time_stamp_s": 380, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ed89e278ca35e8b77b92fdeaa20b0d358375e0c2307246ca49d4549096396d08", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0], "recent_frames_sha256": "830cc26e03f88f5ad0c31263f23f1ece8d99c6fa09f2b38fc18a8fe4e97417ca", "num_recent_frames": 30, "tq": 715288.854096278, "t1": 715296.575352987, "ta": 715296.575352987, "te": 715296.618730826, "first_response_s": 7.721256709075533, "answer_total_s": 7.764634547987953, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_140_a426_q0", "video_id": 140, "time_stamp_s": 380, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0c05fb1695d7abc8233a36a7e07a8a3215570681e504087db7330f53ed0dadb1", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand applies yellow-pink paint to the top of a canvas, then blends it with white to create a gradient.  \n- Lemon yellow and white are mixed and applied below the pink layer, followed by phthalo blue and black mixed with white for a darker gradient.  \n- Paintbrushes and palette with mixed colors are visible beside the canvas, indicating ongoing painting process.\n[30-60s] - Hand uses brush to apply gray paint, forming a mountain silhouette against a gradient sky.  \n- Paint palette with mixed colors (yellow ochre, lemon yellow, medium green) is visible to the right.  \n- Canvas shows a textured surface with distinct horizontal bands of color.\n[60-90s] - A hand applies medium green paint to the bottom edge of the canvas, creating a horizontal band.  \n- The hand then switches to a different brush and applies yellow ochre to the same area, blending it with the green.  \n- The paint palette to the right shows remaining green and yellow ochre, with a small amount of white paint also visible.\n[90-120s] - Hand uses brush to apply green paint across canvas, blending with existing landscape.\n- Palette with green, yellow, and pink paint visible to the right of the canvas.\n- Text overlay identifies paint colors as \"Sap green,\" \"Yellow ochre,\" and \"Lemon yellow.\"\n[120-150s] - Hand holds a fine brush, applying green paint to the lower right of the canvas.  \n- Paint palette with green and yellow hues visible to the right of the canvas.  \n- Canvas depicts a landscape with a pink sky, light blue mountain, and green rolling hills.\n[150-180s] - Hand uses brush to apply green paint to canvas, blending into existing landscape.  \n- Paint palette shows mixed greens and pink hues beside the canvas.  \n- Canvas depicts a mountain under a pink sky with green rolling hills.\n[180-210s] - A hand applies burnt umber paint to a canvas, creating a winding path through green grass.  \n- The paint palette beside the canvas contains various colors, including sap green and white.  \n- The canvas depicts a mountain range under a pink and orange sky, with the path leading toward the mountains.\n[210-240s] - Hand applies sap green to grassy area near path using brush.\n- Palette shows sap green, lemon yellow, and white paint.\n- Path and distant mountain remain partially painted as work progresses.\n[240-270s] - Artist's hand uses a fine brush to add dark lines along the path's edge on the canvas.  \n- A palette with mixed paints (yellow, brown, blue) is visible to the right of the canvas.  \n- Text overlay labels \"Burnt umber White\" and \"Black\" appear as the artist switches paint colors.\n[270-300s] - Hand holds a purple brush, applying burnt umber to the dirt path on the canvas.  \n- Palette with mixed colors (yellow, brown, blue) is visible to the right of the canvas.  \n- The painting depicts a rural scene with a red-roofed house, green fields, and a mountain under a pink-orange sky.\n[300-330s] - Hand holds a brush, applying sap green to the canvas's grassy area near a dirt path.  \n- A small wooden house with a red roof is visible in the midground, partially obscured by greenery.  \n- The artist’s palette, containing various paint colors, is positioned to the right of the canvas.\n[330-360s] - Hand holds a lavender paintbrush, applying dark brown strokes to the tree's branches on a canvas.  \n- The canvas depicts a landscape with green grass, distant mountains, and a pinkish sky.  \n- A paint palette with various colors (blue, green, brown) is visible to the right of the canvas.", "history_tokens": 841, "history_utf8_bytes": 3502, "recent_frame_times_s": [351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0], "recent_frames_sha256": "830cc26e03f88f5ad0c31263f23f1ece8d99c6fa09f2b38fc18a8fe4e97417ca", "num_recent_frames": 30, "tq": 715253.719934734, "t1": 715254.697777583, "ta": 715254.697777583, "te": 715254.73651585, "first_response_s": 0.9778428489807993, "answer_total_s": 1.016581115894951, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 141, "content_group": "1f6ee3cdfdcaa35ddd3fec0a11e8809cb8cc3839e84300d0d7bfaecf2172f0a0", "question": {"question_id": "sample_141_a1547_q0", "video_id": 141, "video_path": "./videos/sample_141_real.mp4", "annotation_index": 1547, "question_index": 0, "question": "What is the arrangement of the items on the wooden surface now?", "options": ["A. The watercolor palette is on the left, and the white canvas is on the right.", "B. The watercolor palette is on the right, and the glass dish is on the left.", "C. The watercolor palette is in the center, and the paper is on the right.", "D. The glass dish is in the center, and the paper is on the left."], "answer": "A", "time_stamp_s": 8, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_141_a1547_q0", "video_id": 141, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d1729171ad34658efce52a110d9cdab7f83e0dbf22872ac225935cd1f3c156a8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0], "recent_frames_sha256": "6aaec1eefdbd099e7ee584b0bc238447c793b199f106796fcaeba27cc77391f5", "num_recent_frames": 9, "tq": 710207.53103751, "t1": 710212.568594372, "ta": 710212.568594372, "te": 710212.606082771, "first_response_s": 5.037556861992925, "answer_total_s": 5.075045260949992, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_141_a1547_q0", "video_id": 141, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7ec172c6ae6a12a28951432e7a83359497b4951e88a3814d808175578f8d5988", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0], "recent_frames_sha256": "6aaec1eefdbd099e7ee584b0bc238447c793b199f106796fcaeba27cc77391f5", "num_recent_frames": 9, "tq": 710235.246717722, "t1": 710247.176044779, "ta": 710247.176044779, "te": 710247.213026467, "first_response_s": 11.929327056976035, "answer_total_s": 11.966308744973503, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 141, "content_group": "1f6ee3cdfdcaa35ddd3fec0a11e8809cb8cc3839e84300d0d7bfaecf2172f0a0", "question": {"question_id": "sample_141_a1548_q0", "video_id": 141, "video_path": "./videos/sample_141_real.mp4", "annotation_index": 1548, "question_index": 0, "question": "Which of the following best summarizes the painting activity just shown in the video?", "options": ["A. The hand is painting a deep green and light green abstract form on paper.", "B. The hand is drawing a detailed landscape.", "C. The hand is sketching with a pencil before painting.", "D. The hand is creating a watercolor portrait."], "answer": "A", "time_stamp_s": 180, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_141_a1548_q0", "video_id": 141, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6880f88457699db317559f6bb8905673381afcefe6d79dac5dcbdfbd87f400c8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "2a8738e15f77b705a53ebacc62d1175ae82c0f61984c6c72d879743729f9f026", "num_recent_frames": 30, "tq": 710212.651790694, "t1": 710220.021302199, "ta": 710220.021302199, "te": 710220.058793669, "first_response_s": 7.3695115050068125, "answer_total_s": 7.4070029750000685, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_141_a1548_q0", "video_id": 141, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5e02a2b0deaa9c85e3e8b4c5e0a3ad8d1bd2d126aae6f4fb0787d53767dd56d9", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hand uses brush to mix dark blue pigment with water in a transparent palette.  \n- Brush repeatedly dips into and scrapes the pigment, creating a textured, uneven mixture.  \n- White paper lies to the right of the palette, untouched and ready for application.\n[30-60s] - Hand dips brush into watercolor palette, mixing blue and brown hues.  \n- Brush strokes across blank paper, creating a horizontal brown line.  \n- Palette shows smeared paint, indicating active mixing and use.\n[60-90s] - A hand holds a brush, applying dark brown watercolor to a white paper surface, extending a horizontal line.\n- The watercolor palette, with multiple colors, is positioned to the left of the paper, showing used and mixed pigments.\n- The brush strokes vary in intensity, creating a textured, uneven line across the paper.\n[90-120s] - Hand uses brush to add dark strokes along a branch’s length, enhancing its texture.  \n- Watercolor palette shows mixed pigments, with blue and brown tones prominent.  \n- Brush strokes vary in direction and intensity, suggesting dynamic application.\n[120-150s] - Hand applies yellowish-brown paint to the left side of the paper, blending it into a horizontal band.\n- Brush strokes vary in width and pressure, creating texture and depth on the painted area.\n- Paint palette shows mixed colors, with yellow and brown hues prominently used for the current stroke.\n[150-180s] - Hand applies dark brown paint to a dry branch on paper, enhancing its texture.  \n- Watercolor palette shows mixed colors, including green and brown, with some dried paint streaks.  \n- Brush strokes vary in pressure, creating depth on the branch’s surface.", "history_tokens": 378, "history_utf8_bytes": 1661, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "2a8738e15f77b705a53ebacc62d1175ae82c0f61984c6c72d879743729f9f026", "num_recent_frames": 30, "tq": 710296.833273279, "t1": 710298.094722147, "ta": 710298.094722147, "te": 710298.131793145, "first_response_s": 1.2614488679682836, "answer_total_s": 1.2985198659589514, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 141, "content_group": "1f6ee3cdfdcaa35ddd3fec0a11e8809cb8cc3839e84300d0d7bfaecf2172f0a0", "question": {"question_id": "sample_141_a1549_q0", "video_id": 141, "video_path": "./videos/sample_141_real.mp4", "annotation_index": 1549, "question_index": 0, "question": "What is the artist likely to do next?", "options": ["A. Sign the painting.", "B. Add more details to the painting.", "C. Clean up the workspace.", "D. Start a new painting."], "answer": "B", "time_stamp_s": 334, "task_type": "Prospective Reasoning", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_141_a1549_q0", "video_id": 141, "time_stamp_s": 334, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "03c784efbcdfc2836d07b5305cfe7a788171c1aac6a0f0a359bbb0214e06fc35", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0], "recent_frames_sha256": "acf6d20cf976e6722b104eda7f3326873c678650ad0da7aafae97ed24ff29079", "num_recent_frames": 30, "tq": 710220.081181767, "t1": 710221.362050748, "ta": 710221.362050748, "te": 710221.402792724, "first_response_s": 1.2808689809171483, "answer_total_s": 1.3216109569184482, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_141_a1549_q0", "video_id": 141, "time_stamp_s": 334, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c7b5e5bfc218b274a7531bb91399c7f0d5084922d5f8667447a1eebd4a87cc2b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hand uses brush to mix dark blue pigment with water in a transparent palette.  \n- Brush repeatedly dips into and scrapes the pigment, creating a textured, uneven mixture.  \n- White paper lies to the right of the palette, untouched and ready for application.\n[30-60s] - Hand dips brush into watercolor palette, mixing blue and brown hues.  \n- Brush strokes across blank paper, creating a horizontal brown line.  \n- Palette shows smeared paint, indicating active mixing and use.\n[60-90s] - A hand holds a brush, applying dark brown watercolor to a white paper surface, extending a horizontal line.\n- The watercolor palette, with multiple colors, is positioned to the left of the paper, showing used and mixed pigments.\n- The brush strokes vary in intensity, creating a textured, uneven line across the paper.\n[90-120s] - Hand uses brush to add dark strokes along a branch’s length, enhancing its texture.  \n- Watercolor palette shows mixed pigments, with blue and brown tones prominent.  \n- Brush strokes vary in direction and intensity, suggesting dynamic application.\n[120-150s] - Hand applies yellowish-brown paint to the left side of the paper, blending it into a horizontal band.\n- Brush strokes vary in width and pressure, creating texture and depth on the painted area.\n- Paint palette shows mixed colors, with yellow and brown hues prominently used for the current stroke.\n[150-180s] - Hand applies dark brown paint to a dry branch on paper, enhancing its texture.  \n- Watercolor palette shows mixed colors, including green and brown, with some dried paint streaks.  \n- Brush strokes vary in pressure, creating depth on the branch’s surface.\n[180-210s] - Hand applies yellow-green paint to a paper branch using a brush, blending it with existing green and brown tones.\n- Paint palette shows mixed colors, including yellow, green, and blue, with visible brush marks and dried paint.\n- Brush strokes vary in direction and intensity, adding texture and depth to the branch’s foliage area.\n[210-240s] - Hand uses brush to apply green watercolor over yellow-green strokes on paper.  \n- Palette shows mixed colors, including dark blue and green, with some dried paint.  \n- Brush moves horizontally across the paper, blending and adding texture to the painted branch.\n[240-270s] - Hand applies dark brown paint to a paper sketch, blending it with existing green and yellow strokes.  \n- Watercolor palette to the left shows mixed colors, including teal and black, with a brush dipped in water.  \n- Brush strokes vary in direction, adding texture to the central branch-like structure on the paper.\n[270-300s] - Hand applies dark green watercolor to the lower portion of the paper, blending with existing yellow-green washes.  \n- Watercolor palette shows mixed blue and green pigments, with a brush dipped in dark blue pigment.  \n- A dry, dark brown branch is positioned horizontally across the paper, with spiky lines extending from it.\n[300-330s] - Hand holds brush, applying green paint to canvas in broad strokes over existing yellow and brown areas.  \n- Watercolor palette to left shows mixed colors, with blue and green hues prominent.  \n- Canvas features a central dark branch, with green and yellow washes below and brown patches above.", "history_tokens": 738, "history_utf8_bytes": 3256, "recent_frame_times_s": [305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0], "recent_frames_sha256": "acf6d20cf976e6722b104eda7f3326873c678650ad0da7aafae97ed24ff29079", "num_recent_frames": 30, "tq": 710340.588435599, "t1": 710342.448997139, "ta": 710342.448997139, "te": 710342.852057736, "first_response_s": 1.860561540001072, "answer_total_s": 2.2636221370194107, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 141, "content_group": "1f6ee3cdfdcaa35ddd3fec0a11e8809cb8cc3839e84300d0d7bfaecf2172f0a0", "question": {"question_id": "sample_141_a1550_q0", "video_id": 141, "video_path": "./videos/sample_141_real.mp4", "annotation_index": 1550, "question_index": 0, "question": "Where is the paint palette positioned relative to the artist's hand?", "options": ["A. To the left of the hand.", "B. To the right of the hand.", "C. Directly below the hand.", "D. Above the hand."], "answer": "A", "time_stamp_s": 499, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_141_a1550_q0", "video_id": 141, "time_stamp_s": 499, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "71cb9b273dce396403823a0c03bcf0e1101a85a40adfb6562b91cb631b7f05f1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0], "recent_frames_sha256": "5b7949da60cfa545ec8dd5ac5fe02cb87c11db7350ec25a6bdce164fc2328adc", "num_recent_frames": 30, "tq": 710221.446602118, "t1": 710229.033619576, "ta": 710229.033619576, "te": 710229.073084919, "first_response_s": 7.587017458048649, "answer_total_s": 7.6264828010462224, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_141_a1550_q0", "video_id": 141, "time_stamp_s": 499, "ground_truth": "A", "raw_output": "A. To the left of the hand.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "49870a772d30164aaee52e3105ee3bb9cbe33679487c8f833c54357d0213d035", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Hand dips brush into watercolor palette, mixing blue and brown hues.  \n- Brush strokes across blank paper, creating a horizontal brown line.  \n- Palette shows smeared paint, indicating active mixing and use.\n[60-90s] - A hand holds a brush, applying dark brown watercolor to a white paper surface, extending a horizontal line.\n- The watercolor palette, with multiple colors, is positioned to the left of the paper, showing used and mixed pigments.\n- The brush strokes vary in intensity, creating a textured, uneven line across the paper.\n[90-120s] - Hand uses brush to add dark strokes along a branch’s length, enhancing its texture.  \n- Watercolor palette shows mixed pigments, with blue and brown tones prominent.  \n- Brush strokes vary in direction and intensity, suggesting dynamic application.\n[120-150s] - Hand applies yellowish-brown paint to the left side of the paper, blending it into a horizontal band.\n- Brush strokes vary in width and pressure, creating texture and depth on the painted area.\n- Paint palette shows mixed colors, with yellow and brown hues prominently used for the current stroke.\n[150-180s] - Hand applies dark brown paint to a dry branch on paper, enhancing its texture.  \n- Watercolor palette shows mixed colors, including green and brown, with some dried paint streaks.  \n- Brush strokes vary in pressure, creating depth on the branch’s surface.\n[180-210s] - Hand applies yellow-green paint to a paper branch using a brush, blending it with existing green and brown tones.\n- Paint palette shows mixed colors, including yellow, green, and blue, with visible brush marks and dried paint.\n- Brush strokes vary in direction and intensity, adding texture and depth to the branch’s foliage area.\n[210-240s] - Hand uses brush to apply green watercolor over yellow-green strokes on paper.  \n- Palette shows mixed colors, including dark blue and green, with some dried paint.  \n- Brush moves horizontally across the paper, blending and adding texture to the painted branch.\n[240-270s] - Hand applies dark brown paint to a paper sketch, blending it with existing green and yellow strokes.  \n- Watercolor palette to the left shows mixed colors, including teal and black, with a brush dipped in water.  \n- Brush strokes vary in direction, adding texture to the central branch-like structure on the paper.\n[270-300s] - Hand applies dark green watercolor to the lower portion of the paper, blending with existing yellow-green washes.  \n- Watercolor palette shows mixed blue and green pigments, with a brush dipped in dark blue pigment.  \n- A dry, dark brown branch is positioned horizontally across the paper, with spiky lines extending from it.\n[300-330s] - Hand holds brush, applying green paint to canvas in broad strokes over existing yellow and brown areas.  \n- Watercolor palette to left shows mixed colors, with blue and green hues prominent.  \n- Canvas features a central dark branch, with green and yellow washes below and brown patches above.\n[330-360s] - Hand uses brush to apply dark green paint over yellow-green area on paper.  \n- Watercolor palette shows mixed colors, including blue and yellow, with some dried paint streaks.  \n- Painting depicts a tree branch across a landscape with blended earthy tones.\n[360-390s] - Hand holds brush, applying dark green paint to lower left area of paper.  \n- Paint palette shows mixed colors, including yellow, red, and blue, with some dried paint streaks.  \n- Brush strokes vary in direction, adding texture to the green region beneath a brown branch.\n[390-420s] - Hand holds brush, applying dark pigment to a painted landscape's foreground area.  \n- Palette with mixed colors (yellow, red, blue, green) visible to the left, showing wet paint streaks.  \n- Brush strokes vary in direction, adding texture to the green and yellow ground areas.\n[420-450s] - Hand holds brush, applying dark pigment to a painted landscape's foreground area.  \n- Palette with mixed colors (yellow, red, blue, purple) visible to the left of the canvas.  \n- Brush strokes vary in direction and pressure, blending into the existing green and yellow hues.\n[450-480s] - Hand holds brush, applying dark blue pigment to paper's left side near a painted tree trunk.\n- Brush strokes are deliberate, blending colors to deepen the foliage area.\n- Paint palette shows mixed pigments, with blue and green hues prominent.", "history_tokens": 1006, "history_utf8_bytes": 4376, "recent_frame_times_s": [470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0], "recent_frames_sha256": "5b7949da60cfa545ec8dd5ac5fe02cb87c11db7350ec25a6bdce164fc2328adc", "num_recent_frames": 30, "tq": 710383.264378563, "t1": 710384.968350946, "ta": 710384.968350946, "te": 710385.330086008, "first_response_s": 1.7039723829366267, "answer_total_s": 2.0657074449118227, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 141, "content_group": "1f6ee3cdfdcaa35ddd3fec0a11e8809cb8cc3839e84300d0d7bfaecf2172f0a0", "question": {"question_id": "sample_141_a1550_q1", "video_id": 141, "video_path": "./videos/sample_141_real.mp4", "annotation_index": 1550, "question_index": 1, "question": "What is the artist creating in the video?", "options": ["A. A portrait of a person.", "B. A watercolor landscape.", "C. An abstract painting.", "D. A charcoal sketch."], "answer": "B", "time_stamp_s": 499, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_141_a1550_q1", "video_id": 141, "time_stamp_s": 499, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0c4517507edc5af2635d124b9d420a9d1891bde4c2e056254314206796d6cbbc", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0], "recent_frames_sha256": "5b7949da60cfa545ec8dd5ac5fe02cb87c11db7350ec25a6bdce164fc2328adc", "num_recent_frames": 30, "tq": 710229.088618866, "t1": 710235.191555613, "ta": 710235.191555613, "te": 710235.23045464, "first_response_s": 6.1029367469018325, "answer_total_s": 6.141835773945786, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_141_a1550_q1", "video_id": 141, "time_stamp_s": 499, "ground_truth": "B", "raw_output": "B. A watercolor landscape.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "3ed4b5f8b4f8da26d811e91f3d84384e69504fbfeba5a9ea759994c97b5f5c7e", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Hand dips brush into watercolor palette, mixing blue and brown hues.  \n- Brush strokes across blank paper, creating a horizontal brown line.  \n- Palette shows smeared paint, indicating active mixing and use.\n[60-90s] - A hand holds a brush, applying dark brown watercolor to a white paper surface, extending a horizontal line.\n- The watercolor palette, with multiple colors, is positioned to the left of the paper, showing used and mixed pigments.\n- The brush strokes vary in intensity, creating a textured, uneven line across the paper.\n[90-120s] - Hand uses brush to add dark strokes along a branch’s length, enhancing its texture.  \n- Watercolor palette shows mixed pigments, with blue and brown tones prominent.  \n- Brush strokes vary in direction and intensity, suggesting dynamic application.\n[120-150s] - Hand applies yellowish-brown paint to the left side of the paper, blending it into a horizontal band.\n- Brush strokes vary in width and pressure, creating texture and depth on the painted area.\n- Paint palette shows mixed colors, with yellow and brown hues prominently used for the current stroke.\n[150-180s] - Hand applies dark brown paint to a dry branch on paper, enhancing its texture.  \n- Watercolor palette shows mixed colors, including green and brown, with some dried paint streaks.  \n- Brush strokes vary in pressure, creating depth on the branch’s surface.\n[180-210s] - Hand applies yellow-green paint to a paper branch using a brush, blending it with existing green and brown tones.\n- Paint palette shows mixed colors, including yellow, green, and blue, with visible brush marks and dried paint.\n- Brush strokes vary in direction and intensity, adding texture and depth to the branch’s foliage area.\n[210-240s] - Hand uses brush to apply green watercolor over yellow-green strokes on paper.  \n- Palette shows mixed colors, including dark blue and green, with some dried paint.  \n- Brush moves horizontally across the paper, blending and adding texture to the painted branch.\n[240-270s] - Hand applies dark brown paint to a paper sketch, blending it with existing green and yellow strokes.  \n- Watercolor palette to the left shows mixed colors, including teal and black, with a brush dipped in water.  \n- Brush strokes vary in direction, adding texture to the central branch-like structure on the paper.\n[270-300s] - Hand applies dark green watercolor to the lower portion of the paper, blending with existing yellow-green washes.  \n- Watercolor palette shows mixed blue and green pigments, with a brush dipped in dark blue pigment.  \n- A dry, dark brown branch is positioned horizontally across the paper, with spiky lines extending from it.\n[300-330s] - Hand holds brush, applying green paint to canvas in broad strokes over existing yellow and brown areas.  \n- Watercolor palette to left shows mixed colors, with blue and green hues prominent.  \n- Canvas features a central dark branch, with green and yellow washes below and brown patches above.\n[330-360s] - Hand uses brush to apply dark green paint over yellow-green area on paper.  \n- Watercolor palette shows mixed colors, including blue and yellow, with some dried paint streaks.  \n- Painting depicts a tree branch across a landscape with blended earthy tones.\n[360-390s] - Hand holds brush, applying dark green paint to lower left area of paper.  \n- Paint palette shows mixed colors, including yellow, red, and blue, with some dried paint streaks.  \n- Brush strokes vary in direction, adding texture to the green region beneath a brown branch.\n[390-420s] - Hand holds brush, applying dark pigment to a painted landscape's foreground area.  \n- Palette with mixed colors (yellow, red, blue, green) visible to the left, showing wet paint streaks.  \n- Brush strokes vary in direction, adding texture to the green and yellow ground areas.\n[420-450s] - Hand holds brush, applying dark pigment to a painted landscape's foreground area.  \n- Palette with mixed colors (yellow, red, blue, purple) visible to the left of the canvas.  \n- Brush strokes vary in direction and pressure, blending into the existing green and yellow hues.\n[450-480s] - Hand holds brush, applying dark blue pigment to paper's left side near a painted tree trunk.\n- Brush strokes are deliberate, blending colors to deepen the foliage area.\n- Paint palette shows mixed pigments, with blue and green hues prominent.", "history_tokens": 1006, "history_utf8_bytes": 4376, "recent_frame_times_s": [470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0], "recent_frames_sha256": "5b7949da60cfa545ec8dd5ac5fe02cb87c11db7350ec25a6bdce164fc2328adc", "num_recent_frames": 30, "tq": 710385.378860339, "t1": 710397.758740816, "ta": 710397.758740816, "te": 710398.021240747, "first_response_s": 12.379880476975814, "answer_total_s": 12.642380407894962, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 142, "content_group": "be6c97b80479d3db8f9be6e22bb27c034bd62073b4d09d48b59b51523ad0d4cb", "question": {"question_id": "sample_142_a253_q0", "video_id": 142, "video_path": "./videos/sample_142_real.mp4", "annotation_index": 253, "question_index": 0, "question": "Where is the paint palette located relative to the canvas?", "options": ["A. To the left of the canvas.", "B. To the right of the canvas.", "C. Below the canvas.", "D. Above the canvas."], "answer": "B", "time_stamp_s": 1, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_142_a253_q0", "video_id": 142, "time_stamp_s": 1, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5f4a1fb0640a19892bdd69b4042b37a0d23bfca4d3284565abfc1c4ad7613b71", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0], "recent_frames_sha256": "ebf1fa81c8916d79cbf026e81f7477d979521368ea49f704c2d4b170d8d11095", "num_recent_frames": 2, "tq": 715738.284027412, "t1": 715745.29033752, "ta": 715745.29033752, "te": 715745.437517745, "first_response_s": 7.006310108001344, "answer_total_s": 7.153490333002992, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_142_a253_q0", "video_id": 142, "time_stamp_s": 1, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "59c32355a0c69a8d5a25702fd7e48e36362c8298053d3263ebe7e94463a9aae3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0], "recent_frames_sha256": "ebf1fa81c8916d79cbf026e81f7477d979521368ea49f704c2d4b170d8d11095", "num_recent_frames": 2, "tq": 715786.804588341, "t1": 715792.08974052, "ta": 715792.08974052, "te": 715792.237834963, "first_response_s": 5.285152178956196, "answer_total_s": 5.433246621978469, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 142, "content_group": "be6c97b80479d3db8f9be6e22bb27c034bd62073b4d09d48b59b51523ad0d4cb", "question": {"question_id": "sample_142_a254_q0", "video_id": 142, "video_path": "./videos/sample_142_real.mp4", "annotation_index": 254, "question_index": 0, "question": "What is the hand doing in the video?", "options": ["A. Applying white paint to a curved surface.", "B. Drawing a straight line with a pencil.", "C. Cleaning the paintbrush.", "D. Mixing colors on a palette."], "answer": "A", "time_stamp_s": 139, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_142_a254_q0", "video_id": 142, "time_stamp_s": 139, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d234a0ee723a7eea6966e976f15daaedb5479e859cdabbde568eefa72271f5df", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0], "recent_frames_sha256": "1135006d2a2388a2692414f66b7263e307b70c10277fbdf8b54415981ecdf83e", "num_recent_frames": 30, "tq": 715745.462578628, "t1": 715753.04296662, "ta": 715753.04296662, "te": 715753.080506796, "first_response_s": 7.580387991969474, "answer_total_s": 7.617928168037906, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_142_a254_q0", "video_id": 142, "time_stamp_s": 139, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5da696dbb616a50c95269c331a9a95f20abad40f6904077f819353a3665a133d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hand applies black paint to canvas using a 25mm flat brush, starting from the top left corner.  \n- Palette shows black, white, and cerulean blue paint being mixed into a dark blue shade.  \n- Canvas is positioned on a wooden surface with text indicating its dimensions: 28cm * 23cm (11inch * 9inch).\n[30-60s] - Hand uses a brush to apply dark gray paint along the top edge of a canvas, creating a gradient effect.  \n- A palette with black, blue, and white paint is visible to the right, with a brush dipped in blue paint.  \n- The artist switches to a pencil to sketch a curved line along the edge of the painted area.\n[60-90s] - Hand applies light blue paint in sweeping strokes across the canvas, blending into a darker blue gradient.  \n- Paintbrush moves from top to bottom, creating a smooth transition between white and dark blue areas.  \n- Palette with mixed blue and black paint is visible to the right, indicating ongoing color adjustments.\n[90-120s] - Hand uses a 5mm brush to apply white paint in sweeping motions across a dark gray canvas.  \n- Palette with mixed blue and gray paint is visible to the right of the canvas.  \n- Canvas shows a curved, planet-like shape with gradient shading from dark to light gray.", "history_tokens": 299, "history_utf8_bytes": 1232, "recent_frame_times_s": [110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0], "recent_frames_sha256": "1135006d2a2388a2692414f66b7263e307b70c10277fbdf8b54415981ecdf83e", "num_recent_frames": 30, "tq": 715828.478920815, "t1": 715830.668152942, "ta": 715830.668152942, "te": 715831.233189022, "first_response_s": 2.189232126926072, "answer_total_s": 2.754268207005225, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 142, "content_group": "be6c97b80479d3db8f9be6e22bb27c034bd62073b4d09d48b59b51523ad0d4cb", "question": {"question_id": "sample_142_a255_q0", "video_id": 142, "video_path": "./videos/sample_142_real.mp4", "annotation_index": 255, "question_index": 0, "question": "What is the artist doing right now", "options": ["A. Mixing colors on the palette.", "B. Applying paint to the moon's surface.", "C. Cleaning the paintbrush.", "D. Adjusting the canvas."], "answer": "B", "time_stamp_s": 251, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_142_a255_q0", "video_id": 142, "time_stamp_s": 251, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7243d5920185a52071795375582c6caaef936996a6e4fef93e037066b7e40e8e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0], "recent_frames_sha256": "3cb40e2f24bbfb348b6b91605c9c17fd155ea4463f142addc18238222937b48f", "num_recent_frames": 30, "tq": 715753.094487987, "t1": 715766.972670728, "ta": 715766.972670728, "te": 715767.010104876, "first_response_s": 13.878182740998454, "answer_total_s": 13.915616889018565, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_142_a255_q0", "video_id": 142, "time_stamp_s": 251, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "73c1453a84ef9f3821dc65452b2ffd6be540e1b0fd4bdc03a6a34b9342c0ace3", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hand applies black paint to canvas using a 25mm flat brush, starting from the top left corner.  \n- Palette shows black, white, and cerulean blue paint being mixed into a dark blue shade.  \n- Canvas is positioned on a wooden surface with text indicating its dimensions: 28cm * 23cm (11inch * 9inch).\n[30-60s] - Hand uses a brush to apply dark gray paint along the top edge of a canvas, creating a gradient effect.  \n- A palette with black, blue, and white paint is visible to the right, with a brush dipped in blue paint.  \n- The artist switches to a pencil to sketch a curved line along the edge of the painted area.\n[60-90s] - Hand applies light blue paint in sweeping strokes across the canvas, blending into a darker blue gradient.  \n- Paintbrush moves from top to bottom, creating a smooth transition between white and dark blue areas.  \n- Palette with mixed blue and black paint is visible to the right, indicating ongoing color adjustments.\n[90-120s] - Hand uses a 5mm brush to apply white paint in sweeping motions across a dark gray canvas.  \n- Palette with mixed blue and gray paint is visible to the right of the canvas.  \n- Canvas shows a curved, planet-like shape with gradient shading from dark to light gray.\n[120-150s] - Hand holds brush, applying white paint in textured strokes across a dark blue canvas.  \n- Brush moves horizontally, blending white paint to form cloud-like shapes on the canvas.  \n- Paint palette with blue and white colors visible to the right of the canvas.\n[150-180s] - Artist's hand holds two paintbrushes, applying strokes to a canvas depicting a planet's curved surface.  \n- The canvas shows a gradient from dark to light gray, with textured areas suggesting craters or terrain.  \n- A palette with black, blue, and gray paint is visible to the right, indicating ongoing color mixing.\n[180-210s] - A hand holds a paintbrush, applying white paint to a canvas depicting a blue-gray planet.  \n- The brush strokes are deliberate, blending paint to create texture and depth on the planetary surface.  \n- The canvas is positioned on a wooden surface, with a palette containing blue and black paint visible to the right.\n[210-240s] - Hand holds brush, applying paint to canvas depicting a moon-like surface.  \n- Palette with blue and gray paint visible to the right of the canvas.  \n- Brush strokes vary in direction and pressure, adding texture to the lunar terrain.", "history_tokens": 570, "history_utf8_bytes": 2410, "recent_frame_times_s": [222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0], "recent_frames_sha256": "3cb40e2f24bbfb348b6b91605c9c17fd155ea4463f142addc18238222937b48f", "num_recent_frames": 30, "tq": 715865.909089976, "t1": 715866.719221053, "ta": 715866.719221053, "te": 715866.904577165, "first_response_s": 0.8101310769561678, "answer_total_s": 0.995487189036794, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 142, "content_group": "be6c97b80479d3db8f9be6e22bb27c034bd62073b4d09d48b59b51523ad0d4cb", "question": {"question_id": "sample_142_a256_q1", "video_id": 142, "video_path": "./videos/sample_142_real.mp4", "annotation_index": 256, "question_index": 1, "question": "Which of the following best summarizes the artist's actions just shown in the video", "options": ["A. The artist sketches a rough outline of a landscape.", "B. The artist adds fine details to a previously sketched portrait.", "C. The artist paints vertical lines, mixes paint, and adds foliage details to the canvas.", "D. The artist starts a new painting with a fresh palette and blank canvas."], "answer": "C", "time_stamp_s": 380, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "painting", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_142_a256_q1", "video_id": 142, "time_stamp_s": 380, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "386db0b22e73151aba59c206cbeae01dc607d0ea95ab9b8cf641d0603c92686a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0], "recent_frames_sha256": "365a4e326907370701bd32493b5d69a5488ca45160e8f931f6ea8f0f629702f0", "num_recent_frames": 30, "tq": 715767.019782257, "t1": 715779.333556684, "ta": 715779.333556684, "te": 715779.371204333, "first_response_s": 12.313774426933378, "answer_total_s": 12.351422075997107, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_142_a256_q1", "video_id": 142, "time_stamp_s": 380, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a14f234eb7c4e2a66fadae0be8bc8eb18d954fed44cd32b35564a49901c087b3", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hand applies black paint to canvas using a 25mm flat brush, starting from the top left corner.  \n- Palette shows black, white, and cerulean blue paint being mixed into a dark blue shade.  \n- Canvas is positioned on a wooden surface with text indicating its dimensions: 28cm * 23cm (11inch * 9inch).\n[30-60s] - Hand uses a brush to apply dark gray paint along the top edge of a canvas, creating a gradient effect.  \n- A palette with black, blue, and white paint is visible to the right, with a brush dipped in blue paint.  \n- The artist switches to a pencil to sketch a curved line along the edge of the painted area.\n[60-90s] - Hand applies light blue paint in sweeping strokes across the canvas, blending into a darker blue gradient.  \n- Paintbrush moves from top to bottom, creating a smooth transition between white and dark blue areas.  \n- Palette with mixed blue and black paint is visible to the right, indicating ongoing color adjustments.\n[90-120s] - Hand uses a 5mm brush to apply white paint in sweeping motions across a dark gray canvas.  \n- Palette with mixed blue and gray paint is visible to the right of the canvas.  \n- Canvas shows a curved, planet-like shape with gradient shading from dark to light gray.\n[120-150s] - Hand holds brush, applying white paint in textured strokes across a dark blue canvas.  \n- Brush moves horizontally, blending white paint to form cloud-like shapes on the canvas.  \n- Paint palette with blue and white colors visible to the right of the canvas.\n[150-180s] - Artist's hand holds two paintbrushes, applying strokes to a canvas depicting a planet's curved surface.  \n- The canvas shows a gradient from dark to light gray, with textured areas suggesting craters or terrain.  \n- A palette with black, blue, and gray paint is visible to the right, indicating ongoing color mixing.\n[180-210s] - A hand holds a paintbrush, applying white paint to a canvas depicting a blue-gray planet.  \n- The brush strokes are deliberate, blending paint to create texture and depth on the planetary surface.  \n- The canvas is positioned on a wooden surface, with a palette containing blue and black paint visible to the right.\n[210-240s] - Hand holds brush, applying paint to canvas depicting a moon-like surface.  \n- Palette with blue and gray paint visible to the right of the canvas.  \n- Brush strokes vary in direction and pressure, adding texture to the lunar terrain.\n[240-270s] - Hand uses a liner brush to apply white paint on a gray planetary surface, enhancing texture and detail.  \n- The brush is dipped into a palette containing blue and white paint, indicating preparation for precise strokes.  \n- The painting is displayed on a wooden surface, with the artist’s hand positioned to the right of the canvas.\n[270-300s] - Hand uses a fine tool to apply white paint on a canvas depicting the moon's surface.  \n- The tool creates textured, crater-like details on the moon's grayish terrain.  \n- Canvas is positioned on a wooden surface with a \"JOONY Art\" watermark visible in the corner.\n[300-330s] - Hand uses a fine tool to etch small circular indentations onto a gray, textured surface resembling the moon's surface.  \n- A palette with blue and black paint is visible to the right, indicating ongoing painting activity.  \n- The artist’s hand moves steadily, applying precise pressure to create detailed craters or features on the artwork.\n[330-360s] - Hand uses fine brush to add small circular details to a moon painting on canvas.  \n- Palette with blue and black paint is visible to the right, showing mixed colors.  \n- Painting depicts a detailed lunar surface with craters, set against a dark background.", "history_tokens": 856, "history_utf8_bytes": 3661, "recent_frame_times_s": [351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0], "recent_frames_sha256": "365a4e326907370701bd32493b5d69a5488ca45160e8f931f6ea8f0f629702f0", "num_recent_frames": 30, "tq": 715904.397908298, "t1": 715911.37810449, "ta": 715911.37810449, "te": 715911.714415171, "first_response_s": 6.980196192045696, "answer_total_s": 7.3165068730013445, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 142, "content_group": "be6c97b80479d3db8f9be6e22bb27c034bd62073b4d09d48b59b51523ad0d4cb", "question": {"question_id": "sample_142_a256_q0", "video_id": 142, "video_path": "./videos/sample_142_real.mp4", "annotation_index": 256, "question_index": 0, "question": "Why does the artist pick up a larger paintbrush after finishing the lines?", "options": ["A. To adds foliage details.", "B. To clean the previous paintbrush.", "C. To start a new painting.", "D. To add a new color to the palette."], "answer": "A", "time_stamp_s": 381, "task_type": "Causal Reasoning", "required_ability": "working memory", "video_category": "painting", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_142_a256_q0", "video_id": 142, "time_stamp_s": 381, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fc7cb0f57c7a43142ec37311a6623c40618f1ff16e0b5cc76b9b2de523d64fce", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0], "recent_frames_sha256": "4dbc3be66ec75f0a837cd4521fa46c3014bac49c2801678fcc233dc15b734df4", "num_recent_frames": 30, "tq": 715779.38129546, "t1": 715786.569495165, "ta": 715786.569495165, "te": 715786.792541095, "first_response_s": 7.188199704978615, "answer_total_s": 7.411245635012165, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_142_a256_q0", "video_id": 142, "time_stamp_s": 381, "ground_truth": "A", "raw_output": "A. To adds foliage details.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "11e487a8dbfeb577f3ef2400449eb5716de1c045ba59361050a81e85f8bb5bc5", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hand applies black paint to canvas using a 25mm flat brush, starting from the top left corner.  \n- Palette shows black, white, and cerulean blue paint being mixed into a dark blue shade.  \n- Canvas is positioned on a wooden surface with text indicating its dimensions: 28cm * 23cm (11inch * 9inch).\n[30-60s] - Hand uses a brush to apply dark gray paint along the top edge of a canvas, creating a gradient effect.  \n- A palette with black, blue, and white paint is visible to the right, with a brush dipped in blue paint.  \n- The artist switches to a pencil to sketch a curved line along the edge of the painted area.\n[60-90s] - Hand applies light blue paint in sweeping strokes across the canvas, blending into a darker blue gradient.  \n- Paintbrush moves from top to bottom, creating a smooth transition between white and dark blue areas.  \n- Palette with mixed blue and black paint is visible to the right, indicating ongoing color adjustments.\n[90-120s] - Hand uses a 5mm brush to apply white paint in sweeping motions across a dark gray canvas.  \n- Palette with mixed blue and gray paint is visible to the right of the canvas.  \n- Canvas shows a curved, planet-like shape with gradient shading from dark to light gray.\n[120-150s] - Hand holds brush, applying white paint in textured strokes across a dark blue canvas.  \n- Brush moves horizontally, blending white paint to form cloud-like shapes on the canvas.  \n- Paint palette with blue and white colors visible to the right of the canvas.\n[150-180s] - Artist's hand holds two paintbrushes, applying strokes to a canvas depicting a planet's curved surface.  \n- The canvas shows a gradient from dark to light gray, with textured areas suggesting craters or terrain.  \n- A palette with black, blue, and gray paint is visible to the right, indicating ongoing color mixing.\n[180-210s] - A hand holds a paintbrush, applying white paint to a canvas depicting a blue-gray planet.  \n- The brush strokes are deliberate, blending paint to create texture and depth on the planetary surface.  \n- The canvas is positioned on a wooden surface, with a palette containing blue and black paint visible to the right.\n[210-240s] - Hand holds brush, applying paint to canvas depicting a moon-like surface.  \n- Palette with blue and gray paint visible to the right of the canvas.  \n- Brush strokes vary in direction and pressure, adding texture to the lunar terrain.\n[240-270s] - Hand uses a liner brush to apply white paint on a gray planetary surface, enhancing texture and detail.  \n- The brush is dipped into a palette containing blue and white paint, indicating preparation for precise strokes.  \n- The painting is displayed on a wooden surface, with the artist’s hand positioned to the right of the canvas.\n[270-300s] - Hand uses a fine tool to apply white paint on a canvas depicting the moon's surface.  \n- The tool creates textured, crater-like details on the moon's grayish terrain.  \n- Canvas is positioned on a wooden surface with a \"JOONY Art\" watermark visible in the corner.\n[300-330s] - Hand uses a fine tool to etch small circular indentations onto a gray, textured surface resembling the moon's surface.  \n- A palette with blue and black paint is visible to the right, indicating ongoing painting activity.  \n- The artist’s hand moves steadily, applying precise pressure to create detailed craters or features on the artwork.\n[330-360s] - Hand uses fine brush to add small circular details to a moon painting on canvas.  \n- Palette with blue and black paint is visible to the right, showing mixed colors.  \n- Painting depicts a detailed lunar surface with craters, set against a dark background.", "history_tokens": 856, "history_utf8_bytes": 3661, "recent_frame_times_s": [352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0], "recent_frames_sha256": "4dbc3be66ec75f0a837cd4521fa46c3014bac49c2801678fcc233dc15b734df4", "num_recent_frames": 30, "tq": 715911.736670837, "t1": 715917.492745164, "ta": 715917.492745164, "te": 715917.864602596, "first_response_s": 5.756074326927774, "answer_total_s": 6.127931758994237, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 143, "content_group": "455f62a545684c029e3f4c814aec281c9b9afd21bc1902f77d78430ab3861c36", "question": {"question_id": "sample_143_a1218_q0", "video_id": 143, "video_path": "./videos/sample_143_real.mp4", "annotation_index": 1218, "question_index": 0, "question": "What does the split-screen show right now?", "options": ["A. Two different people performing the same exercise.", "B. A comparison between two types of exercise equipment.", "C. Two options for the same exercise.", "D. Different stages of the same workout."], "answer": "C", "time_stamp_s": 201, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "gym_workout", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_143_a1218_q0", "video_id": 143, "time_stamp_s": 201, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fec81241f02175b28cee1b40d54bd6a9b7d951aa393a9eb7b165e1c1989417fa", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333], "recent_frames_sha256": "d6f424e4fddf7577f49157b443c8c8deb1a458a7b61c02f1c821d38da9de08cb", "num_recent_frames": 30, "tq": 710018.721957527, "t1": 710020.638007857, "ta": 710020.638007857, "te": 710020.793197314, "first_response_s": 1.9160503300372511, "answer_total_s": 2.0712397870374843, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_143_a1218_q0", "video_id": 143, "time_stamp_s": 201, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "55048ce3bf46ac04f2ff202e827810564048f3594706cc734cc4d3cb73e47fbf", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Jeff Nippard, in a gym, performs a barbell squat with visible effort, adjusting weights and positioning himself for the lift.  \n- A man in a hoodie sits in a dimly lit room with a microphone, likely introducing or explaining the workout series.  \n- A grid of six video thumbnails labeled \"PUSH 1,\" \"PULL 1,\" \"LEGS 1,\" \"PUSH 2,\" \"PULL 2,\" and \"LEGS 2\" previews different exercises in the series.\n[30-60s] - A man in a grey hoodie sits in front of a microphone, speaking in a gym setting with equipment visible behind him.  \n- A split-screen displays two exercises: \"Arm Circles\" and \"Cable External Rotations,\" both shown with a man performing them.  \n- A man performs a bench press on a weight bench, with on-screen text indicating \"Bench Press: 1 Set x 3-5 Reps.\"\n[60-90s] - Man lies on bench, lifting barbell with belt for support, knees bent, feet flat.  \n- Barbell is positioned above chest, hands gripping handles, body aligned with bench.  \n- Man’s head is slightly elevated, eyes focused forward, showing controlled exertion.\n[90-120s] - Man lies on bench, gripping barbell, preparing for bench press.  \n- Spotter stands behind, hands on barbell, ready to assist.  \n- Barbell loaded with multiple weight plates, positioned above man’s chest.\n[120-150s] - Man performs bench press with barbell, wearing white shirt and black shorts, using weight belt for support.  \n- Gym environment visible with various equipment and other people in background.  \n- Video transitions to instructional frame showing man with arms extended and anatomical diagram of shoulder muscles.\n[150-180s] - A man lies on a bench press, gripping a barbell with wrist wraps, preparing for a lift.  \n- White arrows point to the man’s shoulders, indicating proper positioning relative to the bench.  \n- The background shows a gym with dumbbells and equipment, suggesting a training environment.", "history_tokens": 467, "history_utf8_bytes": 1885, "recent_frame_times_s": [171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333], "recent_frames_sha256": "d6f424e4fddf7577f49157b443c8c8deb1a458a7b61c02f1c821d38da9de08cb", "num_recent_frames": 30, "tq": 710105.745594507, "t1": 710117.079628138, "ta": 710117.079628138, "te": 710117.123380268, "first_response_s": 11.334033631021157, "answer_total_s": 11.377785761025734, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 143, "content_group": "455f62a545684c029e3f4c814aec281c9b9afd21bc1902f77d78430ab3861c36", "question": {"question_id": "sample_143_a1218_q1", "video_id": 143, "video_path": "./videos/sample_143_real.mp4", "annotation_index": 1218, "question_index": 1, "question": "What exercise is being performed in \"Exercise 2 of 7\"?", "options": ["A. Deadlift.", "B. Bench Press.", "C. Larsen Press.", "D. Squat."], "answer": "C", "time_stamp_s": 206, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "gym_workout", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_143_a1218_q1", "video_id": 143, "time_stamp_s": 206, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a2529de0dbec3fd9f806eab66dfeb135e2344e7b48c5f9c46df38db29efdfdf3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "8fcbe094e4708cbea5a86d3ce68940fbe72b05ccb09ef3314e41e3a6fffdd939", "num_recent_frames": 30, "tq": 710020.82984685, "t1": 710028.895189787, "ta": 710028.895189787, "te": 710029.118923049, "first_response_s": 8.065342937014066, "answer_total_s": 8.289076198940165, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_143_a1218_q1", "video_id": 143, "time_stamp_s": 206, "ground_truth": "C", "raw_output": "C. Larsen Press.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "1e41b0e354d0a44d28cb10047fadf89265c17f9167c4895bc3d6329495dd5fc3", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Jeff Nippard, in a gym, performs a barbell squat with visible effort, adjusting weights and positioning himself for the lift.  \n- A man in a hoodie sits in a dimly lit room with a microphone, likely introducing or explaining the workout series.  \n- A grid of six video thumbnails labeled \"PUSH 1,\" \"PULL 1,\" \"LEGS 1,\" \"PUSH 2,\" \"PULL 2,\" and \"LEGS 2\" previews different exercises in the series.\n[30-60s] - A man in a grey hoodie sits in front of a microphone, speaking in a gym setting with equipment visible behind him.  \n- A split-screen displays two exercises: \"Arm Circles\" and \"Cable External Rotations,\" both shown with a man performing them.  \n- A man performs a bench press on a weight bench, with on-screen text indicating \"Bench Press: 1 Set x 3-5 Reps.\"\n[60-90s] - Man lies on bench, lifting barbell with belt for support, knees bent, feet flat.  \n- Barbell is positioned above chest, hands gripping handles, body aligned with bench.  \n- Man’s head is slightly elevated, eyes focused forward, showing controlled exertion.\n[90-120s] - Man lies on bench, gripping barbell, preparing for bench press.  \n- Spotter stands behind, hands on barbell, ready to assist.  \n- Barbell loaded with multiple weight plates, positioned above man’s chest.\n[120-150s] - Man performs bench press with barbell, wearing white shirt and black shorts, using weight belt for support.  \n- Gym environment visible with various equipment and other people in background.  \n- Video transitions to instructional frame showing man with arms extended and anatomical diagram of shoulder muscles.\n[150-180s] - A man lies on a bench press, gripping a barbell with wrist wraps, preparing for a lift.  \n- White arrows point to the man’s shoulders, indicating proper positioning relative to the bench.  \n- The background shows a gym with dumbbells and equipment, suggesting a training environment.", "history_tokens": 467, "history_utf8_bytes": 1885, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "8fcbe094e4708cbea5a86d3ce68940fbe72b05ccb09ef3314e41e3a6fffdd939", "num_recent_frames": 30, "tq": 710117.168217475, "t1": 710123.587533304, "ta": 710123.587533304, "te": 710123.812087844, "first_response_s": 6.419315829058178, "answer_total_s": 6.643870369065553, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 143, "content_group": "455f62a545684c029e3f4c814aec281c9b9afd21bc1902f77d78430ab3861c36", "question": {"question_id": "sample_143_a1219_q0", "video_id": 143, "video_path": "./videos/sample_143_real.mp4", "annotation_index": 1219, "question_index": 0, "question": "What exercise is the man performing right now?", "options": ["A. Bicep curls.", "B. Press around.", "C. Leg press.", "D. Shoulder press."], "answer": "B", "time_stamp_s": 400, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_143_a1219_q0", "video_id": 143, "time_stamp_s": 400, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2d51da0ef253afd0c6fc580971396226f2f027b1d114ec210e00d4429d41079c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.00028333333336, 385.00128333333333, 386.0022833333333, 387.00328333333334, 388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334], "recent_frames_sha256": "21b3758c5679dd2d2cb1e35ae2adadda9824da1a57d815d7c925976ebc70738c", "num_recent_frames": 30, "tq": 710029.160497341, "t1": 710036.058577866, "ta": 710036.058577866, "te": 710036.498330462, "first_response_s": 6.8980805249884725, "answer_total_s": 7.337833121069707, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_143_a1219_q0", "video_id": 143, "time_stamp_s": 400, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f04081f7ca2c2b58a85f2d34a6e8e1e30106436e72a8d8b0044d7fd9bccb1bd8", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Jeff Nippard, in a gym, performs a barbell squat with visible effort, adjusting weights and positioning himself for the lift.  \n- A man in a hoodie sits in a dimly lit room with a microphone, likely introducing or explaining the workout series.  \n- A grid of six video thumbnails labeled \"PUSH 1,\" \"PULL 1,\" \"LEGS 1,\" \"PUSH 2,\" \"PULL 2,\" and \"LEGS 2\" previews different exercises in the series.\n[30-60s] - A man in a grey hoodie sits in front of a microphone, speaking in a gym setting with equipment visible behind him.  \n- A split-screen displays two exercises: \"Arm Circles\" and \"Cable External Rotations,\" both shown with a man performing them.  \n- A man performs a bench press on a weight bench, with on-screen text indicating \"Bench Press: 1 Set x 3-5 Reps.\"\n[60-90s] - Man lies on bench, lifting barbell with belt for support, knees bent, feet flat.  \n- Barbell is positioned above chest, hands gripping handles, body aligned with bench.  \n- Man’s head is slightly elevated, eyes focused forward, showing controlled exertion.\n[90-120s] - Man lies on bench, gripping barbell, preparing for bench press.  \n- Spotter stands behind, hands on barbell, ready to assist.  \n- Barbell loaded with multiple weight plates, positioned above man’s chest.\n[120-150s] - Man performs bench press with barbell, wearing white shirt and black shorts, using weight belt for support.  \n- Gym environment visible with various equipment and other people in background.  \n- Video transitions to instructional frame showing man with arms extended and anatomical diagram of shoulder muscles.\n[150-180s] - A man lies on a bench press, gripping a barbell with wrist wraps, preparing for a lift.  \n- White arrows point to the man’s shoulders, indicating proper positioning relative to the bench.  \n- The background shows a gym with dumbbells and equipment, suggesting a training environment.\n[180-210s] - Man performs barbell press on bench, lifting barbell from chest to overhead.  \n- Barbell has \"SPL\" and \"SPL\" branding on sleeves, with weight plates visible.  \n- Man wears white shirt, black shorts, and wrist wraps; bench has \"SPL\" logo.\n[210-240s] - Man performs bench press with 295 lbs, reducing weight to 225 lbs (75% of top set) as shown on screen.\n- Barbell moves vertically as man lowers and raises it, with feet anchored on bench.\n- Man wears white shirt, black shorts, and weightlifting belt, with visible knee pads on legs.\n[240-270s] - Man performs bench press with barbell, wearing weightlifting belt and wrist wraps, lying on bench.  \n- Barbell is loaded with weights, and the man pushes it upward from chest level.  \n- Gym environment visible with mirrors, racks, and other equipment in background.\n[270-300s] - Man performs standing Arnold press with dumbbells, lifting them overhead while wearing a weight belt.  \n- Gym environment features multiple machines and other individuals working out in the background.  \n- On-screen text indicates \"EXERCISE 3 OF 7\" and \"STANDING ARNOLD PRESS: 3 SETS X 10 REPS\".\n[300-330s] - Man in white shirt and black shorts performs dumbbell overhead press while wearing a weight belt.  \n- He lowers dumbbells to shoulder height, then presses them overhead with controlled motion.  \n- Background shows gym equipment and other individuals working out, including a person in orange shirt near racks.\n[330-360s] - Man in white t-shirt and black shorts performs overhead press with dumbbells, then lowers them to chest level.  \n- He walks away from the camera, passing gym equipment, while another person is visible in the background.  \n- On-screen text displays \"EXERCISE 4b\" with instructions for press and pec stretch exercises.\n[360-390s] - Man in white shirt performs cable lateral raise, arms extended sideways, body slightly bent at waist.  \n- He shifts stance, knees bent, feet shoulder-width apart, maintaining controlled motion.  \n- Cable machine’s handles remain fixed, resisting movement as he lifts arms outward.", "history_tokens": 982, "history_utf8_bytes": 3969, "recent_frame_times_s": [370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.00028333333336, 385.00128333333333, 386.0022833333333, 387.00328333333334, 388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334], "recent_frames_sha256": "21b3758c5679dd2d2cb1e35ae2adadda9824da1a57d815d7c925976ebc70738c", "num_recent_frames": 30, "tq": 710174.664856574, "t1": 710175.446253593, "ta": 710175.446253593, "te": 710175.483614045, "first_response_s": 0.7813970189308748, "answer_total_s": 0.8187574709299952, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 143, "content_group": "455f62a545684c029e3f4c814aec281c9b9afd21bc1902f77d78430ab3861c36", "question": {"question_id": "sample_143_a1219_q1", "video_id": 143, "video_path": "./videos/sample_143_real.mp4", "annotation_index": 1219, "question_index": 1, "question": "What is the man wearing during his exercise in the gym?", "options": ["A. Black T-shirt and white shorts.", "B. White T-shirt and black shorts.", "C. Gray T-shirt and white pants.", "D. Blue T-shirt and pants."], "answer": "B", "time_stamp_s": 420, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_143_a1219_q1", "video_id": 143, "time_stamp_s": 420, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4f186d3e49c6e3486f687c50f96e5e8a395e4dbab15375db8147117f65bcb915", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0009166666667, 419.00191666666666], "recent_frames_sha256": "552ebe432d8bdeaad0f6b57b36a473abee708501848c84d1eef34c2e9005074c", "num_recent_frames": 30, "tq": 710036.515027399, "t1": 710046.708072352, "ta": 710046.708072352, "te": 710046.745267796, "first_response_s": 10.19304495304823, "answer_total_s": 10.23024039703887, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_143_a1219_q1", "video_id": 143, "time_stamp_s": 420, "ground_truth": "B", "raw_output": "B. White T-shirt and black shorts.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "688b60d9b48f934e67a019135034c45073da9de3f7b444337f2db7b80765e8d7", "condition_order": ["recent", "notes"], "memory": "[30-60s] - A man in a grey hoodie sits in front of a microphone, speaking in a gym setting with equipment visible behind him.  \n- A split-screen displays two exercises: \"Arm Circles\" and \"Cable External Rotations,\" both shown with a man performing them.  \n- A man performs a bench press on a weight bench, with on-screen text indicating \"Bench Press: 1 Set x 3-5 Reps.\"\n[60-90s] - Man lies on bench, lifting barbell with belt for support, knees bent, feet flat.  \n- Barbell is positioned above chest, hands gripping handles, body aligned with bench.  \n- Man’s head is slightly elevated, eyes focused forward, showing controlled exertion.\n[90-120s] - Man lies on bench, gripping barbell, preparing for bench press.  \n- Spotter stands behind, hands on barbell, ready to assist.  \n- Barbell loaded with multiple weight plates, positioned above man’s chest.\n[120-150s] - Man performs bench press with barbell, wearing white shirt and black shorts, using weight belt for support.  \n- Gym environment visible with various equipment and other people in background.  \n- Video transitions to instructional frame showing man with arms extended and anatomical diagram of shoulder muscles.\n[150-180s] - A man lies on a bench press, gripping a barbell with wrist wraps, preparing for a lift.  \n- White arrows point to the man’s shoulders, indicating proper positioning relative to the bench.  \n- The background shows a gym with dumbbells and equipment, suggesting a training environment.\n[180-210s] - Man performs barbell press on bench, lifting barbell from chest to overhead.  \n- Barbell has \"SPL\" and \"SPL\" branding on sleeves, with weight plates visible.  \n- Man wears white shirt, black shorts, and wrist wraps; bench has \"SPL\" logo.\n[210-240s] - Man performs bench press with 295 lbs, reducing weight to 225 lbs (75% of top set) as shown on screen.\n- Barbell moves vertically as man lowers and raises it, with feet anchored on bench.\n- Man wears white shirt, black shorts, and weightlifting belt, with visible knee pads on legs.\n[240-270s] - Man performs bench press with barbell, wearing weightlifting belt and wrist wraps, lying on bench.  \n- Barbell is loaded with weights, and the man pushes it upward from chest level.  \n- Gym environment visible with mirrors, racks, and other equipment in background.\n[270-300s] - Man performs standing Arnold press with dumbbells, lifting them overhead while wearing a weight belt.  \n- Gym environment features multiple machines and other individuals working out in the background.  \n- On-screen text indicates \"EXERCISE 3 OF 7\" and \"STANDING ARNOLD PRESS: 3 SETS X 10 REPS\".\n[300-330s] - Man in white shirt and black shorts performs dumbbell overhead press while wearing a weight belt.  \n- He lowers dumbbells to shoulder height, then presses them overhead with controlled motion.  \n- Background shows gym equipment and other individuals working out, including a person in orange shirt near racks.\n[330-360s] - Man in white t-shirt and black shorts performs overhead press with dumbbells, then lowers them to chest level.  \n- He walks away from the camera, passing gym equipment, while another person is visible in the background.  \n- On-screen text displays \"EXERCISE 4b\" with instructions for press and pec stretch exercises.\n[360-390s] - Man in white shirt performs cable lateral raise, arms extended sideways, body slightly bent at waist.  \n- He shifts stance, knees bent, feet shoulder-width apart, maintaining controlled motion.  \n- Cable machine’s handles remain fixed, resisting movement as he lifts arms outward.\n[390-420s] - Man in white t-shirt performs cable chest fly exercise, arms extended outward, then pulls inward toward chest.  \n- He transitions to a different machine, gripping handles and moving arms in a controlled arc.  \n- Machine's vertical column and weight stack are visible as he adjusts his position.", "history_tokens": 936, "history_utf8_bytes": 3872, "recent_frame_times_s": [390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0009166666667, 419.00191666666666], "recent_frames_sha256": "552ebe432d8bdeaad0f6b57b36a473abee708501848c84d1eef34c2e9005074c", "num_recent_frames": 30, "tq": 710186.15145744, "t1": 710187.481614602, "ta": 710187.481614602, "te": 710187.815963848, "first_response_s": 1.3301571620395407, "answer_total_s": 1.6645064080366865, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 143, "content_group": "455f62a545684c029e3f4c814aec281c9b9afd21bc1902f77d78430ab3861c36", "question": {"question_id": "sample_143_a1220_q0", "video_id": 143, "video_path": "./videos/sample_143_real.mp4", "annotation_index": 1220, "question_index": 0, "question": "What action is the man in a white shirt performing right now?", "options": ["A. Stretch-Only Overhead Extension.", "B. Bicep Curl.", "C. Squeeze-Only Pressdown.", "D. Leg Press."], "answer": "C", "time_stamp_s": 606, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [600, 660], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_143_a1220_q0", "video_id": 143, "time_stamp_s": 606, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "995fdad28e0aa7b00a7e204f0cd8ec0bc25b3b5faff4c5c9a49c0c343355dae9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [576.0087666666667, 577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0000833333334, 585.0010833333333, 586.0020833333333, 587.0030833333333, 588.0040833333334, 589.0050833333333, 590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044], "recent_frames_sha256": "72c0c3c37e7c4c52f49c9f2b0312a0a02d4c0f78159e8790e51dcfebb9d1d2f6", "num_recent_frames": 30, "tq": 710046.762946153, "t1": 710052.855213154, "ta": 710052.855213154, "te": 710052.89195796, "first_response_s": 6.0922670010477304, "answer_total_s": 6.1290118070319295, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_143_a1220_q0", "video_id": 143, "time_stamp_s": 606, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "12b0284e6bb8a876b2e8e9722720d1b2c06a7008b78ef91b252f4a3a0866b65b", "condition_order": ["recent", "notes"], "memory": "[210-240s] - Man performs bench press with 295 lbs, reducing weight to 225 lbs (75% of top set) as shown on screen.\n- Barbell moves vertically as man lowers and raises it, with feet anchored on bench.\n- Man wears white shirt, black shorts, and weightlifting belt, with visible knee pads on legs.\n[240-270s] - Man performs bench press with barbell, wearing weightlifting belt and wrist wraps, lying on bench.  \n- Barbell is loaded with weights, and the man pushes it upward from chest level.  \n- Gym environment visible with mirrors, racks, and other equipment in background.\n[270-300s] - Man performs standing Arnold press with dumbbells, lifting them overhead while wearing a weight belt.  \n- Gym environment features multiple machines and other individuals working out in the background.  \n- On-screen text indicates \"EXERCISE 3 OF 7\" and \"STANDING ARNOLD PRESS: 3 SETS X 10 REPS\".\n[300-330s] - Man in white shirt and black shorts performs dumbbell overhead press while wearing a weight belt.  \n- He lowers dumbbells to shoulder height, then presses them overhead with controlled motion.  \n- Background shows gym equipment and other individuals working out, including a person in orange shirt near racks.\n[330-360s] - Man in white t-shirt and black shorts performs overhead press with dumbbells, then lowers them to chest level.  \n- He walks away from the camera, passing gym equipment, while another person is visible in the background.  \n- On-screen text displays \"EXERCISE 4b\" with instructions for press and pec stretch exercises.\n[360-390s] - Man in white shirt performs cable lateral raise, arms extended sideways, body slightly bent at waist.  \n- He shifts stance, knees bent, feet shoulder-width apart, maintaining controlled motion.  \n- Cable machine’s handles remain fixed, resisting movement as he lifts arms outward.\n[390-420s] - Man in white t-shirt performs cable chest fly exercise, arms extended outward, then pulls inward toward chest.  \n- He transitions to a different machine, gripping handles and moving arms in a controlled arc.  \n- Machine's vertical column and weight stack are visible as he adjusts his position.\n[420-450s] - Bar graph on right shows \"Stretching\" bar rising to 9.4 mm, while \"No Stretching\" remains at 6.2 mm, indicating greater elongation with stretching.  \n- Left side displays a research article titled \"Tension Reactions in Traditional Resistance Training\" with visible text and figures.  \n- A man in a gym, wearing a white shirt and black shorts, stands beside a weight machine, gesturing toward his chest.\n[450-480s] - Man in white t-shirt and black shorts stands beside a weight machine, placing hand on chest while leaning against it.  \n- Overlay text highlights that \"traditional ST programs without increasing time spent exercising\" may not yield expected results.  \n- Gym environment visible with various equipment and mirrors in background.\n[480-510s] - Man in white shirt performs press-around exercise on cable machine, arms extended outward.  \n- Split-screen shows muscular man posing in underwear on left, while man on right performs pec stretch on cable machine.  \n- Man in white shirt transitions to cross-body cable Y raise, holding dumbbell with arms extended.\n[510-540s] - Man in white t-shirt and black shorts performs cable row exercise, pulling handle toward torso while standing.  \n- Mirror reflection shows his full-body movement, revealing gym equipment and lighting setup.  \n- He transitions from pulling motion to extending arms outward, maintaining posture.\n[540-570s] - Man in white t-shirt pulls cable machine with focused expression, hand gripping chain.  \n- Man in black shorts stands in gym, preparing for exercise, then begins squatting with resistance band.  \n- Anatomical diagram appears beside the man, labeling muscle groups (D6, D5, D4, D3, D2, D1) with arrows indicating movement.\n[570-600s] - Man in white shirt performs cable row exercise, pulling handle toward chest while standing in gym.  \n- Split-screen shows two different exercises: left side depicts a man doing a squat with a barbell, right side shows a man performing a stretch-only overhead extension.  \n- Text overlay labels the exercises as \"Exercise 6a\" and \"Exercise 6b\" with repetition counts.", "history_tokens": 993, "history_utf8_bytes": 4247, "recent_frame_times_s": [576.0087666666667, 577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0000833333334, 585.0010833333333, 586.0020833333333, 587.0030833333333, 588.0040833333334, 589.0050833333333, 590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044], "recent_frames_sha256": "72c0c3c37e7c4c52f49c9f2b0312a0a02d4c0f78159e8790e51dcfebb9d1d2f6", "num_recent_frames": 30, "tq": 710225.799187594, "t1": 710227.782350978, "ta": 710227.782350978, "te": 710227.828134234, "first_response_s": 1.9831633840221912, "answer_total_s": 2.028946639969945, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 144, "content_group": "eeb9cb4a4b6d739a5a06cbaf797c21b5da3e26031deecb457c79bd4314069555", "question": {"question_id": "sample_144_a1439_q0", "video_id": 144, "video_path": "./videos/sample_144_real.mp4", "annotation_index": 1439, "question_index": 0, "question": "What series is being presented according to the text overlay during the video?", "options": ["A. \"THE ULTIMATE BODYBUILDING SERIES\".", "B. \"JEFF NIPPARD'S WORKOUT SERIES\".", "C. \"THE ULTIMATE GYM SERIES\".", "D. \"THE ULTIMATE PUSH PULL LEGS SERIES\"."], "answer": "D", "time_stamp_s": 15, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "gym_workout", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_144_a1439_q0", "video_id": 144, "time_stamp_s": 15, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f62667bd2364370930f481ad12e24eeb25ade06be6cc21e45672adbb8e501384", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014], "recent_frames_sha256": "0e034032cb09cb8436abc469dbc4c5b8ca6ac281e9bb22fbf32605aa1d509021", "num_recent_frames": 15, "tq": 717512.058153573, "t1": 717517.395550555, "ta": 717517.395550555, "te": 717517.432739802, "first_response_s": 5.337396982009523, "answer_total_s": 5.374586229096167, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_144_a1439_q0", "video_id": 144, "time_stamp_s": 15, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "43dcb3e14115bf555e324538bf82e6a2cfcf402ef0960ef83456f95566139f73", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014], "recent_frames_sha256": "0e034032cb09cb8436abc469dbc4c5b8ca6ac281e9bb22fbf32605aa1d509021", "num_recent_frames": 15, "tq": 717557.970669981, "t1": 717569.784123111, "ta": 717569.784123111, "te": 717570.087898941, "first_response_s": 11.813453130074777, "answer_total_s": 12.1172289600363, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 144, "content_group": "eeb9cb4a4b6d739a5a06cbaf797c21b5da3e26031deecb457c79bd4314069555", "question": {"question_id": "sample_144_a1440_q0", "video_id": 144, "video_path": "./videos/sample_144_real.mp4", "annotation_index": 1440, "question_index": 0, "question": "How many exercises are indicated in the sequence the person is following?", "options": ["A. 4.", "B. 5.", "C. 6.", "D. 7."], "answer": "C", "time_stamp_s": 190, "task_type": "Counting", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_144_a1440_q0", "video_id": 144, "time_stamp_s": 190, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "126ee4d9ed6f93a2f8cbd43de3b0bb803b905b4d4c2c1489c1cada6cc2739300", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333], "recent_frames_sha256": "82e270440b62e52b62d98dd75377eb52a4523856062a5470c9bcf7106e036b2f", "num_recent_frames": 30, "tq": 717517.457152908, "t1": 717524.440213429, "ta": 717524.440213429, "te": 717524.4775471, "first_response_s": 6.983060521073639, "answer_total_s": 7.0203941920772195, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_144_a1440_q0", "video_id": 144, "time_stamp_s": 190, "ground_truth": "C", "raw_output": "C. 6.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "1eb4b81689916a2662afa7f2918d426546e2cf28507bb7c061e3a4ad9e080634", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Jeff Nippard, in a gym, performs a barbell back squat with visible focus and form.  \n- He transitions to a seated leg press exercise, holding dumbbells while seated on a machine.  \n- A man in a black \"HIMB\" shirt is seen in a gym, possibly observing or preparing for an exercise.\n[30-60s] - A man in a black hoodie sits on a treadmill, holding a water bottle, with \"WARM-UP\" text overlay indicating 5-10 minutes.  \n- A woman performs squats with a barbell on a squat rack, wearing a gray shirt and blue shorts, with \"EXERCISE 1 OF 6\" text overlay.  \n- The gym environment features multiple treadmills and weight machines, with visible \"TREADMILL OR STAIRMASTER\" branding on equipment.\n[60-90s] - Man in grey shirt and blue shorts performs squat with barbell, knees bent, feet shoulder-width apart, using squat rack for support.  \n- Weight plates visible on barbell, including 45-lb plates, indicating warm-up set 1.  \n- Gym environment with multiple squat racks and weight equipment in background, dim lighting.\n[90-120s] - Two split-screen panels show different substitution exercises: left panel features a man on a leg press machine, right panel shows a man performing a paused squat.  \n- Text labels beneath each panel identify them as \"SUBSTITUTION OPTION #1\" and \"SUBSTITUTION OPTION #2,\" with additional text indicating \"BOOST REPS TO 4-6\" for both.  \n- The gym environment in both panels is visible, with equipment and lighting consistent with a fitness facility.\n[120-150s] - Man in grey shirt and blue shorts performs paused squat with barbell, using knee sleeves and weight belt, positioned in squat rack.\n- Barbell is loaded with weights, and the man adjusts stance and grip while maintaining upright posture.\n- Text overlay advises selecting weight around 75% of top set weight for the exercise.\n[150-180s] - A yellow vertical line appears on screen, indicating the \"HYPOTHETICAL\" position for the barbell's center relative to the athlete's hips.  \n- The athlete is in a squat position, with the barbell resting on their shoulders and knees bent.  \n- The athlete's posture remains consistent, with the barbell positioned over the hips as they maintain the squat stance.", "history_tokens": 533, "history_utf8_bytes": 2192, "recent_frame_times_s": [160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333], "recent_frames_sha256": "82e270440b62e52b62d98dd75377eb52a4523856062a5470c9bcf7106e036b2f", "num_recent_frames": 30, "tq": 717617.672773533, "t1": 717624.641626341, "ta": 717624.641626341, "te": 717624.946489342, "first_response_s": 6.96885280800052, "answer_total_s": 7.2737158089876175, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 144, "content_group": "eeb9cb4a4b6d739a5a06cbaf797c21b5da3e26031deecb457c79bd4314069555", "question": {"question_id": "sample_144_a1441_q0", "video_id": 144, "video_path": "./videos/sample_144_real.mp4", "annotation_index": 1441, "question_index": 0, "question": "What exercise is the person performing right now?", "options": ["A. Squats.", "B. Lunges.", "C. Push-ups.", "D. Deadlifts."], "answer": "B", "time_stamp_s": 362, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_144_a1441_q0", "video_id": 144, "time_stamp_s": 362, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b3157510886a383c01914a3948e15f08b570bd978a5c2237d3e3912496a05b7d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [332.01501666666667, 333.01601666666664, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065], "recent_frames_sha256": "7bcbe0967075454282548904b27de922d71b2331c51b32caa927fd6fc52f68a1", "num_recent_frames": 30, "tq": 717524.492158962, "t1": 717534.617338792, "ta": 717534.617338792, "te": 717534.654759958, "first_response_s": 10.125179830007255, "answer_total_s": 10.162600996089168, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_144_a1441_q0", "video_id": 144, "time_stamp_s": 362, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1335a7aae8bbd55f2064ef16c55b801bb8ad0e32d19d06ebd417ccc1ff244931", "condition_order": ["recent", "notes"], "memory": "[30-60s] - A man in a black hoodie sits on a treadmill, holding a water bottle, with \"WARM-UP\" text overlay indicating 5-10 minutes.  \n- A woman performs squats with a barbell on a squat rack, wearing a gray shirt and blue shorts, with \"EXERCISE 1 OF 6\" text overlay.  \n- The gym environment features multiple treadmills and weight machines, with visible \"TREADMILL OR STAIRMASTER\" branding on equipment.\n[60-90s] - Man in grey shirt and blue shorts performs squat with barbell, knees bent, feet shoulder-width apart, using squat rack for support.  \n- Weight plates visible on barbell, including 45-lb plates, indicating warm-up set 1.  \n- Gym environment with multiple squat racks and weight equipment in background, dim lighting.\n[90-120s] - Two split-screen panels show different substitution exercises: left panel features a man on a leg press machine, right panel shows a man performing a paused squat.  \n- Text labels beneath each panel identify them as \"SUBSTITUTION OPTION #1\" and \"SUBSTITUTION OPTION #2,\" with additional text indicating \"BOOST REPS TO 4-6\" for both.  \n- The gym environment in both panels is visible, with equipment and lighting consistent with a fitness facility.\n[120-150s] - Man in grey shirt and blue shorts performs paused squat with barbell, using knee sleeves and weight belt, positioned in squat rack.\n- Barbell is loaded with weights, and the man adjusts stance and grip while maintaining upright posture.\n- Text overlay advises selecting weight around 75% of top set weight for the exercise.\n[150-180s] - A yellow vertical line appears on screen, indicating the \"HYPOTHETICAL\" position for the barbell's center relative to the athlete's hips.  \n- The athlete is in a squat position, with the barbell resting on their shoulders and knees bent.  \n- The athlete's posture remains consistent, with the barbell positioned over the hips as they maintain the squat stance.\n[180-210s] - Man in grey shirt and blue shorts performs Romanian deadlift with barbell, bending knees and hips while keeping back straight.  \n- Barbell is positioned on the ground, with weights on both sides, and the man is standing upright with feet shoulder-width apart.  \n- Yellow dashed line appears on the floor, indicating the man's hip position during the movement.\n[210-240s] - Man in grey shirt and blue shorts performs a deadlift, bending at the hips while keeping back straight.  \n- Yellow dashed line highlights the man's hip-to-ankle alignment during the lift.  \n- On-screen text labels \"ROL CONCERNS\" and states \"I only feel it in my lower back.\"\n[240-270s] - Man in grey shirt and blue shorts bends over to grip a barbell, preparing for a lift.  \n- He stands upright, holding the barbell, with a weight rack and other gym equipment visible in the background.  \n- A text overlay appears, displaying information about spinal erosion, partially obscuring the view.\n[270-300s] - Man in grey shirt and cap adjusts stance while preparing to lift barbell, with text overlay listing \"ROL CONCERNS\" and two specific issues.\n- Split-screen view shows left side with darker lighting and right side with brighter lighting, both displaying the same man performing a deadlift.\n- Text overlay at bottom of screen changes from \"MORE GLUTES\" to \"MORE HAMSTRINGS\" as the man lifts the barbell, indicating different focus areas for the exercise.\n[300-330s] - Man in grey shirt and blue shorts performs a deadlift with a barbell, bending at the hips and knees while maintaining a straight back.  \n- Gym environment features mirrors, weight racks, and various exercise machines in the background.  \n- Text overlay reads \"MORE HAMSTRINGS\" at the bottom right corner of the screen.\n[330-360s] - Man in grey shirt and shorts performs dumbbell lunges, moving forward while holding weights.  \n- Gym equipment lines both sides of the aisle, with a \"PURE MUSCLE\" sign visible in the background.  \n- Text overlay reads \"2. DON'T 'FREE FALL' ON THE NEGATIVE\" as he continues the exercise.", "history_tokens": 953, "history_utf8_bytes": 3976, "recent_frame_times_s": [332.01501666666667, 333.01601666666664, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065], "recent_frames_sha256": "7bcbe0967075454282548904b27de922d71b2331c51b32caa927fd6fc52f68a1", "num_recent_frames": 30, "tq": 717668.654994234, "t1": 717675.83029602, "ta": 717675.83029602, "te": 717676.032081146, "first_response_s": 7.175301786046475, "answer_total_s": 7.377086912048981, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 144, "content_group": "eeb9cb4a4b6d739a5a06cbaf797c21b5da3e26031deecb457c79bd4314069555", "question": {"question_id": "sample_144_a1441_q1", "video_id": 144, "video_path": "./videos/sample_144_real.mp4", "annotation_index": 1441, "question_index": 1, "question": "What action does the person take after squatting down and adjusting their grip on the dumbbells?", "options": ["A. He put the dumbbells down.", "B. He start doing push-ups.", "C. He switch to another exercise machine.", "D. He begin performing lunges again."], "answer": "D", "time_stamp_s": 377, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "gym_workout", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_144_a1441_q1", "video_id": 144, "time_stamp_s": 377, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c4be7b960f16303b93f14d48ed627306ce488223d79810e13922a4d029e3dd60", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665], "recent_frames_sha256": "ef09761feb326f0ec613df92bd76a099b3e77bd7ee09cbe7721a0154189c978b", "num_recent_frames": 30, "tq": 717534.670603577, "t1": 717546.625712503, "ta": 717546.625712503, "te": 717546.663272158, "first_response_s": 11.955108925933018, "answer_total_s": 11.992668580962345, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_144_a1441_q1", "video_id": 144, "time_stamp_s": 377, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f316d71ec13c309953bfec09b608a618749a179f0158321094f278ed0ac09807", "condition_order": ["recent", "notes"], "memory": "[30-60s] - A man in a black hoodie sits on a treadmill, holding a water bottle, with \"WARM-UP\" text overlay indicating 5-10 minutes.  \n- A woman performs squats with a barbell on a squat rack, wearing a gray shirt and blue shorts, with \"EXERCISE 1 OF 6\" text overlay.  \n- The gym environment features multiple treadmills and weight machines, with visible \"TREADMILL OR STAIRMASTER\" branding on equipment.\n[60-90s] - Man in grey shirt and blue shorts performs squat with barbell, knees bent, feet shoulder-width apart, using squat rack for support.  \n- Weight plates visible on barbell, including 45-lb plates, indicating warm-up set 1.  \n- Gym environment with multiple squat racks and weight equipment in background, dim lighting.\n[90-120s] - Two split-screen panels show different substitution exercises: left panel features a man on a leg press machine, right panel shows a man performing a paused squat.  \n- Text labels beneath each panel identify them as \"SUBSTITUTION OPTION #1\" and \"SUBSTITUTION OPTION #2,\" with additional text indicating \"BOOST REPS TO 4-6\" for both.  \n- The gym environment in both panels is visible, with equipment and lighting consistent with a fitness facility.\n[120-150s] - Man in grey shirt and blue shorts performs paused squat with barbell, using knee sleeves and weight belt, positioned in squat rack.\n- Barbell is loaded with weights, and the man adjusts stance and grip while maintaining upright posture.\n- Text overlay advises selecting weight around 75% of top set weight for the exercise.\n[150-180s] - A yellow vertical line appears on screen, indicating the \"HYPOTHETICAL\" position for the barbell's center relative to the athlete's hips.  \n- The athlete is in a squat position, with the barbell resting on their shoulders and knees bent.  \n- The athlete's posture remains consistent, with the barbell positioned over the hips as they maintain the squat stance.\n[180-210s] - Man in grey shirt and blue shorts performs Romanian deadlift with barbell, bending knees and hips while keeping back straight.  \n- Barbell is positioned on the ground, with weights on both sides, and the man is standing upright with feet shoulder-width apart.  \n- Yellow dashed line appears on the floor, indicating the man's hip position during the movement.\n[210-240s] - Man in grey shirt and blue shorts performs a deadlift, bending at the hips while keeping back straight.  \n- Yellow dashed line highlights the man's hip-to-ankle alignment during the lift.  \n- On-screen text labels \"ROL CONCERNS\" and states \"I only feel it in my lower back.\"\n[240-270s] - Man in grey shirt and blue shorts bends over to grip a barbell, preparing for a lift.  \n- He stands upright, holding the barbell, with a weight rack and other gym equipment visible in the background.  \n- A text overlay appears, displaying information about spinal erosion, partially obscuring the view.\n[270-300s] - Man in grey shirt and cap adjusts stance while preparing to lift barbell, with text overlay listing \"ROL CONCERNS\" and two specific issues.\n- Split-screen view shows left side with darker lighting and right side with brighter lighting, both displaying the same man performing a deadlift.\n- Text overlay at bottom of screen changes from \"MORE GLUTES\" to \"MORE HAMSTRINGS\" as the man lifts the barbell, indicating different focus areas for the exercise.\n[300-330s] - Man in grey shirt and blue shorts performs a deadlift with a barbell, bending at the hips and knees while maintaining a straight back.  \n- Gym environment features mirrors, weight racks, and various exercise machines in the background.  \n- Text overlay reads \"MORE HAMSTRINGS\" at the bottom right corner of the screen.\n[330-360s] - Man in grey shirt and shorts performs dumbbell lunges, moving forward while holding weights.  \n- Gym equipment lines both sides of the aisle, with a \"PURE MUSCLE\" sign visible in the background.  \n- Text overlay reads \"2. DON'T 'FREE FALL' ON THE NEGATIVE\" as he continues the exercise.", "history_tokens": 953, "history_utf8_bytes": 3976, "recent_frame_times_s": [347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665], "recent_frames_sha256": "ef09761feb326f0ec613df92bd76a099b3e77bd7ee09cbe7721a0154189c978b", "num_recent_frames": 30, "tq": 717676.066332706, "t1": 717682.764082348, "ta": 717682.764082348, "te": 717682.843039745, "first_response_s": 6.6977496419567615, "answer_total_s": 6.77670703898184, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 144, "content_group": "eeb9cb4a4b6d739a5a06cbaf797c21b5da3e26031deecb457c79bd4314069555", "question": {"question_id": "sample_144_a1442_q0", "video_id": 144, "video_path": "./videos/sample_144_real.mp4", "annotation_index": 1442, "question_index": 0, "question": "What is shown on the left side of the screen right now?", "options": ["A. An anatomical illustration of the lower leg muscles.", "B. A person exercising in a gym.", "C. A chart with data points.", "D. A blue and green arrow."], "answer": "A", "time_stamp_s": 545, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_144_a1442_q0", "video_id": 144, "time_stamp_s": 545, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f234cb35d5e2ca63912dad26e60bf3624ad461ef14bb4e7a119467797e708e42", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [515.0145, 516.0155, 517.0165, 518.0008166666667, 519.0018166666666, 520.0028166666667, 521.0038166666667, 522.0048166666667, 523.0058166666666, 524.0068166666666, 525.0078166666667, 526.0088166666667, 527.0098166666667, 528.0108166666666, 529.0118166666666, 530.0128166666667, 531.0138166666667, 532.0148166666667, 533.0158166666666, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333], "recent_frames_sha256": "26c2207686f2ef28290b3fff3440249de90a155f2dbbcdd13ec1b7a59cdb301b", "num_recent_frames": 30, "tq": 717546.673028055, "t1": 717557.923483822, "ta": 717557.923483822, "te": 717557.960909536, "first_response_s": 11.25045576703269, "answer_total_s": 11.287881480995566, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_144_a1442_q0", "video_id": 144, "time_stamp_s": 545, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f96e679d6bac8cafa0ee8c9b844b4960b88a32730271aaa118096a0887f034b6", "condition_order": ["recent", "notes"], "memory": "[180-210s] - Man in grey shirt and blue shorts performs Romanian deadlift with barbell, bending knees and hips while keeping back straight.  \n- Barbell is positioned on the ground, with weights on both sides, and the man is standing upright with feet shoulder-width apart.  \n- Yellow dashed line appears on the floor, indicating the man's hip position during the movement.\n[210-240s] - Man in grey shirt and blue shorts performs a deadlift, bending at the hips while keeping back straight.  \n- Yellow dashed line highlights the man's hip-to-ankle alignment during the lift.  \n- On-screen text labels \"ROL CONCERNS\" and states \"I only feel it in my lower back.\"\n[240-270s] - Man in grey shirt and blue shorts bends over to grip a barbell, preparing for a lift.  \n- He stands upright, holding the barbell, with a weight rack and other gym equipment visible in the background.  \n- A text overlay appears, displaying information about spinal erosion, partially obscuring the view.\n[270-300s] - Man in grey shirt and cap adjusts stance while preparing to lift barbell, with text overlay listing \"ROL CONCERNS\" and two specific issues.\n- Split-screen view shows left side with darker lighting and right side with brighter lighting, both displaying the same man performing a deadlift.\n- Text overlay at bottom of screen changes from \"MORE GLUTES\" to \"MORE HAMSTRINGS\" as the man lifts the barbell, indicating different focus areas for the exercise.\n[300-330s] - Man in grey shirt and blue shorts performs a deadlift with a barbell, bending at the hips and knees while maintaining a straight back.  \n- Gym environment features mirrors, weight racks, and various exercise machines in the background.  \n- Text overlay reads \"MORE HAMSTRINGS\" at the bottom right corner of the screen.\n[330-360s] - Man in grey shirt and shorts performs dumbbell lunges, moving forward while holding weights.  \n- Gym equipment lines both sides of the aisle, with a \"PURE MUSCLE\" sign visible in the background.  \n- Text overlay reads \"2. DON'T 'FREE FALL' ON THE NEGATIVE\" as he continues the exercise.\n[360-390s] - Man in grey shirt and cap performs dumbbell step-ups, lifting weights while moving forward.  \n- He transitions to a squatting position, holding dumbbells, then stands up, showing controlled movement.  \n- Text overlay reads: \"3. DON'T LET YOUR GRIP STRENGTH LIMIT THE LOAD YOU CAN USE.\"\n[390-420s] - Man performs seated leg curls on machine, legs extended and bent, with weight plate visible.  \n- Split-screen shows comparison: left side (more stretch) with man in seated position, right side (less stretch) with man lying on bench.  \n- Man adjusts machine settings or position after completing set, moving away from equipment.\n[420-450s] - Man in grey shirt and black cap performs leg curl on machine, feet secured on padded bar.  \n- Anatomical diagram highlights thigh and knee muscles with arrows indicating muscle groups.  \n- Close-up shows feet in black shoes on machine, positioned for leg curl exercise.\n[450-480s] - A man with a beard, wearing a brown hoodie, sits at a desk, gesturing with both hands while speaking.  \n- A silver laptop is positioned in front of him, with a microphone on a boom arm to his right.  \n- To his left, a white globe rests on a stack of books, including one titled \"Essentials of Medical Coding.\"\n[480-510s] - Man in grey t-shirt and black shorts sits on leg press machine, feet positioned on platform, preparing for exercise.  \n- Machine labeled \"BODY MASTERS\" with visible weight stack and footplate mechanism.  \n- On-screen text displays \"EXERCISE 5 OF 6\" and \"LEG PRESS TOE FOCUS: 4 SETS X 10-12 REPS\".\n[510-540s] - Man performs leg press toe off on a machine, seated with feet on pedals, wearing grey shirt and blue shorts.  \n- Close-up shows feet in black socks with \"B\" logo, pressing down on machine pedals.  \n- Man looks down, slightly smiling, while seated on the machine in a gym setting.", "history_tokens": 966, "history_utf8_bytes": 3922, "recent_frame_times_s": [515.0145, 516.0155, 517.0165, 518.0008166666667, 519.0018166666666, 520.0028166666667, 521.0038166666667, 522.0048166666667, 523.0058166666666, 524.0068166666666, 525.0078166666667, 526.0088166666667, 527.0098166666667, 528.0108166666666, 529.0118166666666, 530.0128166666667, 531.0138166666667, 532.0148166666667, 533.0158166666666, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333], "recent_frames_sha256": "26c2207686f2ef28290b3fff3440249de90a155f2dbbcdd13ec1b7a59cdb301b", "num_recent_frames": 30, "tq": 717725.327319943, "t1": 717731.83772679, "ta": 717731.83772679, "te": 717732.02770021, "first_response_s": 6.5104068469954655, "answer_total_s": 6.700380266993307, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 145, "content_group": "9071c30e664539d3cc29cd2c8efc352304d2336a531681f1e8e7ac891b87ceb7", "question": {"question_id": "sample_145_a1331_q0", "video_id": 145, "video_path": "./videos/sample_145_real.mp4", "annotation_index": 1331, "question_index": 0, "question": "What exercise is the individual performing in the gym after the box jumps?", "options": ["A. Squats.", "B. Deadlifts.", "C. Barbell clean and press.", "D. Push-ups."], "answer": "C", "time_stamp_s": 7, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_145_a1331_q0", "video_id": 145, "time_stamp_s": 7, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b0a86f5731619353e783d0f22bc4936768a4cbf0c63e6702bd8dbdf1b14fd7b5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006], "recent_frames_sha256": "6ebe3e589e712bd59a9e5169f647c6d2a7c2ce25f1e90a5cab43fb98ba0a8b11", "num_recent_frames": 7, "tq": 715878.737940716, "t1": 715883.862844665, "ta": 715883.862844665, "te": 715883.900500615, "first_response_s": 5.12490394897759, "answer_total_s": 5.162559899035841, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_145_a1331_q0", "video_id": 145, "time_stamp_s": 7, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "39ea65db21cec91da5417522f84eca0311ae5223dca4dcc3bc404175ae9fa826", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006], "recent_frames_sha256": "6ebe3e589e712bd59a9e5169f647c6d2a7c2ce25f1e90a5cab43fb98ba0a8b11", "num_recent_frames": 7, "tq": 715691.912947596, "t1": 715699.318214045, "ta": 715699.318214045, "te": 715699.356721955, "first_response_s": 7.405266448971815, "answer_total_s": 7.443774358951487, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 145, "content_group": "9071c30e664539d3cc29cd2c8efc352304d2336a531681f1e8e7ac891b87ceb7", "question": {"question_id": "sample_145_a1332_q0", "video_id": 145, "video_path": "./videos/sample_145_real.mp4", "annotation_index": 1332, "question_index": 0, "question": "What color are the sneakers worn by the person performing the lift right now?", "options": ["A. Black and yellow.", "B. White and black.", "C. Blue and white.", "D. Red and white."], "answer": "B", "time_stamp_s": 213, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_145_a1332_q0", "video_id": 145, "time_stamp_s": 213, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fa1c15519a3000b25cba2324a4963852f71ed003eaf7af2d792ca6139e2e11d2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118], "recent_frames_sha256": "48604f1e174168585d7fb4945759fd31f175cfe0d418f509d5269d5581a60da3", "num_recent_frames": 30, "tq": 715883.911599715, "t1": 715898.75055371, "ta": 715898.75055371, "te": 715898.787656978, "first_response_s": 14.838953995029442, "answer_total_s": 14.876057262998074, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_145_a1332_q0", "video_id": 145, "time_stamp_s": 213, "ground_truth": "B", "raw_output": "B. White and black.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "3d468b86d304a2307f0c491d9b5f1f90f86a05721dd379dad4e349d07e1365f2", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Man in blue shirt runs on outdoor track, then transitions to indoor gym for weightlifting.  \n- Man in grey shirt performs agility drills with orange cones on outdoor track under clear sky.  \n- Gym scene shows man lifting barbell while others train in background; American flag visible on wall.\n[30-60s] - Runner in dark shirt and shorts sprints along red track, passing orange cones.  \n- Another runner in light shirt and shorts runs parallel, slightly behind, also passing cones.  \n- Both runners move from left to right across the frame, with background showing trees, fence, and distant buildings.\n[60-90s] - Runner in dark top and shorts sprints past orange cones on red track, moving away from camera.  \n- Background shows green grass, trees, and a building with a fence; parked cars visible near left edge.  \n- Camera pans slightly right, revealing more of the track, trees, and distant light poles under clear sky.\n[90-120s] - Athlete in blue top and dark shorts sprints down red track, passing orange cones.  \n- Camera pans right, revealing grassy field, trees, and distant buildings under clear sky.  \n- Athlete slows and stops near track’s edge, then bends forward in starting position.\n[120-150s] - Man in blue tank top and black shorts performs overhead barbell press on a platform in a gym.  \n- Barbell is lifted from shoulder height to above head, then lowered back down.  \n- Gym equipment, including weight racks and an American flag, is visible in the background.\n[150-180s] - Man in blue tank top and black shorts lifts barbell overhead, then lowers it to shoulder height while standing on platform.  \n- Barbell is positioned horizontally across his upper body, with weights on each end, and he maintains a stable stance.  \n- Background shows gym equipment, including weight racks, an American flag, and another person working out in the distance.\n[180-210s] - Man in blue tank top and black shorts lifts barbell from floor to hip level, then lowers it back down.  \n- Barbell has black weight plates on each side, and the man grips it with both hands.  \n- Gym equipment, including a squat rack and weight plates, is visible in the background.", "history_tokens": 502, "history_utf8_bytes": 2171, "recent_frame_times_s": [183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118], "recent_frames_sha256": "48604f1e174168585d7fb4945759fd31f175cfe0d418f509d5269d5581a60da3", "num_recent_frames": 30, "tq": 715750.309292924, "t1": 715752.019430933, "ta": 715752.019430933, "te": 715752.255979725, "first_response_s": 1.7101380090462044, "answer_total_s": 1.9466868010349572, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 145, "content_group": "9071c30e664539d3cc29cd2c8efc352304d2336a531681f1e8e7ac891b87ceb7", "question": {"question_id": "sample_145_a1332_q1", "video_id": 145, "video_path": "./videos/sample_145_real.mp4", "annotation_index": 1332, "question_index": 1, "question": "Where is the American flag located in relation to the person performing the box jump?", "options": ["A. Directly behind him.", "B. To his left.", "C. To his right.", "D. In front of him."], "answer": "C", "time_stamp_s": 219, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_145_a1332_q1", "video_id": 145, "time_stamp_s": 219, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "24d02bb2c3e00860e920f5b36761fe868b6c041c9b67e9977edcac5278b0e15b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666, 218.00111666666666], "recent_frames_sha256": "d115ff8d40fc4f2250a1560ab558896c659e33a045cdae61a2b5a1c9907186f7", "num_recent_frames": 30, "tq": 715898.800099638, "t1": 715905.066947566, "ta": 715905.066947566, "te": 715905.104406866, "first_response_s": 6.266847927938215, "answer_total_s": 6.3043072279542685, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_145_a1332_q1", "video_id": 145, "time_stamp_s": 219, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "63c12fd2cfb018c056f0c2df56a48fe5f9298ee463165392ee5b742a1fbebbe5", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Man in blue shirt runs on outdoor track, then transitions to indoor gym for weightlifting.  \n- Man in grey shirt performs agility drills with orange cones on outdoor track under clear sky.  \n- Gym scene shows man lifting barbell while others train in background; American flag visible on wall.\n[30-60s] - Runner in dark shirt and shorts sprints along red track, passing orange cones.  \n- Another runner in light shirt and shorts runs parallel, slightly behind, also passing cones.  \n- Both runners move from left to right across the frame, with background showing trees, fence, and distant buildings.\n[60-90s] - Runner in dark top and shorts sprints past orange cones on red track, moving away from camera.  \n- Background shows green grass, trees, and a building with a fence; parked cars visible near left edge.  \n- Camera pans slightly right, revealing more of the track, trees, and distant light poles under clear sky.\n[90-120s] - Athlete in blue top and dark shorts sprints down red track, passing orange cones.  \n- Camera pans right, revealing grassy field, trees, and distant buildings under clear sky.  \n- Athlete slows and stops near track’s edge, then bends forward in starting position.\n[120-150s] - Man in blue tank top and black shorts performs overhead barbell press on a platform in a gym.  \n- Barbell is lifted from shoulder height to above head, then lowered back down.  \n- Gym equipment, including weight racks and an American flag, is visible in the background.\n[150-180s] - Man in blue tank top and black shorts lifts barbell overhead, then lowers it to shoulder height while standing on platform.  \n- Barbell is positioned horizontally across his upper body, with weights on each end, and he maintains a stable stance.  \n- Background shows gym equipment, including weight racks, an American flag, and another person working out in the distance.\n[180-210s] - Man in blue tank top and black shorts lifts barbell from floor to hip level, then lowers it back down.  \n- Barbell has black weight plates on each side, and the man grips it with both hands.  \n- Gym equipment, including a squat rack and weight plates, is visible in the background.", "history_tokens": 502, "history_utf8_bytes": 2171, "recent_frame_times_s": [189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666, 218.00111666666666], "recent_frames_sha256": "d115ff8d40fc4f2250a1560ab558896c659e33a045cdae61a2b5a1c9907186f7", "num_recent_frames": 30, "tq": 715752.301958128, "t1": 715765.932281693, "ta": 715765.932281693, "te": 715766.303399792, "first_response_s": 13.630323564982973, "answer_total_s": 14.00144166406244, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 145, "content_group": "9071c30e664539d3cc29cd2c8efc352304d2336a531681f1e8e7ac891b87ceb7", "question": {"question_id": "sample_145_a1333_q0", "video_id": 145, "video_path": "./videos/sample_145_real.mp4", "annotation_index": 1333, "question_index": 0, "question": "What is the man who is lifting wearing right now?", "options": ["A. Red sleeveless shirt, black shorts, and white athletic shoes.", "B. Blue sleeveless shirt, black shorts, and white athletic shoes.", "C. Green sleeveless shirt, black shorts, and white athletic shoes.", "D. Blue sleeveless shirt, red shorts, and white athletic shoes."], "answer": "B", "time_stamp_s": 420, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_145_a1333_q0", "video_id": 145, "time_stamp_s": 420, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "aa8c0556be136dd994ad0c5a1376edd61a69b6fbf5c3ca1bb0b8dccddb60dc88", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0009166666667, 419.00191666666666], "recent_frames_sha256": "03ea28d3cd1efa790550ca9c883035ce2f214a42287ee8f5c3561357026b03ce", "num_recent_frames": 30, "tq": 715905.115096652, "t1": 715912.482594413, "ta": 715912.482594413, "te": 715912.519277332, "first_response_s": 7.367497761035338, "answer_total_s": 7.404180680052377, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_145_a1333_q0", "video_id": 145, "time_stamp_s": 420, "ground_truth": "B", "raw_output": "B. Blue sleeveless shirt, black shorts, and white athletic shoes.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "39bcb4e84e57f125e7515f68651851ea031bd1ebd8bef9a3368779b29d07de7e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Man in blue shirt runs on outdoor track, then transitions to indoor gym for weightlifting.  \n- Man in grey shirt performs agility drills with orange cones on outdoor track under clear sky.  \n- Gym scene shows man lifting barbell while others train in background; American flag visible on wall.\n[30-60s] - Runner in dark shirt and shorts sprints along red track, passing orange cones.  \n- Another runner in light shirt and shorts runs parallel, slightly behind, also passing cones.  \n- Both runners move from left to right across the frame, with background showing trees, fence, and distant buildings.\n[60-90s] - Runner in dark top and shorts sprints past orange cones on red track, moving away from camera.  \n- Background shows green grass, trees, and a building with a fence; parked cars visible near left edge.  \n- Camera pans slightly right, revealing more of the track, trees, and distant light poles under clear sky.\n[90-120s] - Athlete in blue top and dark shorts sprints down red track, passing orange cones.  \n- Camera pans right, revealing grassy field, trees, and distant buildings under clear sky.  \n- Athlete slows and stops near track’s edge, then bends forward in starting position.\n[120-150s] - Man in blue tank top and black shorts performs overhead barbell press on a platform in a gym.  \n- Barbell is lifted from shoulder height to above head, then lowered back down.  \n- Gym equipment, including weight racks and an American flag, is visible in the background.\n[150-180s] - Man in blue tank top and black shorts lifts barbell overhead, then lowers it to shoulder height while standing on platform.  \n- Barbell is positioned horizontally across his upper body, with weights on each end, and he maintains a stable stance.  \n- Background shows gym equipment, including weight racks, an American flag, and another person working out in the distance.\n[180-210s] - Man in blue tank top and black shorts lifts barbell from floor to hip level, then lowers it back down.  \n- Barbell has black weight plates on each side, and the man grips it with both hands.  \n- Gym equipment, including a squat rack and weight plates, is visible in the background.\n[210-240s] - Man in blue tank top lifts barbell, then walks away from rack.  \n- He transitions to jumping on red padded boxes, moving from lower to higher levels.  \n- American flag hangs on wall behind him during box jumps.\n[240-270s] - Man in blue tank top and black shorts lifts barbell, then drops it to floor.  \n- He transitions to jumping on red padded boxes, moving from lower to higher levels.  \n- American flag hangs on wall behind him as he performs box jumps.\n[270-300s] - Man in blue tank top lifts barbell overhead, then lowers it to rack.\n- Another man in yellow shirt stands nearby, observing.\n- Barbell is loaded with multiple black weight plates on each side.\n[300-330s] - Man in blue shirt and shorts performs squats with barbell on squat rack, feet slightly wider than shoulder-width.\n- Barbell is loaded with multiple weight plates, and the man maintains a neutral spine throughout the movement.\n- Background shows gym equipment, including racks of weights and a visible American flag on the wall.\n[330-360s] - Man in blue tank top and shorts stands in gym, holding barbell with weights, preparing for lift.  \n- Barbell is positioned at shoulder height, with weights on each side, and man appears to be in a deadlift stance.  \n- Gym equipment visible in background, including racks, weights, and a water bottle on floor nearby.\n[360-390s] - Man in blue tank top and shorts lifts barbell from rack, then lowers it to floor.  \n- He stands upright, holding barbell, then removes it from rack.  \n- Barbell is positioned on floor, man steps back, then turns to face camera.\n[390-420s] - Man in blue tank top lifts barbell overhead, then lowers it to shoulder height.  \n- He stands on a gym floor with weight rack and other equipment visible in background.  \n- Another person in blue shirt is partially visible to left, standing near equipment.", "history_tokens": 955, "history_utf8_bytes": 4029, "recent_frame_times_s": [390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0009166666667, 419.00191666666666], "recent_frames_sha256": "03ea28d3cd1efa790550ca9c883035ce2f214a42287ee8f5c3561357026b03ce", "num_recent_frames": 30, "tq": 715822.313232669, "t1": 715830.668152942, "ta": 715830.668152942, "te": 715831.233189022, "first_response_s": 8.35492027294822, "answer_total_s": 8.919956353027374, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 145, "content_group": "9071c30e664539d3cc29cd2c8efc352304d2336a531681f1e8e7ac891b87ceb7", "question": {"question_id": "sample_145_a1334_q0", "video_id": 145, "video_path": "./videos/sample_145_real.mp4", "annotation_index": 1334, "question_index": 0, "question": "What action is the individual performing right now?", "options": ["A. Running on the treadmill.", "B. Lifting weights.", "C. Performing box jumps.", "D. Stretching."], "answer": "C", "time_stamp_s": 627, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [600, 660], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_145_a1334_q0", "video_id": 145, "time_stamp_s": 627, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e6d7bced8ae72d6c228b852300fc67abab6089a691c0ffd1cb29bba7b7ec14f1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074, 609.0084, 610.0094, 611.0104, 612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0007166666667, 619.0017166666667, 620.0027166666666, 621.0037166666667, 622.0047166666667, 623.0057166666667, 624.0067166666666, 625.0077166666666, 626.0087166666667], "recent_frames_sha256": "29136bbdab0b47873527afe5c62246197d15cc5baed5bcebb201620ce9e0734f", "num_recent_frames": 30, "tq": 715912.528273676, "t1": 715923.331123032, "ta": 715923.331123032, "te": 715923.368685668, "first_response_s": 10.802849355968647, "answer_total_s": 10.840411991928704, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_145_a1334_q0", "video_id": 145, "time_stamp_s": 627, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0832a3edc177bd0e6c3040e640119fcce4b19107b2575c99e6ae8a35d810a6b5", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Man in blue tank top and black shorts lifts barbell overhead, then lowers it to shoulder height while standing on platform.  \n- Barbell is positioned horizontally across his upper body, with weights on each end, and he maintains a stable stance.  \n- Background shows gym equipment, including weight racks, an American flag, and another person working out in the distance.\n[180-210s] - Man in blue tank top and black shorts lifts barbell from floor to hip level, then lowers it back down.  \n- Barbell has black weight plates on each side, and the man grips it with both hands.  \n- Gym equipment, including a squat rack and weight plates, is visible in the background.\n[210-240s] - Man in blue tank top lifts barbell, then walks away from rack.  \n- He transitions to jumping on red padded boxes, moving from lower to higher levels.  \n- American flag hangs on wall behind him during box jumps.\n[240-270s] - Man in blue tank top and black shorts lifts barbell, then drops it to floor.  \n- He transitions to jumping on red padded boxes, moving from lower to higher levels.  \n- American flag hangs on wall behind him as he performs box jumps.\n[270-300s] - Man in blue tank top lifts barbell overhead, then lowers it to rack.\n- Another man in yellow shirt stands nearby, observing.\n- Barbell is loaded with multiple black weight plates on each side.\n[300-330s] - Man in blue shirt and shorts performs squats with barbell on squat rack, feet slightly wider than shoulder-width.\n- Barbell is loaded with multiple weight plates, and the man maintains a neutral spine throughout the movement.\n- Background shows gym equipment, including racks of weights and a visible American flag on the wall.\n[330-360s] - Man in blue tank top and shorts stands in gym, holding barbell with weights, preparing for lift.  \n- Barbell is positioned at shoulder height, with weights on each side, and man appears to be in a deadlift stance.  \n- Gym equipment visible in background, including racks, weights, and a water bottle on floor nearby.\n[360-390s] - Man in blue tank top and shorts lifts barbell from rack, then lowers it to floor.  \n- He stands upright, holding barbell, then removes it from rack.  \n- Barbell is positioned on floor, man steps back, then turns to face camera.\n[390-420s] - Man in blue tank top lifts barbell overhead, then lowers it to shoulder height.  \n- He stands on a gym floor with weight rack and other equipment visible in background.  \n- Another person in blue shirt is partially visible to left, standing near equipment.\n[420-450s] - Man in blue shirt performs squat with barbell, maintaining upright posture.  \n- Squat rack with \"SAFETY\" branding visible, equipped with weight plates.  \n- Another person in light blue shirt stands nearby, holding a water bottle.\n[450-480s] - Man in blue tank top and shorts performs a clean and jerk, lifting a barbell from rack to overhead position.  \n- Another person in a light blue hoodie stands nearby, observing or preparing to assist.  \n- Gym equipment, including weight plates and racks, is visible in the background.\n[480-510s] - Man in blue shirt and black shorts performs overhead press with barbell, lifting it above head while standing in gym.  \n- Barbell is positioned on a squat rack, with weight plates stacked on the floor nearby.  \n- Another person in blue shirt walks past in background, moving away from the main subject.\n[510-540s] - Man in blue tank top and black shorts lifts barbell overhead, maintaining upright posture.  \n- Barbell is positioned above his head, with weights visibly attached to both ends.  \n- Gym equipment, including squat racks and weight plates, is visible in the background.\n[540-570s] - Man in blue shirt performs overhead press with barbell, standing in gym.  \n- Another person in blue hoodie is visible in background, bending over near weights.  \n- Barbell is held above head, with weights on both sides, and man is in mid-motion.\n[570-600s] - Man in blue shirt and black shorts performs a clean and jerk with barbell, then drops it to the floor.  \n- He transitions to a red padded box area, jumping onto the stack of boxes and landing on the top.  \n- American flag hangs on the wall behind the boxes, with artificial turf and gym equipment visible in the background.", "history_tokens": 1022, "history_utf8_bytes": 4269, "recent_frame_times_s": [597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074, 609.0084, 610.0094, 611.0104, 612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0007166666667, 619.0017166666667, 620.0027166666666, 621.0037166666667, 622.0047166666667, 623.0057166666667, 624.0067166666666, 625.0077166666666, 626.0087166666667], "recent_frames_sha256": "29136bbdab0b47873527afe5c62246197d15cc5baed5bcebb201620ce9e0734f", "num_recent_frames": 30, "tq": 715877.542972797, "t1": 715878.489516358, "ta": 715878.489516358, "te": 715878.718991296, "first_response_s": 0.9465435610618442, "answer_total_s": 1.1760184990707785, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 146, "content_group": "56fea25ecd6141eb7ed69bb4c0accf84cc881d0deb5eeef56c64ed40b9eaeb33", "question": {"question_id": "sample_146_a1811_q0", "video_id": 146, "video_path": "./videos/sample_146_real.mp4", "annotation_index": 1811, "question_index": 0, "question": "What text is displayed on the screen at the beginning?", "options": ["A. \"HOW I TRAIN\".", "B. \"CHEST WORKOUT\".", "C. \"MUSCLE FLEX\".", "D. \"GYM EQUIPMENT\"."], "answer": "A", "time_stamp_s": 6, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_146_a1811_q0", "video_id": 146, "time_stamp_s": 6, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1bb93cfb4e73ed069b473c5220f3a437bead201a74ea62fe5ccbc4298ae892bb", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005], "recent_frames_sha256": "5c0acbac482a97c4207db6610c8de263411200fd97b33bf44e4e338c915634c7", "num_recent_frames": 6, "tq": 710163.547145198, "t1": 710169.217550288, "ta": 710169.217550288, "te": 710169.254643513, "first_response_s": 5.670405089971609, "answer_total_s": 5.707498315023258, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_146_a1811_q0", "video_id": 146, "time_stamp_s": 6, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "66490db1979bf4d928bfbc712f261d9adc217cfcb84d88da323735d3d834c1f2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005], "recent_frames_sha256": "5c0acbac482a97c4207db6610c8de263411200fd97b33bf44e4e338c915634c7", "num_recent_frames": 6, "tq": 710018.720779043, "t1": 710019.571515042, "ta": 710019.571515042, "te": 710019.612949543, "first_response_s": 0.8507359989453107, "answer_total_s": 0.892170500010252, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 146, "content_group": "56fea25ecd6141eb7ed69bb4c0accf84cc881d0deb5eeef56c64ed40b9eaeb33", "question": {"question_id": "sample_146_a1811_q1", "video_id": 146, "video_path": "./videos/sample_146_real.mp4", "annotation_index": 1811, "question_index": 1, "question": "What is the person doing right now?", "options": ["A. Walking on a treadmill.", "B. Performing bench presses.", "C. Lifting weights overhead.", "D. Doing tricep presses."], "answer": "A", "time_stamp_s": 16, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_146_a1811_q1", "video_id": 146, "time_stamp_s": 16, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0017e977299696ddc8d241c2689e6e53c6617e9a67e69f0ac7f954498208bcc5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "4b3a1aa443e271cff34f4da41ccbc5c1437f0795cb101ac513f9c10ea72a394f", "num_recent_frames": 16, "tq": 710169.270673202, "t1": 710181.078727126, "ta": 710181.078727126, "te": 710181.115863814, "first_response_s": 11.808053924003616, "answer_total_s": 11.845190612017177, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_146_a1811_q1", "video_id": 146, "time_stamp_s": 16, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "91f21a985dd95042a254e09e1bd69dd80f7fe8f4303f78191d503f49f746c717", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "4b3a1aa443e271cff34f4da41ccbc5c1437f0795cb101ac513f9c10ea72a394f", "num_recent_frames": 16, "tq": 710019.631501156, "t1": 710021.083579846, "ta": 710021.083579846, "te": 710021.122261278, "first_response_s": 1.4520786899374798, "answer_total_s": 1.490760121960193, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 146, "content_group": "56fea25ecd6141eb7ed69bb4c0accf84cc881d0deb5eeef56c64ed40b9eaeb33", "question": {"question_id": "sample_146_a1812_q0", "video_id": 146, "video_path": "./videos/sample_146_real.mp4", "annotation_index": 1812, "question_index": 0, "question": "What is the man holding above his chest right now?", "options": ["A. Dumbbells.", "B. A kettlebell.", "C. A barbell.", "D. A medicine ball."], "answer": "C", "time_stamp_s": 180, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_146_a1812_q0", "video_id": 146, "time_stamp_s": 180, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2009d0e757976cbe6ae475b85e228ff3835aab111cdeae187c805acf06e6a8b6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667], "recent_frames_sha256": "8dd5c236fcf170d01a2f5e6bde974481fbd1e28f89875cee7aa36e070863a9bb", "num_recent_frames": 30, "tq": 710181.129165161, "t1": 710194.019113721, "ta": 710194.019113721, "te": 710194.056734203, "first_response_s": 12.88994855992496, "answer_total_s": 12.927569041959941, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_146_a1812_q0", "video_id": 146, "time_stamp_s": 180, "ground_truth": "C", "raw_output": "C. A barbell.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "3f351b0701a415640f8d078d0b8f7c86c9c26d1b7313d7e1cd96b7c72491e21f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Man in gym, shirtless, standing near window, text overlay: \"HOW I TRAIN CHEST SHOULDERS & TRICEPS\".  \n- Man on treadmill, wearing cap and brown shirt, text overlay: \"WARM-UP 5 MINUTES TREADMILL OR STAIRMASTER\".  \n- Three panels show incline barbell press with varying reps (8, 5, 15) per set, labeled \"SET 1\", \"SET 2\", \"SET 3\".\n[30-60s] - Man performs incline barbell press on bench, adjusting weight for each set (8, 5, 15 reps).  \n- Gym environment shows multiple machines and other individuals working in background.  \n- On-screen text displays exercise details and warm-up pyramid structure.\n[60-90s] - Man performs bench press with 205 lbs, then stands up and walks away from the bench.  \n- Another man in gray shirt and black shorts is seen standing near the bench, observing the first man.  \n- The gym environment includes multiple weight machines and other individuals working out in the background.\n[90-120s] - A table compares flat vs. incline bench press effects on upper, mid, and lower body muscle growth, with \"More growth\" highlighted for incline in upper section.  \n- A man performs a bench press on a flat bench in a gym, wearing a gray shirt and white shorts.  \n- A second person in gray pants stands nearby, observing the exercise.\n[120-150s] - Man performs bench press on incline bench, lifting barbell with both hands, body angled upward.\n- Barbell moves vertically between his hands as he lowers and raises it, with arrows indicating motion direction.\n- Gym equipment and another person visible in background, but not interacting with the main subject.\n[150-180s] - Man performs bench press with barbell, arms extended upward at start, then lowering barbell toward chest.  \n- Barbell is positioned above chest, with weights on both sides, and man's body is lying flat on bench.  \n- Man's arms are fully extended at the top of the movement, with barbell above chest, and then begins to lower it.", "history_tokens": 482, "history_utf8_bytes": 1926, "recent_frame_times_s": [150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667], "recent_frames_sha256": "8dd5c236fcf170d01a2f5e6bde974481fbd1e28f89875cee7aa36e070863a9bb", "num_recent_frames": 30, "tq": 710062.953183055, "t1": 710064.477424292, "ta": 710064.477424292, "te": 710064.703391504, "first_response_s": 1.5242412369698286, "answer_total_s": 1.7502084489678964, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 146, "content_group": "56fea25ecd6141eb7ed69bb4c0accf84cc881d0deb5eeef56c64ed40b9eaeb33", "question": {"question_id": "sample_146_a1813_q0", "video_id": 146, "video_path": "./videos/sample_146_real.mp4", "annotation_index": 1813, "question_index": 0, "question": "What is the person doing after the barbell exercise?", "options": ["A. Running on a treadmill.", "B. Performing cable fly.", "C. Stretching.", "D. Using a rowing machine."], "answer": "B", "time_stamp_s": 339, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "gym_workout", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_146_a1813_q0", "video_id": 146, "time_stamp_s": 339, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4fffea4cb7a219164302e98f9e318d0cfa2a4ced053b54181e4029090736ea2a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0000166666667, 318.00101666666666, 319.0020166666667, 320.00301666666667, 321.00401666666664, 322.0050166666667, 323.00601666666665, 324.0070166666667, 325.00801666666666, 326.00901666666664, 327.0100166666667, 328.01101666666665, 329.0120166666667, 330.01301666666666, 331.0140166666667, 332.01501666666667, 333.01601666666664, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333], "recent_frames_sha256": "2d768e0b67d7cf5d0fb80a31aaf2cd8dd36603a7ffa918a42e930fcecd123615", "num_recent_frames": 30, "tq": 710194.071620459, "t1": 710201.343784034, "ta": 710201.343784034, "te": 710201.379930188, "first_response_s": 7.27216357504949, "answer_total_s": 7.308309728978202, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_146_a1813_q0", "video_id": 146, "time_stamp_s": 339, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bc11293ddccb9f2aca0fb16e936c080fc5be5df5fe537805f1586490dd7b1be7", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Man in gym, shirtless, standing near window, text overlay: \"HOW I TRAIN CHEST SHOULDERS & TRICEPS\".  \n- Man on treadmill, wearing cap and brown shirt, text overlay: \"WARM-UP 5 MINUTES TREADMILL OR STAIRMASTER\".  \n- Three panels show incline barbell press with varying reps (8, 5, 15) per set, labeled \"SET 1\", \"SET 2\", \"SET 3\".\n[30-60s] - Man performs incline barbell press on bench, adjusting weight for each set (8, 5, 15 reps).  \n- Gym environment shows multiple machines and other individuals working in background.  \n- On-screen text displays exercise details and warm-up pyramid structure.\n[60-90s] - Man performs bench press with 205 lbs, then stands up and walks away from the bench.  \n- Another man in gray shirt and black shorts is seen standing near the bench, observing the first man.  \n- The gym environment includes multiple weight machines and other individuals working out in the background.\n[90-120s] - A table compares flat vs. incline bench press effects on upper, mid, and lower body muscle growth, with \"More growth\" highlighted for incline in upper section.  \n- A man performs a bench press on a flat bench in a gym, wearing a gray shirt and white shorts.  \n- A second person in gray pants stands nearby, observing the exercise.\n[120-150s] - Man performs bench press on incline bench, lifting barbell with both hands, body angled upward.\n- Barbell moves vertically between his hands as he lowers and raises it, with arrows indicating motion direction.\n- Gym equipment and another person visible in background, but not interacting with the main subject.\n[150-180s] - Man performs bench press with barbell, arms extended upward at start, then lowering barbell toward chest.  \n- Barbell is positioned above chest, with weights on both sides, and man's body is lying flat on bench.  \n- Man's arms are fully extended at the top of the movement, with barbell above chest, and then begins to lower it.\n[180-210s] - Man performs machine shoulder press, lifting barbell upward with arms extended.  \n- He is seated on a weight machine, wearing gray shirt and black shorts.  \n- Barbell moves vertically from chest to overhead position during repetition.\n[210-240s] - Man performs seated cable flyes, pulling handles toward chest while seated on machine.  \n- He transitions to standing position, gripping handles above head, then lowers them.  \n- Close-up shows hand gripping curved handle, with focus on grip and motion.\n[240-270s] - Man performs bench press on incline machine, gripping barbell with both hands, body angled upward.  \n- He is seated on a black incline bench with weight stack visible behind him, surrounded by gym equipment.  \n- His posture remains steady, arms extended overhead, then lowering the barbell toward his chest.\n[270-300s] - Man in grey shirt and black shorts lies on gym floor, lifting a black weight plate toward chest.  \n- Weight plate moves from floor to chest, then back down, indicating a controlled lifting motion.  \n- Gym equipment visible in background, including racks and machines, suggesting a typical gym setting.\n[300-330s] - Man lies on gym floor, performing abdominal crunches with a dumbbell held above his head.  \n- Dumbbell remains stationary on floor as man lifts torso, then lowers back down.  \n- Gym equipment visible in background, including weight machines and racks.", "history_tokens": 806, "history_utf8_bytes": 3342, "recent_frame_times_s": [309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0000166666667, 318.00101666666666, 319.0020166666667, 320.00301666666667, 321.00401666666664, 322.0050166666667, 323.00601666666665, 324.0070166666667, 325.00801666666666, 326.00901666666664, 327.0100166666667, 328.01101666666665, 329.0120166666667, 330.01301666666666, 331.0140166666667, 332.01501666666667, 333.01601666666664, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333], "recent_frames_sha256": "2d768e0b67d7cf5d0fb80a31aaf2cd8dd36603a7ffa918a42e930fcecd123615", "num_recent_frames": 30, "tq": 710115.033421678, "t1": 710117.079628138, "ta": 710117.079628138, "te": 710117.123380268, "first_response_s": 2.0462064599851146, "answer_total_s": 2.089958589989692, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 146, "content_group": "56fea25ecd6141eb7ed69bb4c0accf84cc881d0deb5eeef56c64ed40b9eaeb33", "question": {"question_id": "sample_146_a1814_q0", "video_id": 146, "video_path": "./videos/sample_146_real.mp4", "annotation_index": 1814, "question_index": 0, "question": "What muscle groups are highlighted in red on the left side of the screen during the front raise exercise?", "options": ["A. Front deltoids.", "B. Rear deltoids.", "C. Side deltoids.", "D. Biceps."], "answer": "A", "time_stamp_s": 486, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_146_a1814_q0", "video_id": 146, "time_stamp_s": 486, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8301b4f0e51a3dfbaebd1ea5e6f00a32b8a9ec637eaf98490d264486fc827d2a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [456.00555, 457.00655, 458.00755, 459.00855, 460.00955, 461.01055, 462.01155, 463.01255, 464.01355, 465.01455, 466.01555, 467.01655, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336], "recent_frames_sha256": "4a787265ca5f0930ec68c26bd6c70ac27be68baf2ec92d94ad6d7bb38e438019", "num_recent_frames": 30, "tq": 710201.400167716, "t1": 710207.467369414, "ta": 710207.467369414, "te": 710207.505265254, "first_response_s": 6.067201698082499, "answer_total_s": 6.10509753797669, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_146_a1814_q0", "video_id": 146, "time_stamp_s": 486, "ground_truth": "A", "raw_output": "A. Front deltoids.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "2d34623b4297a25de34dd667750a4f5b4d9d525e68ec957aa578c0d8bed3e217", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A table compares flat vs. incline bench press effects on upper, mid, and lower body muscle growth, with \"More growth\" highlighted for incline in upper section.  \n- A man performs a bench press on a flat bench in a gym, wearing a gray shirt and white shorts.  \n- A second person in gray pants stands nearby, observing the exercise.\n[120-150s] - Man performs bench press on incline bench, lifting barbell with both hands, body angled upward.\n- Barbell moves vertically between his hands as he lowers and raises it, with arrows indicating motion direction.\n- Gym equipment and another person visible in background, but not interacting with the main subject.\n[150-180s] - Man performs bench press with barbell, arms extended upward at start, then lowering barbell toward chest.  \n- Barbell is positioned above chest, with weights on both sides, and man's body is lying flat on bench.  \n- Man's arms are fully extended at the top of the movement, with barbell above chest, and then begins to lower it.\n[180-210s] - Man performs machine shoulder press, lifting barbell upward with arms extended.  \n- He is seated on a weight machine, wearing gray shirt and black shorts.  \n- Barbell moves vertically from chest to overhead position during repetition.\n[210-240s] - Man performs seated cable flyes, pulling handles toward chest while seated on machine.  \n- He transitions to standing position, gripping handles above head, then lowers them.  \n- Close-up shows hand gripping curved handle, with focus on grip and motion.\n[240-270s] - Man performs bench press on incline machine, gripping barbell with both hands, body angled upward.  \n- He is seated on a black incline bench with weight stack visible behind him, surrounded by gym equipment.  \n- His posture remains steady, arms extended overhead, then lowering the barbell toward his chest.\n[270-300s] - Man in grey shirt and black shorts lies on gym floor, lifting a black weight plate toward chest.  \n- Weight plate moves from floor to chest, then back down, indicating a controlled lifting motion.  \n- Gym equipment visible in background, including racks and machines, suggesting a typical gym setting.\n[300-330s] - Man lies on gym floor, performing abdominal crunches with a dumbbell held above his head.  \n- Dumbbell remains stationary on floor as man lifts torso, then lowers back down.  \n- Gym equipment visible in background, including weight machines and racks.\n[330-360s] - Man lies on floor, gripping dumbbell with both hands, performing a lying dumbbell fly.  \n- Dumbbell is positioned horizontally across his body, arms extended outward.  \n- Gym equipment visible in background, including weight machines and racks.\n[360-390s] - Left panel: Man performs bent-over fly with mid-pelvic emphasis, maintaining slight knee bend and torso angle.  \n- Right panel: Man performs decline fly with lower-pelvic emphasis, leaning forward with torso angle and extended arms.  \n- Both panels: Man wears gray shirt, white shorts, and black shoes; gym equipment visible in background.\n[390-420s] - Man performs machine lateral raise with barbell, arms extended horizontally, then pulls back to shoulder height.  \n- Text overlay indicates \"Exercise 5 of 7\" and \"Machine Lateral Raise: 3 Sets x 20 Reps\".  \n- Split-screen comparison shows \"Reps 1-5: Slow Negative\" (left) and \"Reps 6-20: Constant Tension\" (right) with corresponding movement styles.\n[420-450s] - Man performs slow negative movement with cable machine, arms extended outward.  \n- Man performs constant tension movement with cable machine, arms pulled inward.  \n- Text overlay indicates \"REPS 1-5: SLOW NEGATIVE\" and \"REPS 6-20: CONSTANT TENSION\" with instructional text below.\n[450-480s] - Man in gym wearing tank top and shorts lifts dumbbells, rotating arms outward during front raise.  \n- Man in gym wearing tank top and shorts lifts barbell, rotating arms inward during front raise.  \n- Split-screen graphic shows anatomical diagrams with labels indicating \"Front Raise (More Externally Rotated)\" and \"Front Raise (More Internally Rotated).\"", "history_tokens": 970, "history_utf8_bytes": 4060, "recent_frame_times_s": [456.00555, 457.00655, 458.00755, 459.00855, 460.00955, 461.01055, 462.01155, 463.01255, 464.01355, 465.01455, 466.01555, 467.01655, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336], "recent_frames_sha256": "4a787265ca5f0930ec68c26bd6c70ac27be68baf2ec92d94ad6d7bb38e438019", "num_recent_frames": 30, "tq": 710155.81771094, "t1": 710163.04838702, "ta": 710163.04838702, "te": 710163.498883204, "first_response_s": 7.230676079983823, "answer_total_s": 7.681172263924964, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 147, "content_group": "425203b30b1ed0dfcff0e6ac099ba72f5ac840ab360b508068699308148e785c", "question": {"question_id": "sample_147_a2169_q1", "video_id": 147, "video_path": "./videos/sample_147_real.mp4", "annotation_index": 2169, "question_index": 1, "question": "What text appears on the screen when the man is shown exercising on the treadmill?", "options": ["A. \"WARM-UP\".", "B. \"HOW TO TRAIN\".", "C. \"BACK & BICEPS\".", "D. \"WORKOUT PLAN\"."], "answer": "A", "time_stamp_s": 13, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_147_a2169_q1", "video_id": 147, "time_stamp_s": 13, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4467a9b0fc99e53eb00e5072acf5a448c23764455137983a5eef7e391613059a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012], "recent_frames_sha256": "355a221bde1d9796d66d8af9e32db24e7c09618eea7c9de7996d047df5f31d60", "num_recent_frames": 13, "tq": 717965.633249637, "t1": 717970.898976493, "ta": 717970.898976493, "te": 717970.936709567, "first_response_s": 5.265726856072433, "answer_total_s": 5.303459930000827, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_147_a2169_q1", "video_id": 147, "time_stamp_s": 13, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a6fe24bda2d5cf63990388191668552bd299e290ec25538a9da954c4b7f30882", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012], "recent_frames_sha256": "355a221bde1d9796d66d8af9e32db24e7c09618eea7c9de7996d047df5f31d60", "num_recent_frames": 13, "tq": 717812.596236863, "t1": 717825.630089623, "ta": 717825.630089623, "te": 717826.067311884, "first_response_s": 13.033852759981528, "answer_total_s": 13.471075020963326, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 147, "content_group": "425203b30b1ed0dfcff0e6ac099ba72f5ac840ab360b508068699308148e785c", "question": {"question_id": "sample_147_a2169_q0", "video_id": 147, "video_path": "./videos/sample_147_real.mp4", "annotation_index": 2169, "question_index": 0, "question": "What color are the shorts the man is wearing while stretching his arms and warming up?", "options": ["A. Red.", "B. Black.", "C. Gray.", "D. Blue."], "answer": "D", "time_stamp_s": 19, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_147_a2169_q0", "video_id": 147, "time_stamp_s": 19, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2ab6f796afbf26f95380a3599f1593a2865896b78236a97df4b8a9c705a97dcc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668], "recent_frames_sha256": "39278134b028490af50dcf589884694aa776a425bda7f47b2d0ff0430159d0a8", "num_recent_frames": 19, "tq": 717970.947777455, "t1": 717985.958609061, "ta": 717985.958609061, "te": 717985.998852532, "first_response_s": 15.01083160599228, "answer_total_s": 15.051075077033602, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_147_a2169_q0", "video_id": 147, "time_stamp_s": 19, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ad78c1679d2553193eec05f09ba8355d13fcf2d6f21c2040c59c2670b7e7cf84", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668], "recent_frames_sha256": "39278134b028490af50dcf589884694aa776a425bda7f47b2d0ff0430159d0a8", "num_recent_frames": 19, "tq": 717826.086580615, "t1": 717862.585664809, "ta": 717862.585664809, "te": 717862.847489839, "first_response_s": 36.49908419395797, "answer_total_s": 36.76090922392905, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 147, "content_group": "425203b30b1ed0dfcff0e6ac099ba72f5ac840ab360b508068699308148e785c", "question": {"question_id": "sample_147_a2170_q0", "video_id": 147, "video_path": "./videos/sample_147_real.mp4", "annotation_index": 2170, "question_index": 0, "question": "What is the man using for his exercise?", "options": ["A. A treadmill.", "B. A dumbbell.", "C. A pull-up bar.", "D. A bench press."], "answer": "C", "time_stamp_s": 140, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_147_a2170_q0", "video_id": 147, "time_stamp_s": 140, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7bff45433297a9a0ae928ddcddab75a828e1076b961c830dfa4b3c9efb004c5e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335], "recent_frames_sha256": "abad8129a7b69177a13ce8b625eee448c219e416f6044b70ce4a9f14c0bb5ff0", "num_recent_frames": 30, "tq": 717986.011911849, "t1": 717997.896461531, "ta": 717997.896461531, "te": 717997.934120561, "first_response_s": 11.884549682028592, "answer_total_s": 11.922208711970598, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_147_a2170_q0", "video_id": 147, "time_stamp_s": 140, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3bba826a090f293be8dd16d9d9d8b13cc52820af3755ed9d9efa0fc43287be6c", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A muscular man in black shorts and a black shirt flexes his back muscles while standing in a gym, with a text overlay reading \"HOW TO TRAIN BACK & BICEPS\".  \n- A man in a black shirt and blue shorts performs a 1-arm half-kneeling lat pulldown on a cable machine, with a text overlay indicating \"EXERCISE 1 OF 6\" and \"3 SETS X 12-15 REPS\".  \n- A man in a black shirt and cap uses a stairmaster for a 5-minute warm-up, with a text overlay reading \"WARM-UP\n[30-60s] - Man in black shirt and blue shorts performs cable row while kneeling, pulling cable toward torso.  \n- Split-screen comparison shows incorrect (cable too high, pulling too far) vs. correct form (cable at proper height, controlled pull).  \n- Visual cues highlight alignment and posture differences between improper and proper technique.\n[60-90s] - Man in black shirt performs pull-down (front) exercise, kneeling with cable machine, pulling handle toward chest.  \n- Text overlay labels the movement as \"shoulder extension\" and shows side-by-side comparison with \"pull-in (side)\" exercise.  \n- Gym environment visible with various equipment in background, consistent lighting.\n[90-120s] - Man performs pull-up on a bar, wearing black shirt and blue shorts, with a weight rack behind him.  \n- He is in a gym with various equipment visible, including a squat rack and cable machines.  \n- Text overlay indicates \"EXERCISE 2 OF 6\" and \"PULL-UP: 1 SET X 4 REP\" at the bottom of the screen.", "history_tokens": 371, "history_utf8_bytes": 1456, "recent_frame_times_s": [110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335], "recent_frames_sha256": "abad8129a7b69177a13ce8b625eee448c219e416f6044b70ce4a9f14c0bb5ff0", "num_recent_frames": 30, "tq": 717889.141579228, "t1": 717892.003292199, "ta": 717892.003292199, "te": 717892.20161401, "first_response_s": 2.861712971003726, "answer_total_s": 3.060034782043658, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 147, "content_group": "425203b30b1ed0dfcff0e6ac099ba72f5ac840ab360b508068699308148e785c", "question": {"question_id": "sample_147_a2171_q0", "video_id": 147, "video_path": "./videos/sample_147_real.mp4", "annotation_index": 2171, "question_index": 0, "question": "What is the man holding in his left hand?", "options": ["A. A barbell.", "B. A kettlebell.", "C. A resistance band.", "D. A dumbbell."], "answer": "D", "time_stamp_s": 249, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_147_a2171_q0", "video_id": 147, "time_stamp_s": 249, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "46253fd6f78954d583bdf21a8a5cee5c09c6d933cd59672fb3d5236075927b09", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [219.00211666666667, 220.00311666666667, 221.00411666666668, 222.00511666666668, 223.00611666666666, 224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333], "recent_frames_sha256": "9d2ed85fd53b5d98d847278b745018a34952ea5430ee05919a6c7cc1c6534528", "num_recent_frames": 30, "tq": 717997.95225613, "t1": 718005.716390698, "ta": 718005.716390698, "te": 718005.756182358, "first_response_s": 7.764134567929432, "answer_total_s": 7.8039262279635295, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_147_a2171_q0", "video_id": 147, "time_stamp_s": 249, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "643040dc5ce988734970696e48b288426021ee052fecb7e458a25b50628445cb", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A muscular man in black shorts and a black shirt flexes his back muscles while standing in a gym, with a text overlay reading \"HOW TO TRAIN BACK & BICEPS\".  \n- A man in a black shirt and blue shorts performs a 1-arm half-kneeling lat pulldown on a cable machine, with a text overlay indicating \"EXERCISE 1 OF 6\" and \"3 SETS X 12-15 REPS\".  \n- A man in a black shirt and cap uses a stairmaster for a 5-minute warm-up, with a text overlay reading \"WARM-UP\n[30-60s] - Man in black shirt and blue shorts performs cable row while kneeling, pulling cable toward torso.  \n- Split-screen comparison shows incorrect (cable too high, pulling too far) vs. correct form (cable at proper height, controlled pull).  \n- Visual cues highlight alignment and posture differences between improper and proper technique.\n[60-90s] - Man in black shirt performs pull-down (front) exercise, kneeling with cable machine, pulling handle toward chest.  \n- Text overlay labels the movement as \"shoulder extension\" and shows side-by-side comparison with \"pull-in (side)\" exercise.  \n- Gym environment visible with various equipment in background, consistent lighting.\n[90-120s] - Man performs pull-up on a bar, wearing black shirt and blue shorts, with a weight rack behind him.  \n- He is in a gym with various equipment visible, including a squat rack and cable machines.  \n- Text overlay indicates \"EXERCISE 2 OF 6\" and \"PULL-UP: 1 SET X 4 REP\" at the bottom of the screen.\n[120-150s] - Man performs pull-ups, gripping bar with wide hands, body suspended, arms fully extended at start.\n- He lowers body with controlled motion, elbows slightly bent, then pulls up, chin clearing bar.\n- Camera angle shifts from side to low-angle, emphasizing his muscular arms and facial expression.\n[150-180s] - Man performs pull-ups on a bar, gripping it with both hands, body suspended, and arms extended upward.  \n- He transitions to a back-facing view, showing his muscular back and legs as he pulls himself up, with a white arrow graphic indicating movement direction.  \n- He then faces forward, lowering himself down from the bar, with his arms fully extended, before moving to a different piece of equipment.\n[180-210s] - Man performs Kroc row with dumbbells, maintaining bent-knee stance and gripping barbell-like equipment.  \n- Gym environment features rows of dumbbells and mirrors, with another person visible in background.  \n- On-screen text indicates \"EXERCISE 3 OF 6\" and \"KROC ROW: 3 SETS X 10-12 REPS\".\n[210-240s] - Man in dark shirt and shorts performs a bent-over row with dumbbells, maintaining a stable stance on a bench.  \n- Another man in black shirt and shorts assists by positioning weights and adjusting the man’s posture.  \n- A third man in a patterned shirt sits on a bench, observing the exercise.", "history_tokens": 696, "history_utf8_bytes": 2794, "recent_frame_times_s": [219.00211666666667, 220.00311666666667, 221.00411666666668, 222.00511666666668, 223.00611666666666, 224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333], "recent_frames_sha256": "9d2ed85fd53b5d98d847278b745018a34952ea5430ee05919a6c7cc1c6534528", "num_recent_frames": 30, "tq": 717919.860691312, "t1": 717926.316939172, "ta": 717926.316939172, "te": 717926.585516188, "first_response_s": 6.456247859983705, "answer_total_s": 6.724824875942431, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 147, "content_group": "425203b30b1ed0dfcff0e6ac099ba72f5ac840ab360b508068699308148e785c", "question": {"question_id": "sample_147_a2172_q0", "video_id": 147, "video_path": "./videos/sample_147_real.mp4", "annotation_index": 2172, "question_index": 0, "question": "What is the main focus of the study shown in the scientific paper format?", "options": ["A. The effect of hand position on EMG activity of posterior shoulder musculature during horizontal abduction exercise.", "B. The effect of hand position on shoulder pain.", "C. The effect of different exercises on overall shoulder strength.", "D. The comparison of EMG activity between different exercises."], "answer": "A", "time_stamp_s": 380, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_147_a2172_q0", "video_id": 147, "time_stamp_s": 380, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f001372b458883b216838132663c34eb0b0a88c94e0afc57bfee7814ff4f1379", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667], "recent_frames_sha256": "1edc681f28a47b022141ddb05cde0e0c3c90cd81ce435a881aa5c30bd74b0bcd", "num_recent_frames": 30, "tq": 718005.777019377, "t1": 718017.461091209, "ta": 718017.461091209, "te": 718017.503271728, "first_response_s": 11.68407183198724, "answer_total_s": 11.726252351072617, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_147_a2172_q0", "video_id": 147, "time_stamp_s": 380, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c30e0509c127731fcf220a4e68d15af2fc15e053f906ef4f5107d233c25dcc02", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A muscular man in black shorts and a black shirt flexes his back muscles while standing in a gym, with a text overlay reading \"HOW TO TRAIN BACK & BICEPS\".  \n- A man in a black shirt and blue shorts performs a 1-arm half-kneeling lat pulldown on a cable machine, with a text overlay indicating \"EXERCISE 1 OF 6\" and \"3 SETS X 12-15 REPS\".  \n- A man in a black shirt and cap uses a stairmaster for a 5-minute warm-up, with a text overlay reading \"WARM-UP\n[30-60s] - Man in black shirt and blue shorts performs cable row while kneeling, pulling cable toward torso.  \n- Split-screen comparison shows incorrect (cable too high, pulling too far) vs. correct form (cable at proper height, controlled pull).  \n- Visual cues highlight alignment and posture differences between improper and proper technique.\n[60-90s] - Man in black shirt performs pull-down (front) exercise, kneeling with cable machine, pulling handle toward chest.  \n- Text overlay labels the movement as \"shoulder extension\" and shows side-by-side comparison with \"pull-in (side)\" exercise.  \n- Gym environment visible with various equipment in background, consistent lighting.\n[90-120s] - Man performs pull-up on a bar, wearing black shirt and blue shorts, with a weight rack behind him.  \n- He is in a gym with various equipment visible, including a squat rack and cable machines.  \n- Text overlay indicates \"EXERCISE 2 OF 6\" and \"PULL-UP: 1 SET X 4 REP\" at the bottom of the screen.\n[120-150s] - Man performs pull-ups, gripping bar with wide hands, body suspended, arms fully extended at start.\n- He lowers body with controlled motion, elbows slightly bent, then pulls up, chin clearing bar.\n- Camera angle shifts from side to low-angle, emphasizing his muscular arms and facial expression.\n[150-180s] - Man performs pull-ups on a bar, gripping it with both hands, body suspended, and arms extended upward.  \n- He transitions to a back-facing view, showing his muscular back and legs as he pulls himself up, with a white arrow graphic indicating movement direction.  \n- He then faces forward, lowering himself down from the bar, with his arms fully extended, before moving to a different piece of equipment.\n[180-210s] - Man performs Kroc row with dumbbells, maintaining bent-knee stance and gripping barbell-like equipment.  \n- Gym environment features rows of dumbbells and mirrors, with another person visible in background.  \n- On-screen text indicates \"EXERCISE 3 OF 6\" and \"KROC ROW: 3 SETS X 10-12 REPS\".\n[210-240s] - Man in dark shirt and shorts performs a bent-over row with dumbbells, maintaining a stable stance on a bench.  \n- Another man in black shirt and shorts assists by positioning weights and adjusting the man’s posture.  \n- A third man in a patterned shirt sits on a bench, observing the exercise.\n[240-270s] - Man performs dumbbell rows on an incline bench, maintaining a bent-knee stance.  \n- Dumbbell is held in each hand, lowered toward the floor while keeping elbows close to body.  \n- A vertical \"HARD\" to \"EASY\" difficulty scale appears on the left side of the screen.\n[270-300s] - Man performs cable shrug with dumbbells, standing upright with arms extended forward.  \n- Gym equipment and racks visible in background, with a \"PURE MUSCLE\" sign overhead.  \n- On-screen graphic shows \"HARD\" to \"EASY\" difficulty scale, indicating exercise intensity.\n[300-330s] - Man in black shirt and blue shorts stands in gym, holding two dumbbells at shoulder height, arms extended outward.  \n- Gym equipment and \"PURE MUSCLE\" sign visible in background; man appears to be preparing for or performing a dumbbell exercise.  \n- Camera focuses on man’s upper body and arms, showing slight movement as he holds dumbbells steady.\n[330-360s] - Man in black shirt performs cable fly exercise, pulling handles toward chest while facing away from camera.  \n- Background shows gym equipment and another person exercising.  \n- Video transitions to split-screen showing three sets of hand positions during the exercise.", "history_tokens": 987, "history_utf8_bytes": 3999, "recent_frame_times_s": [350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667], "recent_frames_sha256": "1edc681f28a47b022141ddb05cde0e0c3c90cd81ce435a881aa5c30bd74b0bcd", "num_recent_frames": 30, "tq": 717964.589919216, "t1": 717965.571328207, "ta": 717965.571328207, "te": 717965.611126124, "first_response_s": 0.9814089910360053, "answer_total_s": 1.0212069080444053, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 148, "content_group": "0e29a38a4f849cd66fce5685cbbe68cd6c197f28c5b5aeb1a19c6b2e61245560", "question": {"question_id": "sample_148_a1435_q0", "video_id": 148, "video_path": "./videos/sample_148_real.mp4", "annotation_index": 1435, "question_index": 0, "question": "What does the man do at the start of the video?", "options": ["A. He is scratching his head.", "B. He is tying his shoes.", "C. He is drinking water.", "D. He is adjusting his watch."], "answer": "A", "time_stamp_s": 8, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_148_a1435_q0", "video_id": 148, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "36802c2336e7a1f3c81e0b51f26298a308c5720987c49161bb92861e54f46eec", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007], "recent_frames_sha256": "8e03fcfb7ccb239291f89e9e427dd4ca13c5311c9c4758694909b5f2a9c21f7a", "num_recent_frames": 8, "tq": 719088.699699154, "t1": 719089.190447965, "ta": 719089.190447965, "te": 719089.228117682, "first_response_s": 0.4907488110475242, "answer_total_s": 0.5284185280324891, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_148_a1435_q0", "video_id": 148, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ec3399d3dad4e03f7cef418e98708ee02931a8bcdcb672b03d93e4769668509f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007], "recent_frames_sha256": "8e03fcfb7ccb239291f89e9e427dd4ca13c5311c9c4758694909b5f2a9c21f7a", "num_recent_frames": 8, "tq": 718861.50782399, "t1": 718873.935366946, "ta": 718873.935366946, "te": 718874.333357172, "first_response_s": 12.427542956080288, "answer_total_s": 12.825533182010986, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 148, "content_group": "0e29a38a4f849cd66fce5685cbbe68cd6c197f28c5b5aeb1a19c6b2e61245560", "question": {"question_id": "sample_148_a1435_q1", "video_id": 148, "video_path": "./videos/sample_148_real.mp4", "annotation_index": 1435, "question_index": 1, "question": "How is the tier list diagram colored?", "options": ["A. Red, orange, yellow, and green.", "B. Blue, purple, yellow, and red.", "C. Green, yellow, orange, and red.", "D. Yellow, blue, green, and orange."], "answer": "A", "time_stamp_s": 10, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_148_a1435_q1", "video_id": 148, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "70bbe4460e55abde236b8f0a5db11dbe847c5a80931e31eed1d9634fcb418105", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "eed7e8aec4782ccdf3a2b89178b0a4148a0e65c1e0e3ec1a583f33daece7e1fd", "num_recent_frames": 10, "tq": 719089.242408947, "t1": 719099.904372561, "ta": 719099.904372561, "te": 719100.098499327, "first_response_s": 10.661963614053093, "answer_total_s": 10.856090379995294, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_148_a1435_q1", "video_id": 148, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "73b53aee4eac9e9cd13db37648191bf1dcf349d56d7aad582cf90bba8f2057a9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "eed7e8aec4782ccdf3a2b89178b0a4148a0e65c1e0e3ec1a583f33daece7e1fd", "num_recent_frames": 10, "tq": 718874.350720869, "t1": 718882.19344091, "ta": 718882.19344091, "te": 718882.383624536, "first_response_s": 7.842720040935092, "answer_total_s": 8.032903666957282, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 148, "content_group": "0e29a38a4f849cd66fce5685cbbe68cd6c197f28c5b5aeb1a19c6b2e61245560", "question": {"question_id": "sample_148_a1436_q0", "video_id": 148, "video_path": "./videos/sample_148_real.mp4", "annotation_index": 1436, "question_index": 0, "question": "What text appeared at the bottom of the screen just now?", "options": ["A. \"BARBELL BACK SQUAT\".", "B. \"DEADLIFT\".", "C. \"BARBELL FRONT SQUAT\".", "D. \"BENCH PRESS\"."], "answer": "C", "time_stamp_s": 190, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "gym_workout", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_148_a1436_q0", "video_id": 148, "time_stamp_s": 190, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fabd1aae7020d085990dd184165d0883c908f3afd2ad21a3609c09f3e8cfe3f4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666], "recent_frames_sha256": "eb3b01b81679def301f04b530cda842eebe8016153b77a7ebdb061d81e27566c", "num_recent_frames": 30, "tq": 719100.113838699, "t1": 719111.519579865, "ta": 719111.519579865, "te": 719111.557698529, "first_response_s": 11.405741166090593, "answer_total_s": 11.443859830033034, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_148_a1436_q0", "video_id": 148, "time_stamp_s": 190, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9fb5921444a31e054541255059605b6459b7d0a8fe5504e136002c4f7a8ca0a6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A muscular man in black shorts stands against a black background, then poses with arms extended, as a grading scale (S to F) appears on the left.  \n- A grid of 20 numbered workout thumbnails is displayed, followed by a grading scale labeled \"SUPER\" to \"FAIL\" with a trophy icon at the top.  \n- A man in a gym performs various exercises (e.g., squats, bench press) while a text overlay lists \"STRETCH & TENSION,\" \"IT NEEDS TO FEEL GOOD,\" and \"SIMPLE PROGRESSION\" as criteria.\n[30-60s] - Man in black shirt performs seated leg extension with barbell, showing quadriceps engagement.  \n- Man in black shirt transitions to floor-based stretch, arching back while holding barbell.  \n- Man in black shirt sits at desk, gesturing toward laptop screen displaying anatomical muscle labels.\n[60-90s] - Man in black shorts flexes muscles, with colored overlays indicating quadriceps muscles.  \n- Anatomical diagram shows knee extension with muscle activation on the right leg.  \n- Man in gym performs combo squat exercises with dumbbells.\n[90-120s] - Man in gym performs combo squat exercises with dumbbells, transitioning between squat and standing positions.  \n- Man in office setting speaks into microphone, gesturing while seated at desk with laptop.  \n- Woman in dimly lit studio performs balance-based squat with dumbbells on a stability ball, illuminated by a spotlight.\n[120-150s] - Man in blue shirt performs barbell back squat, maintaining upright posture with barbell on shoulders.  \n- Anatomical diagram highlights spinal erectors as the man executes the movement.  \n- Man adjusts weight plates on barbell, preparing for the squat.\n[150-180s] - A young woman in a maroon tank top and shorts flexes her biceps while holding a phone for a mirror selfie.  \n- A young woman performs a back squat with a 170kg barbell, wearing black shorts and knee sleeves, in a gym setting.  \n- A man in a black shirt and shorts stands in a gym, holding a barbell overhead while squatting, with a skeleton diagram labeled \"Rectus Femoris\" displayed on screen.", "history_tokens": 493, "history_utf8_bytes": 2049, "recent_frame_times_s": [160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666], "recent_frames_sha256": "eb3b01b81679def301f04b530cda842eebe8016153b77a7ebdb061d81e27566c", "num_recent_frames": 30, "tq": 718962.353654722, "t1": 718963.41195675, "ta": 718963.41195675, "te": 718963.450476135, "first_response_s": 1.0583020279882476, "answer_total_s": 1.0968214130261913, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 148, "content_group": "0e29a38a4f849cd66fce5685cbbe68cd6c197f28c5b5aeb1a19c6b2e61245560", "question": {"question_id": "sample_148_a1437_q0", "video_id": 148, "video_path": "./videos/sample_148_real.mp4", "annotation_index": 1437, "question_index": 0, "question": "What is the man using right now?", "options": ["A. Treadmill.", "B. Dumbbells.", "C. Elliptical machine.", "D. Leg press machine."], "answer": "D", "time_stamp_s": 383, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_148_a1437_q0", "video_id": 148, "time_stamp_s": 383, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ce5f9b8279f1337c8361d8f457e15b0dd5cbd07a3510c8e6e22e941433d369ad", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667], "recent_frames_sha256": "6ccbd4bac352d19bd0fff2604e4b7fdae7d0f78e82801f24259e3fcbef015969", "num_recent_frames": 30, "tq": 719111.573710493, "t1": 719121.811939565, "ta": 719121.811939565, "te": 719121.849475228, "first_response_s": 10.238229071954265, "answer_total_s": 10.275764734949917, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_148_a1437_q0", "video_id": 148, "time_stamp_s": 383, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2115062f0f507f150a75e9e08fbf8852c74341710df9a643abce912c7d597107", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A muscular man in black shorts stands against a black background, then poses with arms extended, as a grading scale (S to F) appears on the left.  \n- A grid of 20 numbered workout thumbnails is displayed, followed by a grading scale labeled \"SUPER\" to \"FAIL\" with a trophy icon at the top.  \n- A man in a gym performs various exercises (e.g., squats, bench press) while a text overlay lists \"STRETCH & TENSION,\" \"IT NEEDS TO FEEL GOOD,\" and \"SIMPLE PROGRESSION\" as criteria.\n[30-60s] - Man in black shirt performs seated leg extension with barbell, showing quadriceps engagement.  \n- Man in black shirt transitions to floor-based stretch, arching back while holding barbell.  \n- Man in black shirt sits at desk, gesturing toward laptop screen displaying anatomical muscle labels.\n[60-90s] - Man in black shorts flexes muscles, with colored overlays indicating quadriceps muscles.  \n- Anatomical diagram shows knee extension with muscle activation on the right leg.  \n- Man in gym performs combo squat exercises with dumbbells.\n[90-120s] - Man in gym performs combo squat exercises with dumbbells, transitioning between squat and standing positions.  \n- Man in office setting speaks into microphone, gesturing while seated at desk with laptop.  \n- Woman in dimly lit studio performs balance-based squat with dumbbells on a stability ball, illuminated by a spotlight.\n[120-150s] - Man in blue shirt performs barbell back squat, maintaining upright posture with barbell on shoulders.  \n- Anatomical diagram highlights spinal erectors as the man executes the movement.  \n- Man adjusts weight plates on barbell, preparing for the squat.\n[150-180s] - A young woman in a maroon tank top and shorts flexes her biceps while holding a phone for a mirror selfie.  \n- A young woman performs a back squat with a 170kg barbell, wearing black shorts and knee sleeves, in a gym setting.  \n- A man in a black shirt and shorts stands in a gym, holding a barbell overhead while squatting, with a skeleton diagram labeled \"Rectus Femoris\" displayed on screen.\n[180-210s] - Man in blue shirt performs barbell front squat, holding barbell across shoulders, knees bent, back straight.  \n- Gym equipment visible in background, including racks, medicine balls, and weight machines.  \n- On-screen text labels exercise as \"BARBELL FRONT SQUAT\" and displays anatomical diagrams comparing front and back squats.\n[210-240s] - Man in dark shirt sits at desk, gesturing while speaking into microphone, laptop open in front of him.  \n- Man in gym performs barbell squat, holding barbell with two-finger grip, then transitions to crossed arm grip.  \n- On-screen graphic displays three grip types (two-finger, crossed arm, strap) with corresponding images of the man demonstrating each.\n[240-270s] - Man with reddish hair and beard, wearing a dark blue t-shirt, holds a barbell across his upper back, preparing for a squat.  \n- Barbell has weight plates on both sides, with visible \"0.5\" markings on the right plate.  \n- Gym environment includes dark walls, overhead lights, and various exercise equipment in the background.\n[270-300s] - Man performs hack squat on machine, pushing through knee extension while seated.  \n- Machine has adjustable foot platform and weight plates visible on sides.  \n- Man’s posture shifts from upright to reclined as he executes the movement.\n[300-330s] - A man in a gym performs a leg press exercise, seated on a machine with weights, pushing a barbell forward.  \n- The gym environment includes other equipment and people in the background, suggesting a busy workout setting.  \n- The man is wearing a dark t-shirt and shorts, focused on his exercise with visible effort.\n[330-360s] - Man performs Smith machine squats, holding barbell with upright posture, knees bent, and feet shoulder-width apart.  \n- He lowers body into squat position, then stands back up, maintaining controlled movement.  \n- Gym equipment and mirrors visible in background, with another person working out in distance.", "history_tokens": 945, "history_utf8_bytes": 4001, "recent_frame_times_s": [353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667], "recent_frames_sha256": "6ccbd4bac352d19bd0fff2604e4b7fdae7d0f78e82801f24259e3fcbef015969", "num_recent_frames": 30, "tq": 719003.870476742, "t1": 719005.306542453, "ta": 719005.306542453, "te": 719005.34472596, "first_response_s": 1.4360657109646127, "answer_total_s": 1.474249218008481, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 148, "content_group": "0e29a38a4f849cd66fce5685cbbe68cd6c197f28c5b5aeb1a19c6b2e61245560", "question": {"question_id": "sample_148_a1438_q0", "video_id": 148, "video_path": "./videos/sample_148_real.mp4", "annotation_index": 1438, "question_index": 0, "question": "What exercise is the person performing in the gym right now?", "options": ["A. Deadlift.", "B. Bench press.", "C. Weighted squat.", "D. Push-up."], "answer": "C", "time_stamp_s": 554, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_148_a1438_q0", "video_id": 148, "time_stamp_s": 554, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "72ffa985237ceb4c8bd4313c4b7a3e10cb3d64ffa372837a42ad1568b7702b38", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [524.0235, 525.0245, 526.0255, 527.0265, 528.0275, 529.0285, 530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333], "recent_frames_sha256": "e100b1f13228ceab5485a8a75c70bf661cfb6ca166f678b7f29e64e3c71c45f4", "num_recent_frames": 30, "tq": 719121.860902798, "t1": 719130.543791253, "ta": 719130.543791253, "te": 719130.581115893, "first_response_s": 8.682888454990461, "answer_total_s": 8.720213094959036, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_148_a1438_q0", "video_id": 148, "time_stamp_s": 554, "ground_truth": "C", "raw_output": "C. Weighted squat.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "7437b99fc57ac6d354fac0c18ec8ddccc1967bda611f70be95ee8c63d3d9d66b", "condition_order": ["notes", "recent"], "memory": "[150-180s] - A young woman in a maroon tank top and shorts flexes her biceps while holding a phone for a mirror selfie.  \n- A young woman performs a back squat with a 170kg barbell, wearing black shorts and knee sleeves, in a gym setting.  \n- A man in a black shirt and shorts stands in a gym, holding a barbell overhead while squatting, with a skeleton diagram labeled \"Rectus Femoris\" displayed on screen.\n[180-210s] - Man in blue shirt performs barbell front squat, holding barbell across shoulders, knees bent, back straight.  \n- Gym equipment visible in background, including racks, medicine balls, and weight machines.  \n- On-screen text labels exercise as \"BARBELL FRONT SQUAT\" and displays anatomical diagrams comparing front and back squats.\n[210-240s] - Man in dark shirt sits at desk, gesturing while speaking into microphone, laptop open in front of him.  \n- Man in gym performs barbell squat, holding barbell with two-finger grip, then transitions to crossed arm grip.  \n- On-screen graphic displays three grip types (two-finger, crossed arm, strap) with corresponding images of the man demonstrating each.\n[240-270s] - Man with reddish hair and beard, wearing a dark blue t-shirt, holds a barbell across his upper back, preparing for a squat.  \n- Barbell has weight plates on both sides, with visible \"0.5\" markings on the right plate.  \n- Gym environment includes dark walls, overhead lights, and various exercise equipment in the background.\n[270-300s] - Man performs hack squat on machine, pushing through knee extension while seated.  \n- Machine has adjustable foot platform and weight plates visible on sides.  \n- Man’s posture shifts from upright to reclined as he executes the movement.\n[300-330s] - A man in a gym performs a leg press exercise, seated on a machine with weights, pushing a barbell forward.  \n- The gym environment includes other equipment and people in the background, suggesting a busy workout setting.  \n- The man is wearing a dark t-shirt and shorts, focused on his exercise with visible effort.\n[330-360s] - Man performs Smith machine squats, holding barbell with upright posture, knees bent, and feet shoulder-width apart.  \n- He lowers body into squat position, then stands back up, maintaining controlled movement.  \n- Gym equipment and mirrors visible in background, with another person working out in distance.\n[360-390s] - Man in blue shirt performs leg press exercise, pushing platform with legs while seated.  \n- Machine has weight plates and digital display showing resistance level.  \n- Man adjusts position slightly, maintaining focus on exercise form.\n[390-420s] - Man in blue shirt performs dumbbell lunges, alternating legs while holding weights.  \n- Gym equipment, including racks and machines, visible in background.  \n- Dumbbell weights are held in each hand, positioned near the body during movement.\n[420-450s] - Man in blue shirt performs leg extension on machine, seated with knee bent, foot on pad, and handle in hand.  \n- Gym equipment visible in background, including other machines and a digital display on the leg extension machine.  \n- Man’s posture shifts slightly as he extends and flexes his leg during the exercise.\n[450-480s] - A man in a gym performs leg curls on a machine, with his leg extended and foot on the pad.  \n- A second man in the background is also using a leg curl machine, focused on his exercise.  \n- A graphic overlay displays \"RECTUS FEMORIS MUSCLE THICKNESS\" with a bar chart comparing \"SEAT UP\" and \"SEAT BACK\" exercises.\n[480-510s] - Man in blue shirt performs leg press exercise on incline bench, legs extended forward.  \n- Gym equipment visible in background, including weight machines and racks.  \n- Man maintains focused posture while seated on bench, gripping handles for stability.\n[510-540s] - Man in blue shirt performs cable row exercise while kneeling on gym floor, pulling cable toward chest.  \n- Gym equipment and \"DRC MUSCLE\" sign visible in background; text overlay reads \"PROGRESSION OPTION: GRADUALLY INCREASE RANGE OF MOTION EACH WEEK.\"  \n- Man maintains focused posture, arms extended, cable handle near chest during movement.", "history_tokens": 982, "history_utf8_bytes": 4143, "recent_frame_times_s": [524.0235, 525.0245, 526.0255, 527.0265, 528.0275, 529.0285, 530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333], "recent_frames_sha256": "e100b1f13228ceab5485a8a75c70bf661cfb6ca166f678b7f29e64e3c71c45f4", "num_recent_frames": 30, "tq": 719051.577621667, "t1": 719088.45020565, "ta": 719088.45020565, "te": 719088.675114509, "first_response_s": 36.87258398300037, "answer_total_s": 37.0974928420037, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 149, "content_group": "2b412510b9ac19fb6067c1ce824b5dbeef086a0efddad4452540c7696a76892d", "question": {"question_id": "sample_149_a1407_q0", "video_id": 149, "video_path": "./videos/sample_149_real.mp4", "annotation_index": 1407, "question_index": 0, "question": "What text appears prominently on the left side of the screen at the start of the video?", "options": ["A. \"HOW TO TRAIN\".", "B. \"WORKOUT ROUTINE\".", "C. \"TRAINING SCHEDULE\".", "D. \"GYM TIPS\"."], "answer": "A", "time_stamp_s": 3, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_149_a1407_q0", "video_id": 149, "time_stamp_s": 3, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9f10962ce76cc4c109283c0e424680d2cdb8bc39ab93f2a6f7596ad02e53dff7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002], "recent_frames_sha256": "1b122c3ff6a7353724ad85d506c0f4ac354a7178c3e2b6ec4137c4caaeb6fd2a", "num_recent_frames": 3, "tq": 710755.487118823, "t1": 710756.038871027, "ta": 710756.038871027, "te": 710756.078085563, "first_response_s": 0.5517522039590403, "answer_total_s": 0.5909667400410399, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_149_a1407_q0", "video_id": 149, "time_stamp_s": 3, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "75a84528e705831093be698e2c37c3b50d797ddd316dc7f67cf48e096bc15e3e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002], "recent_frames_sha256": "1b122c3ff6a7353724ad85d506c0f4ac354a7178c3e2b6ec4137c4caaeb6fd2a", "num_recent_frames": 3, "tq": 710601.713926349, "t1": 710616.344973627, "ta": 710616.344973627, "te": 710616.382378062, "first_response_s": 14.631047278060578, "answer_total_s": 14.668451713048853, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 149, "content_group": "2b412510b9ac19fb6067c1ce824b5dbeef086a0efddad4452540c7696a76892d", "question": {"question_id": "sample_149_a1407_q1", "video_id": 149, "video_path": "./videos/sample_149_real.mp4", "annotation_index": 1407, "question_index": 1, "question": "How many repetitions are suggested for each leg for both front-to-back and side-to-side leg swings?", "options": ["A. 12 reps.", "B. 10 reps.", "C. 15 reps.", "D. 20 reps."], "answer": "A", "time_stamp_s": 20, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_149_a1407_q1", "video_id": 149, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "82b0ece6098c36e213380b7758f249e70e4bca897ce0cca725b4a2bd12b112d0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665], "recent_frames_sha256": "4b29d8b7630cda1a04c2c3913e34f8bace862646ea90fbc9948f17ba9bdded62", "num_recent_frames": 20, "tq": 710756.103663115, "t1": 710766.50828864, "ta": 710766.50828864, "te": 710766.549566461, "first_response_s": 10.404625524999574, "answer_total_s": 10.445903346058913, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_149_a1407_q1", "video_id": 149, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b681a4e1790aa501e0ab3104c29f1b4336ae4ef18cefe2dec90108f42be5a81e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665], "recent_frames_sha256": "4b29d8b7630cda1a04c2c3913e34f8bace862646ea90fbc9948f17ba9bdded62", "num_recent_frames": 20, "tq": 710616.39069393, "t1": 710622.876575159, "ta": 710622.876575159, "te": 710622.913991854, "first_response_s": 6.4858812290476635, "answer_total_s": 6.523297923966311, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 149, "content_group": "2b412510b9ac19fb6067c1ce824b5dbeef086a0efddad4452540c7696a76892d", "question": {"question_id": "sample_149_a1408_q0", "video_id": 149, "video_path": "./videos/sample_149_real.mp4", "annotation_index": 1408, "question_index": 0, "question": "What is the man wearing during the deadlift exercise?", "options": ["A. A white t-shirt and black shorts.", "B. A dark gray t-shirt and black shorts.", "C. A blue t-shirt and black shorts.", "D. A dark gray t-shirt and blue shorts."], "answer": "B", "time_stamp_s": 134, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_149_a1408_q0", "video_id": 149, "time_stamp_s": 134, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "502b2828f5a2f785c7053d4248ac8262627ddbbe6c94b5bff21e83cdea723c08", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668], "recent_frames_sha256": "4109816f77f80f4af86ba94fe1909ca008f547eed8b12c10c8d1a9b2235b5860", "num_recent_frames": 30, "tq": 710766.562855063, "t1": 710777.331248291, "ta": 710777.331248291, "te": 710777.369820701, "first_response_s": 10.768393227946945, "answer_total_s": 10.80696563795209, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_149_a1408_q0", "video_id": 149, "time_stamp_s": 134, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d83534bc66d956be3d7b712241ecad26aec7da664c199bd118cc717f931e3365", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A muscular man in black shorts stands facing camera, then turns sideways to highlight quads, hamstrings, and glutes with arrows.  \n- A man in a grey hoodie runs on a treadmill, with text overlay indicating \"5 MINUTES TREADMILL OR STAIRMASTER\" for warm-up.  \n- A man performs a deadlift with barbell, labeled \"EXERCISE 1 OF 7\" and \"DEADLIFT (CONVENTIONAL OR SUMO): 1 SET X 5 REPS\".\n[30-60s] - Man performs trap bar deadlift with barbell on trap bar, standing on wooden platform.  \n- Man transitions to barbell hip thrust, lying on bench with barbell across hips.  \n- Man performs Bulgarian split squat, holding dumbbells, one leg forward, other back.\n[60-90s] - Man in grey hoodie adjusts barbell weights, preparing for lift.  \n- Gym equipment visible in background, including racks and weights.  \n- On-screen text displays \"LINEAR PERIODIZATION\" with weekly workout plans.\n[90-120s] - A man in a gym prepares for a deadlift, adjusting barbell weights while standing near a rack.  \n- He bends down, gripping the barbell, with a focus on proper form as he sets up for the lift.  \n- On-screen text indicates \"STIFF-LEG DEADLIFT: 2 SETS X 8 REPS\" and advises using 50–60% of the deadlift top set weight.", "history_tokens": 334, "history_utf8_bytes": 1211, "recent_frame_times_s": [104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668], "recent_frames_sha256": "4109816f77f80f4af86ba94fe1909ca008f547eed8b12c10c8d1a9b2235b5860", "num_recent_frames": 30, "tq": 710652.789657962, "t1": 710654.098938518, "ta": 710654.098938518, "te": 710654.137355789, "first_response_s": 1.309280555928126, "answer_total_s": 1.3476978269172832, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 149, "content_group": "2b412510b9ac19fb6067c1ce824b5dbeef086a0efddad4452540c7696a76892d", "question": {"question_id": "sample_149_a1409_q0", "video_id": 149, "video_path": "./videos/sample_149_real.mp4", "annotation_index": 1409, "question_index": 0, "question": "What is the man doing during the \"Slow-Eccentric Leg Extension\" exercise?", "options": ["A. Pulling the bar upwards quickly with his legs.", "B. Jumping off the machine.", "C. Swinging his legs back and forth.", "D. Pushing the padded bar upwards and lowering it slowly with his legs."], "answer": "D", "time_stamp_s": 259, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_149_a1409_q0", "video_id": 149, "time_stamp_s": 259, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "265bf6b546f3de73f184fc18a66081afd3bc5fe0c2a6f9bd1c624e27cab15432", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775], "recent_frames_sha256": "c91100e31b15ba226c5cbe16fb889264aab9771806ec30151a6938aeb096aef2", "num_recent_frames": 30, "tq": 710777.38719704, "t1": 710788.341240065, "ta": 710788.341240065, "te": 710788.63829983, "first_response_s": 10.95404302503448, "answer_total_s": 11.251102790003642, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_149_a1409_q0", "video_id": 149, "time_stamp_s": 259, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "20786c8425ddd386bcd21dadf81040292cafa30108b2b49014c113e049ad9868", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A muscular man in black shorts stands facing camera, then turns sideways to highlight quads, hamstrings, and glutes with arrows.  \n- A man in a grey hoodie runs on a treadmill, with text overlay indicating \"5 MINUTES TREADMILL OR STAIRMASTER\" for warm-up.  \n- A man performs a deadlift with barbell, labeled \"EXERCISE 1 OF 7\" and \"DEADLIFT (CONVENTIONAL OR SUMO): 1 SET X 5 REPS\".\n[30-60s] - Man performs trap bar deadlift with barbell on trap bar, standing on wooden platform.  \n- Man transitions to barbell hip thrust, lying on bench with barbell across hips.  \n- Man performs Bulgarian split squat, holding dumbbells, one leg forward, other back.\n[60-90s] - Man in grey hoodie adjusts barbell weights, preparing for lift.  \n- Gym equipment visible in background, including racks and weights.  \n- On-screen text displays \"LINEAR PERIODIZATION\" with weekly workout plans.\n[90-120s] - A man in a gym prepares for a deadlift, adjusting barbell weights while standing near a rack.  \n- He bends down, gripping the barbell, with a focus on proper form as he sets up for the lift.  \n- On-screen text indicates \"STIFF-LEG DEADLIFT: 2 SETS X 8 REPS\" and advises using 50–60% of the deadlift top set weight.\n[120-150s] - Man in grey shirt and black shorts performs deadlift with barbell, using 50-60% of his set weight.  \n- He bends at hips and knees, grips barbell, lifts it off the ground, and stands upright.  \n- After lifting, he lowers the barbell back to the ground, then repeats the motion.\n[150-180s] - Man performs leg press on machine, feet strapped, knees bent, pushing plate away.  \n- Machine displays \"20.4\" and \"45\" weight markers; yellow ball visible near machine base.  \n- Brief inset shows man in red shirt speaking, with \"RIP\" and \"FULL R0M\" logos visible.\n[180-210s] - Man performs glute-ham raise on incline machine, holding yellow grip handle.  \n- Weight stack shows 225 lbs, with barbell plates visibly loaded.  \n- Gym environment includes multiple machines and dark flooring, with overhead lighting.\n[210-240s] - Man in grey shirt adjusts barbell on rack, preparing for glute-ham raise.  \n- Man in black outfit kneels beside another man lying prone on floor, assisting with positioning.  \n- Man in grey shirt performs glute-ham raise, lifting barbell while seated on machine.", "history_tokens": 625, "history_utf8_bytes": 2302, "recent_frame_times_s": [229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775], "recent_frames_sha256": "c91100e31b15ba226c5cbe16fb889264aab9771806ec30151a6938aeb096aef2", "num_recent_frames": 30, "tq": 710684.007559691, "t1": 710691.932771068, "ta": 710691.932771068, "te": 710692.088962451, "first_response_s": 7.925211376976222, "answer_total_s": 8.081402759999037, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 149, "content_group": "2b412510b9ac19fb6067c1ce824b5dbeef086a0efddad4452540c7696a76892d", "question": {"question_id": "sample_149_a1410_q0", "video_id": 149, "video_path": "./videos/sample_149_real.mp4", "annotation_index": 1410, "question_index": 0, "question": "What is written on the poster next to the person right now?", "options": ["A. \"The Ultimate Bodybuilding Guide\".", "B. \"The Ultimate Fitness Program\".", "C. \"The Ultimate Muscle Flex System\".", "D. \"The Ultimate Push Pull Legs System\"."], "answer": "D", "time_stamp_s": 461, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [420, 470], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_149_a1410_q0", "video_id": 149, "time_stamp_s": 461, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9c5bc52f6aaefeb17b463e5099565e67ebc2388a0fd60faee1b9d458c4a49fe7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [431.01391666666666, 432.0149166666667, 433.01591666666667, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333, 439.0052333333333, 440.00623333333334, 441.0072333333333, 442.00823333333335, 443.0092333333333, 444.01023333333336, 445.01123333333334, 446.0122333333333, 447.01323333333335, 448.0142333333333, 449.01523333333336, 450.01623333333333, 451.00055, 452.00155, 453.00255, 454.00355, 455.00455, 456.00555, 457.00655, 458.00755, 459.00855, 460.00955], "recent_frames_sha256": "8dd06acc8c0eccf8757e04cd7f9c9e9a8d8af7b121097cde70d7015883c07bfd", "num_recent_frames": 30, "tq": 710788.649216245, "t1": 710799.689047812, "ta": 710799.689047812, "te": 710799.72729261, "first_response_s": 11.03983156697359, "answer_total_s": 11.07807636493817, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_149_a1410_q0", "video_id": 149, "time_stamp_s": 461, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9bcafd0fd37ffe49112b5a6b2092ce98a4a69f9bd16f6ef9d70a5624496e1c13", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Man performs trap bar deadlift with barbell on trap bar, standing on wooden platform.  \n- Man transitions to barbell hip thrust, lying on bench with barbell across hips.  \n- Man performs Bulgarian split squat, holding dumbbells, one leg forward, other back.\n[60-90s] - Man in grey hoodie adjusts barbell weights, preparing for lift.  \n- Gym equipment visible in background, including racks and weights.  \n- On-screen text displays \"LINEAR PERIODIZATION\" with weekly workout plans.\n[90-120s] - A man in a gym prepares for a deadlift, adjusting barbell weights while standing near a rack.  \n- He bends down, gripping the barbell, with a focus on proper form as he sets up for the lift.  \n- On-screen text indicates \"STIFF-LEG DEADLIFT: 2 SETS X 8 REPS\" and advises using 50–60% of the deadlift top set weight.\n[120-150s] - Man in grey shirt and black shorts performs deadlift with barbell, using 50-60% of his set weight.  \n- He bends at hips and knees, grips barbell, lifts it off the ground, and stands upright.  \n- After lifting, he lowers the barbell back to the ground, then repeats the motion.\n[150-180s] - Man performs leg press on machine, feet strapped, knees bent, pushing plate away.  \n- Machine displays \"20.4\" and \"45\" weight markers; yellow ball visible near machine base.  \n- Brief inset shows man in red shirt speaking, with \"RIP\" and \"FULL R0M\" logos visible.\n[180-210s] - Man performs glute-ham raise on incline machine, holding yellow grip handle.  \n- Weight stack shows 225 lbs, with barbell plates visibly loaded.  \n- Gym environment includes multiple machines and dark flooring, with overhead lighting.\n[210-240s] - Man in grey shirt adjusts barbell on rack, preparing for glute-ham raise.  \n- Man in black outfit kneels beside another man lying prone on floor, assisting with positioning.  \n- Man in grey shirt performs glute-ham raise, lifting barbell while seated on machine.\n[240-270s] - Man performs leg press exercise on machine, knees bent, feet on platform, body leaning back slightly.  \n- Yellow semi-transparent overlay appears over his lower body during movement, highlighting muscle engagement.  \n- Gym environment visible with multiple machines and equipment in background, dim lighting with purple accents.\n[270-300s] - Man performs leg press exercise, knees bent at hip level, feet on platform, body leaning back slightly.  \n- Leg press machine's footplate moves downward as man pushes, then returns to starting position.  \n- Man's posture remains consistent throughout motion, with hands resting on thighs or machine frame.\n[300-330s] - Man seated on leg press machine, legs extended, preparing to lower weight.  \n- Man adjusts machine settings, then begins lowering weight by bending knees.  \n- Split-screen shows man performing seated calf raise on left, and standing calf raise on right.\n[330-360s] - Anatomical diagram labels \"SOLEUS\" and \"GASTROCNEMIUS\" with \"less responsive\" and \"more responsive\" respectively, indicating muscle responsiveness to training.  \n- A table from a research paper highlights findings on muscle hypertrophy and plantar flexion strength, comparing high-load and low-load training effects.  \n- A person is seated on a gym machine, performing leg exercises with visible movement of the calf muscles.\n[360-390s] - Man seated on leg press machine, holding water bottle, looking down at it.  \n- Gym equipment visible in background, including weight machines and racks.  \n- Man’s legs positioned on footplate, preparing for exercise.\n[390-420s] - Man seated on leg raise machine, lifting leg while holding handles, preparing for exercise.  \n- Text overlay indicates \"Exercise 7 of 7: Roman Chair Leg Raise, 3 Sets x 10-20 Reps.\"  \n- Gym environment visible with various equipment and clothing racks in background.\n[420-450s] - Man in grey shirt and black shorts uses leg press machine, lifting leg while seated.  \n- He transitions to standing, holding a water bottle, then resumes leg press motion.  \n- Background shows gym equipment and a banner with \"INTEGRITY IS EVERYTHING\" text.", "history_tokens": 1003, "history_utf8_bytes": 4060, "recent_frame_times_s": [431.01391666666666, 432.0149166666667, 433.01591666666667, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333, 439.0052333333333, 440.00623333333334, 441.0072333333333, 442.00823333333335, 443.0092333333333, 444.01023333333336, 445.01123333333334, 446.0122333333333, 447.01323333333335, 448.0142333333333, 449.01523333333336, 450.01623333333333, 451.00055, 452.00155, 453.00255, 454.00355, 455.00455, 456.00555, 457.00655, 458.00755, 459.00855, 460.00955], "recent_frames_sha256": "8dd06acc8c0eccf8757e04cd7f9c9e9a8d8af7b121097cde70d7015883c07bfd", "num_recent_frames": 30, "tq": 710748.606116051, "t1": 710755.225679432, "ta": 710755.225679432, "te": 710755.430330491, "first_response_s": 6.6195633810712025, "answer_total_s": 6.824214440071955, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 150, "content_group": "37a00c19b000566d2e75cf3ba673b42c94448def2a919eae089eb1e67a0374be", "question": {"question_id": "sample_150_a1245_q0", "video_id": 150, "video_path": "./videos/sample_150_real.mp4", "annotation_index": 1245, "question_index": 0, "question": "What action does the man perform after taking off his gray t-shirt?", "options": ["A. Clap hands to remove the excess powder and adjusts a weightlifting belt.", "B. Does a pull-up.", "C. Puts on a black t-shirt.", "D. Walks through the gym."], "answer": "A", "time_stamp_s": 5, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_150_a1245_q0", "video_id": 150, "time_stamp_s": 5, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "09eb2497ad6ad8b608dc5372f23c30d764a626b37f4afb47fc88617ade1f9eed", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004], "recent_frames_sha256": "54f791c2224ee9f476aa48022e27dc9c6080c13d09a19f79157e82278fae5f8e", "num_recent_frames": 5, "tq": 715382.937490406, "t1": 715393.112077452, "ta": 715393.112077452, "te": 715393.150181042, "first_response_s": 10.174587046029046, "answer_total_s": 10.212690636049956, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_150_a1245_q0", "video_id": 150, "time_stamp_s": 5, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9ce261d12b4b87e910d7cfba1b4013d233bf29de8323a07fc76242e786ed6a0d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004], "recent_frames_sha256": "54f791c2224ee9f476aa48022e27dc9c6080c13d09a19f79157e82278fae5f8e", "num_recent_frames": 5, "tq": 715428.699165286, "t1": 715434.089745, "ta": 715434.089745, "te": 715434.127919304, "first_response_s": 5.390579713974148, "answer_total_s": 5.428754017921165, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 150, "content_group": "37a00c19b000566d2e75cf3ba673b42c94448def2a919eae089eb1e67a0374be", "question": {"question_id": "sample_150_a1246_q0", "video_id": 150, "video_path": "./videos/sample_150_real.mp4", "annotation_index": 1246, "question_index": 0, "question": "What is the person adjusting right now?", "options": ["A. The weight on a gym machine.", "B. A treadmill speed.", "C. A dumbbell rack.", "D. A stationary bike seat."], "answer": "A", "time_stamp_s": 182, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "gym_workout", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_150_a1246_q0", "video_id": 150, "time_stamp_s": 182, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9b1f019b2552ed9fb6b87d79f6cfc431ed05e0a29afece08398efd9a9d80af0b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665], "recent_frames_sha256": "b3173e97eb2fd176df80747c8e45bf76723e64d48857fada404aa514433028dc", "num_recent_frames": 30, "tq": 715393.174181983, "t1": 715403.043713549, "ta": 715403.043713549, "te": 715403.08136513, "first_response_s": 9.869531566044316, "answer_total_s": 9.90718314703554, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_150_a1246_q0", "video_id": 150, "time_stamp_s": 182, "ground_truth": "A", "raw_output": "A. The weight on a gym machine.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "645d390711b536aa3dd5c45e3ca25e25b14d56a28af4a21b241e119b33576d1d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Jeff Nippard is shown in a gym, performing various exercises including squats and deadlifts, with text overlays indicating \"THE ULTIMATE PUSH PULL LEGS SERIES\".\n- A man is seated at a desk with a laptop, globe, and books, appearing to present or discuss the workout series.\n- The video transitions to a man in a gym, viewed from behind, performing a movement with a barbell, with text overlays indicating \"PULL 1\" and \"PULL 2\" as part of a segmented workout plan.\n[30-60s] - Man in dark shirt gestures while seated at desk with laptop, globe, and books nearby.  \n- Split-screen shows gym scenes: man adjusting barbell, performing bench press, and another man preparing for a lift.  \n- Visuals transition to a graphic comparing \"Hypertrophy\" and \"Strength\" with a red line indicating progression.\n[60-90s] - Man in black tank top and shorts performs a deadlift, gripping barbell with feet shoulder-width apart, lifting it from floor to hip height.  \n- Gym environment features wooden paneling, multiple weight machines, and a visible \"PURE\" sign in background.  \n- Man’s posture shifts from bent-knee stance to upright position as he lifts the barbell, indicating exertion.\n[90-120s] - Man performs arm circles while standing near gym equipment, with text overlay \"ARM CIRCLES\".\n- Man executes cable external rotations using a cable machine, with text overlay \"CABLE EXTERNAL ROTATIONS\".\n- Man performs lat pulldown on a machine, with text overlay \"EXERCISE 1 OF 6 LAT PULLDOWN: 4 FEEDER SETS X 10 REPS\".\n[120-150s] - Four gym workout screens display different exercises with text labels indicating \"FEEDER SET\" and rep counts.  \n- A white arrow points from the top-right screen to the bottom-right screen, suggesting a sequence or transition.  \n- A man in a dark shirt appears seated at a desk, with a book titled \"The Art of War\" and a lamp visible beside him.\n[150-180s] - Man in black shirt performs pull-up on barbell with focused expression.  \n- Man in grey shirt sits at desk with laptop, globe, and books, gesturing while speaking.  \n- Man in black shirt performs cable pull-down exercise on gym machine, adjusting weight stack.", "history_tokens": 528, "history_utf8_bytes": 2147, "recent_frame_times_s": [152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665], "recent_frames_sha256": "b3173e97eb2fd176df80747c8e45bf76723e64d48857fada404aa514433028dc", "num_recent_frames": 30, "tq": 715473.419996734, "t1": 715478.653455999, "ta": 715478.653455999, "te": 715478.986568223, "first_response_s": 5.233459264971316, "answer_total_s": 5.566571488976479, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 150, "content_group": "37a00c19b000566d2e75cf3ba673b42c94448def2a919eae089eb1e67a0374be", "question": {"question_id": "sample_150_a1247_q0", "video_id": 150, "video_path": "./videos/sample_150_real.mp4", "annotation_index": 1247, "question_index": 0, "question": "What is the individual doing right now after shifting focus to the new exercise machine?", "options": ["A. Performing vertical pull exercises.", "B. Flexing his muscles.", "C. Performing a seated exercise targeting upper body muscles.", "D. Walking around the gym."], "answer": "C", "time_stamp_s": 373, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "gym_workout", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_150_a1247_q0", "video_id": 150, "time_stamp_s": 373, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8a9c2786e974514f5668eb368d0a4dd26a82b2d6f05a72524c1fcfd8b4b4c1c8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667], "recent_frames_sha256": "0581c65dfe5b59b9337ca9ac69da4206374b6e096772d29886442b5297e62b3d", "num_recent_frames": 30, "tq": 715403.099132467, "t1": 715411.001028481, "ta": 715411.001028481, "te": 715411.224139312, "first_response_s": 7.9018960141111165, "answer_total_s": 8.125006845104508, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_150_a1247_q0", "video_id": 150, "time_stamp_s": 373, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1ed2e76309e44985994b15c9dbb1b7ec4f9aeb3826033a450d22644bc95a2101", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Jeff Nippard is shown in a gym, performing various exercises including squats and deadlifts, with text overlays indicating \"THE ULTIMATE PUSH PULL LEGS SERIES\".\n- A man is seated at a desk with a laptop, globe, and books, appearing to present or discuss the workout series.\n- The video transitions to a man in a gym, viewed from behind, performing a movement with a barbell, with text overlays indicating \"PULL 1\" and \"PULL 2\" as part of a segmented workout plan.\n[30-60s] - Man in dark shirt gestures while seated at desk with laptop, globe, and books nearby.  \n- Split-screen shows gym scenes: man adjusting barbell, performing bench press, and another man preparing for a lift.  \n- Visuals transition to a graphic comparing \"Hypertrophy\" and \"Strength\" with a red line indicating progression.\n[60-90s] - Man in black tank top and shorts performs a deadlift, gripping barbell with feet shoulder-width apart, lifting it from floor to hip height.  \n- Gym environment features wooden paneling, multiple weight machines, and a visible \"PURE\" sign in background.  \n- Man’s posture shifts from bent-knee stance to upright position as he lifts the barbell, indicating exertion.\n[90-120s] - Man performs arm circles while standing near gym equipment, with text overlay \"ARM CIRCLES\".\n- Man executes cable external rotations using a cable machine, with text overlay \"CABLE EXTERNAL ROTATIONS\".\n- Man performs lat pulldown on a machine, with text overlay \"EXERCISE 1 OF 6 LAT PULLDOWN: 4 FEEDER SETS X 10 REPS\".\n[120-150s] - Four gym workout screens display different exercises with text labels indicating \"FEEDER SET\" and rep counts.  \n- A white arrow points from the top-right screen to the bottom-right screen, suggesting a sequence or transition.  \n- A man in a dark shirt appears seated at a desk, with a book titled \"The Art of War\" and a lamp visible beside him.\n[150-180s] - Man in black shirt performs pull-up on barbell with focused expression.  \n- Man in grey shirt sits at desk with laptop, globe, and books, gesturing while speaking.  \n- Man in black shirt performs cable pull-down exercise on gym machine, adjusting weight stack.\n[180-210s] - Man performs lat pulldown exercise on machine, pulling bar down with both hands.  \n- Text overlay indicates \"EXERCISE 1 CONT. LAT PULLDOWN: 1 MORE FAILURE SET + 30% DROPSSET\".  \n- Man adjusts grip and position while seated on machine, maintaining consistent form.\n[210-240s] - Man performs lat pulldown with barbell, showing exertion and controlled movement.  \n- Gym equipment visible in background, including weight racks and other machines.  \n- Man adjusts barbell position at start, then pulls down with focused effort.\n[240-270s] - Man performs pull-up on bar with arms extended upward, then lowers body while gripping bar.  \n- Man wears black wristband with \"BICEP\" text on right wrist, visible during grip.  \n- Barbell is attached to overhead cable machine, with man seated on bench during movement.\n[270-300s] - Man in grey shirt grips a horizontal bar, pulling it down with both hands while seated on a machine.  \n- His hands are positioned on the bar, with fingers gripping firmly, and his arms are extended upward.  \n- The bar is attached to a pulley system above, and the man is performing a pulling motion.\n[300-330s] - Man performs pull-down exercise on cable machine, gripping bar with both hands, body leaning back slightly.  \n- Gym equipment surrounds him, including weight racks and other machines in the background.  \n- His posture shifts slightly during the motion, indicating controlled movement while maintaining grip on the bar.\n[330-360s] - Man in black shirt and shorts lifts a barbell with weights, bending at the knees and hips while maintaining a straight back.  \n- He transitions to a seated position on a weight bench, adjusting the barbell's position with both hands.  \n- The gym environment features multiple weight machines and equipment in the background, with a wooden-paneled wall visible.", "history_tokens": 961, "history_utf8_bytes": 3985, "recent_frame_times_s": [343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667], "recent_frames_sha256": "0581c65dfe5b59b9337ca9ac69da4206374b6e096772d29886442b5297e62b3d", "num_recent_frames": 30, "tq": 715525.207214513, "t1": 715528.880485598, "ta": 715528.880485598, "te": 715528.920077054, "first_response_s": 3.6732710850192234, "answer_total_s": 3.7128625409677625, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 150, "content_group": "37a00c19b000566d2e75cf3ba673b42c94448def2a919eae089eb1e67a0374be", "question": {"question_id": "sample_150_a1248_q0", "video_id": 150, "video_path": "./videos/sample_150_real.mp4", "annotation_index": 1248, "question_index": 0, "question": "What type of exercise is the person performing in the left panel?", "options": ["A. High-to-Low.", "B. Mid-to-Mid.", "C. Low-to-High.", "D. Low-to-Mid."], "answer": "C", "time_stamp_s": 541, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_150_a1248_q0", "video_id": 150, "time_stamp_s": 541, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a067cf4aaea6eed19b83726fbb1b56470daf8057753b635fb6788f5dd34f721a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0008166666667, 519.0018166666666, 520.0028166666667, 521.0038166666667, 522.0048166666667, 523.0058166666666, 524.0068166666666, 525.0078166666667, 526.0088166666667, 527.0098166666667, 528.0108166666666, 529.0118166666666, 530.0128166666667, 531.0138166666667, 532.0148166666667, 533.0158166666666, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333], "recent_frames_sha256": "9269e0c528ad9d8a284cf2a1f502568b07f536f1bdaf5102ff840c98c2b11991", "num_recent_frames": 30, "tq": 715411.239291324, "t1": 715418.010670198, "ta": 715418.010670198, "te": 715418.048041616, "first_response_s": 6.77137887396384, "answer_total_s": 6.808750291937031, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_150_a1248_q0", "video_id": 150, "time_stamp_s": 541, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ee9eafbf62c22801943219ddd77ad1ad585d17c3bc26e9b6a09821025284358f", "condition_order": ["recent", "notes"], "memory": "[150-180s] - Man in black shirt performs pull-up on barbell with focused expression.  \n- Man in grey shirt sits at desk with laptop, globe, and books, gesturing while speaking.  \n- Man in black shirt performs cable pull-down exercise on gym machine, adjusting weight stack.\n[180-210s] - Man performs lat pulldown exercise on machine, pulling bar down with both hands.  \n- Text overlay indicates \"EXERCISE 1 CONT. LAT PULLDOWN: 1 MORE FAILURE SET + 30% DROPSSET\".  \n- Man adjusts grip and position while seated on machine, maintaining consistent form.\n[210-240s] - Man performs lat pulldown with barbell, showing exertion and controlled movement.  \n- Gym equipment visible in background, including weight racks and other machines.  \n- Man adjusts barbell position at start, then pulls down with focused effort.\n[240-270s] - Man performs pull-up on bar with arms extended upward, then lowers body while gripping bar.  \n- Man wears black wristband with \"BICEP\" text on right wrist, visible during grip.  \n- Barbell is attached to overhead cable machine, with man seated on bench during movement.\n[270-300s] - Man in grey shirt grips a horizontal bar, pulling it down with both hands while seated on a machine.  \n- His hands are positioned on the bar, with fingers gripping firmly, and his arms are extended upward.  \n- The bar is attached to a pulley system above, and the man is performing a pulling motion.\n[300-330s] - Man performs pull-down exercise on cable machine, gripping bar with both hands, body leaning back slightly.  \n- Gym equipment surrounds him, including weight racks and other machines in the background.  \n- His posture shifts slightly during the motion, indicating controlled movement while maintaining grip on the bar.\n[330-360s] - Man in black shirt and shorts lifts a barbell with weights, bending at the knees and hips while maintaining a straight back.  \n- He transitions to a seated position on a weight bench, adjusting the barbell's position with both hands.  \n- The gym environment features multiple weight machines and equipment in the background, with a wooden-paneled wall visible.\n[360-390s] - Man performs vertical pull on cable machine, pulling handles downward with focused posture.  \n- Man transitions to horizontal pull, seated and pulling handles across body while maintaining grip.  \n- Split-screen displays two exercises: bottom-half OB pullover and static lat stretch, with respective set and time details.\n[390-420s] - A man performs a bottom-half ob pullover on a bench, holding a dumbbell with both hands above his head.  \n- A woman performs a static lat stretch, standing with her arms extended overhead and holding a barbell.  \n- The gym setting features rows of dumbbells and weight racks in the background.\n[420-450s] - Man in blue shirt and cap points to anatomical model's shoulder and neck area with a pointer.  \n- Anatomical model displays red head, white skeleton, and colored muscle/nerve pathways.  \n- Video frame includes a watermark with \"NUTRITION\" and a YouTube URL.\n[450-480s] - Man in blue shirt and cap holds a cable machine handle near a red-and-white anatomical model.  \n- Anatomical model displays skeletal structure with red organs and labeled parts.  \n- Man gestures toward the model while standing in a gym setting.\n[480-510s] - Man in dark shirt and shorts is bent over a barbell, gripping it with both hands, preparing for a lift.  \n- He is positioned in a gym with various weight machines and equipment visible in the background.  \n- His knees are bent, and he appears to be in a squatting position, ready to lift the barbell.\n[510-540s] - Man in black shirt performs barbell row with bent knees, gripping barbell overhead.  \n- Man in gray shirt performs dumbbell face pull, standing upright with dumbbells in hands.  \n- On-screen text labels exercise as \"OMNI-DIRECTION FACE PULL: 3 X 12-15 REPS\" and displays three movement patterns: \"LOW-TO-HIGH,\" \"MID-TO-MID,\" \"HIGH-TO-LOW.\"", "history_tokens": 960, "history_utf8_bytes": 3949, "recent_frame_times_s": [511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0008166666667, 519.0018166666666, 520.0028166666667, 521.0038166666667, 522.0048166666667, 523.0058166666666, 524.0068166666666, 525.0078166666667, 526.0088166666667, 527.0098166666667, 528.0108166666666, 529.0118166666666, 530.0128166666667, 531.0138166666667, 532.0148166666667, 533.0158166666666, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333], "recent_frames_sha256": "9269e0c528ad9d8a284cf2a1f502568b07f536f1bdaf5102ff840c98c2b11991", "num_recent_frames": 30, "tq": 715575.04170624, "t1": 715581.921869431, "ta": 715581.921869431, "te": 715582.117701872, "first_response_s": 6.880163191002794, "answer_total_s": 7.075995631981641, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 150, "content_group": "37a00c19b000566d2e75cf3ba673b42c94448def2a919eae089eb1e67a0374be", "question": {"question_id": "sample_150_a1249_q0", "video_id": 150, "video_path": "./videos/sample_150_real.mp4", "annotation_index": 1249, "question_index": 0, "question": "What is positioned above the books on the man's desk?", "options": ["A. A potted plant.", "B. A laptop.", "C. A microphone.", "D. A globe."], "answer": "D", "time_stamp_s": 701, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "gym_workout", "reference_interval_s": [660, 701], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_150_a1249_q0", "video_id": 150, "time_stamp_s": 701, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "be5db47f28ee8c123ee3a8084e8b6abd5fca0284ddb8e632622a5715dfaca701", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [671.0036666666666, 672.0046666666667, 673.0056666666667, 674.0066666666667, 675.0076666666666, 676.0086666666666, 677.0096666666667, 678.0106666666667, 679.0116666666667, 680.0126666666666, 681.0136666666667, 682.0146666666667, 683.0156666666667, 684.0166666666667, 685.0009833333334, 686.0019833333333, 687.0029833333333, 688.0039833333333, 689.0049833333334, 690.0059833333333, 691.0069833333333, 692.0079833333333, 693.0089833333334, 694.0099833333334, 695.0109833333333, 696.0119833333333, 697.0129833333333, 698.0139833333334, 699.0149833333334, 700.0159833333333], "recent_frames_sha256": "9fe9862e2dfc21b513d2c7d935f7b0694ac2e825dc424e65f433ab3ded135da1", "num_recent_frames": 30, "tq": 715418.065158264, "t1": 715428.653179004, "ta": 715428.653179004, "te": 715428.691020017, "first_response_s": 10.588020739960484, "answer_total_s": 10.625861753011122, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_150_a1249_q0", "video_id": 150, "time_stamp_s": 701, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "54863bb2ca0efc4d0462a26a73d754b6449241d205ae0bd05d0fad73c7f63569", "condition_order": ["recent", "notes"], "memory": "[300-330s] - Man performs pull-down exercise on cable machine, gripping bar with both hands, body leaning back slightly.  \n- Gym equipment surrounds him, including weight racks and other machines in the background.  \n- His posture shifts slightly during the motion, indicating controlled movement while maintaining grip on the bar.\n[330-360s] - Man in black shirt and shorts lifts a barbell with weights, bending at the knees and hips while maintaining a straight back.  \n- He transitions to a seated position on a weight bench, adjusting the barbell's position with both hands.  \n- The gym environment features multiple weight machines and equipment in the background, with a wooden-paneled wall visible.\n[360-390s] - Man performs vertical pull on cable machine, pulling handles downward with focused posture.  \n- Man transitions to horizontal pull, seated and pulling handles across body while maintaining grip.  \n- Split-screen displays two exercises: bottom-half OB pullover and static lat stretch, with respective set and time details.\n[390-420s] - A man performs a bottom-half ob pullover on a bench, holding a dumbbell with both hands above his head.  \n- A woman performs a static lat stretch, standing with her arms extended overhead and holding a barbell.  \n- The gym setting features rows of dumbbells and weight racks in the background.\n[420-450s] - Man in blue shirt and cap points to anatomical model's shoulder and neck area with a pointer.  \n- Anatomical model displays red head, white skeleton, and colored muscle/nerve pathways.  \n- Video frame includes a watermark with \"NUTRITION\" and a YouTube URL.\n[450-480s] - Man in blue shirt and cap holds a cable machine handle near a red-and-white anatomical model.  \n- Anatomical model displays skeletal structure with red organs and labeled parts.  \n- Man gestures toward the model while standing in a gym setting.\n[480-510s] - Man in dark shirt and shorts is bent over a barbell, gripping it with both hands, preparing for a lift.  \n- He is positioned in a gym with various weight machines and equipment visible in the background.  \n- His knees are bent, and he appears to be in a squatting position, ready to lift the barbell.\n[510-540s] - Man in black shirt performs barbell row with bent knees, gripping barbell overhead.  \n- Man in gray shirt performs dumbbell face pull, standing upright with dumbbells in hands.  \n- On-screen text labels exercise as \"OMNI-DIRECTION FACE PULL: 3 X 12-15 REPS\" and displays three movement patterns: \"LOW-TO-HIGH,\" \"MID-TO-MID,\" \"HIGH-TO-LOW.\"\n[540-570s] - Man in grey shirt and green shorts performs EZ-bar dumbbell curls with a barbell, standing in a gym.  \n- Text overlay indicates \"EXERCISE 5 OF 6\" and \"EZ-BAR DICEP CURL: 3 X 3-R REP\".  \n- Man is positioned facing away from the camera, with gym equipment visible in the background.\n[570-600s] - Man performs dumbbell curls with a barbell, lifting weights while standing.  \n- He maintains a steady posture, with dumbbells positioned at shoulder height.  \n- Gym equipment and benches are visible in the background, indicating a fitness center setting.\n[600-630s] - Man performs bottom-half-only preacher curl with dumbbell, seated on bench, focusing on elbow flexion.  \n- Background shows another person exercising on a bench, slightly blurred.  \n- On-screen text displays exercise name and rep count: \"BOTTOM-HALF DB PREACHER CURL: 2 X 10-12 REPS\".\n[630-660s] - Man in black shirt and shorts performs dumbbell curls on a gym machine, focusing on his biceps.  \n- He grips a dumbbell with both hands, maintaining a seated position on the machine, and executes controlled curls.  \n- The gym environment features various weight machines and racks in the background, with no visible text or clock.\n[660-690s] - Man in gym performs dumbbell curls while seated, holding weights with both hands.  \n- Man at desk speaks into microphone, gesturing with hands, with globe and books beside laptop.  \n- Barbell graphic appears on screen with text \"THE ULTIMATE PUSH PULL LEGS SYSTEM\" and \"RISE\" branding.", "history_tokens": 993, "history_utf8_bytes": 4046, "recent_frame_times_s": [671.0036666666666, 672.0046666666667, 673.0056666666667, 674.0066666666667, 675.0076666666666, 676.0086666666666, 677.0096666666667, 678.0106666666667, 679.0116666666667, 680.0126666666666, 681.0136666666667, 682.0146666666667, 683.0156666666667, 684.0166666666667, 685.0009833333334, 686.0019833333333, 687.0029833333333, 688.0039833333333, 689.0049833333334, 690.0059833333333, 691.0069833333333, 692.0079833333333, 693.0089833333334, 694.0099833333334, 695.0109833333333, 696.0119833333333, 697.0129833333333, 698.0139833333334, 699.0149833333334, 700.0159833333333], "recent_frames_sha256": "9fe9862e2dfc21b513d2c7d935f7b0694ac2e825dc424e65f433ab3ded135da1", "num_recent_frames": 30, "tq": 715623.003896778, "t1": 715624.806312965, "ta": 715624.806312965, "te": 715624.969616134, "first_response_s": 1.8024161870125681, "answer_total_s": 1.9657193559687585, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 151, "content_group": "e9efc22c93b2c95ae6471a5a8aff589588ff97de784a6970164aedcdbc0cad7b", "question": {"question_id": "sample_151_a516_q0", "video_id": 151, "video_path": "./videos/sample_151_real.mp4", "annotation_index": 516, "question_index": 0, "question": "What is the woman in the white dress doing when the scene transitions?", "options": ["A. Dancing.", "B. Styling another person's hair.", "C. Getting her hair styled by another person.", "D. Eating."], "answer": "C", "time_stamp_s": 10, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_151_a516_q0", "video_id": 151, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "925cfe8949fc17b6d4947ef976b1bd45254f7722432e04f18d9e5422099a785f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "442991af473ba255e3bff592263977f5c4d97920c507ce80b82159271f029b84", "num_recent_frames": 11, "tq": 719362.734385832, "t1": 719376.118879941, "ta": 719376.118879941, "te": 719376.158104043, "first_response_s": 13.384494108962826, "answer_total_s": 13.423718211008236, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_151_a516_q0", "video_id": 151, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1a079470264aaff28d45f526fc1aa3f0bc72f1b8027dba17d3f0eee7966daf08", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "442991af473ba255e3bff592263977f5c4d97920c507ce80b82159271f029b84", "num_recent_frames": 11, "tq": 719410.256705217, "t1": 719417.002035664, "ta": 719417.002035664, "te": 719417.201737663, "first_response_s": 6.74533044709824, "answer_total_s": 6.945032446063124, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 151, "content_group": "e9efc22c93b2c95ae6471a5a8aff589588ff97de784a6970164aedcdbc0cad7b", "question": {"question_id": "sample_151_a517_q0", "video_id": 151, "video_path": "./videos/sample_151_real.mp4", "annotation_index": 517, "question_index": 0, "question": "What is the color of the undershirt worn by the woman on the left?", "options": ["A. Black.", "B. White.", "C. Red.", "D. Blue."], "answer": "B", "time_stamp_s": 115, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_151_a517_q0", "video_id": 151, "time_stamp_s": 115, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "70f52ef6cc3ac658c91c25c4ed49aa94b03c0f0996bb83d2f2404e81daac2359", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0], "recent_frames_sha256": "b4a17a851805ee6197daefef8f445d14ee4f0db8de44a23201d56d3fa3d33482", "num_recent_frames": 30, "tq": 719376.181559617, "t1": 719383.676776047, "ta": 719383.676776047, "te": 719383.717149073, "first_response_s": 7.495216429932043, "answer_total_s": 7.535589455976151, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_151_a517_q0", "video_id": 151, "time_stamp_s": 115, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "271939b693e5ec8e589c18be59f7271f7bb892fa56e58c75edf7356e360f5290", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A woman in a white gown sits as another woman styles her curly hair and adjusts her attire.  \n- A bowl of grapes, pomegranate, and figs rests on a wooden surface in the background.  \n- The setting features a room with patterned walls, wall-mounted lamps, and a wooden bench.\n[30-60s] - A woman in a light-colored robe sits calmly while another person adjusts a decorative garter on her thigh.  \n- The garter, featuring ornate metalwork, is being fastened around her knee by a hand wearing a light blue sleeve.  \n- A third person, dressed in a red and white outfit with a white cap, stands nearby, observing the process.\n[60-90s] - A person in a light blue shirt is tying the laces of a white shoe with black polka dots on a foot wearing a white sock.  \n- The shoe is being fastened around the ankle, with the person’s hands actively manipulating the laces.  \n- A second white shoe with similar design is visible on the floor nearby, suggesting the person is in the process of putting on both shoes.", "history_tokens": 245, "history_utf8_bytes": 1010, "recent_frame_times_s": [86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0], "recent_frames_sha256": "b4a17a851805ee6197daefef8f445d14ee4f0db8de44a23201d56d3fa3d33482", "num_recent_frames": 30, "tq": 719436.270132413, "t1": 719443.630645948, "ta": 719443.630645948, "te": 719443.821258813, "first_response_s": 7.360513534978963, "answer_total_s": 7.551126400008798, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 151, "content_group": "e9efc22c93b2c95ae6471a5a8aff589588ff97de784a6970164aedcdbc0cad7b", "question": {"question_id": "sample_151_a517_q1", "video_id": 151, "video_path": "./videos/sample_151_real.mp4", "annotation_index": 517, "question_index": 1, "question": "What activity are the two women primarily engaged in?", "options": ["A. Cooking.", "B. Cleaning.", "C. Dressing.", "D. Sewing."], "answer": "C", "time_stamp_s": 120, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_151_a517_q1", "video_id": 151, "time_stamp_s": 120, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9b5fcea46a7ab29e54b6f9c33788e1f3ee8450c9bd4a322742a0e9decdb401aa", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0], "recent_frames_sha256": "ba59a3c56ef2693dc81f1a26c9e3d302e767a51615863c870dd409f274565bcd", "num_recent_frames": 30, "tq": 719383.739321099, "t1": 719395.929816793, "ta": 719395.929816793, "te": 719396.15752306, "first_response_s": 12.190495693939738, "answer_total_s": 12.41820196097251, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_151_a517_q1", "video_id": 151, "time_stamp_s": 120, "ground_truth": "C", "raw_output": "C. Dressing.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "771526a31d098864ff1fa94fbc395f3cd82792af0d54b15e47cbfd03112de250", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A woman in a white gown sits as another woman styles her curly hair and adjusts her attire.  \n- A bowl of grapes, pomegranate, and figs rests on a wooden surface in the background.  \n- The setting features a room with patterned walls, wall-mounted lamps, and a wooden bench.\n[30-60s] - A woman in a light-colored robe sits calmly while another person adjusts a decorative garter on her thigh.  \n- The garter, featuring ornate metalwork, is being fastened around her knee by a hand wearing a light blue sleeve.  \n- A third person, dressed in a red and white outfit with a white cap, stands nearby, observing the process.\n[60-90s] - A person in a light blue shirt is tying the laces of a white shoe with black polka dots on a foot wearing a white sock.  \n- The shoe is being fastened around the ankle, with the person’s hands actively manipulating the laces.  \n- A second white shoe with similar design is visible on the floor nearby, suggesting the person is in the process of putting on both shoes.\n[90-120s] - A woman in a light blue long-sleeved top and white apron helps another woman put on a dark blue dress with a white blouse underneath.  \n- The assisting woman adjusts the dress’s neckline and ties the lacing at the back, ensuring proper fit.  \n- The woman receiving help has curly hair and is standing still while the dress is being fastened.", "history_tokens": 329, "history_utf8_bytes": 1366, "recent_frame_times_s": [91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0], "recent_frames_sha256": "ba59a3c56ef2693dc81f1a26c9e3d302e767a51615863c870dd409f274565bcd", "num_recent_frames": 30, "tq": 719454.935317513, "t1": 719455.918028346, "ta": 719455.918028346, "te": 719456.102941373, "first_response_s": 0.9827108330791816, "answer_total_s": 1.1676238600630313, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 151, "content_group": "e9efc22c93b2c95ae6471a5a8aff589588ff97de784a6970164aedcdbc0cad7b", "question": {"question_id": "sample_151_a518_q0", "video_id": 151, "video_path": "./videos/sample_151_real.mp4", "annotation_index": 518, "question_index": 0, "question": "What color is the assistant's dress?", "options": ["A. Blue and red.", "B. Red and white.", "C. Green and red.", "D. Purple and white."], "answer": "B", "time_stamp_s": 206, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_151_a518_q0", "video_id": 151, "time_stamp_s": 206, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "59130133f11c505243d00f64f2c9f2e37803d2a385dee28ba04950057d150a5b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0], "recent_frames_sha256": "4a4bda8b23dc3d40dc331497e3b202a0a2ebf8e9dadf3ac694c263f2c3f70b0f", "num_recent_frames": 30, "tq": 719396.174284624, "t1": 719402.983737386, "ta": 719402.983737386, "te": 719403.020583063, "first_response_s": 6.809452761895955, "answer_total_s": 6.846298438962549, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_151_a518_q0", "video_id": 151, "time_stamp_s": 206, "ground_truth": "B", "raw_output": "B. Red and white.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "068ee5da2ad0c07784a309fc42cb0713641badbe959c0b7a9a3288b8a1dab076", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A woman in a white gown sits as another woman styles her curly hair and adjusts her attire.  \n- A bowl of grapes, pomegranate, and figs rests on a wooden surface in the background.  \n- The setting features a room with patterned walls, wall-mounted lamps, and a wooden bench.\n[30-60s] - A woman in a light-colored robe sits calmly while another person adjusts a decorative garter on her thigh.  \n- The garter, featuring ornate metalwork, is being fastened around her knee by a hand wearing a light blue sleeve.  \n- A third person, dressed in a red and white outfit with a white cap, stands nearby, observing the process.\n[60-90s] - A person in a light blue shirt is tying the laces of a white shoe with black polka dots on a foot wearing a white sock.  \n- The shoe is being fastened around the ankle, with the person’s hands actively manipulating the laces.  \n- A second white shoe with similar design is visible on the floor nearby, suggesting the person is in the process of putting on both shoes.\n[90-120s] - A woman in a light blue long-sleeved top and white apron helps another woman put on a dark blue dress with a white blouse underneath.  \n- The assisting woman adjusts the dress’s neckline and ties the lacing at the back, ensuring proper fit.  \n- The woman receiving help has curly hair and is standing still while the dress is being fastened.\n[120-150s] - A woman in a dark dress stands still while another woman in a red apron adjusts her corset.  \n- The second woman bends to retrieve a yellow cloth from a wooden chest, then unfolds it.  \n- The first woman’s white sleeves are being pulled up by the second woman’s gloved hand, revealing a golden satin sleeve underneath.\n[150-180s] - A person in a light blue shirt adjusts a yellow satin sleeve on another person’s arm.  \n- The person being dressed wears a dark blue dress with gold buttons and a white collar.  \n- The yellow sleeve is being pulled over the arm, transitioning from a draped position to being fully secured.", "history_tokens": 479, "history_utf8_bytes": 2007, "recent_frame_times_s": [177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0], "recent_frames_sha256": "4a4bda8b23dc3d40dc331497e3b202a0a2ebf8e9dadf3ac694c263f2c3f70b0f", "num_recent_frames": 30, "tq": 719470.835524977, "t1": 719472.419808576, "ta": 719472.419808576, "te": 719472.658774651, "first_response_s": 1.5842835990479216, "answer_total_s": 1.8232496740529314, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 151, "content_group": "e9efc22c93b2c95ae6471a5a8aff589588ff97de784a6970164aedcdbc0cad7b", "question": {"question_id": "sample_151_a519_q0", "video_id": 151, "video_path": "./videos/sample_151_real.mp4", "annotation_index": 519, "question_index": 0, "question": "What is the man with medium-length, curly, white hair wearing?", "options": ["A. A white top with a black neckline.", "B. A black top with a white neckline.", "C. A dark robe with yellow-gold sleeves.", "D. A dress with intricate gold stitching."], "answer": "B", "time_stamp_s": 319, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_151_a519_q0", "video_id": 151, "time_stamp_s": 319, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "52d97cf7ecf10850d40e484335eaf8649db1d5af2a0e9a04f3e314b31e90f487", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0], "recent_frames_sha256": "d74ca69d65cb49684f8b0a8972d216322ed79eca187fe4818047b5d978741542", "num_recent_frames": 30, "tq": 719403.032564364, "t1": 719410.20769029, "ta": 719410.20769029, "te": 719410.245209479, "first_response_s": 7.17512592591811, "answer_total_s": 7.212645114981569, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_151_a519_q0", "video_id": 151, "time_stamp_s": 319, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "adc123c176535b56ab19d16d725385496c87b3374708efe35ac9d28f61ed318b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A woman in a white gown sits as another woman styles her curly hair and adjusts her attire.  \n- A bowl of grapes, pomegranate, and figs rests on a wooden surface in the background.  \n- The setting features a room with patterned walls, wall-mounted lamps, and a wooden bench.\n[30-60s] - A woman in a light-colored robe sits calmly while another person adjusts a decorative garter on her thigh.  \n- The garter, featuring ornate metalwork, is being fastened around her knee by a hand wearing a light blue sleeve.  \n- A third person, dressed in a red and white outfit with a white cap, stands nearby, observing the process.\n[60-90s] - A person in a light blue shirt is tying the laces of a white shoe with black polka dots on a foot wearing a white sock.  \n- The shoe is being fastened around the ankle, with the person’s hands actively manipulating the laces.  \n- A second white shoe with similar design is visible on the floor nearby, suggesting the person is in the process of putting on both shoes.\n[90-120s] - A woman in a light blue long-sleeved top and white apron helps another woman put on a dark blue dress with a white blouse underneath.  \n- The assisting woman adjusts the dress’s neckline and ties the lacing at the back, ensuring proper fit.  \n- The woman receiving help has curly hair and is standing still while the dress is being fastened.\n[120-150s] - A woman in a dark dress stands still while another woman in a red apron adjusts her corset.  \n- The second woman bends to retrieve a yellow cloth from a wooden chest, then unfolds it.  \n- The first woman’s white sleeves are being pulled up by the second woman’s gloved hand, revealing a golden satin sleeve underneath.\n[150-180s] - A person in a light blue shirt adjusts a yellow satin sleeve on another person’s arm.  \n- The person being dressed wears a dark blue dress with gold buttons and a white collar.  \n- The yellow sleeve is being pulled over the arm, transitioning from a draped position to being fully secured.\n[180-210s] - A woman in a yellow and black dress stands facing away, while another woman in a red apron and white cap adjusts a dark, sheer garment over her shoulders.  \n- The second woman holds the garment’s edge, preparing to drape it over the first woman’s arms, who remains still with hands clasped.  \n- The room features a wooden bench, a chair with a draped cloth, and wall sconces, with a decorative border along the lower wall.\n[210-240s] - A woman in a dark green gown with gold trim is seated, holding a small object, while another woman in a red and white dress stands beside her.  \n- The standing woman adjusts the seated woman’s robe, then moves to a wooden chest, retrieving a long, dark fabric item.  \n- The seated woman’s hair is styled in an elaborate updo with a decorative headpiece, and she appears calm and composed.\n[240-270s] - Woman in orange dress stands beside seated woman, holding a long stick to adjust the veil.  \n- Seated woman wears a dark gown and black veil, her hair being styled by the other woman.  \n- Room features white walls with decorative border, wooden bench, and wall-mounted candle sconces.\n[270-300s] - A brush applies thick black paint to a dark surface, leaving visible strokes and drips.  \n- A man with gray hair and a beard, wearing a dark vest over a white shirt, holds a palette and looks at a canvas.  \n- A woman with dark hair and a veil is shown in a bright outdoor setting, looking down with her hand near her face.", "history_tokens": 838, "history_utf8_bytes": 3487, "recent_frame_times_s": [290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0], "recent_frames_sha256": "d74ca69d65cb49684f8b0a8972d216322ed79eca187fe4818047b5d978741542", "num_recent_frames": 30, "tq": 719510.723145846, "t1": 719511.508337768, "ta": 719511.508337768, "te": 719511.659584174, "first_response_s": 0.7851919219829142, "answer_total_s": 0.9364383280044422, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 152, "content_group": "45537a1b7f48d35893b47eb5b4dbbb8eccca055f7c135b92622366b6fc2284b3", "question": {"question_id": "sample_152_a1650_q0", "video_id": 152, "video_path": "./videos/sample_152_real.mp4", "annotation_index": 1650, "question_index": 0, "question": "What item does the video start with someone picking up?", "options": ["A. A decorative hair comb.", "B. A wooden comb.", "C. A hand mirror.", "D. A jeweled necklace."], "answer": "A", "time_stamp_s": 2, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_152_a1650_q0", "video_id": 152, "time_stamp_s": 2, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "227999210ee2dd88f7201109e6159f91375624659077de60a1642fbbc54efaf7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0], "recent_frames_sha256": "63864bb7d05ba3806b77b9db1e5f2351110b8951cdc164a35de5e88ed00950f8", "num_recent_frames": 3, "tq": 718494.616757505, "t1": 718499.985694521, "ta": 718499.985694521, "te": 718500.026296337, "first_response_s": 5.3689370159991086, "answer_total_s": 5.409538832027465, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_152_a1650_q0", "video_id": 152, "time_stamp_s": 2, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4beee8584e688a96172eed10b97787bc6d32675e9fd37093cb22756c45c3f38d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0], "recent_frames_sha256": "63864bb7d05ba3806b77b9db1e5f2351110b8951cdc164a35de5e88ed00950f8", "num_recent_frames": 3, "tq": 718546.068988685, "t1": 718552.9302246, "ta": 718552.9302246, "te": 718552.967871321, "first_response_s": 6.861235914984718, "answer_total_s": 6.898882635985501, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 152, "content_group": "45537a1b7f48d35893b47eb5b4dbbb8eccca055f7c135b92622366b6fc2284b3", "question": {"question_id": "sample_152_a1651_q0", "video_id": 152, "video_path": "./videos/sample_152_real.mp4", "annotation_index": 1651, "question_index": 0, "question": "What are the colors of the corset and its trim worn by the person?", "options": ["A. Light brown with white stripes and black lace trim.", "B. Light brown with black stripes and white lace trim.", "C. White with black stripes and light brown lace trim.", "D. Black with white stripes and brown lace trim."], "answer": "B", "time_stamp_s": 104, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_152_a1651_q0", "video_id": 152, "time_stamp_s": 104, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e6ce696cdfde5dc1a2c7b58087fe36ec12f381f9ebc2dcef7b8560259ebe5e45", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0], "recent_frames_sha256": "2a2082d272c7582f09a7b3ff68e4fd14871d9dad1fe07daa93e34d187b3481c3", "num_recent_frames": 30, "tq": 718500.04295081, "t1": 718514.400814429, "ta": 718514.400814429, "te": 718514.441299104, "first_response_s": 14.357863618992269, "answer_total_s": 14.398348293965682, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_152_a1651_q0", "video_id": 152, "time_stamp_s": 104, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "275ccc4de6424ae74f94a96605cfc32f6b29c989e0a755f7fc641f59cc35664f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A woman in a dark dress styles another woman's hair with a decorative comb while she sits in a white robe.  \n- The styled woman holds a gold-framed mirror, examining her hair as the stylist adjusts it.  \n- A close-up shows a leg with a white sock featuring a blue floral pattern, resting on a patterned rug.\n[30-60s] - Woman in white dress adjusts her thigh-high stockings while seated.  \n- She ties a decorative ribbon around her calf, securing the stocking.  \n- Her hair is styled in loose curls, and she appears focused on the task.\n[60-90s] - Woman adjusts white dress with ruffled sleeves and lace trim, pulling it over her body.  \n- She then holds up a beige corset with black vertical stripes and lace detailing, preparing to wear it.  \n- Corset is positioned over her torso, with hands near the front lacing, indicating readiness to fasten.", "history_tokens": 205, "history_utf8_bytes": 858, "recent_frame_times_s": [75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0], "recent_frames_sha256": "2a2082d272c7582f09a7b3ff68e4fd14871d9dad1fe07daa93e34d187b3481c3", "num_recent_frames": 30, "tq": 718580.234092541, "t1": 718581.573959082, "ta": 718581.573959082, "te": 718581.611786722, "first_response_s": 1.3398665409768, "answer_total_s": 1.3776941809337586, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 152, "content_group": "45537a1b7f48d35893b47eb5b4dbbb8eccca055f7c135b92622366b6fc2284b3", "question": {"question_id": "sample_152_a1651_q1", "video_id": 152, "video_path": "./videos/sample_152_real.mp4", "annotation_index": 1651, "question_index": 1, "question": "What action did the person just perform?", "options": ["A. Fastening the metal clasps.", "B. Adjusting the white dress.", "C. Tightening the corset laces.", "D. Lowering their arms."], "answer": "C", "time_stamp_s": 109, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_152_a1651_q1", "video_id": 152, "time_stamp_s": 109, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7ae682e82c10457eee8b59a15e68b6e772f599818669ee73a36655d5c0986fa0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0], "recent_frames_sha256": "ffeb7f66aea75ae6d9a20d096005fcfb554ac724a0d4cfcf4945bcbf4db53b17", "num_recent_frames": 30, "tq": 718514.459475023, "t1": 718521.594697035, "ta": 718521.594697035, "te": 718521.633845577, "first_response_s": 7.135222012060694, "answer_total_s": 7.17437055404298, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_152_a1651_q1", "video_id": 152, "time_stamp_s": 109, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9f440a14e1b944be6500beceb86826d92c2c437bc9b89a33992b3658f107d839", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A woman in a dark dress styles another woman's hair with a decorative comb while she sits in a white robe.  \n- The styled woman holds a gold-framed mirror, examining her hair as the stylist adjusts it.  \n- A close-up shows a leg with a white sock featuring a blue floral pattern, resting on a patterned rug.\n[30-60s] - Woman in white dress adjusts her thigh-high stockings while seated.  \n- She ties a decorative ribbon around her calf, securing the stocking.  \n- Her hair is styled in loose curls, and she appears focused on the task.\n[60-90s] - Woman adjusts white dress with ruffled sleeves and lace trim, pulling it over her body.  \n- She then holds up a beige corset with black vertical stripes and lace detailing, preparing to wear it.  \n- Corset is positioned over her torso, with hands near the front lacing, indicating readiness to fasten.", "history_tokens": 205, "history_utf8_bytes": 858, "recent_frame_times_s": [80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0], "recent_frames_sha256": "ffeb7f66aea75ae6d9a20d096005fcfb554ac724a0d4cfcf4945bcbf4db53b17", "num_recent_frames": 30, "tq": 718581.64557443, "t1": 718595.773688455, "ta": 718595.773688455, "te": 718595.814742536, "first_response_s": 14.128114024992101, "answer_total_s": 14.169168106047437, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 152, "content_group": "45537a1b7f48d35893b47eb5b4dbbb8eccca055f7c135b92622366b6fc2284b3", "question": {"question_id": "sample_152_a1652_q0", "video_id": 152, "video_path": "./videos/sample_152_real.mp4", "annotation_index": 1652, "question_index": 0, "question": "What is the left side person holding in his hands?", "options": ["A. A white garment.", "B. A black hat.", "C. A book.", "D. A pair of shoes."], "answer": "A", "time_stamp_s": 205, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_152_a1652_q0", "video_id": 152, "time_stamp_s": 205, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3fb7aee6d5a6ff2520d6411c14ec43b988b11a5a96b24a84591b488f9692c616", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0], "recent_frames_sha256": "76da50e7080d63512759d3953308b6945dad8c21a887d093243951d94ba75afa", "num_recent_frames": 30, "tq": 718521.655293349, "t1": 718537.432234212, "ta": 718537.432234212, "te": 718537.471804474, "first_response_s": 15.77694086311385, "answer_total_s": 15.816511125070974, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_152_a1652_q0", "video_id": 152, "time_stamp_s": 205, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a216d076da6a62a6e78366aa980ef7ba94d3a3f515078d5c5a3c7dd6e9972bdd", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A woman in a dark dress styles another woman's hair with a decorative comb while she sits in a white robe.  \n- The styled woman holds a gold-framed mirror, examining her hair as the stylist adjusts it.  \n- A close-up shows a leg with a white sock featuring a blue floral pattern, resting on a patterned rug.\n[30-60s] - Woman in white dress adjusts her thigh-high stockings while seated.  \n- She ties a decorative ribbon around her calf, securing the stocking.  \n- Her hair is styled in loose curls, and she appears focused on the task.\n[60-90s] - Woman adjusts white dress with ruffled sleeves and lace trim, pulling it over her body.  \n- She then holds up a beige corset with black vertical stripes and lace detailing, preparing to wear it.  \n- Corset is positioned over her torso, with hands near the front lacing, indicating readiness to fasten.\n[90-120s] - Person fastens black laces on beige corset with vertical black stripes, securing it at the back.\n- Corset has decorative lace trim at the top and is worn over a white garment.\n- Background shows a wooden dresser and a bed with white bedding, suggesting a bedroom setting.\n[120-150s] - A person in a dark floral dress adjusts the white lacing of a corset on another person’s waist.  \n- The second person, wearing a beige corset and striped skirt, stands with their back to the camera, facing a wooden dresser.  \n- The person in the floral dress bends down to secure the lacing at the lower part of the skirt, near the floor.\n[150-180s] - A hand adjusts a dark, sparkly garment's back seam near the waist.\n- The same hand fastens silver laces on a white boot, which has a blue tree design on the sock.\n- The person, wearing a corset and white dress, stands in a room with pink wallpaper and a wooden dresser.", "history_tokens": 435, "history_utf8_bytes": 1779, "recent_frame_times_s": [176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0], "recent_frames_sha256": "76da50e7080d63512759d3953308b6945dad8c21a887d093243951d94ba75afa", "num_recent_frames": 30, "tq": 718618.32271297, "t1": 718625.976922331, "ta": 718625.976922331, "te": 718626.34994934, "first_response_s": 7.654209361062385, "answer_total_s": 8.027236370020546, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 152, "content_group": "45537a1b7f48d35893b47eb5b4dbbb8eccca055f7c135b92622366b6fc2284b3", "question": {"question_id": "sample_152_a1653_q0", "video_id": 152, "video_path": "./videos/sample_152_real.mp4", "annotation_index": 1653, "question_index": 0, "question": "What is hanging on the mirror right now?", "options": ["A. White gloves.", "B. A hat.", "C. A scarf.", "D. A necklace."], "answer": "A", "time_stamp_s": 310, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_152_a1653_q0", "video_id": 152, "time_stamp_s": 310, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "daf63f287671e4dbf596398ea63f0ce2e31ccab564f3b490890f8a4336bef545", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0], "recent_frames_sha256": "208cde07faf3be2f725f805873fe3d1e763655c499ed3f0e125af363f7913277", "num_recent_frames": 30, "tq": 718537.494885482, "t1": 718546.01730977, "ta": 718546.01730977, "te": 718546.055029487, "first_response_s": 8.522424287977628, "answer_total_s": 8.560144004994072, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_152_a1653_q0", "video_id": 152, "time_stamp_s": 310, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "73ee80a86a1fd7fdba1575d41a0cfea2a0724213dc6c6ffca44a7f30723f3746", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A woman in a dark dress styles another woman's hair with a decorative comb while she sits in a white robe.  \n- The styled woman holds a gold-framed mirror, examining her hair as the stylist adjusts it.  \n- A close-up shows a leg with a white sock featuring a blue floral pattern, resting on a patterned rug.\n[30-60s] - Woman in white dress adjusts her thigh-high stockings while seated.  \n- She ties a decorative ribbon around her calf, securing the stocking.  \n- Her hair is styled in loose curls, and she appears focused on the task.\n[60-90s] - Woman adjusts white dress with ruffled sleeves and lace trim, pulling it over her body.  \n- She then holds up a beige corset with black vertical stripes and lace detailing, preparing to wear it.  \n- Corset is positioned over her torso, with hands near the front lacing, indicating readiness to fasten.\n[90-120s] - Person fastens black laces on beige corset with vertical black stripes, securing it at the back.\n- Corset has decorative lace trim at the top and is worn over a white garment.\n- Background shows a wooden dresser and a bed with white bedding, suggesting a bedroom setting.\n[120-150s] - A person in a dark floral dress adjusts the white lacing of a corset on another person’s waist.  \n- The second person, wearing a beige corset and striped skirt, stands with their back to the camera, facing a wooden dresser.  \n- The person in the floral dress bends down to secure the lacing at the lower part of the skirt, near the floor.\n[150-180s] - A hand adjusts a dark, sparkly garment's back seam near the waist.\n- The same hand fastens silver laces on a white boot, which has a blue tree design on the sock.\n- The person, wearing a corset and white dress, stands in a room with pink wallpaper and a wooden dresser.\n[180-210s] - A person in a dark patterned outfit adjusts a beige corset with black lacing on a woman’s back.  \n- The woman, wearing a white skirt, stands with her back to the camera while the corset is being fastened.  \n- The setting includes a wooden dresser and a bed with a white frame in the background.\n[210-240s] - Woman in white lace dress buttons front corset with both hands.  \n- She adjusts corset straps and smooths fabric as she fastens buttons.  \n- Green striped garment is lifted and draped over her shoulders, partially obscuring her upper body.\n[240-270s] - A woman in a dark, sparkly top adjusts her hair, which is styled in a braid.  \n- She is wearing a teal and black striped dress with lace trim, and her hands are busy tying a ribbon around her waist.  \n- The background features a pink wallpaper with a repeating pattern and a wooden piece of furniture.\n[270-300s] - Woman adjusts lace-trimmed neckline of striped dress while standing.  \n- She turns to face mirror, then reaches for a small object on dresser.  \n- Mirror reflects her profile as she leans forward, partially obscuring her face.", "history_tokens": 711, "history_utf8_bytes": 2897, "recent_frame_times_s": [281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0], "recent_frames_sha256": "208cde07faf3be2f725f805873fe3d1e763655c499ed3f0e125af363f7913277", "num_recent_frames": 30, "tq": 718654.598221778, "t1": 718661.421396851, "ta": 718661.421396851, "te": 718661.570166757, "first_response_s": 6.8231750729028136, "answer_total_s": 6.971944978926331, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 153, "content_group": "ef2d42d32279aab802f43873489842599b2f0ee0e1faaaf7fe3979970330a946", "question": {"question_id": "sample_153_a939_q0", "video_id": 153, "video_path": "./videos/sample_153_real.mp4", "annotation_index": 939, "question_index": 0, "question": "What is the distinctive feature of the man's appearance?", "options": ["A. A scar on his cheek.", "B. A handlebar mustache.", "C. A monocle.", "D. A bow tie."], "answer": "B", "time_stamp_s": 5, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_153_a939_q0", "video_id": 153, "time_stamp_s": 5, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "36b3c4cd0bd435349ebeffa37e15e5c65769023d2f2f68f6899a44a2e812c696", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "5ae9a1c292f56bab28ee03f24728fa60499920ad9089e9abfb303de45e593d65", "num_recent_frames": 6, "tq": 716927.927933228, "t1": 716935.17222729, "ta": 716935.17222729, "te": 716935.209594958, "first_response_s": 7.244294062023982, "answer_total_s": 7.281661730026826, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_153_a939_q0", "video_id": 153, "time_stamp_s": 5, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "00a6399d562e55dc2ae6c71b345853a8796f232fc5e2355aab67a913179a698a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "5ae9a1c292f56bab28ee03f24728fa60499920ad9089e9abfb303de45e593d65", "num_recent_frames": 6, "tq": 716856.725758711, "t1": 716868.384287447, "ta": 716868.384287447, "te": 716868.543085274, "first_response_s": 11.658528735977598, "answer_total_s": 11.817326563061215, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 153, "content_group": "ef2d42d32279aab802f43873489842599b2f0ee0e1faaaf7fe3979970330a946", "question": {"question_id": "sample_153_a940_q0", "video_id": 153, "video_path": "./videos/sample_153_real.mp4", "annotation_index": 940, "question_index": 0, "question": "What item is located below the painting with the golden frame?", "options": ["A. A bookshelf.", "B. A table with a vase.", "C. A candelabrum.", "D. A mirror."], "answer": "C", "time_stamp_s": 64, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_153_a940_q0", "video_id": 153, "time_stamp_s": 64, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bb91c99941e0456f1125d5b5bd3f05c25ce58cc0d268f869d6600ee2fdb3f7c4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0], "recent_frames_sha256": "a39e55afe01b172ef4f644104da48c6305c3570a59f06c2e63d026edb71d6574", "num_recent_frames": 30, "tq": 716935.243368195, "t1": 716947.504275046, "ta": 716947.504275046, "te": 716947.540657955, "first_response_s": 12.260906851035543, "answer_total_s": 12.297289759968407, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_153_a940_q0", "video_id": 153, "time_stamp_s": 64, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f3276f7448a924499cd318244a7e16a4a91194011fd48a4b7e7f07a6711bdb08", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white shirt and trousers puts on a black coat, adjusting it over his shoulders while standing in a room with red curtains and a painting.  \n- He then fastens suspenders over his shoulders, pulling them into place as he stands upright.  \n- A second man in formal attire observes him from the side, standing near a candlelit table.\n[30-60s] - Man with mustache buttons white shirt while another man assists from behind.  \n- Man with mustache sits on chair after removing shoes, then stands as assistant approaches.  \n- Assistant in dark coat walks toward man, then bends to adjust his shoes on patterned rug.", "history_tokens": 144, "history_utf8_bytes": 627, "recent_frame_times_s": [35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0], "recent_frames_sha256": "a39e55afe01b172ef4f644104da48c6305c3570a59f06c2e63d026edb71d6574", "num_recent_frames": 30, "tq": 716887.212244209, "t1": 716887.736507169, "ta": 716887.736507169, "te": 716887.773485189, "first_response_s": 0.5242629599524662, "answer_total_s": 0.5612409799359739, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 153, "content_group": "ef2d42d32279aab802f43873489842599b2f0ee0e1faaaf7fe3979970330a946", "question": {"question_id": "sample_153_a940_q1", "video_id": 153, "video_path": "./videos/sample_153_real.mp4", "annotation_index": 940, "question_index": 1, "question": "What is the man doing while sitting on a chair?", "options": ["A. Reading a book.", "B. Polishing his shoes.", "C. Adjusting his trousers and shoes.", "D. Writing a letter."], "answer": "C", "time_stamp_s": 70, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_153_a940_q1", "video_id": 153, "time_stamp_s": 70, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e732f7bb3884be21122603eecc9b1a18186991fb1297ecede94045c5caec81f9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0], "recent_frames_sha256": "5ca07ef2cd3638e48a19da4b5ad3125adfb369c1e52795e8aa7d2594541da5ed", "num_recent_frames": 30, "tq": 716947.561379796, "t1": 716954.598322122, "ta": 716954.598322122, "te": 716954.635669278, "first_response_s": 7.036942325998098, "answer_total_s": 7.074289481970482, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_153_a940_q1", "video_id": 153, "time_stamp_s": 70, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a47dc9ad64bba378259b105b6426bf2fb37b74da4bc831d31cde2c57cb054b1b", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white shirt and trousers puts on a black coat, adjusting it over his shoulders while standing in a room with red curtains and a painting.  \n- He then fastens suspenders over his shoulders, pulling them into place as he stands upright.  \n- A second man in formal attire observes him from the side, standing near a candlelit table.\n[30-60s] - Man with mustache buttons white shirt while another man assists from behind.  \n- Man with mustache sits on chair after removing shoes, then stands as assistant approaches.  \n- Assistant in dark coat walks toward man, then bends to adjust his shoes on patterned rug.", "history_tokens": 144, "history_utf8_bytes": 627, "recent_frame_times_s": [41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0], "recent_frames_sha256": "5ca07ef2cd3638e48a19da4b5ad3125adfb369c1e52795e8aa7d2594541da5ed", "num_recent_frames": 30, "tq": 716887.787302552, "t1": 716898.911517205, "ta": 716898.911517205, "te": 716899.348247637, "first_response_s": 11.12421465292573, "answer_total_s": 11.56094508501701, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 153, "content_group": "ef2d42d32279aab802f43873489842599b2f0ee0e1faaaf7fe3979970330a946", "question": {"question_id": "sample_153_a941_q1", "video_id": 153, "video_path": "./videos/sample_153_real.mp4", "annotation_index": 941, "question_index": 1, "question": "What does the man being helped do after the helper finishes adjusting his collar and bow tie?", "options": ["A. Looks in the mirror.", "B. Closes his eyes.", "C. Lifts his arm.", "D. Looks down slightly."], "answer": "D", "time_stamp_s": 135, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "getting_dressed", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_153_a941_q1", "video_id": 153, "time_stamp_s": 135, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "28927e8fda4122a137a66f269e78b9f71cd3ce44d7faec317376fbd0c575b13e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0], "recent_frames_sha256": "e7a81aaf9e53a57a9e391e7f13c60d073ec42e861e6985ff9be89dc5b90359da", "num_recent_frames": 30, "tq": 716954.658367026, "t1": 716968.00109506, "ta": 716968.00109506, "te": 716968.040279441, "first_response_s": 13.342728034011088, "answer_total_s": 13.381912415032275, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_153_a941_q1", "video_id": 153, "time_stamp_s": 135, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "37dfd0ebd1fa91ef6baf0cb24e59bb5b31751a429527d5d84efde21de3ac0777", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white shirt and trousers puts on a black coat, adjusting it over his shoulders while standing in a room with red curtains and a painting.  \n- He then fastens suspenders over his shoulders, pulling them into place as he stands upright.  \n- A second man in formal attire observes him from the side, standing near a candlelit table.\n[30-60s] - Man with mustache buttons white shirt while another man assists from behind.  \n- Man with mustache sits on chair after removing shoes, then stands as assistant approaches.  \n- Assistant in dark coat walks toward man, then bends to adjust his shoes on patterned rug.\n[60-90s] - A man in a dark coat adjusts another man's white shirt and suspenders while standing near a door.  \n- The second man, wearing a white shirt and suspenders, stands facing away, with a patterned rug beneath his feet.  \n- A framed painting hangs on the wall behind them, and a candle holder with lit candles is visible on a table nearby.\n[90-120s] - A man in a white shirt and ornate vest stands facing a woman in a dark coat who adjusts his vest buttons.  \n- The man then turns to face the camera, revealing a silver chain attached to his vest.  \n- The woman steps back, allowing the man to adjust his collar and look at himself in a mirror.", "history_tokens": 303, "history_utf8_bytes": 1278, "recent_frame_times_s": [106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0], "recent_frames_sha256": "e7a81aaf9e53a57a9e391e7f13c60d073ec42e861e6985ff9be89dc5b90359da", "num_recent_frames": 30, "tq": 716911.793553336, "t1": 716919.982454833, "ta": 716919.982454833, "te": 716920.135742446, "first_response_s": 8.188901496934704, "answer_total_s": 8.342189109884202, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 153, "content_group": "ef2d42d32279aab802f43873489842599b2f0ee0e1faaaf7fe3979970330a946", "question": {"question_id": "sample_153_a941_q0", "video_id": 153, "video_path": "./videos/sample_153_real.mp4", "annotation_index": 941, "question_index": 0, "question": "What color is the vest of the man being helped?", "options": ["A. White.", "B. Beige.", "C. Black.", "D. Gray."], "answer": "B", "time_stamp_s": 140, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_153_a941_q0", "video_id": 153, "time_stamp_s": 140, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b16259f8e88a705469ca9f308feb0d3e3aeb91279cac796d330972ee375950e2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0], "recent_frames_sha256": "4b1155e0cba40b925ef98db2bb1992797fddb63d8f533e00d7fe367a4102bfc4", "num_recent_frames": 30, "tq": 716968.048875085, "t1": 716978.416750449, "ta": 716978.416750449, "te": 716978.455023361, "first_response_s": 10.367875364026986, "answer_total_s": 10.406148276058957, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_153_a941_q0", "video_id": 153, "time_stamp_s": 140, "ground_truth": "B", "raw_output": "B. Beige.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "c6d3cd8cf83d61ba4eae364785aa58504510c84884040a9476c56a4446200670", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white shirt and trousers puts on a black coat, adjusting it over his shoulders while standing in a room with red curtains and a painting.  \n- He then fastens suspenders over his shoulders, pulling them into place as he stands upright.  \n- A second man in formal attire observes him from the side, standing near a candlelit table.\n[30-60s] - Man with mustache buttons white shirt while another man assists from behind.  \n- Man with mustache sits on chair after removing shoes, then stands as assistant approaches.  \n- Assistant in dark coat walks toward man, then bends to adjust his shoes on patterned rug.\n[60-90s] - A man in a dark coat adjusts another man's white shirt and suspenders while standing near a door.  \n- The second man, wearing a white shirt and suspenders, stands facing away, with a patterned rug beneath his feet.  \n- A framed painting hangs on the wall behind them, and a candle holder with lit candles is visible on a table nearby.\n[90-120s] - A man in a white shirt and ornate vest stands facing a woman in a dark coat who adjusts his vest buttons.  \n- The man then turns to face the camera, revealing a silver chain attached to his vest.  \n- The woman steps back, allowing the man to adjust his collar and look at himself in a mirror.", "history_tokens": 303, "history_utf8_bytes": 1278, "recent_frame_times_s": [111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0], "recent_frames_sha256": "4b1155e0cba40b925ef98db2bb1992797fddb63d8f533e00d7fe367a4102bfc4", "num_recent_frames": 30, "tq": 716920.15659478, "t1": 716927.73396992, "ta": 716927.73396992, "te": 716927.919647285, "first_response_s": 7.577375139924698, "answer_total_s": 7.763052504975349, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 154, "content_group": "89beb33acff2cc2c4fae437f5ecf45f5650d626258907a0611e01f7c11899e8c", "question": {"question_id": "sample_154_a1912_q0", "video_id": 154, "video_path": "./videos/sample_154_real.mp4", "annotation_index": 1912, "question_index": 0, "question": "What color are the walls and the bed in the bedroom?", "options": ["A. Blue.", "B. Green.", "C. Yellow.", "D. Red."], "answer": "D", "time_stamp_s": 5, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_154_a1912_q0", "video_id": 154, "time_stamp_s": 5, "ground_truth": "D", "raw_output": "D. Red.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "82f122689350d97cd0cdccf0a166dcc4caf5f47d7385029080111d1d80aea8a0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "9513c17a233b527cec5c253a24283b98b8d0693618ed70c65d575adde2c2ce52", "num_recent_frames": 6, "tq": 716343.92258525, "t1": 716344.424106311, "ta": 716344.424106311, "te": 716344.572159698, "first_response_s": 0.5015210610581562, "answer_total_s": 0.6495744480052963, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_154_a1912_q0", "video_id": 154, "time_stamp_s": 5, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c92d08cb1b2bdef13a2c5650a53edbca866cbef149c57abb57017b7a7fae58b5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "9513c17a233b527cec5c253a24283b98b8d0693618ed70c65d575adde2c2ce52", "num_recent_frames": 6, "tq": 716281.259616599, "t1": 716288.271390116, "ta": 716288.271390116, "te": 716288.494535285, "first_response_s": 7.011773517006077, "answer_total_s": 7.234918686095625, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 154, "content_group": "89beb33acff2cc2c4fae437f5ecf45f5650d626258907a0611e01f7c11899e8c", "question": {"question_id": "sample_154_a1912_q1", "video_id": 154, "video_path": "./videos/sample_154_real.mp4", "annotation_index": 1912, "question_index": 1, "question": "What does the person do after waking up?", "options": ["A. Lies back down.", "B. Walks out of the room.", "C. Sits up on the edge of the bed.", "D. Stands up and stretches."], "answer": "C", "time_stamp_s": 19, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_154_a1912_q1", "video_id": 154, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cc0e7a21b9cdbb558ae67db893eb9cd78c32102d5a60ab6aa9470d1acaf72a54", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "c05f95e23293eae471e7c87d4ea98595e8bdfcfee0dbffa4e2996df2ebd6b9d2", "num_recent_frames": 20, "tq": 716344.583435643, "t1": 716358.114392469, "ta": 716358.114392469, "te": 716358.152252199, "first_response_s": 13.530956826056354, "answer_total_s": 13.56881655601319, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_154_a1912_q1", "video_id": 154, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1d4d122fa8119e6db3ce801da447dce25687bbace85b80d5367781ba079b9c39", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "c05f95e23293eae471e7c87d4ea98595e8bdfcfee0dbffa4e2996df2ebd6b9d2", "num_recent_frames": 20, "tq": 716288.502792659, "t1": 716296.249202568, "ta": 716296.249202568, "te": 716296.432933078, "first_response_s": 7.746409908984788, "answer_total_s": 7.930140419048257, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 154, "content_group": "89beb33acff2cc2c4fae437f5ecf45f5650d626258907a0611e01f7c11899e8c", "question": {"question_id": "sample_154_a1913_q0", "video_id": 154, "video_path": "./videos/sample_154_real.mp4", "annotation_index": 1913, "question_index": 0, "question": "What type are the man's sleeves?", "options": ["A. Blue with embroidery.", "B. Green with stripes.", "C. Black with buttons.", "D. White with lace."], "answer": "D", "time_stamp_s": 85, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_154_a1913_q0", "video_id": 154, "time_stamp_s": 85, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "79643766feabe7b79c5662e82df611bcde0ad06ce652f44485adbb5333f4aaf3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0], "recent_frames_sha256": "1dbe96fd0feaefc46ef218b70111bd58c796abbf9fa1a1a331bf87b240c65200", "num_recent_frames": 30, "tq": 716358.16078566, "t1": 716369.806740997, "ta": 716369.806740997, "te": 716369.843664772, "first_response_s": 11.645955336978659, "answer_total_s": 11.682879111962393, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_154_a1913_q0", "video_id": 154, "time_stamp_s": 85, "ground_truth": "D", "raw_output": "D. White with lace.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "8bd6d84d37299b3d3230522108d0e5111a8c0731d2ea6b2716223ad4dacee643", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white nightshirt sleeps on a red velvet bed with gold trim, then wakes up and sits up.  \n- He puts on a yellow robe, then walks to a bathroom where he stands barefoot in front of a bathtub.  \n- The bathroom features a vanity with a mirror, framed pictures, and a white bird perched on the table.\n[30-60s] - A man in a white robe is seen putting on a white shirt, then a white sock, and finally a pair of orange pants.  \n- He is seated on a green chair next to a marble bathtub, with a wooden table and mirror nearby.  \n- The room features framed pictures on the walls, a clock on the wall, and a white bird perched on the table.", "history_tokens": 167, "history_utf8_bytes": 649, "recent_frame_times_s": [56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0], "recent_frames_sha256": "1dbe96fd0feaefc46ef218b70111bd58c796abbf9fa1a1a331bf87b240c65200", "num_recent_frames": 30, "tq": 716312.788120539, "t1": 716320.193731459, "ta": 716320.193731459, "te": 716320.416698296, "first_response_s": 7.405610919930041, "answer_total_s": 7.62857775692828, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 154, "content_group": "89beb33acff2cc2c4fae437f5ecf45f5650d626258907a0611e01f7c11899e8c", "question": {"question_id": "sample_154_a1913_q1", "video_id": 154, "video_path": "./videos/sample_154_real.mp4", "annotation_index": 1913, "question_index": 1, "question": "What item does the man pick up from the table while sitting?", "options": ["A. A chalice.", "B. A green vase.", "C. A metal container.", "D. A large white wig."], "answer": "D", "time_stamp_s": 89, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_154_a1913_q1", "video_id": 154, "time_stamp_s": 89, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8b3bc9ed83827f9c6fa8b334f01d2111f30ceef595806ac7e97bc6898b9dfa24", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0], "recent_frames_sha256": "96144e1d6f6aafd07f8e4045af351d727c5267286e800209b5fa30533e8f4ba4", "num_recent_frames": 30, "tq": 716369.852724279, "t1": 716382.887202718, "ta": 716382.887202718, "te": 716382.924879417, "first_response_s": 13.034478438901715, "answer_total_s": 13.072155138012022, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_154_a1913_q1", "video_id": 154, "time_stamp_s": 89, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a81e17c8818ff721a6be36585559d1125e01b5f3ae267cb8f48cb5448007d7e7", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white nightshirt sleeps on a red velvet bed with gold trim, then wakes up and sits up.  \n- He puts on a yellow robe, then walks to a bathroom where he stands barefoot in front of a bathtub.  \n- The bathroom features a vanity with a mirror, framed pictures, and a white bird perched on the table.\n[30-60s] - A man in a white robe is seen putting on a white shirt, then a white sock, and finally a pair of orange pants.  \n- He is seated on a green chair next to a marble bathtub, with a wooden table and mirror nearby.  \n- The room features framed pictures on the walls, a clock on the wall, and a white bird perched on the table.", "history_tokens": 167, "history_utf8_bytes": 649, "recent_frame_times_s": [60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0], "recent_frames_sha256": "96144e1d6f6aafd07f8e4045af351d727c5267286e800209b5fa30533e8f4ba4", "num_recent_frames": 30, "tq": 716320.442274938, "t1": 716327.050103108, "ta": 716327.050103108, "te": 716327.087847047, "first_response_s": 6.6078281700611115, "answer_total_s": 6.645572109031491, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 154, "content_group": "89beb33acff2cc2c4fae437f5ecf45f5650d626258907a0611e01f7c11899e8c", "question": {"question_id": "sample_154_a1913_q2", "video_id": 154, "video_path": "./videos/sample_154_real.mp4", "annotation_index": 1913, "question_index": 2, "question": "How did the scene change just now?", "options": ["A. The man picked up a piece of clothing on a red sofa in a different room, preparing to put it on.", "B. The man is seen standing in front of a mirror.", "C. The man is shown sitting and adjusting his wig.", "D. The man walks out of the room."], "answer": "A", "time_stamp_s": 99, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_154_a1913_q2", "video_id": 154, "time_stamp_s": 99, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "15c6acbeb326ddcd6a0eed3729cb5cada684b1d3a545c7f856d7258d65546301", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0], "recent_frames_sha256": "8584bd6bab4c47b28c2af3c71d401bb5ea79e4ec47b3f39eca9daf0977ed60eb", "num_recent_frames": 30, "tq": 716382.934850934, "t1": 716395.110657866, "ta": 716395.110657866, "te": 716395.14907566, "first_response_s": 12.175806932034902, "answer_total_s": 12.2142247260781, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_154_a1913_q2", "video_id": 154, "time_stamp_s": 99, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1f59f27659f2f7801549f5051c1ab239ef783e4c691425a9f8c57473ecaa9173", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white nightshirt sleeps on a red velvet bed with gold trim, then wakes up and sits up.  \n- He puts on a yellow robe, then walks to a bathroom where he stands barefoot in front of a bathtub.  \n- The bathroom features a vanity with a mirror, framed pictures, and a white bird perched on the table.\n[30-60s] - A man in a white robe is seen putting on a white shirt, then a white sock, and finally a pair of orange pants.  \n- He is seated on a green chair next to a marble bathtub, with a wooden table and mirror nearby.  \n- The room features framed pictures on the walls, a clock on the wall, and a white bird perched on the table.\n[60-90s] - Man adjusts white shirt cuffs while standing near ornate mirror, reflecting his posture.  \n- He then fastens ornate vest buttons while seated at a wooden table with silverware and glassware.  \n- Man stands up, turns to face mirror, and begins tying black shoes on tiled floor.", "history_tokens": 235, "history_utf8_bytes": 937, "recent_frame_times_s": [70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0], "recent_frames_sha256": "8584bd6bab4c47b28c2af3c71d401bb5ea79e4ec47b3f39eca9daf0977ed60eb", "num_recent_frames": 30, "tq": 716337.507079542, "t1": 716343.677704849, "ta": 716343.677704849, "te": 716343.90011759, "first_response_s": 6.170625307015143, "answer_total_s": 6.393038047943264, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 155, "content_group": "d36e29784fbdcd8258b386b25f349b7f05fa77109e11468d3835244d7521d26f", "question": {"question_id": "sample_155_a220_q1", "video_id": 155, "video_path": "./videos/sample_155_real.mp4", "annotation_index": 220, "question_index": 1, "question": "How many eggs are in the wooden bowl next to the marble slab?", "options": ["A. One.", "B. Five.", "C. Three.", "D. Four."], "answer": "B", "time_stamp_s": 3, "task_type": "Counting", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_155_a220_q1", "video_id": 155, "time_stamp_s": 3, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c20b2e20c8d0bff0e62d23654f8d08d4332615c97449c659182953b5e68faf8a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "d5a34d1b91aa904067ed661b0d45e425e71cd707c32ef0dae8452f3250e639cf", "num_recent_frames": 4, "tq": 717367.031925955, "t1": 717367.931180482, "ta": 717367.931180482, "te": 717367.971063581, "first_response_s": 0.8992545270593837, "answer_total_s": 0.9391376259736717, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_155_a220_q1", "video_id": 155, "time_stamp_s": 3, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "913482d5feba8a45cb4ab28ae48045d3465539b7fd24f6396784abec1e705d4c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "d5a34d1b91aa904067ed661b0d45e425e71cd707c32ef0dae8452f3250e639cf", "num_recent_frames": 4, "tq": 717269.599846842, "t1": 717278.321657743, "ta": 717278.321657743, "te": 717278.525938338, "first_response_s": 8.721810900955461, "answer_total_s": 8.926091496017762, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 155, "content_group": "d36e29784fbdcd8258b386b25f349b7f05fa77109e11468d3835244d7521d26f", "question": {"question_id": "sample_155_a220_q0", "video_id": 155, "video_path": "./videos/sample_155_real.mp4", "annotation_index": 220, "question_index": 0, "question": "What is the elderly person with a white beard doing in the video?", "options": ["A. Reading a book.", "B. Painting on a canvas.", "C. Cooking with a pot.", "D. Writing with a quill pen."], "answer": "D", "time_stamp_s": 10, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_155_a220_q0", "video_id": 155, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5914387cded4bd7fbb2844be781866f4fefc9848bc5cfc1a4bea5402a244f3b9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "ce75f651b3a2fde87d76245e7de71069026ffee102454596e6bd6a90f98076f8", "num_recent_frames": 11, "tq": 717367.994261528, "t1": 717379.704790005, "ta": 717379.704790005, "te": 717379.74745209, "first_response_s": 11.710528476978652, "answer_total_s": 11.753190562012605, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_155_a220_q0", "video_id": 155, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ffbe1b69314c04d2fad5b07c427b037be233d615d810b5d3ec7a1151b120cd32", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "ce75f651b3a2fde87d76245e7de71069026ffee102454596e6bd6a90f98076f8", "num_recent_frames": 11, "tq": 717278.549870717, "t1": 717286.529109804, "ta": 717286.529109804, "te": 717286.5667604, "first_response_s": 7.979239086969756, "answer_total_s": 8.016889682970941, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 155, "content_group": "d36e29784fbdcd8258b386b25f349b7f05fa77109e11468d3835244d7521d26f", "question": {"question_id": "sample_155_a221_q0", "video_id": 155, "video_path": "./videos/sample_155_real.mp4", "annotation_index": 221, "question_index": 0, "question": "What action does the man perform after adjusting his waistband?", "options": ["A. Sits down.", "B. Looks out the window.", "C. Lies down on the bed.", "D. Reaches for a piece of clothing."], "answer": "D", "time_stamp_s": 100, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_155_a221_q0", "video_id": 155, "time_stamp_s": 100, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5fc19be359e05dd031a2041c7cbb06638e0d847ae05d3000557af77290665a27", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0], "recent_frames_sha256": "c8dc95d2490c86f889c1cb6b3e7d49778b12bda83f7db7318060762a4164c1fc", "num_recent_frames": 30, "tq": 717379.768046482, "t1": 717391.143639569, "ta": 717391.143639569, "te": 717391.181074947, "first_response_s": 11.375593087053858, "answer_total_s": 11.413028465001844, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_155_a221_q0", "video_id": 155, "time_stamp_s": 100, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6d6e879f57ca7e2a4d005c8c9b8ca1796c2845b3a6f8b59063e79663975c4036", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand presses a green glass bottle onto a wooden surface, leaving a dark stain near eggs in a bowl.  \n- An elderly man with a white beard and glasses writes with a quill pen on parchment, illuminated by candlelight.  \n- A mural depicts two figures in medieval attire, one operating a mechanical device, with stylized flowers and vines painted on a wall.\n[30-60s] - A man sits on a wooden bench in a dimly lit room, bare-chested, and begins putting on blue trousers.  \n- He is surrounded by straw-covered floor and rustic wooden walls, with a blanket draped over a nearby bench.  \n- A fire burns brightly in the background, casting warm light and shadows across the room.\n[60-90s] - Man stands shirtless, adjusting brown trousers while wearing blue boots.  \n- He bends slightly, focusing on securing the waistband of his trousers.  \n- Wooden beams and hay-covered floor indicate a rustic, dimly lit interior.", "history_tokens": 214, "history_utf8_bytes": 918, "recent_frame_times_s": [71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0], "recent_frames_sha256": "c8dc95d2490c86f889c1cb6b3e7d49778b12bda83f7db7318060762a4164c1fc", "num_recent_frames": 30, "tq": 717311.176218351, "t1": 717317.077599627, "ta": 717317.077599627, "te": 717317.435409453, "first_response_s": 5.901381275965832, "answer_total_s": 6.259191101999022, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 155, "content_group": "d36e29784fbdcd8258b386b25f349b7f05fa77109e11468d3835244d7521d26f", "question": {"question_id": "sample_155_a222_q0", "video_id": 155, "video_path": "./videos/sample_155_real.mp4", "annotation_index": 222, "question_index": 0, "question": "What type of boots is the person wearing?", "options": ["A. Brown leather boots.", "B. Rubber boots.", "C. Sneakers.", "D. Sandals."], "answer": "A", "time_stamp_s": 169, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_155_a222_q0", "video_id": 155, "time_stamp_s": 169, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "17848700017f153c61100ecd84f81ac4bef96562308ca916ffcf025de29da2bc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0], "recent_frames_sha256": "456b785cf235094e36db5ba2eee1e07cf26ea83de59b690d13824b4106cc0a4b", "num_recent_frames": 30, "tq": 717391.193470653, "t1": 717401.721144777, "ta": 717401.721144777, "te": 717401.760680533, "first_response_s": 10.527674123994075, "answer_total_s": 10.567209879984148, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_155_a222_q0", "video_id": 155, "time_stamp_s": 169, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f1fad08b162d78133c7a948908f688e74632119ea2e6e9dd8d4e884e570f184a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand presses a green glass bottle onto a wooden surface, leaving a dark stain near eggs in a bowl.  \n- An elderly man with a white beard and glasses writes with a quill pen on parchment, illuminated by candlelight.  \n- A mural depicts two figures in medieval attire, one operating a mechanical device, with stylized flowers and vines painted on a wall.\n[30-60s] - A man sits on a wooden bench in a dimly lit room, bare-chested, and begins putting on blue trousers.  \n- He is surrounded by straw-covered floor and rustic wooden walls, with a blanket draped over a nearby bench.  \n- A fire burns brightly in the background, casting warm light and shadows across the room.\n[60-90s] - Man stands shirtless, adjusting brown trousers while wearing blue boots.  \n- He bends slightly, focusing on securing the waistband of his trousers.  \n- Wooden beams and hay-covered floor indicate a rustic, dimly lit interior.\n[90-120s] - Man adjusts drawstring on loose-fitting trousers while standing in dimly lit room.  \n- He then puts on a long, loose-fitting tunic over his bare torso, revealing a hat hanging on the wall.  \n- After donning the tunic, he picks up a second garment (possibly a cloak or coat) and inspects it before holding it up.\n[120-150s] - Person adjusts a brown coat, then pulls a black belt from a side pocket.  \n- Belt is threaded through belt loops and secured with metal buckles.  \n- Belt is fastened around waist, with a wooden-handled tool visible in a side pocket.", "history_tokens": 362, "history_utf8_bytes": 1488, "recent_frame_times_s": [140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0], "recent_frames_sha256": "456b785cf235094e36db5ba2eee1e07cf26ea83de59b690d13824b4106cc0a4b", "num_recent_frames": 30, "tq": 717335.514706303, "t1": 717342.904094589, "ta": 717342.904094589, "te": 717343.350649344, "first_response_s": 7.389388285926543, "answer_total_s": 7.835943041020073, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 155, "content_group": "d36e29784fbdcd8258b386b25f349b7f05fa77109e11468d3835244d7521d26f", "question": {"question_id": "sample_155_a223_q0", "video_id": 155, "video_path": "./videos/sample_155_real.mp4", "annotation_index": 223, "question_index": 0, "question": "What is the person wearing around their neck right now?", "options": ["A. A dark purple scarf.", "B. A dark green scarf.", "C. A light brown scarf.", "D. A dark blue scarf."], "answer": "A", "time_stamp_s": 245, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [240, 293], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_155_a223_q0", "video_id": 155, "time_stamp_s": 245, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "44806d2fe059e84f852b4b3cefc3b33abcdb083585eb578f43ae07db14676f52", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0], "recent_frames_sha256": "030847694a7e7cc7e1963b0280d28b9bbd6a1fe83dafe7c9e8f414457c17aa6b", "num_recent_frames": 30, "tq": 717401.772295523, "t1": 717414.411897219, "ta": 717414.411897219, "te": 717414.44854407, "first_response_s": 12.639601696049795, "answer_total_s": 12.676248547038995, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_155_a223_q0", "video_id": 155, "time_stamp_s": 245, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5d200b746b919bc0ba0ba99f3659a5ab0d90ab0a19e17cf14f777515570f1357", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand presses a green glass bottle onto a wooden surface, leaving a dark stain near eggs in a bowl.  \n- An elderly man with a white beard and glasses writes with a quill pen on parchment, illuminated by candlelight.  \n- A mural depicts two figures in medieval attire, one operating a mechanical device, with stylized flowers and vines painted on a wall.\n[30-60s] - A man sits on a wooden bench in a dimly lit room, bare-chested, and begins putting on blue trousers.  \n- He is surrounded by straw-covered floor and rustic wooden walls, with a blanket draped over a nearby bench.  \n- A fire burns brightly in the background, casting warm light and shadows across the room.\n[60-90s] - Man stands shirtless, adjusting brown trousers while wearing blue boots.  \n- He bends slightly, focusing on securing the waistband of his trousers.  \n- Wooden beams and hay-covered floor indicate a rustic, dimly lit interior.\n[90-120s] - Man adjusts drawstring on loose-fitting trousers while standing in dimly lit room.  \n- He then puts on a long, loose-fitting tunic over his bare torso, revealing a hat hanging on the wall.  \n- After donning the tunic, he picks up a second garment (possibly a cloak or coat) and inspects it before holding it up.\n[120-150s] - Person adjusts a brown coat, then pulls a black belt from a side pocket.  \n- Belt is threaded through belt loops and secured with metal buckles.  \n- Belt is fastened around waist, with a wooden-handled tool visible in a side pocket.\n[150-180s] - A man adjusts a dark leather belt around his waist while seated in a dimly lit barn.  \n- He then proceeds to tie the laces of brown leather boots, securing them over blue jeans.  \n- After finishing with his boots, he stands up, revealing a worn, earth-toned tunic and a hat resting nearby.\n[180-210s] - Man adjusts hood over head, then removes it to reveal face.\n- He holds a dark cloak and a pair of boots, preparing to leave.\n- Man exits through a doorway, leaving the room with bedding and wooden beams visible.\n[210-240s] - Two oxen with large horns pull a plow through a harvested field, guided by two men in traditional attire.  \n- A close-up shows a wooden fence with hay piled beside it, suggesting a farm setting.  \n- A man in a hooded cloak walks away from the camera, his back turned, against a backdrop of trees under a clear sky.", "history_tokens": 580, "history_utf8_bytes": 2344, "recent_frame_times_s": [216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0], "recent_frames_sha256": "030847694a7e7cc7e1963b0280d28b9bbd6a1fe83dafe7c9e8f414457c17aa6b", "num_recent_frames": 30, "tq": 717365.373847771, "t1": 717366.951180644, "ta": 717366.951180644, "te": 717366.98971785, "first_response_s": 1.5773328730138019, "answer_total_s": 1.6158700790256262, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 156, "content_group": "cb84a465b297d3b6f1e66178e7c3cc0a3c78e4ea115f22208e195bfabdec3658", "question": {"question_id": "sample_156_a1903_q0", "video_id": 156, "video_path": "./videos/sample_156_real.mp4", "annotation_index": 1903, "question_index": 0, "question": "What text appears first on the black screen?", "options": ["A. \"National Museums Liverpool\".", "B. \"Art Gallery\".", "C. \"Walker\".", "D. \"Walker Art Gallery\"."], "answer": "C", "time_stamp_s": 3, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_156_a1903_q0", "video_id": 156, "time_stamp_s": 3, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "59ad187cd5a62ef128e04b1843d604a83ec80522c60ae0eca9aa79a91b6b6740", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "37421f6cb146ce275af8809f20629b63474dd65f3fb9b316e984dcf186a66a9a", "num_recent_frames": 4, "tq": 719088.696042724, "t1": 719089.190447965, "ta": 719089.190447965, "te": 719089.228117682, "first_response_s": 0.4944052411010489, "answer_total_s": 0.5320749580860138, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_156_a1903_q0", "video_id": 156, "time_stamp_s": 3, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a5303216aac9071b83489236596ae27a4bbd45923fa49313437cf63000d2e7be", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "37421f6cb146ce275af8809f20629b63474dd65f3fb9b316e984dcf186a66a9a", "num_recent_frames": 4, "tq": 718969.222448678, "t1": 718976.467692818, "ta": 718976.467692818, "te": 718976.618515463, "first_response_s": 7.245244140038267, "answer_total_s": 7.396066784975119, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 156, "content_group": "cb84a465b297d3b6f1e66178e7c3cc0a3c78e4ea115f22208e195bfabdec3658", "question": {"question_id": "sample_156_a1903_q1", "video_id": 156, "video_path": "./videos/sample_156_real.mp4", "annotation_index": 1903, "question_index": 1, "question": "What are the walls' color in the larger room?", "options": ["A. White.", "B. Peach.", "C. Blue.", "D. Gray."], "answer": "B", "time_stamp_s": 13, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_156_a1903_q1", "video_id": 156, "time_stamp_s": 13, "ground_truth": "B", "raw_output": "B. Peach.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "fa58d66ba81d76c0f6afc289d711aa2b835c49a106905b0f294577c556831e85", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0], "recent_frames_sha256": "c5ef494d732c40a3114ba384981c31ad8a70bd78d0e007989b69b970c41c29d6", "num_recent_frames": 14, "tq": 719089.24071729, "t1": 719099.904372561, "ta": 719099.904372561, "te": 719100.098499327, "first_response_s": 10.663655271055177, "answer_total_s": 10.857782036997378, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_156_a1903_q1", "video_id": 156, "time_stamp_s": 13, "ground_truth": "B", "raw_output": "B. Peach.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "1d624e90c42226eef5eb8dfd7e6e4e3ddc36d2565bf6dd1d3c065e3fe181bb30", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0], "recent_frames_sha256": "c5ef494d732c40a3114ba384981c31ad8a70bd78d0e007989b69b970c41c29d6", "num_recent_frames": 14, "tq": 718976.632731022, "t1": 718984.15945485, "ta": 718984.15945485, "te": 718984.391868704, "first_response_s": 7.526723828050308, "answer_total_s": 7.759137682034634, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 156, "content_group": "cb84a465b297d3b6f1e66178e7c3cc0a3c78e4ea115f22208e195bfabdec3658", "question": {"question_id": "sample_156_a1904_q0", "video_id": 156, "video_path": "./videos/sample_156_real.mp4", "annotation_index": 1904, "question_index": 0, "question": "What is notable about the gold button?", "options": ["A. It has a plain surface.", "B. It is silver with a smooth finish.", "C. It has a decorative design.", "D. It is wooden with carvings."], "answer": "C", "time_stamp_s": 98, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_156_a1904_q0", "video_id": 156, "time_stamp_s": 98, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f47270afc0b33f580625b7778363386798207684309e85e4d12be6d80e076e39", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0], "recent_frames_sha256": "26f79b77f6606a2200bc3530ad550a8fa6caa1907bfe8e6144c7a5cf5db32e2d", "num_recent_frames": 30, "tq": 719100.111447251, "t1": 719111.519579865, "ta": 719111.519579865, "te": 719111.557698529, "first_response_s": 11.4081326139858, "answer_total_s": 11.44625127792824, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_156_a1904_q0", "video_id": 156, "time_stamp_s": 98, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7f66ed2084e97045f9cc7cc2c79432d12c1483027199c3b3afe8254be9fdb59d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white robe reclines on a chair while another man in a vest and apron stands nearby, holding a bowl with a pat of butter.  \n- The standing man removes his apron and places it on the table, then gestures toward the reclining man.  \n- The reclining man stands up, adjusting his dark robe as he prepares to leave the room.\n[30-60s] - Man in white shirt removes it, revealing bare torso; another man in vest assists.  \n- Shirt is pulled off and draped over the man’s shoulders, then removed completely.  \n- Man in vest stands behind, observing as the shirt is removed and discarded.\n[60-90s] - A woman in a white dress sits in a chair, legs crossed, while a man in a black vest and white shirt stands nearby, holding a wooden box.  \n- The woman reaches into the box, pulling out a small object, while the man watches her.  \n- The man then moves toward the woman, extending his hand to assist her with the object.", "history_tokens": 228, "history_utf8_bytes": 930, "recent_frame_times_s": [69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0], "recent_frames_sha256": "26f79b77f6606a2200bc3530ad550a8fa6caa1907bfe8e6144c7a5cf5db32e2d", "num_recent_frames": 30, "tq": 719003.88211644, "t1": 719005.306542453, "ta": 719005.306542453, "te": 719005.34472596, "first_response_s": 1.4244260130217299, "answer_total_s": 1.4626095200655982, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 156, "content_group": "cb84a465b297d3b6f1e66178e7c3cc0a3c78e4ea115f22208e195bfabdec3658", "question": {"question_id": "sample_156_a1905_q0", "video_id": 156, "video_path": "./videos/sample_156_real.mp4", "annotation_index": 1905, "question_index": 0, "question": "What item of clothing is the older man helping the younger man with?", "options": ["A. Shirt.", "B. Trousers.", "C. Waistcoat.", "D. Jacket."], "answer": "C", "time_stamp_s": 180, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_156_a1905_q0", "video_id": 156, "time_stamp_s": 180, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cb9531891003a596b097836187eb387495408ae779ec9f888f0226bf1b55083f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "05d4703576bd420fdc38aba5524b8ca8c798780d5b4916ae7f5620ea45623538", "num_recent_frames": 30, "tq": 719111.571885648, "t1": 719121.811939565, "ta": 719121.811939565, "te": 719121.849475228, "first_response_s": 10.240053917048499, "answer_total_s": 10.27758958004415, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_156_a1905_q0", "video_id": 156, "time_stamp_s": 180, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5e7b461fd9f51867288c12e514a5adb89f91301d7176a618c278d239258705ca", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white robe reclines on a chair while another man in a vest and apron stands nearby, holding a bowl with a pat of butter.  \n- The standing man removes his apron and places it on the table, then gestures toward the reclining man.  \n- The reclining man stands up, adjusting his dark robe as he prepares to leave the room.\n[30-60s] - Man in white shirt removes it, revealing bare torso; another man in vest assists.  \n- Shirt is pulled off and draped over the man’s shoulders, then removed completely.  \n- Man in vest stands behind, observing as the shirt is removed and discarded.\n[60-90s] - A woman in a white dress sits in a chair, legs crossed, while a man in a black vest and white shirt stands nearby, holding a wooden box.  \n- The woman reaches into the box, pulling out a small object, while the man watches her.  \n- The man then moves toward the woman, extending his hand to assist her with the object.\n[90-120s] - A man in a white shirt is being assisted by another man in adjusting his cuffs and shirt sleeves.  \n- The man in the white shirt then begins to put on beige breeches while standing near a table with a white tablecloth.  \n- A table with a white tablecloth, a pitcher, and a small potted plant is visible in the background.\n[120-150s] - Man adjusts beige trousers by buttoning the front closure.  \n- He then pulls the waistband tighter, securing the fit.  \n- Close-up shows hands manipulating buttons and fabric near the hip area.\n[150-180s] - A man in a white shirt is having his beige vest buttoned by another man in a black vest.  \n- The man in the white shirt is standing near a window with orange curtains, while the other man adjusts the vest from behind.  \n- A table with porcelain bowls of fruit and a white pitcher is visible to the right, suggesting a formal or historical setting.", "history_tokens": 446, "history_utf8_bytes": 1832, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "05d4703576bd420fdc38aba5524b8ca8c798780d5b4916ae7f5620ea45623538", "num_recent_frames": 30, "tq": 719031.25420166, "t1": 719033.323021859, "ta": 719033.323021859, "te": 719033.671160443, "first_response_s": 2.068820198997855, "answer_total_s": 2.416958782938309, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 156, "content_group": "cb84a465b297d3b6f1e66178e7c3cc0a3c78e4ea115f22208e195bfabdec3658", "question": {"question_id": "sample_156_a1906_q0", "video_id": 156, "video_path": "./videos/sample_156_real.mp4", "annotation_index": 1906, "question_index": 0, "question": "What is one of the items on the well-decorated table?", "options": ["A. A book.", "B. A ceramic pitcher.", "C. A silver tray.", "D. A candle."], "answer": "B", "time_stamp_s": 261, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_156_a1906_q0", "video_id": 156, "time_stamp_s": 261, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "315f8b754569997a86ba1a8a11f2006603ee08799575aa401a7d8c9d87f15d09", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0], "recent_frames_sha256": "c0c52377b80529324c45bb854f38981f67efb0fa4e15624c6d6db9a8e9dc93e2", "num_recent_frames": 30, "tq": 719121.859101931, "t1": 719130.543791253, "ta": 719130.543791253, "te": 719130.581115893, "first_response_s": 8.684689322020859, "answer_total_s": 8.722013961989433, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_156_a1906_q0", "video_id": 156, "time_stamp_s": 261, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6572406383f15ca2eb74d2e28813c7f0bcbf4a24d93fee1eb1e9789bd3fd81ca", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white robe reclines on a chair while another man in a vest and apron stands nearby, holding a bowl with a pat of butter.  \n- The standing man removes his apron and places it on the table, then gestures toward the reclining man.  \n- The reclining man stands up, adjusting his dark robe as he prepares to leave the room.\n[30-60s] - Man in white shirt removes it, revealing bare torso; another man in vest assists.  \n- Shirt is pulled off and draped over the man’s shoulders, then removed completely.  \n- Man in vest stands behind, observing as the shirt is removed and discarded.\n[60-90s] - A woman in a white dress sits in a chair, legs crossed, while a man in a black vest and white shirt stands nearby, holding a wooden box.  \n- The woman reaches into the box, pulling out a small object, while the man watches her.  \n- The man then moves toward the woman, extending his hand to assist her with the object.\n[90-120s] - A man in a white shirt is being assisted by another man in adjusting his cuffs and shirt sleeves.  \n- The man in the white shirt then begins to put on beige breeches while standing near a table with a white tablecloth.  \n- A table with a white tablecloth, a pitcher, and a small potted plant is visible in the background.\n[120-150s] - Man adjusts beige trousers by buttoning the front closure.  \n- He then pulls the waistband tighter, securing the fit.  \n- Close-up shows hands manipulating buttons and fabric near the hip area.\n[150-180s] - A man in a white shirt is having his beige vest buttoned by another man in a black vest.  \n- The man in the white shirt is standing near a window with orange curtains, while the other man adjusts the vest from behind.  \n- A table with porcelain bowls of fruit and a white pitcher is visible to the right, suggesting a formal or historical setting.\n[180-210s] - A man in a white shirt and beige vest is being assisted by another man in adjusting his attire.  \n- The assistant is seen buttoning the vest and adjusting the collar, indicating a focus on formal dressing.  \n- The scene takes place in a room with warm-toned walls and a window, suggesting an indoor, possibly historical setting.\n[210-240s] - A man in a beige vest and white shirt is seated, receiving a white mask placed over his face by another person.  \n- The seated man has a gray wig and is holding a white cloth near his face while the mask is being adjusted.  \n- The setting includes a table with various items and a window in the background, suggesting an indoor, staged environment.", "history_tokens": 609, "history_utf8_bytes": 2536, "recent_frame_times_s": [232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0], "recent_frames_sha256": "c0c52377b80529324c45bb854f38981f67efb0fa4e15624c6d6db9a8e9dc93e2", "num_recent_frames": 30, "tq": 719051.564672906, "t1": 719088.45020565, "ta": 719088.45020565, "te": 719088.675114509, "first_response_s": 36.88553274399601, "answer_total_s": 37.110441602999344, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 157, "content_group": "898e263a1320b5b3e5ef72d17593788bf944150d5cf628553ad3dc9d987f76b5", "question": {"question_id": "sample_157_a1142_q0", "video_id": 157, "video_path": "./videos/sample_157_real.mp4", "annotation_index": 1142, "question_index": 0, "question": "What is the woman doing to secure the sock in place?", "options": ["A. Tying it with a ribbon.", "B. Securing it with a black strap or garter.", "C. Using a safety pin.", "D. Sewing it in place."], "answer": "B", "time_stamp_s": 13, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_157_a1142_q0", "video_id": 157, "time_stamp_s": 13, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2c57bf901c681169616fef072c05a8d5085ef13bde7125c39bc723b1658a1aac", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0], "recent_frames_sha256": "ad9f87d8da1d182181d047ff7214c827fcecf8c146f16a52d15f9b4940c0e550", "num_recent_frames": 14, "tq": 716637.632685362, "t1": 716644.22991376, "ta": 716644.22991376, "te": 716644.451078873, "first_response_s": 6.5972283979645, "answer_total_s": 6.818393510999158, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_157_a1142_q0", "video_id": 157, "time_stamp_s": 13, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e169ea3e08dd53b00f37d401a9e2ce310929c7e59b52ea9f792b93b0dff6d79a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0], "recent_frames_sha256": "ad9f87d8da1d182181d047ff7214c827fcecf8c146f16a52d15f9b4940c0e550", "num_recent_frames": 14, "tq": 716671.546771457, "t1": 716677.018303511, "ta": 716677.018303511, "te": 716677.205494128, "first_response_s": 5.471532054012641, "answer_total_s": 5.658722671098076, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 157, "content_group": "898e263a1320b5b3e5ef72d17593788bf944150d5cf628553ad3dc9d987f76b5", "question": {"question_id": "sample_157_a1143_q0", "video_id": 157, "video_path": "./videos/sample_157_real.mp4", "annotation_index": 1143, "question_index": 0, "question": "What do the two standing women do to the seated woman?", "options": ["A. They are talking to her.", "B. They are adjusting her clothing items.", "C. They are serving her food.", "D. They are combing her hair."], "answer": "B", "time_stamp_s": 150, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "getting_dressed", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_157_a1143_q0", "video_id": 157, "time_stamp_s": 150, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "72e00af6d51ebb4ea8b0c0340411fa043e4515023d44d24ab56d424d39547456", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0], "recent_frames_sha256": "a241c23a1353fccd491166d8d3b97e13e73b0ae7f758284e150fd82d92129955", "num_recent_frames": 30, "tq": 716644.480888728, "t1": 716650.681614875, "ta": 716650.681614875, "te": 716650.718986415, "first_response_s": 6.200726146926172, "answer_total_s": 6.23809768690262, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_157_a1143_q0", "video_id": 157, "time_stamp_s": 150, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "93814a345792d106152019b7c2fc1a80bba91dd7d9fed093f8534566944b8363", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Woman in white blouse and orange skirt adjusts white stockings while seated on a chair.  \n- She then stands, puts on a black corset over her outfit, and begins lacing it up.  \n- A table with an orange cloth, a glass jar, and a draped black garment are visible in the background.\n[30-60s] - Woman in dark dress with white sleeves fastens front buttons while standing.  \n- She adjusts her sleeves and then pulls the garment over her head, revealing a stone wall background.  \n- After repositioning, she buttons the front again, with a table and window visible behind her.\n[60-90s] - Woman adjusts her dark upper garment's front closure while standing near a stone wall.  \n- She then drapes a white apron over her shoulders and fastens it at the waist.  \n- She pours liquid from a clay jug into a bowl on an orange-draped table, then bends over to attend to something off-screen.\n[90-120s] - Woman adjusts a white headband over her braided hair, securing it at the back of her head.  \n- She wears a black and white athletic top with a visible logo on the chest.  \n- The background features a rustic stone wall and a wooden table with an orange cloth.\n[120-150s] - A young woman in a white gown sits calmly in a chair, facing forward, as two women attend to her.  \n- One woman, wearing a dark dress and white apron, stands to the left, adjusting a cloth or garment near the seated woman’s head.  \n- The other woman, in a reddish-brown dress and white apron, stands to the right, handling a long cloth or garment, possibly preparing to drape it over the seated woman.", "history_tokens": 386, "history_utf8_bytes": 1574, "recent_frame_times_s": [121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0], "recent_frames_sha256": "a241c23a1353fccd491166d8d3b97e13e73b0ae7f758284e150fd82d92129955", "num_recent_frames": 30, "tq": 716708.923347478, "t1": 716716.238943092, "ta": 716716.238943092, "te": 716716.467240168, "first_response_s": 7.315595613908954, "answer_total_s": 7.5438926899805665, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 157, "content_group": "898e263a1320b5b3e5ef72d17593788bf944150d5cf628553ad3dc9d987f76b5", "question": {"question_id": "sample_157_a1144_q1", "video_id": 157, "video_path": "./videos/sample_157_real.mp4", "annotation_index": 1144, "question_index": 1, "question": "Where is the table with a white tablecloth positioned in the room?", "options": ["A. To the left of the central woman.", "B. To the right of the central woman.", "C. In front of the central woman.", "D. Behind the central woman."], "answer": "A", "time_stamp_s": 243, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_157_a1144_q1", "video_id": 157, "time_stamp_s": 243, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b8d269d9a3fae5ee31b994a7873b7fdb067812b7e1e2de0af3f1afa1c61bcc15", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0], "recent_frames_sha256": "c307bac53a54c3c4144dc4fb18e542fb6a626fb1b4ca7793775c5b43d705d066", "num_recent_frames": 30, "tq": 716650.74785472, "t1": 716657.489963305, "ta": 716657.489963305, "te": 716657.527375213, "first_response_s": 6.742108584963717, "answer_total_s": 6.779520493000746, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_157_a1144_q1", "video_id": 157, "time_stamp_s": 243, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "849bd1d52a1cc8875908a70fb307bebff6097691e009c68817c4aeb41e9c9756", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Woman in white blouse and orange skirt adjusts white stockings while seated on a chair.  \n- She then stands, puts on a black corset over her outfit, and begins lacing it up.  \n- A table with an orange cloth, a glass jar, and a draped black garment are visible in the background.\n[30-60s] - Woman in dark dress with white sleeves fastens front buttons while standing.  \n- She adjusts her sleeves and then pulls the garment over her head, revealing a stone wall background.  \n- After repositioning, she buttons the front again, with a table and window visible behind her.\n[60-90s] - Woman adjusts her dark upper garment's front closure while standing near a stone wall.  \n- She then drapes a white apron over her shoulders and fastens it at the waist.  \n- She pours liquid from a clay jug into a bowl on an orange-draped table, then bends over to attend to something off-screen.\n[90-120s] - Woman adjusts a white headband over her braided hair, securing it at the back of her head.  \n- She wears a black and white athletic top with a visible logo on the chest.  \n- The background features a rustic stone wall and a wooden table with an orange cloth.\n[120-150s] - A young woman in a white gown sits calmly in a chair, facing forward, as two women attend to her.  \n- One woman, wearing a dark dress and white apron, stands to the left, adjusting a cloth or garment near the seated woman’s head.  \n- The other woman, in a reddish-brown dress and white apron, stands to the right, handling a long cloth or garment, possibly preparing to drape it over the seated woman.\n[150-180s] - A woman in white attire sits on a wooden chair, barefoot, as two attendants assist her with her stockings and shoes.  \n- One attendant ties a gold band around her thigh, while another carefully fastens a black shoe on her foot.  \n- The setting features stone walls, a patterned rug, and a table with food and candles, suggesting a historical or period context.\n[180-210s] - A woman in a white dress stands with hands on hips, facing away from the camera, as two others assist her.  \n- One woman in a dark dress adjusts the waistband of the white dress, while another in a lighter dress helps with the red garment.  \n- The red garment is being lifted and positioned over the woman’s shoulders by the two assistants.\n[210-240s] - A woman in a white blouse and red skirt has her corset tied by two others, with one hand adjusting the front lacing.  \n- The woman stands centered, flanked by two assistants in dark dresses and white aprons, who adjust her attire.  \n- The setting is a stone-walled room with a table and candles, suggesting a historical or period context.", "history_tokens": 645, "history_utf8_bytes": 2656, "recent_frame_times_s": [214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0], "recent_frames_sha256": "c307bac53a54c3c4144dc4fb18e542fb6a626fb1b4ca7793775c5b43d705d066", "num_recent_frames": 30, "tq": 716746.159981584, "t1": 716753.536102002, "ta": 716753.536102002, "te": 716753.576706814, "first_response_s": 7.376120418077335, "answer_total_s": 7.4167252300539985, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 157, "content_group": "898e263a1320b5b3e5ef72d17593788bf944150d5cf628553ad3dc9d987f76b5", "question": {"question_id": "sample_157_a1144_q0", "video_id": 157, "video_path": "./videos/sample_157_real.mp4", "annotation_index": 1144, "question_index": 0, "question": "What are the two women wearing white caps and aprons doing?", "options": ["A. Standing by the table.", "B. Adjusting the central woman's clothing.", "C. Preparing food.", "D. Cleaning the room."], "answer": "B", "time_stamp_s": 249, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_157_a1144_q0", "video_id": 157, "time_stamp_s": 249, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "30c5a47111a597449be09f565111ea141b37643b73231a8126bdcab06376b537", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0], "recent_frames_sha256": "7fcfcffc7ef247a54b7f63517aa4b18dd745864f11242ae2aea3a7787ce3faa4", "num_recent_frames": 30, "tq": 716657.558866163, "t1": 716664.873498208, "ta": 716664.873498208, "te": 716664.91250181, "first_response_s": 7.314632044988684, "answer_total_s": 7.3536356469849125, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_157_a1144_q0", "video_id": 157, "time_stamp_s": 249, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2bc15bf61e6e6550b0d600a165978f75c1e81cebd3cbf1ab14d1f37ec7dd2175", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Woman in white blouse and orange skirt adjusts white stockings while seated on a chair.  \n- She then stands, puts on a black corset over her outfit, and begins lacing it up.  \n- A table with an orange cloth, a glass jar, and a draped black garment are visible in the background.\n[30-60s] - Woman in dark dress with white sleeves fastens front buttons while standing.  \n- She adjusts her sleeves and then pulls the garment over her head, revealing a stone wall background.  \n- After repositioning, she buttons the front again, with a table and window visible behind her.\n[60-90s] - Woman adjusts her dark upper garment's front closure while standing near a stone wall.  \n- She then drapes a white apron over her shoulders and fastens it at the waist.  \n- She pours liquid from a clay jug into a bowl on an orange-draped table, then bends over to attend to something off-screen.\n[90-120s] - Woman adjusts a white headband over her braided hair, securing it at the back of her head.  \n- She wears a black and white athletic top with a visible logo on the chest.  \n- The background features a rustic stone wall and a wooden table with an orange cloth.\n[120-150s] - A young woman in a white gown sits calmly in a chair, facing forward, as two women attend to her.  \n- One woman, wearing a dark dress and white apron, stands to the left, adjusting a cloth or garment near the seated woman’s head.  \n- The other woman, in a reddish-brown dress and white apron, stands to the right, handling a long cloth or garment, possibly preparing to drape it over the seated woman.\n[150-180s] - A woman in white attire sits on a wooden chair, barefoot, as two attendants assist her with her stockings and shoes.  \n- One attendant ties a gold band around her thigh, while another carefully fastens a black shoe on her foot.  \n- The setting features stone walls, a patterned rug, and a table with food and candles, suggesting a historical or period context.\n[180-210s] - A woman in a white dress stands with hands on hips, facing away from the camera, as two others assist her.  \n- One woman in a dark dress adjusts the waistband of the white dress, while another in a lighter dress helps with the red garment.  \n- The red garment is being lifted and positioned over the woman’s shoulders by the two assistants.\n[210-240s] - A woman in a white blouse and red skirt has her corset tied by two others, with one hand adjusting the front lacing.  \n- The woman stands centered, flanked by two assistants in dark dresses and white aprons, who adjust her attire.  \n- The setting is a stone-walled room with a table and candles, suggesting a historical or period context.", "history_tokens": 645, "history_utf8_bytes": 2656, "recent_frame_times_s": [220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0], "recent_frames_sha256": "7fcfcffc7ef247a54b7f63517aa4b18dd745864f11242ae2aea3a7787ce3faa4", "num_recent_frames": 30, "tq": 716753.601074863, "t1": 716764.793359171, "ta": 716764.793359171, "te": 716765.088390415, "first_response_s": 11.192284308024682, "answer_total_s": 11.48731555195991, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 157, "content_group": "898e263a1320b5b3e5ef72d17593788bf944150d5cf628553ad3dc9d987f76b5", "question": {"question_id": "sample_157_a1145_q0", "video_id": 157, "video_path": "./videos/sample_157_real.mp4", "annotation_index": 1145, "question_index": 0, "question": "Where is the young woman sitting right now?", "options": ["A. On a cushion on the floor.", "B. On an intricately carved wooden chair.", "C. On a plain wooden bench.", "D. On a cushioned sofa."], "answer": "B", "time_stamp_s": 379, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_157_a1145_q0", "video_id": 157, "time_stamp_s": 379, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c8a8d532a7eaf8b9ddb6c8b881040cb24d10fa36efa864eae15c8b6401dcb689", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0], "recent_frames_sha256": "054238cda8232d3c25d6a17fe438cc566d5a013a0d8d8323fdb3e381b5bf0acf", "num_recent_frames": 30, "tq": 716664.931560657, "t1": 716671.373061508, "ta": 716671.373061508, "te": 716671.523736242, "first_response_s": 6.441500851069577, "answer_total_s": 6.592175584984943, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_157_a1145_q0", "video_id": 157, "time_stamp_s": 379, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "819130e4b82a9bb6982e57cea6f02bd48b52f34d8b505f67072b063b46eb4816", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Woman in white blouse and orange skirt adjusts white stockings while seated on a chair.  \n- She then stands, puts on a black corset over her outfit, and begins lacing it up.  \n- A table with an orange cloth, a glass jar, and a draped black garment are visible in the background.\n[30-60s] - Woman in dark dress with white sleeves fastens front buttons while standing.  \n- She adjusts her sleeves and then pulls the garment over her head, revealing a stone wall background.  \n- After repositioning, she buttons the front again, with a table and window visible behind her.\n[60-90s] - Woman adjusts her dark upper garment's front closure while standing near a stone wall.  \n- She then drapes a white apron over her shoulders and fastens it at the waist.  \n- She pours liquid from a clay jug into a bowl on an orange-draped table, then bends over to attend to something off-screen.\n[90-120s] - Woman adjusts a white headband over her braided hair, securing it at the back of her head.  \n- She wears a black and white athletic top with a visible logo on the chest.  \n- The background features a rustic stone wall and a wooden table with an orange cloth.\n[120-150s] - A young woman in a white gown sits calmly in a chair, facing forward, as two women attend to her.  \n- One woman, wearing a dark dress and white apron, stands to the left, adjusting a cloth or garment near the seated woman’s head.  \n- The other woman, in a reddish-brown dress and white apron, stands to the right, handling a long cloth or garment, possibly preparing to drape it over the seated woman.\n[150-180s] - A woman in white attire sits on a wooden chair, barefoot, as two attendants assist her with her stockings and shoes.  \n- One attendant ties a gold band around her thigh, while another carefully fastens a black shoe on her foot.  \n- The setting features stone walls, a patterned rug, and a table with food and candles, suggesting a historical or period context.\n[180-210s] - A woman in a white dress stands with hands on hips, facing away from the camera, as two others assist her.  \n- One woman in a dark dress adjusts the waistband of the white dress, while another in a lighter dress helps with the red garment.  \n- The red garment is being lifted and positioned over the woman’s shoulders by the two assistants.\n[210-240s] - A woman in a white blouse and red skirt has her corset tied by two others, with one hand adjusting the front lacing.  \n- The woman stands centered, flanked by two assistants in dark dresses and white aprons, who adjust her attire.  \n- The setting is a stone-walled room with a table and candles, suggesting a historical or period context.\n[240-270s] - Central woman stands in a stone-walled room, wearing a black bodice and patterned skirt, as two attendants adjust her attire.  \n- Attendants, dressed in white head coverings and dark aprons, are actively fastening and smoothing her dress, with one holding a brooch.  \n- A table with food and candles is visible to the left, while a large window and wooden furniture frame the background.\n[270-300s] - Two women in period attire adjust the black bodice of a central woman, focusing on the neckline and shoulder area.  \n- The central woman stands still, facing forward, while the attendants work on her garment.  \n- A stone wall and a table with food items are visible in the background, indicating a historical setting.\n[300-330s] - A woman in a dark gown with a silver-trimmed neckline stands center, being assisted by two attendants.  \n- One attendant adjusts the woman’s left sleeve while the other handles the right sleeve, both wearing white head coverings and dark aprons.  \n- The setting features stone walls, a table with food, and a large window, suggesting a historical or period context.\n[330-360s] - Central woman in dark gown with white collar stands still as two attendants adjust her attire.  \n- Attendants wear white head coverings and aprons; one adjusts her neckline while the other handles her sleeves.  \n- Background shows stone walls, a table with food, and a window with light entering the room.", "history_tokens": 979, "history_utf8_bytes": 4088, "recent_frame_times_s": [350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0], "recent_frames_sha256": "054238cda8232d3c25d6a17fe438cc566d5a013a0d8d8323fdb3e381b5bf0acf", "num_recent_frames": 30, "tq": 716805.895611897, "t1": 716811.62598531, "ta": 716811.62598531, "te": 716811.664641625, "first_response_s": 5.730373412952758, "answer_total_s": 5.769029728020541, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 158, "content_group": "33e595abc13bc4feb8504a9656243632fc9e210b95aece931fc9e4c82391cc46", "question": {"question_id": "sample_158_a51_q0", "video_id": 158, "video_path": "./videos/sample_158_real.mp4", "annotation_index": 51, "question_index": 0, "question": "What are the patterns on the second fabric piece retrieved from the drawer?", "options": ["A. Polka dots.", "B. Stripes.", "C. Floral patterns.", "D. Geometric shapes."], "answer": "C", "time_stamp_s": 16, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_158_a51_q0", "video_id": 158, "time_stamp_s": 16, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a0089c2f758460cc3b66c594e71acab58b19da18ed1342488e8a2ce907af90dd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0], "recent_frames_sha256": "405c9d209d3ebcc1c7d477d06d4283dead3eca9c434251a9c82f4a3ddf0c64f5", "num_recent_frames": 17, "tq": 719344.544887476, "t1": 719351.05579519, "ta": 719351.05579519, "te": 719351.095675084, "first_response_s": 6.5109077140223235, "answer_total_s": 6.550787608022802, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_158_a51_q0", "video_id": 158, "time_stamp_s": 16, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bacb50bdc81d83d367ea9b604f93c42b324c95454a57cc9d5297f9097ec2bced", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0], "recent_frames_sha256": "405c9d209d3ebcc1c7d477d06d4283dead3eca9c434251a9c82f4a3ddf0c64f5", "num_recent_frames": 17, "tq": 719286.923381404, "t1": 719293.427592353, "ta": 719293.427592353, "te": 719293.46563426, "first_response_s": 6.504210948944092, "answer_total_s": 6.542252855957486, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 158, "content_group": "33e595abc13bc4feb8504a9656243632fc9e210b95aece931fc9e4c82391cc46", "question": {"question_id": "sample_158_a52_q1", "video_id": 158, "video_path": "./videos/sample_158_real.mp4", "annotation_index": 52, "question_index": 1, "question": "What pattern is on the stocking the person is wearing?", "options": ["A. Stripes.", "B. Polka dots.", "C. Checkered.", "D. Floral."], "answer": "C", "time_stamp_s": 84, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_158_a52_q1", "video_id": 158, "time_stamp_s": 84, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6f1046b6114b86678292688924e998b8e07e237e75b56eb3ab2ed913d6fd37aa", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0], "recent_frames_sha256": "dfa047ecd561188d7234cccec1762a342de009dcbad82796ae988ee268b6aa91", "num_recent_frames": 30, "tq": 719351.110258108, "t1": 719362.6792113, "ta": 719362.6792113, "te": 719362.717847318, "first_response_s": 11.568953191977926, "answer_total_s": 11.607589210034348, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_158_a52_q1", "video_id": 158, "time_stamp_s": 84, "ground_truth": "C", "raw_output": "C. Checkered.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "cb4f87c6a71a45703cba29ca212d98fd3d7c1913cc65caeda5e8a20935c5c39d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A woman selects a floral-patterned cloth from a drawer, then examines it in front of a mirror.  \n- She walks to a wooden vanity, opens a black record player, and places a black garment on the vanity.  \n- The room features a bed with geometric-patterned bedding, a yellow pillow, and posters on the wall.\n[30-60s] - Woman removes white robe, revealing a black dress with orange and white vertical stripes.  \n- She adjusts the dress, then walks toward the desk, briefly touching her hair.  \n- She turns away from the camera, facing the desk, and begins to interact with items on it.", "history_tokens": 141, "history_utf8_bytes": 590, "recent_frame_times_s": [55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0], "recent_frames_sha256": "dfa047ecd561188d7234cccec1762a342de009dcbad82796ae988ee268b6aa91", "num_recent_frames": 30, "tq": 719310.242513312, "t1": 719317.803401794, "ta": 719317.803401794, "te": 719318.019391793, "first_response_s": 7.560888482024893, "answer_total_s": 7.7768784809159115, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 158, "content_group": "33e595abc13bc4feb8504a9656243632fc9e210b95aece931fc9e4c82391cc46", "question": {"question_id": "sample_158_a52_q0", "video_id": 158, "video_path": "./videos/sample_158_real.mp4", "annotation_index": 52, "question_index": 0, "question": "What is the person putting on their feet?", "options": ["A. Red boots.", "B. Red shoes with a low heel and a strap.", "C. Black sneakers.", "D. Sandals."], "answer": "B", "time_stamp_s": 90, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_158_a52_q0", "video_id": 158, "time_stamp_s": 90, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "844f0ffd16e7a36fce6035908036b11b7831d094bd74164c324bf3de9a65497e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0], "recent_frames_sha256": "d01bd0fda3e109f367a7458152ec983cb2c057b06207dbb591a894d057693d81", "num_recent_frames": 30, "tq": 719362.733977679, "t1": 719376.118879941, "ta": 719376.118879941, "te": 719376.158104043, "first_response_s": 13.384902261896059, "answer_total_s": 13.424126363941468, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_158_a52_q0", "video_id": 158, "time_stamp_s": 90, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "268483e2eb46c1e98f1fe79755a64387c9699452d7c78c48235e62a587d5660f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A woman selects a floral-patterned cloth from a drawer, then examines it in front of a mirror.  \n- She walks to a wooden vanity, opens a black record player, and places a black garment on the vanity.  \n- The room features a bed with geometric-patterned bedding, a yellow pillow, and posters on the wall.\n[30-60s] - Woman removes white robe, revealing a black dress with orange and white vertical stripes.  \n- She adjusts the dress, then walks toward the desk, briefly touching her hair.  \n- She turns away from the camera, facing the desk, and begins to interact with items on it.\n[60-90s] - Woman in black dress sits on stool, putting on checkered tights over legs.  \n- She then places orange Mary Jane shoes on patterned rug and begins tying laces.  \n- Feet are positioned near bed with geometric-patterned bedding in background.", "history_tokens": 201, "history_utf8_bytes": 841, "recent_frame_times_s": [61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0], "recent_frames_sha256": "d01bd0fda3e109f367a7458152ec983cb2c057b06207dbb591a894d057693d81", "num_recent_frames": 30, "tq": 719323.75402618, "t1": 719325.299633655, "ta": 719325.299633655, "te": 719325.33779213, "first_response_s": 1.5456074749818072, "answer_total_s": 1.583765949937515, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 158, "content_group": "33e595abc13bc4feb8504a9656243632fc9e210b95aece931fc9e4c82391cc46", "question": {"question_id": "sample_158_a52_q2", "video_id": 158, "video_path": "./videos/sample_158_real.mp4", "annotation_index": 52, "question_index": 2, "question": "What is featured in the background of the scene right now?", "options": ["A. A plain white wall.", "B. A patterned rug with horizontal stripes in various colors.", "C. A window with curtains.", "D. A bookshelf."], "answer": "B", "time_stamp_s": 96, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_158_a52_q2", "video_id": 158, "time_stamp_s": 96, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a502bf507d9ce8409f423ef37a34cb470f8b630650cf841a73bcfb01ef2c0bb0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0], "recent_frames_sha256": "e82efb23bd4bd5e1d5977802886db11b5066c501bb63829fb65f55fe1e44b554", "num_recent_frames": 30, "tq": 719376.179696637, "t1": 719383.676776047, "ta": 719383.676776047, "te": 719383.717149073, "first_response_s": 7.497079410008155, "answer_total_s": 7.537452436052263, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_158_a52_q2", "video_id": 158, "time_stamp_s": 96, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f0fbf0d7d3e95cbfee992e770e4f1d94f9f648fbe23e04f4bb5d255a96b77bcf", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A woman selects a floral-patterned cloth from a drawer, then examines it in front of a mirror.  \n- She walks to a wooden vanity, opens a black record player, and places a black garment on the vanity.  \n- The room features a bed with geometric-patterned bedding, a yellow pillow, and posters on the wall.\n[30-60s] - Woman removes white robe, revealing a black dress with orange and white vertical stripes.  \n- She adjusts the dress, then walks toward the desk, briefly touching her hair.  \n- She turns away from the camera, facing the desk, and begins to interact with items on it.\n[60-90s] - Woman in black dress sits on stool, putting on checkered tights over legs.  \n- She then places orange Mary Jane shoes on patterned rug and begins tying laces.  \n- Feet are positioned near bed with geometric-patterned bedding in background.", "history_tokens": 201, "history_utf8_bytes": 841, "recent_frame_times_s": [67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0], "recent_frames_sha256": "e82efb23bd4bd5e1d5977802886db11b5066c501bb63829fb65f55fe1e44b554", "num_recent_frames": 30, "tq": 719325.380982823, "t1": 719336.634913304, "ta": 719336.634913304, "te": 719336.675912446, "first_response_s": 11.253930481034331, "answer_total_s": 11.294929623021744, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 158, "content_group": "33e595abc13bc4feb8504a9656243632fc9e210b95aece931fc9e4c82391cc46", "question": {"question_id": "sample_158_a52_q3", "video_id": 158, "video_path": "./videos/sample_158_real.mp4", "annotation_index": 52, "question_index": 3, "question": "What is the focus of the person when the camera cuts to a close-up of their face?", "options": ["A. They are smiling and talking.", "B. They are eating.", "C. They appear focused, possibly adjusting their appearance.", "D. They are looking at the camera and waving."], "answer": "C", "time_stamp_s": 100, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_158_a52_q3", "video_id": 158, "time_stamp_s": 100, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "85296c66457e671e40ea225c2b094e8c6cfcdd92a7c31b663c512b8d9174bd02", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0], "recent_frames_sha256": "629ddfa76782b71d80001566b06c985f0e642afedee1a423b38d42c217e99ab8", "num_recent_frames": 30, "tq": 719383.737462079, "t1": 719395.929816793, "ta": 719395.929816793, "te": 719396.15752306, "first_response_s": 12.192354713915847, "answer_total_s": 12.42006098094862, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_158_a52_q3", "video_id": 158, "time_stamp_s": 100, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "04663514e75860505857bd32e26e6c558fb0b55f5de57d7e4a1c7edd6f4e0558", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A woman selects a floral-patterned cloth from a drawer, then examines it in front of a mirror.  \n- She walks to a wooden vanity, opens a black record player, and places a black garment on the vanity.  \n- The room features a bed with geometric-patterned bedding, a yellow pillow, and posters on the wall.\n[30-60s] - Woman removes white robe, revealing a black dress with orange and white vertical stripes.  \n- She adjusts the dress, then walks toward the desk, briefly touching her hair.  \n- She turns away from the camera, facing the desk, and begins to interact with items on it.\n[60-90s] - Woman in black dress sits on stool, putting on checkered tights over legs.  \n- She then places orange Mary Jane shoes on patterned rug and begins tying laces.  \n- Feet are positioned near bed with geometric-patterned bedding in background.", "history_tokens": 201, "history_utf8_bytes": 841, "recent_frame_times_s": [71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0], "recent_frames_sha256": "629ddfa76782b71d80001566b06c985f0e642afedee1a423b38d42c217e99ab8", "num_recent_frames": 30, "tq": 719336.692579675, "t1": 719344.300385304, "ta": 719344.300385304, "te": 719344.526554723, "first_response_s": 7.607805629028007, "answer_total_s": 7.833975048037246, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 159, "content_group": "8ed935c0421f83f82429a2d5bb320e2b5705bf75f48da256e8666315e28b15cc", "question": {"question_id": "sample_159_a2048_q0", "video_id": 159, "video_path": "./videos/sample_159_real.mp4", "annotation_index": 2048, "question_index": 0, "question": "What is the woman wearing right now?", "options": ["A. A black dress.", "B. A white strapless top.", "C. A red shirt.", "D. A grayish-blue long-sleeved shirt."], "answer": "B", "time_stamp_s": 11, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_159_a2048_q0", "video_id": 159, "time_stamp_s": 11, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7442f0aed24efd7e2d2a55b2edc6b5bc7c1f00a25835e10828dfbde1a6af5924", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0], "recent_frames_sha256": "0ac1961d52443fcb19224a6d02e7becdf19b55d4172f638c3b8e1fca1dff2ff9", "num_recent_frames": 12, "tq": 718208.440546914, "t1": 718217.329653284, "ta": 718217.329653284, "te": 718217.371909578, "first_response_s": 8.88910637004301, "answer_total_s": 8.93136266397778, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_159_a2048_q0", "video_id": 159, "time_stamp_s": 11, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e41006d7916e8b0aa1f2240ca6dc4fdccaa242ed0e46903c7d5c9647e2a1a57f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0], "recent_frames_sha256": "0ac1961d52443fcb19224a6d02e7becdf19b55d4172f638c3b8e1fca1dff2ff9", "num_recent_frames": 12, "tq": 718257.453433132, "t1": 718264.409278805, "ta": 718264.409278805, "te": 718264.675837087, "first_response_s": 6.95584567298647, "answer_total_s": 7.222403954947367, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 159, "content_group": "8ed935c0421f83f82429a2d5bb320e2b5705bf75f48da256e8666315e28b15cc", "question": {"question_id": "sample_159_a2048_q1", "video_id": 159, "video_path": "./videos/sample_159_real.mp4", "annotation_index": 2048, "question_index": 1, "question": "What is the color of the wall in front of the woman?", "options": ["A. White with blue stripes.", "B. Pink with white stripes.", "C. Light-colored with pink stripes.", "D. Dark-colored with gold detailing."], "answer": "C", "time_stamp_s": 14, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_159_a2048_q1", "video_id": 159, "time_stamp_s": 14, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2e5617615ca29274bddaa97ac9931da9ee39360200c5e73bc4b548a6784a1d18", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0], "recent_frames_sha256": "5a9d6b20a0f3cbc12686c01e002ae985158148287e894ae4a8c227ff5966c099", "num_recent_frames": 15, "tq": 718217.396767061, "t1": 718224.372761554, "ta": 718224.372761554, "te": 718224.411837914, "first_response_s": 6.975994492997415, "answer_total_s": 7.015070853056386, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_159_a2048_q1", "video_id": 159, "time_stamp_s": 14, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "770667a0c8188d351f1b146820864b4578f9417e9d597438749e5e1918e5b5c0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0], "recent_frames_sha256": "5a9d6b20a0f3cbc12686c01e002ae985158148287e894ae4a8c227ff5966c099", "num_recent_frames": 15, "tq": 718264.725618739, "t1": 718272.473742546, "ta": 718272.473742546, "te": 718272.512022071, "first_response_s": 7.748123807017691, "answer_total_s": 7.786403332022019, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 159, "content_group": "8ed935c0421f83f82429a2d5bb320e2b5705bf75f48da256e8666315e28b15cc", "question": {"question_id": "sample_159_a2049_q0", "video_id": 159, "video_path": "./videos/sample_159_real.mp4", "annotation_index": 2049, "question_index": 0, "question": "What are the helpers doing to the person in the golden robe?", "options": ["A. Applying makeup.", "B. Adjusting a braided belt.", "C. Polishing their sandals.", "D. Fixing their hair."], "answer": "B", "time_stamp_s": 66, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_159_a2049_q0", "video_id": 159, "time_stamp_s": 66, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "86bb6a78081ec76cb78d6dda6cc52b036579262a2cdf869a42d83d024be964a3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0], "recent_frames_sha256": "c876dd362b5e2aca9f5483de211e1545125de5d34830ad78cc20940261ce6270", "num_recent_frames": 30, "tq": 718224.429944162, "t1": 718232.424358944, "ta": 718232.424358944, "te": 718232.460224012, "first_response_s": 7.994414781918749, "answer_total_s": 8.030279850005172, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_159_a2049_q0", "video_id": 159, "time_stamp_s": 66, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f61ba1a9c5366385991849d8eb3a6e1d54d311be771f8bf6620c8e9debfb0bd9", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A woman with dark, curly hair is wrapped in a white towel, her back exposed, while another person in a blue uniform adjusts the towel around her.  \n- The second person, wearing a blue uniform and headband, is seen from the side, assisting with the towel and later covering the woman with a white cloth.  \n- A beige fabric bag with braided tassels is placed on a bed, and a hand reaches toward it, suggesting preparation or use of the item.\n[30-60s] - A woman in a blue robe assists another woman in a white robe by draping a golden robe over her shoulders.  \n- The woman in the golden robe stands facing away, with the robe partially covering her body as the assistant adjusts it.  \n- A third woman in a gray robe enters the scene, observing the dressing process.", "history_tokens": 181, "history_utf8_bytes": 773, "recent_frame_times_s": [37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0], "recent_frames_sha256": "c876dd362b5e2aca9f5483de211e1545125de5d34830ad78cc20940261ce6270", "num_recent_frames": 30, "tq": 718292.472387446, "t1": 718298.793441624, "ta": 718298.793441624, "te": 718298.945733494, "first_response_s": 6.3210541780572385, "answer_total_s": 6.473346048034728, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 159, "content_group": "8ed935c0421f83f82429a2d5bb320e2b5705bf75f48da256e8666315e28b15cc", "question": {"question_id": "sample_159_a2050_q0", "video_id": 159, "video_path": "./videos/sample_159_real.mp4", "annotation_index": 2050, "question_index": 0, "question": "What is the person in the yellow garment doing right now?", "options": ["A. Reaching for the box.", "B. Selecting a bracelet from the wooden box and puting it on her hand.", "C. Putting on a necklace.", "D. Fixing their hairstyle."], "answer": "B", "time_stamp_s": 129, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_159_a2050_q0", "video_id": 159, "time_stamp_s": 129, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d8b9e5feedb7840ad1c7e365d45e719f2307a1dcfe19e37d038ed50d8fdbc79a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0], "recent_frames_sha256": "b5c609005db91a59e18e47e8e1bfff8230e821d3dfcde6f58c8080b2a76bc548", "num_recent_frames": 30, "tq": 718232.481720807, "t1": 718244.693205446, "ta": 718244.693205446, "te": 718244.732610065, "first_response_s": 12.21148463897407, "answer_total_s": 12.250889257993549, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_159_a2050_q0", "video_id": 159, "time_stamp_s": 129, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0fd093f2939610cecf4a3cc4844d30209ad5eb7bcfdae3584c89c96ff4d9eec1", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A woman with dark, curly hair is wrapped in a white towel, her back exposed, while another person in a blue uniform adjusts the towel around her.  \n- The second person, wearing a blue uniform and headband, is seen from the side, assisting with the towel and later covering the woman with a white cloth.  \n- A beige fabric bag with braided tassels is placed on a bed, and a hand reaches toward it, suggesting preparation or use of the item.\n[30-60s] - A woman in a blue robe assists another woman in a white robe by draping a golden robe over her shoulders.  \n- The woman in the golden robe stands facing away, with the robe partially covering her body as the assistant adjusts it.  \n- A third woman in a gray robe enters the scene, observing the dressing process.\n[60-90s] - A hand places a small, dark object into an oyster shell on a plate.  \n- A hand picks up a small glass bottle from a collection of decorative glassware.  \n- A wooden bowl containing white powder sits beside the oyster shells on the plate.\n[90-120s] - A woman in a yellow dress holds a magnifying glass, examining her reflection while standing near a seated woman.  \n- Another woman in a light blue dress stands behind the seated woman, styling her hair.  \n- The seated woman in yellow turns her head slightly, observing her reflection in the magnifying glass.", "history_tokens": 315, "history_utf8_bytes": 1343, "recent_frame_times_s": [100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0], "recent_frames_sha256": "b5c609005db91a59e18e47e8e1bfff8230e821d3dfcde6f58c8080b2a76bc548", "num_recent_frames": 30, "tq": 718311.990480582, "t1": 718313.461055767, "ta": 718313.461055767, "te": 718313.654761956, "first_response_s": 1.4705751850269735, "answer_total_s": 1.664281373959966, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 159, "content_group": "8ed935c0421f83f82429a2d5bb320e2b5705bf75f48da256e8666315e28b15cc", "question": {"question_id": "sample_159_a2051_q0", "video_id": 159, "video_path": "./videos/sample_159_real.mp4", "annotation_index": 2051, "question_index": 0, "question": "What does the older woman do after appearing behind the young woman?", "options": ["A. Adjusts the shawl of the young woman.", "B. Hands a vessel to the young woman.", "C. Sits down beside the young woman.", "D. Leaves the scene immediately."], "answer": "A", "time_stamp_s": 185, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [180, 223], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_159_a2051_q0", "video_id": 159, "time_stamp_s": 185, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "82dfd26120657e4c699e71daf2893fbc00848b49b81e0e7f789f87c047ec15d3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0], "recent_frames_sha256": "9bee5b8f9efaa173b620f98bda188b115af5d3635f66767a1eb8b198ddf7d352", "num_recent_frames": 30, "tq": 718244.741193517, "t1": 718257.407500373, "ta": 718257.407500373, "te": 718257.445123991, "first_response_s": 12.666306855971925, "answer_total_s": 12.703930474002846, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_159_a2051_q0", "video_id": 159, "time_stamp_s": 185, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e10bb3e1746c8ab79db5190edf79680ba6484ba4cb3ddc386f04d7e0986749f6", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A woman with dark, curly hair is wrapped in a white towel, her back exposed, while another person in a blue uniform adjusts the towel around her.  \n- The second person, wearing a blue uniform and headband, is seen from the side, assisting with the towel and later covering the woman with a white cloth.  \n- A beige fabric bag with braided tassels is placed on a bed, and a hand reaches toward it, suggesting preparation or use of the item.\n[30-60s] - A woman in a blue robe assists another woman in a white robe by draping a golden robe over her shoulders.  \n- The woman in the golden robe stands facing away, with the robe partially covering her body as the assistant adjusts it.  \n- A third woman in a gray robe enters the scene, observing the dressing process.\n[60-90s] - A hand places a small, dark object into an oyster shell on a plate.  \n- A hand picks up a small glass bottle from a collection of decorative glassware.  \n- A wooden bowl containing white powder sits beside the oyster shells on the plate.\n[90-120s] - A woman in a yellow dress holds a magnifying glass, examining her reflection while standing near a seated woman.  \n- Another woman in a light blue dress stands behind the seated woman, styling her hair.  \n- The seated woman in yellow turns her head slightly, observing her reflection in the magnifying glass.\n[120-150s] - A woman in a blue dress holds a wooden box and opens it to reveal a chain, then hands it to another woman.  \n- The second woman, wearing a yellow dress and gold chain, has her hair styled in braids and is adorned with dangling earrings.  \n- The first woman drapes a beige shawl over the second woman’s shoulders, adjusting it to fit properly.\n[150-180s] - Woman in blue dress assists another woman in adjusting a draped garment.  \n- Woman in beige robe stands with a child on her back, then turns to face the other woman.  \n- A third woman in a purple robe enters, standing beside the woman in beige, both facing each other.", "history_tokens": 472, "history_utf8_bytes": 1983, "recent_frame_times_s": [156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0], "recent_frames_sha256": "9bee5b8f9efaa173b620f98bda188b115af5d3635f66767a1eb8b198ddf7d352", "num_recent_frames": 30, "tq": 718333.843373153, "t1": 718342.227724995, "ta": 718342.227724995, "te": 718342.419156274, "first_response_s": 8.384351841988973, "answer_total_s": 8.57578312093392, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 160, "content_group": "39b4dbdcd9e6bebd3428ce51c6378ff5fafac002981e6093c3ff85f58eaa62fc", "question": {"question_id": "sample_160_a456_q0", "video_id": 160, "video_path": "./videos/sample_160_real.mp4", "annotation_index": 456, "question_index": 0, "question": "What is the person picking up in the video?", "options": ["A. A small piece of fabric.", "B. A large piece of beige fabric.", "C. A wooden beam.", "D. A piece of darker fabric."], "answer": "B", "time_stamp_s": 11, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_160_a456_q0", "video_id": 160, "time_stamp_s": 11, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a9725c700897c3d928cd9263afc025f3ba92b9565c04f77ab88a54d15d6ed057", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0], "recent_frames_sha256": "8efd1137370ea348c83e875cf92f50feee0ecdb06f38c3ea191ea6128dd835ff", "num_recent_frames": 12, "tq": 718017.523648927, "t1": 718027.980116642, "ta": 718027.980116642, "te": 718028.017821886, "first_response_s": 10.456467714975588, "answer_total_s": 10.494172959006391, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_160_a456_q0", "video_id": 160, "time_stamp_s": 11, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2c49a75976b85a5e92b515ff84194b5fe61527db45f06cd1576c909faeb314bb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0], "recent_frames_sha256": "8efd1137370ea348c83e875cf92f50feee0ecdb06f38c3ea191ea6128dd835ff", "num_recent_frames": 12, "tq": 718072.892324367, "t1": 718079.748833107, "ta": 718079.748833107, "te": 718079.939788476, "first_response_s": 6.8565087399911135, "answer_total_s": 7.047464109025896, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 160, "content_group": "39b4dbdcd9e6bebd3428ce51c6378ff5fafac002981e6093c3ff85f58eaa62fc", "question": {"question_id": "sample_160_a456_q1", "video_id": 160, "video_path": "./videos/sample_160_real.mp4", "annotation_index": 456, "question_index": 1, "question": "What action does the person perform with the large piece of fabric?", "options": ["A. Ties it around their waist.", "B. Drapes it over themselves and threads arms through the sleeves.", "C. Folds it neatly and places it on the floor.", "D. Wraps it around their head."], "answer": "B", "time_stamp_s": 15, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_160_a456_q1", "video_id": 160, "time_stamp_s": 15, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "26325588306fefa04a9e6030ac58316ca90e1d3b6aecc8add94ea00e2f437126", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0], "recent_frames_sha256": "3f91c1b79f4b36a58b67dbe7ae075322e9a92958e5dd23587da455f24addba63", "num_recent_frames": 16, "tq": 718028.035933582, "t1": 718035.784141565, "ta": 718035.784141565, "te": 718035.822568828, "first_response_s": 7.7482079829787835, "answer_total_s": 7.7866352460114285, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_160_a456_q1", "video_id": 160, "time_stamp_s": 15, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1956f09b160eb6eed18d30d82f964d0d04e00e3182f3cf78cebe00e587b58f09", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0], "recent_frames_sha256": "3f91c1b79f4b36a58b67dbe7ae075322e9a92958e5dd23587da455f24addba63", "num_recent_frames": 16, "tq": 718079.973234376, "t1": 718090.696380945, "ta": 718090.696380945, "te": 718090.736624382, "first_response_s": 10.723146568983793, "answer_total_s": 10.763390005915426, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 160, "content_group": "39b4dbdcd9e6bebd3428ce51c6378ff5fafac002981e6093c3ff85f58eaa62fc", "question": {"question_id": "sample_160_a457_q0", "video_id": 160, "video_path": "./videos/sample_160_real.mp4", "annotation_index": 457, "question_index": 0, "question": "What does the person do after picking up or placing several small objects?", "options": ["A. Opens the window.", "B. Sits down at the table.", "C. Adjusts a braided belt around their waist.", "D. Leaves the room."], "answer": "C", "time_stamp_s": 93, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_160_a457_q0", "video_id": 160, "time_stamp_s": 93, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9ff222b6a532193284a2d50bb135507b858f906e2d7e919204e0b0baf265c722", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0], "recent_frames_sha256": "9f6e33113fe2d4a072e7f05fa3a3248d074551d8376cc7042848f78eac2b0fbf", "num_recent_frames": 30, "tq": 718035.837594893, "t1": 718047.457601427, "ta": 718047.457601427, "te": 718047.499837693, "first_response_s": 11.620006534038112, "answer_total_s": 11.66224279999733, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_160_a457_q0", "video_id": 160, "time_stamp_s": 93, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2ffca00e7d711b5b3ceea0e06f6b4f058278e9e9a31047ac3a50711a40b67c7b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Woman with long dark hair adjusts her clothing while standing near a textured wall.  \n- She drapes a beige cloak over her shoulders, then pulls it up to cover her head and neck.  \n- A wooden door frame and draped fabric are visible in the background, suggesting a rustic interior.\n[30-60s] - Person in white robe removes brown leather shoes, revealing bare feet on grassy floor.  \n- Person sits on a wooden chair, then stands and moves toward a table, adjusting robe.  \n- Room features a circular hanging object, a window with greenery, and a dark doorway.\n[60-90s] - Woman in white dress adjusts a dark, circular object near her neck, then places it on a table.  \n- She later ties a light-colored belt around her waist, securing it with a knot.  \n- A woven basket labeled \"MARKET\" sits on the table beside her, containing various items.", "history_tokens": 202, "history_utf8_bytes": 847, "recent_frame_times_s": [64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0], "recent_frames_sha256": "9f6e33113fe2d4a072e7f05fa3a3248d074551d8376cc7042848f78eac2b0fbf", "num_recent_frames": 30, "tq": 718118.757122359, "t1": 718132.502641781, "ta": 718132.502641781, "te": 718132.652739478, "first_response_s": 13.745519421994686, "answer_total_s": 13.895617119036615, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 160, "content_group": "39b4dbdcd9e6bebd3428ce51c6378ff5fafac002981e6093c3ff85f58eaa62fc", "question": {"question_id": "sample_160_a458_q0", "video_id": 160, "video_path": "./videos/sample_160_real.mp4", "annotation_index": 458, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Adjusting their belt.", "B. Pulling a hood over their head.", "C. Opening a wooden door.", "D. Stepping outside."], "answer": "D", "time_stamp_s": 177, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_160_a458_q0", "video_id": 160, "time_stamp_s": 177, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "983fd54eb7f971f631abe9852133d7d92e5c53970dc89bb9ba1284a1b17b6db9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0], "recent_frames_sha256": "da719640cb6a42fbbe75b651c464f52368026d6a268866d5a5bacab63e97130e", "num_recent_frames": 30, "tq": 718047.511848593, "t1": 718059.695162074, "ta": 718059.695162074, "te": 718059.732866143, "first_response_s": 12.183313480927609, "answer_total_s": 12.22101754997857, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_160_a458_q0", "video_id": 160, "time_stamp_s": 177, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fabfe76e02d05d6bbff824cabe3e4cdae60c3631af3812730d48885d502e1dba", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Woman with long dark hair adjusts her clothing while standing near a textured wall.  \n- She drapes a beige cloak over her shoulders, then pulls it up to cover her head and neck.  \n- A wooden door frame and draped fabric are visible in the background, suggesting a rustic interior.\n[30-60s] - Person in white robe removes brown leather shoes, revealing bare feet on grassy floor.  \n- Person sits on a wooden chair, then stands and moves toward a table, adjusting robe.  \n- Room features a circular hanging object, a window with greenery, and a dark doorway.\n[60-90s] - Woman in white dress adjusts a dark, circular object near her neck, then places it on a table.  \n- She later ties a light-colored belt around her waist, securing it with a knot.  \n- A woven basket labeled \"MARKET\" sits on the table beside her, containing various items.\n[90-120s] - Hands fasten a belt with a metal buckle, then pull out a pouch from the belt.\n- A beaded necklace with colorful, patterned beads is worn around the neck.\n- A woman in a beige tunic adjusts a pink cloak over her shoulders, standing near a red wall with a golden knot design.\n[120-150s] - Woman adjusts a maroon cloak over her shoulders, then pulls it closed.  \n- She picks up a white veil, drapes it over her head, and smooths it into place.  \n- The setting features a red wall with a golden Celtic knot design behind her.", "history_tokens": 341, "history_utf8_bytes": 1381, "recent_frame_times_s": [148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0], "recent_frames_sha256": "da719640cb6a42fbbe75b651c464f52368026d6a268866d5a5bacab63e97130e", "num_recent_frames": 30, "tq": 718151.185570012, "t1": 718158.690648971, "ta": 718158.690648971, "te": 718158.892708691, "first_response_s": 7.505078959045932, "answer_total_s": 7.7071386789903045, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 160, "content_group": "39b4dbdcd9e6bebd3428ce51c6378ff5fafac002981e6093c3ff85f58eaa62fc", "question": {"question_id": "sample_160_a459_q0", "video_id": 160, "video_path": "./videos/sample_160_real.mp4", "annotation_index": 459, "question_index": 0, "question": "What are the colors of the garments worn by the person lying down?", "options": ["A. Cream and blue with red embroidered edges.", "B. White and blue with gold embroidered edges.", "C. Cream and green with silver embroidered edges.", "D. White and red with blue embroidered edges."], "answer": "A", "time_stamp_s": 268, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_160_a459_q0", "video_id": 160, "time_stamp_s": 268, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c1443aee867ffb29d924a7c31f8fbea2a86ab9e928d0f0c0d59eadc2285ceafa", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0], "recent_frames_sha256": "691ecf7dfacaf4e93b617e541f83dec3798a5b7eedfb7e82432c75c08f83c737", "num_recent_frames": 30, "tq": 718059.740243869, "t1": 718072.847290004, "ta": 718072.847290004, "te": 718072.884448501, "first_response_s": 13.107046135002747, "answer_total_s": 13.144204632029869, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_160_a459_q0", "video_id": 160, "time_stamp_s": 268, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8d2d75e693a5fa529695955bbb99471fbc77a55da47fa9654d1c119d4dcd99ef", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Woman with long dark hair adjusts her clothing while standing near a textured wall.  \n- She drapes a beige cloak over her shoulders, then pulls it up to cover her head and neck.  \n- A wooden door frame and draped fabric are visible in the background, suggesting a rustic interior.\n[30-60s] - Person in white robe removes brown leather shoes, revealing bare feet on grassy floor.  \n- Person sits on a wooden chair, then stands and moves toward a table, adjusting robe.  \n- Room features a circular hanging object, a window with greenery, and a dark doorway.\n[60-90s] - Woman in white dress adjusts a dark, circular object near her neck, then places it on a table.  \n- She later ties a light-colored belt around her waist, securing it with a knot.  \n- A woven basket labeled \"MARKET\" sits on the table beside her, containing various items.\n[90-120s] - Hands fasten a belt with a metal buckle, then pull out a pouch from the belt.\n- A beaded necklace with colorful, patterned beads is worn around the neck.\n- A woman in a beige tunic adjusts a pink cloak over her shoulders, standing near a red wall with a golden knot design.\n[120-150s] - Woman adjusts a maroon cloak over her shoulders, then pulls it closed.  \n- She picks up a white veil, drapes it over her head, and smooths it into place.  \n- The setting features a red wall with a golden Celtic knot design behind her.\n[150-180s] - Person adjusts a light green hood over their head, then ties a dark cord around their neck.  \n- They step out of a dimly lit room into a sunlit doorway, carrying a wooden staff.  \n- Outside, they stand before a wooden door, facing away from the camera, with a basket and table visible nearby.\n[180-210s] - A woman in a white veil and layered dress stands before a wooden door, holding a small object.  \n- An older man in a gray robe and another in an orange cloak approach from the right, gesturing toward her.  \n- The group walks away from the wooden structure into a grassy field, with the woman leading the way.\n[210-240s] - Wooden baskets with contents (one holding grains, another with white material) are positioned on a dark surface, illuminated by warm light.\n- A glass jar with a metal lid and a small wooden comb are placed on a round tray, alongside a ceramic pot.\n- A person’s legs, wrapped in patterned fabric and tied with an orange cord, lie on a dark surface, partially covered by a light-colored cloth.", "history_tokens": 591, "history_utf8_bytes": 2416, "recent_frame_times_s": [239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0], "recent_frames_sha256": "691ecf7dfacaf4e93b617e541f83dec3798a5b7eedfb7e82432c75c08f83c737", "num_recent_frames": 30, "tq": 718184.124142343, "t1": 718185.151312913, "ta": 718185.151312913, "te": 718185.190327211, "first_response_s": 1.027170570101589, "answer_total_s": 1.0661848681047559, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 161, "content_group": "4cc8a0fae95ac6d1eb254d8c7159bef82af7d325b49e7f09b27deac9aa2c6f04", "question": {"question_id": "sample_161_a124_q0", "video_id": 161, "video_path": "./videos/sample_161_real.mp4", "annotation_index": 124, "question_index": 0, "question": "What pattern is on the woman's robe?", "options": ["A. Stripes.", "B. Polka dots.", "C. Floral.", "D. Geometric."], "answer": "C", "time_stamp_s": 2, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_161_a124_q0", "video_id": 161, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "C. Floral.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "86b3d8bcc2eca6c1a225574b3a3fd280ab627b3b1510e33fea9c0ea9601b9dad", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0], "recent_frames_sha256": "755625b27261411453b19b1c968bca7c8f809fe13aef5bf424816e1d21e36caf", "num_recent_frames": 3, "tq": 715274.684727764, "t1": 715280.812721673, "ta": 715280.812721673, "te": 715280.976882349, "first_response_s": 6.127993909060024, "answer_total_s": 6.292154585011303, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_161_a124_q0", "video_id": 161, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "C. Floral.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "3dac076d1ad1360c86ef230cc88021ad31d853bedc00b06d50edf0c6a47bbec3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0], "recent_frames_sha256": "755625b27261411453b19b1c968bca7c8f809fe13aef5bf424816e1d21e36caf", "num_recent_frames": 3, "tq": 715211.579198241, "t1": 715223.732193409, "ta": 715223.732193409, "te": 715223.884785692, "first_response_s": 12.152995167998597, "answer_total_s": 12.30558745097369, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 161, "content_group": "4cc8a0fae95ac6d1eb254d8c7159bef82af7d325b49e7f09b27deac9aa2c6f04", "question": {"question_id": "sample_161_a125_q0", "video_id": 161, "video_path": "./videos/sample_161_real.mp4", "annotation_index": 125, "question_index": 0, "question": "What color is the cover on the bed?", "options": ["A. Blue.", "B. Green.", "C. Peach.", "D. White."], "answer": "C", "time_stamp_s": 80, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_161_a125_q0", "video_id": 161, "time_stamp_s": 80, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6ceb70b212e36aee12fb91060f939dab6fa84a76faa4373bbc41018f2c27522a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0], "recent_frames_sha256": "751586a9aab0eccf152c23a206e0011604d23828d4ec16432d51c61926ee185c", "num_recent_frames": 30, "tq": 715281.001785468, "t1": 715288.58785044, "ta": 715288.58785044, "te": 715288.829652904, "first_response_s": 7.586064971983433, "answer_total_s": 7.827867435989901, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_161_a125_q0", "video_id": 161, "time_stamp_s": 80, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6b88569591b11ab2a596e816bcbc46b7ca055e3c411a8ffc69b0945a129392e0", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Woman removes floral robe to reveal white lace lingerie while standing in bedroom.  \n- She sits on chair by window, adjusting her lingerie and legs, with clothes spread on bed nearby.  \n- Room features floral wallpaper, wooden dresser with mirror, and two beds with pink bedding.\n[30-60s] - Woman in white lingerie sits on chair, adjusting garment near bed.\n- She stands, moves to bed, and begins arranging patterned fabric on it.\n- Room features floral wallpaper, wooden dresser, and two beds with white linens.", "history_tokens": 119, "history_utf8_bytes": 522, "recent_frame_times_s": [51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0], "recent_frames_sha256": "751586a9aab0eccf152c23a206e0011604d23828d4ec16432d51c61926ee185c", "num_recent_frames": 30, "tq": 715233.726334555, "t1": 715235.475585196, "ta": 715235.475585196, "te": 715235.714677287, "first_response_s": 1.749250641092658, "answer_total_s": 1.9883427320746705, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 161, "content_group": "4cc8a0fae95ac6d1eb254d8c7159bef82af7d325b49e7f09b27deac9aa2c6f04", "question": {"question_id": "sample_161_a125_q2", "video_id": 161, "video_path": "./videos/sample_161_real.mp4", "annotation_index": 125, "question_index": 2, "question": "What is the woman primarily doing in the video?", "options": ["A. Cleaning the room.", "B. Reading a book.", "C. Dressing herself.", "D. Writing a letter."], "answer": "C", "time_stamp_s": 80, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_161_a125_q2", "video_id": 161, "time_stamp_s": 80, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "443d7a2a00c271400933ae1222da4052d81f8903abfca25610f88d35322ac863", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0], "recent_frames_sha256": "751586a9aab0eccf152c23a206e0011604d23828d4ec16432d51c61926ee185c", "num_recent_frames": 30, "tq": 715288.86067846, "t1": 715296.575352987, "ta": 715296.575352987, "te": 715296.618730826, "first_response_s": 7.714674527058378, "answer_total_s": 7.758052365970798, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_161_a125_q2", "video_id": 161, "time_stamp_s": 80, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "90c488322a042cbabd9fbb812e251b0453bc1da0a22a344e3b7f884352326c8c", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Woman removes floral robe to reveal white lace lingerie while standing in bedroom.  \n- She sits on chair by window, adjusting her lingerie and legs, with clothes spread on bed nearby.  \n- Room features floral wallpaper, wooden dresser with mirror, and two beds with pink bedding.\n[30-60s] - Woman in white lingerie sits on chair, adjusting garment near bed.\n- She stands, moves to bed, and begins arranging patterned fabric on it.\n- Room features floral wallpaper, wooden dresser, and two beds with white linens.", "history_tokens": 119, "history_utf8_bytes": 522, "recent_frame_times_s": [51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0], "recent_frames_sha256": "751586a9aab0eccf152c23a206e0011604d23828d4ec16432d51c61926ee185c", "num_recent_frames": 30, "tq": 715235.787658739, "t1": 715247.199529736, "ta": 715247.199529736, "te": 715247.392849093, "first_response_s": 11.41187099693343, "answer_total_s": 11.605190353933722, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 161, "content_group": "4cc8a0fae95ac6d1eb254d8c7159bef82af7d325b49e7f09b27deac9aa2c6f04", "question": {"question_id": "sample_161_a125_q1", "video_id": 161, "video_path": "./videos/sample_161_real.mp4", "annotation_index": 125, "question_index": 1, "question": "What does the woman do after putting on the dress?", "options": ["A. Brushes her hair.", "B. Put on her high heels.", "C. Adjusts the mirror.", "D. Picks up a jewelry box."], "answer": "B", "time_stamp_s": 89, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_161_a125_q1", "video_id": 161, "time_stamp_s": 89, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4e5b682344506711b2be7e1567c011cc1ae167037e18175568e7f43a9da2416c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0], "recent_frames_sha256": "784d991f6c38728db68d690fea4ce41d642adc978bc8f82efec4b790486f296e", "num_recent_frames": 30, "tq": 715296.638813105, "t1": 715309.348509805, "ta": 715309.348509805, "te": 715309.388117003, "first_response_s": 12.709696700097993, "answer_total_s": 12.749303898075595, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_161_a125_q1", "video_id": 161, "time_stamp_s": 89, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a2c996099fbeeb0ba68c97f67d640895d230a58fb315b8bffeddc38a44d57836", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Woman removes floral robe to reveal white lace lingerie while standing in bedroom.  \n- She sits on chair by window, adjusting her lingerie and legs, with clothes spread on bed nearby.  \n- Room features floral wallpaper, wooden dresser with mirror, and two beds with pink bedding.\n[30-60s] - Woman in white lingerie sits on chair, adjusting garment near bed.\n- She stands, moves to bed, and begins arranging patterned fabric on it.\n- Room features floral wallpaper, wooden dresser, and two beds with white linens.", "history_tokens": 119, "history_utf8_bytes": 522, "recent_frame_times_s": [60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0], "recent_frames_sha256": "784d991f6c38728db68d690fea4ce41d642adc978bc8f82efec4b790486f296e", "num_recent_frames": 30, "tq": 715247.403393383, "t1": 715254.697777583, "ta": 715254.697777583, "te": 715254.73651585, "first_response_s": 7.294384200009517, "answer_total_s": 7.333122466923669, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 161, "content_group": "4cc8a0fae95ac6d1eb254d8c7159bef82af7d325b49e7f09b27deac9aa2c6f04", "question": {"question_id": "sample_161_a126_q0", "video_id": 161, "video_path": "./videos/sample_161_real.mp4", "annotation_index": 126, "question_index": 0, "question": "What is the woman doing right now?", "options": ["A. Singing.", "B. Dancing.", "C. Smiling.", "D. Reading."], "answer": "B", "time_stamp_s": 162, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_161_a126_q0", "video_id": 161, "time_stamp_s": 162, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "27b4ed2246b938ffe45c9dc8e6c816e34167047bcb9ea3c906e9de4fadfc8fc3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0], "recent_frames_sha256": "0c172dc3d0cd53558e5c630a67f9588059548d3ce091d1c3ef250c45c8cad192", "num_recent_frames": 30, "tq": 715309.401161802, "t1": 715321.312372297, "ta": 715321.312372297, "te": 715321.353495506, "first_response_s": 11.911210495047271, "answer_total_s": 11.952333703986369, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_161_a126_q0", "video_id": 161, "time_stamp_s": 162, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a1fe9ea19103ce4575679be7107eeeb5717150118a364e170b4efbc34b0b85a6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Woman removes floral robe to reveal white lace lingerie while standing in bedroom.  \n- She sits on chair by window, adjusting her lingerie and legs, with clothes spread on bed nearby.  \n- Room features floral wallpaper, wooden dresser with mirror, and two beds with pink bedding.\n[30-60s] - Woman in white lingerie sits on chair, adjusting garment near bed.\n- She stands, moves to bed, and begins arranging patterned fabric on it.\n- Room features floral wallpaper, wooden dresser, and two beds with white linens.\n[60-90s] - Woman adjusts beaded dress straps while seated on bed.  \n- She bends forward to fasten or adjust lower garment section.  \n- Dress features gold beads and floral embroidery; room has floral wallpaper.\n[90-120s] - Woman adjusts her gold-patterned dress while standing near a wooden dresser.  \n- She applies makeup using a brush, then adds a gold leaf headpiece and turquoise necklace.  \n- She turns to face the mirror, adjusting her hair and attire as she prepares for an event.\n[120-150s] - Woman in yellow floral dress adjusts her gown while facing a mirror in a vintage bedroom.  \n- Two cocktail glasses, one with a lemon twist, are shown on a table.  \n- Women in flapper attire socialize and dance at a 1920s-style party, with one woman in a fur stole smiling.", "history_tokens": 310, "history_utf8_bytes": 1296, "recent_frame_times_s": [133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0], "recent_frames_sha256": "0c172dc3d0cd53558e5c630a67f9588059548d3ce091d1c3ef250c45c8cad192", "num_recent_frames": 30, "tq": 715273.407765264, "t1": 715274.45918541, "ta": 715274.45918541, "te": 715274.662686484, "first_response_s": 1.0514201460173354, "answer_total_s": 1.2549212200101465, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 162, "content_group": "86ccd2101f82b56972dc7d4ed34a785426fa34379b2bf468cb6d075ca793860d", "question": {"question_id": "sample_162_a1046_q0", "video_id": 162, "video_path": "./videos/sample_162_real.mp4", "annotation_index": 1046, "question_index": 0, "question": "What is hanging on the wall beside the nurse?", "options": ["A. A clock.", "B. A portrait.", "C. A Union Jack flag.", "D. A medical certificate."], "answer": "C", "time_stamp_s": 14, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_162_a1046_q0", "video_id": 162, "time_stamp_s": 14, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b5a32a61e6a404dc4f9205ff390cce4af12dc7ebb0f4dead994362ba1c5d7b9c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0], "recent_frames_sha256": "fe07431834912a263d75c6005f92e1a41dfd735cc6f01899248c77b222bf33e5", "num_recent_frames": 15, "tq": 718836.837677717, "t1": 718849.541327212, "ta": 718849.541327212, "te": 718849.579759804, "first_response_s": 12.703649495029822, "answer_total_s": 12.742082086973824, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_162_a1046_q0", "video_id": 162, "time_stamp_s": 14, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "763d81661e279c1275afeca1e13672d0a0a4e93006b2ae359a4d0428e564ac72", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0], "recent_frames_sha256": "fe07431834912a263d75c6005f92e1a41dfd735cc6f01899248c77b222bf33e5", "num_recent_frames": 15, "tq": 718894.046252152, "t1": 718900.297333752, "ta": 718900.297333752, "te": 718900.498340101, "first_response_s": 6.2510816000867635, "answer_total_s": 6.452087949030101, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 162, "content_group": "86ccd2101f82b56972dc7d4ed34a785426fa34379b2bf468cb6d075ca793860d", "question": {"question_id": "sample_162_a1046_q1", "video_id": 162, "video_path": "./videos/sample_162_real.mp4", "annotation_index": 1046, "question_index": 1, "question": "What is the nurse doing in the room?", "options": ["A. Preparing a meal.", "B. Writing notes.", "C. Making a bed.", "D. Cleaning the floor."], "answer": "C", "time_stamp_s": 20, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_162_a1046_q1", "video_id": 162, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d87bb7c704b33448f3904304ae0447078e8d119a577614abfe92dea80376c4c3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "4924102f56bbe504a35f291e9d4f56a1e9a437f5e6737bfd2d9fc0c27207169f", "num_recent_frames": 21, "tq": 718849.59358067, "t1": 718859.766596775, "ta": 718859.766596775, "te": 718859.918810825, "first_response_s": 10.173016105080023, "answer_total_s": 10.325230155023746, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_162_a1046_q1", "video_id": 162, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f7024d604221c47d3b8735203ca33bb5dd0739e2b06938d80a433796047360cb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "4924102f56bbe504a35f291e9d4f56a1e9a437f5e6737bfd2d9fc0c27207169f", "num_recent_frames": 21, "tq": 718900.532108452, "t1": 718906.234401845, "ta": 718906.234401845, "te": 718906.26729723, "first_response_s": 5.702293392969295, "answer_total_s": 5.7351887779077515, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 162, "content_group": "86ccd2101f82b56972dc7d4ed34a785426fa34379b2bf468cb6d075ca793860d", "question": {"question_id": "sample_162_a1047_q0", "video_id": 162, "video_path": "./videos/sample_162_real.mp4", "annotation_index": 1047, "question_index": 0, "question": "What color are the socks being put on the seated person?", "options": ["A. Red.", "B. Blue.", "C. Yellow.", "D. Green."], "answer": "D", "time_stamp_s": 72, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_162_a1047_q0", "video_id": 162, "time_stamp_s": 72, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f45eb535446a33ce6c6697bd6a7449c3c0fadae1e5ac42a09d67c39cab5c2c16", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0], "recent_frames_sha256": "45b16417b433a2e5a2c29b4fd7fec43f2d9912a0afc789f0c8a5df7015672ce9", "num_recent_frames": 30, "tq": 718859.931141783, "t1": 718867.294727521, "ta": 718867.294727521, "te": 718867.447225894, "first_response_s": 7.363585737999529, "answer_total_s": 7.5160841109463945, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_162_a1047_q0", "video_id": 162, "time_stamp_s": 72, "ground_truth": "D", "raw_output": "D. Green.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "58ebac80dd8236e193e16f9b72404108b9ad1c7b56ccbfa9a65eb3810afbf350", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A nurse in a white uniform with a red cross emblem makes a bed in a sunlit room with large windows and a Union Jack flag.  \n- A soldier in a straw hat and uniform is seen moving through a trench, with smoke billowing in the background.  \n- A vintage ambulance with a red cross is parked outdoors, with people loading supplies onto it.\n[30-60s] - Three women in period nursing attire interact in a bright, window-lit hospital room with two beds and a cart.  \n- One woman sits on a chair while another stands nearby, and a third approaches with a tray, suggesting a caregiving routine.  \n- A Union Jack flag is visible on the wall, indicating a British setting, and the room has wooden floors and large windows.", "history_tokens": 167, "history_utf8_bytes": 719, "recent_frame_times_s": [43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0], "recent_frames_sha256": "45b16417b433a2e5a2c29b4fd7fec43f2d9912a0afc789f0c8a5df7015672ce9", "num_recent_frames": 30, "tq": 718954.910468201, "t1": 718956.230546355, "ta": 718956.230546355, "te": 718956.389687987, "first_response_s": 1.320078153978102, "answer_total_s": 1.4792197860078886, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 162, "content_group": "86ccd2101f82b56972dc7d4ed34a785426fa34379b2bf468cb6d075ca793860d", "question": {"question_id": "sample_162_a1048_q0", "video_id": 162, "video_path": "./videos/sample_162_real.mp4", "annotation_index": 1048, "question_index": 0, "question": "What color is the man's tie?", "options": ["A. Blue.", "B. Green.", "C. Yellow.", "D. Red."], "answer": "D", "time_stamp_s": 124, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "getting_dressed", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_162_a1048_q0", "video_id": 162, "time_stamp_s": 124, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f6e0b372a7edc3ff2484b157a1c814e9506435d7a083c897d4402b89e7ac5bf1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0], "recent_frames_sha256": "8c4ddc91d1b2c97b8a858864304292ffb8a582a1a6aff295907e6410a33cbdff", "num_recent_frames": 30, "tq": 718867.460050716, "t1": 718880.939216187, "ta": 718880.939216187, "te": 718880.977319751, "first_response_s": 13.479165471042506, "answer_total_s": 13.5172690351028, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_162_a1048_q0", "video_id": 162, "time_stamp_s": 124, "ground_truth": "D", "raw_output": "D. Red.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "b58e61dc1cdd475c15c7f42b880874fbc929132df94a60ad859dec43ae02a565", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A nurse in a white uniform with a red cross emblem makes a bed in a sunlit room with large windows and a Union Jack flag.  \n- A soldier in a straw hat and uniform is seen moving through a trench, with smoke billowing in the background.  \n- A vintage ambulance with a red cross is parked outdoors, with people loading supplies onto it.\n[30-60s] - Three women in period nursing attire interact in a bright, window-lit hospital room with two beds and a cart.  \n- One woman sits on a chair while another stands nearby, and a third approaches with a tray, suggesting a caregiving routine.  \n- A Union Jack flag is visible on the wall, indicating a British setting, and the room has wooden floors and large windows.\n[60-90s] - A woman in a white apron kneels beside a bed, adjusting a man’s green sock on his foot.  \n- The man, seated on the bed, wears a white shirt and is being assisted by the woman.  \n- A second woman in a white apron stands nearby, observing the sock-fitting process.\n[90-120s] - Two nurses in white uniforms assist a seated man in adjusting his shirt and tie, with one nurse holding a red ribbon.  \n- The man is seated on a chair near a hospital bed, with a cart of medical supplies beside him.  \n- A Union Jack flag is visible on the wall, indicating a British setting.", "history_tokens": 315, "history_utf8_bytes": 1299, "recent_frame_times_s": [95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0], "recent_frames_sha256": "8c4ddc91d1b2c97b8a858864304292ffb8a582a1a6aff295907e6410a33cbdff", "num_recent_frames": 30, "tq": 718975.582545383, "t1": 718976.467692818, "ta": 718976.467692818, "te": 718976.618515463, "first_response_s": 0.8851474350085482, "answer_total_s": 1.0359700799454004, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 162, "content_group": "86ccd2101f82b56972dc7d4ed34a785426fa34379b2bf468cb6d075ca793860d", "question": {"question_id": "sample_162_a1049_q0", "video_id": 162, "video_path": "./videos/sample_162_real.mp4", "annotation_index": 1049, "question_index": 0, "question": "What are the women doing as the man puts on the navy blue jacket?", "options": ["A. They are leaving the room.", "B. They are helping him put on the jacket and adjusting it.", "C. They are folding the linens.", "D. They are standing by the window."], "answer": "B", "time_stamp_s": 191, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "getting_dressed", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_162_a1049_q0", "video_id": 162, "time_stamp_s": 191, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ec23e02b591f331c31ced35ac1bcb6d662a886621e643b07cd7001edca5cff6c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0], "recent_frames_sha256": "fdcdbe86cbbbaa97121a95d843cd2acf1534054b1f45d72d37ec0b192805c1b8", "num_recent_frames": 30, "tq": 718880.985458052, "t1": 718893.996887749, "ta": 718893.996887749, "te": 718894.036648972, "first_response_s": 13.011429696925916, "answer_total_s": 13.051190919941291, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_162_a1049_q0", "video_id": 162, "time_stamp_s": 191, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6c5b6858ece85888a883d1feb63673b841206a49fc80ecb907f0ff3e7f2fb93a", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A nurse in a white uniform with a red cross emblem makes a bed in a sunlit room with large windows and a Union Jack flag.  \n- A soldier in a straw hat and uniform is seen moving through a trench, with smoke billowing in the background.  \n- A vintage ambulance with a red cross is parked outdoors, with people loading supplies onto it.\n[30-60s] - Three women in period nursing attire interact in a bright, window-lit hospital room with two beds and a cart.  \n- One woman sits on a chair while another stands nearby, and a third approaches with a tray, suggesting a caregiving routine.  \n- A Union Jack flag is visible on the wall, indicating a British setting, and the room has wooden floors and large windows.\n[60-90s] - A woman in a white apron kneels beside a bed, adjusting a man’s green sock on his foot.  \n- The man, seated on the bed, wears a white shirt and is being assisted by the woman.  \n- A second woman in a white apron stands nearby, observing the sock-fitting process.\n[90-120s] - Two nurses in white uniforms assist a seated man in adjusting his shirt and tie, with one nurse holding a red ribbon.  \n- The man is seated on a chair near a hospital bed, with a cart of medical supplies beside him.  \n- A Union Jack flag is visible on the wall, indicating a British setting.\n[120-150s] - Nurse in white uniform with red cross emblem adjusts blue coat on seated man.  \n- Two other nurses assist by holding coat and positioning it over the man’s shoulders.  \n- Man in red tie sits on chair, then kneels as nurses help him put on coat.\n[150-180s] - Man in red tie and blue trousers is being assisted by two women in white aprons to remove his trousers, with one adjusting his waistband and the other helping with the pants.\n- The man stands upright, revealing his lower body as the women continue to assist him, with one woman holding his waist and the other adjusting his pants.\n- The scene takes place in a room with large windows, two beds, and a British flag on the wall, suggesting a historical or period setting.", "history_tokens": 488, "history_utf8_bytes": 2042, "recent_frame_times_s": [162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0], "recent_frames_sha256": "fdcdbe86cbbbaa97121a95d843cd2acf1534054b1f45d72d37ec0b192805c1b8", "num_recent_frames": 30, "tq": 718991.01181117, "t1": 718997.188256725, "ta": 718997.188256725, "te": 718997.22726233, "first_response_s": 6.176445554941893, "answer_total_s": 6.215451159980148, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 163, "content_group": "e9e04696ac6828a4d30b146a38155ee748e8746221c5c1d3ee4a5237cf3d64bc", "question": {"question_id": "sample_163_a2077_q0", "video_id": 163, "video_path": "./videos/sample_163_real.mp4", "annotation_index": 2077, "question_index": 0, "question": "What is the current mph of the rider in the video?", "options": ["A. 32 mph.", "B. 33 mph.", "C. 34 mph.", "D. 35 mph."], "answer": "A", "time_stamp_s": 49, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_163_a2077_q0", "video_id": 163, "time_stamp_s": 49, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9f648f30612edbf7d5688ea3c16e541d0497d9e013d6a3f2d2d1d35279b959c0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [19.019, 20.02, 21.021, 22.022, 23.023, 24.024, 25.025, 26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.034, 35.035, 36.036, 37.037, 38.038, 39.039, 40.04, 41.041, 42.00029166666667, 43.00129166666667, 44.002291666666665, 45.00329166666667, 46.00429166666667, 47.005291666666665, 48.00629166666667], "recent_frames_sha256": "ba0f57074624744e9bcf5d7f01d633274d9f1c33bad3ab55c27bb6c45680a55d", "num_recent_frames": 30, "tq": 715211.579030513, "t1": 715217.222261554, "ta": 715217.222261554, "te": 715217.266714214, "first_response_s": 5.643231041030958, "answer_total_s": 5.6876837010495365, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_163_a2077_q0", "video_id": 163, "time_stamp_s": 49, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "00d2ba42ae7f35adf1e18c0979ab0759adf23ae6b1527b76ecab501f5bfdb92e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclist rides uphill on a paved road beside a stone building, with a car passing in the opposite direction.  \n- On-screen text displays stats for \"Furka Pass (East Side)\" including time, gradient, distance, average speed, and max speed.  \n- The cyclist continues ascending, with the road curving slightly and the surrounding landscape featuring grassy hills and distant mountains.", "history_tokens": 86, "history_utf8_bytes": 390, "recent_frame_times_s": [19.019, 20.02, 21.021, 22.022, 23.023, 24.024, 25.025, 26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.034, 35.035, 36.036, 37.037, 38.038, 39.039, 40.04, 41.041, 42.00029166666667, 43.00129166666667, 44.002291666666665, 45.00329166666667, 46.00429166666667, 47.005291666666665, 48.00629166666667], "recent_frames_sha256": "ba0f57074624744e9bcf5d7f01d633274d9f1c33bad3ab55c27bb6c45680a55d", "num_recent_frames": 30, "tq": 710678.910957354, "t1": 710686.01249829, "ta": 710686.01249829, "te": 710686.363187837, "first_response_s": 7.101540936040692, "answer_total_s": 7.452230482944287, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 163, "content_group": "e9e04696ac6828a4d30b146a38155ee748e8746221c5c1d3ee4a5237cf3d64bc", "question": {"question_id": "sample_163_a2078_q0", "video_id": 163, "video_path": "./videos/sample_163_real.mp4", "annotation_index": 2078, "question_index": 0, "question": "What is the current kmh of the rider in the video?", "options": ["A. 52 kmh.", "B. 51 kmh.", "C. 53 kmh.", "D. 54 kmh."], "answer": "B", "time_stamp_s": 61, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [112, 132], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_163_a2078_q0", "video_id": 163, "time_stamp_s": 61, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "af501daa1df271324807b0a62acf226a07379c9d49c774a16f8b801a721d81a8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [31.031, 32.032, 33.033, 34.034, 35.035, 36.036, 37.037, 38.038, 39.039, 40.04, 41.041, 42.00029166666667, 43.00129166666667, 44.002291666666665, 45.00329166666667, 46.00429166666667, 47.005291666666665, 48.00629166666667, 49.00729166666667, 50.008291666666665, 51.00929166666667, 52.01029166666667, 53.011291666666665, 54.01229166666667, 55.01329166666667, 56.014291666666665, 57.01529166666667, 58.01629166666667, 59.017291666666665, 60.01829166666667], "recent_frames_sha256": "aee49ea0810f7d02993f3853eb822d3a4468bfd1634df1164201ca52efb40ec3", "num_recent_frames": 30, "tq": 715217.285980595, "t1": 715224.747961907, "ta": 715224.747961907, "te": 715224.785131959, "first_response_s": 7.461981311906129, "answer_total_s": 7.499151363968849, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_163_a2078_q0", "video_id": 163, "time_stamp_s": 61, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cafceeb1cefdd8db4361ef7e7f1dbb5b5d98a75e38ccbcd04e09a9edd3a6b2c6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclist rides uphill on a paved road beside a stone building, with a car passing in the opposite direction.  \n- On-screen text displays stats for \"Furka Pass (East Side)\" including time, gradient, distance, average speed, and max speed.  \n- The cyclist continues ascending, with the road curving slightly and the surrounding landscape featuring grassy hills and distant mountains.\n[30-60s] - Cyclist rides uphill on a winding mountain road, with speed and elevation data displayed on screen.\n- Road curves along a cliffside, with a guardrail visible on the right and distant mountains in the background.\n- A small building appears on the right side of the road as the cyclist approaches a populated area.", "history_tokens": 157, "history_utf8_bytes": 714, "recent_frame_times_s": [31.031, 32.032, 33.033, 34.034, 35.035, 36.036, 37.037, 38.038, 39.039, 40.04, 41.041, 42.00029166666667, 43.00129166666667, 44.002291666666665, 45.00329166666667, 46.00429166666667, 47.005291666666665, 48.00629166666667, 49.00729166666667, 50.008291666666665, 51.00929166666667, 52.01029166666667, 53.011291666666665, 54.01229166666667, 55.01329166666667, 56.014291666666665, 57.01529166666667, 58.01629166666667, 59.017291666666665, 60.01829166666667], "recent_frames_sha256": "aee49ea0810f7d02993f3853eb822d3a4468bfd1634df1164201ca52efb40ec3", "num_recent_frames": 30, "tq": 710697.776763082, "t1": 710704.543464276, "ta": 710704.543464276, "te": 710704.583454713, "first_response_s": 6.7667011939920485, "answer_total_s": 6.806691630976275, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 163, "content_group": "e9e04696ac6828a4d30b146a38155ee748e8746221c5c1d3ee4a5237cf3d64bc", "question": {"question_id": "sample_163_a2079_q0", "video_id": 163, "video_path": "./videos/sample_163_real.mp4", "annotation_index": 2079, "question_index": 0, "question": "What is the current grad. of the rider in the video?", "options": ["A. -7.", "B. -9.", "C. -8.", "D. -6."], "answer": "C", "time_stamp_s": 225, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [224, 244], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_163_a2079_q0", "video_id": 163, "time_stamp_s": 225, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "418605506a659f664867a83992b5a6b8b0ed4f832ecda836a00e720965670c75", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.03416666666666, 202.03516666666667, 203.03616666666667, 204.03716666666668, 205.03816666666665, 206.03916666666666, 207.04016666666666, 208.04116666666667, 209.00045833333334, 210.00145833333335, 211.00245833333332, 212.00345833333333, 213.00445833333333, 214.00545833333334, 215.00645833333334, 216.00745833333335, 217.00845833333332, 218.00945833333333, 219.01045833333333, 220.01145833333334, 221.01245833333334, 222.01345833333335, 223.01445833333332, 224.01545833333333], "recent_frames_sha256": "652ad16dee58a22955eae44ada5e820036a0c57dba29d733b07c0feb5e3df14c", "num_recent_frames": 30, "tq": 715224.80158857, "t1": 715236.436739087, "ta": 715236.436739087, "te": 715236.474735733, "first_response_s": 11.635150516987778, "answer_total_s": 11.673147163004614, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_163_a2079_q0", "video_id": 163, "time_stamp_s": 225, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "00d9f092119510bcd61eeec7246a9eb63600609054bc6b9de99ad31bada243f6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclist rides uphill on a paved road beside a stone building, with a car passing in the opposite direction.  \n- On-screen text displays stats for \"Furka Pass (East Side)\" including time, gradient, distance, average speed, and max speed.  \n- The cyclist continues ascending, with the road curving slightly and the surrounding landscape featuring grassy hills and distant mountains.\n[30-60s] - Cyclist rides uphill on a winding mountain road, with speed and elevation data displayed on screen.\n- Road curves along a cliffside, with a guardrail visible on the right and distant mountains in the background.\n- A small building appears on the right side of the road as the cyclist approaches a populated area.\n[60-90s] - Cyclist maintains steady pace uphill, speed fluctuating between 38–40 MPH as elevation gain increases.  \n- Road curves rightward, with distant mountains and a white building visible on the left.  \n- Shadow of cyclist elongates and shifts as sun angle changes, indicating time progression.\n[90-120s] - Cyclist in black attire rides uphill, with speed and elevation data displayed on screen.\n- Road curves sharply, with a stone wall on one side and open mountain views on the other.\n- Another cyclist appears ahead, slightly to the right, maintaining a steady pace.\n[120-150s] - Cyclist maintains steady pace uphill, with speed fluctuating between 36–42 mph and elevation gain around 200–250 ft.  \n- Road curves sharply to the right, with rocky terrain and guardrails visible on the left.  \n- Shadow of cyclist elongates and shifts as sun angle changes, indicating midday conditions.\n[150-180s] - Cyclist maintains steady pace on winding mountain road, with speed fluctuating between 44–47 MPH.  \n- Road elevation data (e.g., “-8” or “-3”) and distance markers (e.g., “0” or “23”) update dynamically on screen.  \n- Landscape features include rocky cliffs, grassy slopes, and distant mountain peaks under clear blue sky.\n[180-210s] - Cyclist maintains steady pace uphill, shadow elongated by sun.\n- Road curves left, bordered by grassy slopes and distant mountains.\n- On-screen data shows speed fluctuating between 47–50 MPH, elevation gain increasing.", "history_tokens": 524, "history_utf8_bytes": 2201, "recent_frame_times_s": [195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.03416666666666, 202.03516666666667, 203.03616666666667, 204.03716666666668, 205.03816666666665, 206.03916666666666, 207.04016666666666, 208.04116666666667, 209.00045833333334, 210.00145833333335, 211.00245833333332, 212.00345833333333, 213.00445833333333, 214.00545833333334, 215.00645833333334, 216.00745833333335, 217.00845833333332, 218.00945833333333, 219.01045833333333, 220.01145833333334, 221.01245833333334, 222.01345833333335, 223.01445833333332, 224.01545833333333], "recent_frames_sha256": "652ad16dee58a22955eae44ada5e820036a0c57dba29d733b07c0feb5e3df14c", "num_recent_frames": 30, "tq": 710743.154820586, "t1": 710755.225679432, "ta": 710755.225679432, "te": 710755.430330491, "first_response_s": 12.070858846069314, "answer_total_s": 12.275509905070066, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 163, "content_group": "e9e04696ac6828a4d30b146a38155ee748e8746221c5c1d3ee4a5237cf3d64bc", "question": {"question_id": "sample_163_a2080_q0", "video_id": 163, "video_path": "./videos/sample_163_real.mp4", "annotation_index": 2080, "question_index": 0, "question": "What is the current grad. of the rider in the video?", "options": ["A. -7.", "B. -9.", "C. -6.", "D. -8."], "answer": "D", "time_stamp_s": 371, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [336, 356], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_163_a2080_q0", "video_id": 163, "time_stamp_s": 371, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e7db83b3aa2201354b326deb825405003c4bb0b1ffa732c7565c16d3159620d7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.03433333333334, 369.0353333333333, 370.03633333333335], "recent_frames_sha256": "4175ff75f07b446967a2626ea283a5f93ff270ce322649cec7f7eb943916d0ed", "num_recent_frames": 30, "tq": 715236.489850213, "t1": 715248.094340173, "ta": 715248.094340173, "te": 715248.13349058, "first_response_s": 11.604489959892817, "answer_total_s": 11.643640366964974, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_163_a2080_q0", "video_id": 163, "time_stamp_s": 371, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7c29ea18ef5c4a8c44baa58494d4b7a1fb6b8fdfcc02f82cefb0b177e1134fdf", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclist rides uphill on a paved road beside a stone building, with a car passing in the opposite direction.  \n- On-screen text displays stats for \"Furka Pass (East Side)\" including time, gradient, distance, average speed, and max speed.  \n- The cyclist continues ascending, with the road curving slightly and the surrounding landscape featuring grassy hills and distant mountains.\n[30-60s] - Cyclist rides uphill on a winding mountain road, with speed and elevation data displayed on screen.\n- Road curves along a cliffside, with a guardrail visible on the right and distant mountains in the background.\n- A small building appears on the right side of the road as the cyclist approaches a populated area.\n[60-90s] - Cyclist maintains steady pace uphill, speed fluctuating between 38–40 MPH as elevation gain increases.  \n- Road curves rightward, with distant mountains and a white building visible on the left.  \n- Shadow of cyclist elongates and shifts as sun angle changes, indicating time progression.\n[90-120s] - Cyclist in black attire rides uphill, with speed and elevation data displayed on screen.\n- Road curves sharply, with a stone wall on one side and open mountain views on the other.\n- Another cyclist appears ahead, slightly to the right, maintaining a steady pace.\n[120-150s] - Cyclist maintains steady pace uphill, with speed fluctuating between 36–42 mph and elevation gain around 200–250 ft.  \n- Road curves sharply to the right, with rocky terrain and guardrails visible on the left.  \n- Shadow of cyclist elongates and shifts as sun angle changes, indicating midday conditions.\n[150-180s] - Cyclist maintains steady pace on winding mountain road, with speed fluctuating between 44–47 MPH.  \n- Road elevation data (e.g., “-8” or “-3”) and distance markers (e.g., “0” or “23”) update dynamically on screen.  \n- Landscape features include rocky cliffs, grassy slopes, and distant mountain peaks under clear blue sky.\n[180-210s] - Cyclist maintains steady pace uphill, shadow elongated by sun.\n- Road curves left, bordered by grassy slopes and distant mountains.\n- On-screen data shows speed fluctuating between 47–50 MPH, elevation gain increasing.\n[210-240s] - Cyclist rides uphill on a winding mountain road, speed decreasing from 50 to 46 MPH.\n- On-screen display shows elevation gain, distance, and temperature, with a map of the route.\n- Road curves right, with mountains and clear sky in the background; cyclist’s shadow stretches ahead.\n[240-270s] - Cyclist rides uphill on a winding mountain road, with speed decreasing from 48 to 42 mph.\n- A yellow van overtakes the cyclist from behind on the same road.\n- On-screen data shows elevation gain, distance, and pace, with a temperature of -8°C.\n[270-300s] - Cyclist rides uphill on a winding mountain road, wearing a black jacket and backpack, with shadow cast behind.\n- On-screen data shows speed decreasing from 43 to 41 mph, elevation gain increasing from 69 to 70 feet, and distance covered from 282 to 288 feet.\n- Sunlight creates lens flare effect, and road curves to the right, with distant mountains and green hills visible.\n[300-330s] - Cyclist rides uphill on a winding mountain road, with speed fluctuating between 40–43 mph and elevation gain shown as -6 to -5 meters.  \n- A silver car overtakes the cyclist on the right side of the road, followed by a white car.  \n- The road passes through a village with traditional buildings, then transitions to a more open, scenic mountain route with guardrails.\n[330-360s] - Cyclist rides uphill on a winding mountain road, with speed and elevation data displayed on screen.\n- Sunlight glints off the road, casting long shadows of the cyclist and the bike.\n- Road curves sharply to the right, with guardrails visible on the right side and mountains in the background.", "history_tokens": 933, "history_utf8_bytes": 3833, "recent_frame_times_s": [341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.03433333333334, 369.0353333333333, 370.03633333333335], "recent_frames_sha256": "4175ff75f07b446967a2626ea283a5f93ff270ce322649cec7f7eb943916d0ed", "num_recent_frames": 30, "tq": 715186.969244116, "t1": 715189.047552545, "ta": 715189.047552545, "te": 715189.091303915, "first_response_s": 2.0783084289869294, "answer_total_s": 2.122059799032286, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 163, "content_group": "e9e04696ac6828a4d30b146a38155ee748e8746221c5c1d3ee4a5237cf3d64bc", "question": {"question_id": "sample_163_a2081_q0", "video_id": 163, "video_path": "./videos/sample_163_real.mp4", "annotation_index": 2081, "question_index": 0, "question": "Where is the road positioned right now?", "options": ["A. Between field and forest.", "B. Through a dense forest.", "C. Beside a river.", "D. Along a mountain ridge."], "answer": "D", "time_stamp_s": 466, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [448, 468], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_163_a2081_q0", "video_id": 163, "time_stamp_s": 466, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "578cd8e6fe75ecbd03584ea6ef06788b1ab56635d12a81c4d45868c34d96964c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [436.01891666666666, 437.0199166666667, 438.02091666666666, 439.02191666666664, 440.0229166666667, 441.02391666666665, 442.0249166666667, 443.02591666666666, 444.0269166666667, 445.02791666666667, 446.02891666666665, 447.0299166666667, 448.03091666666666, 449.0319166666667, 450.03291666666667, 451.03391666666664, 452.0349166666667, 453.03591666666665, 454.0369166666667, 455.03791666666666, 456.0389166666667, 457.03991666666667, 458.04091666666665, 459.0002083333333, 460.00120833333335, 461.00220833333333, 462.00320833333336, 463.00420833333334, 464.0052083333333, 465.00620833333335], "recent_frames_sha256": "4aea3dbbe37d5b16d2629b9b95f40979e4f9e459a2f696b86894303317a5961a", "num_recent_frames": 30, "tq": 715248.146943398, "t1": 715261.07844818, "ta": 715261.07844818, "te": 715261.118916999, "first_response_s": 12.93150478194002, "answer_total_s": 12.97197360091377, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_163_a2081_q0", "video_id": 163, "time_stamp_s": 466, "ground_truth": "D", "raw_output": "D. Along a mountain ridge.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "96c3febed09249d1c1026a836723cd1a624f501005f98c86d13f719fdedc0868", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Cyclist maintains steady pace uphill, speed fluctuating between 38–40 MPH as elevation gain increases.  \n- Road curves rightward, with distant mountains and a white building visible on the left.  \n- Shadow of cyclist elongates and shifts as sun angle changes, indicating time progression.\n[90-120s] - Cyclist in black attire rides uphill, with speed and elevation data displayed on screen.\n- Road curves sharply, with a stone wall on one side and open mountain views on the other.\n- Another cyclist appears ahead, slightly to the right, maintaining a steady pace.\n[120-150s] - Cyclist maintains steady pace uphill, with speed fluctuating between 36–42 mph and elevation gain around 200–250 ft.  \n- Road curves sharply to the right, with rocky terrain and guardrails visible on the left.  \n- Shadow of cyclist elongates and shifts as sun angle changes, indicating midday conditions.\n[150-180s] - Cyclist maintains steady pace on winding mountain road, with speed fluctuating between 44–47 MPH.  \n- Road elevation data (e.g., “-8” or “-3”) and distance markers (e.g., “0” or “23”) update dynamically on screen.  \n- Landscape features include rocky cliffs, grassy slopes, and distant mountain peaks under clear blue sky.\n[180-210s] - Cyclist maintains steady pace uphill, shadow elongated by sun.\n- Road curves left, bordered by grassy slopes and distant mountains.\n- On-screen data shows speed fluctuating between 47–50 MPH, elevation gain increasing.\n[210-240s] - Cyclist rides uphill on a winding mountain road, speed decreasing from 50 to 46 MPH.\n- On-screen display shows elevation gain, distance, and temperature, with a map of the route.\n- Road curves right, with mountains and clear sky in the background; cyclist’s shadow stretches ahead.\n[240-270s] - Cyclist rides uphill on a winding mountain road, with speed decreasing from 48 to 42 mph.\n- A yellow van overtakes the cyclist from behind on the same road.\n- On-screen data shows elevation gain, distance, and pace, with a temperature of -8°C.\n[270-300s] - Cyclist rides uphill on a winding mountain road, wearing a black jacket and backpack, with shadow cast behind.\n- On-screen data shows speed decreasing from 43 to 41 mph, elevation gain increasing from 69 to 70 feet, and distance covered from 282 to 288 feet.\n- Sunlight creates lens flare effect, and road curves to the right, with distant mountains and green hills visible.\n[300-330s] - Cyclist rides uphill on a winding mountain road, with speed fluctuating between 40–43 mph and elevation gain shown as -6 to -5 meters.  \n- A silver car overtakes the cyclist on the right side of the road, followed by a white car.  \n- The road passes through a village with traditional buildings, then transitions to a more open, scenic mountain route with guardrails.\n[330-360s] - Cyclist rides uphill on a winding mountain road, with speed and elevation data displayed on screen.\n- Sunlight glints off the road, casting long shadows of the cyclist and the bike.\n- Road curves sharply to the right, with guardrails visible on the right side and mountains in the background.\n[360-390s] - Cyclist descends steep mountain road, speed decreasing from 34 to 15 mph as grade drops from -8 to -13%.  \n- Sun glares from left, casting long shadows; road curves right, bordered by guardrails and distant mountains.  \n- Vehicles (van, truck, car) pass on road; construction barriers appear ahead as cyclist approaches a bridge.\n[390-420s] - Cyclist rides uphill on a winding mountain road, with speed fluctuating between 30-40 mph and elevation gain shown as -6 to -8 meters.  \n- Sunlight creates lens flare, casting long shadows of the cyclist and road markings.  \n- A small building appears on the roadside, followed by a curve that reveals more mountainous terrain ahead.\n[420-450s] - Cyclist in black gear rides uphill, shadow cast long on road, speed decreasing from 43 to 32 MPH.\n- Sun glares intensely from above, creating lens flare effect across the frame.\n- Road curves left, with distant mountains and green hills visible on both sides.", "history_tokens": 1019, "history_utf8_bytes": 4081, "recent_frame_times_s": [436.01891666666666, 437.0199166666667, 438.02091666666666, 439.02191666666664, 440.0229166666667, 441.02391666666665, 442.0249166666667, 443.02591666666666, 444.0269166666667, 445.02791666666667, 446.02891666666665, 447.0299166666667, 448.03091666666666, 449.0319166666667, 450.03291666666667, 451.03391666666664, 452.0349166666667, 453.03591666666665, 454.0369166666667, 455.03791666666666, 456.0389166666667, 457.03991666666667, 458.04091666666665, 459.0002083333333, 460.00120833333335, 461.00220833333333, 462.00320833333336, 463.00420833333334, 464.0052083333333, 465.00620833333335], "recent_frames_sha256": "4aea3dbbe37d5b16d2629b9b95f40979e4f9e459a2f696b86894303317a5961a", "num_recent_frames": 30, "tq": 715210.771830224, "t1": 715211.292214826, "ta": 715211.292214826, "te": 715211.562555753, "first_response_s": 0.520384602015838, "answer_total_s": 0.7907255290774629, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 164, "content_group": "93a2352a3e596fb025efd4ca504853406829aac9f6f75103dff449dd53045326", "question": {"question_id": "sample_164_a2038_q0", "video_id": 164, "video_path": "./videos/sample_164_real.mp4", "annotation_index": 2038, "question_index": 0, "question": "Where is the cyclist located right now?", "options": ["A. At an intersection.", "B. On a bridge.", "C. Passing through a tunnel.", "D. In the middle of an open field."], "answer": "A", "time_stamp_s": 7, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_164_a2038_q0", "video_id": 164, "time_stamp_s": 7, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "22befdd52bb6a09a91e8911158ce4722e711531f186885a41eeac956f72abe6a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.044, 1.0116333333333334, 2.0126333333333335, 3.0136333333333334, 4.014633333333333, 5.015633333333334, 6.016633333333333], "recent_frames_sha256": "c072e9b2f0ff00c51c77681087537400847258e6e31d5523df2570ba6e4f814a", "num_recent_frames": 7, "tq": 716201.363661624, "t1": 716207.413469216, "ta": 716207.413469216, "te": 716207.450836338, "first_response_s": 6.049807591945864, "answer_total_s": 6.087174713960849, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_164_a2038_q0", "video_id": 164, "time_stamp_s": 7, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a72daa26bc28819ad83c4e53af8bc2a4b3b814be1d253973d76a2bc4e599f288", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.044, 1.0116333333333334, 2.0126333333333335, 3.0136333333333334, 4.014633333333333, 5.015633333333334, 6.016633333333333], "recent_frames_sha256": "c072e9b2f0ff00c51c77681087537400847258e6e31d5523df2570ba6e4f814a", "num_recent_frames": 7, "tq": 716042.219348721, "t1": 716043.961974015, "ta": 716043.961974015, "te": 716044.241724866, "first_response_s": 1.7426252940203995, "answer_total_s": 2.0223761450033635, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 164, "content_group": "93a2352a3e596fb025efd4ca504853406829aac9f6f75103dff449dd53045326", "question": {"question_id": "sample_164_a2039_q0", "video_id": 164, "video_path": "./videos/sample_164_real.mp4", "annotation_index": 2039, "question_index": 0, "question": "What is located on the right side of the road right now?", "options": ["A. A river.", "B. A fence.", "C. Tall bushes and trees.", "D. A concrete wall."], "answer": "C", "time_stamp_s": 124, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [112, 132], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_164_a2039_q0", "video_id": 164, "time_stamp_s": 124, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dec43db8d2f2778c3ea15aa29c6e1b248480d67702b3740534871db36a4aa5e3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [94.00453333333333, 95.00553333333333, 96.00653333333334, 97.00753333333333, 98.00853333333333, 99.00953333333334, 100.01053333333333, 101.01153333333333, 102.01253333333334, 103.01353333333333, 104.01453333333333, 105.01553333333334, 106.01653333333333, 107.01753333333333, 108.01853333333334, 109.01953333333333, 110.02053333333333, 111.02153333333334, 112.02253333333333, 113.02353333333333, 114.02453333333334, 115.02553333333333, 116.02653333333333, 117.02753333333334, 118.02853333333333, 119.02953333333333, 120.03053333333334, 121.03153333333333, 122.03253333333333, 123.00016666666667], "recent_frames_sha256": "27db5055f024a170eceeae33392096a3da062ad18f00203ed4fe0dfee2ee4ded", "num_recent_frames": 30, "tq": 716207.474853221, "t1": 716214.893809049, "ta": 716214.893809049, "te": 716214.931446692, "first_response_s": 7.41895582806319, "answer_total_s": 7.456593470997177, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_164_a2039_q0", "video_id": 164, "time_stamp_s": 124, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "48998d2dff37205e60ddb73e88f1798ec379fefb0544727125dd433781d611a0", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclist navigates through a village street, passing parked cars and traditional buildings under clear blue skies.  \n- Speed fluctuates between 12-74 km/h, with incline data showing minor slopes (1% to 6%) and distance progressing from 69.9 km to 70.1 km.  \n- Right-side map overlay indicates location near \"Höhe\" with temperature at 36°C, and a purple circular speedometer on the left.\n[30-60s] - Road curves right, passing a white building with a stone wall on the left and trees on both sides.\n- A black car overtakes from the left, followed by a white van and a silver car, all moving in the same direction.\n- A red brick building with a sign reading \"HOTEL\" appears on the right as the road continues through a residential area.\n[60-90s] - A black SUV passes on the left, moving away from the camera's perspective.  \n- A white van with \"Pepsi\" branding is parked on the right side of the road.  \n- The road curves slightly to the right, with residential houses lining both sides.\n[90-120s] - Road ascends gradually, with incline percentage increasing from 4% to 14% as trees line both sides.  \n- GPS map on right shows route progress with a purple marker moving along a white outline of a region.  \n- Speed fluctuates between 50–65 km/h, with cadence dropping from 19 to 12 rpm as the rider climbs.", "history_tokens": 345, "history_utf8_bytes": 1316, "recent_frame_times_s": [94.00453333333333, 95.00553333333333, 96.00653333333334, 97.00753333333333, 98.00853333333333, 99.00953333333334, 100.01053333333333, 101.01153333333333, 102.01253333333334, 103.01353333333333, 104.01453333333333, 105.01553333333334, 106.01653333333333, 107.01753333333333, 108.01853333333334, 109.01953333333333, 110.02053333333333, 111.02153333333334, 112.02253333333333, 113.02353333333333, 114.02453333333334, 115.02553333333333, 116.02653333333333, 117.02753333333334, 118.02853333333333, 119.02953333333333, 120.03053333333334, 121.03153333333333, 122.03253333333333, 123.00016666666667], "recent_frames_sha256": "27db5055f024a170eceeae33392096a3da062ad18f00203ed4fe0dfee2ee4ded", "num_recent_frames": 30, "tq": 716081.724524769, "t1": 716082.905374302, "ta": 716082.905374302, "te": 716083.055402884, "first_response_s": 1.180849532946013, "answer_total_s": 1.3308781150262803, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 164, "content_group": "93a2352a3e596fb025efd4ca504853406829aac9f6f75103dff449dd53045326", "question": {"question_id": "sample_164_a2040_q0", "video_id": 164, "video_path": "./videos/sample_164_real.mp4", "annotation_index": 2040, "question_index": 0, "question": "What is visible on the left side of the road right now?", "options": ["A. A field.", "B. A river.", "C. A dense forest.", "D. A row of trees and bushes."], "answer": "D", "time_stamp_s": 233, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [224, 244], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_164_a2040_q0", "video_id": 164, "time_stamp_s": 233, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "58cc18a73bfc670ce3c3ebb5ac0518c12e008f27b01bfde83b88216a6b5a689c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [203.01343333333332, 204.01443333333333, 205.01543333333333, 206.01643333333334, 207.01743333333334, 208.01843333333332, 209.01943333333332, 210.02043333333333, 211.02143333333333, 212.02243333333334, 213.02343333333334, 214.02443333333332, 215.02543333333332, 216.02643333333333, 217.02743333333333, 218.02843333333334, 219.02943333333334, 220.03043333333332, 221.03143333333333, 222.03243333333333, 223.00006666666667, 224.00106666666667, 225.00206666666668, 226.00306666666665, 227.00406666666666, 228.00506666666666, 229.00606666666667, 230.00706666666667, 231.00806666666668, 232.00906666666666], "recent_frames_sha256": "cfb844fb14a662bda53a65eb87da65145ebbc4ce7bb5dd99b574479cc9e4525e", "num_recent_frames": 30, "tq": 716214.965062121, "t1": 716221.989902681, "ta": 716221.989902681, "te": 716222.026801351, "first_response_s": 7.024840559926815, "answer_total_s": 7.061739229946397, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_164_a2040_q0", "video_id": 164, "time_stamp_s": 233, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1a614a3fad230336fba69e81a2ba04297da342aa5ace21afb5e2cd1ad70ef9fe", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclist navigates through a village street, passing parked cars and traditional buildings under clear blue skies.  \n- Speed fluctuates between 12-74 km/h, with incline data showing minor slopes (1% to 6%) and distance progressing from 69.9 km to 70.1 km.  \n- Right-side map overlay indicates location near \"Höhe\" with temperature at 36°C, and a purple circular speedometer on the left.\n[30-60s] - Road curves right, passing a white building with a stone wall on the left and trees on both sides.\n- A black car overtakes from the left, followed by a white van and a silver car, all moving in the same direction.\n- A red brick building with a sign reading \"HOTEL\" appears on the right as the road continues through a residential area.\n[60-90s] - A black SUV passes on the left, moving away from the camera's perspective.  \n- A white van with \"Pepsi\" branding is parked on the right side of the road.  \n- The road curves slightly to the right, with residential houses lining both sides.\n[90-120s] - Road ascends gradually, with incline percentage increasing from 4% to 14% as trees line both sides.  \n- GPS map on right shows route progress with a purple marker moving along a white outline of a region.  \n- Speed fluctuates between 50–65 km/h, with cadence dropping from 19 to 12 rpm as the rider climbs.\n[120-150s] - Road elevation steadily increases, indicated by rising incline percentage (11% to 13%).\n- GPS map on right shows route progress with a blue dot tracking movement.\n- Speed fluctuates slightly between 62 and 64 km/h, with total distance at 70.6 km.\n[150-180s] - Road surface shows slight gravel texture with trees lining both sides under clear blue sky.\n- On-screen display indicates 70.7 KM distance, 60-63 MIN time, and 10-12% gradient, with temperature at 30°C.\n- Map overlay on right shows route path with a purple marker near \"Hofa\" location.\n[180-210s] - Road surface shows slight incline with consistent 70.8 KM/h speed, indicated by on-screen metrics.\n- Left side of road bordered by dense green foliage, right side by dry grass and sparse trees under clear blue sky.\n- On-screen display shows fluctuating heart rate (e.g., 64 BPM to 67 BPM) and elevation gain (e.g., 4% to 7%) as cyclist progresses.", "history_tokens": 605, "history_utf8_bytes": 2237, "recent_frame_times_s": [203.01343333333332, 204.01443333333333, 205.01543333333333, 206.01643333333334, 207.01743333333334, 208.01843333333332, 209.01943333333332, 210.02043333333333, 211.02143333333333, 212.02243333333334, 213.02343333333334, 214.02443333333332, 215.02543333333332, 216.02643333333333, 217.02743333333333, 218.02843333333334, 219.02943333333334, 220.03043333333332, 221.03143333333333, 222.03243333333333, 223.00006666666667, 224.00106666666667, 225.00206666666668, 226.00306666666665, 227.00406666666666, 228.00506666666666, 229.00606666666667, 230.00706666666667, 231.00806666666668, 232.00906666666666], "recent_frames_sha256": "cfb844fb14a662bda53a65eb87da65145ebbc4ce7bb5dd99b574479cc9e4525e", "num_recent_frames": 30, "tq": 716114.338515789, "t1": 716119.976990648, "ta": 716119.976990648, "te": 716120.015121785, "first_response_s": 5.63847485894803, "answer_total_s": 5.676605995977297, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 164, "content_group": "93a2352a3e596fb025efd4ca504853406829aac9f6f75103dff449dd53045326", "question": {"question_id": "sample_164_a2041_q0", "video_id": 164, "video_path": "./videos/sample_164_real.mp4", "annotation_index": 2041, "question_index": 0, "question": "What is located on the left side of the road right now?", "options": ["A. A field with crops.", "B. A dense line of trees and bushes.", "C. A small river.", "D. An open green field."], "answer": "B", "time_stamp_s": 350, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [336, 356], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_164_a2041_q0", "video_id": 164, "time_stamp_s": 350, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9a3b6bfc40ec35a69553a353b2b24fd2aba9578a22b3c7d83c9055797ff4a9f4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [320.0303333333333, 321.03133333333335, 322.0323333333333, 323.03333333333336, 324.00096666666667, 325.00196666666665, 326.0029666666667, 327.00396666666666, 328.0049666666667, 329.00596666666667, 330.00696666666664, 331.0079666666667, 332.00896666666665, 333.0099666666667, 334.01096666666666, 335.0119666666667, 336.01296666666667, 337.01396666666665, 338.0149666666667, 339.01596666666666, 340.0169666666667, 341.01796666666667, 342.01896666666664, 343.0199666666667, 344.02096666666665, 345.0219666666667, 346.02296666666666, 347.0239666666667, 348.02496666666667, 349.02596666666665], "recent_frames_sha256": "753fa18e0256d1ec77da6e3684e6491d37d180004a3aacc826bd0d4cc077e223", "num_recent_frames": 30, "tq": 716222.04479668, "t1": 716230.151177161, "ta": 716230.151177161, "te": 716230.188444333, "first_response_s": 8.106380481040105, "answer_total_s": 8.14364765305072, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_164_a2041_q0", "video_id": 164, "time_stamp_s": 350, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "98f7d0aded9290332870c0ec3b3329f2fd6c27d098f1afd3d28bb6273c560721", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclist navigates through a village street, passing parked cars and traditional buildings under clear blue skies.  \n- Speed fluctuates between 12-74 km/h, with incline data showing minor slopes (1% to 6%) and distance progressing from 69.9 km to 70.1 km.  \n- Right-side map overlay indicates location near \"Höhe\" with temperature at 36°C, and a purple circular speedometer on the left.\n[30-60s] - Road curves right, passing a white building with a stone wall on the left and trees on both sides.\n- A black car overtakes from the left, followed by a white van and a silver car, all moving in the same direction.\n- A red brick building with a sign reading \"HOTEL\" appears on the right as the road continues through a residential area.\n[60-90s] - A black SUV passes on the left, moving away from the camera's perspective.  \n- A white van with \"Pepsi\" branding is parked on the right side of the road.  \n- The road curves slightly to the right, with residential houses lining both sides.\n[90-120s] - Road ascends gradually, with incline percentage increasing from 4% to 14% as trees line both sides.  \n- GPS map on right shows route progress with a purple marker moving along a white outline of a region.  \n- Speed fluctuates between 50–65 km/h, with cadence dropping from 19 to 12 rpm as the rider climbs.\n[120-150s] - Road elevation steadily increases, indicated by rising incline percentage (11% to 13%).\n- GPS map on right shows route progress with a blue dot tracking movement.\n- Speed fluctuates slightly between 62 and 64 km/h, with total distance at 70.6 km.\n[150-180s] - Road surface shows slight gravel texture with trees lining both sides under clear blue sky.\n- On-screen display indicates 70.7 KM distance, 60-63 MIN time, and 10-12% gradient, with temperature at 30°C.\n- Map overlay on right shows route path with a purple marker near \"Hofa\" location.\n[180-210s] - Road surface shows slight incline with consistent 70.8 KM/h speed, indicated by on-screen metrics.\n- Left side of road bordered by dense green foliage, right side by dry grass and sparse trees under clear blue sky.\n- On-screen display shows fluctuating heart rate (e.g., 64 BPM to 67 BPM) and elevation gain (e.g., 4% to 7%) as cyclist progresses.\n[210-240s] - Road ascends gradually, with speed decreasing from 60 to 58 km/h and gradient shifting from 7% to 6%.\n- Left side lined with dense green trees, right side with grassy field and occasional shrubs.\n- On-screen display shows route progress, current speed, elevation, and temperature (38°C), with map indicating position near Hohne.\n[240-270s] - Road surface transitions from gravel to paved asphalt, flanked by dense greenery on both sides.  \n- GPS map on right shows route progress with a blue marker indicating current position.  \n- Speedometer and elevation data fluctuate, showing descent from 18 to 12 km/h and slight elevation drop.\n[270-300s] - Road ascends gradually, with slope percentage increasing from 3% to 9% over the segment.\n- GPS map on right shows route progress with a blue dot tracking movement.\n- Speed fluctuates between 60-68 km/h, with time elapsed decreasing from 68 min to 60 min.\n[300-330s] - Road ascends gradually, flanked by dense greenery on left and open field on right, with speedometer showing increasing speed from 16 to 23 km/h.\n- GPS map overlay indicates route progress toward a destination marked in the upper right corner, with temperature at 30°C.\n- Speed and elevation data fluctuate, showing a descent from 10% grade to 3% grade, with total distance at 71.4 km and time progressing from 49 to 65 minutes.", "history_tokens": 963, "history_utf8_bytes": 3597, "recent_frame_times_s": [320.0303333333333, 321.03133333333335, 322.0323333333333, 323.03333333333336, 324.00096666666667, 325.00196666666665, 326.0029666666667, 327.00396666666666, 328.0049666666667, 329.00596666666667, 330.00696666666664, 331.0079666666667, 332.00896666666665, 333.0099666666667, 334.01096666666666, 335.0119666666667, 336.01296666666667, 337.01396666666665, 338.0149666666667, 339.01596666666666, 340.0169666666667, 341.01796666666667, 342.01896666666664, 343.0199666666667, 344.02096666666665, 345.0219666666667, 346.02296666666666, 347.0239666666667, 348.02496666666667, 349.02596666666665], "recent_frames_sha256": "753fa18e0256d1ec77da6e3684e6491d37d180004a3aacc826bd0d4cc077e223", "num_recent_frames": 30, "tq": 716160.367344545, "t1": 716161.972618466, "ta": 716161.972618466, "te": 716162.011461301, "first_response_s": 1.6052739210426807, "answer_total_s": 1.644116756040603, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 164, "content_group": "93a2352a3e596fb025efd4ca504853406829aac9f6f75103dff449dd53045326", "question": {"question_id": "sample_164_a2042_q0", "video_id": 164, "video_path": "./videos/sample_164_real.mp4", "annotation_index": 2042, "question_index": 0, "question": "Where is the road positioned right now?", "options": ["A. Between field and forest.", "B. Through a dense forest.", "C. Beside a river.", "D. Along a mountain ridge."], "answer": "A", "time_stamp_s": 467, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [448, 468], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_164_a2042_q0", "video_id": 164, "time_stamp_s": 467, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "98f33c16cf3ffc937fafc4bfc223e44836c50cdbcbecaee2b0cf370fbfa33952", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [437.0138666666667, 438.01486666666665, 439.0158666666667, 440.01686666666666, 441.0178666666667, 442.01886666666667, 443.01986666666664, 444.0208666666667, 445.02186666666665, 446.0228666666667, 447.02386666666666, 448.02486666666664, 449.0258666666667, 450.02686666666665, 451.0278666666667, 452.02886666666666, 453.0298666666667, 454.03086666666667, 455.03186666666664, 456.0328666666667, 457.0005, 458.0015, 459.0025, 460.0035, 461.0045, 462.0055, 463.0065, 464.0075, 465.0085, 466.0095], "recent_frames_sha256": "93e22c05f0989b3d2c4ca921a7c7238d7df9edc36ed8944eadde24d3f5ad0106", "num_recent_frames": 30, "tq": 716230.208567968, "t1": 716237.689663401, "ta": 716237.689663401, "te": 716237.727166292, "first_response_s": 7.481095433002338, "answer_total_s": 7.518598324037157, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_164_a2042_q0", "video_id": 164, "time_stamp_s": 467, "ground_truth": "A", "raw_output": "B. Through a dense forest.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "2f575da18208d16441d834f280e56439e931c0d27db03d16b3e742302d3c4fbf", "condition_order": ["notes", "recent"], "memory": "[120-150s] - Road elevation steadily increases, indicated by rising incline percentage (11% to 13%).\n- GPS map on right shows route progress with a blue dot tracking movement.\n- Speed fluctuates slightly between 62 and 64 km/h, with total distance at 70.6 km.\n[150-180s] - Road surface shows slight gravel texture with trees lining both sides under clear blue sky.\n- On-screen display indicates 70.7 KM distance, 60-63 MIN time, and 10-12% gradient, with temperature at 30°C.\n- Map overlay on right shows route path with a purple marker near \"Hofa\" location.\n[180-210s] - Road surface shows slight incline with consistent 70.8 KM/h speed, indicated by on-screen metrics.\n- Left side of road bordered by dense green foliage, right side by dry grass and sparse trees under clear blue sky.\n- On-screen display shows fluctuating heart rate (e.g., 64 BPM to 67 BPM) and elevation gain (e.g., 4% to 7%) as cyclist progresses.\n[210-240s] - Road ascends gradually, with speed decreasing from 60 to 58 km/h and gradient shifting from 7% to 6%.\n- Left side lined with dense green trees, right side with grassy field and occasional shrubs.\n- On-screen display shows route progress, current speed, elevation, and temperature (38°C), with map indicating position near Hohne.\n[240-270s] - Road surface transitions from gravel to paved asphalt, flanked by dense greenery on both sides.  \n- GPS map on right shows route progress with a blue marker indicating current position.  \n- Speedometer and elevation data fluctuate, showing descent from 18 to 12 km/h and slight elevation drop.\n[270-300s] - Road ascends gradually, with slope percentage increasing from 3% to 9% over the segment.\n- GPS map on right shows route progress with a blue dot tracking movement.\n- Speed fluctuates between 60-68 km/h, with time elapsed decreasing from 68 min to 60 min.\n[300-330s] - Road ascends gradually, flanked by dense greenery on left and open field on right, with speedometer showing increasing speed from 16 to 23 km/h.\n- GPS map overlay indicates route progress toward a destination marked in the upper right corner, with temperature at 30°C.\n- Speed and elevation data fluctuate, showing a descent from 10% grade to 3% grade, with total distance at 71.4 km and time progressing from 49 to 65 minutes.\n[330-360s] - Road surface shows slight incline, with speed fluctuating between 70-72 km/h.\n- Left side features dense green bushes, while right side is open field with distant power lines.\n- On-screen data indicates 71.6 km total distance, 3% gradient, and 69-70 minutes elapsed time.\n[360-390s] - Road surface shows slight incline with consistent 4% gradient as cyclist moves forward.\n- Left side of road bordered by dense green trees, right side by dry grass field under clear blue sky.\n- On-screen display shows speed fluctuating between 62-68 km/h, distance at 71.8 km, and temperature at 30°C.\n[390-420s] - Road surface transitions from paved to gravel, then to tree-lined asphalt, with a slight incline.  \n- On-screen metrics show distance increasing from 71.9 km to 72.1 km, time decreasing from 68:01 to 67:58, and elevation gain fluctuating between 3% and 4%.  \n- Map overlay indicates a route with a purple marker moving along a path, suggesting progression through a rural area.\n[420-450s] - Speedometer shows decreasing speed from 62 to 57 km/h as the cyclist descends a 1% incline.  \n- Distance increases from 72.1 to 72.3 km, with estimated time remaining at 68 to 77 minutes.  \n- Temperature remains steady at 36°C, and a map overlay indicates the cyclist’s position near a forested route.", "history_tokens": 987, "history_utf8_bytes": 3589, "recent_frame_times_s": [437.0138666666667, 438.01486666666665, 439.0158666666667, 440.01686666666666, 441.0178666666667, 442.01886666666667, 443.01986666666664, 444.0208666666667, 445.02186666666665, 446.0228666666667, 447.02386666666666, 448.02486666666664, 449.0258666666667, 450.02686666666665, 451.0278666666667, 452.02886666666666, 453.0298666666667, 454.03086666666667, 455.03186666666664, 456.0328666666667, 457.0005, 458.0015, 459.0025, 460.0035, 461.0045, 462.0055, 463.0065, 464.0075, 465.0085, 466.0095], "recent_frames_sha256": "93e22c05f0989b3d2c4ca921a7c7238d7df9edc36ed8944eadde24d3f5ad0106", "num_recent_frames": 30, "tq": 716194.240115133, "t1": 716201.065702254, "ta": 716201.065702254, "te": 716201.33895287, "first_response_s": 6.825587120954879, "answer_total_s": 7.098837736994028, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 165, "content_group": "166e7e2af8be5e5a4f6a3a4e5d9af077f63ba3afccc16077b83f1b8e9999c044", "question": {"question_id": "sample_165_a2131_q0", "video_id": 165, "video_path": "./videos/sample_165_real.mp4", "annotation_index": 2131, "question_index": 0, "question": "Where is the red car located right now?", "options": ["A. In front of the cyclist, on the left.", "B. Just behind the cyclist, on the right.", "C. Parked on the side of the road, on the right.", "D. Ahead in the distance, slightly to the left."], "answer": "C", "time_stamp_s": 2, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_165_a2131_q0", "video_id": 165, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b5409ef20716d658f30f40ef55ea64ddb443d8a2317581f55d2d6c25c0532e71", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.038, 1.0056333333333334], "recent_frames_sha256": "236c99a6cbbea78658c78ee9ea01d8dc285d67ca02905fb647df701f7df9ba64", "num_recent_frames": 2, "tq": 719597.945986344, "t1": 719604.407840375, "ta": 719604.407840375, "te": 719604.449116388, "first_response_s": 6.4618540309602395, "answer_total_s": 6.503130043973215, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_165_a2131_q0", "video_id": 165, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "392f3ec59f0ad6d141d5acaa850bfa3f3cea90458bfdbe1d1fc30cb981a91643", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.038, 1.0056333333333334], "recent_frames_sha256": "236c99a6cbbea78658c78ee9ea01d8dc285d67ca02905fb647df701f7df9ba64", "num_recent_frames": 2, "tq": 719443.863566065, "t1": 719455.918028346, "ta": 719455.918028346, "te": 719456.102941373, "first_response_s": 12.054462281055748, "answer_total_s": 12.239375308039598, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 165, "content_group": "166e7e2af8be5e5a4f6a3a4e5d9af077f63ba3afccc16077b83f1b8e9999c044", "question": {"question_id": "sample_165_a2132_q0", "video_id": 165, "video_path": "./videos/sample_165_real.mp4", "annotation_index": 2132, "question_index": 0, "question": "Where are the trees located right now?", "options": ["A. On both sides of the road.", "B. Only on the left side of the road.", "C. Only on the right side of the road.", "D. Directly in front of the cyclist."], "answer": "A", "time_stamp_s": 140, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [122, 142], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_165_a2132_q0", "video_id": 165, "time_stamp_s": 140, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2e94ac43f4fbc33c634834404a763b624c8adb4df7f2b1c9c92ced6a320ac712", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [110.01453333333333, 111.01553333333334, 112.01653333333333, 113.01753333333333, 114.01853333333334, 115.01953333333333, 116.02053333333333, 117.02153333333334, 118.02253333333333, 119.02353333333333, 120.02453333333334, 121.02553333333333, 122.02653333333333, 123.02753333333334, 124.02853333333333, 125.02953333333333, 126.03053333333334, 127.03153333333333, 128.03253333333333, 129.00016666666667, 130.00116666666668, 131.00216666666665, 132.00316666666666, 133.00416666666666, 134.00516666666667, 135.00616666666667, 136.00716666666668, 137.00816666666665, 138.00916666666666, 139.01016666666666], "recent_frames_sha256": "6e6e76c2c344af00cd64383d792090bef8c5e8d5b6be31bafe66c3733d59fafa", "num_recent_frames": 30, "tq": 719604.471267092, "t1": 719614.802910633, "ta": 719614.802910633, "te": 719614.843034675, "first_response_s": 10.331643540994264, "answer_total_s": 10.371767582953908, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_165_a2132_q0", "video_id": 165, "time_stamp_s": 140, "ground_truth": "A", "raw_output": "A. On both sides of the road.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "4b4f02640ad93fa3f773f7df5325988e6e9ada3bae5fec2d49bcbbbc3cc615f3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclist navigates through residential streets, passing parked cars and houses with changing speed and incline indicators.  \n- On-screen data shows consistent distance (73.5–73.7 km), elevation (38°C), and speed fluctuating between 22–78 km/h.  \n- Road signs and buildings, including a white house with flower boxes, are visible as the cyclist moves forward.\n[30-60s] - A white van passes on the right, followed by a red car, then a black SUV, all moving in the same direction.  \n- The road curves left, revealing a stone wall and a church with twin spires ahead.  \n- The speedometer shows a gradual decrease from 75 to 62 km/h, with the distance increasing from 73.7 to 73.9 km.\n[60-90s] - Road slopes upward, with houses on the left and dense green hedges on the right.  \n- A blue car is parked on the left side of the road near a house.  \n- The on-screen display shows a temperature of 38°C and a route map with a blue dot indicating current position.\n[90-120s] - Road ascends gradually, flanked by trees and dry grass, with a wooden structure visible on the left.  \n- On-screen data shows distance increasing from 74.0 KM to 74.1 KM, with elevation percentage fluctuating between 13% and 16%.  \n- Map overlay indicates location near Hora, with temperature at 38°C and a blue line graph tracking ride intensity.", "history_tokens": 352, "history_utf8_bytes": 1330, "recent_frame_times_s": [110.01453333333333, 111.01553333333334, 112.01653333333333, 113.01753333333333, 114.01853333333334, 115.01953333333333, 116.02053333333333, 117.02153333333334, 118.02253333333333, 119.02353333333333, 120.02453333333334, 121.02553333333333, 122.02653333333333, 123.02753333333334, 124.02853333333333, 125.02953333333333, 126.03053333333334, 127.03153333333333, 128.03253333333333, 129.00016666666667, 130.00116666666668, 131.00216666666665, 132.00316666666666, 133.00416666666666, 134.00516666666667, 135.00616666666667, 136.00716666666668, 137.00816666666665, 138.00916666666666, 139.01016666666666], "recent_frames_sha256": "6e6e76c2c344af00cd64383d792090bef8c5e8d5b6be31bafe66c3733d59fafa", "num_recent_frames": 30, "tq": 719483.595303723, "t1": 719486.032992815, "ta": 719486.032992815, "te": 719486.3979139, "first_response_s": 2.4376890920102596, "answer_total_s": 2.802610176964663, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 165, "content_group": "166e7e2af8be5e5a4f6a3a4e5d9af077f63ba3afccc16077b83f1b8e9999c044", "question": {"question_id": "sample_165_a2133_q0", "video_id": 165, "video_path": "./videos/sample_165_real.mp4", "annotation_index": 2133, "question_index": 0, "question": "Where are the trees located right now?", "options": ["A. On both sides of the road.", "B. On the right side of the road.", "C. In the center of the road.", "D. Evenly distributed on both sides."], "answer": "A", "time_stamp_s": 255, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [244, 264], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_165_a2133_q0", "video_id": 165, "time_stamp_s": 255, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ffd22df0e4034fbedde26bf6ef25128878f51ecec11273da183d01fa551c8246", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [225.02943333333334, 226.03043333333332, 227.03143333333333, 228.03243333333333, 229.00006666666667, 230.00106666666667, 231.00206666666668, 232.00306666666665, 233.00406666666666, 234.00506666666666, 235.00606666666667, 236.00706666666667, 237.00806666666668, 238.00906666666666, 239.01006666666666, 240.01106666666666, 241.01206666666667, 242.01306666666667, 243.01406666666668, 244.01506666666666, 245.01606666666666, 246.01706666666666, 247.01806666666667, 248.01906666666667, 249.02006666666668, 250.02106666666666, 251.02206666666666, 252.02306666666667, 253.02406666666667, 254.02506666666667], "recent_frames_sha256": "2389b8c75edca0bb2f386b49bad07e64c1ad0f2a1b067f96121b79adc07eb88d", "num_recent_frames": 30, "tq": 719614.861899188, "t1": 719627.508900658, "ta": 719627.508900658, "te": 719627.546160285, "first_response_s": 12.647001469973475, "answer_total_s": 12.684261096990667, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_165_a2133_q0", "video_id": 165, "time_stamp_s": 255, "ground_truth": "A", "raw_output": "A. On both sides of the road.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "1bb1acd89a57ce3b97ece4587bc8a41bacd9b52d7c61d203f9fa4d59461d27dd", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclist navigates through residential streets, passing parked cars and houses with changing speed and incline indicators.  \n- On-screen data shows consistent distance (73.5–73.7 km), elevation (38°C), and speed fluctuating between 22–78 km/h.  \n- Road signs and buildings, including a white house with flower boxes, are visible as the cyclist moves forward.\n[30-60s] - A white van passes on the right, followed by a red car, then a black SUV, all moving in the same direction.  \n- The road curves left, revealing a stone wall and a church with twin spires ahead.  \n- The speedometer shows a gradual decrease from 75 to 62 km/h, with the distance increasing from 73.7 to 73.9 km.\n[60-90s] - Road slopes upward, with houses on the left and dense green hedges on the right.  \n- A blue car is parked on the left side of the road near a house.  \n- The on-screen display shows a temperature of 38°C and a route map with a blue dot indicating current position.\n[90-120s] - Road ascends gradually, flanked by trees and dry grass, with a wooden structure visible on the left.  \n- On-screen data shows distance increasing from 74.0 KM to 74.1 KM, with elevation percentage fluctuating between 13% and 16%.  \n- Map overlay indicates location near Hora, with temperature at 38°C and a blue line graph tracking ride intensity.\n[120-150s] - Road ascends gradually, flanked by dense green trees and dry grass on the left, with a clear blue sky overhead.\n- On-screen display shows speed fluctuating between 52–56 km/h, incline changing from 10% to 16%, and distance at 74.2 km.\n- Map overlay on right indicates route progress with a blue dot moving along a white path, showing a 38°C temperature.\n[150-180s] - Road surface shows slight incline with trees lining both sides, casting dappled shadows.  \n- On-screen display indicates 74.2–74.3 km distance, 56–57 minutes elapsed, and 14%–19% battery level.  \n- Map overlay shows route progress with a blue dot near a town labeled \"Hofa\" at 38°C.\n[180-210s] - Road elevation gradually decreases as cyclist descends, indicated by shifting incline percentage from 17% to 11%.  \n- Trees lining the road remain dense, with sunlight filtering through leaves, creating dynamic lighting.  \n- On-screen display shows consistent speed (52-54 km/h), distance (74.3–74.4 km), and time (02:02–02:05 min), with temperature at 36°C.\n[210-240s] - Road elevation gradually decreases as cyclist moves forward, indicated by shifting percentage on screen.\n- Temperature remains steady at 38°C, with a map overlay showing route progress.\n- Speed fluctuates between 50-60 km/h, with time and distance metrics updating continuously.", "history_tokens": 726, "history_utf8_bytes": 2673, "recent_frame_times_s": [225.02943333333334, 226.03043333333332, 227.03143333333333, 228.03243333333333, 229.00006666666667, 230.00106666666667, 231.00206666666668, 232.00306666666665, 233.00406666666666, 234.00506666666666, 235.00606666666667, 236.00706666666667, 237.00806666666668, 238.00906666666666, 239.01006666666666, 240.01106666666666, 241.01206666666667, 242.01306666666667, 243.01406666666668, 244.01506666666666, 245.01606666666666, 246.01706666666666, 247.01806666666667, 248.01906666666667, 249.02006666666668, 250.02106666666666, 251.02206666666666, 252.02306666666667, 253.02406666666667, 254.02506666666667], "recent_frames_sha256": "2389b8c75edca0bb2f386b49bad07e64c1ad0f2a1b067f96121b79adc07eb88d", "num_recent_frames": 30, "tq": 719521.76575849, "t1": 719523.521520899, "ta": 719523.521520899, "te": 719523.890479568, "first_response_s": 1.7557624090695754, "answer_total_s": 2.124721078085713, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 165, "content_group": "166e7e2af8be5e5a4f6a3a4e5d9af077f63ba3afccc16077b83f1b8e9999c044", "question": {"question_id": "sample_165_a2134_q0", "video_id": 165, "video_path": "./videos/sample_165_real.mp4", "annotation_index": 2134, "question_index": 0, "question": "Where are the trees located right now?", "options": ["A. On both sides of the road.", "B. On the left side of the road.", "C. On the right side of the road.", "D. There are no trees visible right now."], "answer": "C", "time_stamp_s": 385, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [366, 386], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_165_a2134_q0", "video_id": 165, "time_stamp_s": 385, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "30892fbc602418e68d448840c20596c4aa8b2f0959f5fa7a146df8a44d96364d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [355.02596666666665, 356.0269666666667, 357.02796666666666, 358.0289666666667, 359.02996666666667, 360.03096666666664, 361.0319666666667, 362.03296666666665, 363.0006, 364.0016, 365.0026, 366.0036, 367.0046, 368.0056, 369.0066, 370.0076, 371.0086, 372.0096, 373.0106, 374.0116, 375.0126, 376.0136, 377.0146, 378.0156, 379.0166, 380.0176, 381.0186, 382.0196, 383.0206, 384.0216], "recent_frames_sha256": "95830167932863161268f2a901494bdee28df325e6782cb65f5da44033f565b1", "num_recent_frames": 30, "tq": 719627.558014811, "t1": 719638.865615535, "ta": 719638.865615535, "te": 719638.903108899, "first_response_s": 11.307600723928772, "answer_total_s": 11.345094087999314, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_165_a2134_q0", "video_id": 165, "time_stamp_s": 385, "ground_truth": "C", "raw_output": "A. On both sides of the road.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "68e9b3666dc2fb21e91aa3167d6145c591f244955e21bf2efa3720ee7d811a24", "condition_order": ["notes", "recent"], "memory": "[30-60s] - A white van passes on the right, followed by a red car, then a black SUV, all moving in the same direction.  \n- The road curves left, revealing a stone wall and a church with twin spires ahead.  \n- The speedometer shows a gradual decrease from 75 to 62 km/h, with the distance increasing from 73.7 to 73.9 km.\n[60-90s] - Road slopes upward, with houses on the left and dense green hedges on the right.  \n- A blue car is parked on the left side of the road near a house.  \n- The on-screen display shows a temperature of 38°C and a route map with a blue dot indicating current position.\n[90-120s] - Road ascends gradually, flanked by trees and dry grass, with a wooden structure visible on the left.  \n- On-screen data shows distance increasing from 74.0 KM to 74.1 KM, with elevation percentage fluctuating between 13% and 16%.  \n- Map overlay indicates location near Hora, with temperature at 38°C and a blue line graph tracking ride intensity.\n[120-150s] - Road ascends gradually, flanked by dense green trees and dry grass on the left, with a clear blue sky overhead.\n- On-screen display shows speed fluctuating between 52–56 km/h, incline changing from 10% to 16%, and distance at 74.2 km.\n- Map overlay on right indicates route progress with a blue dot moving along a white path, showing a 38°C temperature.\n[150-180s] - Road surface shows slight incline with trees lining both sides, casting dappled shadows.  \n- On-screen display indicates 74.2–74.3 km distance, 56–57 minutes elapsed, and 14%–19% battery level.  \n- Map overlay shows route progress with a blue dot near a town labeled \"Hofa\" at 38°C.\n[180-210s] - Road elevation gradually decreases as cyclist descends, indicated by shifting incline percentage from 17% to 11%.  \n- Trees lining the road remain dense, with sunlight filtering through leaves, creating dynamic lighting.  \n- On-screen display shows consistent speed (52-54 km/h), distance (74.3–74.4 km), and time (02:02–02:05 min), with temperature at 36°C.\n[210-240s] - Road elevation gradually decreases as cyclist moves forward, indicated by shifting percentage on screen.\n- Temperature remains steady at 38°C, with a map overlay showing route progress.\n- Speed fluctuates between 50-60 km/h, with time and distance metrics updating continuously.\n[240-270s] - Road surface curves gently to the right, flanked by dry grass fields under a clear blue sky.  \n- On-screen display shows speed increasing from 16 to 22 km/h, with elevation gain at 4% and distance at 74.6 km.  \n- Map overlay on right indicates route progress with a purple marker near a town labeled \"Höhe\".\n[270-300s] - Road elevation gradually increases, indicated by shifting slope percentage from 2% to 4%.\n- Right-side vegetation becomes denser with trees and bushes as the cyclist progresses.\n- On-screen display shows consistent speed around 65-67 km/h, with total distance at 74.8 km.\n[300-330s] - Road ascends gently, with speedometer showing 66-67 km/h and elevation gain at 6%.\n- Right side features dense green bushes, while left side is open field under clear blue sky.\n- Map overlay indicates location near \"Höhe\" with temperature at 38°C and distance at 74.9–75.0 km.\n[330-360s] - Road elevation gradually decreases from 4% to 1% as cyclist moves forward.\n- GPS map on right shows route progress with a red dot indicating current position.\n- Speedometer fluctuates between 60-75 km/h, with total distance increasing from 75.1 to 75.2 km.", "history_tokens": 962, "history_utf8_bytes": 3471, "recent_frame_times_s": [355.02596666666665, 356.0269666666667, 357.02796666666666, 358.0289666666667, 359.02996666666667, 360.03096666666664, 361.0319666666667, 362.03296666666665, 363.0006, 364.0016, 365.0026, 366.0036, 367.0046, 368.0056, 369.0066, 370.0076, 371.0086, 372.0096, 373.0106, 374.0116, 375.0126, 376.0136, 377.0146, 378.0156, 379.0166, 380.0176, 381.0186, 382.0196, 383.0206, 384.0216], "recent_frames_sha256": "95830167932863161268f2a901494bdee28df325e6782cb65f5da44033f565b1", "num_recent_frames": 30, "tq": 719560.60343215, "t1": 719562.50592482, "ta": 719562.50592482, "te": 719562.879214567, "first_response_s": 1.9024926699930802, "answer_total_s": 2.2757824170403183, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 165, "content_group": "166e7e2af8be5e5a4f6a3a4e5d9af077f63ba3afccc16077b83f1b8e9999c044", "question": {"question_id": "sample_165_a2135_q0", "video_id": 165, "video_path": "./videos/sample_165_real.mp4", "annotation_index": 2135, "question_index": 0, "question": "What is the current value of 'distanz' displayed in the video?", "options": ["A. 76.2KM.", "B. 76.3KM.", "C. 76.1KM.", "D. 76.0KM."], "answer": "A", "time_stamp_s": 493, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [488, 508], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_165_a2135_q0", "video_id": 165, "time_stamp_s": 493, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "67f0171654f9861ec28387aa09404ee493ef94a0a2e2de139185ec83d7a6cd16", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [463.0005, 464.0015, 465.0025, 466.0035, 467.0045, 468.0055, 469.0065, 470.0075, 471.0085, 472.0095, 473.0105, 474.0115, 475.0125, 476.0135, 477.0145, 478.0155, 479.0165, 480.0175, 481.0185, 482.0195, 483.0205, 484.0215, 485.0225, 486.0235, 487.0245, 488.0255, 489.0265, 490.0275, 491.0285, 492.0295], "recent_frames_sha256": "8215b023ad2726a3b28480ced002d1d2a36948d8a425a2e6585db6026fed34ad", "num_recent_frames": 30, "tq": 719638.910113457, "t1": 719650.831446749, "ta": 719650.831446749, "te": 719650.868811747, "first_response_s": 11.921333292033523, "answer_total_s": 11.958698289934546, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_165_a2135_q0", "video_id": 165, "time_stamp_s": 493, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fce45b24cd0db7497c678d677e85d8bcf95e5d3e44b3ba479d3c6be3f64b2e98", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Road surface shows slight incline with trees lining both sides, casting dappled shadows.  \n- On-screen display indicates 74.2–74.3 km distance, 56–57 minutes elapsed, and 14%–19% battery level.  \n- Map overlay shows route progress with a blue dot near a town labeled \"Hofa\" at 38°C.\n[180-210s] - Road elevation gradually decreases as cyclist descends, indicated by shifting incline percentage from 17% to 11%.  \n- Trees lining the road remain dense, with sunlight filtering through leaves, creating dynamic lighting.  \n- On-screen display shows consistent speed (52-54 km/h), distance (74.3–74.4 km), and time (02:02–02:05 min), with temperature at 36°C.\n[210-240s] - Road elevation gradually decreases as cyclist moves forward, indicated by shifting percentage on screen.\n- Temperature remains steady at 38°C, with a map overlay showing route progress.\n- Speed fluctuates between 50-60 km/h, with time and distance metrics updating continuously.\n[240-270s] - Road surface curves gently to the right, flanked by dry grass fields under a clear blue sky.  \n- On-screen display shows speed increasing from 16 to 22 km/h, with elevation gain at 4% and distance at 74.6 km.  \n- Map overlay on right indicates route progress with a purple marker near a town labeled \"Höhe\".\n[270-300s] - Road elevation gradually increases, indicated by shifting slope percentage from 2% to 4%.\n- Right-side vegetation becomes denser with trees and bushes as the cyclist progresses.\n- On-screen display shows consistent speed around 65-67 km/h, with total distance at 74.8 km.\n[300-330s] - Road ascends gently, with speedometer showing 66-67 km/h and elevation gain at 6%.\n- Right side features dense green bushes, while left side is open field under clear blue sky.\n- Map overlay indicates location near \"Höhe\" with temperature at 38°C and distance at 74.9–75.0 km.\n[330-360s] - Road elevation gradually decreases from 4% to 1% as cyclist moves forward.\n- GPS map on right shows route progress with a red dot indicating current position.\n- Speedometer fluctuates between 60-75 km/h, with total distance increasing from 75.1 to 75.2 km.\n[360-390s] - Road elevation gradually increases, indicated by rising slope percentage from 0% to 2%.\n- A small cluster of trees appears on the right side of the road, followed by a house in the distance.\n- The map overlay on the right shows a white outline of a region with a red dot marking the current position, moving forward along the route.\n[390-420s] - Road elevation slightly ascends, indicated by a 1% gradient change on the display.\n- Speed fluctuates between 23–28 km/h, with a brief dip to 22 km/h around 395 seconds.\n- Right side of road features dense green trees, while left side shows dry, golden fields under clear blue sky.\n[420-450s] - Speedometer shows decreasing speed from 70 to 68 km/h, then fluctuates around 68–70 km/h.\n- Elevation graph on right fluctuates slightly, indicating minor terrain changes.\n- Road ahead curves gently to the right, bordered by a tree on the right and open fields on the left.\n[450-480s] - Road speed fluctuates between 67 and 73 km/h, with a 1% incline, as the cyclist approaches a utility pole structure.  \n- A white outline map of a region (possibly Germany) is displayed on the right, with a temperature of 30°C.  \n- The distance increases from 75.9 km to 76.0 km, with the time decreasing from 73:14 min to 73:11 min.", "history_tokens": 954, "history_utf8_bytes": 3422, "recent_frame_times_s": [463.0005, 464.0015, 465.0025, 466.0035, 467.0045, 468.0055, 469.0065, 470.0075, 471.0085, 472.0095, 473.0105, 474.0115, 475.0125, 476.0135, 477.0145, 478.0155, 479.0165, 480.0175, 481.0185, 482.0195, 483.0205, 484.0215, 485.0225, 486.0235, 487.0245, 488.0255, 489.0265, 490.0275, 491.0285, 492.0295], "recent_frames_sha256": "8215b023ad2726a3b28480ced002d1d2a36948d8a425a2e6585db6026fed34ad", "num_recent_frames": 30, "tq": 719596.385947106, "t1": 719597.571674799, "ta": 719597.571674799, "te": 719597.922607878, "first_response_s": 1.185727692907676, "answer_total_s": 1.5366607719333842, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 166, "content_group": "1f1098d63eb8e4da5807b5c2425e8d2b81b4795a46d2649d996219a00fa1facf", "question": {"question_id": "sample_166_a446_q0", "video_id": 166, "video_path": "./videos/sample_166_real.mp4", "annotation_index": 446, "question_index": 0, "question": "Which side of the trail has more dense foliage right now?", "options": ["A. The left side.", "B. The right side.", "C. Both sides equally.", "D. Neither side has foliage."], "answer": "C", "time_stamp_s": 10, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_166_a446_q0", "video_id": 166, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9c0b2affbc84f9a3cb4e92db34dfa781a44672d0e4a16c742b97df78cfa7782b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.051, 1.0186333333333333, 2.019633333333333, 3.0206333333333335, 4.021633333333333, 5.022633333333333, 6.023633333333334, 7.024633333333333, 8.025633333333333, 9.026633333333333], "recent_frames_sha256": "efac4ca11c97d4e14b18873e8e7d5858ee4a3099a5f32d44926b601f4329e209", "num_recent_frames": 10, "tq": 718661.604915905, "t1": 718667.157100005, "ta": 718667.157100005, "te": 718667.194920795, "first_response_s": 5.552184099913575, "answer_total_s": 5.590004889992997, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_166_a446_q0", "video_id": 166, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "63ca0ebbeae591f4d7321fc7f35e6936c3b5b6307103ab5e34fd9c5d16aabb15", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.051, 1.0186333333333333, 2.019633333333333, 3.0206333333333335, 4.021633333333333, 5.022633333333333, 6.023633333333334, 7.024633333333333, 8.025633333333333, 9.026633333333333], "recent_frames_sha256": "efac4ca11c97d4e14b18873e8e7d5858ee4a3099a5f32d44926b601f4329e209", "num_recent_frames": 10, "tq": 718703.884111133, "t1": 718716.392139028, "ta": 718716.392139028, "te": 718716.436551591, "first_response_s": 12.508027894888073, "answer_total_s": 12.552440457977355, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 166, "content_group": "1f1098d63eb8e4da5807b5c2425e8d2b81b4795a46d2649d996219a00fa1facf", "question": {"question_id": "sample_166_a447_q0", "video_id": 166, "video_path": "./videos/sample_166_real.mp4", "annotation_index": 447, "question_index": 0, "question": "Where is the large tree located right now?", "options": ["A. On the left side of the road.", "B. Ahead, slightly to the left.", "C. Overhead, providing shade.", "D. On the right side of the road."], "answer": "D", "time_stamp_s": 126, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [107, 127], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_166_a447_q0", "video_id": 166, "time_stamp_s": 126, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "296c67b2b4dc9269e4a8cb679d350d27344935197c28462d5111aa3675659058", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [96.01353333333333, 97.01453333333333, 98.01553333333334, 99.01653333333333, 100.01753333333333, 101.01853333333334, 102.01953333333333, 103.02053333333333, 104.02153333333334, 105.02253333333333, 106.02353333333333, 107.02453333333334, 108.02553333333333, 109.02653333333333, 110.02753333333334, 111.02853333333333, 112.02953333333333, 113.03053333333334, 114.03153333333333, 115.03253333333333, 116.00016666666667, 117.00116666666666, 118.00216666666667, 119.00316666666667, 120.00416666666666, 121.00516666666667, 122.00616666666667, 123.00716666666666, 124.00816666666667, 125.00916666666667], "recent_frames_sha256": "90013f95fb20c7bcd792604120dd5e2fe9f962d67d4ee76934fd748d9370f2ac", "num_recent_frames": 30, "tq": 718667.214994612, "t1": 718674.983656724, "ta": 718674.983656724, "te": 718675.021226911, "first_response_s": 7.768662111950107, "answer_total_s": 7.806232298957184, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_166_a447_q0", "video_id": 166, "time_stamp_s": 126, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "296f37905344aeb7f8961658b19935c3699f90dcef6bd73deda1a092d0ff157b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Road surface shows gradual incline (slope % increasing from 6% to 7%) through dense green forest.  \n- GPS map overlay indicates location near \"Höhe\" with temperature 34°C and elevation 25.5 km traveled.  \n- Speedometer fluctuates between 50-65 km/h as rider progresses along the winding path.\n[30-60s] - Road surface shows slight wetness, with speed fluctuating between 60-65 km/h.  \n- GPS map displays route progress with a blue dot indicating current position near a forested area.  \n- Temperature remains steady at 34°C, with elevation gain slowly increasing from 1% to 4%.\n[60-90s] - Speed fluctuates between 12-14 km/h as the cyclist navigates a narrow, tree-lined dirt path.  \n- The GPS map on the right shows the route through a forested area with a blue marker indicating current position.  \n- Temperature remains steady at 33°C, and the elevation gain is shown as 12% with a total distance of 25.6 km.\n[90-120s] - Road transitions from tree-lined to open field, with speed increasing from 50 to 73 km/h.  \n- GPS map shows location near Hohne, with temperature at 33°C and distance at 25.9–26.1 km.  \n- Terrain elevation changes from 0% to 2% grade as path opens into flat farmland.", "history_tokens": 338, "history_utf8_bytes": 1207, "recent_frame_times_s": [96.01353333333333, 97.01453333333333, 98.01553333333334, 99.01653333333333, 100.01753333333333, 101.01853333333334, 102.01953333333333, 103.02053333333333, 104.02153333333334, 105.02253333333333, 106.02353333333333, 107.02453333333334, 108.02553333333333, 109.02653333333333, 110.02753333333334, 111.02853333333333, 112.02953333333333, 113.03053333333334, 114.03153333333333, 115.03253333333333, 116.00016666666667, 117.00116666666666, 118.00216666666667, 119.00316666666667, 120.00416666666666, 121.00516666666667, 122.00616666666667, 123.00716666666666, 124.00816666666667, 125.00916666666667], "recent_frames_sha256": "90013f95fb20c7bcd792604120dd5e2fe9f962d67d4ee76934fd748d9370f2ac", "num_recent_frames": 30, "tq": 718752.371822921, "t1": 718753.440869499, "ta": 718753.440869499, "te": 718753.592399622, "first_response_s": 1.0690465780207887, "answer_total_s": 1.2205767009872943, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 166, "content_group": "1f1098d63eb8e4da5807b5c2425e8d2b81b4795a46d2649d996219a00fa1facf", "question": {"question_id": "sample_166_a448_q0", "video_id": 166, "video_path": "./videos/sample_166_real.mp4", "annotation_index": 448, "question_index": 0, "question": "Where is the shadowed area located right now?", "options": ["A. On the left side of the road.", "B. Across the entire road.", "C. On the right side of the road.", "D. No shadow at all."], "answer": "B", "time_stamp_s": 233, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [214, 234], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_166_a448_q0", "video_id": 166, "time_stamp_s": 233, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fa01aacd9ab24a5c35e38062b6ac253144e492210964e9886af8db8f280c6ec1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [203.02043333333333, 204.02143333333333, 205.02243333333334, 206.02343333333334, 207.02443333333332, 208.02543333333332, 209.02643333333333, 210.02743333333333, 211.02843333333334, 212.02943333333334, 213.03043333333332, 214.03143333333333, 215.03243333333333, 216.00006666666667, 217.00106666666667, 218.00206666666668, 219.00306666666665, 220.00406666666666, 221.00506666666666, 222.00606666666667, 223.00706666666667, 224.00806666666668, 225.00906666666666, 226.01006666666666, 227.01106666666666, 228.01206666666667, 229.01306666666667, 230.01406666666668, 231.01506666666666, 232.01606666666666], "recent_frames_sha256": "d5fe8733e0e4993f26a5e8495d2fd5184c6c56b2ac51a59ae2202d2bd1f77623", "num_recent_frames": 30, "tq": 718675.041528135, "t1": 718686.31317712, "ta": 718686.31317712, "te": 718686.350857059, "first_response_s": 11.27164898510091, "answer_total_s": 11.309328924049623, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_166_a448_q0", "video_id": 166, "time_stamp_s": 233, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e2867a2eac1a36dc5126f31d71091e307f53ea527f55f4bab3ed3bd202408efb", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Road surface shows gradual incline (slope % increasing from 6% to 7%) through dense green forest.  \n- GPS map overlay indicates location near \"Höhe\" with temperature 34°C and elevation 25.5 km traveled.  \n- Speedometer fluctuates between 50-65 km/h as rider progresses along the winding path.\n[30-60s] - Road surface shows slight wetness, with speed fluctuating between 60-65 km/h.  \n- GPS map displays route progress with a blue dot indicating current position near a forested area.  \n- Temperature remains steady at 34°C, with elevation gain slowly increasing from 1% to 4%.\n[60-90s] - Speed fluctuates between 12-14 km/h as the cyclist navigates a narrow, tree-lined dirt path.  \n- The GPS map on the right shows the route through a forested area with a blue marker indicating current position.  \n- Temperature remains steady at 33°C, and the elevation gain is shown as 12% with a total distance of 25.6 km.\n[90-120s] - Road transitions from tree-lined to open field, with speed increasing from 50 to 73 km/h.  \n- GPS map shows location near Hohne, with temperature at 33°C and distance at 25.9–26.1 km.  \n- Terrain elevation changes from 0% to 2% grade as path opens into flat farmland.\n[120-150s] - Road speed fluctuates between 31 and 86 km/h, with a slight incline (1%) then descent (-1%) over 26.2–26.8 km.\n- Right side of road bordered by dense green bushes, left by brown harvested field under clear blue sky.\n- On-screen map shows route progress with a blue line indicating current position near a town labeled \"Höhe\" at 33°C.\n[150-180s] - Speedometer shows decreasing speed from 73 to 24 km/h over the segment.\n- Elevation gain drops from +2% to -1% then stabilizes at 0%.\n- Distance traveled increases from 26.4 km to 26.6 km.\n[180-210s] - Road transitions from open field to dense forest, with trees lining both sides.  \n- Speed fluctuates between 69 and 71 km/h, with a slight incline (1% to 3%) indicated.  \n- GPS map shows route progress and current location near a marked town or landmark.", "history_tokens": 583, "history_utf8_bytes": 2028, "recent_frame_times_s": [203.02043333333333, 204.02143333333333, 205.02243333333334, 206.02343333333334, 207.02443333333332, 208.02543333333332, 209.02643333333333, 210.02743333333333, 211.02843333333334, 212.02943333333334, 213.03043333333332, 214.03143333333333, 215.03243333333333, 216.00006666666667, 217.00106666666667, 218.00206666666668, 219.00306666666665, 220.00406666666666, 221.00506666666666, 222.00606666666667, 223.00706666666667, 224.00806666666668, 225.00906666666666, 226.01006666666666, 227.01106666666666, 228.01206666666667, 229.01306666666667, 230.01406666666668, 231.01506666666666, 232.01606666666666], "recent_frames_sha256": "d5fe8733e0e4993f26a5e8495d2fd5184c6c56b2ac51a59ae2202d2bd1f77623", "num_recent_frames": 30, "tq": 718778.386396752, "t1": 718787.111146201, "ta": 718787.111146201, "te": 718787.151749914, "first_response_s": 8.724749449058436, "answer_total_s": 8.765353162074462, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 166, "content_group": "1f1098d63eb8e4da5807b5c2425e8d2b81b4795a46d2649d996219a00fa1facf", "question": {"question_id": "sample_166_a449_q0", "video_id": 166, "video_path": "./videos/sample_166_real.mp4", "annotation_index": 449, "question_index": 0, "question": "What is located immediately ahead in the clearing right now?", "options": ["A. An intersection.", "B. A steep hill.", "C. A large boulder.", "D. A narrow bridge."], "answer": "A", "time_stamp_s": 333, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [321, 341], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_166_a449_q0", "video_id": 166, "time_stamp_s": 333, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "56ba40c060392d9aa68993f90fe86616ad91e452f6d640255994823cafdfc197", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [303.0203333333333, 304.02133333333336, 305.02233333333334, 306.0233333333333, 307.02433333333335, 308.0253333333333, 309.02633333333335, 310.02733333333333, 311.0283333333333, 312.02933333333334, 313.0303333333333, 314.03133333333335, 315.0323333333333, 316.03333333333336, 317.00096666666667, 318.00196666666665, 319.0029666666667, 320.00396666666666, 321.0049666666667, 322.00596666666667, 323.00696666666664, 324.0079666666667, 325.00896666666665, 326.0099666666667, 327.01096666666666, 328.0119666666667, 329.01296666666667, 330.01396666666665, 331.0149666666667, 332.01596666666666], "recent_frames_sha256": "202014ff4bdba737f1b889328edc24766aba189caf96eef21083e47547e8b7d5", "num_recent_frames": 30, "tq": 718686.365389227, "t1": 718693.264936742, "ta": 718693.264936742, "te": 718693.302788221, "first_response_s": 6.899547514971346, "answer_total_s": 6.937398993992247, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_166_a449_q0", "video_id": 166, "time_stamp_s": 333, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a67a9b5c5b8b16ef7337593dfe12033541e917b69a8ddb0595420484c9af8bba", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Road surface shows gradual incline (slope % increasing from 6% to 7%) through dense green forest.  \n- GPS map overlay indicates location near \"Höhe\" with temperature 34°C and elevation 25.5 km traveled.  \n- Speedometer fluctuates between 50-65 km/h as rider progresses along the winding path.\n[30-60s] - Road surface shows slight wetness, with speed fluctuating between 60-65 km/h.  \n- GPS map displays route progress with a blue dot indicating current position near a forested area.  \n- Temperature remains steady at 34°C, with elevation gain slowly increasing from 1% to 4%.\n[60-90s] - Speed fluctuates between 12-14 km/h as the cyclist navigates a narrow, tree-lined dirt path.  \n- The GPS map on the right shows the route through a forested area with a blue marker indicating current position.  \n- Temperature remains steady at 33°C, and the elevation gain is shown as 12% with a total distance of 25.6 km.\n[90-120s] - Road transitions from tree-lined to open field, with speed increasing from 50 to 73 km/h.  \n- GPS map shows location near Hohne, with temperature at 33°C and distance at 25.9–26.1 km.  \n- Terrain elevation changes from 0% to 2% grade as path opens into flat farmland.\n[120-150s] - Road speed fluctuates between 31 and 86 km/h, with a slight incline (1%) then descent (-1%) over 26.2–26.8 km.\n- Right side of road bordered by dense green bushes, left by brown harvested field under clear blue sky.\n- On-screen map shows route progress with a blue line indicating current position near a town labeled \"Höhe\" at 33°C.\n[150-180s] - Speedometer shows decreasing speed from 73 to 24 km/h over the segment.\n- Elevation gain drops from +2% to -1% then stabilizes at 0%.\n- Distance traveled increases from 26.4 km to 26.6 km.\n[180-210s] - Road transitions from open field to dense forest, with trees lining both sides.  \n- Speed fluctuates between 69 and 71 km/h, with a slight incline (1% to 3%) indicated.  \n- GPS map shows route progress and current location near a marked town or landmark.\n[210-240s] - Road surface transitions from wet to dry as cyclist moves through forested area.  \n- Temperature displayed as 34°C, with map showing location near Nördlich.  \n- Speed fluctuates between 21–73 km/h, with distance increasing from 26.8 to 27.0 km.\n[240-270s] - Road surface shows slight wetness, with trees lining both sides under bright sunlight.\n- On-screen display indicates 27.0–27.2 km distance, 1% incline, and 72–73 BPM heart rate.\n- Map overlay shows cyclist’s position near a hilltop, with temperature at 34°C.\n[270-300s] - Speed fluctuates between 24–28 km/h, with a slight incline (1%) visible on the road.  \n- Distance increases from 27.2 to 27.4 km, while estimated time remains around 76–77 minutes.  \n- Temperature remains steady at 20°C, with a map overlay showing route progress.\n[300-330s] - Road surface shows slight incline with consistent 2% gradient, flanked by dense green trees.  \n- Speedometer fluctuates between 22–30 km/h, with total distance at 27.5–27.6 km and time around 78–82 minutes.  \n- Map overlay indicates location near \"Höhe\" with temperature at 33°C, and a blue line tracking route progress.", "history_tokens": 931, "history_utf8_bytes": 3193, "recent_frame_times_s": [303.0203333333333, 304.02133333333336, 305.02233333333334, 306.0233333333333, 307.02433333333335, 308.0253333333333, 309.02633333333335, 310.02733333333333, 311.0283333333333, 312.02933333333334, 313.0303333333333, 314.03133333333335, 315.0323333333333, 316.03333333333336, 317.00096666666667, 318.00196666666665, 319.0029666666667, 320.00396666666666, 321.0049666666667, 322.00596666666667, 323.00696666666664, 324.0079666666667, 325.00896666666665, 326.0099666666667, 327.01096666666666, 328.0119666666667, 329.01296666666667, 330.01396666666665, 331.0149666666667, 332.01596666666666], "recent_frames_sha256": "202014ff4bdba737f1b889328edc24766aba189caf96eef21083e47547e8b7d5", "num_recent_frames": 30, "tq": 718822.125771392, "t1": 718829.679906025, "ta": 718829.679906025, "te": 718829.722059826, "first_response_s": 7.554134632926434, "answer_total_s": 7.5962884339969605, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 166, "content_group": "1f1098d63eb8e4da5807b5c2425e8d2b81b4795a46d2649d996219a00fa1facf", "question": {"question_id": "sample_166_a450_q0", "video_id": 166, "video_path": "./videos/sample_166_real.mp4", "annotation_index": 450, "question_index": 0, "question": "What is mainly visible on the left side of the road right now?", "options": ["A. A lake.", "B. Trees and dense foliage.", "C. A building complex.", "D. Farmland."], "answer": "B", "time_stamp_s": 440, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [428, 448], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_166_a450_q0", "video_id": 166, "time_stamp_s": 440, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ab3b73ee815cf4da26489a030bc0eddc3defc7d87f3372bd8bc23f07f9914e6f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [410.02723333333336, 411.02823333333333, 412.0292333333333, 413.03023333333334, 414.0312333333333, 415.03223333333335, 416.0332333333333, 417.00086666666664, 418.0018666666667, 419.00286666666665, 420.0038666666667, 421.00486666666666, 422.0058666666667, 423.00686666666667, 424.00786666666664, 425.0088666666667, 426.00986666666665, 427.0108666666667, 428.01186666666666, 429.01286666666664, 430.0138666666667, 431.01486666666665, 432.0158666666667, 433.01686666666666, 434.0178666666667, 435.01886666666667, 436.01986666666664, 437.0208666666667, 438.02186666666665, 439.0228666666667], "recent_frames_sha256": "7ee207e0ba0d4d08fa4600c0269e4a047a7f87ed86f0f73c29b3727f287dc342", "num_recent_frames": 30, "tq": 718693.315125255, "t1": 718703.834480928, "ta": 718703.834480928, "te": 718703.871940505, "first_response_s": 10.519355672993697, "answer_total_s": 10.5568152499618, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_166_a450_q0", "video_id": 166, "time_stamp_s": 440, "ground_truth": "B", "raw_output": "B. Trees and dense foliage.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "e907d5d65badd77ff9c79c75b9911a2afe159d8aa989febf3cc2d7a654268c58", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Speed fluctuates between 12-14 km/h as the cyclist navigates a narrow, tree-lined dirt path.  \n- The GPS map on the right shows the route through a forested area with a blue marker indicating current position.  \n- Temperature remains steady at 33°C, and the elevation gain is shown as 12% with a total distance of 25.6 km.\n[90-120s] - Road transitions from tree-lined to open field, with speed increasing from 50 to 73 km/h.  \n- GPS map shows location near Hohne, with temperature at 33°C and distance at 25.9–26.1 km.  \n- Terrain elevation changes from 0% to 2% grade as path opens into flat farmland.\n[120-150s] - Road speed fluctuates between 31 and 86 km/h, with a slight incline (1%) then descent (-1%) over 26.2–26.8 km.\n- Right side of road bordered by dense green bushes, left by brown harvested field under clear blue sky.\n- On-screen map shows route progress with a blue line indicating current position near a town labeled \"Höhe\" at 33°C.\n[150-180s] - Speedometer shows decreasing speed from 73 to 24 km/h over the segment.\n- Elevation gain drops from +2% to -1% then stabilizes at 0%.\n- Distance traveled increases from 26.4 km to 26.6 km.\n[180-210s] - Road transitions from open field to dense forest, with trees lining both sides.  \n- Speed fluctuates between 69 and 71 km/h, with a slight incline (1% to 3%) indicated.  \n- GPS map shows route progress and current location near a marked town or landmark.\n[210-240s] - Road surface transitions from wet to dry as cyclist moves through forested area.  \n- Temperature displayed as 34°C, with map showing location near Nördlich.  \n- Speed fluctuates between 21–73 km/h, with distance increasing from 26.8 to 27.0 km.\n[240-270s] - Road surface shows slight wetness, with trees lining both sides under bright sunlight.\n- On-screen display indicates 27.0–27.2 km distance, 1% incline, and 72–73 BPM heart rate.\n- Map overlay shows cyclist’s position near a hilltop, with temperature at 34°C.\n[270-300s] - Speed fluctuates between 24–28 km/h, with a slight incline (1%) visible on the road.  \n- Distance increases from 27.2 to 27.4 km, while estimated time remains around 76–77 minutes.  \n- Temperature remains steady at 20°C, with a map overlay showing route progress.\n[300-330s] - Road surface shows slight incline with consistent 2% gradient, flanked by dense green trees.  \n- Speedometer fluctuates between 22–30 km/h, with total distance at 27.5–27.6 km and time around 78–82 minutes.  \n- Map overlay indicates location near \"Höhe\" with temperature at 33°C, and a blue line tracking route progress.\n[330-360s] - Road curves right, then left, flanked by dense green trees and underbrush.  \n- On-screen display shows distance (27.7–27.9 km), elevation gain (3%), and temperature (23°C).  \n- GPS map overlay indicates location near Höhne, Germany, with a blue marker tracking route.\n[360-390s] - Speed fluctuates between 31 and 83 km/h as cyclist navigates a narrow forest road.  \n- Gradient changes from 1% to 3% with slight inclines and declines.  \n- Distance increases from 28.0 km to 28.2 km while temperature remains at 33°C.\n[390-420s] - Road surface transitions from gravel to paved asphalt as cyclist approaches intersection.  \n- Trees lining the path show dense green foliage with sunlight filtering through.  \n- On-screen display shows elevation gain increasing from 2% to 4% and distance progressing to 28.4 km.", "history_tokens": 999, "history_utf8_bytes": 3429, "recent_frame_times_s": [410.02723333333336, 411.02823333333333, 412.0292333333333, 413.03023333333334, 414.0312333333333, 415.03223333333335, 416.0332333333333, 417.00086666666664, 418.0018666666667, 419.00286666666665, 420.0038666666667, 421.00486666666666, 422.0058666666667, 423.00686666666667, 424.00786666666664, 425.0088666666667, 426.00986666666665, 427.0108666666667, 428.01186666666666, 429.01286666666664, 430.0138666666667, 431.01486666666665, 432.0158666666667, 433.01686666666666, 434.0178666666667, 435.01886666666667, 436.01986666666664, 437.0208666666667, 438.02186666666665, 439.0228666666667], "recent_frames_sha256": "7ee207e0ba0d4d08fa4600c0269e4a047a7f87ed86f0f73c29b3727f287dc342", "num_recent_frames": 30, "tq": 718854.704733771, "t1": 718861.203088091, "ta": 718861.203088091, "te": 718861.468106654, "first_response_s": 6.498354319948703, "answer_total_s": 6.763372882967815, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 167, "content_group": "ae7774479ecd9cd57a90919908726ceb4cae0a8e014cafc08145deb90df00f0a", "question": {"question_id": "sample_167_a782_q0", "video_id": 167, "video_path": "./videos/sample_167_real.mp4", "annotation_index": 782, "question_index": 0, "question": "Where is the black car parked right now?", "options": ["A. On the right side of the road.", "B. On the left side of the road.", "C. Directly in front of the road.", "D. Behind the cyclist."], "answer": "A", "time_stamp_s": 36, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_167_a782_q0", "video_id": 167, "time_stamp_s": 36, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "509049dd2dbf07d1e653c88d2275352a538787f44e8918d832454c9cc6cbb9ec", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [6.014633333333333, 7.015633333333334, 8.016633333333333, 9.017633333333333, 10.018633333333334, 11.019633333333333, 12.020633333333333, 13.021633333333334, 14.022633333333333, 15.023633333333333, 16.024633333333334, 17.02563333333333, 18.026633333333333, 19.027633333333334, 20.02863333333333, 21.029633333333333, 22.030633333333334, 23.031633333333332, 24.032633333333333, 25.00026666666667, 26.001266666666666, 27.002266666666667, 28.003266666666665, 29.004266666666666, 30.005266666666667, 31.006266666666665, 32.007266666666666, 33.008266666666664, 34.00926666666667, 35.010266666666666], "recent_frames_sha256": "3749e7de0c5ce5ee19ccfd6c45eba7de9bb530c27f2649a6610736a104641f17", "num_recent_frames": 30, "tq": 719195.606795209, "t1": 719195.947467359, "ta": 719195.947467359, "te": 719195.989470942, "first_response_s": 0.34067215002141893, "answer_total_s": 0.3826757329516113, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_167_a782_q0", "video_id": 167, "time_stamp_s": 36, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "65897be8b557fc30a497f276d98ff3eb3f156cf9d1671d53bf531114e18df296", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A cyclist rides along a narrow paved road flanked by dense green trees and bushes, with a GPS overlay showing route progress and elevation changes.  \n- The on-screen display shows fluctuating speed (e.g., 69 km/h, 70 km/h) and distance (4.3 km to 4.4 km), alongside a temperature reading of 30°C.  \n- A map in the top right corner indicates the cyclist’s position relative to a route outline, with a blue dot marking the current location.", "history_tokens": 115, "history_utf8_bytes": 451, "recent_frame_times_s": [6.014633333333333, 7.015633333333334, 8.016633333333333, 9.017633333333333, 10.018633333333334, 11.019633333333333, 12.020633333333333, 13.021633333333334, 14.022633333333333, 15.023633333333333, 16.024633333333334, 17.02563333333333, 18.026633333333333, 19.027633333333334, 20.02863333333333, 21.029633333333333, 22.030633333333334, 23.031633333333332, 24.032633333333333, 25.00026666666667, 26.001266666666666, 27.002266666666667, 28.003266666666665, 29.004266666666666, 30.005266666666667, 31.006266666666665, 32.007266666666666, 33.008266666666664, 34.00926666666667, 35.010266666666666], "recent_frames_sha256": "3749e7de0c5ce5ee19ccfd6c45eba7de9bb530c27f2649a6610736a104641f17", "num_recent_frames": 30, "tq": 719003.894898021, "t1": 719005.306542453, "ta": 719005.306542453, "te": 719005.34472596, "first_response_s": 1.411644431995228, "answer_total_s": 1.4498279390390962, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 167, "content_group": "ae7774479ecd9cd57a90919908726ceb4cae0a8e014cafc08145deb90df00f0a", "question": {"question_id": "sample_167_a783_q0", "video_id": 167, "video_path": "./videos/sample_167_real.mp4", "annotation_index": 783, "question_index": 0, "question": "What is the current value of 'distanz' displayed in the video?", "options": ["A. 6.0KM.", "B. 6.1KM.", "C. 6.2KM.", "D. 5.9KM."], "answer": "A", "time_stamp_s": 145, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [125, 145], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_167_a783_q0", "video_id": 167, "time_stamp_s": 145, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2947d80a26a1e8729dc6af35d41278979c361be054c76f1b915da770c8b5087d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [115.02353333333333, 116.02453333333334, 117.02553333333333, 118.02653333333333, 119.02753333333334, 120.02853333333333, 121.02953333333333, 122.03053333333334, 123.03153333333333, 124.03253333333333, 125.00016666666667, 126.00116666666666, 127.00216666666667, 128.00316666666666, 129.00416666666666, 130.00516666666667, 131.00616666666667, 132.00716666666668, 133.00816666666665, 134.00916666666666, 135.01016666666666, 136.01116666666667, 137.01216666666667, 138.01316666666668, 139.01416666666665, 140.01516666666666, 141.01616666666666, 142.01716666666667, 143.01816666666667, 144.01916666666668], "recent_frames_sha256": "2392fdfb4fb3ce64096e9e011b74de3e55433c8cce8391f372996dc1e4726494", "num_recent_frames": 30, "tq": 719195.999563946, "t1": 719209.032103149, "ta": 719209.032103149, "te": 719209.068993317, "first_response_s": 13.0325392029481, "answer_total_s": 13.0694293709239, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_167_a783_q0", "video_id": 167, "time_stamp_s": 145, "ground_truth": "A", "raw_output": "D. 5.9KM.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "53af6858d5612f3af2ac17669398b5f964a093ce57148546b54c465f39d359a3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A cyclist rides along a narrow paved road flanked by dense green trees and bushes, with a GPS overlay showing route progress and elevation changes.  \n- The on-screen display shows fluctuating speed (e.g., 69 km/h, 70 km/h) and distance (4.3 km to 4.4 km), alongside a temperature reading of 30°C.  \n- A map in the top right corner indicates the cyclist’s position relative to a route outline, with a blue dot marking the current location.\n[30-60s] - A white car passes on the road ahead, followed by a red SUV, then a black sedan, all moving in the same direction.\n- The cyclist crosses a red metal bridge, with the road surface appearing smooth and the bridge spanning over a valley.\n- The cyclist enters a forested area with tall trees lining the narrow road, and the speedometer shows a steady increase in speed.\n[60-90s] - A cyclist rides along a narrow road flanked by dense trees on the left and a golden field on the right.  \n- The road curves gently, with a small hill visible in the distance under a clear blue sky.  \n- A herd of cattle appears on the right side of the road, grazing in the field, as the cyclist approaches.\n[90-120s] - Road elevation gradually increases, indicated by rising incline percentage from 0% to 4%.  \n- Distance traveled increases from 5.7 km to 5.9 km, with estimated time decreasing from 76 min to 68 min.  \n- Temperature remains steady at 22°C, and a map overlay shows current location near the top of a route.", "history_tokens": 366, "history_utf8_bytes": 1464, "recent_frame_times_s": [115.02353333333333, 116.02453333333334, 117.02553333333333, 118.02653333333333, 119.02753333333334, 120.02853333333333, 121.02953333333333, 122.03053333333334, 123.03153333333333, 124.03253333333333, 125.00016666666667, 126.00116666666666, 127.00216666666667, 128.00316666666666, 129.00416666666666, 130.00516666666667, 131.00616666666667, 132.00716666666668, 133.00816666666665, 134.00916666666666, 135.01016666666666, 136.01116666666667, 137.01216666666667, 138.01316666666668, 139.01416666666665, 140.01516666666666, 141.01616666666666, 142.01716666666667, 143.01816666666667, 144.01916666666668], "recent_frames_sha256": "2392fdfb4fb3ce64096e9e011b74de3e55433c8cce8391f372996dc1e4726494", "num_recent_frames": 30, "tq": 719031.2578552, "t1": 719033.323021859, "ta": 719033.323021859, "te": 719033.671160443, "first_response_s": 2.06516665907111, "answer_total_s": 2.413305243011564, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 167, "content_group": "ae7774479ecd9cd57a90919908726ceb4cae0a8e014cafc08145deb90df00f0a", "question": {"question_id": "sample_167_a784_q0", "video_id": 167, "video_path": "./videos/sample_167_real.mp4", "annotation_index": 784, "question_index": 0, "question": "What is the object seen parallel and closest to the right side of the cyclist right now?", "options": ["A. A river.", "B. A line of trees.", "C. Another cyclist.", "D. A fenceline."], "answer": "B", "time_stamp_s": 270, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [250, 270], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_167_a784_q0", "video_id": 167, "time_stamp_s": 270, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0b106899d7b17bb5688f4286f99f7c5791cf0781ee6c0f30248d70c4294aeed6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [240.01506666666666, 241.01606666666666, 242.01706666666666, 243.01806666666667, 244.01906666666667, 245.02006666666668, 246.02106666666666, 247.02206666666666, 248.02306666666667, 249.02406666666667, 250.02506666666667, 251.02606666666668, 252.02706666666666, 253.02806666666666, 254.02906666666667, 255.03006666666667, 256.0310666666667, 257.03206666666665, 258.0330666666667, 259.0007, 260.0017, 261.0027, 262.0037, 263.0047, 264.0057, 265.0067, 266.0077, 267.0087, 268.0097, 269.0107], "recent_frames_sha256": "8ec35794091d267ea002f0dfc1bd5b15f03fb894704892ee3229c4559a0f6510", "num_recent_frames": 30, "tq": 719209.078510692, "t1": 719219.582636201, "ta": 719219.582636201, "te": 719219.619556043, "first_response_s": 10.50412550906185, "answer_total_s": 10.541045350953937, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_167_a784_q0", "video_id": 167, "time_stamp_s": 270, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "769a3d388f6fbd5ae8110b18095d2b313b6e4453172ee3d112de3b3d17156b58", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A cyclist rides along a narrow paved road flanked by dense green trees and bushes, with a GPS overlay showing route progress and elevation changes.  \n- The on-screen display shows fluctuating speed (e.g., 69 km/h, 70 km/h) and distance (4.3 km to 4.4 km), alongside a temperature reading of 30°C.  \n- A map in the top right corner indicates the cyclist’s position relative to a route outline, with a blue dot marking the current location.\n[30-60s] - A white car passes on the road ahead, followed by a red SUV, then a black sedan, all moving in the same direction.\n- The cyclist crosses a red metal bridge, with the road surface appearing smooth and the bridge spanning over a valley.\n- The cyclist enters a forested area with tall trees lining the narrow road, and the speedometer shows a steady increase in speed.\n[60-90s] - A cyclist rides along a narrow road flanked by dense trees on the left and a golden field on the right.  \n- The road curves gently, with a small hill visible in the distance under a clear blue sky.  \n- A herd of cattle appears on the right side of the road, grazing in the field, as the cyclist approaches.\n[90-120s] - Road elevation gradually increases, indicated by rising incline percentage from 0% to 4%.  \n- Distance traveled increases from 5.7 km to 5.9 km, with estimated time decreasing from 76 min to 68 min.  \n- Temperature remains steady at 22°C, and a map overlay shows current location near the top of a route.\n[120-150s] - Road elevation gradually increases, indicated by rising incline percentage (e.g., 1% to 3%).\n- Distance traveled increases from 5.9 km to 6.0 km, with time displayed as 78 min to 81 min.\n- Temperature remains stable at 22°C, with a map showing location near the UK's northern coast.\n[150-180s] - Road surface shows gradual descent with trees lining both sides, and a wooden fence appears on the right.\n- Speedometer fluctuates between 18 and 22 mph, while distance increases from 6.0 to 6.2 km.\n- Temperature remains steady at 31°C, and the map overlay indicates a route through a forested area.\n[180-210s] - Road surface transitions from gravel to paved, with trees lining both sides.  \n- Speed fluctuates between 60-85 km/h, with a 3% incline briefly appearing.  \n- GPS map shows location near the UK, with temperature at 31°C.\n[210-240s] - Speed fluctuates between 32 and 92 km/h as the cyclist navigates a winding forest road.  \n- The route progresses from 6.4 km to 6.7 km, with elevation changes indicated by a -3% to +4% gradient.  \n- A map overlay shows the cyclist’s position near a town labeled \"Hofa\" with a temperature of 31°C.\n[240-270s] - Speed fluctuates between 19-90 km/h as cyclist navigates a forested road.  \n- A second cyclist appears ahead, wearing orange, moving at a steady pace.  \n- On-screen data shows distance increasing from 6.8 to 7.0 km, with temperature at 31°C.", "history_tokens": 777, "history_utf8_bytes": 2879, "recent_frame_times_s": [240.01506666666666, 241.01606666666666, 242.01706666666666, 243.01806666666667, 244.01906666666667, 245.02006666666668, 246.02106666666666, 247.02206666666666, 248.02306666666667, 249.02406666666667, 250.02506666666667, 251.02606666666668, 252.02706666666666, 253.02806666666666, 254.02906666666667, 255.03006666666667, 256.0310666666667, 257.03206666666665, 258.0330666666667, 259.0007, 260.0017, 261.0027, 262.0037, 263.0047, 264.0057, 265.0067, 266.0077, 267.0087, 268.0097, 269.0107], "recent_frames_sha256": "8ec35794091d267ea002f0dfc1bd5b15f03fb894704892ee3229c4559a0f6510", "num_recent_frames": 30, "tq": 719105.222084438, "t1": 719110.815182574, "ta": 719110.815182574, "te": 719110.852771925, "first_response_s": 5.593098136014305, "answer_total_s": 5.630687487078831, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 167, "content_group": "ae7774479ecd9cd57a90919908726ceb4cae0a8e014cafc08145deb90df00f0a", "question": {"question_id": "sample_167_a785_q0", "video_id": 167, "video_path": "./videos/sample_167_real.mp4", "annotation_index": 785, "question_index": 0, "question": "Where is the white railing located right now?", "options": ["A. On the right side of the path.", "B. On the left side of the path.", "C. Overhead, forming an arch.", "D. Directly in front of the cyclist."], "answer": "A", "time_stamp_s": 393, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [375, 395], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_167_a785_q0", "video_id": 167, "time_stamp_s": 393, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a95178c89836bf652a19c5e57770013e2f0fdeb35550621473434750a78ced54", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [363.0046, 364.0056, 365.0066, 366.0076, 367.0086, 368.0096, 369.0106, 370.0116, 371.0126, 372.0136, 373.0146, 374.0156, 375.0166, 376.0176, 377.0186, 378.0196, 379.0206, 380.0216, 381.0226, 382.0236, 383.0246, 384.0256, 385.0266, 386.0276, 387.0286, 388.0296, 389.0306, 390.0316, 391.0326, 392.0002333333333], "recent_frames_sha256": "90efac612907c9cf6d62226e676f9567101174dca9512b6e38f5b7da2ba3efa4", "num_recent_frames": 30, "tq": 719219.630377896, "t1": 719231.105444316, "ta": 719231.105444316, "te": 719231.145711964, "first_response_s": 11.475066420040093, "answer_total_s": 11.515334067982621, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_167_a785_q0", "video_id": 167, "time_stamp_s": 393, "ground_truth": "A", "raw_output": "A. On the right side of the path.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "47d9dcc33aceec43b87b3ae0f53b0318d27708928c1040eb94ddf53fdf42639c", "condition_order": ["notes", "recent"], "memory": "[30-60s] - A white car passes on the road ahead, followed by a red SUV, then a black sedan, all moving in the same direction.\n- The cyclist crosses a red metal bridge, with the road surface appearing smooth and the bridge spanning over a valley.\n- The cyclist enters a forested area with tall trees lining the narrow road, and the speedometer shows a steady increase in speed.\n[60-90s] - A cyclist rides along a narrow road flanked by dense trees on the left and a golden field on the right.  \n- The road curves gently, with a small hill visible in the distance under a clear blue sky.  \n- A herd of cattle appears on the right side of the road, grazing in the field, as the cyclist approaches.\n[90-120s] - Road elevation gradually increases, indicated by rising incline percentage from 0% to 4%.  \n- Distance traveled increases from 5.7 km to 5.9 km, with estimated time decreasing from 76 min to 68 min.  \n- Temperature remains steady at 22°C, and a map overlay shows current location near the top of a route.\n[120-150s] - Road elevation gradually increases, indicated by rising incline percentage (e.g., 1% to 3%).\n- Distance traveled increases from 5.9 km to 6.0 km, with time displayed as 78 min to 81 min.\n- Temperature remains stable at 22°C, with a map showing location near the UK's northern coast.\n[150-180s] - Road surface shows gradual descent with trees lining both sides, and a wooden fence appears on the right.\n- Speedometer fluctuates between 18 and 22 mph, while distance increases from 6.0 to 6.2 km.\n- Temperature remains steady at 31°C, and the map overlay indicates a route through a forested area.\n[180-210s] - Road surface transitions from gravel to paved, with trees lining both sides.  \n- Speed fluctuates between 60-85 km/h, with a 3% incline briefly appearing.  \n- GPS map shows location near the UK, with temperature at 31°C.\n[210-240s] - Speed fluctuates between 32 and 92 km/h as the cyclist navigates a winding forest road.  \n- The route progresses from 6.4 km to 6.7 km, with elevation changes indicated by a -3% to +4% gradient.  \n- A map overlay shows the cyclist’s position near a town labeled \"Hofa\" with a temperature of 31°C.\n[240-270s] - Speed fluctuates between 19-90 km/h as cyclist navigates a forested road.  \n- A second cyclist appears ahead, wearing orange, moving at a steady pace.  \n- On-screen data shows distance increasing from 6.8 to 7.0 km, with temperature at 31°C.\n[270-300s] - Road elevation gradually increases, indicated by rising percentage grade from 4% to 9%.\n- GPS map shows the rider's position moving northeast along a forested path.\n- Temperature remains stable at 31°C, with a slight drop to 30°C near the end of the segment.\n[300-330s] - Road surface shows slight incline with consistent 6% gradient as indicated on screen.\n- Vegetation on both sides of the road is dense with tall grass and trees, partially obscuring the horizon.\n- On-screen display shows distance increasing from 7.2 km to 7.3 km, with time decreasing from 69:00 to 68:00 minutes.\n[330-360s] - Road surface shows slight incline with consistent 6-7% gradient as cyclist progresses.\n- Left side of road bordered by dense green foliage, right side by trees with wooden guardrail.\n- On-screen display updates distance to 7.4 KM and time to 77 MIN, with temperature at 30°C.\n[360-390s] - Road surface shows slight incline with consistent 1-3% gradient as cyclist progresses.\n- Forest canopy allows dappled sunlight to filter through, creating dynamic lighting on path.\n- On-screen metrics display fluctuating speed (15-18 km/h), distance (7.5-7.6 km), and time (66-73 min), with temperature at 30°C.", "history_tokens": 994, "history_utf8_bytes": 3643, "recent_frame_times_s": [363.0046, 364.0056, 365.0066, 366.0076, 367.0086, 368.0096, 369.0106, 370.0116, 371.0126, 372.0136, 373.0146, 374.0156, 375.0166, 376.0176, 377.0186, 378.0196, 379.0206, 380.0216, 381.0226, 382.0236, 383.0246, 384.0256, 385.0266, 386.0276, 387.0286, 388.0296, 389.0306, 390.0316, 391.0326, 392.0002333333333], "recent_frames_sha256": "90efac612907c9cf6d62226e676f9567101174dca9512b6e38f5b7da2ba3efa4", "num_recent_frames": 30, "tq": 719147.227295764, "t1": 719155.09806883, "ta": 719155.09806883, "te": 719155.485258681, "first_response_s": 7.870773065951653, "answer_total_s": 8.257962916977704, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 167, "content_group": "ae7774479ecd9cd57a90919908726ceb4cae0a8e014cafc08145deb90df00f0a", "question": {"question_id": "sample_167_a786_q0", "video_id": 167, "video_path": "./videos/sample_167_real.mp4", "annotation_index": 786, "question_index": 0, "question": "Where are the power lines located right now?", "options": ["A. To the left of the road.", "B. Overhead, crossing the road.", "C. To the right side of the road.", "D. Directly in front of the cyclist."], "answer": "C", "time_stamp_s": 513, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [500, 520], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_167_a786_q0", "video_id": 167, "time_stamp_s": 513, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d1705a6b1fd453f2d3de968f7db8ecce938398cb1042bcf69a681d154beccc4b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [483.0245, 484.0255, 485.0265, 486.0275, 487.0285, 488.0295, 489.0305, 490.0315, 491.0325, 492.00013333333334, 493.0011333333333, 494.00213333333335, 495.0031333333333, 496.00413333333336, 497.00513333333333, 498.0061333333333, 499.00713333333334, 500.0081333333333, 501.00913333333335, 502.01013333333333, 503.0111333333333, 504.01213333333334, 505.0131333333333, 506.01413333333335, 507.0151333333333, 508.01613333333336, 509.01713333333333, 510.0181333333333, 511.01913333333334, 512.0201333333333], "recent_frames_sha256": "4047bd295c39e1662cbba505e522de90976ac646b74625b02e9da3cacbb0c9fc", "num_recent_frames": 30, "tq": 719231.157208086, "t1": 719238.326433088, "ta": 719238.326433088, "te": 719238.365138416, "first_response_s": 7.169225002056919, "answer_total_s": 7.207930329954252, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_167_a786_q0", "video_id": 167, "time_stamp_s": 513, "ground_truth": "C", "raw_output": "C. To the right side of the road.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "1f7fcf6a86d0bd3d534c248acd06380dfe5a09d4098eb27125751063e956b5c1", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Road surface shows gradual descent with trees lining both sides, and a wooden fence appears on the right.\n- Speedometer fluctuates between 18 and 22 mph, while distance increases from 6.0 to 6.2 km.\n- Temperature remains steady at 31°C, and the map overlay indicates a route through a forested area.\n[180-210s] - Road surface transitions from gravel to paved, with trees lining both sides.  \n- Speed fluctuates between 60-85 km/h, with a 3% incline briefly appearing.  \n- GPS map shows location near the UK, with temperature at 31°C.\n[210-240s] - Speed fluctuates between 32 and 92 km/h as the cyclist navigates a winding forest road.  \n- The route progresses from 6.4 km to 6.7 km, with elevation changes indicated by a -3% to +4% gradient.  \n- A map overlay shows the cyclist’s position near a town labeled \"Hofa\" with a temperature of 31°C.\n[240-270s] - Speed fluctuates between 19-90 km/h as cyclist navigates a forested road.  \n- A second cyclist appears ahead, wearing orange, moving at a steady pace.  \n- On-screen data shows distance increasing from 6.8 to 7.0 km, with temperature at 31°C.\n[270-300s] - Road elevation gradually increases, indicated by rising percentage grade from 4% to 9%.\n- GPS map shows the rider's position moving northeast along a forested path.\n- Temperature remains stable at 31°C, with a slight drop to 30°C near the end of the segment.\n[300-330s] - Road surface shows slight incline with consistent 6% gradient as indicated on screen.\n- Vegetation on both sides of the road is dense with tall grass and trees, partially obscuring the horizon.\n- On-screen display shows distance increasing from 7.2 km to 7.3 km, with time decreasing from 69:00 to 68:00 minutes.\n[330-360s] - Road surface shows slight incline with consistent 6-7% gradient as cyclist progresses.\n- Left side of road bordered by dense green foliage, right side by trees with wooden guardrail.\n- On-screen display updates distance to 7.4 KM and time to 77 MIN, with temperature at 30°C.\n[360-390s] - Road surface shows slight incline with consistent 1-3% gradient as cyclist progresses.\n- Forest canopy allows dappled sunlight to filter through, creating dynamic lighting on path.\n- On-screen metrics display fluctuating speed (15-18 km/h), distance (7.5-7.6 km), and time (66-73 min), with temperature at 30°C.\n[390-420s] - Road surface shows slight wetness, with visible water pooling near the center.  \n- Trees on both sides form a dense canopy, allowing dappled sunlight to filter through.  \n- On-screen display indicates a steady pace of 66 minutes for 7.7 km, with a 7% incline and 13°C temperature.\n[420-450s] - Speed fluctuates between 67 and 70 km/h as the cyclist moves along a narrow forest path.  \n- The route is flanked by dense green trees, with sunlight filtering through the canopy.  \n- On-screen data shows 7.8 km distance, 66–67 minutes elapsed, and a 10–15% gradient, with temperature at 30°C.\n[450-480s] - Road surface shows slight incline, with speedometer indicating 11-18 km/h and distance increasing to 7.9–8.0 km.  \n- Trees on both sides form a dense canopy, with sunlight filtering through leaves.  \n- On-screen map displays location near \"Hofa\" with temperature at 30°C and elevation fluctuating.\n[480-510s] - Road surface transitions from dirt to gravel, with trees lining the left and open field on the right.  \n- A tall electricity pylon appears on the right side of the road at 4:58, with a clear blue sky and white clouds above.  \n- On-screen metrics show a steady pace of 70–75 BPM, 1%–4% gradient, and distance increasing from 8.0 to 8.2 KM.", "history_tokens": 1021, "history_utf8_bytes": 3610, "recent_frame_times_s": [483.0245, 484.0255, 485.0265, 486.0275, 487.0285, 488.0295, 489.0305, 490.0315, 491.0325, 492.00013333333334, 493.0011333333333, 494.00213333333335, 495.0031333333333, 496.00413333333336, 497.00513333333333, 498.0061333333333, 499.00713333333334, 500.0081333333333, 501.00913333333335, 502.01013333333333, 503.0111333333333, 504.01213333333334, 505.0131333333333, 506.01413333333335, 507.0151333333333, 508.01613333333336, 509.01713333333333, 510.0181333333333, 511.01913333333334, 512.0201333333333], "recent_frames_sha256": "4047bd295c39e1662cbba505e522de90976ac646b74625b02e9da3cacbb0c9fc", "num_recent_frames": 30, "tq": 719189.829341079, "t1": 719195.2113471, "ta": 719195.2113471, "te": 719195.588329063, "first_response_s": 5.382006020983681, "answer_total_s": 5.758987984037958, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 168, "content_group": "0e5d4b450f0b795446925d1e207512a505841728ac8d6118f95e34ca2c4d199a", "question": {"question_id": "sample_168_a243_q0", "video_id": 168, "video_path": "./videos/sample_168_real.mp4", "annotation_index": 243, "question_index": 0, "question": "What is located on the left side of the cyclists right now?", "options": ["A. A row of shops.", "B. A forest.", "C. A parking lot.", "D. A large park."], "answer": "A", "time_stamp_s": 19, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_168_a243_q0", "video_id": 168, "time_stamp_s": 19, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a855e2931e62c19c9af1e2fcd74c4959b7b5efbe6a61d48f852dba6af6c927a4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.034, 1.0016333333333334, 2.0026333333333333, 3.003633333333333, 4.0046333333333335, 5.005633333333333, 6.006633333333333, 7.007633333333334, 8.008633333333334, 9.009633333333333, 10.010633333333333, 11.011633333333334, 12.012633333333333, 13.013633333333333, 14.014633333333334, 15.015633333333334, 16.016633333333335, 17.00095, 18.00195], "recent_frames_sha256": "f84f38972a110729126754800ad491e8cb17180c886364534b9f6c644547b9fb", "num_recent_frames": 19, "tq": 717414.470129305, "t1": 717421.883193716, "ta": 717421.883193716, "te": 717421.919907649, "first_response_s": 7.413064411026426, "answer_total_s": 7.449778344016522, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_168_a243_q0", "video_id": 168, "time_stamp_s": 19, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6a74950621155521e275c3eeca6a998cebd8394c87ba482b9f88625dcd8f7213", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.034, 1.0016333333333334, 2.0026333333333333, 3.003633333333333, 4.0046333333333335, 5.005633333333333, 6.006633333333333, 7.007633333333334, 8.008633333333334, 9.009633333333333, 10.010633333333333, 11.011633333333334, 12.012633333333333, 13.013633333333333, 14.014633333333334, 15.015633333333334, 16.016633333333335, 17.00095, 18.00195], "recent_frames_sha256": "f84f38972a110729126754800ad491e8cb17180c886364534b9f6c644547b9fb", "num_recent_frames": 19, "tq": 717461.8751644, "t1": 717473.818218029, "ta": 717473.818218029, "te": 717474.126979942, "first_response_s": 11.943053629016504, "answer_total_s": 12.25181554199662, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 168, "content_group": "0e5d4b450f0b795446925d1e207512a505841728ac8d6118f95e34ca2c4d199a", "question": {"question_id": "sample_168_a244_q0", "video_id": 168, "video_path": "./videos/sample_168_real.mp4", "annotation_index": 244, "question_index": 0, "question": "Where is the National Championships banner located right now?", "options": ["A. Hanging above the cyclist.", "B. On the left side of the road.", "C. On the right side of the road.", "D. Directly behind the cyclist."], "answer": "A", "time_stamp_s": 137, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [119, 139], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_168_a244_q0", "video_id": 168, "time_stamp_s": 137, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3e25c40c7f6d12af4820a43eee5c6543307e83dc384ad7b4c2959d8d762ac5d6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [107.00753333333333, 108.00853333333333, 109.00953333333334, 110.01053333333333, 111.01153333333333, 112.01253333333334, 113.01353333333333, 114.01453333333333, 115.01553333333334, 116.01653333333333, 117.00085, 118.00185, 119.00285, 120.00385, 121.00485, 122.00585, 123.00685, 124.00785, 125.00885, 126.00985, 127.01085, 128.01185, 129.01285, 130.01385, 131.01485, 132.01585, 133.00016666666667, 134.00116666666668, 135.00216666666665, 136.00316666666666], "recent_frames_sha256": "e8d849fcbdbe88ad7cf81648de558bdba9ec208fa0d77b4f2ce8f5f821a91d6d", "num_recent_frames": 30, "tq": 717421.939783296, "t1": 717433.808883915, "ta": 717433.808883915, "te": 717433.84659619, "first_response_s": 11.86910061899107, "answer_total_s": 11.90681289404165, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_168_a244_q0", "video_id": 168, "time_stamp_s": 137, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2b02b06902add56c598082892ef7f00f33d968bb4845bf2caabc94c6a7d0ed60", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cyclist in blue jersey rides ahead, maintaining high cadence (175-182 rpm) while navigating urban streets with traffic and spectators.  \n- Group of cyclists follows closely behind, with varying speeds and positions, passing through intersections and near buildings.  \n- On-screen metrics show distance decreasing (16768m to 16343m) and cadence fluctuating, indicating dynamic pacing during the race.\n[30-60s] - Cyclist in black jersey rides solo, maintaining high cadence (188-193 rpm) through urban streets.  \n- Other cyclists appear ahead, including one in red jersey, suggesting competitive proximity.  \n- Roadside barriers and spectators line the route, with buildings and traffic lights visible in background.\n[60-90s] - Cyclist in blue jersey rides ahead, maintaining pace with group; distance marker shows 1570m.\n- Other riders follow closely, including one in orange jersey, navigating urban streets with traffic cones.\n- Road surface shows cracks; cyclists pass under a bridge with visible signage.\n[90-120s] - Cyclist in orange jersey rides ahead, maintaining steady pace with fluctuating speed (125-135 bpm) and cadence (182-178 rpm).  \n- Green barriers line the street, with spectators and urban buildings visible on either side.  \n- Distance marker increases from 1542m to 1502m, indicating progress along the route.", "history_tokens": 328, "history_utf8_bytes": 1339, "recent_frame_times_s": [107.00753333333333, 108.00853333333333, 109.00953333333334, 110.01053333333333, 111.01153333333333, 112.01253333333334, 113.01353333333333, 114.01453333333333, 115.01553333333334, 116.01653333333333, 117.00085, 118.00185, 119.00285, 120.00385, 121.00485, 122.00585, 123.00685, 124.00785, 125.00885, 126.00985, 127.01085, 128.01185, 129.01285, 130.01385, 131.01485, 132.01585, 133.00016666666667, 134.00116666666668, 135.00216666666665, 136.00316666666666], "recent_frames_sha256": "e8d849fcbdbe88ad7cf81648de558bdba9ec208fa0d77b4f2ce8f5f821a91d6d", "num_recent_frames": 30, "tq": 717503.476592701, "t1": 717511.460194982, "ta": 717511.460194982, "te": 717512.027282361, "first_response_s": 7.98360228096135, "answer_total_s": 8.550689660012722, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 168, "content_group": "0e5d4b450f0b795446925d1e207512a505841728ac8d6118f95e34ca2c4d199a", "question": {"question_id": "sample_168_a245_q0", "video_id": 168, "video_path": "./videos/sample_168_real.mp4", "annotation_index": 245, "question_index": 0, "question": "Where is the stop sign located right now?", "options": ["A. On the right side of the cyclists.", "B. On the left side of the road.", "C. Directly ahead of the cyclists.", "D. Behind the cyclists."], "answer": "A", "time_stamp_s": 253, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [238, 258], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_168_a245_q0", "video_id": 168, "time_stamp_s": 253, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f3169c30cdb4994da1a7ccaa74d3440ca762c82dc3332439c52a1490c85a4a57", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [223.00675, 224.00775, 225.00875, 226.00975, 227.01075, 228.01175, 229.01275, 230.01375, 231.01475, 232.01575, 233.00006666666667, 234.00106666666667, 235.00206666666668, 236.00306666666665, 237.00406666666666, 238.00506666666666, 239.00606666666667, 240.00706666666667, 241.00806666666668, 242.00906666666666, 243.01006666666666, 244.01106666666666, 245.01206666666667, 246.01306666666667, 247.01406666666668, 248.01506666666666, 249.01606666666666, 250.00038333333333, 251.00138333333334, 252.00238333333334], "recent_frames_sha256": "724ad2dcae0a42ba14c0413a57813517a9906e859b246d233b05cd1e2091646e", "num_recent_frames": 30, "tq": 717433.864470423, "t1": 717442.054920873, "ta": 717442.054920873, "te": 717442.092392212, "first_response_s": 8.190450450056233, "answer_total_s": 8.227921789046377, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_168_a245_q0", "video_id": 168, "time_stamp_s": 253, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "23248b5f72e390f0201536c3d5d5fa8f3776fd7e71663b509602ed01d00067e5", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cyclist in blue jersey rides ahead, maintaining high cadence (175-182 rpm) while navigating urban streets with traffic and spectators.  \n- Group of cyclists follows closely behind, with varying speeds and positions, passing through intersections and near buildings.  \n- On-screen metrics show distance decreasing (16768m to 16343m) and cadence fluctuating, indicating dynamic pacing during the race.\n[30-60s] - Cyclist in black jersey rides solo, maintaining high cadence (188-193 rpm) through urban streets.  \n- Other cyclists appear ahead, including one in red jersey, suggesting competitive proximity.  \n- Roadside barriers and spectators line the route, with buildings and traffic lights visible in background.\n[60-90s] - Cyclist in blue jersey rides ahead, maintaining pace with group; distance marker shows 1570m.\n- Other riders follow closely, including one in orange jersey, navigating urban streets with traffic cones.\n- Road surface shows cracks; cyclists pass under a bridge with visible signage.\n[90-120s] - Cyclist in orange jersey rides ahead, maintaining steady pace with fluctuating speed (125-135 bpm) and cadence (182-178 rpm).  \n- Green barriers line the street, with spectators and urban buildings visible on either side.  \n- Distance marker increases from 1542m to 1502m, indicating progress along the route.\n[120-150s] - Cyclist maintains steady pace, averaging 177 rpm, as they navigate urban streets lined with spectators and barriers.\n- Distance increases from 1501m to 1465m, indicating a slight descent or course change, with speed fluctuating between 31-34 mph.\n- Road features include crosswalks, traffic signals, and buildings, with the cyclist approaching a \"National Championship\" archway.\n[150-180s] - Cyclist in orange jersey and black shorts rides ahead, maintaining steady pace with RPMs around 180-185.  \n- Road surface shows cracks and lane markings; buildings and green barriers line the route.  \n- On-screen metrics display distance (1460m–1420m) and cadence, with a map showing route progress.\n[180-210s] - Cyclist in black jersey rides through urban streets, passing buildings and spectators.  \n- On-screen metrics show power output, cadence, and distance, with a map indicating route progress.  \n- Other cyclists appear ahead, with one overtaking the main rider near a crosswalk.\n[210-240s] - Cyclist in black jersey rides ahead, maintaining steady pace with fluctuating speed (173-177 rpm) and elevation gain (338-358m).\n- Other cyclists, including one in orange jersey, ride closely behind, navigating urban streets with traffic lights and barriers.\n- Roadside signage and buildings, including a \"NATIONAL CHAMPIONS\" banner, indicate a competitive race environment.", "history_tokens": 678, "history_utf8_bytes": 2722, "recent_frame_times_s": [223.00675, 224.00775, 225.00875, 226.00975, 227.01075, 228.01175, 229.01275, 230.01375, 231.01475, 232.01575, 233.00006666666667, 234.00106666666667, 235.00206666666668, 236.00306666666665, 237.00406666666666, 238.00506666666666, 239.00606666666667, 240.00706666666667, 241.00806666666668, 242.00906666666666, 243.01006666666666, 244.01106666666666, 245.01206666666667, 246.01306666666667, 247.01406666666668, 248.01506666666666, 249.01606666666666, 250.00038333333333, 251.00138333333334, 252.00238333333334], "recent_frames_sha256": "724ad2dcae0a42ba14c0413a57813517a9906e859b246d233b05cd1e2091646e", "num_recent_frames": 30, "tq": 717541.195358468, "t1": 717547.343145664, "ta": 717547.343145664, "te": 717547.379850106, "first_response_s": 6.1477871959796175, "answer_total_s": 6.1844916379777715, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 168, "content_group": "0e5d4b450f0b795446925d1e207512a505841728ac8d6118f95e34ca2c4d199a", "question": {"question_id": "sample_168_a246_q0", "video_id": 168, "video_path": "./videos/sample_168_real.mp4", "annotation_index": 246, "question_index": 0, "question": "What is positioned on the right side of the cyclists right now?", "options": ["A. A green fence.", "B. A banner with an advertisement.", "C. A row of trees.", "D. A pedestrian sitting area."], "answer": "A", "time_stamp_s": 369, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [357, 377], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_168_a246_q0", "video_id": 168, "time_stamp_s": 369, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4a41f3dc915b935198102317472756ef093ec15dc869dcb1b78bb5ffd556267e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [339.00596666666667, 340.00696666666664, 341.0079666666667, 342.00896666666665, 343.0099666666667, 344.01096666666666, 345.0119666666667, 346.01296666666667, 347.01396666666665, 348.0149666666667, 349.01596666666666, 350.00028333333336, 351.00128333333333, 352.0022833333333, 353.00328333333334, 354.0042833333333, 355.00528333333335, 356.00628333333333, 357.0072833333333, 358.00828333333334, 359.0092833333333, 360.01028333333335, 361.0112833333333, 362.01228333333336, 363.01328333333333, 364.0142833333333, 365.01528333333334, 366.0162833333333, 367.0006, 368.0016], "recent_frames_sha256": "ef9e2a68cec1818ac9c2f99ab7c98b97d6e62c821cbe4a1c53f5d3a9b12275a6", "num_recent_frames": 30, "tq": 717442.124736791, "t1": 717448.88053435, "ta": 717448.88053435, "te": 717448.917252279, "first_response_s": 6.7557975590461865, "answer_total_s": 6.792515487992205, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_168_a246_q0", "video_id": 168, "time_stamp_s": 369, "ground_truth": "A", "raw_output": "A. A green fence.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "53e794b79a3ac15993669759587ce56c9e56f92adcbfc1bc4736b8d1cd4619e0", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Cyclist in black jersey rides solo, maintaining high cadence (188-193 rpm) through urban streets.  \n- Other cyclists appear ahead, including one in red jersey, suggesting competitive proximity.  \n- Roadside barriers and spectators line the route, with buildings and traffic lights visible in background.\n[60-90s] - Cyclist in blue jersey rides ahead, maintaining pace with group; distance marker shows 1570m.\n- Other riders follow closely, including one in orange jersey, navigating urban streets with traffic cones.\n- Road surface shows cracks; cyclists pass under a bridge with visible signage.\n[90-120s] - Cyclist in orange jersey rides ahead, maintaining steady pace with fluctuating speed (125-135 bpm) and cadence (182-178 rpm).  \n- Green barriers line the street, with spectators and urban buildings visible on either side.  \n- Distance marker increases from 1542m to 1502m, indicating progress along the route.\n[120-150s] - Cyclist maintains steady pace, averaging 177 rpm, as they navigate urban streets lined with spectators and barriers.\n- Distance increases from 1501m to 1465m, indicating a slight descent or course change, with speed fluctuating between 31-34 mph.\n- Road features include crosswalks, traffic signals, and buildings, with the cyclist approaching a \"National Championship\" archway.\n[150-180s] - Cyclist in orange jersey and black shorts rides ahead, maintaining steady pace with RPMs around 180-185.  \n- Road surface shows cracks and lane markings; buildings and green barriers line the route.  \n- On-screen metrics display distance (1460m–1420m) and cadence, with a map showing route progress.\n[180-210s] - Cyclist in black jersey rides through urban streets, passing buildings and spectators.  \n- On-screen metrics show power output, cadence, and distance, with a map indicating route progress.  \n- Other cyclists appear ahead, with one overtaking the main rider near a crosswalk.\n[210-240s] - Cyclist in black jersey rides ahead, maintaining steady pace with fluctuating speed (173-177 rpm) and elevation gain (338-358m).\n- Other cyclists, including one in orange jersey, ride closely behind, navigating urban streets with traffic lights and barriers.\n- Roadside signage and buildings, including a \"NATIONAL CHAMPIONS\" banner, indicate a competitive race environment.\n[240-270s] - Cyclist in orange jersey leads a group, maintaining high cadence (173-175 rpm) as they navigate a city street with traffic lights and buildings.\n- A cyclist in blue jersey follows closely, with a slight gap, while others trail behind, all riding in a tight formation.\n- The route map on screen shows a 28-mile distance with a 40% gradient, indicating a challenging urban course.\n[270-300s] - Cyclists in blue and black jerseys ride closely together, maintaining high cadence (167-168 rpm) as they navigate urban streets.\n- A green banner lines the roadside, with spectators visible on sidewalks, some holding flags or banners.\n- The route map on screen shows a 28-mile distance with a current position near 12,800 meters, indicating progress through a city environment.\n[300-330s] - Cyclist in blue jersey and orange bike leads group, maintaining high cadence (162-173 rpm) as they navigate urban streets.  \n- Race route map shows 12.2-12.5 km remaining, with 32-33% gradient and 91-94% power output displayed.  \n- Spectators line sidewalks behind white barriers, with buildings and traffic lights visible in background.\n[330-360s] - Cyclist in red jersey and black shorts maintains high cadence (177 rpm) while riding in a tight pack.\n- Group of cyclists navigates a street with buildings and traffic barriers, showing dynamic movement and close proximity.\n- On-screen display shows distance (1190m–1167m) and pace (27–30 mph) as the group progresses through the urban course.", "history_tokens": 971, "history_utf8_bytes": 3807, "recent_frame_times_s": [339.00596666666667, 340.00696666666664, 341.0079666666667, 342.00896666666665, 343.0099666666667, 344.01096666666666, 345.0119666666667, 346.01296666666667, 347.01396666666665, 348.0149666666667, 349.01596666666666, 350.00028333333336, 351.00128333333333, 352.0022833333333, 353.00328333333334, 354.0042833333333, 355.00528333333335, 356.00628333333333, 357.0072833333333, 358.00828333333334, 359.0092833333333, 360.01028333333335, 361.0112833333333, 362.01228333333336, 363.01328333333333, 364.0142833333333, 365.01528333333334, 366.0162833333333, 367.0006, 368.0016], "recent_frames_sha256": "ef9e2a68cec1818ac9c2f99ab7c98b97d6e62c821cbe4a1c53f5d3a9b12275a6", "num_recent_frames": 30, "tq": 717580.013643994, "t1": 717581.526853067, "ta": 717581.526853067, "te": 717581.750640136, "first_response_s": 1.5132090729894117, "answer_total_s": 1.7369961419608444, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 168, "content_group": "0e5d4b450f0b795446925d1e207512a505841728ac8d6118f95e34ca2c4d199a", "question": {"question_id": "sample_168_a247_q0", "video_id": 168, "video_path": "./videos/sample_168_real.mp4", "annotation_index": 247, "question_index": 0, "question": "Where is the cyclist with the orange socks located right now?", "options": ["A. To the right of the cameraman.", "B. Directly in front of the cameraman.", "C. To the left of the cameraman.", "D. Behind the cameraman."], "answer": "B", "time_stamp_s": 492, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [476, 496], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_168_a247_q0", "video_id": 168, "time_stamp_s": 492, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "db5437902d66528bcf7268ce7d1f717522e724a200f451d4ef42d8f566185ed5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [462.0121833333333, 463.01318333333336, 464.01418333333334, 465.0151833333333, 466.01618333333334, 467.0005, 468.0015, 469.0025, 470.0035, 471.0045, 472.0055, 473.0065, 474.0075, 475.0085, 476.0095, 477.0105, 478.0115, 479.0125, 480.0135, 481.0145, 482.0155, 483.0165, 484.00081666666665, 485.0018166666667, 486.00281666666666, 487.0038166666667, 488.00481666666667, 489.00581666666665, 490.0068166666667, 491.00781666666666], "recent_frames_sha256": "d64b87ec97bb145d080aea82b5ae66ab344e2a08645ac7dfc52199e4ef6ce648", "num_recent_frames": 30, "tq": 717448.93608685, "t1": 717461.669681549, "ta": 717461.669681549, "te": 717461.856559573, "first_response_s": 12.733594698947854, "answer_total_s": 12.920472722966224, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_168_a247_q0", "video_id": 168, "time_stamp_s": 492, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b5b1089bab5f5cbed610ace104bbbd7067830f7dea0e4f72a3ad69d386983e68", "condition_order": ["recent", "notes"], "memory": "[180-210s] - Cyclist in black jersey rides through urban streets, passing buildings and spectators.  \n- On-screen metrics show power output, cadence, and distance, with a map indicating route progress.  \n- Other cyclists appear ahead, with one overtaking the main rider near a crosswalk.\n[210-240s] - Cyclist in black jersey rides ahead, maintaining steady pace with fluctuating speed (173-177 rpm) and elevation gain (338-358m).\n- Other cyclists, including one in orange jersey, ride closely behind, navigating urban streets with traffic lights and barriers.\n- Roadside signage and buildings, including a \"NATIONAL CHAMPIONS\" banner, indicate a competitive race environment.\n[240-270s] - Cyclist in orange jersey leads a group, maintaining high cadence (173-175 rpm) as they navigate a city street with traffic lights and buildings.\n- A cyclist in blue jersey follows closely, with a slight gap, while others trail behind, all riding in a tight formation.\n- The route map on screen shows a 28-mile distance with a 40% gradient, indicating a challenging urban course.\n[270-300s] - Cyclists in blue and black jerseys ride closely together, maintaining high cadence (167-168 rpm) as they navigate urban streets.\n- A green banner lines the roadside, with spectators visible on sidewalks, some holding flags or banners.\n- The route map on screen shows a 28-mile distance with a current position near 12,800 meters, indicating progress through a city environment.\n[300-330s] - Cyclist in blue jersey and orange bike leads group, maintaining high cadence (162-173 rpm) as they navigate urban streets.  \n- Race route map shows 12.2-12.5 km remaining, with 32-33% gradient and 91-94% power output displayed.  \n- Spectators line sidewalks behind white barriers, with buildings and traffic lights visible in background.\n[330-360s] - Cyclist in red jersey and black shorts maintains high cadence (177 rpm) while riding in a tight pack.\n- Group of cyclists navigates a street with buildings and traffic barriers, showing dynamic movement and close proximity.\n- On-screen display shows distance (1190m–1167m) and pace (27–30 mph) as the group progresses through the urban course.\n[360-390s] - Cyclist in white jersey and black shorts leans forward, pedaling vigorously on a road with urban buildings on either side.\n- Group of cyclists ahead, including one in red jersey, maintains a tight formation while navigating a street with traffic lights and spectators.\n- On-screen metrics show speed fluctuating between 28–33 mph, heart rate around 175–178 bpm, and distance covered increasing from 11,168 to 11,218 meters.\n[390-420s] - Cyclist in black jersey and shorts maintains high cadence (173-182 rpm) while riding a white bike through urban streets.  \n- Group of cyclists ahead, including one in purple jersey, navigates a turn near a building with a \"V\" logo banner.  \n- On-screen metrics show distance decreasing from 1115m to 1076m, with speed fluctuating between 32-53 mph and heart rate around 170-180 bpm.\n[420-450s] - Cyclist in purple jersey leads group, maintaining high cadence (178-188 rpm) while navigating urban streets.\n- Group rides past buildings and intersections, with a green barrier visible on the right side of the road.\n- Distance marker shows progression from 10689m to 10336m, indicating a steady descent or flat section.\n[450-480s] - Cyclist in blue jersey leads group, maintaining steady pace with 174 rpm cadence.  \n- Right-side spectator barrier shows green tape, with crowd watching from sidewalk.  \n- Distance marker decreases from 1020m to 990m as group navigates urban street.", "history_tokens": 946, "history_utf8_bytes": 3604, "recent_frame_times_s": [462.0121833333333, 463.01318333333336, 464.01418333333334, 465.0151833333333, 466.01618333333334, 467.0005, 468.0015, 469.0025, 470.0035, 471.0045, 472.0055, 473.0065, 474.0075, 475.0085, 476.0095, 477.0105, 478.0115, 479.0125, 480.0135, 481.0145, 482.0155, 483.0165, 484.00081666666665, 485.0018166666667, 486.00281666666666, 487.0038166666667, 488.00481666666667, 489.00581666666665, 490.0068166666667, 491.00781666666666], "recent_frames_sha256": "d64b87ec97bb145d080aea82b5ae66ab344e2a08645ac7dfc52199e4ef6ce648", "num_recent_frames": 30, "tq": 717617.661967794, "t1": 717624.641626341, "ta": 717624.641626341, "te": 717624.946489342, "first_response_s": 6.9796585470903665, "answer_total_s": 7.284521548077464, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 169, "content_group": "5125616b4cf1c0d51623b39b52f155c05016f417284f4c0ba7a04f23a8b302f7", "question": {"question_id": "sample_169_a1645_q0", "video_id": 169, "video_path": "./videos/sample_169_real.mp4", "annotation_index": 1645, "question_index": 0, "question": "What is located to the right side of the road right now?", "options": ["A. A gas station.", "B. A bank.", "C. A park.", "D. A cafe."], "answer": "D", "time_stamp_s": 20, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_169_a1645_q0", "video_id": 169, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8bd7d3c4b0201b741a60f8bf02892b9504443fa4e79b10fef9a086650f9c8919", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.033, 1.0006333333333333, 2.0016333333333334, 3.0026333333333333, 4.003633333333333, 5.0046333333333335, 6.005633333333333, 7.006633333333333, 8.007633333333333, 9.008633333333334, 10.009633333333333, 11.010633333333333, 12.011633333333334, 13.012633333333333, 14.013633333333333, 15.014633333333334, 16.015633333333334, 17.016633333333335, 18.017633333333333, 19.018633333333334], "recent_frames_sha256": "98a73ac9a851705d2c0dda0bcccd5e7bf6b992446eedd48029cc5a70d9bb449f", "num_recent_frames": 20, "tq": 710315.600666546, "t1": 710326.210700371, "ta": 710326.210700371, "te": 710326.248875044, "first_response_s": 10.610033824923448, "answer_total_s": 10.64820849802345, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_169_a1645_q0", "video_id": 169, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "469ebb24d689f0511bc96680d096b509fe2236009c356b68e916676e217bfe80", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.033, 1.0006333333333333, 2.0016333333333334, 3.0026333333333333, 4.003633333333333, 5.0046333333333335, 6.005633333333333, 7.006633333333333, 8.007633333333333, 9.008633333333334, 10.009633333333333, 11.010633333333333, 12.011633333333334, 13.012633333333333, 14.013633333333333, 15.014633333333334, 16.015633333333334, 17.016633333333335, 18.017633333333333, 19.018633333333334], "recent_frames_sha256": "98a73ac9a851705d2c0dda0bcccd5e7bf6b992446eedd48029cc5a70d9bb449f", "num_recent_frames": 20, "tq": 710142.110661671, "t1": 710151.645792765, "ta": 710151.645792765, "te": 710151.860824554, "first_response_s": 9.535131093929522, "answer_total_s": 9.750162882963195, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 169, "content_group": "5125616b4cf1c0d51623b39b52f155c05016f417284f4c0ba7a04f23a8b302f7", "question": {"question_id": "sample_169_a1646_q0", "video_id": 169, "video_path": "./videos/sample_169_real.mp4", "annotation_index": 1646, "question_index": 0, "question": "What are the main colors of the flowers in the hanging baskets right now?", "options": ["A. Green and black.", "B. Red and pink.", "C. Red and blue.", "D. White, yellow and purple."], "answer": "D", "time_stamp_s": 134, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [133, 153], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_169_a1646_q0", "video_id": 169, "time_stamp_s": 134, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c62e5c88d051927f2c4d5d42a332104a4e1e5d09c5e599505f60ead07f8eba7d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [104.00353333333334, 105.00453333333333, 106.00553333333333, 107.00653333333334, 108.00753333333333, 109.00853333333333, 110.00953333333334, 111.01053333333333, 112.01153333333333, 113.01253333333334, 114.01353333333333, 115.01453333333333, 116.01553333333334, 117.01653333333333, 118.01753333333333, 119.01853333333334, 120.01953333333333, 121.02053333333333, 122.02153333333334, 123.02253333333333, 124.02353333333333, 125.02453333333334, 126.02553333333333, 127.02653333333333, 128.02753333333334, 129.02853333333334, 130.02953333333335, 131.03053333333332, 132.03153333333333, 133.03253333333333], "recent_frames_sha256": "e146c8ce90053dd386fc8c5bab2ebcf453c42d13f5f7f0804aaf5be7bd4fc764", "num_recent_frames": 30, "tq": 710326.255096652, "t1": 710336.133658695, "ta": 710336.133658695, "te": 710336.170727862, "first_response_s": 9.878562043071724, "answer_total_s": 9.91563121008221, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_169_a1646_q0", "video_id": 169, "time_stamp_s": 134, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "926c728105a9953414552aff585fc92bef47f6fd0e9daff2cd7ec3f7604322b2", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A white van passes on the left, followed by a silver car, both moving in the same direction as the camera vehicle.  \n- The camera vehicle approaches a gas station with a \"One\" sign, then continues past residential buildings with varied colors and designs.  \n- The speedometer fluctuates between 25 and 83 km/h, while the route distance increases from 41.5 km to 41.8 km, and the elevation gain remains steady at -1% to -2%.\n[30-60s] - Road speed fluctuates between 41-84 km/h as vehicle navigates residential streets and intersections.\n- Temperature remains steady at 36°C, with a map overlay showing route progress toward Hohne.\n- Vehicle passes buildings, parked cars, and roadside trees under clear blue skies.\n[60-90s] - Cyclist passes a red-brick building with a clock tower under clear blue sky.  \n- Road surface shows slight incline (1% grade) with speed fluctuating between 24–27 km/h.  \n- Right-side street signs indicate \"Höhen\" and \"Höhenstraße\" as cyclist proceeds through urban area.\n[90-120s] - A white car approaches from the opposite direction, slowing down as it nears the intersection.  \n- A black SUV is parked on the right side of the road, stationary near a building with a sign.  \n- The cyclist’s speed fluctuates between 15 and 28 km/h, with the distance traveled increasing from 42.3 km to 42.6 km.", "history_tokens": 351, "history_utf8_bytes": 1340, "recent_frame_times_s": [104.00353333333334, 105.00453333333333, 106.00553333333333, 107.00653333333334, 108.00753333333333, 109.00853333333333, 110.00953333333334, 111.01053333333333, 112.01153333333333, 113.01253333333334, 114.01353333333333, 115.01453333333333, 116.01553333333334, 117.01653333333333, 118.01753333333333, 119.01853333333334, 120.01953333333333, 121.02053333333333, 122.02153333333334, 123.02253333333333, 124.02353333333333, 125.02453333333334, 126.02553333333333, 127.02653333333333, 128.02753333333334, 129.02853333333334, 130.02953333333335, 131.03053333333332, 132.03153333333333, 133.03253333333333], "recent_frames_sha256": "e146c8ce90053dd386fc8c5bab2ebcf453c42d13f5f7f0804aaf5be7bd4fc764", "num_recent_frames": 30, "tq": 710186.155017797, "t1": 710187.481614602, "ta": 710187.481614602, "te": 710187.815963848, "first_response_s": 1.3265968050109223, "answer_total_s": 1.660946051008068, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 169, "content_group": "5125616b4cf1c0d51623b39b52f155c05016f417284f4c0ba7a04f23a8b302f7", "question": {"question_id": "sample_169_a1647_q0", "video_id": 169, "video_path": "./videos/sample_169_real.mp4", "annotation_index": 1647, "question_index": 0, "question": "Where are the kayaks located right now?", "options": ["A. On the right side of the road.", "B. On the left side of the road.", "C. On the grass beside the path.", "D. Docked at the shore."], "answer": "B", "time_stamp_s": 280, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [266, 286], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_169_a1647_q0", "video_id": 169, "time_stamp_s": 280, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e383514bc773497c61447a76cc96ecbc8c374753aabfda27f73f71e0a5b881c3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [250.01606666666666, 251.01706666666666, 252.01806666666667, 253.01906666666667, 254.02006666666668, 255.02106666666666, 256.02206666666666, 257.0230666666667, 258.02406666666667, 259.02506666666665, 260.0260666666667, 261.02706666666666, 262.0280666666667, 263.02906666666667, 264.03006666666664, 265.0310666666667, 266.03206666666665, 267.0330666666667, 268.0007, 269.0017, 270.0027, 271.0037, 272.0047, 273.0057, 274.0067, 275.0077, 276.0087, 277.0097, 278.0107, 279.0117], "recent_frames_sha256": "40911168c5bf5d32aefa9e33695eebae119b70e23d3087c7ac6c03526d94fa2a", "num_recent_frames": 30, "tq": 710336.177331983, "t1": 710347.657995861, "ta": 710347.657995861, "te": 710347.695322725, "first_response_s": 11.480663878028281, "answer_total_s": 11.517990741995163, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_169_a1647_q0", "video_id": 169, "time_stamp_s": 280, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "74e11f3e06607332234b975f5311d9a0d60d6d37ba3931668f1116921ceba64e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A white van passes on the left, followed by a silver car, both moving in the same direction as the camera vehicle.  \n- The camera vehicle approaches a gas station with a \"One\" sign, then continues past residential buildings with varied colors and designs.  \n- The speedometer fluctuates between 25 and 83 km/h, while the route distance increases from 41.5 km to 41.8 km, and the elevation gain remains steady at -1% to -2%.\n[30-60s] - Road speed fluctuates between 41-84 km/h as vehicle navigates residential streets and intersections.\n- Temperature remains steady at 36°C, with a map overlay showing route progress toward Hohne.\n- Vehicle passes buildings, parked cars, and roadside trees under clear blue skies.\n[60-90s] - Cyclist passes a red-brick building with a clock tower under clear blue sky.  \n- Road surface shows slight incline (1% grade) with speed fluctuating between 24–27 km/h.  \n- Right-side street signs indicate \"Höhen\" and \"Höhenstraße\" as cyclist proceeds through urban area.\n[90-120s] - A white car approaches from the opposite direction, slowing down as it nears the intersection.  \n- A black SUV is parked on the right side of the road, stationary near a building with a sign.  \n- The cyclist’s speed fluctuates between 15 and 28 km/h, with the distance traveled increasing from 42.3 km to 42.6 km.\n[120-150s] - A red car is seen driving on the right side of the road, moving away from the camera.  \n- The cyclist's speed fluctuates between 22 and 70 km/h as they navigate a bridge with metal railings.  \n- A blue flag is visible on a pole on the left side of the bridge, fluttering in the wind.\n[150-180s] - Camera pans left, revealing a bridge spanning the river with vehicles passing underneath.  \n- The path continues along the riverbank, flanked by trees and buildings, with a speedometer showing increasing speed.  \n- A map overlay on the right indicates the route and current location, with temperature and distance metrics displayed.\n[180-210s] - Cyclist approaches a stone arch bridge, passing under it with river visible below.  \n- Pedestrian couple walks along the path on the right, moving away from camera.  \n- Riverbank scenery includes trees, buildings, and a distant amusement park ride.\n[210-240s] - Riverbank path with trees and a stone wall on right, boats visible on water.\n- Ferris wheel structure appears in distance on right, partially obscured by trees.\n- On-screen display shows speed fluctuating between 24-28 km/h, elevation gain of 0%, and distance increasing to 43.2 km.\n[240-270s] - Riverbank path with stone wall on right, trees on left, cyclist moving forward.\n- On-screen display shows speed decreasing from 78 to 74, elevation gain increasing from 0% to 1%, distance increasing from 43.3 to 43.6 km.\n- Map overlay on right indicates location near a town, with temperature at 34°C.", "history_tokens": 739, "history_utf8_bytes": 2857, "recent_frame_times_s": [250.01606666666666, 251.01706666666666, 252.01806666666667, 253.01906666666667, 254.02006666666668, 255.02106666666666, 256.02206666666666, 257.0230666666667, 258.02406666666667, 259.02506666666665, 260.0260666666667, 261.02706666666666, 262.0280666666667, 263.02906666666667, 264.03006666666664, 265.0310666666667, 266.03206666666665, 267.0330666666667, 268.0007, 269.0017, 270.0027, 271.0037, 272.0047, 273.0057, 274.0067, 275.0077, 276.0087, 277.0097, 278.0107, 279.0117], "recent_frames_sha256": "40911168c5bf5d32aefa9e33695eebae119b70e23d3087c7ac6c03526d94fa2a", "num_recent_frames": 30, "tq": 710225.790558838, "t1": 710227.782350978, "ta": 710227.782350978, "te": 710227.828134234, "first_response_s": 1.991792139946483, "answer_total_s": 2.037575395894237, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 169, "content_group": "5125616b4cf1c0d51623b39b52f155c05016f417284f4c0ba7a04f23a8b302f7", "question": {"question_id": "sample_169_a1648_q0", "video_id": 169, "video_path": "./videos/sample_169_real.mp4", "annotation_index": 1648, "question_index": 0, "question": "What is located on the left side of the cyclist right now?", "options": ["A. A field.", "B. A canal.", "C. A dense forest.", "D. A building."], "answer": "B", "time_stamp_s": 409, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [399, 419], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_169_a1648_q0", "video_id": 169, "time_stamp_s": 409, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9aa115781b53a9d4865e1e4fbf870a2b894690a22869403648c4e2b6e0ce0400", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [379.0116, 380.0126, 381.0136, 382.0146, 383.0156, 384.0166, 385.0176, 386.0186, 387.0196, 388.0206, 389.0216, 390.0226, 391.0236, 392.0246, 393.0256, 394.0266, 395.0276, 396.0286, 397.0296, 398.0306, 399.0316, 400.0326, 401.0002333333333, 402.00123333333335, 403.0022333333333, 404.00323333333336, 405.00423333333333, 406.0052333333333, 407.00623333333334, 408.0072333333333], "recent_frames_sha256": "ff899f78bceb271ac1884662bb7a9cbe8080604d5c61bab0956870917e67c79e", "num_recent_frames": 30, "tq": 710347.701712441, "t1": 710355.2426855, "ta": 710355.2426855, "te": 710355.280089544, "first_response_s": 7.540973058901727, "answer_total_s": 7.578377102967352, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_169_a1648_q0", "video_id": 169, "time_stamp_s": 409, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7a74e07fabe830dc05cbb932894482b7f5d4c42876beb3ce08adb27fa82342ae", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Road speed fluctuates between 41-84 km/h as vehicle navigates residential streets and intersections.\n- Temperature remains steady at 36°C, with a map overlay showing route progress toward Hohne.\n- Vehicle passes buildings, parked cars, and roadside trees under clear blue skies.\n[60-90s] - Cyclist passes a red-brick building with a clock tower under clear blue sky.  \n- Road surface shows slight incline (1% grade) with speed fluctuating between 24–27 km/h.  \n- Right-side street signs indicate \"Höhen\" and \"Höhenstraße\" as cyclist proceeds through urban area.\n[90-120s] - A white car approaches from the opposite direction, slowing down as it nears the intersection.  \n- A black SUV is parked on the right side of the road, stationary near a building with a sign.  \n- The cyclist’s speed fluctuates between 15 and 28 km/h, with the distance traveled increasing from 42.3 km to 42.6 km.\n[120-150s] - A red car is seen driving on the right side of the road, moving away from the camera.  \n- The cyclist's speed fluctuates between 22 and 70 km/h as they navigate a bridge with metal railings.  \n- A blue flag is visible on a pole on the left side of the bridge, fluttering in the wind.\n[150-180s] - Camera pans left, revealing a bridge spanning the river with vehicles passing underneath.  \n- The path continues along the riverbank, flanked by trees and buildings, with a speedometer showing increasing speed.  \n- A map overlay on the right indicates the route and current location, with temperature and distance metrics displayed.\n[180-210s] - Cyclist approaches a stone arch bridge, passing under it with river visible below.  \n- Pedestrian couple walks along the path on the right, moving away from camera.  \n- Riverbank scenery includes trees, buildings, and a distant amusement park ride.\n[210-240s] - Riverbank path with trees and a stone wall on right, boats visible on water.\n- Ferris wheel structure appears in distance on right, partially obscured by trees.\n- On-screen display shows speed fluctuating between 24-28 km/h, elevation gain of 0%, and distance increasing to 43.2 km.\n[240-270s] - Riverbank path with stone wall on right, trees on left, cyclist moving forward.\n- On-screen display shows speed decreasing from 78 to 74, elevation gain increasing from 0% to 1%, distance increasing from 43.3 to 43.6 km.\n- Map overlay on right indicates location near a town, with temperature at 34°C.\n[270-300s] - A cyclist rides along a paved path beside a canal, with a speedometer showing 75 km/h and a distance of 43.5 km.\n- A small boat is visible on the canal, moving away from the camera.\n- The path curves slightly to the right, passing under a bridge with a stone wall on the right side.\n[300-330s] - River flows alongside a paved path under clear blue sky, with a concrete wall and buildings on the right.  \n- A bridge spans the river ahead, and the path curves slightly to the right.  \n- On-screen data shows speed fluctuating between 74–75 km/h, distance at 43.7 km, and temperature at 34°C.\n[330-360s] - Cyclist approaches a concrete bridge spanning a calm river, with lush green trees lining both banks.\n- The route display shows increasing distance (43.9 KM to 44.0 KM) and slightly rising elevation (0% to 1% grade).\n- A map overlay on the right indicates the cyclist’s position along a route marked in purple, with a temperature of 30°C.\n[360-390s] - Cyclist rides along a paved path beside a canal, passing moored boats and a concrete wall with graffiti.  \n- The route transitions from a residential street to a canal-side path, with the cyclist maintaining a steady pace.  \n- On-screen data shows a 1% incline, 73 minutes elapsed, and 44.1 km distance covered, with temperature at 20°C.", "history_tokens": 978, "history_utf8_bytes": 3735, "recent_frame_times_s": [379.0116, 380.0126, 381.0136, 382.0146, 383.0156, 384.0166, 385.0176, 386.0186, 387.0196, 388.0206, 389.0216, 390.0226, 391.0236, 392.0246, 393.0256, 394.0266, 395.0276, 396.0286, 397.0296, 398.0306, 399.0316, 400.0326, 401.0002333333333, 402.00123333333335, 403.0022333333333, 404.00323333333336, 405.00423333333333, 406.0052333333333, 407.00623333333334, 408.0072333333333], "recent_frames_sha256": "ff899f78bceb271ac1884662bb7a9cbe8080604d5c61bab0956870917e67c79e", "num_recent_frames": 30, "tq": 710252.888100536, "t1": 710260.01909596, "ta": 710260.01909596, "te": 710260.057784677, "first_response_s": 7.130995423998684, "answer_total_s": 7.169684141059406, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 169, "content_group": "5125616b4cf1c0d51623b39b52f155c05016f417284f4c0ba7a04f23a8b302f7", "question": {"question_id": "sample_169_a1649_q0", "video_id": 169, "video_path": "./videos/sample_169_real.mp4", "annotation_index": 1649, "question_index": 0, "question": "What is located on the left side of the path right now?", "options": ["A. A river.", "B. A line of trees.", "C. A building.", "D. A field."], "answer": "B", "time_stamp_s": 551, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [532, 552], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_169_a1649_q0", "video_id": 169, "time_stamp_s": 551, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8cfabdb1fa891584bb17efffb9c8787d8d15c505f9f415405ded3efe6ac4b3cc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [521.0201333333333, 522.0211333333333, 523.0221333333334, 524.0231333333334, 525.0241333333333, 526.0251333333333, 527.0261333333333, 528.0271333333334, 529.0281333333334, 530.0291333333333, 531.0301333333333, 532.0311333333333, 533.0321333333334, 534.0331333333334, 535.0007666666667, 536.0017666666666, 537.0027666666666, 538.0037666666667, 539.0047666666667, 540.0057666666667, 541.0067666666666, 542.0077666666666, 543.0087666666667, 544.0097666666667, 545.0107666666667, 546.0117666666666, 547.0127666666667, 548.0137666666667, 549.0147666666667, 550.0157666666667], "recent_frames_sha256": "90460ece8d7c2c2b482ec9008e562e9b22e66863d8e0cb2c1be92e81d8c5de32", "num_recent_frames": 30, "tq": 710355.293079622, "t1": 710366.329060174, "ta": 710366.329060174, "te": 710366.366856383, "first_response_s": 11.03598055196926, "answer_total_s": 11.073776761069894, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_169_a1649_q0", "video_id": 169, "time_stamp_s": 551, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0454b37cb8a7f4fd170738bf73ddd358c9a08601465420f845f6ca281d91121c", "condition_order": ["notes", "recent"], "memory": "[180-210s] - Cyclist approaches a stone arch bridge, passing under it with river visible below.  \n- Pedestrian couple walks along the path on the right, moving away from camera.  \n- Riverbank scenery includes trees, buildings, and a distant amusement park ride.\n[210-240s] - Riverbank path with trees and a stone wall on right, boats visible on water.\n- Ferris wheel structure appears in distance on right, partially obscured by trees.\n- On-screen display shows speed fluctuating between 24-28 km/h, elevation gain of 0%, and distance increasing to 43.2 km.\n[240-270s] - Riverbank path with stone wall on right, trees on left, cyclist moving forward.\n- On-screen display shows speed decreasing from 78 to 74, elevation gain increasing from 0% to 1%, distance increasing from 43.3 to 43.6 km.\n- Map overlay on right indicates location near a town, with temperature at 34°C.\n[270-300s] - A cyclist rides along a paved path beside a canal, with a speedometer showing 75 km/h and a distance of 43.5 km.\n- A small boat is visible on the canal, moving away from the camera.\n- The path curves slightly to the right, passing under a bridge with a stone wall on the right side.\n[300-330s] - River flows alongside a paved path under clear blue sky, with a concrete wall and buildings on the right.  \n- A bridge spans the river ahead, and the path curves slightly to the right.  \n- On-screen data shows speed fluctuating between 74–75 km/h, distance at 43.7 km, and temperature at 34°C.\n[330-360s] - Cyclist approaches a concrete bridge spanning a calm river, with lush green trees lining both banks.\n- The route display shows increasing distance (43.9 KM to 44.0 KM) and slightly rising elevation (0% to 1% grade).\n- A map overlay on the right indicates the cyclist’s position along a route marked in purple, with a temperature of 30°C.\n[360-390s] - Cyclist rides along a paved path beside a canal, passing moored boats and a concrete wall with graffiti.  \n- The route transitions from a residential street to a canal-side path, with the cyclist maintaining a steady pace.  \n- On-screen data shows a 1% incline, 73 minutes elapsed, and 44.1 km distance covered, with temperature at 20°C.\n[390-420s] - A paved path runs alongside a calm canal, bordered by greenery and occasional houses.  \n- A large concrete bridge with multiple arches spans the canal, appearing ahead as the path curves toward it.  \n- The cyclist’s speed fluctuates between 24–78 km/h, with a steady incline of 1% as they approach the bridge.\n[420-450s] - Cyclist enters a tunnel with stone arches, transitioning from bright daylight to dimmer interior lighting.\n- After exiting the tunnel, the cyclist rides along a paved path beside a calm river, flanked by green railings and trees.\n- A large brick building stands on the left, while residential structures and a road with a white van are visible on the right.\n[450-480s] - The cyclist's speed fluctuates between 73 and 75 km/h, with a slight incline (1%) appearing around 458 seconds.\n- The route map on the right shows a white outline of the UK, with a path indicating the cyclist's current position.\n- The temperature remains at 20°C, and the total distance covered is 44.7 km, with the time displayed as 73:14 min.\n[480-510s] - Speedometer shows decreasing speed from 75 to 73 km/h, indicating deceleration.\n- Distance counter increases from 44.9 to 45.1 km, suggesting forward motion.\n- Right-side canal remains visible, with trees lining the path and a clear sky overhead.\n[510-540s] - Road surface shows slight incline (0% to 1%) with distance increasing from 45.1 km to 45.2 km.\n- Left side of path lined with dense green trees, right side bordered by calm waterway.\n- On-screen display shows temperature at 20°C and a map outline of the UK with a route marker.", "history_tokens": 1013, "history_utf8_bytes": 3794, "recent_frame_times_s": [521.0201333333333, 522.0211333333333, 523.0221333333334, 524.0231333333334, 525.0241333333333, 526.0251333333333, 527.0261333333333, 528.0271333333334, 529.0281333333334, 530.0291333333333, 531.0301333333333, 532.0311333333333, 533.0321333333334, 534.0331333333334, 535.0007666666667, 536.0017666666666, 537.0027666666666, 538.0037666666667, 539.0047666666667, 540.0057666666667, 541.0067666666666, 542.0077666666666, 543.0087666666667, 544.0097666666667, 545.0107666666667, 546.0117666666666, 547.0127666666667, 548.0137666666667, 549.0147666666667, 550.0157666666667], "recent_frames_sha256": "90460ece8d7c2c2b482ec9008e562e9b22e66863d8e0cb2c1be92e81d8c5de32", "num_recent_frames": 30, "tq": 710308.491370679, "t1": 710315.369030264, "ta": 710315.369030264, "te": 710315.559540493, "first_response_s": 6.877659584977664, "answer_total_s": 7.068169813952409, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 170, "content_group": "15036ee2d81d9c6de3ca7893d27d27d125a9a1a56c3353a57a946509a666d84d", "question": {"question_id": "sample_170_a1939_q0", "video_id": 170, "video_path": "./videos/sample_170_real.mp4", "annotation_index": 1939, "question_index": 0, "question": "What is on the left side of the road right now?", "options": ["A. A clear field.", "B. A group of houses.", "C. A river.", "D. A line of trees."], "answer": "D", "time_stamp_s": 10, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_170_a1939_q0", "video_id": 170, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "11dcb4fbb07c8aabd31ad14d1cb4d8f7bcb7a6c94683fec984d5378f51da92c3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.045, 1.0126333333333333, 2.0136333333333334, 3.0146333333333333, 4.015633333333334, 5.016633333333333, 6.017633333333333, 7.018633333333334, 8.019633333333333, 9.020633333333333], "recent_frames_sha256": "e3b8731f81a3fcc26a4e99bceb19626653e651d1c8d85d59e786ebfd01bbe045", "num_recent_frames": 10, "tq": 717367.994639002, "t1": 717379.704790005, "ta": 717379.704790005, "te": 717379.74745209, "first_response_s": 11.71015100297518, "answer_total_s": 11.752813088009134, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_170_a1939_q0", "video_id": 170, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cfaa28f319482ec8edb4bf997e5d8165b3fec39c0ddd4543f8dea79d7755e159", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.045, 1.0126333333333333, 2.0136333333333334, 3.0146333333333333, 4.015633333333334, 5.016633333333333, 6.017633333333333, 7.018633333333334, 8.019633333333333, 9.020633333333333], "recent_frames_sha256": "e3b8731f81a3fcc26a4e99bceb19626653e651d1c8d85d59e786ebfd01bbe045", "num_recent_frames": 10, "tq": 717421.930152159, "t1": 717427.905929856, "ta": 717427.905929856, "te": 717428.206310451, "first_response_s": 5.975777697050944, "answer_total_s": 6.276158292079344, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 170, "content_group": "15036ee2d81d9c6de3ca7893d27d27d125a9a1a56c3353a57a946509a666d84d", "question": {"question_id": "sample_170_a1940_q0", "video_id": 170, "video_path": "./videos/sample_170_real.mp4", "annotation_index": 1940, "question_index": 0, "question": "Where is the nearest dense row of trees located right now?", "options": ["A. On the right side of the road.", "B. On both sides of the road.", "C. In the distance ahead.", "D. On the left side of the road."], "answer": "D", "time_stamp_s": 150, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [138, 158], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_170_a1940_q0", "video_id": 170, "time_stamp_s": 150, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "29576b73f772c8d30d3560cb04932153bdc50904d4bf73a9a737f8dc5e8f207b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [120.03153333333333, 121.03253333333333, 122.00016666666667, 123.00116666666666, 124.00216666666667, 125.00316666666667, 126.00416666666666, 127.00516666666667, 128.00616666666667, 129.00716666666668, 130.00816666666665, 131.00916666666666, 132.01016666666666, 133.01116666666667, 134.01216666666667, 135.01316666666668, 136.01416666666665, 137.01516666666666, 138.01616666666666, 139.01716666666667, 140.01816666666667, 141.01916666666668, 142.02016666666665, 143.02116666666666, 144.02216666666666, 145.02316666666667, 146.02416666666667, 147.02516666666668, 148.02616666666665, 149.02716666666666], "recent_frames_sha256": "f3331dd743fd56bc796c0643f23e4754e9b9171e95a4bcb991fe0a8b940ac0a2", "num_recent_frames": 30, "tq": 717379.769967503, "t1": 717391.143639569, "ta": 717391.143639569, "te": 717391.181074947, "first_response_s": 11.373672066023573, "answer_total_s": 11.41110744397156, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_170_a1940_q0", "video_id": 170, "time_stamp_s": 150, "ground_truth": "D", "raw_output": "A. On the right side of the road.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "10884656214d0cc0c034231cdbb1dc84d218d681dc8ec2164129e3b373e1842a", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A cyclist rides along a paved forest path, with a digital display showing speed, elevation, distance, and temperature.  \n- The path curves gently through dense green trees, with sunlight filtering through the canopy.  \n- A map overlay on the right indicates location and route, with a blue dot tracking progress.\n[30-60s] - Road slopes gently upward, transitioning from flat to slightly uphill terrain as cyclist approaches village.\n- Left side reveals houses and green fields, while right side is dense forest, with road curving ahead.\n- On-screen data shows increasing distance (18.0 KM to 19.1 KM) and time (77 MIN to 85 MIN), with temperature at 20°C.\n[60-90s] - Road transitions from narrow forest path to wider residential street with houses lining both sides.  \n- Speed fluctuates between 24–30 km/h as the cyclist navigates through the neighborhood.  \n- On-screen display shows distance increasing from 10.2 km to 10.4 km, with temperature at 23°C.\n[90-120s] - Cyclist approaches a roundabout with a red bicycle lane marking, turning right onto a new road segment.  \n- A blue car is visible parked on the left side of the road, near a building with a sloped roof.  \n- The GPS overlay shows a route map with a white line indicating the path, and the current speed is around 24-32 km/h.\n[120-150s] - Road speed fluctuates between 23–78 km/h as cyclist navigates through residential and rural landscapes.  \n- Temperature remains steady at 30°C, with a map overlay indicating current location near a rural area.  \n- Terrain transitions from paved streets to gravel paths, with elevation changes shown as -1% to +3%.", "history_tokens": 405, "history_utf8_bytes": 1636, "recent_frame_times_s": [120.03153333333333, 121.03253333333333, 122.00016666666667, 123.00116666666666, 124.00216666666667, 125.00316666666667, 126.00416666666666, 127.00516666666667, 128.00616666666667, 129.00716666666668, 130.00816666666665, 131.00916666666666, 132.01016666666666, 133.01116666666667, 134.01216666666667, 135.01316666666668, 136.01416666666665, 137.01516666666666, 138.01616666666666, 139.01716666666667, 140.01816666666667, 141.01916666666668, 142.02016666666665, 143.02116666666666, 144.02216666666666, 145.02316666666667, 146.02416666666667, 147.02516666666668, 148.02616666666665, 149.02716666666666], "recent_frames_sha256": "f3331dd743fd56bc796c0643f23e4754e9b9171e95a4bcb991fe0a8b940ac0a2", "num_recent_frames": 30, "tq": 717458.691284335, "t1": 717460.440360337, "ta": 717460.440360337, "te": 717460.853091907, "first_response_s": 1.7490760020446032, "answer_total_s": 2.161807572003454, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 170, "content_group": "15036ee2d81d9c6de3ca7893d27d27d125a9a1a56c3353a57a946509a666d84d", "question": {"question_id": "sample_170_a1941_q0", "video_id": 170, "video_path": "./videos/sample_170_real.mp4", "annotation_index": 1941, "question_index": 0, "question": "Where is the wooden bench?", "options": ["A. On the left side of the road.", "B. Directly ahead.", "C. There is no bench.", "D. On the right side of the road."], "answer": "D", "time_stamp_s": 288, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [276, 296], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_170_a1941_q0", "video_id": 170, "time_stamp_s": 288, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1447b30308060bcc2e828101716667d195a7d4c1603c36b6a1f092fd938a1de3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [258.0027, 259.0037, 260.0047, 261.0057, 262.0067, 263.0077, 264.0087, 265.0097, 266.0107, 267.0117, 268.0127, 269.0137, 270.0147, 271.0157, 272.0167, 273.0177, 274.0187, 275.0197, 276.0207, 277.0217, 278.0227, 279.0237, 280.0247, 281.0257, 282.0267, 283.0277, 284.0287, 285.0297, 286.0307, 287.0317], "recent_frames_sha256": "2493055c7875f6329d4fc127b4ffd7a47c51818d57222ae72ade2be318ac5de1", "num_recent_frames": 30, "tq": 717391.195133133, "t1": 717401.721144777, "ta": 717401.721144777, "te": 717401.760680533, "first_response_s": 10.526011644047685, "answer_total_s": 10.565547400037758, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_170_a1941_q0", "video_id": 170, "time_stamp_s": 288, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d91c33f6c7506e8a1e566d5cf7b96d94aeed685df47fd05cf9dcf5ea8f8929fd", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A cyclist rides along a paved forest path, with a digital display showing speed, elevation, distance, and temperature.  \n- The path curves gently through dense green trees, with sunlight filtering through the canopy.  \n- A map overlay on the right indicates location and route, with a blue dot tracking progress.\n[30-60s] - Road slopes gently upward, transitioning from flat to slightly uphill terrain as cyclist approaches village.\n- Left side reveals houses and green fields, while right side is dense forest, with road curving ahead.\n- On-screen data shows increasing distance (18.0 KM to 19.1 KM) and time (77 MIN to 85 MIN), with temperature at 20°C.\n[60-90s] - Road transitions from narrow forest path to wider residential street with houses lining both sides.  \n- Speed fluctuates between 24–30 km/h as the cyclist navigates through the neighborhood.  \n- On-screen display shows distance increasing from 10.2 km to 10.4 km, with temperature at 23°C.\n[90-120s] - Cyclist approaches a roundabout with a red bicycle lane marking, turning right onto a new road segment.  \n- A blue car is visible parked on the left side of the road, near a building with a sloped roof.  \n- The GPS overlay shows a route map with a white line indicating the path, and the current speed is around 24-32 km/h.\n[120-150s] - Road speed fluctuates between 23–78 km/h as cyclist navigates through residential and rural landscapes.  \n- Temperature remains steady at 30°C, with a map overlay indicating current location near a rural area.  \n- Terrain transitions from paved streets to gravel paths, with elevation changes shown as -1% to +3%.\n[150-180s] - Road surface curves gently to the right, flanked by dense green trees on the left and open fields on the right.\n- Speed fluctuates between 24 and 30 km/h, with a slight incline indicated by a 1% gradient.\n- GPS map overlay shows a blue route marker moving forward, with temperature at 23°C and distance at 22.7 km.\n[180-210s] - Road ascends gradually, with incline percentage increasing from 1% to 9%.\n- Right side of road lined with dense green hedges, left side with open fields.\n- On-screen display shows distance increasing from 22.9 km to 23.0 km, with temperature at 30°C.\n[210-240s] - Road elevation gradually descends from 6% to -1% slope over the segment.\n- GPS distance increases from 23.1 km to 23.2 km, indicating forward motion.\n- Temperature remains steady at 30°C, with a map overlay showing location near Höh.\n[240-270s] - Road surface transitions from paved to gravel, with trees lining the path.  \n- GPS map shows a blue route marker moving along a white outline of a region.  \n- Speedometer fluctuates between 22–75 km/h, with elevation gain decreasing from 3% to 1%.", "history_tokens": 719, "history_utf8_bytes": 2742, "recent_frame_times_s": [258.0027, 259.0037, 260.0047, 261.0057, 262.0067, 263.0077, 264.0087, 265.0097, 266.0107, 267.0117, 268.0127, 269.0137, 270.0147, 271.0157, 272.0167, 273.0177, 274.0187, 275.0197, 276.0207, 277.0217, 278.0227, 279.0237, 280.0247, 281.0257, 282.0267, 283.0277, 284.0287, 285.0297, 286.0307, 287.0317], "recent_frames_sha256": "2493055c7875f6329d4fc127b4ffd7a47c51818d57222ae72ade2be318ac5de1", "num_recent_frames": 30, "tq": 717495.285483155, "t1": 717496.845049438, "ta": 717496.845049438, "te": 717496.883920626, "first_response_s": 1.5595662829000503, "answer_total_s": 1.5984374709660187, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 170, "content_group": "15036ee2d81d9c6de3ca7893d27d27d125a9a1a56c3353a57a946509a666d84d", "question": {"question_id": "sample_170_a1942_q0", "video_id": 170, "video_path": "./videos/sample_170_real.mp4", "annotation_index": 1942, "question_index": 0, "question": "What is present on the left side of the road right now?", "options": ["A. A small park with benches.", "B. A river with a pedestrian bridge.", "C. An open field with trees.", "D. A parked cars and several houses."], "answer": "D", "time_stamp_s": 429, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [414, 434], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_170_a1942_q0", "video_id": 170, "time_stamp_s": 429, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a89621797e84b2405e8c51c4226877565ecef2c0c55703ff1ce8248e10f2cdbe", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [399.01023333333336, 400.01123333333334, 401.0122333333333, 402.01323333333335, 403.0142333333333, 404.01523333333336, 405.01623333333333, 406.0172333333333, 407.01823333333334, 408.0192333333333, 409.02023333333335, 410.0212333333333, 411.02223333333336, 412.02323333333334, 413.0242333333333, 414.02523333333335, 415.0262333333333, 416.02723333333336, 417.02823333333333, 418.0292333333333, 419.03023333333334, 420.0312333333333, 421.03223333333335, 422.0332333333333, 423.00086666666664, 424.0018666666667, 425.00286666666665, 426.0038666666667, 427.00486666666666, 428.0058666666667], "recent_frames_sha256": "78db52df9c86467fb9a59d992893b1f9497f28c4bd91509af81e215dbb39c440", "num_recent_frames": 30, "tq": 717401.774295294, "t1": 717414.411897219, "ta": 717414.411897219, "te": 717414.44854407, "first_response_s": 12.637601925060153, "answer_total_s": 12.674248776049353, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_170_a1942_q0", "video_id": 170, "time_stamp_s": 429, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "74e4bbc7f2a4e192ee837f9caeeac49a5bd38f3dc72db50860632382c47b6250", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Road transitions from narrow forest path to wider residential street with houses lining both sides.  \n- Speed fluctuates between 24–30 km/h as the cyclist navigates through the neighborhood.  \n- On-screen display shows distance increasing from 10.2 km to 10.4 km, with temperature at 23°C.\n[90-120s] - Cyclist approaches a roundabout with a red bicycle lane marking, turning right onto a new road segment.  \n- A blue car is visible parked on the left side of the road, near a building with a sloped roof.  \n- The GPS overlay shows a route map with a white line indicating the path, and the current speed is around 24-32 km/h.\n[120-150s] - Road speed fluctuates between 23–78 km/h as cyclist navigates through residential and rural landscapes.  \n- Temperature remains steady at 30°C, with a map overlay indicating current location near a rural area.  \n- Terrain transitions from paved streets to gravel paths, with elevation changes shown as -1% to +3%.\n[150-180s] - Road surface curves gently to the right, flanked by dense green trees on the left and open fields on the right.\n- Speed fluctuates between 24 and 30 km/h, with a slight incline indicated by a 1% gradient.\n- GPS map overlay shows a blue route marker moving forward, with temperature at 23°C and distance at 22.7 km.\n[180-210s] - Road ascends gradually, with incline percentage increasing from 1% to 9%.\n- Right side of road lined with dense green hedges, left side with open fields.\n- On-screen display shows distance increasing from 22.9 km to 23.0 km, with temperature at 30°C.\n[210-240s] - Road elevation gradually descends from 6% to -1% slope over the segment.\n- GPS distance increases from 23.1 km to 23.2 km, indicating forward motion.\n- Temperature remains steady at 30°C, with a map overlay showing location near Höh.\n[240-270s] - Road surface transitions from paved to gravel, with trees lining the path.  \n- GPS map shows a blue route marker moving along a white outline of a region.  \n- Speedometer fluctuates between 22–75 km/h, with elevation gain decreasing from 3% to 1%.\n[270-300s] - Road transitions from tree-lined path to open field with fence on right, under clear blue sky.  \n- Speedometer shows steady increase from 18 to 24 km/h, with elevation gain of 4% to 1%.  \n- GPS map displays route progress with current location near Hohne, temperature at 30°C.\n[300-330s] - Road surface transitions from paved to gravel, with trees on left and open field on right.  \n- Speed fluctuates between 24–29 km/h, with incline decreasing from -1% to 0%.  \n- GPS map shows route progress over Northern England, with temperature at 33°C.\n[330-360s] - Road surface shows slight incline, with speed fluctuating between 23-26 km/h and gradient changing from 1% to -1%.\n- Left side of road bordered by dense green hedgerows, right side by dry grass fields under clear blue sky.\n- On-screen display shows temperature at 20°C, route progress at 23.6–24.0 km, and a map indicating current position in a region with a blue marker.\n[360-390s] - Road surface shows slight incline, with speedometer indicating 72-74 km/h and distance increasing from 24.0 to 24.2 km.\n- Left side features dense green hedges, while right side has a grassy field with a fence line.\n- On-screen map displays a blue route marker moving along a path, with temperature at 20°C and heart rate fluctuating.\n[390-420s] - Road surface shows slight incline, with speedometer indicating 24-25 km/h and elevation gain around 1%.\n- Right side of road features a grassy field with a fence, while left side has dense green hedges.\n- A white car is parked on the right side of the road, near a house, as the cyclist approaches.", "history_tokens": 1006, "history_utf8_bytes": 3685, "recent_frame_times_s": [399.01023333333336, 400.01123333333334, 401.0122333333333, 402.01323333333335, 403.0142333333333, 404.01523333333336, 405.01623333333333, 406.0172333333333, 407.01823333333334, 408.0192333333333, 409.02023333333335, 410.0212333333333, 411.02223333333336, 412.02323333333334, 413.0242333333333, 414.02523333333335, 415.0262333333333, 416.02723333333336, 417.02823333333333, 418.0292333333333, 419.03023333333334, 420.0312333333333, 421.03223333333335, 422.0332333333333, 423.00086666666664, 424.0018666666667, 425.00286666666665, 426.0038666666667, 427.00486666666666, 428.0058666666667], "recent_frames_sha256": "78db52df9c86467fb9a59d992893b1f9497f28c4bd91509af81e215dbb39c440", "num_recent_frames": 30, "tq": 717533.955753831, "t1": 717535.663921658, "ta": 717535.663921658, "te": 717536.035921768, "first_response_s": 1.7081678269896656, "answer_total_s": 2.080167937092483, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 170, "content_group": "15036ee2d81d9c6de3ca7893d27d27d125a9a1a56c3353a57a946509a666d84d", "question": {"question_id": "sample_170_a1943_q0", "video_id": 170, "video_path": "./videos/sample_170_real.mp4", "annotation_index": 1943, "question_index": 0, "question": "Where is the tree casting a shadow located right now?", "options": ["A. On the left side, in the field.", "B. In the middle of the road.", "C. On the right side of the road.", "D. Slightly in front of the cyclist, on the left."], "answer": "D", "time_stamp_s": 560, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [552, 572], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_170_a1943_q0", "video_id": 170, "time_stamp_s": 560, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d8c15129928fe0add246f612e0895c8d38d4468c07e41e4a466ff7114802e552", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [530.0077666666666, 531.0087666666667, 532.0097666666667, 533.0107666666667, 534.0117666666666, 535.0127666666667, 536.0137666666667, 537.0147666666667, 538.0157666666667, 539.0167666666666, 540.0177666666667, 541.0187666666667, 542.0197666666667, 543.0207666666666, 544.0217666666666, 545.0227666666667, 546.0237666666667, 547.0247666666667, 548.0257666666666, 549.0267666666666, 550.0277666666667, 551.0287666666667, 552.0297666666667, 553.0307666666666, 554.0317666666666, 555.0327666666667, 556.0004, 557.0014, 558.0024, 559.0034], "recent_frames_sha256": "cc159001a2b429553c09d3a0b0e9c2a857516943a1e01a3e6332257c39873540", "num_recent_frames": 30, "tq": 717414.463903789, "t1": 717421.883193716, "ta": 717421.883193716, "te": 717421.919907649, "first_response_s": 7.419289927114733, "answer_total_s": 7.456003860104829, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_170_a1943_q0", "video_id": 170, "time_stamp_s": 560, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0025a1b85fadf1afdc497b3a46d6a88e7bafd08d1bb63b580a1e56f71860cb14", "condition_order": ["recent", "notes"], "memory": "[210-240s] - Road elevation gradually descends from 6% to -1% slope over the segment.\n- GPS distance increases from 23.1 km to 23.2 km, indicating forward motion.\n- Temperature remains steady at 30°C, with a map overlay showing location near Höh.\n[240-270s] - Road surface transitions from paved to gravel, with trees lining the path.  \n- GPS map shows a blue route marker moving along a white outline of a region.  \n- Speedometer fluctuates between 22–75 km/h, with elevation gain decreasing from 3% to 1%.\n[270-300s] - Road transitions from tree-lined path to open field with fence on right, under clear blue sky.  \n- Speedometer shows steady increase from 18 to 24 km/h, with elevation gain of 4% to 1%.  \n- GPS map displays route progress with current location near Hohne, temperature at 30°C.\n[300-330s] - Road surface transitions from paved to gravel, with trees on left and open field on right.  \n- Speed fluctuates between 24–29 km/h, with incline decreasing from -1% to 0%.  \n- GPS map shows route progress over Northern England, with temperature at 33°C.\n[330-360s] - Road surface shows slight incline, with speed fluctuating between 23-26 km/h and gradient changing from 1% to -1%.\n- Left side of road bordered by dense green hedgerows, right side by dry grass fields under clear blue sky.\n- On-screen display shows temperature at 20°C, route progress at 23.6–24.0 km, and a map indicating current position in a region with a blue marker.\n[360-390s] - Road surface shows slight incline, with speedometer indicating 72-74 km/h and distance increasing from 24.0 to 24.2 km.\n- Left side features dense green hedges, while right side has a grassy field with a fence line.\n- On-screen map displays a blue route marker moving along a path, with temperature at 20°C and heart rate fluctuating.\n[390-420s] - Road surface shows slight incline, with speedometer indicating 24-25 km/h and elevation gain around 1%.\n- Right side of road features a grassy field with a fence, while left side has dense green hedges.\n- A white car is parked on the right side of the road, near a house, as the cyclist approaches.\n[420-450s] - Road slopes upward, indicated by a +1% grade, as the cyclist ascends a residential street lined with hedges and houses.\n- A white car is parked on the right side of the road, stationary, with its rear facing the camera.\n- The cyclist's speed decreases from 80 to 15 km/h, and the distance traveled increases from 24.5 to 24.6 km, as shown on the on-screen display.\n[450-480s] - Road incline increases from 1% to 13% as cyclist ascends a residential street.  \n- Temperature remains steady at 34°C, with a map overlay showing location near Hønefoss.  \n- Speed fluctuates between 64–68 km/h, with total distance at 24.7 km and time around 65–66 minutes.\n[480-510s] - Road surface transitions from paved to gravel, with a slight incline visible ahead.  \n- A horse is seen grazing in a field to the right, near a fence.  \n- The on-screen display shows a temperature of 34°C and a route distance of 24.8 km.\n[510-540s] - The road ahead is a gravel path ascending a gentle hill, flanked by green fields and trees under a clear blue sky.\n- The cycling dashboard shows a steady pace of 60-68 km/h, with distance increasing from 24.9 to 25.0 km and time progressing from 61 to 63 minutes.\n- The map overlay on the right indicates the cyclist’s position near a town, with a temperature of 34°C displayed.", "history_tokens": 965, "history_utf8_bytes": 3438, "recent_frame_times_s": [530.0077666666666, 531.0087666666667, 532.0097666666667, 533.0107666666667, 534.0117666666666, 535.0127666666667, 536.0137666666667, 537.0147666666667, 538.0157666666667, 539.0167666666666, 540.0177666666667, 541.0187666666667, 542.0197666666667, 543.0207666666666, 544.0217666666666, 545.0227666666667, 546.0237666666667, 547.0247666666667, 548.0257666666666, 549.0267666666666, 550.0277666666667, 551.0287666666667, 552.0297666666667, 553.0307666666666, 554.0317666666666, 555.0327666666667, 556.0004, 557.0014, 558.0024, 559.0034], "recent_frames_sha256": "cc159001a2b429553c09d3a0b0e9c2a857516943a1e01a3e6332257c39873540", "num_recent_frames": 30, "tq": 717567.789392848, "t1": 717569.784123111, "ta": 717569.784123111, "te": 717570.087898941, "first_response_s": 1.994730263017118, "answer_total_s": 2.2985060929786414, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 171, "content_group": "a5cdb6d8b343ae29615a73afdd4a6427aefd9b49cfa227a9bef9e32503dd3d47", "question": {"question_id": "sample_171_a875_q0", "video_id": 171, "video_path": "./videos/sample_171_real.mp4", "annotation_index": 875, "question_index": 0, "question": "Where are the power lines located right now?", "options": ["A. Crossing diagonally over the road.", "B. Parallel to the right side of the road.", "C. Intersecting the road perpendicularly.", "D. Running parallel to the left side of the road."], "answer": "D", "time_stamp_s": 8, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_171_a875_q0", "video_id": 171, "time_stamp_s": 8, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "798ae70f29ca55c50253ec68c2b397664c07866e8fa286f6fd42377018ff7208", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.038, 1.0056333333333334, 2.0066333333333333, 3.007633333333333, 4.008633333333333, 5.009633333333333, 6.010633333333334, 7.011633333333333], "recent_frames_sha256": "12e47e1fb079d88404137b7458394b2f3b763aed924139eca53c716ded591ec2", "num_recent_frames": 8, "tq": 710163.555162942, "t1": 710169.217550288, "ta": 710169.217550288, "te": 710169.254643513, "first_response_s": 5.662387345917523, "answer_total_s": 5.699480570969172, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_171_a875_q0", "video_id": 171, "time_stamp_s": 8, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5e4db14a62f908dbcbe350c81dbcf0fce155a2d7a0d78d46566255088352c474", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.038, 1.0056333333333334, 2.0066333333333333, 3.007633333333333, 4.008633333333333, 5.009633333333333, 6.010633333333334, 7.011633333333333], "recent_frames_sha256": "12e47e1fb079d88404137b7458394b2f3b763aed924139eca53c716ded591ec2", "num_recent_frames": 8, "tq": 710018.722372397, "t1": 710019.571515042, "ta": 710019.571515042, "te": 710019.612949543, "first_response_s": 0.8491426450200379, "answer_total_s": 0.8905771460849792, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 171, "content_group": "a5cdb6d8b343ae29615a73afdd4a6427aefd9b49cfa227a9bef9e32503dd3d47", "question": {"question_id": "sample_171_a876_q0", "video_id": 171, "video_path": "./videos/sample_171_real.mp4", "annotation_index": 876, "question_index": 0, "question": "Where is the red graffiti?", "options": ["A. On the right side of the road.", "B. On the left side of the road.", "C. In front of the road.", "D. Above the entrance of the tunnel."], "answer": "D", "time_stamp_s": 136, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [125, 145], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_171_a876_q0", "video_id": 171, "time_stamp_s": 136, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5d72f4d2b03e55023a7d540591ac061dc5d6363b0a313a715a2f54ae2aaf33bc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [106.01053333333333, 107.01153333333333, 108.01253333333334, 109.01353333333333, 110.01453333333333, 111.01553333333334, 112.01653333333333, 113.01753333333333, 114.01853333333334, 115.01953333333333, 116.02053333333333, 117.02153333333334, 118.02253333333333, 119.02353333333333, 120.02453333333334, 121.02553333333333, 122.02653333333333, 123.02753333333334, 124.02853333333333, 125.02953333333333, 126.03053333333334, 127.03153333333333, 128.03253333333333, 129.00016666666667, 130.00116666666668, 131.00216666666665, 132.00316666666666, 133.00416666666666, 134.00516666666667, 135.00616666666667], "recent_frames_sha256": "2323e26f1da976f2da4c29712d7e82c2b79d2ea3856fd65c8dde30b681a5a3b2", "num_recent_frames": 30, "tq": 710169.272378057, "t1": 710181.078727126, "ta": 710181.078727126, "te": 710181.115863814, "first_response_s": 11.806349068996496, "answer_total_s": 11.843485757010058, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_171_a876_q0", "video_id": 171, "time_stamp_s": 136, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a1448c36b936dfea4dda56492c81f2bb8935e737dab2d3a00fe78cf4e3cb7020", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Road surface transitions from dirt to paved, with a bridge crossing visible at 0:24.  \n- Temperature remains steady at 31°C, and the route map shows a blue dot moving along a path.  \n- Speed fluctuates between 22–32 km/h, with elevation changes indicated as -1% to +2%.\n[30-60s] - Road surface transitions from paved to gravel, with elevation slightly increasing.  \n- Temperature displayed as 31°C, with a map showing route progress.  \n- Speed fluctuates between 25–30 km/h, with a slight incline indicated by -1% to 1%.\n[60-90s] - Road speed increases from 38 to 56 km/h as cyclist moves through a tree-lined path.  \n- GPS map shows route progress with a blue dot indicating current position near a rural area.  \n- Temperature remains steady at 32°C, with slight elevation changes (4% to 3%) visible on the display.\n[90-120s] - Road surface slopes gently upward, transitioning from rural to residential area with houses visible ahead.  \n- Speedometer shows decreasing speed from 90 to 33 km/h as the cyclist approaches the residential zone.  \n- Map overlay indicates position moving toward a marked destination, with temperature at 22°C displayed.", "history_tokens": 299, "history_utf8_bytes": 1166, "recent_frame_times_s": [106.01053333333333, 107.01153333333333, 108.01253333333334, 109.01353333333333, 110.01453333333333, 111.01553333333334, 112.01653333333333, 113.01753333333333, 114.01853333333334, 115.01953333333333, 116.02053333333333, 117.02153333333334, 118.02253333333333, 119.02353333333333, 120.02453333333334, 121.02553333333333, 122.02653333333333, 123.02753333333334, 124.02853333333333, 125.02953333333333, 126.03053333333334, 127.03153333333333, 128.03253333333333, 129.00016666666667, 130.00116666666668, 131.00216666666665, 132.00316666666666, 133.00416666666666, 134.00516666666667, 135.00616666666667], "recent_frames_sha256": "2323e26f1da976f2da4c29712d7e82c2b79d2ea3856fd65c8dde30b681a5a3b2", "num_recent_frames": 30, "tq": 710045.543769629, "t1": 710051.629946361, "ta": 710051.629946361, "te": 710051.667132196, "first_response_s": 6.086176731972955, "answer_total_s": 6.123362567042932, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 171, "content_group": "a5cdb6d8b343ae29615a73afdd4a6427aefd9b49cfa227a9bef9e32503dd3d47", "question": {"question_id": "sample_171_a877_q0", "video_id": 171, "video_path": "./videos/sample_171_real.mp4", "annotation_index": 877, "question_index": 0, "question": "What is on the left side of the road right now?", "options": ["A. A river.", "B. A small building.", "C. An open field.", "D. Dense vegetation."], "answer": "D", "time_stamp_s": 250, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [250, 270], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_171_a877_q0", "video_id": 171, "time_stamp_s": 250, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5a2cf68e28c5ae5840dda8390fd699407fcbbabb9382c89b2f5306eab375892e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [220.02443333333332, 221.02543333333332, 222.02643333333333, 223.02743333333333, 224.02843333333334, 225.02943333333334, 226.03043333333332, 227.03143333333333, 228.03243333333333, 229.00006666666667, 230.00106666666667, 231.00206666666668, 232.00306666666665, 233.00406666666666, 234.00506666666666, 235.00606666666667, 236.00706666666667, 237.00806666666668, 238.00906666666666, 239.01006666666666, 240.01106666666666, 241.01206666666667, 242.01306666666667, 243.01406666666668, 244.01506666666666, 245.01606666666666, 246.01706666666666, 247.01806666666667, 248.01906666666667, 249.02006666666668], "recent_frames_sha256": "ce04aaf0ecf100778d3859696a5a068708fa2ece57890c3fd158fb27d0fb73fb", "num_recent_frames": 30, "tq": 710181.130864296, "t1": 710194.019113721, "ta": 710194.019113721, "te": 710194.056734203, "first_response_s": 12.888249424984679, "answer_total_s": 12.92586990701966, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_171_a877_q0", "video_id": 171, "time_stamp_s": 250, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8ed4d4e336430e2e89f0b4abe1b8544d2393bd3b258f09a1697be824e51791d0", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Road surface transitions from dirt to paved, with a bridge crossing visible at 0:24.  \n- Temperature remains steady at 31°C, and the route map shows a blue dot moving along a path.  \n- Speed fluctuates between 22–32 km/h, with elevation changes indicated as -1% to +2%.\n[30-60s] - Road surface transitions from paved to gravel, with elevation slightly increasing.  \n- Temperature displayed as 31°C, with a map showing route progress.  \n- Speed fluctuates between 25–30 km/h, with a slight incline indicated by -1% to 1%.\n[60-90s] - Road speed increases from 38 to 56 km/h as cyclist moves through a tree-lined path.  \n- GPS map shows route progress with a blue dot indicating current position near a rural area.  \n- Temperature remains steady at 32°C, with slight elevation changes (4% to 3%) visible on the display.\n[90-120s] - Road surface slopes gently upward, transitioning from rural to residential area with houses visible ahead.  \n- Speedometer shows decreasing speed from 90 to 33 km/h as the cyclist approaches the residential zone.  \n- Map overlay indicates position moving toward a marked destination, with temperature at 22°C displayed.\n[120-150s] - Road curves left, bordered by dense green trees and grass, with a metal guardrail on the right.  \n- A tunnel entrance appears ahead, with graffiti visible on its concrete walls.  \n- After exiting the tunnel, the road continues straight, flanked by trees and a clear blue sky.\n[150-180s] - Road surface shows slight incline with consistent 4-7% gradient as cyclist progresses.  \n- Right-side guardrail remains static, parallel to the path, while trees line both sides.  \n- On-screen data updates: speed fluctuates (e.g., 44 to 48 km/h), distance increases (10.4 to 10.7 km), and temperature remains at 32°C.\n[180-210s] - Road surface transitions from paved to gravel, with speed fluctuating between 18-39 km/h.  \n- Trees on both sides of the path create a shaded, green corridor with sunlight filtering through.  \n- On-screen data shows distance increasing from 10.8 km to 11.0 km, with elevation gain around 6-7%.\n[210-240s] - A cyclist appears on the road, riding away from the camera, with a steady pace.  \n- The road is flanked by dense green trees, with sunlight filtering through the canopy.  \n- On-screen metrics show a 6% incline, 72 minutes elapsed, and 11.0 km distance covered.", "history_tokens": 629, "history_utf8_bytes": 2368, "recent_frame_times_s": [220.02443333333332, 221.02543333333332, 222.02643333333333, 223.02743333333333, 224.02843333333334, 225.02943333333334, 226.03043333333332, 227.03143333333333, 228.03243333333333, 229.00006666666667, 230.00106666666667, 231.00206666666668, 232.00306666666665, 233.00406666666666, 234.00506666666666, 235.00606666666667, 236.00706666666667, 237.00806666666668, 238.00906666666666, 239.01006666666666, 240.01106666666666, 241.01206666666667, 242.01306666666667, 243.01406666666668, 244.01506666666666, 245.01606666666666, 246.01706666666666, 247.01806666666667, 248.01906666666667, 249.02006666666668], "recent_frames_sha256": "ce04aaf0ecf100778d3859696a5a068708fa2ece57890c3fd158fb27d0fb73fb", "num_recent_frames": 30, "tq": 710088.90175331, "t1": 710090.072431229, "ta": 710090.072431229, "te": 710090.256376756, "first_response_s": 1.1706779190571979, "answer_total_s": 1.3546234460081905, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 171, "content_group": "a5cdb6d8b343ae29615a73afdd4a6427aefd9b49cfa227a9bef9e32503dd3d47", "question": {"question_id": "sample_171_a878_q0", "video_id": 171, "video_path": "./videos/sample_171_real.mp4", "annotation_index": 878, "question_index": 0, "question": "What is located on the left side of the path right now?", "options": ["A. A cornfield.", "B. A tall building.", "C. A dense forest.", "D. A patch of grass."], "answer": "D", "time_stamp_s": 387, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [375, 395], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_171_a878_q0", "video_id": 171, "time_stamp_s": 387, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "85c78ea17e20f2d20c8e4b38bfb83bc43fefb81f8d74749dab7b5c6a1fadb107", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [357.02796666666666, 358.0289666666667, 359.02996666666667, 360.03096666666664, 361.0319666666667, 362.03296666666665, 363.0006, 364.0016, 365.0026, 366.0036, 367.0046, 368.0056, 369.0066, 370.0076, 371.0086, 372.0096, 373.0106, 374.0116, 375.0126, 376.0136, 377.0146, 378.0156, 379.0166, 380.0176, 381.0186, 382.0196, 383.0206, 384.0216, 385.0226, 386.0236], "recent_frames_sha256": "69d7b9173c1d256cf85022d4082fbcc95e0521aa1e537f1204aa0907056b8871", "num_recent_frames": 30, "tq": 710194.073308725, "t1": 710201.343784034, "ta": 710201.343784034, "te": 710201.379930188, "first_response_s": 7.2704753089929, "answer_total_s": 7.306621462921612, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_171_a878_q0", "video_id": 171, "time_stamp_s": 387, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4cb46a70a791e3a58eba957f4a925be6cf2c94cd46bdb6f6c64a33c5589f3bb1", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Road surface transitions from dirt to paved, with a bridge crossing visible at 0:24.  \n- Temperature remains steady at 31°C, and the route map shows a blue dot moving along a path.  \n- Speed fluctuates between 22–32 km/h, with elevation changes indicated as -1% to +2%.\n[30-60s] - Road surface transitions from paved to gravel, with elevation slightly increasing.  \n- Temperature displayed as 31°C, with a map showing route progress.  \n- Speed fluctuates between 25–30 km/h, with a slight incline indicated by -1% to 1%.\n[60-90s] - Road speed increases from 38 to 56 km/h as cyclist moves through a tree-lined path.  \n- GPS map shows route progress with a blue dot indicating current position near a rural area.  \n- Temperature remains steady at 32°C, with slight elevation changes (4% to 3%) visible on the display.\n[90-120s] - Road surface slopes gently upward, transitioning from rural to residential area with houses visible ahead.  \n- Speedometer shows decreasing speed from 90 to 33 km/h as the cyclist approaches the residential zone.  \n- Map overlay indicates position moving toward a marked destination, with temperature at 22°C displayed.\n[120-150s] - Road curves left, bordered by dense green trees and grass, with a metal guardrail on the right.  \n- A tunnel entrance appears ahead, with graffiti visible on its concrete walls.  \n- After exiting the tunnel, the road continues straight, flanked by trees and a clear blue sky.\n[150-180s] - Road surface shows slight incline with consistent 4-7% gradient as cyclist progresses.  \n- Right-side guardrail remains static, parallel to the path, while trees line both sides.  \n- On-screen data updates: speed fluctuates (e.g., 44 to 48 km/h), distance increases (10.4 to 10.7 km), and temperature remains at 32°C.\n[180-210s] - Road surface transitions from paved to gravel, with speed fluctuating between 18-39 km/h.  \n- Trees on both sides of the path create a shaded, green corridor with sunlight filtering through.  \n- On-screen data shows distance increasing from 10.8 km to 11.0 km, with elevation gain around 6-7%.\n[210-240s] - A cyclist appears on the road, riding away from the camera, with a steady pace.  \n- The road is flanked by dense green trees, with sunlight filtering through the canopy.  \n- On-screen metrics show a 6% incline, 72 minutes elapsed, and 11.0 km distance covered.\n[240-270s] - Road speed fluctuates between 69 and 73 km/h, with a 7% incline maintained.  \n- GPS map shows a blue route marker near the UK’s northern coast.  \n- Temperature remains steady at 22°C, with heart rate and power metrics displayed.\n[270-300s] - Road surface shows slight incline with consistent 6% gradient, flanked by dense green trees.  \n- GPS map overlay indicates route progress toward a destination marked in blue, with temperature at 31°C.  \n- Speedometer fluctuates between 60–70 km/h, with total distance increasing from 11.3 to 11.4 km.\n[300-330s] - Road curves left, then right, flanked by dense trees and green fields under clear blue sky.\n- Speed fluctuates between 60-75 km/h, with incline decreasing from 6% to 3%.\n- GPS map shows route progress toward a destination marked in the UK, with temperature at 31°C.\n[330-360s] - Road ascends slightly, indicated by increasing gradient from 6% to 7%.\n- Right side of road bordered by tall green crops, left by trees and a fence.\n- GPS map shows route progress with a blue dot moving along a white path.", "history_tokens": 930, "history_utf8_bytes": 3446, "recent_frame_times_s": [357.02796666666666, 358.0289666666667, 359.02996666666667, 360.03096666666664, 361.0319666666667, 362.03296666666665, 363.0006, 364.0016, 365.0026, 366.0036, 367.0046, 368.0056, 369.0066, 370.0076, 371.0086, 372.0096, 373.0106, 374.0116, 375.0126, 376.0136, 377.0146, 378.0156, 379.0166, 380.0176, 381.0186, 382.0196, 383.0206, 384.0216, 385.0226, 386.0236], "recent_frames_sha256": "69d7b9173c1d256cf85022d4082fbcc95e0521aa1e537f1204aa0907056b8871", "num_recent_frames": 30, "tq": 710122.041714478, "t1": 710123.587533304, "ta": 710123.587533304, "te": 710123.812087844, "first_response_s": 1.545818825950846, "answer_total_s": 1.7703733659582213, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 171, "content_group": "a5cdb6d8b343ae29615a73afdd4a6427aefd9b49cfa227a9bef9e32503dd3d47", "question": {"question_id": "sample_171_a879_q0", "video_id": 171, "video_path": "./videos/sample_171_real.mp4", "annotation_index": 879, "question_index": 0, "question": "What is located on the right side of the road right now?", "options": ["A. A field of corn.", "B. A forest.", "C. A river.", "D. A field of wheat."], "answer": "D", "time_stamp_s": 514, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [500, 520], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_171_a879_q0", "video_id": 171, "time_stamp_s": 514, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f85f4d887194c7b63bacd867b68a01787bf07b3e0560ec3cc47279e2b15585c0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [484.0215, 485.0225, 486.0235, 487.0245, 488.0255, 489.0265, 490.0275, 491.0285, 492.0295, 493.0305, 494.0315, 495.0325, 496.00013333333334, 497.0011333333333, 498.00213333333335, 499.0031333333333, 500.00413333333336, 501.00513333333333, 502.0061333333333, 503.00713333333334, 504.0081333333333, 505.00913333333335, 506.01013333333333, 507.0111333333333, 508.01213333333334, 509.0131333333333, 510.01413333333335, 511.0151333333333, 512.0161333333333, 513.0171333333333], "recent_frames_sha256": "1aecb9e597eec3c08dc2e3bdb2cb687e9713fb1ad4120ea77a2da90da54e43cf", "num_recent_frames": 30, "tq": 710201.402020398, "t1": 710207.467369414, "ta": 710207.467369414, "te": 710207.505265254, "first_response_s": 6.065349016105756, "answer_total_s": 6.103244855999947, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_171_a879_q0", "video_id": 171, "time_stamp_s": 514, "ground_truth": "D", "raw_output": "A. A field of corn.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "03d2ab860204e15b6f574a7bf14aaebe0800d38a58a3535ad1cd9731baea9133", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Road surface shows slight incline with consistent 4-7% gradient as cyclist progresses.  \n- Right-side guardrail remains static, parallel to the path, while trees line both sides.  \n- On-screen data updates: speed fluctuates (e.g., 44 to 48 km/h), distance increases (10.4 to 10.7 km), and temperature remains at 32°C.\n[180-210s] - Road surface transitions from paved to gravel, with speed fluctuating between 18-39 km/h.  \n- Trees on both sides of the path create a shaded, green corridor with sunlight filtering through.  \n- On-screen data shows distance increasing from 10.8 km to 11.0 km, with elevation gain around 6-7%.\n[210-240s] - A cyclist appears on the road, riding away from the camera, with a steady pace.  \n- The road is flanked by dense green trees, with sunlight filtering through the canopy.  \n- On-screen metrics show a 6% incline, 72 minutes elapsed, and 11.0 km distance covered.\n[240-270s] - Road speed fluctuates between 69 and 73 km/h, with a 7% incline maintained.  \n- GPS map shows a blue route marker near the UK’s northern coast.  \n- Temperature remains steady at 22°C, with heart rate and power metrics displayed.\n[270-300s] - Road surface shows slight incline with consistent 6% gradient, flanked by dense green trees.  \n- GPS map overlay indicates route progress toward a destination marked in blue, with temperature at 31°C.  \n- Speedometer fluctuates between 60–70 km/h, with total distance increasing from 11.3 to 11.4 km.\n[300-330s] - Road curves left, then right, flanked by dense trees and green fields under clear blue sky.\n- Speed fluctuates between 60-75 km/h, with incline decreasing from 6% to 3%.\n- GPS map shows route progress toward a destination marked in the UK, with temperature at 31°C.\n[330-360s] - Road ascends slightly, indicated by increasing gradient from 6% to 7%.\n- Right side of road bordered by tall green crops, left by trees and a fence.\n- GPS map shows route progress with a blue dot moving along a white path.\n[360-390s] - Road curves left, bordered by tall trees on the right and a golden field on the left, under a clear blue sky.\n- On-screen display shows speed fluctuating between 60–75 km/h, elevation gain of 3%, and distance of 11.8–11.9 km.\n- Temperature reading on screen increases from 31°C to 32°C as the ride progresses.\n[390-420s] - Speedometer shows decreasing speed from 74 to 65 km/h over the segment.\n- Distance traveled increases from 12.0 km to 12.1 km, with time decreasing from 74:00 to 70:00 minutes.\n- Road is flanked by golden fields on the left and tall green crops on the right under a clear blue sky.\n[420-450s] - Road speed fluctuates between 70-72 km/h with a 4% incline, covering 12.1–12.3 km.  \n- Right side features tall green crops; left side shows harvested golden fields under clear blue sky.  \n- GPS map on right displays route progress with a blue marker near \"Höhe\" at 32°C.\n[450-480s] - Road speed fluctuates between 70-75 km/h with a 3% incline, showing a 12.3 km distance covered.  \n- Temperature remains at 32°C, with a map overlay indicating route progress.  \n- Terrain transitions from flat to slightly uphill, as indicated by the changing gradient percentage.\n[480-510s] - Road surface shows slight incline, indicated by 1% gradient on display.  \n- Cornfield on right side remains tall and dense, contrasting with harvested field on left.  \n- GPS map on right shows route progress with blue dot moving forward along path.", "history_tokens": 981, "history_utf8_bytes": 3458, "recent_frame_times_s": [484.0215, 485.0225, 486.0235, 487.0245, 488.0255, 489.0265, 490.0275, 491.0285, 492.0295, 493.0305, 494.0315, 495.0325, 496.00013333333334, 497.0011333333333, 498.00213333333335, 499.0031333333333, 500.00413333333336, 501.00513333333333, 502.0061333333333, 503.00713333333334, 504.0081333333333, 505.00913333333335, 506.01013333333333, 507.0111333333333, 508.01213333333334, 509.0131333333333, 510.01413333333335, 511.0151333333333, 512.0161333333333, 513.0171333333333], "recent_frames_sha256": "1aecb9e597eec3c08dc2e3bdb2cb687e9713fb1ad4120ea77a2da90da54e43cf", "num_recent_frames": 30, "tq": 710161.147297105, "t1": 710163.04838702, "ta": 710163.04838702, "te": 710163.498883204, "first_response_s": 1.9010899149579927, "answer_total_s": 2.3515860988991335, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 172, "content_group": "a3873e9f85110e27da67089ed128b9922928ef553991db906da6e64d7e2ac472", "question": {"question_id": "sample_172_a524_q0", "video_id": 172, "video_path": "./videos/sample_172_real.mp4", "annotation_index": 524, "question_index": 0, "question": "What is located on the right side of the cyclist right now?", "options": ["A. A supermarket entrance.", "B. A row of flags.", "C. A bus stop.", "D. A park."], "answer": "B", "time_stamp_s": 14, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_172_a524_q0", "video_id": 172, "time_stamp_s": 14, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b957a713197bca34c31163bb310359b1059bc48fb98e8d342a7657b5ca1df83e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013], "recent_frames_sha256": "73a0960c3ba559b090220013813a2f60655d55661a5786abf4ef4ebee1d00e40", "num_recent_frames": 14, "tq": 717662.768058359, "t1": 717663.635675557, "ta": 717663.635675557, "te": 717663.674468765, "first_response_s": 0.867617197916843, "answer_total_s": 0.9064104059943929, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_172_a524_q0", "video_id": 172, "time_stamp_s": 14, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "542158c7a1e968fd3fbad5be763640e9251dc10b99b120964d5c5489a969498c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013], "recent_frames_sha256": "73a0960c3ba559b090220013813a2f60655d55661a5786abf4ef4ebee1d00e40", "num_recent_frames": 14, "tq": 717712.565086073, "t1": 717718.39654139, "ta": 717718.39654139, "te": 717718.435583993, "first_response_s": 5.831455316976644, "answer_total_s": 5.870497919968329, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 172, "content_group": "a3873e9f85110e27da67089ed128b9922928ef553991db906da6e64d7e2ac472", "question": {"question_id": "sample_172_a525_q0", "video_id": 172, "video_path": "./videos/sample_172_real.mp4", "annotation_index": 525, "question_index": 0, "question": "What structure is located straight ahead on the right side of the road, visible right now?", "options": ["A. A bridge.", "B. A gym.", "C. A billboard.", "D. A roundabout."], "answer": "C", "time_stamp_s": 141, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [124, 144], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_172_a525_q0", "video_id": 172, "time_stamp_s": 141, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7afeb4bc281db49f6ef21be424158c860262afa1a8160d755e9e1410e2bb1ee0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332], "recent_frames_sha256": "e89e1ffbf53fec0a8981b89387dd3fbee39f75dd96c0c4b9e1f28b3c07cc50ea", "num_recent_frames": 30, "tq": 717663.69624167, "t1": 717676.876432572, "ta": 717676.876432572, "te": 717676.915686001, "first_response_s": 13.18019090197049, "answer_total_s": 13.219444330898114, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_172_a525_q0", "video_id": 172, "time_stamp_s": 141, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a197fde65f12d851608e8f376f4541a1a9edecac7391e5585cdb60cf9cb63c09", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cyclist rides through a town, passing buildings and traffic lights, with speed fluctuating between 28-79 km/h.  \n- A map overlay on the right shows a route with a blue line indicating progress, and a temperature of 33°C is displayed.  \n- The cyclist approaches a large commercial building with flags, then turns right onto a road lined with trees and parked cars.\n[30-60s] - Road sign for \"Bäckström\" visible on right side, indicating a location or business.\n- A stone arch bridge with graffiti appears ahead, crossing the road.\n- Traffic light and road markings indicate an intersection approaching.\n[60-90s] - A brick building with large windows lines the right side of the road, showing signs of industrial use.  \n- The road curves slightly to the left, passing a fenced area with greenery and a sign indicating a direction to \"Höchst\" and \"Höchst\".  \n- A pedestrian crossing appears ahead, followed by a road sign indicating a right turn or intersection.\n[90-120s] - Road surface shows slight incline with speedometer reading 2% grade, transitioning from 72 to 82 km/h.\n- Right side features a continuous fence and trees, while left side reveals buildings and parked vehicles.\n- GPS map overlay indicates location near Hohne with temperature at 34°C, and distance increasing from 0.7 to 0.9 km.", "history_tokens": 319, "history_utf8_bytes": 1314, "recent_frame_times_s": [111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332], "recent_frames_sha256": "e89e1ffbf53fec0a8981b89387dd3fbee39f75dd96c0c4b9e1f28b3c07cc50ea", "num_recent_frames": 30, "tq": 717756.37816329, "t1": 717764.57368037, "ta": 717764.57368037, "te": 717764.881507818, "first_response_s": 8.19551708002109, "answer_total_s": 8.50334452802781, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 172, "content_group": "a3873e9f85110e27da67089ed128b9922928ef553991db906da6e64d7e2ac472", "question": {"question_id": "sample_172_a526_q0", "video_id": 172, "video_path": "./videos/sample_172_real.mp4", "annotation_index": 526, "question_index": 0, "question": "What is located on the right side of the road right now?", "options": ["A. A series of road signs.", "B. A parked car.", "C. A bus stop.", "D. A pedestrian crossing."], "answer": "A", "time_stamp_s": 263, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [248, 268], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_172_a526_q0", "video_id": 172, "time_stamp_s": 263, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e27a5aeb89183d9d560c01dfa13579792391eb5db90e9281f5eab78fa9a201cd", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334], "recent_frames_sha256": "353ff219e6e89c835b89fc5f7e25b0a3d0b638251d28d35421a642d8c01fe983", "num_recent_frames": 30, "tq": 717676.93824624, "t1": 717688.774204858, "ta": 717688.774204858, "te": 717688.814964952, "first_response_s": 11.83595861797221, "answer_total_s": 11.876718711922877, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_172_a526_q0", "video_id": 172, "time_stamp_s": 263, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1d746d98ac90a9ac65f7875e22ee2dcf2ecfb5af7f410a20287f4fd2509b6c79", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cyclist rides through a town, passing buildings and traffic lights, with speed fluctuating between 28-79 km/h.  \n- A map overlay on the right shows a route with a blue line indicating progress, and a temperature of 33°C is displayed.  \n- The cyclist approaches a large commercial building with flags, then turns right onto a road lined with trees and parked cars.\n[30-60s] - Road sign for \"Bäckström\" visible on right side, indicating a location or business.\n- A stone arch bridge with graffiti appears ahead, crossing the road.\n- Traffic light and road markings indicate an intersection approaching.\n[60-90s] - A brick building with large windows lines the right side of the road, showing signs of industrial use.  \n- The road curves slightly to the left, passing a fenced area with greenery and a sign indicating a direction to \"Höchst\" and \"Höchst\".  \n- A pedestrian crossing appears ahead, followed by a road sign indicating a right turn or intersection.\n[90-120s] - Road surface shows slight incline with speedometer reading 2% grade, transitioning from 72 to 82 km/h.\n- Right side features a continuous fence and trees, while left side reveals buildings and parked vehicles.\n- GPS map overlay indicates location near Hohne with temperature at 34°C, and distance increasing from 0.7 to 0.9 km.\n[120-150s] - A cyclist passes a white building with a sign reading \"AIR VENTURE\" while riding on a paved road.\n- The cyclist continues past a row of buildings with a metal fence on the right side of the road.\n- The cyclist's speed decreases from 65 to 24 km/h as they approach a traffic light and a pedestrian crossing.\n[150-180s] - A white van passes on the right, followed by a silver car and then a red car, all moving in the same direction.  \n- The road curves slightly to the left, with a stone wall and greenery on the left side.  \n- The speedometer shows a decreasing speed from 67 to 60 km/h, indicating slowing down.\n[180-210s] - Road surface shows slight incline with speedometer indicating 24-30 km/h and distance increasing from 1.4 to 1.6 km.\n- Trees line the right side of the road, with a brick building visible alongside them, showing graffiti on its wall.\n- A white van passes in the opposite direction, appearing at 1:26 and moving away from the camera's perspective.\n[210-240s] - Road speed fluctuates between 21–70 km/h as the cyclist navigates a tree-lined street with a brick building on the right.  \n- A white car passes on the left, followed by a cyclist, while a yellow sign with \"Höhe\" appears near the building.  \n- The route map on the right shows a blue dot moving along a path, with temperature at 38°C and distance increasing from 1.0 to 1.8 km.", "history_tokens": 688, "history_utf8_bytes": 2695, "recent_frame_times_s": [233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334], "recent_frames_sha256": "353ff219e6e89c835b89fc5f7e25b0a3d0b638251d28d35421a642d8c01fe983", "num_recent_frames": 30, "tq": 717797.960389863, "t1": 717806.125178634, "ta": 717806.125178634, "te": 717806.495973214, "first_response_s": 8.164788770955056, "answer_total_s": 8.535583351040259, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 172, "content_group": "a3873e9f85110e27da67089ed128b9922928ef553991db906da6e64d7e2ac472", "question": {"question_id": "sample_172_a527_q0", "video_id": 172, "video_path": "./videos/sample_172_real.mp4", "annotation_index": 527, "question_index": 0, "question": "Where is the cyclist right now?", "options": ["A. Turning a corner.", "B. Going uphill.", "C. On a straight road.", "D. About to reach a roundabout."], "answer": "C", "time_stamp_s": 374, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [372, 392], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_172_a527_q0", "video_id": 172, "time_stamp_s": 374, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "57b02ae1acbf4dfa95c4e67b805bc859ac18b6b40814da10ff04b8d62b15d94f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667], "recent_frames_sha256": "1fb0e4d84d3ca42d7c7a9c95bbb8e6bf7a03cde834cbadbd5f381228b41c1466", "num_recent_frames": 30, "tq": 717688.830691144, "t1": 717699.718197822, "ta": 717699.718197822, "te": 717699.77501536, "first_response_s": 10.887506678001955, "answer_total_s": 10.944324215990491, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_172_a527_q0", "video_id": 172, "time_stamp_s": 374, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1e90626a5e011783d045354d2e26fe38cc0825cdaad83c2f38fb5f0127a1313b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cyclist rides through a town, passing buildings and traffic lights, with speed fluctuating between 28-79 km/h.  \n- A map overlay on the right shows a route with a blue line indicating progress, and a temperature of 33°C is displayed.  \n- The cyclist approaches a large commercial building with flags, then turns right onto a road lined with trees and parked cars.\n[30-60s] - Road sign for \"Bäckström\" visible on right side, indicating a location or business.\n- A stone arch bridge with graffiti appears ahead, crossing the road.\n- Traffic light and road markings indicate an intersection approaching.\n[60-90s] - A brick building with large windows lines the right side of the road, showing signs of industrial use.  \n- The road curves slightly to the left, passing a fenced area with greenery and a sign indicating a direction to \"Höchst\" and \"Höchst\".  \n- A pedestrian crossing appears ahead, followed by a road sign indicating a right turn or intersection.\n[90-120s] - Road surface shows slight incline with speedometer reading 2% grade, transitioning from 72 to 82 km/h.\n- Right side features a continuous fence and trees, while left side reveals buildings and parked vehicles.\n- GPS map overlay indicates location near Hohne with temperature at 34°C, and distance increasing from 0.7 to 0.9 km.\n[120-150s] - A cyclist passes a white building with a sign reading \"AIR VENTURE\" while riding on a paved road.\n- The cyclist continues past a row of buildings with a metal fence on the right side of the road.\n- The cyclist's speed decreases from 65 to 24 km/h as they approach a traffic light and a pedestrian crossing.\n[150-180s] - A white van passes on the right, followed by a silver car and then a red car, all moving in the same direction.  \n- The road curves slightly to the left, with a stone wall and greenery on the left side.  \n- The speedometer shows a decreasing speed from 67 to 60 km/h, indicating slowing down.\n[180-210s] - Road surface shows slight incline with speedometer indicating 24-30 km/h and distance increasing from 1.4 to 1.6 km.\n- Trees line the right side of the road, with a brick building visible alongside them, showing graffiti on its wall.\n- A white van passes in the opposite direction, appearing at 1:26 and moving away from the camera's perspective.\n[210-240s] - Road speed fluctuates between 21–70 km/h as the cyclist navigates a tree-lined street with a brick building on the right.  \n- A white car passes on the left, followed by a cyclist, while a yellow sign with \"Höhe\" appears near the building.  \n- The route map on the right shows a blue dot moving along a path, with temperature at 38°C and distance increasing from 1.0 to 1.8 km.\n[240-270s] - Road surface shows slight incline (1% grade) with distance increasing to 2.0 KM.\n- A silver car passes on the left, then a yellow vehicle appears ahead on the right.\n- On-screen map displays a white outline of the UK with a blue dot indicating current location.\n[270-300s] - Road speed increases from 75 to 89 km/h as the cyclist ascends a gentle incline.\n- A white bus passes on the left, followed by a black car, indicating traffic movement.\n- The route map on the right shows a continuous path with a temperature of 28°C.\n[300-330s] - Road speed fluctuates between 22–30 km/h as cyclist approaches a bridge.\n- A black car overtakes from the left lane, then exits the frame.\n- Right-side hedge and trees line the road, with a map overlay showing route progress.\n[330-360s] - Road speed fluctuates between 24-79 km/h as cyclist navigates through town streets.  \n- A yellow building with a sign is passed on the right, followed by a tunnel entrance with red-and-white striped barriers.  \n- The route map on screen shows the cyclist’s position near a town center, with temperature at 28°C.", "history_tokens": 978, "history_utf8_bytes": 3803, "recent_frame_times_s": [344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667], "recent_frames_sha256": "1fb0e4d84d3ca42d7c7a9c95bbb8e6bf7a03cde834cbadbd5f381228b41c1466", "num_recent_frames": 30, "tq": 717869.050909011, "t1": 717870.928253664, "ta": 717870.928253664, "te": 717870.969692515, "first_response_s": 1.8773446530103683, "answer_total_s": 1.9187835039338097, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 172, "content_group": "a3873e9f85110e27da67089ed128b9922928ef553991db906da6e64d7e2ac472", "question": {"question_id": "sample_172_a528_q0", "video_id": 172, "video_path": "./videos/sample_172_real.mp4", "annotation_index": 528, "question_index": 0, "question": "Where is the big red truck?", "options": ["A. On the left side of the cyclist.", "B. Behind the cyclist, on the right.", "C. On the right side of the main path.", "D. Ahead, to the left."], "answer": "A", "time_stamp_s": 560, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [496, 516], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_172_a528_q0", "video_id": 172, "time_stamp_s": 560, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "653b4ce05ba40ac4b24924bf168b6fefd45c7e969047707f42fc10e257455b49", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333, 554.0201333333333, 555.0211333333333, 556.0221333333334, 557.0231333333334, 558.0241333333333, 559.0251333333333], "recent_frames_sha256": "4359608b97d13a7124a23952241747da69035da5f59cf095746878378b5a3096", "num_recent_frames": 30, "tq": 717699.806139887, "t1": 717712.512564579, "ta": 717712.512564579, "te": 717712.550471905, "first_response_s": 12.706424692063592, "answer_total_s": 12.74433201807551, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_172_a528_q0", "video_id": 172, "time_stamp_s": 560, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2094787dedcb5b80ad2316bffdeb8a150b302b57e519f0d21f5ea342c6ac5fa7", "condition_order": ["recent", "notes"], "memory": "[180-210s] - Road surface shows slight incline with speedometer indicating 24-30 km/h and distance increasing from 1.4 to 1.6 km.\n- Trees line the right side of the road, with a brick building visible alongside them, showing graffiti on its wall.\n- A white van passes in the opposite direction, appearing at 1:26 and moving away from the camera's perspective.\n[210-240s] - Road speed fluctuates between 21–70 km/h as the cyclist navigates a tree-lined street with a brick building on the right.  \n- A white car passes on the left, followed by a cyclist, while a yellow sign with \"Höhe\" appears near the building.  \n- The route map on the right shows a blue dot moving along a path, with temperature at 38°C and distance increasing from 1.0 to 1.8 km.\n[240-270s] - Road surface shows slight incline (1% grade) with distance increasing to 2.0 KM.\n- A silver car passes on the left, then a yellow vehicle appears ahead on the right.\n- On-screen map displays a white outline of the UK with a blue dot indicating current location.\n[270-300s] - Road speed increases from 75 to 89 km/h as the cyclist ascends a gentle incline.\n- A white bus passes on the left, followed by a black car, indicating traffic movement.\n- The route map on the right shows a continuous path with a temperature of 28°C.\n[300-330s] - Road speed fluctuates between 22–30 km/h as cyclist approaches a bridge.\n- A black car overtakes from the left lane, then exits the frame.\n- Right-side hedge and trees line the road, with a map overlay showing route progress.\n[330-360s] - Road speed fluctuates between 24-79 km/h as cyclist navigates through town streets.  \n- A yellow building with a sign is passed on the right, followed by a tunnel entrance with red-and-white striped barriers.  \n- The route map on screen shows the cyclist’s position near a town center, with temperature at 28°C.\n[360-390s] - A silver car passes on the left, followed by a black SUV, then a red car, all moving in the same direction.  \n- A white van turns right at a street corner, followed by another white van approaching from the opposite direction.  \n- The road curves slightly to the right, bordered by green hedges and residential buildings under a clear blue sky.\n[390-420s] - Road transitions from paved to gravel, flanked by dense green trees.  \n- Speedometer shows decreasing speed from 72 to 68 km/h as the road curves left.  \n- On-screen display indicates 3.0–3.1 km distance, 1% incline, and 72–70 minutes remaining.\n[420-450s] - Road surface shows slight incline with 3% gradient, consistent throughout the segment.  \n- GPS map overlay indicates current location near the UK's northern coastline.  \n- Speedometer fluctuates between 21–28 km/h, with distance increasing from 3.2 to 3.3 km.\n[450-480s] - Road surface transitions from paved to gravel, with elevation gain increasing from 3% to 7%.\n- Forest canopy density decreases as the path opens slightly, revealing more sky and surrounding greenery.\n- On-screen metrics show distance increasing from 3.4 km to 3.5 km, with time progressing from 67 min to 71 min.\n[480-510s] - Road surface shows slight incline with consistent 1% gradient, marked by changing elevation data on screen.\n- Trees on both sides of the path are dense and green, with sunlight filtering through leaves.\n- On-screen display shows distance increasing from 3.5 to 3.7 km, with temperature at 34°C and location labeled \"Hohne\".\n[510-540s] - Road surface transitions from paved to gravel, with a 3% incline indicated.  \n- Trees and greenery line both sides of the road, with yellow wildflowers appearing on the right.  \n- On-screen display shows 3.7 KM distance, 76-77 minutes elapsed, and 22-24°C temperature.", "history_tokens": 985, "history_utf8_bytes": 3705, "recent_frame_times_s": [530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333, 554.0201333333333, 555.0211333333333, 556.0221333333334, 557.0231333333334, 558.0241333333333, 559.0251333333333], "recent_frames_sha256": "4359608b97d13a7124a23952241747da69035da5f59cf095746878378b5a3096", "num_recent_frames": 30, "tq": 717907.914774989, "t1": 717909.387145085, "ta": 717909.387145085, "te": 717909.579642956, "first_response_s": 1.4723700960166752, "answer_total_s": 1.6648679670179263, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 174, "content_group": "a84e993062d0fdea37af309c1bc0b4ef58f40308b47c53a4b2af094224621c73", "question": {"question_id": "sample_174_a215_q0", "video_id": 174, "video_path": "./videos/sample_174_real.mp4", "annotation_index": 215, "question_index": 0, "question": "What is located on the left side of the current road?", "options": ["A. A dense forest.", "B. An open field.", "C. A river.", "D. A row of houses."], "answer": "B", "time_stamp_s": 10, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_174_a215_q0", "video_id": 174, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "40d011ea02132b891969cd94e4bdaf6a8795ccfabb4d966f0a380592a50277ac", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.034, 1.0016333333333334, 2.0026333333333333, 3.003633333333333, 4.0046333333333335, 5.005633333333333, 6.006633333333333, 7.007633333333334, 8.008633333333334, 9.009633333333333], "recent_frames_sha256": "c770e9a6ba8711dda0d4d263568fe8b5caf1e8fed5f2d5e0e053453ee6e439c2", "num_recent_frames": 10, "tq": 718963.480635778, "t1": 718969.152901651, "ta": 718969.152901651, "te": 718969.19263267, "first_response_s": 5.672265872941352, "answer_total_s": 5.71199689200148, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_174_a215_q0", "video_id": 174, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "05ba92b453e808133743ad970b71df8c8711410f800044a0519fd0ac9f6b6d06", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.034, 1.0016333333333334, 2.0026333333333333, 3.003633333333333, 4.0046333333333335, 5.005633333333333, 6.006633333333333, 7.007633333333334, 8.008633333333334, 9.009633333333333], "recent_frames_sha256": "c770e9a6ba8711dda0d4d263568fe8b5caf1e8fed5f2d5e0e053453ee6e439c2", "num_recent_frames": 10, "tq": 719006.438574115, "t1": 719018.282839298, "ta": 719018.282839298, "te": 719018.469332766, "first_response_s": 11.844265182968229, "answer_total_s": 12.03075865097344, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 174, "content_group": "a84e993062d0fdea37af309c1bc0b4ef58f40308b47c53a4b2af094224621c73", "question": {"question_id": "sample_174_a216_q0", "video_id": 174, "video_path": "./videos/sample_174_real.mp4", "annotation_index": 216, "question_index": 0, "question": "Where is the wire fence located right now?", "options": ["A. On the right side of the road.", "B. On the left side of the road.", "C. Ahead on the left.", "D. Behind on the right."], "answer": "B", "time_stamp_s": 140, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [122, 142], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_174_a216_q0", "video_id": 174, "time_stamp_s": 140, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b6c9955d46035d17d765a2d7bca74fcc4b830a98690170027f6d80120ae4885d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [110.01053333333333, 111.01153333333333, 112.01253333333334, 113.01353333333333, 114.01453333333333, 115.01553333333334, 116.01653333333333, 117.01753333333333, 118.01853333333334, 119.01953333333333, 120.02053333333333, 121.02153333333334, 122.02253333333333, 123.02353333333333, 124.02453333333334, 125.02553333333333, 126.02653333333333, 127.02753333333334, 128.02853333333334, 129.02953333333335, 130.03053333333332, 131.03153333333333, 132.03253333333333, 133.00016666666667, 134.00116666666668, 135.00216666666665, 136.00316666666666, 137.00416666666666, 138.00516666666667, 139.00616666666667], "recent_frames_sha256": "15464a158d2fcaf18884ab6dadf9606acc09ec5a8598627966accb825f7dea0f", "num_recent_frames": 30, "tq": 718969.222224342, "t1": 718977.639666417, "ta": 718977.639666417, "te": 718977.841230657, "first_response_s": 8.417442074976861, "answer_total_s": 8.619006314896978, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_174_a216_q0", "video_id": 174, "time_stamp_s": 140, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6fad1e6140b5ce91d17b6425657c0cfa26037c1f51f8f1c1da63087f77bb1c8c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Road surface curves left, bordered by golden fields and green trees under a clear blue sky.  \n- On-screen data shows speed decreasing from 72 to 70 km/h, distance increasing from 13.3 to 13.6 km, and elevation dropping from 2% to 1%.  \n- Map overlay indicates a route through a region with a temperature of 34°C and a current altitude of 134.6 m.\n[30-60s] - Road surface transitions from paved to gravel, with trees lining both sides.  \n- Speed fluctuates between 24-93 km/h, and elevation changes from +2% to -1%.  \n- GPS map shows a route through a rural area with a marked location near a forested zone.\n[60-90s] - Road surface transitions from paved to gravel, with trees lining both sides.  \n- A red car passes on the right, followed by a white vehicle further ahead.  \n- On-screen data shows speed fluctuating between 45–50 km/h, with distance increasing to 14.0 km.\n[90-120s] - Road transitions from tree-lined to open field with visible elevation drop (-1% to -9%).\n- A white car appears on the left side of the road, moving in the same direction as the cyclist.\n- The map overlay shows the cyclist's position near the top of the UK map, with a temperature of 33°C.", "history_tokens": 322, "history_utf8_bytes": 1187, "recent_frame_times_s": [110.01053333333333, 111.01153333333333, 112.01253333333334, 113.01353333333333, 114.01453333333333, 115.01553333333334, 116.01653333333333, 117.01753333333333, 118.01853333333334, 119.01953333333333, 120.02053333333333, 121.02153333333334, 122.02253333333333, 123.02353333333333, 124.02453333333334, 125.02553333333333, 126.02653333333333, 127.02753333333334, 128.02853333333334, 129.02953333333335, 130.03053333333332, 131.03153333333333, 132.03253333333333, 133.00016666666667, 134.00116666666668, 135.00216666666665, 136.00316666666666, 137.00416666666666, 138.00516666666667, 139.00616666666667], "recent_frames_sha256": "15464a158d2fcaf18884ab6dadf9606acc09ec5a8598627966accb825f7dea0f", "num_recent_frames": 30, "tq": 719051.581163959, "t1": 719088.45020565, "ta": 719088.45020565, "te": 719088.675114509, "first_response_s": 36.869041690952145, "answer_total_s": 37.09395054995548, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 174, "content_group": "a84e993062d0fdea37af309c1bc0b4ef58f40308b47c53a4b2af094224621c73", "question": {"question_id": "sample_174_a217_q0", "video_id": 174, "video_path": "./videos/sample_174_real.mp4", "annotation_index": 217, "question_index": 0, "question": "What is situated on the right side of the path right now?", "options": ["A. A lamp post.", "B. A bench.", "C. A trash can.", "D. A bicycle rack."], "answer": "B", "time_stamp_s": 259, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [244, 264], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_174_a217_q0", "video_id": 174, "time_stamp_s": 259, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f8f959b5b2c8d1d0b5b1bf9f016e7e119193ff5a765891c55beabaf26583addb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [229.02943333333334, 230.03043333333332, 231.03143333333333, 232.03243333333333, 233.00006666666667, 234.00106666666667, 235.00206666666668, 236.00306666666665, 237.00406666666666, 238.00506666666666, 239.00606666666667, 240.00706666666667, 241.00806666666668, 242.00906666666666, 243.01006666666666, 244.01106666666666, 245.01206666666667, 246.01306666666667, 247.01406666666668, 248.01506666666666, 249.01606666666666, 250.01706666666666, 251.01806666666667, 252.01906666666667, 253.02006666666668, 254.02106666666666, 255.02206666666666, 256.0230666666667, 257.02406666666667, 258.02506666666665], "recent_frames_sha256": "0647c2ede287b98bf2f4f4d7b82516dd311871951ff70dc8ec225cc7e6150fcc", "num_recent_frames": 30, "tq": 718977.867060254, "t1": 718985.259925696, "ta": 718985.259925696, "te": 718985.298165679, "first_response_s": 7.39286544197239, "answer_total_s": 7.431105424999259, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_174_a217_q0", "video_id": 174, "time_stamp_s": 259, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2d83bd3e15dc3db1aa6f7742c39fe04db6e43e6f4997bc9e9d31b2f3a5e26fc0", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Road surface curves left, bordered by golden fields and green trees under a clear blue sky.  \n- On-screen data shows speed decreasing from 72 to 70 km/h, distance increasing from 13.3 to 13.6 km, and elevation dropping from 2% to 1%.  \n- Map overlay indicates a route through a region with a temperature of 34°C and a current altitude of 134.6 m.\n[30-60s] - Road surface transitions from paved to gravel, with trees lining both sides.  \n- Speed fluctuates between 24-93 km/h, and elevation changes from +2% to -1%.  \n- GPS map shows a route through a rural area with a marked location near a forested zone.\n[60-90s] - Road surface transitions from paved to gravel, with trees lining both sides.  \n- A red car passes on the right, followed by a white vehicle further ahead.  \n- On-screen data shows speed fluctuating between 45–50 km/h, with distance increasing to 14.0 km.\n[90-120s] - Road transitions from tree-lined to open field with visible elevation drop (-1% to -9%).\n- A white car appears on the left side of the road, moving in the same direction as the cyclist.\n- The map overlay shows the cyclist's position near the top of the UK map, with a temperature of 33°C.\n[120-150s] - Road surface shows slight incline, indicated by 1% gradient on display.\n- Left side of road bordered by open field, right side by dense tree line.\n- GPS map overlay shows current position near a marked location in the UK.\n[150-180s] - Road elevation slightly ascends, indicated by a 1% incline, while speed fluctuates between 75 and 80 km/h.\n- Right side of road lined with dense green trees, left side shows open fields under clear blue sky.\n- GPS map overlay shows route progress toward a destination marked in the upper right corner.\n[180-210s] - Road elevation gradually increases, indicated by slope percentage shifting from -1% to +2%.\n- Distance traveled increases from 14.9 km to 15.1 km, with estimated time remaining decreasing from 76:14 min to 72:14 min.\n- Temperature remains steady at 33°C, and the map shows a fixed location near the top of the UK outline.\n[210-240s] - Road surface shows gradual incline, with speedometer reading decreasing from 82 to 25 km/h over the segment.\n- Trees on both sides of the road become denser, creating a shaded corridor effect.\n- GPS map overlay indicates position near Hohne, with temperature at 33°C and distance increasing from 15.1 to 15.4 km.", "history_tokens": 646, "history_utf8_bytes": 2400, "recent_frame_times_s": [229.02943333333334, 230.03043333333332, 231.03143333333333, 232.03243333333333, 233.00006666666667, 234.00106666666667, 235.00206666666668, 236.00306666666665, 237.00406666666666, 238.00506666666666, 239.00606666666667, 240.00706666666667, 241.00806666666668, 242.00906666666666, 243.01006666666666, 244.01106666666666, 245.01206666666667, 246.01306666666667, 247.01406666666668, 248.01506666666666, 249.01606666666666, 250.01706666666666, 251.01806666666667, 252.01906666666667, 253.02006666666668, 254.02106666666666, 255.02206666666666, 256.0230666666667, 257.02406666666667, 258.02506666666665], "recent_frames_sha256": "0647c2ede287b98bf2f4f4d7b82516dd311871951ff70dc8ec225cc7e6150fcc", "num_recent_frames": 30, "tq": 719116.637660105, "t1": 719123.640863854, "ta": 719123.640863854, "te": 719123.682525952, "first_response_s": 7.003203748958185, "answer_total_s": 7.044865846983157, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 174, "content_group": "a84e993062d0fdea37af309c1bc0b4ef58f40308b47c53a4b2af094224621c73", "question": {"question_id": "sample_174_a218_q0", "video_id": 174, "video_path": "./videos/sample_174_real.mp4", "annotation_index": 218, "question_index": 0, "question": "Where are the overhead power lines located right now?", "options": ["A. Crossing the road ahead.", "B. Running parallel to the left of the road.", "C. Running parallel to the right of the road.", "D. Not visible at the moment."], "answer": "B", "time_stamp_s": 377, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [366, 386], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_174_a218_q0", "video_id": 174, "time_stamp_s": 377, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "48984c5f998651e131523ee08371e862e32a0f4fc01dcb3e8c690e0b7cdae483", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [347.01396666666665, 348.0149666666667, 349.01596666666666, 350.0169666666667, 351.01796666666667, 352.01896666666664, 353.0199666666667, 354.02096666666665, 355.0219666666667, 356.02296666666666, 357.0239666666667, 358.02496666666667, 359.02596666666665, 360.0269666666667, 361.02796666666666, 362.0289666666667, 363.02996666666667, 364.03096666666664, 365.0319666666667, 366.03296666666665, 367.0006, 368.0016, 369.0026, 370.0036, 371.0046, 372.0056, 373.0066, 374.0076, 375.0086, 376.0096], "recent_frames_sha256": "56b6c8ea81d514a909b26037de2b98f28474830b04b73a13f34eeff7768236a7", "num_recent_frames": 30, "tq": 718985.310717182, "t1": 718998.327208059, "ta": 718998.327208059, "te": 718998.365394765, "first_response_s": 13.016490877023898, "answer_total_s": 13.054677583044395, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_174_a218_q0", "video_id": 174, "time_stamp_s": 377, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "552e03c7ad07c0bdc6bba960ee77101f5af4518ac5798da9f4a92fe2172e2285", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Road surface curves left, bordered by golden fields and green trees under a clear blue sky.  \n- On-screen data shows speed decreasing from 72 to 70 km/h, distance increasing from 13.3 to 13.6 km, and elevation dropping from 2% to 1%.  \n- Map overlay indicates a route through a region with a temperature of 34°C and a current altitude of 134.6 m.\n[30-60s] - Road surface transitions from paved to gravel, with trees lining both sides.  \n- Speed fluctuates between 24-93 km/h, and elevation changes from +2% to -1%.  \n- GPS map shows a route through a rural area with a marked location near a forested zone.\n[60-90s] - Road surface transitions from paved to gravel, with trees lining both sides.  \n- A red car passes on the right, followed by a white vehicle further ahead.  \n- On-screen data shows speed fluctuating between 45–50 km/h, with distance increasing to 14.0 km.\n[90-120s] - Road transitions from tree-lined to open field with visible elevation drop (-1% to -9%).\n- A white car appears on the left side of the road, moving in the same direction as the cyclist.\n- The map overlay shows the cyclist's position near the top of the UK map, with a temperature of 33°C.\n[120-150s] - Road surface shows slight incline, indicated by 1% gradient on display.\n- Left side of road bordered by open field, right side by dense tree line.\n- GPS map overlay shows current position near a marked location in the UK.\n[150-180s] - Road elevation slightly ascends, indicated by a 1% incline, while speed fluctuates between 75 and 80 km/h.\n- Right side of road lined with dense green trees, left side shows open fields under clear blue sky.\n- GPS map overlay shows route progress toward a destination marked in the upper right corner.\n[180-210s] - Road elevation gradually increases, indicated by slope percentage shifting from -1% to +2%.\n- Distance traveled increases from 14.9 km to 15.1 km, with estimated time remaining decreasing from 76:14 min to 72:14 min.\n- Temperature remains steady at 33°C, and the map shows a fixed location near the top of the UK outline.\n[210-240s] - Road surface shows gradual incline, with speedometer reading decreasing from 82 to 25 km/h over the segment.\n- Trees on both sides of the road become denser, creating a shaded corridor effect.\n- GPS map overlay indicates position near Hohne, with temperature at 33°C and distance increasing from 15.1 to 15.4 km.\n[240-270s] - Road surface shows slight incline, with speedometer indicating 73-83 km/h and elevation gain around 3-4%.\n- Left side of road features tall trees and grassy embankment, while right side has dense foliage and a power line tower.\n- On-screen display shows route progress (15.4–15.7 km), time (77–81 min), and temperature (33°C), with a map outline of the region.\n[270-300s] - Road surface transitions from narrow, tree-lined path to wider asphalt road with visible power lines overhead.  \n- Speedometer fluctuates between 30–85 km/h, indicating variable pedaling effort.  \n- GPS map shows position moving northeast, with distance increasing from 15.7 to 16.0 km.\n[300-330s] - Road curves left, then right, flanked by dense green trees and grassy verges under clear blue sky.\n- GPS overlay shows route progress with a blue dot indicating current position near a tunnel entrance.\n- Speed fluctuates between 30–90 km/h, with incline/decline indicators showing minor terrain changes.\n[330-360s] - Road surface shows slight incline, with speed decreasing from 95 to 75 km/h over the segment.\n- Trees line both sides of the road, with a power line tower visible on the left.\n- On-screen display shows distance increasing from 16.4 to 16.5 km, with temperature at 33°C.", "history_tokens": 995, "history_utf8_bytes": 3684, "recent_frame_times_s": [347.01396666666665, 348.0149666666667, 349.01596666666666, 350.0169666666667, 351.01796666666667, 352.01896666666664, 353.0199666666667, 354.02096666666665, 355.0219666666667, 356.02296666666666, 357.0239666666667, 358.02496666666667, 359.02596666666665, 360.0269666666667, 361.02796666666666, 362.0289666666667, 363.02996666666667, 364.03096666666664, 365.0319666666667, 366.03296666666665, 367.0006, 368.0016, 369.0026, 370.0036, 371.0046, 372.0056, 373.0066, 374.0076, 375.0086, 376.0096], "recent_frames_sha256": "56b6c8ea81d514a909b26037de2b98f28474830b04b73a13f34eeff7768236a7", "num_recent_frames": 30, "tq": 719161.041263733, "t1": 719166.121901921, "ta": 719166.121901921, "te": 719166.159366913, "first_response_s": 5.080638188053854, "answer_total_s": 5.118103180080652, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 174, "content_group": "a84e993062d0fdea37af309c1bc0b4ef58f40308b47c53a4b2af094224621c73", "question": {"question_id": "sample_174_a219_q0", "video_id": 174, "video_path": "./videos/sample_174_real.mp4", "annotation_index": 219, "question_index": 0, "question": "What is visible on the left side of the path right now?", "options": ["A. A field with some fencing.", "B. A dense forest.", "C. A village with a few houses.", "D. A river flowing parallel to the path."], "answer": "A", "time_stamp_s": 498, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [488, 508], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_174_a219_q0", "video_id": 174, "time_stamp_s": 498, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d5d12a7ffda02a05ecaea56cdd7e780a96477e5d8ad7708d96934c003ae9be43", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [468.0015, 469.0025, 470.0035, 471.0045, 472.0055, 473.0065, 474.0075, 475.0085, 476.0095, 477.0105, 478.0115, 479.0125, 480.0135, 481.0145, 482.0155, 483.0165, 484.0175, 485.0185, 486.0195, 487.0205, 488.0215, 489.0225, 490.0235, 491.0245, 492.0255, 493.0265, 494.0275, 495.0285, 496.0295, 497.0305], "recent_frames_sha256": "a7b12ca31ae1fb26462a9945dc5d6c88a6ea978f664a191e184c15f9a0392396", "num_recent_frames": 30, "tq": 718998.384394199, "t1": 719006.390497056, "ta": 719006.390497056, "te": 719006.428503736, "first_response_s": 8.006102856947109, "answer_total_s": 8.044109537033364, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_174_a219_q0", "video_id": 174, "time_stamp_s": 498, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "889c1ed5990722669b031790c5ea43fe50c9d76cd4b44d116673173ee23560bd", "condition_order": ["recent", "notes"], "memory": "[120-150s] - Road surface shows slight incline, indicated by 1% gradient on display.\n- Left side of road bordered by open field, right side by dense tree line.\n- GPS map overlay shows current position near a marked location in the UK.\n[150-180s] - Road elevation slightly ascends, indicated by a 1% incline, while speed fluctuates between 75 and 80 km/h.\n- Right side of road lined with dense green trees, left side shows open fields under clear blue sky.\n- GPS map overlay shows route progress toward a destination marked in the upper right corner.\n[180-210s] - Road elevation gradually increases, indicated by slope percentage shifting from -1% to +2%.\n- Distance traveled increases from 14.9 km to 15.1 km, with estimated time remaining decreasing from 76:14 min to 72:14 min.\n- Temperature remains steady at 33°C, and the map shows a fixed location near the top of the UK outline.\n[210-240s] - Road surface shows gradual incline, with speedometer reading decreasing from 82 to 25 km/h over the segment.\n- Trees on both sides of the road become denser, creating a shaded corridor effect.\n- GPS map overlay indicates position near Hohne, with temperature at 33°C and distance increasing from 15.1 to 15.4 km.\n[240-270s] - Road surface shows slight incline, with speedometer indicating 73-83 km/h and elevation gain around 3-4%.\n- Left side of road features tall trees and grassy embankment, while right side has dense foliage and a power line tower.\n- On-screen display shows route progress (15.4–15.7 km), time (77–81 min), and temperature (33°C), with a map outline of the region.\n[270-300s] - Road surface transitions from narrow, tree-lined path to wider asphalt road with visible power lines overhead.  \n- Speedometer fluctuates between 30–85 km/h, indicating variable pedaling effort.  \n- GPS map shows position moving northeast, with distance increasing from 15.7 to 16.0 km.\n[300-330s] - Road curves left, then right, flanked by dense green trees and grassy verges under clear blue sky.\n- GPS overlay shows route progress with a blue dot indicating current position near a tunnel entrance.\n- Speed fluctuates between 30–90 km/h, with incline/decline indicators showing minor terrain changes.\n[330-360s] - Road surface shows slight incline, with speed decreasing from 95 to 75 km/h over the segment.\n- Trees line both sides of the road, with a power line tower visible on the left.\n- On-screen display shows distance increasing from 16.4 to 16.5 km, with temperature at 33°C.\n[360-390s] - Road surface transitions from paved to gravel, with speed decreasing from 33 to 30 km/h.\n- Trees and grassy embankments flank the road, with a power line tower visible in the distance.\n- A map overlay shows a route through a region with a blue marker indicating current position.\n[390-420s] - Road surface transitions from open field to dense tree-lined path, with speed fluctuating between 41-48 km/h.  \n- GPS map on right shows route progress with a blue dot indicating current position near a forested area.  \n- Temperature remains steady at 33°C, and elevation gain is minimal, with slight inclines and declines visible.\n[420-450s] - Road surface shows slight incline, with speedometer indicating gradual increase from 24 to 28 km/h.\n- Right side of road lined with dense green trees, left side features open fields and distant hills.\n- On-screen display shows consistent distance (17.3–17.5 km) and time (75–78 min), with temperature at 23°C.\n[450-480s] - A white van is parked on the right side of a dirt road, with a silver car visible behind it.  \n- The road curves slightly to the right, passing through a green, tree-lined area under a clear blue sky.  \n- A map overlay on the screen shows a location marked in the UK, with a temperature of 20°C displayed.", "history_tokens": 1005, "history_utf8_bytes": 3783, "recent_frame_times_s": [468.0015, 469.0025, 470.0035, 471.0045, 472.0055, 473.0065, 474.0075, 475.0085, 476.0095, 477.0105, 478.0115, 479.0125, 480.0135, 481.0145, 482.0155, 483.0165, 484.0175, 485.0185, 486.0195, 487.0205, 488.0215, 489.0225, 490.0235, 491.0245, 492.0255, 493.0265, 494.0275, 495.0285, 496.0295, 497.0305], "recent_frames_sha256": "a7b12ca31ae1fb26462a9945dc5d6c88a6ea978f664a191e184c15f9a0392396", "num_recent_frames": 30, "tq": 719201.943781331, "t1": 719208.500523847, "ta": 719208.500523847, "te": 719208.542483767, "first_response_s": 6.55674251599703, "answer_total_s": 6.5987024360802025, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 175, "content_group": "d70ad2b326323b0b7aab0afa6017f6303ccc9dbfa03cf3cd5eb280ef6b320374", "question": {"question_id": "sample_175_a224_q0", "video_id": 175, "video_path": "./videos/sample_175_real.mp4", "annotation_index": 224, "question_index": 0, "question": "Where is the cyclist with the number 894 located relative to the main pack right now?", "options": ["A. Leading the main pack.", "B. Directly behind the main pack.", "C. In the middle of the main pack.", "D. To the side of the main pack."], "answer": "B", "time_stamp_s": 19, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_175_a224_q0", "video_id": 175, "time_stamp_s": 19, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "144db6481b5b75d9779d5d9c69002354c8029b6c4a19f5fb2f90c091fdfc95dd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.018, 1.0023166666666667, 2.0033166666666666, 3.0043166666666665, 4.005316666666666, 5.006316666666667, 6.007316666666667, 7.0083166666666665, 8.009316666666667, 9.010316666666666, 10.011316666666668, 11.012316666666667, 12.013316666666666, 13.014316666666666, 14.015316666666667, 15.016316666666667, 16.000633333333333, 17.001633333333334, 18.002633333333332], "recent_frames_sha256": "a1a5141f6a8d783203dc33ae6a2727800c29c6090debfedaed20a1bebb659b97", "num_recent_frames": 19, "tq": 717624.989318336, "t1": 717626.810951799, "ta": 717626.810951799, "te": 717626.850651523, "first_response_s": 1.8216334630269557, "answer_total_s": 1.8613331869710237, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_175_a224_q0", "video_id": 175, "time_stamp_s": 19, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "23a7843220e0db651731745e0fe2b8bffb17afca5e90bca1d74e73e9200c8809", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.018, 1.0023166666666667, 2.0033166666666666, 3.0043166666666665, 4.005316666666666, 5.006316666666667, 6.007316666666667, 7.0083166666666665, 8.009316666666667, 9.010316666666666, 10.011316666666668, 11.012316666666667, 12.013316666666666, 13.014316666666666, 14.015316666666667, 15.016316666666667, 16.000633333333333, 17.001633333333334, 18.002633333333332], "recent_frames_sha256": "a1a5141f6a8d783203dc33ae6a2727800c29c6090debfedaed20a1bebb659b97", "num_recent_frames": 19, "tq": 717448.939993276, "t1": 717460.440360337, "ta": 717460.440360337, "te": 717460.853091907, "first_response_s": 11.50036706100218, "answer_total_s": 11.91309863096103, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 175, "content_group": "d70ad2b326323b0b7aab0afa6017f6303ccc9dbfa03cf3cd5eb280ef6b320374", "question": {"question_id": "sample_175_a225_q0", "video_id": 175, "video_path": "./videos/sample_175_real.mp4", "annotation_index": 225, "question_index": 0, "question": "What structure is the cyclist approaching right now?", "options": ["A. A National Championships banner.", "B. A McDonald's sign.", "C. A residential building.", "D. A traffic light."], "answer": "A", "time_stamp_s": 127, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [125, 145], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_175_a225_q0", "video_id": 175, "time_stamp_s": 127, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2c626e012e113ed2e677bfee86282c40c1d57517f854ee0c8a68e0878f8e0711", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [97.0149, 98.0159, 99.00021666666666, 100.00121666666666, 101.00221666666667, 102.00321666666666, 103.00421666666666, 104.00521666666667, 105.00621666666666, 106.00721666666666, 107.00821666666667, 108.00921666666666, 109.01021666666666, 110.01121666666667, 111.01221666666666, 112.01321666666666, 113.01421666666667, 114.01521666666666, 115.01621666666666, 116.00053333333334, 117.00153333333333, 118.00253333333333, 119.00353333333334, 120.00453333333333, 121.00553333333333, 122.00653333333334, 123.00753333333333, 124.00853333333333, 125.00953333333334, 126.01053333333333], "recent_frames_sha256": "381dd0d4ef145f2360bfef9c0ab726a3d105cb6338f9051ee331419c8123c592", "num_recent_frames": 30, "tq": 717626.861129153, "t1": 717638.386417719, "ta": 717638.386417719, "te": 717638.424172381, "first_response_s": 11.525288565899245, "answer_total_s": 11.563043228001334, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_175_a225_q0", "video_id": 175, "time_stamp_s": 127, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "14bd7bc860704d2cd91af89ce5f62c88c886507dee3a2fd90caeb2bbb0ccdd6d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclist in black jersey (number 894) leads group, maintaining 182 rpm cadence through urban streets.  \n- Race route marked by green barriers, with spectators and buildings lining the path; distance decreases from 4289m to 4250m.  \n- On-screen metrics show performance data (power, cadence, distance) and a map indicating route progress.\n[30-60s] - Cyclist in white jersey and black shorts maintains high cadence (172-178 rpm) while riding in a tight pack.  \n- Roadside spectators and barriers line the course, with buildings and traffic lights visible in the background.  \n- On-screen metrics show distance decreasing (42,489m to 42,214m) and pace fluctuating (33.5 to 24.5 km/h) as the group navigates urban streets.\n[60-90s] - Cyclist in white jersey leads group, maintaining high cadence (173 rpm) as they navigate urban streets.  \n- Group rides past modern buildings and traffic lights, with a green banner visible on the right side of the road.  \n- Distance marker shows 4176m remaining, with speed fluctuating between 28–38 km/h as they approach a turn.\n[90-120s] - Cyclist in white jersey and black shorts rides ahead, maintaining a steady pace with a heart rate of 168 bpm.  \n- A cyclist in orange jersey and black shorts is positioned slightly behind, showing a heart rate of 170 bpm.  \n- The group navigates a city street with buildings on both sides, passing a crosswalk and a storefront with visible signage.", "history_tokens": 380, "history_utf8_bytes": 1432, "recent_frame_times_s": [97.0149, 98.0159, 99.00021666666666, 100.00121666666666, 101.00221666666667, 102.00321666666666, 103.00421666666666, 104.00521666666667, 105.00621666666666, 106.00721666666666, 107.00821666666667, 108.00921666666666, 109.01021666666666, 110.01121666666667, 111.01221666666666, 112.01321666666666, 113.01421666666667, 114.01521666666666, 115.01621666666666, 116.00053333333334, 117.00153333333333, 118.00253333333333, 119.00353333333334, 120.00453333333333, 121.00553333333333, 122.00653333333334, 123.00753333333333, 124.00853333333333, 125.00953333333334, 126.01053333333333], "recent_frames_sha256": "381dd0d4ef145f2360bfef9c0ab726a3d105cb6338f9051ee331419c8123c592", "num_recent_frames": 30, "tq": 717490.208539744, "t1": 717496.845049438, "ta": 717496.845049438, "te": 717496.883920626, "first_response_s": 6.6365096939262, "answer_total_s": 6.675380881992169, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 175, "content_group": "d70ad2b326323b0b7aab0afa6017f6303ccc9dbfa03cf3cd5eb280ef6b320374", "question": {"question_id": "sample_175_a226_q0", "video_id": 175, "video_path": "./videos/sample_175_real.mp4", "annotation_index": 226, "question_index": 0, "question": "What is the relative position of the red brick building to the cyclist right now?", "options": ["A. On the left side of the road.", "B. Directly ahead.", "C. On the right side of the road.", "D. Directly behind the cyclist."], "answer": "C", "time_stamp_s": 259, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [250, 270], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_175_a226_q0", "video_id": 175, "time_stamp_s": 259, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5a01ec4e7964a535c811b13f078c77415469c1a48a6f6a753efe9186a21339f7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [229.01343333333332, 230.01443333333333, 231.01543333333333, 232.01643333333334, 233.00075, 234.00175, 235.00275, 236.00375, 237.00475, 238.00575, 239.00675, 240.00775, 241.00875, 242.00975, 243.01075, 244.01175, 245.01275, 246.01375, 247.01475, 248.01575, 249.00006666666667, 250.00106666666667, 251.00206666666668, 252.00306666666665, 253.00406666666666, 254.00506666666666, 255.00606666666667, 256.0070666666667, 257.00806666666665, 258.0090666666667], "recent_frames_sha256": "6f35983c33280c1e66ba8da62e2950bf45bb1268a7d4f2da35ee0760be33483e", "num_recent_frames": 30, "tq": 717638.434792174, "t1": 717650.782424919, "ta": 717650.782424919, "te": 717650.821366879, "first_response_s": 12.347632744931616, "answer_total_s": 12.386574705014937, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_175_a226_q0", "video_id": 175, "time_stamp_s": 259, "ground_truth": "C", "raw_output": "A. On the left side of the road.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "424d379797392c84fb991769ac614be361bffded34a449f3becf4485ec1c1a62", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclist in black jersey (number 894) leads group, maintaining 182 rpm cadence through urban streets.  \n- Race route marked by green barriers, with spectators and buildings lining the path; distance decreases from 4289m to 4250m.  \n- On-screen metrics show performance data (power, cadence, distance) and a map indicating route progress.\n[30-60s] - Cyclist in white jersey and black shorts maintains high cadence (172-178 rpm) while riding in a tight pack.  \n- Roadside spectators and barriers line the course, with buildings and traffic lights visible in the background.  \n- On-screen metrics show distance decreasing (42,489m to 42,214m) and pace fluctuating (33.5 to 24.5 km/h) as the group navigates urban streets.\n[60-90s] - Cyclist in white jersey leads group, maintaining high cadence (173 rpm) as they navigate urban streets.  \n- Group rides past modern buildings and traffic lights, with a green banner visible on the right side of the road.  \n- Distance marker shows 4176m remaining, with speed fluctuating between 28–38 km/h as they approach a turn.\n[90-120s] - Cyclist in white jersey and black shorts rides ahead, maintaining a steady pace with a heart rate of 168 bpm.  \n- A cyclist in orange jersey and black shorts is positioned slightly behind, showing a heart rate of 170 bpm.  \n- The group navigates a city street with buildings on both sides, passing a crosswalk and a storefront with visible signage.\n[120-150s] - Cyclist in black jersey and white helmet rides ahead, maintaining steady pace with visible cadence and power metrics.\n- Roadside barriers and spectators line the street, with buildings and trees in the background as the cyclist navigates urban terrain.\n- On-screen data shows distance, speed, cadence, and power output, indicating performance tracking during the race.\n[150-180s] - Cyclist in black jersey and helmet maintains high cadence (182-185 rpm) while riding in a group.\n- Group of cyclists navigates urban streets, passing buildings and intersections with traffic lights.\n- On-screen metrics show increasing power output (205W to 285W) and distance covered (4058m to 4069m).\n[180-210s] - Cyclist in black jersey and orange shorts rides ahead, maintaining high cadence (173-178 rpm) while passing urban street barriers.\n- Group of cyclists follows closely, with one rider in blue jersey visible behind, showing consistent pace and effort.\n- On-screen metrics display distance (400m–402m) and heart rate (173–178 bpm), indicating sustained performance during the race.\n[210-240s] - Cyclist in black and yellow jersey rides ahead, maintaining a steady pace with fluctuating power output (210-230W) and cadence (175-182rpm).  \n- Group of cyclists in orange and blue jerseys follows closely, with one rider in blue jersey slightly ahead of the others.  \n- Road is lined with barriers and urban buildings; traffic lights and street signs are visible, indicating a city street environment.", "history_tokens": 757, "history_utf8_bytes": 2941, "recent_frame_times_s": [229.01343333333332, 230.01443333333333, 231.01543333333333, 232.01643333333334, 233.00075, 234.00175, 235.00275, 236.00375, 237.00475, 238.00575, 239.00675, 240.00775, 241.00875, 242.00975, 243.01075, 244.01175, 245.01275, 246.01375, 247.01475, 248.01575, 249.00006666666667, 250.00106666666667, 251.00206666666668, 252.00306666666665, 253.00406666666666, 254.00506666666666, 255.00606666666667, 256.0070666666667, 257.00806666666665, 258.0090666666667], "recent_frames_sha256": "6f35983c33280c1e66ba8da62e2950bf45bb1268a7d4f2da35ee0760be33483e", "num_recent_frames": 30, "tq": 717529.323364693, "t1": 717535.663921658, "ta": 717535.663921658, "te": 717536.035921768, "first_response_s": 6.340556964976713, "answer_total_s": 6.7125570750795305, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 175, "content_group": "d70ad2b326323b0b7aab0afa6017f6303ccc9dbfa03cf3cd5eb280ef6b320374", "question": {"question_id": "sample_175_a227_q0", "video_id": 175, "video_path": "./videos/sample_175_real.mp4", "annotation_index": 227, "question_index": 0, "question": "Where is the \"National Championships\" banner located right now?", "options": ["A. On the right side of the road.", "B. Above the cyclists.", "C. Hanging in the middle of the road.", "D. Directly behind the cyclists."], "answer": "C", "time_stamp_s": 394, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [375, 395], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_175_a227_q0", "video_id": 175, "time_stamp_s": 394, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f030bc13bc0c7dd264cab1bc9035e1f8329777cc8369151b9c769674566a1a19", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [364.0149666666667, 365.01596666666666, 366.00028333333336, 367.00128333333333, 368.0022833333333, 369.00328333333334, 370.0042833333333, 371.00528333333335, 372.00628333333333, 373.0072833333333, 374.00828333333334, 375.0092833333333, 376.01028333333335, 377.0112833333333, 378.01228333333336, 379.01328333333333, 380.0142833333333, 381.01528333333334, 382.0162833333333, 383.0006, 384.0016, 385.0026, 386.0036, 387.0046, 388.0056, 389.0066, 390.0076, 391.0086, 392.0096, 393.0106], "recent_frames_sha256": "4ef4efdab43635eb810bb65d9510957fd40dfbcf18e8378f5e589719b3cf2250", "num_recent_frames": 30, "tq": 717650.833200825, "t1": 717663.635675557, "ta": 717663.635675557, "te": 717663.674468765, "first_response_s": 12.802474731928669, "answer_total_s": 12.841267940006219, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_175_a227_q0", "video_id": 175, "time_stamp_s": 394, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d9ccf41c1ac5abf375d243a21b515a9206f733ed565ac6411b4c25c7bd527f0f", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Cyclist in white jersey leads group, maintaining high cadence (173 rpm) as they navigate urban streets.  \n- Group rides past modern buildings and traffic lights, with a green banner visible on the right side of the road.  \n- Distance marker shows 4176m remaining, with speed fluctuating between 28–38 km/h as they approach a turn.\n[90-120s] - Cyclist in white jersey and black shorts rides ahead, maintaining a steady pace with a heart rate of 168 bpm.  \n- A cyclist in orange jersey and black shorts is positioned slightly behind, showing a heart rate of 170 bpm.  \n- The group navigates a city street with buildings on both sides, passing a crosswalk and a storefront with visible signage.\n[120-150s] - Cyclist in black jersey and white helmet rides ahead, maintaining steady pace with visible cadence and power metrics.\n- Roadside barriers and spectators line the street, with buildings and trees in the background as the cyclist navigates urban terrain.\n- On-screen data shows distance, speed, cadence, and power output, indicating performance tracking during the race.\n[150-180s] - Cyclist in black jersey and helmet maintains high cadence (182-185 rpm) while riding in a group.\n- Group of cyclists navigates urban streets, passing buildings and intersections with traffic lights.\n- On-screen metrics show increasing power output (205W to 285W) and distance covered (4058m to 4069m).\n[180-210s] - Cyclist in black jersey and orange shorts rides ahead, maintaining high cadence (173-178 rpm) while passing urban street barriers.\n- Group of cyclists follows closely, with one rider in blue jersey visible behind, showing consistent pace and effort.\n- On-screen metrics display distance (400m–402m) and heart rate (173–178 bpm), indicating sustained performance during the race.\n[210-240s] - Cyclist in black and yellow jersey rides ahead, maintaining a steady pace with fluctuating power output (210-230W) and cadence (175-182rpm).  \n- Group of cyclists in orange and blue jerseys follows closely, with one rider in blue jersey slightly ahead of the others.  \n- Road is lined with barriers and urban buildings; traffic lights and street signs are visible, indicating a city street environment.\n[240-270s] - Cyclist in orange jersey and black shorts leans forward, pedaling vigorously on a paved road with buildings on the right.\n- A cyclist in blue jersey and black shorts rides ahead, maintaining a steady pace with a visible speedometer reading around 28 mph.\n- The road surface shows cracks, and the cyclists are surrounded by urban infrastructure, including traffic lights and street signs.\n[270-300s] - Cyclist in orange jersey (number 89) maintains position in the peloton, slightly ahead of others.\n- A cyclist in black jersey (number 910) rides closely behind, with a visible green ribbon marking the course boundary.\n- The road surface shows wet patches, and the camera angle captures the rear view of multiple riders navigating the urban street.\n[300-330s] - Cyclist in black jersey with \"9109\" number rides ahead, slightly right of center, maintaining high cadence.\n- Group of cyclists in orange and black jerseys closely follow, with one cyclist in purple jersey visible on the left.\n- Roadside barriers and spectators line the street, with buildings and a traffic light visible in the background.\n[330-360s] - Cyclist in teal jersey and black shorts rides ahead, maintaining a steady pace with a cadence of 167 rpm.\n- Group of cyclists follows closely, with one rider in blue and orange jersey visible to the left, navigating a city street.\n- Road signs and urban buildings pass by, indicating a city route with traffic lights and intersections.\n[360-390s] - Cyclist in white jersey and blue helmet rides ahead, maintaining pace with others.\n- A cyclist in black and yellow jersey overtakes from the right, adjusting position relative to the group.\n- On-screen metrics show speed fluctuating between 28–34 mph, with heart rate around 172–173 bpm.", "history_tokens": 966, "history_utf8_bytes": 3983, "recent_frame_times_s": [364.0149666666667, 365.01596666666666, 366.00028333333336, 367.00128333333333, 368.0022833333333, 369.00328333333334, 370.0042833333333, 371.00528333333335, 372.00628333333333, 373.0072833333333, 374.00828333333334, 375.0092833333333, 376.01028333333335, 377.0112833333333, 378.01228333333336, 379.01328333333333, 380.0142833333333, 381.01528333333334, 382.0162833333333, 383.0006, 384.0016, 385.0026, 386.0036, 387.0046, 388.0056, 389.0066, 390.0076, 391.0086, 392.0096, 393.0106], "recent_frames_sha256": "4ef4efdab43635eb810bb65d9510957fd40dfbcf18e8378f5e589719b3cf2250", "num_recent_frames": 30, "tq": 717575.66156943, "t1": 717581.526853067, "ta": 717581.526853067, "te": 717581.750640136, "first_response_s": 5.865283636958338, "answer_total_s": 6.089070705929771, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 175, "content_group": "d70ad2b326323b0b7aab0afa6017f6303ccc9dbfa03cf3cd5eb280ef6b320374", "question": {"question_id": "sample_175_a228_q0", "video_id": 175, "video_path": "./videos/sample_175_real.mp4", "annotation_index": 228, "question_index": 0, "question": "What is the relative position of the cyclist in the green shoes to the group right now?", "options": ["A. Leading the group.", "B. In the middle of the group.", "C. At the back of the group.", "D. Outside the group."], "answer": "C", "time_stamp_s": 512, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [500, 520], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_175_a228_q0", "video_id": 175, "time_stamp_s": 512, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a1c0185d0a38e0c0728948a7b2af022109e1f3db3912d0ce48315f6014e522ce", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [482.01618333333334, 483.0005, 484.0015, 485.0025, 486.0035, 487.0045, 488.0055, 489.0065, 490.0075, 491.0085, 492.0095, 493.0105, 494.0115, 495.0125, 496.0135, 497.0145, 498.0155, 499.0165, 500.00081666666665, 501.0018166666667, 502.00281666666666, 503.0038166666667, 504.00481666666667, 505.00581666666665, 506.0068166666667, 507.00781666666666, 508.0088166666667, 509.00981666666667, 510.01081666666664, 511.0118166666667], "recent_frames_sha256": "ad26f15ad2101a5e4db940d9ff037337a9671be2f2c05ddcff58f74c2b704a1a", "num_recent_frames": 30, "tq": 717663.690291058, "t1": 717676.876432572, "ta": 717676.876432572, "te": 717676.915686001, "first_response_s": 13.186141513986513, "answer_total_s": 13.225394942914136, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_175_a228_q0", "video_id": 175, "time_stamp_s": 512, "ground_truth": "C", "raw_output": "A. Leading the group.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "9f5300d61006f5a751c94cc3e4cc37fe810e9f8f996268ef22a3615c42006d71", "condition_order": ["notes", "recent"], "memory": "[180-210s] - Cyclist in black jersey and orange shorts rides ahead, maintaining high cadence (173-178 rpm) while passing urban street barriers.\n- Group of cyclists follows closely, with one rider in blue jersey visible behind, showing consistent pace and effort.\n- On-screen metrics display distance (400m–402m) and heart rate (173–178 bpm), indicating sustained performance during the race.\n[210-240s] - Cyclist in black and yellow jersey rides ahead, maintaining a steady pace with fluctuating power output (210-230W) and cadence (175-182rpm).  \n- Group of cyclists in orange and blue jerseys follows closely, with one rider in blue jersey slightly ahead of the others.  \n- Road is lined with barriers and urban buildings; traffic lights and street signs are visible, indicating a city street environment.\n[240-270s] - Cyclist in orange jersey and black shorts leans forward, pedaling vigorously on a paved road with buildings on the right.\n- A cyclist in blue jersey and black shorts rides ahead, maintaining a steady pace with a visible speedometer reading around 28 mph.\n- The road surface shows cracks, and the cyclists are surrounded by urban infrastructure, including traffic lights and street signs.\n[270-300s] - Cyclist in orange jersey (number 89) maintains position in the peloton, slightly ahead of others.\n- A cyclist in black jersey (number 910) rides closely behind, with a visible green ribbon marking the course boundary.\n- The road surface shows wet patches, and the camera angle captures the rear view of multiple riders navigating the urban street.\n[300-330s] - Cyclist in black jersey with \"9109\" number rides ahead, slightly right of center, maintaining high cadence.\n- Group of cyclists in orange and black jerseys closely follow, with one cyclist in purple jersey visible on the left.\n- Roadside barriers and spectators line the street, with buildings and a traffic light visible in the background.\n[330-360s] - Cyclist in teal jersey and black shorts rides ahead, maintaining a steady pace with a cadence of 167 rpm.\n- Group of cyclists follows closely, with one rider in blue and orange jersey visible to the left, navigating a city street.\n- Road signs and urban buildings pass by, indicating a city route with traffic lights and intersections.\n[360-390s] - Cyclist in white jersey and blue helmet rides ahead, maintaining pace with others.\n- A cyclist in black and yellow jersey overtakes from the right, adjusting position relative to the group.\n- On-screen metrics show speed fluctuating between 28–34 mph, with heart rate around 172–173 bpm.\n[390-420s] - Cyclist in blue jersey and black shorts rides ahead, maintaining a steady pace with a heart rate of 178 bpm.\n- A group of cyclists follows closely, with one rider in a blue and white jersey visible to the left.\n- The road is lined with barriers and spectators, with buildings and trees visible in the background.\n[420-450s] - Cyclists in orange and blue jerseys ride in a tight group, maintaining high cadence (172-178 rpm) on a city street with buildings and green barriers.\n- The group navigates a turn, passing a traffic light and crossing a street with visible lane markings and a manhole cover.\n- On-screen metrics show distance (3680m–3660m) and power output (38–63 W), indicating steady effort during the ride.\n[450-480s] - Cyclist in orange jersey and black shorts leans forward, pedaling intensely, with power meter showing 173w.\n- Group of cyclists ahead maintains tight formation, with one rider in red jersey slightly ahead.\n- Roadside spectators line the street, separated by barriers, watching the race unfold.\n[480-510s] - Cyclist in orange jersey and black helmet rides solo, maintaining high cadence (174-183 rpm) while passing urban street scenes.\n- Group of cyclists follows closely behind, with one rider in red jersey visible at 4:56, indicating a peloton formation.\n- On-screen metrics show distance decreasing from 3600m to 2700m, with power output fluctuating between 145W and 183W.", "history_tokens": 986, "history_utf8_bytes": 4005, "recent_frame_times_s": [482.01618333333334, 483.0005, 484.0015, 485.0025, 486.0035, 487.0045, 488.0055, 489.0065, 490.0075, 491.0085, 492.0095, 493.0105, 494.0115, 495.0125, 496.0135, 497.0145, 498.0155, 499.0165, 500.00081666666665, 501.0018166666667, 502.00281666666666, 503.0038166666667, 504.00481666666667, 505.00581666666665, 506.0068166666667, 507.00781666666666, 508.0088166666667, 509.00981666666667, 510.01081666666664, 511.0118166666667], "recent_frames_sha256": "ad26f15ad2101a5e4db940d9ff037337a9671be2f2c05ddcff58f74c2b704a1a", "num_recent_frames": 30, "tq": 717617.65343886, "t1": 717624.641626341, "ta": 717624.641626341, "te": 717624.946489342, "first_response_s": 6.988187481067143, "answer_total_s": 7.293050482054241, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 176, "content_group": "03906e30f34c6003b63601f9409f60e7832dddce98537653f69cd8ecff388047", "question": {"question_id": "sample_176_a2052_q0", "video_id": 176, "video_path": "./videos/sample_176_real.mp4", "annotation_index": 2052, "question_index": 0, "question": "Where is the white car parked right now?", "options": ["A. Next to the cyclist.", "B. On the right side of the road.", "C. Directly ahead of the cyclist.", "D. On the left side of the road."], "answer": "D", "time_stamp_s": 10, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_176_a2052_q0", "video_id": 176, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "24b09bdd1bcdf44a53cb4989fc9572b74e1a51681e027da84f1610be61ca5857", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.049, 1.0166333333333333, 2.0176333333333334, 3.0186333333333333, 4.019633333333333, 5.0206333333333335, 6.021633333333333, 7.022633333333333, 8.023633333333333, 9.024633333333334], "recent_frames_sha256": "400637d50c2d4eb387c6718ba3dee92159af192cfa129892ff4021916d3358f8", "num_recent_frames": 10, "tq": 718232.483593616, "t1": 718244.693205446, "ta": 718244.693205446, "te": 718244.732610065, "first_response_s": 12.209611829952337, "answer_total_s": 12.249016448971815, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_176_a2052_q0", "video_id": 176, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d865858d13e240f248ac6a00dd1f51b148997d219a4ebcb41e22b9d89d774a4e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.049, 1.0166333333333333, 2.0176333333333334, 3.0186333333333333, 4.019633333333333, 5.0206333333333335, 6.021633333333333, 7.022633333333333, 8.023633333333333, 9.024633333333334], "recent_frames_sha256": "400637d50c2d4eb387c6718ba3dee92159af192cfa129892ff4021916d3358f8", "num_recent_frames": 10, "tq": 718286.307106473, "t1": 718298.793441624, "ta": 718298.793441624, "te": 718298.945733494, "first_response_s": 12.486335151013918, "answer_total_s": 12.638627020991407, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 176, "content_group": "03906e30f34c6003b63601f9409f60e7832dddce98537653f69cd8ecff388047", "question": {"question_id": "sample_176_a2053_q0", "video_id": 176, "video_path": "./videos/sample_176_real.mp4", "annotation_index": 2053, "question_index": 0, "question": "Where is the telegraph pole located right now?", "options": ["A. On the left side.", "B. In the middle of the road.", "C. Directly above the road.", "D. On the right side."], "answer": "D", "time_stamp_s": 127, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [127, 147], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_176_a2053_q0", "video_id": 176, "time_stamp_s": 127, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3bbd57660e00fa2fd23576dcb5b020309f2e286a2fd76ad2f3bab4c7d04a617d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [97.01253333333334, 98.01353333333333, 99.01453333333333, 100.01553333333334, 101.01653333333333, 102.01753333333333, 103.01853333333334, 104.01953333333333, 105.02053333333333, 106.02153333333334, 107.02253333333333, 108.02353333333333, 109.02453333333334, 110.02553333333333, 111.02653333333333, 112.02753333333334, 113.02853333333333, 114.02953333333333, 115.03053333333334, 116.03153333333333, 117.03253333333333, 118.00016666666667, 119.00116666666666, 120.00216666666667, 121.00316666666667, 122.00416666666666, 123.00516666666667, 124.00616666666667, 125.00716666666666, 126.00816666666667], "recent_frames_sha256": "55e453874438dec871c713290b6f35ae3953a25e7348e1911be0426cd5489282", "num_recent_frames": 30, "tq": 718244.745496413, "t1": 718257.407500373, "ta": 718257.407500373, "te": 718257.445123991, "first_response_s": 12.662003959994763, "answer_total_s": 12.699627578025684, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_176_a2053_q0", "video_id": 176, "time_stamp_s": 127, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2dea5653ff31e11ac9a0412345e57d4fa416795267d96295704122dc90e1fdbc", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Road ascends gradually, passing residential buildings and parked cars, with speed fluctuating between 22-79 km/h.  \n- Trees line both sides of the road, with a white car overtaking from behind around 0:25.  \n- On-screen data shows distance increasing from 50.1 to 50.3 km, elevation gain around 1%, and temperature at 34°C.\n[30-60s] - Road surface transitions from gravel to paved asphalt, with trees lining both sides.  \n- Speed fluctuates between 24–33 km/h, and elevation gain increases slightly from -1% to +1%.  \n- GPS map shows route progress toward a destination, with temperature at 34°C and route length at 50.4–50.6 km.\n[60-90s] - Road surface shows slight incline with consistent 1% gradient, marked by changing elevation on the dashboard.\n- Trees line both sides of the road, with a noticeable shift in foliage density as the camera moves forward.\n- A small structure or shed appears on the right side of the road around 78 seconds, partially obscured by trees.\n[90-120s] - Road surface transitions from asphalt to gravel as the cyclist approaches a curve.  \n- Trees and shrubs line both sides of the road, with a clear blue sky overhead.  \n- On-screen data shows speed fluctuating between 23–26 km/h, with distance increasing from 50.8 to 51.9 km.", "history_tokens": 338, "history_utf8_bytes": 1278, "recent_frame_times_s": [97.01253333333334, 98.01353333333333, 99.01453333333333, 100.01553333333334, 101.01653333333333, 102.01753333333333, 103.01853333333334, 104.01953333333333, 105.02053333333333, 106.02153333333334, 107.02253333333333, 108.02353333333333, 109.02453333333334, 110.02553333333333, 111.02653333333333, 112.02753333333334, 113.02853333333333, 114.02953333333333, 115.03053333333334, 116.03153333333333, 117.03253333333333, 118.00016666666667, 119.00116666666666, 120.00216666666667, 121.00316666666667, 122.00416666666666, 123.00516666666667, 124.00616666666667, 125.00716666666666, 126.00816666666667], "recent_frames_sha256": "55e453874438dec871c713290b6f35ae3953a25e7348e1911be0426cd5489282", "num_recent_frames": 30, "tq": 718325.838398895, "t1": 718328.044503436, "ta": 718328.044503436, "te": 718328.235868288, "first_response_s": 2.2061045409645885, "answer_total_s": 2.397469392977655, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 176, "content_group": "03906e30f34c6003b63601f9409f60e7832dddce98537653f69cd8ecff388047", "question": {"question_id": "sample_176_a2054_q0", "video_id": 176, "video_path": "./videos/sample_176_real.mp4", "annotation_index": 2054, "question_index": 0, "question": "Where are the trees located right now?", "options": ["A. On the left side of the road.", "B. On the right side of the road.", "C. Directly ahead.", "D. On both sides of the road."], "answer": "D", "time_stamp_s": 260, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [254, 274], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_176_a2054_q0", "video_id": 176, "time_stamp_s": 260, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e231d2cf86b4892779db0fbc8cfa327e17d2daf2fefd50f958dd400404b3a58c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [230.01206666666667, 231.01306666666667, 232.01406666666668, 233.01506666666666, 234.01606666666666, 235.01706666666666, 236.01806666666667, 237.01906666666667, 238.02006666666668, 239.02106666666666, 240.02206666666666, 241.02306666666667, 242.02406666666667, 243.02506666666667, 244.02606666666668, 245.02706666666666, 246.02806666666666, 247.02906666666667, 248.03006666666667, 249.03106666666667, 250.03206666666668, 251.03306666666666, 252.0007, 253.0017, 254.0027, 255.0037, 256.0047, 257.0057, 258.0067, 259.0077], "recent_frames_sha256": "c43120443d079c171284efd89e52614bac5e2c2c1c6990b72f3043c405841567", "num_recent_frames": 30, "tq": 718257.457257129, "t1": 718265.321666095, "ta": 718265.321666095, "te": 718265.361342985, "first_response_s": 7.864408966037445, "answer_total_s": 7.904085855931044, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_176_a2054_q0", "video_id": 176, "time_stamp_s": 260, "ground_truth": "D", "raw_output": "D. On both sides of the road.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "77d1719761fcd593d050d4a3b0a05885ccae106789bc040bf0200ebd4b4b54c1", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Road ascends gradually, passing residential buildings and parked cars, with speed fluctuating between 22-79 km/h.  \n- Trees line both sides of the road, with a white car overtaking from behind around 0:25.  \n- On-screen data shows distance increasing from 50.1 to 50.3 km, elevation gain around 1%, and temperature at 34°C.\n[30-60s] - Road surface transitions from gravel to paved asphalt, with trees lining both sides.  \n- Speed fluctuates between 24–33 km/h, and elevation gain increases slightly from -1% to +1%.  \n- GPS map shows route progress toward a destination, with temperature at 34°C and route length at 50.4–50.6 km.\n[60-90s] - Road surface shows slight incline with consistent 1% gradient, marked by changing elevation on the dashboard.\n- Trees line both sides of the road, with a noticeable shift in foliage density as the camera moves forward.\n- A small structure or shed appears on the right side of the road around 78 seconds, partially obscured by trees.\n[90-120s] - Road surface transitions from asphalt to gravel as the cyclist approaches a curve.  \n- Trees and shrubs line both sides of the road, with a clear blue sky overhead.  \n- On-screen data shows speed fluctuating between 23–26 km/h, with distance increasing from 50.8 to 51.9 km.\n[120-150s] - Road ascends with visible incline, marked by changing gradient percentages (e.g., 7% to 10%).\n- GPS map overlay shows route progress and current location near a forested area.\n- Temperature display consistently reads 34°C, indicating warm weather conditions.\n[150-180s] - Road surface slopes upward, with incline percentage fluctuating between 4% and 7%.\n- Trees line both sides of the road, with sunlight filtering through leaves.\n- On-screen data shows distance increasing from 51.2 km to 51.3 km, and time progressing from 66:01 to 76:01.\n[180-210s] - Road ascends with visible incline markers (e.g., 1% to 7%) and power lines overhead.  \n- Speed fluctuates between 60–75 km/h, with distance increasing from 51.3 km to 51.4 km.  \n- Right-side map shows route progress toward \"Hofa\" with temperature at 38°C.\n[210-240s] - Road surface shows slight incline (4% grade) with trees lining both sides under clear blue sky.\n- A white vehicle appears on the left side of the road, parked near a roadside sign.\n- On-screen display shows distance (51.4–51.6 km), time (79 min to 61 min), and temperature (38°C) with a map overlay.", "history_tokens": 674, "history_utf8_bytes": 2422, "recent_frame_times_s": [230.01206666666667, 231.01306666666667, 232.01406666666668, 233.01506666666666, 234.01606666666666, 235.01706666666666, 236.01806666666667, 237.01906666666667, 238.02006666666668, 239.02106666666666, 240.02206666666666, 241.02306666666667, 242.02406666666667, 243.02506666666667, 244.02606666666668, 245.02706666666666, 246.02806666666666, 247.02906666666667, 248.03006666666667, 249.03106666666667, 250.03206666666668, 251.03306666666666, 252.0007, 253.0017, 254.0027, 255.0037, 256.0047, 257.0057, 258.0067, 259.0077], "recent_frames_sha256": "c43120443d079c171284efd89e52614bac5e2c2c1c6990b72f3043c405841567", "num_recent_frames": 30, "tq": 718363.917514741, "t1": 718370.98923859, "ta": 718370.98923859, "te": 718371.325567544, "first_response_s": 7.071723849046975, "answer_total_s": 7.408052803017199, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 176, "content_group": "03906e30f34c6003b63601f9409f60e7832dddce98537653f69cd8ecff388047", "question": {"question_id": "sample_176_a2055_q0", "video_id": 176, "video_path": "./videos/sample_176_real.mp4", "annotation_index": 2055, "question_index": 0, "question": "What is the object on the left front of the cyclist right now?", "options": ["A. A traffic light.", "B. A bus stop.", "C. A water fountain.", "D. A green bollard."], "answer": "D", "time_stamp_s": 399, "task_type": "Spatial Understanding", "required_ability": "episodic memory", "video_category": "cycling", "reference_interval_s": [381, 401], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_176_a2055_q0", "video_id": 176, "time_stamp_s": 399, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5a862d22a3be19d0c6e67a5d8ac5b076cef4a13cbb58b7348f9144c06702a4fb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [369.0176, 370.0186, 371.0196, 372.0206, 373.0216, 374.0226, 375.0236, 376.0246, 377.0256, 378.0266, 379.0276, 380.0286, 381.0296, 382.0306, 383.0316, 384.0326, 385.0002333333333, 386.00123333333335, 387.0022333333333, 388.00323333333336, 389.00423333333333, 390.0052333333333, 391.00623333333334, 392.0072333333333, 393.00823333333335, 394.0092333333333, 395.01023333333336, 396.01123333333334, 397.0122333333333, 398.01323333333335], "recent_frames_sha256": "863916b48b21ac964f9d5dacd9cd27a1b39a7c0e161904ab3581969777da2573", "num_recent_frames": 30, "tq": 718265.37180482, "t1": 718278.454053009, "ta": 718278.454053009, "te": 718278.492323398, "first_response_s": 13.082248189020902, "answer_total_s": 13.120518577983603, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_176_a2055_q0", "video_id": 176, "time_stamp_s": 399, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b52b4d84cc3469bd9e5823286555a05ac2d31a1e02637cda24c5196a6356434a", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Road surface transitions from gravel to paved asphalt, with trees lining both sides.  \n- Speed fluctuates between 24–33 km/h, and elevation gain increases slightly from -1% to +1%.  \n- GPS map shows route progress toward a destination, with temperature at 34°C and route length at 50.4–50.6 km.\n[60-90s] - Road surface shows slight incline with consistent 1% gradient, marked by changing elevation on the dashboard.\n- Trees line both sides of the road, with a noticeable shift in foliage density as the camera moves forward.\n- A small structure or shed appears on the right side of the road around 78 seconds, partially obscured by trees.\n[90-120s] - Road surface transitions from asphalt to gravel as the cyclist approaches a curve.  \n- Trees and shrubs line both sides of the road, with a clear blue sky overhead.  \n- On-screen data shows speed fluctuating between 23–26 km/h, with distance increasing from 50.8 to 51.9 km.\n[120-150s] - Road ascends with visible incline, marked by changing gradient percentages (e.g., 7% to 10%).\n- GPS map overlay shows route progress and current location near a forested area.\n- Temperature display consistently reads 34°C, indicating warm weather conditions.\n[150-180s] - Road surface slopes upward, with incline percentage fluctuating between 4% and 7%.\n- Trees line both sides of the road, with sunlight filtering through leaves.\n- On-screen data shows distance increasing from 51.2 km to 51.3 km, and time progressing from 66:01 to 76:01.\n[180-210s] - Road ascends with visible incline markers (e.g., 1% to 7%) and power lines overhead.  \n- Speed fluctuates between 60–75 km/h, with distance increasing from 51.3 km to 51.4 km.  \n- Right-side map shows route progress toward \"Hofa\" with temperature at 38°C.\n[210-240s] - Road surface shows slight incline (4% grade) with trees lining both sides under clear blue sky.\n- A white vehicle appears on the left side of the road, parked near a roadside sign.\n- On-screen display shows distance (51.4–51.6 km), time (79 min to 61 min), and temperature (38°C) with a map overlay.\n[240-270s] - Road surface shows slight incline with changing gradient from 6% to 4% to 1%.  \n- Trees line both sides of the road, with sunlight filtering through leaves.  \n- On-screen display shows distance increasing from 51.6 km to 51.7 km, with pace fluctuating between 62 and 64 BPM.\n[270-300s] - Road ascends gently, flanked by dense green trees and a concrete wall on the left.  \n- Speedometer shows increasing speed from 62 to 72 km/h, with elevation gain rising from 3% to 5%.  \n- Map overlay indicates location near Hohne, with temperature at 38°C and distance at 51.7–51.9 km.\n[300-330s] - Road ascends gradually, with incline percentage increasing from 3% to 7%.\n- Left side features a stone wall and trees, while right side opens to a golden field.\n- GPS map shows route progress, with distance decreasing from 51.9 km to 52.0 km.\n[330-360s] - Road ascends slightly, indicated by changing gradient from 7% to 4% and then 1%.\n- Left side transitions from golden fields to tall green cornstalks, while right side remains wooded.\n- On-screen map updates to show route progression, with current location near a village signpost.\n[360-390s] - Road surface shows gradual incline, with speedometer indicating increasing speed from 38 to 105 km/h.\n- Left side features a cornfield, while right side has dry grass and sparse trees; road curves slightly to the right.\n- On-screen display shows distance increasing from 52.3 km to 52.6 km, with temperature at 34°C and a map of the route.", "history_tokens": 1001, "history_utf8_bytes": 3581, "recent_frame_times_s": [369.0176, 370.0186, 371.0196, 372.0206, 373.0216, 374.0226, 375.0236, 376.0246, 377.0256, 378.0266, 379.0276, 380.0286, 381.0296, 382.0306, 383.0316, 384.0326, 385.0002333333333, 386.00123333333335, 387.0022333333333, 388.00323333333336, 389.00423333333333, 390.0052333333333, 391.00623333333334, 392.0072333333333, 393.00823333333335, 394.0092333333333, 395.01023333333336, 396.01123333333334, 397.0122333333333, 398.01323333333335], "recent_frames_sha256": "863916b48b21ac964f9d5dacd9cd27a1b39a7c0e161904ab3581969777da2573", "num_recent_frames": 30, "tq": 718407.438745249, "t1": 718408.669609403, "ta": 718408.669609403, "te": 718408.85929898, "first_response_s": 1.2308641540585086, "answer_total_s": 1.4205537310335785, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 176, "content_group": "03906e30f34c6003b63601f9409f60e7832dddce98537653f69cd8ecff388047", "question": {"question_id": "sample_176_a2056_q0", "video_id": 176, "video_path": "./videos/sample_176_real.mp4", "annotation_index": 2056, "question_index": 0, "question": "What is the position of the church building right now?", "options": ["A. On the left side of the road.", "B. On the right side of the road.", "C. Behind the cyclist.", "D. Directly ahead."], "answer": "D", "time_stamp_s": 525, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [508, 528], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_176_a2056_q0", "video_id": 176, "time_stamp_s": 525, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9ffe896c6933cfad5e5ca772e517cdef69dcf5c7d4c69c9b9549d3b76d0178e7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [495.01013333333333, 496.0111333333333, 497.01213333333334, 498.0131333333333, 499.01413333333335, 500.0151333333333, 501.01613333333336, 502.01713333333333, 503.0181333333333, 504.01913333333334, 505.0201333333333, 506.02113333333335, 507.02213333333333, 508.0231333333333, 509.02413333333334, 510.0251333333333, 511.02613333333335, 512.0271333333334, 513.0281333333334, 514.0291333333333, 515.0301333333333, 516.0311333333333, 517.0321333333334, 518.0331333333334, 519.0007666666667, 520.0017666666666, 521.0027666666666, 522.0037666666667, 523.0047666666667, 524.0057666666667], "recent_frames_sha256": "f7dfe526fbbf1cd6b94c12fe2bb0b9bc5202f104996e786a34bff54cd1c3d599", "num_recent_frames": 30, "tq": 718278.509191691, "t1": 718286.255827821, "ta": 718286.255827821, "te": 718286.293261964, "first_response_s": 7.74663613003213, "answer_total_s": 7.784070273046382, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_176_a2056_q0", "video_id": 176, "time_stamp_s": 525, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7b91f6e917c2da1d70212e7789baf5e83f73df866508ee81dd234c9370cb5770", "condition_order": ["recent", "notes"], "memory": "[150-180s] - Road surface slopes upward, with incline percentage fluctuating between 4% and 7%.\n- Trees line both sides of the road, with sunlight filtering through leaves.\n- On-screen data shows distance increasing from 51.2 km to 51.3 km, and time progressing from 66:01 to 76:01.\n[180-210s] - Road ascends with visible incline markers (e.g., 1% to 7%) and power lines overhead.  \n- Speed fluctuates between 60–75 km/h, with distance increasing from 51.3 km to 51.4 km.  \n- Right-side map shows route progress toward \"Hofa\" with temperature at 38°C.\n[210-240s] - Road surface shows slight incline (4% grade) with trees lining both sides under clear blue sky.\n- A white vehicle appears on the left side of the road, parked near a roadside sign.\n- On-screen display shows distance (51.4–51.6 km), time (79 min to 61 min), and temperature (38°C) with a map overlay.\n[240-270s] - Road surface shows slight incline with changing gradient from 6% to 4% to 1%.  \n- Trees line both sides of the road, with sunlight filtering through leaves.  \n- On-screen display shows distance increasing from 51.6 km to 51.7 km, with pace fluctuating between 62 and 64 BPM.\n[270-300s] - Road ascends gently, flanked by dense green trees and a concrete wall on the left.  \n- Speedometer shows increasing speed from 62 to 72 km/h, with elevation gain rising from 3% to 5%.  \n- Map overlay indicates location near Hohne, with temperature at 38°C and distance at 51.7–51.9 km.\n[300-330s] - Road ascends gradually, with incline percentage increasing from 3% to 7%.\n- Left side features a stone wall and trees, while right side opens to a golden field.\n- GPS map shows route progress, with distance decreasing from 51.9 km to 52.0 km.\n[330-360s] - Road ascends slightly, indicated by changing gradient from 7% to 4% and then 1%.\n- Left side transitions from golden fields to tall green cornstalks, while right side remains wooded.\n- On-screen map updates to show route progression, with current location near a village signpost.\n[360-390s] - Road surface shows gradual incline, with speedometer indicating increasing speed from 38 to 105 km/h.\n- Left side features a cornfield, while right side has dry grass and sparse trees; road curves slightly to the right.\n- On-screen display shows distance increasing from 52.3 km to 52.6 km, with temperature at 34°C and a map of the route.\n[390-420s] - Road elevation gradually decreases from 2% to -1% slope, with distance increasing to 52.7 km.  \n- Right side of road features dry grassy embankment, while left side has trees and fencing.  \n- On-screen map shows route progress with a white outline of a region, and temperature remains at 34°C.\n[420-450s] - Road elevation gradually increases, indicated by a slope percentage shifting from -2% to +4%.\n- A 30 km/h speed limit sign appears on the right side of the road.\n- The cyclist's speed fluctuates between 80-90 km/h, with the displayed distance increasing from 53.9 km to 53.2 km.\n[450-480s] - A black SUV passes on the road, moving away from the camera's perspective.  \n- The road curves gently to the right, lined with trees and residential houses on the left.  \n- A blue circular speedometer graphic on the left shows a decreasing speed from 24 to 21 mph.\n[480-510s] - A silver car is parked on the left side of the road, stationary near a curb.  \n- The road curves gently to the right, flanked by residential houses with red-tiled roofs.  \n- A white car passes by on the right, moving in the opposite direction, as the camera continues forward.", "history_tokens": 1005, "history_utf8_bytes": 3532, "recent_frame_times_s": [495.01013333333333, 496.0111333333333, 497.01213333333334, 498.0131333333333, 499.01413333333335, 500.0151333333333, 501.01613333333336, 502.01713333333333, 503.0181333333333, 504.01913333333334, 505.0201333333333, 506.02113333333335, 507.02213333333333, 508.0231333333333, 509.02413333333334, 510.0251333333333, 511.02613333333335, 512.0271333333334, 513.0281333333334, 514.0291333333333, 515.0301333333333, 516.0311333333333, 517.0321333333334, 518.0331333333334, 519.0007666666667, 520.0017666666666, 521.0027666666666, 522.0037666666667, 523.0047666666667, 524.0057666666667], "recent_frames_sha256": "f7dfe526fbbf1cd6b94c12fe2bb0b9bc5202f104996e786a34bff54cd1c3d599", "num_recent_frames": 30, "tq": 718437.975206104, "t1": 718438.97332018, "ta": 718438.97332018, "te": 718439.011235954, "first_response_s": 0.9981140759773552, "answer_total_s": 1.036029850016348, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 177, "content_group": "2c739ef7636bce59f0dbbef86bc95019dcdf233684ab6d44a073858179655d0a", "question": {"question_id": "sample_177_a552_q0", "video_id": 177, "video_path": "./videos/sample_177_real.mp4", "annotation_index": 552, "question_index": 0, "question": "Where are the trees located right now?", "options": ["A. On the both sides of the road.", "B. On the left side of the road.", "C. In the middle of the road.", "D. On the right side of the road."], "answer": "A", "time_stamp_s": 20, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_177_a552_q0", "video_id": 177, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e4213ad7bffa1d2c647ca86a9da5d60bfd582294f2e489738f108d738c66b726", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.035, 1.0026333333333333, 2.003633333333333, 3.0046333333333335, 4.005633333333333, 5.006633333333333, 6.007633333333334, 7.008633333333333, 8.009633333333333, 9.010633333333333, 10.011633333333334, 11.012633333333333, 12.013633333333333, 13.014633333333334, 14.015633333333334, 15.016633333333333, 16.017633333333333, 17.018633333333334, 18.019633333333335, 19.020633333333333], "recent_frames_sha256": "3e48a3f6ab9f8ffe7d46dfc22f897990c5ddeefef986ba8bf18fdcc552029d70", "num_recent_frames": 20, "tq": 715941.660546876, "t1": 715942.759714661, "ta": 715942.759714661, "te": 715942.797306233, "first_response_s": 1.0991677850252017, "answer_total_s": 1.1367593569448218, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_177_a552_q0", "video_id": 177, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e69128775601e821f6e8b61d356b86ccd5e82f3e10ce5c9f62d7441e38970863", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.035, 1.0026333333333333, 2.003633333333333, 3.0046333333333335, 4.005633333333333, 5.006633333333333, 6.007633333333334, 7.008633333333333, 8.009633333333333, 9.010633333333333, 10.011633333333334, 11.012633333333333, 12.013633333333333, 13.014633333333334, 14.015633333333334, 15.016633333333333, 16.017633333333333, 17.018633333333334, 18.019633333333335, 19.020633333333333], "recent_frames_sha256": "3e48a3f6ab9f8ffe7d46dfc22f897990c5ddeefef986ba8bf18fdcc552029d70", "num_recent_frames": 20, "tq": 715797.78447353, "t1": 715804.318693306, "ta": 715804.318693306, "te": 715804.508195709, "first_response_s": 6.534219775930978, "answer_total_s": 6.723722178954631, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 177, "content_group": "2c739ef7636bce59f0dbbef86bc95019dcdf233684ab6d44a073858179655d0a", "question": {"question_id": "sample_177_a553_q0", "video_id": 177, "video_path": "./videos/sample_177_real.mp4", "annotation_index": 553, "question_index": 0, "question": "What is located on the right side of the path right now?", "options": ["A. An open field.", "B. A dense forest.", "C. A farmhouse.", "D. A shopping plaza."], "answer": "A", "time_stamp_s": 139, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [119, 139], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_177_a553_q0", "video_id": 177, "time_stamp_s": 139, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7ac85f87bd5c88bee39d5d15be5b5d538bf0861b94a356062b2893ac3e3fb1e1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [109.01053333333333, 110.01153333333333, 111.01253333333334, 112.01353333333333, 113.01453333333333, 114.01553333333334, 115.01653333333333, 116.01753333333333, 117.01853333333334, 118.01953333333333, 119.02053333333333, 120.02153333333334, 121.02253333333333, 122.02353333333333, 123.02453333333334, 124.02553333333333, 125.02653333333333, 126.02753333333334, 127.02853333333333, 128.02953333333335, 129.03053333333332, 130.03153333333333, 131.03253333333333, 132.00016666666667, 133.00116666666668, 134.00216666666665, 135.00316666666666, 136.00416666666666, 137.00516666666667, 138.00616666666667], "recent_frames_sha256": "635638f87de82795a3c35c1e79eacda0dabc416687438fc517ff66bee919f4a8", "num_recent_frames": 30, "tq": 715942.826341375, "t1": 715953.1303115, "ta": 715953.1303115, "te": 715953.16821528, "first_response_s": 10.303970125038177, "answer_total_s": 10.341873905039392, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_177_a553_q0", "video_id": 177, "time_stamp_s": 139, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2b270cb8fa31888a7f9f7fc4a543d15c94056649f856b9b15731c075659302c9", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Road surface shows gradual incline, with speed fluctuating between 59-77 km/h and gradient changing from 4% to 1%.  \n- Left side of road lined with dense green trees, right side with taller, sunlit trees; map overlay indicates location near 'Hofa' with 33°C temperature.  \n- On-screen display updates distance (81.6–81.9 km), time (80–76 min), and speedometer readings, with a blue circular graphic tracking speed.\n[30-60s] - Road surface shows slight incline, with speedometer indicating 77-88 km/h and distance increasing from 81.9 to 82.1 km.\n- Left side of road bordered by dense green trees, right side by lighter foliage with a white map outline of a region.\n- Temperature displayed as 33°C, with a small blue icon indicating current location near \"Höhe\" on the map.\n[60-90s] - Road surface transitions from gravel to smoother asphalt, with trees lining both sides.  \n- Speedometer shows decreasing speed from 90 to 68 km/h, indicating a gradual descent.  \n- Map overlay displays a blue dot moving along a route, with temperature at 23°C.\n[90-120s] - Road surface shows slight incline, with speed fluctuating between 65-74 km/h and gradient increasing from 10% to 12%.  \n- Right-side trees become denser, while left-side field remains open, with a small building visible in distance.  \n- Map overlay indicates position near a town, with temperature at 22°C and route length at 82.4 km.", "history_tokens": 378, "history_utf8_bytes": 1410, "recent_frame_times_s": [109.01053333333333, 110.01153333333333, 111.01253333333334, 112.01353333333333, 113.01453333333333, 114.01553333333334, 115.01653333333333, 116.01753333333333, 117.01853333333334, 118.01953333333333, 119.02053333333333, 120.02153333333334, 121.02253333333333, 122.02353333333333, 123.02453333333334, 124.02553333333333, 125.02653333333333, 126.02753333333334, 127.02853333333333, 128.02953333333335, 129.03053333333332, 130.03153333333333, 131.03253333333333, 132.00016666666667, 133.00116666666668, 134.00216666666665, 135.00316666666666, 136.00416666666666, 137.00516666666667, 138.00616666666667], "recent_frames_sha256": "635638f87de82795a3c35c1e79eacda0dabc416687438fc517ff66bee919f4a8", "num_recent_frames": 30, "tq": 715842.326342813, "t1": 715849.805868445, "ta": 715849.805868445, "te": 715850.006745586, "first_response_s": 7.479525631992146, "answer_total_s": 7.680402773083188, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 177, "content_group": "2c739ef7636bce59f0dbbef86bc95019dcdf233684ab6d44a073858179655d0a", "question": {"question_id": "sample_177_a554_q0", "video_id": 177, "video_path": "./videos/sample_177_real.mp4", "annotation_index": 554, "question_index": 0, "question": "Where is the house with the brown roof located right now?", "options": ["A. On the right side of the road.", "B. On the left side of the road.", "C. Directly behind the cyclist.", "D. In the middle of the forest."], "answer": "A", "time_stamp_s": 249, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [238, 258], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_177_a554_q0", "video_id": 177, "time_stamp_s": 249, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2f16dec980f92199ac2ec0017288fbc5590e56f1360142f132f3cd36a2814b60", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [219.02043333333333, 220.02143333333333, 221.02243333333334, 222.02343333333334, 223.02443333333332, 224.02543333333332, 225.02643333333333, 226.02743333333333, 227.02843333333334, 228.02943333333334, 229.03043333333332, 230.03143333333333, 231.03243333333333, 232.00006666666667, 233.00106666666667, 234.00206666666668, 235.00306666666665, 236.00406666666666, 237.00506666666666, 238.00606666666667, 239.00706666666667, 240.00806666666668, 241.00906666666666, 242.01006666666666, 243.01106666666666, 244.01206666666667, 245.01306666666667, 246.01406666666668, 247.01506666666666, 248.01606666666666], "recent_frames_sha256": "3550f1fb17267e33a0172f53546f7a0c033d361100b6b51019ea00998b77a1dc", "num_recent_frames": 30, "tq": 715953.190170572, "t1": 715959.902661174, "ta": 715959.902661174, "te": 715959.940713461, "first_response_s": 6.712490601930767, "answer_total_s": 6.750542888999917, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_177_a554_q0", "video_id": 177, "time_stamp_s": 249, "ground_truth": "A", "raw_output": "A. On the right side of the road.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "c30b030d7601caeb8b577e8b61eea2f0e12657d07ef43b159d0665bc06327a12", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Road surface shows gradual incline, with speed fluctuating between 59-77 km/h and gradient changing from 4% to 1%.  \n- Left side of road lined with dense green trees, right side with taller, sunlit trees; map overlay indicates location near 'Hofa' with 33°C temperature.  \n- On-screen display updates distance (81.6–81.9 km), time (80–76 min), and speedometer readings, with a blue circular graphic tracking speed.\n[30-60s] - Road surface shows slight incline, with speedometer indicating 77-88 km/h and distance increasing from 81.9 to 82.1 km.\n- Left side of road bordered by dense green trees, right side by lighter foliage with a white map outline of a region.\n- Temperature displayed as 33°C, with a small blue icon indicating current location near \"Höhe\" on the map.\n[60-90s] - Road surface transitions from gravel to smoother asphalt, with trees lining both sides.  \n- Speedometer shows decreasing speed from 90 to 68 km/h, indicating a gradual descent.  \n- Map overlay displays a blue dot moving along a route, with temperature at 23°C.\n[90-120s] - Road surface shows slight incline, with speed fluctuating between 65-74 km/h and gradient increasing from 10% to 12%.  \n- Right-side trees become denser, while left-side field remains open, with a small building visible in distance.  \n- Map overlay indicates position near a town, with temperature at 22°C and route length at 82.4 km.\n[120-150s] - Road elevation gradually increases, indicated by rising incline percentage from 1% to 4%.  \n- GPS map shows a blue dot moving along a white route, with \"Höhe\" (altitude) displayed as 32°C.  \n- Speed fluctuates between 60–70 km/h, with time decreasing from 79:14 min to 66:14 min.\n[150-180s] - Road transitions from narrow dirt path to paved highway with visible lane markings and traffic.  \n- A large industrial building with blue accents appears on the left side of the road.  \n- A red bicycle sign is visible on the right, indicating a designated bike route.\n[180-210s] - Road sign indicating \"Südwest\" (southwest) direction appears at 189 seconds, with a yellow arrow pointing left.\n- Speedometer shows decreasing speed from 25 to 24 km/h between 180 and 200 seconds.\n- Roadside grassy area and trees remain static on the right, with a distant building visible on the left.\n[210-240s] - Road transitions from paved to dirt path, flanked by dense trees, with a house visible on the right.  \n- On-screen metrics show distance increasing from 83.1 to 83.2 km, time decreasing from 78 to 73 min, and elevation gain fluctuating around 1%.  \n- Temperature remains steady at 33°C, with a map overlay indicating location near the UK.", "history_tokens": 724, "history_utf8_bytes": 2658, "recent_frame_times_s": [219.02043333333333, 220.02143333333333, 221.02243333333334, 222.02343333333334, 223.02443333333332, 224.02543333333332, 225.02643333333333, 226.02743333333333, 227.02843333333334, 228.02943333333334, 229.03043333333332, 230.03143333333333, 231.03243333333333, 232.00006666666667, 233.00106666666667, 234.00206666666668, 235.00306666666665, 236.00406666666666, 237.00506666666666, 238.00606666666667, 239.00706666666667, 240.00806666666668, 241.00906666666666, 242.01006666666666, 243.01106666666666, 244.01206666666667, 245.01306666666667, 246.01406666666668, 247.01506666666666, 248.01606666666666], "recent_frames_sha256": "3550f1fb17267e33a0172f53546f7a0c033d361100b6b51019ea00998b77a1dc", "num_recent_frames": 30, "tq": 715883.394332171, "t1": 715891.64618968, "ta": 715891.64618968, "te": 715892.024500763, "first_response_s": 8.251857509021647, "answer_total_s": 8.63016859209165, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 177, "content_group": "2c739ef7636bce59f0dbbef86bc95019dcdf233684ab6d44a073858179655d0a", "question": {"question_id": "sample_177_a555_q0", "video_id": 177, "video_path": "./videos/sample_177_real.mp4", "annotation_index": 555, "question_index": 0, "question": "Where are the trees located right now?", "options": ["A. On the both sides of the road.", "B. On the left side of the road.", "C. In the middle of the road.", "D. On the right side of the road."], "answer": "A", "time_stamp_s": 376, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [357, 377], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_177_a555_q0", "video_id": 177, "time_stamp_s": 376, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b2e21299f527128a72642c4e6a830a5f556ee9f4ffc4c103c733857083e9e7e6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [346.01396666666665, 347.0149666666667, 348.01596666666666, 349.0169666666667, 350.01796666666667, 351.01896666666664, 352.0199666666667, 353.02096666666665, 354.0219666666667, 355.02296666666666, 356.0239666666667, 357.02496666666667, 358.02596666666665, 359.0269666666667, 360.02796666666666, 361.0289666666667, 362.02996666666667, 363.03096666666664, 364.0319666666667, 365.03296666666665, 366.0006, 367.0016, 368.0026, 369.0036, 370.0046, 371.0056, 372.0066, 373.0076, 374.0086, 375.0096], "recent_frames_sha256": "f5435421812561bc94e9b08f966586ac5e0066ebc1de0004a8330dfccf89575a", "num_recent_frames": 30, "tq": 715959.966931874, "t1": 715971.471530428, "ta": 715971.471530428, "te": 715971.509086628, "first_response_s": 11.504598553990945, "answer_total_s": 11.542154753929935, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_177_a555_q0", "video_id": 177, "time_stamp_s": 376, "ground_truth": "A", "raw_output": "B. On the left side of the road.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "5c70f30d8c5987c9a94afbb4d60dad19326003dcd2c4fddf830f016175f4dee3", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Road surface shows slight incline, with speedometer indicating 77-88 km/h and distance increasing from 81.9 to 82.1 km.\n- Left side of road bordered by dense green trees, right side by lighter foliage with a white map outline of a region.\n- Temperature displayed as 33°C, with a small blue icon indicating current location near \"Höhe\" on the map.\n[60-90s] - Road surface transitions from gravel to smoother asphalt, with trees lining both sides.  \n- Speedometer shows decreasing speed from 90 to 68 km/h, indicating a gradual descent.  \n- Map overlay displays a blue dot moving along a route, with temperature at 23°C.\n[90-120s] - Road surface shows slight incline, with speed fluctuating between 65-74 km/h and gradient increasing from 10% to 12%.  \n- Right-side trees become denser, while left-side field remains open, with a small building visible in distance.  \n- Map overlay indicates position near a town, with temperature at 22°C and route length at 82.4 km.\n[120-150s] - Road elevation gradually increases, indicated by rising incline percentage from 1% to 4%.  \n- GPS map shows a blue dot moving along a white route, with \"Höhe\" (altitude) displayed as 32°C.  \n- Speed fluctuates between 60–70 km/h, with time decreasing from 79:14 min to 66:14 min.\n[150-180s] - Road transitions from narrow dirt path to paved highway with visible lane markings and traffic.  \n- A large industrial building with blue accents appears on the left side of the road.  \n- A red bicycle sign is visible on the right, indicating a designated bike route.\n[180-210s] - Road sign indicating \"Südwest\" (southwest) direction appears at 189 seconds, with a yellow arrow pointing left.\n- Speedometer shows decreasing speed from 25 to 24 km/h between 180 and 200 seconds.\n- Roadside grassy area and trees remain static on the right, with a distant building visible on the left.\n[210-240s] - Road transitions from paved to dirt path, flanked by dense trees, with a house visible on the right.  \n- On-screen metrics show distance increasing from 83.1 to 83.2 km, time decreasing from 78 to 73 min, and elevation gain fluctuating around 1%.  \n- Temperature remains steady at 33°C, with a map overlay indicating location near the UK.\n[240-270s] - Road surface transitions from paved to gravel, with trees lining both sides.  \n- On-screen metrics show decreasing speed (e.g., 70 to 65 km/h) and time (e.g., 89:14 to 88:14 min).  \n- Right side features a rustic building with a red-tiled roof, partially obscured by foliage.\n[270-300s] - Road surface transitions from paved to gravel, with slight incline changes (e.g., +1% to -1%).\n- Trees and foliage on both sides of the path remain dense, with sunlight filtering through leaves.\n- On-screen metrics show consistent speed (60-70 km/h), distance (83.5 km), and temperature (33°C), with minor elevation fluctuations.\n[300-330s] - Road surface transitions from dirt to paved path, with trees lining both sides.  \n- Speed fluctuates between 18–24 km/h, and elevation gain decreases from 6% to 3%.  \n- Map overlay shows route progress with a blue dot indicating current position near a rural area.\n[330-360s] - Road elevation gradually decreases from 3% to 1% as cyclist moves forward.\n- Left side of road lined with dense green trees, right side with open fields.\n- On-screen map shows cyclist's position near a town marked 'Höhn' with temperature 22°C.", "history_tokens": 926, "history_utf8_bytes": 3400, "recent_frame_times_s": [346.01396666666665, 347.0149666666667, 348.01596666666666, 349.0169666666667, 350.01796666666667, 351.01896666666664, 352.0199666666667, 353.02096666666665, 354.0219666666667, 355.02296666666666, 356.0239666666667, 357.02496666666667, 358.02596666666665, 359.0269666666667, 360.02796666666666, 361.0289666666667, 362.02996666666667, 363.03096666666664, 364.0319666666667, 365.03296666666665, 366.0006, 367.0016, 368.0026, 369.0036, 370.0046, 371.0056, 372.0066, 373.0076, 374.0086, 375.0096], "recent_frames_sha256": "f5435421812561bc94e9b08f966586ac5e0066ebc1de0004a8330dfccf89575a", "num_recent_frames": 30, "tq": 715916.749350163, "t1": 715917.492745164, "ta": 715917.492745164, "te": 715917.864602596, "first_response_s": 0.7433950009290129, "answer_total_s": 1.1152524329954758, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 177, "content_group": "2c739ef7636bce59f0dbbef86bc95019dcdf233684ab6d44a073858179655d0a", "question": {"question_id": "sample_177_a556_q0", "video_id": 177, "video_path": "./videos/sample_177_real.mp4", "annotation_index": 556, "question_index": 0, "question": "What is the black car parked right now?", "options": ["A. On the left side of the road.", "B. On the both sides of the road.", "C. On the right side of the road.", "D. No black car."], "answer": "A", "time_stamp_s": 477, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [476, 496], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_177_a556_q0", "video_id": 177, "time_stamp_s": 477, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "15a1cd9c0545d5b04ba4de8d8b2f466ffc49d4d740e954c92e0e012f145e0399", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [447.01486666666665, 448.0158666666667, 449.01686666666666, 450.0178666666667, 451.01886666666667, 452.01986666666664, 453.0208666666667, 454.02186666666665, 455.0228666666667, 456.02386666666666, 457.02486666666664, 458.0258666666667, 459.02686666666665, 460.0278666666667, 461.02886666666666, 462.0298666666667, 463.03086666666667, 464.03186666666664, 465.0328666666667, 466.0005, 467.0015, 468.0025, 469.0035, 470.0045, 471.0055, 472.0065, 473.0075, 474.0085, 475.0095, 476.0105], "recent_frames_sha256": "0d3dd36de5614e4ae9b525e943e9f8752fc959e81e8f32cef0d88a8a50a25fcc", "num_recent_frames": 30, "tq": 715971.526739719, "t1": 715977.773582386, "ta": 715977.773582386, "te": 715977.811378836, "first_response_s": 6.24684266699478, "answer_total_s": 6.28463911707513, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_177_a556_q0", "video_id": 177, "time_stamp_s": 477, "ground_truth": "A", "raw_output": "D. No black car.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "a47226bd445aa3a7cd2de51de624784c676b34a5a41f871bb56584bf3b5bb439", "condition_order": ["notes", "recent"], "memory": "[120-150s] - Road elevation gradually increases, indicated by rising incline percentage from 1% to 4%.  \n- GPS map shows a blue dot moving along a white route, with \"Höhe\" (altitude) displayed as 32°C.  \n- Speed fluctuates between 60–70 km/h, with time decreasing from 79:14 min to 66:14 min.\n[150-180s] - Road transitions from narrow dirt path to paved highway with visible lane markings and traffic.  \n- A large industrial building with blue accents appears on the left side of the road.  \n- A red bicycle sign is visible on the right, indicating a designated bike route.\n[180-210s] - Road sign indicating \"Südwest\" (southwest) direction appears at 189 seconds, with a yellow arrow pointing left.\n- Speedometer shows decreasing speed from 25 to 24 km/h between 180 and 200 seconds.\n- Roadside grassy area and trees remain static on the right, with a distant building visible on the left.\n[210-240s] - Road transitions from paved to dirt path, flanked by dense trees, with a house visible on the right.  \n- On-screen metrics show distance increasing from 83.1 to 83.2 km, time decreasing from 78 to 73 min, and elevation gain fluctuating around 1%.  \n- Temperature remains steady at 33°C, with a map overlay indicating location near the UK.\n[240-270s] - Road surface transitions from paved to gravel, with trees lining both sides.  \n- On-screen metrics show decreasing speed (e.g., 70 to 65 km/h) and time (e.g., 89:14 to 88:14 min).  \n- Right side features a rustic building with a red-tiled roof, partially obscured by foliage.\n[270-300s] - Road surface transitions from paved to gravel, with slight incline changes (e.g., +1% to -1%).\n- Trees and foliage on both sides of the path remain dense, with sunlight filtering through leaves.\n- On-screen metrics show consistent speed (60-70 km/h), distance (83.5 km), and temperature (33°C), with minor elevation fluctuations.\n[300-330s] - Road surface transitions from dirt to paved path, with trees lining both sides.  \n- Speed fluctuates between 18–24 km/h, and elevation gain decreases from 6% to 3%.  \n- Map overlay shows route progress with a blue dot indicating current position near a rural area.\n[330-360s] - Road elevation gradually decreases from 3% to 1% as cyclist moves forward.\n- Left side of road lined with dense green trees, right side with open fields.\n- On-screen map shows cyclist's position near a town marked 'Höhn' with temperature 22°C.\n[360-390s] - Road surface shows slight incline with consistent 4% gradient, marked by changing elevation on the display.\n- Left side features dense green hedgerow, while right side is open golden field under clear blue sky.\n- On-screen data updates: distance increases from 84.1 km to 84.2 km, pace fluctuates between 67-69 min/km, and temperature remains at 22°C.\n[390-420s] - Road elevation fluctuates between -1% and +2% as cyclist progresses along the path.  \n- Right side of road bordered by golden fields, left by green trees under clear blue sky.  \n- On-screen display shows distance at 84.3 km, time 68:14 min, and temperature 22°C.\n[420-450s] - Road surface transitions from paved to gravel, with a wooden fence on the right and fields on the left.  \n- A cyclist appears ahead, riding away on the gravel path.  \n- On-screen data shows speed fluctuating between 21–26 km/h, with a slight incline of 1% and distance at 86.0 km.", "history_tokens": 931, "history_utf8_bytes": 3358, "recent_frame_times_s": [447.01486666666665, 448.0158666666667, 449.01686666666666, 450.0178666666667, 451.01886666666667, 452.01986666666664, 453.0208666666667, 454.02186666666665, 455.0228666666667, 456.02386666666666, 457.02486666666664, 458.0258666666667, 459.02686666666665, 460.0278666666667, 461.02886666666666, 462.0298666666667, 463.03086666666667, 464.03186666666664, 465.0328666666667, 466.0005, 467.0015, 468.0025, 469.0035, 470.0045, 471.0055, 472.0065, 473.0075, 474.0085, 475.0095, 476.0105], "recent_frames_sha256": "0d3dd36de5614e4ae9b525e943e9f8752fc959e81e8f32cef0d88a8a50a25fcc", "num_recent_frames": 30, "tq": 715939.453311337, "t1": 715941.364100068, "ta": 715941.364100068, "te": 715941.623529864, "first_response_s": 1.910788730951026, "answer_total_s": 2.170218526967801, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 178, "content_group": "1edfcf15c3b166b049af20b437a4c64afc2dd750ee357cd238cc42ad3ec8cc9a", "question": {"question_id": "sample_178_a884_q0", "video_id": 178, "video_path": "./videos/sample_178_real.mp4", "annotation_index": 884, "question_index": 0, "question": "Where is the white road marker positioned relative to the cyclist right now?", "options": ["A. On the both sides of the cyclist.", "B. In front of the cyclist.", "C. To the left of the cyclist.", "D. Behind the cyclist."], "answer": "A", "time_stamp_s": 6, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_178_a884_q0", "video_id": 178, "time_stamp_s": 6, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "99aab5c2064a85a72253ab31fd071345946a1e41dc970559ec2e3fdc2a85e1c5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.053, 1.0206333333333333, 2.0216333333333334, 3.0226333333333333, 4.023633333333334, 5.024633333333333], "recent_frames_sha256": "fb8ae238da6c97f6b8136f1c784d9ccb872227b32638d5a32435334eea5c3f22", "num_recent_frames": 6, "tq": 719232.757030599, "t1": 719238.326433088, "ta": 719238.326433088, "te": 719238.365138416, "first_response_s": 5.569402488996275, "answer_total_s": 5.608107816893607, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_178_a884_q0", "video_id": 178, "time_stamp_s": 6, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "04731529936a89aaf0e9edabc3a1bfb189bd143e64328572c61fa1747bc1e771", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.053, 1.0206333333333333, 2.0216333333333334, 3.0226333333333333, 4.023633333333334, 5.024633333333333], "recent_frames_sha256": "fb8ae238da6c97f6b8136f1c784d9ccb872227b32638d5a32435334eea5c3f22", "num_recent_frames": 6, "tq": 719033.728451001, "t1": 719045.821756909, "ta": 719045.821756909, "te": 719045.860518555, "first_response_s": 12.093305908027105, "answer_total_s": 12.132067554048263, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 178, "content_group": "1edfcf15c3b166b049af20b437a4c64afc2dd750ee357cd238cc42ad3ec8cc9a", "question": {"question_id": "sample_178_a885_q0", "video_id": 178, "video_path": "./videos/sample_178_real.mp4", "annotation_index": 885, "question_index": 0, "question": "How are the road signs oriented right now?", "options": ["A. Indicating a left turn.", "B. Pointing straight ahead.", "C. Indicating a right turn.", "D. Indicating a U-turn."], "answer": "A", "time_stamp_s": 115, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [111, 131], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_178_a885_q0", "video_id": 178, "time_stamp_s": 115, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6f40b46b4227fe0dc3ddd9b74a3f95e17f95d7e53cc0f74ab88dd2951a966a61", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [85.00453333333333, 86.00553333333333, 87.00653333333334, 88.00753333333333, 89.00853333333333, 90.00953333333334, 91.01053333333333, 92.01153333333333, 93.01253333333334, 94.01353333333333, 95.01453333333333, 96.01553333333334, 97.01653333333333, 98.01753333333333, 99.01853333333334, 100.01953333333333, 101.02053333333333, 102.02153333333334, 103.02253333333333, 104.02353333333333, 105.02453333333334, 106.02553333333333, 107.02653333333333, 108.02753333333334, 109.02853333333333, 110.02953333333333, 111.03053333333334, 112.03153333333333, 113.03253333333333, 114.00016666666667], "recent_frames_sha256": "e9fa0d2e63b0d54aa11bc1cdf08cc9d64211f9e07cfabbc500f3da7cb87e24cf", "num_recent_frames": 30, "tq": 719238.380488833, "t1": 719250.523404462, "ta": 719250.523404462, "te": 719250.561332177, "first_response_s": 12.14291562908329, "answer_total_s": 12.180843344074674, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_178_a885_q0", "video_id": 178, "time_stamp_s": 115, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "06895133ddbb86de667ca52386696542928993ca4006af0580e5d262bd9343a0", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Road curves left, flanked by dense green trees and dry grass, with a speedometer showing fluctuating speeds (e.g., 73 to 80 km/h) and distance increasing from 87.1 to 87.3 km.\n- A map overlay on the right displays a route with a blue marker indicating current position, and temperature reading of 26°C.\n- The road surface appears smooth, with white lane markings, and the camera perspective suggests a forward-moving vehicle.\n[30-60s] - Road curves left, bordered by dense green trees and a metal guardrail on the right.  \n- Speedometer shows increasing speed from 25 to 85 km/h, with a 2% incline and 72-87 km distance remaining.  \n- A dark sedan overtakes the viewer’s vehicle from behind, then disappears around a bend.\n[60-90s] - Road speed increases from 87 to 93 km/h while navigating a gentle curve with a metal guardrail on the right.  \n- Temperature remains steady at 34°C, and the route map shows progression along a forested path.  \n- Speed fluctuates slightly, peaking at 93 km/h, with a minor descent indicated by a -3% gradient.", "history_tokens": 280, "history_utf8_bytes": 1056, "recent_frame_times_s": [85.00453333333333, 86.00553333333333, 87.00653333333334, 88.00753333333333, 89.00853333333333, 90.00953333333334, 91.01053333333333, 92.01153333333333, 93.01253333333334, 94.01353333333333, 95.01453333333333, 96.01553333333334, 97.01653333333333, 98.01753333333333, 99.01853333333334, 100.01953333333333, 101.02053333333333, 102.02153333333334, 103.02253333333333, 104.02353333333333, 105.02453333333334, 106.02553333333333, 107.02653333333333, 108.02753333333334, 109.02853333333333, 110.02953333333333, 111.03053333333334, 112.03153333333333, 113.03253333333333, 114.00016666666667], "recent_frames_sha256": "e9fa0d2e63b0d54aa11bc1cdf08cc9d64211f9e07cfabbc500f3da7cb87e24cf", "num_recent_frames": 30, "tq": 719099.357712589, "t1": 719110.815182574, "ta": 719110.815182574, "te": 719110.852771925, "first_response_s": 11.457469985005446, "answer_total_s": 11.495059336069971, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 178, "content_group": "1edfcf15c3b166b049af20b437a4c64afc2dd750ee357cd238cc42ad3ec8cc9a", "question": {"question_id": "sample_178_a886_q0", "video_id": 178, "video_path": "./videos/sample_178_real.mp4", "annotation_index": 886, "question_index": 0, "question": "What is located at the far end of the left side of the road right now?", "options": ["A. A tall tree.", "B. A hospital.", "C. A park.", "D. A bridge."], "answer": "A", "time_stamp_s": 237, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [222, 242], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_178_a886_q0", "video_id": 178, "time_stamp_s": 237, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "73cfd84c1b510d0b16248d65a86d7595c6bdb60925a44656fac0db1e9feb4d10", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [207.02643333333333, 208.02743333333333, 209.02843333333334, 210.02943333333334, 211.03043333333332, 212.03143333333333, 213.03243333333333, 214.00006666666667, 215.00106666666667, 216.00206666666668, 217.00306666666665, 218.00406666666666, 219.00506666666666, 220.00606666666667, 221.00706666666667, 222.00806666666668, 223.00906666666666, 224.01006666666666, 225.01106666666666, 226.01206666666667, 227.01306666666667, 228.01406666666668, 229.01506666666666, 230.01606666666666, 231.01706666666666, 232.01806666666667, 233.01906666666667, 234.02006666666668, 235.02106666666666, 236.02206666666666], "recent_frames_sha256": "af60e3a3f35030b9e3579eaf8e22ef35c12636af6b88829700583216a7993557", "num_recent_frames": 30, "tq": 719250.573204675, "t1": 719262.167258453, "ta": 719262.167258453, "te": 719262.204726809, "first_response_s": 11.59405377798248, "answer_total_s": 11.631522134062834, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_178_a886_q0", "video_id": 178, "time_stamp_s": 237, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4b8d1d1d0f78ee02c0453de0acd2353496c5995a5f99b6d2792df459137efd1e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Road curves left, flanked by dense green trees and dry grass, with a speedometer showing fluctuating speeds (e.g., 73 to 80 km/h) and distance increasing from 87.1 to 87.3 km.\n- A map overlay on the right displays a route with a blue marker indicating current position, and temperature reading of 26°C.\n- The road surface appears smooth, with white lane markings, and the camera perspective suggests a forward-moving vehicle.\n[30-60s] - Road curves left, bordered by dense green trees and a metal guardrail on the right.  \n- Speedometer shows increasing speed from 25 to 85 km/h, with a 2% incline and 72-87 km distance remaining.  \n- A dark sedan overtakes the viewer’s vehicle from behind, then disappears around a bend.\n[60-90s] - Road speed increases from 87 to 93 km/h while navigating a gentle curve with a metal guardrail on the right.  \n- Temperature remains steady at 34°C, and the route map shows progression along a forested path.  \n- Speed fluctuates slightly, peaking at 93 km/h, with a minor descent indicated by a -3% gradient.\n[90-120s] - Road curves left, then right, with speed fluctuating between 43–52 km/h and gradient changing from 3% to 4%.  \n- A silver car overtakes from the opposite direction at 0:99–1:01.  \n- On-screen display shows distance increasing from 88.0 km to 88.4 km, with temperature at 34°C and location labeled \"Höhe\".\n[120-150s] - A black car passes on the left side of the road, moving in the opposite direction.  \n- The road curves to the right, with a guardrail on the right side and trees lining both sides.  \n- The speedometer shows a speed fluctuating between 45 and 54 km/h, with the gradient changing from -4% to -3%.\n[150-180s] - Road sign indicating a 10% gradient appears on the right side of the road.  \n- A car is seen approaching from the opposite direction on the road.  \n- The speedometer reading increases from 15 to 58 km/h as the vehicle ascends a gentle slope.\n[180-210s] - Speed fluctuates between 48-97 km/h as the cyclist navigates a road with trees and a concrete wall on the right.\n- A yellow road sign indicating \"B 22\" appears at 3:14, followed by a bridge at 3:27.\n- The map overlay shows a route progressing from \"89.3 KM\" to \"89.6 KM\" with a temperature of 22°C.", "history_tokens": 642, "history_utf8_bytes": 2255, "recent_frame_times_s": [207.02643333333333, 208.02743333333333, 209.02843333333334, 210.02943333333334, 211.03043333333332, 212.03143333333333, 213.03243333333333, 214.00006666666667, 215.00106666666667, 216.00206666666668, 217.00306666666665, 218.00406666666666, 219.00506666666666, 220.00606666666667, 221.00706666666667, 222.00806666666668, 223.00906666666666, 224.01006666666666, 225.01106666666666, 226.01206666666667, 227.01306666666667, 228.01406666666668, 229.01506666666666, 230.01606666666666, 231.01706666666666, 232.01806666666667, 233.01906666666667, 234.02006666666668, 235.02106666666666, 236.02206666666666], "recent_frames_sha256": "af60e3a3f35030b9e3579eaf8e22ef35c12636af6b88829700583216a7993557", "num_recent_frames": 30, "tq": 719147.210224932, "t1": 719155.09806883, "ta": 719155.09806883, "te": 719155.485258681, "first_response_s": 7.887843898031861, "answer_total_s": 8.275033749057911, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 178, "content_group": "1edfcf15c3b166b049af20b437a4c64afc2dd750ee357cd238cc42ad3ec8cc9a", "question": {"question_id": "sample_178_a887_q0", "video_id": 178, "video_path": "./videos/sample_178_real.mp4", "annotation_index": 887, "question_index": 0, "question": "Where is the blue car located right now?", "options": ["A. On the right side of the cyclist.", "B. On the left side of the cyclist.", "C. Directly in front of the cyclist.", "D. Behind the cyclist."], "answer": "A", "time_stamp_s": 338, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [333, 353], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_178_a887_q0", "video_id": 178, "time_stamp_s": 338, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d479f4ebe71b82e54adf816d2f57f70e5fca49eaa96cac16d5ae77f38255d715", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [308.02733333333333, 309.0283333333333, 310.02933333333334, 311.0303333333333, 312.03133333333335, 313.0323333333333, 314.03333333333336, 315.00096666666667, 316.00196666666665, 317.0029666666667, 318.00396666666666, 319.0049666666667, 320.00596666666667, 321.00696666666664, 322.0079666666667, 323.00896666666665, 324.0099666666667, 325.01096666666666, 326.0119666666667, 327.01296666666667, 328.01396666666665, 329.0149666666667, 330.01596666666666, 331.0169666666667, 332.01796666666667, 333.01896666666664, 334.0199666666667, 335.02096666666665, 336.0219666666667, 337.02296666666666], "recent_frames_sha256": "9d76c788aacabee5b5ba9c423482e2c50d26da89713d13c2612a927d672cc7fd", "num_recent_frames": 30, "tq": 719262.215144273, "t1": 719273.287757651, "ta": 719273.287757651, "te": 719273.324551093, "first_response_s": 11.072613377938978, "answer_total_s": 11.109406820032746, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_178_a887_q0", "video_id": 178, "time_stamp_s": 338, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c8a75d49257af5a068d1068d726695c801ec72ce13413abbc1d4b0982a18b2f6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Road curves left, flanked by dense green trees and dry grass, with a speedometer showing fluctuating speeds (e.g., 73 to 80 km/h) and distance increasing from 87.1 to 87.3 km.\n- A map overlay on the right displays a route with a blue marker indicating current position, and temperature reading of 26°C.\n- The road surface appears smooth, with white lane markings, and the camera perspective suggests a forward-moving vehicle.\n[30-60s] - Road curves left, bordered by dense green trees and a metal guardrail on the right.  \n- Speedometer shows increasing speed from 25 to 85 km/h, with a 2% incline and 72-87 km distance remaining.  \n- A dark sedan overtakes the viewer’s vehicle from behind, then disappears around a bend.\n[60-90s] - Road speed increases from 87 to 93 km/h while navigating a gentle curve with a metal guardrail on the right.  \n- Temperature remains steady at 34°C, and the route map shows progression along a forested path.  \n- Speed fluctuates slightly, peaking at 93 km/h, with a minor descent indicated by a -3% gradient.\n[90-120s] - Road curves left, then right, with speed fluctuating between 43–52 km/h and gradient changing from 3% to 4%.  \n- A silver car overtakes from the opposite direction at 0:99–1:01.  \n- On-screen display shows distance increasing from 88.0 km to 88.4 km, with temperature at 34°C and location labeled \"Höhe\".\n[120-150s] - A black car passes on the left side of the road, moving in the opposite direction.  \n- The road curves to the right, with a guardrail on the right side and trees lining both sides.  \n- The speedometer shows a speed fluctuating between 45 and 54 km/h, with the gradient changing from -4% to -3%.\n[150-180s] - Road sign indicating a 10% gradient appears on the right side of the road.  \n- A car is seen approaching from the opposite direction on the road.  \n- The speedometer reading increases from 15 to 58 km/h as the vehicle ascends a gentle slope.\n[180-210s] - Speed fluctuates between 48-97 km/h as the cyclist navigates a road with trees and a concrete wall on the right.\n- A yellow road sign indicating \"B 22\" appears at 3:14, followed by a bridge at 3:27.\n- The map overlay shows a route progressing from \"89.3 KM\" to \"89.6 KM\" with a temperature of 22°C.\n[210-240s] - Speed fluctuates from 43 to 72 km/h as the cyclist navigates urban roads and intersections.\n- The route progresses from a bridge to residential areas, passing buildings, traffic lights, and signage.\n- On-screen data shows a steady pace, 2% gradient, 89.7 km total distance, and 32°C temperature.\n[240-270s] - A blue and white gas station canopy is visible on the left side of the road, with a parked car nearby.  \n- The road is lined with residential buildings, including a white house with a sloped roof and a beige house with shutters.  \n- A red vertical sign with white text is positioned on the right side of the road, near a hedge.\n[270-300s] - Cyclist accelerates past residential buildings with changing speed indicators (32-78 km/h) and incline (2% to -1%).\n- Road surface transitions from paved to asphalt with visible lane markings and traffic signs.\n- Temperature remains steady at 33°C, with GPS map showing route progress toward 90.3 km.\n[300-330s] - A white car passes on the right, moving in the same direction as the cyclist.\n- The cyclist's speed fluctuates between 70-78 km/h, with a slight incline indicated by the 1% gradient.\n- The map overlay shows the cyclist's route progressing through a residential area with houses and trees.", "history_tokens": 969, "history_utf8_bytes": 3523, "recent_frame_times_s": [308.02733333333333, 309.0283333333333, 310.02933333333334, 311.0303333333333, 312.03133333333335, 313.0323333333333, 314.03333333333336, 315.00096666666667, 316.00196666666665, 317.0029666666667, 318.00396666666666, 319.0049666666667, 320.00596666666667, 321.00696666666664, 322.0079666666667, 323.00896666666665, 324.0099666666667, 325.01096666666666, 326.0119666666667, 327.01296666666667, 328.01396666666665, 329.0149666666667, 330.01596666666666, 331.0169666666667, 332.01796666666667, 333.01896666666664, 334.0199666666667, 335.02096666666665, 336.0219666666667, 337.02296666666666], "recent_frames_sha256": "9d76c788aacabee5b5ba9c423482e2c50d26da89713d13c2612a927d672cc7fd", "num_recent_frames": 30, "tq": 719183.937752529, "t1": 719195.2113471, "ta": 719195.2113471, "te": 719195.588329063, "first_response_s": 11.273594570928253, "answer_total_s": 11.65057653398253, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 178, "content_group": "1edfcf15c3b166b049af20b437a4c64afc2dd750ee357cd238cc42ad3ec8cc9a", "question": {"question_id": "sample_178_a888_q0", "video_id": 178, "video_path": "./videos/sample_178_real.mp4", "annotation_index": 888, "question_index": 0, "question": "Where is the red car located right now?", "options": ["A. On the right side of the cyclist.", "B. On the left side of the cyclist.", "C. Directly in front of the cyclist.", "D. Behind the cyclist."], "answer": "A", "time_stamp_s": 458, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [444, 464], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_178_a888_q0", "video_id": 178, "time_stamp_s": 458, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "eb61fe12608255266df32976cf1e77eead36dba08f3a6cf1b3d8daafcf042f95", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [428.0138666666667, 429.01486666666665, 430.0158666666667, 431.01686666666666, 432.0178666666667, 433.01886666666667, 434.01986666666664, 435.0208666666667, 436.02186666666665, 437.0228666666667, 438.02386666666666, 439.02486666666664, 440.0258666666667, 441.02686666666665, 442.0278666666667, 443.02886666666666, 444.0298666666667, 445.03086666666667, 446.03186666666664, 447.0328666666667, 448.0005, 449.0015, 450.0025, 451.0035, 452.0045, 453.0055, 454.0065, 455.0075, 456.0085, 457.0095], "recent_frames_sha256": "9472eddb7fafc2afd70b30a47c77c221fbe00dcdf283ef57abe705d36deaeb77", "num_recent_frames": 30, "tq": 719273.331965838, "t1": 719286.872529103, "ta": 719286.872529103, "te": 719286.909346028, "first_response_s": 13.540563264978118, "answer_total_s": 13.577380190021358, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_178_a888_q0", "video_id": 178, "time_stamp_s": 458, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f161c6a839e128864787f3996316fba3fc48fd02e9f6f3d35754eaf45fc91988", "condition_order": ["notes", "recent"], "memory": "[90-120s] - Road curves left, then right, with speed fluctuating between 43–52 km/h and gradient changing from 3% to 4%.  \n- A silver car overtakes from the opposite direction at 0:99–1:01.  \n- On-screen display shows distance increasing from 88.0 km to 88.4 km, with temperature at 34°C and location labeled \"Höhe\".\n[120-150s] - A black car passes on the left side of the road, moving in the opposite direction.  \n- The road curves to the right, with a guardrail on the right side and trees lining both sides.  \n- The speedometer shows a speed fluctuating between 45 and 54 km/h, with the gradient changing from -4% to -3%.\n[150-180s] - Road sign indicating a 10% gradient appears on the right side of the road.  \n- A car is seen approaching from the opposite direction on the road.  \n- The speedometer reading increases from 15 to 58 km/h as the vehicle ascends a gentle slope.\n[180-210s] - Speed fluctuates between 48-97 km/h as the cyclist navigates a road with trees and a concrete wall on the right.\n- A yellow road sign indicating \"B 22\" appears at 3:14, followed by a bridge at 3:27.\n- The map overlay shows a route progressing from \"89.3 KM\" to \"89.6 KM\" with a temperature of 22°C.\n[210-240s] - Speed fluctuates from 43 to 72 km/h as the cyclist navigates urban roads and intersections.\n- The route progresses from a bridge to residential areas, passing buildings, traffic lights, and signage.\n- On-screen data shows a steady pace, 2% gradient, 89.7 km total distance, and 32°C temperature.\n[240-270s] - A blue and white gas station canopy is visible on the left side of the road, with a parked car nearby.  \n- The road is lined with residential buildings, including a white house with a sloped roof and a beige house with shutters.  \n- A red vertical sign with white text is positioned on the right side of the road, near a hedge.\n[270-300s] - Cyclist accelerates past residential buildings with changing speed indicators (32-78 km/h) and incline (2% to -1%).\n- Road surface transitions from paved to asphalt with visible lane markings and traffic signs.\n- Temperature remains steady at 33°C, with GPS map showing route progress toward 90.3 km.\n[300-330s] - A white car passes on the right, moving in the same direction as the cyclist.\n- The cyclist's speed fluctuates between 70-78 km/h, with a slight incline indicated by the 1% gradient.\n- The map overlay shows the cyclist's route progressing through a residential area with houses and trees.\n[330-360s] - A blue car is parked on the right side of the road, stationary near a building with a white facade.  \n- The cyclist's speedometer shows a steady increase from 60 to 78 km/h, with the route distance rising from 90.7 to 91.0 km.  \n- The road curves slightly to the right, with trees and residential buildings lining both sides under a clear blue sky.\n[360-390s] - White car drives ahead on right side of road, passing buildings with varied facades.  \n- Road surface shows slight incline, with speedometer indicating gradual acceleration.  \n- Pedestrian crossing appears ahead, with traffic light visible at intersection.\n[390-420s] - Cyclist maintains steady speed around 40-50 km/h on a residential street with parked cars and buildings.  \n- Road signs and traffic lights are visible at intersections, indicating urban navigation.  \n- Temperature display shows 23°C, suggesting warm weather conditions.\n[420-450s] - Vehicle passes under a stone arch bridge, transitioning from a sunlit road to a shaded tunnel interior.\n- Speed fluctuates between 22–38 km/h as the vehicle navigates a curve and approaches a crosswalk.\n- Roadside signage and buildings, including a parking lot sign (P4.3), are visible on the right as the vehicle proceeds uphill.", "history_tokens": 999, "history_utf8_bytes": 3728, "recent_frame_times_s": [428.0138666666667, 429.01486666666665, 430.0158666666667, 431.01686666666666, 432.0178666666667, 433.01886666666667, 434.01986666666664, 435.0208666666667, 436.02186666666665, 437.0228666666667, 438.02386666666666, 439.02486666666664, 440.0258666666667, 441.02686666666665, 442.0278666666667, 443.02886666666666, 444.0298666666667, 445.03086666666667, 446.03186666666664, 447.0328666666667, 448.0005, 449.0015, 450.0025, 451.0035, 452.0045, 453.0055, 454.0065, 455.0075, 456.0085, 457.0095], "recent_frames_sha256": "9472eddb7fafc2afd70b30a47c77c221fbe00dcdf283ef57abe705d36deaeb77", "num_recent_frames": 30, "tq": 719230.399653616, "t1": 719232.678683315, "ta": 719232.678683315, "te": 719232.716851359, "first_response_s": 2.2790296990424395, "answer_total_s": 2.3171977429883555, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 179, "content_group": "4910a9d800e5878820fb7ed6f0dab902f29928ad44b0d12f26236204f274eb21", "question": {"question_id": "sample_179_a337_q0", "video_id": 179, "video_path": "./videos/sample_179_real.mp4", "annotation_index": 337, "question_index": 0, "question": "Where is the green banner located right now?", "options": ["A. Hanging above the cyclists.", "B. On the left side of the road.", "C. Directly behind the cyclists.", "D. On the both sides of the road."], "answer": "D", "time_stamp_s": 4, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_179_a337_q0", "video_id": 179, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e2eedee73e317e36c1c3fe5d9bb54b4479dcf017866b3a9c06388e74c567a2c6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.032, 1.0163166666666668, 2.0006333333333335, 3.0016333333333334], "recent_frames_sha256": "a7a2a36265254e1b9d0e97249031aa19b459a24a7d406ec6ae0abfed9ed26a44", "num_recent_frames": 4, "tq": 715434.151881738, "t1": 715439.237563698, "ta": 715439.237563698, "te": 715439.275540683, "first_response_s": 5.085681959986687, "answer_total_s": 5.1236589449690655, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_179_a337_q0", "video_id": 179, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e8436ac0bc765f74bc37cca971b6af68739c02462d594f73901b809e4378071f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.032, 1.0163166666666668, 2.0006333333333335, 3.0016333333333334], "recent_frames_sha256": "a7a2a36265254e1b9d0e97249031aa19b459a24a7d406ec6ae0abfed9ed26a44", "num_recent_frames": 4, "tq": 715479.966735741, "t1": 715491.733990585, "ta": 715491.733990585, "te": 715491.922206508, "first_response_s": 11.767254843958654, "answer_total_s": 11.955470766988583, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 179, "content_group": "4910a9d800e5878820fb7ed6f0dab902f29928ad44b0d12f26236204f274eb21", "question": {"question_id": "sample_179_a338_q0", "video_id": 179, "video_path": "./videos/sample_179_real.mp4", "annotation_index": 338, "question_index": 0, "question": "Where is the flag located right now?", "options": ["A. Hanging on the left side of the road.", "B. Hanging above the cyclists.", "C. Hanging behind the cyclists.", "D. Hanging on the right side of the road."], "answer": "D", "time_stamp_s": 138, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [121, 141], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_179_a338_q0", "video_id": 179, "time_stamp_s": 138, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6f97f6121512585bff4da67a006ac8d123191795b42bce45d6053d26fcf1d875", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [108.00653333333334, 109.00753333333333, 110.00853333333333, 111.00953333333334, 112.01053333333333, 113.01153333333333, 114.01253333333334, 115.01353333333333, 116.01453333333333, 117.01553333333334, 118.01653333333333, 119.00085, 120.00185, 121.00285, 122.00385, 123.00485, 124.00585, 125.00685, 126.00785, 127.00885, 128.00985, 129.01085, 130.01185, 131.01285, 132.01385, 133.01485, 134.01585, 135.00016666666667, 136.00116666666668, 137.00216666666665], "recent_frames_sha256": "aa78007e10174cbd5fed6d9aab4f4c00e01ae471c7586a8d72d9addea8ed349c", "num_recent_frames": 30, "tq": 715439.289159729, "t1": 715450.551922149, "ta": 715450.551922149, "te": 715450.589660193, "first_response_s": 11.262762419995852, "answer_total_s": 11.300500463927165, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_179_a338_q0", "video_id": 179, "time_stamp_s": 138, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "caae960c74ff24c33aaa1d7b0e6eb64f5ae21db2b4866dc04252d746f76d0746", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cyclists in a peloton ride through urban streets, with a rider in white and blue jersey leading the group.  \n- A green barrier lines the right side of the road, and spectators are visible near the curb.  \n- On-screen data shows distance, speed, and cadence, with the distance decreasing as the group progresses.\n[30-60s] - Cyclist in orange jersey leads group, maintaining high cadence (178-180 rpm) as they navigate urban street.\n- Group rides past buildings with green barriers, passing a crosswalk and a pedestrian area with spectators.\n- Distance marker shows 7,700m to 7,400m, with pace indicator fluctuating between 28-32 km/h.\n[60-90s] - Cyclist in black jersey (number 88) maintains a steady pace, slightly ahead of the group.  \n- A cyclist in blue jersey (number 6) is positioned near the center of the pack, closely following others.  \n- The group navigates a paved urban street with buildings and barriers on either side, maintaining a tight formation.\n[90-120s] - Cyclists maintain high cadence (184-188 rpm) while navigating urban streets with buildings and traffic lights.\n- Group rides past a green-roofed structure and a modern glass building, with distance markers showing 6680m to 6650m.\n- Riders' positions shift slightly as they pedal through turns, with one cyclist in a white jersey leading the pack.", "history_tokens": 339, "history_utf8_bytes": 1332, "recent_frame_times_s": [108.00653333333334, 109.00753333333333, 110.00853333333333, 111.00953333333334, 112.01053333333333, 113.01153333333333, 114.01253333333334, 115.01353333333333, 116.01453333333333, 117.01553333333334, 118.01653333333333, 119.00085, 120.00185, 121.00285, 122.00385, 123.00485, 124.00585, 125.00685, 126.00785, 127.00885, 128.00985, 129.01085, 130.01185, 131.01285, 132.01385, 133.01485, 134.01585, 135.00016666666667, 136.00116666666668, 137.00216666666665], "recent_frames_sha256": "aa78007e10174cbd5fed6d9aab4f4c00e01ae471c7586a8d72d9addea8ed349c", "num_recent_frames": 30, "tq": 715520.680780947, "t1": 715527.217257422, "ta": 715527.217257422, "te": 715527.434934947, "first_response_s": 6.536476475070231, "answer_total_s": 6.754154000082053, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 179, "content_group": "4910a9d800e5878820fb7ed6f0dab902f29928ad44b0d12f26236204f274eb21", "question": {"question_id": "sample_179_a339_q0", "video_id": 179, "video_path": "./videos/sample_179_real.mp4", "annotation_index": 339, "question_index": 0, "question": "Where is the cyclist located relative to the National Championships banner right now?", "options": ["A. Far down the road from the banner.", "B. Before reaching the banner.", "C. Turned away from the banner.", "D. Just crossing underneath the banner."], "answer": "D", "time_stamp_s": 245, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [242, 262], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_179_a339_q0", "video_id": 179, "time_stamp_s": 245, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8fcdceb2cd39edea31afb32bf1764bff337e6407b54c5062cb9d81560a7acfd0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [215.01343333333332, 216.01443333333333, 217.01543333333333, 218.01643333333334, 219.00075, 220.00175, 221.00275, 222.00375, 223.00475, 224.00575, 225.00675, 226.00775, 227.00875, 228.00975, 229.01075, 230.01175, 231.01275, 232.01375, 233.01475, 234.01575, 235.00006666666667, 236.00106666666667, 237.00206666666668, 238.00306666666665, 239.00406666666666, 240.00506666666666, 241.00606666666667, 242.00706666666667, 243.00806666666668, 244.00906666666666], "recent_frames_sha256": "9a09e3fe622dcf1332e8aa524dae70ba85c1a9016c1e9e49c85d9126fa70c466", "num_recent_frames": 30, "tq": 715450.614084941, "t1": 715461.951691365, "ta": 715461.951691365, "te": 715461.989042004, "first_response_s": 11.337606424000114, "answer_total_s": 11.374957063002512, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_179_a339_q0", "video_id": 179, "time_stamp_s": 245, "ground_truth": "D", "raw_output": "B. Before reaching the banner.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "11b800d209816725dd08ce8901c038083bd2a1151413d6c259329eadc362e361", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cyclists in a peloton ride through urban streets, with a rider in white and blue jersey leading the group.  \n- A green barrier lines the right side of the road, and spectators are visible near the curb.  \n- On-screen data shows distance, speed, and cadence, with the distance decreasing as the group progresses.\n[30-60s] - Cyclist in orange jersey leads group, maintaining high cadence (178-180 rpm) as they navigate urban street.\n- Group rides past buildings with green barriers, passing a crosswalk and a pedestrian area with spectators.\n- Distance marker shows 7,700m to 7,400m, with pace indicator fluctuating between 28-32 km/h.\n[60-90s] - Cyclist in black jersey (number 88) maintains a steady pace, slightly ahead of the group.  \n- A cyclist in blue jersey (number 6) is positioned near the center of the pack, closely following others.  \n- The group navigates a paved urban street with buildings and barriers on either side, maintaining a tight formation.\n[90-120s] - Cyclists maintain high cadence (184-188 rpm) while navigating urban streets with buildings and traffic lights.\n- Group rides past a green-roofed structure and a modern glass building, with distance markers showing 6680m to 6650m.\n- Riders' positions shift slightly as they pedal through turns, with one cyclist in a white jersey leading the pack.\n[120-150s] - Cyclist in orange jersey (num. 992) leads a group, maintaining high cadence (183-185 rpm) while navigating urban streets.  \n- A cyclist in black jersey (num. 991) rides closely behind, slightly trailing the group as they pass buildings and intersections.  \n- The group’s pace fluctuates, with cadence dropping to 179 rpm as they approach a turn, indicating a shift in terrain or group dynamics.\n[150-180s] - Cyclist in purple jersey rides ahead, maintaining high cadence (188-190 rpm) while navigating urban streets.  \n- Other riders, including one in blue jersey, follow closely, with distance markers showing progression through the course.  \n- Roadside barriers and spectators line the route, with buildings and traffic lights visible in the background.\n[180-210s] - Cyclist in black jersey maintains high cadence (190 rpm) while navigating urban streets.  \n- Another cyclist in blue jersey follows closely, both riding on paved roads with traffic signs and buildings.  \n- On-screen metrics show distance decreasing from 5680m to 5420m, with speed fluctuating between 28-30 km/h.\n[210-240s] - Cyclist leans forward, pedaling vigorously, with power output fluctuating between 180-198 watts and cadence around 90-95 rpm.\n- Roadside spectators line the street behind green and white barriers, watching the cyclist pass by.\n- On-screen display shows distance decreasing from 5219m to 4890m, with a map indicating route progress and current speed around 28-33 km/h.", "history_tokens": 728, "history_utf8_bytes": 2811, "recent_frame_times_s": [215.01343333333332, 216.01443333333333, 217.01543333333333, 218.01643333333334, 219.00075, 220.00175, 221.00275, 222.00375, 223.00475, 224.00575, 225.00675, 226.00775, 227.00875, 228.00975, 229.01075, 230.01175, 231.01275, 232.01375, 233.01475, 234.01575, 235.00006666666667, 236.00106666666667, 237.00206666666668, 238.00306666666665, 239.00406666666666, 240.00506666666666, 241.00606666666667, 242.00706666666667, 243.00806666666668, 244.00906666666666], "recent_frames_sha256": "9a09e3fe622dcf1332e8aa524dae70ba85c1a9016c1e9e49c85d9126fa70c466", "num_recent_frames": 30, "tq": 715557.394900448, "t1": 715558.737168978, "ta": 715558.737168978, "te": 715559.004500252, "first_response_s": 1.342268529930152, "answer_total_s": 1.6095998039236292, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 179, "content_group": "4910a9d800e5878820fb7ed6f0dab902f29928ad44b0d12f26236204f274eb21", "question": {"question_id": "sample_179_a340_q0", "video_id": 179, "video_path": "./videos/sample_179_real.mp4", "annotation_index": 340, "question_index": 0, "question": "What is the position of the tall building with many windows right now?", "options": ["A. On the left side of the road.", "B. Directly in front of the cyclists.", "C. Behind the cyclists.", "D. On the right side of the road."], "answer": "D", "time_stamp_s": 369, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [363, 383], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_179_a340_q0", "video_id": 179, "time_stamp_s": 369, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a47a268174feb400bb11e739bc737e69311cc833fc3906f6de15940b84551029", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [339.00396666666666, 340.0049666666667, 341.00596666666667, 342.00696666666664, 343.0079666666667, 344.00896666666665, 345.0099666666667, 346.01096666666666, 347.0119666666667, 348.01296666666667, 349.01396666666665, 350.0149666666667, 351.01596666666666, 352.00028333333336, 353.00128333333333, 354.0022833333333, 355.00328333333334, 356.0042833333333, 357.00528333333335, 358.00628333333333, 359.0072833333333, 360.00828333333334, 361.0092833333333, 362.01028333333335, 363.0112833333333, 364.01228333333336, 365.01328333333333, 366.0142833333333, 367.01528333333334, 368.0162833333333], "recent_frames_sha256": "662238c682c4381daa68d7e91dd75fe1ea306c9ef5019d6c05d88b8ea6b5076a", "num_recent_frames": 30, "tq": 715461.997938854, "t1": 715468.998129943, "ta": 715468.998129943, "te": 715469.035426417, "first_response_s": 7.00019108899869, "answer_total_s": 7.03748756297864, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_179_a340_q0", "video_id": 179, "time_stamp_s": 369, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e7352fce62281556f180d573439ff4e491fb154efbcd5e45f920191b6174635c", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Cyclist in orange jersey leads group, maintaining high cadence (178-180 rpm) as they navigate urban street.\n- Group rides past buildings with green barriers, passing a crosswalk and a pedestrian area with spectators.\n- Distance marker shows 7,700m to 7,400m, with pace indicator fluctuating between 28-32 km/h.\n[60-90s] - Cyclist in black jersey (number 88) maintains a steady pace, slightly ahead of the group.  \n- A cyclist in blue jersey (number 6) is positioned near the center of the pack, closely following others.  \n- The group navigates a paved urban street with buildings and barriers on either side, maintaining a tight formation.\n[90-120s] - Cyclists maintain high cadence (184-188 rpm) while navigating urban streets with buildings and traffic lights.\n- Group rides past a green-roofed structure and a modern glass building, with distance markers showing 6680m to 6650m.\n- Riders' positions shift slightly as they pedal through turns, with one cyclist in a white jersey leading the pack.\n[120-150s] - Cyclist in orange jersey (num. 992) leads a group, maintaining high cadence (183-185 rpm) while navigating urban streets.  \n- A cyclist in black jersey (num. 991) rides closely behind, slightly trailing the group as they pass buildings and intersections.  \n- The group’s pace fluctuates, with cadence dropping to 179 rpm as they approach a turn, indicating a shift in terrain or group dynamics.\n[150-180s] - Cyclist in purple jersey rides ahead, maintaining high cadence (188-190 rpm) while navigating urban streets.  \n- Other riders, including one in blue jersey, follow closely, with distance markers showing progression through the course.  \n- Roadside barriers and spectators line the route, with buildings and traffic lights visible in the background.\n[180-210s] - Cyclist in black jersey maintains high cadence (190 rpm) while navigating urban streets.  \n- Another cyclist in blue jersey follows closely, both riding on paved roads with traffic signs and buildings.  \n- On-screen metrics show distance decreasing from 5680m to 5420m, with speed fluctuating between 28-30 km/h.\n[210-240s] - Cyclist leans forward, pedaling vigorously, with power output fluctuating between 180-198 watts and cadence around 90-95 rpm.\n- Roadside spectators line the street behind green and white barriers, watching the cyclist pass by.\n- On-screen display shows distance decreasing from 5219m to 4890m, with a map indicating route progress and current speed around 28-33 km/h.\n[240-270s] - Cyclist in black jersey rides ahead, maintaining high cadence (184 rpm) as distance decreases to 440m.\n- Other cyclists approach from behind, including one in blue jersey, as they navigate a city street with barriers.\n- On-screen metrics show performance data, including power output and heart rate, alongside a map indicating route progress.\n[270-300s] - Cyclist in front maintains high cadence (183-188 rpm) while leading a group through urban streets.  \n- Group rides closely together, with visible distance markers (e.g., 4370m to 4000m) and route map overlay.  \n- Buildings and traffic infrastructure (e.g., traffic lights, cones) flank the road as riders pass.\n[300-330s] - Cyclist in teal jersey and black shorts maintains position near front, slightly right of lead rider.\n- Group of cyclists rides in tight formation down urban street, passing storefronts and green barriers.\n- On-screen metrics show distance decreasing from 300m to 260m, with cadence fluctuating between 183-188rpm.\n[330-360s] - Cyclist in blue jersey and black shorts maintains a steady pace, slightly ahead of the group.  \n- A cyclist in a teal jersey and black shorts rides closely behind, adjusting position as they navigate the street.  \n- The group passes under a large archway with \"NATIONAL\" visible, indicating a race checkpoint or landmark.", "history_tokens": 991, "history_utf8_bytes": 3831, "recent_frame_times_s": [339.00396666666666, 340.0049666666667, 341.00596666666667, 342.00696666666664, 343.0079666666667, 344.00896666666665, 345.0099666666667, 346.01096666666666, 347.0119666666667, 348.01296666666667, 349.01396666666665, 350.0149666666667, 351.01596666666666, 352.00028333333336, 353.00128333333333, 354.0022833333333, 355.00328333333334, 356.0042833333333, 357.00528333333335, 358.00628333333333, 359.0072833333333, 360.00828333333334, 361.0092833333333, 362.01028333333335, 363.0112833333333, 364.01228333333336, 365.01328333333333, 366.0142833333333, 367.01528333333334, 368.0162833333333], "recent_frames_sha256": "662238c682c4381daa68d7e91dd75fe1ea306c9ef5019d6c05d88b8ea6b5076a", "num_recent_frames": 30, "tq": 715587.968294989, "t1": 715593.772531491, "ta": 715593.772531491, "te": 715593.815282065, "first_response_s": 5.804236502037384, "answer_total_s": 5.846987075987272, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 179, "content_group": "4910a9d800e5878820fb7ed6f0dab902f29928ad44b0d12f26236204f274eb21", "question": {"question_id": "sample_179_a341_q0", "video_id": 179, "video_path": "./videos/sample_179_real.mp4", "annotation_index": 341, "question_index": 0, "question": "What is the current positioning of the National Championships banner right now?", "options": ["A. Behind the cyclists.", "B. On the left side of the road.", "C. On the right side of the road.", "D. Directly above the cyclists."], "answer": "D", "time_stamp_s": 497, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [484, 504], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_179_a341_q0", "video_id": 179, "time_stamp_s": 497, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "94101d8552a00fee78268fdd972a33a556f6bd5e0e03c5b5f597b5a3c1b77600", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [467.0151833333333, 468.01618333333334, 469.0005, 470.0015, 471.0025, 472.0035, 473.0045, 474.0055, 475.0065, 476.0075, 477.0085, 478.0095, 479.0105, 480.0115, 481.0125, 482.0135, 483.0145, 484.0155, 485.0165, 486.00081666666665, 487.0018166666667, 488.00281666666666, 489.0038166666667, 490.00481666666667, 491.00581666666665, 492.0068166666667, 493.00781666666666, 494.0088166666667, 495.00981666666667, 496.01081666666664], "recent_frames_sha256": "c68368b51f6661897c3813cb58c4daa2e34efef09a82a9436e75196d754a91cb", "num_recent_frames": 30, "tq": 715469.045824964, "t1": 715479.661393034, "ta": 715479.661393034, "te": 715479.95818103, "first_response_s": 10.615568070090376, "answer_total_s": 10.91235606605187, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_179_a341_q0", "video_id": 179, "time_stamp_s": 497, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3dc0892f755b55986cc409a711b6cc05c9546bc6ed3365826985b6e7a95d97ce", "condition_order": ["recent", "notes"], "memory": "[180-210s] - Cyclist in black jersey maintains high cadence (190 rpm) while navigating urban streets.  \n- Another cyclist in blue jersey follows closely, both riding on paved roads with traffic signs and buildings.  \n- On-screen metrics show distance decreasing from 5680m to 5420m, with speed fluctuating between 28-30 km/h.\n[210-240s] - Cyclist leans forward, pedaling vigorously, with power output fluctuating between 180-198 watts and cadence around 90-95 rpm.\n- Roadside spectators line the street behind green and white barriers, watching the cyclist pass by.\n- On-screen display shows distance decreasing from 5219m to 4890m, with a map indicating route progress and current speed around 28-33 km/h.\n[240-270s] - Cyclist in black jersey rides ahead, maintaining high cadence (184 rpm) as distance decreases to 440m.\n- Other cyclists approach from behind, including one in blue jersey, as they navigate a city street with barriers.\n- On-screen metrics show performance data, including power output and heart rate, alongside a map indicating route progress.\n[270-300s] - Cyclist in front maintains high cadence (183-188 rpm) while leading a group through urban streets.  \n- Group rides closely together, with visible distance markers (e.g., 4370m to 4000m) and route map overlay.  \n- Buildings and traffic infrastructure (e.g., traffic lights, cones) flank the road as riders pass.\n[300-330s] - Cyclist in teal jersey and black shorts maintains position near front, slightly right of lead rider.\n- Group of cyclists rides in tight formation down urban street, passing storefronts and green barriers.\n- On-screen metrics show distance decreasing from 300m to 260m, with cadence fluctuating between 183-188rpm.\n[330-360s] - Cyclist in blue jersey and black shorts maintains a steady pace, slightly ahead of the group.  \n- A cyclist in a teal jersey and black shorts rides closely behind, adjusting position as they navigate the street.  \n- The group passes under a large archway with \"NATIONAL\" visible, indicating a race checkpoint or landmark.\n[360-390s] - Cyclists in blue jerseys ride closely together, maintaining high cadence (188 rpm) as they navigate urban streets.  \n- A cyclist in the foreground leans forward, adjusting position slightly while others maintain similar aerodynamic stances.  \n- The route map on screen shows decreasing distance (from 300m to 270m) and fluctuating elevation, indicating a downhill or flat section.\n[390-420s] - Cyclist in blue jersey and white shorts rides closely behind another cyclist, both maintaining high cadence (187-188 rpm) as they navigate urban streets.\n- The race route passes through city blocks with buildings, storefronts, and spectators along barriers, with a visible \"SONS\" sign on a building.\n- On-screen metrics show distance decreasing from 2610m to 2224m, with speed fluctuating between 28-33 mph, and a map indicating the route's progress.\n[420-450s] - Cyclist in blue jersey and black shorts maintains a steady pace, slightly ahead of the group, with power output fluctuating between 330-350W.\n- A cyclist in red and white jersey rides closely behind, adjusting position as the group navigates a turn near a modern building.\n- The road is lined with white barriers, and spectators are visible on sidewalks, with a traffic light and street signs indicating urban surroundings.\n[450-480s] - Cyclist in teal jersey and black shorts rides ahead, maintaining a steady pace with a heart rate of 198 bpm.\n- Group of cyclists follows closely behind, navigating urban streets with buildings and traffic lights visible.\n- On-screen metrics show distance increasing from 1785m to 1436m, with speed fluctuating between 28-34 km/h and cadence around 90-95 rpm.", "history_tokens": 950, "history_utf8_bytes": 3715, "recent_frame_times_s": [467.0151833333333, 468.01618333333334, 469.0005, 470.0015, 471.0025, 472.0035, 473.0045, 474.0055, 475.0065, 476.0075, 477.0085, 478.0095, 479.0105, 480.0115, 481.0125, 482.0135, 483.0145, 484.0155, 485.0165, 486.00081666666665, 487.0018166666667, 488.00281666666666, 489.0038166666667, 490.00481666666667, 491.00581666666665, 492.0068166666667, 493.00781666666666, 494.0088166666667, 495.00981666666667, 496.01081666666664], "recent_frames_sha256": "c68368b51f6661897c3813cb58c4daa2e34efef09a82a9436e75196d754a91cb", "num_recent_frames": 30, "tq": 715629.862095072, "t1": 715667.005795935, "ta": 715667.005795935, "te": 715667.044138394, "first_response_s": 37.14370086300187, "answer_total_s": 37.182043321896344, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 180, "content_group": "997858444f61450051e1d1936c3e2a7a8685e0cd1197ebb92897ab3165d2a4ed", "question": {"question_id": "sample_180_a1819_q0", "video_id": 180, "video_path": "./videos/sample_180_real.mp4", "annotation_index": 1819, "question_index": 0, "question": "How many trees are on the left side of the road right now?", "options": ["A. Four.", "B. Six.", "C. Seven.", "D. Three."], "answer": "D", "time_stamp_s": 3, "task_type": "Counting", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_180_a1819_q0", "video_id": 180, "time_stamp_s": 3, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "99a4e83337929a2c27f2d22816ac7bc00b0f93535c4edbbec0f4ef555498ce73", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.046, 1.0136333333333334, 2.0146333333333333], "recent_frames_sha256": "545022788f98a9d6edbb112a4f92d1bf229df1034a31e95bc5cec30af76cac3c", "num_recent_frames": 3, "tq": 715850.055246, "t1": 715850.30387441, "ta": 715850.30387441, "te": 715850.342187713, "first_response_s": 0.24862841004505754, "answer_total_s": 0.28694171307142824, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_180_a1819_q0", "video_id": 180, "time_stamp_s": 3, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ffacc083430c63a53ec726330915242e917c18f055414046e48d399ffd780d0c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.046, 1.0136333333333334, 2.0146333333333333], "recent_frames_sha256": "545022788f98a9d6edbb112a4f92d1bf229df1034a31e95bc5cec30af76cac3c", "num_recent_frames": 3, "tq": 715898.796516992, "t1": 715899.759756712, "ta": 715899.759756712, "te": 715899.945680315, "first_response_s": 0.9632397199748084, "answer_total_s": 1.1491633229888976, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 180, "content_group": "997858444f61450051e1d1936c3e2a7a8685e0cd1197ebb92897ab3165d2a4ed", "question": {"question_id": "sample_180_a1820_q0", "video_id": 180, "video_path": "./videos/sample_180_real.mp4", "annotation_index": 1820, "question_index": 0, "question": "Where are the hay bales located right now?", "options": ["A. On the left side of the road.", "B. On the both sides of the road.", "C. In the middle of the road.", "D. Directly ahead of the cyclist."], "answer": "B", "time_stamp_s": 141, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [136, 156], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_180_a1820_q0", "video_id": 180, "time_stamp_s": 141, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c9401d1191f1aa1202195cf7f17f21c0ec162d9c4e2e583fcdb52c7ed143c8b7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [111.02353333333333, 112.02453333333334, 113.02553333333333, 114.02653333333333, 115.02753333333334, 116.02853333333333, 117.02953333333333, 118.03053333333334, 119.03153333333333, 120.03253333333333, 121.00016666666667, 122.00116666666666, 123.00216666666667, 124.00316666666667, 125.00416666666666, 126.00516666666667, 127.00616666666667, 128.00716666666668, 129.00816666666665, 130.00916666666666, 131.01016666666666, 132.01116666666667, 133.01216666666667, 134.01316666666668, 135.01416666666665, 136.01516666666666, 137.01616666666666, 138.01716666666667, 139.01816666666667, 140.01916666666668], "recent_frames_sha256": "8decc04a4aad55ac02040a133ae7ea0ee688e5d0497c81102358184c2c461a60", "num_recent_frames": 30, "tq": 715850.350747801, "t1": 715861.161626773, "ta": 715861.161626773, "te": 715861.199137111, "first_response_s": 10.810878971940838, "answer_total_s": 10.848389309947379, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_180_a1820_q0", "video_id": 180, "time_stamp_s": 141, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3bd0bec6cc8fea472d162285163a9f38cb15862b6752b9dc0ee61291bb91b4fd", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Road surface shows gradual descent with slope percentage decreasing from 3% to 1% as cyclist moves forward.  \n- Trees line the roadside, with spacing and density changing as the path curves slightly to the right.  \n- On-screen data updates continuously: speed fluctuates around 24-25 km/h, distance increases from 63.4 to 63.6 km, and time decreases from 81:14 to 72:14 minutes.\n[30-60s] - A white SUV passes on the left, briefly obscuring the view before moving out of frame.  \n- The road curves slightly to the right, with a fence and industrial buildings visible on the left side.  \n- The speedometer shows a steady 24-25 km/h, with the route map indicating a total distance of 63.7 km.\n[60-90s] - Road sign for \"Görsbach\" appears on right side, indicating location change.  \n- A silver car passes on left, moving in opposite direction.  \n- Terrain transitions from paved road to gravel path with slight incline.\n[90-120s] - Road ascends gradually, with speedometer showing increasing speed from 80 to 90 km/h.\n- Left side features a long fence with industrial structures, while right side has dry grass and distant hills.\n- Road signs indicate a 3% incline and a truck speed limit of 30 km/h ahead.", "history_tokens": 322, "history_utf8_bytes": 1213, "recent_frame_times_s": [111.02353333333333, 112.02453333333334, 113.02553333333333, 114.02653333333333, 115.02753333333334, 116.02853333333333, 117.02953333333333, 118.03053333333334, 119.03153333333333, 120.03253333333333, 121.00016666666667, 122.00116666666666, 123.00216666666667, 124.00316666666667, 125.00416666666666, 126.00516666666667, 127.00616666666667, 128.00716666666668, 129.00816666666665, 130.00916666666666, 131.01016666666666, 132.01116666666667, 133.01216666666667, 134.01316666666668, 135.01416666666665, 136.01516666666666, 137.01616666666666, 138.01716666666667, 139.01816666666667, 140.01916666666668], "recent_frames_sha256": "8decc04a4aad55ac02040a133ae7ea0ee688e5d0497c81102358184c2c461a60", "num_recent_frames": 30, "tq": 715927.968123351, "t1": 715929.505013855, "ta": 715929.505013855, "te": 715929.696439998, "first_response_s": 1.5368905040668324, "answer_total_s": 1.7283166470006108, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 180, "content_group": "997858444f61450051e1d1936c3e2a7a8685e0cd1197ebb92897ab3165d2a4ed", "question": {"question_id": "sample_180_a1821_q0", "video_id": 180, "video_path": "./videos/sample_180_real.mp4", "annotation_index": 1821, "question_index": 0, "question": "What is the object located near the lamp post right now?", "options": ["A. A car.", "B. A bicycle.", "C. A mailbox.", "D. A tree with white flowers."], "answer": "D", "time_stamp_s": 276, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [272, 292], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_180_a1821_q0", "video_id": 180, "time_stamp_s": 276, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "67880434403a60e066a5f435541dde25c83f7883bab008e7f605218c690d11d3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [246.02506666666667, 247.02606666666668, 248.02706666666666, 249.02806666666666, 250.02906666666667, 251.03006666666667, 252.03106666666667, 253.03206666666668, 254.03306666666666, 255.0007, 256.0017, 257.0027, 258.0037, 259.0047, 260.0057, 261.0067, 262.0077, 263.0087, 264.0097, 265.0107, 266.0117, 267.0127, 268.0137, 269.0147, 270.0157, 271.0167, 272.0177, 273.0187, 274.0197, 275.0207], "recent_frames_sha256": "d90774f5236f54c00d9d8b0991346a088442e926a486c3eb357b6a3909f3373d", "num_recent_frames": 30, "tq": 715861.209253807, "t1": 715872.406232951, "ta": 715872.406232951, "te": 715872.4463978, "first_response_s": 11.196979144006036, "answer_total_s": 11.23714399302844, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_180_a1821_q0", "video_id": 180, "time_stamp_s": 276, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "79b44e3b087e5c79498ecf45a35d3fca1b1d91cb070b7892fda4eba186b7419f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Road surface shows gradual descent with slope percentage decreasing from 3% to 1% as cyclist moves forward.  \n- Trees line the roadside, with spacing and density changing as the path curves slightly to the right.  \n- On-screen data updates continuously: speed fluctuates around 24-25 km/h, distance increases from 63.4 to 63.6 km, and time decreases from 81:14 to 72:14 minutes.\n[30-60s] - A white SUV passes on the left, briefly obscuring the view before moving out of frame.  \n- The road curves slightly to the right, with a fence and industrial buildings visible on the left side.  \n- The speedometer shows a steady 24-25 km/h, with the route map indicating a total distance of 63.7 km.\n[60-90s] - Road sign for \"Görsbach\" appears on right side, indicating location change.  \n- A silver car passes on left, moving in opposite direction.  \n- Terrain transitions from paved road to gravel path with slight incline.\n[90-120s] - Road ascends gradually, with speedometer showing increasing speed from 80 to 90 km/h.\n- Left side features a long fence with industrial structures, while right side has dry grass and distant hills.\n- Road signs indicate a 3% incline and a truck speed limit of 30 km/h ahead.\n[120-150s] - Road speed fluctuates between 44-105 km/h with a 2-3% incline, showing steady progress over 64.3-64.7 km.\n- The route map on the right displays a white outline of a region, with a small blue dot indicating current position.\n- The environment remains consistent: open fields with hay bales, clear blue sky, and distant horizon.\n[150-180s] - Road surface slopes upward, indicated by a +1% grade, with speed decreasing from 82 to 70 km/h.\n- A white road sign appears on the right, indicating a turn or route change ahead.\n- The map overlay shows a white line tracing the route, with a small marker near the current position.\n[180-210s] - Road ascends slightly, indicated by changing gradient from -4% to -3% and then -2%.\n- Speed fluctuates between 63 and 69 km/h, with a minor dip to 60 km/h around 188 seconds.\n- Road sign (triangle) appears on the right, indicating a potential hazard ahead.\n[210-240s] - Road surface slopes upward, indicated by increasing gradient from -1% to +4%.\n- GPS map shows route progression with a white line tracing path through rural terrain.\n- Speedometer fluctuates between 40-90 km/h as cyclist navigates the winding road.\n[240-270s] - Road surface transitions from rural asphalt to paved village street with houses on either side.  \n- Speedometer shows decreasing speed from 58 to 43 km/h as the cyclist approaches a residential area.  \n- GPS map overlay indicates route progress and elevation changes, with temperature at 33°C.", "history_tokens": 717, "history_utf8_bytes": 2688, "recent_frame_times_s": [246.02506666666667, 247.02606666666668, 248.02706666666666, 249.02806666666666, 250.02906666666667, 251.03006666666667, 252.03106666666667, 253.03206666666668, 254.03306666666666, 255.0007, 256.0017, 257.0027, 258.0037, 259.0047, 260.0057, 261.0067, 262.0077, 263.0087, 264.0097, 265.0107, 266.0117, 267.0127, 268.0137, 269.0147, 270.0157, 271.0167, 272.0177, 273.0187, 274.0197, 275.0207], "recent_frames_sha256": "d90774f5236f54c00d9d8b0991346a088442e926a486c3eb357b6a3909f3373d", "num_recent_frames": 30, "tq": 715964.896840989, "t1": 715966.124508745, "ta": 715966.124508745, "te": 715966.312316307, "first_response_s": 1.2276677560294047, "answer_total_s": 1.4154753179755062, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 180, "content_group": "997858444f61450051e1d1936c3e2a7a8685e0cd1197ebb92897ab3165d2a4ed", "question": {"question_id": "sample_180_a1822_q0", "video_id": 180, "video_path": "./videos/sample_180_real.mp4", "annotation_index": 1822, "question_index": 0, "question": "Where is the tree shadow located right now?", "options": ["A. On the left side of the road.", "B. Across the entire road.", "C. On the right side of the road.", "D. In the middle of the road."], "answer": "B", "time_stamp_s": 423, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [408, 428], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_180_a1822_q0", "video_id": 180, "time_stamp_s": 423, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1506e330336bfe1a4fa3eaa33749a59c9809796778dcb7d895f87d09b402218b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [393.0052333333333, 394.00623333333334, 395.0072333333333, 396.00823333333335, 397.0092333333333, 398.01023333333336, 399.01123333333334, 400.0122333333333, 401.01323333333335, 402.0142333333333, 403.01523333333336, 404.01623333333333, 405.0172333333333, 406.01823333333334, 407.0192333333333, 408.02023333333335, 409.0212333333333, 410.02223333333336, 411.02323333333334, 412.0242333333333, 413.02523333333335, 414.0262333333333, 415.02723333333336, 416.02823333333333, 417.0292333333333, 418.03023333333334, 419.0312333333333, 420.03223333333335, 421.0332333333333, 422.00086666666664], "recent_frames_sha256": "89323576e442b71cd44dc35207285770001f2e71a9e129474f6ed4a5077e9c55", "num_recent_frames": 30, "tq": 715872.45846295, "t1": 715883.862844665, "ta": 715883.862844665, "te": 715883.900500615, "first_response_s": 11.404381714994088, "answer_total_s": 11.44203766505234, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_180_a1822_q0", "video_id": 180, "time_stamp_s": 423, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0f75f8a4adc59065f9542b82dc8afb03eaa809aa56ea222194e35e1a5c7e1d6c", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Road sign for \"Görsbach\" appears on right side, indicating location change.  \n- A silver car passes on left, moving in opposite direction.  \n- Terrain transitions from paved road to gravel path with slight incline.\n[90-120s] - Road ascends gradually, with speedometer showing increasing speed from 80 to 90 km/h.\n- Left side features a long fence with industrial structures, while right side has dry grass and distant hills.\n- Road signs indicate a 3% incline and a truck speed limit of 30 km/h ahead.\n[120-150s] - Road speed fluctuates between 44-105 km/h with a 2-3% incline, showing steady progress over 64.3-64.7 km.\n- The route map on the right displays a white outline of a region, with a small blue dot indicating current position.\n- The environment remains consistent: open fields with hay bales, clear blue sky, and distant horizon.\n[150-180s] - Road surface slopes upward, indicated by a +1% grade, with speed decreasing from 82 to 70 km/h.\n- A white road sign appears on the right, indicating a turn or route change ahead.\n- The map overlay shows a white line tracing the route, with a small marker near the current position.\n[180-210s] - Road ascends slightly, indicated by changing gradient from -4% to -3% and then -2%.\n- Speed fluctuates between 63 and 69 km/h, with a minor dip to 60 km/h around 188 seconds.\n- Road sign (triangle) appears on the right, indicating a potential hazard ahead.\n[210-240s] - Road surface slopes upward, indicated by increasing gradient from -1% to +4%.\n- GPS map shows route progression with a white line tracing path through rural terrain.\n- Speedometer fluctuates between 40-90 km/h as cyclist navigates the winding road.\n[240-270s] - Road surface transitions from rural asphalt to paved village street with houses on either side.  \n- Speedometer shows decreasing speed from 58 to 43 km/h as the cyclist approaches a residential area.  \n- GPS map overlay indicates route progress and elevation changes, with temperature at 33°C.\n[270-300s] - Road surface transitions from paved to gravel, with trees lining both sides.  \n- Speed fluctuates between 35-75 km/h, with incline changing from -1% to +2%.  \n- GPS map shows route progress toward a destination marked in the upper right corner.\n[300-330s] - Road surface shows gradual incline, with speedometer reading increasing from 24 to 33 km/h.\n- Trees line both sides of the road, with a clear view of a rural landscape and distant hills.\n- On-screen display indicates 66.6 km total distance, 76 minutes elapsed, and 3% gradient, with temperature at 33°C.\n[330-360s] - Road ascends gently with a 1% incline, passing through a tree-lined section with a speedometer showing 85-86 km/h.\n- A white car is visible ahead, moving slowly on the road, with a map overlay indicating the route and current location.\n- The road surface appears dry and smooth, with a clear blue sky overhead and a temperature of 20°C displayed on-screen.\n[360-390s] - Road surface shows slight incline with consistent 1-3% gradient as indicated on screen.\n- Trees and grassy embankments flank both sides of the road, with clear lane markings.\n- On-screen data updates: speed fluctuates between 24-28 km/h, distance increases from 67.1 to 67.3 km, and estimated time decreases from 82 to 76 minutes.\n[390-420s] - Road speed fluctuates between 76 and 83 km/h, with a slight incline (1%) visible on the left.\n- A green sign for \"Burgstall\" appears on the right side of the road at 394 seconds.\n- The map overlay shows a route with a blue dot indicating the current position, moving along a winding path.", "history_tokens": 966, "history_utf8_bytes": 3581, "recent_frame_times_s": [393.0052333333333, 394.00623333333334, 395.0072333333333, 396.00823333333335, 397.0092333333333, 398.01023333333336, 399.01123333333334, 400.0122333333333, 401.01323333333335, 402.0142333333333, 403.01523333333336, 404.01623333333333, 405.0172333333333, 406.01823333333334, 407.0192333333333, 408.02023333333335, 409.0212333333333, 410.02223333333336, 411.02323333333334, 412.0242333333333, 413.02523333333335, 414.0262333333333, 415.02723333333336, 416.02823333333333, 417.0292333333333, 418.03023333333334, 419.0312333333333, 420.03223333333335, 421.0332333333333, 422.00086666666664], "recent_frames_sha256": "89323576e442b71cd44dc35207285770001f2e71a9e129474f6ed4a5077e9c55", "num_recent_frames": 30, "tq": 715999.777924011, "t1": 716001.858740793, "ta": 716001.858740793, "te": 716001.898709892, "first_response_s": 2.0808167819632217, "answer_total_s": 2.1207858809502795, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 180, "content_group": "997858444f61450051e1d1936c3e2a7a8685e0cd1197ebb92897ab3165d2a4ed", "question": {"question_id": "sample_180_a1823_q0", "video_id": 180, "video_path": "./videos/sample_180_real.mp4", "annotation_index": 1823, "question_index": 0, "question": "Where is the cyclist heading right now?", "options": ["A. Towards a commercial area.", "B. Towards a residential area.", "C. Towards an industrial area.", "D. Towards a forest."], "answer": "B", "time_stamp_s": 563, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [544, 564], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_180_a1823_q0", "video_id": 180, "time_stamp_s": 563, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8f976704463a9158fca4375090de711b3cc20da74fa83ff7723e80dd1e684da7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [533.0117666666666, 534.0127666666667, 535.0137666666667, 536.0147666666667, 537.0157666666667, 538.0167666666666, 539.0177666666667, 540.0187666666667, 541.0197666666667, 542.0207666666666, 543.0217666666666, 544.0227666666667, 545.0237666666667, 546.0247666666667, 547.0257666666666, 548.0267666666666, 549.0277666666667, 550.0287666666667, 551.0297666666667, 552.0307666666666, 553.0317666666666, 554.0327666666667, 555.0004, 556.0014, 557.0024, 558.0034, 559.0044, 560.0054, 561.0064, 562.0074], "recent_frames_sha256": "b7f371ce4143570575684889a7f7901cb32ed9616bf6d785a1e4138b272591dd", "num_recent_frames": 30, "tq": 715883.907923756, "t1": 715898.75055371, "ta": 715898.75055371, "te": 715898.787656978, "first_response_s": 14.842629953986034, "answer_total_s": 14.879733221954666, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_180_a1823_q0", "video_id": 180, "time_stamp_s": 563, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3772f89f380abed4d56d18f79d86a99a602291859fdf94f47c894a0290cbae38", "condition_order": ["recent", "notes"], "memory": "[180-210s] - Road ascends slightly, indicated by changing gradient from -4% to -3% and then -2%.\n- Speed fluctuates between 63 and 69 km/h, with a minor dip to 60 km/h around 188 seconds.\n- Road sign (triangle) appears on the right, indicating a potential hazard ahead.\n[210-240s] - Road surface slopes upward, indicated by increasing gradient from -1% to +4%.\n- GPS map shows route progression with a white line tracing path through rural terrain.\n- Speedometer fluctuates between 40-90 km/h as cyclist navigates the winding road.\n[240-270s] - Road surface transitions from rural asphalt to paved village street with houses on either side.  \n- Speedometer shows decreasing speed from 58 to 43 km/h as the cyclist approaches a residential area.  \n- GPS map overlay indicates route progress and elevation changes, with temperature at 33°C.\n[270-300s] - Road surface transitions from paved to gravel, with trees lining both sides.  \n- Speed fluctuates between 35-75 km/h, with incline changing from -1% to +2%.  \n- GPS map shows route progress toward a destination marked in the upper right corner.\n[300-330s] - Road surface shows gradual incline, with speedometer reading increasing from 24 to 33 km/h.\n- Trees line both sides of the road, with a clear view of a rural landscape and distant hills.\n- On-screen display indicates 66.6 km total distance, 76 minutes elapsed, and 3% gradient, with temperature at 33°C.\n[330-360s] - Road ascends gently with a 1% incline, passing through a tree-lined section with a speedometer showing 85-86 km/h.\n- A white car is visible ahead, moving slowly on the road, with a map overlay indicating the route and current location.\n- The road surface appears dry and smooth, with a clear blue sky overhead and a temperature of 20°C displayed on-screen.\n[360-390s] - Road surface shows slight incline with consistent 1-3% gradient as indicated on screen.\n- Trees and grassy embankments flank both sides of the road, with clear lane markings.\n- On-screen data updates: speed fluctuates between 24-28 km/h, distance increases from 67.1 to 67.3 km, and estimated time decreases from 82 to 76 minutes.\n[390-420s] - Road speed fluctuates between 76 and 83 km/h, with a slight incline (1%) visible on the left.\n- A green sign for \"Burgstall\" appears on the right side of the road at 394 seconds.\n- The map overlay shows a route with a blue dot indicating the current position, moving along a winding path.\n[420-450s] - Road ascends gradually with a consistent 1% incline, flanked by green trees and dry grassy fields.  \n- Speedometer shows steady increase from 72 to 85 km/h, indicating accelerating ride.  \n- GPS map on right displays route progress with a blue dot tracking position near the UK’s southern coast.\n[450-480s] - Road ascends slightly, indicated by 2% gradient, with speed increasing from 37 to 45 km/h.\n- A white house with a red roof appears on the right, followed by a silver van parked nearby.\n- Road sign indicating a 1.1 km distance to a junction is visible, with speed dropping to 0 km/h as the rider approaches.\n[480-510s] - A black van drives past on the road, moving away from the camera's perspective.  \n- The road curves gently to the right, flanked by trees and grassy fields under a clear blue sky.  \n- On-screen data shows a slight incline (3% to 4%) and increasing distance (68.2 KM to 68.4 KM).\n[510-540s] - Road surface shows slight incline (1% to 2%) with trees lining both sides.  \n- GPS map on right displays location near Hohne, Germany, with temperature at 34°C.  \n- Speed fluctuates between 35–90 km/h, with cadence around 80–85 RPM.", "history_tokens": 994, "history_utf8_bytes": 3606, "recent_frame_times_s": [533.0117666666666, 534.0127666666667, 535.0137666666667, 536.0147666666667, 537.0157666666667, 538.0167666666666, 539.0177666666667, 540.0187666666667, 541.0197666666667, 542.0207666666666, 543.0217666666666, 544.0227666666667, 545.0237666666667, 546.0247666666667, 547.0257666666666, 548.0267666666666, 549.0277666666667, 550.0287666666667, 551.0297666666667, 552.0307666666666, 553.0317666666666, 554.0327666666667, 555.0004, 556.0014, 557.0024, 558.0034, 559.0044, 560.0054, 561.0064, 562.0074], "recent_frames_sha256": "b7f371ce4143570575684889a7f7901cb32ed9616bf6d785a1e4138b272591dd", "num_recent_frames": 30, "tq": 716037.139768036, "t1": 716043.961974015, "ta": 716043.961974015, "te": 716044.241724866, "first_response_s": 6.822205979027785, "answer_total_s": 7.101956830010749, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 182, "content_group": "c61f87bcac6860f2407f44ae888a30dd36d22cb5fd025b3e7427a818ba42f281", "question": {"question_id": "sample_182_a1556_q0", "video_id": 182, "video_path": "./videos/sample_182_real.mp4", "annotation_index": 1556, "question_index": 0, "question": "What is trees located right now?", "options": ["A. Directly beside the cyclist.", "B. Behind the cyclist.", "C. On the right side of the road.", "D. On the both sides of the road."], "answer": "D", "time_stamp_s": 20, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_182_a1556_q0", "video_id": 182, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bb508ff3a9cf35554a88afac1428f3f02af87e8adf4ebdfaf543416fd3ea4e3e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.033, 1.0006333333333333, 2.0016333333333334, 3.0026333333333333, 4.003633333333333, 5.0046333333333335, 6.005633333333333, 7.006633333333333, 8.007633333333333, 9.008633333333334, 10.009633333333333, 11.010633333333333, 12.011633333333334, 13.012633333333333, 14.013633333333333, 15.014633333333334, 16.015633333333334, 17.016633333333335, 18.017633333333333, 19.018633333333334], "recent_frames_sha256": "50c91362b44b100146439cb9d9160112373e5cdf2edd086a88407a34d5a0e1ab", "num_recent_frames": 20, "tq": 715781.24227825, "t1": 715786.569495165, "ta": 715786.569495165, "te": 715786.792541095, "first_response_s": 5.327216914971359, "answer_total_s": 5.550262845004909, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_182_a1556_q0", "video_id": 182, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "C. On the right side of the road.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "5a78a16ff2ad44015cd7a04a9e2fd03d3bd8d8182a019fb2a9014eb74651b2f4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.033, 1.0006333333333333, 2.0016333333333334, 3.0026333333333333, 4.003633333333333, 5.0046333333333335, 6.005633333333333, 7.006633333333333, 8.007633333333333, 9.008633333333334, 10.009633333333333, 11.010633333333333, 12.011633333333334, 13.012633333333333, 14.013633333333333, 15.014633333333334, 16.015633333333334, 17.016633333333335, 18.017633333333333, 19.018633333333334], "recent_frames_sha256": "50c91362b44b100146439cb9d9160112373e5cdf2edd086a88407a34d5a0e1ab", "num_recent_frames": 20, "tq": 715829.201511834, "t1": 715830.668152942, "ta": 715830.668152942, "te": 715831.233189022, "first_response_s": 1.4666411079233512, "answer_total_s": 2.0316771880025044, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 182, "content_group": "c61f87bcac6860f2407f44ae888a30dd36d22cb5fd025b3e7427a818ba42f281", "question": {"question_id": "sample_182_a1557_q0", "video_id": 182, "video_path": "./videos/sample_182_real.mp4", "annotation_index": 1557, "question_index": 0, "question": "Which direction is the road curving right now?", "options": ["A. To the left.", "B. It is straight.", "C. It is a U-turn.", "D. To the right."], "answer": "D", "time_stamp_s": 131, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [111, 131], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_182_a1557_q0", "video_id": 182, "time_stamp_s": 131, "ground_truth": "D", "raw_output": "D. To the right.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "4d4f321a0020cfe96fbfef60473ec547b12d686eef6e77b5eb8cf6417da76ada", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [101.00053333333334, 102.00153333333333, 103.00253333333333, 104.00353333333334, 105.00453333333333, 106.00553333333333, 107.00653333333334, 108.00753333333333, 109.00853333333333, 110.00953333333334, 111.01053333333333, 112.01153333333333, 113.01253333333334, 114.01353333333333, 115.01453333333333, 116.01553333333334, 117.01653333333333, 118.01753333333333, 119.01853333333334, 120.01953333333333, 121.02053333333333, 122.02153333333334, 123.02253333333333, 124.02353333333333, 125.02453333333334, 126.02553333333333, 127.02653333333333, 128.02753333333334, 129.02853333333334, 130.02953333333335], "recent_frames_sha256": "6f8cfc04f3e2e7ab30306f1d4d503ef961f48c1e40efec0bd226a204f75c5e14", "num_recent_frames": 30, "tq": 715786.811948598, "t1": 715797.541124161, "ta": 715797.541124161, "te": 715797.761999278, "first_response_s": 10.72917556297034, "answer_total_s": 10.950050679966807, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_182_a1557_q0", "video_id": 182, "time_stamp_s": 131, "ground_truth": "D", "raw_output": "D. To the right.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "b00b8047145a3861281dd3d1e7eafee79a956338c8ae6f1c9734e16844f5c659", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Road speed fluctuates between 75-80 km/h with a 1% incline, while a map overlay shows route progress near Nörd.\n- A white car overtakes from the left at 0:23, followed by a black car at 0:25.\n- The speedometer and map display remain static, indicating steady cycling conditions with no significant changes in terrain or traffic.\n[30-60s] - Road speed increases from 30 to 49 km/h while maintaining a 2% incline, with distance progressing from 77.2 to 77.5 km.\n- A single tree stands prominently on the right side of the road, with fields and distant hills visible in the background.\n- The on-screen map shows a route marked in blue, with a temperature of 36°C displayed in the top right corner.\n[60-90s] - Road curves right, then left, with trees lining both sides and a grassy verge on the right.  \n- Speed fluctuates between 51–53 km/h, with a slight incline (3% grade) indicated.  \n- GPS map shows route progress toward a destination marked in northern Germany.\n[90-120s] - Road surface curves gently to the right, with a white dashed line marking the center.\n- A dark-colored car passes on the left, moving in the opposite direction.\n- On-screen display shows speed fluctuating between 48 and 69 km/h, with a 4% incline and 78.0–78.8 km distance traveled.", "history_tokens": 347, "history_utf8_bytes": 1275, "recent_frame_times_s": [101.00053333333334, 102.00153333333333, 103.00253333333333, 104.00353333333334, 105.00453333333333, 106.00553333333333, 107.00653333333334, 108.00753333333333, 109.00853333333333, 110.00953333333334, 111.01053333333333, 112.01153333333333, 113.01253333333334, 114.01353333333333, 115.01453333333333, 116.01553333333334, 117.01653333333333, 118.01753333333333, 119.01853333333334, 120.01953333333333, 121.02053333333333, 122.02153333333334, 123.02253333333333, 124.02353333333333, 125.02453333333334, 126.02553333333333, 127.02653333333333, 128.02753333333334, 129.02853333333334, 130.02953333333335], "recent_frames_sha256": "6f8cfc04f3e2e7ab30306f1d4d503ef961f48c1e40efec0bd226a204f75c5e14", "num_recent_frames": 30, "tq": 715871.876096882, "t1": 715878.489516358, "ta": 715878.489516358, "te": 715878.718991296, "first_response_s": 6.613419475965202, "answer_total_s": 6.842894413974136, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 182, "content_group": "c61f87bcac6860f2407f44ae888a30dd36d22cb5fd025b3e7427a818ba42f281", "question": {"question_id": "sample_182_a1558_q0", "video_id": 182, "video_path": "./videos/sample_182_real.mp4", "annotation_index": 1558, "question_index": 0, "question": "Where is the white post with a reflector located right now?", "options": ["A. In the middle of the road.", "B. On the left side of the road.", "C. At the end of the road.", "D. Along the both sides of the road."], "answer": "D", "time_stamp_s": 236, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [222, 242], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_182_a1558_q0", "video_id": 182, "time_stamp_s": 236, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "22f05f027ddcc2af7d7e8ca773d803f411cc8f0442838adf1376f264a40daf58", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [206.00543333333334, 207.00643333333332, 208.00743333333332, 209.00843333333333, 210.00943333333333, 211.01043333333334, 212.01143333333334, 213.01243333333332, 214.01343333333332, 215.01443333333333, 216.01543333333333, 217.01643333333334, 218.01743333333334, 219.01843333333332, 220.01943333333332, 221.02043333333333, 222.02143333333333, 223.02243333333334, 224.02343333333334, 225.02443333333332, 226.02543333333332, 227.02643333333333, 228.02743333333333, 229.02843333333334, 230.02943333333334, 231.03043333333332, 232.03143333333333, 233.03243333333333, 234.00006666666667, 235.00106666666667], "recent_frames_sha256": "dab005ed866280a33bd4d7e37877c1a73b248ee1158d470e86c786221599c913", "num_recent_frames": 30, "tq": 715797.782631222, "t1": 715805.054736573, "ta": 715805.054736573, "te": 715805.092282044, "first_response_s": 7.272105350974016, "answer_total_s": 7.309650821960531, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_182_a1558_q0", "video_id": 182, "time_stamp_s": 236, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2928f0e99c8bfda6c57cde82a02f9f83097d0758611709b82b214922819fcdbd", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Road speed fluctuates between 75-80 km/h with a 1% incline, while a map overlay shows route progress near Nörd.\n- A white car overtakes from the left at 0:23, followed by a black car at 0:25.\n- The speedometer and map display remain static, indicating steady cycling conditions with no significant changes in terrain or traffic.\n[30-60s] - Road speed increases from 30 to 49 km/h while maintaining a 2% incline, with distance progressing from 77.2 to 77.5 km.\n- A single tree stands prominently on the right side of the road, with fields and distant hills visible in the background.\n- The on-screen map shows a route marked in blue, with a temperature of 36°C displayed in the top right corner.\n[60-90s] - Road curves right, then left, with trees lining both sides and a grassy verge on the right.  \n- Speed fluctuates between 51–53 km/h, with a slight incline (3% grade) indicated.  \n- GPS map shows route progress toward a destination marked in northern Germany.\n[90-120s] - Road surface curves gently to the right, with a white dashed line marking the center.\n- A dark-colored car passes on the left, moving in the opposite direction.\n- On-screen display shows speed fluctuating between 48 and 69 km/h, with a 4% incline and 78.0–78.8 km distance traveled.\n[120-150s] - Road curves left, then right, flanked by trees and dry grass, with a yellow road sign visible.  \n- Speedometer shows decreasing speed from 68 to 55 km/h, and elevation gain drops from 4% to 2%.  \n- Map overlay indicates location near Hohne, with temperature at 34°C and distance at 78.5–79.0 km.\n[150-180s] - A red car passes on the right side of the road, moving away from the camera.  \n- The road curves to the right, with a stop sign visible on the right side of the road.  \n- The speedometer shows a decreasing speed, indicating the cyclist is slowing down.\n[180-210s] - Road speed fluctuates between 24-76 km/h with a 1% incline, total distance 79.3 km.  \n- Right side of road shows grassy verge with fence and trees, left side lined with dense foliage.  \n- Map overlay indicates location near \"Höhe\" with temperature 34°C and a blue dot marking current position.", "history_tokens": 600, "history_utf8_bytes": 2162, "recent_frame_times_s": [206.00543333333334, 207.00643333333332, 208.00743333333332, 209.00843333333333, 210.00943333333333, 211.01043333333334, 212.01143333333334, 213.01243333333332, 214.01343333333332, 215.01443333333333, 216.01543333333333, 217.01643333333334, 218.01743333333334, 219.01843333333332, 220.01943333333332, 221.02043333333333, 222.02143333333333, 223.02243333333334, 224.02343333333334, 225.02443333333332, 226.02543333333332, 227.02643333333333, 228.02743333333333, 229.02843333333334, 230.02943333333334, 231.03043333333332, 232.03143333333333, 233.03243333333333, 234.00006666666667, 235.00106666666667], "recent_frames_sha256": "dab005ed866280a33bd4d7e37877c1a73b248ee1158d470e86c786221599c913", "num_recent_frames": 30, "tq": 715904.405896225, "t1": 715911.37810449, "ta": 715911.37810449, "te": 715911.714415171, "first_response_s": 6.972208264982328, "answer_total_s": 7.308518945937976, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 182, "content_group": "c61f87bcac6860f2407f44ae888a30dd36d22cb5fd025b3e7427a818ba42f281", "question": {"question_id": "sample_182_a1559_q0", "video_id": 182, "video_path": "./videos/sample_182_real.mp4", "annotation_index": 1559, "question_index": 0, "question": "Where is the white road marker located right now?", "options": ["A. On the left side of the road.", "B. In the middle of the road.", "C. Directly ahead on the road.", "D. On the both sides of the road."], "answer": "D", "time_stamp_s": 334, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [333, 353], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_182_a1559_q0", "video_id": 182, "time_stamp_s": 334, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f1434ae27cebbd278119925417bd3fdfc1102be8540ae4dcb2dadccbfd0a1034", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [304.00333333333333, 305.0043333333333, 306.00533333333334, 307.0063333333333, 308.00733333333335, 309.0083333333333, 310.00933333333336, 311.01033333333334, 312.0113333333333, 313.01233333333334, 314.0133333333333, 315.01433333333335, 316.01533333333333, 317.0163333333333, 318.01733333333334, 319.0183333333333, 320.01933333333335, 321.0203333333333, 322.02133333333336, 323.02233333333334, 324.0233333333333, 325.02433333333335, 326.0253333333333, 327.02633333333335, 328.02733333333333, 329.0283333333333, 330.02933333333334, 331.0303333333333, 332.03133333333335, 333.0323333333333], "recent_frames_sha256": "cf02c618e2d46c8d7329505d1a1a907ddbccf1db450945ab38cf1a7cdf0772da", "num_recent_frames": 30, "tq": 715805.101552717, "t1": 715816.807319697, "ta": 715816.807319697, "te": 715816.844820886, "first_response_s": 11.705766979954205, "answer_total_s": 11.74326816899702, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_182_a1559_q0", "video_id": 182, "time_stamp_s": 334, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6a93c4f2440f5993473bc2cf8a44d37ae258d3b8b6a4fad3bd51cb00fe7e0ec2", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Road speed fluctuates between 75-80 km/h with a 1% incline, while a map overlay shows route progress near Nörd.\n- A white car overtakes from the left at 0:23, followed by a black car at 0:25.\n- The speedometer and map display remain static, indicating steady cycling conditions with no significant changes in terrain or traffic.\n[30-60s] - Road speed increases from 30 to 49 km/h while maintaining a 2% incline, with distance progressing from 77.2 to 77.5 km.\n- A single tree stands prominently on the right side of the road, with fields and distant hills visible in the background.\n- The on-screen map shows a route marked in blue, with a temperature of 36°C displayed in the top right corner.\n[60-90s] - Road curves right, then left, with trees lining both sides and a grassy verge on the right.  \n- Speed fluctuates between 51–53 km/h, with a slight incline (3% grade) indicated.  \n- GPS map shows route progress toward a destination marked in northern Germany.\n[90-120s] - Road surface curves gently to the right, with a white dashed line marking the center.\n- A dark-colored car passes on the left, moving in the opposite direction.\n- On-screen display shows speed fluctuating between 48 and 69 km/h, with a 4% incline and 78.0–78.8 km distance traveled.\n[120-150s] - Road curves left, then right, flanked by trees and dry grass, with a yellow road sign visible.  \n- Speedometer shows decreasing speed from 68 to 55 km/h, and elevation gain drops from 4% to 2%.  \n- Map overlay indicates location near Hohne, with temperature at 34°C and distance at 78.5–79.0 km.\n[150-180s] - A red car passes on the right side of the road, moving away from the camera.  \n- The road curves to the right, with a stop sign visible on the right side of the road.  \n- The speedometer shows a decreasing speed, indicating the cyclist is slowing down.\n[180-210s] - Road speed fluctuates between 24-76 km/h with a 1% incline, total distance 79.3 km.  \n- Right side of road shows grassy verge with fence and trees, left side lined with dense foliage.  \n- Map overlay indicates location near \"Höhe\" with temperature 34°C and a blue dot marking current position.\n[210-240s] - A silver car overtakes the viewer's vehicle on the left, then pulls ahead and disappears around a bend.  \n- The road curves gently to the right, flanked by dense green trees and dry grass on the right side.  \n- On-screen data shows speed fluctuating between 23–28 km/h, with distance decreasing slightly from 79.5 km to 79.6 km.\n[240-270s] - Road speed fluctuates between 73 and 76 km/h, with a slight incline (1% to 0%) and distance progressing from 70.7 to 70.9 km.\n- The route map on the right shows a blue line indicating the path, with a small marker near the current position.\n- The environment transitions from dense trees to a golden field on the right, with clear blue skies overhead.\n[270-300s] - Road speed increases from 73 to 78 km/h while maintaining a 1% incline.\n- Distance traveled rises from 79.9 km to 80.1 km.\n- Right-side roadside grassland transitions to a more open field with scattered trees.\n[300-330s] - Road speed fluctuates between 74-76 km/h with a 1% incline, covering 80.1 km total distance.  \n- Right side of road bordered by tall grass and dense trees, with a white road marker visible.  \n- GPS map overlay shows route progress toward a destination marked in northern Germany.", "history_tokens": 942, "history_utf8_bytes": 3387, "recent_frame_times_s": [304.00333333333333, 305.0043333333333, 306.00533333333334, 307.0063333333333, 308.00733333333335, 309.0083333333333, 310.00933333333336, 311.01033333333334, 312.0113333333333, 313.01233333333334, 314.0133333333333, 315.01433333333335, 316.01533333333333, 317.0163333333333, 318.01733333333334, 319.0183333333333, 320.01933333333335, 321.0203333333333, 322.02133333333336, 323.02233333333334, 324.0233333333333, 325.02433333333335, 326.0253333333333, 327.02633333333335, 328.02733333333333, 329.0283333333333, 330.02933333333334, 331.0303333333333, 332.03133333333335, 333.0323333333333], "recent_frames_sha256": "cf02c618e2d46c8d7329505d1a1a907ddbccf1db450945ab38cf1a7cdf0772da", "num_recent_frames": 30, "tq": 715939.459245802, "t1": 715941.364100068, "ta": 715941.364100068, "te": 715941.623529864, "first_response_s": 1.904854265972972, "answer_total_s": 2.164284061989747, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 182, "content_group": "c61f87bcac6860f2407f44ae888a30dd36d22cb5fd025b3e7427a818ba42f281", "question": {"question_id": "sample_182_a1560_q0", "video_id": 182, "video_path": "./videos/sample_182_real.mp4", "annotation_index": 1560, "question_index": 0, "question": "What is on the right side of the cyclist right now?", "options": ["A. A pedestrian path.", "B. A signpost.", "C. A ditch.", "D. A metal guardrail."], "answer": "D", "time_stamp_s": 465, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [444, 464], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_182_a1560_q0", "video_id": 182, "time_stamp_s": 465, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f4f35aee61402aca0c9b258da6888441a1ac3624f35f5b98cf88de5811383433", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [435.00086666666664, 436.0018666666667, 437.00286666666665, 438.0038666666667, 439.00486666666666, 440.0058666666667, 441.00686666666667, 442.00786666666664, 443.0088666666667, 444.00986666666665, 445.0108666666667, 446.01186666666666, 447.01286666666664, 448.0138666666667, 449.01486666666665, 450.0158666666667, 451.01686666666666, 452.0178666666667, 453.01886666666667, 454.01986666666664, 455.0208666666667, 456.02186666666665, 457.0228666666667, 458.02386666666666, 459.02486666666664, 460.0258666666667, 461.02686666666665, 462.0278666666667, 463.02886666666666, 464.0298666666667], "recent_frames_sha256": "d788700033f57d156bd161b80bd7990a3284ba08790370e1961a9bf91a422557", "num_recent_frames": 30, "tq": 715816.854167967, "t1": 715829.153205709, "ta": 715829.153205709, "te": 715829.19140249, "first_response_s": 12.29903774196282, "answer_total_s": 12.33723452303093, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_182_a1560_q0", "video_id": 182, "time_stamp_s": 465, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "793085c67cccd585d36697e6b54852d02d581ed2b118c3bf335f4f91cc5bbe6a", "condition_order": ["recent", "notes"], "memory": "[120-150s] - Road curves left, then right, flanked by trees and dry grass, with a yellow road sign visible.  \n- Speedometer shows decreasing speed from 68 to 55 km/h, and elevation gain drops from 4% to 2%.  \n- Map overlay indicates location near Hohne, with temperature at 34°C and distance at 78.5–79.0 km.\n[150-180s] - A red car passes on the right side of the road, moving away from the camera.  \n- The road curves to the right, with a stop sign visible on the right side of the road.  \n- The speedometer shows a decreasing speed, indicating the cyclist is slowing down.\n[180-210s] - Road speed fluctuates between 24-76 km/h with a 1% incline, total distance 79.3 km.  \n- Right side of road shows grassy verge with fence and trees, left side lined with dense foliage.  \n- Map overlay indicates location near \"Höhe\" with temperature 34°C and a blue dot marking current position.\n[210-240s] - A silver car overtakes the viewer's vehicle on the left, then pulls ahead and disappears around a bend.  \n- The road curves gently to the right, flanked by dense green trees and dry grass on the right side.  \n- On-screen data shows speed fluctuating between 23–28 km/h, with distance decreasing slightly from 79.5 km to 79.6 km.\n[240-270s] - Road speed fluctuates between 73 and 76 km/h, with a slight incline (1% to 0%) and distance progressing from 70.7 to 70.9 km.\n- The route map on the right shows a blue line indicating the path, with a small marker near the current position.\n- The environment transitions from dense trees to a golden field on the right, with clear blue skies overhead.\n[270-300s] - Road speed increases from 73 to 78 km/h while maintaining a 1% incline.\n- Distance traveled rises from 79.9 km to 80.1 km.\n- Right-side roadside grassland transitions to a more open field with scattered trees.\n[300-330s] - Road speed fluctuates between 74-76 km/h with a 1% incline, covering 80.1 km total distance.  \n- Right side of road bordered by tall grass and dense trees, with a white road marker visible.  \n- GPS map overlay shows route progress toward a destination marked in northern Germany.\n[330-360s] - Road surface shows slight incline with consistent 1% gradient, marked by digital overlay.\n- Right side of road bordered by tall grass and dense trees, with a white roadside marker visible.\n- Digital display shows speed fluctuating between 75 and 76 km/h, with distance increasing from 80.3 to 80.6 km.\n[360-390s] - Road speed fluctuates between 24–26 km/h with a 1% incline, covering 80.5–80.7 km.  \n- Right side of road shows dry grass and trees, with a yellow road sign visible at 385 seconds.  \n- GPS map on right displays route progress with a temperature of 34°C and a heart rate of 76 bpm.\n[390-420s] - Road sign indicating \"B 22\" and \"B 22\" with a yellow background and black text, positioned on the right side of the road.  \n- A silver car approaches from the opposite direction, passing the camera's viewpoint.  \n- The speedometer shows a steady speed of 75 km/h, with the distance to the destination displayed as 80.8 km.\n[420-450s] - Road curves left, then right, with a car overtaking from the opposite direction at 4:36.\n- A blue circular sign with a downward arrow appears at 4:22, indicating a descent.\n- The map overlay on the right shows a route marked with a red dot, indicating the current position.", "history_tokens": 944, "history_utf8_bytes": 3348, "recent_frame_times_s": [435.00086666666664, 436.0018666666667, 437.00286666666665, 438.0038666666667, 439.00486666666666, 440.0058666666667, 441.00686666666667, 442.00786666666664, 443.0088666666667, 444.00986666666665, 445.0108666666667, 446.01186666666666, 447.01286666666664, 448.0138666666667, 449.01486666666665, 450.0158666666667, 451.01686666666666, 452.0178666666667, 453.01886666666667, 454.01986666666664, 455.0208666666667, 456.02186666666665, 457.0228666666667, 458.02386666666666, 459.02486666666664, 460.0258666666667, 461.02686666666665, 462.0278666666667, 463.02886666666666, 464.0298666666667], "recent_frames_sha256": "d788700033f57d156bd161b80bd7990a3284ba08790370e1961a9bf91a422557", "num_recent_frames": 30, "tq": 715964.92075851, "t1": 715966.124508745, "ta": 715966.124508745, "te": 715966.312316307, "first_response_s": 1.203750235028565, "answer_total_s": 1.3915577969746664, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 183, "content_group": "c73d92df88777bc36fbb593fbc9975bc4aabf64da5c70c67036f23db76a4b0f4", "question": {"question_id": "sample_183_a1696_q0", "video_id": 183, "video_path": "./videos/sample_183_real.mp4", "annotation_index": 1696, "question_index": 0, "question": "Where is the white sign with the number 50 right now?", "options": ["A. At the front of the road.", "B. At the back of the road.", "C. On the left side of the road.", "D. On the right side of the road."], "answer": "D", "time_stamp_s": 10, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_183_a1696_q0", "video_id": 183, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e7372897b555cd0fc284d70ceae884f1d514c52a912fb0401f1a2c067b8ba7c1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "ffe4d766f6d746c8f14bc9fb2a2af3cdc355a023893f30c07eb701697bef9289", "num_recent_frames": 10, "tq": 716832.407309818, "t1": 716837.59856814, "ta": 716837.59856814, "te": 716837.63931634, "first_response_s": 5.191258321981877, "answer_total_s": 5.232006522011943, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_183_a1696_q0", "video_id": 183, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e0ee1049ea2e807f07a0132c049d5c97d20344437e8dd9656cd49bdc418ddeb1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "ffe4d766f6d746c8f14bc9fb2a2af3cdc355a023893f30c07eb701697bef9289", "num_recent_frames": 10, "tq": 716671.556947767, "t1": 716677.018303511, "ta": 716677.018303511, "te": 716677.205494128, "first_response_s": 5.461355743929744, "answer_total_s": 5.648546361015178, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 183, "content_group": "c73d92df88777bc36fbb593fbc9975bc4aabf64da5c70c67036f23db76a4b0f4", "question": {"question_id": "sample_183_a1697_q0", "video_id": 183, "video_path": "./videos/sample_183_real.mp4", "annotation_index": 1697, "question_index": 0, "question": "What is located on the left side of the road while the cyclists are passing right now?", "options": ["A. A coffee shop.", "B. A National Championships banner.", "C. A grocery store.", "D. A bank."], "answer": "D", "time_stamp_s": 128, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [123, 143], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_183_a1697_q0", "video_id": 183, "time_stamp_s": 128, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "aa83cf4ac8005f85cdf494ed6c10e800d8ea3594564b2a34c2f8132884314af3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666], "recent_frames_sha256": "87dfff178310d5bf573d2285e684337e112fbc51b558d4e8bc2f3d1e2ca10222", "num_recent_frames": 30, "tq": 716837.654626839, "t1": 716849.770599123, "ta": 716849.770599123, "te": 716849.808522727, "first_response_s": 12.115972283994779, "answer_total_s": 12.153895888011903, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_183_a1697_q0", "video_id": 183, "time_stamp_s": 128, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ba9e8b10a523db22d1066c815597cf2ae5e91ddfc997569892ef6e509c025f82", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclists in colorful jerseys and numbered bibs (e.g., #1010, #1011) start a race, with some stationary at the beginning line.  \n- The race proceeds down a city street lined with spectators and barriers, passing buildings and signs like \"National Champions\" and \"Fiji.\"  \n- A cyclist in a purple jersey with \"MISBRA\" branding is visible among the pack, with a digital overlay showing speed (91 RPM) and distance (0.0 km).\n[30-60s] - Cyclists in blue and orange jerseys pedal vigorously through urban streets, with a red bus visible ahead.  \n- A cyclist in a green jersey briefly overtakes others, followed by a rider in a black jersey.  \n- On-screen metrics show heart rate increasing from 104 bpm to 138 bpm, with distance covered rising from 5100m to 50900m.\n[60-90s] - Cyclist in black jersey leads group, maintaining steady pace with others.  \n- Group navigates urban street with traffic lights and buildings visible.  \n- On-screen metrics show consistent speed (~162 rpm) and distance (~5040m).\n[90-120s] - Cyclist in black jersey (number 80) rides ahead, maintaining high cadence (168-170 rpm) as group navigates urban streets.  \n- Green barrier lines the right side of road, with spectators visible behind it; buildings and traffic lights form backdrop.  \n- On-screen metrics show distance decreasing (50014m to 50001m) and cadence fluctuating, indicating dynamic pacing during race.", "history_tokens": 373, "history_utf8_bytes": 1399, "recent_frame_times_s": [98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666], "recent_frames_sha256": "87dfff178310d5bf573d2285e684337e112fbc51b558d4e8bc2f3d1e2ca10222", "num_recent_frames": 30, "tq": 716708.909564176, "t1": 716716.238943092, "ta": 716716.238943092, "te": 716716.467240168, "first_response_s": 7.329378915950656, "answer_total_s": 7.5576759920222685, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 183, "content_group": "c73d92df88777bc36fbb593fbc9975bc4aabf64da5c70c67036f23db76a4b0f4", "question": {"question_id": "sample_183_a1698_q0", "video_id": 183, "video_path": "./videos/sample_183_real.mp4", "annotation_index": 1698, "question_index": 0, "question": "What is located on the right side of the road right now", "options": ["A. A coffee shop.", "B. A bank.", "C. A cafe.", "D. A brown building."], "answer": "D", "time_stamp_s": 265, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [246, 266], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_183_a1698_q0", "video_id": 183, "time_stamp_s": 265, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6b81dd4bb614c0c85b162bde6ab86c70884eea0a6c207566143acf68ce714331", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375], "recent_frames_sha256": "f7e6f465829c6090b9d737a937103d84d83509eab54f46013240f89e25292416", "num_recent_frames": 30, "tq": 716849.818298225, "t1": 716856.673103556, "ta": 716856.673103556, "te": 716856.711143109, "first_response_s": 6.854805331095122, "answer_total_s": 6.892844884074293, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_183_a1698_q0", "video_id": 183, "time_stamp_s": 265, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4972ebb31a0d47518b50629fe4755d8eee747dea23e0494d52c40dae599e0833", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclists in colorful jerseys and numbered bibs (e.g., #1010, #1011) start a race, with some stationary at the beginning line.  \n- The race proceeds down a city street lined with spectators and barriers, passing buildings and signs like \"National Champions\" and \"Fiji.\"  \n- A cyclist in a purple jersey with \"MISBRA\" branding is visible among the pack, with a digital overlay showing speed (91 RPM) and distance (0.0 km).\n[30-60s] - Cyclists in blue and orange jerseys pedal vigorously through urban streets, with a red bus visible ahead.  \n- A cyclist in a green jersey briefly overtakes others, followed by a rider in a black jersey.  \n- On-screen metrics show heart rate increasing from 104 bpm to 138 bpm, with distance covered rising from 5100m to 50900m.\n[60-90s] - Cyclist in black jersey leads group, maintaining steady pace with others.  \n- Group navigates urban street with traffic lights and buildings visible.  \n- On-screen metrics show consistent speed (~162 rpm) and distance (~5040m).\n[90-120s] - Cyclist in black jersey (number 80) rides ahead, maintaining high cadence (168-170 rpm) as group navigates urban streets.  \n- Green barrier lines the right side of road, with spectators visible behind it; buildings and traffic lights form backdrop.  \n- On-screen metrics show distance decreasing (50014m to 50001m) and cadence fluctuating, indicating dynamic pacing during race.\n[120-150s] - Cyclist in red jersey maintains high cadence (168-173 rpm) while navigating urban streets.  \n- Group of cyclists forms a tight pack, with some riders in blue and green jerseys visible ahead.  \n- Roadside barriers and spectators line the route, with buildings and traffic lights in the background.\n[150-180s] - Cyclist in green jersey and black shorts maintains a steady pace, positioned slightly ahead of the group.\n- The group navigates a city street with modern buildings and traffic lights, passing a large glass structure.\n- On-screen metrics show a consistent power output of around 170-175 watts and a cadence of 165-170 rpm, with distance decreasing from 49.5 km to 49.1 km.\n[180-210s] - Cyclist in orange jersey (number 809) leads a group, maintaining high cadence (168-169 rpm) as they navigate urban streets.  \n- A green ribbon barrier lines the right side of the road, separating riders from spectators and buildings.  \n- The race route map on screen shows a 48.8km distance with a 28% gradient, indicating a challenging urban course.\n[210-240s] - Cyclist in black shorts and orange socks maintains high cadence (163-178 rpm) while riding in a group.\n- Roadside barriers and spectators line the street, with buildings and traffic lights visible in the background.\n- Distance marker shows progression from 4850m to 4830m, indicating a steady pace through urban terrain.", "history_tokens": 740, "history_utf8_bytes": 2792, "recent_frame_times_s": [235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375], "recent_frames_sha256": "f7e6f465829c6090b9d737a937103d84d83509eab54f46013240f89e25292416", "num_recent_frames": 30, "tq": 716751.464082578, "t1": 716753.536102002, "ta": 716753.536102002, "te": 716753.576706814, "first_response_s": 2.0720194240566343, "answer_total_s": 2.112624236033298, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 183, "content_group": "c73d92df88777bc36fbb593fbc9975bc4aabf64da5c70c67036f23db76a4b0f4", "question": {"question_id": "sample_183_a1699_q0", "video_id": 183, "video_path": "./videos/sample_183_real.mp4", "annotation_index": 1699, "question_index": 0, "question": "Where is the boxley building located right now?", "options": ["A. On the left side.", "B. Directly ahead.", "C. Behind the cyclist.", "D. On the right side."], "answer": "D", "time_stamp_s": 370, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [369, 389], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_183_a1699_q0", "video_id": 183, "time_stamp_s": 370, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7325b6bf1d55607a85cd4c52300ac51a5a4418e635ed40696afb13cf3d327981", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665], "recent_frames_sha256": "a5407f4dbad9cca08fe78b7adbf4574689bee4edb41bcd88621ebfb35449a22b", "num_recent_frames": 30, "tq": 716856.721718884, "t1": 716869.198862648, "ta": 716869.198862648, "te": 716869.238896237, "first_response_s": 12.477143764030188, "answer_total_s": 12.517177353031002, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_183_a1699_q0", "video_id": 183, "time_stamp_s": 370, "ground_truth": "D", "raw_output": "A. On the left side.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "550caaa120459b3c2cf89efd38c223b4edc673b0ea7da5f93b1c6434b15ccdfb", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Cyclists in blue and orange jerseys pedal vigorously through urban streets, with a red bus visible ahead.  \n- A cyclist in a green jersey briefly overtakes others, followed by a rider in a black jersey.  \n- On-screen metrics show heart rate increasing from 104 bpm to 138 bpm, with distance covered rising from 5100m to 50900m.\n[60-90s] - Cyclist in black jersey leads group, maintaining steady pace with others.  \n- Group navigates urban street with traffic lights and buildings visible.  \n- On-screen metrics show consistent speed (~162 rpm) and distance (~5040m).\n[90-120s] - Cyclist in black jersey (number 80) rides ahead, maintaining high cadence (168-170 rpm) as group navigates urban streets.  \n- Green barrier lines the right side of road, with spectators visible behind it; buildings and traffic lights form backdrop.  \n- On-screen metrics show distance decreasing (50014m to 50001m) and cadence fluctuating, indicating dynamic pacing during race.\n[120-150s] - Cyclist in red jersey maintains high cadence (168-173 rpm) while navigating urban streets.  \n- Group of cyclists forms a tight pack, with some riders in blue and green jerseys visible ahead.  \n- Roadside barriers and spectators line the route, with buildings and traffic lights in the background.\n[150-180s] - Cyclist in green jersey and black shorts maintains a steady pace, positioned slightly ahead of the group.\n- The group navigates a city street with modern buildings and traffic lights, passing a large glass structure.\n- On-screen metrics show a consistent power output of around 170-175 watts and a cadence of 165-170 rpm, with distance decreasing from 49.5 km to 49.1 km.\n[180-210s] - Cyclist in orange jersey (number 809) leads a group, maintaining high cadence (168-169 rpm) as they navigate urban streets.  \n- A green ribbon barrier lines the right side of the road, separating riders from spectators and buildings.  \n- The race route map on screen shows a 48.8km distance with a 28% gradient, indicating a challenging urban course.\n[210-240s] - Cyclist in black shorts and orange socks maintains high cadence (163-178 rpm) while riding in a group.\n- Roadside barriers and spectators line the street, with buildings and traffic lights visible in the background.\n- Distance marker shows progression from 4850m to 4830m, indicating a steady pace through urban terrain.\n[240-270s] - Cyclist in black and orange jersey maintains high cadence (173-180 rpm) while riding closely behind others.  \n- Group of cyclists navigates urban streets, passing modern buildings and traffic signals.  \n- On-screen metrics show distance (4800m+) and heart rate fluctuations, indicating sustained effort.\n[270-300s] - Cyclist in green jersey and yellow shorts rides ahead, maintaining pace with group.\n- Rider in black shorts and pink gloves follows closely, slightly behind the lead cyclist.\n- Urban street scene with buildings, trees, and spectators along the route.\n[300-330s] - Cyclist in black jersey and yellow shorts rides a bicycle, maintaining a steady pace through an urban street lined with spectators and barriers.\n- A group of cyclists, including one in green and yellow, follows closely behind, navigating the course with similar intensity.\n- The on-screen display shows performance metrics like speed, cadence, and distance, indicating a competitive cycling event.\n[330-360s] - Cyclist in green jersey and black shorts rides ahead, maintaining a steady pace with a heart rate of 180 bpm.\n- Group of cyclists follows closely, with one rider in black and orange gear slightly behind, adjusting position as they navigate the street.\n- Road signs and urban buildings pass by, indicating a city environment with traffic lights and sidewalks visible.", "history_tokens": 929, "history_utf8_bytes": 3733, "recent_frame_times_s": [340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665], "recent_frames_sha256": "a5407f4dbad9cca08fe78b7adbf4574689bee4edb41bcd88621ebfb35449a22b", "num_recent_frames": 30, "tq": 716792.19911087, "t1": 716799.392176986, "ta": 716799.392176986, "te": 716799.667041773, "first_response_s": 7.1930661159567535, "answer_total_s": 7.467930902959779, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 183, "content_group": "c73d92df88777bc36fbb593fbc9975bc4aabf64da5c70c67036f23db76a4b0f4", "question": {"question_id": "sample_183_a1700_q0", "video_id": 183, "video_path": "./videos/sample_183_real.mp4", "annotation_index": 1700, "question_index": 0, "question": "What is the positioning of the cyclist with number '901' right now?", "options": ["A. At the front of the group.", "B. In the middle of the group.", "C. On the left side of the group.", "D. At the back of the group."], "answer": "D", "time_stamp_s": 500, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [492, 512], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_183_a1700_q0", "video_id": 183, "time_stamp_s": 500, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "492e6cd1a4d9f714f68cacaaf0ddde1b590ac2db2b284aed3706892c38dda12b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336, 498.01418333333334, 499.0151833333333], "recent_frames_sha256": "7e308fa3bd10b8052bb4861f3953d4ca0d2a0849b318089099b7d6e4d7266938", "num_recent_frames": 30, "tq": 716869.247383493, "t1": 716882.66372491, "ta": 716882.66372491, "te": 716882.886682224, "first_response_s": 13.416341417003423, "answer_total_s": 13.639298730995506, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_183_a1700_q0", "video_id": 183, "time_stamp_s": 500, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5c7e24da54f21560280c93541d68c9e6ef535a65f44c74cfb24aaffab991918f", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Cyclist in green jersey and black shorts maintains a steady pace, positioned slightly ahead of the group.\n- The group navigates a city street with modern buildings and traffic lights, passing a large glass structure.\n- On-screen metrics show a consistent power output of around 170-175 watts and a cadence of 165-170 rpm, with distance decreasing from 49.5 km to 49.1 km.\n[180-210s] - Cyclist in orange jersey (number 809) leads a group, maintaining high cadence (168-169 rpm) as they navigate urban streets.  \n- A green ribbon barrier lines the right side of the road, separating riders from spectators and buildings.  \n- The race route map on screen shows a 48.8km distance with a 28% gradient, indicating a challenging urban course.\n[210-240s] - Cyclist in black shorts and orange socks maintains high cadence (163-178 rpm) while riding in a group.\n- Roadside barriers and spectators line the street, with buildings and traffic lights visible in the background.\n- Distance marker shows progression from 4850m to 4830m, indicating a steady pace through urban terrain.\n[240-270s] - Cyclist in black and orange jersey maintains high cadence (173-180 rpm) while riding closely behind others.  \n- Group of cyclists navigates urban streets, passing modern buildings and traffic signals.  \n- On-screen metrics show distance (4800m+) and heart rate fluctuations, indicating sustained effort.\n[270-300s] - Cyclist in green jersey and yellow shorts rides ahead, maintaining pace with group.\n- Rider in black shorts and pink gloves follows closely, slightly behind the lead cyclist.\n- Urban street scene with buildings, trees, and spectators along the route.\n[300-330s] - Cyclist in black jersey and yellow shorts rides a bicycle, maintaining a steady pace through an urban street lined with spectators and barriers.\n- A group of cyclists, including one in green and yellow, follows closely behind, navigating the course with similar intensity.\n- The on-screen display shows performance metrics like speed, cadence, and distance, indicating a competitive cycling event.\n[330-360s] - Cyclist in green jersey and black shorts rides ahead, maintaining a steady pace with a heart rate of 180 bpm.\n- Group of cyclists follows closely, with one rider in black and orange gear slightly behind, adjusting position as they navigate the street.\n- Road signs and urban buildings pass by, indicating a city environment with traffic lights and sidewalks visible.\n[360-390s] - Cyclist in black and white jersey maintains high cadence (178–182 rpm) while riding in a tight group.\n- Group navigates urban streets with buildings and spectators on sidewalks, passing a \"BANK OF AMERICA\" sign.\n- On-screen metrics show distance (4650m–4660m) and speed (24–30 mph) fluctuating as riders pedal through the course.\n[390-420s] - Cyclist in white jersey and black shorts maintains high cadence (178–180 rpm) while riding in a tight group.\n- Group navigates urban streets with buildings and traffic lights, passing under a \"NATIONAL CHAMPIONSHIP\" archway.\n- On-screen metrics show distance decreasing (4600m to 4500m) and pace fluctuating (94–97 bpm), indicating a steady but variable effort.\n[420-450s] - Cyclist in orange jersey and black shorts rides ahead, maintaining a steady pace with others in the pack.\n- A cyclist in a blue jersey and black shorts is positioned slightly behind, closely following the group.\n- The road is lined with buildings and trees, with a clear view of the race route and distance markers on the screen.\n[450-480s] - Cyclist in blue jersey and black shorts rides ahead, maintaining high cadence (182-188 rpm) while navigating urban streets.\n- Group of cyclists follows closely, with one rider in orange jersey visible ahead, indicating a competitive pack.\n- On-screen metrics show distance covered (4500m to 4480m) and speed (31-34 km/h), with a map indicating route progress.", "history_tokens": 980, "history_utf8_bytes": 3898, "recent_frame_times_s": [470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336, 498.01418333333334, 499.0151833333333], "recent_frames_sha256": "7e308fa3bd10b8052bb4861f3953d4ca0d2a0849b318089099b7d6e4d7266938", "num_recent_frames": 30, "tq": 716831.049601056, "t1": 716832.327809254, "ta": 716832.327809254, "te": 716832.365870081, "first_response_s": 1.2782081980258226, "answer_total_s": 1.3162690249737352, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 184, "content_group": "173fe7a96a8155ddd8e4eeeba63bfbac48b2460f17ba1d115b6a3180fc18b003", "question": {"question_id": "sample_184_a325_q0", "video_id": 184, "video_path": "./videos/sample_184_real.mp4", "annotation_index": 325, "question_index": 0, "question": "What color is the traffic light now?", "options": ["A. Yellow.", "B. Red.", "C. Green.", "D. Black."], "answer": "C", "time_stamp_s": 2, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_184_a325_q0", "video_id": 184, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5fc347fbf9526880badb18312fc3d108607868126ce25e11f82e8cbae237be26", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.038, 1.0056333333333334], "recent_frames_sha256": "0b4a4cac392ce772386a4a5126f1db682402644b9167c6293a8f3d383825ad6c", "num_recent_frames": 2, "tq": 715382.055751703, "t1": 715382.87623093, "ta": 715382.87623093, "te": 715382.916206524, "first_response_s": 0.8204792269971222, "answer_total_s": 0.8604548210278153, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_184_a325_q0", "video_id": 184, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8018133a2ea36536e9ee635cbaa1e41eb0aa2667584f33528691fcbd635466e5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.038, 1.0056333333333334], "recent_frames_sha256": "0b4a4cac392ce772386a4a5126f1db682402644b9167c6293a8f3d383825ad6c", "num_recent_frames": 2, "tq": 715236.490155058, "t1": 715247.199529736, "ta": 715247.199529736, "te": 715247.392849093, "first_response_s": 10.709374677971937, "answer_total_s": 10.902694034972228, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 184, "content_group": "173fe7a96a8155ddd8e4eeeba63bfbac48b2460f17ba1d115b6a3180fc18b003", "question": {"question_id": "sample_184_a326_q0", "video_id": 184, "video_path": "./videos/sample_184_real.mp4", "annotation_index": 326, "question_index": 0, "question": "Where is the fenced area located right now?", "options": ["A. Only on the left side of the road.", "B. Directly behind the cyclist.", "C. Directly ahead of the cyclist.", "D. On both sides of the road."], "answer": "D", "time_stamp_s": 123, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [118, 138], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_184_a326_q0", "video_id": 184, "time_stamp_s": 123, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2e91a35b7f09878cc13c264f5caa5e4ab5bf86a129895691f93770c3b5f7a588", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [93.01421666666667, 94.01521666666666, 95.01621666666666, 96.00053333333334, 97.00153333333333, 98.00253333333333, 99.00353333333334, 100.00453333333333, 101.00553333333333, 102.00653333333334, 103.00753333333333, 104.00853333333333, 105.00953333333334, 106.01053333333333, 107.01153333333333, 108.01253333333334, 109.01353333333333, 110.01453333333333, 111.01553333333334, 112.01653333333333, 113.00085, 114.00185, 115.00285, 116.00385, 117.00485, 118.00585, 119.00685, 120.00785, 121.00885, 122.00985], "recent_frames_sha256": "48110b5ea9a619d4a7937f41cc1b48c236d9db43a60a6d94cfe3fa0778772b6a", "num_recent_frames": 30, "tq": 715382.933802546, "t1": 715393.112077452, "ta": 715393.112077452, "te": 715393.150181042, "first_response_s": 10.178274906007573, "answer_total_s": 10.216378496028483, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_184_a326_q0", "video_id": 184, "time_stamp_s": 123, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "956cf506b465d2d5382ca0798b34ec32e77227fa883e777c4ec5e59d10525d94", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclist in orange jersey leads group, maintaining high cadence (173-183 rpm) as they navigate urban street course.  \n- Rider in black jersey follows closely, with power output fluctuating between 44-58 watts, indicating effort changes.  \n- Spectators line sidewalks behind barriers, watching as cyclists pass through city blocks with visible buildings and signage.\n[30-60s] - Cyclist in black jersey and shorts leads group, maintaining high cadence (183-188 rpm) as they navigate urban street with barriers.  \n- Group rides past buildings and traffic signs, with distance and elevation data displayed on screen.  \n- Road surface shows cracks; riders maintain tight formation, with slight shifts in position as they pass intersections.\n[60-90s] - Cyclist in blue jersey maintains steady pace, slightly ahead of group, with power output fluctuating between 450-500W.  \n- Group of cyclists closely packed, with one rider in white jersey visibly lagging behind, adjusting position mid-ride.  \n- Road surface shows cracks and wear, with buildings and green barriers lining the route, indicating urban cycling environment.\n[90-120s] - Cyclist in blue jersey (number 28) leads a group, maintaining a steady pace with visible cadence and power metrics.\n- A cyclist in orange jersey overtakes from the left, briefly closing the gap before falling back.\n- Spectators line the street behind barriers, watching the race as the group navigates urban streets with buildings and signage.", "history_tokens": 336, "history_utf8_bytes": 1482, "recent_frame_times_s": [93.01421666666667, 94.01521666666666, 95.01621666666666, 96.00053333333334, 97.00153333333333, 98.00253333333333, 99.00353333333334, 100.00453333333333, 101.00553333333333, 102.00653333333334, 103.00753333333333, 104.00853333333333, 105.00953333333334, 106.01053333333333, 107.01153333333333, 108.01253333333334, 109.01353333333333, 110.01453333333333, 111.01553333333334, 112.01653333333333, 113.00085, 114.00185, 115.00285, 116.00385, 117.00485, 118.00585, 119.00685, 120.00785, 121.00885, 122.00985], "recent_frames_sha256": "48110b5ea9a619d4a7937f41cc1b48c236d9db43a60a6d94cfe3fa0778772b6a", "num_recent_frames": 30, "tq": 715279.689417156, "t1": 715287.047444019, "ta": 715287.047444019, "te": 715287.205506412, "first_response_s": 7.3580268629593775, "answer_total_s": 7.516089255921543, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 184, "content_group": "173fe7a96a8155ddd8e4eeeba63bfbac48b2460f17ba1d115b6a3180fc18b003", "question": {"question_id": "sample_184_a327_q0", "video_id": 184, "video_path": "./videos/sample_184_real.mp4", "annotation_index": 327, "question_index": 0, "question": "Where is the stop sign located right now?", "options": ["A. On the left side of the road.", "B. In the middle of the crossroad.", "C. Above the traffic lights.", "D. On the right side of the road."], "answer": "D", "time_stamp_s": 234, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [236, 256], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_184_a327_q0", "video_id": 184, "time_stamp_s": 234, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a693ada4641a353e638b5391dbd47525321947041c98eb1786ecb89af8756bf2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [204.00843333333333, 205.00943333333333, 206.01043333333334, 207.01143333333334, 208.01243333333332, 209.01343333333332, 210.01443333333333, 211.01543333333333, 212.01643333333334, 213.00075, 214.00175, 215.00275, 216.00375, 217.00475, 218.00575, 219.00675, 220.00775, 221.00875, 222.00975, 223.01075, 224.01175, 225.01275, 226.01375, 227.01475, 228.01575, 229.00006666666667, 230.00106666666667, 231.00206666666668, 232.00306666666665, 233.00406666666666], "recent_frames_sha256": "f2fdc6f23fc79a989a3a691b6e147317c00b1619de99c5cc804a3dbcff7bd060", "num_recent_frames": 30, "tq": 715393.168720989, "t1": 715403.043713549, "ta": 715403.043713549, "te": 715403.08136513, "first_response_s": 9.874992560013197, "answer_total_s": 9.91264414100442, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_184_a327_q0", "video_id": 184, "time_stamp_s": 234, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "967841a81a361b0adc2f7dc88ccbd2313bfd1c425d4a6d19af88d2dc8cd2a5c6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclist in orange jersey leads group, maintaining high cadence (173-183 rpm) as they navigate urban street course.  \n- Rider in black jersey follows closely, with power output fluctuating between 44-58 watts, indicating effort changes.  \n- Spectators line sidewalks behind barriers, watching as cyclists pass through city blocks with visible buildings and signage.\n[30-60s] - Cyclist in black jersey and shorts leads group, maintaining high cadence (183-188 rpm) as they navigate urban street with barriers.  \n- Group rides past buildings and traffic signs, with distance and elevation data displayed on screen.  \n- Road surface shows cracks; riders maintain tight formation, with slight shifts in position as they pass intersections.\n[60-90s] - Cyclist in blue jersey maintains steady pace, slightly ahead of group, with power output fluctuating between 450-500W.  \n- Group of cyclists closely packed, with one rider in white jersey visibly lagging behind, adjusting position mid-ride.  \n- Road surface shows cracks and wear, with buildings and green barriers lining the route, indicating urban cycling environment.\n[90-120s] - Cyclist in blue jersey (number 28) leads a group, maintaining a steady pace with visible cadence and power metrics.\n- A cyclist in orange jersey overtakes from the left, briefly closing the gap before falling back.\n- Spectators line the street behind barriers, watching the race as the group navigates urban streets with buildings and signage.\n[120-150s] - Cyclist in black jersey with \"PERFORMANCE OUTPOST\" text rides a bike with orange frame, maintaining high cadence (182-188 rpm) and speed (31-33 mph) on urban road.\n- Other cyclists in colorful jerseys follow closely behind, navigating turns and intersections with visible road markings and barriers.\n- On-screen metrics show distance decreasing from 32.2 to 31.9 km, with heart rate fluctuating between 182-188 bpm, indicating intense effort.\n[150-180s] - Cyclist in blue jersey and black shorts rides a bike with orange accents, maintaining a steady pace on a city street.\n- Pedestrians and other cyclists are visible on sidewalks and adjacent lanes, with some individuals standing near green barriers.\n- On-screen metrics show performance data including cadence (183-178 rpm), distance (31,800m), and speed (42-45 km/h), indicating a structured cycling event.\n[180-210s] - Cyclist in blue jersey rides steadily, maintaining high cadence (173-176 rpm) through urban streets.  \n- On-screen metrics show distance increasing from 31.3km to 31.1km, with speed fluctuating between 28-35 km/h.  \n- Spectators line sidewalks behind barriers, watching as the cyclist passes under a \"VILLARE\" banner.", "history_tokens": 659, "history_utf8_bytes": 2688, "recent_frame_times_s": [204.00843333333333, 205.00943333333333, 206.01043333333334, 207.01143333333334, 208.01243333333332, 209.01343333333332, 210.01443333333333, 211.01543333333333, 212.01643333333334, 213.00075, 214.00175, 215.00275, 216.00375, 217.00475, 218.00575, 219.00675, 220.00775, 221.00875, 222.00975, 223.01075, 224.01175, 225.01275, 226.01375, 227.01475, 228.01575, 229.00006666666667, 230.00106666666667, 231.00206666666668, 232.00306666666665, 233.00406666666666], "recent_frames_sha256": "f2fdc6f23fc79a989a3a691b6e147317c00b1619de99c5cc804a3dbcff7bd060", "num_recent_frames": 30, "tq": 715306.362798642, "t1": 715308.157793478, "ta": 715308.157793478, "te": 715308.364600173, "first_response_s": 1.7949948359746486, "answer_total_s": 2.0018015309469774, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 184, "content_group": "173fe7a96a8155ddd8e4eeeba63bfbac48b2460f17ba1d115b6a3180fc18b003", "question": {"question_id": "sample_184_a328_q0", "video_id": 184, "video_path": "./videos/sample_184_real.mp4", "annotation_index": 328, "question_index": 0, "question": "What is placed along the side of the road right now?", "options": ["A. Tree barriers.", "B. Cones.", "C. Metal fences.", "D. Hay bales."], "answer": "D", "time_stamp_s": 355, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [354, 374], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_184_a328_q0", "video_id": 184, "time_stamp_s": 355, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "83be4b5834189b57498236cd8f1b57d528f6defd471a5b79726e4a23ea700892", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [325.01265, 326.01365, 327.01465, 328.01565, 329.01665, 330.00096666666667, 331.00196666666665, 332.0029666666667, 333.00396666666666, 334.0049666666667, 335.00596666666667, 336.00696666666664, 337.0079666666667, 338.00896666666665, 339.0099666666667, 340.01096666666666, 341.0119666666667, 342.01296666666667, 343.01396666666665, 344.0149666666667, 345.01596666666666, 346.00028333333336, 347.00128333333333, 348.0022833333333, 349.00328333333334, 350.0042833333333, 351.00528333333335, 352.00628333333333, 353.0072833333333, 354.00828333333334], "recent_frames_sha256": "992ee0cc31012f594927694d885c43709b38dda97b2abede1cfc81f70449152d", "num_recent_frames": 30, "tq": 715403.093850062, "t1": 715411.001028481, "ta": 715411.001028481, "te": 715411.224139312, "first_response_s": 7.907178419060074, "answer_total_s": 8.130289250053465, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_184_a328_q0", "video_id": 184, "time_stamp_s": 355, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "077147052a75b85827c6ec99265064569814a89a58f7e2065b478fb892426623", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Cyclist in black jersey and shorts leads group, maintaining high cadence (183-188 rpm) as they navigate urban street with barriers.  \n- Group rides past buildings and traffic signs, with distance and elevation data displayed on screen.  \n- Road surface shows cracks; riders maintain tight formation, with slight shifts in position as they pass intersections.\n[60-90s] - Cyclist in blue jersey maintains steady pace, slightly ahead of group, with power output fluctuating between 450-500W.  \n- Group of cyclists closely packed, with one rider in white jersey visibly lagging behind, adjusting position mid-ride.  \n- Road surface shows cracks and wear, with buildings and green barriers lining the route, indicating urban cycling environment.\n[90-120s] - Cyclist in blue jersey (number 28) leads a group, maintaining a steady pace with visible cadence and power metrics.\n- A cyclist in orange jersey overtakes from the left, briefly closing the gap before falling back.\n- Spectators line the street behind barriers, watching the race as the group navigates urban streets with buildings and signage.\n[120-150s] - Cyclist in black jersey with \"PERFORMANCE OUTPOST\" text rides a bike with orange frame, maintaining high cadence (182-188 rpm) and speed (31-33 mph) on urban road.\n- Other cyclists in colorful jerseys follow closely behind, navigating turns and intersections with visible road markings and barriers.\n- On-screen metrics show distance decreasing from 32.2 to 31.9 km, with heart rate fluctuating between 182-188 bpm, indicating intense effort.\n[150-180s] - Cyclist in blue jersey and black shorts rides a bike with orange accents, maintaining a steady pace on a city street.\n- Pedestrians and other cyclists are visible on sidewalks and adjacent lanes, with some individuals standing near green barriers.\n- On-screen metrics show performance data including cadence (183-178 rpm), distance (31,800m), and speed (42-45 km/h), indicating a structured cycling event.\n[180-210s] - Cyclist in blue jersey rides steadily, maintaining high cadence (173-176 rpm) through urban streets.  \n- On-screen metrics show distance increasing from 31.3km to 31.1km, with speed fluctuating between 28-35 km/h.  \n- Spectators line sidewalks behind barriers, watching as the cyclist passes under a \"VILLARE\" banner.\n[210-240s] - Cyclist in teal jersey and orange shoes rides ahead, maintaining high cadence (168-175 rpm) as distance increases from 3085m to 3065m.\n- A cyclist in black and yellow jersey overtakes from behind, showing a steady pace with cadence around 175 rpm.\n- Roadside barriers and urban buildings line the route, with spectators visible near intersections and sidewalks.\n[240-270s] - Cyclist in blue jersey and helmet leads group, maintaining high cadence (173-178 rpm) while navigating urban street with traffic lights and buildings.\n- Group of cyclists follows closely, with some riders in white and black jerseys, all riding on paved road with yellow centerline.\n- On-screen metrics show distance (3000m+), speed (22-30 mph), and cadence fluctuating, indicating dynamic pace changes during the race.\n[270-300s] - Cyclist in black jersey and helmet rides ahead, maintaining steady pace with visible cadence of 168-173 rpm.  \n- A cyclist in blue jersey and helmet is slightly behind, adjusting position as they navigate the urban street.  \n- Spectators line the route behind barriers, observing the race as the cyclists pass through city streets.\n[300-330s] - Cyclist in black shorts and white jersey maintains a steady pace, slightly ahead of others, with a visible power meter reading fluctuating between 177-183 RPM.\n- Group of cyclists, including one in blue jersey and another in orange, ride closely together, navigating a city street with traffic cones and buildings.\n- On-screen metrics show distance increasing from 29,800m to 29,900m, with cadence and power output dynamically adjusting as they pedal through urban terrain.", "history_tokens": 981, "history_utf8_bytes": 3952, "recent_frame_times_s": [325.01265, 326.01365, 327.01465, 328.01565, 329.01665, 330.00096666666667, 331.00196666666665, 332.0029666666667, 333.00396666666666, 334.0049666666667, 335.00596666666667, 336.00696666666664, 337.0079666666667, 338.00896666666665, 339.0099666666667, 340.01096666666666, 341.0119666666667, 342.01296666666667, 343.01396666666665, 344.0149666666667, 345.01596666666666, 346.00028333333336, 347.00128333333333, 348.0022833333333, 349.00328333333334, 350.0042833333333, 351.00528333333335, 352.00628333333333, 353.0072833333333, 354.00828333333334], "recent_frames_sha256": "992ee0cc31012f594927694d885c43709b38dda97b2abede1cfc81f70449152d", "num_recent_frames": 30, "tq": 715339.750592441, "t1": 715341.608336119, "ta": 715341.608336119, "te": 715341.769639125, "first_response_s": 1.8577436780324206, "answer_total_s": 2.019046684028581, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 184, "content_group": "173fe7a96a8155ddd8e4eeeba63bfbac48b2460f17ba1d115b6a3180fc18b003", "question": {"question_id": "sample_184_a329_q0", "video_id": 184, "video_path": "./videos/sample_184_real.mp4", "annotation_index": 329, "question_index": 0, "question": "What is located in front of the cyclists right now?", "options": ["A. A finishing line.", "B. A straight road.", "C. A roundabout.", "D. A sharp left turn."], "answer": "D", "time_stamp_s": 487, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [472, 492], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_184_a329_q0", "video_id": 184, "time_stamp_s": 487, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "82699887cac923721c8fdea701268b02caaaf3100c59b943b65c0ead41e14bae", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [457.01118333333335, 458.0121833333333, 459.01318333333336, 460.01418333333334, 461.0151833333333, 462.01618333333334, 463.0005, 464.0015, 465.0025, 466.0035, 467.0045, 468.0055, 469.0065, 470.0075, 471.0085, 472.0095, 473.0105, 474.0115, 475.0125, 476.0135, 477.0145, 478.0155, 479.0165, 480.00081666666665, 481.0018166666667, 482.00281666666666, 483.0038166666667, 484.00481666666667, 485.00581666666665, 486.0068166666667], "recent_frames_sha256": "ec8c395a4f7fa1b2e16ee75104e0706253878515061f4860c61fbe06cc24646b", "num_recent_frames": 30, "tq": 715411.234090185, "t1": 715418.010670198, "ta": 715418.010670198, "te": 715418.048041616, "first_response_s": 6.776580012985505, "answer_total_s": 6.813951430958696, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_184_a329_q0", "video_id": 184, "time_stamp_s": 487, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fdf42105308405202a0cba89c6bd4a93b2c93ed9f4e327166c864fc48d9b79fd", "condition_order": ["notes", "recent"], "memory": "[180-210s] - Cyclist in blue jersey rides steadily, maintaining high cadence (173-176 rpm) through urban streets.  \n- On-screen metrics show distance increasing from 31.3km to 31.1km, with speed fluctuating between 28-35 km/h.  \n- Spectators line sidewalks behind barriers, watching as the cyclist passes under a \"VILLARE\" banner.\n[210-240s] - Cyclist in teal jersey and orange shoes rides ahead, maintaining high cadence (168-175 rpm) as distance increases from 3085m to 3065m.\n- A cyclist in black and yellow jersey overtakes from behind, showing a steady pace with cadence around 175 rpm.\n- Roadside barriers and urban buildings line the route, with spectators visible near intersections and sidewalks.\n[240-270s] - Cyclist in blue jersey and helmet leads group, maintaining high cadence (173-178 rpm) while navigating urban street with traffic lights and buildings.\n- Group of cyclists follows closely, with some riders in white and black jerseys, all riding on paved road with yellow centerline.\n- On-screen metrics show distance (3000m+), speed (22-30 mph), and cadence fluctuating, indicating dynamic pace changes during the race.\n[270-300s] - Cyclist in black jersey and helmet rides ahead, maintaining steady pace with visible cadence of 168-173 rpm.  \n- A cyclist in blue jersey and helmet is slightly behind, adjusting position as they navigate the urban street.  \n- Spectators line the route behind barriers, observing the race as the cyclists pass through city streets.\n[300-330s] - Cyclist in black shorts and white jersey maintains a steady pace, slightly ahead of others, with a visible power meter reading fluctuating between 177-183 RPM.\n- Group of cyclists, including one in blue jersey and another in orange, ride closely together, navigating a city street with traffic cones and buildings.\n- On-screen metrics show distance increasing from 29,800m to 29,900m, with cadence and power output dynamically adjusting as they pedal through urban terrain.\n[330-360s] - Cyclist in black jersey and shorts maintains a steady pace, slightly ahead of others, with a visible power meter reading 175rpm.\n- A cyclist in orange jersey and yellow shoes is positioned to the left, closely following the lead cyclist.\n- The race route passes through urban streets lined with buildings and spectators, with a green barrier marking the course boundary.\n[360-390s] - Cyclist in orange jersey leads group, maintaining high cadence (172-180 rpm) through urban streets.  \n- Group of cyclists follows closely, with one rider in teal bike slightly behind, navigating a turn.  \n- On-screen metrics show distance decreasing (2882m to 2842m) and speed fluctuating (34-27 km/h) as they pass buildings and spectators.\n[390-420s] - Cyclist in orange jersey leads a group, maintaining high cadence (178-183 rpm) as they navigate urban streets.  \n- A cyclist in green jersey rides closely behind, slightly to the right, with a visible power meter reading fluctuating.  \n- The race route shows a marked 28.4 km distance remaining, with a map indicating a turn ahead and a traffic light approaching.\n[420-450s] - Cyclist in blue jersey maintains position in the peloton, slightly ahead of others.  \n- Road marked with yellow lines, flanked by buildings and spectators behind barriers.  \n- On-screen data shows speed fluctuating between 28–30 mph and cadence around 175–178 rpm.\n[450-480s] - Cyclist in black shorts and white socks maintains steady pace, slightly ahead of group.\n- Group of cyclists ahead shows varied cadence, with one cyclist in blue jersey visibly accelerating.\n- Roadside barriers and spectators line the route, with buildings and urban infrastructure visible in background.", "history_tokens": 926, "history_utf8_bytes": 3683, "recent_frame_times_s": [457.01118333333335, 458.0121833333333, 459.01318333333336, 460.01418333333334, 461.0151833333333, 462.01618333333334, 463.0005, 464.0015, 465.0025, 466.0035, 467.0045, 468.0055, 469.0065, 470.0075, 471.0085, 472.0095, 473.0105, 474.0115, 475.0125, 476.0135, 477.0145, 478.0155, 479.0165, 480.00081666666665, 481.0018166666667, 482.00281666666666, 483.0038166666667, 484.00481666666667, 485.00581666666665, 486.0068166666667], "recent_frames_sha256": "ec8c395a4f7fa1b2e16ee75104e0706253878515061f4860c61fbe06cc24646b", "num_recent_frames": 30, "tq": 715375.872144987, "t1": 715381.833266126, "ta": 715381.833266126, "te": 715382.024409856, "first_response_s": 5.96112113900017, "answer_total_s": 6.1522648689569905, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 185, "content_group": "996a3f08ff5c352c4bb2109c93dfa7414f9af6e4737255cd5b8f51dc239b3fe5", "question": {"question_id": "sample_185_a983_q0", "video_id": 185, "video_path": "./videos/sample_185_real.mp4", "annotation_index": 983, "question_index": 0, "question": "What is located on the right side of the road right now?", "options": ["A. A river.", "B. A forest.", "C. A field.", "D. A building."], "answer": "A", "time_stamp_s": 15, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_185_a983_q0", "video_id": 185, "time_stamp_s": 15, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ed0cbd5ddce2c9e472fd3fb811dcb092ff356e1a291db8a33d46848141d085e2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.038, 1.0056333333333334, 2.0066333333333333, 3.007633333333333, 4.008633333333333, 5.009633333333333, 6.010633333333334, 7.011633333333333, 8.012633333333333, 9.013633333333333, 10.014633333333334, 11.015633333333334, 12.016633333333333, 13.017633333333333, 14.018633333333334], "recent_frames_sha256": "b92e0973a908f769656e31f263526af1672bb326d00ed1adc218395f77575cee", "num_recent_frames": 15, "tq": 710551.69886625, "t1": 710563.238274778, "ta": 710563.238274778, "te": 710563.276732807, "first_response_s": 11.539408528013155, "answer_total_s": 11.577866557054222, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_185_a983_q0", "video_id": 185, "time_stamp_s": 15, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0c92521f04c22ff41b8358503fe69bcb663e4e8e4447e84c4daa834fa40bb900", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.038, 1.0056333333333334, 2.0066333333333333, 3.007633333333333, 4.008633333333333, 5.009633333333333, 6.010633333333334, 7.011633333333333, 8.012633333333333, 9.013633333333333, 10.014633333333334, 11.015633333333334, 12.016633333333333, 13.017633333333333, 14.018633333333334], "recent_frames_sha256": "b92e0973a908f769656e31f263526af1672bb326d00ed1adc218395f77575cee", "num_recent_frames": 15, "tq": 710602.943836244, "t1": 710616.344973627, "ta": 710616.344973627, "te": 710616.382378062, "first_response_s": 13.401137382956222, "answer_total_s": 13.438541817944497, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 185, "content_group": "996a3f08ff5c352c4bb2109c93dfa7414f9af6e4737255cd5b8f51dc239b3fe5", "question": {"question_id": "sample_185_a984_q0", "video_id": 185, "video_path": "./videos/sample_185_real.mp4", "annotation_index": 984, "question_index": 0, "question": "What is located on the left side of the path right now?", "options": ["A. A line of trees.", "B. A lake.", "C. A canal.", "D. A field."], "answer": "A", "time_stamp_s": 142, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [122, 142], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_185_a984_q0", "video_id": 185, "time_stamp_s": 142, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f8f672ade7f7d644aae08d8f975410718da63d43744e1bb5754d3e11ff0e0019", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [112.01653333333333, 113.01753333333333, 114.01853333333334, 115.01953333333333, 116.02053333333333, 117.02153333333334, 118.02253333333333, 119.02353333333333, 120.02453333333334, 121.02553333333333, 122.02653333333333, 123.02753333333334, 124.02853333333333, 125.02953333333333, 126.03053333333334, 127.03153333333333, 128.03253333333333, 129.00016666666667, 130.00116666666668, 131.00216666666665, 132.00316666666666, 133.00416666666666, 134.00516666666667, 135.00616666666667, 136.00716666666668, 137.00816666666665, 138.00916666666666, 139.01016666666666, 140.01116666666667, 141.01216666666667], "recent_frames_sha256": "0900747557794031eae18080c2b382d90dd511bb99d99e73de19a1179bf00102", "num_recent_frames": 30, "tq": 710563.29978312, "t1": 710575.093356641, "ta": 710575.093356641, "te": 710575.130322098, "first_response_s": 11.793573520961218, "answer_total_s": 11.83053897798527, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_185_a984_q0", "video_id": 185, "time_stamp_s": 142, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a7071004abb4a14fa5c9b9e1bbc252966f90f0bc5060474246819cadf65bc020", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cyclist rides along a paved path beside a calm river, with trees lining both sides under a clear blue sky.  \n- On-screen display shows increasing speed (from 24 to 75 km/h), distance (46.0 km to 46.2 km), and time (73 min to 76 min), alongside a map of the route.  \n- Temperature remains steady at 23°C, and the terrain slope is consistently 0%.\n[30-60s] - Road surface slopes gently upward, indicated by a -1% grade change near 0:55.  \n- A white building with a red roof is visible on the left, passing by as the camera moves forward.  \n- The river runs parallel to the road on the right, bordered by dense green trees under a clear blue sky.\n[60-90s] - Road surface shows slight incline, with speedometer indicating 74-75 km/h and elevation gain around 1%.\n- Right side of road features a calm canal bordered by dense green trees under clear blue sky.\n- On-screen display shows distance increasing from 46.4 to 46.6 km, with temperature at 20°C and route map visible in corner.\n[90-120s] - The cyclist maintains a steady pace along a paved path beside a canal, with the speedometer fluctuating between 74 and 76 km/h.  \n- The route map on the screen shows the cyclist’s progress through a region with a temperature of 34°C.  \n- The elevation remains flat (0%) as the cyclist travels approximately 46.7 km, with the time displayed as 76 minutes.", "history_tokens": 370, "history_utf8_bytes": 1361, "recent_frame_times_s": [112.01653333333333, 113.01753333333333, 114.01853333333334, 115.01953333333333, 116.02053333333333, 117.02153333333334, 118.02253333333333, 119.02353333333333, 120.02453333333334, 121.02553333333333, 122.02653333333333, 123.02753333333334, 124.02853333333333, 125.02953333333333, 126.03053333333334, 127.03153333333333, 128.03253333333333, 129.00016666666667, 130.00116666666668, 131.00216666666665, 132.00316666666666, 133.00416666666666, 134.00516666666667, 135.00616666666667, 136.00716666666668, 137.00816666666665, 138.00916666666666, 139.01016666666666, 140.01116666666667, 141.01216666666667], "recent_frames_sha256": "0900747557794031eae18080c2b382d90dd511bb99d99e73de19a1179bf00102", "num_recent_frames": 30, "tq": 710646.280917102, "t1": 710654.098938518, "ta": 710654.098938518, "te": 710654.137355789, "first_response_s": 7.818021415965632, "answer_total_s": 7.856438686954789, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 185, "content_group": "996a3f08ff5c352c4bb2109c93dfa7414f9af6e4737255cd5b8f51dc239b3fe5", "question": {"question_id": "sample_185_a985_q0", "video_id": 185, "video_path": "./videos/sample_185_real.mp4", "annotation_index": 985, "question_index": 0, "question": "What is on the right side of the path right now?", "options": ["A. A river.", "B. A grassy field.", "C. A dense forest.", "D. A parking lot."], "answer": "A", "time_stamp_s": 250, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [244, 264], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_185_a985_q0", "video_id": 185, "time_stamp_s": 250, "ground_truth": "A", "raw_output": "A. A river.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "f26eee0a62115b5271d672aaea745a196b4820bfdc98ca8ad1d05c53f5491197", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [220.02443333333332, 221.02543333333332, 222.02643333333333, 223.02743333333333, 224.02843333333334, 225.02943333333334, 226.03043333333332, 227.03143333333333, 228.03243333333333, 229.00006666666667, 230.00106666666667, 231.00206666666668, 232.00306666666665, 233.00406666666666, 234.00506666666666, 235.00606666666667, 236.00706666666667, 237.00806666666668, 238.00906666666666, 239.01006666666666, 240.01106666666666, 241.01206666666667, 242.01306666666667, 243.01406666666668, 244.01506666666666, 245.01606666666666, 246.01706666666666, 247.01806666666667, 248.01906666666667, 249.02006666666668], "recent_frames_sha256": "26114e3758dc87bde9a62f6815db955130cdb035b55d381e8e064b22cd76ba57", "num_recent_frames": 30, "tq": 710575.145639166, "t1": 710586.318911469, "ta": 710586.318911469, "te": 710586.504523099, "first_response_s": 11.17327230295632, "answer_total_s": 11.358883933047764, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_185_a985_q0", "video_id": 185, "time_stamp_s": 250, "ground_truth": "A", "raw_output": "A. A river.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "8d10d33431b05eb9406e6058bc9af5eb9026f8730a1a3672f2c1a1d0c92bf852", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cyclist rides along a paved path beside a calm river, with trees lining both sides under a clear blue sky.  \n- On-screen display shows increasing speed (from 24 to 75 km/h), distance (46.0 km to 46.2 km), and time (73 min to 76 min), alongside a map of the route.  \n- Temperature remains steady at 23°C, and the terrain slope is consistently 0%.\n[30-60s] - Road surface slopes gently upward, indicated by a -1% grade change near 0:55.  \n- A white building with a red roof is visible on the left, passing by as the camera moves forward.  \n- The river runs parallel to the road on the right, bordered by dense green trees under a clear blue sky.\n[60-90s] - Road surface shows slight incline, with speedometer indicating 74-75 km/h and elevation gain around 1%.\n- Right side of road features a calm canal bordered by dense green trees under clear blue sky.\n- On-screen display shows distance increasing from 46.4 to 46.6 km, with temperature at 20°C and route map visible in corner.\n[90-120s] - The cyclist maintains a steady pace along a paved path beside a canal, with the speedometer fluctuating between 74 and 76 km/h.  \n- The route map on the screen shows the cyclist’s progress through a region with a temperature of 34°C.  \n- The elevation remains flat (0%) as the cyclist travels approximately 46.7 km, with the time displayed as 76 minutes.\n[120-150s] - Road surface shows slight incline (0% to 1%) as cyclist progresses forward.  \n- River runs parallel to the paved path, bordered by dense green trees.  \n- On-screen display updates distance to 46.9 KM and shows temperature at 34°C.\n[150-180s] - Cyclist approaches a bridge with a white railing, passing under it while the route tracker shows 47.1 KM.\n- Road transitions from a paved path beside a canal to a wider asphalt road with parked cars on the left.\n- Temperature display reads 34°C, and the cyclist’s speed fluctuates between 22 and 25 km/h as they navigate a slight incline.\n[180-210s] - Road surface transitions from paved to gravel, then to a narrow asphalt path flanked by tall grass and trees.  \n- A white car is parked on the left side of the road, and a blue vehicle is visible further ahead.  \n- The on-screen display shows a steady pace of 75 BPM, 76 minutes elapsed, and 47.3–47.6 km distance covered.\n[210-240s] - Road surface shows slight incline, with speed fluctuating between 23–25 km/h.  \n- Right side of path is a calm canal bordered by greenery, with a building visible in distance.  \n- On-screen data indicates 47.5 km total distance, 74–78 minutes elapsed, and 0% elevation gain.", "history_tokens": 709, "history_utf8_bytes": 2591, "recent_frame_times_s": [220.02443333333332, 221.02543333333332, 222.02643333333333, 223.02743333333333, 224.02843333333334, 225.02943333333334, 226.03043333333332, 227.03143333333333, 228.03243333333333, 229.00006666666667, 230.00106666666667, 231.00206666666668, 232.00306666666665, 233.00406666666666, 234.00506666666666, 235.00606666666667, 236.00706666666667, 237.00806666666668, 238.00906666666666, 239.01006666666666, 240.01106666666666, 241.01206666666667, 242.01306666666667, 243.01406666666668, 244.01506666666666, 245.01606666666666, 246.01706666666666, 247.01806666666667, 248.01906666666667, 249.02006666666668], "recent_frames_sha256": "26114e3758dc87bde9a62f6815db955130cdb035b55d381e8e064b22cd76ba57", "num_recent_frames": 30, "tq": 710683.991418993, "t1": 710686.01249829, "ta": 710686.01249829, "te": 710686.363187837, "first_response_s": 2.0210792970610783, "answer_total_s": 2.3717688439646736, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 185, "content_group": "996a3f08ff5c352c4bb2109c93dfa7414f9af6e4737255cd5b8f51dc239b3fe5", "question": {"question_id": "sample_185_a986_q0", "video_id": 185, "video_path": "./videos/sample_185_real.mp4", "annotation_index": 986, "question_index": 0, "question": "Where is the canal located right now?", "options": ["A. On the right side of the path.", "B. On the left side of the path.", "C. Directly behind the cyclist.", "D. Directly ahead of the cyclist."], "answer": "A", "time_stamp_s": 386, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [366, 386], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_185_a986_q0", "video_id": 185, "time_stamp_s": 386, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "aa72915b0d3225c975a9cea673ae1b2e836b17f6e425850540dd54db09eb503f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [356.0269666666667, 357.02796666666666, 358.0289666666667, 359.02996666666667, 360.03096666666664, 361.0319666666667, 362.03296666666665, 363.0006, 364.0016, 365.0026, 366.0036, 367.0046, 368.0056, 369.0066, 370.0076, 371.0086, 372.0096, 373.0106, 374.0116, 375.0126, 376.0136, 377.0146, 378.0156, 379.0166, 380.0176, 381.0186, 382.0196, 383.0206, 384.0216, 385.0226], "recent_frames_sha256": "413e81a1a9d7b0286cb644461cac5534e86d1899b196aa6959636d327655ad28", "num_recent_frames": 30, "tq": 710586.521574105, "t1": 710594.013953991, "ta": 710594.013953991, "te": 710594.051128997, "first_response_s": 7.492379885981791, "answer_total_s": 7.529554891982116, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_185_a986_q0", "video_id": 185, "time_stamp_s": 386, "ground_truth": "A", "raw_output": "A. On the right side of the path.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "db1cf7975a869a5f66f4543c98fe2206d5414cfb4baa05625d6bdb864419c112", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Road surface slopes gently upward, indicated by a -1% grade change near 0:55.  \n- A white building with a red roof is visible on the left, passing by as the camera moves forward.  \n- The river runs parallel to the road on the right, bordered by dense green trees under a clear blue sky.\n[60-90s] - Road surface shows slight incline, with speedometer indicating 74-75 km/h and elevation gain around 1%.\n- Right side of road features a calm canal bordered by dense green trees under clear blue sky.\n- On-screen display shows distance increasing from 46.4 to 46.6 km, with temperature at 20°C and route map visible in corner.\n[90-120s] - The cyclist maintains a steady pace along a paved path beside a canal, with the speedometer fluctuating between 74 and 76 km/h.  \n- The route map on the screen shows the cyclist’s progress through a region with a temperature of 34°C.  \n- The elevation remains flat (0%) as the cyclist travels approximately 46.7 km, with the time displayed as 76 minutes.\n[120-150s] - Road surface shows slight incline (0% to 1%) as cyclist progresses forward.  \n- River runs parallel to the paved path, bordered by dense green trees.  \n- On-screen display updates distance to 46.9 KM and shows temperature at 34°C.\n[150-180s] - Cyclist approaches a bridge with a white railing, passing under it while the route tracker shows 47.1 KM.\n- Road transitions from a paved path beside a canal to a wider asphalt road with parked cars on the left.\n- Temperature display reads 34°C, and the cyclist’s speed fluctuates between 22 and 25 km/h as they navigate a slight incline.\n[180-210s] - Road surface transitions from paved to gravel, then to a narrow asphalt path flanked by tall grass and trees.  \n- A white car is parked on the left side of the road, and a blue vehicle is visible further ahead.  \n- The on-screen display shows a steady pace of 75 BPM, 76 minutes elapsed, and 47.3–47.6 km distance covered.\n[210-240s] - Road surface shows slight incline, with speed fluctuating between 23–25 km/h.  \n- Right side of path is a calm canal bordered by greenery, with a building visible in distance.  \n- On-screen data indicates 47.5 km total distance, 74–78 minutes elapsed, and 0% elevation gain.\n[240-270s] - Road surface shows slight incline (1% grade) with consistent speed (75-76 km/h) as cyclist moves forward.\n- Right side of path is a calm canal bordered by greenery, with a map overlay indicating location near 'Höhe' at 34°C.\n- On-screen metrics display distance (47.7 km), time (76:14 min), and heart rate (24-26 bpm) fluctuating slightly during ride.\n[270-300s] - Road surface shows slight incline (1% grade) with distance increasing from 47.9 km to 48.0 km.\n- Temperature remains steady at 34°C, with a map overlay indicating location near Höhne.\n- Speed fluctuates between 23 and 25 km/h, with a blue circular gauge indicating current speed.\n[300-330s] - Road speed fluctuates between 22 and 28 mph, with a slight incline (1%) visible on the left.\n- The cyclist maintains a steady pace, with the distance increasing from 48.1 to 48.3 km.\n- The right side of the path is bordered by a calm river, with trees lining both sides under clear skies.\n[330-360s] - The cyclist's speed fluctuates between 74 and 75 km/h, with a slight incline (1%) appearing around 340 seconds.\n- The route map on the right shows a highlighted path along a river, with the current location marked near the riverbank.\n- The distance increases from 48.3 km to 48.5 km, indicating steady forward motion along the paved path.", "history_tokens": 982, "history_utf8_bytes": 3550, "recent_frame_times_s": [356.0269666666667, 357.02796666666666, 358.0289666666667, 359.02996666666667, 360.03096666666664, 361.0319666666667, 362.03296666666665, 363.0006, 364.0016, 365.0026, 366.0036, 367.0046, 368.0056, 369.0066, 370.0076, 371.0086, 372.0096, 373.0106, 374.0116, 375.0126, 376.0136, 377.0146, 378.0156, 379.0166, 380.0176, 381.0186, 382.0196, 383.0206, 384.0216, 385.0226], "recent_frames_sha256": "413e81a1a9d7b0286cb644461cac5534e86d1899b196aa6959636d327655ad28", "num_recent_frames": 30, "tq": 710718.694765124, "t1": 710719.699960262, "ta": 710719.699960262, "te": 710720.071405716, "first_response_s": 1.0051951380446553, "answer_total_s": 1.3766405920032412, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 185, "content_group": "996a3f08ff5c352c4bb2109c93dfa7414f9af6e4737255cd5b8f51dc239b3fe5", "question": {"question_id": "sample_185_a987_q0", "video_id": 185, "video_path": "./videos/sample_185_real.mp4", "annotation_index": 987, "question_index": 0, "question": "What is on the right side of the path right now?", "options": ["A. A river.", "B. A forest.", "C. A mountain.", "D. A road."], "answer": "A", "time_stamp_s": 498, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [488, 508], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_185_a987_q0", "video_id": 185, "time_stamp_s": 498, "ground_truth": "A", "raw_output": "A. A river.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "c54ec0318ccf7fd575702075f5091b69f1ab255c1f0d7bc7ef334170e0531af5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [468.0055, 469.0065, 470.0075, 471.0085, 472.0095, 473.0105, 474.0115, 475.0125, 476.0135, 477.0145, 478.0155, 479.0165, 480.0175, 481.0185, 482.0195, 483.0205, 484.0215, 485.0225, 486.0235, 487.0245, 488.0255, 489.0265, 490.0275, 491.0285, 492.0295, 493.0305, 494.0315, 495.0325, 496.00013333333334, 497.0011333333333], "recent_frames_sha256": "143d2d6e79c5d4e516d202d11bf0a7ddf6799e6d9b58b0931d9318ebf402a2d0", "num_recent_frames": 30, "tq": 710594.06234458, "t1": 710602.675086981, "ta": 710602.675086981, "te": 710602.932788287, "first_response_s": 8.612742401077412, "answer_total_s": 8.870443707099184, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_185_a987_q0", "video_id": 185, "time_stamp_s": 498, "ground_truth": "A", "raw_output": "A. A river.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "c2df4e782f08c6c06ef082585229ce18506a71236c74b5118635d0921baefc77", "condition_order": ["recent", "notes"], "memory": "[150-180s] - Cyclist approaches a bridge with a white railing, passing under it while the route tracker shows 47.1 KM.\n- Road transitions from a paved path beside a canal to a wider asphalt road with parked cars on the left.\n- Temperature display reads 34°C, and the cyclist’s speed fluctuates between 22 and 25 km/h as they navigate a slight incline.\n[180-210s] - Road surface transitions from paved to gravel, then to a narrow asphalt path flanked by tall grass and trees.  \n- A white car is parked on the left side of the road, and a blue vehicle is visible further ahead.  \n- The on-screen display shows a steady pace of 75 BPM, 76 minutes elapsed, and 47.3–47.6 km distance covered.\n[210-240s] - Road surface shows slight incline, with speed fluctuating between 23–25 km/h.  \n- Right side of path is a calm canal bordered by greenery, with a building visible in distance.  \n- On-screen data indicates 47.5 km total distance, 74–78 minutes elapsed, and 0% elevation gain.\n[240-270s] - Road surface shows slight incline (1% grade) with consistent speed (75-76 km/h) as cyclist moves forward.\n- Right side of path is a calm canal bordered by greenery, with a map overlay indicating location near 'Höhe' at 34°C.\n- On-screen metrics display distance (47.7 km), time (76:14 min), and heart rate (24-26 bpm) fluctuating slightly during ride.\n[270-300s] - Road surface shows slight incline (1% grade) with distance increasing from 47.9 km to 48.0 km.\n- Temperature remains steady at 34°C, with a map overlay indicating location near Höhne.\n- Speed fluctuates between 23 and 25 km/h, with a blue circular gauge indicating current speed.\n[300-330s] - Road speed fluctuates between 22 and 28 mph, with a slight incline (1%) visible on the left.\n- The cyclist maintains a steady pace, with the distance increasing from 48.1 to 48.3 km.\n- The right side of the path is bordered by a calm river, with trees lining both sides under clear skies.\n[330-360s] - The cyclist's speed fluctuates between 74 and 75 km/h, with a slight incline (1%) appearing around 340 seconds.\n- The route map on the right shows a highlighted path along a river, with the current location marked near the riverbank.\n- The distance increases from 48.3 km to 48.5 km, indicating steady forward motion along the paved path.\n[360-390s] - Road surface shows slight elevation change with a gentle incline (0% to 1%) as cyclist progresses.\n- River runs parallel to the path, bordered by dense green trees on both sides under clear blue sky.\n- On-screen display indicates increasing distance (48.5 KM to 48.7 KM) and time (76.1 MIN to 77.1 MIN) with temperature at 28°C.\n[390-420s] - Road elevation slightly ascends, indicated by a 1% incline on the display.  \n- River flows parallel to the paved path, bordered by dense green trees.  \n- GPS map on screen shows a route marker moving along the riverbank.\n[420-450s] - Speedometer shows fluctuating speeds between 72 and 75 km/h, with a slight incline (0% to 1%) indicated.\n- The route map on the right displays a highlighted path along a river, with the current position marked near the riverbank.\n- The road is flanked by dense green trees and a calm river, with the camera perspective moving forward along the path.\n[450-480s] - The cyclist's speed fluctuates slightly, showing 72 to 73 km/h, while the route progresses from 49.1 to 49.3 km.\n- The terrain slope changes from -1% to -0% and then to -1%, indicating minor elevation shifts along the path.\n- The river remains on the right, bordered by dense green trees, under a clear blue sky.", "history_tokens": 997, "history_utf8_bytes": 3566, "recent_frame_times_s": [468.0055, 469.0065, 470.0075, 471.0085, 472.0095, 473.0105, 474.0115, 475.0125, 476.0135, 477.0145, 478.0155, 479.0165, 480.0175, 481.0185, 482.0195, 483.0205, 484.0215, 485.0225, 486.0235, 487.0245, 488.0255, 489.0265, 490.0275, 491.0285, 492.0295, 493.0305, 494.0315, 495.0325, 496.00013333333334, 497.0011333333333], "recent_frames_sha256": "143d2d6e79c5d4e516d202d11bf0a7ddf6799e6d9b58b0931d9318ebf402a2d0", "num_recent_frames": 30, "tq": 710753.337845078, "t1": 710755.225679432, "ta": 710755.225679432, "te": 710755.430330491, "first_response_s": 1.8878343540709466, "answer_total_s": 2.0924854130716994, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 186, "content_group": "4941f3f64c026d84073eb274231363e9a4620927725e928b1cf27726d7118d7e", "question": {"question_id": "sample_186_a1335_q0", "video_id": 186, "video_path": "./videos/sample_186_real.mp4", "annotation_index": 1335, "question_index": 0, "question": "What is the focus of today's video as mentioned at the beginning?", "options": ["A. Cooking recipes.", "B. Building something.", "C. Making a tutorial.", "D. Crafting objects."], "answer": "B", "time_stamp_s": 20, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_186_a1335_q0", "video_id": 186, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "dc3db7f1306f77d5322076f4e5d8f0077f46655138dccf739515eb9ea9048fea", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "b299808e0aebc9cc49c092f282b9fb6428dfcafa6d1ace352ee744a28fae5a6c", "num_recent_frames": 21, "tq": 716321.181212503, "t1": 716332.171141247, "ta": 716332.171141247, "te": 716332.209396431, "first_response_s": 10.989928744034842, "answer_total_s": 11.028183927992359, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_186_a1335_q0", "video_id": 186, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b2bf4acc0868974d025954bb58227b9ce7ba07bfad5b58968eb3e6de68ee1917", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "b299808e0aebc9cc49c092f282b9fb6428dfcafa6d1ace352ee744a28fae5a6c", "num_recent_frames": 21, "tq": 716382.933044913, "t1": 716394.427977422, "ta": 716394.427977422, "te": 716394.613918452, "first_response_s": 11.494932509027421, "answer_total_s": 11.680873539065942, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 186, "content_group": "4941f3f64c026d84073eb274231363e9a4620927725e928b1cf27726d7118d7e", "question": {"question_id": "sample_186_a1336_q0", "video_id": 186, "video_path": "./videos/sample_186_real.mp4", "annotation_index": 1336, "question_index": 0, "question": "What material are the walls of the structure made from?", "options": ["A. Wood blocks.", "B. Metal blocks.", "C. Brown soil blocks.", "D. Glass blocks."], "answer": "C", "time_stamp_s": 190, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_186_a1336_q0", "video_id": 186, "time_stamp_s": 190, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cad3507e9f88950847d232513bf5e1d29beec744bb7200096f45fb42e602408e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0], "recent_frames_sha256": "ceeacdcd2994e500cd3ce712af56df367fe90005b92a98c02b49fa08fc529e34", "num_recent_frames": 30, "tq": 716332.219709636, "t1": 716344.424106311, "ta": 716344.424106311, "te": 716344.572159698, "first_response_s": 12.204396675108, "answer_total_s": 12.35245006205514, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_186_a1336_q0", "video_id": 186, "time_stamp_s": 190, "ground_truth": "C", "raw_output": "A. Wood blocks.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "4a9fe7e66dc4556ab225bb2978590f8ff311d334b295620dd419a09a1da71b80", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Player approaches a wooden dock leading to a small stone house with a blue diamond sword in hand, near a body of water.\n- Player enters the house, revealing a forge, crafting table, and storage chests, then proceeds into a narrow stone tunnel.\n- Player holds a wooden pickaxe and moves through the tunnel, with a ladder visible at the end, suggesting an upcoming descent or climb.\n[30-60s] - Player approaches a purple-veined stone archway, then descends into a cavern with flowing water and stone walls.  \n- Player navigates through a narrow, rocky passage with visible water channels and a torch-lit path.  \n- Player’s inventory shows a diamond pickaxe and a diamond sword, indicating mining or combat readiness.\n[60-90s] - Player moves through a dark, stone-lined cavern with flowing water and glowing blue blocks.\n- Player approaches a glowing, dark blue block structure with a visible \"Raided Potato\" item in inventory.\n- Player looks up at a ceiling with glowing blue particles and a distant, faintly visible structure.\n[90-120s] - Player in a lava-filled underground chamber, wearing diamond armor, with a pickaxe in hand, near blue structures and orange lava.  \n- Player exits the underground, transitioning to a surface biome with a wooden dock, a small house, and a hot air balloon in the sky.  \n- Player moves across a grassy landscape with trees and water, heading toward a distant red structure labeled \"To the creator.\"\n[120-150s] - Player holds a red mushroom-shaped item, likely a mushroom block, while looking at a landscape with trees and water.\n- A large, floating, blocky structure (possibly a tree or building) is visible in the sky, moving or rotating.\n- The sky transitions from blue to orange during sunset, with clouds and distant mountains visible in the background.\n[150-180s] - A frog is visible on the ground, with text \"PUP!\" above it, indicating a player interaction or game event.\n- A red \"Subscribe\" button appears on screen, suggesting a YouTube channel promotion.\n- An aerial view reveals a wooden structure resembling a cross or star, surrounded by trees and grass.", "history_tokens": 477, "history_utf8_bytes": 2113, "recent_frame_times_s": [161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0], "recent_frames_sha256": "ceeacdcd2994e500cd3ce712af56df367fe90005b92a98c02b49fa08fc529e34", "num_recent_frames": 30, "tq": 716447.048385897, "t1": 716448.797322794, "ta": 716448.797322794, "te": 716448.998387333, "first_response_s": 1.7489368970273063, "answer_total_s": 1.950001436052844, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 186, "content_group": "4941f3f64c026d84073eb274231363e9a4620927725e928b1cf27726d7118d7e", "question": {"question_id": "sample_186_a1337_q0", "video_id": 186, "video_path": "./videos/sample_186_real.mp4", "annotation_index": 1337, "question_index": 0, "question": "What tool is the character holding in the first-person perspective right now?", "options": ["A. A sword.", "B. A pickaxe.", "C. A shovel.", "D. An axe."], "answer": "B", "time_stamp_s": 361, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_186_a1337_q0", "video_id": 186, "time_stamp_s": 361, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "91d6dbea5811ba2bb6115f3fd7cfca1cdef649fc5f3944b249bff34e0c6b5bbe", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0], "recent_frames_sha256": "f14ac03a9cf31a260f935cc35166651aabefb9d365abbb7c9a3b3fc93cce5425", "num_recent_frames": 30, "tq": 716344.581769454, "t1": 716358.114392469, "ta": 716358.114392469, "te": 716358.152252199, "first_response_s": 13.532623015111312, "answer_total_s": 13.570482745068148, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_186_a1337_q0", "video_id": 186, "time_stamp_s": 361, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dae9dfde3c5088855723328b5329f0bed8e14b88ae1f53a033e62ad1495653d2", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Player approaches a wooden dock leading to a small stone house with a blue diamond sword in hand, near a body of water.\n- Player enters the house, revealing a forge, crafting table, and storage chests, then proceeds into a narrow stone tunnel.\n- Player holds a wooden pickaxe and moves through the tunnel, with a ladder visible at the end, suggesting an upcoming descent or climb.\n[30-60s] - Player approaches a purple-veined stone archway, then descends into a cavern with flowing water and stone walls.  \n- Player navigates through a narrow, rocky passage with visible water channels and a torch-lit path.  \n- Player’s inventory shows a diamond pickaxe and a diamond sword, indicating mining or combat readiness.\n[60-90s] - Player moves through a dark, stone-lined cavern with flowing water and glowing blue blocks.\n- Player approaches a glowing, dark blue block structure with a visible \"Raided Potato\" item in inventory.\n- Player looks up at a ceiling with glowing blue particles and a distant, faintly visible structure.\n[90-120s] - Player in a lava-filled underground chamber, wearing diamond armor, with a pickaxe in hand, near blue structures and orange lava.  \n- Player exits the underground, transitioning to a surface biome with a wooden dock, a small house, and a hot air balloon in the sky.  \n- Player moves across a grassy landscape with trees and water, heading toward a distant red structure labeled \"To the creator.\"\n[120-150s] - Player holds a red mushroom-shaped item, likely a mushroom block, while looking at a landscape with trees and water.\n- A large, floating, blocky structure (possibly a tree or building) is visible in the sky, moving or rotating.\n- The sky transitions from blue to orange during sunset, with clouds and distant mountains visible in the background.\n[150-180s] - A frog is visible on the ground, with text \"PUP!\" above it, indicating a player interaction or game event.\n- A red \"Subscribe\" button appears on screen, suggesting a YouTube channel promotion.\n- An aerial view reveals a wooden structure resembling a cross or star, surrounded by trees and grass.\n[180-210s] - A circular structure with a central square and radial pathways is surrounded by stone walls and trees.  \n- A blue character is visible near the center, moving around the structure.  \n- The camera pans and zooms, revealing the structure's layout and surrounding environment.\n[210-240s] - Player character in purple cape walks across a flat stone platform, then turns toward a forested area.\n- A red mushroom-like entity appears in the distance, followed by a fiery explosion effect near a tree.\n- Player switches to a \"Firework Rocket\" and moves toward a structure with a red and white striped pattern.\n[240-270s] - Player holds a red-and-white pickaxe, standing on a grassy hill under a clear sky with scattered clouds.\n- Player’s inventory shows various items, including a sword, tools, and food, with health and hunger bars visible.\n- Scene transitions to a redstone-lit underground tunnel with a torch in hand, indicating movement into a Nether biome.\n[270-300s] - Player holds a pickaxe and mines redstone ore in a dark, narrow underground tunnel.\n- Player switches to a TNT block, then to a pickaxe, and later to a diamond pickaxe while mining.\n- Player collects redstone ore and other blocks, with inventory items visible at the bottom of the screen.\n[300-330s] - Player mining Nether bricks with a diamond pickaxe, count increasing from 6 to 13.\n- Player switches to a Netherite pickaxe at 3:05, continuing to mine.\n- Player opens inventory at 3:15, showing 25 ancient debris and a crafting grid with Netherite items.\n[330-360s] - Player opens inventory to access \"Upgrade Gear\" interface, showing axe and gear combination options.\n- Player navigates to \"Search...\" menu, revealing a purple-skinned character model in the crafting area.\n- Player views a \"Large Chest\" with multiple slots, including \"Dungeon\" and \"Chest\" labels, indicating storage organization.", "history_tokens": 931, "history_utf8_bytes": 3997, "recent_frame_times_s": [332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0], "recent_frames_sha256": "f14ac03a9cf31a260f935cc35166651aabefb9d365abbb7c9a3b3fc93cce5425", "num_recent_frames": 30, "tq": 716498.948493129, "t1": 716500.375996317, "ta": 716500.375996317, "te": 716500.413976226, "first_response_s": 1.427503188024275, "answer_total_s": 1.4654830970102921, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 186, "content_group": "4941f3f64c026d84073eb274231363e9a4620927725e928b1cf27726d7118d7e", "question": {"question_id": "sample_186_a1337_q1", "video_id": 186, "video_path": "./videos/sample_186_real.mp4", "annotation_index": 1337, "question_index": 1, "question": "Which enchantment is NOT on the diamond shovel?", "options": ["A. Efficiency IV.", "B. Unbreaking III.", "C. Silk Touch.", "D. Fortune III."], "answer": "D", "time_stamp_s": 366, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_186_a1337_q1", "video_id": 186, "time_stamp_s": 366, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "324db3e3d7c3855657b7892c3038e6b7f98eef24d9e51eead86127288569c700", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0], "recent_frames_sha256": "b8081c972da92e06f8055b52883f038152dcd1cd0cdac38c6c0c752f5a71e7ef", "num_recent_frames": 30, "tq": 716358.15908055, "t1": 716369.806740997, "ta": 716369.806740997, "te": 716369.843664772, "first_response_s": 11.647660447051749, "answer_total_s": 11.684584222035483, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_186_a1337_q1", "video_id": 186, "time_stamp_s": 366, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2d52a94e1a91041c34c77ecaf3c96c0ef2e3c64b7776617d8cbe85f2d93d1451", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Player approaches a wooden dock leading to a small stone house with a blue diamond sword in hand, near a body of water.\n- Player enters the house, revealing a forge, crafting table, and storage chests, then proceeds into a narrow stone tunnel.\n- Player holds a wooden pickaxe and moves through the tunnel, with a ladder visible at the end, suggesting an upcoming descent or climb.\n[30-60s] - Player approaches a purple-veined stone archway, then descends into a cavern with flowing water and stone walls.  \n- Player navigates through a narrow, rocky passage with visible water channels and a torch-lit path.  \n- Player’s inventory shows a diamond pickaxe and a diamond sword, indicating mining or combat readiness.\n[60-90s] - Player moves through a dark, stone-lined cavern with flowing water and glowing blue blocks.\n- Player approaches a glowing, dark blue block structure with a visible \"Raided Potato\" item in inventory.\n- Player looks up at a ceiling with glowing blue particles and a distant, faintly visible structure.\n[90-120s] - Player in a lava-filled underground chamber, wearing diamond armor, with a pickaxe in hand, near blue structures and orange lava.  \n- Player exits the underground, transitioning to a surface biome with a wooden dock, a small house, and a hot air balloon in the sky.  \n- Player moves across a grassy landscape with trees and water, heading toward a distant red structure labeled \"To the creator.\"\n[120-150s] - Player holds a red mushroom-shaped item, likely a mushroom block, while looking at a landscape with trees and water.\n- A large, floating, blocky structure (possibly a tree or building) is visible in the sky, moving or rotating.\n- The sky transitions from blue to orange during sunset, with clouds and distant mountains visible in the background.\n[150-180s] - A frog is visible on the ground, with text \"PUP!\" above it, indicating a player interaction or game event.\n- A red \"Subscribe\" button appears on screen, suggesting a YouTube channel promotion.\n- An aerial view reveals a wooden structure resembling a cross or star, surrounded by trees and grass.\n[180-210s] - A circular structure with a central square and radial pathways is surrounded by stone walls and trees.  \n- A blue character is visible near the center, moving around the structure.  \n- The camera pans and zooms, revealing the structure's layout and surrounding environment.\n[210-240s] - Player character in purple cape walks across a flat stone platform, then turns toward a forested area.\n- A red mushroom-like entity appears in the distance, followed by a fiery explosion effect near a tree.\n- Player switches to a \"Firework Rocket\" and moves toward a structure with a red and white striped pattern.\n[240-270s] - Player holds a red-and-white pickaxe, standing on a grassy hill under a clear sky with scattered clouds.\n- Player’s inventory shows various items, including a sword, tools, and food, with health and hunger bars visible.\n- Scene transitions to a redstone-lit underground tunnel with a torch in hand, indicating movement into a Nether biome.\n[270-300s] - Player holds a pickaxe and mines redstone ore in a dark, narrow underground tunnel.\n- Player switches to a TNT block, then to a pickaxe, and later to a diamond pickaxe while mining.\n- Player collects redstone ore and other blocks, with inventory items visible at the bottom of the screen.\n[300-330s] - Player mining Nether bricks with a diamond pickaxe, count increasing from 6 to 13.\n- Player switches to a Netherite pickaxe at 3:05, continuing to mine.\n- Player opens inventory at 3:15, showing 25 ancient debris and a crafting grid with Netherite items.\n[330-360s] - Player opens inventory to access \"Upgrade Gear\" interface, showing axe and gear combination options.\n- Player navigates to \"Search...\" menu, revealing a purple-skinned character model in the crafting area.\n- Player views a \"Large Chest\" with multiple slots, including \"Dungeon\" and \"Chest\" labels, indicating storage organization.", "history_tokens": 931, "history_utf8_bytes": 3997, "recent_frame_times_s": [337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0], "recent_frames_sha256": "b8081c972da92e06f8055b52883f038152dcd1cd0cdac38c6c0c752f5a71e7ef", "num_recent_frames": 30, "tq": 716500.449754321, "t1": 716512.301366922, "ta": 716512.301366922, "te": 716512.449653587, "first_response_s": 11.851612600963563, "answer_total_s": 11.999899265938438, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 186, "content_group": "4941f3f64c026d84073eb274231363e9a4620927725e928b1cf27726d7118d7e", "question": {"question_id": "sample_186_a1338_q0", "video_id": 186, "video_path": "./videos/sample_186_real.mp4", "annotation_index": 1338, "question_index": 0, "question": "What colors are the blocks used in the structure shown right now?", "options": ["A. Red, green and brown.", "B. Orange, yellow, blue and green.", "C. Blue and white.", "D. Purple and pink."], "answer": "B", "time_stamp_s": 544, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_186_a1338_q0", "video_id": 186, "time_stamp_s": 544, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6fa9ca351d99cc89c1f2993f90663a922282ec52584c15755a1cb398344d880d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0], "recent_frames_sha256": "c0f12b1c15af6b91008657dfca5864a8d8ba7ea2c97c14168cb0e09a0d0d5f20", "num_recent_frames": 30, "tq": 716369.851044039, "t1": 716382.887202718, "ta": 716382.887202718, "te": 716382.924879417, "first_response_s": 13.036158678936772, "answer_total_s": 13.073835378047079, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_186_a1338_q0", "video_id": 186, "time_stamp_s": 544, "ground_truth": "B", "raw_output": "B. Orange, yellow, blue and green.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "bb2fc21808ab70aba3614f3cdd44384230894e5e1b045396f584b1eaf918f79c", "condition_order": ["recent", "notes"], "memory": "[150-180s] - A frog is visible on the ground, with text \"PUP!\" above it, indicating a player interaction or game event.\n- A red \"Subscribe\" button appears on screen, suggesting a YouTube channel promotion.\n- An aerial view reveals a wooden structure resembling a cross or star, surrounded by trees and grass.\n[180-210s] - A circular structure with a central square and radial pathways is surrounded by stone walls and trees.  \n- A blue character is visible near the center, moving around the structure.  \n- The camera pans and zooms, revealing the structure's layout and surrounding environment.\n[210-240s] - Player character in purple cape walks across a flat stone platform, then turns toward a forested area.\n- A red mushroom-like entity appears in the distance, followed by a fiery explosion effect near a tree.\n- Player switches to a \"Firework Rocket\" and moves toward a structure with a red and white striped pattern.\n[240-270s] - Player holds a red-and-white pickaxe, standing on a grassy hill under a clear sky with scattered clouds.\n- Player’s inventory shows various items, including a sword, tools, and food, with health and hunger bars visible.\n- Scene transitions to a redstone-lit underground tunnel with a torch in hand, indicating movement into a Nether biome.\n[270-300s] - Player holds a pickaxe and mines redstone ore in a dark, narrow underground tunnel.\n- Player switches to a TNT block, then to a pickaxe, and later to a diamond pickaxe while mining.\n- Player collects redstone ore and other blocks, with inventory items visible at the bottom of the screen.\n[300-330s] - Player mining Nether bricks with a diamond pickaxe, count increasing from 6 to 13.\n- Player switches to a Netherite pickaxe at 3:05, continuing to mine.\n- Player opens inventory at 3:15, showing 25 ancient debris and a crafting grid with Netherite items.\n[330-360s] - Player opens inventory to access \"Upgrade Gear\" interface, showing axe and gear combination options.\n- Player navigates to \"Search...\" menu, revealing a purple-skinned character model in the crafting area.\n- Player views a \"Large Chest\" with multiple slots, including \"Dungeon\" and \"Chest\" labels, indicating storage organization.\n[360-390s] - Player holds a purple pickaxe and upgrades it to a \"Battlete Shovel\" in an inventory menu.\n- Player exits the interior, standing on a wooden dock beside a river, with a large purple and orange creature nearby.\n- The creature appears to be stationary, positioned near the dock's edge, facing the player.\n[390-420s] - Player holds purple pickaxe, standing on wooden dock near water, with chests and a flower pot nearby.\n- Player approaches a wooden house at night, then opens a chest containing Red Concrete and other items.\n- Player looks up at a red hot air balloon floating above the water, then transitions to a desert biome with a large sand dune.\n[420-450s] - Player holds a purple sword, moving across a grassy plain with trees and hills in the background.\n- A small white object (possibly a mob or item) is visible in the distance, moving toward the player.\n- The player's health bar and inventory are visible at the bottom of the screen, indicating active gameplay.\n[450-480s] - A red hot air balloon floats in the sky, moving slowly across the open field.  \n- The player’s hand holds a purple pickaxe, positioned near a yellow block structure.  \n- The player’s inventory shows a crafting grid with various items, including a red hot air balloon icon.\n[480-510s] - Player constructs a yellow rectangular path with orange and blue striped towers at its corners.  \n- Towers have blue conical tops and are positioned symmetrically around the path.  \n- The landscape features green grass, trees, and distant mountains under a clear sky.\n[510-540s] - A pixelated castle with orange and yellow striped towers and blue conical roofs is under construction on a grassy hillside.  \n- The castle’s central courtyard is partially filled with green blocks, and a small blue structure is visible near the center.  \n- The camera pans around the structure, revealing a distant mountain range and scattered trees in the background.", "history_tokens": 972, "history_utf8_bytes": 4133, "recent_frame_times_s": [515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0], "recent_frames_sha256": "c0f12b1c15af6b91008657dfca5864a8d8ba7ea2c97c14168cb0e09a0d0d5f20", "num_recent_frames": 30, "tq": 716568.281778735, "t1": 716575.902052358, "ta": 716575.902052358, "te": 716576.27635105, "first_response_s": 7.620273623033427, "answer_total_s": 7.99457231501583, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 187, "content_group": "25d214aafb696bbead55924aace98e3c81858226f41b9477c19e745b3a8a4008", "question": {"question_id": "sample_187_a2107_q0", "video_id": 187, "video_path": "./videos/sample_187_real.mp4", "annotation_index": 2107, "question_index": 0, "question": "What is the theme of the video as revealed in the text at the beginning?", "options": ["A. Building a treehouse.", "B. Exploring a natural park.", "C. Constructing a haunted mansion.", "D. Farming in a game environment."], "answer": "C", "time_stamp_s": 20, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_187_a2107_q0", "video_id": 187, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7f3b55347b5e1748ca0aa42243c66717711fbadaf8180fededbcb2ef3b4c3073", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "e430479f0a52e593646edd972124f1a734eefed0bf58eb46452cdee84d2ebd39", "num_recent_frames": 21, "tq": 719748.19504056, "t1": 719748.499622354, "ta": 719748.499622354, "te": 719748.537422159, "first_response_s": 0.3045817940728739, "answer_total_s": 0.34238159900996834, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_187_a2107_q0", "video_id": 187, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e739bb3d34d994c75bc7beb6674a5335e8ee99fe68d55dc85b5bad84d0101bec", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "e430479f0a52e593646edd972124f1a734eefed0bf58eb46452cdee84d2ebd39", "num_recent_frames": 21, "tq": 719627.558563003, "t1": 719633.776295806, "ta": 719633.776295806, "te": 719634.076603349, "first_response_s": 6.217732803081162, "answer_total_s": 6.518040345981717, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 187, "content_group": "25d214aafb696bbead55924aace98e3c81858226f41b9477c19e745b3a8a4008", "question": {"question_id": "sample_187_a2108_q1", "video_id": 187, "video_path": "./videos/sample_187_real.mp4", "annotation_index": 2108, "question_index": 1, "question": "What did this person do in the video just now?", "options": ["A. He start flying.", "B. He catch on fire.", "C. He climb a tree.", "D. He swim in a river."], "answer": "B", "time_stamp_s": 179, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "minecraft", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_187_a2108_q1", "video_id": 187, "time_stamp_s": 179, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "06d3b74272515559eba138e69ef7a2130f2f675b359aed452bba9a5cdde7e597", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0], "recent_frames_sha256": "50ab6a63d13492a8ec2ef93d331e2272b2cdfbbcfabea455ac9dd577cb08c923", "num_recent_frames": 30, "tq": 719748.546799297, "t1": 719752.323857076, "ta": 719752.323857076, "te": 719752.356527344, "first_response_s": 3.777057779021561, "answer_total_s": 3.8097280469955876, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_187_a2108_q1", "video_id": 187, "time_stamp_s": 179, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bd553c73cf61d45fd4b9903ff1987d70ec678e41a8069229efb0076cdc0a44e4", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A Minecraft player with purple hair and a purple outfit stands on a wooden dock near water, holding a pickaxe and looking at a build.  \n- The player opens the inventory, revealing tools like a Netherite Pickaxe and a Shulker Box, with various blocks such as stone, spruce logs, and oak logs.  \n- The player is near a wooden structure with a window, and the environment includes trees, water, and distant hills.\n[30-60s] - Player opens inventory, showing a Shulker Box with stone bricks and cobblestone, then exits to an outdoor wooden dock area.\n- Player approaches a wooden structure with a purple Shulker entity inside, which is later seen breaking apart into white blocks.\n- Player enters the structure, revealing a wooden interior with cobwebs and torches, then moves toward a stone wall with a torch mounted on it.\n[60-90s] - Player holds a red sword, standing on a wooden platform near a lava pool.  \n- A wooden structure with blue pillars and orange lava flows is visible in the background.  \n- Player moves forward on the platform, approaching a spider web and a wooden door.\n[90-120s] - Player holds a Spider Eye and moves through a dimly lit underground tunnel with torches.\n- Player opens the \"ChunkBase\" menu, displaying a map of a multiplayer server with multiple player slots.\n- Player descends into a dark underwater environment, surrounded by bubbles, then surfaces onto a wooden dock at night.\n[120-150s] - Player in purple armor stands in a forest, holding a golden pickaxe, with a comment box overlayed on screen.\n- Player moves through a forest biome, transitioning from a dark, enclosed tunnel to an open, sunlit forest area.\n- Player’s inventory shows various tools and items, including a red sword, as they navigate the terrain.", "history_tokens": 405, "history_utf8_bytes": 1763, "recent_frame_times_s": [150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0], "recent_frames_sha256": "50ab6a63d13492a8ec2ef93d331e2272b2cdfbbcfabea455ac9dd577cb08c923", "num_recent_frames": 30, "tq": 719675.486631827, "t1": 719682.533197729, "ta": 719682.533197729, "te": 719682.774054086, "first_response_s": 7.046565902070142, "answer_total_s": 7.287422258988954, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 187, "content_group": "25d214aafb696bbead55924aace98e3c81858226f41b9477c19e745b3a8a4008", "question": {"question_id": "sample_187_a2108_q0", "video_id": 187, "video_path": "./videos/sample_187_real.mp4", "annotation_index": 2108, "question_index": 0, "question": "What is the video primarily depicting right now?", "options": ["A. A peaceful forest.", "B. A construction site.", "C. A desert landscape.", "D. A forest fire."], "answer": "D", "time_stamp_s": 195, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "minecraft", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_187_a2108_q0", "video_id": 187, "time_stamp_s": 195, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "52695babffcdcb06a0503827bf2f072adc8969b83e7a2da72c81c7ceb42331fe", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0], "recent_frames_sha256": "ef47d01b50c621b90db9e50fb375d6b22acb8afae3ae85728924b5c20eba6633", "num_recent_frames": 30, "tq": 719752.362051427, "t1": 719756.536832642, "ta": 719756.536832642, "te": 719756.574434031, "first_response_s": 4.174781215027906, "answer_total_s": 4.212382604018785, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_187_a2108_q0", "video_id": 187, "time_stamp_s": 195, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "49259ddc45e61ce197c25b608221e5fc84718ebfcb635264daef9a713354f77a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A Minecraft player with purple hair and a purple outfit stands on a wooden dock near water, holding a pickaxe and looking at a build.  \n- The player opens the inventory, revealing tools like a Netherite Pickaxe and a Shulker Box, with various blocks such as stone, spruce logs, and oak logs.  \n- The player is near a wooden structure with a window, and the environment includes trees, water, and distant hills.\n[30-60s] - Player opens inventory, showing a Shulker Box with stone bricks and cobblestone, then exits to an outdoor wooden dock area.\n- Player approaches a wooden structure with a purple Shulker entity inside, which is later seen breaking apart into white blocks.\n- Player enters the structure, revealing a wooden interior with cobwebs and torches, then moves toward a stone wall with a torch mounted on it.\n[60-90s] - Player holds a red sword, standing on a wooden platform near a lava pool.  \n- A wooden structure with blue pillars and orange lava flows is visible in the background.  \n- Player moves forward on the platform, approaching a spider web and a wooden door.\n[90-120s] - Player holds a Spider Eye and moves through a dimly lit underground tunnel with torches.\n- Player opens the \"ChunkBase\" menu, displaying a map of a multiplayer server with multiple player slots.\n- Player descends into a dark underwater environment, surrounded by bubbles, then surfaces onto a wooden dock at night.\n[120-150s] - Player in purple armor stands in a forest, holding a golden pickaxe, with a comment box overlayed on screen.\n- Player moves through a forest biome, transitioning from a dark, enclosed tunnel to an open, sunlit forest area.\n- Player’s inventory shows various tools and items, including a red sword, as they navigate the terrain.\n[150-180s] - Purple character stands near a wooden chest in a forested area, holding a sword.\n- The character moves through dense trees, then approaches a large orange-brown terrain.\n- The character appears to be walking or running, with health and inventory visible at the bottom of the screen.", "history_tokens": 472, "history_utf8_bytes": 2059, "recent_frame_times_s": [166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0], "recent_frames_sha256": "ef47d01b50c621b90db9e50fb375d6b22acb8afae3ae85728924b5c20eba6633", "num_recent_frames": 30, "tq": 719689.403612021, "t1": 719689.991702901, "ta": 719689.991702901, "te": 719690.029187283, "first_response_s": 0.5880908799590543, "answer_total_s": 0.6255752620054409, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 187, "content_group": "25d214aafb696bbead55924aace98e3c81858226f41b9477c19e745b3a8a4008", "question": {"question_id": "sample_187_a2109_q0", "video_id": 187, "video_path": "./videos/sample_187_real.mp4", "annotation_index": 2109, "question_index": 0, "question": "What type of armor is the character wearing?", "options": ["A. Golden armor.", "B. Iron armor.", "C. Purple armor.", "D. Leather armor."], "answer": "C", "time_stamp_s": 497, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_187_a2109_q0", "video_id": 187, "time_stamp_s": 497, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f48edd9d3a1cbfa9823e43ca15569b8669bf100ba64524dac759e9f42312fd3c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0], "recent_frames_sha256": "1d2b8d40db938ab820cf6e4257e74afa3a5bfed6688e1b9d90efc34c26aa35fb", "num_recent_frames": 30, "tq": 719756.581221395, "t1": 719760.132140075, "ta": 719760.132140075, "te": 719760.169553527, "first_response_s": 3.550918679917231, "answer_total_s": 3.588332131970674, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_187_a2109_q0", "video_id": 187, "time_stamp_s": 497, "ground_truth": "C", "raw_output": "C. Purple armor.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "69e05d8f0e078b86361e832aeb971ac93f1a38f6c6f1d25d2aba8c74d976d205", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Player holds a red sword, standing on a wooden platform near a lava pool.  \n- A wooden structure with blue pillars and orange lava flows is visible in the background.  \n- Player moves forward on the platform, approaching a spider web and a wooden door.\n[90-120s] - Player holds a Spider Eye and moves through a dimly lit underground tunnel with torches.\n- Player opens the \"ChunkBase\" menu, displaying a map of a multiplayer server with multiple player slots.\n- Player descends into a dark underwater environment, surrounded by bubbles, then surfaces onto a wooden dock at night.\n[120-150s] - Player in purple armor stands in a forest, holding a golden pickaxe, with a comment box overlayed on screen.\n- Player moves through a forest biome, transitioning from a dark, enclosed tunnel to an open, sunlit forest area.\n- Player’s inventory shows various tools and items, including a red sword, as they navigate the terrain.\n[150-180s] - Purple character stands near a wooden chest in a forested area, holding a sword.\n- The character moves through dense trees, then approaches a large orange-brown terrain.\n- The character appears to be walking or running, with health and inventory visible at the bottom of the screen.\n[180-210s] - Fire spreads across the forest floor, consuming trees and ground cover in a wide area.  \n- A player character is visible near the center, moving through the burning terrain.  \n- The camera pans to show the extent of the fire, revealing multiple burning patches and scattered torches.\n[210-240s] - Player holds a stone block, placing it on dirt ground near trees.  \n- A fire burns in the distance, with embers floating upward.  \n- Player’s inventory shows various tools and items, including a stone block and a torch.\n[240-270s] - Player places stone blocks to form a rectangular foundation in a forest clearing.  \n- A second rectangular foundation is added adjacent to the first, creating a larger layout.  \n- The player’s inventory is visible, showing tools and items, including a pickaxe and a sword.\n[270-300s] - Player character holds a purple tool, standing on a stone platform near a wooden door.  \n- A small wooden door is embedded in a stone wall, with a visible \"S\" symbol on its surface.  \n- The player moves toward a stone structure with wooden pillars, suggesting an entrance or passage.\n[300-330s] - Player holds a purple sword, standing near stone pillars and wooden doors in a constructed area.  \n- The player moves around the structure, showing its layout with stone pathways and surrounding trees.  \n- A text overlay reads \"I have a plan\" and \"Built this all in\" as the player inspects the construction.\n[330-360s] - A partially constructed stone and wood structure with a central archway is visible, surrounded by trees and dirt ground.  \n- Bats appear in the sky above the structure, flying around it.  \n- The player’s hand holding a wooden pickaxe is visible in the lower right corner.\n[360-390s] - A player character in purple armor stands inside a partially built stone and wood structure, facing a large open archway.  \n- The structure features wooden beams and stone walls, with a roof partially constructed, and is surrounded by trees and grass.  \n- The environment transitions from daytime to sunset, casting warm light across the scene.\n[390-420s] - A purple Minecraft character stands on a dirt path in front of a partially built wooden and stone house.  \n- The house features exposed wooden beams, stone walls, and a roof under construction, with a visible window and door.  \n- The character is positioned centrally, facing the house, with trees and grass visible in the background.\n[420-450s] - Player character stands in front of a large, detailed house with wooden beams and stone walls, surrounded by trees.  \n- The house features a prominent central archway and multiple windows, with a visible roof structure.  \n- Player's health and hunger bars are displayed at the bottom of the screen, indicating active gameplay.\n[450-480s] - Player character in purple armor stands near a wooden house, holding a red sword, with text overlay indicating \"I want to build\" and \"black knight\" at 457s.\n- The player's inventory shows a \"Pleasure Pocket\" item at 478s, while the house remains visible in the background.\n- The environment features dense trees surrounding the house, with the player's position shifting slightly as the camera pans around the structure.", "history_tokens": 1017, "history_utf8_bytes": 4434, "recent_frame_times_s": [468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0], "recent_frames_sha256": "1d2b8d40db938ab820cf6e4257e74afa3a5bfed6688e1b9d90efc34c26aa35fb", "num_recent_frames": 30, "tq": 719743.324838168, "t1": 719743.842989713, "ta": 719743.842989713, "te": 719744.028703894, "first_response_s": 0.5181515449658036, "answer_total_s": 0.7038657260127366, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 187, "content_group": "25d214aafb696bbead55924aace98e3c81858226f41b9477c19e745b3a8a4008", "question": {"question_id": "sample_187_a2109_q1", "video_id": 187, "video_path": "./videos/sample_187_real.mp4", "annotation_index": 2109, "question_index": 1, "question": "What happens as a result of the TNT explosion?", "options": ["A. The roof collapses.", "B. The pine trees catch fire.", "C. The character is thrown off the roof.", "D. The dark block wall is blown apart."], "answer": "D", "time_stamp_s": 505, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "minecraft", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_187_a2109_q1", "video_id": 187, "time_stamp_s": 505, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d2b4196ec6992a4f8dc4bbce22e0a0e4e17433fbd87fbc08f0d9265098ad5b8f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0], "recent_frames_sha256": "64fcf46a2f2dc2bed1b39a76cbe8de584bfb1270707eeb4894574313301eb404", "num_recent_frames": 30, "tq": 719760.176097685, "t1": 719763.508159151, "ta": 719763.508159151, "te": 719763.547676584, "first_response_s": 3.332061465946026, "answer_total_s": 3.371578898979351, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_187_a2109_q1", "video_id": 187, "time_stamp_s": 505, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3f57aad24bf3e329b86c65d8631b209b100099ca9792f76cdf4fb42c1f271be3", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Player holds a red sword, standing on a wooden platform near a lava pool.  \n- A wooden structure with blue pillars and orange lava flows is visible in the background.  \n- Player moves forward on the platform, approaching a spider web and a wooden door.\n[90-120s] - Player holds a Spider Eye and moves through a dimly lit underground tunnel with torches.\n- Player opens the \"ChunkBase\" menu, displaying a map of a multiplayer server with multiple player slots.\n- Player descends into a dark underwater environment, surrounded by bubbles, then surfaces onto a wooden dock at night.\n[120-150s] - Player in purple armor stands in a forest, holding a golden pickaxe, with a comment box overlayed on screen.\n- Player moves through a forest biome, transitioning from a dark, enclosed tunnel to an open, sunlit forest area.\n- Player’s inventory shows various tools and items, including a red sword, as they navigate the terrain.\n[150-180s] - Purple character stands near a wooden chest in a forested area, holding a sword.\n- The character moves through dense trees, then approaches a large orange-brown terrain.\n- The character appears to be walking or running, with health and inventory visible at the bottom of the screen.\n[180-210s] - Fire spreads across the forest floor, consuming trees and ground cover in a wide area.  \n- A player character is visible near the center, moving through the burning terrain.  \n- The camera pans to show the extent of the fire, revealing multiple burning patches and scattered torches.\n[210-240s] - Player holds a stone block, placing it on dirt ground near trees.  \n- A fire burns in the distance, with embers floating upward.  \n- Player’s inventory shows various tools and items, including a stone block and a torch.\n[240-270s] - Player places stone blocks to form a rectangular foundation in a forest clearing.  \n- A second rectangular foundation is added adjacent to the first, creating a larger layout.  \n- The player’s inventory is visible, showing tools and items, including a pickaxe and a sword.\n[270-300s] - Player character holds a purple tool, standing on a stone platform near a wooden door.  \n- A small wooden door is embedded in a stone wall, with a visible \"S\" symbol on its surface.  \n- The player moves toward a stone structure with wooden pillars, suggesting an entrance or passage.\n[300-330s] - Player holds a purple sword, standing near stone pillars and wooden doors in a constructed area.  \n- The player moves around the structure, showing its layout with stone pathways and surrounding trees.  \n- A text overlay reads \"I have a plan\" and \"Built this all in\" as the player inspects the construction.\n[330-360s] - A partially constructed stone and wood structure with a central archway is visible, surrounded by trees and dirt ground.  \n- Bats appear in the sky above the structure, flying around it.  \n- The player’s hand holding a wooden pickaxe is visible in the lower right corner.\n[360-390s] - A player character in purple armor stands inside a partially built stone and wood structure, facing a large open archway.  \n- The structure features wooden beams and stone walls, with a roof partially constructed, and is surrounded by trees and grass.  \n- The environment transitions from daytime to sunset, casting warm light across the scene.\n[390-420s] - A purple Minecraft character stands on a dirt path in front of a partially built wooden and stone house.  \n- The house features exposed wooden beams, stone walls, and a roof under construction, with a visible window and door.  \n- The character is positioned centrally, facing the house, with trees and grass visible in the background.\n[420-450s] - Player character stands in front of a large, detailed house with wooden beams and stone walls, surrounded by trees.  \n- The house features a prominent central archway and multiple windows, with a visible roof structure.  \n- Player's health and hunger bars are displayed at the bottom of the screen, indicating active gameplay.\n[450-480s] - Player character in purple armor stands near a wooden house, holding a red sword, with text overlay indicating \"I want to build\" and \"black knight\" at 457s.\n- The player's inventory shows a \"Pleasure Pocket\" item at 478s, while the house remains visible in the background.\n- The environment features dense trees surrounding the house, with the player's position shifting slightly as the camera pans around the structure.", "history_tokens": 1017, "history_utf8_bytes": 4434, "recent_frame_times_s": [476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0], "recent_frames_sha256": "64fcf46a2f2dc2bed1b39a76cbe8de584bfb1270707eeb4894574313301eb404", "num_recent_frames": 30, "tq": 719744.045615585, "t1": 719748.153729705, "ta": 719748.153729705, "te": 719748.18657802, "first_response_s": 4.108114119968377, "answer_total_s": 4.1409624349325895, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 188, "content_group": "09bad0fa9276f9fd27d39175bb854915c689ff2ab8f8a705dc1cdbae4fa7d834", "question": {"question_id": "sample_188_a1789_q0", "video_id": 188, "video_path": "./videos/sample_188_real.mp4", "annotation_index": 1789, "question_index": 0, "question": "What is the figure in the video wearing?", "options": ["A. A red cloak.", "B. Blue jeans.", "C. Purple pixelated armor.", "D. A green suit."], "answer": "C", "time_stamp_s": 4, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_188_a1789_q0", "video_id": 188, "time_stamp_s": 4, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "88dc972ba7415b8289e0592eaf88c17aafd29cd19aa8401237ba6ff59378f0c9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003], "recent_frames_sha256": "d822e2a43cd8d8f3bd2fc84cd436ab062525247fe6ce59972e2d1a8a8b9d19df", "num_recent_frames": 4, "tq": 719790.988753909, "t1": 719791.229128524, "ta": 719791.229128524, "te": 719791.266277393, "first_response_s": 0.24037461495026946, "answer_total_s": 0.27752348396461457, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_188_a1789_q0", "video_id": 188, "time_stamp_s": 4, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e6501718007e7f3fbbc9354d104e002f3c4864be2cbf1cbb716ce358173860a7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003], "recent_frames_sha256": "d822e2a43cd8d8f3bd2fc84cd436ab062525247fe6ce59972e2d1a8a8b9d19df", "num_recent_frames": 4, "tq": 719590.781097965, "t1": 719597.571674799, "ta": 719597.571674799, "te": 719597.922607878, "first_response_s": 6.790576833998784, "answer_total_s": 7.141509913024493, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 188, "content_group": "09bad0fa9276f9fd27d39175bb854915c689ff2ab8f8a705dc1cdbae4fa7d834", "question": {"question_id": "sample_188_a1790_q1", "video_id": 188, "video_path": "./videos/sample_188_real.mp4", "annotation_index": 1790, "question_index": 1, "question": "Why does the player character's health start depleting?", "options": ["A. Lack of food.", "B. Attack by Endermen.", "C. Fall from a height.", "D. Poison effect."], "answer": "B", "time_stamp_s": 522, "task_type": "Causal Reasoning", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_188_a1790_q1", "video_id": 188, "time_stamp_s": 522, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "63655e1e57eaa6b913d99e21df62235cfeb7c15d07f1fe65eec918d83bff1013", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336, 498.01418333333334, 499.0151833333333, 500.01618333333334, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0008166666667, 519.0018166666666, 520.0028166666667, 521.0038166666667], "recent_frames_sha256": "548a088962b07f45007acdb96a2c0cbcf0d8e8519a5b0d183663889acfe99057", "num_recent_frames": 30, "tq": 719791.274597607, "t1": 719791.604879744, "ta": 719791.604879744, "te": 719791.643623401, "first_response_s": 0.3302821370307356, "answer_total_s": 0.3690257939742878, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_188_a1790_q1", "video_id": 188, "time_stamp_s": 522, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "552146b2acd7d55931de6ab29ed4282593994251e3f5f04c191533060c9627b6", "condition_order": ["notes", "recent"], "memory": "[120-150s] - Brewing Stand displays \"Faction of Slow Falling\" potion after combining ingredients.\n- Player opens inventory, revealing \"Eye of Ender\" and \"Potion of Slowness\" in the hotbar.\n- Player moves to an outdoor area with a bed, bird, and sign reading \"BIRD BIRD\" near a wooden fence.\n[150-180s] - A purple Minecraft character with glowing eyes walks forward, then jumps onto a stone block.  \n- The character’s sword is visibly absent from its inventory, indicating it’s banned.  \n- The environment features stone pathways, wooden structures, and hanging lanterns.\n[180-210s] - A large, pixelated black skull statue stands beside a tall, cross-shaped monument in a cemetery setting.  \n- The camera pans to reveal a mountainous landscape with a village, trees, and a flying creature (possibly a dragon) above.  \n- A red, pixelated structure (possibly a tower or building) is shown from a low-angle view, with a checkered pattern on its base.\n[210-240s] - Player navigates a narrow, redstone-lined tunnel with torches, carrying a purple item (likely a potion or enchanted item) and a wooden boat.\n- Player approaches a dark, stone-covered area with a purple portal (Nether portal) visible, suggesting a transition to another dimension.\n- Player's inventory shows various tools and items, including a pickaxe, and the health bar indicates low health, implying danger or recent combat.\n[240-270s] - Player enters a purple-lit underground chamber with a chest and a diamond sword nearby.  \n- A green checkmark appears briefly, indicating a successful action or checkpoint.  \n- Player exits the chamber into a stone corridor lit by torches, with a redstone circuit setup visible ahead.\n[270-300s] - A purple Enderman appears in the center of a stone room, surrounded by green and orange blocks, with a black void beneath it.  \n- The player’s inventory is visible at the bottom of the screen, showing various tools and items.  \n- The scene transitions to a black screen with white text reading \"Thanks Friend\" before loading a new map.\n[300-330s] - Player character is suspended in mid-air, facing a large purple dragon with a health bar above.\n- Player is holding a sword and has a \"Noob\" item in inventory, positioned near a narrow stone path.\n- A text overlay appears, reading \"IT'S JUST A PRANK BRO\" with a face image, suggesting a humorous interruption.\n[330-360s] - Player holds a purple arrow, aiming upward toward a distant, tall structure.  \n- The structure is dark, blocky, and appears to be made of obsidian or similar material, with a glowing top.  \n- The environment is dimly lit, with the player’s inventory and health bar visible at the bottom of the screen.\n[360-390s] - Player holds a purple sword, facing a towering black structure labeled \"Order Dragon\" in the sky.\n- End Crystals count displayed as 2/10, then 3/10, then 4/10, indicating progression toward the dragon.\n- Player moves across a flat, sandy terrain with tall, dark towers in the background, suggesting an End dimension setting.\n[390-420s] - Player holds a purple sword, facing an End Dragon in a dark, sandy biome with tall obsidian pillars.\n- End Crystals count increases from 5 to 8 as the dragon flies and attacks, with purple particles indicating damage.\n- Dragon’s health bar shows “Order Dragon” and decreases as the player attacks, suggesting combat progression.\n[420-450s] - Player holds purple sword, facing a large, dark, pixelated dragon in a dimly lit environment.\n- Dragon is positioned above the player, with its wings spread and body partially visible against the dark sky.\n- Player’s health and inventory are visible at the bottom of the screen, indicating combat readiness.\n[450-480s] - Player holds purple sword, facing dark sky with tall structures.\n- Order Dragon appears, flying low with wings spread, then descends toward ground.\n- Player switches to pickaxe, then sword, while dragon attacks with fireballs.\n[480-510s] - A red, pixelated creature (Order Dragon) floats in a dark void, with a purple sword visible in the foreground.\n- The creature's health bar is displayed at the top of the screen, indicating it is an enemy.\n- A text overlay appears, asking \"Is The Enderdragon?\" as the scene transitions to images of pterodactyls.", "history_tokens": 1021, "history_utf8_bytes": 4254, "recent_frame_times_s": [492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336, 498.01418333333334, 499.0151833333333, 500.01618333333334, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0008166666667, 519.0018166666666, 520.0028166666667, 521.0038166666667], "recent_frames_sha256": "548a088962b07f45007acdb96a2c0cbcf0d8e8519a5b0d183663889acfe99057", "num_recent_frames": 30, "tq": 719721.578650735, "t1": 719722.365076392, "ta": 719722.365076392, "te": 719722.514665924, "first_response_s": 0.7864256569882855, "answer_total_s": 0.9360151890432462, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 188, "content_group": "09bad0fa9276f9fd27d39175bb854915c689ff2ab8f8a705dc1cdbae4fa7d834", "question": {"question_id": "sample_188_a1790_q0", "video_id": 188, "video_path": "./videos/sample_188_real.mp4", "annotation_index": 1790, "question_index": 0, "question": "What is the item being held by the player character right now?", "options": ["A. Ender Pearl.", "B. Baked Potato.", "C. Golden Apple.", "D. Diamond Sword."], "answer": "B", "time_stamp_s": 527, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_188_a1790_q0", "video_id": 188, "time_stamp_s": 527, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9a4f2d16059900c978bb1c34225171b5e3edbe1043e1bdced4d6ae22077a740d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [497.01318333333336, 498.01418333333334, 499.0151833333333, 500.01618333333334, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0008166666667, 519.0018166666666, 520.0028166666667, 521.0038166666667, 522.0048166666667, 523.0058166666666, 524.0068166666666, 525.0078166666667, 526.0088166666667], "recent_frames_sha256": "3cfae22e7e8720515a7ab54dfcebde8de31f4c155af56423609552048ecd42d8", "num_recent_frames": 30, "tq": 719791.652615725, "t1": 719791.807183272, "ta": 719791.807183272, "te": 719791.840945679, "first_response_s": 0.15456754702609032, "answer_total_s": 0.18832995404955, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_188_a1790_q0", "video_id": 188, "time_stamp_s": 527, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4ebf16f7fa300b7bc3f3067a8d58bf312729f9baca9a16391645097f7dc0c0b6", "condition_order": ["notes", "recent"], "memory": "[120-150s] - Brewing Stand displays \"Faction of Slow Falling\" potion after combining ingredients.\n- Player opens inventory, revealing \"Eye of Ender\" and \"Potion of Slowness\" in the hotbar.\n- Player moves to an outdoor area with a bed, bird, and sign reading \"BIRD BIRD\" near a wooden fence.\n[150-180s] - A purple Minecraft character with glowing eyes walks forward, then jumps onto a stone block.  \n- The character’s sword is visibly absent from its inventory, indicating it’s banned.  \n- The environment features stone pathways, wooden structures, and hanging lanterns.\n[180-210s] - A large, pixelated black skull statue stands beside a tall, cross-shaped monument in a cemetery setting.  \n- The camera pans to reveal a mountainous landscape with a village, trees, and a flying creature (possibly a dragon) above.  \n- A red, pixelated structure (possibly a tower or building) is shown from a low-angle view, with a checkered pattern on its base.\n[210-240s] - Player navigates a narrow, redstone-lined tunnel with torches, carrying a purple item (likely a potion or enchanted item) and a wooden boat.\n- Player approaches a dark, stone-covered area with a purple portal (Nether portal) visible, suggesting a transition to another dimension.\n- Player's inventory shows various tools and items, including a pickaxe, and the health bar indicates low health, implying danger or recent combat.\n[240-270s] - Player enters a purple-lit underground chamber with a chest and a diamond sword nearby.  \n- A green checkmark appears briefly, indicating a successful action or checkpoint.  \n- Player exits the chamber into a stone corridor lit by torches, with a redstone circuit setup visible ahead.\n[270-300s] - A purple Enderman appears in the center of a stone room, surrounded by green and orange blocks, with a black void beneath it.  \n- The player’s inventory is visible at the bottom of the screen, showing various tools and items.  \n- The scene transitions to a black screen with white text reading \"Thanks Friend\" before loading a new map.\n[300-330s] - Player character is suspended in mid-air, facing a large purple dragon with a health bar above.\n- Player is holding a sword and has a \"Noob\" item in inventory, positioned near a narrow stone path.\n- A text overlay appears, reading \"IT'S JUST A PRANK BRO\" with a face image, suggesting a humorous interruption.\n[330-360s] - Player holds a purple arrow, aiming upward toward a distant, tall structure.  \n- The structure is dark, blocky, and appears to be made of obsidian or similar material, with a glowing top.  \n- The environment is dimly lit, with the player’s inventory and health bar visible at the bottom of the screen.\n[360-390s] - Player holds a purple sword, facing a towering black structure labeled \"Order Dragon\" in the sky.\n- End Crystals count displayed as 2/10, then 3/10, then 4/10, indicating progression toward the dragon.\n- Player moves across a flat, sandy terrain with tall, dark towers in the background, suggesting an End dimension setting.\n[390-420s] - Player holds a purple sword, facing an End Dragon in a dark, sandy biome with tall obsidian pillars.\n- End Crystals count increases from 5 to 8 as the dragon flies and attacks, with purple particles indicating damage.\n- Dragon’s health bar shows “Order Dragon” and decreases as the player attacks, suggesting combat progression.\n[420-450s] - Player holds purple sword, facing a large, dark, pixelated dragon in a dimly lit environment.\n- Dragon is positioned above the player, with its wings spread and body partially visible against the dark sky.\n- Player’s health and inventory are visible at the bottom of the screen, indicating combat readiness.\n[450-480s] - Player holds purple sword, facing dark sky with tall structures.\n- Order Dragon appears, flying low with wings spread, then descends toward ground.\n- Player switches to pickaxe, then sword, while dragon attacks with fireballs.\n[480-510s] - A red, pixelated creature (Order Dragon) floats in a dark void, with a purple sword visible in the foreground.\n- The creature's health bar is displayed at the top of the screen, indicating it is an enemy.\n- A text overlay appears, asking \"Is The Enderdragon?\" as the scene transitions to images of pterodactyls.", "history_tokens": 1021, "history_utf8_bytes": 4254, "recent_frame_times_s": [497.01318333333336, 498.01418333333334, 499.0151833333333, 500.01618333333334, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0008166666667, 519.0018166666666, 520.0028166666667, 521.0038166666667, 522.0048166666667, 523.0058166666666, 524.0068166666666, 525.0078166666667, 526.0088166666667], "recent_frames_sha256": "3cfae22e7e8720515a7ab54dfcebde8de31f4c155af56423609552048ecd42d8", "num_recent_frames": 30, "tq": 719722.531365026, "t1": 719726.74768758, "ta": 719726.74768758, "te": 719726.784819562, "first_response_s": 4.2163225539261475, "answer_total_s": 4.253454535966739, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 188, "content_group": "09bad0fa9276f9fd27d39175bb854915c689ff2ab8f8a705dc1cdbae4fa7d834", "question": {"question_id": "sample_188_a1791_q0", "video_id": 188, "video_path": "./videos/sample_188_real.mp4", "annotation_index": 1791, "question_index": 0, "question": "What can be seen to the left-hand side of the stairway?", "options": ["A. A potted plant.", "B. A blue-roofed tower.", "C. A hay bale.", "D. A red flower."], "answer": "D", "time_stamp_s": 791, "task_type": "Spatial Understanding", "required_ability": "episodic memory", "video_category": "minecraft", "reference_interval_s": [780, 840], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_188_a1791_q0", "video_id": 188, "time_stamp_s": 791, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e55f22da585d7d3b216a48df133ca6140c7f052e1194b36153d511a8825793f6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [761.01025, 762.01125, 763.01225, 764.01325, 765.01425, 766.01525, 767.01625, 768.0005666666667, 769.0015666666667, 770.0025666666667, 771.0035666666666, 772.0045666666666, 773.0055666666667, 774.0065666666667, 775.0075666666667, 776.0085666666666, 777.0095666666666, 778.0105666666667, 779.0115666666667, 780.0125666666667, 781.0135666666666, 782.0145666666666, 783.0155666666667, 784.0165666666667, 785.0008833333334, 786.0018833333334, 787.0028833333333, 788.0038833333333, 789.0048833333333, 790.0058833333334], "recent_frames_sha256": "8de2f61e8b7eab899305968272010af1f1dfd382e5e9c4217ff5697ccaaf3b32", "num_recent_frames": 30, "tq": 719791.848359385, "t1": 719792.013683291, "ta": 719792.013683291, "te": 719792.05022773, "first_response_s": 0.16532390599604696, "answer_total_s": 0.2018683449132368, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_188_a1791_q0", "video_id": 188, "time_stamp_s": 791, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "87675974f6bcaf7f85350d775dacc70aab95b5dc8678dabd8c72496de88d6706", "condition_order": ["notes", "recent"], "memory": "[420-450s] - Player holds purple sword, facing a large, dark, pixelated dragon in a dimly lit environment.\n- Dragon is positioned above the player, with its wings spread and body partially visible against the dark sky.\n- Player’s health and inventory are visible at the bottom of the screen, indicating combat readiness.\n[450-480s] - Player holds purple sword, facing dark sky with tall structures.\n- Order Dragon appears, flying low with wings spread, then descends toward ground.\n- Player switches to pickaxe, then sword, while dragon attacks with fireballs.\n[480-510s] - A red, pixelated creature (Order Dragon) floats in a dark void, with a purple sword visible in the foreground.\n- The creature's health bar is displayed at the top of the screen, indicating it is an enemy.\n- A text overlay appears, asking \"Is The Enderdragon?\" as the scene transitions to images of pterodactyls.\n[510-540s] - Player holds a purple sword, facing a large \"Order Dragon\" boss with a health bar above it.\n- Multiple black, stick-figure-like mobs (likely Endermen) appear in the dark, sandy environment, some moving toward the player.\n- A red, humanoid mob (possibly a Blaze or similar) is visible near the player, surrounded by purple particles, indicating an attack or interaction.\n[540-570s] - Player holds a purple sword, facing a large, dark, multi-limbed creature (Order Dragon) in a dimly lit cavern.\n- The dragon's health bar is visible at the top of the screen, indicating it is still alive.\n- The player moves toward the dragon, which is surrounded by floating blue particles and emits purple energy.\n[570-600s] - Player holds a purple sword, facing a distant \"Order Dragon\" with a health bar above it.\n- The player moves toward a dark, towering structure, then looks upward as the dragon's health bar diminishes.\n- A text overlay appears: \"Wash The Dragon\" and \"Base Revamps!!\", indicating a gameplay objective or update.\n[600-630s] - Player holds a purple sword, facing a distant \"Ender Dragon\" with a health bar above it.  \n- The dragon is not visible in the frame, but its presence is indicated by the health bar and the player's aiming direction.  \n- The player's view shifts upward, revealing a small, glowing, cross-shaped object in the sky, possibly a projectile or entity.\n[630-660s] - Player holds a purple sword, facing a distant \"Order Dragon\" with a health bar above it.  \n- The dragon is surrounded by dark, blocky structures and emits glowing purple particles.  \n- The player moves forward, approaching the dragon as it hovers above the ground, with its health bar visibly decreasing.\n[660-690s] - A pixelated dragon with white and black features and purple wings is shown in a dark environment, emitting purple light rays as it transforms or explodes.\n- The scene transitions to a Minecraft-like world with sand, stone blocks, and glowing green orbs floating in the air.\n- A player character, holding a sword, is visible in the lower right corner, standing near a stone block with a dark, possibly hostile, entity nearby.\n[690-720s] - A tall, dark, blocky structure with glowing orange torches on its sides stands in a sandy area at night.\n- A black, pixelated entity with purple eyes and a glowing mouth appears, holding a purple dragon head item.\n- A small, dark, blocky creature with glowing eyes is seen near the ground, surrounded by sand and stone blocks.\n[720-750s] - Player holds a purple sword, standing on sandy terrain near a dark cave entrance.  \n- Player approaches a small, glowing orange torch embedded in stone blocks.  \n- Screen transitions to Minecraft Java Edition title screen with text overlay: \"I see the player you mean.\"\n[750-780s] - A purple Enderman stands in a stone-walled room, facing the camera, with glowing purple eyes and mouth.\n- The player's inventory shows a purple enchanted sword and a red block, suggesting preparation for combat or building.\n- The scene transitions to a purple-hued environment with blocky structures, indicating a shift to a different location or game mode.", "history_tokens": 951, "history_utf8_bytes": 4028, "recent_frame_times_s": [761.01025, 762.01125, 763.01225, 764.01325, 765.01425, 766.01525, 767.01625, 768.0005666666667, 769.0015666666667, 770.0025666666667, 771.0035666666666, 772.0045666666666, 773.0055666666667, 774.0065666666667, 775.0075666666667, 776.0085666666666, 777.0095666666666, 778.0105666666667, 779.0115666666667, 780.0125666666667, 781.0135666666666, 782.0145666666666, 783.0155666666667, 784.0165666666667, 785.0008833333334, 786.0018833333334, 787.0028833333333, 788.0038833333333, 789.0048833333333, 790.0058833333334], "recent_frames_sha256": "8de2f61e8b7eab899305968272010af1f1dfd382e5e9c4217ff5697ccaaf3b32", "num_recent_frames": 30, "tq": 719763.179707509, "t1": 719767.541947305, "ta": 719767.541947305, "te": 719767.575317146, "first_response_s": 4.362239795969799, "answer_total_s": 4.395609637023881, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 188, "content_group": "09bad0fa9276f9fd27d39175bb854915c689ff2ab8f8a705dc1cdbae4fa7d834", "question": {"question_id": "sample_188_a1792_q0", "video_id": 188, "video_path": "./videos/sample_188_real.mp4", "annotation_index": 1792, "question_index": 0, "question": "What action is being performed by the character in purple and black armor right now?", "options": ["A. Running.", "B. Attacking an enemy.", "C. Holding an item and prompting a \"Subscribe\" button.", "D. Building a structure."], "answer": "C", "time_stamp_s": 1006, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [960, 1020], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_188_a1792_q0", "video_id": 188, "time_stamp_s": 1006, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8a850e5e3f14415d6d49653964d71d9aadd4c05076d25b338fa338aeacf2afd5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [976.0083666666667, 977.0093666666667, 978.0103666666666, 979.0113666666666, 980.0123666666667, 981.0133666666667, 982.0143666666667, 983.0153666666666, 984.0163666666666, 985.0006833333333, 986.0016833333333, 987.0026833333334, 988.0036833333334, 989.0046833333333, 990.0056833333333, 991.0066833333333, 992.0076833333334, 993.0086833333334, 994.0096833333333, 995.0106833333333, 996.0116833333333, 997.0126833333334, 998.0136833333333, 999.0146833333333, 1000.0156833333333, 1001.0, 1002.001, 1003.002, 1004.003, 1005.004], "recent_frames_sha256": "4cc6f88ec08eadbfc2e5f99f0b6e3fcca6cfd5328117600e2ca9dda4e9e8042b", "num_recent_frames": 30, "tq": 719792.058091529, "t1": 719792.228024401, "ta": 719792.228024401, "te": 719792.262316501, "first_response_s": 0.16993287205696106, "answer_total_s": 0.2042249720543623, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_188_a1792_q0", "video_id": 188, "time_stamp_s": 1006, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8557545086af64337660940f8868b4ba9934c95ca42406b10bb85cbbd327fdab", "condition_order": ["notes", "recent"], "memory": "[600-630s] - Player holds a purple sword, facing a distant \"Ender Dragon\" with a health bar above it.  \n- The dragon is not visible in the frame, but its presence is indicated by the health bar and the player's aiming direction.  \n- The player's view shifts upward, revealing a small, glowing, cross-shaped object in the sky, possibly a projectile or entity.\n[630-660s] - Player holds a purple sword, facing a distant \"Order Dragon\" with a health bar above it.  \n- The dragon is surrounded by dark, blocky structures and emits glowing purple particles.  \n- The player moves forward, approaching the dragon as it hovers above the ground, with its health bar visibly decreasing.\n[660-690s] - A pixelated dragon with white and black features and purple wings is shown in a dark environment, emitting purple light rays as it transforms or explodes.\n- The scene transitions to a Minecraft-like world with sand, stone blocks, and glowing green orbs floating in the air.\n- A player character, holding a sword, is visible in the lower right corner, standing near a stone block with a dark, possibly hostile, entity nearby.\n[690-720s] - A tall, dark, blocky structure with glowing orange torches on its sides stands in a sandy area at night.\n- A black, pixelated entity with purple eyes and a glowing mouth appears, holding a purple dragon head item.\n- A small, dark, blocky creature with glowing eyes is seen near the ground, surrounded by sand and stone blocks.\n[720-750s] - Player holds a purple sword, standing on sandy terrain near a dark cave entrance.  \n- Player approaches a small, glowing orange torch embedded in stone blocks.  \n- Screen transitions to Minecraft Java Edition title screen with text overlay: \"I see the player you mean.\"\n[750-780s] - A purple Enderman stands in a stone-walled room, facing the camera, with glowing purple eyes and mouth.\n- The player's inventory shows a purple enchanted sword and a red block, suggesting preparation for combat or building.\n- The scene transitions to a purple-hued environment with blocky structures, indicating a shift to a different location or game mode.\n[780-810s] - Player holds a purple pickaxe, mining stone blocks near water.  \n- Rain falls, with visible water droplets and flowing streams.  \n- Player moves across a wooden platform, then transitions to grassy terrain with bees flying nearby.\n[810-840s] - Player holds a purple enchanted sword, standing near a newly placed dark stone staircase leading upward.  \n- A chest is visible on the ground, positioned near the base of the staircase, with a red mushroom nearby.  \n- The player’s inventory shows “Deepslate Tile Stairs” selected, indicating preparation to place more stairs.\n[840-870s] - Player stands on a grassy platform near a river, facing a stone structure with a water feature.\n- A purple-hued entity (possibly a mob or player) appears on the grassy area, positioned near the water.\n- The player’s inventory shows a sword and other tools, indicating readiness for interaction or combat.\n[870-900s] - Player holds a pickaxe and mines a block near a river, then moves to a stone staircase leading to a village.  \n- The player approaches a village with wooden structures, torches, and a cobblestone path, with a castle-like building visible in the distance.  \n- The player looks down from a high vantage point, revealing a body of water and a distant island with a tower.\n[900-930s] - A small yellow flower is visible on the grass near a wooden sign.  \n- The player is standing on a stone platform next to a body of water.  \n- A tall, light-colored stone structure rises from the water, surrounded by trees and hills.\n[930-960s] - A mummy-like figure stands on a circular platform with a black orb atop its head, surrounded by grass and stone structures.  \n- A player in purple armor with a green hat and black beard stands on wooden steps, holding a purple sword.  \n- The camera pans to show a first-person view of the player walking through a village with wooden fences, stone paths, and distant buildings.\n[960-990s] - Player approaches a large wooden wall with multiple storage chests, some containing redstone components and other items.  \n- A \"Lore Chest\" inventory interface appears, displaying various items like books, tools, and enchanted gear.  \n- The player is inside a stone and wood structure with hanging lanterns, near a water feature and a crafting table.", "history_tokens": 1020, "history_utf8_bytes": 4400, "recent_frame_times_s": [976.0083666666667, 977.0093666666667, 978.0103666666666, 979.0113666666666, 980.0123666666667, 981.0133666666667, 982.0143666666667, 983.0153666666666, 984.0163666666666, 985.0006833333333, 986.0016833333333, 987.0026833333334, 988.0036833333334, 989.0046833333333, 990.0056833333333, 991.0066833333333, 992.0076833333334, 993.0086833333334, 994.0096833333333, 995.0106833333333, 996.0116833333333, 997.0126833333334, 998.0136833333333, 999.0146833333333, 1000.0156833333333, 1001.0, 1002.001, 1003.002, 1004.003, 1005.004], "recent_frames_sha256": "4cc6f88ec08eadbfc2e5f99f0b6e3fcca6cfd5328117600e2ca9dda4e9e8042b", "num_recent_frames": 30, "tq": 719790.517162852, "t1": 719790.943975856, "ta": 719790.943975856, "te": 719790.978780819, "first_response_s": 0.42681300395634025, "answer_total_s": 0.4616179669974372, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 189, "content_group": "4487cf803ae5d040835b617b73f2b32375455d4f1d06ff04e906b6c56a641aea", "question": {"question_id": "sample_189_a832_q0", "video_id": 189, "video_path": "./videos/sample_189_real.mp4", "annotation_index": 832, "question_index": 0, "question": "What color is the character's outfit standing on the path?", "options": ["A. Blue and white.", "B. Yellow and pink.", "C. Red and green.", "D. Black and yellow."], "answer": "B", "time_stamp_s": 17, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_189_a832_q0", "video_id": 189, "time_stamp_s": 17, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f2eba6bffec02d1d5c3619ef7c3b23c6df4122739a2aa96af8cebd6e45590ac4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016], "recent_frames_sha256": "ab4cb5fce33608c3b59992564e87ae51f5ca9e4d89b213699e0aa53534a752fd", "num_recent_frames": 17, "tq": 710187.864166171, "t1": 710194.019113721, "ta": 710194.019113721, "te": 710194.056734203, "first_response_s": 6.154947549919598, "answer_total_s": 6.192568031954579, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_189_a832_q0", "video_id": 189, "time_stamp_s": 17, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "118b787b447edb73e1deaff113e5d2398a6e09c45725a14a8e0b17350d79b406", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016], "recent_frames_sha256": "ab4cb5fce33608c3b59992564e87ae51f5ca9e4d89b213699e0aa53534a752fd", "num_recent_frames": 17, "tq": 710220.075831835, "t1": 710227.782350978, "ta": 710227.782350978, "te": 710227.828134234, "first_response_s": 7.706519142957404, "answer_total_s": 7.752302398905158, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 189, "content_group": "4487cf803ae5d040835b617b73f2b32375455d4f1d06ff04e906b6c56a641aea", "question": {"question_id": "sample_189_a833_q0", "video_id": 189, "video_path": "./videos/sample_189_real.mp4", "annotation_index": 833, "question_index": 0, "question": "What objects are seen on the grassy area below the stone structure?", "options": ["A. A white and red bed and a crafting table.", "B. A brown chair and a red table.", "C. A yellow bed and a crafting table.", "D. A green chair and a red table."], "answer": "A", "time_stamp_s": 300, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_189_a833_q0", "video_id": 189, "time_stamp_s": 300, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c0f3698418a4f7a42cd458d26ab5d2966afde5a01c344662760978e73c1110a8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.00038333333333, 285.0013833333333, 286.00238333333334, 287.0033833333333, 288.00438333333335, 289.0053833333333, 290.00638333333336, 291.00738333333334, 292.0083833333333, 293.00938333333335, 294.0103833333333, 295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333], "recent_frames_sha256": "766b3b31eb48f34d95ff81f6a2df240d1af552832b284369e7ab513722cea1d0", "num_recent_frames": 30, "tq": 710194.078825092, "t1": 710201.343784034, "ta": 710201.343784034, "te": 710201.379930188, "first_response_s": 7.264958942076191, "answer_total_s": 7.301105096004903, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_189_a833_q0", "video_id": 189, "time_stamp_s": 300, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0dd3fd9a4326f9cb865c664604379ade580b45472a3fbda9d8aa0303d4833151", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Minecraft player stands on a dirt path surrounded by crops and torches, facing a large wooden structure with trees nearby.  \n- A floating overlay displays a Reddit post about \"MATTLES\" and \"KISS MATTLES\" with images of a large creature, suggesting a mod or game update.  \n- The player’s inventory shows tools and items, including a pickaxe and a sword, indicating readiness for exploration or combat.\n[30-60s] - A Minecraft player's inventory is visible at the bottom of the screen, showing tools and items.  \n- The player is walking across a grassy hillside with trees and a distant mountain in the background.  \n- A small wooden structure is visible on the hillside, near the player's path.\n[60-90s] - Player opens a chest containing stacks of cobblestone and a single iron ingot.  \n- Player is standing on a grassy slope near a river, with trees and stone structures in the background.  \n- The player’s inventory shows a sword, a pickaxe, and a few other tools, indicating preparation for exploration or combat.\n[90-120s] - Player walks along a wooden bridge over a grassy, flower-dotted terrain with a torchlit path ahead.  \n- A golden egg appears on the ground near a tree, indicating a potential collectible item.  \n- Player approaches a stone pathway leading uphill, surrounded by greenery and small yellow flowers.\n[120-150s] - Player walks along a stone path bordered by grass and yellow flowers, moving uphill toward a distant structure.  \n- The path curves slightly, revealing more flowers and a tree to the right as the player progresses.  \n- Player’s inventory and health bar remain visible at the bottom of the screen, indicating active gameplay.\n[150-180s] - Player moves through grassy terrain with yellow flowers, then approaches a dirt slope.  \n- Player digs into the dirt, revealing a tree trunk and roots beneath.  \n- Player transitions to a flat, stone-covered area near water, with text overlay \"IN EPISODE ONE...\".\n[180-210s] - Player uses a pickaxe to mine dirt blocks along a sloped terrain near a river.  \n- Yellow and white flowers are visible on the grassy upper slope, adjacent to the mining area.  \n- The player’s health and inventory are displayed at the bottom of the screen, indicating active gameplay.\n[210-240s] - Player approaches a stone wall with green moss blocks and breaks through it to reveal a cave entrance.  \n- Player switches to a pickaxe and begins mining stone blocks within the cave.  \n- Player’s inventory shows various tools and items, including a crafting table and a diamond pickaxe.\n[240-270s] - Player constructs stone wall along grassy terrain with scattered flowers and trees nearby.  \n- Stone wall extends upward, forming a stepped structure resembling a pyramid.  \n- A real-world image of a pyramid (Tikal) is overlaid on the screen, suggesting a building comparison.\n[270-300s] - Player’s view shifts upward, revealing a steep, rocky cliff face with sparse vegetation and a distant wooden structure.  \n- A small red object (possibly a chest or block) is visible on the grassy slope near the cliff’s base.  \n- The player’s inventory bar remains visible at the bottom, showing tools and items, with health and hunger indicators.", "history_tokens": 738, "history_utf8_bytes": 3212, "recent_frame_times_s": [270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.00038333333333, 285.0013833333333, 286.00238333333334, 287.0033833333333, 288.00438333333335, 289.0053833333333, 290.00638333333336, 291.00738333333334, 292.0083833333333, 293.00938333333335, 294.0103833333333, 295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333], "recent_frames_sha256": "766b3b31eb48f34d95ff81f6a2df240d1af552832b284369e7ab513722cea1d0", "num_recent_frames": 30, "tq": 710303.075458426, "t1": 710315.369030264, "ta": 710315.369030264, "te": 710315.559540493, "first_response_s": 12.29357183794491, "answer_total_s": 12.484082066919655, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 189, "content_group": "4487cf803ae5d040835b617b73f2b32375455d4f1d06ff04e906b6c56a641aea", "question": {"question_id": "sample_189_a834_q1", "video_id": 189, "video_path": "./videos/sample_189_real.mp4", "annotation_index": 834, "question_index": 1, "question": "What action is the player performing in the video right now?", "options": ["A. Planting seeds.", "B. Pruning the vines on the tree.", "C. Climbing the tree.", "D. Collecting bamboo stalks."], "answer": "B", "time_stamp_s": 577, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_189_a834_q1", "video_id": 189, "time_stamp_s": 577, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5db911cd8f15d25857d1dd6b238938d8508b38b598d38a54a8f10d5c4dea1223", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.00045, 552.00145, 553.00245, 554.00345, 555.00445, 556.00545, 557.00645, 558.00745, 559.00845, 560.00945, 561.01045, 562.01145, 563.01245, 564.01345, 565.01445, 566.01545, 567.01645, 568.0007666666667, 569.0017666666666, 570.0027666666666, 571.0037666666667, 572.0047666666667, 573.0057666666667, 574.0067666666666, 575.0077666666666, 576.0087666666667], "recent_frames_sha256": "141620856f7c1cf4604e290e704eca87f7c4bbdbf78f2feed3faa13b3f7b1814", "num_recent_frames": 30, "tq": 710201.407028096, "t1": 710207.467369414, "ta": 710207.467369414, "te": 710207.505265254, "first_response_s": 6.060341318021528, "answer_total_s": 6.098237157915719, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_189_a834_q1", "video_id": 189, "time_stamp_s": 577, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c0b6400a9c5963d7b0596951f61ce817465b5f11617824e36aad1fc6536c189e", "condition_order": ["recent", "notes"], "memory": "[180-210s] - Player uses a pickaxe to mine dirt blocks along a sloped terrain near a river.  \n- Yellow and white flowers are visible on the grassy upper slope, adjacent to the mining area.  \n- The player’s health and inventory are displayed at the bottom of the screen, indicating active gameplay.\n[210-240s] - Player approaches a stone wall with green moss blocks and breaks through it to reveal a cave entrance.  \n- Player switches to a pickaxe and begins mining stone blocks within the cave.  \n- Player’s inventory shows various tools and items, including a crafting table and a diamond pickaxe.\n[240-270s] - Player constructs stone wall along grassy terrain with scattered flowers and trees nearby.  \n- Stone wall extends upward, forming a stepped structure resembling a pyramid.  \n- A real-world image of a pyramid (Tikal) is overlaid on the screen, suggesting a building comparison.\n[270-300s] - Player’s view shifts upward, revealing a steep, rocky cliff face with sparse vegetation and a distant wooden structure.  \n- A small red object (possibly a chest or block) is visible on the grassy slope near the cliff’s base.  \n- The player’s inventory bar remains visible at the bottom, showing tools and items, with health and hunger indicators.\n[300-330s] - Player approaches a stone wall with a small gap, revealing a grassy area beyond.  \n- A white sheep stands near the wall’s edge, facing the player.  \n- Player’s inventory shows a crafting table and various items, including a sword and a bucket.\n[330-360s] - Player views a stone wall with a wooden door, then moves to inspect a nearby stone structure with a redstone torch.  \n- The player looks up at a snow-covered mountain range with a distant tree and a small orange creature (likely a fox) on the grass.  \n- The player’s inventory shows a sword, a pickaxe, and a few food items, indicating readiness for exploration or combat.\n[360-390s] - Player opens inventory, showing diamond armor and tools, with crafting table visible for diamond helmet/boots.\n- Player moves to a stone structure, then enters a wooden door into a room with bookshelves and torches.\n- Player interacts with crafting table, selecting diamond helmet and boots, with \"Diamond Helmet\" and \"Diamond Boots\" recipes displayed.\n[390-420s] - Player opens enchantment screen with \"Efficiency IV\" selected, showing \"Looting III\" as the current enchantment level.  \n- Inventory displays a Diamond Pickaxe with \"Efficiency III\" and \"Looting III\" enchantments, alongside other tools and items.  \n- Enchantment GUI shows \"Looting III\" as the active enchantment, with \"Efficiency IV\" highlighted as the next available level.\n[420-450s] - Enchantment screen displays \"Diamond Chestplate\" with Protection IV and \"Diamond Leggings\" with Protection III.  \n- Player selects \"Diamond Helmet\" showing Protection III and \"Diamond Chestplate\" with Protection IV.  \n- Inventory grid shows various enchanted items, including \"Diamond Boots\" with Protection III.\n[450-480s] - Player views a large stone statue atop a hill, surrounded by grass and trees, under a clear sky with clouds.\n- Player walks up a wooden staircase toward the statue, carrying a torch and a sword.\n- Player approaches a wooden door at the base of the hill, with inventory and enchantment menus visible on screen.\n[480-510s] - Player approaches a tall stone tower structure on a grassy hillside, holding a sword.  \n- A wooden bridge or path leads upward toward the tower, with a player character visible ahead.  \n- The environment features trees, grass, and a body of water in the distance under a partly cloudy sky.\n[510-540s] - Player moves from a wooden platform overlooking a river and forested hills, then approaches a stone structure with a red glowing block inside.\n- Player enters a dark cave with stone walls and a wooden door, then proceeds into a dimly lit interior with a red glowing block visible.\n- Player’s inventory shows a sword and various items, with a health bar and experience level indicator visible at the bottom of the screen.\n[540-570s] - Player views a stone tower from ground level, surrounded by grass and trees, with a wooden fence nearby.  \n- Player looks up at a tall tree with vines, then pans to reveal a dense forest with tall green trees.  \n- Player moves toward a tree, then looks up at the sky, showing a clear blue sky with clouds.", "history_tokens": 1013, "history_utf8_bytes": 4369, "recent_frame_times_s": [547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.00045, 552.00145, 553.00245, 554.00345, 555.00445, 556.00545, 557.00645, 558.00745, 559.00845, 560.00945, 561.01045, 562.01145, 563.01245, 564.01345, 565.01445, 566.01545, 567.01645, 568.0007666666667, 569.0017666666666, 570.0027666666666, 571.0037666666667, 572.0047666666667, 573.0057666666667, 574.0067666666666, 575.0077666666666, 576.0087666666667], "recent_frames_sha256": "141620856f7c1cf4604e290e704eca87f7c4bbdbf78f2feed3faa13b3f7b1814", "num_recent_frames": 30, "tq": 710383.272768071, "t1": 710384.968350946, "ta": 710384.968350946, "te": 710385.330086008, "first_response_s": 1.695582874934189, "answer_total_s": 2.057317936909385, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 189, "content_group": "4487cf803ae5d040835b617b73f2b32375455d4f1d06ff04e906b6c56a641aea", "question": {"question_id": "sample_189_a834_q0", "video_id": 189, "video_path": "./videos/sample_189_real.mp4", "annotation_index": 834, "question_index": 0, "question": "What tool is the player holding in his hand right now?", "options": ["A. A shovel.", "B. A pixel-style scissors.", "C. A saw.", "D. A pickaxe."], "answer": "B", "time_stamp_s": 581, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_189_a834_q0", "video_id": 189, "time_stamp_s": 581, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "99cfbc56f8433e042c88c59d1134c3b34015f76439104baac527b799cb5430af", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [551.00045, 552.00145, 553.00245, 554.00345, 555.00445, 556.00545, 557.00645, 558.00745, 559.00845, 560.00945, 561.01045, 562.01145, 563.01245, 564.01345, 565.01445, 566.01545, 567.01645, 568.0007666666667, 569.0017666666666, 570.0027666666666, 571.0037666666667, 572.0047666666667, 573.0057666666667, 574.0067666666666, 575.0077666666666, 576.0087666666667, 577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667], "recent_frames_sha256": "60b084d6b725574e40218970bce3bb7f3e8d41055aa2f2c4185e5012fae45075", "num_recent_frames": 30, "tq": 710207.526567561, "t1": 710212.568594372, "ta": 710212.568594372, "te": 710212.606082771, "first_response_s": 5.042026811046526, "answer_total_s": 5.079515210003592, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_189_a834_q0", "video_id": 189, "time_stamp_s": 581, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "49ec600e0102f4dd404d3f2fc907bb2abe865d8cf16de15f39466e0ab58ba42a", "condition_order": ["recent", "notes"], "memory": "[180-210s] - Player uses a pickaxe to mine dirt blocks along a sloped terrain near a river.  \n- Yellow and white flowers are visible on the grassy upper slope, adjacent to the mining area.  \n- The player’s health and inventory are displayed at the bottom of the screen, indicating active gameplay.\n[210-240s] - Player approaches a stone wall with green moss blocks and breaks through it to reveal a cave entrance.  \n- Player switches to a pickaxe and begins mining stone blocks within the cave.  \n- Player’s inventory shows various tools and items, including a crafting table and a diamond pickaxe.\n[240-270s] - Player constructs stone wall along grassy terrain with scattered flowers and trees nearby.  \n- Stone wall extends upward, forming a stepped structure resembling a pyramid.  \n- A real-world image of a pyramid (Tikal) is overlaid on the screen, suggesting a building comparison.\n[270-300s] - Player’s view shifts upward, revealing a steep, rocky cliff face with sparse vegetation and a distant wooden structure.  \n- A small red object (possibly a chest or block) is visible on the grassy slope near the cliff’s base.  \n- The player’s inventory bar remains visible at the bottom, showing tools and items, with health and hunger indicators.\n[300-330s] - Player approaches a stone wall with a small gap, revealing a grassy area beyond.  \n- A white sheep stands near the wall’s edge, facing the player.  \n- Player’s inventory shows a crafting table and various items, including a sword and a bucket.\n[330-360s] - Player views a stone wall with a wooden door, then moves to inspect a nearby stone structure with a redstone torch.  \n- The player looks up at a snow-covered mountain range with a distant tree and a small orange creature (likely a fox) on the grass.  \n- The player’s inventory shows a sword, a pickaxe, and a few food items, indicating readiness for exploration or combat.\n[360-390s] - Player opens inventory, showing diamond armor and tools, with crafting table visible for diamond helmet/boots.\n- Player moves to a stone structure, then enters a wooden door into a room with bookshelves and torches.\n- Player interacts with crafting table, selecting diamond helmet and boots, with \"Diamond Helmet\" and \"Diamond Boots\" recipes displayed.\n[390-420s] - Player opens enchantment screen with \"Efficiency IV\" selected, showing \"Looting III\" as the current enchantment level.  \n- Inventory displays a Diamond Pickaxe with \"Efficiency III\" and \"Looting III\" enchantments, alongside other tools and items.  \n- Enchantment GUI shows \"Looting III\" as the active enchantment, with \"Efficiency IV\" highlighted as the next available level.\n[420-450s] - Enchantment screen displays \"Diamond Chestplate\" with Protection IV and \"Diamond Leggings\" with Protection III.  \n- Player selects \"Diamond Helmet\" showing Protection III and \"Diamond Chestplate\" with Protection IV.  \n- Inventory grid shows various enchanted items, including \"Diamond Boots\" with Protection III.\n[450-480s] - Player views a large stone statue atop a hill, surrounded by grass and trees, under a clear sky with clouds.\n- Player walks up a wooden staircase toward the statue, carrying a torch and a sword.\n- Player approaches a wooden door at the base of the hill, with inventory and enchantment menus visible on screen.\n[480-510s] - Player approaches a tall stone tower structure on a grassy hillside, holding a sword.  \n- A wooden bridge or path leads upward toward the tower, with a player character visible ahead.  \n- The environment features trees, grass, and a body of water in the distance under a partly cloudy sky.\n[510-540s] - Player moves from a wooden platform overlooking a river and forested hills, then approaches a stone structure with a red glowing block inside.\n- Player enters a dark cave with stone walls and a wooden door, then proceeds into a dimly lit interior with a red glowing block visible.\n- Player’s inventory shows a sword and various items, with a health bar and experience level indicator visible at the bottom of the screen.\n[540-570s] - Player views a stone tower from ground level, surrounded by grass and trees, with a wooden fence nearby.  \n- Player looks up at a tall tree with vines, then pans to reveal a dense forest with tall green trees.  \n- Player moves toward a tree, then looks up at the sky, showing a clear blue sky with clouds.", "history_tokens": 1013, "history_utf8_bytes": 4369, "recent_frame_times_s": [551.00045, 552.00145, 553.00245, 554.00345, 555.00445, 556.00545, 557.00645, 558.00745, 559.00845, 560.00945, 561.01045, 562.01145, 563.01245, 564.01345, 565.01445, 566.01545, 567.01645, 568.0007666666667, 569.0017666666666, 570.0027666666666, 571.0037666666667, 572.0047666666667, 573.0057666666667, 574.0067666666666, 575.0077666666666, 576.0087666666667, 577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667], "recent_frames_sha256": "60b084d6b725574e40218970bce3bb7f3e8d41055aa2f2c4185e5012fae45075", "num_recent_frames": 30, "tq": 710385.384859953, "t1": 710397.758740816, "ta": 710397.758740816, "te": 710398.021240747, "first_response_s": 12.373880863073282, "answer_total_s": 12.63638079399243, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 189, "content_group": "4487cf803ae5d040835b617b73f2b32375455d4f1d06ff04e906b6c56a641aea", "question": {"question_id": "sample_189_a835_q0", "video_id": 189, "video_path": "./videos/sample_189_real.mp4", "annotation_index": 835, "question_index": 0, "question": "What can be seen flying away when the user removes a block of dirt?", "options": ["A. Bits of stone.", "B. Bits of dirt.", "C. Grass particles.", "D. Wood fragments."], "answer": "B", "time_stamp_s": 843, "task_type": "Attribute Recognition", "required_ability": "episodic memory", "video_category": "minecraft", "reference_interval_s": [840, 900], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_189_a835_q0", "video_id": 189, "time_stamp_s": 843, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e64d970d319404697e46e17e293bc3b102306fa3f4914b711768f231bcfd11d1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [813.0122, 814.0132, 815.0142, 816.0152, 817.0162, 818.0005166666666, 819.0015166666667, 820.0025166666667, 821.0035166666667, 822.0045166666666, 823.0055166666667, 824.0065166666667, 825.0075166666667, 826.0085166666667, 827.0095166666666, 828.0105166666667, 829.0115166666667, 830.0125166666667, 831.0135166666666, 832.0145166666666, 833.0155166666667, 834.0165166666667, 835.0008333333334, 836.0018333333334, 837.0028333333333, 838.0038333333333, 839.0048333333333, 840.0058333333334, 841.0068333333334, 842.0078333333333], "recent_frames_sha256": "5d61c05b1389786526d4ace3da2e9e5be56f69089666c88d9f82697dff7a3da1", "num_recent_frames": 30, "tq": 710212.646318405, "t1": 710220.021302199, "ta": 710220.021302199, "te": 710220.058793669, "first_response_s": 7.374983793939464, "answer_total_s": 7.41247526393272, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_189_a835_q0", "video_id": 189, "time_stamp_s": 843, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "dfb3c2608a83c4ad8400418de0898910b471542a8cb134388abf2ed3c43cca75", "condition_order": ["recent", "notes"], "memory": "[450-480s] - Player views a large stone statue atop a hill, surrounded by grass and trees, under a clear sky with clouds.\n- Player walks up a wooden staircase toward the statue, carrying a torch and a sword.\n- Player approaches a wooden door at the base of the hill, with inventory and enchantment menus visible on screen.\n[480-510s] - Player approaches a tall stone tower structure on a grassy hillside, holding a sword.  \n- A wooden bridge or path leads upward toward the tower, with a player character visible ahead.  \n- The environment features trees, grass, and a body of water in the distance under a partly cloudy sky.\n[510-540s] - Player moves from a wooden platform overlooking a river and forested hills, then approaches a stone structure with a red glowing block inside.\n- Player enters a dark cave with stone walls and a wooden door, then proceeds into a dimly lit interior with a red glowing block visible.\n- Player’s inventory shows a sword and various items, with a health bar and experience level indicator visible at the bottom of the screen.\n[540-570s] - Player views a stone tower from ground level, surrounded by grass and trees, with a wooden fence nearby.  \n- Player looks up at a tall tree with vines, then pans to reveal a dense forest with tall green trees.  \n- Player moves toward a tree, then looks up at the sky, showing a clear blue sky with clouds.\n[570-600s] - Player holds a sword, climbing a tall tree with green foliage and brown trunk, surrounded by tall grass and other trees.\n- Player moves upward, then descends, passing through a gap in the tree canopy, revealing a grassy area below.\n- Player transitions to a rocky, mountainous terrain with moss-covered stone, then enters a wooden structure with a blue and white interior.\n[600-630s] - Player holds a Spider's Head in inventory while viewing a large chest with various items.\n- Player moves through a stone-walled room with wooden furniture and exits into an outdoor area with a path and trees.\n- Player approaches a crafting table with a pink pig and a red chest nearby, then exits the room.\n[630-660s] - Player approaches a stone tower atop a hill, with a wooden staircase leading up to it.  \n- A red chest is visible in the foreground, and the player’s inventory shows a pickaxe and other tools.  \n- The player’s health and hunger bars are displayed at the bottom of the screen, indicating active gameplay.\n[660-690s] - Player approaches a stone structure with mossy blocks and steps, holding a pickaxe.  \n- Inside, a crafting table and furnace are visible on grassy ground near stone walls.  \n- Player moves toward the structure’s interior, revealing a small room with basic setup.\n[690-720s] - Player moves away from a stone structure with moss and windows, revealing a grassy area with trees and distant hills.  \n- Player looks up to see a tall stone tower with a golden top, surrounded by greenery and a clear sky.  \n- Player’s inventory shows tools and items, including a chest and a torch, indicating preparation for exploration or building.\n[720-750s] - Player opens inventory, selecting stone bricks from crafting grid.  \n- Player places stone bricks on grassy terrain, forming a path or structure.  \n- Player moves forward, placing more stone bricks along a sloped, grassy hillside.\n[750-780s] - Player holds an iron pickaxe and mines wooden blocks, revealing a small underground cave entrance.  \n- The player moves upward along a wooden cliffside, passing over greenery and a small stream.  \n- A small cave opening with moss and dirt is visible ahead, suggesting further exploration.\n[780-810s] - Player approaches a stone structure with mossy blocks and blue glass windows, holding a pickaxe.  \n- The structure is built into a rocky hillside with grass and trees nearby, under a clear sky.  \n- Player’s inventory shows tools and items, including a sword and a pickaxe, with health and hunger bars visible.\n[810-840s] - Player stands near a stone wall with a redstone torch embedded in it, facing a grassy hillside.  \n- A tall, pyramid-like stone structure rises in the distance, partially covered in moss and surrounded by greenery.  \n- The player’s inventory shows a pickaxe and other tools, with health and hunger bars visible at the bottom of the screen.", "history_tokens": 990, "history_utf8_bytes": 4277, "recent_frame_times_s": [813.0122, 814.0132, 815.0142, 816.0152, 817.0162, 818.0005166666666, 819.0015166666667, 820.0025166666667, 821.0035166666667, 822.0045166666666, 823.0055166666667, 824.0065166666667, 825.0075166666667, 826.0085166666667, 827.0095166666666, 828.0105166666667, 829.0115166666667, 830.0125166666667, 831.0135166666666, 832.0145166666666, 833.0155166666667, 834.0165166666667, 835.0008333333334, 836.0018333333334, 837.0028333333333, 838.0038333333333, 839.0048333333333, 840.0058333333334, 841.0068333333334, 842.0078333333333], "recent_frames_sha256": "5d61c05b1389786526d4ace3da2e9e5be56f69089666c88d9f82697dff7a3da1", "num_recent_frames": 30, "tq": 710455.76583574, "t1": 710463.462759465, "ta": 710463.462759465, "te": 710463.741539588, "first_response_s": 7.696923724957742, "answer_total_s": 7.975703847943805, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 191, "content_group": "7197c8ab7a57d66c9273a8cfb4acfe6edf02a1b8e348aa727419b49379743406", "question": {"question_id": "sample_191_a2034_q0", "video_id": 191, "video_path": "./videos/sample_191_real.mp4", "annotation_index": 2034, "question_index": 0, "question": "What is the character wearing at the beginning of the video?", "options": ["A. A red jacket and black pants.", "B. A white sweater and black pants.", "C. A blue shirt and white pants.", "D. A green hoodie and blue jeans."], "answer": "B", "time_stamp_s": 25, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_191_a2034_q0", "video_id": 191, "time_stamp_s": 25, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f8b1e7bdba31ba0df6b314a35b4b2c579bf1207d1534400b17ade9d8b219b3d1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0], "recent_frames_sha256": "d503f5d25ed630db24f37c3cf2bc3a7e3d6a77138875b8938fd8e63984b8fffe", "num_recent_frames": 26, "tq": 716649.362598713, "t1": 716650.681614875, "ta": 716650.681614875, "te": 716650.718986415, "first_response_s": 1.3190161619568244, "answer_total_s": 1.3563877019332722, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_191_a2034_q0", "video_id": 191, "time_stamp_s": 25, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3cf5d023a10089f868036cade60d393c492d8cb5996252fa6b7604fc6e135a5b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0], "recent_frames_sha256": "d503f5d25ed630db24f37c3cf2bc3a7e3d6a77138875b8938fd8e63984b8fffe", "num_recent_frames": 26, "tq": 716463.36212297, "t1": 716475.163733318, "ta": 716475.163733318, "te": 716475.201816906, "first_response_s": 11.801610347931273, "answer_total_s": 11.839693935937248, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 191, "content_group": "7197c8ab7a57d66c9273a8cfb4acfe6edf02a1b8e348aa727419b49379743406", "question": {"question_id": "sample_191_a2035_q0", "video_id": 191, "video_path": "./videos/sample_191_real.mp4", "annotation_index": 2035, "question_index": 0, "question": "What is the player holding right now?", "options": ["A. Planks.", "B. Sticks.", "C. Crafting Table.", "D. Red Flower."], "answer": "C", "time_stamp_s": 205, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_191_a2035_q0", "video_id": 191, "time_stamp_s": 205, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "df129cd47b7e7d112b5d523a7037f7ffd5601fb5379c139219a57a093deb73dd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0], "recent_frames_sha256": "752b5a604a1d2d0976801729bd1244f2075c8e3321c42e47722e3adf1a3dbd9e", "num_recent_frames": 30, "tq": 716650.760563055, "t1": 716657.489963305, "ta": 716657.489963305, "te": 716657.527375213, "first_response_s": 6.729400249896571, "answer_total_s": 6.7668121579336, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_191_a2035_q0", "video_id": 191, "time_stamp_s": 205, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d7e466ebc56b3fae9f4d508b35a479e8bb9cae86b19c3122d238446b34bd5087", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A Minecraft character stands in a forested area with green trees and grass, facing the camera.  \n- The scene transitions to a first-person view showing a river with trees and hills in the background, indicating the player's spawn location.  \n- Text overlays appear, explaining the tutorial's purpose and the player's initial spawn environment.\n[30-60s] - Player views a river with trees and hills, then pans up to see the sun in a clear sky.\n- Text overlay indicates the player should create a new world if they can't find trees or water.\n- The sun is visible above tree-covered hills, suggesting daytime spawn location.\n[60-90s] - Player navigates a riverbank with trees and hills in the background, holding a wooden pickaxe.  \n- Text overlay lists \"3 Main Goals\" for survival, including crafting tools, gathering food, and building a base.  \n- Screen transitions to a parchment-style \"DAY 1 To-Do List\" with icons for tools, food, and base construction.\n[90-120s] - Player stands near a river, facing a tree with a log in hand, preparing to chop it.\n- A floating log appears above the player, indicating a new recipe unlocked for crafting.\n- The player looks up at the tree, which has a wooden block on its trunk, suggesting a crafting or resource gathering action.\n[120-150s] - Player views a large tree canopy from below, then pans to reveal a river and forested landscape.  \n- Player opens inventory, showing a crafting grid with a crafted item (likely a tool or block) and a single item in the hotbar.  \n- Player’s health bar is full, and the inventory screen is displayed against a backdrop of grass, trees, and water.\n[150-180s] - Player opens inventory, revealing a crafting grid with a single item (likely a tool) in the top-right slot.\n- Player selects a \"Dirt Block\" from the inventory, which is then placed into the crafting grid.\n- A notification appears indicating \"New Recipes Unlocked\" and prompts to check the recipe book.", "history_tokens": 456, "history_utf8_bytes": 1952, "recent_frame_times_s": [176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0], "recent_frames_sha256": "752b5a604a1d2d0976801729bd1244f2075c8e3321c42e47722e3adf1a3dbd9e", "num_recent_frames": 30, "tq": 716524.796900893, "t1": 716526.492888081, "ta": 716526.492888081, "te": 716526.768867365, "first_response_s": 1.6959871880244464, "answer_total_s": 1.9719664719887078, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 191, "content_group": "7197c8ab7a57d66c9273a8cfb4acfe6edf02a1b8e348aa727419b49379743406", "question": {"question_id": "sample_191_a2035_q1", "video_id": 191, "video_path": "./videos/sample_191_real.mp4", "annotation_index": 2035, "question_index": 1, "question": "What happens after the player places the crafting table on the ground?", "options": ["A. The player throws it into the river.", "B. The player crafted 4 sticks from wood at the crafting table.", "C. The player holds another item.", "D. The player exchanges it for planks."], "answer": "B", "time_stamp_s": 228, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "minecraft", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_191_a2035_q1", "video_id": 191, "time_stamp_s": 228, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "834a1b1ff7964cda7d1e70a3d266d01a46121444cbc3915e97b449f1f3df8d53", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0], "recent_frames_sha256": "e2ad8e9d0bd1338726a7a0253092c68ea30f853963a9a93753dff2d31e83dccd", "num_recent_frames": 30, "tq": 716657.56058415, "t1": 716664.873498208, "ta": 716664.873498208, "te": 716664.91250181, "first_response_s": 7.312914057984017, "answer_total_s": 7.351917659980245, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_191_a2035_q1", "video_id": 191, "time_stamp_s": 228, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9f50ddae3f1884cc3504db629f6f322aecdbf9487e28f7d96ec698972976fa4b", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A Minecraft character stands in a forested area with green trees and grass, facing the camera.  \n- The scene transitions to a first-person view showing a river with trees and hills in the background, indicating the player's spawn location.  \n- Text overlays appear, explaining the tutorial's purpose and the player's initial spawn environment.\n[30-60s] - Player views a river with trees and hills, then pans up to see the sun in a clear sky.\n- Text overlay indicates the player should create a new world if they can't find trees or water.\n- The sun is visible above tree-covered hills, suggesting daytime spawn location.\n[60-90s] - Player navigates a riverbank with trees and hills in the background, holding a wooden pickaxe.  \n- Text overlay lists \"3 Main Goals\" for survival, including crafting tools, gathering food, and building a base.  \n- Screen transitions to a parchment-style \"DAY 1 To-Do List\" with icons for tools, food, and base construction.\n[90-120s] - Player stands near a river, facing a tree with a log in hand, preparing to chop it.\n- A floating log appears above the player, indicating a new recipe unlocked for crafting.\n- The player looks up at the tree, which has a wooden block on its trunk, suggesting a crafting or resource gathering action.\n[120-150s] - Player views a large tree canopy from below, then pans to reveal a river and forested landscape.  \n- Player opens inventory, showing a crafting grid with a crafted item (likely a tool or block) and a single item in the hotbar.  \n- Player’s health bar is full, and the inventory screen is displayed against a backdrop of grass, trees, and water.\n[150-180s] - Player opens inventory, revealing a crafting grid with a single item (likely a tool) in the top-right slot.\n- Player selects a \"Dirt Block\" from the inventory, which is then placed into the crafting grid.\n- A notification appears indicating \"New Recipes Unlocked\" and prompts to check the recipe book.\n[180-210s] - Crafting table interface displayed with inventory slots and a crafting grid, showing a single item (wooden plank) in the grid.\n- Player's inventory contains various items including a sword, a bow, and a redstone torch, with a crafting table selected.\n- The player is positioned near a riverbank with trees and grass, holding a crafting table in their hand.", "history_tokens": 540, "history_utf8_bytes": 2322, "recent_frame_times_s": [199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0], "recent_frames_sha256": "e2ad8e9d0bd1338726a7a0253092c68ea30f853963a9a93753dff2d31e83dccd", "num_recent_frames": 30, "tq": 716537.708323291, "t1": 716538.612425963, "ta": 716538.612425963, "te": 716538.650154579, "first_response_s": 0.9041026720078662, "answer_total_s": 0.9418312879279256, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 191, "content_group": "7197c8ab7a57d66c9273a8cfb4acfe6edf02a1b8e348aa727419b49379743406", "question": {"question_id": "sample_191_a2036_q0", "video_id": 191, "video_path": "./videos/sample_191_real.mp4", "annotation_index": 2036, "question_index": 0, "question": "What does the player do after switching to a wooden sword?", "options": ["A. Attacks a white sheep.", "B. Chops down a tree.", "C. Digs into the dirt.", "D. Places a block of wool."], "answer": "A", "time_stamp_s": 428, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_191_a2036_q0", "video_id": 191, "time_stamp_s": 428, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "26b0a9f3e08b473f8a4f6706579194758d9861619cc2d533407de3157a904781", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0, 421.0, 422.0, 423.0, 424.0, 425.0, 426.0, 427.0, 428.0], "recent_frames_sha256": "bd240b5ac91395c5fd222ac2bffb9a3df8ee9f306ede38a8da2190bf097d6b39", "num_recent_frames": 30, "tq": 716664.933254504, "t1": 716671.373061508, "ta": 716671.373061508, "te": 716671.523736242, "first_response_s": 6.439807004062459, "answer_total_s": 6.590481737977825, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_191_a2036_q0", "video_id": 191, "time_stamp_s": 428, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c6eebf5f5ee0929afb9447f65eff25939ae8bb24964068b9e452201f644dd4c6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A Minecraft character stands in a forested area with green trees and grass, facing the camera.  \n- The scene transitions to a first-person view showing a river with trees and hills in the background, indicating the player's spawn location.  \n- Text overlays appear, explaining the tutorial's purpose and the player's initial spawn environment.\n[30-60s] - Player views a river with trees and hills, then pans up to see the sun in a clear sky.\n- Text overlay indicates the player should create a new world if they can't find trees or water.\n- The sun is visible above tree-covered hills, suggesting daytime spawn location.\n[60-90s] - Player navigates a riverbank with trees and hills in the background, holding a wooden pickaxe.  \n- Text overlay lists \"3 Main Goals\" for survival, including crafting tools, gathering food, and building a base.  \n- Screen transitions to a parchment-style \"DAY 1 To-Do List\" with icons for tools, food, and base construction.\n[90-120s] - Player stands near a river, facing a tree with a log in hand, preparing to chop it.\n- A floating log appears above the player, indicating a new recipe unlocked for crafting.\n- The player looks up at the tree, which has a wooden block on its trunk, suggesting a crafting or resource gathering action.\n[120-150s] - Player views a large tree canopy from below, then pans to reveal a river and forested landscape.  \n- Player opens inventory, showing a crafting grid with a crafted item (likely a tool or block) and a single item in the hotbar.  \n- Player’s health bar is full, and the inventory screen is displayed against a backdrop of grass, trees, and water.\n[150-180s] - Player opens inventory, revealing a crafting grid with a single item (likely a tool) in the top-right slot.\n- Player selects a \"Dirt Block\" from the inventory, which is then placed into the crafting grid.\n- A notification appears indicating \"New Recipes Unlocked\" and prompts to check the recipe book.\n[180-210s] - Crafting table interface displayed with inventory slots and a crafting grid, showing a single item (wooden plank) in the grid.\n- Player's inventory contains various items including a sword, a bow, and a redstone torch, with a crafting table selected.\n- The player is positioned near a riverbank with trees and grass, holding a crafting table in their hand.\n[210-240s] - Player selects a stick from inventory, then places it in crafting grid to create a new item.\n- Crafting grid updates to show the newly created item after stick is placed.\n- Inventory screen displays a single stick in the player's inventory, with a notification indicating new recipes are unlocked.\n[240-270s] - Player selects oak plank from inventory, then places it in crafting grid to create wooden pickaxe.  \n- Wooden pickaxe appears in inventory after crafting, ready for use.  \n- Player switches to wooden pickaxe in hand, preparing to mine nearby block.\n[270-300s] - Player crafts wooden sword from sticks and stone in crafting grid.  \n- Inventory shows 2 sticks and 1 stone in hotbar, with 1 wooden sword in inventory.  \n- Crafting table and chest are visible in the player's inventory interface.\n[300-330s] - Player holds wooden axe, facing birch tree with white bark and green leaves.  \n- Player approaches a large oak tree, then looks up at its canopy.  \n- Player places a wooden chest on the ground near the oak tree, then turns to face the birch tree.\n[330-360s] - Player holds wooden pickaxe, standing near a tree with a wooden chest nearby.  \n- Player’s health bar shows 10 hearts, and inventory includes pickaxe, shovel, sword, and chest.  \n- Fast-forward text appears over the screen, indicating time acceleration.\n[360-390s] - Player is fishing near a river with a fishing rod, surrounded by grass and flowers.\n- A white sheep is visible in the distance, standing on the grassy terrain.\n- The player’s inventory shows various items, including a fishing rod and food, with health and armor indicators visible.\n[390-420s] - A white sheep is stationary on grassy terrain, near a hillside with trees and dirt blocks.\n- A pink pig appears nearby, moving slightly as the player observes it.\n- A small white block (likely a sheep's wool) is visible on the ground, indicating recent interaction or collection.", "history_tokens": 1001, "history_utf8_bytes": 4258, "recent_frame_times_s": [399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0, 421.0, 422.0, 423.0, 424.0, 425.0, 426.0, 427.0, 428.0], "recent_frames_sha256": "bd240b5ac91395c5fd222ac2bffb9a3df8ee9f306ede38a8da2190bf097d6b39", "num_recent_frames": 30, "tq": 716603.396793601, "t1": 716610.687784095, "ta": 716610.687784095, "te": 716610.969059585, "first_response_s": 7.290990493958816, "answer_total_s": 7.5722659840248525, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 191, "content_group": "7197c8ab7a57d66c9273a8cfb4acfe6edf02a1b8e348aa727419b49379743406", "question": {"question_id": "sample_191_a2037_q0", "video_id": 191, "video_path": "./videos/sample_191_real.mp4", "annotation_index": 2037, "question_index": 0, "question": "What type of pickaxe was used to break the stone block just now?", "options": ["A. Wooden.", "B. Stone.", "C. Iron.", "D. Diamond."], "answer": "A", "time_stamp_s": 608, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "minecraft", "reference_interval_s": [600, 660], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_191_a2037_q0", "video_id": 191, "time_stamp_s": 608, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5faef99bbadadc0118f156bb9041c2cae8df9d0679763816b1fc94586fadc664", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [579.0, 580.0, 581.0, 582.0, 583.0, 584.0, 585.0, 586.0, 587.0, 588.0, 589.0, 590.0, 591.0, 592.0, 593.0, 594.0, 595.0, 596.0, 597.0, 598.0, 599.0, 600.0, 601.0, 602.0, 603.0, 604.0, 605.0, 606.0, 607.0, 608.0], "recent_frames_sha256": "b0b144a145d0bd411964ac48f48c54b7ea487f0d30f584246e1c1105a9a79654", "num_recent_frames": 30, "tq": 716671.548647096, "t1": 716676.690231861, "ta": 716676.690231861, "te": 716676.727547175, "first_response_s": 5.141584764933214, "answer_total_s": 5.178900078986771, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_191_a2037_q0", "video_id": 191, "time_stamp_s": 608, "ground_truth": "A", "raw_output": "A. Wooden.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "69ca32abb6dcebf42fcd526db9f82981ce9e1b73a43f07dc01d4e899aa1c6507", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Player opens inventory, revealing a crafting grid with a single item (likely a tool) in the top-right slot.\n- Player selects a \"Dirt Block\" from the inventory, which is then placed into the crafting grid.\n- A notification appears indicating \"New Recipes Unlocked\" and prompts to check the recipe book.\n[180-210s] - Crafting table interface displayed with inventory slots and a crafting grid, showing a single item (wooden plank) in the grid.\n- Player's inventory contains various items including a sword, a bow, and a redstone torch, with a crafting table selected.\n- The player is positioned near a riverbank with trees and grass, holding a crafting table in their hand.\n[210-240s] - Player selects a stick from inventory, then places it in crafting grid to create a new item.\n- Crafting grid updates to show the newly created item after stick is placed.\n- Inventory screen displays a single stick in the player's inventory, with a notification indicating new recipes are unlocked.\n[240-270s] - Player selects oak plank from inventory, then places it in crafting grid to create wooden pickaxe.  \n- Wooden pickaxe appears in inventory after crafting, ready for use.  \n- Player switches to wooden pickaxe in hand, preparing to mine nearby block.\n[270-300s] - Player crafts wooden sword from sticks and stone in crafting grid.  \n- Inventory shows 2 sticks and 1 stone in hotbar, with 1 wooden sword in inventory.  \n- Crafting table and chest are visible in the player's inventory interface.\n[300-330s] - Player holds wooden axe, facing birch tree with white bark and green leaves.  \n- Player approaches a large oak tree, then looks up at its canopy.  \n- Player places a wooden chest on the ground near the oak tree, then turns to face the birch tree.\n[330-360s] - Player holds wooden pickaxe, standing near a tree with a wooden chest nearby.  \n- Player’s health bar shows 10 hearts, and inventory includes pickaxe, shovel, sword, and chest.  \n- Fast-forward text appears over the screen, indicating time acceleration.\n[360-390s] - Player is fishing near a river with a fishing rod, surrounded by grass and flowers.\n- A white sheep is visible in the distance, standing on the grassy terrain.\n- The player’s inventory shows various items, including a fishing rod and food, with health and armor indicators visible.\n[390-420s] - A white sheep is stationary on grassy terrain, near a hillside with trees and dirt blocks.\n- A pink pig appears nearby, moving slightly as the player observes it.\n- A small white block (likely a sheep's wool) is visible on the ground, indicating recent interaction or collection.\n[420-450s] - A white sheep is seen running across a grassy field, moving away from the player.  \n- The player holds a white block, likely a sheep wool block, and looks toward a distant hillside.  \n- A pink pig appears in the field, standing near a body of water, while the sheep continues to move.\n[450-480s] - Player holds a pickaxe and breaks a stone block, revealing a cave entrance.  \n- The player moves into a cave with stone walls and a dirt ceiling, then exits to a grassy area.  \n- A \"New Recipes Unlocked\" notification appears above the player's head.\n[480-510s] - Player breaks stone with pickaxe, triggering a \"Stone Axe\" recipe unlock notification.\n- A pig appears outside the cave entrance, moving toward the player.\n- Player turns to face a wooden chest inside the cave, which is positioned near a small water pool.\n[510-540s] - Player opens inventory, selecting oak planks from the crafting grid.  \n- Crafting grid shows oak planks being placed into the output slot.  \n- Player exits inventory, revealing a sunset view from a stone structure.\n[540-570s] - Player opens inventory, revealing tools and items, then selects a torch from the crafting grid.\n- Player equips torch and walks toward a stone structure, illuminating the area as dusk sets in.\n- Player places wooden planks on the stone structure, extending the structure outward.\n[570-600s] - A sheep with black wool and pink face is standing near a stone wall, facing the player.  \n- The player is holding a wooden plank and is near a torch-lit stone wall with a wooden structure.  \n- A \"New Recipes Unlocked\" notification appears above the player's head, indicating a game update.", "history_tokens": 1022, "history_utf8_bytes": 4274, "recent_frame_times_s": [579.0, 580.0, 581.0, 582.0, 583.0, 584.0, 585.0, 586.0, 587.0, 588.0, 589.0, 590.0, 591.0, 592.0, 593.0, 594.0, 595.0, 596.0, 597.0, 598.0, 599.0, 600.0, 601.0, 602.0, 603.0, 604.0, 605.0, 606.0, 607.0, 608.0], "recent_frames_sha256": "b0b144a145d0bd411964ac48f48c54b7ea487f0d30f584246e1c1105a9a79654", "num_recent_frames": 30, "tq": 716648.401543815, "t1": 716649.193790664, "ta": 716649.193790664, "te": 716649.342148431, "first_response_s": 0.7922468489268795, "answer_total_s": 0.9406046159565449, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 192, "content_group": "cf0b14d2edb9f7aa20421c8e4ee81fb5b33bce3223dc0c29abffc02c86d0abb0", "question": {"question_id": "sample_192_a1977_q0", "video_id": 192, "video_path": "./videos/sample_192_real.mp4", "annotation_index": 1977, "question_index": 0, "question": "What is the speaker planning to build?", "options": ["A. A boring setup.", "B. A new house.", "C. An enchanting setup.", "D. A dangerous place."], "answer": "C", "time_stamp_s": 14, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_192_a1977_q0", "video_id": 192, "time_stamp_s": 14, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5e0d1d2f76d6d15e2860660ee26aa1b58709e38ade5179bd7173ad27733d2c61", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0], "recent_frames_sha256": "6929d1bc7348d7f5dda9424150492799b20d71c72d481891e8615928dd12e1a4", "num_recent_frames": 15, "tq": 710550.850408267, "t1": 710551.630842852, "ta": 710551.630842852, "te": 710551.66759958, "first_response_s": 0.780434585059993, "answer_total_s": 0.817191313020885, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_192_a1977_q0", "video_id": 192, "time_stamp_s": 14, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f15caf7b1c1f583be290a33ac8192fe7cfaf8c92fd29c2b73dc5ae02c7d8e956", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0], "recent_frames_sha256": "6929d1bc7348d7f5dda9424150492799b20d71c72d481891e8615928dd12e1a4", "num_recent_frames": 15, "tq": 710594.06075057, "t1": 710601.489333855, "ta": 710601.489333855, "te": 710601.65017011, "first_response_s": 7.428583284956403, "answer_total_s": 7.589419540017843, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 192, "content_group": "cf0b14d2edb9f7aa20421c8e4ee81fb5b33bce3223dc0c29abffc02c86d0abb0", "question": {"question_id": "sample_192_a1978_q0", "video_id": 192, "video_path": "./videos/sample_192_real.mp4", "annotation_index": 1978, "question_index": 0, "question": "What is the character holding in their right hand right now?", "options": ["A. A bow.", "B. A purple-hued sword.", "C. A water bucket.", "D. A diamond pickaxe."], "answer": "B", "time_stamp_s": 264, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_192_a1978_q0", "video_id": 192, "time_stamp_s": 264, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "898884dfc755c1a44d8bfb23bd78922b39536b2bd6ae48b52a842e7c6ee84e72", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0], "recent_frames_sha256": "11258ac0ba4613ed14b4bd21de851bfbc541e62b8f5773899d1178cf8c7818cc", "num_recent_frames": 30, "tq": 710551.698560956, "t1": 710563.238274778, "ta": 710563.238274778, "te": 710563.276732807, "first_response_s": 11.539713821955957, "answer_total_s": 11.578171850997023, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_192_a1978_q0", "video_id": 192, "time_stamp_s": 264, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6e58ee65a9b64926952d714e0bad430872c4003ce4de4ce2145c2f32d906b3f5", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A Minecraft player character stands on a wooden dock near water, holding a sword and wearing armor, with inventory visible at the bottom of the screen.\n- The player swims through a wide river, moving toward distant landmasses with trees and hills visible on the horizon.\n- The player's health and hunger bars are displayed at the bottom center, indicating active gameplay with minimal UI clutter.\n[30-60s] - Player is on a boat navigating a wide river with grassy banks and trees visible in the distance.\n- Player approaches a grassy shore with a small stream and a chicken appears near the bank.\n- Player is holding a wooden boat and has a full inventory with various tools and items.\n[60-90s] - Player is in a boat on water, moving toward a distant shoreline with trees and hills visible.  \n- A yellow boat with a player inside appears ahead, moving in the same direction.  \n- The player’s health bar is visible at the bottom, showing full health.\n[90-120s] - Player approaches a submerged wooden structure near water's edge, with a \"New Recipes Unlocked\" notification visible.\n- Player enters a submerged wooden structure, revealing a chest with items like diamonds and a \"Buried Treasure Map\" inside.\n- Player holds a diamond pickaxe and stands inside the structure, with a \"That's the big question\" text overlay.\n[120-150s] - Player opens chest, revealing items like potatoes and seeds, then exits to water.\n- Player swims underwater, approaches a submerged chest, and retrieves a bucket.\n- Player surfaces, walks to land, and opens crafting menu to view new recipe book.\n[150-180s] - Player holds a flower, which is then shown in a close-up with a red health bar, indicating it's being used or consumed.\n- A cow is visible in a grassy area near trees, standing still and facing the player.\n- The player moves toward a body of water, then transitions to a black-and-white view showing a water bucket being used to interact with a water source.\n[180-210s] - Player moves through a stone-walled room with a wooden ladder leading to a water pool.  \n- Player approaches a purple glowing portal embedded in stone walls.  \n- Player enters a narrow, dimly lit tunnel with lava pools on the floor, then exits into a stone chamber with torches and a chest.\n[210-240s] - Player views inventory with \"Search\" and \"Crafting\" interfaces, holding a diamond sword and diamond pickaxe.\n- Player moves through a dimly lit stone tunnel with torches, approaching a chest and a crafting table.\n- Player enters a lava-filled area, then navigates to a water-filled chamber with a chest and a crafting table.", "history_tokens": 597, "history_utf8_bytes": 2602, "recent_frame_times_s": [235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0], "recent_frames_sha256": "11258ac0ba4613ed14b4bd21de851bfbc541e62b8f5773899d1178cf8c7818cc", "num_recent_frames": 30, "tq": 710659.416631558, "t1": 710667.356426825, "ta": 710667.356426825, "te": 710667.63792948, "first_response_s": 7.939795267069712, "answer_total_s": 8.22129792207852, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 192, "content_group": "cf0b14d2edb9f7aa20421c8e4ee81fb5b33bce3223dc0c29abffc02c86d0abb0", "question": {"question_id": "sample_192_a1978_q1", "video_id": 192, "video_path": "./videos/sample_192_real.mp4", "annotation_index": 1978, "question_index": 1, "question": "What is the notable feature of the player's experience level when shown outdoors?", "options": ["A. Low-level (5).", "B. Mid-level (20).", "C. High-level (35).", "D. Maximum level (50)."], "answer": "C", "time_stamp_s": 278, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_192_a1978_q1", "video_id": 192, "time_stamp_s": 278, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "77b0ba492acef51f212127a7db29fb6f9535ad8a8340164b4e115546abf5e72b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0], "recent_frames_sha256": "5f5bb389b53dd62b447a1f657664acb838cc4436853fee87e239721d79fa7703", "num_recent_frames": 30, "tq": 710563.297957574, "t1": 710575.093356641, "ta": 710575.093356641, "te": 710575.130322098, "first_response_s": 11.795399066992104, "answer_total_s": 11.832364524016157, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_192_a1978_q1", "video_id": 192, "time_stamp_s": 278, "ground_truth": "C", "raw_output": "C. High-level (35).", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "3fd49c9b2c03449c03cfa578d413253b49ca64cfdd38063eb3d221b63641089b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A Minecraft player character stands on a wooden dock near water, holding a sword and wearing armor, with inventory visible at the bottom of the screen.\n- The player swims through a wide river, moving toward distant landmasses with trees and hills visible on the horizon.\n- The player's health and hunger bars are displayed at the bottom center, indicating active gameplay with minimal UI clutter.\n[30-60s] - Player is on a boat navigating a wide river with grassy banks and trees visible in the distance.\n- Player approaches a grassy shore with a small stream and a chicken appears near the bank.\n- Player is holding a wooden boat and has a full inventory with various tools and items.\n[60-90s] - Player is in a boat on water, moving toward a distant shoreline with trees and hills visible.  \n- A yellow boat with a player inside appears ahead, moving in the same direction.  \n- The player’s health bar is visible at the bottom, showing full health.\n[90-120s] - Player approaches a submerged wooden structure near water's edge, with a \"New Recipes Unlocked\" notification visible.\n- Player enters a submerged wooden structure, revealing a chest with items like diamonds and a \"Buried Treasure Map\" inside.\n- Player holds a diamond pickaxe and stands inside the structure, with a \"That's the big question\" text overlay.\n[120-150s] - Player opens chest, revealing items like potatoes and seeds, then exits to water.\n- Player swims underwater, approaches a submerged chest, and retrieves a bucket.\n- Player surfaces, walks to land, and opens crafting menu to view new recipe book.\n[150-180s] - Player holds a flower, which is then shown in a close-up with a red health bar, indicating it's being used or consumed.\n- A cow is visible in a grassy area near trees, standing still and facing the player.\n- The player moves toward a body of water, then transitions to a black-and-white view showing a water bucket being used to interact with a water source.\n[180-210s] - Player moves through a stone-walled room with a wooden ladder leading to a water pool.  \n- Player approaches a purple glowing portal embedded in stone walls.  \n- Player enters a narrow, dimly lit tunnel with lava pools on the floor, then exits into a stone chamber with torches and a chest.\n[210-240s] - Player views inventory with \"Search\" and \"Crafting\" interfaces, holding a diamond sword and diamond pickaxe.\n- Player moves through a dimly lit stone tunnel with torches, approaching a chest and a crafting table.\n- Player enters a lava-filled area, then navigates to a water-filled chamber with a chest and a crafting table.\n[240-270s] - Player opens inventory, revealing tools and items in a 3x3 grid layout.\n- Player switches to a pickaxe, then moves toward a wooden door in a stone-walled room.\n- A small, brown, pixelated creature (likely a pig) is visible on the floor near the door.", "history_tokens": 669, "history_utf8_bytes": 2866, "recent_frame_times_s": [249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0], "recent_frames_sha256": "5f5bb389b53dd62b447a1f657664acb838cc4436853fee87e239721d79fa7703", "num_recent_frames": 30, "tq": 710673.027011783, "t1": 710686.01249829, "ta": 710686.01249829, "te": 710686.363187837, "first_response_s": 12.985486507066526, "answer_total_s": 13.33617605397012, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 192, "content_group": "cf0b14d2edb9f7aa20421c8e4ee81fb5b33bce3223dc0c29abffc02c86d0abb0", "question": {"question_id": "sample_192_a1979_q0", "video_id": 192, "video_path": "./videos/sample_192_real.mp4", "annotation_index": 1979, "question_index": 0, "question": "What does the player character do after standing on the central pole?", "options": ["A. Jumps off the pole.", "B. Dismantles the structure.", "C. Continue to construct this red building.", "D. Walks around the structure."], "answer": "C", "time_stamp_s": 785, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [780, 840], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_192_a1979_q0", "video_id": 192, "time_stamp_s": 785, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c1d33c43c7d5868a12099b6547173aab18c0e1108c66f4c069250f6e067ae693", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [756.0, 757.0, 758.0, 759.0, 760.0, 761.0, 762.0, 763.0, 764.0, 765.0, 766.0, 767.0, 768.0, 769.0, 770.0, 771.0, 772.0, 773.0, 774.0, 775.0, 776.0, 777.0, 778.0, 779.0, 780.0, 781.0, 782.0, 783.0, 784.0, 785.0], "recent_frames_sha256": "cdbbbe0d253961a606bdc35875678e936bb91ff38b6e9b6f107acd851cb368dc", "num_recent_frames": 30, "tq": 710575.143887128, "t1": 710586.318911469, "ta": 710586.318911469, "te": 710586.504523099, "first_response_s": 11.175024340976961, "answer_total_s": 11.360635971068405, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_192_a1979_q0", "video_id": 192, "time_stamp_s": 785, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f2f08684a6ef1a98ae10fc2f0d0c17cd8283a028f93b933286e4f94dea0cb5bf", "condition_order": ["recent", "notes"], "memory": "[420-450s] - Player enters a dark cave with redstone torches and purple blocks, holding a diamond sword.\n- Player approaches a purple portal block, which emits purple particles, indicating it's an Nether portal.\n- Player looks up at the sky through the cave entrance, showing a clear blue sky with clouds.\n[450-480s] - Player enters a purple-tinged cave with glowing particles, likely a Nether portal, and moves toward a dark, enclosed space.  \n- Player exits the cave into a grassy biome with scattered trees and a distant river, indicating a transition from underground to surface.  \n- Player’s inventory shows tools and items, including a pickaxe and sword, suggesting preparation for exploration or combat.\n[480-510s] - Player's inventory shows full health and equipped tools, including a sword and pickaxe, near a riverbank with trees and hills in the distance.\n- A top-down map view reveals a rectangular structure surrounded by walls, with a small tree and two dark blocks inside the central area.\n- The scene transitions from a first-person view of the landscape to an overhead map, indicating a shift in perspective or planning phase.\n[510-540s] - Player opens chest inventory, revealing sand and other items in top slots.\n- Player navigates to a large chest inside a wooden structure, showing various tools and materials.\n- Player accesses a search interface, selecting a crafting recipe involving a \"Porkchop\" and \"Porkchop\" item.\n[540-570s] - Player opens inventory, showing red concrete and other blocks in hotbar, with crafting grid displaying a red concrete item.\n- Player looks out over a wide river with distant islands and trees, then pans to a tall tower structure on the far bank.\n- Player approaches the tower, which is built on a rocky outcrop, and stands atop it, overlooking the landscape.\n[570-600s] - Player stands on a wooden platform extending over water, holding a diamond pickaxe.  \n- A distant mountain range with sparse trees is visible, labeled \"non rendered\" and \"mountain\" in text overlays.  \n- The player’s inventory shows various tools and items, including a sword and a bow.\n[600-630s] - Player holds a diamond pickaxe and stands on a wooden platform extending over water.  \n- A tall wooden structure with a red flag is visible on a distant cliffside.  \n- The player’s health bar is full, and the inventory shows various tools and items.\n[630-660s] - A large, brown, leaf-shaped object floats in the sky, appearing to drift slowly.  \n- The player’s inventory and health bar are visible at the bottom of the screen, indicating active gameplay.  \n- The landscape below includes a river, green hills, and a wooden structure, suggesting an outdoor Minecraft environment.\n[660-690s] - A bird flies overhead against a bright sky, near a wooden structure and water body.  \n- The player’s inventory shows enchanted items, including a diamond sword with \"Efficiency IV\" and \"Sharpness V\" enchantments.  \n- The player moves toward a grassy slope with red flowers, approaching a wooden structure with bookshelves.\n[690-720s] - A bird flies across a bright sky above a wooden structure near water, with floating white blocks appearing in the air.\n- The player is on a wooden platform, holding a \"Dropped Item\" and \"Spruce Log,\" with a red structure visible in the distance.\n- The scene transitions to a red structure atop a mountain at dusk, with the player standing on it, as the sky darkens and stars appear.\n[720-750s] - A red, pixelated hot air balloon structure floats above a wooden platform, with a \"PAUSED\" indicator visible in the top-left corner.\n- The camera pans downward, revealing a body of water and a small wooden structure near a cave entrance on a grassy, blocky terrain.\n- The balloon structure appears to be stationary, with no visible movement or interaction with the environment.\n[750-780s] - A red, pixelated, multi-tiered structure (possibly a custom-built tower or monument) is centered on a grassy island, surrounded by water and trees.\n- The structure appears to be made of red blocks, with a central core and outwardly expanding tiers, and is viewed from a low angle.\n- The camera pans around the structure, revealing its full circular, concentric design, with some blocks appearing to be in motion or falling.", "history_tokens": 983, "history_utf8_bytes": 4274, "recent_frame_times_s": [756.0, 757.0, 758.0, 759.0, 760.0, 761.0, 762.0, 763.0, 764.0, 765.0, 766.0, 767.0, 768.0, 769.0, 770.0, 771.0, 772.0, 773.0, 774.0, 775.0, 776.0, 777.0, 778.0, 779.0, 780.0, 781.0, 782.0, 783.0, 784.0, 785.0], "recent_frames_sha256": "cdbbbe0d253961a606bdc35875678e936bb91ff38b6e9b6f107acd851cb368dc", "num_recent_frames": 30, "tq": 715193.821828083, "t1": 715200.451843297, "ta": 715200.451843297, "te": 715200.491420108, "first_response_s": 6.63001521397382, "answer_total_s": 6.669592024991289, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 192, "content_group": "cf0b14d2edb9f7aa20421c8e4ee81fb5b33bce3223dc0c29abffc02c86d0abb0", "question": {"question_id": "sample_192_a1979_q1", "video_id": 192, "video_path": "./videos/sample_192_real.mp4", "annotation_index": 1979, "question_index": 1, "question": "Where is the player character located right now?", "options": ["A. At the center of the circle.", "B. Near the edge of the circular formation.", "C. Outside the structure.", "D. On the terrain below."], "answer": "B", "time_stamp_s": 799, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [780, 840], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_192_a1979_q1", "video_id": 192, "time_stamp_s": 799, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d202210a50249a3576e01a2f80cd6fdc2086f8a21d0a29d94b7f8308ac4b9f94", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [770.0, 771.0, 772.0, 773.0, 774.0, 775.0, 776.0, 777.0, 778.0, 779.0, 780.0, 781.0, 782.0, 783.0, 784.0, 785.0, 786.0, 787.0, 788.0, 789.0, 790.0, 791.0, 792.0, 793.0, 794.0, 795.0, 796.0, 797.0, 798.0, 799.0], "recent_frames_sha256": "a387d07269c477fe058aee94bc3074ec8b982d5f12be93d570965dc51822a8b1", "num_recent_frames": 30, "tq": 710586.519370205, "t1": 710594.013953991, "ta": 710594.013953991, "te": 710594.051128997, "first_response_s": 7.494583785999566, "answer_total_s": 7.531758791999891, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_192_a1979_q1", "video_id": 192, "time_stamp_s": 799, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "967e3a0de0561dfd9b6eb490e1c2239616fca76e32ee95860508d2d644ca0775", "condition_order": ["recent", "notes"], "memory": "[420-450s] - Player enters a dark cave with redstone torches and purple blocks, holding a diamond sword.\n- Player approaches a purple portal block, which emits purple particles, indicating it's an Nether portal.\n- Player looks up at the sky through the cave entrance, showing a clear blue sky with clouds.\n[450-480s] - Player enters a purple-tinged cave with glowing particles, likely a Nether portal, and moves toward a dark, enclosed space.  \n- Player exits the cave into a grassy biome with scattered trees and a distant river, indicating a transition from underground to surface.  \n- Player’s inventory shows tools and items, including a pickaxe and sword, suggesting preparation for exploration or combat.\n[480-510s] - Player's inventory shows full health and equipped tools, including a sword and pickaxe, near a riverbank with trees and hills in the distance.\n- A top-down map view reveals a rectangular structure surrounded by walls, with a small tree and two dark blocks inside the central area.\n- The scene transitions from a first-person view of the landscape to an overhead map, indicating a shift in perspective or planning phase.\n[510-540s] - Player opens chest inventory, revealing sand and other items in top slots.\n- Player navigates to a large chest inside a wooden structure, showing various tools and materials.\n- Player accesses a search interface, selecting a crafting recipe involving a \"Porkchop\" and \"Porkchop\" item.\n[540-570s] - Player opens inventory, showing red concrete and other blocks in hotbar, with crafting grid displaying a red concrete item.\n- Player looks out over a wide river with distant islands and trees, then pans to a tall tower structure on the far bank.\n- Player approaches the tower, which is built on a rocky outcrop, and stands atop it, overlooking the landscape.\n[570-600s] - Player stands on a wooden platform extending over water, holding a diamond pickaxe.  \n- A distant mountain range with sparse trees is visible, labeled \"non rendered\" and \"mountain\" in text overlays.  \n- The player’s inventory shows various tools and items, including a sword and a bow.\n[600-630s] - Player holds a diamond pickaxe and stands on a wooden platform extending over water.  \n- A tall wooden structure with a red flag is visible on a distant cliffside.  \n- The player’s health bar is full, and the inventory shows various tools and items.\n[630-660s] - A large, brown, leaf-shaped object floats in the sky, appearing to drift slowly.  \n- The player’s inventory and health bar are visible at the bottom of the screen, indicating active gameplay.  \n- The landscape below includes a river, green hills, and a wooden structure, suggesting an outdoor Minecraft environment.\n[660-690s] - A bird flies overhead against a bright sky, near a wooden structure and water body.  \n- The player’s inventory shows enchanted items, including a diamond sword with \"Efficiency IV\" and \"Sharpness V\" enchantments.  \n- The player moves toward a grassy slope with red flowers, approaching a wooden structure with bookshelves.\n[690-720s] - A bird flies across a bright sky above a wooden structure near water, with floating white blocks appearing in the air.\n- The player is on a wooden platform, holding a \"Dropped Item\" and \"Spruce Log,\" with a red structure visible in the distance.\n- The scene transitions to a red structure atop a mountain at dusk, with the player standing on it, as the sky darkens and stars appear.\n[720-750s] - A red, pixelated hot air balloon structure floats above a wooden platform, with a \"PAUSED\" indicator visible in the top-left corner.\n- The camera pans downward, revealing a body of water and a small wooden structure near a cave entrance on a grassy, blocky terrain.\n- The balloon structure appears to be stationary, with no visible movement or interaction with the environment.\n[750-780s] - A red, pixelated, multi-tiered structure (possibly a custom-built tower or monument) is centered on a grassy island, surrounded by water and trees.\n- The structure appears to be made of red blocks, with a central core and outwardly expanding tiers, and is viewed from a low angle.\n- The camera pans around the structure, revealing its full circular, concentric design, with some blocks appearing to be in motion or falling.", "history_tokens": 983, "history_utf8_bytes": 4274, "recent_frame_times_s": [770.0, 771.0, 772.0, 773.0, 774.0, 775.0, 776.0, 777.0, 778.0, 779.0, 780.0, 781.0, 782.0, 783.0, 784.0, 785.0, 786.0, 787.0, 788.0, 789.0, 790.0, 791.0, 792.0, 793.0, 794.0, 795.0, 796.0, 797.0, 798.0, 799.0], "recent_frames_sha256": "a387d07269c477fe058aee94bc3074ec8b982d5f12be93d570965dc51822a8b1", "num_recent_frames": 30, "tq": 715200.503282296, "t1": 715211.292214826, "ta": 715211.292214826, "te": 715211.562555753, "first_response_s": 10.788932529976591, "answer_total_s": 11.059273457038216, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 193, "content_group": "e99d6c43f469896cde12393a6aa339c5f5f551c968a4d1a88ae953df8c0aa60f", "question": {"question_id": "sample_193_a1255_q1", "video_id": 193, "video_path": "./videos/sample_193_real.mp4", "annotation_index": 1255, "question_index": 1, "question": "What does the character mention he need?", "options": ["A. Health potions.", "B. Tools.", "C. Enderpearls.", "D. Weapons."], "answer": "C", "time_stamp_s": 19, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_193_a1255_q1", "video_id": 193, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "74ac8d1b5498fecf7e0fc28291f190cbf85698080d9a4d0b7604a19a1c11c68e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "7edc18602683e74d1e3782258c8ca021e03fccef5e8b94942d4396ac4477c234", "num_recent_frames": 20, "tq": 716702.570575931, "t1": 716709.823734225, "ta": 716709.823734225, "te": 716709.862098664, "first_response_s": 7.253158294013701, "answer_total_s": 7.291522733052261, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_193_a1255_q1", "video_id": 193, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6977195e85df105d30c1302525691201068e0179d92628bd9de3cf56c008f516", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "7edc18602683e74d1e3782258c8ca021e03fccef5e8b94942d4396ac4477c234", "num_recent_frames": 20, "tq": 716751.859847406, "t1": 716753.536102002, "ta": 716753.536102002, "te": 716753.576706814, "first_response_s": 1.6762545959791169, "answer_total_s": 1.7168594079557806, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 193, "content_group": "e99d6c43f469896cde12393a6aa339c5f5f551c968a4d1a88ae953df8c0aa60f", "question": {"question_id": "sample_193_a1255_q0", "video_id": 193, "video_path": "./videos/sample_193_real.mp4", "annotation_index": 1255, "question_index": 0, "question": "What color armor is the character wearing on the wooden platform?", "options": ["A. Red.", "B. Green.", "C. Blue.", "D. Yellow."], "answer": "C", "time_stamp_s": 29, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_193_a1255_q0", "video_id": 193, "time_stamp_s": 29, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "669a2576ad69725557559fd47ef9dca5b53b99875b742e2681a560c4d9ed77fc", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0, 27.0, 28.0, 29.0], "recent_frames_sha256": "f5fca5c14e23de61a2eaba701152088af184b3c9324eb6695586353e9109a7e2", "num_recent_frames": 30, "tq": 716709.881206707, "t1": 716717.158709966, "ta": 716717.158709966, "te": 716717.197284865, "first_response_s": 7.277503259014338, "answer_total_s": 7.316078157979064, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_193_a1255_q0", "video_id": 193, "time_stamp_s": 29, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3016edec8ab178da0a453412ed1dccc2a06f1a734fa3e5c9c108ec6ab89e026f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0, 27.0, 28.0, 29.0], "recent_frames_sha256": "f5fca5c14e23de61a2eaba701152088af184b3c9324eb6695586353e9109a7e2", "num_recent_frames": 30, "tq": 716753.616451608, "t1": 716764.793359171, "ta": 716764.793359171, "te": 716765.088390415, "first_response_s": 11.176907562999986, "answer_total_s": 11.471938806935214, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 193, "content_group": "e99d6c43f469896cde12393a6aa339c5f5f551c968a4d1a88ae953df8c0aa60f", "question": {"question_id": "sample_193_a1256_q0", "video_id": 193, "video_path": "./videos/sample_193_real.mp4", "annotation_index": 1256, "question_index": 0, "question": "What is the player holding in the right hand right now?", "options": ["A. A purple sword.", "B. A diamond pickaxe.", "C. A golden apple.", "D. A shield."], "answer": "A", "time_stamp_s": 721, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [720, 780], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_193_a1256_q0", "video_id": 193, "time_stamp_s": 721, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e2266c680a0554eedb23ec11dd1d968e4b3f6de2e83de9520dd33453eb71f254", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [692.0, 693.0, 694.0, 695.0, 696.0, 697.0, 698.0, 699.0, 700.0, 701.0, 702.0, 703.0, 704.0, 705.0, 706.0, 707.0, 708.0, 709.0, 710.0, 711.0, 712.0, 713.0, 714.0, 715.0, 716.0, 717.0, 718.0, 719.0, 720.0, 721.0], "recent_frames_sha256": "23e2b19a1ce54867c5a2c75b349c7438da2d4de223448d52e565024127009b3b", "num_recent_frames": 30, "tq": 716717.214809183, "t1": 716728.794286291, "ta": 716728.794286291, "te": 716728.833828607, "first_response_s": 11.57947710796725, "answer_total_s": 11.619019423960708, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_193_a1256_q0", "video_id": 193, "time_stamp_s": 721, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5134a904963ca790223f4dd1d01bd2db85992e53924e784a3b06ca4281d3c624", "condition_order": ["recent", "notes"], "memory": "[390-420s] - A large, orange, blocky face with a black mouth and red eyes is visible in a Minecraft scene, likely a custom mob or structure.  \n- The player navigates a dark, multi-level interior with wooden walls, torches, and a central staircase, suggesting a custom-built base or dungeon.  \n- The player opens the inventory, revealing items like \"Phantom Membrane\" and \"Enchanted Book,\" indicating preparation for gameplay or crafting.\n[420-450s] - Player interacts with librarian NPC, trading enchanted books for emeralds.  \n- Inventory shows items including enchanted books, emeralds, and various tools.  \n- Librarian NPC is positioned in a wooden room with a bed and torches visible.\n[450-480s] - Player interacts with Librarian NPC, trading enchanted books for experience orbs.  \n- Inventory shows various enchanted items and tools, including a diamond pickaxe.  \n- Player switches between inventory and trades, selecting items for trade.\n[480-510s] - Player interacts with a \"Traders\" GUI, selecting an \"Enchanted Book\" from a trade offer.\n- Player then opens a \"Repair & Name\" GUI, showing a \"Dirt\" item in the inventory.\n- Player selects a \"Book\" item, which triggers a tooltip indicating it's an \"Enchanted Book\" with \"Looting III\" enchantment.\n[510-540s] - Player interacts with \"Repair & Name\" interface, swapping items between slots to repair or rename tools.\n- \"Netherite Sword\" is selected, showing durability 1200/2021, with \"Shininess IV\" and \"Looting III\" enchantments.\n- Player attempts to repair the sword using \"Netherite Sword\" and \"Netherite Sword\" from inventory, but no repair action occurs.\n[540-570s] - Player views a \"Repair & Name\" interface with a diamond pickaxe, showing durability and enchantments like Fortune III and Unbreaking III.\n- Player exits the interface, walks to a wooden door, then moves to a dock area with a hot air balloon visible in the rain.\n- Player enters a wooden interior, then views a chat message from \"RiggedM88\" asking for help with a tool.\n[570-600s] - Player character in blue armor stands in a wooden interior, holding a diamond pickaxe, with a crafting table and inventory visible.\n- A chat message from \"Ryuk42\" appears on screen, asking about using a \"biggest bottom\" for a \"Laser\" in a \"UFO\" for \"episode 301\".\n- Player character turns to face the camera, then walks toward a ladder leading to an upper level, with a \"Leave a comment below!\" prompt visible.\n[600-630s] - Player uses diamond pickaxe to mine stone blocks in a dark underground cave.\n- Player switches to a \"Ful of Ender\" item, indicating a transition to a different tool or state.\n- Screen briefly displays performance metrics, suggesting a system log or debug overlay.\n[630-660s] - Player holds a purple pickaxe and approaches a stone chest in a dark tunnel.\n- Player opens the chest, revealing an Iron Ingot and a \"Savage Log\" item.\n- Player moves toward a barred gate in a stone-walled corridor, with a torchlit path ahead.\n[660-690s] - Player holds a purple-hued item, likely a tool or weapon, while navigating a stone-walled dungeon with torches.  \n- Player approaches a bookshelf area, opens an inventory, and selects an \"Enchanted Book\" with \"Power IV,\" \"Sharpness IV,\" \"Efficiency IV,\" and \"Flame\" enchantments.  \n- Player views a chest containing various items, including enchanted books and tools, before closing the inventory.\n[690-720s] - Player opens inventory, showing a crafting grid with a blue armor piece and various items like iron ingots and redstone.\n- Player navigates to a large, circular, green-tinged machine with a central dark void, surrounded by stone walls and windows.\n- Player looks up at the dark void, which appears to be a starry sky or a void-like space, then turns to face the machine's control panel.", "history_tokens": 946, "history_utf8_bytes": 3767, "recent_frame_times_s": [692.0, 693.0, 694.0, 695.0, 696.0, 697.0, 698.0, 699.0, 700.0, 701.0, 702.0, 703.0, 704.0, 705.0, 706.0, 707.0, 708.0, 709.0, 710.0, 711.0, 712.0, 713.0, 714.0, 715.0, 716.0, 717.0, 718.0, 719.0, 720.0, 721.0], "recent_frames_sha256": "23e2b19a1ce54867c5a2c75b349c7438da2d4de223448d52e565024127009b3b", "num_recent_frames": 30, "tq": 716945.746801091, "t1": 716946.447545242, "ta": 716946.447545242, "te": 716946.485131011, "first_response_s": 0.7007441510213539, "answer_total_s": 0.7383299199864268, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 193, "content_group": "e99d6c43f469896cde12393a6aa339c5f5f551c968a4d1a88ae953df8c0aa60f", "question": {"question_id": "sample_193_a1256_q1", "video_id": 193, "video_path": "./videos/sample_193_real.mp4", "annotation_index": 1256, "question_index": 1, "question": "What happens when the player shoots the arrow at the pillar?", "options": ["A. It causes an explosion.", "B. It regenerates the Ender Dragon.", "C. It spawns more Endermen.", "D. It creates a new portal."], "answer": "A", "time_stamp_s": 740, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "minecraft", "reference_interval_s": [720, 780], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_193_a1256_q1", "video_id": 193, "time_stamp_s": 740, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e7e5ea96375fb83c71aa2e20ddd98d7851d29989ca7abd584a70e003731d738c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [711.0, 712.0, 713.0, 714.0, 715.0, 716.0, 717.0, 718.0, 719.0, 720.0, 721.0, 722.0, 723.0, 724.0, 725.0, 726.0, 727.0, 728.0, 729.0, 730.0, 731.0, 732.0, 733.0, 734.0, 735.0, 736.0, 737.0, 738.0, 739.0, 740.0], "recent_frames_sha256": "8c1bb5e2f0404c0f3fb5cea0bc5a8355ee1c2f70bb1bb7dc28a09c2d1346e7e3", "num_recent_frames": 30, "tq": 716728.853458264, "t1": 716740.553278439, "ta": 716740.553278439, "te": 716740.590138388, "first_response_s": 11.699820174952038, "answer_total_s": 11.736680123955011, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_193_a1256_q1", "video_id": 193, "time_stamp_s": 740, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5a3597b250a14874e050497bfbf4e78f5e4c3a065c57c88e7423300be09107db", "condition_order": ["recent", "notes"], "memory": "[390-420s] - A large, orange, blocky face with a black mouth and red eyes is visible in a Minecraft scene, likely a custom mob or structure.  \n- The player navigates a dark, multi-level interior with wooden walls, torches, and a central staircase, suggesting a custom-built base or dungeon.  \n- The player opens the inventory, revealing items like \"Phantom Membrane\" and \"Enchanted Book,\" indicating preparation for gameplay or crafting.\n[420-450s] - Player interacts with librarian NPC, trading enchanted books for emeralds.  \n- Inventory shows items including enchanted books, emeralds, and various tools.  \n- Librarian NPC is positioned in a wooden room with a bed and torches visible.\n[450-480s] - Player interacts with Librarian NPC, trading enchanted books for experience orbs.  \n- Inventory shows various enchanted items and tools, including a diamond pickaxe.  \n- Player switches between inventory and trades, selecting items for trade.\n[480-510s] - Player interacts with a \"Traders\" GUI, selecting an \"Enchanted Book\" from a trade offer.\n- Player then opens a \"Repair & Name\" GUI, showing a \"Dirt\" item in the inventory.\n- Player selects a \"Book\" item, which triggers a tooltip indicating it's an \"Enchanted Book\" with \"Looting III\" enchantment.\n[510-540s] - Player interacts with \"Repair & Name\" interface, swapping items between slots to repair or rename tools.\n- \"Netherite Sword\" is selected, showing durability 1200/2021, with \"Shininess IV\" and \"Looting III\" enchantments.\n- Player attempts to repair the sword using \"Netherite Sword\" and \"Netherite Sword\" from inventory, but no repair action occurs.\n[540-570s] - Player views a \"Repair & Name\" interface with a diamond pickaxe, showing durability and enchantments like Fortune III and Unbreaking III.\n- Player exits the interface, walks to a wooden door, then moves to a dock area with a hot air balloon visible in the rain.\n- Player enters a wooden interior, then views a chat message from \"RiggedM88\" asking for help with a tool.\n[570-600s] - Player character in blue armor stands in a wooden interior, holding a diamond pickaxe, with a crafting table and inventory visible.\n- A chat message from \"Ryuk42\" appears on screen, asking about using a \"biggest bottom\" for a \"Laser\" in a \"UFO\" for \"episode 301\".\n- Player character turns to face the camera, then walks toward a ladder leading to an upper level, with a \"Leave a comment below!\" prompt visible.\n[600-630s] - Player uses diamond pickaxe to mine stone blocks in a dark underground cave.\n- Player switches to a \"Ful of Ender\" item, indicating a transition to a different tool or state.\n- Screen briefly displays performance metrics, suggesting a system log or debug overlay.\n[630-660s] - Player holds a purple pickaxe and approaches a stone chest in a dark tunnel.\n- Player opens the chest, revealing an Iron Ingot and a \"Savage Log\" item.\n- Player moves toward a barred gate in a stone-walled corridor, with a torchlit path ahead.\n[660-690s] - Player holds a purple-hued item, likely a tool or weapon, while navigating a stone-walled dungeon with torches.  \n- Player approaches a bookshelf area, opens an inventory, and selects an \"Enchanted Book\" with \"Power IV,\" \"Sharpness IV,\" \"Efficiency IV,\" and \"Flame\" enchantments.  \n- Player views a chest containing various items, including enchanted books and tools, before closing the inventory.\n[690-720s] - Player opens inventory, showing a crafting grid with a blue armor piece and various items like iron ingots and redstone.\n- Player navigates to a large, circular, green-tinged machine with a central dark void, surrounded by stone walls and windows.\n- Player looks up at the dark void, which appears to be a starry sky or a void-like space, then turns to face the machine's control panel.", "history_tokens": 946, "history_utf8_bytes": 3767, "recent_frame_times_s": [711.0, 712.0, 713.0, 714.0, 715.0, 716.0, 717.0, 718.0, 719.0, 720.0, 721.0, 722.0, 723.0, 724.0, 725.0, 726.0, 727.0, 728.0, 729.0, 730.0, 731.0, 732.0, 733.0, 734.0, 735.0, 736.0, 737.0, 738.0, 739.0, 740.0], "recent_frames_sha256": "8c1bb5e2f0404c0f3fb5cea0bc5a8355ee1c2f70bb1bb7dc28a09c2d1346e7e3", "num_recent_frames": 30, "tq": 716946.502982367, "t1": 716953.436541533, "ta": 716953.436541533, "te": 716953.661245674, "first_response_s": 6.933559166034684, "answer_total_s": 7.158263307064772, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 193, "content_group": "e99d6c43f469896cde12393a6aa339c5f5f551c968a4d1a88ae953df8c0aa60f", "question": {"question_id": "sample_193_a1257_q0", "video_id": 193, "video_path": "./videos/sample_193_real.mp4", "annotation_index": 1257, "question_index": 0, "question": "What is the player holding in the right hand right now?", "options": ["A. A firework rocket.", "B. A stone block.", "C. A wooden plank.", "D. A shovel."], "answer": "B", "time_stamp_s": 1087, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [1080, 1140], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_193_a1257_q0", "video_id": 193, "time_stamp_s": 1087, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0711c4e65907a5af71d5a9f92318d7627eca4f01d8ad2c88167003229d7bc3cd", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [1058.0, 1059.0, 1060.0, 1061.0, 1062.0, 1063.0, 1064.0, 1065.0, 1066.0, 1067.0, 1068.0, 1069.0, 1070.0, 1071.0, 1072.0, 1073.0, 1074.0, 1075.0, 1076.0, 1077.0, 1078.0, 1079.0, 1080.0, 1081.0, 1082.0, 1083.0, 1084.0, 1085.0, 1086.0, 1087.0], "recent_frames_sha256": "792e95ddc6a19090a1de2be7767ea21f836ffa4270e0393704ac466a5feede5c", "num_recent_frames": 30, "tq": 716740.598527127, "t1": 716751.814255427, "ta": 716751.814255427, "te": 716751.851655709, "first_response_s": 11.215728300041519, "answer_total_s": 11.253128582029603, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_193_a1257_q0", "video_id": 193, "time_stamp_s": 1087, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b6283741c8367d0e608f5c3e5f03bc1cee0e324fd4e73d71b8e61eddf42ea54d", "condition_order": ["recent", "notes"], "memory": "[720-750s] - Player holds a purple sword, facing the Ender Dragon in a dark, open arena with Endermen and Ender Crystals visible.\n- Player switches to a Sugar Cane in the inventory, then exits the inventory to face the dragon.\n- Player moves forward, aiming the sword at the dragon, which is positioned above the player in the distance.\n[750-780s] - Ender Dragon is visible in the distance, surrounded by obsidian pillars and sand, with a health bar above it.  \n- Player holds a purple diamond sword and moves toward the dragon, while a small Enderman appears nearby.  \n- Player opens inventory, revealing a \"Fool of the Falling\" item, then switches to a \"Fool of Strength\" item, indicating preparation for combat.\n[780-810s] - Player holds a purple sword, facing the Ender Dragon in a dark, towering environment.\n- Ender Dragon is visible in mid-air, emitting purple particles, with health bar above it.\n- Player’s inventory shows various items, including enchanted tools and potions, while the ground is littered with broken blocks.\n[810-840s] - Ender Dragon is defeated, leaving behind a glowing purple portal and scattered loot.\n- Player approaches a newly formed Ender Pearl, which is floating above the ground.\n- Player moves toward a redstone block, indicating a potential crafting or interaction point.\n[840-870s] - Player is on a redstone-embedded path above dark void, with a diamond sword in hand and health bar visible.\n- Player moves forward, then opens a chat box to type \"I am a player\" and sends it.\n- Player exits the chat box, now standing on a sandy biome with trees and a distant structure under night sky.\n[870-900s] - Player holds a purple sword, moving through a dark, sandy biome with purple trees.  \n- A small blue creature (likely a slime) is visible on the ground, near the center of the screen.  \n- Player approaches a structure made of purple and beige blocks, partially obscured by trees.\n[900-930s] - Player opens inventory, revealing a chest with \"Iron Helmet\" and \"Iron Boots\" in the top row, alongside a \"Chest\" slot.\n- Player navigates to a crafting table, then moves to a purple-tiled room with a chest and a crafting table nearby.\n- Player looks up at a large, dark, floating structure above the purple-tiled floor, suggesting a high-altitude or sky-like environment.\n[930-960s] - Player enters a purple-walled room with two chests and a crafting table, then opens a chest containing gold ingots and other items.\n- Player switches to a purple sword and moves to a wooden platform overlooking a landscape with mountains and trees.\n- Player looks up at a sky with clouds, then turns to face a wooden structure with a red door.\n[960-990s] - Player opens inventory, revealing enchanted book and other items, then switches to a crafting table with a \"Repair\" recipe.\n- Player selects a \"Book\" from inventory, then uses a \"Repair\" recipe to repair an enchanted book.\n- Player exits inventory, holding a repaired enchanted book, and walks toward a crafting table with a \"Crafting\" interface visible.\n[990-1020s] - Player's inventory shows a diamond pickaxe and sword, with health and hunger bars visible.\n- The player is standing on a grassy hillside with trees and a distant mountain range.\n- A small structure or building is visible in the distance, surrounded by trees and open land.\n[1020-1050s] - A large, flat, gray stone structure is built near a riverbank, surrounded by green terrain and trees.  \n- The structure has a rectangular shape with a flat roof and appears to be a base or platform.  \n- The camera pans around the structure, revealing its position on a grassy slope near the water's edge.\n[1050-1080s] - Player character moves along a paved path, holding a purple sword, with a health bar and inventory visible at the bottom of the screen.\n- A flying vehicle (possibly a glider or hovercraft) is seen in the sky above the landscape.\n- The environment features green grass, trees, and a body of water in the distance, with a wooden structure and yellow blocks nearby.", "history_tokens": 955, "history_utf8_bytes": 4016, "recent_frame_times_s": [1058.0, 1059.0, 1060.0, 1061.0, 1062.0, 1063.0, 1064.0, 1065.0, 1066.0, 1067.0, 1068.0, 1069.0, 1070.0, 1071.0, 1072.0, 1073.0, 1074.0, 1075.0, 1076.0, 1077.0, 1078.0, 1079.0, 1080.0, 1081.0, 1082.0, 1083.0, 1084.0, 1085.0, 1086.0, 1087.0], "recent_frames_sha256": "792e95ddc6a19090a1de2be7767ea21f836ffa4270e0393704ac466a5feede5c", "num_recent_frames": 30, "tq": 717041.33433697, "t1": 717042.557186747, "ta": 717042.557186747, "te": 717042.59870754, "first_response_s": 1.22284977696836, "answer_total_s": 1.2643705699592829, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 194, "content_group": "fa280ca4302439baef428e3218086331de36b0093ef87a5301c45215670a435b", "question": {"question_id": "sample_194_a1349_q0", "video_id": 194, "video_path": "./videos/sample_194_real.mp4", "annotation_index": 1349, "question_index": 0, "question": "What type of landscape is shown in the video?", "options": ["A. Realistic forest and mountains.", "B. Cartoon-style desert.", "C. Blocky, pixelated landscape.", "D. Detailed urban cityscape."], "answer": "C", "time_stamp_s": 15, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_194_a1349_q0", "video_id": 194, "time_stamp_s": 15, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2f64907605bcb0f46f482bc3e6a3c3f296e0bc1c0fed07918336f7a575a92e0b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0], "recent_frames_sha256": "68e978426dbcb2b6ddb39ad9bc0065b85d63a5d7067d20045670b4508dcfbb37", "num_recent_frames": 16, "tq": 717570.138928231, "t1": 717570.510993952, "ta": 717570.510993952, "te": 717570.550094969, "first_response_s": 0.37206572107970715, "answer_total_s": 0.41116673802025616, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_194_a1349_q0", "video_id": 194, "time_stamp_s": 15, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6b4e9fac1972cc6de8b00860eab784967513602249208603b8733ec91efa6c4b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0], "recent_frames_sha256": "68e978426dbcb2b6ddb39ad9bc0065b85d63a5d7067d20045670b4508dcfbb37", "num_recent_frames": 16, "tq": 717618.320241282, "t1": 717625.942044515, "ta": 717625.942044515, "te": 717626.319519573, "first_response_s": 7.621803233050741, "answer_total_s": 7.9992782910121605, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 194, "content_group": "fa280ca4302439baef428e3218086331de36b0093ef87a5301c45215670a435b", "question": {"question_id": "sample_194_a1349_q1", "video_id": 194, "video_path": "./videos/sample_194_real.mp4", "annotation_index": 1349, "question_index": 1, "question": "Where is the player standing as the scene shows dense tree cover ahead?", "options": ["A. In a valley.", "B. On a cliff or ledge.", "C. Next to a river.", "D. Inside a cave."], "answer": "B", "time_stamp_s": 18, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_194_a1349_q1", "video_id": 194, "time_stamp_s": 18, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b74437312d6a8ed135d936374b18a2d7c67d44140dfd1c17259c7c54a062c4ba", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0], "recent_frames_sha256": "f53182d46e18ad03384c8ef10273f0d29f211521acc5112694cc32d119050ec2", "num_recent_frames": 19, "tq": 717570.561062203, "t1": 717580.466196809, "ta": 717580.466196809, "te": 717580.504027666, "first_response_s": 9.905134605942294, "answer_total_s": 9.942965462920256, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_194_a1349_q1", "video_id": 194, "time_stamp_s": 18, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0580ff1691e72e8d2fafed524879b3eaede0fa7c2c5272faeab40d78bb405799", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0], "recent_frames_sha256": "f53182d46e18ad03384c8ef10273f0d29f211521acc5112694cc32d119050ec2", "num_recent_frames": 19, "tq": 717626.328104741, "t1": 717637.572581435, "ta": 717637.572581435, "te": 717637.83475515, "first_response_s": 11.244476693915203, "answer_total_s": 11.506650408962741, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 194, "content_group": "fa280ca4302439baef428e3218086331de36b0093ef87a5301c45215670a435b", "question": {"question_id": "sample_194_a1350_q0", "video_id": 194, "video_path": "./videos/sample_194_real.mp4", "annotation_index": 1350, "question_index": 0, "question": "What does the inventory bar change after the player chops the tree trunk?", "options": ["A. No change has occurred.", "B. Losing items.", "C. Damaging tools.", "D. Gaining health."], "answer": "A", "time_stamp_s": 269, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "minecraft", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_194_a1350_q0", "video_id": 194, "time_stamp_s": 269, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a61c3c05e5a310c00ca7baa260b62c49bf89358bf6735736c7f38561ef13d8f6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0], "recent_frames_sha256": "86e072ceeb07a70a95ae2449adf11effd4645967b1fc3bf78f8a944356b97d44", "num_recent_frames": 30, "tq": 717580.515157232, "t1": 717594.199924451, "ta": 717594.199924451, "te": 717594.238384544, "first_response_s": 13.684767219005153, "answer_total_s": 13.723227312089875, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_194_a1350_q0", "video_id": 194, "time_stamp_s": 269, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "429d0fcfe02160dcc656b6bab9bc9720be74edb268a4a581739d989a8a742bdf", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Player character moves across a grassy landscape near a river, with health and inventory bars visible at the bottom of the screen.\n- Player approaches a skeleton enemy standing on grass, which is positioned near a tree and a small hill.\n- Player looks up at a tall tree with hanging vines, then turns to face a steep cliffside with a cave entrance.\n[30-60s] - Player character moves through a dense forest, approaching a tall tree with a visible trunk and leaf canopy.  \n- The player looks upward, focusing on the tree’s top, with a text overlay reading \"I am actually\" and \"for this series\" appearing.  \n- A YouTube video thumbnail for \"I Built a MEDIEVAL Port In Minecraft\" is briefly displayed, indicating a prior project.\n[60-90s] - Player opens crafting menu, placing wooden planks in a 2x2 grid to create a wooden door.\n- Player switches to a shovel, then digs into dirt, revealing a small hole.\n- Player encounters a cow standing near birch trees, then returns to crafting interface.\n[90-120s] - Player interacts with crafting interface, selecting items like wood planks and sticks to craft tools or structures.\n- Player moves outdoors into a forested area with birch trees, encountering pigs and other animals.\n- Player approaches a pig, which is stationary on grass near trees, with a sword in hand, suggesting potential interaction or combat.\n[120-150s] - Player moves through grassy terrain with trees and vines, holding a pickaxe.  \n- A \"New Recipes Unlocked\" notification appears near a tree.  \n- Player approaches a hillside with a small body of water visible in the distance.\n[150-180s] - Player moves from grassy hill to a village near water, then enters a wooden house.  \n- Inside, player opens a chest containing bread and other items, then exits to the outside.  \n- Player walks outdoors, looking at a distant mountain range with trees and a clear sky.\n[180-210s] - Player opens inventory, revealing a chest with various items including a golden chestplate and a leather cap.  \n- Player switches to a golden helmet, which has a \"Curse of Vanishing\" effect and +2 armor.  \n- Player exits the inventory, standing in a grassy biome with trees and a distant structure visible.\n[210-240s] - Player views a grassy field with trees, then looks down into a dark cave entrance.  \n- A comment overlay appears, prompting viewers to leave a comment, followed by a Gru meme.  \n- Player enters water, rows a boat toward a distant shoreline with trees and cliffs.", "history_tokens": 581, "history_utf8_bytes": 2479, "recent_frame_times_s": [240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0], "recent_frames_sha256": "86e072ceeb07a70a95ae2449adf11effd4645967b1fc3bf78f8a944356b97d44", "num_recent_frames": 30, "tq": 717698.833441034, "t1": 717706.905780366, "ta": 717706.905780366, "te": 717706.947604609, "first_response_s": 8.072339332080446, "answer_total_s": 8.114163574995473, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 194, "content_group": "fa280ca4302439baef428e3218086331de36b0093ef87a5301c45215670a435b", "question": {"question_id": "sample_194_a1351_q0", "video_id": 194, "video_path": "./videos/sample_194_real.mp4", "annotation_index": 1351, "question_index": 0, "question": "What item is the player holding in his hand right now", "options": ["A. A Pickaxe.", "B. A bed of white and yellow.", "C. A Shield.", "D. A red Bed."], "answer": "B", "time_stamp_s": 551, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_194_a1351_q0", "video_id": 194, "time_stamp_s": 551, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fe5e3126a65d1b06391bb73207ff69009ff24e4b8e95b9d5fec9274e3b23e332", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0], "recent_frames_sha256": "5a7d2aa7e78a2a15db44692bb73db81eff4d4fb4592c38198f6aec49f7055139", "num_recent_frames": 30, "tq": 717594.2501235, "t1": 717605.366915604, "ta": 717605.366915604, "te": 717605.400959498, "first_response_s": 11.116792103974149, "answer_total_s": 11.150835998007096, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_194_a1351_q0", "video_id": 194, "time_stamp_s": 551, "ground_truth": "B", "raw_output": "A. A Pickaxe.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "ab2289a3afa842bdc6cb4c0a4007be098736614325a450804c739805e8b7e837", "condition_order": ["recent", "notes"], "memory": "[120-150s] - Player moves through grassy terrain with trees and vines, holding a pickaxe.  \n- A \"New Recipes Unlocked\" notification appears near a tree.  \n- Player approaches a hillside with a small body of water visible in the distance.\n[150-180s] - Player moves from grassy hill to a village near water, then enters a wooden house.  \n- Inside, player opens a chest containing bread and other items, then exits to the outside.  \n- Player walks outdoors, looking at a distant mountain range with trees and a clear sky.\n[180-210s] - Player opens inventory, revealing a chest with various items including a golden chestplate and a leather cap.  \n- Player switches to a golden helmet, which has a \"Curse of Vanishing\" effect and +2 armor.  \n- Player exits the inventory, standing in a grassy biome with trees and a distant structure visible.\n[210-240s] - Player views a grassy field with trees, then looks down into a dark cave entrance.  \n- A comment overlay appears, prompting viewers to leave a comment, followed by a Gru meme.  \n- Player enters water, rows a boat toward a distant shoreline with trees and cliffs.\n[240-270s] - Player swims through a dark underwater cave with water flowing around them.\n- Player surfaces into a bright, open area with a river and greenery visible above.\n- Player enters a narrow, dimly lit tunnel with mossy blocks and water on the left side.\n[270-300s] - A wooden chest is visible on a grassy bank near water, with a red health bar above it.  \n- The player approaches the chest, which is positioned beside a tree and a stone structure.  \n- The player opens the chest, revealing an \"Iron Ingot\" item inside, and then accesses the crafting menu.\n[300-330s] - Player interacts with crafting interface, placing items to craft a shield.  \n- Player exits crafting menu, holding a shield and looking at a wooden structure.  \n- Player moves toward a body of water, then enters a dark underground tunnel.\n[330-360s] - Player in dark underground space, holding a pickaxe, with health and inventory UI visible.\n- Player exits underground, transitioning to bright outdoor environment with a river and grassy terrain.\n- Player holds a stone sword, with cobblestone and stone blocks visible in inventory.\n[360-390s] - Player descends into a dark cave using a stone pickaxe, transitioning from a grassy area to a subterranean environment.  \n- The player’s inventory shows a stone sword and stone pickaxe, with a health bar and hunger indicator visible.  \n- A \"New Recipe Unlocked\" notification appears, followed by an \"Advancement Made! Monster Hunter\" message as the player enters a cave.\n[390-420s] - Player moves through a dark cave, switching tools (Stone Hoe, Stone Pickaxe) while collecting cobblestone and bread.\n- Player’s inventory shows various items including tools, food, and a health bar with 10 hearts.\n- Screen displays \"Advancement: Riddle Not Told, Thank You\" at the top right.\n[420-450s] - Player moves through a dark, stone-walled underground tunnel, holding a pickaxe and observing a \"New Recipe Info\" notification.\n- Player exits the tunnel into a bright, grassy outdoor area with a visible river and trees.\n- Player's inventory shows a \"Stone Axe\" and a \"Stone Sword\" in the hotbar, indicating tool readiness for outdoor exploration.\n[450-480s] - Player jumps into a river, then descends into a cave with water flowing beneath.\n- A red mob (likely a zombie or skeleton) appears on the ground near the cave entrance.\n- The player's inventory shows a pickaxe and other tools, indicating preparation for mining or combat.\n[480-510s] - Player switches to stone pickaxe, then uses it to mine stone blocks in a dark cave.\n- Player opens crafting menu, then closes it, revealing inventory with various items.\n- Player moves toward a glowing entity (possibly a mob) in the cave, then stops near it.\n[510-540s] - Player moves through a dark, stone-walled tunnel with torchlight, heading toward a blue-lit exit.  \n- Player switches between tools (Iron Pickaxe, Stone Sword) and items (Yellow Berries, Bread) while navigating.  \n- Player approaches a bright, open area with visible greenery and a blue structure, indicating transition from underground to surface.", "history_tokens": 1010, "history_utf8_bytes": 4198, "recent_frame_times_s": [522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0], "recent_frames_sha256": "5a7d2aa7e78a2a15db44692bb73db81eff4d4fb4592c38198f6aec49f7055139", "num_recent_frames": 30, "tq": 717777.56742465, "t1": 717778.814259359, "ta": 717778.814259359, "te": 717779.043319657, "first_response_s": 1.2468347090762109, "answer_total_s": 1.4758950070245191, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 194, "content_group": "fa280ca4302439baef428e3218086331de36b0093ef87a5301c45215670a435b", "question": {"question_id": "sample_194_a1352_q0", "video_id": 194, "video_path": "./videos/sample_194_real.mp4", "annotation_index": 1352, "question_index": 0, "question": "What did the player do after placing the oak plank block into the gap in the wall?", "options": ["A. Turned towards a furnace.", "B. Opened the oak plank.", "C. Opened a chest.", "D. Placed a yellow bed."], "answer": "B", "time_stamp_s": 788, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "minecraft", "reference_interval_s": [780, 840], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_194_a1352_q0", "video_id": 194, "time_stamp_s": 788, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7aab975f90b00fc74c9b102d349e297d3a0aa873fb2b7935ac536f481b43f5a3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [759.0, 760.0, 761.0, 762.0, 763.0, 764.0, 765.0, 766.0, 767.0, 768.0, 769.0, 770.0, 771.0, 772.0, 773.0, 774.0, 775.0, 776.0, 777.0, 778.0, 779.0, 780.0, 781.0, 782.0, 783.0, 784.0, 785.0, 786.0, 787.0, 788.0], "recent_frames_sha256": "5c88fec7440171c33ec4e9783a5705114208a10997ceb9396b4dbefd47739bc4", "num_recent_frames": 30, "tq": 717605.409130882, "t1": 717618.272170997, "ta": 717618.272170997, "te": 717618.310378789, "first_response_s": 12.863040114985779, "answer_total_s": 12.901247906964272, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_194_a1352_q0", "video_id": 194, "time_stamp_s": 788, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "62817798536da71749884d126b18832620272dc5f7879cc612c36ad0388861df", "condition_order": ["recent", "notes"], "memory": "[390-420s] - Player moves through a dark cave, switching tools (Stone Hoe, Stone Pickaxe) while collecting cobblestone and bread.\n- Player’s inventory shows various items including tools, food, and a health bar with 10 hearts.\n- Screen displays \"Advancement: Riddle Not Told, Thank You\" at the top right.\n[420-450s] - Player moves through a dark, stone-walled underground tunnel, holding a pickaxe and observing a \"New Recipe Info\" notification.\n- Player exits the tunnel into a bright, grassy outdoor area with a visible river and trees.\n- Player's inventory shows a \"Stone Axe\" and a \"Stone Sword\" in the hotbar, indicating tool readiness for outdoor exploration.\n[450-480s] - Player jumps into a river, then descends into a cave with water flowing beneath.\n- A red mob (likely a zombie or skeleton) appears on the ground near the cave entrance.\n- The player's inventory shows a pickaxe and other tools, indicating preparation for mining or combat.\n[480-510s] - Player switches to stone pickaxe, then uses it to mine stone blocks in a dark cave.\n- Player opens crafting menu, then closes it, revealing inventory with various items.\n- Player moves toward a glowing entity (possibly a mob) in the cave, then stops near it.\n[510-540s] - Player moves through a dark, stone-walled tunnel with torchlight, heading toward a blue-lit exit.  \n- Player switches between tools (Iron Pickaxe, Stone Sword) and items (Yellow Berries, Bread) while navigating.  \n- Player approaches a bright, open area with visible greenery and a blue structure, indicating transition from underground to surface.\n[540-570s] - Player holds a bed, then drops it into water, causing a splash effect.\n- Player looks up at a blue sky with a distant tree visible on the horizon.\n- Player moves forward, revealing a grassy landscape with scattered trees and dirt blocks.\n[570-600s] - Player stands near a Nether portal in a grassy biome, holding a pickaxe and looking toward the portal.\n- Player moves toward a lava flow, then turns to face a snowy biome with mountains in the distance.\n- Player’s inventory shows tools and items, including a pickaxe, and the health bar is visible at the bottom of the screen.\n[600-630s] - Player enters a snowy, mountainous terrain with sparse trees and rocky outcrops, then transitions into a stone-walled interior.  \n- Inside, the player approaches a \"Local Brewery\" with a \"Potion Maker\" and \"Island Guard\" visible, indicating a crafting or combat zone.  \n- The player’s inventory shows tools and items, including a \"New Recipes Unlocked\" notification, suggesting progression in gameplay.\n[630-660s] - Player moves from underground tunnel to surface, passing a wooden chest and red carpeted path.  \n- Player approaches a tree near water, then jumps into the lake.  \n- Player surfaces on grassy shore, opens inventory to view a large chest with various items.\n[660-690s] - Player holds a wooden log and approaches a crafting table near a riverbank.  \n- A chest is visible nearby, with a counter text overlay indicating \"There we go\" and a numerical counter.  \n- The player moves toward a wooden structure with a door, passing by several logs and a tree stump.\n[690-720s] - Player views a crafting interface with a \"New Recipes Unlocked\" notification, then crafts a \"Service Planks\" item from wood planks.\n- The player's inventory shows various items including tools, food, and blocks, with a \"There we go counter: 16\" displayed at the top.\n- The environment features a grassy area near water with wooden structures and trees, suggesting a crafting or building zone.\n[720-750s] - Player opens inventory, selecting a barrel from the \"Crafting\" grid.\n- Player moves toward a tree with a chest beneath it, then approaches a wooden structure with a furnace nearby.\n- Player interacts with a tree, causing it to break and reveal a hidden chest beneath.\n[750-780s] - Player holds oak plank and approaches a wooden structure with a crafting table nearby.  \n- Player opens crafting interface, then exits to walk toward a crafting table positioned near a body of water.  \n- Player moves toward a wooden structure with a crafting table, then exits to a grassy area near water.", "history_tokens": 992, "history_utf8_bytes": 4173, "recent_frame_times_s": [759.0, 760.0, 761.0, 762.0, 763.0, 764.0, 765.0, 766.0, 767.0, 768.0, 769.0, 770.0, 771.0, 772.0, 773.0, 774.0, 775.0, 776.0, 777.0, 778.0, 779.0, 780.0, 781.0, 782.0, 783.0, 784.0, 785.0, 786.0, 787.0, 788.0], "recent_frames_sha256": "5c88fec7440171c33ec4e9783a5705114208a10997ceb9396b4dbefd47739bc4", "num_recent_frames": 30, "tq": 717875.863618859, "t1": 717877.932603643, "ta": 717877.932603643, "te": 717877.97298063, "first_response_s": 2.068984784069471, "answer_total_s": 2.109361771028489, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 195, "content_group": "fd6789374780a54f5da60468441d96be0680bbb7d780d80b5dc19c4e6e00507d", "question": {"question_id": "sample_195_a1221_q0", "video_id": 195, "video_path": "./videos/sample_195_real.mp4", "annotation_index": 1221, "question_index": 0, "question": "What is the first word displayed at the start of the video?", "options": ["A. Earth.", "B. Farm.", "C. In.", "D. Video."], "answer": "C", "time_stamp_s": 20, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_195_a1221_q0", "video_id": 195, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "129d24a9915e3fb1e3ae62b4ab2ae0e1f9fc7665ea76e6ee722b629a28624ba0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "d528bb21dee0215699fc1904096f114819014c87892a18d5bb7aa64bcd11ee27", "num_recent_frames": 21, "tq": 710200.059977273, "t1": 710201.343784034, "ta": 710201.343784034, "te": 710201.379930188, "first_response_s": 1.283806761028245, "answer_total_s": 1.319952914956957, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_195_a1221_q0", "video_id": 195, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "827b7ed142268156919a95fcebe6ad99aa7300f6a26567c78b110e9fbbda58ad", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "d528bb21dee0215699fc1904096f114819014c87892a18d5bb7aa64bcd11ee27", "num_recent_frames": 21, "tq": 710018.722613682, "t1": 710021.083579846, "ta": 710021.083579846, "te": 710021.122261278, "first_response_s": 2.3609661639202386, "answer_total_s": 2.3996475959429517, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 195, "content_group": "fd6789374780a54f5da60468441d96be0680bbb7d780d80b5dc19c4e6e00507d", "question": {"question_id": "sample_195_a1222_q0", "video_id": 195, "video_path": "./videos/sample_195_real.mp4", "annotation_index": 1222, "question_index": 0, "question": "What does the player open to display various items such as an enchanted pickaxe and armor?", "options": ["A. A crafting table.", "B. An inventory.", "C. A chest.", "D. A furnace."], "answer": "B", "time_stamp_s": 189, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_195_a1222_q0", "video_id": 195, "time_stamp_s": 189, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "65b62c7383d6428ff27fb9318400f7a110c4c66a26b819ca79e961fdc0416137", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0], "recent_frames_sha256": "3fa0e9dc0a1c82c80e552ced44896535eb4fb0e2f12ce444b055e4b2d90391f1", "num_recent_frames": 30, "tq": 710201.410907127, "t1": 710207.467369414, "ta": 710207.467369414, "te": 710207.505265254, "first_response_s": 6.056462287087925, "answer_total_s": 6.094358126982115, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_195_a1222_q0", "video_id": 195, "time_stamp_s": 189, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fed8f54a269f902e3f322585f5973ad6e055efebec8822d3ede282bd290c832a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A Minecraft player character stands on a wooden dock near a house, holding a red sword, with a hot air balloon visible in the sky.  \n- The player runs across a grassy hill toward a tall, circular structure, with a crosshair targeting it, and then moves toward a river.  \n- The player’s inventory shows items like a sword, a bow, and a redstone torch, with a health bar and experience level visible.\n[30-60s] - Player approaches a small island with a tree and a wooden structure, then swims toward it.\n- Player enters a submerged structure with a redstone torch and a crafting table visible inside.\n- Player looks up at a tall wooden structure with a cross on top, then views a large wooden dome-like structure above.\n[60-90s] - Player moves through a dark, wooden interior, approaching a glowing torch-lit area.  \n- Player transitions to an underwater scene, swimming near a submerged structure with visible blocks.  \n- Player surfaces and moves toward a floating island with a tree and a wooden platform, then proceeds to a grassy area with a sheep farm.\n[90-120s] - A large, pixelated Earth model appears suspended in mid-air above a Minecraft landscape, with text overlay reading \"THE BIGGEST\".\n- The player navigates a floating platform over water, holding a Netherite Sword, and approaches a fence structure near a village.\n- A pig is seen running across a grassy area near a wooden fence, with the player's inventory visible at the bottom of the screen.\n[120-150s] - Player holds diamond pickaxe near stone structure with wooden door, facing a grassy field with hay bales.\n- Player walks toward a fenced area with sheep grazing, then turns to face a small wooden house with a thatched roof.\n- Player approaches a stone wall with a torch mounted on it, then moves toward a cluster of hay bales and a wooden fence.\n[150-180s] - A white sheep is visible in the grassy field, moving near trees and water.\n- The player opens the inventory, showing various items including potatoes and a sword.\n- A black sheep appears nearby, standing close to the white sheep, with both animals in the same grassy area.", "history_tokens": 486, "history_utf8_bytes": 2116, "recent_frame_times_s": [160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0], "recent_frames_sha256": "3fa0e9dc0a1c82c80e552ced44896535eb4fb0e2f12ce444b055e4b2d90391f1", "num_recent_frames": 30, "tq": 710062.943833625, "t1": 710064.477424292, "ta": 710064.477424292, "te": 710064.703391504, "first_response_s": 1.5335906670661643, "answer_total_s": 1.759557879064232, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 195, "content_group": "fd6789374780a54f5da60468441d96be0680bbb7d780d80b5dc19c4e6e00507d", "question": {"question_id": "sample_195_a1222_q1", "video_id": 195, "video_path": "./videos/sample_195_real.mp4", "annotation_index": 1222, "question_index": 1, "question": "What is visible in the player's hand right now?", "options": ["A. A sword.", "B. Nothing.", "C. A pickaxe.", "D. A torch."], "answer": "B", "time_stamp_s": 202, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_195_a1222_q1", "video_id": 195, "time_stamp_s": 202, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0338378efd9a5ddfd5208a972a8e71bd0c70f5d351df9990fd39187a2dac38de", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0], "recent_frames_sha256": "85bfdd62f55610026d919787f4378c04be3eb5434a22cb8f129d02b4b1da18b9", "num_recent_frames": 30, "tq": 710207.530188047, "t1": 710212.568594372, "ta": 710212.568594372, "te": 710212.606082771, "first_response_s": 5.0384063250385225, "answer_total_s": 5.075894723995589, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_195_a1222_q1", "video_id": 195, "time_stamp_s": 202, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f5b001ef0cdc49876aa6e45880b65d98fccb8bd400dd7e0eceff4db3f8c60ad7", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A Minecraft player character stands on a wooden dock near a house, holding a red sword, with a hot air balloon visible in the sky.  \n- The player runs across a grassy hill toward a tall, circular structure, with a crosshair targeting it, and then moves toward a river.  \n- The player’s inventory shows items like a sword, a bow, and a redstone torch, with a health bar and experience level visible.\n[30-60s] - Player approaches a small island with a tree and a wooden structure, then swims toward it.\n- Player enters a submerged structure with a redstone torch and a crafting table visible inside.\n- Player looks up at a tall wooden structure with a cross on top, then views a large wooden dome-like structure above.\n[60-90s] - Player moves through a dark, wooden interior, approaching a glowing torch-lit area.  \n- Player transitions to an underwater scene, swimming near a submerged structure with visible blocks.  \n- Player surfaces and moves toward a floating island with a tree and a wooden platform, then proceeds to a grassy area with a sheep farm.\n[90-120s] - A large, pixelated Earth model appears suspended in mid-air above a Minecraft landscape, with text overlay reading \"THE BIGGEST\".\n- The player navigates a floating platform over water, holding a Netherite Sword, and approaches a fence structure near a village.\n- A pig is seen running across a grassy area near a wooden fence, with the player's inventory visible at the bottom of the screen.\n[120-150s] - Player holds diamond pickaxe near stone structure with wooden door, facing a grassy field with hay bales.\n- Player walks toward a fenced area with sheep grazing, then turns to face a small wooden house with a thatched roof.\n- Player approaches a stone wall with a torch mounted on it, then moves toward a cluster of hay bales and a wooden fence.\n[150-180s] - A white sheep is visible in the grassy field, moving near trees and water.\n- The player opens the inventory, showing various items including potatoes and a sword.\n- A black sheep appears nearby, standing close to the white sheep, with both animals in the same grassy area.", "history_tokens": 486, "history_utf8_bytes": 2116, "recent_frame_times_s": [173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0], "recent_frames_sha256": "85bfdd62f55610026d919787f4378c04be3eb5434a22cb8f129d02b4b1da18b9", "num_recent_frames": 30, "tq": 710064.744214296, "t1": 710075.038524745, "ta": 710075.038524745, "te": 710075.07519213, "first_response_s": 10.294310449040495, "answer_total_s": 10.33097783406265, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 195, "content_group": "fd6789374780a54f5da60468441d96be0680bbb7d780d80b5dc19c4e6e00507d", "question": {"question_id": "sample_195_a1223_q0", "video_id": 195, "video_path": "./videos/sample_195_real.mp4", "annotation_index": 1223, "question_index": 0, "question": "What was notable about the gray sheep observed just now?", "options": ["A. It has a unique color pattern.", "B. It is labeled with the numbers \"1\".", "C. It is larger than the other sheep.", "D. It is standing alone in the field."], "answer": "B", "time_stamp_s": 402, "task_type": "Attribute Recognition", "required_ability": "episodic memory", "video_category": "minecraft", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_195_a1223_q0", "video_id": 195, "time_stamp_s": 402, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "63464c13905cf09f92d01b9a7a97eec71215916f9657117e1b44bf9c46149296", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0], "recent_frames_sha256": "350dccb3746f4341883fb17955ac3e6c6028af2063a8762007f39cd0034a8ada", "num_recent_frames": 30, "tq": 710212.650112838, "t1": 710220.021302199, "ta": 710220.021302199, "te": 710220.058793669, "first_response_s": 7.371189360972494, "answer_total_s": 7.40868083096575, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_195_a1223_q0", "video_id": 195, "time_stamp_s": 402, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4ddafb4b1d356995a378afa406c0823957c3112b4616451830702e9358bbe3c6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A Minecraft player character stands on a wooden dock near a house, holding a red sword, with a hot air balloon visible in the sky.  \n- The player runs across a grassy hill toward a tall, circular structure, with a crosshair targeting it, and then moves toward a river.  \n- The player’s inventory shows items like a sword, a bow, and a redstone torch, with a health bar and experience level visible.\n[30-60s] - Player approaches a small island with a tree and a wooden structure, then swims toward it.\n- Player enters a submerged structure with a redstone torch and a crafting table visible inside.\n- Player looks up at a tall wooden structure with a cross on top, then views a large wooden dome-like structure above.\n[60-90s] - Player moves through a dark, wooden interior, approaching a glowing torch-lit area.  \n- Player transitions to an underwater scene, swimming near a submerged structure with visible blocks.  \n- Player surfaces and moves toward a floating island with a tree and a wooden platform, then proceeds to a grassy area with a sheep farm.\n[90-120s] - A large, pixelated Earth model appears suspended in mid-air above a Minecraft landscape, with text overlay reading \"THE BIGGEST\".\n- The player navigates a floating platform over water, holding a Netherite Sword, and approaches a fence structure near a village.\n- A pig is seen running across a grassy area near a wooden fence, with the player's inventory visible at the bottom of the screen.\n[120-150s] - Player holds diamond pickaxe near stone structure with wooden door, facing a grassy field with hay bales.\n- Player walks toward a fenced area with sheep grazing, then turns to face a small wooden house with a thatched roof.\n- Player approaches a stone wall with a torch mounted on it, then moves toward a cluster of hay bales and a wooden fence.\n[150-180s] - A white sheep is visible in the grassy field, moving near trees and water.\n- The player opens the inventory, showing various items including potatoes and a sword.\n- A black sheep appears nearby, standing close to the white sheep, with both animals in the same grassy area.\n[180-210s] - Player opens inventory, showing various dyes and tools, including a \"Spruce Sapling\" and \"Soul Sand\" in the chest.\n- Player walks through a grassy field with trees and a river, carrying a wooden sword and approaching a chest.\n- Player interacts with a chest, revealing items like \"Soul Sand\" and \"Soul Dirt,\" then exits the chest interface.\n[210-240s] - Player uses purple pickaxe to mine blue diamonds in a stone cave.\n- Player mines gold ore and redstone ore in the same cave.\n- Player exits cave, transitioning to a grassy outdoor area with trees and water.\n[240-270s] - Player opens chest, revealing items like iron ingots and diamonds in inventory grid.\n- Player walks through grassy terrain with trees and a river nearby, holding a red mushroom.\n- A large, dark, disc-shaped object hovers above the landscape, supported by green poles.\n[270-300s] - Player holds a wooden sword, facing a small white sheep in an open grassy field near a river.\n- A wooden block is placed on the ground, then broken by the player, revealing a \"Squid\" entity nearby.\n- The player's inventory shows a \"Squid\" item and a \"Squid\" block, indicating interaction with the squid entity.\n[300-330s] - A player character is seen holding a wooden plank, standing near a floating wooden platform over water.\n- The player’s inventory shows various tools and items, including a sword and a pickaxe.\n- The player is near a tree with a purple flower, and a red block is visible on the ground nearby.\n[330-360s] - Player stands near a wooden structure with a redstone torch mounted on it, facing a river.\n- Player opens inventory, revealing a chest with various items including a purple enchanted item.\n- Player moves to a grassy area near the structure, then approaches a redstone block and a dirt path leading to a river.\n[360-390s] - Player places glass panes to form a transparent structure over a pig enclosure.  \n- A pig is visible inside the structure, standing on dirt blocks beneath the glass.  \n- Player’s inventory shows a crafting table and various items, including a purple potion.", "history_tokens": 993, "history_utf8_bytes": 4198, "recent_frame_times_s": [373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0], "recent_frames_sha256": "350dccb3746f4341883fb17955ac3e6c6028af2063a8762007f39cd0034a8ada", "num_recent_frames": 30, "tq": 710135.800678646, "t1": 710142.017189018, "ta": 710142.017189018, "te": 710142.055238216, "first_response_s": 6.21651037200354, "answer_total_s": 6.254559569992125, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 195, "content_group": "fd6789374780a54f5da60468441d96be0680bbb7d780d80b5dc19c4e6e00507d", "question": {"question_id": "sample_195_a1224_q0", "video_id": 195, "video_path": "./videos/sample_195_real.mp4", "annotation_index": 1224, "question_index": 0, "question": "What is visible in the background while the person builds upward?", "options": ["A. The river and treeline.", "B. The grassy terrain and distant hills.", "C. The sky and a distant mountain.", "D. The forest and a lake."], "answer": "A", "time_stamp_s": 614, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [600, 660], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_195_a1224_q0", "video_id": 195, "time_stamp_s": 614, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3984a453ac293613d6fade691fcf44b475adee8cbbd016330fb5be301c5122c6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [585.0, 586.0, 587.0, 588.0, 589.0, 590.0, 591.0, 592.0, 593.0, 594.0, 595.0, 596.0, 597.0, 598.0, 599.0, 600.0, 601.0, 602.0, 603.0, 604.0, 605.0, 606.0, 607.0, 608.0, 609.0, 610.0, 611.0, 612.0, 613.0, 614.0], "recent_frames_sha256": "257e7c82990e327f66f4214d648e41ea5660848ce935475bc7f6f84b52fe89a4", "num_recent_frames": 30, "tq": 710220.079075789, "t1": 710221.362050748, "ta": 710221.362050748, "te": 710221.402792724, "first_response_s": 1.2829749590018764, "answer_total_s": 1.3237169350031763, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_195_a1224_q0", "video_id": 195, "time_stamp_s": 614, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a2662dc77020fd499af3fdabdb66be2682da5d407dc2d2e8efdc082cfb9c2ce3", "condition_order": ["notes", "recent"], "memory": "[210-240s] - Player uses purple pickaxe to mine blue diamonds in a stone cave.\n- Player mines gold ore and redstone ore in the same cave.\n- Player exits cave, transitioning to a grassy outdoor area with trees and water.\n[240-270s] - Player opens chest, revealing items like iron ingots and diamonds in inventory grid.\n- Player walks through grassy terrain with trees and a river nearby, holding a red mushroom.\n- A large, dark, disc-shaped object hovers above the landscape, supported by green poles.\n[270-300s] - Player holds a wooden sword, facing a small white sheep in an open grassy field near a river.\n- A wooden block is placed on the ground, then broken by the player, revealing a \"Squid\" entity nearby.\n- The player's inventory shows a \"Squid\" item and a \"Squid\" block, indicating interaction with the squid entity.\n[300-330s] - A player character is seen holding a wooden plank, standing near a floating wooden platform over water.\n- The player’s inventory shows various tools and items, including a sword and a pickaxe.\n- The player is near a tree with a purple flower, and a red block is visible on the ground nearby.\n[330-360s] - Player stands near a wooden structure with a redstone torch mounted on it, facing a river.\n- Player opens inventory, revealing a chest with various items including a purple enchanted item.\n- Player moves to a grassy area near the structure, then approaches a redstone block and a dirt path leading to a river.\n[360-390s] - Player places glass panes to form a transparent structure over a pig enclosure.  \n- A pig is visible inside the structure, standing on dirt blocks beneath the glass.  \n- Player’s inventory shows a crafting table and various items, including a purple potion.\n[390-420s] - Player stands near glass enclosures with pigs, cows, and sheep inside, near a river.  \n- Player moves to a grassy field, then returns to the enclosures, with text indicating \"I need 4 more up\" and \"Come on, hurry up, guys.\"  \n- Player is seen near a wooden platform with enclosures, and text reads \"All good, we're done\" and \"the cages are here.\"\n[420-450s] - A sheep with a purple head is standing on a redstone-powered conveyor belt, surrounded by glass enclosures.\n- The player character is holding a pickaxe and appears to be near a wooden structure, possibly a fence or gate.\n- The player is looking at a sheep that is standing on a redstone-powered conveyor belt, which is part of a larger automated system.\n[450-480s] - Player is near a wooden structure with redstone components and a minecart track beside a river.\n- Player holds a redstone block and looks at a chest under the structure, then moves to interact with a redstone-powered mechanism.\n- Player’s inventory shows a redstone block and a minecart, indicating preparation for a redstone-powered minecart system.\n[480-510s] - Player views a long row of glass-enclosed sheep pens along a riverbank, with sheep inside.  \n- Player moves to the side of the pens, revealing stacked wooden platforms beneath them.  \n- Player stands near a stone block and a redstone torch, indicating setup for a redstone mechanism.\n[510-540s] - Player's inventory shows empty slots, indicating resource depletion.\n- A tall, multi-level structure made of wooden planks and glass stands in the distance.\n- The environment transitions from dusk to dawn, with changing sky colors and lighting.\n[540-570s] - A tall, multi-level structure made of wooden planks and redstone blocks stands prominently in a grassy, tree-surrounded area with a body of water nearby.\n- A purple, pixelated character with a yellow face is seated on a wooden block, facing the camera, with a health bar and inventory visible at the bottom of the screen.\n- The character is positioned near a tree, with the structure in the background, and the sky above is clear blue with white clouds.\n[570-600s] - Player holds a red-and-white pickaxe, facing a grassy landscape with trees and water, while text overlays indicate iron farming goals.\n- A tall, multi-layered structure made of red and brown blocks stands prominently in the scene, with text suggesting it's a \"tower\" or \"building.\"\n- The camera pans to show a vast, flat, sandy terrain with orange and gray block formations, indicating a transition to a different biome or area.", "history_tokens": 1020, "history_utf8_bytes": 4284, "recent_frame_times_s": [585.0, 586.0, 587.0, 588.0, 589.0, 590.0, 591.0, 592.0, 593.0, 594.0, 595.0, 596.0, 597.0, 598.0, 599.0, 600.0, 601.0, 602.0, 603.0, 604.0, 605.0, 606.0, 607.0, 608.0, 609.0, 610.0, 611.0, 612.0, 613.0, 614.0], "recent_frames_sha256": "257e7c82990e327f66f4214d648e41ea5660848ce935475bc7f6f84b52fe89a4", "num_recent_frames": 30, "tq": 710192.925408344, "t1": 710199.80747646, "ta": 710199.80747646, "te": 710200.028918857, "first_response_s": 6.882068115985021, "answer_total_s": 7.103510512970388, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 196, "content_group": "4f1f2685305948809531502b3d4c7052ede8969faf961f83123347fbd9ffc0c8", "question": {"question_id": "sample_196_a2210_q0", "video_id": 196, "video_path": "./videos/sample_196_real.mp4", "annotation_index": 2210, "question_index": 0, "question": "What does the player prepare to do?", "options": ["A. Dig for resources.", "B. Fight a monster.", "C. Use a firework rocket.", "D. Build a house."], "answer": "C", "time_stamp_s": 19, "task_type": "Prospective Reasoning", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_196_a2210_q0", "video_id": 196, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "153d6fce620a322849582e3ab442efa61f4fe0822811329934fae70dbacf0951", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "050756153738b7f4d3e86d2827a292fe265b1d72b4acaa0111a032e27eaccc64", "num_recent_frames": 20, "tq": 710601.694165702, "t1": 710602.675086981, "ta": 710602.675086981, "te": 710602.932788287, "first_response_s": 0.980921279056929, "answer_total_s": 1.2386225850787014, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_196_a2210_q0", "video_id": 196, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6e3d3647562076eed88fe2ad57215ea5308a2f7c0ba9c26c554c26c6b23ae1e8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "050756153738b7f4d3e86d2827a292fe265b1d72b4acaa0111a032e27eaccc64", "num_recent_frames": 20, "tq": 710409.807917724, "t1": 710422.639812261, "ta": 710422.639812261, "te": 710422.679130061, "first_response_s": 12.83189453696832, "answer_total_s": 12.87121233693324, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 196, "content_group": "4f1f2685305948809531502b3d4c7052ede8969faf961f83123347fbd9ffc0c8", "question": {"question_id": "sample_196_a2211_q0", "video_id": 196, "video_path": "./videos/sample_196_real.mp4", "annotation_index": 2211, "question_index": 0, "question": "What object is held in the hand while standing on the wooden dock?", "options": ["A. An enchanted tool.", "B. A wooden crate.", "C. A torch.", "D. A golden apple."], "answer": "D", "time_stamp_s": 200, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_196_a2211_q0", "video_id": 196, "time_stamp_s": 200, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "25208618178f87710f499b43d7317695e2513171dbe3868b29a02021bcf02d63", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0], "recent_frames_sha256": "70320a0ccdf7ddcff2e552c5ba930820057e5c23fb385080b06bc5be6ef97517", "num_recent_frames": 30, "tq": 710602.95274618, "t1": 710617.062615597, "ta": 710617.062615597, "te": 710617.100178418, "first_response_s": 14.109869417035952, "answer_total_s": 14.147432237979956, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_196_a2211_q0", "video_id": 196, "time_stamp_s": 200, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ec81e9b8ba8db5e1c93fa8bd6133219a1eb5503efe7491eaa60e8a387b827c2c", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player character (purple outfit) stands on a wooden dock beside a river, holding a bucket of sand.  \n- Player enters a dark, narrow underground tunnel made of redstone blocks, carrying a firework rocket.  \n- A viewer comment appears on screen suggesting faster tunnel construction using sand for easier transport.\n[30-60s] - Player collects sand from a desert biome, then smelts it in a furnace to produce glass.\n- Player places a furnace on the ground and adds sand to it, resulting in glass as output.\n- Player holds a glass block in inventory, indicating successful crafting.\n[60-90s] - Player character stands in a cavernous area with water, holding a pickaxe and facing purple blocks.  \n- A \"Achievement Got!\" notification appears above the player's head.  \n- The player's inventory shows various tools and items, including a sword and a pickaxe.\n[90-120s] - Player in purple armor mines iron ore in a dark, blocky cave with torches.\n- Player moves through a flooded cave passage, approaching a distant torch-lit area.\n- Player transitions to an outdoor base with wooden structures, water, and a windmill visible.\n[120-150s] - A tall, glass-like tower with a dark base stands prominently near water, with a purple entity (possibly a mob) visible on its structure.  \n- The camera pans across a sprawling Minecraft village with wooden houses, farms, and waterways, transitioning from day to night.  \n- At 147 seconds, the scene shifts to nighttime, revealing stars above and the same tower now silhouetted against the dark sky.\n[150-180s] - A text overlay states \"Rake forgot to record his reaction to the build, once again.\"  \n- A Minecraft character in a red suit and sunglasses stands in front of a wooden structure, adjusting sunglasses.  \n- A Minecraft player character in purple armor stands on a wooden platform near water, with a hot air balloon visible in the sky.", "history_tokens": 436, "history_utf8_bytes": 1886, "recent_frame_times_s": [171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0], "recent_frames_sha256": "70320a0ccdf7ddcff2e552c5ba930820057e5c23fb385080b06bc5be6ef97517", "num_recent_frames": 30, "tq": 710469.549493433, "t1": 710475.49127646, "ta": 710475.49127646, "te": 710475.638732011, "first_response_s": 5.94178302702494, "answer_total_s": 6.089238577987999, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 196, "content_group": "4f1f2685305948809531502b3d4c7052ede8969faf961f83123347fbd9ffc0c8", "question": {"question_id": "sample_196_a2212_q0", "video_id": 196, "video_path": "./videos/sample_196_real.mp4", "annotation_index": 2212, "question_index": 0, "question": "How many egg clusters are visible in the pond?", "options": ["A. Four.", "B. Five.", "C. Nine.", "D. Seven."], "answer": "C", "time_stamp_s": 374, "task_type": "Counting", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_196_a2212_q0", "video_id": 196, "time_stamp_s": 374, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ea422215d1afaf93a4820791390e46a6e97f099d23ae261b2884c3b16dff7a6f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0], "recent_frames_sha256": "9d46941f2334903192e8a7963843222d1c47064bd3f31790d30219280f3ea2bd", "num_recent_frames": 30, "tq": 710617.114352779, "t1": 710628.667230143, "ta": 710628.667230143, "te": 710628.705328576, "first_response_s": 11.552877363981679, "answer_total_s": 11.590975797036663, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_196_a2212_q0", "video_id": 196, "time_stamp_s": 374, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "244f8e45001fb9540a28a39265c8d2773a409e4fc41767236a0d8427a7ee3371", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player character (purple outfit) stands on a wooden dock beside a river, holding a bucket of sand.  \n- Player enters a dark, narrow underground tunnel made of redstone blocks, carrying a firework rocket.  \n- A viewer comment appears on screen suggesting faster tunnel construction using sand for easier transport.\n[30-60s] - Player collects sand from a desert biome, then smelts it in a furnace to produce glass.\n- Player places a furnace on the ground and adds sand to it, resulting in glass as output.\n- Player holds a glass block in inventory, indicating successful crafting.\n[60-90s] - Player character stands in a cavernous area with water, holding a pickaxe and facing purple blocks.  \n- A \"Achievement Got!\" notification appears above the player's head.  \n- The player's inventory shows various tools and items, including a sword and a pickaxe.\n[90-120s] - Player in purple armor mines iron ore in a dark, blocky cave with torches.\n- Player moves through a flooded cave passage, approaching a distant torch-lit area.\n- Player transitions to an outdoor base with wooden structures, water, and a windmill visible.\n[120-150s] - A tall, glass-like tower with a dark base stands prominently near water, with a purple entity (possibly a mob) visible on its structure.  \n- The camera pans across a sprawling Minecraft village with wooden houses, farms, and waterways, transitioning from day to night.  \n- At 147 seconds, the scene shifts to nighttime, revealing stars above and the same tower now silhouetted against the dark sky.\n[150-180s] - A text overlay states \"Rake forgot to record his reaction to the build, once again.\"  \n- A Minecraft character in a red suit and sunglasses stands in front of a wooden structure, adjusting sunglasses.  \n- A Minecraft player character in purple armor stands on a wooden platform near water, with a hot air balloon visible in the sky.\n[180-210s] - Player is underwater near a stone wall, with a health bar and inventory visible, indicating low health and carrying Netherite Scrap.\n- Player surfaces to a wooden dock with chests, then enters a stone-brick house with a furnace and crafting table.\n- Player opens inventory, showing Netherite Scrap and other tools, then accesses crafting menu to craft items.\n[210-240s] - Player interacts with a crafting table, upgrading a pickaxe using netherite ingots and a netherite gear.  \n- Player then opens a chest labeled \"Enders Chest\" and later a \"Large Chest,\" revealing various items including enchanted tools and materials.  \n- Player moves to an outdoor area with a stone structure, lava, and a crafting table, then transitions to a room with a bed and furnace.\n[240-270s] - Player views a sunset over a river with floating red balloons above a wooden dock.  \n- Player enters a cave, then quickly descends into a dark underground tunnel.  \n- Player appears in a forest biome with a river, then moves to a grassy field where they harvest moss blocks.\n[270-300s] - Player uses a purple pickaxe to mine stone blocks in a narrow cave passage.\n- Player exits the cave into a grassy area with flowers and a stone wall, then moves toward a distant structure.\n- Player approaches a large, flat, circular structure on a hill, with a red sword visible in the inventory.\n[300-330s] - Player's inventory shows a red sword and a green pickaxe, with health and hunger bars visible.\n- A small orange creature with a green eye is seen near the player, possibly a mob.\n- The player is in a grassy, tree-covered area with a clear sky and distant hills.\n[330-360s] - Player holds a water bucket, approaching a pond with floating pig-like creatures.\n- Pig-like creatures are seen swimming in the pond, some appearing to be dead or injured.\n- Player uses a water bucket to interact with the pond, causing water to splash and potentially affecting the creatures.", "history_tokens": 894, "history_utf8_bytes": 3839, "recent_frame_times_s": [345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0], "recent_frames_sha256": "9d46941f2334903192e8a7963843222d1c47064bd3f31790d30219280f3ea2bd", "num_recent_frames": 30, "tq": 710529.924547, "t1": 710536.804283843, "ta": 710536.804283843, "te": 710537.066413937, "first_response_s": 6.8797368430532515, "answer_total_s": 7.141866937046871, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 196, "content_group": "4f1f2685305948809531502b3d4c7052ede8969faf961f83123347fbd9ffc0c8", "question": {"question_id": "sample_196_a2213_q0", "video_id": 196, "video_path": "./videos/sample_196_real.mp4", "annotation_index": 2213, "question_index": 0, "question": "What object is floating in the sky outside the mesh enclosure?", "options": ["A. A drone.", "B. A kite.", "C. A glider.", "D. A hot air balloon."], "answer": "D", "time_stamp_s": 560, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_196_a2213_q0", "video_id": 196, "time_stamp_s": 560, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4bb940dd5e62604afb54bcc6387b2636694b6dacf9553322dca13fe02fe52385", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0], "recent_frames_sha256": "2e3d9a49117f26488d27b6d4f1c1ee640025bbff39dc1d31bc468db295e2804f", "num_recent_frames": 30, "tq": 710628.725692084, "t1": 710639.937519071, "ta": 710639.937519071, "te": 710639.976036738, "first_response_s": 11.211826987098902, "answer_total_s": 11.250344654079527, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_196_a2213_q0", "video_id": 196, "time_stamp_s": 560, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f39959822df0444826656e963f650b62fda499f8bff2c8a0716d1f077914c08c", "condition_order": ["notes", "recent"], "memory": "[150-180s] - A text overlay states \"Rake forgot to record his reaction to the build, once again.\"  \n- A Minecraft character in a red suit and sunglasses stands in front of a wooden structure, adjusting sunglasses.  \n- A Minecraft player character in purple armor stands on a wooden platform near water, with a hot air balloon visible in the sky.\n[180-210s] - Player is underwater near a stone wall, with a health bar and inventory visible, indicating low health and carrying Netherite Scrap.\n- Player surfaces to a wooden dock with chests, then enters a stone-brick house with a furnace and crafting table.\n- Player opens inventory, showing Netherite Scrap and other tools, then accesses crafting menu to craft items.\n[210-240s] - Player interacts with a crafting table, upgrading a pickaxe using netherite ingots and a netherite gear.  \n- Player then opens a chest labeled \"Enders Chest\" and later a \"Large Chest,\" revealing various items including enchanted tools and materials.  \n- Player moves to an outdoor area with a stone structure, lava, and a crafting table, then transitions to a room with a bed and furnace.\n[240-270s] - Player views a sunset over a river with floating red balloons above a wooden dock.  \n- Player enters a cave, then quickly descends into a dark underground tunnel.  \n- Player appears in a forest biome with a river, then moves to a grassy field where they harvest moss blocks.\n[270-300s] - Player uses a purple pickaxe to mine stone blocks in a narrow cave passage.\n- Player exits the cave into a grassy area with flowers and a stone wall, then moves toward a distant structure.\n- Player approaches a large, flat, circular structure on a hill, with a red sword visible in the inventory.\n[300-330s] - Player's inventory shows a red sword and a green pickaxe, with health and hunger bars visible.\n- A small orange creature with a green eye is seen near the player, possibly a mob.\n- The player is in a grassy, tree-covered area with a clear sky and distant hills.\n[330-360s] - Player holds a water bucket, approaching a pond with floating pig-like creatures.\n- Pig-like creatures are seen swimming in the pond, some appearing to be dead or injured.\n- Player uses a water bucket to interact with the pond, causing water to splash and potentially affecting the creatures.\n[360-390s] - Player holds a bucket and approaches a small pond with floating potatoes, then uses the bucket to collect them.\n- A purple, pixelated creature (likely a pig) is visible near the pond, standing still.\n- The player's inventory shows a \"Bucket of Tadpole\" and \"Bucket of Potatoes\" in the hotbar, indicating recent collection.\n[390-420s] - A large, dark, disc-shaped object hovers above the terrain, supported by a tall, thin pole, with a small flying creature nearby.\n- The player character, holding a red sword, stands on grassy terrain near a distant castle-like structure.\n- The landscape shows patches of grass, dirt, and water, with a noticeable change in terrain texture suggesting ongoing terraforming.\n[420-450s] - Player places black blocks (likely obsidian) in a linear pattern on a dirt/grass terrain, with a distant tower visible.  \n- Player switches to \"Obsidian Concrete\" in inventory, indicating material change.  \n- Player continues placing blocks, with a text overlay reading \"And this video is an early one\" and \"I don't know how much we were going to do.\"\n[450-480s] - Player character (purple outfit) walks across a black concrete path in a grassy biome, carrying a pickaxe.\n- A white sheep is visible in the distance, standing near the path’s edge.\n- A red-and-white hot air balloon floats in the sky, positioned above a distant tree line.\n[480-510s] - A purple character stands inside a large, fenced enclosure with green grass and scattered rocks.  \n- The enclosure is surrounded by a wire mesh fence, with a body of water and distant structures visible beyond.  \n- The character is positioned near the center of the enclosure, facing forward, with no visible movement or interaction.\n[510-540s] - A hot air balloon floats in the distance beyond the enclosure's mesh walls.  \n- The camera pans downward, revealing a blue water surface with a small island of green grass and brown blocks.  \n- A purple and yellow object (possibly a player or item) is visible on the water near the island.", "history_tokens": 1013, "history_utf8_bytes": 4321, "recent_frame_times_s": [531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0], "recent_frames_sha256": "2e3d9a49117f26488d27b6d4f1c1ee640025bbff39dc1d31bc468db295e2804f", "num_recent_frames": 30, "tq": 710579.593251104, "t1": 710587.548266091, "ta": 710587.548266091, "te": 710587.695626216, "first_response_s": 7.955014987033792, "answer_total_s": 8.102375112008303, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 196, "content_group": "4f1f2685305948809531502b3d4c7052ede8969faf961f83123347fbd9ffc0c8", "question": {"question_id": "sample_196_a2213_q1", "video_id": 196, "video_path": "./videos/sample_196_real.mp4", "annotation_index": 2213, "question_index": 1, "question": "What is the color of the gear worn by the player character?", "options": ["A. Red.", "B. Blue.", "C. Green.", "D. Purple."], "answer": "D", "time_stamp_s": 580, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_196_a2213_q1", "video_id": 196, "time_stamp_s": 580, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ba9f75d27c4eba1d7b52d11775c421792f11dc4025f82e533bf7bdea737d21d6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0, 561.0, 562.0, 563.0, 564.0, 565.0, 566.0, 567.0, 568.0, 569.0, 570.0, 571.0, 572.0, 573.0, 574.0, 575.0, 576.0, 577.0, 578.0, 579.0, 580.0], "recent_frames_sha256": "57af6b7017f2e7897cec3262dc3ab0f798991b5098d57ef8fd8e210572163623", "num_recent_frames": 30, "tq": 710639.986086925, "t1": 710646.914085858, "ta": 710646.914085858, "te": 710646.952427899, "first_response_s": 6.927998933009803, "answer_total_s": 6.966340973973274, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_196_a2213_q1", "video_id": 196, "time_stamp_s": 580, "ground_truth": "D", "raw_output": "D. Purple.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "2462f3112b5165bb8c7bea657135b7f8d8989e18b72ca13c39f825744a6208d1", "condition_order": ["notes", "recent"], "memory": "[180-210s] - Player is underwater near a stone wall, with a health bar and inventory visible, indicating low health and carrying Netherite Scrap.\n- Player surfaces to a wooden dock with chests, then enters a stone-brick house with a furnace and crafting table.\n- Player opens inventory, showing Netherite Scrap and other tools, then accesses crafting menu to craft items.\n[210-240s] - Player interacts with a crafting table, upgrading a pickaxe using netherite ingots and a netherite gear.  \n- Player then opens a chest labeled \"Enders Chest\" and later a \"Large Chest,\" revealing various items including enchanted tools and materials.  \n- Player moves to an outdoor area with a stone structure, lava, and a crafting table, then transitions to a room with a bed and furnace.\n[240-270s] - Player views a sunset over a river with floating red balloons above a wooden dock.  \n- Player enters a cave, then quickly descends into a dark underground tunnel.  \n- Player appears in a forest biome with a river, then moves to a grassy field where they harvest moss blocks.\n[270-300s] - Player uses a purple pickaxe to mine stone blocks in a narrow cave passage.\n- Player exits the cave into a grassy area with flowers and a stone wall, then moves toward a distant structure.\n- Player approaches a large, flat, circular structure on a hill, with a red sword visible in the inventory.\n[300-330s] - Player's inventory shows a red sword and a green pickaxe, with health and hunger bars visible.\n- A small orange creature with a green eye is seen near the player, possibly a mob.\n- The player is in a grassy, tree-covered area with a clear sky and distant hills.\n[330-360s] - Player holds a water bucket, approaching a pond with floating pig-like creatures.\n- Pig-like creatures are seen swimming in the pond, some appearing to be dead or injured.\n- Player uses a water bucket to interact with the pond, causing water to splash and potentially affecting the creatures.\n[360-390s] - Player holds a bucket and approaches a small pond with floating potatoes, then uses the bucket to collect them.\n- A purple, pixelated creature (likely a pig) is visible near the pond, standing still.\n- The player's inventory shows a \"Bucket of Tadpole\" and \"Bucket of Potatoes\" in the hotbar, indicating recent collection.\n[390-420s] - A large, dark, disc-shaped object hovers above the terrain, supported by a tall, thin pole, with a small flying creature nearby.\n- The player character, holding a red sword, stands on grassy terrain near a distant castle-like structure.\n- The landscape shows patches of grass, dirt, and water, with a noticeable change in terrain texture suggesting ongoing terraforming.\n[420-450s] - Player places black blocks (likely obsidian) in a linear pattern on a dirt/grass terrain, with a distant tower visible.  \n- Player switches to \"Obsidian Concrete\" in inventory, indicating material change.  \n- Player continues placing blocks, with a text overlay reading \"And this video is an early one\" and \"I don't know how much we were going to do.\"\n[450-480s] - Player character (purple outfit) walks across a black concrete path in a grassy biome, carrying a pickaxe.\n- A white sheep is visible in the distance, standing near the path’s edge.\n- A red-and-white hot air balloon floats in the sky, positioned above a distant tree line.\n[480-510s] - A purple character stands inside a large, fenced enclosure with green grass and scattered rocks.  \n- The enclosure is surrounded by a wire mesh fence, with a body of water and distant structures visible beyond.  \n- The character is positioned near the center of the enclosure, facing forward, with no visible movement or interaction.\n[510-540s] - A hot air balloon floats in the distance beyond the enclosure's mesh walls.  \n- The camera pans downward, revealing a blue water surface with a small island of green grass and brown blocks.  \n- A purple and yellow object (possibly a player or item) is visible on the water near the island.\n[540-570s] - Player holds a red sword, standing on grass near a large fenced enclosure with a river and trees inside.  \n- A hot air balloon floats in the sky above the enclosure, visible through the fence.  \n- The camera pans around the enclosure, revealing a stone structure and a large circular platform at the top of the fence.", "history_tokens": 1010, "history_utf8_bytes": 4306, "recent_frame_times_s": [551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0, 561.0, 562.0, 563.0, 564.0, 565.0, 566.0, 567.0, 568.0, 569.0, 570.0, 571.0, 572.0, 573.0, 574.0, 575.0, 576.0, 577.0, 578.0, 579.0, 580.0], "recent_frames_sha256": "57af6b7017f2e7897cec3262dc3ab0f798991b5098d57ef8fd8e210572163623", "num_recent_frames": 30, "tq": 710593.039093538, "t1": 710601.489333855, "ta": 710601.489333855, "te": 710601.65017011, "first_response_s": 8.450240317033604, "answer_total_s": 8.611076572095044, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 197, "content_group": "6c79f79ba73156ee6c677166818d2a1d25eaa8aa7ebfdcd556ea5cbe0ddd5a43", "question": {"question_id": "sample_197_a922_q0", "video_id": 197, "video_path": "./videos/sample_197_real.mp4", "annotation_index": 922, "question_index": 0, "question": "What is one of the objectives mentioned in the video?", "options": ["A. Build a house.", "B. Get a bunch of TNT.", "C. Collect water.", "D. Find a treasure."], "answer": "B", "time_stamp_s": 20, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_197_a922_q0", "video_id": 197, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "26599093679040c9eda044f2afcad1b509350fa2b215d755e611f7d65b9808eb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "470d813a3538249d582eedabfea6d859b1f26eece23b1ca484d37e82dc0c651a", "num_recent_frames": 21, "tq": 715403.099514911, "t1": 715411.001028481, "ta": 715411.001028481, "te": 715411.224139312, "first_response_s": 7.901513570104726, "answer_total_s": 8.124624401098117, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_197_a922_q0", "video_id": 197, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "043a9b0b595207b74ce60b4295a2695a1d82847ed9cc811e6ea1f8c41d12a316", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "470d813a3538249d582eedabfea6d859b1f26eece23b1ca484d37e82dc0c651a", "num_recent_frames": 21, "tq": 715450.608125976, "t1": 715456.795758668, "ta": 715456.795758668, "te": 715456.832917, "first_response_s": 6.187632691930048, "answer_total_s": 6.224791023996659, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 197, "content_group": "6c79f79ba73156ee6c677166818d2a1d25eaa8aa7ebfdcd556ea5cbe0ddd5a43", "question": {"question_id": "sample_197_a923_q0", "video_id": 197, "video_path": "./videos/sample_197_real.mp4", "annotation_index": 923, "question_index": 0, "question": "What object is positioned to the left of the large tree?", "options": ["A. A wooden crafting table.", "B. A stone statue.", "C. A blue tent.", "D. A metal bench."], "answer": "A", "time_stamp_s": 180, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_197_a923_q0", "video_id": 197, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e5a65536a42985878fa72af4cc70b160f482965376f4d1df4427f406d73219e6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "6dc8ea1c6ac90314a5464e50278753c54f563020cb11be4143b6580722fc47e0", "num_recent_frames": 30, "tq": 715411.240908654, "t1": 715418.010670198, "ta": 715418.010670198, "te": 715418.048041616, "first_response_s": 6.769761543953791, "answer_total_s": 6.807132961926982, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_197_a923_q0", "video_id": 197, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2ac42800bd9523b22a15b03bc4bbcef8a018def28ff1d15711ba5ffc1b189b2d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A Minecraft player with a diamond pickaxe mines stone blocks in a dark underground area.\n- The player opens a large chest containing various items, including armor, tools, and redstone components.\n- The player is near a body of water, with a wooden dock and a sunset visible in the background.\n[30-60s] - Player holds a purple enchanted item, moving through a dark stone tunnel toward a water-filled opening.  \n- Player emerges into a bright, open landscape with a large, ornate stone tower visible in the distance.  \n- A hot air balloon floats above the terrain, and a \"JOIN\" button appears on screen, suggesting a multiplayer invitation.\n[60-90s] - Player moves from rainy terrain to open grassland, then toward ocean, with \"oh no!\" text indicating surprise or danger.\n- Player swims underwater, then surfaces near a coral reef, with \"guardian\" text suggesting proximity to a hostile mob.\n- Player approaches a \"Sugar Cane\" block on land, with \"also an orange plant\" text, indicating a plant type in the environment.\n[90-120s] - Player stands on a floating stone platform over water, holding a wooden chest and looking toward a distant island.  \n- The platform extends with stone blocks, forming a rectangular structure with open sides and a small wooden chest placed on it.  \n- Player’s inventory shows various items, including tools and food, while the camera pans to reveal the surrounding water and distant landmasses.\n[120-150s] - Player views a floating wooden platform with a central structure and a long bridge extending toward a distant island.\n- The player opens the inventory, revealing a \"Firework Rocket\" in the crafting grid, indicating preparation for an action.\n- A game menu briefly appears, displaying \"Minecraft\" branding and player stats, before the view returns to the floating platform.\n[150-180s] - Player holds a red mushroom while moving through a forested area near water.\n- Player approaches a tree with a \"Diamond Ore\" sign, then enters the tree, causing a visual effect of falling blocks.\n- A large floating block appears mid-air, followed by a view of a massive mushroom structure in the distance.", "history_tokens": 475, "history_utf8_bytes": 2141, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "6dc8ea1c6ac90314a5464e50278753c54f563020cb11be4143b6580722fc47e0", "num_recent_frames": 30, "tq": 715501.979701928, "t1": 715503.109437605, "ta": 715503.109437605, "te": 715503.521781827, "first_response_s": 1.129735677037388, "answer_total_s": 1.542079898994416, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 197, "content_group": "6c79f79ba73156ee6c677166818d2a1d25eaa8aa7ebfdcd556ea5cbe0ddd5a43", "question": {"question_id": "sample_197_a923_q1", "video_id": 197, "video_path": "./videos/sample_197_real.mp4", "annotation_index": 923, "question_index": 1, "question": "What color is the bed seen in the video?", "options": ["A. Yellow.", "B. Red.", "C. Blue.", "D. Green."], "answer": "A", "time_stamp_s": 212, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_197_a923_q1", "video_id": 197, "time_stamp_s": 212, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6366e554d9ec0043fa1abaee45407e096323483b1495ae7c3629b2b1b584ef63", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0], "recent_frames_sha256": "a5db4f63ddc09edfce49bd4347b7f01d33cbb9b525ac439b8e02989b0540da03", "num_recent_frames": 30, "tq": 715418.066896197, "t1": 715428.653179004, "ta": 715428.653179004, "te": 715428.691020017, "first_response_s": 10.586282806936651, "answer_total_s": 10.62412381998729, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_197_a923_q1", "video_id": 197, "time_stamp_s": 212, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "97cb010476d202930e72a8511b5b0eb161958e325f33747d80ffeb36e3365ab0", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A Minecraft player with a diamond pickaxe mines stone blocks in a dark underground area.\n- The player opens a large chest containing various items, including armor, tools, and redstone components.\n- The player is near a body of water, with a wooden dock and a sunset visible in the background.\n[30-60s] - Player holds a purple enchanted item, moving through a dark stone tunnel toward a water-filled opening.  \n- Player emerges into a bright, open landscape with a large, ornate stone tower visible in the distance.  \n- A hot air balloon floats above the terrain, and a \"JOIN\" button appears on screen, suggesting a multiplayer invitation.\n[60-90s] - Player moves from rainy terrain to open grassland, then toward ocean, with \"oh no!\" text indicating surprise or danger.\n- Player swims underwater, then surfaces near a coral reef, with \"guardian\" text suggesting proximity to a hostile mob.\n- Player approaches a \"Sugar Cane\" block on land, with \"also an orange plant\" text, indicating a plant type in the environment.\n[90-120s] - Player stands on a floating stone platform over water, holding a wooden chest and looking toward a distant island.  \n- The platform extends with stone blocks, forming a rectangular structure with open sides and a small wooden chest placed on it.  \n- Player’s inventory shows various items, including tools and food, while the camera pans to reveal the surrounding water and distant landmasses.\n[120-150s] - Player views a floating wooden platform with a central structure and a long bridge extending toward a distant island.\n- The player opens the inventory, revealing a \"Firework Rocket\" in the crafting grid, indicating preparation for an action.\n- A game menu briefly appears, displaying \"Minecraft\" branding and player stats, before the view returns to the floating platform.\n[150-180s] - Player holds a red mushroom while moving through a forested area near water.\n- Player approaches a tree with a \"Diamond Ore\" sign, then enters the tree, causing a visual effect of falling blocks.\n- A large floating block appears mid-air, followed by a view of a massive mushroom structure in the distance.\n[180-210s] - A large, circular, floating structure with a central pole is suspended above a grassy field, appearing to be a custom-built platform or device.  \n- The player’s inventory is visible, showing tools and items, including a diamond sword and a pickaxe, indicating active gameplay.  \n- The player interacts with a crafting interface, suggesting they are preparing or modifying items for the floating structure.", "history_tokens": 564, "history_utf8_bytes": 2562, "recent_frame_times_s": [183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0], "recent_frames_sha256": "a5db4f63ddc09edfce49bd4347b7f01d33cbb9b525ac439b8e02989b0540da03", "num_recent_frames": 30, "tq": 715514.028610648, "t1": 715515.039850006, "ta": 715515.039850006, "te": 715515.077786046, "first_response_s": 1.011239357991144, "answer_total_s": 1.0491753979586065, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 197, "content_group": "6c79f79ba73156ee6c677166818d2a1d25eaa8aa7ebfdcd556ea5cbe0ddd5a43", "question": {"question_id": "sample_197_a924_q0", "video_id": 197, "video_path": "./videos/sample_197_real.mp4", "annotation_index": 924, "question_index": 0, "question": "What inventory items are visible in the player's HUD?", "options": ["A. Sword and pickaxe.", "B. Sword and shield.", "C. Axe and bow.", "D. Pickaxe and bow."], "answer": "A", "time_stamp_s": 559, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_197_a924_q0", "video_id": 197, "time_stamp_s": 559, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cadcb196f76359c61f86fead05b5da9678d55c413b9d4b911ab41fe3e67d0328", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0], "recent_frames_sha256": "786b3b070d70e43144a367b29b2299bcacf9fdde1608965661eea12c60cab182", "num_recent_frames": 30, "tq": 715428.701024232, "t1": 715439.237563698, "ta": 715439.237563698, "te": 715439.275540683, "first_response_s": 10.536539466003887, "answer_total_s": 10.574516450986266, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_197_a924_q0", "video_id": 197, "time_stamp_s": 559, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a1eadfca24535df63d199f597549f81bb37d6a04f28ac3f631d0d907995edc20", "condition_order": ["recent", "notes"], "memory": "[150-180s] - Player holds a red mushroom while moving through a forested area near water.\n- Player approaches a tree with a \"Diamond Ore\" sign, then enters the tree, causing a visual effect of falling blocks.\n- A large floating block appears mid-air, followed by a view of a massive mushroom structure in the distance.\n[180-210s] - A large, circular, floating structure with a central pole is suspended above a grassy field, appearing to be a custom-built platform or device.  \n- The player’s inventory is visible, showing tools and items, including a diamond sword and a pickaxe, indicating active gameplay.  \n- The player interacts with a crafting interface, suggesting they are preparing or modifying items for the floating structure.\n[210-240s] - Player holds diamond shovel with 73 diamonds, standing on a wooden platform above water.\n- Player looks up at a large floating wooden structure with a tree and a red-and-white striped object nearby.\n- Player opens inventory, revealing 824 cooked potatoes, then moves to a floating platform with chests and a furnace.\n[240-270s] - Player stands on grassy shore near water, holding a red sword, with a wooden structure overhead and a tree nearby.\n- Player walks toward a fenced area with a cow, then moves to a large stone castle-like structure with a prominent archway.\n- Player looks up at the castle, then pans to show a distant island with a small structure, while text overlays appear on screen.\n[270-300s] - Player holds a diamond pickaxe, standing near a tree in a grassy biome with scattered trees and a river in the distance.\n- The player's inventory is visible, showing various tools and items, including a diamond sword and a diamond pickaxe.\n- The player is in a first-person perspective, looking around the environment, with the camera slightly tilted upward toward the sky.\n[300-330s] - Player holds a purple pickaxe, standing beneath a large tree with a cross-shaped structure above it.  \n- The player looks up at the tree, then pans to reveal a wide, grassy landscape with a river and distant hills.  \n- A wooden bridge spans the river, with a small structure visible on the far side.\n[330-360s] - Player holds a red-and-white pickaxe, moving across grassy terrain with a river nearby.  \n- A tall, brown chimney structure is visible in the distance, with a wooden bridge crossing the river.  \n- The player approaches a wooden structure with a yellow block on top, possibly a trap or mechanism.\n[360-390s] - Player digs downward into a dirt trench with a diamond pickaxe, transitioning from surface to underground.\n- Player switches to a shovel to clear stone blocks, then to a torch to illuminate the tunnel.\n- Player's inventory shows various tools and items, including a diamond pickaxe, shovel, and torch, with health and hunger bars visible.\n[390-420s] - Player launches a firework rocket upward, then falls through a hole in the ground.\n- Player switches to a shovel and digs through dirt blocks, revealing a hidden TNT field.\n- Player opens inventory to access items, then exits inventory to view the expansive TNT layout.\n[420-450s] - Player holds a redstone torch, moving across grassy terrain near water and trees.  \n- A large TNT block is visible in the distance, positioned on a hillside.  \n- The player approaches a cliff edge with stone and grass, overlooking a body of water.\n[450-480s] - A pixelated house with a chimney is perched atop a cliffside, surrounded by greenery and water.\n- A large, blocky Creeper face appears on a distant cliff, partially obscured by trees.\n- The camera pans across a river flowing between grassy hills and rocky cliffs, with a hot air balloon visible in the sky.\n[480-510s] - Player holds a red-orange block with a black pattern, likely a crafted item, while moving through a rocky, grassy terrain near water.\n- A large, blocky skull structure made of gray stone blocks is visible in the distance, partially obscured by terrain and trees.\n- The player’s inventory bar shows various tools and items, including a sword, pickaxe, and a red-orange block, indicating preparation for exploration or combat.\n[510-540s] - Player holds a TNT block, facing a rocky cliffside with a river below.  \n- A skull-shaped structure is visible on the cliff, with a white, glowing entity (possibly a mob) near it.  \n- The player moves toward the cliff, with the river and distant hills in the background.", "history_tokens": 1018, "history_utf8_bytes": 4400, "recent_frame_times_s": [530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0], "recent_frames_sha256": "786b3b070d70e43144a367b29b2299bcacf9fdde1608965661eea12c60cab182", "num_recent_frames": 30, "tq": 715598.507522616, "t1": 715612.399032491, "ta": 715612.399032491, "te": 715612.712896724, "first_response_s": 13.891509875073098, "answer_total_s": 14.205374108045362, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 197, "content_group": "6c79f79ba73156ee6c677166818d2a1d25eaa8aa7ebfdcd556ea5cbe0ddd5a43", "question": {"question_id": "sample_197_a925_q0", "video_id": 197, "video_path": "./videos/sample_197_real.mp4", "annotation_index": 925, "question_index": 0, "question": "What action is depicted with the \"Subscribe\" button?", "options": ["A. It remains static.", "B. It disappears.", "C. It changes to \"Subscribed\".", "D. It moves to the top of the screen."], "answer": "C", "time_stamp_s": 709, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [660, 708], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_197_a925_q0", "video_id": 197, "time_stamp_s": 709, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e18016d06fc21370b4c7038597a45918a27827dadf3b68bceb2c652fa93bab3b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [680.0, 681.0, 682.0, 683.0, 684.0, 685.0, 686.0, 687.0, 688.0, 689.0, 690.0, 691.0, 692.0, 693.0, 694.0, 695.0, 696.0, 697.0, 698.0, 699.0, 700.0, 701.0, 702.0, 703.0, 704.0, 705.0, 706.0, 707.0, 708.0], "recent_frames_sha256": "318f532baec405fa6d722df5b2ba30dcde146645e4292a738396798d8a7dfd48", "num_recent_frames": 29, "tq": 715439.2840364, "t1": 715450.551922149, "ta": 715450.551922149, "te": 715450.589660193, "first_response_s": 11.267885748995468, "answer_total_s": 11.30562379292678, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_197_a925_q0", "video_id": 197, "time_stamp_s": 709, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2771322ebf75e54e433d2c4e8b0489a5d7ea8b6e2b779f82c15373452adf674e", "condition_order": ["recent", "notes"], "memory": "[300-330s] - Player holds a purple pickaxe, standing beneath a large tree with a cross-shaped structure above it.  \n- The player looks up at the tree, then pans to reveal a wide, grassy landscape with a river and distant hills.  \n- A wooden bridge spans the river, with a small structure visible on the far side.\n[330-360s] - Player holds a red-and-white pickaxe, moving across grassy terrain with a river nearby.  \n- A tall, brown chimney structure is visible in the distance, with a wooden bridge crossing the river.  \n- The player approaches a wooden structure with a yellow block on top, possibly a trap or mechanism.\n[360-390s] - Player digs downward into a dirt trench with a diamond pickaxe, transitioning from surface to underground.\n- Player switches to a shovel to clear stone blocks, then to a torch to illuminate the tunnel.\n- Player's inventory shows various tools and items, including a diamond pickaxe, shovel, and torch, with health and hunger bars visible.\n[390-420s] - Player launches a firework rocket upward, then falls through a hole in the ground.\n- Player switches to a shovel and digs through dirt blocks, revealing a hidden TNT field.\n- Player opens inventory to access items, then exits inventory to view the expansive TNT layout.\n[420-450s] - Player holds a redstone torch, moving across grassy terrain near water and trees.  \n- A large TNT block is visible in the distance, positioned on a hillside.  \n- The player approaches a cliff edge with stone and grass, overlooking a body of water.\n[450-480s] - A pixelated house with a chimney is perched atop a cliffside, surrounded by greenery and water.\n- A large, blocky Creeper face appears on a distant cliff, partially obscured by trees.\n- The camera pans across a river flowing between grassy hills and rocky cliffs, with a hot air balloon visible in the sky.\n[480-510s] - Player holds a red-orange block with a black pattern, likely a crafted item, while moving through a rocky, grassy terrain near water.\n- A large, blocky skull structure made of gray stone blocks is visible in the distance, partially obscured by terrain and trees.\n- The player’s inventory bar shows various tools and items, including a sword, pickaxe, and a red-orange block, indicating preparation for exploration or combat.\n[510-540s] - Player holds a TNT block, facing a rocky cliffside with a river below.  \n- A skull-shaped structure is visible on the cliff, with a white, glowing entity (possibly a mob) near it.  \n- The player moves toward the cliff, with the river and distant hills in the background.\n[540-570s] - Player holds a red-and-white sword, facing a grassy hillside with a small structure and trees.\n- A small white bird flies across the sky above the hill.\n- The player pans the camera to reveal a river flowing near a rocky cliffside.\n[570-600s] - A red sword is visible in the player's hand, pointing toward a distant structure.  \n- A creeper is positioned on a cliffside, appearing to be in a state of explosion or imminent detonation.  \n- The player's inventory bar displays various items, including tools and weapons, indicating readiness for combat or exploration.\n[600-630s] - A tall, grey, rectangular structure stands centered in a narrow canyon, flanked by rocky cliffs covered in sparse vegetation.  \n- The structure appears to be a portal or doorway, with no visible doors or openings, and is surrounded by a small river flowing nearby.  \n- The camera pans around the structure, showing its static position and the surrounding landscape, including distant hills and a clear sky.\n[630-660s] - A Creeper stands centrally between two rocky cliffs, facing the viewer, with a river flowing below.  \n- A hot air balloon floats in the sky to the right, near a grassy area with cacti.  \n- The player’s inventory is visible at the bottom, showing a red mushroom and other items.\n[660-690s] - A Creeper stands stationary on a rocky outcrop near a river, facing the player.  \n- The player’s inventory shows a red mushroom and various tools, indicating readiness for interaction.  \n- A chat message from \"Annoying1993\" appears on screen, praising the cave’s beauty.", "history_tokens": 981, "history_utf8_bytes": 4142, "recent_frame_times_s": [680.0, 681.0, 682.0, 683.0, 684.0, 685.0, 686.0, 687.0, 688.0, 689.0, 690.0, 691.0, 692.0, 693.0, 694.0, 695.0, 696.0, 697.0, 698.0, 699.0, 700.0, 701.0, 702.0, 703.0, 704.0, 705.0, 706.0, 707.0, 708.0], "recent_frames_sha256": "318f532baec405fa6d722df5b2ba30dcde146645e4292a738396798d8a7dfd48", "num_recent_frames": 29, "tq": 715683.082731135, "t1": 715691.669053876, "ta": 715691.669053876, "te": 715691.863138813, "first_response_s": 8.586322741000913, "answer_total_s": 8.780407677986659, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 198, "content_group": "162781e8f3045f49dd752a71d4df6b578e42367c172b55154b686a156dacef0a", "question": {"question_id": "sample_198_a889_q0", "video_id": 198, "video_path": "./videos/sample_198_real.mp4", "annotation_index": 889, "question_index": 0, "question": "What action is the character in purple armor performing when the camera follows its movements from a first-person perspective?", "options": ["A. Mining blocks.", "B. Building a structure.", "C. Walking through a portal.", "D. Flying with wings."], "answer": "D", "time_stamp_s": 10, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_198_a889_q0", "video_id": 198, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "57877ac68c9b05fe6db597c6873446fef323971eca6309247b2cc354d6b64a59", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "5ba2f561404de8a032c643e8f2f0959c4a1c1e89a58b23c69d84663b2b7cff33", "num_recent_frames": 10, "tq": 717103.745208031, "t1": 717114.694029945, "ta": 717114.694029945, "te": 717114.883211557, "first_response_s": 10.948821913916618, "answer_total_s": 11.138003526022658, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_198_a889_q0", "video_id": 198, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "159e62c7062f2d3869a8dfeb0cd6fac827496c90fb32ec94560dfc4044080ab9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "5ba2f561404de8a032c643e8f2f0959c4a1c1e89a58b23c69d84663b2b7cff33", "num_recent_frames": 10, "tq": 717192.005824782, "t1": 717204.492895719, "ta": 717204.492895719, "te": 717204.755299172, "first_response_s": 12.487070937058888, "answer_total_s": 12.74947439006064, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 198, "content_group": "162781e8f3045f49dd752a71d4df6b578e42367c172b55154b686a156dacef0a", "question": {"question_id": "sample_198_a890_q0", "video_id": 198, "video_path": "./videos/sample_198_real.mp4", "annotation_index": 890, "question_index": 0, "question": "What item is the character holding in their hand right now?", "options": ["A. A sword.", "B. A shield.", "C. A torch.", "D. A white block."], "answer": "D", "time_stamp_s": 281, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_198_a890_q0", "video_id": 198, "time_stamp_s": 281, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "21f8fa1ad444378f501b2944c9040bd0722faffdd1a590850103f1bae495cc23", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665], "recent_frames_sha256": "e93a4c567557891943a32304f2b78a86e8d523d6bb497ef03adc52ad1204cf66", "num_recent_frames": 30, "tq": 717114.895953076, "t1": 717126.548854189, "ta": 717126.548854189, "te": 717126.587578068, "first_response_s": 11.652901113033295, "answer_total_s": 11.691624992061406, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_198_a890_q0", "video_id": 198, "time_stamp_s": 281, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fe1113d068a329aa9c0e8f6ca9405a2b4cec9a8a6e7d454e60f9dbd4599fe0cb", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A purple-skinned Minecraft character with green eyes stands near a purple portal, then jumps into the air.  \n- The player’s view shifts to a floating island with colorful houses, then dives underwater near a green structure.  \n- The player enters a dimly lit underground cave with a \"Chest\" inventory open, containing various items like food and tools.\n[30-60s] - Player opens inventory, revealing multiple green slime blocks and other items in a grid layout.\n- Player switches to a shovel, then selects a slime block from inventory, indicating preparation for interaction.\n- Player moves forward in a narrow stone tunnel, approaching a distant light source ahead.\n[60-90s] - Player holds a purple slimeball, moving through a grassy biome with a river nearby.  \n- A large purple slime creature is seen flying over a green landscape, with a red block visible in the player's inventory.  \n- The player's inventory shows a \"Slime Ball\" in the hotbar, and the screen displays \"SLIME FARM\" text.\n[90-120s] - Player uses a purple rocket to launch into the sky, flying over colorful farm plots.  \n- Player enters a purple portal, transitioning to a Nether-like environment with red terrain.  \n- Player encounters a Nether portal with a glowing entity inside, then moves through a redstone-lit tunnel.\n[120-150s] - Player views a sprawling, colorful Minecraft world with floating islands and diverse biomes, including snowy peaks and lush forests.  \n- A red mushroom block is visible on the right side of the screen, suggesting a player's current position or tool.  \n- The player moves through a village with wooden houses, stone pathways, and a visible sign reading \"VILLAGE\" near a doorway.\n[150-180s] - A wool farm with sheep in glass enclosures is shown, featuring a water channel and a crafting table nearby.  \n- The player moves to a different area, passing a purple pig and a yellow flower near a stone wall.  \n- A red carpet is visible on the ground, leading to a structure with a wooden door and stone walls.\n[180-210s] - Player moves along a red carpet toward a row of glass-enclosed cages containing villagers.  \n- Villagers inside cages are stationary, some with chests nearby, suggesting a trading or display setup.  \n- Camera pans left, revealing more cages and a stone-walled interior with hanging lanterns.\n[210-240s] - Player opens inventory, revealing a full stack of blue dye in the top-left grid slot.\n- Player exits inventory, revealing a large wooden wall with multiple colored glass panes and flowers in front.\n- Player moves toward a purple mob (likely a zombie or skeleton) that appears to be walking toward them.\n[240-270s] - Player approaches a Nether portal in a dimly lit, lava-filled Nether biome, with redstone torches illuminating the area.\n- The player is holding a green block (likely a Nether wart or similar item) and is near a white portal frame.\n- A text overlay \"*FINALLY*\" appears, indicating a significant moment or achievement in the game.", "history_tokens": 690, "history_utf8_bytes": 2985, "recent_frame_times_s": [251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665], "recent_frames_sha256": "e93a4c567557891943a32304f2b78a86e8d523d6bb497ef03adc52ad1204cf66", "num_recent_frames": 30, "tq": 717268.011989518, "t1": 717269.319723183, "ta": 717269.319723183, "te": 717269.550075583, "first_response_s": 1.3077336651040241, "answer_total_s": 1.5380860650911927, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 198, "content_group": "162781e8f3045f49dd752a71d4df6b578e42367c172b55154b686a156dacef0a", "question": {"question_id": "sample_198_a890_q1", "video_id": 198, "video_path": "./videos/sample_198_real.mp4", "annotation_index": 890, "question_index": 1, "question": "What action does the character perform after turning away from the lava room?", "options": ["A. Fights a creature.", "B. Collects a resource.", "C. Lights a torch.", "D. Places a white block in the wall."], "answer": "D", "time_stamp_s": 284, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_198_a890_q1", "video_id": 198, "time_stamp_s": 284, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e988c6f0f60654225a8bba1f8d0b42507b331268a38703aaaa9fd91e9c5e739e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667], "recent_frames_sha256": "e3fe1f1d541a388df95f3fa1a00f7a3f5f83632ec91e3860bfec2639ded783ed", "num_recent_frames": 30, "tq": 717126.597264177, "t1": 717166.230581846, "ta": 717166.230581846, "te": 717166.268046735, "first_response_s": 39.633317668922246, "answer_total_s": 39.670782557921484, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_198_a890_q1", "video_id": 198, "time_stamp_s": 284, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e17cafdfe63f032f278385b6d9402d009b392373dd5ac545be7eed2a274fff59", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A purple-skinned Minecraft character with green eyes stands near a purple portal, then jumps into the air.  \n- The player’s view shifts to a floating island with colorful houses, then dives underwater near a green structure.  \n- The player enters a dimly lit underground cave with a \"Chest\" inventory open, containing various items like food and tools.\n[30-60s] - Player opens inventory, revealing multiple green slime blocks and other items in a grid layout.\n- Player switches to a shovel, then selects a slime block from inventory, indicating preparation for interaction.\n- Player moves forward in a narrow stone tunnel, approaching a distant light source ahead.\n[60-90s] - Player holds a purple slimeball, moving through a grassy biome with a river nearby.  \n- A large purple slime creature is seen flying over a green landscape, with a red block visible in the player's inventory.  \n- The player's inventory shows a \"Slime Ball\" in the hotbar, and the screen displays \"SLIME FARM\" text.\n[90-120s] - Player uses a purple rocket to launch into the sky, flying over colorful farm plots.  \n- Player enters a purple portal, transitioning to a Nether-like environment with red terrain.  \n- Player encounters a Nether portal with a glowing entity inside, then moves through a redstone-lit tunnel.\n[120-150s] - Player views a sprawling, colorful Minecraft world with floating islands and diverse biomes, including snowy peaks and lush forests.  \n- A red mushroom block is visible on the right side of the screen, suggesting a player's current position or tool.  \n- The player moves through a village with wooden houses, stone pathways, and a visible sign reading \"VILLAGE\" near a doorway.\n[150-180s] - A wool farm with sheep in glass enclosures is shown, featuring a water channel and a crafting table nearby.  \n- The player moves to a different area, passing a purple pig and a yellow flower near a stone wall.  \n- A red carpet is visible on the ground, leading to a structure with a wooden door and stone walls.\n[180-210s] - Player moves along a red carpet toward a row of glass-enclosed cages containing villagers.  \n- Villagers inside cages are stationary, some with chests nearby, suggesting a trading or display setup.  \n- Camera pans left, revealing more cages and a stone-walled interior with hanging lanterns.\n[210-240s] - Player opens inventory, revealing a full stack of blue dye in the top-left grid slot.\n- Player exits inventory, revealing a large wooden wall with multiple colored glass panes and flowers in front.\n- Player moves toward a purple mob (likely a zombie or skeleton) that appears to be walking toward them.\n[240-270s] - Player approaches a Nether portal in a dimly lit, lava-filled Nether biome, with redstone torches illuminating the area.\n- The player is holding a green block (likely a Nether wart or similar item) and is near a white portal frame.\n- A text overlay \"*FINALLY*\" appears, indicating a significant moment or achievement in the game.", "history_tokens": 690, "history_utf8_bytes": 2985, "recent_frame_times_s": [254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667], "recent_frames_sha256": "e3fe1f1d541a388df95f3fa1a00f7a3f5f83632ec91e3860bfec2639ded783ed", "num_recent_frames": 30, "tq": 717269.586147671, "t1": 717278.321657743, "ta": 717278.321657743, "te": 717278.525938338, "first_response_s": 8.735510071972385, "answer_total_s": 8.939790667034686, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 198, "content_group": "162781e8f3045f49dd752a71d4df6b578e42367c172b55154b686a156dacef0a", "question": {"question_id": "sample_198_a891_q0", "video_id": 198, "video_path": "./videos/sample_198_real.mp4", "annotation_index": 891, "question_index": 0, "question": "What is prominently displayed on the screen as the player continues flying deeper into the cave?", "options": ["A. Usefulness.", "B. Danger.", "C. Exploration.", "D. Achievement."], "answer": "A", "time_stamp_s": 573, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_198_a891_q0", "video_id": 198, "time_stamp_s": 573, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "610326f2ea6d55a5b3cdecac203ab65a3e39083b4c6e83879d1de9c3c7b51cf2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.00045, 552.00145, 553.00245, 554.00345, 555.00445, 556.00545, 557.00645, 558.00745, 559.00845, 560.00945, 561.01045, 562.01145, 563.01245, 564.01345, 565.01445, 566.01545, 567.01645, 568.0007666666667, 569.0017666666666, 570.0027666666666, 571.0037666666667, 572.0047666666667], "recent_frames_sha256": "e7707132984719a214703e1380adbe46afa0d92f36f3dff72c7e718a6fdb88b1", "num_recent_frames": 30, "tq": 717166.278392287, "t1": 717180.495933239, "ta": 717180.495933239, "te": 717180.533791891, "first_response_s": 14.217540952027775, "answer_total_s": 14.25539960397873, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_198_a891_q0", "video_id": 198, "time_stamp_s": 573, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a4e9e5e3cfc5ca65e4782555cb5855ebf0d7536b582a20e686ad65e7299ce9f6", "condition_order": ["recent", "notes"], "memory": "[210-240s] - Player opens inventory, revealing a full stack of blue dye in the top-left grid slot.\n- Player exits inventory, revealing a large wooden wall with multiple colored glass panes and flowers in front.\n- Player moves toward a purple mob (likely a zombie or skeleton) that appears to be walking toward them.\n[240-270s] - Player approaches a Nether portal in a dimly lit, lava-filled Nether biome, with redstone torches illuminating the area.\n- The player is holding a green block (likely a Nether wart or similar item) and is near a white portal frame.\n- A text overlay \"*FINALLY*\" appears, indicating a significant moment or achievement in the game.\n[270-300s] - Player holds a purple diamond sword, facing a narrow tunnel with lava flows on either side.  \n- A small, glowing entity (possibly a mob) is visible near the ceiling, partially obscured by stone blocks.  \n- The player’s inventory shows a full set of tools and items, including a pickaxe and a sword, with a health bar indicating full health.\n[300-330s] - Player holds a purple sword, facing a room with orange glowstone pillars and red mushrooms.  \n- A white door with red eyes appears, followed by a purple mob (likely a Blaze) that spawns near the door.  \n- The player moves toward the door, then turns to face a Blaze that drops green particles upon defeat.\n[330-360s] - Player opens inventory, revealing a crafting table and various items, then exits to a Nether biome with lava flows and redstone torches.\n- A purple-skinned, bearded entity (likely a Nether mob) appears, holding a sword and standing near a white block structure.\n- Player moves toward a large purple portal, with a glowing orange torch visible in the background, suggesting a transition or encounter point.\n[360-390s] - Player character with purple skin and green eyes stands in a forested area, facing forward.  \n- A stone pathway leads upward toward a large, ornate temple structure with spires and towers.  \n- Wooden statues or pillars with yellow hats are positioned near the base of the temple, surrounded by green grass.\n[390-420s] - Villager with yellow hat stands near wooden door, facing camera, surrounded by green crops.  \n- Player character (purple robe) appears in center, standing among crops, facing villagers.  \n- Wooden table with items and torches visible in background, suggesting a farm setup.\n[420-450s] - Player character (purple skin) stands near a blue bed in a stone-walled room with wooden floors and torches.  \n- Several villagers are positioned around the room, some near beds and others near crafting tables.  \n- A small white pixelated entity (possibly a mob or item) appears briefly near the player’s feet.\n[450-480s] - Player approaches a large, white, multi-story building with a clock tower, surrounded by greenery and a purple structure in the distance.  \n- The player’s inventory shows a red mushroom and various tools, indicating preparation for interaction or exploration.  \n- The camera pans to reveal a circular, enclosed area with green plants and stone structures, labeled \"BONE MEAL TITAN\" on-screen.\n[480-510s] - Player views a large, circular wooden structure with multiple windows and greenery, then moves to a stone-walled entrance with torches and a wooden chest.  \n- The player approaches a stone archway leading to a lower area with a wooden staircase and a chest nearby.  \n- A dark, blocky structure (possibly a minecart or trap) is visible on the ground, with a red \"r/wattles\" overlay indicating a community or mod.\n[510-540s] - Player views a large, open landscape with scattered trees, flowers, and structures under a clear sky.\n- A green checkmark appears over a tree, indicating a selection or target.\n- Several animals, including cows and pigs, are visible near the tree and surrounding terrain.\n[540-570s] - Player moves through a village with wooden structures and trees, then transitions to a mountainous terrain with snow-covered peaks.  \n- A green glowing orb appears in the sky, followed by a fiery orange object (possibly a mob or item) in the distance.  \n- Player descends into a dark cave with blue and orange lighting, revealing a red sword in hand and a text overlay reading \"usefullness\".", "history_tokens": 979, "history_utf8_bytes": 4208, "recent_frame_times_s": [543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.00045, 552.00145, 553.00245, 554.00345, 555.00445, 556.00545, 557.00645, 558.00745, 559.00845, 560.00945, 561.01045, 562.01145, 563.01245, 564.01345, 565.01445, 566.01545, 567.01645, 568.0007666666667, 569.0017666666666, 570.0027666666666, 571.0037666666667, 572.0047666666667], "recent_frames_sha256": "e7707132984719a214703e1380adbe46afa0d92f36f3dff72c7e718a6fdb88b1", "num_recent_frames": 30, "tq": 717359.287285601, "t1": 717366.951180644, "ta": 717366.951180644, "te": 717366.98971785, "first_response_s": 7.663895042962395, "answer_total_s": 7.702432248974219, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 198, "content_group": "162781e8f3045f49dd752a71d4df6b578e42367c172b55154b686a156dacef0a", "question": {"question_id": "sample_198_a892_q0", "video_id": 198, "video_path": "./videos/sample_198_real.mp4", "annotation_index": 892, "question_index": 0, "question": "What happens as the player approaches the tall, snowy mountain?", "options": ["A. The player increases altitude significantly.", "B. The player changes to a third-person perspective.", "C. The player starts building a structure.", "D. The player start to fly upwards."], "answer": "D", "time_stamp_s": 856, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [840, 900], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_198_a892_q0", "video_id": 198, "time_stamp_s": 856, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "498b340303a695d360521105d93c03f58c3412af8811f9063ea7c833105273a5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [826.0085166666667, 827.0095166666666, 828.0105166666667, 829.0115166666667, 830.0125166666667, 831.0135166666666, 832.0145166666666, 833.0155166666667, 834.0165166666667, 835.0008333333334, 836.0018333333334, 837.0028333333333, 838.0038333333333, 839.0048333333333, 840.0058333333334, 841.0068333333334, 842.0078333333333, 843.0088333333333, 844.0098333333333, 845.0108333333334, 846.0118333333334, 847.0128333333333, 848.0138333333333, 849.0148333333333, 850.0158333333334, 851.00015, 852.00115, 853.00215, 854.00315, 855.00415], "recent_frames_sha256": "84b4aad0de31215de5d1f08f734cbd1b514413acc934eae0806f93ba71e136ce", "num_recent_frames": 30, "tq": 717180.543420664, "t1": 717191.958927242, "ta": 717191.958927242, "te": 717191.996488366, "first_response_s": 11.415506577934138, "answer_total_s": 11.453067702008411, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_198_a892_q0", "video_id": 198, "time_stamp_s": 856, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c732f61e685cda0fe07c405ecbb268fcab3c31bb5b43ec8200e520830ee1c798", "condition_order": ["recent", "notes"], "memory": "[480-510s] - Player views a large, circular wooden structure with multiple windows and greenery, then moves to a stone-walled entrance with torches and a wooden chest.  \n- The player approaches a stone archway leading to a lower area with a wooden staircase and a chest nearby.  \n- A dark, blocky structure (possibly a minecart or trap) is visible on the ground, with a red \"r/wattles\" overlay indicating a community or mod.\n[510-540s] - Player views a large, open landscape with scattered trees, flowers, and structures under a clear sky.\n- A green checkmark appears over a tree, indicating a selection or target.\n- Several animals, including cows and pigs, are visible near the tree and surrounding terrain.\n[540-570s] - Player moves through a village with wooden structures and trees, then transitions to a mountainous terrain with snow-covered peaks.  \n- A green glowing orb appears in the sky, followed by a fiery orange object (possibly a mob or item) in the distance.  \n- Player descends into a dark cave with blue and orange lighting, revealing a red sword in hand and a text overlay reading \"usefullness\".\n[570-600s] - A Minecraft character in blue armor stands on grassy terrain, then falls off a cliff.\n- Inside a dark, industrial structure, a player navigates a complex network of pipes and machinery.\n- The player approaches a glowing, circular device mounted on a stone platform.\n[600-630s] - Player approaches a tall, dark structure with glass panels and metal frames, surrounded by glowing blue blocks.  \n- The player looks upward, revealing a vertical shaft with a ladder leading to a higher platform.  \n- The player moves toward the ladder, preparing to ascend into the dark, enclosed space.\n[630-660s] - A tall, blue-lit structure with vertical glass panels and metal frames dominates the center of the cavernous space.  \n- The player’s inventory is visible at the bottom of the screen, showing tools and items, including a golden apple.  \n- The player moves toward the structure, approaching a narrow staircase leading upward, with torches illuminating the path.\n[660-690s] - Player uses a purple glider to descend from a high cliff, landing on a grassy hill with a cow nearby.  \n- A red \"no\" sign appears over the cow, indicating it's not interactable or has been marked for removal.  \n- Player approaches a wooden structure with stairs and a door, surrounded by trees and flowers, suggesting a village or settlement.\n[690-720s] - Player views an auto-pumpkin farm with glass frames, rows of pumpkins, and automated watering systems.  \n- A large wooden structure with stairs and a door is visible, with a player character standing near it.  \n- Player opens inventory, showing items like seeds, tools, and blocks, with a \"Craft\" menu displayed.\n[720-750s] - Player character with purple headgear and black armor stands in a village, holding a torch.  \n- A large green egg is visible in the sky, positioned above a snowy mountain range.  \n- Player moves to a wooden shop interior, where a villager in orange robes stands behind a counter.\n[750-780s] - A player in a hot air balloon floats above snowy terrain, carrying two other players in a transparent cabin.  \n- The balloon drifts over a snow-covered landscape with distant villages and a red dragon visible on the ground.  \n- The player’s inventory shows a purple block and a furnace, suggesting resource gathering or crafting activities.\n[780-810s] - A player opens a \"Lapis Lazuli Chest\" containing redstone dust and lapis lazuli blocks.\n- A floating iron golem appears, positioned above a snow-covered landscape with a minecart track.\n- A purple Enderman stands on the ground, facing the player, near a wooden structure with a redstone torch.\n[810-840s] - A red-and-yellow character floats mid-air near a snow-covered mountain peak, seemingly unaffected by gravity.  \n- A large, multi-level wooden structure with glass panels is suspended above the snowy terrain, appearing to be a floating platform or building.  \n- A player with purple hair and a black outfit stands on a purple block platform, facing the camera, with a village visible in the background.", "history_tokens": 955, "history_utf8_bytes": 4137, "recent_frame_times_s": [826.0085166666667, 827.0095166666666, 828.0105166666667, 829.0115166666667, 830.0125166666667, 831.0135166666666, 832.0145166666666, 833.0155166666667, 834.0165166666667, 835.0008333333334, 836.0018333333334, 837.0028333333333, 838.0038333333333, 839.0048333333333, 840.0058333333334, 841.0068333333334, 842.0078333333333, 843.0088333333333, 844.0098333333333, 845.0108333333334, 846.0118333333334, 847.0128333333333, 848.0138333333333, 849.0148333333333, 850.0158333333334, 851.00015, 852.00115, 853.00215, 854.00315, 855.00415], "recent_frames_sha256": "84b4aad0de31215de5d1f08f734cbd1b514413acc934eae0806f93ba71e136ce", "num_recent_frames": 30, "tq": 717426.428124987, "t1": 717427.905929856, "ta": 717427.905929856, "te": 717428.206310451, "first_response_s": 1.4778048689477146, "answer_total_s": 1.778185463976115, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 199, "content_group": "b8fb623f8b969b3e3a3a2dcb304fa7f0c2f5b8a7cf22f1257c297e1b5714f959", "question": {"question_id": "sample_199_a1878_q0", "video_id": 199, "video_path": "./videos/sample_199_real.mp4", "annotation_index": 1878, "question_index": 0, "question": "What tool is the player using to cut down the trees?", "options": ["A. Stone axe.", "B. Diamond Axe.", "C. Golden axe.", "D. SWooden axe."], "answer": "A", "time_stamp_s": 323, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_199_a1878_q0", "video_id": 199, "time_stamp_s": 323, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e2ab2a510e971217f020ddd06e607ed7820de43e720fbdbeebe71bdf4c528a98", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [293.00938333333335, 294.0103833333333, 295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333, 300.01638333333335, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0000166666667, 318.00101666666666, 319.0020166666667, 320.00301666666667, 321.00401666666664, 322.0050166666667], "recent_frames_sha256": "02ed94610bfba922e344c3945f8bedf3f2404d7dad6c943d5c39c9e472c037fc", "num_recent_frames": 30, "tq": 718619.07584865, "t1": 718631.513195687, "ta": 718631.513195687, "te": 718631.550499094, "first_response_s": 12.437347037019208, "answer_total_s": 12.474650443997234, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_199_a1878_q0", "video_id": 199, "time_stamp_s": 323, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "93713e8aad7ebf9b00c1e2c5f9f3c9632fe017c17e11b8129160ec414288895d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A Minecraft character with a pixelated face and black beard stands in a stone-walled underground chamber, holding a pickaxe.  \n- The player navigates a dimly lit cave with flowing water and torches, approaching a dark, narrow passage.  \n- A YouTube comment overlay appears, reading \"You actually found diamond!!!\", indicating a viewer's reaction to the player's discovery.\n[30-60s] - Player holds a pickaxe and approaches a diamond block submerged in water within a stone-walled cavern.\n- Player opens inventory, revealing a crafting grid and various items, including a diamond and redstone.\n- Player moves toward a torch-lit stone staircase leading upward, with a redstone torch visible on the wall.\n[60-90s] - Player approaches a narrow passage with torches illuminating the path.  \n- A zombie appears on a higher ledge, facing the player, with a torch nearby.  \n- Player moves downward into a deeper, darker tunnel with visible lava flow.\n[90-120s] - Player in Minecraft mines underground, holding a pickaxe, with torches illuminating stone walls and a lava source nearby.  \n- A meme overlay appears, showing a man in a red jacket with text about \"sitting on the couch\" and \"sitting on the couch\" again.  \n- Player switches to a fire torch, then to a stone sword, while navigating a narrow, torch-lit tunnel.\n[120-150s] - Player’s hand holds a sword, facing a campfire with a lit torch on a chest nearby.  \n- Rain falls continuously, with trees and grass visibly wet.  \n- Player opens inventory, revealing a crafting grid and a “Search” box, then closes it.\n[150-180s] - Rain falls over a grassy area with trees, a campfire, and a bed nearby.  \n- A smoking chimney rises from a wooden structure beside the fire.  \n- The game menu appears, showing \"Singleplayer,\" \"Multiplayer,\" and \"Minecraft Realms\" options.\n[180-210s] - Red bed with white blanket placed on grass near a wooden chest with a torch on top.\n- Player swims underwater near a submerged structure with green seaweed and blue water.\n- Player approaches a sandy beach with a stone wall and trees in the background.\n[210-240s] - Player swims underwater near a submerged block, then surfaces near a grassy bank with rain falling.\n- Player approaches a campfire and a crafting table, then opens an inventory showing a \"Chest\" and \"Chest\" with items.\n- Player moves through a forested area with trees and birch trees, rain continuing to fall.\n[240-270s] - Player is in a dense forest with rain falling, holding a sword, and moving forward.  \n- A stone structure is visible to the right, near a body of water.  \n- The player opens the game menu, then adjusts settings like render distance and simulation distance.\n[270-300s] - A large white cube floats above a rocky terrain near a forested area.  \n- The player’s inventory is visible at the bottom, showing tools and items.  \n- The landscape includes green trees, blue water, and distant mountains under a clear sky.", "history_tokens": 708, "history_utf8_bytes": 2944, "recent_frame_times_s": [293.00938333333335, 294.0103833333333, 295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333, 300.01638333333335, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0000166666667, 318.00101666666666, 319.0020166666667, 320.00301666666667, 321.00401666666664, 322.0050166666667], "recent_frames_sha256": "02ed94610bfba922e344c3945f8bedf3f2404d7dad6c943d5c39c9e472c037fc", "num_recent_frames": 30, "tq": 718760.252924787, "t1": 718767.124132666, "ta": 718767.124132666, "te": 718767.165838117, "first_response_s": 6.871207879041322, "answer_total_s": 6.912913330015726, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 199, "content_group": "b8fb623f8b969b3e3a3a2dcb304fa7f0c2f5b8a7cf22f1257c297e1b5714f959", "question": {"question_id": "sample_199_a1879_q0", "video_id": 199, "video_path": "./videos/sample_199_real.mp4", "annotation_index": 1879, "question_index": 0, "question": "What did the player just take out of the furnace?", "options": ["A. Iron pickaxe.", "B. Stone.", "C. Food.", "D. Stone block."], "answer": "B", "time_stamp_s": 651, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "minecraft", "reference_interval_s": [600, 660], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_199_a1879_q0", "video_id": 199, "time_stamp_s": 651, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6f1c722e6a025b85e42a1a690c041053c8393da7399a2a428699cff2cc28323a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [621.0037166666667, 622.0047166666667, 623.0057166666667, 624.0067166666666, 625.0077166666666, 626.0087166666667, 627.0097166666667, 628.0107166666667, 629.0117166666666, 630.0127166666666, 631.0137166666667, 632.0147166666667, 633.0157166666667, 634.0000333333334, 635.0010333333333, 636.0020333333333, 637.0030333333333, 638.0040333333334, 639.0050333333334, 640.0060333333333, 641.0070333333333, 642.0080333333333, 643.0090333333334, 644.0100333333334, 645.0110333333333, 646.0120333333333, 647.0130333333333, 648.0140333333334, 649.0150333333333, 650.0160333333333], "recent_frames_sha256": "4d743eaa2d286e35d40a1d8e836d4fd33e884bdf46992384ba87168a101f16c4", "num_recent_frames": 30, "tq": 718631.56350845, "t1": 718644.322199263, "ta": 718644.322199263, "te": 718644.360037536, "first_response_s": 12.758690812974237, "answer_total_s": 12.796529085957445, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_199_a1879_q0", "video_id": 199, "time_stamp_s": 651, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d2034b4cfa05cf20cc881e0abca262bbf6edc49e7c9a6cd13962a00413c50340", "condition_order": ["recent", "notes"], "memory": "[240-270s] - Player is in a dense forest with rain falling, holding a sword, and moving forward.  \n- A stone structure is visible to the right, near a body of water.  \n- The player opens the game menu, then adjusts settings like render distance and simulation distance.\n[270-300s] - A large white cube floats above a rocky terrain near a forested area.  \n- The player’s inventory is visible at the bottom, showing tools and items.  \n- The landscape includes green trees, blue water, and distant mountains under a clear sky.\n[300-330s] - Player interacts with a furnace interface, selecting a crafting recipe involving a crafting grid and item slots.\n- Player exits the crafting menu, revealing a furnace and torches on a stone platform near water.\n- Player moves to a cliffside, approaching a stone structure with a torch nearby, suggesting preparation for further exploration.\n[330-360s] - Player is in a forest, observing a tree with a white block (possibly a crafting table or structure) suspended among its branches.  \n- The player moves around the tree, looking up and down, with the camera angle shifting to show the tree's structure and surrounding foliage.  \n- At 350 seconds, the player opens the inventory and crafting interface, revealing items like a stone axe and various materials, indicating preparation for further actions.\n[360-390s] - A stone structure with a flat top and sloped sides is visible, situated on a grassy island with trees and water nearby.\n- The player approaches the structure, which has a small opening or entrance on its side.\n- A character wearing a black suit and red tie appears on the structure's surface, standing still.\n[390-420s] - Player uses a pickaxe to mine stone blocks, revealing a cave entrance with glowing ores.  \n- A large orange block (likely a redstone block) is visible in the foreground, partially embedded in the terrain.  \n- The player moves toward a newly exposed area with scattered ores and a small body of water nearby.\n[420-450s] - Player opens inventory, revealing a grid of items including tools and blocks, with a redstone torch visible.\n- Player switches to a pickaxe and begins mining gray stone blocks, breaking them into smaller pieces.\n- Player moves along a rocky terrain near a body of water, with trees and hills visible in the background.\n[450-480s] - Player holds wooden planks, placing them on gravel near water's edge.  \n- Inventory shows \"Ripch Log\" (likely a typo for \"Ripch Log\" or \"Ripch Log\") in hotbar.  \n- Player builds a small wooden structure extending from the shore into the water.\n[480-510s] - Player views a wooden structure with a central pit, surrounded by water and trees, from an elevated perspective.  \n- Inventory screen shows crafting grid with a \"Crafting\" label and a \"New Recipes unlocked\" notification.  \n- Player switches to a \"Crafting\" interface, revealing a recipe for a \"Crafting Table\" with a \"Crafting\" label and a \"Crafting\" icon.\n[510-540s] - Player is on a wooden structure overlooking a body of water with a small island visible in the distance.  \n- The structure has a redstone-powered mechanism (possibly a piston or trapdoor) near the edge, which is currently inactive.  \n- The player’s inventory shows a wooden pickaxe and other tools, indicating preparation for building or mining.\n[540-570s] - Player stands on a wooden platform overlooking a river and forested terrain, with a large wooden structure nearby.  \n- The player’s inventory is visible, showing tools and items, including a sword and a bucket.  \n- A white block (possibly a diamond or quartz) floats in the air above the structure, suggesting a recent placement or interaction.\n[570-600s] - Player holds a snow hoe, standing on a wooden platform near water, with a small white creature nearby.  \n- The player looks down into a deep vertical shaft made of wooden planks, with a clear view of the sky above.  \n- The player’s inventory shows a snow hoe and other tools, with a health bar and experience level visible at the bottom.\n[600-630s] - Player wields a pickaxe near a tall tower, then swims underwater past kelp and rocks.\n- Player surfaces near a body of water, then walks toward a tower with a red flag on top.\n- Player opens inventory, showing a crafting table with a \"Cauldron\" recipe and various items.", "history_tokens": 1008, "history_utf8_bytes": 4301, "recent_frame_times_s": [621.0037166666667, 622.0047166666667, 623.0057166666667, 624.0067166666666, 625.0077166666666, 626.0087166666667, 627.0097166666667, 628.0107166666667, 629.0117166666666, 630.0127166666666, 631.0137166666667, 632.0147166666667, 633.0157166666667, 634.0000333333334, 635.0010333333333, 636.0020333333333, 637.0030333333333, 638.0040333333334, 639.0050333333334, 640.0060333333333, 641.0070333333333, 642.0080333333333, 643.0090333333334, 644.0100333333334, 645.0110333333333, 646.0120333333333, 647.0130333333333, 648.0140333333334, 649.0150333333333, 650.0160333333333], "recent_frames_sha256": "4d743eaa2d286e35d40a1d8e836d4fd33e884bdf46992384ba87168a101f16c4", "num_recent_frames": 30, "tq": 718854.689986259, "t1": 718861.203088091, "ta": 718861.203088091, "te": 718861.468106654, "first_response_s": 6.513101832009852, "answer_total_s": 6.778120395028964, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 199, "content_group": "b8fb623f8b969b3e3a3a2dcb304fa7f0c2f5b8a7cf22f1257c297e1b5714f959", "question": {"question_id": "sample_199_a1880_q0", "video_id": 199, "video_path": "./videos/sample_199_real.mp4", "annotation_index": 1880, "question_index": 0, "question": "What food did the player just eat?", "options": ["A. Fishes.", "B. pork.", "C. Orange.", "D. beef."], "answer": "A", "time_stamp_s": 665, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "minecraft", "reference_interval_s": [660, 720], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_199_a1880_q0", "video_id": 199, "time_stamp_s": 665, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ef2c8a62ba521dc7d2d6ee39bb5f89cc2f47f8bb5d69f15ff9f31dc33dbf6d15", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [635.0010333333333, 636.0020333333333, 637.0030333333333, 638.0040333333334, 639.0050333333334, 640.0060333333333, 641.0070333333333, 642.0080333333333, 643.0090333333334, 644.0100333333334, 645.0110333333333, 646.0120333333333, 647.0130333333333, 648.0140333333334, 649.0150333333333, 650.0160333333333, 651.00035, 652.00135, 653.00235, 654.00335, 655.00435, 656.00535, 657.00635, 658.00735, 659.00835, 660.00935, 661.01035, 662.01135, 663.01235, 664.01335], "recent_frames_sha256": "ac1196a0c2f1f3f960a0c030298c5b65ef9ac66f76a38d29a26f6d7d99979967", "num_recent_frames": 30, "tq": 718644.373114342, "t1": 718655.280668726, "ta": 718655.280668726, "te": 718655.318712799, "first_response_s": 10.907554383971728, "answer_total_s": 10.9455984570086, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_199_a1880_q0", "video_id": 199, "time_stamp_s": 665, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3d6a743f5ea1b69de484abca6da9235827f4a9301acffc4d536ca4807fa7a352", "condition_order": ["recent", "notes"], "memory": "[270-300s] - A large white cube floats above a rocky terrain near a forested area.  \n- The player’s inventory is visible at the bottom, showing tools and items.  \n- The landscape includes green trees, blue water, and distant mountains under a clear sky.\n[300-330s] - Player interacts with a furnace interface, selecting a crafting recipe involving a crafting grid and item slots.\n- Player exits the crafting menu, revealing a furnace and torches on a stone platform near water.\n- Player moves to a cliffside, approaching a stone structure with a torch nearby, suggesting preparation for further exploration.\n[330-360s] - Player is in a forest, observing a tree with a white block (possibly a crafting table or structure) suspended among its branches.  \n- The player moves around the tree, looking up and down, with the camera angle shifting to show the tree's structure and surrounding foliage.  \n- At 350 seconds, the player opens the inventory and crafting interface, revealing items like a stone axe and various materials, indicating preparation for further actions.\n[360-390s] - A stone structure with a flat top and sloped sides is visible, situated on a grassy island with trees and water nearby.\n- The player approaches the structure, which has a small opening or entrance on its side.\n- A character wearing a black suit and red tie appears on the structure's surface, standing still.\n[390-420s] - Player uses a pickaxe to mine stone blocks, revealing a cave entrance with glowing ores.  \n- A large orange block (likely a redstone block) is visible in the foreground, partially embedded in the terrain.  \n- The player moves toward a newly exposed area with scattered ores and a small body of water nearby.\n[420-450s] - Player opens inventory, revealing a grid of items including tools and blocks, with a redstone torch visible.\n- Player switches to a pickaxe and begins mining gray stone blocks, breaking them into smaller pieces.\n- Player moves along a rocky terrain near a body of water, with trees and hills visible in the background.\n[450-480s] - Player holds wooden planks, placing them on gravel near water's edge.  \n- Inventory shows \"Ripch Log\" (likely a typo for \"Ripch Log\" or \"Ripch Log\") in hotbar.  \n- Player builds a small wooden structure extending from the shore into the water.\n[480-510s] - Player views a wooden structure with a central pit, surrounded by water and trees, from an elevated perspective.  \n- Inventory screen shows crafting grid with a \"Crafting\" label and a \"New Recipes unlocked\" notification.  \n- Player switches to a \"Crafting\" interface, revealing a recipe for a \"Crafting Table\" with a \"Crafting\" label and a \"Crafting\" icon.\n[510-540s] - Player is on a wooden structure overlooking a body of water with a small island visible in the distance.  \n- The structure has a redstone-powered mechanism (possibly a piston or trapdoor) near the edge, which is currently inactive.  \n- The player’s inventory shows a wooden pickaxe and other tools, indicating preparation for building or mining.\n[540-570s] - Player stands on a wooden platform overlooking a river and forested terrain, with a large wooden structure nearby.  \n- The player’s inventory is visible, showing tools and items, including a sword and a bucket.  \n- A white block (possibly a diamond or quartz) floats in the air above the structure, suggesting a recent placement or interaction.\n[570-600s] - Player holds a snow hoe, standing on a wooden platform near water, with a small white creature nearby.  \n- The player looks down into a deep vertical shaft made of wooden planks, with a clear view of the sky above.  \n- The player’s inventory shows a snow hoe and other tools, with a health bar and experience level visible at the bottom.\n[600-630s] - Player wields a pickaxe near a tall tower, then swims underwater past kelp and rocks.\n- Player surfaces near a body of water, then walks toward a tower with a red flag on top.\n- Player opens inventory, showing a crafting table with a \"Cauldron\" recipe and various items.\n[630-660s] - Player opens inventory, showing a crafting table and furnace with items like coal and iron ingots.\n- Player moves to a stone structure, then digs into a stone cave, revealing a narrow tunnel.\n- Player enters a wooden structure with a crafting table and furnace, then exits to a grassy area with a torch and chest.", "history_tokens": 1019, "history_utf8_bytes": 4358, "recent_frame_times_s": [635.0010333333333, 636.0020333333333, 637.0030333333333, 638.0040333333334, 639.0050333333334, 640.0060333333333, 641.0070333333333, 642.0080333333333, 643.0090333333334, 644.0100333333334, 645.0110333333333, 646.0120333333333, 647.0130333333333, 648.0140333333334, 649.0150333333333, 650.0160333333333, 651.00035, 652.00135, 653.00235, 654.00335, 655.00435, 656.00535, 657.00635, 658.00735, 659.00835, 660.00935, 661.01035, 662.01135, 663.01235, 664.01335], "recent_frames_sha256": "ac1196a0c2f1f3f960a0c030298c5b65ef9ac66f76a38d29a26f6d7d99979967", "num_recent_frames": 30, "tq": 718872.509396577, "t1": 718873.935366946, "ta": 718873.935366946, "te": 718874.333357172, "first_response_s": 1.4259703690186143, "answer_total_s": 1.8239605949493125, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 199, "content_group": "b8fb623f8b969b3e3a3a2dcb304fa7f0c2f5b8a7cf22f1257c297e1b5714f959", "question": {"question_id": "sample_199_a1881_q0", "video_id": 199, "video_path": "./videos/sample_199_real.mp4", "annotation_index": 1881, "question_index": 0, "question": "What object is the player holding right now?", "options": ["A. A map.", "B. A sword.", "C. A pickaxe.", "D. A bow."], "answer": "A", "time_stamp_s": 965, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [960, 1020], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_199_a1881_q0", "video_id": 199, "time_stamp_s": 965, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "42f41b4f0df954a6d38276d9cac4b6c946b557aab8977ae7fadb239fb7b440a7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [935.0007333333333, 936.0017333333333, 937.0027333333334, 938.0037333333333, 939.0047333333333, 940.0057333333333, 941.0067333333334, 942.0077333333334, 943.0087333333333, 944.0097333333333, 945.0107333333333, 946.0117333333334, 947.0127333333334, 948.0137333333333, 949.0147333333333, 950.0157333333333, 951.00005, 952.00105, 953.00205, 954.00305, 955.00405, 956.00505, 957.00605, 958.00705, 959.00805, 960.00905, 961.01005, 962.01105, 963.01205, 964.01305], "recent_frames_sha256": "71c8f7ba66ce0dcf65b046dce070de51c5fc55aad59ff6f8b94279889ca8c476", "num_recent_frames": 30, "tq": 718655.329488525, "t1": 718667.157100005, "ta": 718667.157100005, "te": 718667.194920795, "first_response_s": 11.827611479908228, "answer_total_s": 11.86543226998765, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_199_a1881_q0", "video_id": 199, "time_stamp_s": 965, "ground_truth": "A", "raw_output": "C. A pickaxe.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "7a03b01cc7d76852f6b12f22312f91e06b69facb621ca557f6e2a7b1e02a3904", "condition_order": ["recent", "notes"], "memory": "[600-630s] - Player wields a pickaxe near a tall tower, then swims underwater past kelp and rocks.\n- Player surfaces near a body of water, then walks toward a tower with a red flag on top.\n- Player opens inventory, showing a crafting table with a \"Cauldron\" recipe and various items.\n[630-660s] - Player opens inventory, showing a crafting table and furnace with items like coal and iron ingots.\n- Player moves to a stone structure, then digs into a stone cave, revealing a narrow tunnel.\n- Player enters a wooden structure with a crafting table and furnace, then exits to a grassy area with a torch and chest.\n[660-690s] - Player places a wooden door on a stone block inside a wooden structure.  \n- Player exits the structure, revealing a beach and ocean view from a wooden platform.  \n- Player opens a crafting menu, showing a crafting grid with various items and a \"Crafting\" tab active.\n[690-720s] - Player opens inventory, selecting \"Block of Copper\" from crafting grid.  \n- Player switches to \"Stonecutter\" interface, placing \"Block of Copper\" into the stonecutter's input slot.  \n- Player then selects \"Cut Copper\" from the stonecutter's output slot, indicating the crafting process.\n[720-750s] - Player is placing orange blocks (likely terracotta) to form a roof or wall structure atop a wooden framework.  \n- The structure is situated on a cliff edge overlooking water, with a forested landscape visible in the background.  \n- The player’s inventory shows tools and items, including a pickaxe, indicating ongoing construction or modification.\n[750-780s] - Player opens inventory, showing a crafting grid with \"Lightning Rod\" recipe and \"Copper\" in the crafting slot.\n- Player looks up inside a tall wooden structure, then pans to view a large copper structure floating above water.\n- Player holds a \"Copper\" block, with a \"Cut Corner\" item in inventory, as they look down at the copper structure from above.\n[780-810s] - Player descends a tall wooden structure, transitioning from a high vantage point to a lower level with a wooden platform.  \n- Player enters a wooden door, moving from an interior space to an exterior landscape featuring a tall tower and river.  \n- The tower, made of wooden blocks with a red top, stands prominently beside the river, with clouds visible in the sky.\n[810-840s] - A tall, pixelated lighthouse with a red top stands on a rocky island, surrounded by water and greenery.  \n- The player’s inventory is open, showing tools and items, including a pickaxe and a furnace.  \n- The player is near the lighthouse, with a view of the ocean and distant landmasses under a partly cloudy sky.\n[840-870s] - Player opens inventory, revealing tools and items, then switches to a map showing a coastal area with a tall tower.  \n- Player moves toward a forested area near a river, with trees and terrain visible.  \n- Player approaches a tall tower structure in the distance, partially obscured by trees.\n[870-900s] - Player holds a pickaxe and moves along a grassy riverbank, then swims across a river toward a distant island.\n- A small boat with a red flag is visible on the far side of the river, anchored near a stone wall.\n- The player approaches a small island with bamboo stalks growing from the ground.\n[900-930s] - Player is underwater near a lava flow, holding a pickaxe, with a chest nearby containing \"Soul Fire\" and \"Soul Sand\" items.\n- Player surfaces onto a sandy beach, then opens inventory to access tools and items, including a \"Soul Fire\" and \"Soul Sand\" in the chest.\n- Player looks toward a distant tower structure on the horizon while holding a pickaxe, with a lava flow visible nearby.\n[930-960s] - Player opens inventory, showing various items including tools and food, with a crafting grid visible.\n- Player navigates to a crafting table, selecting materials to craft items, with a crafting grid displaying item recipes.\n- Player interacts with a chest labeled \"Chest\" in a wooden structure, accessing stored items.", "history_tokens": 947, "history_utf8_bytes": 3968, "recent_frame_times_s": [935.0007333333333, 936.0017333333333, 937.0027333333334, 938.0037333333333, 939.0047333333333, 940.0057333333333, 941.0067333333334, 942.0077333333334, 943.0087333333333, 944.0097333333333, 945.0107333333333, 946.0117333333334, 947.0127333333334, 948.0137333333333, 949.0147333333333, 950.0157333333333, 951.00005, 952.00105, 953.00205, 954.00305, 955.00405, 956.00505, 957.00605, 958.00705, 959.00805, 960.00905, 961.01005, 962.01105, 963.01205, 964.01305], "recent_frames_sha256": "71c8f7ba66ce0dcf65b046dce070de51c5fc55aad59ff6f8b94279889ca8c476", "num_recent_frames": 30, "tq": 718982.97937474, "t1": 718984.15945485, "ta": 718984.15945485, "te": 718984.391868704, "first_response_s": 1.1800801099743694, "answer_total_s": 1.4124939639586955, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 199, "content_group": "b8fb623f8b969b3e3a3a2dcb304fa7f0c2f5b8a7cf22f1257c297e1b5714f959", "question": {"question_id": "sample_199_a1881_q1", "video_id": 199, "video_path": "./videos/sample_199_real.mp4", "annotation_index": 1881, "question_index": 1, "question": "What did the player do after the coordinates '1320, 1450' appeared on the screen?", "options": ["A. Fight an enemy.", "B. Open a chest.", "C. Craft an item.", "D. Explore the terrain."], "answer": "C", "time_stamp_s": 972, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "minecraft", "reference_interval_s": [960, 1020], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_199_a1881_q1", "video_id": 199, "time_stamp_s": 972, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "87196d5cf1dd270133d54df1c8f02a7c06f1d19f82f6d2296b8cfac40ec3263f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [942.0077333333334, 943.0087333333333, 944.0097333333333, 945.0107333333333, 946.0117333333334, 947.0127333333334, 948.0137333333333, 949.0147333333333, 950.0157333333333, 951.00005, 952.00105, 953.00205, 954.00305, 955.00405, 956.00505, 957.00605, 958.00705, 959.00805, 960.00905, 961.01005, 962.01105, 963.01205, 964.01305, 965.01405, 966.01505, 967.01605, 968.0003666666667, 969.0013666666666, 970.0023666666667, 971.0033666666667], "recent_frames_sha256": "2d5b0a011152f0838876f318a1554959a0fc931e664147892bebdbdb874066f3", "num_recent_frames": 30, "tq": 718667.205220169, "t1": 718674.983656724, "ta": 718674.983656724, "te": 718675.021226911, "first_response_s": 7.778436554945074, "answer_total_s": 7.816006741952151, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_199_a1881_q1", "video_id": 199, "time_stamp_s": 972, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f54089a6704f2c42539fa84babe53ae2f0b4dec40b087d029289e943b87c18e7", "condition_order": ["recent", "notes"], "memory": "[600-630s] - Player wields a pickaxe near a tall tower, then swims underwater past kelp and rocks.\n- Player surfaces near a body of water, then walks toward a tower with a red flag on top.\n- Player opens inventory, showing a crafting table with a \"Cauldron\" recipe and various items.\n[630-660s] - Player opens inventory, showing a crafting table and furnace with items like coal and iron ingots.\n- Player moves to a stone structure, then digs into a stone cave, revealing a narrow tunnel.\n- Player enters a wooden structure with a crafting table and furnace, then exits to a grassy area with a torch and chest.\n[660-690s] - Player places a wooden door on a stone block inside a wooden structure.  \n- Player exits the structure, revealing a beach and ocean view from a wooden platform.  \n- Player opens a crafting menu, showing a crafting grid with various items and a \"Crafting\" tab active.\n[690-720s] - Player opens inventory, selecting \"Block of Copper\" from crafting grid.  \n- Player switches to \"Stonecutter\" interface, placing \"Block of Copper\" into the stonecutter's input slot.  \n- Player then selects \"Cut Copper\" from the stonecutter's output slot, indicating the crafting process.\n[720-750s] - Player is placing orange blocks (likely terracotta) to form a roof or wall structure atop a wooden framework.  \n- The structure is situated on a cliff edge overlooking water, with a forested landscape visible in the background.  \n- The player’s inventory shows tools and items, including a pickaxe, indicating ongoing construction or modification.\n[750-780s] - Player opens inventory, showing a crafting grid with \"Lightning Rod\" recipe and \"Copper\" in the crafting slot.\n- Player looks up inside a tall wooden structure, then pans to view a large copper structure floating above water.\n- Player holds a \"Copper\" block, with a \"Cut Corner\" item in inventory, as they look down at the copper structure from above.\n[780-810s] - Player descends a tall wooden structure, transitioning from a high vantage point to a lower level with a wooden platform.  \n- Player enters a wooden door, moving from an interior space to an exterior landscape featuring a tall tower and river.  \n- The tower, made of wooden blocks with a red top, stands prominently beside the river, with clouds visible in the sky.\n[810-840s] - A tall, pixelated lighthouse with a red top stands on a rocky island, surrounded by water and greenery.  \n- The player’s inventory is open, showing tools and items, including a pickaxe and a furnace.  \n- The player is near the lighthouse, with a view of the ocean and distant landmasses under a partly cloudy sky.\n[840-870s] - Player opens inventory, revealing tools and items, then switches to a map showing a coastal area with a tall tower.  \n- Player moves toward a forested area near a river, with trees and terrain visible.  \n- Player approaches a tall tower structure in the distance, partially obscured by trees.\n[870-900s] - Player holds a pickaxe and moves along a grassy riverbank, then swims across a river toward a distant island.\n- A small boat with a red flag is visible on the far side of the river, anchored near a stone wall.\n- The player approaches a small island with bamboo stalks growing from the ground.\n[900-930s] - Player is underwater near a lava flow, holding a pickaxe, with a chest nearby containing \"Soul Fire\" and \"Soul Sand\" items.\n- Player surfaces onto a sandy beach, then opens inventory to access tools and items, including a \"Soul Fire\" and \"Soul Sand\" in the chest.\n- Player looks toward a distant tower structure on the horizon while holding a pickaxe, with a lava flow visible nearby.\n[930-960s] - Player opens inventory, showing various items including tools and food, with a crafting grid visible.\n- Player navigates to a crafting table, selecting materials to craft items, with a crafting grid displaying item recipes.\n- Player interacts with a chest labeled \"Chest\" in a wooden structure, accessing stored items.", "history_tokens": 947, "history_utf8_bytes": 3968, "recent_frame_times_s": [942.0077333333334, 943.0087333333333, 944.0097333333333, 945.0107333333333, 946.0117333333334, 947.0127333333334, 948.0137333333333, 949.0147333333333, 950.0157333333333, 951.00005, 952.00105, 953.00205, 954.00305, 955.00405, 956.00505, 957.00605, 958.00705, 959.00805, 960.00905, 961.01005, 962.01105, 963.01205, 964.01305, 965.01405, 966.01505, 967.01605, 968.0003666666667, 969.0013666666666, 970.0023666666667, 971.0033666666667], "recent_frames_sha256": "2d5b0a011152f0838876f318a1554959a0fc931e664147892bebdbdb874066f3", "num_recent_frames": 30, "tq": 718984.414621544, "t1": 718997.188256725, "ta": 718997.188256725, "te": 718997.22726233, "first_response_s": 12.773635181016289, "answer_total_s": 12.812640786054544, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 200, "content_group": "1898df3688f1844d9b05ffea0973f4290187cf4ea4b7167b6e53b5957ae09670", "question": {"question_id": "sample_200_a119_q0", "video_id": 200, "video_path": "./videos/sample_200_real.mp4", "annotation_index": 119, "question_index": 0, "question": "What can be seen on the left side of the wooden house at the beginning of the video?", "options": ["A. A waterfall.", "B. A village.", "C. A tower.", "D. A cave opening."], "answer": "D", "time_stamp_s": 20, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "minecraft", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_200_a119_q0", "video_id": 200, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "664432280e1cd5243da14b6566e4828d144a21160841845d1ff22e79cb0292e4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "7ae791bdf7eeac945e3e20af95a476d775d3c677e9bbfbfcdeab93ede5fd4839", "num_recent_frames": 21, "tq": 710574.030737872, "t1": 710575.093356641, "ta": 710575.093356641, "te": 710575.130322098, "first_response_s": 1.0626187690068036, "answer_total_s": 1.0995842260308564, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_200_a119_q0", "video_id": 200, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c29cc47d23f3cdce75560b9fa3af21a5bdda49b5750de9fe7c88e307cdd6c897", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "7ae791bdf7eeac945e3e20af95a476d775d3c677e9bbfbfcdeab93ede5fd4839", "num_recent_frames": 21, "tq": 710366.387743559, "t1": 710372.735037934, "ta": 710372.735037934, "te": 710372.88997889, "first_response_s": 6.347294375067577, "answer_total_s": 6.502235330990516, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 200, "content_group": "1898df3688f1844d9b05ffea0973f4290187cf4ea4b7167b6e53b5957ae09670", "question": {"question_id": "sample_200_a120_q0", "video_id": 200, "video_path": "./videos/sample_200_real.mp4", "annotation_index": 120, "question_index": 0, "question": "What action does the player take towards the cow standing in the grassy area?", "options": ["A. Feeds the cow.", "B. Leads the cow to water.", "C. Ties the cow to a tree.", "D. Hits the cow with a sword."], "answer": "D", "time_stamp_s": 207, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_200_a120_q0", "video_id": 200, "time_stamp_s": 207, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8bf2d74641e1683324931641de4f78b63dcbf3036576d975738853f70b035f94", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0], "recent_frames_sha256": "f4c6f895ae2af034af838dd7ecdb9889a77b4393df560aa313ee59b1bf065ad1", "num_recent_frames": 30, "tq": 710575.150964567, "t1": 710586.318911469, "ta": 710586.318911469, "te": 710586.504523099, "first_response_s": 11.167946901987307, "answer_total_s": 11.35355853207875, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_200_a120_q0", "video_id": 200, "time_stamp_s": 207, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cbf461c5105e6349a862205d69ce87177184f14330ca575e591acb6cd1075f86", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A Minecraft character stands on a wooden dock near a river, with a small wooden house built into a cliffside behind them.  \n- The camera pans to show the interior of the house, revealing a brick fireplace and a furnace.  \n- The character walks along the dock, passing wooden barrels and a small wooden structure, with the house and surrounding landscape visible in the background.\n[30-60s] - Player enters a wooden structure, opens a large chest, and selects jungle planks from inventory.\n- Player exits the structure, approaches a cave entrance, and encounters a zombie holding an iron axe.\n- Player moves through the cave, passing a glowing green block and a creeper, then returns to the wooden structure.\n[60-90s] - Player holds torch, illuminating dark cave with stone walls and torches.\n- Player moves toward a large, dark, open area with a visible Enderman in the distance.\n- Player switches to stone sword, then bread, then torch, indicating tool changes while navigating the cave.\n[90-120s] - Player approaches a wooden door in a dimly lit underground structure, then opens it to reveal a dark, narrow passage.\n- Player drops a stone hoe and iron axe on the ground, then picks up a bread item before moving forward.\n- Player descends into a deep, shadowy tunnel with visible torchlight illuminating parts of the walls and ceiling.\n[120-150s] - Player approaches a glowing purple portal in a dark cave, with torches illuminating nearby stone walls.  \n- Player moves toward a small pool of water near a blue pillar, then proceeds to a narrow passage with a redstone torch.  \n- Player looks up at a tall, dark structure with a glowing orange light at its top, suggesting a vertical climb or passage ahead.\n[150-180s] - Player switches to iron pickaxe, then moves to a wooden dock near water.  \n- Player opens large chest, revealing diamonds and other items, then accesses inventory.  \n- Player attempts to craft an item using a crafting grid, but the action results in a \"Boom!\" sound effect.", "history_tokens": 457, "history_utf8_bytes": 2007, "recent_frame_times_s": [178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0], "recent_frames_sha256": "f4c6f895ae2af034af838dd7ecdb9889a77b4393df560aa313ee59b1bf065ad1", "num_recent_frames": 30, "tq": 710416.422431971, "t1": 710422.639812261, "ta": 710422.639812261, "te": 710422.679130061, "first_response_s": 6.21738029003609, "answer_total_s": 6.256698090001009, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 200, "content_group": "1898df3688f1844d9b05ffea0973f4290187cf4ea4b7167b6e53b5957ae09670", "question": {"question_id": "sample_200_a121_q0", "video_id": 200, "video_path": "./videos/sample_200_real.mp4", "annotation_index": 121, "question_index": 0, "question": "What is the box supported by right now?", "options": ["A. Wood floor.", "B. soil block.", "C. stone.", "D. Nothing."], "answer": "D", "time_stamp_s": 416, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_200_a121_q0", "video_id": 200, "time_stamp_s": 416, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d918aff9cbb50a51ce65e606d4dcc0de33c7f7f1555666984a2498cd0ee3deef", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0], "recent_frames_sha256": "f3178b1a6de4ee438f1ee23b4e3b1d021c15141a76301bb1e934433771b5d30d", "num_recent_frames": 30, "tq": 710586.526994905, "t1": 710594.013953991, "ta": 710594.013953991, "te": 710594.051128997, "first_response_s": 7.486959086032584, "answer_total_s": 7.524134092032909, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_200_a121_q0", "video_id": 200, "time_stamp_s": 416, "ground_truth": "D", "raw_output": "C. stone.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "c61c497b88edba6eb634e3e579c4a77621c627cafe26edd2f70b984b65b1d1c2", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A Minecraft character stands on a wooden dock near a river, with a small wooden house built into a cliffside behind them.  \n- The camera pans to show the interior of the house, revealing a brick fireplace and a furnace.  \n- The character walks along the dock, passing wooden barrels and a small wooden structure, with the house and surrounding landscape visible in the background.\n[30-60s] - Player enters a wooden structure, opens a large chest, and selects jungle planks from inventory.\n- Player exits the structure, approaches a cave entrance, and encounters a zombie holding an iron axe.\n- Player moves through the cave, passing a glowing green block and a creeper, then returns to the wooden structure.\n[60-90s] - Player holds torch, illuminating dark cave with stone walls and torches.\n- Player moves toward a large, dark, open area with a visible Enderman in the distance.\n- Player switches to stone sword, then bread, then torch, indicating tool changes while navigating the cave.\n[90-120s] - Player approaches a wooden door in a dimly lit underground structure, then opens it to reveal a dark, narrow passage.\n- Player drops a stone hoe and iron axe on the ground, then picks up a bread item before moving forward.\n- Player descends into a deep, shadowy tunnel with visible torchlight illuminating parts of the walls and ceiling.\n[120-150s] - Player approaches a glowing purple portal in a dark cave, with torches illuminating nearby stone walls.  \n- Player moves toward a small pool of water near a blue pillar, then proceeds to a narrow passage with a redstone torch.  \n- Player looks up at a tall, dark structure with a glowing orange light at its top, suggesting a vertical climb or passage ahead.\n[150-180s] - Player switches to iron pickaxe, then moves to a wooden dock near water.  \n- Player opens large chest, revealing diamonds and other items, then accesses inventory.  \n- Player attempts to craft an item using a crafting grid, but the action results in a \"Boom!\" sound effect.\n[180-210s] - Player enters a wooden house with a lantern and chest visible inside.  \n- Player exits the house, stepping onto a wooden platform overlooking water.  \n- Player moves toward a grassy field where a cow and a sheep are visible.\n[210-240s] - Player opens chest, revealing items including a \"Chest\" slot and \"Inventory\" with various tools and blocks.\n- Player switches to crafting interface, placing items like \"Cactus\" and \"Cactus\" into the crafting grid to create \"Cactus\" items.\n- Player's health bar shows 30 hearts, and the player is holding a \"Sword\" with a \"Sword\" in the inventory.\n[240-270s] - Player holds a diamond pickaxe with Unbreaking III enchantment, visible in inventory at 2:49.\n- Player moves toward a bookshelf, then opens the crafting menu at 2:43.\n- Player interacts with a chest, then opens the enchanting interface at 2:47.\n[270-300s] - Player opens an enchantment table interface showing \"Enchanted Pickaxe\" with \"Unbreaking III\" and \"Mending\" enchantments.\n- Player exits the house, entering a dark underground cave with stone blocks and a visible water source nearby.\n- Player approaches a wooden door inside the house, which leads to a room with a furnace and crafting table.\n[300-330s] - Player navigates a dimly lit underground cave with water flowing nearby, using torches for illumination.\n- Player moves through narrow passages, occasionally stepping on water or over stone blocks.\n- Player’s inventory is visible, showing tools and items, with health and hunger bars displayed at the bottom.\n[330-360s] - Player holds an iron sword and approaches a chest with torches nearby.  \n- Player opens the chest, revealing items like coal, iron ingots, and food.  \n- Player then opens the crafting table, showing a diamond pickaxe and other tools.\n[360-390s] - Player holds a purple sword and moves through a dark, stone-walled cave with torches illuminating parts of the path.\n- Player opens inventory at 379s, revealing items like tools, food, and a chest, then closes it to continue exploring.\n- Player ascends a tall, narrow stone staircase leading upward into a brighter, open area with more torches and a visible ceiling.", "history_tokens": 990, "history_utf8_bytes": 4170, "recent_frame_times_s": [387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0], "recent_frames_sha256": "f3178b1a6de4ee438f1ee23b4e3b1d021c15141a76301bb1e934433771b5d30d", "num_recent_frames": 30, "tq": 710474.551810246, "t1": 710475.49127646, "ta": 710475.49127646, "te": 710475.638732011, "first_response_s": 0.9394662140402943, "answer_total_s": 1.0869217650033534, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 200, "content_group": "1898df3688f1844d9b05ffea0973f4290187cf4ea4b7167b6e53b5957ae09670", "question": {"question_id": "sample_200_a122_q0", "video_id": 200, "video_path": "./videos/sample_200_real.mp4", "annotation_index": 122, "question_index": 0, "question": "What happens when the player encounters the small creature wearing purple armor?", "options": ["A. The creature attacks the player.", "B. The player hit the creature.", "C. The player kill the creature.", "D. The player left without doing anything."], "answer": "D", "time_stamp_s": 625, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "minecraft", "reference_interval_s": [600, 660], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_200_a122_q0", "video_id": 200, "time_stamp_s": 625, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "00ff20c7aafaa809150f3bd87c96546061b005069aa86b647e7528c8fcc9903a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [596.0, 597.0, 598.0, 599.0, 600.0, 601.0, 602.0, 603.0, 604.0, 605.0, 606.0, 607.0, 608.0, 609.0, 610.0, 611.0, 612.0, 613.0, 614.0, 615.0, 616.0, 617.0, 618.0, 619.0, 620.0, 621.0, 622.0, 623.0, 624.0, 625.0], "recent_frames_sha256": "0d16dec37dd47b5f5f66cae39849dba642268d3280499b48cf282648f0266db0", "num_recent_frames": 30, "tq": 710594.06777604, "t1": 710602.675086981, "ta": 710602.675086981, "te": 710602.932788287, "first_response_s": 8.607310940977186, "answer_total_s": 8.865012246998958, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_200_a122_q0", "video_id": 200, "time_stamp_s": 625, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4f9ff07f8bcbb4bd5d1b77b07bfd486c672e7b56953e825ee0c23adb9bf97b22", "condition_order": ["notes", "recent"], "memory": "[210-240s] - Player opens chest, revealing items including a \"Chest\" slot and \"Inventory\" with various tools and blocks.\n- Player switches to crafting interface, placing items like \"Cactus\" and \"Cactus\" into the crafting grid to create \"Cactus\" items.\n- Player's health bar shows 30 hearts, and the player is holding a \"Sword\" with a \"Sword\" in the inventory.\n[240-270s] - Player holds a diamond pickaxe with Unbreaking III enchantment, visible in inventory at 2:49.\n- Player moves toward a bookshelf, then opens the crafting menu at 2:43.\n- Player interacts with a chest, then opens the enchanting interface at 2:47.\n[270-300s] - Player opens an enchantment table interface showing \"Enchanted Pickaxe\" with \"Unbreaking III\" and \"Mending\" enchantments.\n- Player exits the house, entering a dark underground cave with stone blocks and a visible water source nearby.\n- Player approaches a wooden door inside the house, which leads to a room with a furnace and crafting table.\n[300-330s] - Player navigates a dimly lit underground cave with water flowing nearby, using torches for illumination.\n- Player moves through narrow passages, occasionally stepping on water or over stone blocks.\n- Player’s inventory is visible, showing tools and items, with health and hunger bars displayed at the bottom.\n[330-360s] - Player holds an iron sword and approaches a chest with torches nearby.  \n- Player opens the chest, revealing items like coal, iron ingots, and food.  \n- Player then opens the crafting table, showing a diamond pickaxe and other tools.\n[360-390s] - Player holds a purple sword and moves through a dark, stone-walled cave with torches illuminating parts of the path.\n- Player opens inventory at 379s, revealing items like tools, food, and a chest, then closes it to continue exploring.\n- Player ascends a tall, narrow stone staircase leading upward into a brighter, open area with more torches and a visible ceiling.\n[390-420s] - Player enters a cavern with purple blocks and torches, then ascends via wooden stairs.  \n- A wooden chest is suspended above the player’s head, indicating a vertical structure.  \n- The player moves to a wooden-floored area with torches and redstone blocks, suggesting a constructed interior.\n[420-450s] - Player moves through a dimly lit underground room with wooden floors and stone walls, passing torches and chests.  \n- A purple glowing block (possibly a purple shulker box or similar) is visible on a wooden platform near the center.  \n- The player approaches a tall wooden pillar or structure, with a staircase or ramp leading upward to a higher level.\n[450-480s] - Player moves through a dimly lit underground structure with stone and wooden walls, carrying a torch and a sword.  \n- A purple glowing block (possibly a portal or magical structure) is visible in the distance, with a small fire nearby.  \n- The player approaches a wooden platform with a central stone structure, then turns left toward a staircase leading upward.\n[480-510s] - Player moves through a stone-walled underground structure with torches and purple ore deposits.  \n- Player exits the underground area into a grassy outdoor environment with a dirt block and a blue creature nearby.  \n- Player’s inventory shows a wooden sword and other tools, with health and hunger bars visible.\n[510-540s] - Player holds a diamond pickaxe and approaches a dark, blocky structure (possibly a Nether portal) embedded in stone.  \n- Player then moves upward, revealing a grassy, mountainous landscape with trees and flowers, and switches to a water bucket.  \n- Player looks toward a distant body of water, with a bucket in hand, suggesting preparation to interact with the environment.\n[540-570s] - Player holds water bucket, standing on a grassy island with water bodies nearby.  \n- Player enters a Nether dimension, encountering red Nether bricks and lava flows.  \n- Player equips an iron sword and navigates through a Nether fortress with glowing structures.\n[570-600s] - Player switches to a diamond pickaxe and mines gold ore in a redstone-rich cavern.\n- A \"New Recipes Unlocked\" notification appears after mining, indicating recipe acquisition.\n- Player drops a \"Soul Shovel\" item, suggesting a tool change or inventory management action.", "history_tokens": 1005, "history_utf8_bytes": 4246, "recent_frame_times_s": [596.0, 597.0, 598.0, 599.0, 600.0, 601.0, 602.0, 603.0, 604.0, 605.0, 606.0, 607.0, 608.0, 609.0, 610.0, 611.0, 612.0, 613.0, 614.0, 615.0, 616.0, 617.0, 618.0, 619.0, 620.0, 621.0, 622.0, 623.0, 624.0, 625.0], "recent_frames_sha256": "0d16dec37dd47b5f5f66cae39849dba642268d3280499b48cf282648f0266db0", "num_recent_frames": 30, "tq": 710534.812378521, "t1": 710536.804283843, "ta": 710536.804283843, "te": 710537.066413937, "first_response_s": 1.991905322065577, "answer_total_s": 2.254035416059196, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 200, "content_group": "1898df3688f1844d9b05ffea0973f4290187cf4ea4b7167b6e53b5957ae09670", "question": {"question_id": "sample_200_a123_q0", "video_id": 200, "video_path": "./videos/sample_200_real.mp4", "annotation_index": 123, "question_index": 0, "question": "What is the player character holding in his left hand right now?", "options": ["A. A beef steak.", "B. A sword.", "C. A red item.", "D. A shield."], "answer": "D", "time_stamp_s": 755, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "minecraft", "reference_interval_s": [720, 762], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_200_a123_q0", "video_id": 200, "time_stamp_s": 755, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "aefec6cc3f3c245f99ef6e3f25cc2a2076954207c4270d6c0680f0c609ce1fb7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [726.0, 727.0, 728.0, 729.0, 730.0, 731.0, 732.0, 733.0, 734.0, 735.0, 736.0, 737.0, 738.0, 739.0, 740.0, 741.0, 742.0, 743.0, 744.0, 745.0, 746.0, 747.0, 748.0, 749.0, 750.0, 751.0, 752.0, 753.0, 754.0, 755.0], "recent_frames_sha256": "287af10b88bbc308d1a6c4b19ea15eda96067d617611f08f7bfdd6de0efab6c2", "num_recent_frames": 30, "tq": 710602.949391972, "t1": 710617.062615597, "ta": 710617.062615597, "te": 710617.100178418, "first_response_s": 14.113223624997772, "answer_total_s": 14.150786445941776, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_200_a123_q0", "video_id": 200, "time_stamp_s": 755, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "88293ff198f146b400580c0af068c21e2bf1b6e13dda647126aa258691e4503d", "condition_order": ["notes", "recent"], "memory": "[360-390s] - Player holds a purple sword and moves through a dark, stone-walled cave with torches illuminating parts of the path.\n- Player opens inventory at 379s, revealing items like tools, food, and a chest, then closes it to continue exploring.\n- Player ascends a tall, narrow stone staircase leading upward into a brighter, open area with more torches and a visible ceiling.\n[390-420s] - Player enters a cavern with purple blocks and torches, then ascends via wooden stairs.  \n- A wooden chest is suspended above the player’s head, indicating a vertical structure.  \n- The player moves to a wooden-floored area with torches and redstone blocks, suggesting a constructed interior.\n[420-450s] - Player moves through a dimly lit underground room with wooden floors and stone walls, passing torches and chests.  \n- A purple glowing block (possibly a purple shulker box or similar) is visible on a wooden platform near the center.  \n- The player approaches a tall wooden pillar or structure, with a staircase or ramp leading upward to a higher level.\n[450-480s] - Player moves through a dimly lit underground structure with stone and wooden walls, carrying a torch and a sword.  \n- A purple glowing block (possibly a portal or magical structure) is visible in the distance, with a small fire nearby.  \n- The player approaches a wooden platform with a central stone structure, then turns left toward a staircase leading upward.\n[480-510s] - Player moves through a stone-walled underground structure with torches and purple ore deposits.  \n- Player exits the underground area into a grassy outdoor environment with a dirt block and a blue creature nearby.  \n- Player’s inventory shows a wooden sword and other tools, with health and hunger bars visible.\n[510-540s] - Player holds a diamond pickaxe and approaches a dark, blocky structure (possibly a Nether portal) embedded in stone.  \n- Player then moves upward, revealing a grassy, mountainous landscape with trees and flowers, and switches to a water bucket.  \n- Player looks toward a distant body of water, with a bucket in hand, suggesting preparation to interact with the environment.\n[540-570s] - Player holds water bucket, standing on a grassy island with water bodies nearby.  \n- Player enters a Nether dimension, encountering red Nether bricks and lava flows.  \n- Player equips an iron sword and navigates through a Nether fortress with glowing structures.\n[570-600s] - Player switches to a diamond pickaxe and mines gold ore in a redstone-rich cavern.\n- A \"New Recipes Unlocked\" notification appears after mining, indicating recipe acquisition.\n- Player drops a \"Soul Shovel\" item, suggesting a tool change or inventory management action.\n[600-630s] - Player holds a diamond pickaxe and mines red netherrack blocks in a dimly lit Nether cave.\n- A pig with a purple saddle is visible nearby, standing still on the ground.\n- Player switches to a harvester tool and begins mining a purple nether quartz block.\n[630-660s] - Player opens chest, revealing diamond pickaxe and other items, then selects the diamond pickaxe.  \n- Player moves to a dark, brick-walled area, holding a diamond pickaxe, with a wooden plank visible nearby.  \n- Player’s inventory shows a diamond pickaxe, and a crafting table is visible in the background.\n[660-690s] - Player opens inventory, showing diamond pickaxe with 723 durability out of 1561.  \n- Player approaches a wandering trader, viewing trade options including iron armor and enchanted items.  \n- Player switches to iron sword, then moves toward a wooden structure with purple flowers, possibly a shop or base.\n[690-720s] - Player views a large purple crystal formation embedded in stone walls, with stairs leading up to it.  \n- The player moves around the room, revealing wooden floors, stone pillars, and torches illuminating the space.  \n- A staircase leads to an upper level, with a wooden door visible at the far end of the room.\n[720-750s] - Player views a wooden interior with stone walls, torches, and a purple flower on a wooden platform.  \n- A chat message from \"Minecraft\" appears, asking for a \"good spark\" and \"more for the last point.\"  \n- Player turns to face a stone wall with a small, unlit torch on the left side.", "history_tokens": 999, "history_utf8_bytes": 4229, "recent_frame_times_s": [726.0, 727.0, 728.0, 729.0, 730.0, 731.0, 732.0, 733.0, 734.0, 735.0, 736.0, 737.0, 738.0, 739.0, 740.0, 741.0, 742.0, 743.0, 744.0, 745.0, 746.0, 747.0, 748.0, 749.0, 750.0, 751.0, 752.0, 753.0, 754.0, 755.0], "recent_frames_sha256": "287af10b88bbc308d1a6c4b19ea15eda96067d617611f08f7bfdd6de0efab6c2", "num_recent_frames": 30, "tq": 710572.116888091, "t1": 710573.673709786, "ta": 710573.673709786, "te": 710573.973406701, "first_response_s": 1.5568216950632632, "answer_total_s": 1.856518610031344, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 201, "content_group": "dd5ae72b3e9f3902137e5a084c51f6128a3805834c20cad819c74823222785ac", "question": {"question_id": "sample_201_a1050_q0", "video_id": 201, "video_path": "./videos/sample_201_real.mp4", "annotation_index": 1050, "question_index": 0, "question": "What action is the hand performing on the train?", "options": ["A. Lifting the train.", "B. Assembling the train.", "C. Painting the train.", "D. Push the train to the right."], "answer": "D", "time_stamp_s": 12, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_201_a1050_q0", "video_id": 201, "time_stamp_s": 12, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e294bd25dcf231c020958889366643f5b1f13d2c2e601bca8da5edb1f855e526", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0], "recent_frames_sha256": "aece87f34d01f86d6fbfd66d746bf5b70f3eebf1f579a8aa46cba09f6ac0dc97", "num_recent_frames": 13, "tq": 716586.529685501, "t1": 716586.68211963, "ta": 716586.68211963, "te": 716586.827974182, "first_response_s": 0.15243412903510034, "answer_total_s": 0.2982886809622869, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_201_a1050_q0", "video_id": 201, "time_stamp_s": 12, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d0c80ed566ecc15a8087646fe7f7c6ae674659d6b92ecd1f3084eec914c4cbde", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0], "recent_frames_sha256": "aece87f34d01f86d6fbfd66d746bf5b70f3eebf1f579a8aa46cba09f6ac0dc97", "num_recent_frames": 13, "tq": 716488.311898972, "t1": 716500.375996317, "ta": 716500.375996317, "te": 716500.413976226, "first_response_s": 12.064097344991751, "answer_total_s": 12.102077253977768, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 201, "content_group": "dd5ae72b3e9f3902137e5a084c51f6128a3805834c20cad819c74823222785ac", "question": {"question_id": "sample_201_a1051_q0", "video_id": 201, "video_path": "./videos/sample_201_real.mp4", "annotation_index": 1051, "question_index": 0, "question": "What color Lego brick is placed first on the surface?", "options": ["A. Blue.", "B. Green.", "C. Red.", "D. Yellow."], "answer": "D", "time_stamp_s": 63, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_201_a1051_q0", "video_id": 201, "time_stamp_s": 63, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "da2da82306e990d7a321dd6dffd17a74601f3e1e4edaaa1792d439d87e5db8f8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [34.0, 35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0], "recent_frames_sha256": "9212b4c7bb64c3e75f5694d25a39433bab112dc1adbbc4418ab44b4d8edc2754", "num_recent_frames": 30, "tq": 716586.838194957, "t1": 716597.856103232, "ta": 716597.856103232, "te": 716597.89324848, "first_response_s": 11.017908275010996, "answer_total_s": 11.05505352304317, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_201_a1051_q0", "video_id": 201, "time_stamp_s": 63, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "177b47db65b00686aff74ddc7f683a2c6d889a9c3fbbba6f878f2e5109778144", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand manipulates a colorful LEGO train on a striped track, adjusting its position.  \n- The train, composed of multicolored bricks, has wheels and a chimney-like structure.  \n- A single yellow LEGO brick is placed on the white surface, separate from the train.\n[30-60s] - A hand manipulates yellow LEGO bricks, arranging them in a linear pattern on a white surface.  \n- The hand repeatedly adjusts the position of the bricks, sometimes lifting or sliding them to form a longer row.  \n- The bricks remain connected in a single continuous line throughout the sequence.", "history_tokens": 130, "history_utf8_bytes": 577, "recent_frame_times_s": [34.0, 35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0], "recent_frames_sha256": "9212b4c7bb64c3e75f5694d25a39433bab112dc1adbbc4418ab44b4d8edc2754", "num_recent_frames": 30, "tq": 716518.874684111, "t1": 716526.492888081, "ta": 716526.492888081, "te": 716526.768867365, "first_response_s": 7.618203970021568, "answer_total_s": 7.89418325398583, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 201, "content_group": "dd5ae72b3e9f3902137e5a084c51f6128a3805834c20cad819c74823222785ac", "question": {"question_id": "sample_201_a1052_q1", "video_id": 201, "video_path": "./videos/sample_201_real.mp4", "annotation_index": 1052, "question_index": 1, "question": "How many colors of bricks have been used so far?", "options": ["A. Two.", "B. Three.", "C. Four.", "D. Five."], "answer": "C", "time_stamp_s": 139, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_201_a1052_q1", "video_id": 201, "time_stamp_s": 139, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d0ad70b75c4047c1c8f2ed7d1810101de5fb504536dc18b7c9a41b6241f1ade9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0], "recent_frames_sha256": "91aea8dea93931e9362baf1f08e66a43a77bcea4d24871fc0e2d6c580028dcd9", "num_recent_frames": 30, "tq": 716597.901476783, "t1": 716608.840181675, "ta": 716608.840181675, "te": 716608.876519293, "first_response_s": 10.93870489206165, "answer_total_s": 10.975042509962805, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_201_a1052_q1", "video_id": 201, "time_stamp_s": 139, "ground_truth": "C", "raw_output": "C. Four.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "2fdc941b8b72f907770edf94d8d2c8ef71b5892621d3aa39fe5d764bda93f209", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand manipulates a colorful LEGO train on a striped track, adjusting its position.  \n- The train, composed of multicolored bricks, has wheels and a chimney-like structure.  \n- A single yellow LEGO brick is placed on the white surface, separate from the train.\n[30-60s] - A hand manipulates yellow LEGO bricks, arranging them in a linear pattern on a white surface.  \n- The hand repeatedly adjusts the position of the bricks, sometimes lifting or sliding them to form a longer row.  \n- The bricks remain connected in a single continuous line throughout the sequence.\n[60-90s] - A hand places a green block onto a yellow baseplate, then adds a blue block on top of the green one.  \n- The hand then positions a yellow block adjacent to the blue block, completing a small structure.  \n- The green and blue blocks are stacked vertically, with the yellow block placed to their right.\n[90-120s] - Hand places orange bricks atop green and blue base blocks, forming a stacked structure.  \n- Hand then adds a green brick to the side of the existing structure.  \n- A yellow baseplate extends horizontally beneath the assembled blocks.", "history_tokens": 258, "history_utf8_bytes": 1135, "recent_frame_times_s": [110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0], "recent_frames_sha256": "91aea8dea93931e9362baf1f08e66a43a77bcea4d24871fc0e2d6c580028dcd9", "num_recent_frames": 30, "tq": 716544.814559584, "t1": 716552.095795839, "ta": 716552.095795839, "te": 716552.244182087, "first_response_s": 7.281236254959367, "answer_total_s": 7.429622502997518, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 201, "content_group": "dd5ae72b3e9f3902137e5a084c51f6128a3805834c20cad819c74823222785ac", "question": {"question_id": "sample_201_a1052_q0", "video_id": 201, "video_path": "./videos/sample_201_real.mp4", "annotation_index": 1052, "question_index": 0, "question": "What was the sequence of actions performed by the hand just now?", "options": ["A. Placing orange and green bricks, adding blue bricks, extending the yellow base.", "B. Adding green bricks for the roof, extending the yellow base, expanding the structure to the right.", "C. Starting with blue bricks, adding a rooftop, then dismantling it.", "D. Completing the structure and then painting it."], "answer": "B", "time_stamp_s": 149, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_201_a1052_q0", "video_id": 201, "time_stamp_s": 149, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3fda9678233c6811afd9cd061fcbbca55b984a48ca83321be3f2952355da01c7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0], "recent_frames_sha256": "9e992f6fb4029d43309cb4dfbf3091b12e95d462fa5a369ab4fc784f73828e6e", "num_recent_frames": 30, "tq": 716608.884841417, "t1": 716616.336737922, "ta": 716616.336737922, "te": 716616.373622434, "first_response_s": 7.451896505081095, "answer_total_s": 7.488781017018482, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_201_a1052_q0", "video_id": 201, "time_stamp_s": 149, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1064aa10356ea0b9d896eb46a187ee86bc0946fc68bb6734d782647464d09f85", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand manipulates a colorful LEGO train on a striped track, adjusting its position.  \n- The train, composed of multicolored bricks, has wheels and a chimney-like structure.  \n- A single yellow LEGO brick is placed on the white surface, separate from the train.\n[30-60s] - A hand manipulates yellow LEGO bricks, arranging them in a linear pattern on a white surface.  \n- The hand repeatedly adjusts the position of the bricks, sometimes lifting or sliding them to form a longer row.  \n- The bricks remain connected in a single continuous line throughout the sequence.\n[60-90s] - A hand places a green block onto a yellow baseplate, then adds a blue block on top of the green one.  \n- The hand then positions a yellow block adjacent to the blue block, completing a small structure.  \n- The green and blue blocks are stacked vertically, with the yellow block placed to their right.\n[90-120s] - Hand places orange bricks atop green and blue base blocks, forming a stacked structure.  \n- Hand then adds a green brick to the side of the existing structure.  \n- A yellow baseplate extends horizontally beneath the assembled blocks.", "history_tokens": 258, "history_utf8_bytes": 1135, "recent_frame_times_s": [120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0], "recent_frames_sha256": "9e992f6fb4029d43309cb4dfbf3091b12e95d462fa5a369ab4fc784f73828e6e", "num_recent_frames": 30, "tq": 716552.262231316, "t1": 716563.388972381, "ta": 716563.388972381, "te": 716563.538593962, "first_response_s": 11.126741065061651, "answer_total_s": 11.27636264602188, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 201, "content_group": "dd5ae72b3e9f3902137e5a084c51f6128a3805834c20cad819c74823222785ac", "question": {"question_id": "sample_201_a1053_q0", "video_id": 201, "video_path": "./videos/sample_201_real.mp4", "annotation_index": 1053, "question_index": 0, "question": "What type of pieces did the hand attach to the top surface of the structure just now?", "options": ["A. Square pieces.", "B. Triangular pieces.", "C. Rectangular pieces.", "D. Circular pieces resembling wheels."], "answer": "D", "time_stamp_s": 205, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_201_a1053_q0", "video_id": 201, "time_stamp_s": 205, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "48949d8c4ee281bbba0a87d69734a36a098764be86f4a920ba93b5c5ca4291fc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0], "recent_frames_sha256": "d404e3067459443f480002d59fb47fb8a1672c9c106cb362b723a7d5110574e0", "num_recent_frames": 30, "tq": 716616.383808126, "t1": 716624.777529607, "ta": 716624.777529607, "te": 716624.815778621, "first_response_s": 8.393721480970271, "answer_total_s": 8.431970495032147, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_201_a1053_q0", "video_id": 201, "time_stamp_s": 205, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "82c94cd8d3ae40c05cffa0dbac975722e2ad6d48503f09075324233069003440", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand manipulates a colorful LEGO train on a striped track, adjusting its position.  \n- The train, composed of multicolored bricks, has wheels and a chimney-like structure.  \n- A single yellow LEGO brick is placed on the white surface, separate from the train.\n[30-60s] - A hand manipulates yellow LEGO bricks, arranging them in a linear pattern on a white surface.  \n- The hand repeatedly adjusts the position of the bricks, sometimes lifting or sliding them to form a longer row.  \n- The bricks remain connected in a single continuous line throughout the sequence.\n[60-90s] - A hand places a green block onto a yellow baseplate, then adds a blue block on top of the green one.  \n- The hand then positions a yellow block adjacent to the blue block, completing a small structure.  \n- The green and blue blocks are stacked vertically, with the yellow block placed to their right.\n[90-120s] - Hand places orange bricks atop green and blue base blocks, forming a stacked structure.  \n- Hand then adds a green brick to the side of the existing structure.  \n- A yellow baseplate extends horizontally beneath the assembled blocks.\n[120-150s] - Hand places green brick atop existing structure, then adds yellow bricks to extend the base.  \n- Yellow base bricks are systematically aligned and pressed into place, forming a continuous foundation.  \n- Structure remains static on a white surface with a beige wall in the background.\n[150-180s] - Hand places orange brick atop green structure, then adds blue brick beside it.  \n- Green bricks are stacked on top of orange base, forming a layered structure.  \n- Orange bricks are positioned on the right side of the yellow base, adjacent to green blocks.", "history_tokens": 384, "history_utf8_bytes": 1703, "recent_frame_times_s": [176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0], "recent_frames_sha256": "d404e3067459443f480002d59fb47fb8a1672c9c106cb362b723a7d5110574e0", "num_recent_frames": 30, "tq": 716581.533733292, "t1": 716586.480248375, "ta": 716586.480248375, "te": 716586.516822799, "first_response_s": 4.946515082963742, "answer_total_s": 4.983089506975375, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 202, "content_group": "cef4d37f6bc2fe533d8c3264d1f00cc47dccdf3fe92b06113150966d8acfa668", "question": {"question_id": "sample_202_a2073_q0", "video_id": 202, "video_path": "./videos/sample_202_real.mp4", "annotation_index": 2073, "question_index": 0, "question": "What colors are the wheels of the race car?", "options": ["A. Green and blue.", "B. Red and blue.", "C. Yellow and Red.", "D. Brown."], "answer": "C", "time_stamp_s": 12, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_202_a2073_q0", "video_id": 202, "time_stamp_s": 12, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8874355b07f0635f3028aa8bc54929b71c900279cca518ee8e60a79a20591b8c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0], "recent_frames_sha256": "94044cf056abd41a6dd2d40aae16801c75886040a647638c42189530cea86d2f", "num_recent_frames": 13, "tq": 717890.358747853, "t1": 717897.509137915, "ta": 717897.509137915, "te": 717897.548548545, "first_response_s": 7.150390062015504, "answer_total_s": 7.189800692023709, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_202_a2073_q0", "video_id": 202, "time_stamp_s": 12, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "01621f214b3f0183633580ca5594d04c0d5d22306815a2eb167f5aa65ac7e6f0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0], "recent_frames_sha256": "94044cf056abd41a6dd2d40aae16801c75886040a647638c42189530cea86d2f", "num_recent_frames": 13, "tq": 717946.48686606, "t1": 717947.971450774, "ta": 717947.971450774, "te": 717948.126925361, "first_response_s": 1.4845847140531987, "answer_total_s": 1.640059301047586, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 202, "content_group": "cef4d37f6bc2fe533d8c3264d1f00cc47dccdf3fe92b06113150966d8acfa668", "question": {"question_id": "sample_202_a2074_q0", "video_id": 202, "video_path": "./videos/sample_202_real.mp4", "annotation_index": 2074, "question_index": 0, "question": "What feature is present on the front of the toy?", "options": ["A. A sad face.", "B. A happy face.", "C. A star.", "D. A heart."], "answer": "B", "time_stamp_s": 72, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_202_a2074_q0", "video_id": 202, "time_stamp_s": 72, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "437894bacfc854e93f84414bd41be1357e9f030473e53d9ab6c8ba04f783d90b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0], "recent_frames_sha256": "8144b1f21264981716970f657278c6a2714c33bad543743784fb8dd9ffc81c7e", "num_recent_frames": 30, "tq": 717897.569254938, "t1": 717910.220387385, "ta": 717910.220387385, "te": 717910.259549551, "first_response_s": 12.651132446946576, "answer_total_s": 12.69029461289756, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_202_a2074_q0", "video_id": 202, "time_stamp_s": 72, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c95155fba45a6b76a81c01bbe83849cedd91d8d466465b8c65239129a883c900", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand assembles a yellow and blue race car from interlocking blocks, adding green and orange pieces to form a detailed vehicle.  \n- A separate hand constructs a mini truck using green, yellow, and blue blocks, then places a small figurine on its bed.  \n- The mini truck is later shown with the figurine seated on it, positioned on a white surface against a yellow wall, with the word \"playtime\" appearing on screen.\n[30-60s] - Hand places yellow blocks to the right of blue blocks, forming a two-column structure.\n- Hand adds green blocks on top of the yellow blocks, creating a three-tiered structure.\n- Hand places orange blocks on top of the green blocks, completing the vertical stack.", "history_tokens": 161, "history_utf8_bytes": 700, "recent_frame_times_s": [43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0], "recent_frames_sha256": "8144b1f21264981716970f657278c6a2714c33bad543743784fb8dd9ffc81c7e", "num_recent_frames": 30, "tq": 717970.469377897, "t1": 717979.032945268, "ta": 717979.032945268, "te": 717979.436060009, "first_response_s": 8.563567370991223, "answer_total_s": 8.966682111960836, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 202, "content_group": "cef4d37f6bc2fe533d8c3264d1f00cc47dccdf3fe92b06113150966d8acfa668", "question": {"question_id": "sample_202_a2075_q0", "video_id": 202, "video_path": "./videos/sample_202_real.mp4", "annotation_index": 2075, "question_index": 0, "question": "How are the yellow building blocks arranged before the blue block is placed on top?", "options": ["A. In a circle.", "B. In a straight line.", "C. In a random pattern.", "D. In a triangular shape."], "answer": "B", "time_stamp_s": 128, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_202_a2075_q0", "video_id": 202, "time_stamp_s": 128, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0fa8c24c7adde6303f79fefcfbde32134d1a34d101d6db1e19b08687557b6d43", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0], "recent_frames_sha256": "f49a9544bd01e9ef6efc9e90b15d6235985af0ab8a76be010a400be4872912f1", "num_recent_frames": 30, "tq": 717910.271696521, "t1": 717920.531632451, "ta": 717920.531632451, "te": 717920.572815181, "first_response_s": 10.259935930022039, "answer_total_s": 10.30111866001971, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_202_a2075_q0", "video_id": 202, "time_stamp_s": 128, "ground_truth": "B", "raw_output": "B. In a straight line.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "0d78ae95fb3bf2399535473c6723755a4b464f795cbede592a896025eb8d7afe", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand assembles a yellow and blue race car from interlocking blocks, adding green and orange pieces to form a detailed vehicle.  \n- A separate hand constructs a mini truck using green, yellow, and blue blocks, then places a small figurine on its bed.  \n- The mini truck is later shown with the figurine seated on it, positioned on a white surface against a yellow wall, with the word \"playtime\" appearing on screen.\n[30-60s] - Hand places yellow blocks to the right of blue blocks, forming a two-column structure.\n- Hand adds green blocks on top of the yellow blocks, creating a three-tiered structure.\n- Hand places orange blocks on top of the green blocks, completing the vertical stack.\n[60-90s] - Hand places a blue block atop the green and yellow structure, completing the face's top section.  \n- The hand then adds a red block to the top, forming a vertical stack above the blue block.  \n- The assembled structure, now with a smiling face and wheels, is shown in a stable, upright position.\n[90-120s] - A hand places yellow LEGO bricks in a linear row on a white surface.  \n- A blue LEGO brick is added perpendicular to the yellow row, forming a small structure.  \n- The hand adjusts the position of the blue brick relative to the yellow bricks.", "history_tokens": 295, "history_utf8_bytes": 1262, "recent_frame_times_s": [99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0], "recent_frames_sha256": "f49a9544bd01e9ef6efc9e90b15d6235985af0ab8a76be010a400be4872912f1", "num_recent_frames": 30, "tq": 717997.054815752, "t1": 718004.440231309, "ta": 718004.440231309, "te": 718004.705132218, "first_response_s": 7.385415557073429, "answer_total_s": 7.6503164659952745, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 202, "content_group": "cef4d37f6bc2fe533d8c3264d1f00cc47dccdf3fe92b06113150966d8acfa668", "question": {"question_id": "sample_202_a2076_q0", "video_id": 202, "video_path": "./videos/sample_202_real.mp4", "annotation_index": 2076, "question_index": 0, "question": "What is the new item introduced in the video?", "options": ["A. A small structure made of blue and green blocks.", "B. A small structure made of yellow and red blocks with wheels.", "C. A toy vehicle with blue and yellow wheels.", "D. An orange and green interlocking block structure."], "answer": "B", "time_stamp_s": 202, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_202_a2076_q0", "video_id": 202, "time_stamp_s": 202, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6f07ec2731a2739402a86f81c828364d2292e1a0752d5c27e2bb099baeeb277c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0], "recent_frames_sha256": "b35bbc7e032471b61d862f6d12246899032c7a967f57fad01eae588c9b3d58ae", "num_recent_frames": 30, "tq": 717920.584702614, "t1": 717932.472296064, "ta": 717932.472296064, "te": 717932.512156972, "first_response_s": 11.887593450024724, "answer_total_s": 11.92745435796678, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_202_a2076_q0", "video_id": 202, "time_stamp_s": 202, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "318ea14241ecd2b0b2ce08e2e9d5a177a127bdb8d49558d7d622d76bdae9f89b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand assembles a yellow and blue race car from interlocking blocks, adding green and orange pieces to form a detailed vehicle.  \n- A separate hand constructs a mini truck using green, yellow, and blue blocks, then places a small figurine on its bed.  \n- The mini truck is later shown with the figurine seated on it, positioned on a white surface against a yellow wall, with the word \"playtime\" appearing on screen.\n[30-60s] - Hand places yellow blocks to the right of blue blocks, forming a two-column structure.\n- Hand adds green blocks on top of the yellow blocks, creating a three-tiered structure.\n- Hand places orange blocks on top of the green blocks, completing the vertical stack.\n[60-90s] - Hand places a blue block atop the green and yellow structure, completing the face's top section.  \n- The hand then adds a red block to the top, forming a vertical stack above the blue block.  \n- The assembled structure, now with a smiling face and wheels, is shown in a stable, upright position.\n[90-120s] - A hand places yellow LEGO bricks in a linear row on a white surface.  \n- A blue LEGO brick is added perpendicular to the yellow row, forming a small structure.  \n- The hand adjusts the position of the blue brick relative to the yellow bricks.\n[120-150s] - A hand places a blue block onto a yellow base, aligning its studs with the yellow block's protrusions.  \n- The hand then adds more yellow blocks to extend the structure, followed by placing additional blue blocks on top.  \n- The structure grows horizontally, with blue and yellow blocks interlocking to form a longer, segmented base.\n[150-180s] - Hand places a green brick atop yellow bricks, forming a central section.  \n- Orange bricks are stacked on top of the green section, creating a layered color gradient.  \n- A white brick is added to the topmost layer, completing the colorful, multi-tiered structure.", "history_tokens": 440, "history_utf8_bytes": 1887, "recent_frame_times_s": [173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0], "recent_frames_sha256": "b35bbc7e032471b61d862f6d12246899032c7a967f57fad01eae588c9b3d58ae", "num_recent_frames": 30, "tq": 718015.605449408, "t1": 718016.606865697, "ta": 718016.606865697, "te": 718016.644330794, "first_response_s": 1.0014162890147418, "answer_total_s": 1.0388813860481605, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 202, "content_group": "cef4d37f6bc2fe533d8c3264d1f00cc47dccdf3fe92b06113150966d8acfa668", "question": {"question_id": "sample_202_a2076_q1", "video_id": 202, "video_path": "./videos/sample_202_real.mp4", "annotation_index": 2076, "question_index": 1, "question": "What happened to the toy vehicle just now?", "options": ["A. The toy vehicle is disassembled.", "B. The toy vehicle moves to the right.", "C. The toy vehicle start circling around the table.", "D. The toy vehicle is lifted off the surface."], "answer": "C", "time_stamp_s": 227, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_202_a2076_q1", "video_id": 202, "time_stamp_s": 227, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "766bf32aa7ab2ae503927b88a2b0535b76bd021ef2661cc4c55e2974cab6d722", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0], "recent_frames_sha256": "41e13896dd86ba682c89d3735215e7ceb2703e858ba4f8d3e51a0869d038471b", "num_recent_frames": 30, "tq": 717932.524085049, "t1": 717946.442119438, "ta": 717946.442119438, "te": 717946.480127291, "first_response_s": 13.918034388916567, "answer_total_s": 13.956042242003605, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_202_a2076_q1", "video_id": 202, "time_stamp_s": 227, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c0989a8658ca3fc3e863e39b986c5598917aad19c83380c9857c52fb1987bb64", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand assembles a yellow and blue race car from interlocking blocks, adding green and orange pieces to form a detailed vehicle.  \n- A separate hand constructs a mini truck using green, yellow, and blue blocks, then places a small figurine on its bed.  \n- The mini truck is later shown with the figurine seated on it, positioned on a white surface against a yellow wall, with the word \"playtime\" appearing on screen.\n[30-60s] - Hand places yellow blocks to the right of blue blocks, forming a two-column structure.\n- Hand adds green blocks on top of the yellow blocks, creating a three-tiered structure.\n- Hand places orange blocks on top of the green blocks, completing the vertical stack.\n[60-90s] - Hand places a blue block atop the green and yellow structure, completing the face's top section.  \n- The hand then adds a red block to the top, forming a vertical stack above the blue block.  \n- The assembled structure, now with a smiling face and wheels, is shown in a stable, upright position.\n[90-120s] - A hand places yellow LEGO bricks in a linear row on a white surface.  \n- A blue LEGO brick is added perpendicular to the yellow row, forming a small structure.  \n- The hand adjusts the position of the blue brick relative to the yellow bricks.\n[120-150s] - A hand places a blue block onto a yellow base, aligning its studs with the yellow block's protrusions.  \n- The hand then adds more yellow blocks to extend the structure, followed by placing additional blue blocks on top.  \n- The structure grows horizontally, with blue and yellow blocks interlocking to form a longer, segmented base.\n[150-180s] - Hand places a green brick atop yellow bricks, forming a central section.  \n- Orange bricks are stacked on top of the green section, creating a layered color gradient.  \n- A white brick is added to the topmost layer, completing the colorful, multi-tiered structure.\n[180-210s] - A hand places a yellow block onto a colorful Lego structure, completing its top layer.  \n- The Lego structure, now fully assembled, is positioned on a white surface with a yellow and red toy cart nearby.  \n- The hand then moves the toy cart closer to the Lego structure, preparing to attach it.", "history_tokens": 513, "history_utf8_bytes": 2195, "recent_frame_times_s": [198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0], "recent_frames_sha256": "41e13896dd86ba682c89d3735215e7ceb2703e858ba4f8d3e51a0869d038471b", "num_recent_frames": 30, "tq": 718027.225991973, "t1": 718029.511899397, "ta": 718029.511899397, "te": 718029.704772428, "first_response_s": 2.28590742405504, "answer_total_s": 2.4787804550724104, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 204, "content_group": "c25b10db8a1c94160da55179ae7445a7a101df458ed7c15abd257a16736f9c36", "question": {"question_id": "sample_204_a1527_q0", "video_id": 204, "video_path": "./videos/sample_204_real.mp4", "annotation_index": 1527, "question_index": 0, "question": "What color is the plastic block added on top of the green blocks?", "options": ["A. Red.", "B. Blue.", "C. Yellow.", "D. Purple."], "answer": "C", "time_stamp_s": 16, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_204_a1527_q0", "video_id": 204, "time_stamp_s": 16, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c0d7a73d7079037f435c067903eba89e1ac340f2f3e3ea13ab390d391a537e35", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0], "recent_frames_sha256": "32f487d75c996d363d24abd32f3c6f095819019028ace8773a79e603a2fe702b", "num_recent_frames": 17, "tq": 718536.37484192, "t1": 718537.432234212, "ta": 718537.432234212, "te": 718537.471804474, "first_response_s": 1.0573922920739278, "answer_total_s": 1.0969625540310517, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_204_a1527_q0", "video_id": 204, "time_stamp_s": 16, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "88b8c04aa0edd5a02a4400de7fcf0a87929150530b402974276b0794b17675b6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0], "recent_frames_sha256": "32f487d75c996d363d24abd32f3c6f095819019028ace8773a79e603a2fe702b", "num_recent_frames": 17, "tq": 718452.212793126, "t1": 718459.196678682, "ta": 718459.196678682, "te": 718459.423117397, "first_response_s": 6.983885555993766, "answer_total_s": 7.21032427099999, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 204, "content_group": "c25b10db8a1c94160da55179ae7445a7a101df458ed7c15abd257a16736f9c36", "question": {"question_id": "sample_204_a1528_q0", "video_id": 204, "video_path": "./videos/sample_204_real.mp4", "annotation_index": 1528, "question_index": 0, "question": "What are the primary colors of the plastic building blocks shown right now?", "options": ["A. Blue, green, and yellow.", "B. Red, green, and yellow.", "C. Red, blue, and yellow.", "D. Green, blue, and orange."], "answer": "B", "time_stamp_s": 62, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_204_a1528_q0", "video_id": 204, "time_stamp_s": 62, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a32b1824ce1fde77a2ed7cfb24105df30b1ebf487d62f8b7ff7b6f85ca47eea5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [33.0, 34.0, 35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0], "recent_frames_sha256": "5260483d10b2760591522fdb3ebab93aadc2c35f28f8f77723f7c4bcfb133770", "num_recent_frames": 30, "tq": 718537.49847115, "t1": 718546.01730977, "ta": 718546.01730977, "te": 718546.055029487, "first_response_s": 8.518838620046154, "answer_total_s": 8.556558337062597, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_204_a1528_q0", "video_id": 204, "time_stamp_s": 62, "ground_truth": "B", "raw_output": "B. Red, green, and yellow.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "090f2c1efd3fb6a0db13494aafa2b96101263bea3af07d07fe3a18c5e74ecbe3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hand places green blocks side-by-side, then adds yellow, orange, and red blocks on top to form a multi-colored letter 'A' structure.  \n- The hand adjusts the blocks to ensure the 'A' shape is stable and correctly assembled.  \n- The final structure is a stacked, rainbow-colored 'A' made of interlocking plastic blocks.\n[30-60s] - Hand places green blocks onto a partially built structure, then adds orange blocks to the sides.  \n- Red blocks are stacked on top, completing the structure's upper layer.  \n- Structure collapses when hand removes it, scattering blocks across the surface.", "history_tokens": 137, "history_utf8_bytes": 595, "recent_frame_times_s": [33.0, 34.0, 35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0], "recent_frames_sha256": "5260483d10b2760591522fdb3ebab93aadc2c35f28f8f77723f7c4bcfb133770", "num_recent_frames": 30, "tq": 718474.830201279, "t1": 718481.104342625, "ta": 718481.104342625, "te": 718481.441540692, "first_response_s": 6.274141345988028, "answer_total_s": 6.61133941297885, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 204, "content_group": "c25b10db8a1c94160da55179ae7445a7a101df458ed7c15abd257a16736f9c36", "question": {"question_id": "sample_204_a1528_q1", "video_id": 204, "video_path": "./videos/sample_204_real.mp4", "annotation_index": 1528, "question_index": 1, "question": "Which block was picked up and attached to the top of red block first just now?", "options": ["A. A white block.", "B. A green block.", "C. An yellow block.", "D. A blue block."], "answer": "C", "time_stamp_s": 85, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_204_a1528_q1", "video_id": 204, "time_stamp_s": 85, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "10a511fdeb0c8fbb0269f7488ef5e21237ecf9f6b9d4e0baae38943c03b3dab6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0], "recent_frames_sha256": "4aa069b9288e3892d952a4e2dd18000ce666216a79bbf0ccd940b163a8c68239", "num_recent_frames": 30, "tq": 718546.072962147, "t1": 718553.814152024, "ta": 718553.814152024, "te": 718553.851947962, "first_response_s": 7.741189877036959, "answer_total_s": 7.778985815006308, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_204_a1528_q1", "video_id": 204, "time_stamp_s": 85, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "91aee82eeade9c974890bb3588e7f28513b4ce66600a8dca864108cfc7609fe4", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hand places green blocks side-by-side, then adds yellow, orange, and red blocks on top to form a multi-colored letter 'A' structure.  \n- The hand adjusts the blocks to ensure the 'A' shape is stable and correctly assembled.  \n- The final structure is a stacked, rainbow-colored 'A' made of interlocking plastic blocks.\n[30-60s] - Hand places green blocks onto a partially built structure, then adds orange blocks to the sides.  \n- Red blocks are stacked on top, completing the structure's upper layer.  \n- Structure collapses when hand removes it, scattering blocks across the surface.", "history_tokens": 137, "history_utf8_bytes": 595, "recent_frame_times_s": [56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0], "recent_frames_sha256": "4aa069b9288e3892d952a4e2dd18000ce666216a79bbf0ccd940b163a8c68239", "num_recent_frames": 30, "tq": 718481.455304603, "t1": 718494.325067827, "ta": 718494.325067827, "te": 718494.565280037, "first_response_s": 12.869763224036433, "answer_total_s": 13.109975434024818, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 204, "content_group": "c25b10db8a1c94160da55179ae7445a7a101df458ed7c15abd257a16736f9c36", "question": {"question_id": "sample_204_a1529_q0", "video_id": 204, "video_path": "./videos/sample_204_real.mp4", "annotation_index": 1529, "question_index": 0, "question": "What was the white text on the purple animated overlay read just now?", "options": ["A. \"Alphabet A transform to Box\".", "B. \"Alphabet B transform to Box\".", "C. \"Alphabet C transform to Box\".", "D. \"Alphabet D transform to Box\"."], "answer": "B", "time_stamp_s": 141, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_204_a1529_q0", "video_id": 204, "time_stamp_s": 141, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9989c94a7b1e2d903104e56f711493f82638f4d20673c17aa54d5b9fb18e104e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0], "recent_frames_sha256": "a102dcd582a6ae372088b1df32dc7d0bee33d062e27cfae837332a93c7a5e83f", "num_recent_frames": 30, "tq": 718553.865104516, "t1": 718566.19860015, "ta": 718566.19860015, "te": 718566.23599514, "first_response_s": 12.333495633909479, "answer_total_s": 12.370890624006279, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_204_a1529_q0", "video_id": 204, "time_stamp_s": 141, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d7936cf7f598be5db32a9c99cba5b5a1965811a841092bb29ec176679284b255", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hand places green blocks side-by-side, then adds yellow, orange, and red blocks on top to form a multi-colored letter 'A' structure.  \n- The hand adjusts the blocks to ensure the 'A' shape is stable and correctly assembled.  \n- The final structure is a stacked, rainbow-colored 'A' made of interlocking plastic blocks.\n[30-60s] - Hand places green blocks onto a partially built structure, then adds orange blocks to the sides.  \n- Red blocks are stacked on top, completing the structure's upper layer.  \n- Structure collapses when hand removes it, scattering blocks across the surface.\n[60-90s] - Hand places a green block onto a red block, forming a vertical stack.\n- Hand then adds a yellow block on top of the green block, creating a three-block tower.\n- Hand adjusts the position of the tower slightly, ensuring stability.\n[90-120s] - Hands place green blocks on either side of a red central structure.  \n- Orange blocks are added to the top of the red structure.  \n- Green blocks are positioned at the bottom of the red structure.", "history_tokens": 245, "history_utf8_bytes": 1045, "recent_frame_times_s": [112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0], "recent_frames_sha256": "a102dcd582a6ae372088b1df32dc7d0bee33d062e27cfae837332a93c7a5e83f", "num_recent_frames": 30, "tq": 718513.526028639, "t1": 718520.291125685, "ta": 718520.291125685, "te": 718520.6034884, "first_response_s": 6.765097045921721, "answer_total_s": 7.077459760941565, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 204, "content_group": "c25b10db8a1c94160da55179ae7445a7a101df458ed7c15abd257a16736f9c36", "question": {"question_id": "sample_204_a1530_q0", "video_id": 204, "video_path": "./videos/sample_204_real.mp4", "annotation_index": 1530, "question_index": 0, "question": "What happens to the blocks after they are disassembled and mixed?", "options": ["A. The blocks are arranged in a new pattern.", "B. The blocks are scattered and then gathered into a pile.", "C. The blocks are thrown away.", "D. The blocks are sorted by color."], "answer": "B", "time_stamp_s": 198, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_204_a1530_q0", "video_id": 204, "time_stamp_s": 198, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9bc7be09c34f0bc85f8f3b8ddf8aed0e34359463483a7bc9a342136d74babf8b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0], "recent_frames_sha256": "b37db32a73a64df9805093bfa811ae7dffb7808673df5b56cd9c4c45c1951301", "num_recent_frames": 30, "tq": 718566.247017712, "t1": 718574.673086064, "ta": 718574.673086064, "te": 718574.710602686, "first_response_s": 8.426068352069706, "answer_total_s": 8.463584974058904, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_204_a1530_q0", "video_id": 204, "time_stamp_s": 198, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a1e109d7db1ac4e5a972d626a65c61bcfc13dc4af5667ef542534f744d56a2dd", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hand places green blocks side-by-side, then adds yellow, orange, and red blocks on top to form a multi-colored letter 'A' structure.  \n- The hand adjusts the blocks to ensure the 'A' shape is stable and correctly assembled.  \n- The final structure is a stacked, rainbow-colored 'A' made of interlocking plastic blocks.\n[30-60s] - Hand places green blocks onto a partially built structure, then adds orange blocks to the sides.  \n- Red blocks are stacked on top, completing the structure's upper layer.  \n- Structure collapses when hand removes it, scattering blocks across the surface.\n[60-90s] - Hand places a green block onto a red block, forming a vertical stack.\n- Hand then adds a yellow block on top of the green block, creating a three-block tower.\n- Hand adjusts the position of the tower slightly, ensuring stability.\n[90-120s] - Hands place green blocks on either side of a red central structure.  \n- Orange blocks are added to the top of the red structure.  \n- Green blocks are positioned at the bottom of the red structure.\n[120-150s] - Hand places orange blocks onto green and red base structure, forming a cross-like shape.\n- Red and green blocks are repositioned to create a new configuration resembling a letter 'B'.\n- Final structure is a flat, cross-shaped arrangement with orange blocks on top of green and red base.\n[150-180s] - Hand places orange block atop green block, completing a vertical stack.  \n- Red base block remains stationary beneath the growing structure.  \n- Structure’s height increases as blocks are stacked, forming a multi-layered tower.", "history_tokens": 368, "history_utf8_bytes": 1588, "recent_frame_times_s": [169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0], "recent_frames_sha256": "b37db32a73a64df9805093bfa811ae7dffb7808673df5b56cd9c4c45c1951301", "num_recent_frames": 30, "tq": 718534.602626691, "t1": 718536.296207599, "ta": 718536.296207599, "te": 718536.337138616, "first_response_s": 1.6935809080023319, "answer_total_s": 1.7345119250239804, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 205, "content_group": "6f61905ed091c0664daac12572ca5842113562bfcddf00fdbd3d0dc096e2d6bf", "question": {"question_id": "sample_205_a2098_q0", "video_id": 205, "video_path": "./videos/sample_205_real.mp4", "annotation_index": 2098, "question_index": 0, "question": "What colors are the wheels of the toy car?", "options": ["A. Blue and Yellow.", "B. Green and Red.", "C. Red and Yellow.", "D. Yellow and Green."], "answer": "C", "time_stamp_s": 4, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_205_a2098_q0", "video_id": 205, "time_stamp_s": 4, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7509509a15fb033db61875c165c3ed752ff67ef24ecf80bcf31691beb9d6a864", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0], "recent_frames_sha256": "a9dae1d8e186a68477deec2b895c1426c5b6a99c482eb49d982ca81a2727c8d5", "num_recent_frames": 5, "tq": 710018.723038893, "t1": 710020.638007857, "ta": 710020.638007857, "te": 710020.793197314, "first_response_s": 1.9149689640616998, "answer_total_s": 2.070158421061933, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_205_a2098_q0", "video_id": 205, "time_stamp_s": 4, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4521c5e35e085b82664eec0d0b4d995256e1e9877081042de094b3e30cfb3bdf", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0], "recent_frames_sha256": "a9dae1d8e186a68477deec2b895c1426c5b6a99c482eb49d982ca81a2727c8d5", "num_recent_frames": 5, "tq": 710052.914413995, "t1": 710064.477424292, "ta": 710064.477424292, "te": 710064.703391504, "first_response_s": 11.563010297017172, "answer_total_s": 11.78897750901524, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 205, "content_group": "6f61905ed091c0664daac12572ca5842113562bfcddf00fdbd3d0dc096e2d6bf", "question": {"question_id": "sample_205_a2099_q0", "video_id": 205, "video_path": "./videos/sample_205_real.mp4", "annotation_index": 2099, "question_index": 0, "question": "What action did the hand perform after placing the green block next to the blue block?", "options": ["A. Placed a yellow block over the blue block.", "B. Adjusted the green block.", "C. Picked up an orange block.", "D. Removed the blue block."], "answer": "C", "time_stamp_s": 70, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_205_a2099_q0", "video_id": 205, "time_stamp_s": 70, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "21e6bb481a4de692bbabd34be0d13123dbdbd3003d206094ae13fde73ab2a56e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0], "recent_frames_sha256": "977b1376db652957b25de444775592d574c11c407e95f555eba225c22a8ee7b6", "num_recent_frames": 30, "tq": 710020.833293645, "t1": 710028.895189787, "ta": 710028.895189787, "te": 710029.118923049, "first_response_s": 8.061896142084152, "answer_total_s": 8.285629404010251, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_205_a2099_q0", "video_id": 205, "time_stamp_s": 70, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0a40665d215169dfae9e2af3da99772329284a2104fe0a9ac7bcf7d2863c73d1", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand places yellow LEGO bricks on a marble surface, forming a cross-like structure.  \n- The hand then adds orange bricks below the yellow ones, extending the structure downward.  \n- Finally, a green LEGO brick is placed on top of the yellow structure, completing the assembly.\n[30-60s] - Hands adjust green block position atop yellow and orange bricks, forming a central vertical stack.  \n- Orange bricks are added to the left and right of the green block, extending the structure horizontally.  \n- Yellow bricks are placed above the green block, completing a layered, symmetrical structure.", "history_tokens": 130, "history_utf8_bytes": 603, "recent_frame_times_s": [41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0], "recent_frames_sha256": "977b1376db652957b25de444775592d574c11c407e95f555eba225c22a8ee7b6", "num_recent_frames": 30, "tq": 710083.99758657, "t1": 710090.072431229, "ta": 710090.072431229, "te": 710090.256376756, "first_response_s": 6.074844659073278, "answer_total_s": 6.258790186024271, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 205, "content_group": "6f61905ed091c0664daac12572ca5842113562bfcddf00fdbd3d0dc096e2d6bf", "question": {"question_id": "sample_205_a2099_q1", "video_id": 205, "video_path": "./videos/sample_205_real.mp4", "annotation_index": 2099, "question_index": 1, "question": "How many hands are involved in arranging the blocks right now?", "options": ["A. One hand.", "B. Two hands.", "C. Three hands.", "D. Four hands."], "answer": "B", "time_stamp_s": 79, "task_type": "Counting", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_205_a2099_q1", "video_id": 205, "time_stamp_s": 79, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8971406ac8add9e295268fb7c0e55167191784c022a561e370a28fa096b0dc71", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0], "recent_frames_sha256": "27b1e1a9bf7279c2e834b81b06bdca4bb05ebe35e4d46bd0d961b76d6bc9997a", "num_recent_frames": 30, "tq": 710029.165025592, "t1": 710036.058577866, "ta": 710036.058577866, "te": 710036.498330462, "first_response_s": 6.893552273977548, "answer_total_s": 7.333304870058782, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_205_a2099_q1", "video_id": 205, "time_stamp_s": 79, "ground_truth": "B", "raw_output": "B. Two hands.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "6dde10edefb7a65832aabf95e0880844b8fccc2c290b45b3e3de1cb23fd2c0d9", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand places yellow LEGO bricks on a marble surface, forming a cross-like structure.  \n- The hand then adds orange bricks below the yellow ones, extending the structure downward.  \n- Finally, a green LEGO brick is placed on top of the yellow structure, completing the assembly.\n[30-60s] - Hands adjust green block position atop yellow and orange bricks, forming a central vertical stack.  \n- Orange bricks are added to the left and right of the green block, extending the structure horizontally.  \n- Yellow bricks are placed above the green block, completing a layered, symmetrical structure.", "history_tokens": 130, "history_utf8_bytes": 603, "recent_frame_times_s": [50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0], "recent_frames_sha256": "27b1e1a9bf7279c2e834b81b06bdca4bb05ebe35e4d46bd0d961b76d6bc9997a", "num_recent_frames": 30, "tq": 710090.279217731, "t1": 710101.486293464, "ta": 710101.486293464, "te": 710101.671633212, "first_response_s": 11.207075732992962, "answer_total_s": 11.39241548103746, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 205, "content_group": "6f61905ed091c0664daac12572ca5842113562bfcddf00fdbd3d0dc096e2d6bf", "question": {"question_id": "sample_205_a2100_q0", "video_id": 205, "video_path": "./videos/sample_205_real.mp4", "annotation_index": 2100, "question_index": 0, "question": "What does the hand do after picking up the yellow building block?", "options": ["A. Places it on the right side.", "B. Places it on the left side.", "C. Discards it.", "D. Hands it to someone else."], "answer": "B", "time_stamp_s": 126, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_205_a2100_q0", "video_id": 205, "time_stamp_s": 126, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5ce5e442b28d0780eb47eaacf1279f28b73253cf9937e3e6c85868f8401b82d3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0], "recent_frames_sha256": "c4ceb3a83dee529cb15066f9f9e25f6623486fafae31aa5db5ea785000da67b5", "num_recent_frames": 30, "tq": 710036.51863824, "t1": 710046.708072352, "ta": 710046.708072352, "te": 710046.745267796, "first_response_s": 10.189434111933224, "answer_total_s": 10.226629555923864, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_205_a2100_q0", "video_id": 205, "time_stamp_s": 126, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d9f1f26ac20d3f97818e12d73b953a24c1bed9f47ebac25eee1feddb594b709a", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand places yellow LEGO bricks on a marble surface, forming a cross-like structure.  \n- The hand then adds orange bricks below the yellow ones, extending the structure downward.  \n- Finally, a green LEGO brick is placed on top of the yellow structure, completing the assembly.\n[30-60s] - Hands adjust green block position atop yellow and orange bricks, forming a central vertical stack.  \n- Orange bricks are added to the left and right of the green block, extending the structure horizontally.  \n- Yellow bricks are placed above the green block, completing a layered, symmetrical structure.\n[60-90s] - Hands place a green block onto a blue block, which is positioned on a larger orange block.  \n- The green block is then pressed firmly into place, aligning with the blue block.  \n- A yellow block is subsequently placed adjacent to the green and blue blocks, completing a small section of the structure.\n[90-120s] - Hands adjust green and orange blocks on a yellow base, aligning them in rows.  \n- A blue and orange block is placed to the left of the main structure, then later positioned on top of the yellow base.  \n- The structure is being assembled with precise placement of colored blocks, showing incremental growth.", "history_tokens": 273, "history_utf8_bytes": 1235, "recent_frame_times_s": [97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0], "recent_frames_sha256": "c4ceb3a83dee529cb15066f9f9e25f6623486fafae31aa5db5ea785000da67b5", "num_recent_frames": 30, "tq": 710115.071606925, "t1": 710123.587533304, "ta": 710123.587533304, "te": 710123.812087844, "first_response_s": 8.515926379011944, "answer_total_s": 8.74048091901932, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 205, "content_group": "6f61905ed091c0664daac12572ca5842113562bfcddf00fdbd3d0dc096e2d6bf", "question": {"question_id": "sample_205_a2101_q0", "video_id": 205, "video_path": "./videos/sample_205_real.mp4", "annotation_index": 2101, "question_index": 0, "question": "What does the hand do after positioning the three green blocks securely?", "options": ["A. Picks up a red block.", "B. Picks up an orange block.", "C. Picks up another green block.", "D. Adjusts the yellow block."], "answer": "B", "time_stamp_s": 191, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_205_a2101_q0", "video_id": 205, "time_stamp_s": 191, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "92081398baf5ae432ca07547a4e837768a65bef425952567c370dee65ddf8c87", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0], "recent_frames_sha256": "0dbe98094a54f4351c1b5776e7e1b462826d6eec8b8ce91854de33bf10dd6bd4", "num_recent_frames": 30, "tq": 710046.766608043, "t1": 710052.855213154, "ta": 710052.855213154, "te": 710052.89195796, "first_response_s": 6.088605110999197, "answer_total_s": 6.125349916983396, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_205_a2101_q0", "video_id": 205, "time_stamp_s": 191, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3603dcb552b68bbd618c9106446bfe6ed59739f6ff70e6d468ec5f8809a8f8a4", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand places yellow LEGO bricks on a marble surface, forming a cross-like structure.  \n- The hand then adds orange bricks below the yellow ones, extending the structure downward.  \n- Finally, a green LEGO brick is placed on top of the yellow structure, completing the assembly.\n[30-60s] - Hands adjust green block position atop yellow and orange bricks, forming a central vertical stack.  \n- Orange bricks are added to the left and right of the green block, extending the structure horizontally.  \n- Yellow bricks are placed above the green block, completing a layered, symmetrical structure.\n[60-90s] - Hands place a green block onto a blue block, which is positioned on a larger orange block.  \n- The green block is then pressed firmly into place, aligning with the blue block.  \n- A yellow block is subsequently placed adjacent to the green and blue blocks, completing a small section of the structure.\n[90-120s] - Hands adjust green and orange blocks on a yellow base, aligning them in rows.  \n- A blue and orange block is placed to the left of the main structure, then later positioned on top of the yellow base.  \n- The structure is being assembled with precise placement of colored blocks, showing incremental growth.\n[120-150s] - Hands adjust and align yellow LEGO bricks to form a rectangular base with green and orange horizontal stripes.\n- A blue LEGO brick is positioned at the left end of the structure, partially covered by yellow bricks.\n- The structure is slightly tilted and manipulated, with hands pressing bricks into place to secure the assembly.\n[150-180s] - A hand places a yellow block on a marble surface, then adds a blue block adjacent to it, forming a 2x2 structure.  \n- The hand then positions a green block to the left of the blue block, creating a 3x2 structure.  \n- The blocks remain static on the surface, with no further movement or interaction observed.", "history_tokens": 426, "history_utf8_bytes": 1898, "recent_frame_times_s": [162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0], "recent_frames_sha256": "0dbe98094a54f4351c1b5776e7e1b462826d6eec8b8ce91854de33bf10dd6bd4", "num_recent_frames": 30, "tq": 710140.263864971, "t1": 710142.017189018, "ta": 710142.017189018, "te": 710142.055238216, "first_response_s": 1.7533240469638258, "answer_total_s": 1.7913732449524105, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 206, "content_group": "ad0e35ab7306d707e39427a766d60251b6317d8463b244d762781467873a217d", "question": {"question_id": "sample_206_a778_q0", "video_id": 206, "video_path": "./videos/sample_206_real.mp4", "annotation_index": 778, "question_index": 0, "question": "What colors are the blocks used to form the helicopter rotor blades?", "options": ["A. Blue and Green.", "B. Yellow and Blue.", "C. Green and Red.", "D. Red and Orange."], "answer": "A", "time_stamp_s": 2, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_206_a778_q0", "video_id": 206, "time_stamp_s": 2, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c6da9248607646ad09f7ba4171a845ec16bb36a2d4f355044310ddef9845d59e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0], "recent_frames_sha256": "d519cea2ff5ed87d55e831d66fa6674e5ede91d97c11518db135cc48ae26a4f5", "num_recent_frames": 3, "tq": 716100.779480132, "t1": 716114.593629251, "ta": 716114.593629251, "te": 716114.631277624, "first_response_s": 13.814149118959904, "answer_total_s": 13.851797492010519, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_206_a778_q0", "video_id": 206, "time_stamp_s": 2, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2e2dfa9ce19c3a7fbc588f07de0d7a906f8da90d1af62c9de30aed4d3def7a0a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0], "recent_frames_sha256": "d519cea2ff5ed87d55e831d66fa6674e5ede91d97c11518db135cc48ae26a4f5", "num_recent_frames": 3, "tq": 716162.950110535, "t1": 716175.694180624, "ta": 716175.694180624, "te": 716175.732272991, "first_response_s": 12.744070088956505, "answer_total_s": 12.782162455958314, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 206, "content_group": "ad0e35ab7306d707e39427a766d60251b6317d8463b244d762781467873a217d", "question": {"question_id": "sample_206_a778_q1", "video_id": 206, "video_path": "./videos/sample_206_real.mp4", "annotation_index": 778, "question_index": 1, "question": "What is the sequence of actions performed with the blocks just now?", "options": ["A. Placing a yellow block, then two green blocks, and finally a blue block.", "B. Placing a blue block, then two green blocks, and finally a yellow block.", "C. Placing a yellow block, then a blue block, and finally two green blocks.", "D. Placing a yellow block, then one green block, and finally two blue blocks."], "answer": "A", "time_stamp_s": 23, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_206_a778_q1", "video_id": 206, "time_stamp_s": 23, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "aa990440bad4af323e2a5aabf9a49c405cb278f8106771799582ea15baa77623", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0], "recent_frames_sha256": "c6780d04ff549ba180fa085d2ce604a5189a2573fab35243d7e771da8fc6e12f", "num_recent_frames": 24, "tq": 716114.640249655, "t1": 716126.312393098, "ta": 716126.312393098, "te": 716126.349781441, "first_response_s": 11.672143443021923, "answer_total_s": 11.709531786036678, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_206_a778_q1", "video_id": 206, "time_stamp_s": 23, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5cb939d27b9bd8be144b11aa4106916805214162f178e81a8dfe44b4570d924d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0], "recent_frames_sha256": "c6780d04ff549ba180fa085d2ce604a5189a2573fab35243d7e771da8fc6e12f", "num_recent_frames": 24, "tq": 716175.745365642, "t1": 716182.548078556, "ta": 716182.548078556, "te": 716182.698342072, "first_response_s": 6.8027129139518365, "answer_total_s": 6.952976429951377, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 206, "content_group": "ad0e35ab7306d707e39427a766d60251b6317d8463b244d762781467873a217d", "question": {"question_id": "sample_206_a779_q0", "video_id": 206, "video_path": "./videos/sample_206_real.mp4", "annotation_index": 779, "question_index": 0, "question": "What is the hand doing after placing three yellow blocks onto the top of the structure?", "options": ["A. Adds another block on top.", "B. Removes the yellow block.", "C. Leaves the block structure.", "D. Adjusts the yellow block."], "answer": "D", "time_stamp_s": 71, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_206_a779_q0", "video_id": 206, "time_stamp_s": 71, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9bb4db718dcb2f622ab843d5c07409dca62d1bbfb5687781bf0be5f6262c7603", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0], "recent_frames_sha256": "4b4487a6547a2f7068bf0be9c5a6ae47ec03c18b2ab1a7896a8df31d2a6e86bd", "num_recent_frames": 30, "tq": 716126.360036829, "t1": 716140.255339434, "ta": 716140.255339434, "te": 716140.292392924, "first_response_s": 13.895302605000325, "answer_total_s": 13.932356094941497, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_206_a779_q0", "video_id": 206, "time_stamp_s": 71, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4cb095c27a7634007c0a33dc541ecb590d158f0c52eff0192a0d32bf090d3dd4", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand places green blocks side by side on a marble surface, then adds blue blocks on top, forming a vertical structure.  \n- Yellow blocks are positioned adjacent to the blue structure, creating a horizontal extension.  \n- The hand continues assembling by adding more blocks, including orange and red ones, to the right side of the structure.\n[30-60s] - Hand places yellow blocks onto a blue base, forming a vertical structure.  \n- Hand adjusts and stacks additional yellow blocks on top of the blue base.  \n- Hand adds a green block to the side of the growing structure.", "history_tokens": 129, "history_utf8_bytes": 581, "recent_frame_times_s": [42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0], "recent_frames_sha256": "4b4487a6547a2f7068bf0be9c5a6ae47ec03c18b2ab1a7896a8df31d2a6e86bd", "num_recent_frames": 30, "tq": 716198.695050916, "t1": 716201.065702254, "ta": 716201.065702254, "te": 716201.33895287, "first_response_s": 2.370651337900199, "answer_total_s": 2.6439019539393485, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 206, "content_group": "ad0e35ab7306d707e39427a766d60251b6317d8463b244d762781467873a217d", "question": {"question_id": "sample_206_a780_q0", "video_id": 206, "video_path": "./videos/sample_206_real.mp4", "annotation_index": 780, "question_index": 0, "question": "What was the sequence of events the hand followed when building the structure just now?", "options": ["A. Picks up a yellow block, adjusts it, then picks up a red block.", "B. Picks up a green block, adjusts it, then picks up a yellow block.", "C. Picks up a red block, adjusts it, then picks up a yellow block.", "D. Picks up a blue block, adjusts it, then picks up a green block."], "answer": "B", "time_stamp_s": 135, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_206_a780_q0", "video_id": 206, "time_stamp_s": 135, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2bbd78c82737718c4dd1187f6714e19f10de89f5cd38ffcf5a3aa2a1ffa3cb6e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0], "recent_frames_sha256": "770c56648255023084d82e6cb5c90385b8692d255935ac67eb7c9f30c95c6fdc", "num_recent_frames": 30, "tq": 716140.301642406, "t1": 716154.991255448, "ta": 716154.991255448, "te": 716155.028859789, "first_response_s": 14.689613041933626, "answer_total_s": 14.727217382984236, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_206_a780_q0", "video_id": 206, "time_stamp_s": 135, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "dcf4d3090395976f15fd7c3de5776642d2972558fbcbffc5008b4f6ebf4cfa4c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand places green blocks side by side on a marble surface, then adds blue blocks on top, forming a vertical structure.  \n- Yellow blocks are positioned adjacent to the blue structure, creating a horizontal extension.  \n- The hand continues assembling by adding more blocks, including orange and red ones, to the right side of the structure.\n[30-60s] - Hand places yellow blocks onto a blue base, forming a vertical structure.  \n- Hand adjusts and stacks additional yellow blocks on top of the blue base.  \n- Hand adds a green block to the side of the growing structure.\n[60-90s] - Hand places orange blocks onto the yellow base, aligning them with studs.  \n- Yellow base remains stationary while orange blocks are added to its top surface.  \n- Green blocks are visible to the left, and orange blocks are scattered to the right.\n[90-120s] - Hands adjust a yellow baseplate with orange studs, then add a green baseplate beneath it.  \n- A red brick is placed on the left side of the structure, followed by an orange brick on the right.  \n- The structure is slightly tilted and repositioned as hands continue assembling.", "history_tokens": 257, "history_utf8_bytes": 1128, "recent_frame_times_s": [106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0], "recent_frames_sha256": "770c56648255023084d82e6cb5c90385b8692d255935ac67eb7c9f30c95c6fdc", "num_recent_frames": 30, "tq": 716220.588315792, "t1": 716228.635984255, "ta": 716228.635984255, "te": 716228.859041539, "first_response_s": 8.047668462968431, "answer_total_s": 8.270725746988319, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 206, "content_group": "ad0e35ab7306d707e39427a766d60251b6317d8463b244d762781467873a217d", "question": {"question_id": "sample_206_a781_q0", "video_id": 206, "video_path": "./videos/sample_206_real.mp4", "annotation_index": 781, "question_index": 0, "question": "What action is the person performing with the blue blocks?", "options": ["A. Adds blue blocks to the bottom of the structure.", "B. Adds blue blocks to the side of the structure.", "C. Removes blue blocks from the structure.", "D. Adds blue blocks to the top of the structure."], "answer": "D", "time_stamp_s": 195, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [180, 235], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_206_a781_q0", "video_id": 206, "time_stamp_s": 195, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "41faaa1a68182d8909bec3c0b9ba56e215150afd37d112ac0e9dcb6405e271e9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0], "recent_frames_sha256": "63ecf6add953a56e84b2025259991c03701233360fe4bb31c1f773d2428f6e8f", "num_recent_frames": 30, "tq": 716155.045690716, "t1": 716162.902221384, "ta": 716162.902221384, "te": 716162.939361924, "first_response_s": 7.856530667981133, "answer_total_s": 7.8936712079448625, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_206_a781_q0", "video_id": 206, "time_stamp_s": 195, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "caef9f5d02a015043bd061f180ac30b16689668b741aa9f9f01b5ffedcbd09f8", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand places green blocks side by side on a marble surface, then adds blue blocks on top, forming a vertical structure.  \n- Yellow blocks are positioned adjacent to the blue structure, creating a horizontal extension.  \n- The hand continues assembling by adding more blocks, including orange and red ones, to the right side of the structure.\n[30-60s] - Hand places yellow blocks onto a blue base, forming a vertical structure.  \n- Hand adjusts and stacks additional yellow blocks on top of the blue base.  \n- Hand adds a green block to the side of the growing structure.\n[60-90s] - Hand places orange blocks onto the yellow base, aligning them with studs.  \n- Yellow base remains stationary while orange blocks are added to its top surface.  \n- Green blocks are visible to the left, and orange blocks are scattered to the right.\n[90-120s] - Hands adjust a yellow baseplate with orange studs, then add a green baseplate beneath it.  \n- A red brick is placed on the left side of the structure, followed by an orange brick on the right.  \n- The structure is slightly tilted and repositioned as hands continue assembling.\n[120-150s] - A hand places a green brick onto the right side of a partially built structure, extending its length.\n- The hand then adds a red brick to the top of the green extension, forming a small tower.\n- A green brick is subsequently placed on top of the red brick, completing a vertical stack on the structure's right end.\n[150-180s] - Hand places green block atop existing structure, then adds blue block beside it.  \n- Blue block is positioned to extend the structure's length, forming a new segment.  \n- Green block is later adjusted slightly, indicating ongoing assembly.", "history_tokens": 391, "history_utf8_bytes": 1709, "recent_frame_times_s": [166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0], "recent_frames_sha256": "63ecf6add953a56e84b2025259991c03701233360fe4bb31c1f773d2428f6e8f", "num_recent_frames": 30, "tq": 716273.182465859, "t1": 716281.00709964, "ta": 716281.00709964, "te": 716281.20983267, "first_response_s": 7.824633780983277, "answer_total_s": 8.027366811060347, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 207, "content_group": "89cf4aa5165bb2359ac907c22957fe3a84b3e44bb7b2d488ba5a4eb77ef6a7af", "question": {"question_id": "sample_207_a766_q0", "video_id": 207, "video_path": "./videos/sample_207_real.mp4", "annotation_index": 766, "question_index": 0, "question": "What is positioned underneath the archway made of colorful interlocking blocks?", "options": ["A. A small tree.", "B. A toy truck.", "C. A small building.", "D. A toy car."], "answer": "D", "time_stamp_s": 3, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_207_a766_q0", "video_id": 207, "time_stamp_s": 3, "ground_truth": "D", "raw_output": "D. A toy car.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "e1cfa6c1c1369778aa28af417a1da58e1c10435a435d84de403f99334654b624", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "5b840c324c076a430832ddcfcb121d7bd4be693767b1300f00ccbe5d0e857fdc", "num_recent_frames": 4, "tq": 716906.331553877, "t1": 716912.761676153, "ta": 716912.761676153, "te": 716912.990924321, "first_response_s": 6.430122276069596, "answer_total_s": 6.659370444016531, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_207_a766_q0", "video_id": 207, "time_stamp_s": 3, "ground_truth": "D", "raw_output": "D. A toy car.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "b7c58297ba116ab0dc1a6d1fe03bd4f4fcdbd1079f706866555cf1c55c05ff50", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "5b840c324c076a430832ddcfcb121d7bd4be693767b1300f00ccbe5d0e857fdc", "num_recent_frames": 4, "tq": 716811.68809212, "t1": 716821.465340301, "ta": 716821.465340301, "te": 716821.835302396, "first_response_s": 9.777248181053437, "answer_total_s": 10.147210275987163, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 207, "content_group": "89cf4aa5165bb2359ac907c22957fe3a84b3e44bb7b2d488ba5a4eb77ef6a7af", "question": {"question_id": "sample_207_a766_q1", "video_id": 207, "video_path": "./videos/sample_207_real.mp4", "annotation_index": 766, "question_index": 1, "question": "How many yellow blocks are connected in a line?", "options": ["A. Two.", "B. Three.", "C. Four.", "D. Five."], "answer": "C", "time_stamp_s": 19, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_207_a766_q1", "video_id": 207, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "976f56a25cda8bca8b6af1d1c657c892ba312bbc9dceb564120ba1ff72dbd5ac", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "86f01bd9d2ff23dc21c930f42e09ca3b0e840f6d9c9414d84228f7cc0c967d60", "num_recent_frames": 20, "tq": 716913.012630923, "t1": 716921.157571683, "ta": 716921.157571683, "te": 716921.197597676, "first_response_s": 8.144940760103054, "answer_total_s": 8.184966753004119, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_207_a766_q1", "video_id": 207, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1519c465b1d7f1acc492d20199361f84a1fd9871d8bf1a51a1b5e0aa20423390", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "86f01bd9d2ff23dc21c930f42e09ca3b0e840f6d9c9414d84228f7cc0c967d60", "num_recent_frames": 20, "tq": 716821.841843206, "t1": 716832.327809254, "ta": 716832.327809254, "te": 716832.365870081, "first_response_s": 10.485966048086993, "answer_total_s": 10.524026875034906, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 207, "content_group": "89cf4aa5165bb2359ac907c22957fe3a84b3e44bb7b2d488ba5a4eb77ef6a7af", "question": {"question_id": "sample_207_a767_q0", "video_id": 207, "video_path": "./videos/sample_207_real.mp4", "annotation_index": 767, "question_index": 0, "question": "Where is the green brick placed relative to the yellow bricks in the structure?", "options": ["A. In the middle.", "B. On the right side.", "C. On top of the blue bricks.", "D. On top of the yellow bricks."], "answer": "D", "time_stamp_s": 69, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_207_a767_q0", "video_id": 207, "time_stamp_s": 69, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "95dcbd92e36c7c903defce74b2640c2149001312d1e6efbfa7ad296d43f7f03a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0], "recent_frames_sha256": "d12478ad9f29f2497326bb52c04b89ba56a4f2878383712c75e79e593b570a69", "num_recent_frames": 30, "tq": 716921.225152429, "t1": 716935.17222729, "ta": 716935.17222729, "te": 716935.209594958, "first_response_s": 13.947074861032888, "answer_total_s": 13.984442529035732, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_207_a767_q0", "video_id": 207, "time_stamp_s": 69, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4d0ffa2c295c25ee44fa0c71b19b5b8129f4fcc331f87b3506eae59436d24e12", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand places yellow LEGO bricks in a linear sequence, then adds a blue brick to the right end.  \n- The hand subsequently attaches an orange brick to the left end of the growing structure.  \n- The final assembled structure consists of a long yellow base with a blue and orange brick at each end.\n[30-60s] - Hand places blue bricks onto yellow baseplate, extending the structure from center.\n- Orange end pieces remain fixed at both ends of the yellow baseplate.\n- Blue bricks are stacked in a row, covering part of the yellow baseplate.", "history_tokens": 125, "history_utf8_bytes": 546, "recent_frame_times_s": [40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0], "recent_frames_sha256": "d12478ad9f29f2497326bb52c04b89ba56a4f2878383712c75e79e593b570a69", "num_recent_frames": 30, "tq": 716849.184498208, "t1": 716855.926807387, "ta": 716855.926807387, "te": 716855.963984123, "first_response_s": 6.742309179040603, "answer_total_s": 6.779485914972611, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 207, "content_group": "89cf4aa5165bb2359ac907c22957fe3a84b3e44bb7b2d488ba5a4eb77ef6a7af", "question": {"question_id": "sample_207_a768_q0", "video_id": 207, "video_path": "./videos/sample_207_real.mp4", "annotation_index": 768, "question_index": 0, "question": "What does the person do after adding more yellow bricks?", "options": ["A. Removes the yellow bricks.", "B. Adds green bricks.", "C. Adjusts the yellow bricks.", "D. Adds blue bricks."], "answer": "C", "time_stamp_s": 196, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_207_a768_q0", "video_id": 207, "time_stamp_s": 196, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9006c48c956ffd355ffafc24b827034a0e302f885cc9c0b7d251db79f2dd34a1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0], "recent_frames_sha256": "99e85a7b433824ec164b3b013036bb5c51099db96a44237888aaddf32bd3c6ff", "num_recent_frames": 30, "tq": 716935.239497801, "t1": 716947.504275046, "ta": 716947.504275046, "te": 716947.540657955, "first_response_s": 12.264777245000005, "answer_total_s": 12.30116015393287, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_207_a768_q0", "video_id": 207, "time_stamp_s": 196, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9cc009a630e32f4948d87a9efba332ec6c68c1aa3a37633e5a03e2d8719e2f93", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand places yellow LEGO bricks in a linear sequence, then adds a blue brick to the right end.  \n- The hand subsequently attaches an orange brick to the left end of the growing structure.  \n- The final assembled structure consists of a long yellow base with a blue and orange brick at each end.\n[30-60s] - Hand places blue bricks onto yellow baseplate, extending the structure from center.\n- Orange end pieces remain fixed at both ends of the yellow baseplate.\n- Blue bricks are stacked in a row, covering part of the yellow baseplate.\n[60-90s] - Hand places green blocks onto yellow base plates on both sides of the blue central section.  \n- Structure forms an L-shape with yellow supports and a blue middle segment.  \n- Green blocks are stacked vertically on yellow plates, extending outward from the main structure.\n[90-120s] - A hand places a blue block at the right end of the structure, completing the right-side extension.  \n- The structure now has a rectangular frame with yellow base plates, blue top plates, and green and orange side blocks.  \n- The hand adjusts the right-side blocks, ensuring stability and alignment of the structure.\n[120-150s] - Hand places blue block atop yellow base, then adds green block on top of blue, followed by orange block on green.  \n- Two separate blue-yellow stacks are positioned side-by-side on white surface.  \n- Existing structure in background remains static while new blocks are assembled.\n[150-180s] - A hand places a green brick onto an orange brick, forming a vertical stack.  \n- The hand then adds a blue brick beneath the green one, creating a layered structure.  \n- The hand adjusts the position of the green and orange bricks, aligning them with adjacent structures.", "history_tokens": 391, "history_utf8_bytes": 1734, "recent_frame_times_s": [167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0], "recent_frames_sha256": "99e85a7b433824ec164b3b013036bb5c51099db96a44237888aaddf32bd3c6ff", "num_recent_frames": 30, "tq": 716892.198894907, "t1": 716898.911517205, "ta": 716898.911517205, "te": 716899.348247637, "first_response_s": 6.712622297927737, "answer_total_s": 7.149352730019018, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 207, "content_group": "89cf4aa5165bb2359ac907c22957fe3a84b3e44bb7b2d488ba5a4eb77ef6a7af", "question": {"question_id": "sample_207_a768_q1", "video_id": 207, "video_path": "./videos/sample_207_real.mp4", "annotation_index": 768, "question_index": 1, "question": "What is the person likely to do next after moving their hand towards the new set of connected bricks?", "options": ["A. Remove the connected bricks.", "B. Add more bricks to the arrangement.", "C. Paint the bricks.", "D. Disassemble the structure."], "answer": "B", "time_stamp_s": 199, "task_type": "Causal Reasoning", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_207_a768_q1", "video_id": 207, "time_stamp_s": 199, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ec4d5b9aad61e531cf90b3241c2079636a65a8d725eaf31c574dd1dd0748ce44", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0], "recent_frames_sha256": "c0da5efee5a6916c34cc5e707f4097dcc7fcd8af4ab78cb194ef980a257cdda0", "num_recent_frames": 30, "tq": 716947.557011658, "t1": 716954.598322122, "ta": 716954.598322122, "te": 716954.635669278, "first_response_s": 7.041310464031994, "answer_total_s": 7.078657620004378, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_207_a768_q1", "video_id": 207, "time_stamp_s": 199, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6b74df0c9af24186b79c9266d19313005a7b8f96a8e6d45609e767cde5c5be79", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand places yellow LEGO bricks in a linear sequence, then adds a blue brick to the right end.  \n- The hand subsequently attaches an orange brick to the left end of the growing structure.  \n- The final assembled structure consists of a long yellow base with a blue and orange brick at each end.\n[30-60s] - Hand places blue bricks onto yellow baseplate, extending the structure from center.\n- Orange end pieces remain fixed at both ends of the yellow baseplate.\n- Blue bricks are stacked in a row, covering part of the yellow baseplate.\n[60-90s] - Hand places green blocks onto yellow base plates on both sides of the blue central section.  \n- Structure forms an L-shape with yellow supports and a blue middle segment.  \n- Green blocks are stacked vertically on yellow plates, extending outward from the main structure.\n[90-120s] - A hand places a blue block at the right end of the structure, completing the right-side extension.  \n- The structure now has a rectangular frame with yellow base plates, blue top plates, and green and orange side blocks.  \n- The hand adjusts the right-side blocks, ensuring stability and alignment of the structure.\n[120-150s] - Hand places blue block atop yellow base, then adds green block on top of blue, followed by orange block on green.  \n- Two separate blue-yellow stacks are positioned side-by-side on white surface.  \n- Existing structure in background remains static while new blocks are assembled.\n[150-180s] - A hand places a green brick onto an orange brick, forming a vertical stack.  \n- The hand then adds a blue brick beneath the green one, creating a layered structure.  \n- The hand adjusts the position of the green and orange bricks, aligning them with adjacent structures.", "history_tokens": 391, "history_utf8_bytes": 1734, "recent_frame_times_s": [170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0], "recent_frames_sha256": "c0da5efee5a6916c34cc5e707f4097dcc7fcd8af4ab78cb194ef980a257cdda0", "num_recent_frames": 30, "tq": 716899.380149151, "t1": 716906.157686315, "ta": 716906.157686315, "te": 716906.31602228, "first_response_s": 6.777537164045498, "answer_total_s": 6.935873129055835, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 208, "content_group": "59d2c4b8fb7e55bb933fd2fc681736af5c0299a0aafc3890147cbd175947cf77", "question": {"question_id": "sample_208_a2028_q1", "video_id": 208, "video_path": "./videos/sample_208_real.mp4", "annotation_index": 2028, "question_index": 1, "question": "What are the colors of the crane arm?", "options": ["A. Yellow, green.", "B. Yellow, blue.", "C. Red, green, blue.", "D. Yellow, blue, green."], "answer": "A", "time_stamp_s": 7, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_208_a2028_q1", "video_id": 208, "time_stamp_s": 7, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1bb8ff456ed1d03b3670f361d7527701a2ad3fdebacd110ee849d78d952991d3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0], "recent_frames_sha256": "b565057e453a9d7fc4c33dfb31888006dfd04e79f523478ae156d7601b214140", "num_recent_frames": 8, "tq": 718464.76128263, "t1": 718475.095356776, "ta": 718475.095356776, "te": 718475.133064171, "first_response_s": 10.334074145997874, "answer_total_s": 10.371781540918164, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_208_a2028_q1", "video_id": 208, "time_stamp_s": 7, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "79a0ad11be14a0a8e855b759d6204bfc40d078cc5cba0c42051462b4fe0a7d51", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0], "recent_frames_sha256": "b565057e453a9d7fc4c33dfb31888006dfd04e79f523478ae156d7601b214140", "num_recent_frames": 8, "tq": 718521.646972955, "t1": 718536.296207599, "ta": 718536.296207599, "te": 718536.337138616, "first_response_s": 14.649234644020908, "answer_total_s": 14.690165661042556, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 208, "content_group": "59d2c4b8fb7e55bb933fd2fc681736af5c0299a0aafc3890147cbd175947cf77", "question": {"question_id": "sample_208_a2028_q0", "video_id": 208, "video_path": "./videos/sample_208_real.mp4", "annotation_index": 2028, "question_index": 0, "question": "What happens to the orange block as the video progresses?", "options": ["A. It falls to the ground.", "B. It remains stationary.", "C. It lifts and swings gently.", "D. It changes color."], "answer": "C", "time_stamp_s": 19, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_208_a2028_q0", "video_id": 208, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3d7e5e7697379de3204d04dab2c9f3a788c80d35c2128a638f8493923653ec0b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "d957c45e0021c34fc58a03e3eef9c1ca7182f4f4fc1b956315ab8fc8c95aa14b", "num_recent_frames": 20, "tq": 718475.141085956, "t1": 718487.325105805, "ta": 718487.325105805, "te": 718487.363509784, "first_response_s": 12.184019848937169, "answer_total_s": 12.222423827974126, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_208_a2028_q0", "video_id": 208, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3e39c98c7dde996f23c09f0508ef15565359f0028d8da2c0f67b445b287facca", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "d957c45e0021c34fc58a03e3eef9c1ca7182f4f4fc1b956315ab8fc8c95aa14b", "num_recent_frames": 20, "tq": 718536.357074739, "t1": 718544.542096624, "ta": 718544.542096624, "te": 718544.913209926, "first_response_s": 8.185021885088645, "answer_total_s": 8.556135187041946, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 208, "content_group": "59d2c4b8fb7e55bb933fd2fc681736af5c0299a0aafc3890147cbd175947cf77", "question": {"question_id": "sample_208_a2029_q0", "video_id": 208, "video_path": "./videos/sample_208_real.mp4", "annotation_index": 2029, "question_index": 0, "question": "What was the sequence of actions performed with the blocks just now?", "options": ["A. The hand first places a green block, then a yellow block, followed by a blue block.", "B. The hand builds a structure with red, green, and blue blocks.", "C. The hand stacks blocks randomly.", "D. The hand places a yellow block, moves it, then places a green block next to it."], "answer": "D", "time_stamp_s": 96, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_208_a2029_q0", "video_id": 208, "time_stamp_s": 96, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b82da7231537e51f736ffb387fefb64e02f35734da179dc298c17144f8e30896", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0], "recent_frames_sha256": "add998c7735f249d254d370e7c338c65aa221bdc0f5eeccaee9da43ae6bd9259", "num_recent_frames": 30, "tq": 718487.370779083, "t1": 718499.985694521, "ta": 718499.985694521, "te": 718500.026296337, "first_response_s": 12.614915437996387, "answer_total_s": 12.655517254024744, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_208_a2029_q0", "video_id": 208, "time_stamp_s": 96, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8e85a58d040536ef3277a1de256673acaad5c58990a72de2c131e194d985355c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A green block crane with a yellow base and multicolored supports lifts an orange block, moving it from the ground to a suspended position.  \n- The crane's arm rotates slightly as it lifts the block, then lowers it back to the ground.  \n- The orange block is consistently positioned near the crane's base during the lifting and lowering motion.\n[30-60s] - A hand places a yellow block with studs onto a white surface, then adds a green block on top of it.  \n- The hand then positions a second yellow block to the left of the green block, forming a small structure.  \n- The hand adjusts the green block slightly, ensuring it is centered over the yellow base.\n[60-90s] - A hand places a blue brick atop a green one, which is already seated on a yellow base structure.  \n- The hand then adjusts the blue brick to ensure it is properly aligned with the green base.  \n- A single yellow brick is placed separately on the white surface to the right of the assembled structure.", "history_tokens": 223, "history_utf8_bytes": 978, "recent_frame_times_s": [67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0], "recent_frames_sha256": "add998c7735f249d254d370e7c338c65aa221bdc0f5eeccaee9da43ae6bd9259", "num_recent_frames": 30, "tq": 718573.745430188, "t1": 718581.573959082, "ta": 718581.573959082, "te": 718581.611786722, "first_response_s": 7.828528893995099, "answer_total_s": 7.866356533952057, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 208, "content_group": "59d2c4b8fb7e55bb933fd2fc681736af5c0299a0aafc3890147cbd175947cf77", "question": {"question_id": "sample_208_a2030_q0", "video_id": 208, "video_path": "./videos/sample_208_real.mp4", "annotation_index": 2030, "question_index": 0, "question": "What happens to the smaller structure after it is first moved out of view?", "options": ["A. It is disassembled.", "B. It is placed on top of the larger structure.", "C. It is left in the foreground.", "D. It is placed back beside the larger structure."], "answer": "D", "time_stamp_s": 171, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_208_a2030_q0", "video_id": 208, "time_stamp_s": 171, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d5096bd63bc4c1ea4c179b82b656bc4135be203f92d07c6c319147e7ab8ff6a0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0], "recent_frames_sha256": "5268c0eae8bde2540b037bd3fb28b4fdb1c9a98c9fd89e09192d4dc039d659da", "num_recent_frames": 30, "tq": 718500.035601801, "t1": 718514.400814429, "ta": 718514.400814429, "te": 718514.441299104, "first_response_s": 14.365212628035806, "answer_total_s": 14.40569730300922, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_208_a2030_q0", "video_id": 208, "time_stamp_s": 171, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "aa2b4115ddf7ec6bd320d59d0ed34eeb4427c3ecdf3aeb3e48a1258cabdee151", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A green block crane with a yellow base and multicolored supports lifts an orange block, moving it from the ground to a suspended position.  \n- The crane's arm rotates slightly as it lifts the block, then lowers it back to the ground.  \n- The orange block is consistently positioned near the crane's base during the lifting and lowering motion.\n[30-60s] - A hand places a yellow block with studs onto a white surface, then adds a green block on top of it.  \n- The hand then positions a second yellow block to the left of the green block, forming a small structure.  \n- The hand adjusts the green block slightly, ensuring it is centered over the yellow base.\n[60-90s] - A hand places a blue brick atop a green one, which is already seated on a yellow base structure.  \n- The hand then adjusts the blue brick to ensure it is properly aligned with the green base.  \n- A single yellow brick is placed separately on the white surface to the right of the assembled structure.\n[90-120s] - A hand places green blocks onto a yellow baseplate, forming a flat green surface.  \n- The hand then adds a second yellow baseplate on top of the green one, creating a layered structure.  \n- A partially assembled yellow-green-blue block structure remains stationary in the background.\n[120-150s] - Hand places green brick into yellow structure, then adds blue bricks on top.  \n- Two completed yellow-green-blue structures are visible in background.  \n- A single yellow brick is placed on the table, then two more are added beside it.", "history_tokens": 348, "history_utf8_bytes": 1523, "recent_frame_times_s": [142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0], "recent_frames_sha256": "5268c0eae8bde2540b037bd3fb28b4fdb1c9a98c9fd89e09192d4dc039d659da", "num_recent_frames": 30, "tq": 718593.985922925, "t1": 718595.773688455, "ta": 718595.773688455, "te": 718595.814742536, "first_response_s": 1.7877655299380422, "answer_total_s": 1.8288196109933779, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 208, "content_group": "59d2c4b8fb7e55bb933fd2fc681736af5c0299a0aafc3890147cbd175947cf77", "question": {"question_id": "sample_208_a2031_q0", "video_id": 208, "video_path": "./videos/sample_208_real.mp4", "annotation_index": 2031, "question_index": 0, "question": "How many green blocks are stacked now?", "options": ["A. Ten.", "B. Three.", "C. Nine.", "D. Eight."], "answer": "C", "time_stamp_s": 265, "task_type": "Counting", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_208_a2031_q0", "video_id": 208, "time_stamp_s": 265, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "52479576827439451f22975ad157bcc3985e76d9af3e9fdd729c2e94f763da95", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0], "recent_frames_sha256": "e89e28a3a6057792e9ac222ff1b2b4dda6eb133ea41ba7647d5dc5fa9b0163a0", "num_recent_frames": 30, "tq": 718514.45115165, "t1": 718521.594697035, "ta": 718521.594697035, "te": 718521.633845577, "first_response_s": 7.1435453849844635, "answer_total_s": 7.182693926966749, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_208_a2031_q0", "video_id": 208, "time_stamp_s": 265, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0f01f5d54788f7676c29c80441c666d05e62b8493a65408d37749925e8de93bf", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A green block crane with a yellow base and multicolored supports lifts an orange block, moving it from the ground to a suspended position.  \n- The crane's arm rotates slightly as it lifts the block, then lowers it back to the ground.  \n- The orange block is consistently positioned near the crane's base during the lifting and lowering motion.\n[30-60s] - A hand places a yellow block with studs onto a white surface, then adds a green block on top of it.  \n- The hand then positions a second yellow block to the left of the green block, forming a small structure.  \n- The hand adjusts the green block slightly, ensuring it is centered over the yellow base.\n[60-90s] - A hand places a blue brick atop a green one, which is already seated on a yellow base structure.  \n- The hand then adjusts the blue brick to ensure it is properly aligned with the green base.  \n- A single yellow brick is placed separately on the white surface to the right of the assembled structure.\n[90-120s] - A hand places green blocks onto a yellow baseplate, forming a flat green surface.  \n- The hand then adds a second yellow baseplate on top of the green one, creating a layered structure.  \n- A partially assembled yellow-green-blue block structure remains stationary in the background.\n[120-150s] - Hand places green brick into yellow structure, then adds blue bricks on top.  \n- Two completed yellow-green-blue structures are visible in background.  \n- A single yellow brick is placed on the table, then two more are added beside it.\n[150-180s] - Hand places a blue block atop a yellow base, completing a small structure.  \n- A larger yellow-green-blue structure remains in the background, partially assembled.  \n- Hand adds an orange block to the top of the small structure, then places a yellow block beside it.\n[180-210s] - Hand places a blue block atop an orange base, completing a vertical stack.  \n- Green blocks are added to the top of the blue block, forming a layered structure.  \n- A separate yellow block with a green center is positioned to the right, partially assembled.\n[210-240s] - Hand places orange blocks onto a central structure, adding to its height.  \n- Two yellow structures with blue tops remain static in the background.  \n- A small green block is introduced and positioned near the bottom of the central structure.", "history_tokens": 534, "history_utf8_bytes": 2330, "recent_frame_times_s": [236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0], "recent_frames_sha256": "e89e28a3a6057792e9ac222ff1b2b4dda6eb133ea41ba7647d5dc5fa9b0163a0", "num_recent_frames": 30, "tq": 718624.092900214, "t1": 718625.976922331, "ta": 718625.976922331, "te": 718626.34994934, "first_response_s": 1.8840221170103177, "answer_total_s": 2.2570491259684786, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 209, "content_group": "d50664402feff2ac1fdf008eec52fc01d9b6645303132339410b8ffec353ed8a", "question": {"question_id": "sample_209_a529_q0", "video_id": 209, "video_path": "./videos/sample_209_real.mp4", "annotation_index": 529, "question_index": 0, "question": "What happens after the first green block is placed on the yellow block?", "options": ["A. The hand removes the green block.", "B. The hand moves away and does nothing.", "C. The hand removes the yellow block.", "D. The hand adds another green block."], "answer": "D", "time_stamp_s": 25, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_209_a529_q0", "video_id": 209, "time_stamp_s": 25, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5ff2d8d0a471363239cdcf33246d07c4ea49fbe33df220d452b09fbd09ee1da1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0], "recent_frames_sha256": "8d1c7abca69e9346c914e91ae7f02017319b97d3ab558f1d52648e8730e03a34", "num_recent_frames": 26, "tq": 716175.752285818, "t1": 716176.539119105, "ta": 716176.539119105, "te": 716176.576655794, "first_response_s": 0.7868332869838923, "answer_total_s": 0.8243699760641903, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_209_a529_q0", "video_id": 209, "time_stamp_s": 25, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9ed4ef65020fa5ff51b0d92ad87cafe8c1e2e571cf1c508f7a1e7e336110a3f1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0], "recent_frames_sha256": "8d1c7abca69e9346c914e91ae7f02017319b97d3ab558f1d52648e8730e03a34", "num_recent_frames": 26, "tq": 716050.563112295, "t1": 716058.064578825, "ta": 716058.064578825, "te": 716058.106075859, "first_response_s": 7.501466530025937, "answer_total_s": 7.542963564046659, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 209, "content_group": "d50664402feff2ac1fdf008eec52fc01d9b6645303132339410b8ffec353ed8a", "question": {"question_id": "sample_209_a530_q0", "video_id": 209, "video_path": "./videos/sample_209_real.mp4", "annotation_index": 530, "question_index": 0, "question": "What action do the hands perform just before moving away from the structure?", "options": ["A. Adding a yellow block.", "B. Adding a blue block.", "C. Adjusting the blue block.", "D. Pressing down the green blocks."], "answer": "D", "time_stamp_s": 118, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_209_a530_q0", "video_id": 209, "time_stamp_s": 118, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b264e3893c5f9db3b944a6499353a12663218a31c030dcf9524a9c4342eca5f3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0], "recent_frames_sha256": "daedcd80ba10a7b1c063da382d312dae45d554a790f6cabaf483f8b2838a3f8a", "num_recent_frames": 30, "tq": 716176.592904619, "t1": 716188.839733877, "ta": 716188.839733877, "te": 716188.877076798, "first_response_s": 12.246829257928766, "answer_total_s": 12.284172178944573, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_209_a530_q0", "video_id": 209, "time_stamp_s": 118, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0c28c5e221ed889a40f5c66dca80b7b23b57a251731ba0c7b5d0bd4549cf5f29", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand places a yellow LEGO baseplate on a white surface, then adds a green LEGO piece on top, followed by a blue LEGO piece.  \n- The hand manipulates the green and blue pieces, adjusting their positions relative to the yellow baseplate.  \n- The hand continues to stack and reposition LEGO pieces, forming a small structure on the white surface.\n[30-60s] - Hand places a blue brick atop a green base, then adds a yellow brick on top of the blue one.  \n- The hand adjusts the yellow brick to align with the green base, forming a stacked structure.  \n- The hand then positions a second blue brick on top of the yellow one, completing the tower.\n[60-90s] - Hands manipulate colorful plastic blocks, adding yellow pieces to the base.  \n- Green and blue blocks form a central structure atop the yellow base.  \n- Blocks are arranged in a linear, stepped pattern on a white surface.", "history_tokens": 206, "history_utf8_bytes": 885, "recent_frame_times_s": [89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0], "recent_frames_sha256": "daedcd80ba10a7b1c063da382d312dae45d554a790f6cabaf483f8b2838a3f8a", "num_recent_frames": 30, "tq": 716088.456473569, "t1": 716095.317713254, "ta": 716095.317713254, "te": 716095.68872223, "first_response_s": 6.8612396849785, "answer_total_s": 7.2322486609919, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 209, "content_group": "d50664402feff2ac1fdf008eec52fc01d9b6645303132339410b8ffec353ed8a", "question": {"question_id": "sample_209_a531_q0", "video_id": 209, "video_path": "./videos/sample_209_real.mp4", "annotation_index": 531, "question_index": 0, "question": "What sequence of actions occured with the green and yellow blocks just now?", "options": ["A. The green block is placed first, followed by the yellow block.", "B. The yellow block is placed first, followed by the green block.", "C. The green block is removed, then the yellow block is placed.", "D. The yellow block is adjusted, then the green block is placed."], "answer": "A", "time_stamp_s": 210, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_209_a531_q0", "video_id": 209, "time_stamp_s": 210, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0d4cd756e5f2d91b8710126d8037b9721961f848eaa2097e9e0afafbfba81269", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0], "recent_frames_sha256": "afa748507cbdd35fc3ad5a47a55892fc3f57b12242f781e51faae0840bfca54b", "num_recent_frames": 30, "tq": 716188.898556372, "t1": 716199.707385751, "ta": 716199.707385751, "te": 716199.744447853, "first_response_s": 10.808829378918745, "answer_total_s": 10.84589148091618, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_209_a531_q0", "video_id": 209, "time_stamp_s": 210, "ground_truth": "A", "raw_output": "A. The green block is placed first, followed by the yellow block.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "e6ee752d3274a3db7a166cb7c3909542e9f96eea6fe662bd471a50b611e4ad60", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand places a yellow LEGO baseplate on a white surface, then adds a green LEGO piece on top, followed by a blue LEGO piece.  \n- The hand manipulates the green and blue pieces, adjusting their positions relative to the yellow baseplate.  \n- The hand continues to stack and reposition LEGO pieces, forming a small structure on the white surface.\n[30-60s] - Hand places a blue brick atop a green base, then adds a yellow brick on top of the blue one.  \n- The hand adjusts the yellow brick to align with the green base, forming a stacked structure.  \n- The hand then positions a second blue brick on top of the yellow one, completing the tower.\n[60-90s] - Hands manipulate colorful plastic blocks, adding yellow pieces to the base.  \n- Green and blue blocks form a central structure atop the yellow base.  \n- Blocks are arranged in a linear, stepped pattern on a white surface.\n[90-120s] - Hand places green blocks atop existing yellow and blue base structure.  \n- Hand adjusts green blocks to align with the base, ensuring stability.  \n- Blue blocks remain fixed at the bottom, serving as a foundation for the green additions.\n[120-150s] - Hands adjust blue and green blocks on a yellow base, aligning them in a row.  \n- A yellow block is added to the right side, extending the structure.  \n- The structure remains static on a white surface against a yellow wall.\n[150-180s] - A hand places a yellow brick with studs onto a white table, adjacent to a partially built structure made of blue, green, and yellow bricks.  \n- The hand then positions an orange brick with studs next to the yellow brick, forming a new segment.  \n- The hand continues to add more bricks, including another yellow brick, to extend the structure horizontally.\n[180-210s] - Hand places a green block onto the white table, positioning it near the existing colorful block structures.  \n- The hand then moves away, leaving the green block in place as the other blocks remain assembled on the table.  \n- The green block is positioned to the right of the orange and yellow blocks, slightly separated from the main structure.", "history_tokens": 483, "history_utf8_bytes": 2101, "recent_frame_times_s": [181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0], "recent_frames_sha256": "afa748507cbdd35fc3ad5a47a55892fc3f57b12242f781e51faae0840bfca54b", "num_recent_frames": 30, "tq": 716132.479928801, "t1": 716133.005266204, "ta": 716133.005266204, "te": 716133.560069477, "first_response_s": 0.5253374030580744, "answer_total_s": 1.0801406760001555, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 209, "content_group": "d50664402feff2ac1fdf008eec52fc01d9b6645303132339410b8ffec353ed8a", "question": {"question_id": "sample_209_a531_q1", "video_id": 209, "video_path": "./videos/sample_209_real.mp4", "annotation_index": 531, "question_index": 1, "question": "Where is the new yellow and green block placed relative to the original structure?", "options": ["A. Behind the original structure.", "B. Next to the original structure.", "C. On top of the original structure.", "D. In front of the original structure."], "answer": "D", "time_stamp_s": 212, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_209_a531_q1", "video_id": 209, "time_stamp_s": 212, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8dbe9f675adb415097b8974eaedda79ab0363517e69076c8be71a9e9d3c89ac6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0], "recent_frames_sha256": "91f4e4c456fee93f8caa6afe96e197448723dfeb28cf1c602b690899b32e47ab", "num_recent_frames": 30, "tq": 716199.760629132, "t1": 716207.413469216, "ta": 716207.413469216, "te": 716207.450836338, "first_response_s": 7.652840083930641, "answer_total_s": 7.690207205945626, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_209_a531_q1", "video_id": 209, "time_stamp_s": 212, "ground_truth": "D", "raw_output": "B. Next to the original structure.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "2d8258872cd48ea2d2cc73ab716da002549bd13a46017ccde9330785b0b9ee2b", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand places a yellow LEGO baseplate on a white surface, then adds a green LEGO piece on top, followed by a blue LEGO piece.  \n- The hand manipulates the green and blue pieces, adjusting their positions relative to the yellow baseplate.  \n- The hand continues to stack and reposition LEGO pieces, forming a small structure on the white surface.\n[30-60s] - Hand places a blue brick atop a green base, then adds a yellow brick on top of the blue one.  \n- The hand adjusts the yellow brick to align with the green base, forming a stacked structure.  \n- The hand then positions a second blue brick on top of the yellow one, completing the tower.\n[60-90s] - Hands manipulate colorful plastic blocks, adding yellow pieces to the base.  \n- Green and blue blocks form a central structure atop the yellow base.  \n- Blocks are arranged in a linear, stepped pattern on a white surface.\n[90-120s] - Hand places green blocks atop existing yellow and blue base structure.  \n- Hand adjusts green blocks to align with the base, ensuring stability.  \n- Blue blocks remain fixed at the bottom, serving as a foundation for the green additions.\n[120-150s] - Hands adjust blue and green blocks on a yellow base, aligning them in a row.  \n- A yellow block is added to the right side, extending the structure.  \n- The structure remains static on a white surface against a yellow wall.\n[150-180s] - A hand places a yellow brick with studs onto a white table, adjacent to a partially built structure made of blue, green, and yellow bricks.  \n- The hand then positions an orange brick with studs next to the yellow brick, forming a new segment.  \n- The hand continues to add more bricks, including another yellow brick, to extend the structure horizontally.\n[180-210s] - Hand places a green block onto the white table, positioning it near the existing colorful block structures.  \n- The hand then moves away, leaving the green block in place as the other blocks remain assembled on the table.  \n- The green block is positioned to the right of the orange and yellow blocks, slightly separated from the main structure.", "history_tokens": 483, "history_utf8_bytes": 2101, "recent_frame_times_s": [183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0], "recent_frames_sha256": "91f4e4c456fee93f8caa6afe96e197448723dfeb28cf1c602b690899b32e47ab", "num_recent_frames": 30, "tq": 716133.573047204, "t1": 716147.672905931, "ta": 716147.672905931, "te": 716147.974766901, "first_response_s": 14.099858727073297, "answer_total_s": 14.401719697052613, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 209, "content_group": "d50664402feff2ac1fdf008eec52fc01d9b6645303132339410b8ffec353ed8a", "question": {"question_id": "sample_209_a532_q0", "video_id": 209, "video_path": "./videos/sample_209_real.mp4", "annotation_index": 532, "question_index": 0, "question": "What did the person do with the yellow block just now?", "options": ["A. Removed them from the structure.", "B. Arranged them on the blue block and adjusted for alignment.", "C. Stacked them on top of the blue blocks.", "D. Placed them above the green block and another yellow block."], "answer": "D", "time_stamp_s": 315, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_209_a532_q0", "video_id": 209, "time_stamp_s": 315, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4f07617fd8b516646d354d0b07abe18aeb8dbc54be3e9e10da452cb88bd21e2a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0], "recent_frames_sha256": "048527d1187f49dba0f7da0c87420c6a9ea16d20c26a98f7cc9ad566e462c0e7", "num_recent_frames": 30, "tq": 716207.467187618, "t1": 716214.893809049, "ta": 716214.893809049, "te": 716214.931446692, "first_response_s": 7.426621431019157, "answer_total_s": 7.464259073953144, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_209_a532_q0", "video_id": 209, "time_stamp_s": 315, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "81715289012f2541d5ea99cbf30a167650cbc9f37d161677491d3268bea0c6fe", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand places a yellow LEGO baseplate on a white surface, then adds a green LEGO piece on top, followed by a blue LEGO piece.  \n- The hand manipulates the green and blue pieces, adjusting their positions relative to the yellow baseplate.  \n- The hand continues to stack and reposition LEGO pieces, forming a small structure on the white surface.\n[30-60s] - Hand places a blue brick atop a green base, then adds a yellow brick on top of the blue one.  \n- The hand adjusts the yellow brick to align with the green base, forming a stacked structure.  \n- The hand then positions a second blue brick on top of the yellow one, completing the tower.\n[60-90s] - Hands manipulate colorful plastic blocks, adding yellow pieces to the base.  \n- Green and blue blocks form a central structure atop the yellow base.  \n- Blocks are arranged in a linear, stepped pattern on a white surface.\n[90-120s] - Hand places green blocks atop existing yellow and blue base structure.  \n- Hand adjusts green blocks to align with the base, ensuring stability.  \n- Blue blocks remain fixed at the bottom, serving as a foundation for the green additions.\n[120-150s] - Hands adjust blue and green blocks on a yellow base, aligning them in a row.  \n- A yellow block is added to the right side, extending the structure.  \n- The structure remains static on a white surface against a yellow wall.\n[150-180s] - A hand places a yellow brick with studs onto a white table, adjacent to a partially built structure made of blue, green, and yellow bricks.  \n- The hand then positions an orange brick with studs next to the yellow brick, forming a new segment.  \n- The hand continues to add more bricks, including another yellow brick, to extend the structure horizontally.\n[180-210s] - Hand places a green block onto the white table, positioning it near the existing colorful block structures.  \n- The hand then moves away, leaving the green block in place as the other blocks remain assembled on the table.  \n- The green block is positioned to the right of the orange and yellow blocks, slightly separated from the main structure.\n[210-240s] - A hand places a green block onto a yellow base, then adds a blue block on top of the green one.  \n- The hand then positions a yellow block adjacent to the blue-green structure, extending the assembly.  \n- A separate orange and yellow structure remains static in the background, untouched during the assembly.\n[240-270s] - Hands manipulate colorful interlocking blocks, assembling a multi-layered structure with blue, yellow, green, and orange pieces.  \n- The structure grows vertically as blocks are stacked, with the hands adjusting positions to align interlocking studs.  \n- A partially completed structure remains in the background, while the foreground structure is actively being built.\n[270-300s] - Hands place green blocks onto a growing structure made of yellow, blue, and orange interlocking pieces.  \n- The structure, resembling a vehicle, is assembled on a white surface against a yellow wall.  \n- A single green block is set aside after being used in the assembly process.", "history_tokens": 701, "history_utf8_bytes": 3099, "recent_frame_times_s": [286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0], "recent_frames_sha256": "048527d1187f49dba0f7da0c87420c6a9ea16d20c26a98f7cc9ad566e462c0e7", "num_recent_frames": 30, "tq": 716168.521150915, "t1": 716175.694180624, "ta": 716175.694180624, "te": 716175.732272991, "first_response_s": 7.173029709025286, "answer_total_s": 7.211122076027095, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 210, "content_group": "4ad0e2ab4b22f50e6dc92b1942946b3dae72120c767fd0b7cc7e2c9985f72e24", "question": {"question_id": "sample_210_a1312_q0", "video_id": 210, "video_path": "./videos/sample_210_real.mp4", "annotation_index": 1312, "question_index": 0, "question": "What was written in the top right corner at the start of the video?", "options": ["A. Toy Car.", "B. Auto Rickshaw.", "C. Building Blocks.", "D. Colorful Toy."], "answer": "B", "time_stamp_s": 8, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_210_a1312_q0", "video_id": 210, "time_stamp_s": 8, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c78a055545c1026b5b1c7e4b53cf1b97f0d0bb47c092687c6b0bb905d6864f61", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0], "recent_frames_sha256": "d283cc5195874560425686d697b93480a1d9b1ef28be17bd591e6a7acd7b8cf3", "num_recent_frames": 9, "tq": 718626.392287783, "t1": 718631.513195687, "ta": 718631.513195687, "te": 718631.550499094, "first_response_s": 5.120907903998159, "answer_total_s": 5.158211310976185, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_210_a1312_q0", "video_id": 210, "time_stamp_s": 8, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c3428e58fdd472b47b2e8276b5fde6e38dd60a2502b118d5d1dc189ce5da6278", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0], "recent_frames_sha256": "d283cc5195874560425686d697b93480a1d9b1ef28be17bd591e6a7acd7b8cf3", "num_recent_frames": 9, "tq": 718537.500316268, "t1": 718544.542096624, "ta": 718544.542096624, "te": 718544.913209926, "first_response_s": 7.041780356084928, "answer_total_s": 7.412893658038229, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 210, "content_group": "4ad0e2ab4b22f50e6dc92b1942946b3dae72120c767fd0b7cc7e2c9985f72e24", "question": {"question_id": "sample_210_a1312_q1", "video_id": 210, "video_path": "./videos/sample_210_real.mp4", "annotation_index": 1312, "question_index": 1, "question": "What sequence of actions happened after the blue rectangular block is placed on the surface?", "options": ["A. The hand adds a yellow block, then an orange block, and adjusts the orange block.", "B. The hand adjusts the blue block, then adds a red block, and adjusts it again.", "C. The hand places a green block, then a yellow block, and adjusts the yellow block.", "D. The hand removes the blue block, places it again, and then adds a yellow block."], "answer": "A", "time_stamp_s": 19, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "block_building", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_210_a1312_q1", "video_id": 210, "time_stamp_s": 19, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "565244c71954c72d37d789a3ef211b0bfb7b27f5f4165da3907ebc2ea4f63e93", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "35205b301226d0aa9d458f786004d2f8d952b2d07223372835a28e744a588a3d", "num_recent_frames": 20, "tq": 718631.565702864, "t1": 718644.322199263, "ta": 718644.322199263, "te": 718644.360037536, "first_response_s": 12.75649639905896, "answer_total_s": 12.794334672042169, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_210_a1312_q1", "video_id": 210, "time_stamp_s": 19, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ceb840c0d2de421f5a03813f3c9c10c250cd02ddd8be7ec17af74f328dedb8f2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "35205b301226d0aa9d458f786004d2f8d952b2d07223372835a28e744a588a3d", "num_recent_frames": 20, "tq": 718544.924101887, "t1": 718552.9302246, "ta": 718552.9302246, "te": 718552.967871321, "first_response_s": 8.00612271297723, "answer_total_s": 8.043769433978014, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 210, "content_group": "4ad0e2ab4b22f50e6dc92b1942946b3dae72120c767fd0b7cc7e2c9985f72e24", "question": {"question_id": "sample_210_a1313_q0", "video_id": 210, "video_path": "./videos/sample_210_real.mp4", "annotation_index": 1313, "question_index": 0, "question": "What is the predominant color of the blocks being placed by the hand right now?", "options": ["A. Blue.", "B. Orange.", "C. Green.", "D. Yellow."], "answer": "D", "time_stamp_s": 66, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_210_a1313_q0", "video_id": 210, "time_stamp_s": 66, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5c65f3a2031197cb5e18bbfb947c5956ebc514184a89fcc923e36b11e0769fff", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0], "recent_frames_sha256": "cc64165d62684ee30977e5d30503ebe1ae4c83f31856d26428a4bcedaca128d3", "num_recent_frames": 30, "tq": 718644.375012572, "t1": 718655.280668726, "ta": 718655.280668726, "te": 718655.318712799, "first_response_s": 10.905656153918244, "answer_total_s": 10.943700226955116, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_210_a1313_q0", "video_id": 210, "time_stamp_s": 66, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3b93f8af03459930b7d908fea275323f932bfbfedeed30975cc7fd4bfef53570", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand places a blue baseplate on a white surface, then stacks orange and yellow blocks on top of it.  \n- The hand continues to add more orange blocks, forming a small structure on the blue baseplate.  \n- The hand adjusts the blocks, ensuring they are properly aligned and stacked.\n[30-60s] - Hand places a yellow block atop a blue baseplate, then adds a second yellow block beside it.  \n- Hand subsequently positions an orange block next to the yellow ones, followed by a smaller yellow block to the left.  \n- Final arrangement shows a row of yellow and orange blocks on the blue baseplate, with the hand no longer visible.", "history_tokens": 146, "history_utf8_bytes": 634, "recent_frame_times_s": [37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0], "recent_frames_sha256": "cc64165d62684ee30977e5d30503ebe1ae4c83f31856d26428a4bcedaca128d3", "num_recent_frames": 30, "tq": 718573.755676974, "t1": 718581.573959082, "ta": 718581.573959082, "te": 718581.611786722, "first_response_s": 7.818282108055428, "answer_total_s": 7.856109748012386, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 210, "content_group": "4ad0e2ab4b22f50e6dc92b1942946b3dae72120c767fd0b7cc7e2c9985f72e24", "question": {"question_id": "sample_210_a1314_q0", "video_id": 210, "video_path": "./videos/sample_210_real.mp4", "annotation_index": 1314, "question_index": 0, "question": "What color is the block being placed on the left side of the structure right now?", "options": ["A. Red.", "B. Blue.", "C. Green.", "D. Yellow."], "answer": "B", "time_stamp_s": 122, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_210_a1314_q0", "video_id": 210, "time_stamp_s": 122, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c31203dca57605abdd776eb4c29a5ee1bc35108c60cca5594dacf3e468d9b46e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0], "recent_frames_sha256": "f5b72409a6dd56860639cec594c07ac1d72fb0bfc27b1cb33ee99e72b0f6b910", "num_recent_frames": 30, "tq": 718655.331208917, "t1": 718667.157100005, "ta": 718667.157100005, "te": 718667.194920795, "first_response_s": 11.825891087995842, "answer_total_s": 11.863711878075264, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_210_a1314_q0", "video_id": 210, "time_stamp_s": 122, "ground_truth": "B", "raw_output": "D. Yellow.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "fba79db11d9c9457c928aecda7072bf0e2524fe230fcedd6246982385e4ba4ad", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand places a blue baseplate on a white surface, then stacks orange and yellow blocks on top of it.  \n- The hand continues to add more orange blocks, forming a small structure on the blue baseplate.  \n- The hand adjusts the blocks, ensuring they are properly aligned and stacked.\n[30-60s] - Hand places a yellow block atop a blue baseplate, then adds a second yellow block beside it.  \n- Hand subsequently positions an orange block next to the yellow ones, followed by a smaller yellow block to the left.  \n- Final arrangement shows a row of yellow and orange blocks on the blue baseplate, with the hand no longer visible.\n[60-90s] - Hand places yellow block onto blue base, aligning it with existing structure.  \n- Yellow blocks are stacked in a row, forming a continuous horizontal line.  \n- Blue baseplate remains stationary as yellow blocks are added to its right side.\n[90-120s] - Hand repeatedly places and adjusts orange and blue blocks on a growing structure.  \n- Blocks are stacked in a linear arrangement with some vertical stacking on the right side.  \n- Structure remains on a plain white surface with no visible background objects.", "history_tokens": 260, "history_utf8_bytes": 1156, "recent_frame_times_s": [93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0], "recent_frames_sha256": "f5b72409a6dd56860639cec594c07ac1d72fb0bfc27b1cb33ee99e72b0f6b910", "num_recent_frames": 30, "tq": 718601.872504123, "t1": 718608.374465802, "ta": 718608.374465802, "te": 718608.524943876, "first_response_s": 6.501961678965017, "answer_total_s": 6.6524397529428825, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 210, "content_group": "4ad0e2ab4b22f50e6dc92b1942946b3dae72120c767fd0b7cc7e2c9985f72e24", "question": {"question_id": "sample_210_a1315_q0", "video_id": 210, "video_path": "./videos/sample_210_real.mp4", "annotation_index": 1315, "question_index": 0, "question": "What is the block structure identified as?", "options": ["A. A house.", "B. A vehicle.", "C. A spaceship.", "D. A robot."], "answer": "B", "time_stamp_s": 197, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "block_building", "reference_interval_s": [180, 230], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_210_a1315_q0", "video_id": 210, "time_stamp_s": 197, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1d611ca360210a36a0ee2fffb95dfd3dd4c25de1ff91d97e4cacf3fc5747a6e7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0], "recent_frames_sha256": "56d65f993e31200aa79f39fb2b7da6ce6b43b15894fedc52ad4d5d88a86e4188", "num_recent_frames": 30, "tq": 718667.207254636, "t1": 718674.983656724, "ta": 718674.983656724, "te": 718675.021226911, "first_response_s": 7.7764020879985765, "answer_total_s": 7.8139722750056535, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_210_a1315_q0", "video_id": 210, "time_stamp_s": 197, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "06cfc58560bad10f2a1e5056f6205dfd0b4887412c8910e485683a918bb9ada0", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand places a blue baseplate on a white surface, then stacks orange and yellow blocks on top of it.  \n- The hand continues to add more orange blocks, forming a small structure on the blue baseplate.  \n- The hand adjusts the blocks, ensuring they are properly aligned and stacked.\n[30-60s] - Hand places a yellow block atop a blue baseplate, then adds a second yellow block beside it.  \n- Hand subsequently positions an orange block next to the yellow ones, followed by a smaller yellow block to the left.  \n- Final arrangement shows a row of yellow and orange blocks on the blue baseplate, with the hand no longer visible.\n[60-90s] - Hand places yellow block onto blue base, aligning it with existing structure.  \n- Yellow blocks are stacked in a row, forming a continuous horizontal line.  \n- Blue baseplate remains stationary as yellow blocks are added to its right side.\n[90-120s] - Hand repeatedly places and adjusts orange and blue blocks on a growing structure.  \n- Blocks are stacked in a linear arrangement with some vertical stacking on the right side.  \n- Structure remains on a plain white surface with no visible background objects.\n[120-150s] - Hand places a green block atop the existing structure, aligning it with adjacent blocks.  \n- Green block is then adjusted slightly to ensure stability and proper fit with surrounding pieces.  \n- Hand continues to interact with the green block, making minor adjustments to its position on the structure.\n[150-180s] - Hand places a yellow block onto the green section of a multicolored LEGO structure.  \n- Hand then lifts the entire structure, revealing two separate toy vehicles (yellow and red) on the white surface below.  \n- Structure is repositioned, with the hand adjusting its orientation and placement on the table.", "history_tokens": 400, "history_utf8_bytes": 1791, "recent_frame_times_s": [168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0], "recent_frames_sha256": "56d65f993e31200aa79f39fb2b7da6ce6b43b15894fedc52ad4d5d88a86e4188", "num_recent_frames": 30, "tq": 718624.109181495, "t1": 718625.976922331, "ta": 718625.976922331, "te": 718626.34994934, "first_response_s": 1.867740835994482, "answer_total_s": 2.240767844952643, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 211, "content_group": "0677c2fd9c1c7a73e21b8cdede4187654b7bde425da2bc36d7d077acc55af35b", "question": {"question_id": "sample_211_a822_q0", "video_id": 211, "video_path": "./videos/sample_211_real.mp4", "annotation_index": 822, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. Graphing on the Coordinate Plane.", "B. Calculus functions.", "C. Trigonometric ratios.", "D. Differential equations."], "answer": "A", "time_stamp_s": 16, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_211_a822_q0", "video_id": 211, "time_stamp_s": 16, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4f81b2d3c0d81db5d787ecdd9abee5d66caaba2bc14188f7237f03a911489482", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "4c1eb574a44a0d53d39a5c454ed65999f413f09cf837407fce6d32ba265e2622", "num_recent_frames": 16, "tq": 710537.117955148, "t1": 710537.692957544, "ta": 710537.692957544, "te": 710537.730173792, "first_response_s": 0.5750023960135877, "answer_total_s": 0.6122186440043151, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_211_a822_q0", "video_id": 211, "time_stamp_s": 16, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b192078276eae04db275001368b22739a8f40a72bec0336280e63bd6538f0cce", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "4c1eb574a44a0d53d39a5c454ed65999f413f09cf837407fce6d32ba265e2622", "num_recent_frames": 16, "tq": 710360.386852667, "t1": 710372.735037934, "ta": 710372.735037934, "te": 710372.88997889, "first_response_s": 12.348185267066583, "answer_total_s": 12.503126222989522, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 211, "content_group": "0677c2fd9c1c7a73e21b8cdede4187654b7bde425da2bc36d7d077acc55af35b", "question": {"question_id": "sample_211_a823_q0", "video_id": 211, "video_path": "./videos/sample_211_real.mp4", "annotation_index": 823, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to label the axes.", "B. How to connect the plotted points.", "C. How to identify coordinates.", "D. How to scale the graph."], "answer": "B", "time_stamp_s": 142, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [126, 146], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_211_a823_q0", "video_id": 211, "time_stamp_s": 142, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "71ae19c68133a6a34ea3c5f2139458b3009918675862926fe3f8495020846edf", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333], "recent_frames_sha256": "de4e4be03304cae5f0b7e2cac37d86fdf4e57dcac7c249373894594b55294878", "num_recent_frames": 30, "tq": 710537.749175849, "t1": 710551.630842852, "ta": 710551.630842852, "te": 710551.66759958, "first_response_s": 13.881667003035545, "answer_total_s": 13.918423730996437, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_211_a823_q0", "video_id": 211, "time_stamp_s": 142, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d589f7ad7901f1b14c0e2d7215c3106543187490c608fc6ace9e32416faca291", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a grey \"Math Antics\" t-shirt stands against a green background, gesturing as text overlays appear, including \"Important Foundation\" and \"Graphing\" with equations.\n- A second man with a curly wig and paintbrush stands before an easel with a coordinate plane, pointing to a plotted curve while holding a paint palette.\n- The video transitions from a grid background with animated text to a solid green backdrop with the presenter, then to a black background with the artist and coordinate plane.\n[30-60s] - Artist with curly gray hair paints a blue curved line on a grid using a brush and palette.  \n- The grid is mounted on an easel, and the artist gestures toward the painted curve while speaking.  \n- The background remains black, emphasizing the artist and the canvas.\n[60-90s] - A man in a gray \"math antics\" t-shirt stands against a grid background, gesturing toward on-screen text and graphics.  \n- A table labeled \"Data Set\" with X and Y values appears, followed by a floating sheet displaying mathematical expressions and results.  \n- The sheet transitions to show a window frame with a blue sine wave inside, then shifts to a coordinate plane with axes.\n[90-120s] - A number line appears with labeled integers from -4 to 4, centered at zero, with arrows indicating directionality.\n- A vertical number line is added to the right, aligned with the horizontal line at zero, forming a cross.\n- The cross-shaped coordinate plane is shown with both axes labeled and marked with integer increments, replacing the previous number line.", "history_tokens": 343, "history_utf8_bytes": 1554, "recent_frame_times_s": [112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333], "recent_frames_sha256": "de4e4be03304cae5f0b7e2cac37d86fdf4e57dcac7c249373894594b55294878", "num_recent_frames": 30, "tq": 710403.113166174, "t1": 710409.513236994, "ta": 710409.513236994, "te": 710409.759063549, "first_response_s": 6.400070820003748, "answer_total_s": 6.645897374954075, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 211, "content_group": "0677c2fd9c1c7a73e21b8cdede4187654b7bde425da2bc36d7d077acc55af35b", "question": {"question_id": "sample_211_a824_q0", "video_id": 211, "video_path": "./videos/sample_211_real.mp4", "annotation_index": 824, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. How to plot points on the axes.", "B. The importance of the x-axis.", "C. The significance of the y-axis.", "D. What ordered pairs represent."], "answer": "D", "time_stamp_s": 260, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [252, 272], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_211_a824_q0", "video_id": 211, "time_stamp_s": 260, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9783a7162982a304d9d8b000718ad5cc01e60211037daf5147647213a435d54a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335], "recent_frames_sha256": "db34585b597ac95540169d10bd7ca14c6f5f6064bc2ba5b0d1012d1257d567ee", "num_recent_frames": 30, "tq": 710551.694516961, "t1": 710563.238274778, "ta": 710563.238274778, "te": 710563.276732807, "first_response_s": 11.543757817009464, "answer_total_s": 11.58221584605053, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_211_a824_q0", "video_id": 211, "time_stamp_s": 260, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6f9c881412ce1968f9344063c0d83f496e0512467b017ee285550fd7fa904f99", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a grey \"Math Antics\" t-shirt stands against a green background, gesturing as text overlays appear, including \"Important Foundation\" and \"Graphing\" with equations.\n- A second man with a curly wig and paintbrush stands before an easel with a coordinate plane, pointing to a plotted curve while holding a paint palette.\n- The video transitions from a grid background with animated text to a solid green backdrop with the presenter, then to a black background with the artist and coordinate plane.\n[30-60s] - Artist with curly gray hair paints a blue curved line on a grid using a brush and palette.  \n- The grid is mounted on an easel, and the artist gestures toward the painted curve while speaking.  \n- The background remains black, emphasizing the artist and the canvas.\n[60-90s] - A man in a gray \"math antics\" t-shirt stands against a grid background, gesturing toward on-screen text and graphics.  \n- A table labeled \"Data Set\" with X and Y values appears, followed by a floating sheet displaying mathematical expressions and results.  \n- The sheet transitions to show a window frame with a blue sine wave inside, then shifts to a coordinate plane with axes.\n[90-120s] - A number line appears with labeled integers from -4 to 4, centered at zero, with arrows indicating directionality.\n- A vertical number line is added to the right, aligned with the horizontal line at zero, forming a cross.\n- The cross-shaped coordinate plane is shown with both axes labeled and marked with integer increments, replacing the previous number line.\n[120-150s] - A man in a gray \"Math Antics\" t-shirt gestures while standing beside a grid background.  \n- A number line with labeled \"0\" appears below the grid, followed by blue dots marking positions along it.  \n- The grid displays blue dots forming a curve, indicating plotting points in a 2D plane.\n[150-180s] - A blue dot appears on a 1D number line at position 0.5, labeled as \"1 Dimensional\".\n- A blue dot appears on a 2D coordinate plane at (2, 3), with \"2 Dimensional\" and \"Coordinates\" labels.\n- The presenter appears, wearing a \"mathantics\" shirt, standing beside the 2D coordinate plane.\n[180-210s] - Text \"Format (#, #)\" and \"Coordinates\" appear on screen, followed by examples (2,5), (-7,3), (0,15) as the presenter speaks.\n- A grid with yellow axes appears, labeled \"Axis\" at the bottom, then \"Vertical\" on the y-axis, and \"Horizontal\" on the x-axis.\n- The presenter gestures toward the grid as labels are added to the axes.\n[210-240s] - A grid with labeled axes (Vertical, Horizontal, Axis) appears on a light purple background.  \n- Text \"Variable based names\" appears in blue on the left side of the grid.  \n- The horizontal axis is labeled \"x axis\" in red, and the vertical axis is labeled \"y axis\" in red.  \n- A man in a gray shirt with \"Math Antics\" logo appears on the right, gesturing toward the grid.", "history_tokens": 709, "history_utf8_bytes": 2876, "recent_frame_times_s": [230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335], "recent_frames_sha256": "db34585b597ac95540169d10bd7ca14c6f5f6064bc2ba5b0d1012d1257d567ee", "num_recent_frames": 30, "tq": 710442.935272781, "t1": 710449.07437879, "ta": 710449.07437879, "te": 710449.112230432, "first_response_s": 6.1391060090390965, "answer_total_s": 6.176957651041448, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 211, "content_group": "0677c2fd9c1c7a73e21b8cdede4187654b7bde425da2bc36d7d077acc55af35b", "question": {"question_id": "sample_211_a825_q0", "video_id": 211, "video_path": "./videos/sample_211_real.mp4", "annotation_index": 825, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. How to plot another point.", "B. How to label the y-axis.", "C. The importance of the y-intercept.", "D. How to draw a quadratic curve."], "answer": "A", "time_stamp_s": 397, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [378, 398], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_211_a825_q0", "video_id": 211, "time_stamp_s": 397, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "652eec188db6c8fa121c69c95e23b177a8dfa2f65986c5221c5c84618ff25319", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.0169666666667, 385.01796666666667, 386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665, 394.0269666666667, 395.02796666666666, 396.0289666666667], "recent_frames_sha256": "21971eaa8ba56c60602022c5cfb79798b9a01ea6e325a81350e23a7f5b48c06a", "num_recent_frames": 30, "tq": 710563.294214243, "t1": 710575.093356641, "ta": 710575.093356641, "te": 710575.130322098, "first_response_s": 11.799142398056574, "answer_total_s": 11.836107855080627, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_211_a825_q0", "video_id": 211, "time_stamp_s": 397, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1b27af09a89854f433848b202d508e82f98b470e113d9ca407f58f807a8deb70", "condition_order": ["notes", "recent"], "memory": "[60-90s] - A man in a gray \"math antics\" t-shirt stands against a grid background, gesturing toward on-screen text and graphics.  \n- A table labeled \"Data Set\" with X and Y values appears, followed by a floating sheet displaying mathematical expressions and results.  \n- The sheet transitions to show a window frame with a blue sine wave inside, then shifts to a coordinate plane with axes.\n[90-120s] - A number line appears with labeled integers from -4 to 4, centered at zero, with arrows indicating directionality.\n- A vertical number line is added to the right, aligned with the horizontal line at zero, forming a cross.\n- The cross-shaped coordinate plane is shown with both axes labeled and marked with integer increments, replacing the previous number line.\n[120-150s] - A man in a gray \"Math Antics\" t-shirt gestures while standing beside a grid background.  \n- A number line with labeled \"0\" appears below the grid, followed by blue dots marking positions along it.  \n- The grid displays blue dots forming a curve, indicating plotting points in a 2D plane.\n[150-180s] - A blue dot appears on a 1D number line at position 0.5, labeled as \"1 Dimensional\".\n- A blue dot appears on a 2D coordinate plane at (2, 3), with \"2 Dimensional\" and \"Coordinates\" labels.\n- The presenter appears, wearing a \"mathantics\" shirt, standing beside the 2D coordinate plane.\n[180-210s] - Text \"Format (#, #)\" and \"Coordinates\" appear on screen, followed by examples (2,5), (-7,3), (0,15) as the presenter speaks.\n- A grid with yellow axes appears, labeled \"Axis\" at the bottom, then \"Vertical\" on the y-axis, and \"Horizontal\" on the x-axis.\n- The presenter gestures toward the grid as labels are added to the axes.\n[210-240s] - A grid with labeled axes (Vertical, Horizontal, Axis) appears on a light purple background.  \n- Text \"Variable based names\" appears in blue on the left side of the grid.  \n- The horizontal axis is labeled \"x axis\" in red, and the vertical axis is labeled \"y axis\" in red.  \n- A man in a gray shirt with \"Math Antics\" logo appears on the right, gesturing toward the grid.\n[240-270s] - A man in a gray \"Math Antics\" t-shirt gestures while explaining coordinate system concepts.\n- A grid with labeled x-axis and y-axis appears, with \"(x, y)\" text below it.\n- Arrows highlight the order of coordinates, first pointing to \"x\" then \"y\", with text labels \"first\" and \"second\" appearing sequentially.\n[270-300s] - Text \"Coordinates (x, y)\" appears with \"Ordered Pairs\" below it, followed by \"x=3 y=5\" as the point to plot.\n- A grid with labeled x-axis and y-axis is displayed, with arrows pointing to the axes to indicate their directions.\n- A man in a gray shirt appears, gesturing toward the grid as he explains the concept of plotting coordinates.\n[300-330s] - A man in a gray t-shirt with \"Math Antics\" logo gestures toward a grid graph with labeled x and y axes.\n- The text \"Plot (x, y)\" appears in yellow at the top left, with \"Work Together\" in white to its right.\n- The graph displays a coordinate point (3,2) in blue, positioned above the x-axis and to the right of the y-axis.\n[330-360s] - A red arrow points to the point (3,2) on the grid, indicating its location.\n- A vertical line labeled \"Line x = 3\" is drawn, intersecting the x-axis at x=3.\n- The red arrow moves along the vertical line, showing that the point (3,2) lies on this line.\n[360-390s] - A grid with labeled axes (x-axis, y-axis) and a point (3,2) is displayed.\n- A vertical line labeled \"Line x = 3\" is shown intersecting the grid at x=3.\n- A horizontal line labeled \"Line y = 2\" is shown intersecting the grid at y=2.", "history_tokens": 966, "history_utf8_bytes": 3604, "recent_frame_times_s": [367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.0169666666667, 385.01796666666667, 386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665, 394.0269666666667, 395.02796666666666, 396.0289666666667], "recent_frames_sha256": "21971eaa8ba56c60602022c5cfb79798b9a01ea6e325a81350e23a7f5b48c06a", "num_recent_frames": 30, "tq": 710491.784668857, "t1": 710499.005872963, "ta": 710499.005872963, "te": 710499.225027274, "first_response_s": 7.221204105997458, "answer_total_s": 7.44035841699224, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 211, "content_group": "0677c2fd9c1c7a73e21b8cdede4187654b7bde425da2bc36d7d077acc55af35b", "question": {"question_id": "sample_211_a826_q0", "video_id": 211, "video_path": "./videos/sample_211_real.mp4", "annotation_index": 826, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. How to plot a line graph.", "B. The significance of the axes intersections.", "C. How to differentiate the quadrants.", "D. The concept of linear equations."], "answer": "C", "time_stamp_s": 511, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [504, 524], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_211_a826_q0", "video_id": 211, "time_stamp_s": 511, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5b92eef11b017a38073abddb3719799d6221599ffa4b60f5891818604fd77869", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667, 487.01986666666664, 488.0208666666667, 489.02186666666665, 490.0228666666667, 491.02386666666666, 492.02486666666664, 493.0258666666667, 494.02686666666665, 495.0278666666667, 496.02886666666666, 497.0298666666667, 498.03086666666667, 499.03186666666664, 500.0328666666667, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095], "recent_frames_sha256": "5bd4180f1414d3c5c1977dee3683ef98b9b96e92e786b8f855f0a1393537da0b", "num_recent_frames": 30, "tq": 710575.140558789, "t1": 710586.318911469, "ta": 710586.318911469, "te": 710586.504523099, "first_response_s": 11.178352679940872, "answer_total_s": 11.363964310032316, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_211_a826_q0", "video_id": 211, "time_stamp_s": 511, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "483f3ed3d0cf8832585d071d152074ccc1d3f940a1e932402cbf3e9d27c74e1c", "condition_order": ["notes", "recent"], "memory": "[180-210s] - Text \"Format (#, #)\" and \"Coordinates\" appear on screen, followed by examples (2,5), (-7,3), (0,15) as the presenter speaks.\n- A grid with yellow axes appears, labeled \"Axis\" at the bottom, then \"Vertical\" on the y-axis, and \"Horizontal\" on the x-axis.\n- The presenter gestures toward the grid as labels are added to the axes.\n[210-240s] - A grid with labeled axes (Vertical, Horizontal, Axis) appears on a light purple background.  \n- Text \"Variable based names\" appears in blue on the left side of the grid.  \n- The horizontal axis is labeled \"x axis\" in red, and the vertical axis is labeled \"y axis\" in red.  \n- A man in a gray shirt with \"Math Antics\" logo appears on the right, gesturing toward the grid.\n[240-270s] - A man in a gray \"Math Antics\" t-shirt gestures while explaining coordinate system concepts.\n- A grid with labeled x-axis and y-axis appears, with \"(x, y)\" text below it.\n- Arrows highlight the order of coordinates, first pointing to \"x\" then \"y\", with text labels \"first\" and \"second\" appearing sequentially.\n[270-300s] - Text \"Coordinates (x, y)\" appears with \"Ordered Pairs\" below it, followed by \"x=3 y=5\" as the point to plot.\n- A grid with labeled x-axis and y-axis is displayed, with arrows pointing to the axes to indicate their directions.\n- A man in a gray shirt appears, gesturing toward the grid as he explains the concept of plotting coordinates.\n[300-330s] - A man in a gray t-shirt with \"Math Antics\" logo gestures toward a grid graph with labeled x and y axes.\n- The text \"Plot (x, y)\" appears in yellow at the top left, with \"Work Together\" in white to its right.\n- The graph displays a coordinate point (3,2) in blue, positioned above the x-axis and to the right of the y-axis.\n[330-360s] - A red arrow points to the point (3,2) on the grid, indicating its location.\n- A vertical line labeled \"Line x = 3\" is drawn, intersecting the x-axis at x=3.\n- The red arrow moves along the vertical line, showing that the point (3,2) lies on this line.\n[360-390s] - A grid with labeled axes (x-axis, y-axis) and a point (3,2) is displayed.\n- A vertical line labeled \"Line x = 3\" is shown intersecting the grid at x=3.\n- A horizontal line labeled \"Line y = 2\" is shown intersecting the grid at y=2.\n[390-420s] - A man in a gray \"math antics\" shirt gestures while explaining coordinate axes on a grid.\n- The grid displays labeled x-axis and y-axis with a blue dot at the origin.\n- The point (3,2) appears in blue text above the grid, indicating coordinates for plotting.\n[420-450s] - A yellow line segment appears, extending horizontally from the origin (0,0) to the point (3,2) along the x-axis.\n- The point (3,2) is marked with a blue dot, positioned above the x-axis and to the right of the origin.\n- The x-axis label is highlighted in red, and the y-axis label is also visible, with the point (3,2) located along the y-axis.\n[450-480s] - The point (-4,3) is highlighted with a yellow circle and then a yellow line extends horizontally to the point (-3,3).\n- The point (-3,3) is labeled and highlighted in yellow, indicating its coordinates.\n- The point (3,2) remains static, positioned in the first quadrant.\n[480-510s] - A grid with labeled axes (x-axis and y-axis) displays four plotted points: (-4,3), (3,2), (-3,-3), and (4,-2.5).  \n- The point (-3,-3) is highlighted with a yellow path drawn from it to the origin, indicating movement along the axes.  \n- The point (4,-2.5) is highlighted with a yellow path drawn from it to the origin, indicating movement along the axes.", "history_tokens": 986, "history_utf8_bytes": 3523, "recent_frame_times_s": [481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667, 487.01986666666664, 488.0208666666667, 489.02186666666665, 490.0228666666667, 491.02386666666666, 492.02486666666664, 493.0258666666667, 494.02686666666665, 495.0278666666667, 496.02886666666666, 497.0298666666667, 498.03086666666667, 499.03186666666664, 500.0328666666667, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095], "recent_frames_sha256": "5bd4180f1414d3c5c1977dee3683ef98b9b96e92e786b8f855f0a1393537da0b", "num_recent_frames": 30, "tq": 710529.943575466, "t1": 710536.804283843, "ta": 710536.804283843, "te": 710537.066413937, "first_response_s": 6.860708376974799, "answer_total_s": 7.122838470968418, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 212, "content_group": "0dfc9943bf380053745c25d0c6448698a5ee764feb8f99c631fcb145b23768bb", "question": {"question_id": "sample_212_a561_q0", "video_id": 212, "video_path": "./videos/sample_212_real.mp4", "annotation_index": 561, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to add mixed numbers.", "B. The subtraction of mixed numbers.", "C. The multiplication of fractions.", "D. The properties of whole numbers."], "answer": "A", "time_stamp_s": 20, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_212_a561_q0", "video_id": 212, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d70accee9e01514b4515c67fe11f2ba874d5d8c035b3ec0d0b37883805203af1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019], "recent_frames_sha256": "aeab57cc27b1c686c0f4531d18bbb4a87326d2ce2ccfaa39f61bc615f54b3e98", "num_recent_frames": 20, "tq": 710456.720325535, "t1": 710464.279491253, "ta": 710464.279491253, "te": 710464.317938597, "first_response_s": 7.5591657179174945, "answer_total_s": 7.597613062011078, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_212_a561_q0", "video_id": 212, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2a98f7de99de9870c55c3d61aa765fb2a2c6ebfd0454aed7ff07bb85e6fc1321", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019], "recent_frames_sha256": "aeab57cc27b1c686c0f4531d18bbb4a87326d2ce2ccfaa39f61bc615f54b3e98", "num_recent_frames": 20, "tq": 710511.887258371, "t1": 710524.184184207, "ta": 710524.184184207, "te": 710524.222235838, "first_response_s": 12.296925836009905, "answer_total_s": 12.3349774669623, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 212, "content_group": "0dfc9943bf380053745c25d0c6448698a5ee764feb8f99c631fcb145b23768bb", "question": {"question_id": "sample_212_a562_q0", "video_id": 212, "video_path": "./videos/sample_212_real.mp4", "annotation_index": 562, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to add those two mixed numbers.", "B. The process of converting mixed numbers to improper fractions.", "C. Subtracting mixed numbers.", "D. The definition of mixed numbers."], "answer": "A", "time_stamp_s": 130, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [112, 142], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_212_a562_q0", "video_id": 212, "time_stamp_s": 130, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ca74439c1619d6f910a04ee94503202bdbe7127ca9a3037add062605feab0bac", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [100.03326666666666, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289], "recent_frames_sha256": "de88b38bfe07da823408e105faa119e4d491d835871c6cb68ac7ced5a54274ab", "num_recent_frames": 30, "tq": 710464.337118915, "t1": 710476.08777841, "ta": 710476.08777841, "te": 710476.125246674, "first_response_s": 11.750659494893625, "answer_total_s": 11.788127759005874, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_212_a562_q0", "video_id": 212, "time_stamp_s": 130, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "850dfb87a588f3e89d41d13c714ae08d8f7faacc90ed7560fd32c298add3308b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a green background, gesturing while explaining math concepts.  \n- On-screen text appears sequentially: \"Add Mixed Numbers?\", \"Mixed Number\", and examples like \"4 1/2\" and \"4 + 1/2\".  \n- A small inset screen briefly displays \"Add Mixed Numbers\" and \"Improper Fractions\" as related topics.\n[30-60s] - A man in a white \"math Antics\" t-shirt stands in front of a green screen, gesturing while explaining mixed number addition problems.\n- On-screen text displays equations like \"4 + 1/2\" and \"3 + 1/4\", with arrows highlighting the \"Added\" part of the first equation.\n- The background transitions to a light blue grid as the man continues explaining, with equations like \"2 + 3 1/4\" appearing, and a red arrow pointing to the \"2\" in \"2 + 3 1/4\".\n[60-90s] - A mixed number \"5 1/4\" is highlighted in a yellow circle, indicating it as the result of an addition problem.\n- The word \"whole\" appears in green text above the mixed number, while \"mixed\" appears in red text next to it.\n- The video transitions to a new problem, \"1 3/8 + 1/8,\" with arrows pointing to the fractions, suggesting a focus on combining like fractions.\n[90-120s] - A man in a white t-shirt with \"math Antics\" text appears, gesturing toward a math problem involving fractions.\n- The screen displays the equation \"1 + 3/8 + 1/8\" with the result \"1 4/8\" shown below, which is then corrected to \"1 1/2\" with a yellow circle highlighting the simplified fraction.\n- The word \"simplify\" appears in yellow text near the corrected fraction, indicating the next step in the math process.", "history_tokens": 431, "history_utf8_bytes": 1605, "recent_frame_times_s": [100.03326666666666, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289], "recent_frames_sha256": "de88b38bfe07da823408e105faa119e4d491d835871c6cb68ac7ced5a54274ab", "num_recent_frames": 30, "tq": 710557.051319825, "t1": 710562.234069753, "ta": 710562.234069753, "te": 710562.49249655, "first_response_s": 5.182749927975237, "answer_total_s": 5.441176724969409, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 212, "content_group": "0dfc9943bf380053745c25d0c6448698a5ee764feb8f99c631fcb145b23768bb", "question": {"question_id": "sample_212_a563_q0", "video_id": 212, "video_path": "./videos/sample_212_real.mp4", "annotation_index": 563, "question_index": 0, "question": "What might the speaker do next?", "options": ["A. How to add those two mixed numbers.", "B. Subtract the fractions.", "C. Multiply the fractions.", "D. Divide the fractions."], "answer": "A", "time_stamp_s": 248, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [224, 254], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_212_a563_q0", "video_id": 212, "time_stamp_s": 248, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8276969ba5aebf6038e3bada175568792091594949ff52c0202f994f16aacd98", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332], "recent_frames_sha256": "96f3053e578ca67cdcb9022ff40b30718e44177fe58f118b3319f69f44f52b79", "num_recent_frames": 30, "tq": 710476.143457621, "t1": 710486.827788571, "ta": 710486.827788571, "te": 710486.864698887, "first_response_s": 10.684330950025469, "answer_total_s": 10.721241266001016, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_212_a563_q0", "video_id": 212, "time_stamp_s": 248, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6ca892f828f99b2207d5d56ba43e01e66a8b28e51eb750da716862eebafc8a78", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a green background, gesturing while explaining math concepts.  \n- On-screen text appears sequentially: \"Add Mixed Numbers?\", \"Mixed Number\", and examples like \"4 1/2\" and \"4 + 1/2\".  \n- A small inset screen briefly displays \"Add Mixed Numbers\" and \"Improper Fractions\" as related topics.\n[30-60s] - A man in a white \"math Antics\" t-shirt stands in front of a green screen, gesturing while explaining mixed number addition problems.\n- On-screen text displays equations like \"4 + 1/2\" and \"3 + 1/4\", with arrows highlighting the \"Added\" part of the first equation.\n- The background transitions to a light blue grid as the man continues explaining, with equations like \"2 + 3 1/4\" appearing, and a red arrow pointing to the \"2\" in \"2 + 3 1/4\".\n[60-90s] - A mixed number \"5 1/4\" is highlighted in a yellow circle, indicating it as the result of an addition problem.\n- The word \"whole\" appears in green text above the mixed number, while \"mixed\" appears in red text next to it.\n- The video transitions to a new problem, \"1 3/8 + 1/8,\" with arrows pointing to the fractions, suggesting a focus on combining like fractions.\n[90-120s] - A man in a white t-shirt with \"math Antics\" text appears, gesturing toward a math problem involving fractions.\n- The screen displays the equation \"1 + 3/8 + 1/8\" with the result \"1 4/8\" shown below, which is then corrected to \"1 1/2\" with a yellow circle highlighting the simplified fraction.\n- The word \"simplify\" appears in yellow text near the corrected fraction, indicating the next step in the math process.\n[120-150s] - The man gestures toward equations displayed on a grid background, which include mixed numbers like 2 1/5 and 4 2/5.\n- Red arrows point downward from the fractions in the equation, with text \"Commutative Property\" and \"order doesn't matter\" appearing below.\n- The equation rearranges visually to group whole numbers and fractions separately, showing 2 + 4 + 1/5 + 2/5.\n[150-180s] - Red arrows point downward from the numbers '2' and '4' to the number '6' below, indicating their sum.\n- The fraction '1/5' and '2/5' are highlighted with red arrows pointing to the number '3/5' below, showing their sum.\n- A yellow circle highlights the final result '6 3/5' after the addition is completed.\n[180-210s] - A man in a white \"Math Antics\" shirt stands beside a grid background, gesturing toward a math problem involving fractions.\n- The screen displays a vertical addition problem: 2 1/5 + 4 2/5 = 6 3/5, with the answer highlighted in green and labeled \"Answer\" in red text.\n- The problem transitions to a new addition problem: 25 + 15 = 10, followed by 1 25 + 15 = 0, with the numbers highlighted in green.\n[210-240s] - A man in a white \"Math Antics\" t-shirt gestures while standing beside a vertical addition problem (563 + 236) displayed on a grid background.  \n- The scene transitions to a group of men in a cozy, wood-paneled room, casually eating pizza and interacting while holding plates.  \n- On-screen graphics show four pizzas with slices removed, labeled as \"1 3/8\" and \"1 5/8,\" with the word \"Total?\" appearing in red.", "history_tokens": 865, "history_utf8_bytes": 3143, "recent_frame_times_s": [218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332], "recent_frames_sha256": "96f3053e578ca67cdcb9022ff40b30718e44177fe58f118b3319f69f44f52b79", "num_recent_frames": 30, "tq": 710593.005550126, "t1": 710601.489333855, "ta": 710601.489333855, "te": 710601.65017011, "first_response_s": 8.483783729025163, "answer_total_s": 8.644619984086603, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 212, "content_group": "0dfc9943bf380053745c25d0c6448698a5ee764feb8f99c631fcb145b23768bb", "question": {"question_id": "sample_212_a564_q0", "video_id": 212, "video_path": "./videos/sample_212_real.mp4", "annotation_index": 564, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to add mixed numbers.", "B. How to convert fractions to decimals.", "C. The process of subtracting fractions.", "D. How to add those two fractions numbers."], "answer": "D", "time_stamp_s": 396, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [336, 366], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_212_a564_q0", "video_id": 212, "time_stamp_s": 396, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5d9e8daa23c874abb193159f46159233661ca27370e64a879d369727f6d36b2d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.0169666666667, 385.01796666666667, 386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665, 394.0269666666667, 395.02796666666666], "recent_frames_sha256": "23b8bc9e094642f4c8b81ca8b61f207cc4265ad63d55583be56503da82b992cd", "num_recent_frames": 30, "tq": 710486.88479392, "t1": 710499.828418774, "ta": 710499.828418774, "te": 710499.865578617, "first_response_s": 12.943624853971414, "answer_total_s": 12.980784696992487, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_212_a564_q0", "video_id": 212, "time_stamp_s": 396, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "236344518df8cd7e5c56e2682f3277e17d578a609a90fe65a3980d56fe439e6d", "condition_order": ["recent", "notes"], "memory": "[120-150s] - The man gestures toward equations displayed on a grid background, which include mixed numbers like 2 1/5 and 4 2/5.\n- Red arrows point downward from the fractions in the equation, with text \"Commutative Property\" and \"order doesn't matter\" appearing below.\n- The equation rearranges visually to group whole numbers and fractions separately, showing 2 + 4 + 1/5 + 2/5.\n[150-180s] - Red arrows point downward from the numbers '2' and '4' to the number '6' below, indicating their sum.\n- The fraction '1/5' and '2/5' are highlighted with red arrows pointing to the number '3/5' below, showing their sum.\n- A yellow circle highlights the final result '6 3/5' after the addition is completed.\n[180-210s] - A man in a white \"Math Antics\" shirt stands beside a grid background, gesturing toward a math problem involving fractions.\n- The screen displays a vertical addition problem: 2 1/5 + 4 2/5 = 6 3/5, with the answer highlighted in green and labeled \"Answer\" in red text.\n- The problem transitions to a new addition problem: 25 + 15 = 10, followed by 1 25 + 15 = 0, with the numbers highlighted in green.\n[210-240s] - A man in a white \"Math Antics\" t-shirt gestures while standing beside a vertical addition problem (563 + 236) displayed on a grid background.  \n- The scene transitions to a group of men in a cozy, wood-paneled room, casually eating pizza and interacting while holding plates.  \n- On-screen graphics show four pizzas with slices removed, labeled as \"1 3/8\" and \"1 5/8,\" with the word \"Total?\" appearing in red.\n[240-270s] - A man in a white t-shirt with \"Math Antics\" text stands beside a grid background, gesturing toward a math problem involving adding mixed numbers.\n- The screen displays the problem \"1 3/8 + 1 5/8\" with a green vertical bar highlighting the addition process, showing intermediate steps like \"2 8/8\" and final result \"2 8/8\".\n- The final result \"2 8/8\" is circled, and a red arrow points to the \"whole fraction\" label as the man explains the conversion to \"2 + 1\" (implying simpl\n[270-300s] - A man in a white t-shirt with \"math Antics\" text stands beside a math problem involving mixed numbers.\n- The screen displays a visual of three pizzas, illustrating the concept of adding fractions.\n- The problem transitions to a new equation: 1 3/7 + 2 5/7, with text highlighting the commutative property.\n[300-330s] - A man in a white t-shirt with \"math Antics\" appears, gesturing toward a math problem on screen.  \n- The screen displays the fraction 3 8/7, with text labels \"Improper fraction\" and \"bad form\" appearing nearby.  \n- A green arrow points to the fraction 8/7, which then transforms into \"7 + 1/7\" to demonstrate conversion.\n[330-360s] - The equation displays 1+2+3/7+5/7, simplifying to 3 8/7, then rewritten as 3+1/7.\n- A red arrow points to the fraction 8/7, which is highlighted in yellow, indicating its role in the simplification.\n- The presenter appears, gesturing toward the equation, with the \"Math Antics\" logo visible on their shirt.\n[360-390s] - A man in a \"math Antics\" t-shirt gestures while text labels \"Whole Number\" and \"Fraction\" appear on a grid background.  \n- The text \"More Than One?\" appears under \"Fraction\" as the man continues speaking.  \n- The screen transitions to show \"like fractions\" and \"unlike fractions\" with a math expression \"1 1/2 + 2 1/4\" displayed.", "history_tokens": 946, "history_utf8_bytes": 3342, "recent_frame_times_s": [366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.0169666666667, 385.01796666666667, 386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665, 394.0269666666667, 395.02796666666666], "recent_frames_sha256": "23b8bc9e094642f4c8b81ca8b61f207cc4265ad63d55583be56503da82b992cd", "num_recent_frames": 30, "tq": 710639.231721854, "t1": 710641.294178942, "ta": 710641.294178942, "te": 710641.481047162, "first_response_s": 2.062457088031806, "answer_total_s": 2.2493253080174327, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 212, "content_group": "0dfc9943bf380053745c25d0c6448698a5ee764feb8f99c631fcb145b23768bb", "question": {"question_id": "sample_212_a565_q0", "video_id": 212, "video_path": "./videos/sample_212_real.mp4", "annotation_index": 565, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. Adding the fractions together.", "B. Converting the results back to whole numbers.", "C. Finding a different common denominator.", "D. Subtracting the fractions."], "answer": "A", "time_stamp_s": 478, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [448, 478], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_212_a565_q0", "video_id": 212, "time_stamp_s": 478, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f7e3ba9cac4c1a17b70164c7e84f39fe0ce978f7a6812b4f5dc79f4f58ab2dcb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [448.0142333333333, 449.01523333333336, 450.01623333333333, 451.0172333333333, 452.01823333333334, 453.0192333333333, 454.02023333333335, 455.0212333333333, 456.02223333333336, 457.02323333333334, 458.0242333333333, 459.02523333333335, 460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665], "recent_frames_sha256": "8ad97b63104753fcee44d05c332bc43e7b112028f5272675adedc67011481237", "num_recent_frames": 30, "tq": 710499.881857942, "t1": 710511.837895583, "ta": 710511.837895583, "te": 710511.87816997, "first_response_s": 11.956037641037256, "answer_total_s": 11.996312028029934, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_212_a565_q0", "video_id": 212, "time_stamp_s": 478, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a7ed058c84130c95d0e2a213f4ab92f8bea7fb07cb8fab8a64b0a5af97bee7f8", "condition_order": ["recent", "notes"], "memory": "[180-210s] - A man in a white \"Math Antics\" shirt stands beside a grid background, gesturing toward a math problem involving fractions.\n- The screen displays a vertical addition problem: 2 1/5 + 4 2/5 = 6 3/5, with the answer highlighted in green and labeled \"Answer\" in red text.\n- The problem transitions to a new addition problem: 25 + 15 = 10, followed by 1 25 + 15 = 0, with the numbers highlighted in green.\n[210-240s] - A man in a white \"Math Antics\" t-shirt gestures while standing beside a vertical addition problem (563 + 236) displayed on a grid background.  \n- The scene transitions to a group of men in a cozy, wood-paneled room, casually eating pizza and interacting while holding plates.  \n- On-screen graphics show four pizzas with slices removed, labeled as \"1 3/8\" and \"1 5/8,\" with the word \"Total?\" appearing in red.\n[240-270s] - A man in a white t-shirt with \"Math Antics\" text stands beside a grid background, gesturing toward a math problem involving adding mixed numbers.\n- The screen displays the problem \"1 3/8 + 1 5/8\" with a green vertical bar highlighting the addition process, showing intermediate steps like \"2 8/8\" and final result \"2 8/8\".\n- The final result \"2 8/8\" is circled, and a red arrow points to the \"whole fraction\" label as the man explains the conversion to \"2 + 1\" (implying simpl\n[270-300s] - A man in a white t-shirt with \"math Antics\" text stands beside a math problem involving mixed numbers.\n- The screen displays a visual of three pizzas, illustrating the concept of adding fractions.\n- The problem transitions to a new equation: 1 3/7 + 2 5/7, with text highlighting the commutative property.\n[300-330s] - A man in a white t-shirt with \"math Antics\" appears, gesturing toward a math problem on screen.  \n- The screen displays the fraction 3 8/7, with text labels \"Improper fraction\" and \"bad form\" appearing nearby.  \n- A green arrow points to the fraction 8/7, which then transforms into \"7 + 1/7\" to demonstrate conversion.\n[330-360s] - The equation displays 1+2+3/7+5/7, simplifying to 3 8/7, then rewritten as 3+1/7.\n- A red arrow points to the fraction 8/7, which is highlighted in yellow, indicating its role in the simplification.\n- The presenter appears, gesturing toward the equation, with the \"Math Antics\" logo visible on their shirt.\n[360-390s] - A man in a \"math Antics\" t-shirt gestures while text labels \"Whole Number\" and \"Fraction\" appear on a grid background.  \n- The text \"More Than One?\" appears under \"Fraction\" as the man continues speaking.  \n- The screen transitions to show \"like fractions\" and \"unlike fractions\" with a math expression \"1 1/2 + 2 1/4\" displayed.\n[390-420s] - A man in a white t-shirt with \"math antics\" text appears, gesturing toward a fraction equation on a grid background.\n- The equation \"1+2+1/2+1/4\" is displayed with \"Common Denominator\" text below it, and a red arrow points to the \"2\" in \"1/2\".\n- The \"2\" in \"1/2\" is highlighted with a yellow circle, and a red arrow indicates a multiplication operation being applied to convert the fraction to a common denominator.\n[420-450s] - A math problem \"1+2+(2/2)+1/4\" is displayed with intermediate steps showing \"3\" and \"3/4\" as results.\n- The problem transitions to \"3 2/3 + 4 3/4\" with a visual emphasis on the fractions \"2/3\" and \"3/4\" being highlighted.\n- The final result \"7\" appears below the problem, indicating the sum of the mixed numbers.", "history_tokens": 975, "history_utf8_bytes": 3396, "recent_frame_times_s": [448.0142333333333, 449.01523333333336, 450.01623333333333, 451.0172333333333, 452.01823333333334, 453.0192333333333, 454.02023333333335, 455.0212333333333, 456.02223333333336, 457.02323333333334, 458.0242333333333, 459.02523333333335, 460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665], "recent_frames_sha256": "8ad97b63104753fcee44d05c332bc43e7b112028f5272675adedc67011481237", "num_recent_frames": 30, "tq": 710659.401713419, "t1": 710667.356426825, "ta": 710667.356426825, "te": 710667.63792948, "first_response_s": 7.9547134060412645, "answer_total_s": 8.236216061050072, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 213, "content_group": "e0c106a2d58bb07032788a272487cfd0a056bf6c101cf47f0267480000e33b14", "question": {"question_id": "sample_213_a2023_q0", "video_id": 213, "video_path": "./videos/sample_213_real.mp4", "annotation_index": 2023, "question_index": 0, "question": "What topics might the speaker explain next?", "options": ["A. Simplifying fractions.", "B. Adding fractions.", "C. Dividing fractions.", "D. Subtracting fractions."], "answer": "B", "time_stamp_s": 16, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_213_a2023_q0", "video_id": 213, "time_stamp_s": 16, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1c002f9148f86ff7c0a04e0a85cf5ef66765518370ad6f32d6f9cc17f70a8b92", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "89a1b7594c8fe73fb46384d39102f726e85ae143b03bb90ac0ca2f6d60a71046", "num_recent_frames": 16, "tq": 717329.751898345, "t1": 717341.513751312, "ta": 717341.513751312, "te": 717341.556939178, "first_response_s": 11.76185296708718, "answer_total_s": 11.8050408330746, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_213_a2023_q0", "video_id": 213, "time_stamp_s": 16, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "323c0e9cbe90b1ef302ecbac8a03196d3870d0e5d56832f376c83d03fc066f73", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "89a1b7594c8fe73fb46384d39102f726e85ae143b03bb90ac0ca2f6d60a71046", "num_recent_frames": 16, "tq": 717379.759822122, "t1": 717390.137101016, "ta": 717390.137101016, "te": 717390.439507261, "first_response_s": 10.37727889395319, "answer_total_s": 10.679685138980858, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 213, "content_group": "e0c106a2d58bb07032788a272487cfd0a056bf6c101cf47f0267480000e33b14", "question": {"question_id": "sample_213_a2024_q0", "video_id": 213, "video_path": "./videos/sample_213_real.mp4", "annotation_index": 2024, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to multiply fractions.", "B. How to add 1/2 + 1/2.", "C. How to divide fractions.", "D. How to subtract fractions."], "answer": "B", "time_stamp_s": 120, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [53, 83], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_213_a2024_q0", "video_id": 213, "time_stamp_s": 120, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0b1852a615610a4a208dcafca4012cf7893ddb8a3161d2f380a7c1f0f8a2b129", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [90.02326666666667, 91.02426666666666, 92.02526666666667, 93.02626666666667, 94.02726666666666, 95.02826666666667, 96.02926666666667, 97.03026666666666, 98.03126666666667, 99.03226666666667, 100.03326666666666, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189], "recent_frames_sha256": "f02be6749c4b463f7dba7e5d343b4234d67a7fd862aaa8ed0a419e8ce02aa2c6", "num_recent_frames": 30, "tq": 717341.567093995, "t1": 717348.98387418, "ta": 717348.98387418, "te": 717349.021216312, "first_response_s": 7.416780184954405, "answer_total_s": 7.45412231690716, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_213_a2024_q0", "video_id": 213, "time_stamp_s": 120, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "85144a5cefdad68d457c904762fcadebc47ce533f5a31bd9c300982552f69b48", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray t-shirt stands against a green abstract background, speaking to the camera.  \n- On-screen text appears sequentially: \"Math Antics,\" \"Adding & Subtracting Fractions,\" and \"Add Fractions.\"  \n- A fraction multiplication problem (2/3 × 4/5) is displayed with animated circles highlighting numerators and denominators, followed by a question mark.\n[30-60s] - A man in a gray t-shirt stands against a green abstract background, gesturing while speaking.\n- A mathematical equation (1/2 + 1/2 = 2/4) appears on screen, followed by the text \"Can't Be Right\" in red.\n- The equation is visually corrected to 1/2 + 1/2 = 1, accompanied by three pie charts illustrating the concept.\n[60-90s] - A man in a gray t-shirt stands against a light purple grid background, speaking directly to the camera.  \n- At 63 seconds, the background transitions to a swirling green and blue abstract pattern.  \n- Text overlays appear on screen, including \"Math Rules,\" \"Order of Operations,\" and symbols for multiplication, division, and addition/subtraction.\n[90-120s] - Man in gray shirt gestures while speaking against a green textured background.  \n- Text overlays appear sequentially: \"Rules,\" \"Trick,\" \"Uh Oh!,\" \"Same Bottom Numbers,\" and \"Add Top Numbers Keep Same Bottom Number.\"  \n- At 1:56, a fraction equation \"1/2 + 1/2\" appears on a grid background as the man continues explaining.", "history_tokens": 351, "history_utf8_bytes": 1390, "recent_frame_times_s": [90.02326666666667, 91.02426666666666, 92.02526666666667, 93.02626666666667, 94.02726666666666, 95.02826666666667, 96.02926666666667, 97.03026666666666, 98.03126666666667, 99.03226666666667, 100.03326666666666, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189], "recent_frames_sha256": "f02be6749c4b463f7dba7e5d343b4234d67a7fd862aaa8ed0a419e8ce02aa2c6", "num_recent_frames": 30, "tq": 717420.968133805, "t1": 717427.905929856, "ta": 717427.905929856, "te": 717428.206310451, "first_response_s": 6.93779605103191, "answer_total_s": 7.23817664606031, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 213, "content_group": "e0c106a2d58bb07032788a272487cfd0a056bf6c101cf47f0267480000e33b14", "question": {"question_id": "sample_213_a2025_q0", "video_id": 213, "video_path": "./videos/sample_213_real.mp4", "annotation_index": 2025, "question_index": 0, "question": "What might the speaker suggest next?", "options": ["A. How to multiply fractions.", "B. How to find a common denominator for addition.", "C. How to simplify fractions.", "D. How to subtract fractions."], "answer": "D", "time_stamp_s": 159, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [106, 136], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_213_a2025_q0", "video_id": 213, "time_stamp_s": 159, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ecfc64c34f2335cb333ca251429d2987af6ea788ab20687dff0512531240c274", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332], "recent_frames_sha256": "352faed4dcdfd0c3e9f7dbdce3acedc5fd997c79879306700681a515d8462210", "num_recent_frames": 30, "tq": 717349.031440443, "t1": 717360.010048881, "ta": 717360.010048881, "te": 717360.199554292, "first_response_s": 10.978608438046649, "answer_total_s": 11.168113849009387, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_213_a2025_q0", "video_id": 213, "time_stamp_s": 159, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "52da3d346d1217e1cbdbad86657135d35821f70b1b82009646f627ef2116e17d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray t-shirt stands against a green abstract background, speaking to the camera.  \n- On-screen text appears sequentially: \"Math Antics,\" \"Adding & Subtracting Fractions,\" and \"Add Fractions.\"  \n- A fraction multiplication problem (2/3 × 4/5) is displayed with animated circles highlighting numerators and denominators, followed by a question mark.\n[30-60s] - A man in a gray t-shirt stands against a green abstract background, gesturing while speaking.\n- A mathematical equation (1/2 + 1/2 = 2/4) appears on screen, followed by the text \"Can't Be Right\" in red.\n- The equation is visually corrected to 1/2 + 1/2 = 1, accompanied by three pie charts illustrating the concept.\n[60-90s] - A man in a gray t-shirt stands against a light purple grid background, speaking directly to the camera.  \n- At 63 seconds, the background transitions to a swirling green and blue abstract pattern.  \n- Text overlays appear on screen, including \"Math Rules,\" \"Order of Operations,\" and symbols for multiplication, division, and addition/subtraction.\n[90-120s] - Man in gray shirt gestures while speaking against a green textured background.  \n- Text overlays appear sequentially: \"Rules,\" \"Trick,\" \"Uh Oh!,\" \"Same Bottom Numbers,\" and \"Add Top Numbers Keep Same Bottom Number.\"  \n- At 1:56, a fraction equation \"1/2 + 1/2\" appears on a grid background as the man continues explaining.\n[120-150s] - A man in a gray t-shirt gestures while explaining a math problem involving fractions.\n- The screen displays the equation \"1/2 + 1/2 = 2\" with text \"Don't Add\" appearing below it.\n- The equation is then modified to show \"1/2 + 1/2 = 2/2\" with a visual representation of two circles divided into halves, each shaded green.", "history_tokens": 446, "history_utf8_bytes": 1724, "recent_frame_times_s": [129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332], "recent_frames_sha256": "352faed4dcdfd0c3e9f7dbdce3acedc5fd997c79879306700681a515d8462210", "num_recent_frames": 30, "tq": 717432.793164078, "t1": 717440.880113476, "ta": 717440.880113476, "te": 717440.918230511, "first_response_s": 8.086949397926219, "answer_total_s": 8.125066432985477, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 213, "content_group": "e0c106a2d58bb07032788a272487cfd0a056bf6c101cf47f0267480000e33b14", "question": {"question_id": "sample_213_a2026_q0", "video_id": 213, "video_path": "./videos/sample_213_real.mp4", "annotation_index": 2026, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to add two fractions with different denominators.", "B. How to convert fractions to decimals.", "C. Why the denominators stay the same.", "D. How to simplify the resulting fraction."], "answer": "C", "time_stamp_s": 184, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [159, 189], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_213_a2026_q0", "video_id": 213, "time_stamp_s": 184, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a82b81a2e9d89f9c9d9d0eb2b8e5d58e62568c4b3f514a83c2683de1782443aa", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666], "recent_frames_sha256": "6e54df82dcf3de5bc3407afc3dfba1a10acea87a15b1401cc6673d301e178179", "num_recent_frames": 30, "tq": 717360.211189317, "t1": 717367.931180482, "ta": 717367.931180482, "te": 717367.971063581, "first_response_s": 7.719991164980456, "answer_total_s": 7.759874263894744, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_213_a2026_q0", "video_id": 213, "time_stamp_s": 184, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2a3c6cf470b0b81d81f75120a864dad0dee0ed12dd1495ad6e97b3d11016bfd1", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray t-shirt stands against a green abstract background, speaking to the camera.  \n- On-screen text appears sequentially: \"Math Antics,\" \"Adding & Subtracting Fractions,\" and \"Add Fractions.\"  \n- A fraction multiplication problem (2/3 × 4/5) is displayed with animated circles highlighting numerators and denominators, followed by a question mark.\n[30-60s] - A man in a gray t-shirt stands against a green abstract background, gesturing while speaking.\n- A mathematical equation (1/2 + 1/2 = 2/4) appears on screen, followed by the text \"Can't Be Right\" in red.\n- The equation is visually corrected to 1/2 + 1/2 = 1, accompanied by three pie charts illustrating the concept.\n[60-90s] - A man in a gray t-shirt stands against a light purple grid background, speaking directly to the camera.  \n- At 63 seconds, the background transitions to a swirling green and blue abstract pattern.  \n- Text overlays appear on screen, including \"Math Rules,\" \"Order of Operations,\" and symbols for multiplication, division, and addition/subtraction.\n[90-120s] - Man in gray shirt gestures while speaking against a green textured background.  \n- Text overlays appear sequentially: \"Rules,\" \"Trick,\" \"Uh Oh!,\" \"Same Bottom Numbers,\" and \"Add Top Numbers Keep Same Bottom Number.\"  \n- At 1:56, a fraction equation \"1/2 + 1/2\" appears on a grid background as the man continues explaining.\n[120-150s] - A man in a gray t-shirt gestures while explaining a math problem involving fractions.\n- The screen displays the equation \"1/2 + 1/2 = 2\" with text \"Don't Add\" appearing below it.\n- The equation is then modified to show \"1/2 + 1/2 = 2/2\" with a visual representation of two circles divided into halves, each shaded green.\n[150-180s] - A man in a gray t-shirt stands in front of a grid background, explaining fraction operations.\n- On-screen text displays \"5/16 + 2/16 = 7/16\" with a yellow oval highlighting the fractions and result.\n- Text changes to \"Subtracting Fractions\" and \"Subtract the top Same Bottom Numbers\" as the man continues his explanation.", "history_tokens": 537, "history_utf8_bytes": 2059, "recent_frame_times_s": [154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666], "recent_frames_sha256": "6e54df82dcf3de5bc3407afc3dfba1a10acea87a15b1401cc6673d301e178179", "num_recent_frames": 30, "tq": 717446.733810061, "t1": 717447.391443616, "ta": 717447.391443616, "te": 717447.688744837, "first_response_s": 0.6576335550053045, "answer_total_s": 0.9549347759457305, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 213, "content_group": "e0c106a2d58bb07032788a272487cfd0a056bf6c101cf47f0267480000e33b14", "question": {"question_id": "sample_213_a2027_q0", "video_id": 213, "video_path": "./videos/sample_213_real.mp4", "annotation_index": 2027, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. How to convert fractions to decimals.", "B. Steps to compare fractions.", "C. Methods to simplify fractions.", "D. How to find a common denominator."], "answer": "D", "time_stamp_s": 241, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [212, 242], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_213_a2027_q0", "video_id": 213, "time_stamp_s": 241, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0f0ba647f59de27204fc5b23e84f9be0773b82bcddb155d63c12397669cdb137", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332], "recent_frames_sha256": "ef4d423e2ae00a3fcefed8bc65a24612f101b4f7399e5f42743f96b0eac2aab4", "num_recent_frames": 30, "tq": 717367.987266685, "t1": 717379.704790005, "ta": 717379.704790005, "te": 717379.74745209, "first_response_s": 11.717523319995962, "answer_total_s": 11.760185405029915, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_213_a2027_q0", "video_id": 213, "time_stamp_s": 241, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ab38c3f5f82dad014faa069c2ed7bcf75be0e2d6054ab0740d484dce0c4e7ce7", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a gray t-shirt stands against a green abstract background, speaking to the camera.  \n- On-screen text appears sequentially: \"Math Antics,\" \"Adding & Subtracting Fractions,\" and \"Add Fractions.\"  \n- A fraction multiplication problem (2/3 × 4/5) is displayed with animated circles highlighting numerators and denominators, followed by a question mark.\n[30-60s] - A man in a gray t-shirt stands against a green abstract background, gesturing while speaking.\n- A mathematical equation (1/2 + 1/2 = 2/4) appears on screen, followed by the text \"Can't Be Right\" in red.\n- The equation is visually corrected to 1/2 + 1/2 = 1, accompanied by three pie charts illustrating the concept.\n[60-90s] - A man in a gray t-shirt stands against a light purple grid background, speaking directly to the camera.  \n- At 63 seconds, the background transitions to a swirling green and blue abstract pattern.  \n- Text overlays appear on screen, including \"Math Rules,\" \"Order of Operations,\" and symbols for multiplication, division, and addition/subtraction.\n[90-120s] - Man in gray shirt gestures while speaking against a green textured background.  \n- Text overlays appear sequentially: \"Rules,\" \"Trick,\" \"Uh Oh!,\" \"Same Bottom Numbers,\" and \"Add Top Numbers Keep Same Bottom Number.\"  \n- At 1:56, a fraction equation \"1/2 + 1/2\" appears on a grid background as the man continues explaining.\n[120-150s] - A man in a gray t-shirt gestures while explaining a math problem involving fractions.\n- The screen displays the equation \"1/2 + 1/2 = 2\" with text \"Don't Add\" appearing below it.\n- The equation is then modified to show \"1/2 + 1/2 = 2/2\" with a visual representation of two circles divided into halves, each shaded green.\n[150-180s] - A man in a gray t-shirt stands in front of a grid background, explaining fraction operations.\n- On-screen text displays \"5/16 + 2/16 = 7/16\" with a yellow oval highlighting the fractions and result.\n- Text changes to \"Subtracting Fractions\" and \"Subtract the top Same Bottom Numbers\" as the man continues his explanation.\n[180-210s] - A man in a gray shirt stands in front of a grid background, gesturing toward a math equation: 5/9 - 2/9 = 3/9.\n- The equation visually highlights the subtraction of fractions, with the result 3/9 appearing after the operation.\n- The background transitions to a green, abstract pattern as the man continues speaking, with the word \"Like\" appearing on screen.\n[210-240s] - A man in a gray t-shirt stands against a green abstract background, gesturing with his hands while speaking.\n- Text overlays appear sequentially: \"Seriously?\", \"Like Fractions\", \"un Like Fractions\", \"Different Bottom\", \"Change Them\", \"unLike\", \"Like\", and \"Common Denominator\".\n- The text \"Common Denominator\" is highlighted with a yellow underline as the man continues speaking.", "history_tokens": 726, "history_utf8_bytes": 2823, "recent_frame_times_s": [211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332], "recent_frames_sha256": "ef4d423e2ae00a3fcefed8bc65a24612f101b4f7399e5f42743f96b0eac2aab4", "num_recent_frames": 30, "tq": 717466.958795187, "t1": 717473.818218029, "ta": 717473.818218029, "te": 717474.126979942, "first_response_s": 6.859422842040658, "answer_total_s": 7.168184755020775, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 214, "content_group": "aba55057c84da44787e34fc3ace830b0192c880f5cdbea25d2b6ecb188a59ab5", "question": {"question_id": "sample_214_a408_q0", "video_id": 214, "video_path": "./videos/sample_214_real.mp4", "annotation_index": 408, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. Calculating the perimeter of shapes.", "B. Understanding different geometric figures.", "C. The concept of Area.", "D. The concept of volume."], "answer": "C", "time_stamp_s": 24, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_214_a408_q0", "video_id": 214, "time_stamp_s": 24, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7240c3269d6d1487751302252580833401633e5fe72c26d2dbfc0bc53afc4e56", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019, 20.02, 21.021, 22.022, 23.023], "recent_frames_sha256": "b5cccac1e0f8db09b9326d59403498c83a9b43e043e55809a8894c832b9c7dcc", "num_recent_frames": 24, "tq": 717823.498259396, "t1": 717861.655079343, "ta": 717861.655079343, "te": 717861.841581743, "first_response_s": 38.15681994706392, "answer_total_s": 38.3433223470347, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_214_a408_q0", "video_id": 214, "time_stamp_s": 24, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d448c0715991c19877e56191d45fe2637517821d26160f80a9afbf70d38b1a5f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019, 20.02, 21.021, 22.022, 23.023], "recent_frames_sha256": "b5cccac1e0f8db09b9326d59403498c83a9b43e043e55809a8894c832b9c7dcc", "num_recent_frames": 24, "tq": 717890.346492846, "t1": 717892.003292199, "ta": 717892.003292199, "te": 717892.20161401, "first_response_s": 1.656799352960661, "answer_total_s": 1.8551211640005931, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 214, "content_group": "aba55057c84da44787e34fc3ace830b0192c880f5cdbea25d2b6ecb188a59ab5", "question": {"question_id": "sample_214_a409_q0", "video_id": 214, "video_path": "./videos/sample_214_real.mp4", "annotation_index": 409, "question_index": 0, "question": "What formula might the speaker likely introduce next?", "options": ["A. Perimeter of a rectangle.", "B. Volume of a cube.", "C. Circumference of a circle.", "D. Area of a triangle."], "answer": "D", "time_stamp_s": 123, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [129, 159], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_214_a409_q0", "video_id": 214, "time_stamp_s": 123, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c458715edc8b5b8b5e8ca097708e4ef85936640bb0409316b507c3d96e3288e0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [93.02626666666667, 94.02726666666666, 95.02826666666667, 96.02926666666667, 97.03026666666666, 98.03126666666667, 99.03226666666667, 100.03326666666666, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219], "recent_frames_sha256": "cd3f4026f2513854e27210f9356b46626b64f42f3d9564f030cdd49be67a5733", "num_recent_frames": 30, "tq": 717861.858969275, "t1": 717870.162362062, "ta": 717870.162362062, "te": 717870.393729626, "first_response_s": 8.303392786998302, "answer_total_s": 8.534760350943543, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_214_a409_q0", "video_id": 214, "time_stamp_s": 123, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e51e254b55f28159a95ef5d2fc795a2f9e03ed2eec3c2ef13b3476a1215f9223", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a green geometric background, speaking to the camera.  \n- On-screen text transitions from \"math Antics\" to \"Area\" and then to \"1D Perimeter\" and \"2D Area,\" indicating educational topics.  \n- At 0:28, a blue vertical line labeled \"1cm\" appears on the left side of the screen, suggesting a measurement context.\n[30-60s] - A vertical blue line labeled \"1 cm\" appears, then extends horizontally to form a square with a horizontal line labeled \"1 cm\" at the bottom.  \n- A white arrow extends from the vertical line to the right, then the square fills with blue, indicating area.  \n- An orange arrow points to the right side of the square, with the word \"Area\" appearing above it.\n[60-90s] - A man in a \"Math Antics\" t-shirt stands beside a grid background, gesturing toward a blue square labeled \"Square Centimeter\" with 1 cm sides.  \n- The word \"Area\" appears above the square, and \"Length\" is displayed to the left of the square's vertical side.  \n- The square's label changes to \"Square Centimeter\" as the man speaks, with the 1 cm measurements remaining visible.\n[90-120s] - A blue square labeled \"Square mile\" appears centered on a grid, flanked by \"1 mi\" labels on its top and bottom sides.  \n- The text \"Units of Measurement\" fades in above the square.  \n- A man in a white \"math Antics\" t-shirt appears, standing against a grid background, as text transitions to \"Calculate Area Formulas (or Equations).\"", "history_tokens": 376, "history_utf8_bytes": 1471, "recent_frame_times_s": [93.02626666666667, 94.02726666666666, 95.02826666666667, 96.02926666666667, 97.03026666666666, 98.03126666666667, 99.03226666666667, 100.03326666666666, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219], "recent_frames_sha256": "cd3f4026f2513854e27210f9356b46626b64f42f3d9564f030cdd49be67a5733", "num_recent_frames": 30, "tq": 717925.133210977, "t1": 717926.316939172, "ta": 717926.316939172, "te": 717926.585516188, "first_response_s": 1.1837281950283796, "answer_total_s": 1.452305210987106, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 214, "content_group": "aba55057c84da44787e34fc3ace830b0192c880f5cdbea25d2b6ecb188a59ab5", "question": {"question_id": "sample_214_a410_q0", "video_id": 214, "video_path": "./videos/sample_214_real.mp4", "annotation_index": 410, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to convert between different units of length.", "B. The concept of volume measurement.", "C. The perimeter of different shapes.", "D. How to calculate the area of another shapes."], "answer": "D", "time_stamp_s": 285, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [258, 288], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_214_a410_q0", "video_id": 214, "time_stamp_s": 285, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d6cd876c5ee720260a4ec8b7f39eb935d0ad663fee35ed0f26e8e546781bfdb4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666], "recent_frames_sha256": "71e5e2367b6037124f4ee176e3312e4df8ffbb7251eee613acf89f7dbd8750a7", "num_recent_frames": 30, "tq": 717870.410408558, "t1": 717877.12159255, "ta": 717877.12159255, "te": 717877.159753538, "first_response_s": 6.71118399198167, "answer_total_s": 6.74934497999493, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_214_a410_q0", "video_id": 214, "time_stamp_s": 285, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3e5fd2a01311941e849245d2346908684f833228d6210c660d47d68809a8f0ce", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a green geometric background, speaking to the camera.  \n- On-screen text transitions from \"math Antics\" to \"Area\" and then to \"1D Perimeter\" and \"2D Area,\" indicating educational topics.  \n- At 0:28, a blue vertical line labeled \"1cm\" appears on the left side of the screen, suggesting a measurement context.\n[30-60s] - A vertical blue line labeled \"1 cm\" appears, then extends horizontally to form a square with a horizontal line labeled \"1 cm\" at the bottom.  \n- A white arrow extends from the vertical line to the right, then the square fills with blue, indicating area.  \n- An orange arrow points to the right side of the square, with the word \"Area\" appearing above it.\n[60-90s] - A man in a \"Math Antics\" t-shirt stands beside a grid background, gesturing toward a blue square labeled \"Square Centimeter\" with 1 cm sides.  \n- The word \"Area\" appears above the square, and \"Length\" is displayed to the left of the square's vertical side.  \n- The square's label changes to \"Square Centimeter\" as the man speaks, with the 1 cm measurements remaining visible.\n[90-120s] - A blue square labeled \"Square mile\" appears centered on a grid, flanked by \"1 mi\" labels on its top and bottom sides.  \n- The text \"Units of Measurement\" fades in above the square.  \n- A man in a white \"math Antics\" t-shirt appears, standing against a grid background, as text transitions to \"Calculate Area Formulas (or Equations).\"\n[120-150s] - A green rectangle appears with labeled \"Width\" and \"Length\" dimensions.\n- The formula \"Area = Length × Width\" is displayed with \"A\", \"L\", and \"W\" symbols.\n- A small 1 cm by 1 cm square appears, illustrating unit measurement for area calculation.\n[150-180s] - A blue square graphic with \"1 cm\" labels on its sides appears, with a formula \"A = 1 cm × 1 cm\" displayed below.\n- The unit \"cm²\" is highlighted in yellow, with text \"centimeters squared\" appearing beneath it.\n- The presenter, wearing a \"Math Antics\" t-shirt, stands to the right of the graphic, gesturing toward the formula and unit.\n[180-210s] - A yellow rectangle appears with labeled dimensions: 2 cm (height) and 4 cm (width).  \n- The formula \"A = L × W\" is displayed below the rectangle.  \n- The rectangle's dimensions are substituted into the formula, resulting in \"A = 2 cm × 4 cm = 8\".\n[210-240s] - A yellow rectangle with labeled dimensions (2 cm height, 4 cm width) and area calculation (A = 8 cm²) is displayed on a grid background.\n- A man in a \"Math Antics\" t-shirt appears, gesturing toward the rectangle as it remains static on screen.\n- The rectangle is later subdivided into a 2x4 grid of smaller squares, with numbers 1-8 labeling each square, while the area formula and result stay unchanged.\n[240-270s] - A man in a white \"math Antics\" shirt stands beside a grid background, gesturing toward a diagram of a rectangle with labeled dimensions (2 cm height, 1/2 cm width) and the formula \"A = L × W\".\n- The rectangle's dimensions are highlighted with yellow circles, and the calculation \"A = 2 cm × 1/2 cm = 1 cm²\" appears on screen as the man explains.\n- The man in the white shirt is joined by another man in a dark blue \"math Antics\" shirt, who gestures toward the rectangle as they both discuss the area calculation.", "history_tokens": 866, "history_utf8_bytes": 3291, "recent_frame_times_s": [255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666], "recent_frames_sha256": "71e5e2367b6037124f4ee176e3312e4df8ffbb7251eee613acf89f7dbd8750a7", "num_recent_frames": 30, "tq": 717977.140428593, "t1": 717979.032945268, "ta": 717979.032945268, "te": 717979.436060009, "first_response_s": 1.892516674939543, "answer_total_s": 2.295631415909156, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 214, "content_group": "aba55057c84da44787e34fc3ace830b0192c880f5cdbea25d2b6ecb188a59ab5", "question": {"question_id": "sample_214_a411_q0", "video_id": 214, "video_path": "./videos/sample_214_real.mp4", "annotation_index": 411, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. The angle of the base.", "B. The formula for area.", "C. The hypotenuse of the triangle.", "D. The height of the triangle."], "answer": "D", "time_stamp_s": 415, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [387, 417], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_214_a411_q0", "video_id": 214, "time_stamp_s": 415, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fb4a8ba47e229d4af05c4e306c65c81de72a60a3a7ea332ec4bfafed9f730a2e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [385.01796666666667, 386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665, 394.0269666666667, 395.02796666666666, 396.0289666666667, 397.02996666666667, 398.03096666666664, 399.0319666666667, 400.03296666666665, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136], "recent_frames_sha256": "da4a52e43ae97be55705d1ba130c78793c26e8b63cbbe7caa7dc9a5944cb5693", "num_recent_frames": 30, "tq": 717877.174544986, "t1": 717883.465420767, "ta": 717883.465420767, "te": 717883.504823025, "first_response_s": 6.29087578097824, "answer_total_s": 6.330278038978577, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_214_a411_q0", "video_id": 214, "time_stamp_s": 415, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b41fbbbe832622a9f6af5557309121d71fd816a06495b8a9b393f67633fda55d", "condition_order": ["recent", "notes"], "memory": "[90-120s] - A blue square labeled \"Square mile\" appears centered on a grid, flanked by \"1 mi\" labels on its top and bottom sides.  \n- The text \"Units of Measurement\" fades in above the square.  \n- A man in a white \"math Antics\" t-shirt appears, standing against a grid background, as text transitions to \"Calculate Area Formulas (or Equations).\"\n[120-150s] - A green rectangle appears with labeled \"Width\" and \"Length\" dimensions.\n- The formula \"Area = Length × Width\" is displayed with \"A\", \"L\", and \"W\" symbols.\n- A small 1 cm by 1 cm square appears, illustrating unit measurement for area calculation.\n[150-180s] - A blue square graphic with \"1 cm\" labels on its sides appears, with a formula \"A = 1 cm × 1 cm\" displayed below.\n- The unit \"cm²\" is highlighted in yellow, with text \"centimeters squared\" appearing beneath it.\n- The presenter, wearing a \"Math Antics\" t-shirt, stands to the right of the graphic, gesturing toward the formula and unit.\n[180-210s] - A yellow rectangle appears with labeled dimensions: 2 cm (height) and 4 cm (width).  \n- The formula \"A = L × W\" is displayed below the rectangle.  \n- The rectangle's dimensions are substituted into the formula, resulting in \"A = 2 cm × 4 cm = 8\".\n[210-240s] - A yellow rectangle with labeled dimensions (2 cm height, 4 cm width) and area calculation (A = 8 cm²) is displayed on a grid background.\n- A man in a \"Math Antics\" t-shirt appears, gesturing toward the rectangle as it remains static on screen.\n- The rectangle is later subdivided into a 2x4 grid of smaller squares, with numbers 1-8 labeling each square, while the area formula and result stay unchanged.\n[240-270s] - A man in a white \"math Antics\" shirt stands beside a grid background, gesturing toward a diagram of a rectangle with labeled dimensions (2 cm height, 1/2 cm width) and the formula \"A = L × W\".\n- The rectangle's dimensions are highlighted with yellow circles, and the calculation \"A = 2 cm × 1/2 cm = 1 cm²\" appears on screen as the man explains.\n- The man in the white shirt is joined by another man in a dark blue \"math Antics\" shirt, who gestures toward the rectangle as they both discuss the area calculation.\n[270-300s] - A man in a white \"Math Antics\" t-shirt stands against a grid background, gesturing while speaking.\n- On-screen text displays \"A=1cm²\" and later \"Square Units cm²\" as geometric shapes (square, triangle, circle, irregular shape) appear sequentially.\n- The man's expression and gestures suggest he is explaining concepts related to area and square units.\n[300-330s] - A purple rectangle appears on a grid background with dimensions labeled as 3m (height) and 4m (width).  \n- The formula \"A = L × W\" is displayed, followed by the calculation \"A = 3m × 4m = 12m²\".  \n- A diagonal line is drawn across the rectangle, dividing it into two triangles, each labeled \"half\".\n[330-360s] - A purple rectangle is divided diagonally, with \"half\" labels on both triangular sections and \"Area\" arrows pointing to each half.\n- The total area \"A = 12 m²\" is displayed below, with the number \"12\" highlighted in an oval.\n- The \"half\" labels and \"Area\" arrows animate to show each half has an area of \"6 m²\".\n[360-390s] - A purple triangle labeled \"half\" with \"6 m²\" appears, then the formula \"A = ½(L × W)\" is displayed.  \n- The formula transitions to \"A = ½(B × H)\" with \"Base\" and \"Height\" labels appearing below.  \n- A right triangle is shown with \"Length,\" \"Width,\" and \"Right\" labels, followed by a comparison of acute, right, and obtuse triangles.", "history_tokens": 956, "history_utf8_bytes": 3524, "recent_frame_times_s": [385.01796666666667, 386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665, 394.0269666666667, 395.02796666666666, 396.0289666666667, 397.02996666666667, 398.03096666666664, 399.0319666666667, 400.03296666666665, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136], "recent_frames_sha256": "da4a52e43ae97be55705d1ba130c78793c26e8b63cbbe7caa7dc9a5944cb5693", "num_recent_frames": 30, "tq": 718010.793597367, "t1": 718016.606865697, "ta": 718016.606865697, "te": 718016.644330794, "first_response_s": 5.813268329948187, "answer_total_s": 5.850733426981606, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 214, "content_group": "aba55057c84da44787e34fc3ace830b0192c880f5cdbea25d2b6ecb188a59ab5", "question": {"question_id": "sample_214_a412_q0", "video_id": 214, "video_path": "./videos/sample_214_real.mp4", "annotation_index": 412, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. Discussing the properties of different quadrilaterals.", "B. Solving for the perimeter of the triangle.", "C. Simplifying algebraic expressions.", "D. Calculating the area of a different triangle."], "answer": "D", "time_stamp_s": 525, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [516, 546], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_214_a412_q0", "video_id": 214, "time_stamp_s": 525, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a2142509f33b947ee5b7d9bccf41adcc9b860b50be6bd116292c41c32e0c7570", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [495.0278666666667, 496.02886666666666, 497.0298666666667, 498.03086666666667, 499.03186666666664, 500.0328666666667, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0175, 519.0185, 520.0195, 521.0205, 522.0215, 523.0225, 524.0235], "recent_frames_sha256": "64c7efd67a34c292d6072acf32ca68e4a3c1491046968662ed047703702e76c9", "num_recent_frames": 30, "tq": 717883.530202415, "t1": 717890.291748168, "ta": 717890.291748168, "te": 717890.329085743, "first_response_s": 6.7615457529900596, "answer_total_s": 6.798883328097872, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_214_a412_q0", "video_id": 214, "time_stamp_s": 525, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a94e8314aead2b42f8c1896473267c851be92b21e462a55422faf627c8e7146e", "condition_order": ["recent", "notes"], "memory": "[210-240s] - A yellow rectangle with labeled dimensions (2 cm height, 4 cm width) and area calculation (A = 8 cm²) is displayed on a grid background.\n- A man in a \"Math Antics\" t-shirt appears, gesturing toward the rectangle as it remains static on screen.\n- The rectangle is later subdivided into a 2x4 grid of smaller squares, with numbers 1-8 labeling each square, while the area formula and result stay unchanged.\n[240-270s] - A man in a white \"math Antics\" shirt stands beside a grid background, gesturing toward a diagram of a rectangle with labeled dimensions (2 cm height, 1/2 cm width) and the formula \"A = L × W\".\n- The rectangle's dimensions are highlighted with yellow circles, and the calculation \"A = 2 cm × 1/2 cm = 1 cm²\" appears on screen as the man explains.\n- The man in the white shirt is joined by another man in a dark blue \"math Antics\" shirt, who gestures toward the rectangle as they both discuss the area calculation.\n[270-300s] - A man in a white \"Math Antics\" t-shirt stands against a grid background, gesturing while speaking.\n- On-screen text displays \"A=1cm²\" and later \"Square Units cm²\" as geometric shapes (square, triangle, circle, irregular shape) appear sequentially.\n- The man's expression and gestures suggest he is explaining concepts related to area and square units.\n[300-330s] - A purple rectangle appears on a grid background with dimensions labeled as 3m (height) and 4m (width).  \n- The formula \"A = L × W\" is displayed, followed by the calculation \"A = 3m × 4m = 12m²\".  \n- A diagonal line is drawn across the rectangle, dividing it into two triangles, each labeled \"half\".\n[330-360s] - A purple rectangle is divided diagonally, with \"half\" labels on both triangular sections and \"Area\" arrows pointing to each half.\n- The total area \"A = 12 m²\" is displayed below, with the number \"12\" highlighted in an oval.\n- The \"half\" labels and \"Area\" arrows animate to show each half has an area of \"6 m²\".\n[360-390s] - A purple triangle labeled \"half\" with \"6 m²\" appears, then the formula \"A = ½(L × W)\" is displayed.  \n- The formula transitions to \"A = ½(B × H)\" with \"Base\" and \"Height\" labels appearing below.  \n- A right triangle is shown with \"Length,\" \"Width,\" and \"Right\" labels, followed by a comparison of acute, right, and obtuse triangles.\n[390-420s] - A purple triangle appears on a grid background, labeled \"Base\" diagonally across its lower side.  \n- The triangle rotates slightly to show its base resting on a brown \"Ground\" surface.  \n- An arrow points upward from the triangle’s apex, indicating its orientation relative to the ground.\n[420-450s] - A purple triangle with a red arrow pointing to its apex appears above a brown \"Ground\" label.  \n- A yellow dashed line is drawn from the apex perpendicular to the base, labeled \"Height\" and later \"Altitude.\"  \n- A man in a white \"math\" t-shirt appears on the right, standing beside the triangle graphic.\n[450-480s] - Left triangle labeled \"Acute\" with a dashed vertical line indicating height (H) and base (B).  \n- Middle triangle labeled \"Right\" with dashed vertical line for height (H) and base (B).  \n- Right triangle labeled \"Obtuse\" with dashed vertical line for height (H) and base (B).  \n- Formula \"A = 1/2 (B × H)\" appears with arrows pointing to B and H on each triangle.\n[480-510s] - A green triangle appears on a grid background, with a rectangular outline beneath it, and the formula \"1/2 (B×H)\" appears to its right.  \n- The triangle visually transforms into a rectangle by splitting and rearranging its parts, demonstrating the area equivalence.  \n- The scene transitions to a purple triangle on the same grid, with the same formula displayed, followed by a similar transformation into a rectangle.", "history_tokens": 972, "history_utf8_bytes": 3738, "recent_frame_times_s": [495.0278666666667, 496.02886666666666, 497.0298666666667, 498.03086666666667, 499.03186666666664, 500.0328666666667, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0175, 519.0185, 520.0195, 521.0205, 522.0215, 523.0225, 524.0235], "recent_frames_sha256": "64c7efd67a34c292d6072acf32ca68e4a3c1491046968662ed047703702e76c9", "num_recent_frames": 30, "tq": 718046.755420758, "t1": 718058.851668002, "ta": 718058.851668002, "te": 718059.124262861, "first_response_s": 12.096247243927792, "answer_total_s": 12.368842102936469, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 215, "content_group": "7683738237c8ca7dd1c87bd4118e0f4d2cad8422a2b9647b3f3774eb5065133b", "question": {"question_id": "sample_215_a769_q0", "video_id": 215, "video_path": "./videos/sample_215_real.mp4", "annotation_index": 769, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. How to calculate the probability of an event.", "B. The definition of basic probability.", "C. An example involving multiple dice rolls.", "D. The combination formula in probability."], "answer": "B", "time_stamp_s": 13, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_215_a769_q0", "video_id": 215, "time_stamp_s": 13, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5ed4d1b96f1fbc14b747b2f81e17d42709758779ff45dec6769795b3cb16512d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012], "recent_frames_sha256": "55893bc86cfd6445f0bf8d071bc5b44b031301aa7d2f1c44ad52d13339e336b6", "num_recent_frames": 13, "tq": 717250.259474959, "t1": 717255.358890924, "ta": 717255.358890924, "te": 717255.39610456, "first_response_s": 5.0994159650290385, "answer_total_s": 5.13662960100919, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_215_a769_q0", "video_id": 215, "time_stamp_s": 13, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4185466454d0e73a3b731e47500f59eedc83f3d0473d47f46a0646ad38b9b310", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012], "recent_frames_sha256": "55893bc86cfd6445f0bf8d071bc5b44b031301aa7d2f1c44ad52d13339e336b6", "num_recent_frames": 13, "tq": 717008.872334545, "t1": 717019.949628685, "ta": 717019.949628685, "te": 717019.987328497, "first_response_s": 11.077294140006416, "answer_total_s": 11.114993951981887, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 215, "content_group": "7683738237c8ca7dd1c87bd4118e0f4d2cad8422a2b9647b3f3774eb5065133b", "question": {"question_id": "sample_215_a770_q0", "video_id": 215, "video_path": "./videos/sample_215_real.mp4", "annotation_index": 770, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. The concept of mutually exclusive events.", "B. Introduction to experimental probability.", "C. Explanation of rolling a six-sided die.", "D. Definition of independent events."], "answer": "C", "time_stamp_s": 173, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [142, 172], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_215_a770_q0", "video_id": 215, "time_stamp_s": 173, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b2c036fe18c11978ed989dae377006047bc4edee6c6dda53ca1ac901cdbf392f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667], "recent_frames_sha256": "6b7e391c149508a0dd91e9f56869bfb678314f0a11d6401dd387037f646d0703", "num_recent_frames": 30, "tq": 717255.41437079, "t1": 717270.477955794, "ta": 717270.477955794, "te": 717270.515374649, "first_response_s": 15.063585003954358, "answer_total_s": 15.101003858959302, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_215_a770_q0", "video_id": 215, "time_stamp_s": 173, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2807f7f95db1969274209886be3af96000dcd7264cce88224a3df60fc80488db", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a dark blue background, gesturing while speaking.  \n- On-screen text appears sequentially: \"likely,\" \"unlikely,\" \"Probability,\" \"Certain!,\" \"Always 1+1=2,\" and \"Always 2×3=6,\" indicating mathematical concepts.  \n- The video opens with a grid background displaying \"math\" and \"Math Antics\" logos, transitioning to the man speaking.\n[30-60s] - Man in white \"Math Antics\" shirt gestures while speaking, with text \"Always 1+1=2\" and \"Always 2×3=6\" displayed above him.  \n- A red prohibition symbol with \"Predictable\" text appears over his head, then disappears.  \n- Two coins (one with \"UNPREDICTABLE\" and one with \"RANDOM\" text) appear on either side of him as he gestures toward them.\n[60-90s] - A man in a white t-shirt with \"math Antics\" text gestures while speaking against a dark blue background.  \n- Two U.S. quarters appear on screen: one showing George Washington and the other showing the Liberty Bell, with red arrows pointing to each.  \n- Text overlays appear sequentially, including \"just as likely,\" \"Probability of an event,\" and \"Value: How Likely,\" with the man continuing to speak.\n[90-120s] - Probability Line graphic appears with a horizontal scale from 0 to 1, marked with 1/2 in the center.\n- Blue arrows point to 0 (labeled \"Impossible\") and 1 (labeled \"Certain\"), indicating endpoints of the probability spectrum.\n- The background transitions to a grid pattern with the title \"Probability Line\" at the top.\n[120-150s] - Probability Line graphic displays \"Impossible\" at 0, \"Certain\" at 1, and \"As likely as not\" at 0.5, with arrows indicating positions.\n- Labels \"Unlikely\" and \"Likely\" appear below the line, with \"Unlikely\" near 0 and \"Likely\" near 1.\n- Percentages (0%, 50%, 100%) are added beneath the numerical scale, corresponding to the probability values.", "history_tokens": 490, "history_utf8_bytes": 1849, "recent_frame_times_s": [143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667], "recent_frames_sha256": "6b7e391c149508a0dd91e9f56869bfb678314f0a11d6401dd387037f646d0703", "num_recent_frames": 30, "tq": 717071.653739019, "t1": 717078.828524628, "ta": 717078.828524628, "te": 717078.867377077, "first_response_s": 7.174785609007813, "answer_total_s": 7.213638058048673, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 215, "content_group": "7683738237c8ca7dd1c87bd4118e0f4d2cad8422a2b9647b3f3774eb5065133b", "question": {"question_id": "sample_215_a771_q0", "video_id": 215, "video_path": "./videos/sample_215_real.mp4", "annotation_index": 771, "question_index": 0, "question": "What concept might the speaker explain next?", "options": ["A. How to find the sum of rolled dice values.", "B. How to design an experiment with coins.", "C. The process of drawing bar graphs for data.", "D. The probability of rolling a specific number with a die."], "answer": "D", "time_stamp_s": 305, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [284, 314], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_215_a771_q0", "video_id": 215, "time_stamp_s": 305, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b42702db91dfa4c378adef081b633225cf7bf3d6fedd20626a77f1d68262d709", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037], "recent_frames_sha256": "cc2de505ff503087e87c2d943debf8af5a117ebf83892e3524bd790e5908178c", "num_recent_frames": 30, "tq": 717270.531030146, "t1": 717279.333213535, "ta": 717279.333213535, "te": 717279.375132819, "first_response_s": 8.802183388965204, "answer_total_s": 8.844102672999725, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_215_a771_q0", "video_id": 215, "time_stamp_s": 305, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "083e9b16fef01086b57428e8a6938658e1d6259d8b3feec067458aa890f81b2a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a dark blue background, gesturing while speaking.  \n- On-screen text appears sequentially: \"likely,\" \"unlikely,\" \"Probability,\" \"Certain!,\" \"Always 1+1=2,\" and \"Always 2×3=6,\" indicating mathematical concepts.  \n- The video opens with a grid background displaying \"math\" and \"Math Antics\" logos, transitioning to the man speaking.\n[30-60s] - Man in white \"Math Antics\" shirt gestures while speaking, with text \"Always 1+1=2\" and \"Always 2×3=6\" displayed above him.  \n- A red prohibition symbol with \"Predictable\" text appears over his head, then disappears.  \n- Two coins (one with \"UNPREDICTABLE\" and one with \"RANDOM\" text) appear on either side of him as he gestures toward them.\n[60-90s] - A man in a white t-shirt with \"math Antics\" text gestures while speaking against a dark blue background.  \n- Two U.S. quarters appear on screen: one showing George Washington and the other showing the Liberty Bell, with red arrows pointing to each.  \n- Text overlays appear sequentially, including \"just as likely,\" \"Probability of an event,\" and \"Value: How Likely,\" with the man continuing to speak.\n[90-120s] - Probability Line graphic appears with a horizontal scale from 0 to 1, marked with 1/2 in the center.\n- Blue arrows point to 0 (labeled \"Impossible\") and 1 (labeled \"Certain\"), indicating endpoints of the probability spectrum.\n- The background transitions to a grid pattern with the title \"Probability Line\" at the top.\n[120-150s] - Probability Line graphic displays \"Impossible\" at 0, \"Certain\" at 1, and \"As likely as not\" at 0.5, with arrows indicating positions.\n- Labels \"Unlikely\" and \"Likely\" appear below the line, with \"Unlikely\" near 0 and \"Likely\" near 1.\n- Percentages (0%, 50%, 100%) are added beneath the numerical scale, corresponding to the probability values.\n[150-180s] - Probability Line graphic displays \"Impossible\" at 0.0%, \"As likely as not\" at 0.5 (50%), and \"Certain\" at 1.0 (100%) with red arrows highlighting these values.\n- A man in a \"math Antics\" t-shirt appears, gesturing while speaking, against a light blue grid background.\n- Dice icons appear sequentially from left to right, with text \"Just as likely\" above them, indicating equal probability.\n[180-210s] - A man in a white \"Math Antics\" t-shirt gestures while speaking, positioned to the right of a grid background.  \n- Six dice are displayed horizontally at the top, with blue arrows labeled \"Just as likely\" connecting them.  \n- Two coins are shown below the dice, with green arrows labeled \"Just as likely\" connecting them, and a red \"? 50%\" appears to the right of the dice.\n[210-240s] - Text \"Certain = 1 or 100%\" appears with green and black font on a grid background.\n- The phrase \"1 of 6\" is displayed with \"6\" as a series of dice icons, then transitions to \"divide\" in blue text.\n- Two silver coins appear below, with a fraction \"1/2 = 0.5 or 50%\" appearing beneath them.\n[240-270s] - A mathematical equation displays \"1/6 = 0.167 or 16.7%\" with a number line from 0 to 1 showing fractions.\n- A man in a \"Math Antics\" t-shirt appears, gesturing as text \"Same probability\" and \"About as often\" appears on screen.\n- A judge in a black robe and gray wig sits at a wooden bench with American flags on either side, appearing to speak or gesture.\n[270-300s] - A man in a \"Math Antics\" shirt stands against a grid background, gesturing while explaining concepts.  \n- On-screen text labels \"Trial,\" \"Experiment,\" and \"Random outcome\" appear alongside visual icons like a coin, dice, and a wheel.  \n- The man bends down, and a row of five icons (including dice and a coin) appears above him, with one icon highlighted.", "history_tokens": 990, "history_utf8_bytes": 3678, "recent_frame_times_s": [275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037], "recent_frames_sha256": "cc2de505ff503087e87c2d943debf8af5a117ebf83892e3524bd790e5908178c", "num_recent_frames": 30, "tq": 717126.090474004, "t1": 717134.685649512, "ta": 717134.685649512, "te": 717134.996370567, "first_response_s": 8.595175507944077, "answer_total_s": 8.905896562966518, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 215, "content_group": "7683738237c8ca7dd1c87bd4118e0f4d2cad8422a2b9647b3f3774eb5065133b", "question": {"question_id": "sample_215_a772_q0", "video_id": 215, "video_path": "./videos/sample_215_real.mp4", "annotation_index": 772, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. Addition of probabilities.", "B. The probability of this disc rotating to the blue area.", "C. Expected value calculation.", "D. Subtraction of probabilities."], "answer": "B", "time_stamp_s": 481, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [426, 456], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_215_a772_q0", "video_id": 215, "time_stamp_s": 481, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5fc130c54060f9cf6021fe38ee4668081b8358583b0cccd50e50f5f86dfc0ec4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [451.0172333333333, 452.01823333333334, 453.0192333333333, 454.02023333333335, 455.0212333333333, 456.02223333333336, 457.02323333333334, 458.0242333333333, 459.02523333333335, 460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664], "recent_frames_sha256": "307e3145c40cf7bfb9d8281bcf5fd1c44263221b81f0dc97d9ed56d3ff81840c", "num_recent_frames": 30, "tq": 717279.386215155, "t1": 717291.871459546, "ta": 717291.871459546, "te": 717291.910299144, "first_response_s": 12.485244391020387, "answer_total_s": 12.52408398897387, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_215_a772_q0", "video_id": 215, "time_stamp_s": 481, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "92b0d89ba7bce9eabd02197fc6c62f84328518e9c0124f322a11e2cf012f0389", "condition_order": ["notes", "recent"], "memory": "[180-210s] - A man in a white \"Math Antics\" t-shirt gestures while speaking, positioned to the right of a grid background.  \n- Six dice are displayed horizontally at the top, with blue arrows labeled \"Just as likely\" connecting them.  \n- Two coins are shown below the dice, with green arrows labeled \"Just as likely\" connecting them, and a red \"? 50%\" appears to the right of the dice.\n[210-240s] - Text \"Certain = 1 or 100%\" appears with green and black font on a grid background.\n- The phrase \"1 of 6\" is displayed with \"6\" as a series of dice icons, then transitions to \"divide\" in blue text.\n- Two silver coins appear below, with a fraction \"1/2 = 0.5 or 50%\" appearing beneath them.\n[240-270s] - A mathematical equation displays \"1/6 = 0.167 or 16.7%\" with a number line from 0 to 1 showing fractions.\n- A man in a \"Math Antics\" t-shirt appears, gesturing as text \"Same probability\" and \"About as often\" appears on screen.\n- A judge in a black robe and gray wig sits at a wooden bench with American flags on either side, appearing to speak or gesture.\n[270-300s] - A man in a \"Math Antics\" shirt stands against a grid background, gesturing while explaining concepts.  \n- On-screen text labels \"Trial,\" \"Experiment,\" and \"Random outcome\" appear alongside visual icons like a coin, dice, and a wheel.  \n- The man bends down, and a row of five icons (including dice and a coin) appears above him, with one icon highlighted.\n[300-330s] - Two men stand facing each other, one in a black shirt gesturing, the other in a white \"math antics\" shirt listening.  \n- A graphic overlay shows five dice with green checkmarks beneath them, indicating correct answers.  \n- The man in the black shirt points to the dice graphic while speaking, and the man in the white shirt responds with hand gestures.\n[330-360s] - A yellow die with three dots is seen on a light surface, then picked up by a hand.  \n- Two men stand side by side; one in a black shirt, the other in a white \"Math Antics\" shirt, facing each other.  \n- The man in the white shirt bends down, then stands up, gesturing while speaking.\n[360-390s] - A man in a \"math Antics\" t-shirt gestures while standing against a grid background.  \n- On-screen text labels \"Few trials\" (with a shocked face) and \"More trials\" (with a smiling face) appear beside him.  \n- Visuals show coins labeled \"1/2\" and dice labeled \"1/6\" appearing sequentially, followed by a math equation summing to \"1\".\n[390-420s] - Dice display shows six 1s summing to 6, visually represented as 6/6 = 1, then labeled as 100%.\n- A blue curved arrow appears, connecting the dice equation to a coin equation (1/2 + 1/2 = 1 = 100%).\n- A man in a \"Math Antics\" shirt appears, gesturing toward a spinning wheel with numbers 1-6, then transitions to a 12-section wheel with numbers 1-12.\n[420-450s] - A circular wheel with numbered segments (1-12) appears on the left side of the screen.  \n- A white die with black dots is positioned below the wheel.  \n- Text appears on the right, stating \"1 or 100% = 1/6\" and later changes to \"between 16\" and \"1/16 or 6%\".\n[450-480s] - A circular spinner with blue and yellow sections appears, showing numbers 1–12, with a pointer indicating section 5.\n- Two silver coins are displayed below the spinner, with the fraction 1/2 written beside them.\n- A row of six dice showing various pips appears to the right, with the fraction 1/6 written beside them.", "history_tokens": 947, "history_utf8_bytes": 3400, "recent_frame_times_s": [451.0172333333333, 452.01823333333334, 453.0192333333333, 454.02023333333335, 455.0212333333333, 456.02223333333336, 457.02323333333334, 458.0242333333333, 459.02523333333335, 460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664], "recent_frames_sha256": "307e3145c40cf7bfb9d8281bcf5fd1c44263221b81f0dc97d9ed56d3ff81840c", "num_recent_frames": 30, "tq": 717212.030930552, "t1": 717213.01731775, "ta": 717213.01731775, "te": 717213.40812459, "first_response_s": 0.9863871979760006, "answer_total_s": 1.377194037893787, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 215, "content_group": "7683738237c8ca7dd1c87bd4118e0f4d2cad8422a2b9647b3f3774eb5065133b", "question": {"question_id": "sample_215_a773_q0", "video_id": 215, "video_path": "./videos/sample_215_real.mp4", "annotation_index": 773, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. The concept of probability distributions.", "B. Calculating the probability for yellow colors.", "C. How to convert decimals to fractions.", "D. Applying the formula to find expected value."], "answer": "B", "time_stamp_s": 600, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [568, 598], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_215_a773_q0", "video_id": 215, "time_stamp_s": 600, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "79054123f51ab36390be8491fd0396bcd233bfd24bf2ab96e8f43dd623a1fac6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [570.0027666666666, 571.0037666666667, 572.0047666666667, 573.0057666666667, 574.0067666666666, 575.0077666666666, 576.0087666666667, 577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0167666666666, 585.0177666666667, 586.0187666666667, 587.0197666666667, 588.0207666666666, 589.0217666666666, 590.0227666666667, 591.0237666666667, 592.0247666666667, 593.0257666666666, 594.0267666666666, 595.0277666666667, 596.0287666666667, 597.0297666666667, 598.0307666666666, 599.0317666666666], "recent_frames_sha256": "669a0b98776f2f31eef640e07a25b4fb000b2fe4ddaf0d7403ab90f76dd070d9", "num_recent_frames": 30, "tq": 717291.91953522, "t1": 717304.977129097, "ta": 717304.977129097, "te": 717305.016537565, "first_response_s": 13.057593876961619, "answer_total_s": 13.097002345020883, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_215_a773_q0", "video_id": 215, "time_stamp_s": 600, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8d18c7e98df7cf89809433fe30aa2c09e28b80113ca9eff3f30963c2b3ecdb46", "condition_order": ["notes", "recent"], "memory": "[300-330s] - Two men stand facing each other, one in a black shirt gesturing, the other in a white \"math antics\" shirt listening.  \n- A graphic overlay shows five dice with green checkmarks beneath them, indicating correct answers.  \n- The man in the black shirt points to the dice graphic while speaking, and the man in the white shirt responds with hand gestures.\n[330-360s] - A yellow die with three dots is seen on a light surface, then picked up by a hand.  \n- Two men stand side by side; one in a black shirt, the other in a white \"Math Antics\" shirt, facing each other.  \n- The man in the white shirt bends down, then stands up, gesturing while speaking.\n[360-390s] - A man in a \"math Antics\" t-shirt gestures while standing against a grid background.  \n- On-screen text labels \"Few trials\" (with a shocked face) and \"More trials\" (with a smiling face) appear beside him.  \n- Visuals show coins labeled \"1/2\" and dice labeled \"1/6\" appearing sequentially, followed by a math equation summing to \"1\".\n[390-420s] - Dice display shows six 1s summing to 6, visually represented as 6/6 = 1, then labeled as 100%.\n- A blue curved arrow appears, connecting the dice equation to a coin equation (1/2 + 1/2 = 1 = 100%).\n- A man in a \"Math Antics\" shirt appears, gesturing toward a spinning wheel with numbers 1-6, then transitions to a 12-section wheel with numbers 1-12.\n[420-450s] - A circular wheel with numbered segments (1-12) appears on the left side of the screen.  \n- A white die with black dots is positioned below the wheel.  \n- Text appears on the right, stating \"1 or 100% = 1/6\" and later changes to \"between 16\" and \"1/16 or 6%\".\n[450-480s] - A circular spinner with blue and yellow sections appears, showing numbers 1–12, with a pointer indicating section 5.\n- Two silver coins are displayed below the spinner, with the fraction 1/2 written beside them.\n- A row of six dice showing various pips appears to the right, with the fraction 1/6 written beside them.\n[480-510s] - A circular spinner with 16 segments (blue and yellow) is shown, with the pointer moving to indicate 5 out of 16.\n- The fraction \"5/16\" appears on screen, followed by \"31%\" as an alternative representation.\n- A number line from 0 to 1 is displayed with markers at 0, 1/2, and 1, and arrows pointing to the spinner and fraction.\n[510-540s] - Probability formula displayed: \"Probability of any Event = # of outcomes that satisfy requirement / total # of possible outcomes\".\n- Wheel graphic appears with 16 segments, 11 of which are yellow, showing 11/16 as the probability.\n- Number line graphic appears with a fraction 1/2 and an arrow pointing to 11/16, visually aligning with the wheel's probability.\n[540-570s] - A fraction equation (5/16 + 11/16 = 16/16 = 1) is displayed with a green checkmark confirming the result.\n- A man in a \"math antics\" t-shirt appears, gesturing toward a cartoon jar that initially contains green candies.\n- The jar's contents change to yellow candies, then a green candy is shown separately with a fraction symbol above it.\n[570-600s] - A brown bag with green and yellow spheres appears, showing 3 out of 11 total spheres as green.\n- The fraction 3/11 is displayed next to the bag, with decimal 0.27 and percentage 27% appearing beside it.\n- A number line from 0 to 1 is shown, with an arrow pointing to 1/2, and a green sphere positioned above it.", "history_tokens": 948, "history_utf8_bytes": 3365, "recent_frame_times_s": [570.0027666666666, 571.0037666666667, 572.0047666666667, 573.0057666666667, 574.0067666666666, 575.0077666666666, 576.0087666666667, 577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0167666666666, 585.0177666666667, 586.0187666666667, 587.0197666666667, 588.0207666666666, 589.0217666666666, 590.0227666666667, 591.0237666666667, 592.0247666666667, 593.0257666666666, 594.0267666666666, 595.0277666666667, 596.0287666666667, 597.0297666666667, 598.0307666666666, 599.0317666666666], "recent_frames_sha256": "669a0b98776f2f31eef640e07a25b4fb000b2fe4ddaf0d7403ab90f76dd070d9", "num_recent_frames": 30, "tq": 717242.863532437, "t1": 717250.193414806, "ta": 717250.193414806, "te": 717250.23148005, "first_response_s": 7.329882369027473, "answer_total_s": 7.367947613005526, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 216, "content_group": "5318c923c989c22bff8f5a6cb04bcc22907bc45a01162427826ff3ae78921a41", "question": {"question_id": "sample_216_a418_q0", "video_id": 216, "video_path": "./videos/sample_216_real.mp4", "annotation_index": 418, "question_index": 0, "question": "What concept might the speaker explain next?", "options": ["A. How to visualize data on a graph.", "B. The types of charts used in data representation.", "C. Differences between continuous and discrete data.", "D. Examples of data collection methods."], "answer": "C", "time_stamp_s": 40, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_216_a418_q0", "video_id": 216, "time_stamp_s": 40, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0f82a08b23043b880c19b756bf750d26a778fc2f14511853c8466323ff79a17a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019, 20.02, 21.021, 22.022, 23.023, 24.024, 25.025, 26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336], "recent_frames_sha256": "b58565c6b4c82e19d6a45dcb1b97d39d7fe2120412ae20307a757d797952bf83", "num_recent_frames": 30, "tq": 719562.933137344, "t1": 719568.800065138, "ta": 719568.800065138, "te": 719568.838118592, "first_response_s": 5.866927794064395, "answer_total_s": 5.90498124808073, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_216_a418_q0", "video_id": 216, "time_stamp_s": 40, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f770a2a2b27e94cff2ec7b9cf841813880181cc0fb5744b009aba2f2679082a3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white t-shirt with \"Math Antics\" logo stands against a green background, gesturing while speaking.  \n- On-screen text changes from \"Data & Graphs\" to \"Few Key Concepts\" and then to \"Data Information Quantitative Quantities\" as he explains.  \n- The video opens with animated text \"Math Antics\" and \"Data & Graphs\" appearing on a grid background before transitioning to the man.", "history_tokens": 98, "history_utf8_bytes": 397, "recent_frame_times_s": [10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019, 20.02, 21.021, 22.022, 23.023, 24.024, 25.025, 26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336], "recent_frames_sha256": "b58565c6b4c82e19d6a45dcb1b97d39d7fe2120412ae20307a757d797952bf83", "num_recent_frames": 30, "tq": 719381.225783739, "t1": 719382.525390135, "ta": 719382.525390135, "te": 719382.563013385, "first_response_s": 1.2996063960017636, "answer_total_s": 1.337229646043852, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 216, "content_group": "5318c923c989c22bff8f5a6cb04bcc22907bc45a01162427826ff3ae78921a41", "question": {"question_id": "sample_216_a419_q0", "video_id": 216, "video_path": "./videos/sample_216_real.mp4", "annotation_index": 419, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to create a bar graph.", "B. How to fill in the data in the data table.", "C. How to interpret the data in the data table.", "D. How to convert the data table into a pie chart."], "answer": "B", "time_stamp_s": 179, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [156, 186], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_216_a419_q0", "video_id": 216, "time_stamp_s": 179, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d3a5bc1ba75d763a02edf2cd7e31aea73ac94432820563bf8a679b8053f20f0b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667], "recent_frames_sha256": "95ad28c07c7e05498ce8474ae6511628fcba0917f5fe8d4841bc9f7fa200870a", "num_recent_frames": 30, "tq": 719568.850946792, "t1": 719582.873890291, "ta": 719582.873890291, "te": 719582.913615423, "first_response_s": 14.022943498915993, "answer_total_s": 14.06266863096971, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_216_a419_q0", "video_id": 216, "time_stamp_s": 179, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3618a9c417f77293212b221eb5dbfbc32e7d0a9104844983386b76739498c75e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white t-shirt with \"Math Antics\" logo stands against a green background, gesturing while speaking.  \n- On-screen text changes from \"Data & Graphs\" to \"Few Key Concepts\" and then to \"Data Information Quantitative Quantities\" as he explains.  \n- The video opens with animated text \"Math Antics\" and \"Data & Graphs\" appearing on a grid background before transitioning to the man.\n[30-60s] - Man in white \"Math Antics\" shirt gestures while explaining concepts, with text overlays showing \"Data Information\" and \"Quantitative Quantities Numbers.\"\n- Two men appear side-by-side; one in blue holds ice cream cones, the other in white gestures, with text \"Continuous Discrete\" displayed above them.\n- Visual transitions show a line with dots labeled \"Infinite\" and \"Any Value,\" illustrating continuous data, as the man in white continues explaining.\n[60-90s] - A cartoon ice cream shop with palm trees appears on the left side of the screen, accompanied by the text \"How much Ice Cream?\".\n- A horizontal line with labeled endpoints \"14\" and \"15 kg\" is displayed below the shop, indicating a range or measurement.\n- The presenter gestures toward the line and text, explaining the concept of discrete values as shown in the visual elements.\n[90-120s] - A man in a white shirt stands beside an ice cream shop illustration, gesturing as text displays \"Whole Number 1, 2, ..., 31\".\n- A second man in a blue shirt appears holding an ice cream cone, reacting to a displayed number \"-31.4159\" with surprise.\n- A chinchilla wearing a party hat and holding an ice cream cone appears between the two men, replacing the ice cream shop illustration.\n[120-150s] - A man in a white t-shirt with \"Math Antics\" text gestures while explaining data types against a grid background.\n- A ruler appears next to \"Continuous Data Measurement,\" then \"Discrete Data Counting\" with integer examples.\n- A baseball player in a red jersey swings a bat, with a scoreboard showing \"HOME RUNS\" and \"AVG. DISTANCE ft,\" later updating to \"19\" and \"162.7 ft.\"", "history_tokens": 496, "history_utf8_bytes": 2036, "recent_frame_times_s": [149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667], "recent_frames_sha256": "95ad28c07c7e05498ce8474ae6511628fcba0917f5fe8d4841bc9f7fa200870a", "num_recent_frames": 30, "tq": 719415.264866322, "t1": 719417.002035664, "ta": 719417.002035664, "te": 719417.201737663, "first_response_s": 1.737169341999106, "answer_total_s": 1.9368713409639895, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 216, "content_group": "5318c923c989c22bff8f5a6cb04bcc22907bc45a01162427826ff3ae78921a41", "question": {"question_id": "sample_216_a420_q0", "video_id": 216, "video_path": "./videos/sample_216_real.mp4", "annotation_index": 420, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. The average precipitation in May.", "B. The meaning of the scale on the graph.", "C. The total annual precipitation.", "D. The method used to calculate the average precipitation."], "answer": "B", "time_stamp_s": 338, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [312, 342], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_216_a420_q0", "video_id": 216, "time_stamp_s": 338, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "72cfb7fe86d2649c76e2b26c8134d19d276966042faf5414c0b19ded0014e273", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317, 333.0327, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333], "recent_frames_sha256": "180e1bba850fa621da8b4f88f110d37e6fb12eb9eadb3f829cd7dd5f253f9f77", "num_recent_frames": 30, "tq": 719582.935701586, "t1": 719590.722813605, "ta": 719590.722813605, "te": 719590.761159099, "first_response_s": 7.787112019024789, "answer_total_s": 7.825457513099536, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_216_a420_q0", "video_id": 216, "time_stamp_s": 338, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "50f602337aca5e2096753c3d4baf4af39a5367220c8d53cebdeefb17c8d8201f", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Man in white \"Math Antics\" shirt gestures while explaining concepts, with text overlays showing \"Data Information\" and \"Quantitative Quantities Numbers.\"\n- Two men appear side-by-side; one in blue holds ice cream cones, the other in white gestures, with text \"Continuous Discrete\" displayed above them.\n- Visual transitions show a line with dots labeled \"Infinite\" and \"Any Value,\" illustrating continuous data, as the man in white continues explaining.\n[60-90s] - A cartoon ice cream shop with palm trees appears on the left side of the screen, accompanied by the text \"How much Ice Cream?\".\n- A horizontal line with labeled endpoints \"14\" and \"15 kg\" is displayed below the shop, indicating a range or measurement.\n- The presenter gestures toward the line and text, explaining the concept of discrete values as shown in the visual elements.\n[90-120s] - A man in a white shirt stands beside an ice cream shop illustration, gesturing as text displays \"Whole Number 1, 2, ..., 31\".\n- A second man in a blue shirt appears holding an ice cream cone, reacting to a displayed number \"-31.4159\" with surprise.\n- A chinchilla wearing a party hat and holding an ice cream cone appears between the two men, replacing the ice cream shop illustration.\n[120-150s] - A man in a white t-shirt with \"Math Antics\" text gestures while explaining data types against a grid background.\n- A ruler appears next to \"Continuous Data Measurement,\" then \"Discrete Data Counting\" with integer examples.\n- A baseball player in a red jersey swings a bat, with a scoreboard showing \"HOME RUNS\" and \"AVG. DISTANCE ft,\" later updating to \"19\" and \"162.7 ft.\"\n[150-180s] - A man in a white \"Math Antics\" t-shirt gestures while standing against a grid background, with text \"Quantitative Data\" and \"Organized / Formatted\" appearing on screen.  \n- A graphic of scattered numbers (e.g., 5, 0, 8, 2, 3, 1, 2, 4, 8) appears to his left as he speaks.  \n- A \"Data Table\" graphic with labeled rows and columns is displayed, and a red arrow points to a cell in the table.\n[180-210s] - A table with labeled columns and rows is shown, with a red arrow pointing to the cell containing \"35\".\n- The table's headers are replaced with \"Pizza\", \"Tacos\", \"Hamburgers\", \"Mac & Cheese\", and \"Other\", and the row labels are updated to \"# of students\".\n- A \"Class Survey\" title appears above the table, and a \"Favorite Foods\" checklist is displayed below it.\n[210-240s] - A table titled \"Class Survey\" displays student counts for food preferences: Pizza (10), Tacos (7), Hamburgers (9), Mac & Cheese (8), Other (5).  \n- The number \"9\" under \"Hamburgers\" is highlighted with a red arrow, and text overlay confirms \"9 students answered 'Hamburgers'\".  \n- A blue arrow points rightward across the table, indicating a transition or reorientation of the data display.\n[240-270s] - A man in a white t-shirt stands in front of a scenic Yellowstone National Park background, gesturing toward a climate data table.  \n- The table displays monthly climate statistics for Yellowstone, including average daily temperature, low temperature, and precipitation.  \n- The text \"which month is typically the warmest in Yellowstone?\" appears on screen, prompting viewers to identify the warmest month from the data.\n[270-300s] - A man in a white t-shirt with \"math Antics\" text stands beside a grid background, gesturing toward a table showing Yellowstone's climate data.  \n- The screen displays a table with monthly average temperatures and precipitation, with July highlighted as the warmest month.  \n- A bar graph titled \"Average Precipitation (in.)\" appears below the table, visually representing monthly rainfall data.\n[300-330s] - Bar graph titled \"Average Precipitation (in.)\" displays monthly rainfall data with blue bars.\n- Red outline highlights the bar for July, indicating peak precipitation.\n- Yellow box labels the horizontal axis as \"Horizontal Axis\" and vertical axis as \"Vertical Axis.\"", "history_tokens": 972, "history_utf8_bytes": 3940, "recent_frame_times_s": [308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317, 333.0327, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333], "recent_frames_sha256": "180e1bba850fa621da8b4f88f110d37e6fb12eb9eadb3f829cd7dd5f253f9f77", "num_recent_frames": 30, "tq": 719460.875266682, "t1": 719472.419808576, "ta": 719472.419808576, "te": 719472.658774651, "first_response_s": 11.544541893992573, "answer_total_s": 11.783507968997583, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 216, "content_group": "5318c923c989c22bff8f5a6cb04bcc22907bc45a01162427826ff3ae78921a41", "question": {"question_id": "sample_216_a421_q0", "video_id": 216, "video_path": "./videos/sample_216_real.mp4", "annotation_index": 421, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. The use of the negative coordinate axis.", "B. How the fluctuation in investment income impacts yearly analysis.", "C. Strategies to improve investment returns.", "D. The overall trend of investment income throughout the year."], "answer": "D", "time_stamp_s": 481, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [468, 498], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_216_a421_q0", "video_id": 216, "time_stamp_s": 481, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "92a8c521a78bf515e94b6b883cf50a35728fc3b18160f7c623e6bc3be0fc6f7a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [451.0172333333333, 452.01823333333334, 453.0192333333333, 454.02023333333335, 455.0212333333333, 456.02223333333336, 457.02323333333334, 458.0242333333333, 459.02523333333335, 460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664], "recent_frames_sha256": "47eae8fbaf138b8479ce068865eebb3df8760174150b7f92ee84d223d2449888", "num_recent_frames": 30, "tq": 719590.774879156, "t1": 719604.407840375, "ta": 719604.407840375, "te": 719604.449116388, "first_response_s": 13.63296121894382, "answer_total_s": 13.674237231956795, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_216_a421_q0", "video_id": 216, "time_stamp_s": 481, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "43b24025fec5b0be9e453d1b42525ae99a112334ec92583e489464a76af9e4e6", "condition_order": ["notes", "recent"], "memory": "[180-210s] - A table with labeled columns and rows is shown, with a red arrow pointing to the cell containing \"35\".\n- The table's headers are replaced with \"Pizza\", \"Tacos\", \"Hamburgers\", \"Mac & Cheese\", and \"Other\", and the row labels are updated to \"# of students\".\n- A \"Class Survey\" title appears above the table, and a \"Favorite Foods\" checklist is displayed below it.\n[210-240s] - A table titled \"Class Survey\" displays student counts for food preferences: Pizza (10), Tacos (7), Hamburgers (9), Mac & Cheese (8), Other (5).  \n- The number \"9\" under \"Hamburgers\" is highlighted with a red arrow, and text overlay confirms \"9 students answered 'Hamburgers'\".  \n- A blue arrow points rightward across the table, indicating a transition or reorientation of the data display.\n[240-270s] - A man in a white t-shirt stands in front of a scenic Yellowstone National Park background, gesturing toward a climate data table.  \n- The table displays monthly climate statistics for Yellowstone, including average daily temperature, low temperature, and precipitation.  \n- The text \"which month is typically the warmest in Yellowstone?\" appears on screen, prompting viewers to identify the warmest month from the data.\n[270-300s] - A man in a white t-shirt with \"math Antics\" text stands beside a grid background, gesturing toward a table showing Yellowstone's climate data.  \n- The screen displays a table with monthly average temperatures and precipitation, with July highlighted as the warmest month.  \n- A bar graph titled \"Average Precipitation (in.)\" appears below the table, visually representing monthly rainfall data.\n[300-330s] - Bar graph titled \"Average Precipitation (in.)\" displays monthly rainfall data with blue bars.\n- Red outline highlights the bar for July, indicating peak precipitation.\n- Yellow box labels the horizontal axis as \"Horizontal Axis\" and vertical axis as \"Vertical Axis.\"\n[330-360s] - A red arrow points to the \"Average Precipitation (in.)\" label on the bar chart, highlighting the y-axis scale.\n- The arrow then moves to indicate a specific bar's height, aligning with the 2.0-inch mark on the scale.\n- A cloud icon appears near the top of the chart, visually emphasizing the precipitation data.\n[360-390s] - Man in white t-shirt gestures toward bar charts showing precipitation and snowfall data for Yellowstone National Park.  \n- Bar charts display monthly averages with precipitation in inches (left) and snowfall in inches (right), both labeled clearly.  \n- A red arrow points to the \"Average Snow Fall (in.)\" chart, highlighting its y-axis scale.\n[390-420s] - Two bar charts display average precipitation and snowfall in inches for each month, with red dashed lines indicating thresholds.  \n- A table above the charts lists monthly climate data for different years, including precipitation and snowfall amounts.  \n- Red arrows point to specific data points on the precipitation and snowfall charts, highlighting values of 0.5 inches and 2 inches respectively.\n[420-450s] - A man in a white t-shirt with \"math Antics\" text gestures toward two bar charts titled \"Average Snow Fall (in.)\" and \"Average Precipitation (in.)\" displayed on a grid background.  \n- The \"Average Snow Fall\" chart shows tall bars for winter months, while the \"Average Precipitation\" chart displays shorter bars with a red arrow pointing to a specific bar.  \n- The man points to the \"Average Snow Fall\" chart, highlighting its vertical axis labeled with snowfall measurements in inches.\n[450-480s] - A man in a white t-shirt gestures toward a bar graph showing solar farm energy production with 2019 marked as the highest and 2017 as the lowest.\n- The graph transitions to display investment income data with arrows pointing to monthly values, and a top hat icon appears beside the data.\n- The man continues explaining as the bar graph updates to show monthly investment income, with the highest value in June and the lowest in December.", "history_tokens": 921, "history_utf8_bytes": 3941, "recent_frame_times_s": [451.0172333333333, 452.01823333333334, 453.0192333333333, 454.02023333333335, 455.0212333333333, 456.02223333333336, 457.02323333333334, 458.0242333333333, 459.02523333333335, 460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664], "recent_frames_sha256": "47eae8fbaf138b8479ce068865eebb3df8760174150b7f92ee84d223d2449888", "num_recent_frames": 30, "tq": 719516.950585838, "t1": 719523.521520899, "ta": 719523.521520899, "te": 719523.890479568, "first_response_s": 6.570935060968623, "answer_total_s": 6.93989372998476, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 216, "content_group": "5318c923c989c22bff8f5a6cb04bcc22907bc45a01162427826ff3ae78921a41", "question": {"question_id": "sample_216_a422_q0", "video_id": 216, "video_path": "./videos/sample_216_real.mp4", "annotation_index": 422, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. Interpret the trends shown in the graphs.", "B. Introduce new data sets for comparison.", "C. Calculate the mean of the data sets.", "D. Convert the temperatures to Celsius."], "answer": "A", "time_stamp_s": 609, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [624, 654], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_216_a422_q0", "video_id": 216, "time_stamp_s": 609, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2460131fdd2479e57133f6d0b3b58c54816a99381a6bcaf5ea9db71433acf5b7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0167666666666, 585.0177666666667, 586.0187666666667, 587.0197666666667, 588.0207666666666, 589.0217666666666, 590.0227666666667, 591.0237666666667, 592.0247666666667, 593.0257666666666, 594.0267666666666, 595.0277666666667, 596.0287666666667, 597.0297666666667, 598.0307666666666, 599.0317666666666, 600.0327666666667, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074], "recent_frames_sha256": "e4261a33726aa7191db5090fb704b0378eb7dcea0944838d27dfa95bea4028d5", "num_recent_frames": 30, "tq": 719604.46325819, "t1": 719614.802910633, "ta": 719614.802910633, "te": 719614.843034675, "first_response_s": 10.339652443071827, "answer_total_s": 10.37977648503147, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_216_a422_q0", "video_id": 216, "time_stamp_s": 609, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cfe2b05b4758204a43473d7071258b7791b442f5d178c34a138e09efdb48af6d", "condition_order": ["notes", "recent"], "memory": "[300-330s] - Bar graph titled \"Average Precipitation (in.)\" displays monthly rainfall data with blue bars.\n- Red outline highlights the bar for July, indicating peak precipitation.\n- Yellow box labels the horizontal axis as \"Horizontal Axis\" and vertical axis as \"Vertical Axis.\"\n[330-360s] - A red arrow points to the \"Average Precipitation (in.)\" label on the bar chart, highlighting the y-axis scale.\n- The arrow then moves to indicate a specific bar's height, aligning with the 2.0-inch mark on the scale.\n- A cloud icon appears near the top of the chart, visually emphasizing the precipitation data.\n[360-390s] - Man in white t-shirt gestures toward bar charts showing precipitation and snowfall data for Yellowstone National Park.  \n- Bar charts display monthly averages with precipitation in inches (left) and snowfall in inches (right), both labeled clearly.  \n- A red arrow points to the \"Average Snow Fall (in.)\" chart, highlighting its y-axis scale.\n[390-420s] - Two bar charts display average precipitation and snowfall in inches for each month, with red dashed lines indicating thresholds.  \n- A table above the charts lists monthly climate data for different years, including precipitation and snowfall amounts.  \n- Red arrows point to specific data points on the precipitation and snowfall charts, highlighting values of 0.5 inches and 2 inches respectively.\n[420-450s] - A man in a white t-shirt with \"math Antics\" text gestures toward two bar charts titled \"Average Snow Fall (in.)\" and \"Average Precipitation (in.)\" displayed on a grid background.  \n- The \"Average Snow Fall\" chart shows tall bars for winter months, while the \"Average Precipitation\" chart displays shorter bars with a red arrow pointing to a specific bar.  \n- The man points to the \"Average Snow Fall\" chart, highlighting its vertical axis labeled with snowfall measurements in inches.\n[450-480s] - A man in a white t-shirt gestures toward a bar graph showing solar farm energy production with 2019 marked as the highest and 2017 as the lowest.\n- The graph transitions to display investment income data with arrows pointing to monthly values, and a top hat icon appears beside the data.\n- The man continues explaining as the bar graph updates to show monthly investment income, with the highest value in June and the lowest in December.\n[480-510s] - A man in a white t-shirt with \"math Antics\" text gestures toward a bar graph showing investment income data.  \n- The bar graph displays monthly values with a red arrow pointing to a specific bar, and later, red circles highlight certain data points.  \n- The screen transitions to show various graph types, including a line graph, pie chart, scatter plot, histogram, and dot plot, with the man gesturing toward them.\n[510-540s] - A man in a white t-shirt with \"math antics\" text gestures while standing beside a line graph titled \"Line Graph\" showing temperature changes over days (Mon–Fri).\n- The screen transitions to a table labeled \"Climate in Yellowstone National Park\" with columns for months and temperature data, followed by a line graph for average high temperature (°F) across months.\n- A bar graph for \"Avg precipitation (in.)\" appears below the temperature graph, with dashed red lines indicating average precipitation levels for each month.\n[540-570s] - A graph titled \"Avg. High Temp. (°F)\" displays temperature trends across months, with a red dashed line and data points marked by blue dots.\n- The graph's grid lines are highlighted, with a red arrow pointing to the \"Grid\" label on the right side.\n- A blue dot appears on the graph at the \"July\" mark, indicating a specific temperature value around 70°F.\n[570-600s] - A man in a white t-shirt with \"math Antics\" text gestures toward a graph showing average high temperatures in Yellowstone National Park.  \n- The graph displays a red line with data points for each month, labeled \"Avg. High Temp. (°F)\" and includes a red arrow pointing to the peak temperature.  \n- The screen transitions to show the word \"Trends\" in pink, followed by \"Pattern\" and arrows indicating \"Increasing,\" \"Decreasing,\" and \"Steady\" trends.", "history_tokens": 957, "history_utf8_bytes": 4124, "recent_frame_times_s": [579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0167666666666, 585.0177666666667, 586.0187666666667, 587.0197666666667, 588.0207666666666, 589.0217666666666, 590.0227666666667, 591.0237666666667, 592.0247666666667, 593.0257666666666, 594.0267666666666, 595.0277666666667, 596.0287666666667, 597.0297666666667, 598.0307666666666, 599.0317666666666, 600.0327666666667, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074], "recent_frames_sha256": "e4261a33726aa7191db5090fb704b0378eb7dcea0944838d27dfa95bea4028d5", "num_recent_frames": 30, "tq": 719560.581466888, "t1": 719562.50592482, "ta": 719562.50592482, "te": 719562.879214567, "first_response_s": 1.924457932007499, "answer_total_s": 2.297747679054737, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 217, "content_group": "cb7b9f71ec341a3dde6109be83af46a33d01b9ec0c21e9b696e1c11bab819b50", "question": {"question_id": "sample_217_a1929_q0", "video_id": 217, "video_path": "./videos/sample_217_real.mp4", "annotation_index": 1929, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to find the Mean of a data set.", "B. An overview of different types of graphs.", "C. The definition of a median.", "D. Steps to calculate the mode."], "answer": "A", "time_stamp_s": 88, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_217_a1929_q0", "video_id": 217, "time_stamp_s": 88, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a4a6aec13d8e1fbc410e3c96c574223fa25302eadd015cf805aa461269bd9133", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.01726666666667, 85.01826666666666, 86.01926666666667, 87.02026666666667], "recent_frames_sha256": "624c53d45529bfae9e399fd49a39d3282732f407964003e4db674784c458bb05", "num_recent_frames": 30, "tq": 719370.363780874, "t1": 719376.118879941, "ta": 719376.118879941, "te": 719376.158104043, "first_response_s": 5.75509906699881, "answer_total_s": 5.794323169044219, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_217_a1929_q0", "video_id": 217, "time_stamp_s": 88, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "481205bcbdf4882f01cdcea0cd6c4186a6ddcfaf037879cfab5df8d95e82b746", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a dark background, gesturing as text appears beside him.  \n- On-screen text displays \"Mean, Median, Mode\" and \"data sets\" with example sets like {1.8, 3.2, 6} and {7.2, 5.8, 14...}.  \n- Animated icons of a beaker and a laptop with a \"Survey\" screen appear to the left and right of the man, respectively.\n[30-60s] - Man in \"math Antics\" shirt gestures while numbers (2, 5, 35, 40, 68, 72) appear around a framed photo of a family.  \n- He points to a set of three animals on scales (dog, cat, dog) with weights (38, 6, 17) displayed below.  \n- A large set of numbers (e.g., 7.5, 4.3, 8.2, etc.) appears on screen as he speaks, with no visible interaction with the numbers.", "history_tokens": 243, "history_utf8_bytes": 734, "recent_frame_times_s": [58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.01726666666667, 85.01826666666666, 86.01926666666667, 87.02026666666667], "recent_frames_sha256": "624c53d45529bfae9e399fd49a39d3282732f407964003e4db674784c458bb05", "num_recent_frames": 30, "tq": 719201.908820442, "t1": 719208.500523847, "ta": 719208.500523847, "te": 719208.542483767, "first_response_s": 6.5917034049052745, "answer_total_s": 6.633663324988447, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 217, "content_group": "cb7b9f71ec341a3dde6109be83af46a33d01b9ec0c21e9b696e1c11bab819b50", "question": {"question_id": "sample_217_a1930_q0", "video_id": 217, "video_path": "./videos/sample_217_real.mp4", "annotation_index": 1930, "question_index": 0, "question": "What concept is likely to be explained next?", "options": ["A. Median.", "B. Variance.", "C. Mode.", "D. Range."], "answer": "A", "time_stamp_s": 258, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [137, 167], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_217_a1930_q0", "video_id": 217, "time_stamp_s": 258, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "81ffd11368d49e1d064066ada0f677aca0eefa9422f4b1216438de1debc54deb", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334], "recent_frames_sha256": "1d2705bd1f5c11ab7b96700bc264da92ceec82d563b4a109352231905b233dd2", "num_recent_frames": 30, "tq": 719376.183320609, "t1": 719383.676776047, "ta": 719383.676776047, "te": 719383.717149073, "first_response_s": 7.493455437943339, "answer_total_s": 7.533828463987447, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_217_a1930_q0", "video_id": 217, "time_stamp_s": 258, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a242527f0d3692251375bcaec79f8d747100419b6d6609545d5e3b4dbb472f24", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a dark background, gesturing as text appears beside him.  \n- On-screen text displays \"Mean, Median, Mode\" and \"data sets\" with example sets like {1.8, 3.2, 6} and {7.2, 5.8, 14...}.  \n- Animated icons of a beaker and a laptop with a \"Survey\" screen appear to the left and right of the man, respectively.\n[30-60s] - Man in \"math Antics\" shirt gestures while numbers (2, 5, 35, 40, 68, 72) appear around a framed photo of a family.  \n- He points to a set of three animals on scales (dog, cat, dog) with weights (38, 6, 17) displayed below.  \n- A large set of numbers (e.g., 7.5, 4.3, 8.2, etc.) appears on screen as he speaks, with no visible interaction with the numbers.\n[60-90s] - A man in a white \"Math Antics\" t-shirt gestures while speaking, standing against a dark background with text overlays.  \n- The screen displays \"MEAN MEDIAN MODE\" in bold, yellow text, with curved arrows pointing to each term.  \n- The background transitions to a light blue grid pattern as the man continues to explain, with the word \"MEAN\" appearing on the left side of the screen.\n[90-120s] - Text \"THE MEAN?\" appears on screen, followed by \"THE AVERAGE\" in red, then \"MEAN = AVERAGE\" in blue and red.\n- A data set {1,8,3,2,6} is displayed with red bars below it, each bar corresponding to a number in the set.\n- Yellow arrows point downward from each number in the data set to its respective bar.\n[120-150s] - Red blocks are shown in varying heights, labeled as \"different numbers\" and \"different heights\" with a set {1,8,3,2,6}.\n- The text \"Rearrange the Blocks?\" appears, followed by \"each stack same amount?\" as the blocks are visually rearranged into equal stacks.\n- The final display shows \"MEAN\" with the answer \"4\" and four equal stacks of blocks, indicating the mean value.\n[150-180s] - A man in a white t-shirt with \"math Antics\" text gestures while text \"MEAN\" and \"value\" appears on screen.  \n- The screen displays a bar graph with five bars, then transitions to text \"one consistent value\" and \"MATH?\" as the man continues speaking.  \n- A colorful \"M\" made of blocks appears, followed by a scene of a man in a gray shirt arranging dominoes into stacks on a table.\n[180-210s] - A set of numbers {1,8,3,2,6} is displayed with a bar graph beneath it, showing corresponding heights.\n- The text \"Addition and Division\" appears above the set, followed by \"Goal:\" with a blank line below.\n- A vertical stack of numbers (6,2,3,8,1) is shown with a plus sign, then transitions to a single red bar representing the sum \"20\" as the result of addition.\n[210-240s] - Red bars visually represent division of 20 by 5, reducing to 4 units.  \n- Text \"MEAN\" appears above a set of numbers {1,8,3,2,6} with instructions to \"Add then Divide.\"  \n- A man in a \"math Autistics\" shirt appears, followed by a family photo with age labels (72, 35, 40, 68, 2, 5).", "history_tokens": 851, "history_utf8_bytes": 2896, "recent_frame_times_s": [228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334], "recent_frames_sha256": "1d2705bd1f5c11ab7b96700bc264da92ceec82d563b4a109352231905b233dd2", "num_recent_frames": 30, "tq": 719255.699134779, "t1": 719261.368619554, "ta": 719261.368619554, "te": 719261.557378473, "first_response_s": 5.669484774931334, "answer_total_s": 5.858243693946861, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 217, "content_group": "cb7b9f71ec341a3dde6109be83af46a33d01b9ec0c21e9b696e1c11bab819b50", "question": {"question_id": "sample_217_a1931_q0", "video_id": 217, "video_path": "./videos/sample_217_real.mp4", "annotation_index": 1931, "question_index": 0, "question": "What is the next logical step after the operation to the numbers?", "options": ["A. Find the mean of the numbers.", "B. Find the median of the numbers.", "C. Find the mode of the numbers.", "D. Find the range of the numbers."], "answer": "B", "time_stamp_s": 307, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [274, 304], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_217_a1931_q0", "video_id": 217, "time_stamp_s": 307, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b46f6c9d2ce892e8b467de8bd3834a7d65cad827e840ab5ace3813e304af2b31", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057], "recent_frames_sha256": "9c050f235fc7b1d2d90659e35113f5d8aa2893815533fec08539553beb31d110", "num_recent_frames": 30, "tq": 719383.741215709, "t1": 719395.929816793, "ta": 719395.929816793, "te": 719396.15752306, "first_response_s": 12.188601083937101, "answer_total_s": 12.416307350969873, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_217_a1931_q0", "video_id": 217, "time_stamp_s": 307, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fe9be97560710745dccaeab238d50b0c3b5e060379d40b5268ebdb449b3e560f", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Man in \"math Antics\" shirt gestures while numbers (2, 5, 35, 40, 68, 72) appear around a framed photo of a family.  \n- He points to a set of three animals on scales (dog, cat, dog) with weights (38, 6, 17) displayed below.  \n- A large set of numbers (e.g., 7.5, 4.3, 8.2, etc.) appears on screen as he speaks, with no visible interaction with the numbers.\n[60-90s] - A man in a white \"Math Antics\" t-shirt gestures while speaking, standing against a dark background with text overlays.  \n- The screen displays \"MEAN MEDIAN MODE\" in bold, yellow text, with curved arrows pointing to each term.  \n- The background transitions to a light blue grid pattern as the man continues to explain, with the word \"MEAN\" appearing on the left side of the screen.\n[90-120s] - Text \"THE MEAN?\" appears on screen, followed by \"THE AVERAGE\" in red, then \"MEAN = AVERAGE\" in blue and red.\n- A data set {1,8,3,2,6} is displayed with red bars below it, each bar corresponding to a number in the set.\n- Yellow arrows point downward from each number in the data set to its respective bar.\n[120-150s] - Red blocks are shown in varying heights, labeled as \"different numbers\" and \"different heights\" with a set {1,8,3,2,6}.\n- The text \"Rearrange the Blocks?\" appears, followed by \"each stack same amount?\" as the blocks are visually rearranged into equal stacks.\n- The final display shows \"MEAN\" with the answer \"4\" and four equal stacks of blocks, indicating the mean value.\n[150-180s] - A man in a white t-shirt with \"math Antics\" text gestures while text \"MEAN\" and \"value\" appears on screen.  \n- The screen displays a bar graph with five bars, then transitions to text \"one consistent value\" and \"MATH?\" as the man continues speaking.  \n- A colorful \"M\" made of blocks appears, followed by a scene of a man in a gray shirt arranging dominoes into stacks on a table.\n[180-210s] - A set of numbers {1,8,3,2,6} is displayed with a bar graph beneath it, showing corresponding heights.\n- The text \"Addition and Division\" appears above the set, followed by \"Goal:\" with a blank line below.\n- A vertical stack of numbers (6,2,3,8,1) is shown with a plus sign, then transitions to a single red bar representing the sum \"20\" as the result of addition.\n[210-240s] - Red bars visually represent division of 20 by 5, reducing to 4 units.  \n- Text \"MEAN\" appears above a set of numbers {1,8,3,2,6} with instructions to \"Add then Divide.\"  \n- A man in a \"math Autistics\" shirt appears, followed by a family photo with age labels (72, 35, 40, 68, 2, 5).\n[240-270s] - A family photo is displayed in a golden frame against a blue grid background.  \n- Numbers (72, 35, 40, 68, 2, 5) are annotated above the photo, then vertically aligned for addition.  \n- The sum \"222\" appears below the numbers, followed by a division symbol and \"6\" indicating the calculation of the mean.\n[270-300s] - Man in white t-shirt gestures while explaining median concept with set {1,2,3,6,8} and arrows indicating \"less\" and \"greater\" values.  \n- On-screen text changes to show \"easy!\" and \"HARD\" with cartoon faces appearing above the text.  \n- Man transitions to a new set {3,2,1,8,6} and arranges it in order as {1,2,3,6,8} with \"least\" and \"greatest\" labels.", "history_tokens": 948, "history_utf8_bytes": 3213, "recent_frame_times_s": [277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057], "recent_frames_sha256": "9c050f235fc7b1d2d90659e35113f5d8aa2893815533fec08539553beb31d110", "num_recent_frames": 30, "tq": 719278.806353975, "t1": 719286.018335262, "ta": 719286.018335262, "te": 719286.327300633, "first_response_s": 7.21198128699325, "answer_total_s": 7.520946657983586, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 217, "content_group": "cb7b9f71ec341a3dde6109be83af46a33d01b9ec0c21e9b696e1c11bab819b50", "question": {"question_id": "sample_217_a1932_q0", "video_id": 217, "video_path": "./videos/sample_217_real.mp4", "annotation_index": 1932, "question_index": 0, "question": "What might the instructor explain next?", "options": ["A. How to calculate the mean of a set of numbers.", "B. How to interpret the result of the median calculation.", "C. The difference between mean and median.", "D. How to find the mode of a data set."], "answer": "B", "time_stamp_s": 440, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [411, 441], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_217_a1932_q0", "video_id": 217, "time_stamp_s": 440, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fb3d600ddc585f01ad1e50ea1cdd1dcf69bcf81ae1079e15fb1f4a7938bef302", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256, 427.0266, 428.0276, 429.0286, 430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333, 439.0052333333333], "recent_frames_sha256": "1cbc4953a7f7e7b8901c3d777b84fe54d88c3fa3e17ccd824ca9ef99d7642002", "num_recent_frames": 30, "tq": 719396.176230543, "t1": 719402.983737386, "ta": 719402.983737386, "te": 719403.020583063, "first_response_s": 6.807506843004376, "answer_total_s": 6.84435252007097, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_217_a1932_q0", "video_id": 217, "time_stamp_s": 440, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4a61f7f209f4a83d45ca9915bc0cb6c387970636260f71d104d0979b90abf242", "condition_order": ["notes", "recent"], "memory": "[150-180s] - A man in a white t-shirt with \"math Antics\" text gestures while text \"MEAN\" and \"value\" appears on screen.  \n- The screen displays a bar graph with five bars, then transitions to text \"one consistent value\" and \"MATH?\" as the man continues speaking.  \n- A colorful \"M\" made of blocks appears, followed by a scene of a man in a gray shirt arranging dominoes into stacks on a table.\n[180-210s] - A set of numbers {1,8,3,2,6} is displayed with a bar graph beneath it, showing corresponding heights.\n- The text \"Addition and Division\" appears above the set, followed by \"Goal:\" with a blank line below.\n- A vertical stack of numbers (6,2,3,8,1) is shown with a plus sign, then transitions to a single red bar representing the sum \"20\" as the result of addition.\n[210-240s] - Red bars visually represent division of 20 by 5, reducing to 4 units.  \n- Text \"MEAN\" appears above a set of numbers {1,8,3,2,6} with instructions to \"Add then Divide.\"  \n- A man in a \"math Autistics\" shirt appears, followed by a family photo with age labels (72, 35, 40, 68, 2, 5).\n[240-270s] - A family photo is displayed in a golden frame against a blue grid background.  \n- Numbers (72, 35, 40, 68, 2, 5) are annotated above the photo, then vertically aligned for addition.  \n- The sum \"222\" appears below the numbers, followed by a division symbol and \"6\" indicating the calculation of the mean.\n[270-300s] - Man in white t-shirt gestures while explaining median concept with set {1,2,3,6,8} and arrows indicating \"less\" and \"greater\" values.  \n- On-screen text changes to show \"easy!\" and \"HARD\" with cartoon faces appearing above the text.  \n- Man transitions to a new set {3,2,1,8,6} and arranges it in order as {1,2,3,6,8} with \"least\" and \"greatest\" labels.\n[300-330s] - Text \"in order\" appears with \"least\" and \"greatest\" labels above a set {2, 3} that changes to {1, 2, 3}.\n- The word \"MEDIAN\" is displayed with \"Middle\" below it, pointing to the middle element in the set {1, 2, 3}.\n- The presenter gestures toward the screen while explaining the median concept.\n[330-360s] - \"MEAN 2\" and \"MEDIAN 2\" labels appear with sets {1,2,3} and {1,2,3} respectively, then bar graphs show three red bars under \"MEAN 2\".\n- \"MEAN 4\" and \"MEDIAN ?\" labels appear with set {1.8,3,2,6} for \"MEAN 4\" and \"MEDIAN ?\" for \"MEDIAN\", then bar graphs show four red bars under \"MEAN 4\".\n- \"MEDIAN 3\" label appears with set {1,2,3,6\n[360-390s] - Man in white \"Math Antics\" shirt gestures while explaining median concepts.  \n- On-screen text displays median calculations for sets like {9,1,7,5,5,0,6,1,3} and {0,1,1,3,5,5,6,7,9}.  \n- Visuals show median arrows pointing to middle values, with annotations indicating \"4 numbers\" for even-length sets.\n[390-420s] - A yellow arrow points to the set {1,2,3,4} as \"even\" appears beside it.  \n- The word \"MEAN\" appears below the set, then \"MEDIAN\" appears above it with a yellow arrow pointing to the set.  \n- The set's elements are highlighted sequentially, with the number \"2\" being emphasized as the median.", "history_tokens": 950, "history_utf8_bytes": 3026, "recent_frame_times_s": [410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256, 427.0266, 428.0276, 429.0286, 430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333, 439.0052333333333], "recent_frames_sha256": "1cbc4953a7f7e7b8901c3d777b84fe54d88c3fa3e17ccd824ca9ef99d7642002", "num_recent_frames": 30, "tq": 719315.866517166, "t1": 719325.299633655, "ta": 719325.299633655, "te": 719325.33779213, "first_response_s": 9.43311648897361, "answer_total_s": 9.471274963929318, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 217, "content_group": "cb7b9f71ec341a3dde6109be83af46a33d01b9ec0c21e9b696e1c11bab819b50", "question": {"question_id": "sample_217_a1933_q0", "video_id": 217, "video_path": "./videos/sample_217_real.mp4", "annotation_index": 1933, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. Divide the sum by the first number in the list.", "B. Subtract the smallest number from the sum.", "C. Divide the sum by the count of numbers.", "D. Add all the numbers again."], "answer": "C", "time_stamp_s": 554, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [548, 578], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_217_a1933_q0", "video_id": 217, "time_stamp_s": 554, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "306ce30a3d6c787c867bc4582e0580bfb7b0a9a3b68fc937a8c277d271cf3528", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [524.0235, 525.0245, 526.0255, 527.0265, 528.0275, 529.0285, 530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333], "recent_frames_sha256": "7a28a44bef3be259264498a9f86d14a47b5eeef4adefb0f0da8e33047d9f123e", "num_recent_frames": 30, "tq": 719403.034570052, "t1": 719410.20769029, "ta": 719410.20769029, "te": 719410.245209479, "first_response_s": 7.173120237886906, "answer_total_s": 7.210639426950365, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_217_a1933_q0", "video_id": 217, "time_stamp_s": 554, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a3c3b235331a35d3d3fcc24a7a6f492a4ad46804e33b147bbfdffad7232437b2", "condition_order": ["notes", "recent"], "memory": "[270-300s] - Man in white t-shirt gestures while explaining median concept with set {1,2,3,6,8} and arrows indicating \"less\" and \"greater\" values.  \n- On-screen text changes to show \"easy!\" and \"HARD\" with cartoon faces appearing above the text.  \n- Man transitions to a new set {3,2,1,8,6} and arranges it in order as {1,2,3,6,8} with \"least\" and \"greatest\" labels.\n[300-330s] - Text \"in order\" appears with \"least\" and \"greatest\" labels above a set {2, 3} that changes to {1, 2, 3}.\n- The word \"MEDIAN\" is displayed with \"Middle\" below it, pointing to the middle element in the set {1, 2, 3}.\n- The presenter gestures toward the screen while explaining the median concept.\n[330-360s] - \"MEAN 2\" and \"MEDIAN 2\" labels appear with sets {1,2,3} and {1,2,3} respectively, then bar graphs show three red bars under \"MEAN 2\".\n- \"MEAN 4\" and \"MEDIAN ?\" labels appear with set {1.8,3,2,6} for \"MEAN 4\" and \"MEDIAN ?\" for \"MEDIAN\", then bar graphs show four red bars under \"MEAN 4\".\n- \"MEDIAN 3\" label appears with set {1,2,3,6\n[360-390s] - Man in white \"Math Antics\" shirt gestures while explaining median concepts.  \n- On-screen text displays median calculations for sets like {9,1,7,5,5,0,6,1,3} and {0,1,1,3,5,5,6,7,9}.  \n- Visuals show median arrows pointing to middle values, with annotations indicating \"4 numbers\" for even-length sets.\n[390-420s] - A yellow arrow points to the set {1,2,3,4} as \"even\" appears beside it.  \n- The word \"MEAN\" appears below the set, then \"MEDIAN\" appears above it with a yellow arrow pointing to the set.  \n- The set's elements are highlighted sequentially, with the number \"2\" being emphasized as the median.\n[420-450s] - Text \"MEDIAN 2.5\" appears with a yellow arrow pointing to the set {1,2,3,4}.  \n- The word \"Middle\" appears below the set, highlighting the central position.  \n- A man in a white t-shirt with \"Math Antics\" appears, gesturing toward the screen.\n[450-480s] - Man in white \"Math Antics\" shirt gestures while explaining mode, with text \"MODE\" and \"most often\" appearing on screen.\n- Set of numbers {1,2,3,8,6} and {2,5,35,40,68,72} are displayed as examples for mode.\n- Set {2,1,3,2,3,3} appears with text \"Values Repeated\" as the man continues explaining mode.\n[480-510s] - The presenter gestures toward the set {1,2,3,3} as \"MODE 3\" is highlighted in yellow, indicating the most frequent value.\n- The screen transitions to show {1,2,3,4} with \"No MODE\" displayed, emphasizing all values appear once.\n- The presenter then points to the set {0,5,7,7,10,12,15,15,32} with \"More than one MODE\" and arrows highlighting the repeated values 7 and 15, labeled \"They Tie!\"\n[510-540s] - A man in a white t-shirt with \"math Antics\" text stands against a blue grid background, gesturing as \"MEAN\", \"MEDIAN\", and \"MODE\" appear sequentially on screen.  \n- A table titled \"Month\" and \"Sales Sold\" appears, listing monthly sales figures from January to December.  \n- The man points to the table as \"MEAN\", \"MEDIAN\", and \"MODE\" labels appear vertically on the left side of the screen.", "history_tokens": 961, "history_utf8_bytes": 3019, "recent_frame_times_s": [524.0235, 525.0245, 526.0255, 527.0265, 528.0275, 529.0285, 530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333], "recent_frames_sha256": "7a28a44bef3be259264498a9f86d14a47b5eeef4adefb0f0da8e33047d9f123e", "num_recent_frames": 30, "tq": 719361.952799446, "t1": 719370.151655767, "ta": 719370.151655767, "te": 719370.342457786, "first_response_s": 8.19885632104706, "answer_total_s": 8.389658340020105, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 218, "content_group": "058e1ef70b012470786687bc0f97e6b8f226981a2bc2b123a9e3a1e94dae8367", "question": {"question_id": "sample_218_a2219_q0", "video_id": 218, "video_path": "./videos/sample_218_real.mp4", "annotation_index": 2219, "question_index": 0, "question": "What topic might the teacher explain next?", "options": ["A. mixed numbers and improper fractions.", "B. Add mixed numbers.", "C. Subtract improper fractions.", "D. Multiply fractions."], "answer": "A", "time_stamp_s": 11, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_218_a2219_q0", "video_id": 218, "time_stamp_s": 11, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1267e5aa111eba4537ebefffb8488ba2b3d07d56412a9d8f51bb65b951ea5fb5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01], "recent_frames_sha256": "b879522b48ecc5f2492a0d474b0b62bf5a171a7e01ff6ef9b5d933ae175df09d", "num_recent_frames": 11, "tq": 717662.754204791, "t1": 717663.635675557, "ta": 717663.635675557, "te": 717663.674468765, "first_response_s": 0.8814707659184933, "answer_total_s": 0.9202639739960432, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_218_a2219_q0", "video_id": 218, "time_stamp_s": 11, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4f815218f6c8894432dce9877d08de22c3d93d86ec218d061a2fdbfcb86f9829", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01], "recent_frames_sha256": "b879522b48ecc5f2492a0d474b0b62bf5a171a7e01ff6ef9b5d933ae175df09d", "num_recent_frames": 11, "tq": 717460.898312777, "t1": 717473.818218029, "ta": 717473.818218029, "te": 717474.126979942, "first_response_s": 12.919905251939781, "answer_total_s": 13.228667164919898, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 218, "content_group": "058e1ef70b012470786687bc0f97e6b8f226981a2bc2b123a9e3a1e94dae8367", "question": {"question_id": "sample_218_a2220_q0", "video_id": 218, "video_path": "./videos/sample_218_real.mp4", "annotation_index": 2220, "question_index": 0, "question": "What might the teacher explain next?", "options": ["A. Compare the fractions using decimal values.", "B. Explain how improper fractions is connected to proper fractions and whole fractions.", "C. Demonstrate how to multiply two fractions.", "D. Discuss the concept of mixed numbers."], "answer": "B", "time_stamp_s": 190, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [158, 188], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_218_a2220_q0", "video_id": 218, "time_stamp_s": 190, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ecd30b108f387fad528138828b2b6bb848cb1677fefb80212b82d76fb690d241", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666], "recent_frames_sha256": "5cdc764da48725fa24ee28d599735bba4a2e202bc4b944595e216c848dc6726e", "num_recent_frames": 30, "tq": 717663.692459664, "t1": 717676.876432572, "ta": 717676.876432572, "te": 717676.915686001, "first_response_s": 13.183972908067517, "answer_total_s": 13.22322633699514, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_218_a2220_q0", "video_id": 218, "time_stamp_s": 190, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "63efde0b81b9f579832991f7b2d520f768c429182a07c02c20f114f31911c538", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a blue background, gesturing as he speaks.  \n- Another man in a gray t-shirt holds a small container labeled with \"+ - x ÷\" and later points to it while discussing its contents.  \n- The container is labeled \"Protein\" and \"Vitamin\" with an arrow pointing to \"Nuts?\" as the second man questions its contents.\n[30-60s] - Man in gray shirt holds blue bag and gestures while speaking to man in white shirt.  \n- Man in white shirt (with \"math Antics\" shirt) gestures and speaks, with text overlays appearing on screen.  \n- Background transitions from solid blue to grid-patterned with number line (0 to 3) appearing as the man continues speaking.\n[60-90s] - Red arrows appear pointing leftward from the number 1 on the number line.  \n- A blue rectangle is drawn from 0 to 1, labeled \"1\".  \n- An orange rectangle appears below the number line, labeled \"1/4\", positioned from 0 to 0.25.\n[90-120s] - A man in a white \"Math Antics\" t-shirt gestures while explaining, with a number line and fractions displayed on screen.  \n- The number line shows a blue bar labeled \"1\" and an orange bar labeled \"3/4\" below it, which later changes to \"4/4\".  \n- A second man in a gray sweater and tie appears, holding a stick, as the text \"Whole Fraction\" is underlined and then accompanied by \"Same Number on top and on the bottom\".\n[120-150s] - Fractions 2/2, 8/8, and 100/100 are shown with red arrows pointing to the number \"1\" on a grid background.\n- A number line appears with a blue segment labeled \"1\" and an orange segment labeled \"4/4\" below it, indicating equivalence to \"1\".\n- Red arrows extend from the fractions to \"1\" and then to additional fractions like 5/5, 34/34, and 7/7, illustrating their equivalence to \"1\".\n[150-180s] - A blue bar labeled \"1\" is positioned above a number line from 0 to 3.  \n- An orange bar labeled \"5/4\" extends beyond the \"1\" mark, visually indicating a value greater than 1.  \n- The orange bar is shown with a red arrow pointing to its right, emphasizing its length exceeds the unit bar.", "history_tokens": 563, "history_utf8_bytes": 2070, "recent_frame_times_s": [160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666], "recent_frames_sha256": "5cdc764da48725fa24ee28d599735bba4a2e202bc4b944595e216c848dc6726e", "num_recent_frames": 30, "tq": 717516.489492651, "t1": 717523.48189285, "ta": 717523.48189285, "te": 717523.776577046, "first_response_s": 6.992400199058466, "answer_total_s": 7.287084395065904, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 218, "content_group": "058e1ef70b012470786687bc0f97e6b8f226981a2bc2b123a9e3a1e94dae8367", "question": {"question_id": "sample_218_a2221_q0", "video_id": 218, "video_path": "./videos/sample_218_real.mp4", "annotation_index": 2221, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to convert mixed numbers to improper fractions.", "B. The method for adding mixed numbers and improper fractions.", "C. Simplifying improper fractions.", "D. Dividing fractions by whole numbers."], "answer": "A", "time_stamp_s": 331, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [316, 346], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_218_a2221_q0", "video_id": 218, "time_stamp_s": 331, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fb83346e1ce435fb5cf5c287969e06edee1d04027cd72b3b386450d57d25dd90", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297], "recent_frames_sha256": "4ac098588132932914c2bae57f5d88e390500cbe675ae0f4417861b7968b87b6", "num_recent_frames": 30, "tq": 717676.933449325, "t1": 717688.774204858, "ta": 717688.774204858, "te": 717688.814964952, "first_response_s": 11.840755532961339, "answer_total_s": 11.881515626912005, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_218_a2221_q0", "video_id": 218, "time_stamp_s": 331, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4733d77789ece0d1d7281d5889744b4c3b7fa8f778e958970d4c7374db1ed5ba", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Man in gray shirt holds blue bag and gestures while speaking to man in white shirt.  \n- Man in white shirt (with \"math Antics\" shirt) gestures and speaks, with text overlays appearing on screen.  \n- Background transitions from solid blue to grid-patterned with number line (0 to 3) appearing as the man continues speaking.\n[60-90s] - Red arrows appear pointing leftward from the number 1 on the number line.  \n- A blue rectangle is drawn from 0 to 1, labeled \"1\".  \n- An orange rectangle appears below the number line, labeled \"1/4\", positioned from 0 to 0.25.\n[90-120s] - A man in a white \"Math Antics\" t-shirt gestures while explaining, with a number line and fractions displayed on screen.  \n- The number line shows a blue bar labeled \"1\" and an orange bar labeled \"3/4\" below it, which later changes to \"4/4\".  \n- A second man in a gray sweater and tie appears, holding a stick, as the text \"Whole Fraction\" is underlined and then accompanied by \"Same Number on top and on the bottom\".\n[120-150s] - Fractions 2/2, 8/8, and 100/100 are shown with red arrows pointing to the number \"1\" on a grid background.\n- A number line appears with a blue segment labeled \"1\" and an orange segment labeled \"4/4\" below it, indicating equivalence to \"1\".\n- Red arrows extend from the fractions to \"1\" and then to additional fractions like 5/5, 34/34, and 7/7, illustrating their equivalence to \"1\".\n[150-180s] - A blue bar labeled \"1\" is positioned above a number line from 0 to 3.  \n- An orange bar labeled \"5/4\" extends beyond the \"1\" mark, visually indicating a value greater than 1.  \n- The orange bar is shown with a red arrow pointing to its right, emphasizing its length exceeds the unit bar.\n[180-210s] - A number line with labeled segments from 0 to 3, showing fractions 1/4 and 5/4.\n- Text labels \"Whole Fractions,\" \"Proper Fractions,\" and \"Improper Fractions\" appear below the number line.\n- An arrow points to the segment labeled \"5/4,\" indicating its classification as an improper fraction.\n[210-240s] - A number line visually represents mixed numbers with segments labeled as whole fractions (4/4), proper fractions (1/4), and the resulting improper fraction (5/4).\n- The red arrow points to the whole number 1, indicating its role in the mixed number 1 1/4.\n- The equation 4/4 + 1/4 = 5/4 is displayed with labels identifying each component as \"Whole,\" \"Proper,\" and \"Improper\" fractions.\n[240-270s] - A man in a white t-shirt with \"math antics\" text gestures while explaining fractions.\n- On-screen text labels \"Mixed Number,\" \"Improper Fraction,\" and \"Whole Fractions\" appear with arrows pointing to corresponding fractions.\n- A number line with \"8/3\" displayed above it shows divisions into thirds, with arrows indicating the scale.\n[270-300s] - The number 8/3 is displayed above a number line with pink segments representing fractional parts.\n- Labels \"Whole Fraction\" appear under segments, initially showing 2/3, then expanding to 6/3, and finally 8/3 as the total.\n- The number line is marked with integers 0, 1, 2, 3, and the pink segments extend from 0 to 2, with the final label \"Mixed Number\" appearing above the line.\n[300-330s] - A number line visually represents the mixed number 2 2/3, with blue and pink segments indicating whole and fractional parts.\n- The fraction 8/3 is shown as equivalent to 2 2/3, with a yellow arrow circling the equality to emphasize equivalence.\n- The presenter, wearing a \"math antics\" shirt, gestures toward the screen while explaining the conversion.", "history_tokens": 943, "history_utf8_bytes": 3509, "recent_frame_times_s": [301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297], "recent_frames_sha256": "4ac098588132932914c2bae57f5d88e390500cbe675ae0f4417861b7968b87b6", "num_recent_frames": 30, "tq": 717562.597948143, "t1": 717569.784123111, "ta": 717569.784123111, "te": 717570.087898941, "first_response_s": 7.186174968024716, "answer_total_s": 7.489950797986239, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 218, "content_group": "058e1ef70b012470786687bc0f97e6b8f226981a2bc2b123a9e3a1e94dae8367", "question": {"question_id": "sample_218_a2222_q0", "video_id": 218, "video_path": "./videos/sample_218_real.mp4", "annotation_index": 2222, "question_index": 0, "question": "What concept will the speaker likely explain next?", "options": ["A. Multiplying mixed fractions by a whole number.", "B. Converting improper fractions to mixed numbers.", "C. Adding improper fractions together.", "D. Simplifying mixed fractions."], "answer": "B", "time_stamp_s": 500, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [474, 504], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_218_a2222_q0", "video_id": 218, "time_stamp_s": 500, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3870c97896a744704c8a97bd2da4493f45d605d54ce800c50df3867f85660dec", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667, 487.01986666666664, 488.0208666666667, 489.02186666666665, 490.0228666666667, 491.02386666666666, 492.02486666666664, 493.0258666666667, 494.02686666666665, 495.0278666666667, 496.02886666666666, 497.0298666666667, 498.03086666666667, 499.03186666666664], "recent_frames_sha256": "466a575d2a3a9f6474c0fe4b05d77b2bf43dafef3cb7a2874b35fa03279b29e4", "num_recent_frames": 30, "tq": 717688.82529778, "t1": 717699.718197822, "ta": 717699.718197822, "te": 717699.77501536, "first_response_s": 10.89290004200302, "answer_total_s": 10.949717579991557, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_218_a2222_q0", "video_id": 218, "time_stamp_s": 500, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2ce7aa18f344ad251334f3962287c81a62fa12b134ac8a9d6082ef89f33d9ae7", "condition_order": ["notes", "recent"], "memory": "[210-240s] - A number line visually represents mixed numbers with segments labeled as whole fractions (4/4), proper fractions (1/4), and the resulting improper fraction (5/4).\n- The red arrow points to the whole number 1, indicating its role in the mixed number 1 1/4.\n- The equation 4/4 + 1/4 = 5/4 is displayed with labels identifying each component as \"Whole,\" \"Proper,\" and \"Improper\" fractions.\n[240-270s] - A man in a white t-shirt with \"math antics\" text gestures while explaining fractions.\n- On-screen text labels \"Mixed Number,\" \"Improper Fraction,\" and \"Whole Fractions\" appear with arrows pointing to corresponding fractions.\n- A number line with \"8/3\" displayed above it shows divisions into thirds, with arrows indicating the scale.\n[270-300s] - The number 8/3 is displayed above a number line with pink segments representing fractional parts.\n- Labels \"Whole Fraction\" appear under segments, initially showing 2/3, then expanding to 6/3, and finally 8/3 as the total.\n- The number line is marked with integers 0, 1, 2, 3, and the pink segments extend from 0 to 2, with the final label \"Mixed Number\" appearing above the line.\n[300-330s] - A number line visually represents the mixed number 2 2/3, with blue and pink segments indicating whole and fractional parts.\n- The fraction 8/3 is shown as equivalent to 2 2/3, with a yellow arrow circling the equality to emphasize equivalence.\n- The presenter, wearing a \"math antics\" shirt, gestures toward the screen while explaining the conversion.\n[330-360s] - A man in a white t-shirt with \"math Antics\" text gestures while explaining mixed numbers.\n- On-screen text displays the equation \"8/3 = 2 2/3\" with arrows highlighting the conversion process.\n- The visual breaks down \"8/3\" into \"1 + 1 + 2/3\" to illustrate the mixed number formation.\n[360-390s] - A man in a white t-shirt with \"Math Antics\" text gestures while explaining mixed numbers on a grid background.\n- On-screen text labels \"Mixed Number\" and \"Improper Fraction\" appear, with fractions like 8/3 and 2 2/3 visually broken down into 3+3+2 over 3.\n- The video transitions to show \"Any Mixed Number\" converting to \"Improper Fraction\" with examples like 3 1/2 and 7/2, followed by a clean slate with \"2 1/8\" displayed.\n[390-420s] - The equation 2 1/8 is broken down into three eighths: 8/8 + 8/8 + 1/8 = 17/8.\n- The mixed number 3 4/5 is decomposed into five fifths: 5/5 + 5/5 + 5/5 + 4/5 = 19/5.\n- The mixed number 4 2/3 is further broken down into three thirds: 3/3 + 3/3 + 3/3 + 2/3 = 14/3.\n[420-450s] - Red arrows point to the fractional components in each equation, highlighting the repeated addition of the fractional part.\n- A man in a white t-shirt appears, gesturing toward the equations as if explaining them.\n- The text \"How many?\" appears at the bottom, suggesting a question about the quantity of fractional parts being added.\n[450-480s] - The first equation shows 2 1/8 rewritten as 16/8 + 1/8 = 17/8, with the 17/8 result circled.\n- The second equation displays 3 4/5 as 15/5 + 4/5 = 19/5, with the 19/5 result circled.\n- The third equation presents 4 2/3 as 12/3 + 2/3 = 14/3, with the 14/3 result circled.", "history_tokens": 948, "history_utf8_bytes": 3145, "recent_frame_times_s": [470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667, 487.01986666666664, 488.0208666666667, 489.02186666666665, 490.0228666666667, 491.02386666666666, 492.02486666666664, 493.0258666666667, 494.02686666666665, 495.0278666666667, 496.02886666666666, 497.0298666666667, 498.03086666666667, 499.03186666666664], "recent_frames_sha256": "466a575d2a3a9f6474c0fe4b05d77b2bf43dafef3cb7a2874b35fa03279b29e4", "num_recent_frames": 30, "tq": 717610.973195709, "t1": 717612.286946841, "ta": 717612.286946841, "te": 717612.444976621, "first_response_s": 1.3137511319946498, "answer_total_s": 1.471780911902897, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 218, "content_group": "058e1ef70b012470786687bc0f97e6b8f226981a2bc2b123a9e3a1e94dae8367", "question": {"question_id": "sample_218_a2223_q0", "video_id": 218, "video_path": "./videos/sample_218_real.mp4", "annotation_index": 2223, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. Add the remainder to the quotient.", "B. Subtract 6 from 1.", "C. Divide 7 by 3.", "D. How to use dividing to convert improper fractions to a mixed number form."], "answer": "D", "time_stamp_s": 646, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [632, 662], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_218_a2223_q0", "video_id": 218, "time_stamp_s": 646, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d66b296a4bee24b5b86dc50ae14113d2f23f55e01535e9a6a2fbb7dab13c898f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [616.0154, 617.0164, 618.0174, 619.0184, 620.0194, 621.0204, 622.0214, 623.0224, 624.0234, 625.0244, 626.0254, 627.0264, 628.0274, 629.0284, 630.0294, 631.0304, 632.0314, 633.0324, 634.0000333333334, 635.0010333333333, 636.0020333333333, 637.0030333333333, 638.0040333333334, 639.0050333333334, 640.0060333333333, 641.0070333333333, 642.0080333333333, 643.0090333333334, 644.0100333333334, 645.0110333333333], "recent_frames_sha256": "2486d7bdabb2d42345b60ccc6660b3f362572f57c91720202546def372afcad5", "num_recent_frames": 30, "tq": 717699.797996413, "t1": 717712.512564579, "ta": 717712.512564579, "te": 717712.550471905, "first_response_s": 12.714568166062236, "answer_total_s": 12.752475492074154, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_218_a2223_q0", "video_id": 218, "time_stamp_s": 646, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "72f8c4d2d755a45736bb49544102e239bc1e5dac4b32cb864e5b2b9d3d2d8096", "condition_order": ["notes", "recent"], "memory": "[330-360s] - A man in a white t-shirt with \"math Antics\" text gestures while explaining mixed numbers.\n- On-screen text displays the equation \"8/3 = 2 2/3\" with arrows highlighting the conversion process.\n- The visual breaks down \"8/3\" into \"1 + 1 + 2/3\" to illustrate the mixed number formation.\n[360-390s] - A man in a white t-shirt with \"Math Antics\" text gestures while explaining mixed numbers on a grid background.\n- On-screen text labels \"Mixed Number\" and \"Improper Fraction\" appear, with fractions like 8/3 and 2 2/3 visually broken down into 3+3+2 over 3.\n- The video transitions to show \"Any Mixed Number\" converting to \"Improper Fraction\" with examples like 3 1/2 and 7/2, followed by a clean slate with \"2 1/8\" displayed.\n[390-420s] - The equation 2 1/8 is broken down into three eighths: 8/8 + 8/8 + 1/8 = 17/8.\n- The mixed number 3 4/5 is decomposed into five fifths: 5/5 + 5/5 + 5/5 + 4/5 = 19/5.\n- The mixed number 4 2/3 is further broken down into three thirds: 3/3 + 3/3 + 3/3 + 2/3 = 14/3.\n[420-450s] - Red arrows point to the fractional components in each equation, highlighting the repeated addition of the fractional part.\n- A man in a white t-shirt appears, gesturing toward the equations as if explaining them.\n- The text \"How many?\" appears at the bottom, suggesting a question about the quantity of fractional parts being added.\n[450-480s] - The first equation shows 2 1/8 rewritten as 16/8 + 1/8 = 17/8, with the 17/8 result circled.\n- The second equation displays 3 4/5 as 15/5 + 4/5 = 19/5, with the 19/5 result circled.\n- The third equation presents 4 2/3 as 12/3 + 2/3 = 14/3, with the 14/3 result circled.\n[480-510s] - A man's head appears with a surprised expression, positioned below the mathematical equation.  \n- The equation transforms to show 15 multiplied by 4/4, with the result 60/4 highlighted in green.  \n- The final equation displays 60/4 + 1/4, with the sum 61/4 circled in yellow.\n[510-540s] - A man in a white t-shirt with \"math antics\" text appears, gesturing while explaining math concepts.  \n- On-screen text displays \"Improper Fraction\" and \"Mixed Number\" with an arrow indicating conversion.  \n- A fraction \"10/3\" appears with a green \"How many?\" text, suggesting a question about converting improper fractions.\n[540-570s] - The improper fraction 7/2 is shown being subtracted by 2/2, resulting in 5/2.\n- The mixed number 1 5/2 appears on the right, labeled \"Bad Form\" in red text.\n- A yellow curved arrow connects the improper fraction result (5/2) to the mixed number (1 5/2), highlighting the incorrect form.\n[570-600s] - The improper fraction 7/2 is visually reduced by subtracting 2/2 twice, resulting in 3/2.\n- The mixed number 1 1/2 is labeled \"Bad Form\" and is shown as an incorrect representation.\n- The mixed number 2 3/2 is also labeled \"Bad Form\" and appears after the improper fraction is simplified.\n[600-630s] - A grid displays improper fractions and mixed numbers with green boxes showing subtraction steps, transitioning to highlight \"Proper Form\" for 3 1/2.\n- Yellow arrows trace the subtraction process from 7/2 to 1, emphasizing the conversion to proper form.\n- The text \"Bad Form\" appears under 1 1/2 and 2 3/2, contrasting with \"Proper Form\" under 3 1/2.", "history_tokens": 1007, "history_utf8_bytes": 3229, "recent_frame_times_s": [616.0154, 617.0164, 618.0174, 619.0184, 620.0194, 621.0204, 622.0214, 623.0224, 624.0234, 625.0244, 626.0254, 627.0264, 628.0274, 629.0284, 630.0294, 631.0304, 632.0314, 633.0324, 634.0000333333334, 635.0010333333333, 636.0020333333333, 637.0030333333333, 638.0040333333334, 639.0050333333334, 640.0060333333333, 641.0070333333333, 642.0080333333333, 643.0090333333334, 644.0100333333334, 645.0110333333333], "recent_frames_sha256": "2486d7bdabb2d42345b60ccc6660b3f362572f57c91720202546def372afcad5", "num_recent_frames": 30, "tq": 717656.056330454, "t1": 717662.562054957, "ta": 717662.562054957, "te": 717662.718191985, "first_response_s": 6.505724503076635, "answer_total_s": 6.661861531087197, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 219, "content_group": "abcfb2648dc865cf030d04f75f7f5f0b778fe8620ed6619a0003b56e9c68c05f", "question": {"question_id": "sample_219_a2060_q0", "video_id": 219, "video_path": "./videos/sample_219_real.mp4", "annotation_index": 2060, "question_index": 0, "question": "What mathematical topic might the speaker focus on next?", "options": ["A. Adding Fractions.", "B. Dividing Fractions.", "C. Simplifying Fractions.", "D. Multiplying Fractions."], "answer": "D", "time_stamp_s": 10, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_219_a2060_q0", "video_id": 219, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dad4f31270c5165d11164ef6adbfd5437c6321277c6bc56ba1a0424b1e46ef20", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "6af8af956a5f8a43000f3b329d8c173707ef45d92accccf46fab0f73e22874f3", "num_recent_frames": 10, "tq": 719218.967831054, "t1": 719219.582636201, "ta": 719219.582636201, "te": 719219.619556043, "first_response_s": 0.6148051470518112, "answer_total_s": 0.6517249889438972, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_219_a2060_q0", "video_id": 219, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "037f74d38d6522acd91101e1fc3859c6d0f6e3258bdb6d957eb505455042c156", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "6af8af956a5f8a43000f3b329d8c173707ef45d92accccf46fab0f73e22874f3", "num_recent_frames": 10, "tq": 719262.213194976, "t1": 719272.744403054, "ta": 719272.744403054, "te": 719272.782827818, "first_response_s": 10.531208078027703, "answer_total_s": 10.569632841972634, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 219, "content_group": "abcfb2648dc865cf030d04f75f7f5f0b778fe8620ed6619a0003b56e9c68c05f", "question": {"question_id": "sample_219_a2061_q0", "video_id": 219, "video_path": "./videos/sample_219_real.mp4", "annotation_index": 2061, "question_index": 0, "question": "What might the speaker do next?", "options": ["A. Explain how to convert the fractions.", "B. Show the steps to add the fractions.", "C. Show the steps to multiply the fractions.", "D. Discuss the importance of common denominators."], "answer": "C", "time_stamp_s": 55, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [70, 100], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_219_a2061_q0", "video_id": 219, "time_stamp_s": 55, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ae88d15b3419bae5f6551922fbe6d4241d4206019bc144e34b60066fabc4df20", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [25.025, 26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336], "recent_frames_sha256": "e1d87641ed1395749606ad9e43205b9451c65d5b179d233287cb83f8858bbbf5", "num_recent_frames": 30, "tq": 719219.634028182, "t1": 719231.105444316, "ta": 719231.105444316, "te": 719231.145711964, "first_response_s": 11.471416134038009, "answer_total_s": 11.511683781980537, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_219_a2061_q0", "video_id": 219, "time_stamp_s": 55, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "242896f088b8fcc2cbe2743027c30c27adf3c9698ff02b02e9fd038737dad956", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a beige t-shirt speaks against a blurred background of warm-toned rectangular panels, gesturing with his hands while text overlays appear (e.g., \"Fractions,\" \"Really\").\n- The scene transitions to an outdoor setting featuring a large red and blue circus tent with diamond patterns, where the man continues speaking and gesturing.\n- The video opens with a title sequence displaying \"Math Antics\" and \"Multiplying Fractions\" on a grid background, followed by the man appearing in a studio setting.", "history_tokens": 112, "history_utf8_bytes": 513, "recent_frame_times_s": [25.025, 26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336], "recent_frames_sha256": "e1d87641ed1395749606ad9e43205b9451c65d5b179d233287cb83f8858bbbf5", "num_recent_frames": 30, "tq": 719283.939082556, "t1": 719286.018335262, "ta": 719286.018335262, "te": 719286.327300633, "first_response_s": 2.0792527059093118, "answer_total_s": 2.3882180768996477, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 219, "content_group": "abcfb2648dc865cf030d04f75f7f5f0b778fe8620ed6619a0003b56e9c68c05f", "question": {"question_id": "sample_219_a2062_q0", "video_id": 219, "video_path": "./videos/sample_219_real.mp4", "annotation_index": 2062, "question_index": 0, "question": "What might the speaker do next?", "options": ["A. Add the fractions together.", "B. Subtract the fractions.", "C. Show the steps to multiply the fractions.", "D. Divide the fractions."], "answer": "C", "time_stamp_s": 149, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [140, 170], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_219_a2062_q0", "video_id": 219, "time_stamp_s": 149, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8cc2a4f7f0810f1ee323f9c82986f5401dc91a48cd7edb4af85b73eb11531f83", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333], "recent_frames_sha256": "d586b400e4f02c30d58e49606fae327c502cbe7ade82c2a63aceaa97797814d3", "num_recent_frames": 30, "tq": 719231.162494475, "t1": 719238.326433088, "ta": 719238.326433088, "te": 719238.365138416, "first_response_s": 7.163938613026403, "answer_total_s": 7.2026439409237355, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_219_a2062_q0", "video_id": 219, "time_stamp_s": 149, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a2f6eb58a6ea7adf5b33b52e153a46692e0bf5f7faceed31cf903784a82b0351", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a beige t-shirt speaks against a blurred background of warm-toned rectangular panels, gesturing with his hands while text overlays appear (e.g., \"Fractions,\" \"Really\").\n- The scene transitions to an outdoor setting featuring a large red and blue circus tent with diamond patterns, where the man continues speaking and gesturing.\n- The video opens with a title sequence displaying \"Math Antics\" and \"Multiplying Fractions\" on a grid background, followed by the man appearing in a studio setting.\n[30-60s] - A man in a beige t-shirt stands against a warm-toned, abstract background, gesturing with his hands while speaking.\n- On-screen text appears sequentially: \"Multiplying Fractions,\" then \"Super Easy,\" followed by \"Multiplication × Division +,\" indicating a math tutorial theme.\n- A fraction multiplication problem (1/4 × 2/3) is displayed on a grid background, with a red arrow highlighting the numerator of the first fraction.\n[60-90s] - A man in a beige t-shirt stands against a grid background, gesturing toward a fraction multiplication problem displayed on screen.\n- The fraction problem 1/4 × 2/3 is shown, with visual emphasis on the numerators (1 and 2) and denominators (4 and 3) as they are multiplied separately.\n- The result 2/12 appears after multiplying numerators and denominators, with a yellow oval highlighting the final fraction.\n[90-120s] - A man in a beige shirt stands against a grid background, gesturing while explaining fraction multiplication.\n- The on-screen math problem changes from 1/4 × 2/3 to 2/3 × 4/5, with intermediate steps shown as 2×4 over 3×5.\n- The final answer is displayed as \"Answer Fraction\" with the equation 2/3 × 4/5 = —, followed by \"Multiply Top Numbers\" in green text.", "history_tokens": 425, "history_utf8_bytes": 1751, "recent_frame_times_s": [119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333], "recent_frames_sha256": "d586b400e4f02c30d58e49606fae327c502cbe7ade82c2a63aceaa97797814d3", "num_recent_frames": 30, "tq": 719315.836894493, "t1": 719317.803401794, "ta": 719317.803401794, "te": 719318.019391793, "first_response_s": 1.966507301083766, "answer_total_s": 2.1824972999747843, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 219, "content_group": "abcfb2648dc865cf030d04f75f7f5f0b778fe8620ed6619a0003b56e9c68c05f", "question": {"question_id": "sample_219_a2063_q0", "video_id": 219, "video_path": "./videos/sample_219_real.mp4", "annotation_index": 2063, "question_index": 0, "question": "What mathematical concept might the speaker move on to explain next?", "options": ["A. Addition of fractions.", "B. Subtraction of fractions.", "C. Simplifying fractions.", "D. Another explanation to fractions."], "answer": "D", "time_stamp_s": 231, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [210, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_219_a2063_q0", "video_id": 219, "time_stamp_s": 231, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6c85d5e4ee1fd20ece3c76fbfcf4c9075e196f42e70eb43c2c37de9104e1b78d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298], "recent_frames_sha256": "4851901a5feb0cc9ce057486981d99c5e56e53f9ff14a3d9c8dfc339f1936349", "num_recent_frames": 30, "tq": 719238.378224892, "t1": 719250.523404462, "ta": 719250.523404462, "te": 719250.561332177, "first_response_s": 12.145179570070468, "answer_total_s": 12.183107285061851, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_219_a2063_q0", "video_id": 219, "time_stamp_s": 231, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3159b6949d361edca9ad8e27925f11b09b9ea77605836ec6591b81ac23c57060", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a beige t-shirt speaks against a blurred background of warm-toned rectangular panels, gesturing with his hands while text overlays appear (e.g., \"Fractions,\" \"Really\").\n- The scene transitions to an outdoor setting featuring a large red and blue circus tent with diamond patterns, where the man continues speaking and gesturing.\n- The video opens with a title sequence displaying \"Math Antics\" and \"Multiplying Fractions\" on a grid background, followed by the man appearing in a studio setting.\n[30-60s] - A man in a beige t-shirt stands against a warm-toned, abstract background, gesturing with his hands while speaking.\n- On-screen text appears sequentially: \"Multiplying Fractions,\" then \"Super Easy,\" followed by \"Multiplication × Division +,\" indicating a math tutorial theme.\n- A fraction multiplication problem (1/4 × 2/3) is displayed on a grid background, with a red arrow highlighting the numerator of the first fraction.\n[60-90s] - A man in a beige t-shirt stands against a grid background, gesturing toward a fraction multiplication problem displayed on screen.\n- The fraction problem 1/4 × 2/3 is shown, with visual emphasis on the numerators (1 and 2) and denominators (4 and 3) as they are multiplied separately.\n- The result 2/12 appears after multiplying numerators and denominators, with a yellow oval highlighting the final fraction.\n[90-120s] - A man in a beige shirt stands against a grid background, gesturing while explaining fraction multiplication.\n- The on-screen math problem changes from 1/4 × 2/3 to 2/3 × 4/5, with intermediate steps shown as 2×4 over 3×5.\n- The final answer is displayed as \"Answer Fraction\" with the equation 2/3 × 4/5 = —, followed by \"Multiply Top Numbers\" in green text.\n[120-150s] - A fraction multiplication problem (2/3 × 4/5) is displayed with the top numbers (2 and 4) highlighted for multiplication.\n- The bottom numbers (3 and 5) are then highlighted for multiplication, resulting in 15.\n- A man in a beige shirt appears, standing in front of the grid background, with the final answer (8/15) displayed beside him.\n[150-180s] - A fraction multiplication problem is displayed: 6/11 × 7/8 = 42/88.\n- The numerator 42 and denominator 88 are highlighted in yellow, indicating simplification.\n- A man in a beige shirt appears, gesturing toward the equation as it is simplified.\n[180-210s] - Red arrows point to numerators 4 and 3, then 3 and 5, indicating multiplication steps.\n- Yellow oval highlights the numerator 4 and denominator 3, suggesting a simplification step.\n- Blue line appears under the equals sign, preparing for the result of the multiplication.", "history_tokens": 664, "history_utf8_bytes": 2647, "recent_frame_times_s": [201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298], "recent_frames_sha256": "4851901a5feb0cc9ce057486981d99c5e56e53f9ff14a3d9c8dfc339f1936349", "num_recent_frames": 30, "tq": 719341.850861142, "t1": 719344.300385304, "ta": 719344.300385304, "te": 719344.526554723, "first_response_s": 2.449524161987938, "answer_total_s": 2.6756935809971765, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 219, "content_group": "abcfb2648dc865cf030d04f75f7f5f0b778fe8620ed6619a0003b56e9c68c05f", "question": {"question_id": "sample_219_a2064_q0", "video_id": 219, "video_path": "./videos/sample_219_real.mp4", "annotation_index": 2064, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. How to add fractions.", "B. How to divide fractions.", "C. How to multiply the denominators.", "D. How to subtract fractions."], "answer": "C", "time_stamp_s": 310, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [280, 310], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_219_a2064_q0", "video_id": 219, "time_stamp_s": 310, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "30aca0914c34e685fb57c55296ba38563c4cc1966d84f3561eb83b4a1302cfec", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087], "recent_frames_sha256": "9f87f3fc3e39135cd3d5193f2c8773829c94d4505ad9637fa26a2172a6e357c4", "num_recent_frames": 30, "tq": 719250.571477625, "t1": 719262.167258453, "ta": 719262.167258453, "te": 719262.204726809, "first_response_s": 11.595780827919953, "answer_total_s": 11.633249184000306, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_219_a2064_q0", "video_id": 219, "time_stamp_s": 310, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "616e1a5d32acc546629055dd82e43169f4a597c923c12d5e6df7cf7579fe9655", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a beige t-shirt speaks against a blurred background of warm-toned rectangular panels, gesturing with his hands while text overlays appear (e.g., \"Fractions,\" \"Really\").\n- The scene transitions to an outdoor setting featuring a large red and blue circus tent with diamond patterns, where the man continues speaking and gesturing.\n- The video opens with a title sequence displaying \"Math Antics\" and \"Multiplying Fractions\" on a grid background, followed by the man appearing in a studio setting.\n[30-60s] - A man in a beige t-shirt stands against a warm-toned, abstract background, gesturing with his hands while speaking.\n- On-screen text appears sequentially: \"Multiplying Fractions,\" then \"Super Easy,\" followed by \"Multiplication × Division +,\" indicating a math tutorial theme.\n- A fraction multiplication problem (1/4 × 2/3) is displayed on a grid background, with a red arrow highlighting the numerator of the first fraction.\n[60-90s] - A man in a beige t-shirt stands against a grid background, gesturing toward a fraction multiplication problem displayed on screen.\n- The fraction problem 1/4 × 2/3 is shown, with visual emphasis on the numerators (1 and 2) and denominators (4 and 3) as they are multiplied separately.\n- The result 2/12 appears after multiplying numerators and denominators, with a yellow oval highlighting the final fraction.\n[90-120s] - A man in a beige shirt stands against a grid background, gesturing while explaining fraction multiplication.\n- The on-screen math problem changes from 1/4 × 2/3 to 2/3 × 4/5, with intermediate steps shown as 2×4 over 3×5.\n- The final answer is displayed as \"Answer Fraction\" with the equation 2/3 × 4/5 = —, followed by \"Multiply Top Numbers\" in green text.\n[120-150s] - A fraction multiplication problem (2/3 × 4/5) is displayed with the top numbers (2 and 4) highlighted for multiplication.\n- The bottom numbers (3 and 5) are then highlighted for multiplication, resulting in 15.\n- A man in a beige shirt appears, standing in front of the grid background, with the final answer (8/15) displayed beside him.\n[150-180s] - A fraction multiplication problem is displayed: 6/11 × 7/8 = 42/88.\n- The numerator 42 and denominator 88 are highlighted in yellow, indicating simplification.\n- A man in a beige shirt appears, gesturing toward the equation as it is simplified.\n[180-210s] - Red arrows point to numerators 4 and 3, then 3 and 5, indicating multiplication steps.\n- Yellow oval highlights the numerator 4 and denominator 3, suggesting a simplification step.\n- Blue line appears under the equals sign, preparing for the result of the multiplication.\n[210-240s] - A fraction multiplication problem (1/2 × 4/3 × 3/5) is displayed with intermediate steps showing 12/30, then simplified to 12/30.\n- A man in a beige t-shirt appears, speaking against a background of warm-toned horizontal blocks.\n- A pizza image appears to the left of the man, followed by a multiplication symbol and the fraction 1/2, then disappears.\n[240-270s] - A man in a beige t-shirt stands against a blurred orange and brown background, speaking to the camera.\n- Text appears on screen: \"Multiplying Fractions\" and \"Part of another Part.\"\n- A pizza graphic appears on the left side of the screen, with fractions and multiplication symbols displayed alongside it.\n[270-300s] - A man in a beige t-shirt stands against a grid background, explaining math concepts.  \n- Text appears on screen: \"Word or Story Problems\" followed by \"What is 3/4 of 2/3\" and the multiplication symbol.  \n- The scene transitions to a darker background with text \"Division Problems\" and \"Parts of Something\" as the man continues speaking.", "history_tokens": 927, "history_utf8_bytes": 3682, "recent_frame_times_s": [280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087], "recent_frames_sha256": "9f87f3fc3e39135cd3d5193f2c8773829c94d4505ad9637fa26a2172a6e357c4", "num_recent_frames": 30, "tq": 719368.851651242, "t1": 719370.151655767, "ta": 719370.151655767, "te": 719370.342457786, "first_response_s": 1.3000045249937102, "answer_total_s": 1.4908065439667553, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 220, "content_group": "d8a71893e326a11ab2ae4e4e7705c0eb8eee21e2b0c0b4ec0e3ae3900273b29b", "question": {"question_id": "sample_220_a1373_q0", "video_id": 220, "video_path": "./videos/sample_220_real.mp4", "annotation_index": 1373, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. Basic addition and subtraction.", "B. Algebraic expressions.", "C. Properties of equality.", "D. The order of operations rules."], "answer": "D", "time_stamp_s": 23, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_220_a1373_q0", "video_id": 220, "time_stamp_s": 23, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f01628eb643e65aa30abc72a8d74b5d47c508485381b28bf4fbbd179773c8a38", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019, 20.02, 21.021, 22.022], "recent_frames_sha256": "6dd66f97895e2d0107e036630540b6bd8013d3887b14973a367b448305cbaed6", "num_recent_frames": 23, "tq": 710667.701702562, "t1": 710673.915928837, "ta": 710673.915928837, "te": 710673.955144285, "first_response_s": 6.214226274983957, "answer_total_s": 6.253441722947173, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_220_a1373_q0", "video_id": 220, "time_stamp_s": 23, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "73476a095d9880fd30eaf945cdd6b884e4cd6896b24338a544badbb25a920091", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019, 20.02, 21.021, 22.022], "recent_frames_sha256": "6dd66f97895e2d0107e036630540b6bd8013d3887b14973a367b448305cbaed6", "num_recent_frames": 23, "tq": 710720.628783029, "t1": 710731.673352597, "ta": 710731.673352597, "te": 710731.858731501, "first_response_s": 11.044569568010047, "answer_total_s": 11.229948471998796, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 220, "content_group": "d8a71893e326a11ab2ae4e4e7705c0eb8eee21e2b0c0b4ec0e3ae3900273b29b", "question": {"question_id": "sample_220_a1374_q0", "video_id": 220, "video_path": "./videos/sample_220_real.mp4", "annotation_index": 1374, "question_index": 0, "question": "What might be the next topic the speaker will address?", "options": ["A. The order of operations for addition and subtraction.", "B. The highest priority operator symbols.", "C. The importance of following the PEMDAS rule.", "D. Practice problems involving exponents."], "answer": "B", "time_stamp_s": 148, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [119, 149], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_220_a1374_q0", "video_id": 220, "time_stamp_s": 148, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4ea0bf21d7d1744983316a25cf3784640f7fcefcdf5bef9713ff330da0915160", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333], "recent_frames_sha256": "8143a4979e4b3af920e4541c761868bef437d7b86c8197ae0fcf0b336d2cb517", "num_recent_frames": 30, "tq": 710673.984796967, "t1": 710686.96136153, "ta": 710686.96136153, "te": 710687.004103436, "first_response_s": 12.976564562995918, "answer_total_s": 13.01930646901019, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_220_a1374_q0", "video_id": 220, "time_stamp_s": 148, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "76b8757455f6ae69741a6a7cd096977581b7cfa2b997bc99a36bb68674ce4852", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a beige t-shirt stands against a purple grid background, speaking to the camera.  \n- Text overlays appear sequentially: \"Order of Operations,\" \"Math Rules,\" and \"Why? Why? Why?\" floating around him.  \n- The man gestures with his hands while explaining, with symbols (×, +) appearing near \"Math Rules\" to indicate operations.\n[30-60s] - Two men stand side-by-side against a purple grid background, each wearing a different colored t-shirt (blue and orange), facing the camera.  \n- The math problem \"2+5×4\" appears on screen above them, with the left man gesturing as if explaining or solving it.  \n- The left man's expression shifts from thoughtful to confident as he calculates, while the right man remains passive, observing.\n[60-90s] - Man in blue shirt looks down, then up, while man in orange shirt gestures with hand.\n- Scoreboard displays \"28\" and \"22\" above each man's head.\n- Man in orange shirt smiles and looks at the other man, then at the camera.\n[90-120s] - Man in beige shirt speaks against purple grid background, gesturing with hands.\n- Text overlays appear sequentially: \"No Mistakes,\" \"Different Answers Same Problem,\" \"Order of Operations Agree,\" and \"Same Order.\"\n- Two framed portraits (one with 28, one with 22) are visible on either side of the man, then disappear as text overlays appear.", "history_tokens": 327, "history_utf8_bytes": 1333, "recent_frame_times_s": [118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333], "recent_frames_sha256": "8143a4979e4b3af920e4541c761868bef437d7b86c8197ae0fcf0b336d2cb517", "num_recent_frames": 30, "tq": 710764.607248812, "t1": 710765.663323004, "ta": 710765.663323004, "te": 710765.882755424, "first_response_s": 1.0560741920489818, "answer_total_s": 1.275506612029858, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 220, "content_group": "d8a71893e326a11ab2ae4e4e7705c0eb8eee21e2b0c0b4ec0e3ae3900273b29b", "question": {"question_id": "sample_220_a1375_q0", "video_id": 220, "video_path": "./videos/sample_220_real.mp4", "annotation_index": 1375, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. Simplify the expression.", "B. Subtract the results.", "C. Add the simplified terms.", "D. Multiply the results."], "answer": "C", "time_stamp_s": 268, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [238, 268], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_220_a1375_q0", "video_id": 220, "time_stamp_s": 268, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8b61ccd0b577f7ded8c8580e6c2e3e0a3d85462ed2e9160d47339fe7ae20a11a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667], "recent_frames_sha256": "d9b33ac79eaa73f298c4472d00ee6eecc500da4860251c017b0ac4f5577a1f81", "num_recent_frames": 30, "tq": 710687.014626465, "t1": 710698.326547559, "ta": 710698.326547559, "te": 710698.36464347, "first_response_s": 11.311921093962155, "answer_total_s": 11.350017004995607, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_220_a1375_q0", "video_id": 220, "time_stamp_s": 268, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "071297f206848b6691c4b234f95e82f381a30f1d4695b33382ec0298604de435", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a beige t-shirt stands against a purple grid background, speaking to the camera.  \n- Text overlays appear sequentially: \"Order of Operations,\" \"Math Rules,\" and \"Why? Why? Why?\" floating around him.  \n- The man gestures with his hands while explaining, with symbols (×, +) appearing near \"Math Rules\" to indicate operations.\n[30-60s] - Two men stand side-by-side against a purple grid background, each wearing a different colored t-shirt (blue and orange), facing the camera.  \n- The math problem \"2+5×4\" appears on screen above them, with the left man gesturing as if explaining or solving it.  \n- The left man's expression shifts from thoughtful to confident as he calculates, while the right man remains passive, observing.\n[60-90s] - Man in blue shirt looks down, then up, while man in orange shirt gestures with hand.\n- Scoreboard displays \"28\" and \"22\" above each man's head.\n- Man in orange shirt smiles and looks at the other man, then at the camera.\n[90-120s] - Man in beige shirt speaks against purple grid background, gesturing with hands.\n- Text overlays appear sequentially: \"No Mistakes,\" \"Different Answers Same Problem,\" \"Order of Operations Agree,\" and \"Same Order.\"\n- Two framed portraits (one with 28, one with 22) are visible on either side of the man, then disappear as text overlays appear.\n[120-150s] - A man in a beige t-shirt stands against a purple grid background, gesturing while speaking.\n- Text overlays appear sequentially: \"Why\" (green), then \"4\" (blue), followed by a list of PEMDAS steps on a grid background.\n- The man reappears with the full PEMDAS list displayed, then exits as the text remains on screen.\n[150-180s] - A man in a brown shirt stands against a grid background, gesturing as text appears beside him.  \n- Parentheses ( ) appear on screen, followed by the expression (2+4) with a red \"Group\" label beneath it.  \n- Brackets [ ] then appear, enclosing the same expression (2+4), with a red arrow pointing to it.\n[180-210s] - Man gestures while explaining parentheses and brackets as grouping symbols.  \n- On-screen text highlights \"group\" under parentheses and brackets.  \n- Expression \"10 × (4 + 5)\" appears with arrows indicating multiplication and addition operations.\n[210-240s] - The expression \"10 × (4 + 5)\" is displayed with a red circle highlighting the parentheses.\n- A red arrow points downward from the parentheses to the number \"9\" below.\n- The number \"9\" is then replaced by \"10 × 9\", and the result \"90\" appears below, circled in yellow.", "history_tokens": 640, "history_utf8_bytes": 2523, "recent_frame_times_s": [238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667], "recent_frames_sha256": "d9b33ac79eaa73f298c4472d00ee6eecc500da4860251c017b0ac4f5577a1f81", "num_recent_frames": 30, "tq": 715187.003703966, "t1": 715189.047552545, "ta": 715189.047552545, "te": 715189.091303915, "first_response_s": 2.0438485789345577, "answer_total_s": 2.087599948979914, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 220, "content_group": "d8a71893e326a11ab2ae4e4e7705c0eb8eee21e2b0c0b4ec0e3ae3900273b29b", "question": {"question_id": "sample_220_a1376_q0", "video_id": 220, "video_path": "./videos/sample_220_real.mp4", "annotation_index": 1376, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. How to integrate functions.", "B. The operator symbols for 'Then' and 'last' precedence.", "C. Application of quadratic equations.", "D. Solving basic arithmetic."], "answer": "B", "time_stamp_s": 386, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [357, 387], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_220_a1376_q0", "video_id": 220, "time_stamp_s": 386, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "067f36ca8c8113f7e1ae8d2ba29121bfa3fe669940e6503b42b5da856f9b3c1a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.0169666666667, 385.01796666666667], "recent_frames_sha256": "bd8936ef0c63594aac51007a9246742c2450d7c819875bfdede16fc02d6d3af3", "num_recent_frames": 30, "tq": 710698.387957218, "t1": 710709.585623714, "ta": 710709.585623714, "te": 710709.627529468, "first_response_s": 11.197666496038437, "answer_total_s": 11.239572250051424, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_220_a1376_q0", "video_id": 220, "time_stamp_s": 386, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f60188fb65072993e4f337e4099b21a6594eadd1d0f90d6abe336d4a5e541994", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a beige t-shirt stands against a purple grid background, speaking to the camera.  \n- Text overlays appear sequentially: \"Order of Operations,\" \"Math Rules,\" and \"Why? Why? Why?\" floating around him.  \n- The man gestures with his hands while explaining, with symbols (×, +) appearing near \"Math Rules\" to indicate operations.\n[30-60s] - Two men stand side-by-side against a purple grid background, each wearing a different colored t-shirt (blue and orange), facing the camera.  \n- The math problem \"2+5×4\" appears on screen above them, with the left man gesturing as if explaining or solving it.  \n- The left man's expression shifts from thoughtful to confident as he calculates, while the right man remains passive, observing.\n[60-90s] - Man in blue shirt looks down, then up, while man in orange shirt gestures with hand.\n- Scoreboard displays \"28\" and \"22\" above each man's head.\n- Man in orange shirt smiles and looks at the other man, then at the camera.\n[90-120s] - Man in beige shirt speaks against purple grid background, gesturing with hands.\n- Text overlays appear sequentially: \"No Mistakes,\" \"Different Answers Same Problem,\" \"Order of Operations Agree,\" and \"Same Order.\"\n- Two framed portraits (one with 28, one with 22) are visible on either side of the man, then disappear as text overlays appear.\n[120-150s] - A man in a beige t-shirt stands against a purple grid background, gesturing while speaking.\n- Text overlays appear sequentially: \"Why\" (green), then \"4\" (blue), followed by a list of PEMDAS steps on a grid background.\n- The man reappears with the full PEMDAS list displayed, then exits as the text remains on screen.\n[150-180s] - A man in a brown shirt stands against a grid background, gesturing as text appears beside him.  \n- Parentheses ( ) appear on screen, followed by the expression (2+4) with a red \"Group\" label beneath it.  \n- Brackets [ ] then appear, enclosing the same expression (2+4), with a red arrow pointing to it.\n[180-210s] - Man gestures while explaining parentheses and brackets as grouping symbols.  \n- On-screen text highlights \"group\" under parentheses and brackets.  \n- Expression \"10 × (4 + 5)\" appears with arrows indicating multiplication and addition operations.\n[210-240s] - The expression \"10 × (4 + 5)\" is displayed with a red circle highlighting the parentheses.\n- A red arrow points downward from the parentheses to the number \"9\" below.\n- The number \"9\" is then replaced by \"10 × 9\", and the result \"90\" appears below, circled in yellow.\n[240-270s] - Mathematical expression (5-3)+(6×2) displayed with red arrows pointing to each group.  \n- Text \"Before\" appears below the expression, followed by \"simplify\" in yellow.  \n- Numbers \"2\" and \"12\" appear beneath the respective groups after simplification.\n[270-300s] - Mathematical expression (5-3)+(6×2) is displayed with intermediate steps showing 2 + 12 and final result 14.\n- Text \"First: Parentheses and Brackets\" appears, followed by \"Next: Exponents\" as instructional headings.\n- \"Exponents\" text is shown with \"repeated multiplication\" below, illustrating 4×4 → 4² and 4×4×4 → 4³.\n[300-330s] - The text \"repeated multiplication\" is displayed at the top of the screen.  \n- Arrows point from repeated multiplication expressions (4×4, 4×4×4) to their exponential forms (4², 4³).  \n- The exponent \"2\" is highlighted with a red arrow and labeled \"exponent or power\" in red text.\n[330-360s] - The expression \"3 × 5²\" is displayed with a red arrow pointing to the exponent \"2\" and another to the multiplication symbol, indicating the order of operations.\n- The number \"25\" appears below \"3 × 5²\", showing the result of 5².\n- The word \"then\" appears in red text, followed by \"3 × 25\", suggesting the next step in the calculation.", "history_tokens": 997, "history_utf8_bytes": 3784, "recent_frame_times_s": [356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.0169666666667, 385.01796666666667], "recent_frames_sha256": "bd8936ef0c63594aac51007a9246742c2450d7c819875bfdede16fc02d6d3af3", "num_recent_frames": 30, "tq": 715216.389478837, "t1": 715223.732193409, "ta": 715223.732193409, "te": 715223.884785692, "first_response_s": 7.342714571976103, "answer_total_s": 7.495306854951195, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 220, "content_group": "d8a71893e326a11ab2ae4e4e7705c0eb8eee21e2b0c0b4ec0e3ae3900273b29b", "question": {"question_id": "sample_220_a1377_q0", "video_id": 220, "video_path": "./videos/sample_220_real.mp4", "annotation_index": 1377, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. The importance of parentheses in operations.", "B. The commutative property of multiplication.", "C. How to handle exponents in an equation.", "D. The order of operations between the multiplication sign and the division sign."], "answer": "D", "time_stamp_s": 487, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [476, 506], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_220_a1377_q0", "video_id": 220, "time_stamp_s": 487, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3ab84a7aee4d2ae73431dbc8093850e60f06d6f0573fd08b1e3a0b448079c572", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [457.02323333333334, 458.0242333333333, 459.02523333333335, 460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667], "recent_frames_sha256": "5e245e8da18041fff3eb9950b42ca5d090c9b446daca791d1e0fefd49f24c6fa", "num_recent_frames": 30, "tq": 710709.64732591, "t1": 710720.57827857, "ta": 710720.57827857, "te": 710720.615633766, "first_response_s": 10.930952659924515, "answer_total_s": 10.968307856004685, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_220_a1377_q0", "video_id": 220, "time_stamp_s": 487, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "53868f0ae7d0cbee1c9aab503f9793266f351f38941420ea87ae03231ebff6f5", "condition_order": ["recent", "notes"], "memory": "[150-180s] - A man in a brown shirt stands against a grid background, gesturing as text appears beside him.  \n- Parentheses ( ) appear on screen, followed by the expression (2+4) with a red \"Group\" label beneath it.  \n- Brackets [ ] then appear, enclosing the same expression (2+4), with a red arrow pointing to it.\n[180-210s] - Man gestures while explaining parentheses and brackets as grouping symbols.  \n- On-screen text highlights \"group\" under parentheses and brackets.  \n- Expression \"10 × (4 + 5)\" appears with arrows indicating multiplication and addition operations.\n[210-240s] - The expression \"10 × (4 + 5)\" is displayed with a red circle highlighting the parentheses.\n- A red arrow points downward from the parentheses to the number \"9\" below.\n- The number \"9\" is then replaced by \"10 × 9\", and the result \"90\" appears below, circled in yellow.\n[240-270s] - Mathematical expression (5-3)+(6×2) displayed with red arrows pointing to each group.  \n- Text \"Before\" appears below the expression, followed by \"simplify\" in yellow.  \n- Numbers \"2\" and \"12\" appear beneath the respective groups after simplification.\n[270-300s] - Mathematical expression (5-3)+(6×2) is displayed with intermediate steps showing 2 + 12 and final result 14.\n- Text \"First: Parentheses and Brackets\" appears, followed by \"Next: Exponents\" as instructional headings.\n- \"Exponents\" text is shown with \"repeated multiplication\" below, illustrating 4×4 → 4² and 4×4×4 → 4³.\n[300-330s] - The text \"repeated multiplication\" is displayed at the top of the screen.  \n- Arrows point from repeated multiplication expressions (4×4, 4×4×4) to their exponential forms (4², 4³).  \n- The exponent \"2\" is highlighted with a red arrow and labeled \"exponent or power\" in red text.\n[330-360s] - The expression \"3 × 5²\" is displayed with a red arrow pointing to the exponent \"2\" and another to the multiplication symbol, indicating the order of operations.\n- The number \"25\" appears below \"3 × 5²\", showing the result of 5².\n- The word \"then\" appears in red text, followed by \"3 × 25\", suggesting the next step in the calculation.\n[360-390s] - A man in a brown shirt stands in front of a grid background, explaining a math problem.\n- The math problem displayed is (3² × 4) + 6, with the exponent 3² highlighted in yellow.\n- The solution steps show 3² calculated as 9, then multiplied by 4 to get 36, and finally adding 6 to get 42.\n[390-420s] - Text overlay changes from \"Then: Multiplication and Division\" to \"Then: Multiplication and Division\" with \"Last: Addition and Subtraction\" highlighted in yellow.  \n- A man in a brown shirt stands against a grid background, gesturing while speaking.  \n- The expression \"2+5×4\" appears on screen, with an arrow pointing to the \"×\" symbol.\n[420-450s] - A man in a brown shirt stands in front of a grid background, explaining math problems.  \n- The screen displays \"Then: Multiplication and Division\" and \"Last: Addition and Subtraction\" with the equation \"3 × 5 - 1\" appearing.  \n- The equation is solved step-by-step, showing \"3 × 5 = 15\" followed by \"15 - 1 = 14\".\n[450-480s] - Text \"Then: Multiplication and Division\" and \"Last: Addition and Subtraction\" remain static on the grid background.  \n- Expression \"20 - 10 ÷ 5\" appears, with \"10 ÷ 5\" highlighted in blue, then replaced by \"2\" as the division result.  \n- Subtraction \"20 - 2\" appears below, followed by \"18\" as the final result.", "history_tokens": 966, "history_utf8_bytes": 3433, "recent_frame_times_s": [457.02323333333334, 458.0242333333333, 459.02523333333335, 460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667], "recent_frames_sha256": "5e245e8da18041fff3eb9950b42ca5d090c9b446daca791d1e0fefd49f24c6fa", "num_recent_frames": 30, "tq": 715246.022708314, "t1": 715247.199529736, "ta": 715247.199529736, "te": 715247.392849093, "first_response_s": 1.1768214219482616, "answer_total_s": 1.370140778948553, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 221, "content_group": "27656cc8a71f9b6cca3008054ca4a7ce738c0d55b2957eedb4dd0cb0d2466331", "question": {"question_id": "sample_221_a10_q0", "video_id": 221, "video_path": "./videos/sample_221_real.mp4", "annotation_index": 10, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. The area of different shapes.", "B. How to measure the diameter.", "C. The concept of length in 2-dimensional shapes.", "D. How to calculate perimeter."], "answer": "D", "time_stamp_s": 11, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_221_a10_q0", "video_id": 221, "time_stamp_s": 11, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9e55aa1a21609f648a46c9373bf69b7ed4318d64aceb55781c7393956bd35831", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01], "recent_frames_sha256": "654638a61fe3b01250abfceabad103867c330ea286d86d717917c3f6185a1a80", "num_recent_frames": 11, "tq": 716463.361765446, "t1": 716464.137611179, "ta": 716464.137611179, "te": 716464.174809379, "first_response_s": 0.7758457330055535, "answer_total_s": 0.8130439330125228, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_221_a10_q0", "video_id": 221, "time_stamp_s": 11, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7532317a389455683a9fbc1b2891a2fed12469bba99150afda6dc09b49aca85a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01], "recent_frames_sha256": "654638a61fe3b01250abfceabad103867c330ea286d86d717917c3f6185a1a80", "num_recent_frames": 11, "tq": 716321.181467256, "t1": 716327.050103108, "ta": 716327.050103108, "te": 716327.087847047, "first_response_s": 5.868635852006264, "answer_total_s": 5.906379790976644, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 221, "content_group": "27656cc8a71f9b6cca3008054ca4a7ce738c0d55b2957eedb4dd0cb0d2466331", "question": {"question_id": "sample_221_a11_q0", "video_id": 221, "video_path": "./videos/sample_221_real.mp4", "annotation_index": 11, "question_index": 0, "question": "What will the speaker most likely explain next?", "options": ["A. How to calculate the perimeter of the shape.", "B. How to convert meters into centimeters.", "C. The differences between perimeter and area.", "D. How to measure the perimeter accurately."], "answer": "A", "time_stamp_s": 133, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [92, 122], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_221_a11_q0", "video_id": 221, "time_stamp_s": 133, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dd8db8118c0c5a9d96dad8ef57a5d9e04a736956482eff742da59fd68c1860bd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319], "recent_frames_sha256": "249a523c88e0099a179552834d9dd6734501608a080221c18f88bbfd61a9ddba", "num_recent_frames": 30, "tq": 716464.192447464, "t1": 716475.857660989, "ta": 716475.857660989, "te": 716475.895084649, "first_response_s": 11.665213525062427, "answer_total_s": 11.702637184993364, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_221_a11_q0", "video_id": 221, "time_stamp_s": 133, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8a54775a20be38028846a72bd3775443407044b18997168953998ac8b1bef733", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a blue water ripple background, speaking to the camera.  \n- The word \"Perimeter\" appears on screen, followed by its definition: \"distance around a shape.\"  \n- Text overlays define \"Distance or length\" as \"1 dimensional,\" appearing sequentially as the man continues speaking.\n[30-60s] - Text \"Perimeter\" appears in yellow, followed by \"1 dimensional cm in mi\" in orange, then disappears.\n- A square graphic appears with \"10 cm\" below it, then \"25 mi\" appears below \"10 cm\".\n- The presenter gestures toward the square and text as they appear.\n[60-90s] - A yellow, wavy line appears around a black square, with the text \"around a shape\" displayed above it.  \n- The man in the \"math Antics\" shirt stands to the right, gesturing toward the graphic.  \n- The background remains a light blue grid pattern throughout the segment.\n[90-120s] - A red line traces the outer boundary of a parallelogram, with a green \"Total:\" label above it.  \n- Two stick figures walk along the red line, starting from the left and moving rightward, indicating the perimeter's length.  \n- At 1:40, the parallelogram's sides are labeled with \"10 m\" values, and the total perimeter is displayed as \"50 m\".", "history_tokens": 318, "history_utf8_bytes": 1237, "recent_frame_times_s": [103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319], "recent_frames_sha256": "249a523c88e0099a179552834d9dd6734501608a080221c18f88bbfd61a9ddba", "num_recent_frames": 30, "tq": 716362.990742709, "t1": 716369.226643196, "ta": 716369.226643196, "te": 716369.268492929, "first_response_s": 6.235900486935861, "answer_total_s": 6.27775022003334, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 221, "content_group": "27656cc8a71f9b6cca3008054ca4a7ce738c0d55b2957eedb4dd0cb0d2466331", "question": {"question_id": "sample_221_a12_q0", "video_id": 221, "video_path": "./videos/sample_221_real.mp4", "annotation_index": 12, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to calculate the area of the rectangle.", "B. How to find the perimeter of a rectangle.", "C. How to label the units.", "D. How to measure with a ruler."], "answer": "B", "time_stamp_s": 213, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [184, 214], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_221_a12_q0", "video_id": 221, "time_stamp_s": 213, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b8261809ca25fd3df1a21e6334a0428ed0ac5b27f94ad5127d9afdd482fca09a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118], "recent_frames_sha256": "0d0c2d98d094c02d706f01ffb885468f553afabf145342b04190a54c66c9c03b", "num_recent_frames": 30, "tq": 716475.909162973, "t1": 716488.263467247, "ta": 716488.263467247, "te": 716488.299883432, "first_response_s": 12.354304273962043, "answer_total_s": 12.390720458934084, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_221_a12_q0", "video_id": 221, "time_stamp_s": 213, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "be483d7131d497e152928b25c562c216be1831549369af55b41dc0bc1f9430ed", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a blue water ripple background, speaking to the camera.  \n- The word \"Perimeter\" appears on screen, followed by its definition: \"distance around a shape.\"  \n- Text overlays define \"Distance or length\" as \"1 dimensional,\" appearing sequentially as the man continues speaking.\n[30-60s] - Text \"Perimeter\" appears in yellow, followed by \"1 dimensional cm in mi\" in orange, then disappears.\n- A square graphic appears with \"10 cm\" below it, then \"25 mi\" appears below \"10 cm\".\n- The presenter gestures toward the square and text as they appear.\n[60-90s] - A yellow, wavy line appears around a black square, with the text \"around a shape\" displayed above it.  \n- The man in the \"math Antics\" shirt stands to the right, gesturing toward the graphic.  \n- The background remains a light blue grid pattern throughout the segment.\n[90-120s] - A red line traces the outer boundary of a parallelogram, with a green \"Total:\" label above it.  \n- Two stick figures walk along the red line, starting from the left and moving rightward, indicating the perimeter's length.  \n- At 1:40, the parallelogram's sides are labeled with \"10 m\" values, and the total perimeter is displayed as \"50 m\".\n[120-150s] - A yellow ruler labeled \"Perimeter\" is displayed on a grid background, with the text \"1 Dimensional\" appearing below it.  \n- The ruler transitions to a 2D square graphic, with the text \"1 Dimensional\" still visible, indicating a shift in dimensionality.  \n- A man in a \"math Antics\" shirt appears, standing next to the 2D square, with a red arrow pointing to it and a question mark appearing beside it.\n[150-180s] - A blue circle and red heart appear on a grid background, with a red arrow pointing from the circle to the heart.  \n- The scene transitions to show four polygons (octagon, square, pentagon, star) under the label \"Polygons,\" with a yellow arrow pointing to the square.  \n- A yellow diamond with \"Add 5\" appears over the square, indicating a mathematical operation.\n[180-210s] - A right triangle with labeled sides: 3 cm, 4 cm, and 5 cm appears on a grid background.\n- The sum \"3 + 4 + 5 = 12\" is displayed below the triangle, followed by \"12 cm\" with a red arrow pointing to \"cm\".\n- The word \"Units\" appears to the right of the arrow, indicating the unit of measurement for the perimeter.", "history_tokens": 614, "history_utf8_bytes": 2352, "recent_frame_times_s": [183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118], "recent_frames_sha256": "0d0c2d98d094c02d706f01ffb885468f553afabf145342b04190a54c66c9c03b", "num_recent_frames": 30, "tq": 716393.736473142, "t1": 716394.427977422, "ta": 716394.427977422, "te": 716394.613918452, "first_response_s": 0.6915042799664661, "answer_total_s": 0.8774453100049868, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 221, "content_group": "27656cc8a71f9b6cca3008054ca4a7ce738c0d55b2957eedb4dd0cb0d2466331", "question": {"question_id": "sample_221_a13_q0", "video_id": 221, "video_path": "./videos/sample_221_real.mp4", "annotation_index": 13, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. How to calculate the perimeter of any regular polygon.", "B. The significance of repeated addition.", "C. The properties of regular polygons.", "D. The importance of perimeter in geometry."], "answer": "A", "time_stamp_s": 306, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [276, 306], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_221_a13_q0", "video_id": 221, "time_stamp_s": 306, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7e179fe142415af98d50480ef4ca0f37b6f1c5c64f43c6bbd27fecb0bf17b187", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047], "recent_frames_sha256": "0564c99907c7853f73ad0add7b08fc70c8c65369930c270a9892a71a2a137fe7", "num_recent_frames": 30, "tq": 716488.311654489, "t1": 716500.770367662, "ta": 716500.770367662, "te": 716500.807983687, "first_response_s": 12.45871317293495, "answer_total_s": 12.496329198009335, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_221_a13_q0", "video_id": 221, "time_stamp_s": 306, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a67fca49d35ad501ae2fd9e7f448ee79c473b6aac663e59c90d45f7f83a3e21e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a blue water ripple background, speaking to the camera.  \n- The word \"Perimeter\" appears on screen, followed by its definition: \"distance around a shape.\"  \n- Text overlays define \"Distance or length\" as \"1 dimensional,\" appearing sequentially as the man continues speaking.\n[30-60s] - Text \"Perimeter\" appears in yellow, followed by \"1 dimensional cm in mi\" in orange, then disappears.\n- A square graphic appears with \"10 cm\" below it, then \"25 mi\" appears below \"10 cm\".\n- The presenter gestures toward the square and text as they appear.\n[60-90s] - A yellow, wavy line appears around a black square, with the text \"around a shape\" displayed above it.  \n- The man in the \"math Antics\" shirt stands to the right, gesturing toward the graphic.  \n- The background remains a light blue grid pattern throughout the segment.\n[90-120s] - A red line traces the outer boundary of a parallelogram, with a green \"Total:\" label above it.  \n- Two stick figures walk along the red line, starting from the left and moving rightward, indicating the perimeter's length.  \n- At 1:40, the parallelogram's sides are labeled with \"10 m\" values, and the total perimeter is displayed as \"50 m\".\n[120-150s] - A yellow ruler labeled \"Perimeter\" is displayed on a grid background, with the text \"1 Dimensional\" appearing below it.  \n- The ruler transitions to a 2D square graphic, with the text \"1 Dimensional\" still visible, indicating a shift in dimensionality.  \n- A man in a \"math Antics\" shirt appears, standing next to the 2D square, with a red arrow pointing to it and a question mark appearing beside it.\n[150-180s] - A blue circle and red heart appear on a grid background, with a red arrow pointing from the circle to the heart.  \n- The scene transitions to show four polygons (octagon, square, pentagon, star) under the label \"Polygons,\" with a yellow arrow pointing to the square.  \n- A yellow diamond with \"Add 5\" appears over the square, indicating a mathematical operation.\n[180-210s] - A right triangle with labeled sides: 3 cm, 4 cm, and 5 cm appears on a grid background.\n- The sum \"3 + 4 + 5 = 12\" is displayed below the triangle, followed by \"12 cm\" with a red arrow pointing to \"cm\".\n- The word \"Units\" appears to the right of the arrow, indicating the unit of measurement for the perimeter.\n[210-240s] - A man in a white \"Math Antics\" t-shirt stands beside a grid background with a shaded rectangle labeled 10m by 5m.  \n- Yellow circles highlight the 5m labels on the left and right sides of the rectangle, then the 10m label at the bottom.  \n- Text appears below: \"5+5=10\" and \"10+10=20\", with red arrows pointing to the respective sides of the rectangle.\n[240-270s] - A yellow-outlined rectangle with dimensions 10m by 5m is displayed on a grid background.  \n- Mathematical equations (5+5=10, 10+10=20, 10+20=30) appear sequentially below the rectangle.  \n- A man in a \"Math Antics\" t-shirt appears, gesturing toward the equations and rectangle.\n[270-300s] - A blue hexagon with all sides labeled \"4 cm\" is displayed on a grid background.  \n- A man in a white \"Math Antics\" t-shirt appears, gesturing toward the hexagon.  \n- The text \"6 × 4 cm = 24\" appears on screen, followed by two men shaking hands, with \"24\" highlighted in a yellow circle.", "history_tokens": 908, "history_utf8_bytes": 3310, "recent_frame_times_s": [276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047], "recent_frames_sha256": "0564c99907c7853f73ad0add7b08fc70c8c65369930c270a9892a71a2a137fe7", "num_recent_frames": 30, "tq": 716428.048529655, "t1": 716434.790716855, "ta": 716434.790716855, "te": 716434.982734884, "first_response_s": 6.742187199997716, "answer_total_s": 6.934205229044892, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 221, "content_group": "27656cc8a71f9b6cca3008054ca4a7ce738c0d55b2957eedb4dd0cb0d2466331", "question": {"question_id": "sample_221_a14_q0", "video_id": 221, "video_path": "./videos/sample_221_real.mp4", "annotation_index": 14, "question_index": 0, "question": "What might the speaker ask the students to do next?", "options": ["A. Calculate the area of the shape.", "B. Determine the perimeter of the shape.", "C. Measure each side length.", "D. Convert the measurements to centimeters."], "answer": "B", "time_stamp_s": 392, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [368, 398], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_221_a14_q0", "video_id": 221, "time_stamp_s": 392, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e89a36191ab09fa811c64c9df507265490e188bbc9f44e8834a5f2da210f4eed", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.0169666666667, 385.01796666666667, 386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667], "recent_frames_sha256": "86483d153e055412270a631ced61b1d1ee0ead93d720c48a71912502a3b157f6", "num_recent_frames": 30, "tq": 716500.817225917, "t1": 716512.729243264, "ta": 716512.729243264, "te": 716512.766690474, "first_response_s": 11.912017346941866, "answer_total_s": 11.949464556993917, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_221_a14_q0", "video_id": 221, "time_stamp_s": 392, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1c0784a5ab5d62d4d003b6279b5905ce7ab0469b12567b4e44e2f8c7aaf34a8e", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A red line traces the outer boundary of a parallelogram, with a green \"Total:\" label above it.  \n- Two stick figures walk along the red line, starting from the left and moving rightward, indicating the perimeter's length.  \n- At 1:40, the parallelogram's sides are labeled with \"10 m\" values, and the total perimeter is displayed as \"50 m\".\n[120-150s] - A yellow ruler labeled \"Perimeter\" is displayed on a grid background, with the text \"1 Dimensional\" appearing below it.  \n- The ruler transitions to a 2D square graphic, with the text \"1 Dimensional\" still visible, indicating a shift in dimensionality.  \n- A man in a \"math Antics\" shirt appears, standing next to the 2D square, with a red arrow pointing to it and a question mark appearing beside it.\n[150-180s] - A blue circle and red heart appear on a grid background, with a red arrow pointing from the circle to the heart.  \n- The scene transitions to show four polygons (octagon, square, pentagon, star) under the label \"Polygons,\" with a yellow arrow pointing to the square.  \n- A yellow diamond with \"Add 5\" appears over the square, indicating a mathematical operation.\n[180-210s] - A right triangle with labeled sides: 3 cm, 4 cm, and 5 cm appears on a grid background.\n- The sum \"3 + 4 + 5 = 12\" is displayed below the triangle, followed by \"12 cm\" with a red arrow pointing to \"cm\".\n- The word \"Units\" appears to the right of the arrow, indicating the unit of measurement for the perimeter.\n[210-240s] - A man in a white \"Math Antics\" t-shirt stands beside a grid background with a shaded rectangle labeled 10m by 5m.  \n- Yellow circles highlight the 5m labels on the left and right sides of the rectangle, then the 10m label at the bottom.  \n- Text appears below: \"5+5=10\" and \"10+10=20\", with red arrows pointing to the respective sides of the rectangle.\n[240-270s] - A yellow-outlined rectangle with dimensions 10m by 5m is displayed on a grid background.  \n- Mathematical equations (5+5=10, 10+10=20, 10+20=30) appear sequentially below the rectangle.  \n- A man in a \"Math Antics\" t-shirt appears, gesturing toward the equations and rectangle.\n[270-300s] - A blue hexagon with all sides labeled \"4 cm\" is displayed on a grid background.  \n- A man in a white \"Math Antics\" t-shirt appears, gesturing toward the hexagon.  \n- The text \"6 × 4 cm = 24\" appears on screen, followed by two men shaking hands, with \"24\" highlighted in a yellow circle.\n[300-330s] - A man in a white \"Math Antics\" shirt stands against a grid background, gesturing as text appears beside him.  \n- Text overlays sequentially display \"Any Regular Polygon,\" then \"# of sides × length = Perimeter.\"  \n- A green irregular polygon with labeled sides (10 in, 4 in, 5 in, 6 in) appears, with \"6 sides\" text below it, followed by question marks indicating an upcoming calculation.\n[330-360s] - A green irregular polygon with labeled dimensions (10 in, 4 in, 5 in, 6 in) is displayed on a grid background.  \n- Red question marks appear at the top-left, bottom-left, and bottom-right corners of the polygon.  \n- A yellow dashed line is drawn horizontally across the polygon, dividing it into two sections.\n[360-390s] - The green L-shaped figure's left vertical side is labeled \"10 in\" and its bottom horizontal side is labeled \"10 in\" after being extended.\n- The right vertical side of the figure is labeled \"6 in\" and the bottom horizontal side is labeled \"15 in\" after being extended.\n- A dashed yellow line appears horizontally across the figure, indicating a division or measurement point.", "history_tokens": 963, "history_utf8_bytes": 3538, "recent_frame_times_s": [362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.0169666666667, 385.01796666666667, 386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667], "recent_frames_sha256": "86483d153e055412270a631ced61b1d1ee0ead93d720c48a71912502a3b157f6", "num_recent_frames": 30, "tq": 716462.130696544, "t1": 716463.120744707, "ta": 716463.120744707, "te": 716463.341943747, "first_response_s": 0.990048162988387, "answer_total_s": 1.2112472030567005, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 222, "content_group": "a07fd9e4af720641d44c6ce2582370fa046da798e1dfc41c846252717711060f", "question": {"question_id": "sample_222_a2228_q0", "video_id": 222, "video_path": "./videos/sample_222_real.mp4", "annotation_index": 2228, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to plot 25/50 on a graph.", "B. How to further simplify 1/2.", "C. How to simplify fractions.", "D. How to multiply fractions."], "answer": "C", "time_stamp_s": 13, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_222_a2228_q0", "video_id": 222, "time_stamp_s": 13, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2d81cc092600e468f2066d9c28e61a99775301a8dd278c12a746b2ff8f0088af", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012], "recent_frames_sha256": "c052c97183eb7c497172586570ef6e12da145b78300e477996d4b39bbbf2aa66", "num_recent_frames": 13, "tq": 715515.783317066, "t1": 715528.066299407, "ta": 715528.066299407, "te": 715528.10475253, "first_response_s": 12.282982341013849, "answer_total_s": 12.321435463964008, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_222_a2228_q0", "video_id": 222, "time_stamp_s": 13, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "60778b60c3b61e6ee7351e1661303a47ba5e7bd338598a93af86014503ca93b7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012], "recent_frames_sha256": "c052c97183eb7c497172586570ef6e12da145b78300e477996d4b39bbbf2aa66", "num_recent_frames": 13, "tq": 715575.773446649, "t1": 715581.921869431, "ta": 715581.921869431, "te": 715582.117701872, "first_response_s": 6.148422782076523, "answer_total_s": 6.34425522305537, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 222, "content_group": "a07fd9e4af720641d44c6ce2582370fa046da798e1dfc41c846252717711060f", "question": {"question_id": "sample_222_a2229_q0", "video_id": 222, "video_path": "./videos/sample_222_real.mp4", "annotation_index": 2229, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. Converting 1/2 to a decimal.", "B. Adding fractions with different denominators.", "C. Equivalent fractions of 3/6.", "D. Subtracting fractions with common denominators."], "answer": "C", "time_stamp_s": 84, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [105, 135], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_222_a2229_q0", "video_id": 222, "time_stamp_s": 84, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "569f23399c8e2f296035a637a8c310a56ebb4cbdc1a51c36f41a76a62d35f9a3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667], "recent_frames_sha256": "4fb548fab33ff1bb37add0db2f8d48e5d52d993f6bbd6f1cab39d2dc4d3b4bfe", "num_recent_frames": 30, "tq": 715528.116900581, "t1": 715539.888573112, "ta": 715539.888573112, "te": 715539.926731666, "first_response_s": 11.771672530914657, "answer_total_s": 11.809831084916368, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_222_a2229_q0", "video_id": 222, "time_stamp_s": 84, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d0c3fded740925c13884d63df234e7891a880240b22f7edecacc62c941b4f1a2", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a black t-shirt stands against a greenish-blue textured background, speaking while text overlays appear.  \n- The text \"Simplifying Fractions\" appears on screen, followed by \"Factoring\" and \"Simplify Fractions\" as the man continues speaking.  \n- A fraction \"25/50\" is shown with the simplified form \"1/2\" appearing beside it under the label \"Re Writing\".\n[30-60s] - A green and white rectangular bar appears, with the fraction 1/2 displayed below it.\n- The bar is then divided into six equal parts, with three parts shaded green, and the fraction 3/6 appears below.\n- The fraction 3/6 is simplified to 1/2, shown with an equals sign between them.", "history_tokens": 174, "history_utf8_bytes": 664, "recent_frame_times_s": [54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667], "recent_frames_sha256": "4fb548fab33ff1bb37add0db2f8d48e5d52d993f6bbd6f1cab39d2dc4d3b4bfe", "num_recent_frames": 30, "tq": 715604.289897395, "t1": 715612.399032491, "ta": 715612.399032491, "te": 715612.712896724, "first_response_s": 8.109135096077807, "answer_total_s": 8.422999329050072, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 222, "content_group": "a07fd9e4af720641d44c6ce2582370fa046da798e1dfc41c846252717711060f", "question": {"question_id": "sample_222_a2230_q0", "video_id": 222, "video_path": "./videos/sample_222_real.mp4", "annotation_index": 2230, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. Converting improper fractions to mixed numbers.", "B. Adding fractions with different denominators.", "C. Simplifying fractions by finding common factors.", "D. Multiplying fractions by whole numbers."], "answer": "C", "time_stamp_s": 153, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [210, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_222_a2230_q0", "video_id": 222, "time_stamp_s": 153, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "72c13e78e91cb62e2f4dd9ea4a7d2f88759c6931ee35af7558514aff8cfe6a5f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332], "recent_frames_sha256": "73d454e34101310b8ca49cfc026669099779443bb57271afe06771fb942d2234", "num_recent_frames": 30, "tq": 715539.940146448, "t1": 715552.096254854, "ta": 715552.096254854, "te": 715552.134361427, "first_response_s": 12.156108406023122, "answer_total_s": 12.194214979070239, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_222_a2230_q0", "video_id": 222, "time_stamp_s": 153, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8d57d11c29c86008547597b66a9597615f3e7e8760e4eb9960c9bd1dfa641d36", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a black t-shirt stands against a greenish-blue textured background, speaking while text overlays appear.  \n- The text \"Simplifying Fractions\" appears on screen, followed by \"Factoring\" and \"Simplify Fractions\" as the man continues speaking.  \n- A fraction \"25/50\" is shown with the simplified form \"1/2\" appearing beside it under the label \"Re Writing\".\n[30-60s] - A green and white rectangular bar appears, with the fraction 1/2 displayed below it.\n- The bar is then divided into six equal parts, with three parts shaded green, and the fraction 3/6 appears below.\n- The fraction 3/6 is simplified to 1/2, shown with an equals sign between them.\n[60-90s] - A man in a black shirt stands in front of a grid background, gesturing toward a fraction bar diagram showing 3/6.\n- The fraction 3/6 is visually simplified to 1/2, with a green bar divided into three parts and a yellow oval highlighting the simplified fraction.\n- The man points to the fraction 3/6, which is then shown as 2×3, indicating factorization of the numerator and denominator.\n[90-120s] - The man gestures toward the fraction 3/6 as it simplifies to 1/2, with the numerator and denominator being crossed out in yellow.\n- The simplified fraction equals 1, highlighted in yellow, with a red arrow pointing to it.\n- The fraction 3/6 is shown as 1×3 over 2×3, with the 3s being crossed out to indicate cancellation.\n[120-150s] - A man in a black shirt stands in front of a grid background, gesturing while explaining a math problem.\n- The screen displays the fraction \"3/6 = 1/2\" with a yellow oval highlighting the \"3/6\" part.\n- The fraction \"6/20\" appears on the screen, replacing the previous equation.", "history_tokens": 448, "history_utf8_bytes": 1690, "recent_frame_times_s": [123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332], "recent_frames_sha256": "73d454e34101310b8ca49cfc026669099779443bb57271afe06771fb942d2234", "num_recent_frames": 30, "tq": 715666.258078936, "t1": 715667.005795935, "ta": 715667.005795935, "te": 715667.044138394, "first_response_s": 0.747716999030672, "answer_total_s": 0.7860594579251483, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 222, "content_group": "a07fd9e4af720641d44c6ce2582370fa046da798e1dfc41c846252717711060f", "question": {"question_id": "sample_222_a2231_q0", "video_id": 222, "video_path": "./videos/sample_222_real.mp4", "annotation_index": 2231, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to find the greatest common divisor.", "B. How to convert the fraction to a decimal.", "C. How to factorize each number to prime factors.", "D. How to add fractions with different denominators."], "answer": "C", "time_stamp_s": 345, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [315, 345], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_222_a2231_q0", "video_id": 222, "time_stamp_s": 345, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "77f5ae73dfec62ab5c89bb406419bc30c3cc94c51f9fc3b456464c302b7d9e08", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317, 333.0327, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334], "recent_frames_sha256": "5bf1c4db5fbff0a4d9fbd9f13145b0f49f6c32dbba5d73102e6e76d075a74142", "num_recent_frames": 30, "tq": 715552.145235757, "t1": 715564.271178549, "ta": 715564.271178549, "te": 715564.314262964, "first_response_s": 12.125942792044953, "answer_total_s": 12.169027206953615, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_222_a2231_q0", "video_id": 222, "time_stamp_s": 345, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cf03b81c17dc2033570a8ea980039ad0e018850689d3fea62864d4e8dad4ddad", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a black t-shirt stands against a greenish-blue textured background, speaking while text overlays appear.  \n- The text \"Simplifying Fractions\" appears on screen, followed by \"Factoring\" and \"Simplify Fractions\" as the man continues speaking.  \n- A fraction \"25/50\" is shown with the simplified form \"1/2\" appearing beside it under the label \"Re Writing\".\n[30-60s] - A green and white rectangular bar appears, with the fraction 1/2 displayed below it.\n- The bar is then divided into six equal parts, with three parts shaded green, and the fraction 3/6 appears below.\n- The fraction 3/6 is simplified to 1/2, shown with an equals sign between them.\n[60-90s] - A man in a black shirt stands in front of a grid background, gesturing toward a fraction bar diagram showing 3/6.\n- The fraction 3/6 is visually simplified to 1/2, with a green bar divided into three parts and a yellow oval highlighting the simplified fraction.\n- The man points to the fraction 3/6, which is then shown as 2×3, indicating factorization of the numerator and denominator.\n[90-120s] - The man gestures toward the fraction 3/6 as it simplifies to 1/2, with the numerator and denominator being crossed out in yellow.\n- The simplified fraction equals 1, highlighted in yellow, with a red arrow pointing to it.\n- The fraction 3/6 is shown as 1×3 over 2×3, with the 3s being crossed out to indicate cancellation.\n[120-150s] - A man in a black shirt stands in front of a grid background, gesturing while explaining a math problem.\n- The screen displays the fraction \"3/6 = 1/2\" with a yellow oval highlighting the \"3/6\" part.\n- The fraction \"6/20\" appears on the screen, replacing the previous equation.\n[150-180s] - The fraction 6/20 is shown with numerator factored as 2×3 and denominator as 2×2×5.\n- A yellow circle highlights the common factor '2' in both numerator and denominator.\n- A red vertical line appears under the common factor '2', indicating it will be canceled out.\n[180-210s] - Man in black shirt gestures while speaking against a green textured background.  \n- Text \"Factors\" appears twice on screen, underlined in red.  \n- Number \"1\" and \"15\" appear with accompanying text \"Always A Factor\" and \"5×3\" respectively.\n[210-240s] - A man in a black t-shirt stands against a teal-green abstract background, gesturing with hands while speaking.  \n- On-screen text displays \"Simplifying Fractions\" in red, appearing at 220 seconds.  \n- The man continues speaking and gesturing, with no significant change in his position or the background.\n[240-270s] - A man in a black t-shirt stands in front of a greenish-blue abstract background, gesturing with his hands while speaking.  \n- Text overlays appear sequentially: \"Homework,\" then \"Simplifying Fractions Part 2,\" followed by \"Procedure,\" \"Factor Top & Bottom,\" \"Cancel Common Factors,\" and \"ReMultiply Leftovers.\"  \n- The man’s gestures and facial expressions suggest he is explaining the steps for simplifying fractions.\n[270-300s] - Man in black shirt stands before a green background, gesturing while explaining fraction simplification.\n- On-screen text \"Factor Top & Bottom\" appears above a fraction 5/15, which is then factored as 5×3.\n- The fraction is visually simplified by canceling the common factor of 5, showing 1/3 as the reduced form.\n[300-330s] - A fraction equation displays \"5/15 = 5/5×3\" with a red arrow pointing to the numerator \"5\" and a yellow circle highlighting the denominator \"15\".\n- The presenter appears, gesturing toward the equation as the text changes to \"Re Organize\".\n- The fraction simplifies to \"1/3\" after canceling the common factor \"5\" and reorganizing the expression.", "history_tokens": 955, "history_utf8_bytes": 3663, "recent_frame_times_s": [315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317, 333.0327, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334], "recent_frames_sha256": "5bf1c4db5fbff0a4d9fbd9f13145b0f49f6c32dbba5d73102e6e76d075a74142", "num_recent_frames": 30, "tq": 715710.892145851, "t1": 715711.654130862, "ta": 715711.654130862, "te": 715711.690749343, "first_response_s": 0.761985010933131, "answer_total_s": 0.7986034919740632, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 222, "content_group": "a07fd9e4af720641d44c6ce2582370fa046da798e1dfc41c846252717711060f", "question": {"question_id": "sample_222_a2232_q0", "video_id": 222, "video_path": "./videos/sample_222_real.mp4", "annotation_index": 2232, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. How to find common denominators.", "B. The process of cross-multiplication.", "C. Simplifying fractions using greatest common factor.", "D. The difference between factors and multiples."], "answer": "C", "time_stamp_s": 437, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [420, 450], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_222_a2232_q0", "video_id": 222, "time_stamp_s": 437, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fefee32402c74c9fc4463f3fa3e53d44b4970e87a5d0be9bf9db2bf480a1072d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256, 427.0266, 428.0276, 429.0286, 430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333, 435.00123333333335, 436.0022333333333], "recent_frames_sha256": "095f0ebc8c9622a119b10a4eb1e22ba22e43c5293c48f592f3316453b71370c7", "num_recent_frames": 30, "tq": 715564.325240212, "t1": 715575.725733842, "ta": 715575.725733842, "te": 715575.765102392, "first_response_s": 11.400493629975244, "answer_total_s": 11.439862179919146, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_222_a2232_q0", "video_id": 222, "time_stamp_s": 437, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fd900f1317dddf7b72504aed8679817a38980a1c53d56e2453a7dbdf59614f51", "condition_order": ["recent", "notes"], "memory": "[90-120s] - The man gestures toward the fraction 3/6 as it simplifies to 1/2, with the numerator and denominator being crossed out in yellow.\n- The simplified fraction equals 1, highlighted in yellow, with a red arrow pointing to it.\n- The fraction 3/6 is shown as 1×3 over 2×3, with the 3s being crossed out to indicate cancellation.\n[120-150s] - A man in a black shirt stands in front of a grid background, gesturing while explaining a math problem.\n- The screen displays the fraction \"3/6 = 1/2\" with a yellow oval highlighting the \"3/6\" part.\n- The fraction \"6/20\" appears on the screen, replacing the previous equation.\n[150-180s] - The fraction 6/20 is shown with numerator factored as 2×3 and denominator as 2×2×5.\n- A yellow circle highlights the common factor '2' in both numerator and denominator.\n- A red vertical line appears under the common factor '2', indicating it will be canceled out.\n[180-210s] - Man in black shirt gestures while speaking against a green textured background.  \n- Text \"Factors\" appears twice on screen, underlined in red.  \n- Number \"1\" and \"15\" appear with accompanying text \"Always A Factor\" and \"5×3\" respectively.\n[210-240s] - A man in a black t-shirt stands against a teal-green abstract background, gesturing with hands while speaking.  \n- On-screen text displays \"Simplifying Fractions\" in red, appearing at 220 seconds.  \n- The man continues speaking and gesturing, with no significant change in his position or the background.\n[240-270s] - A man in a black t-shirt stands in front of a greenish-blue abstract background, gesturing with his hands while speaking.  \n- Text overlays appear sequentially: \"Homework,\" then \"Simplifying Fractions Part 2,\" followed by \"Procedure,\" \"Factor Top & Bottom,\" \"Cancel Common Factors,\" and \"ReMultiply Leftovers.\"  \n- The man’s gestures and facial expressions suggest he is explaining the steps for simplifying fractions.\n[270-300s] - Man in black shirt stands before a green background, gesturing while explaining fraction simplification.\n- On-screen text \"Factor Top & Bottom\" appears above a fraction 5/15, which is then factored as 5×3.\n- The fraction is visually simplified by canceling the common factor of 5, showing 1/3 as the reduced form.\n[300-330s] - A fraction equation displays \"5/15 = 5/5×3\" with a red arrow pointing to the numerator \"5\" and a yellow circle highlighting the denominator \"15\".\n- The presenter appears, gesturing toward the equation as the text changes to \"Re Organize\".\n- The fraction simplifies to \"1/3\" after canceling the common factor \"5\" and reorganizing the expression.\n[330-360s] - A man in a black t-shirt stands against a grid background, gesturing while speaking.\n- The fraction \"30/36\" appears on screen, followed by the text \"Prime Factors\" above it.\n- The fraction is broken down into \"5×6\" and then further into \"5×2×3\" with the \"30\" circled.\n[360-390s] - A man in a black shirt appears, gesturing toward a math equation showing prime factorization of 30 and 36.\n- The equation displays 30 = 5×2×3 and 36 = 2×3×2×3, with common factors highlighted in red.\n- The text \"Common Factors\" appears in orange below the equation as the man explains the concept.\n[390-420s] - The fraction 30/36 is shown with prime factorization: 30 = 5×2×3 and 36 = 2×3×2×3.\n- Red crosses highlight the common factors (2 and 3) in both numerator and denominator.\n- Yellow circles emphasize the remaining factors after canceling common factors, leading to the simplified fraction 5/6.", "history_tokens": 952, "history_utf8_bytes": 3509, "recent_frame_times_s": [407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256, 427.0266, 428.0276, 429.0286, 430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333, 435.00123333333335, 436.0022333333333], "recent_frames_sha256": "095f0ebc8c9622a119b10a4eb1e22ba22e43c5293c48f592f3316453b71370c7", "num_recent_frames": 30, "tq": 715737.015837126, "t1": 715738.032316579, "ta": 715738.032316579, "te": 715738.253855938, "first_response_s": 1.0164794530719519, "answer_total_s": 1.2380188120296225, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 225, "content_group": "ee4060f9091db5f3e9da83b860f9f03b6b7e1d3ee6dde58e50f9b8320b02b0ef", "question": {"question_id": "sample_225_a1711_q0", "video_id": 225, "video_path": "./videos/sample_225_real.mp4", "annotation_index": 1711, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How the distributive property helps in simplifying equations.", "B. The practical applications of the probability theory.", "C. The definition of the distributive property.", "D. The definition of stochastic process."], "answer": "C", "time_stamp_s": 11, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_225_a1711_q0", "video_id": 225, "time_stamp_s": 11, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0d8e981d508c24d85518c371b34def1700c210e29a1846f568de160f6162d7ee", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01], "recent_frames_sha256": "0cadbfd5d6f4f906732827a022d0fa49b36bb3005f1a8f6ee723c51454abf00e", "num_recent_frames": 11, "tq": 710537.134714596, "t1": 710537.692957544, "ta": 710537.692957544, "te": 710537.730173792, "first_response_s": 0.5582429480273277, "answer_total_s": 0.5954591960180551, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_225_a1711_q0", "video_id": 225, "time_stamp_s": 11, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "baba366013f7bd7aa2830226dd972302b8d7013959bdd21d2d17081dfa67e8cc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01], "recent_frames_sha256": "0cadbfd5d6f4f906732827a022d0fa49b36bb3005f1a8f6ee723c51454abf00e", "num_recent_frames": 11, "tq": 710372.92360607, "t1": 710384.968350946, "ta": 710384.968350946, "te": 710385.330086008, "first_response_s": 12.044744875980541, "answer_total_s": 12.406479937955737, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 225, "content_group": "ee4060f9091db5f3e9da83b860f9f03b6b7e1d3ee6dde58e50f9b8320b02b0ef", "question": {"question_id": "sample_225_a1712_q0", "video_id": 225, "video_path": "./videos/sample_225_real.mp4", "annotation_index": 1712, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. Combining like terms.", "B. Factoring out a common factor.", "C. Simplifying the expression further.", "D. How to use distributive property to the example."], "answer": "D", "time_stamp_s": 120, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [125, 155], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_225_a1712_q0", "video_id": 225, "time_stamp_s": 120, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "74ecd9dab9e46bc63252fd0658446c35c303803f867c7f1ab6d8b9a95e38965e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [90.02326666666667, 91.02426666666666, 92.02526666666667, 93.02626666666667, 94.02726666666666, 95.02826666666667, 96.02926666666667, 97.03026666666666, 98.03126666666667, 99.03226666666667, 100.03326666666666, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189], "recent_frames_sha256": "51adeb0c1cb5fe8f7a3919f0ab6969bc98f1d3262fb7206212ba0ce61da0bc27", "num_recent_frames": 30, "tq": 710537.751115083, "t1": 710551.630842852, "ta": 710551.630842852, "te": 710551.66759958, "first_response_s": 13.879727769060992, "answer_total_s": 13.916484497021884, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_225_a1712_q0", "video_id": 225, "time_stamp_s": 120, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9db4e81b0b8d56259dfeb15eb26bda2a6d7cc0edfec6d19feab7eba83f93e63d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a green textured background, gesturing as he speaks.  \n- The text \"Distributive Property\" appears on screen in yellow, followed by \"Distributive Property of Multiplication Over Addition\" as the man continues explaining.  \n- The video opens with a grid background displaying the word \"math\" and transitions to the \"Math Antics\" logo before the man appears.\n[30-60s] - Man in white \"Math Antics\" shirt gestures while speaking against a green textured background.  \n- Text overlays appear sequentially: \"Thing 1 Thing 2,\" then \"Distribute,\" followed by \"Distribute to each member of a group.\"  \n- A cartoon inset of a laughing man holding a rolled-up paper appears briefly as the man continues speaking.\n[60-90s] - Man in white \"Math Antics\" shirt stands against green textured background, gesturing while speaking.  \n- Text \"Order of Operations\" appears in yellow on left side of screen.  \n- Small inset video shows two people discussing math problems (2÷5×4) on a screen.\n[90-120s] - Left side displays \"Order of Operations\" with a step-by-step breakdown, highlighting \"1 (Groups)\" and showing the expression \"3×(4+6)\" with a yellow highlight on the parentheses.\n- Right side shows \"Distributive Property\" with the same expression \"3×(4+6)\".\n- Both sides conclude with the result \"30\" after performing the calculation, with the left side showing intermediate steps: \"3×10\" then \"30\".", "history_tokens": 356, "history_utf8_bytes": 1451, "recent_frame_times_s": [90.02326666666667, 91.02426666666666, 92.02526666666667, 93.02626666666667, 94.02726666666666, 95.02826666666667, 96.02926666666667, 97.03026666666666, 98.03126666666667, 99.03226666666667, 100.03326666666666, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189], "recent_frames_sha256": "51adeb0c1cb5fe8f7a3919f0ab6969bc98f1d3262fb7206212ba0ce61da0bc27", "num_recent_frames": 30, "tq": 710416.409638605, "t1": 710422.639812261, "ta": 710422.639812261, "te": 710422.679130061, "first_response_s": 6.230173656018451, "answer_total_s": 6.2694914559833705, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 225, "content_group": "ee4060f9091db5f3e9da83b860f9f03b6b7e1d3ee6dde58e50f9b8320b02b0ef", "question": {"question_id": "sample_225_a1713_q0", "video_id": 225, "video_path": "./videos/sample_225_real.mp4", "annotation_index": 1713, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. The formula for compound interest.", "B. Why the two way get the same answer.", "C. Solving quadratic equations.", "D. Graphing linear equations."], "answer": "B", "time_stamp_s": 270, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [250, 280], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_225_a1713_q0", "video_id": 225, "time_stamp_s": 270, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "11a89b79c60b89dbe9f9648f51eafa5ba2155a6376b83e5b4b09b541d76cc089", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667], "recent_frames_sha256": "aa6c2195a6942e4deabda616669b1e3f3cd93859ccc6819341d19a738ad4242d", "num_recent_frames": 30, "tq": 710551.69616141, "t1": 710563.238274778, "ta": 710563.238274778, "te": 710563.276732807, "first_response_s": 11.542113368050195, "answer_total_s": 11.580571397091262, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_225_a1713_q0", "video_id": 225, "time_stamp_s": 270, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cb95800d478d015562b90a2f7648a499352c582d6b754fdf7dc67f81a3195b9d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a green textured background, gesturing as he speaks.  \n- The text \"Distributive Property\" appears on screen in yellow, followed by \"Distributive Property of Multiplication Over Addition\" as the man continues explaining.  \n- The video opens with a grid background displaying the word \"math\" and transitions to the \"Math Antics\" logo before the man appears.\n[30-60s] - Man in white \"Math Antics\" shirt gestures while speaking against a green textured background.  \n- Text overlays appear sequentially: \"Thing 1 Thing 2,\" then \"Distribute,\" followed by \"Distribute to each member of a group.\"  \n- A cartoon inset of a laughing man holding a rolled-up paper appears briefly as the man continues speaking.\n[60-90s] - Man in white \"Math Antics\" shirt stands against green textured background, gesturing while speaking.  \n- Text \"Order of Operations\" appears in yellow on left side of screen.  \n- Small inset video shows two people discussing math problems (2÷5×4) on a screen.\n[90-120s] - Left side displays \"Order of Operations\" with a step-by-step breakdown, highlighting \"1 (Groups)\" and showing the expression \"3×(4+6)\" with a yellow highlight on the parentheses.\n- Right side shows \"Distributive Property\" with the same expression \"3×(4+6)\".\n- Both sides conclude with the result \"30\" after performing the calculation, with the left side showing intermediate steps: \"3×10\" then \"30\".\n[120-150s] - The expression \"3×(4+6)\" is highlighted in yellow, indicating it's the \"Different Form\" being shown.\n- The text \"Different Form\" appears below the highlighted expression, clarifying its purpose.\n- The expression is then expanded to \"(3×4+3×6)\" with a yellow oval highlighting the expanded form.\n[150-180s] - Left side: Expression 3×(4+6) simplifies to 3×10, then to 30.\n- Right side: Expression 3×(4+6) expands via distributive property to 3×4+3×6, then simplifies to 12+18, and finally to 30.\n- Visual cue: A purple box labeled \"Order of Operations\" appears, listing groupings, exponents, multiplication, and division.\n[180-210s] - Red arrow points to '3×(4+6)' and then moves to '3×4+3×6', highlighting the distributive property.\n- Yellow highlight appears on '4+6' and '3×4+3×6', emphasizing the breakdown of the expression.\n- Text 'No Group' appears above the right side of the equation, indicating the absence of grouping after distribution.\n[210-240s] - A man in a \"Math Antics\" t-shirt stands before a grid background, gesturing as expressions like \"7×(2+3)\" and \"4×(1+2+3)\" appear on screen.\n- The word \"Distribute\" appears in green text as the expression \"7×(2+3)\" is expanded to \"7×2 + 7×3\".\n- A split-screen comparison shows the original expression \"4×(1+2+3)\" on the right and a highlighted \"4×(6)\" on the left, indicating simplification.\n[240-270s] - Left side: Equation 4×(1+2+3) simplifies to 4×6, then to 24.\n- Right side: Equation 4×(1+2+3) expands via distributive property to 4×1 + 4×2 + 4×3.\n- Numbers 4, 8, and 12 appear sequentially as intermediate results from the expanded terms.", "history_tokens": 866, "history_utf8_bytes": 3094, "recent_frame_times_s": [240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667], "recent_frames_sha256": "aa6c2195a6942e4deabda616669b1e3f3cd93859ccc6819341d19a738ad4242d", "num_recent_frames": 30, "tq": 710461.791828214, "t1": 710463.462759465, "ta": 710463.462759465, "te": 710463.741539588, "first_response_s": 1.670931251021102, "answer_total_s": 1.9497113740071654, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 225, "content_group": "ee4060f9091db5f3e9da83b860f9f03b6b7e1d3ee6dde58e50f9b8320b02b0ef", "question": {"question_id": "sample_225_a1714_q0", "video_id": 225, "video_path": "./videos/sample_225_real.mp4", "annotation_index": 1714, "question_index": 0, "question": "What might the speaker calculate next?", "options": ["A. 5 times 7.", "B. 47 times 47.", "C. 5 times 5.", "D. 5 plus 40."], "answer": "A", "time_stamp_s": 403, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [375, 405], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_225_a1714_q0", "video_id": 225, "time_stamp_s": 403, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "48c84442176ee5f9be2aaca7e3398270916c1b8ba02b7f9bc278a2aef66d58da", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.0169666666667, 385.01796666666667, 386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665, 394.0269666666667, 395.02796666666666, 396.0289666666667, 397.02996666666667, 398.03096666666664, 399.0319666666667, 400.03296666666665, 401.0006, 402.0016], "recent_frames_sha256": "25411dd887fce898f4eb36356ac50d4e0092a08cdfbd0af29e00bb5517df1165", "num_recent_frames": 30, "tq": 710563.296256206, "t1": 710575.093356641, "ta": 710575.093356641, "te": 710575.130322098, "first_response_s": 11.797100435011089, "answer_total_s": 11.834065892035142, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_225_a1714_q0", "video_id": 225, "time_stamp_s": 403, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "812992df07959429262ff5968e4d8a337e13e82c6cfc945c011d9188d7546f8f", "condition_order": ["notes", "recent"], "memory": "[90-120s] - Left side displays \"Order of Operations\" with a step-by-step breakdown, highlighting \"1 (Groups)\" and showing the expression \"3×(4+6)\" with a yellow highlight on the parentheses.\n- Right side shows \"Distributive Property\" with the same expression \"3×(4+6)\".\n- Both sides conclude with the result \"30\" after performing the calculation, with the left side showing intermediate steps: \"3×10\" then \"30\".\n[120-150s] - The expression \"3×(4+6)\" is highlighted in yellow, indicating it's the \"Different Form\" being shown.\n- The text \"Different Form\" appears below the highlighted expression, clarifying its purpose.\n- The expression is then expanded to \"(3×4+3×6)\" with a yellow oval highlighting the expanded form.\n[150-180s] - Left side: Expression 3×(4+6) simplifies to 3×10, then to 30.\n- Right side: Expression 3×(4+6) expands via distributive property to 3×4+3×6, then simplifies to 12+18, and finally to 30.\n- Visual cue: A purple box labeled \"Order of Operations\" appears, listing groupings, exponents, multiplication, and division.\n[180-210s] - Red arrow points to '3×(4+6)' and then moves to '3×4+3×6', highlighting the distributive property.\n- Yellow highlight appears on '4+6' and '3×4+3×6', emphasizing the breakdown of the expression.\n- Text 'No Group' appears above the right side of the equation, indicating the absence of grouping after distribution.\n[210-240s] - A man in a \"Math Antics\" t-shirt stands before a grid background, gesturing as expressions like \"7×(2+3)\" and \"4×(1+2+3)\" appear on screen.\n- The word \"Distribute\" appears in green text as the expression \"7×(2+3)\" is expanded to \"7×2 + 7×3\".\n- A split-screen comparison shows the original expression \"4×(1+2+3)\" on the right and a highlighted \"4×(6)\" on the left, indicating simplification.\n[240-270s] - Left side: Equation 4×(1+2+3) simplifies to 4×6, then to 24.\n- Right side: Equation 4×(1+2+3) expands via distributive property to 4×1 + 4×2 + 4×3.\n- Numbers 4, 8, and 12 appear sequentially as intermediate results from the expanded terms.\n[270-300s] - Man in white t-shirt gestures toward \"Distributive Property\" text on screen.  \n- On-screen text highlights \"Regular Order of Operations\" and \"The Distributive Property\" with a question \"Why?\" appearing below.  \n- Man points to the text as he speaks, emphasizing the concept.\n[300-330s] - A man in a white \"Math Antics\" t-shirt gestures while speaking against a blue grid background.  \n- On-screen text displays \"Regular Order of Operations\" and \"The Distributive Property\" with a \"Why?\" question.  \n- A \"True\" checkmark appears next to a math example showing 3×(4+6) = 30, with both \"Group First\" and \"Distributive Property\" methods yielding the same result.\n[330-360s] - Left side: \"Group First!\" text with \"8×53\" thought bubble above a man's head.  \n- Right side: \"Distributive Property\" text with \"8×50 + 8×3\" appearing below, followed by \"400 + 24\" and \"42\".  \n- Two men's heads appear, one on each side, with smiling expressions as calculations progress.\n[360-390s] - A man in a white t-shirt with \"Math Antics\" text stands against a blue grid background, gesturing toward a screen displaying \"Multi-Digit Multiplication\" and an expanded form equation.\n- The screen transitions to show \"5 × 47\" with a vertical multiplication layout below it, then highlights \"Distributive Property\" as an alternative method.\n- A yellow arrow points from \"5 × 47\" to the vertical multiplication layout, indicating the relationship between the two representations.", "history_tokens": 1004, "history_utf8_bytes": 3528, "recent_frame_times_s": [373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.0169666666667, 385.01796666666667, 386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665, 394.0269666666667, 395.02796666666666, 396.0289666666667, 397.02996666666667, 398.03096666666664, 399.0319666666667, 400.03296666666665, 401.0006, 402.0016], "recent_frames_sha256": "25411dd887fce898f4eb36356ac50d4e0092a08cdfbd0af29e00bb5517df1165", "num_recent_frames": 30, "tq": 710496.98164652, "t1": 710506.31989259, "ta": 710506.31989259, "te": 710506.357246991, "first_response_s": 9.338246070081368, "answer_total_s": 9.37560047104489, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 225, "content_group": "ee4060f9091db5f3e9da83b860f9f03b6b7e1d3ee6dde58e50f9b8320b02b0ef", "question": {"question_id": "sample_225_a1715_q0", "video_id": 225, "video_path": "./videos/sample_225_real.mp4", "annotation_index": 1715, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. The example can not use distributive property.", "B. The commutative property of addition.", "C. The identity property of multiplication.", "D. The distributive property of subtraction."], "answer": "A", "time_stamp_s": 527, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [500, 530], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_225_a1715_q0", "video_id": 225, "time_stamp_s": 527, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "23e0c620209863c9f4b0885974793523bddc197019ba7c5cd8fb2c48fd77de60", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [497.0298666666667, 498.03086666666667, 499.03186666666664, 500.0328666666667, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0175, 519.0185, 520.0195, 521.0205, 522.0215, 523.0225, 524.0235, 525.0245, 526.0255], "recent_frames_sha256": "2aaa7efab2f59960994a32866936cc6872aaf86e11d7025c02887fc868a63dab", "num_recent_frames": 30, "tq": 710575.142112401, "t1": 710586.318911469, "ta": 710586.318911469, "te": 710586.504523099, "first_response_s": 11.17679906799458, "answer_total_s": 11.362410698086023, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_225_a1715_q0", "video_id": 225, "time_stamp_s": 527, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "de02da47e9b8f5e3c4e3a299dc3e9e2a6e11508a34f1567ffc3b6184bf959c78", "condition_order": ["notes", "recent"], "memory": "[240-270s] - Left side: Equation 4×(1+2+3) simplifies to 4×6, then to 24.\n- Right side: Equation 4×(1+2+3) expands via distributive property to 4×1 + 4×2 + 4×3.\n- Numbers 4, 8, and 12 appear sequentially as intermediate results from the expanded terms.\n[270-300s] - Man in white t-shirt gestures toward \"Distributive Property\" text on screen.  \n- On-screen text highlights \"Regular Order of Operations\" and \"The Distributive Property\" with a question \"Why?\" appearing below.  \n- Man points to the text as he speaks, emphasizing the concept.\n[300-330s] - A man in a white \"Math Antics\" t-shirt gestures while speaking against a blue grid background.  \n- On-screen text displays \"Regular Order of Operations\" and \"The Distributive Property\" with a \"Why?\" question.  \n- A \"True\" checkmark appears next to a math example showing 3×(4+6) = 30, with both \"Group First\" and \"Distributive Property\" methods yielding the same result.\n[330-360s] - Left side: \"Group First!\" text with \"8×53\" thought bubble above a man's head.  \n- Right side: \"Distributive Property\" text with \"8×50 + 8×3\" appearing below, followed by \"400 + 24\" and \"42\".  \n- Two men's heads appear, one on each side, with smiling expressions as calculations progress.\n[360-390s] - A man in a white t-shirt with \"Math Antics\" text stands against a blue grid background, gesturing toward a screen displaying \"Multi-Digit Multiplication\" and an expanded form equation.\n- The screen transitions to show \"5 × 47\" with a vertical multiplication layout below it, then highlights \"Distributive Property\" as an alternative method.\n- A yellow arrow points from \"5 × 47\" to the vertical multiplication layout, indicating the relationship between the two representations.\n[390-420s] - The equation \"5×47\" is displayed with a yellow arrow pointing to \"5×(40+7)\" as an alternative representation.\n- The expression \"(5×40+5×7)\" appears below, highlighting the distributive property applied to the multiplication.\n- The numbers \"200\" and \"35\" are shown as intermediate results, followed by their sum \"235\" as the final answer.\n[420-450s] - The expression \"3×127\" is shown with \"127\" circled, then decomposed into \"100 + 20 + 7\" below it.\n- The multiplication symbol \"×\" is highlighted with a red arrow pointing to it, indicating the distributive property application.\n- The expression is rewritten as \"3×(100 + 20 + 7)\" and then expanded to \"3×100 + 3×20 + 3×7\" with each term highlighted in yellow.\n[450-480s] - A math equation \"3×100 + 3×20 + 3×7\" is displayed with its expanded form \"300 + 60 + 21\" below it.  \n- The number \"381\" appears highlighted in a yellow oval beneath the expanded equation.  \n- A man in a white \"Math Antics\" t-shirt appears, gesturing as he speaks, with a grid background.\n[480-510s] - Left side: \"Group First\" label with calculation 7×(10-4) → 7×6 → 42.\n- Right side: \"Distributive Property\" label with calculation 7×(10-4) → 7×10 - 7×4 → 70 - 28 → 42.\n- Both sides conclude with the result \"42\" after respective calculations.", "history_tokens": 908, "history_utf8_bytes": 3037, "recent_frame_times_s": [497.0298666666667, 498.03086666666667, 499.03186666666664, 500.0328666666667, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0175, 519.0185, 520.0195, 521.0205, 522.0215, 523.0225, 524.0235, 525.0245, 526.0255], "recent_frames_sha256": "2aaa7efab2f59960994a32866936cc6872aaf86e11d7025c02887fc868a63dab", "num_recent_frames": 30, "tq": 710534.819275983, "t1": 710536.804283843, "ta": 710536.804283843, "te": 710537.066413937, "first_response_s": 1.985007859999314, "answer_total_s": 2.247137953992933, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 226, "content_group": "583ea4f59fb89a3a2c0ae31043a7b66ea4298b5f9abcc13f6a2b1dd0eddb0dd5", "question": {"question_id": "sample_226_a1505_q0", "video_id": 226, "video_path": "./videos/sample_226_real.mp4", "annotation_index": 1505, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. The concept of the division.", "B. The process of multiplying numbers.", "C. The concept of subtraction.", "D. How to solve an equation."], "answer": "C", "time_stamp_s": 13, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_226_a1505_q0", "video_id": 226, "time_stamp_s": 13, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c2d515b5f8c17523b43ff4244f534df20bb9177fdbbbcd90c2b8e5fb14e54534", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012], "recent_frames_sha256": "875d2f5d1ce85ca51634d0ae5e580e15a201e981dbe0a58a5a5f40c88a13e1af", "num_recent_frames": 13, "tq": 715923.387260012, "t1": 715930.639161457, "ta": 715930.639161457, "te": 715930.676759459, "first_response_s": 7.251901444979012, "answer_total_s": 7.289499446982518, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_226_a1505_q0", "video_id": 226, "time_stamp_s": 13, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "faae3eb93dfe91bd0a79c7b078f5087e22b1ece469cd506d78bd5a3f04d39e51", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012], "recent_frames_sha256": "875d2f5d1ce85ca51634d0ae5e580e15a201e981dbe0a58a5a5f40c88a13e1af", "num_recent_frames": 13, "tq": 715971.518813814, "t1": 715977.097102697, "ta": 715977.097102697, "te": 715977.136505326, "first_response_s": 5.57828888297081, "answer_total_s": 5.617691511986777, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 226, "content_group": "583ea4f59fb89a3a2c0ae31043a7b66ea4298b5f9abcc13f6a2b1dd0eddb0dd5", "question": {"question_id": "sample_226_a1506_q0", "video_id": 226, "video_path": "./videos/sample_226_real.mp4", "annotation_index": 1506, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. The meaning of the dividend.", "B. The process of multiplying numbers.", "C. The concept of subtraction.", "D. How to solve an equation."], "answer": "A", "time_stamp_s": 136, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [123, 153], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_226_a1506_q0", "video_id": 226, "time_stamp_s": 136, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "beee4edab04f5ac6fceb2efd8544eaea73ab77b24e6be42bf6cd5b5d0f36b975", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333], "recent_frames_sha256": "d0ce085f279a961a7c29860afc12716803480136e5c8b6279672990f8c21dd25", "num_recent_frames": 30, "tq": 715930.701091243, "t1": 715942.759714661, "ta": 715942.759714661, "te": 715942.797306233, "first_response_s": 12.058623418095522, "answer_total_s": 12.096214990015142, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_226_a1506_q0", "video_id": 226, "time_stamp_s": 136, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2f2774a2208dda197445495647b2ccb6d5a81b9efeb3334032914add20fe7717", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a yellow textured background, speaking to the camera.  \n- On-screen text appears sequentially: \"Division,\" then \"Long Division,\" then a math problem \"9 ÷ 3\" with question marks below it.  \n- The background transitions from yellow to a grid pattern as the math problem appears.\n[30-60s] - A multiplication fact box labeled \"3 × 3 = 9\" appears on the left side of the screen.  \n- A multiplication table grid is displayed on the right, with the number 9 highlighted in red.  \n- A red arrow points from the multiplication fact box to the corresponding cell in the multiplication table.\n[60-90s] - A multiplication table grid appears, with numbers arranged in rows and columns, highlighting the number 9 in the top-left corner.\n- The number 9 is circled in yellow, and the division symbol \"÷\" is positioned next to it, indicating the operation 9 ÷ 4.\n- The grid remains static, with no visible changes or interactions occurring during this segment.\n[90-120s] - A man in a white \"Math Anfics\" t-shirt stands against a grid background, gesturing while explaining math concepts.  \n- A blue division symbol appears on screen, followed by a blue \"Stage\" text and a horizontal line, indicating a transition or new topic.  \n- The man continues speaking, with no visible change in his position or expression, maintaining focus on the educational content.", "history_tokens": 330, "history_utf8_bytes": 1409, "recent_frame_times_s": [106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333], "recent_frames_sha256": "d0ce085f279a961a7c29860afc12716803480136e5c8b6279672990f8c21dd25", "num_recent_frames": 30, "tq": 716012.943330521, "t1": 716020.209208873, "ta": 716020.209208873, "te": 716020.395699577, "first_response_s": 7.26587835198734, "answer_total_s": 7.452369056059979, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 226, "content_group": "583ea4f59fb89a3a2c0ae31043a7b66ea4298b5f9abcc13f6a2b1dd0eddb0dd5", "question": {"question_id": "sample_226_a1507_q0", "video_id": 226, "video_path": "./videos/sample_226_real.mp4", "annotation_index": 1507, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to determine the remainder.", "B. How to find the remainder.", "C. The concept of partial quotients.", "D. The relationship between divisor and dividend."], "answer": "A", "time_stamp_s": 256, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [246, 276], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_226_a1507_q0", "video_id": 226, "time_stamp_s": 256, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3c4e7d9f3764baa2d27c35738f8165c3a7a8d3559ccc281421ec25337aabd93d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333], "recent_frames_sha256": "27b98945e09525e6d6c6866bd18eb505d66370f176b04395d4ae7b336be1e806", "num_recent_frames": 30, "tq": 715942.812205266, "t1": 715953.1303115, "ta": 715953.1303115, "te": 715953.16821528, "first_response_s": 10.318106234073639, "answer_total_s": 10.356010014074855, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_226_a1507_q0", "video_id": 226, "time_stamp_s": 256, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "56757bbc303c472fdc04682c4d8b986333b5f0fff35c83e11fefc93d98bcf8d6", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a yellow textured background, speaking to the camera.  \n- On-screen text appears sequentially: \"Division,\" then \"Long Division,\" then a math problem \"9 ÷ 3\" with question marks below it.  \n- The background transitions from yellow to a grid pattern as the math problem appears.\n[30-60s] - A multiplication fact box labeled \"3 × 3 = 9\" appears on the left side of the screen.  \n- A multiplication table grid is displayed on the right, with the number 9 highlighted in red.  \n- A red arrow points from the multiplication fact box to the corresponding cell in the multiplication table.\n[60-90s] - A multiplication table grid appears, with numbers arranged in rows and columns, highlighting the number 9 in the top-left corner.\n- The number 9 is circled in yellow, and the division symbol \"÷\" is positioned next to it, indicating the operation 9 ÷ 4.\n- The grid remains static, with no visible changes or interactions occurring during this segment.\n[90-120s] - A man in a white \"Math Anfics\" t-shirt stands against a grid background, gesturing while explaining math concepts.  \n- A blue division symbol appears on screen, followed by a blue \"Stage\" text and a horizontal line, indicating a transition or new topic.  \n- The man continues speaking, with no visible change in his position or expression, maintaining focus on the educational content.\n[120-150s] - A green circle appears to the left of a horizontal blue line, with a red arrow pointing to the orange rectangle below the line.  \n- The text \"Number Dividing Up\" appears below the green circle, and \"Dividend\" appears next to the orange rectangle.  \n- The red arrow moves from the orange rectangle to the green circle, indicating a shift in focus.\n[150-180s] - Text \"Number Dividing By\" appears above a green circle and blue division symbol, with \"Divisor\" labeled below the arrow pointing to the green circle.\n- Text \"Where Answer Will Go\" appears above the yellow square, with \"Quotient\" labeled above the arrow pointing to the yellow square.\n- A man in a white \"Math Antics\" t-shirt appears, standing against a grid background, with no visible action or movement.\n[180-210s] - Man in white \"Math Anfics\" shirt gestures while speaking, standing against a grid background.  \n- On-screen text transitions from \"9 ÷ 4\" to \"4)9\" as the division problem is visually restructured.  \n- Text overlays appear sequentially: \"Next Step\" then \"Answer,\" followed by \"Really Important Question\" with an arrow pointing to \"How Many To Make.\"\n[210-240s] - A man in a white \"Math Antics\" t-shirt stands against a grid background, gesturing toward a division problem (4)9 with text \"How Many To Make Or Almost\" above it.\n- The problem evolves to show \"1\" above the division symbol as the quotient, with a yellow highlight indicating the result.\n- The scene transitions to show three bear heads and a cartoon girl head, with furniture labeled \"Too Small,\" \"Just Right,\" and \"Too Big\" below them, suggesting a visual analogy for the division result.", "history_tokens": 730, "history_utf8_bytes": 3054, "recent_frame_times_s": [226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333], "recent_frames_sha256": "27b98945e09525e6d6c6866bd18eb505d66370f176b04395d4ae7b336be1e806", "num_recent_frames": 30, "tq": 716049.872425538, "t1": 716058.064578825, "ta": 716058.064578825, "te": 716058.106075859, "first_response_s": 8.192153287003748, "answer_total_s": 8.23365032102447, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 226, "content_group": "583ea4f59fb89a3a2c0ae31043a7b66ea4298b5f9abcc13f6a2b1dd0eddb0dd5", "question": {"question_id": "sample_226_a1508_q0", "video_id": 226, "video_path": "./videos/sample_226_real.mp4", "annotation_index": 1508, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. Why dividing cookies by people is useful.", "B. The importance of remainders in division.", "C. Use real-life example to explain the concept of remainders.", "D. How to distribute the cookie to people."], "answer": "D", "time_stamp_s": 394, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [369, 399], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_226_a1508_q0", "video_id": 226, "time_stamp_s": 394, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6308c534140f7da38b2454a8f9a55baa2dd91f477202d1ab3549aa326c6f6672", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.0169666666667, 385.01796666666667, 386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665], "recent_frames_sha256": "7d10a90dfa9d344a4c12e5eebde662c3f67fd7e2e3608a06a5a640a0bfbae084", "num_recent_frames": 30, "tq": 715953.182643851, "t1": 715959.902661174, "ta": 715959.902661174, "te": 715959.940713461, "first_response_s": 6.720017322921194, "answer_total_s": 6.7580696099903435, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_226_a1508_q0", "video_id": 226, "time_stamp_s": 394, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "02d76e3925d2de208c7ea8ae52a51dadd9344f3afe15d2019ba523a41adc97f0", "condition_order": ["recent", "notes"], "memory": "[60-90s] - A multiplication table grid appears, with numbers arranged in rows and columns, highlighting the number 9 in the top-left corner.\n- The number 9 is circled in yellow, and the division symbol \"÷\" is positioned next to it, indicating the operation 9 ÷ 4.\n- The grid remains static, with no visible changes or interactions occurring during this segment.\n[90-120s] - A man in a white \"Math Anfics\" t-shirt stands against a grid background, gesturing while explaining math concepts.  \n- A blue division symbol appears on screen, followed by a blue \"Stage\" text and a horizontal line, indicating a transition or new topic.  \n- The man continues speaking, with no visible change in his position or expression, maintaining focus on the educational content.\n[120-150s] - A green circle appears to the left of a horizontal blue line, with a red arrow pointing to the orange rectangle below the line.  \n- The text \"Number Dividing Up\" appears below the green circle, and \"Dividend\" appears next to the orange rectangle.  \n- The red arrow moves from the orange rectangle to the green circle, indicating a shift in focus.\n[150-180s] - Text \"Number Dividing By\" appears above a green circle and blue division symbol, with \"Divisor\" labeled below the arrow pointing to the green circle.\n- Text \"Where Answer Will Go\" appears above the yellow square, with \"Quotient\" labeled above the arrow pointing to the yellow square.\n- A man in a white \"Math Antics\" t-shirt appears, standing against a grid background, with no visible action or movement.\n[180-210s] - Man in white \"Math Anfics\" shirt gestures while speaking, standing against a grid background.  \n- On-screen text transitions from \"9 ÷ 4\" to \"4)9\" as the division problem is visually restructured.  \n- Text overlays appear sequentially: \"Next Step\" then \"Answer,\" followed by \"Really Important Question\" with an arrow pointing to \"How Many To Make.\"\n[210-240s] - A man in a white \"Math Antics\" t-shirt stands against a grid background, gesturing toward a division problem (4)9 with text \"How Many To Make Or Almost\" above it.\n- The problem evolves to show \"1\" above the division symbol as the quotient, with a yellow highlight indicating the result.\n- The scene transitions to show three bear heads and a cartoon girl head, with furniture labeled \"Too Small,\" \"Just Right,\" and \"Too Big\" below them, suggesting a visual analogy for the division result.\n[240-270s] - A division problem \"9 ÷ 4\" is displayed with a quotient \"1\" above the division bar.\n- The number \"1\" is circled in yellow, indicating it as the quotient.\n- The subtraction result \"5\" appears below the division bar, labeled as \"Remainder\" in orange text.\n[270-300s] - A man in a white \"Math Antics\" t-shirt gestures while explaining a division problem on a grid background.\n- The division problem \"49 ÷ 4\" is displayed with a quotient of \"1\" and a remainder of \"5\", highlighted with yellow boxes and arrows.\n- Text labels like \"Trouble!\", \"Bigger Than\", and \"Too Small\" appear dynamically to indicate conceptual errors in the division process.\n[300-330s] - A man in a white \"Math Anics\" t-shirt appears, gesturing toward a division problem on screen.  \n- The problem shows \"4)9\" with a \"3\" above the division bar, and \"12\" written below \"9\" after multiplying 4 by 3.  \n- A question mark appears below \"12\", indicating an unresolved step in the calculation.\n[330-360s] - Man in white \"Math Antics\" shirt gestures while speaking against a grid background.  \n- On-screen math problem shows division: 12 ÷ 4 = ? with 3 above 4 and 9 above 12.  \n- Text appears indicating \"1 too small\" and \"3 too BIG\" as options for the answer.\n[360-390s] - Man in white \"Math Antics\" shirt gestures while numbers \"1 too small\" and \"3 too BIG\" appear on screen.  \n- Number \"2\" appears centered as the correct guess, replacing the previous options.  \n- Long division problem \"4)9\" is shown with \"2\" as quotient, \"8\" as product, and \"1\" as remainder.", "history_tokens": 1010, "history_utf8_bytes": 3949, "recent_frame_times_s": [364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.0169666666667, 385.01796666666667, 386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665], "recent_frames_sha256": "7d10a90dfa9d344a4c12e5eebde662c3f67fd7e2e3608a06a5a640a0bfbae084", "num_recent_frames": 30, "tq": 716106.952266905, "t1": 716108.803631728, "ta": 716108.803631728, "te": 716108.844322858, "first_response_s": 1.8513648230582476, "answer_total_s": 1.892055953037925, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 226, "content_group": "583ea4f59fb89a3a2c0ae31043a7b66ea4298b5f9abcc13f6a2b1dd0eddb0dd5", "question": {"question_id": "sample_226_a1509_q0", "video_id": 226, "video_path": "./videos/sample_226_real.mp4", "annotation_index": 1509, "question_index": 0, "question": "Based on the current explanation, what might the speaker do next?", "options": ["A. Explain the next division step using the tabular.", "B. Talk about prime numbers.", "C. Introduce a new mathematical operation.", "D. Discuss the properties of multiplication."], "answer": "A", "time_stamp_s": 521, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [492, 522], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_226_a1509_q0", "video_id": 226, "time_stamp_s": 521, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2408355441825a982c97e43ef7a1113ccf668c56c9d12a159679bcbc6b276e54", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [491.02386666666666, 492.02486666666664, 493.0258666666667, 494.02686666666665, 495.0278666666667, 496.02886666666666, 497.0298666666667, 498.03086666666667, 499.03186666666664, 500.0328666666667, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0175, 519.0185, 520.0195], "recent_frames_sha256": "526fde2990d887022108b104b239c90362eb0550e87ccb051d53377b57add637", "num_recent_frames": 30, "tq": 715959.949982381, "t1": 715971.471530428, "ta": 715971.471530428, "te": 715971.509086628, "first_response_s": 11.521548047079705, "answer_total_s": 11.559104247018695, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_226_a1509_q0", "video_id": 226, "time_stamp_s": 521, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "287faeb2cc5ab1e344e1a246dead2832dd8e070ae5fa3a8bbe7e37a10dbe3274", "condition_order": ["recent", "notes"], "memory": "[210-240s] - A man in a white \"Math Antics\" t-shirt stands against a grid background, gesturing toward a division problem (4)9 with text \"How Many To Make Or Almost\" above it.\n- The problem evolves to show \"1\" above the division symbol as the quotient, with a yellow highlight indicating the result.\n- The scene transitions to show three bear heads and a cartoon girl head, with furniture labeled \"Too Small,\" \"Just Right,\" and \"Too Big\" below them, suggesting a visual analogy for the division result.\n[240-270s] - A division problem \"9 ÷ 4\" is displayed with a quotient \"1\" above the division bar.\n- The number \"1\" is circled in yellow, indicating it as the quotient.\n- The subtraction result \"5\" appears below the division bar, labeled as \"Remainder\" in orange text.\n[270-300s] - A man in a white \"Math Antics\" t-shirt gestures while explaining a division problem on a grid background.\n- The division problem \"49 ÷ 4\" is displayed with a quotient of \"1\" and a remainder of \"5\", highlighted with yellow boxes and arrows.\n- Text labels like \"Trouble!\", \"Bigger Than\", and \"Too Small\" appear dynamically to indicate conceptual errors in the division process.\n[300-330s] - A man in a white \"Math Anics\" t-shirt appears, gesturing toward a division problem on screen.  \n- The problem shows \"4)9\" with a \"3\" above the division bar, and \"12\" written below \"9\" after multiplying 4 by 3.  \n- A question mark appears below \"12\", indicating an unresolved step in the calculation.\n[330-360s] - Man in white \"Math Antics\" shirt gestures while speaking against a grid background.  \n- On-screen math problem shows division: 12 ÷ 4 = ? with 3 above 4 and 9 above 12.  \n- Text appears indicating \"1 too small\" and \"3 too BIG\" as options for the answer.\n[360-390s] - Man in white \"Math Antics\" shirt gestures while numbers \"1 too small\" and \"3 too BIG\" appear on screen.  \n- Number \"2\" appears centered as the correct guess, replacing the previous options.  \n- Long division problem \"4)9\" is shown with \"2\" as quotient, \"8\" as product, and \"1\" as remainder.\n[390-420s] - A division problem (9 ÷ 4) is displayed with a remainder of 1, highlighted by a yellow circle.  \n- Four cartoon faces are aligned vertically to the right of the problem, with cookies appearing beside them.  \n- A man in a white t-shirt with \"math antics\" text appears, gesturing toward the problem.\n[420-450s] - The presenter wears a white t-shirt with \"math antics\" printed on it.\n- The division problem \"23 ÷ 5\" is displayed on the screen, with the dividend \"23\" and divisor \"5\" labeled.\n- The presenter gestures toward the problem as text labels like \"Dividend\" and \"Divisor\" appear above the respective numbers.\n[450-480s] - A multiplication table for 5 is displayed, showing 1×5=5, 2×5=10, 3×5=15, 4×5=20, and 5×5=25.\n- The number 23 is shown under a division symbol with 5, indicating a division problem.\n- The number 4 appears above the division symbol, suggesting the quotient is 4, with 20 subtracted from 23 to leave a remainder of 3.\n[480-510s] - A man in a white t-shirt with \"math Antics\" text stands in front of a grid background, gesturing while explaining division.\n- On-screen text displays \"57 ÷ 6\" and \"6)57\" as the division problem.\n- A multiplication table grid appears, showing numbers 1-10 for each multiplier from 1 to 10, likely to aid in understanding division.", "history_tokens": 934, "history_utf8_bytes": 3353, "recent_frame_times_s": [491.02386666666666, 492.02486666666664, 493.0258666666667, 494.02686666666665, 495.0278666666667, 496.02886666666666, 497.0298666666667, 498.03086666666667, 499.03186666666664, 500.0328666666667, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0175, 519.0185, 520.0195], "recent_frames_sha256": "526fde2990d887022108b104b239c90362eb0550e87ccb051d53377b57add637", "num_recent_frames": 30, "tq": 716146.180826045, "t1": 716147.672905931, "ta": 716147.672905931, "te": 716147.974766901, "first_response_s": 1.4920798860257491, "answer_total_s": 1.7939408560050651, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 227, "content_group": "1262e5f3c76600ee4890fb95593ae752deeffa8e701276183d231c75ceac7e63", "question": {"question_id": "sample_227_a623_q0", "video_id": 227, "video_path": "./videos/sample_227_real.mp4", "annotation_index": 623, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. The addition of decimals.", "B. Converting fractions to decimals.", "C. The subtraction of decimals.", "D. The rules for multiplying decimals."], "answer": "A", "time_stamp_s": 66, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_227_a623_q0", "video_id": 227, "time_stamp_s": 66, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8a1c99ec632f975c6cb2162869c42d225f15fc196d44257758ba8675af8ba1ce", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333], "recent_frames_sha256": "e8bfa23ef674a07123c8fd164cde3aa004b8651c181a0b4d35de382630a6fc60", "num_recent_frames": 30, "tq": 710206.101097064, "t1": 710212.568594372, "ta": 710212.568594372, "te": 710212.606082771, "first_response_s": 6.467497308040038, "answer_total_s": 6.504985706997104, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_227_a623_q0", "video_id": 227, "time_stamp_s": 66, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "02b39bb5f80e7e734d7fa7fed3ba06b2b036219b1b838e9a2b4ab37c91a98a95", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a wooden background, speaking to the camera.  \n- Text overlays appear sequentially: \"Decimal Arithmetic,\" \"Multi-digit Arithmetic,\" \"Whole Numbers,\" and \"Modify the procedures.\"  \n- The man gestures with his hands while speaking, indicating different mathematical concepts as text appears on screen.\n[30-60s] - A man in a white \"Math Antics\" t-shirt stands against a wooden background, gesturing while speaking.\n- On-screen text appears: \"Decimal Numbers,\" followed by \"Multi-Digit Addition,\" \"Multi-Digit Subtraction,\" \"Multi-Digit Multiplication Part 1,\" and \"Long Division\" in floating boxes.\n- Visual comparison of decimal (3.27 + 4.15) and whole numbers (327 + 415) appears, with the word \"differences\" highlighted in red.", "history_tokens": 197, "history_utf8_bytes": 791, "recent_frame_times_s": [36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333], "recent_frames_sha256": "e8bfa23ef674a07123c8fd164cde3aa004b8651c181a0b4d35de382630a6fc60", "num_recent_frames": 30, "tq": 710252.868694205, "t1": 710260.01909596, "ta": 710260.01909596, "te": 710260.057784677, "first_response_s": 7.150401755003259, "answer_total_s": 7.189090472063981, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 227, "content_group": "1262e5f3c76600ee4890fb95593ae752deeffa8e701276183d231c75ceac7e63", "question": {"question_id": "sample_227_a624_q0", "video_id": 227, "video_path": "./videos/sample_227_real.mp4", "annotation_index": 624, "question_index": 0, "question": "What is the teacher likely to explain next?", "options": ["A. How to correctly align the decimal points when adding.", "B. How to subtract decimal numbers.", "C. How to multiply decimal numbers.", "D. How to divide decimal numbers."], "answer": "A", "time_stamp_s": 180, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [151, 181], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_227_a624_q0", "video_id": 227, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "81d9c6aba7f7ee6ac3d9dc0c305bfacce6475db5ac4742ec275b0626f1a10f30", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667], "recent_frames_sha256": "69a482ce3fca4c3545ed4a6f26a637d80675f454c30e896f7e7d443abf5d81a7", "num_recent_frames": 30, "tq": 710212.64015327, "t1": 710220.021302199, "ta": 710220.021302199, "te": 710220.058793669, "first_response_s": 7.381148929009214, "answer_total_s": 7.41864039900247, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_227_a624_q0", "video_id": 227, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f6b36a786dbe2896d3f33d544e7c271644cb210f1fbec4b0d7bcb1d525693878", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a wooden background, speaking to the camera.  \n- Text overlays appear sequentially: \"Decimal Arithmetic,\" \"Multi-digit Arithmetic,\" \"Whole Numbers,\" and \"Modify the procedures.\"  \n- The man gestures with his hands while speaking, indicating different mathematical concepts as text appears on screen.\n[30-60s] - A man in a white \"Math Antics\" t-shirt stands against a wooden background, gesturing while speaking.\n- On-screen text appears: \"Decimal Numbers,\" followed by \"Multi-Digit Addition,\" \"Multi-Digit Subtraction,\" \"Multi-Digit Multiplication Part 1,\" and \"Long Division\" in floating boxes.\n- Visual comparison of decimal (3.27 + 4.15) and whole numbers (327 + 415) appears, with the word \"differences\" highlighted in red.\n[60-90s] - A man in a white \"Math Antics\" t-shirt stands against a grid background, gesturing toward a math problem displayed on screen.\n- The problem \"153 + 19 =\" appears, with the \"ones' place\" highlighted as the man explains the addition process.\n- The solution \"172\" is shown after the man completes the calculation, with an arrow pointing to the result.\n[90-120s] - A man in a white t-shirt with \"math Antics\" text stands beside a grid background, gesturing toward a decimal addition problem (26.4 + 8.31) displayed on screen.\n- Arrows point to \"ones' place\" and \"tenths' place\" on the numbers, indicating place value components of the decimal addition.\n- The screen transitions to display \"Decimal Numbers\" with examples (0.1, 0.12, 0.123, 0.1234) as the man continues explaining.\n[120-150s] - A man in a white t-shirt with \"math antics\" text stands against a grid background, explaining math concepts.\n- On-screen text displays \"10.8 + 5.34\" with a red arrow pointing to \"not aligned\" above the numbers.\n- The numbers are adjusted to \"10.80\" and \"05.34\" with text overlays indicating \"No Problem!\" and \"put a zero there\" to align decimal places.\n[150-180s] - A red arrow points to the \"ones' place\" above the digit '0' in \"10.80\" and '0' in \"05.34\".  \n- A blue arrow then points to the \"hundredths' place\" above the digit '0' in \"10.80\" and '4' in \"05.34\".  \n- The number \"16.14\" appears as the result, followed by a red \"wrong!\" label.", "history_tokens": 637, "history_utf8_bytes": 2235, "recent_frame_times_s": [150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667], "recent_frames_sha256": "69a482ce3fca4c3545ed4a6f26a637d80675f454c30e896f7e7d443abf5d81a7", "num_recent_frames": 30, "tq": 710296.820771936, "t1": 710298.094722147, "ta": 710298.094722147, "te": 710298.131793145, "first_response_s": 1.2739502110052854, "answer_total_s": 1.3110212089959532, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 227, "content_group": "1262e5f3c76600ee4890fb95593ae752deeffa8e701276183d231c75ceac7e63", "question": {"question_id": "sample_227_a625_q0", "video_id": 227, "video_path": "./videos/sample_227_real.mp4", "annotation_index": 625, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to multiply whole numbers.", "B. The importance of carrying over digits.", "C. The process of correctly placing the decimal in the product.", "D. How to add the products from multiplication."], "answer": "C", "time_stamp_s": 328, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [302, 332], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_227_a625_q0", "video_id": 227, "time_stamp_s": 328, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f2509812444bd665635b7b4fbc5cf9dccf7de3e178bdb9f1ac48c5083456ed4c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267], "recent_frames_sha256": "40e490385e89fb1b54023437c46db11b30561eaaf1f2737afa986709bb1e3375", "num_recent_frames": 30, "tq": 710220.071794206, "t1": 710221.362050748, "ta": 710221.362050748, "te": 710221.402792724, "first_response_s": 1.2902565419208258, "answer_total_s": 1.3309985179221258, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_227_a625_q0", "video_id": 227, "time_stamp_s": 328, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "96cd30999f62bb162a57cea08feb105b7b0c63bf8f643fc6eccba6c5c1365ecb", "condition_order": ["recent", "notes"], "memory": "[30-60s] - A man in a white \"Math Antics\" t-shirt stands against a wooden background, gesturing while speaking.\n- On-screen text appears: \"Decimal Numbers,\" followed by \"Multi-Digit Addition,\" \"Multi-Digit Subtraction,\" \"Multi-Digit Multiplication Part 1,\" and \"Long Division\" in floating boxes.\n- Visual comparison of decimal (3.27 + 4.15) and whole numbers (327 + 415) appears, with the word \"differences\" highlighted in red.\n[60-90s] - A man in a white \"Math Antics\" t-shirt stands against a grid background, gesturing toward a math problem displayed on screen.\n- The problem \"153 + 19 =\" appears, with the \"ones' place\" highlighted as the man explains the addition process.\n- The solution \"172\" is shown after the man completes the calculation, with an arrow pointing to the result.\n[90-120s] - A man in a white t-shirt with \"math Antics\" text stands beside a grid background, gesturing toward a decimal addition problem (26.4 + 8.31) displayed on screen.\n- Arrows point to \"ones' place\" and \"tenths' place\" on the numbers, indicating place value components of the decimal addition.\n- The screen transitions to display \"Decimal Numbers\" with examples (0.1, 0.12, 0.123, 0.1234) as the man continues explaining.\n[120-150s] - A man in a white t-shirt with \"math antics\" text stands against a grid background, explaining math concepts.\n- On-screen text displays \"10.8 + 5.34\" with a red arrow pointing to \"not aligned\" above the numbers.\n- The numbers are adjusted to \"10.80\" and \"05.34\" with text overlays indicating \"No Problem!\" and \"put a zero there\" to align decimal places.\n[150-180s] - A red arrow points to the \"ones' place\" above the digit '0' in \"10.80\" and '0' in \"05.34\".  \n- A blue arrow then points to the \"hundredths' place\" above the digit '0' in \"10.80\" and '4' in \"05.34\".  \n- The number \"16.14\" appears as the result, followed by a red \"wrong!\" label.\n[180-210s] - A man in a white t-shirt with \"math antics\" text stands beside a grid background, gesturing toward a decimal addition problem (10.80 + 05.34 = 16.14).\n- The problem is highlighted with a yellow circle around the result \"16.14\" as the man explains the calculation.\n- The screen transitions to a new problem: \"7.122 - 3.41 =\", with a red arrow pointing to the decimal points, emphasizing alignment.\n[210-240s] - A subtraction problem (7.122 - 3.410) is displayed with intermediate steps showing the result as 3.712.  \n- A man in a \"Math Antics\" t-shirt appears, introducing decimal operations with text overlays like \"Decimal + Decimal -\".  \n- A multiplication problem (561 × 47) is shown, followed by a simplified version (5.61 × 4.7) with the text \"Good News\" and \"NOT MUCH HARDER THAN\".\n[240-270s] - Man in white \"Math Antics\" shirt gestures while explaining multiplication problem on screen.\n- On-screen text changes from \"NOT MUCH HARDER THAN\" to \"Clever Way\" then to \"The Key: 561 × 47 = PRETEND\".\n- A second man enters, wearing a hood and holding a red lightsaber, engaging in conversation with the first man.\n[270-300s] - Man in hoodie holds a stick while standing beside the other man, both facing forward.  \n- Man in white t-shirt gestures with hands while speaking, with a math problem displayed on screen.  \n- On-screen text shows \"3.65 × 2.4 =\" followed by \"PRETEND\" appearing in orange letters.", "history_tokens": 966, "history_utf8_bytes": 3295, "recent_frame_times_s": [298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267], "recent_frames_sha256": "40e490385e89fb1b54023437c46db11b30561eaaf1f2737afa986709bb1e3375", "num_recent_frames": 30, "tq": 710331.29471037, "t1": 710342.448997139, "ta": 710342.448997139, "te": 710342.852057736, "first_response_s": 11.154286768985912, "answer_total_s": 11.557347366004251, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 227, "content_group": "1262e5f3c76600ee4890fb95593ae752deeffa8e701276183d231c75ceac7e63", "question": {"question_id": "sample_227_a626_q0", "video_id": 227, "video_path": "./videos/sample_227_real.mp4", "annotation_index": 626, "question_index": 0, "question": "What topic might the speaker explain next?", "options": ["A. The steps for decimal addition.", "B. The steps for decimal subtraction.", "C. The principles of decimal division.", "D. The basics of whole number multiplication."], "answer": "C", "time_stamp_s": 482, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [453, 483], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_227_a626_q0", "video_id": 227, "time_stamp_s": 482, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "117344458f70af60db84ead0d548367276616197cbe2e2720ed5e8ddaa66cde9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [452.01823333333334, 453.0192333333333, 454.02023333333335, 455.0212333333333, 456.02223333333336, 457.02323333333334, 458.0242333333333, 459.02523333333335, 460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667], "recent_frames_sha256": "4af321048d7da66b89617bbaba50e2fa67e6f5f51132e357f78bfe9ccf1473ce", "num_recent_frames": 30, "tq": 710221.440332535, "t1": 710229.033619576, "ta": 710229.033619576, "te": 710229.073084919, "first_response_s": 7.593287041061558, "answer_total_s": 7.632752384059131, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_227_a626_q0", "video_id": 227, "time_stamp_s": 482, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f56b01ab2b8d3fb51b2cc827a3b45ddf6534dc991680fc362b70f172d45b3830", "condition_order": ["recent", "notes"], "memory": "[210-240s] - A subtraction problem (7.122 - 3.410) is displayed with intermediate steps showing the result as 3.712.  \n- A man in a \"Math Antics\" t-shirt appears, introducing decimal operations with text overlays like \"Decimal + Decimal -\".  \n- A multiplication problem (561 × 47) is shown, followed by a simplified version (5.61 × 4.7) with the text \"Good News\" and \"NOT MUCH HARDER THAN\".\n[240-270s] - Man in white \"Math Antics\" shirt gestures while explaining multiplication problem on screen.\n- On-screen text changes from \"NOT MUCH HARDER THAN\" to \"Clever Way\" then to \"The Key: 561 × 47 = PRETEND\".\n- A second man enters, wearing a hood and holding a red lightsaber, engaging in conversation with the first man.\n[270-300s] - Man in hoodie holds a stick while standing beside the other man, both facing forward.  \n- Man in white t-shirt gestures with hands while speaking, with a math problem displayed on screen.  \n- On-screen text shows \"3.65 × 2.4 =\" followed by \"PRETEND\" appearing in orange letters.\n[300-330s] - A multiplication problem (365 × 24) is displayed with intermediate steps and final result (8760) on a grid background.\n- The problem is then shown with decimal numbers (3.65 × 2.4) and a \"NOT!\" label indicating an incorrect approach.\n- A man in a \"Math Antics\" t-shirt appears, gesturing toward the problem as it transitions to demonstrate decimal multiplication.\n[330-360s] - The multiplication problem \"3.65 × 2.4\" is displayed with a grid background, and the word \"SHIFTED\" appears below it with an arrow.\n- The decimal points in both numbers are highlighted, and the text \"DO HAVE DECIMAL POINTS\" appears above the problem.\n- The numbers are visually shifted to the right, aligning the decimal points, as indicated by the text \"SHIFT to the Right\" and an arrow.\n[360-390s] - A multiplication problem (365 × 24) is displayed with text \"Changed the Numbers\" beside it.\n- The numbers 365 and 24 are highlighted, and \"100×\" and \"10×\" appear next to them, indicating scaling.\n- A man in a \"Math Antics\" shirt appears, gesturing toward the problem, which now shows 10000 × 10 × 10 × 10, with a large result of 8760 below.\n[390-420s] - The multiplication problem 365 × 24 is displayed with intermediate steps (1460, 7300) and final result 8760, all on a grid background.\n- Red arrows point to the numbers 1460 and 7300, indicating their alignment and contribution to the final sum.\n- The final result 8760 is shown with a red underline, and the text \"same amount: opposite direction\" appears below, suggesting a conceptual relationship between the steps.\n[420-450s] - A multiplication problem (3.65 × 2.4) is displayed with intermediate steps and a final result of 8.760.  \n- Red arrows point to the numbers 3.65 and 2.4, highlighting them.  \n- A man in a white t-shirt with \"math Antics\" appears, gesturing toward the problem.\n[450-480s] - A man in a white t-shirt with \"math Antics\" text stands in front of a grid background, gesturing while explaining.\n- The screen displays a multiplication problem (.561 × 4.7) with intermediate steps and the final result (26367), highlighted with colored boxes.\n- Text \"TOTAL SHIFT\" appears in red at the top left, and a red arrow points to the final result at 4:58.", "history_tokens": 925, "history_utf8_bytes": 3242, "recent_frame_times_s": [452.01823333333334, 453.0192333333333, 454.02023333333335, 455.0212333333333, 456.02223333333336, 457.02323333333334, 458.0242333333333, 459.02523333333335, 460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667], "recent_frames_sha256": "4af321048d7da66b89617bbaba50e2fa67e6f5f51132e357f78bfe9ccf1473ce", "num_recent_frames": 30, "tq": 710390.397344821, "t1": 710397.758740816, "ta": 710397.758740816, "te": 710398.021240747, "first_response_s": 7.36139599501621, "answer_total_s": 7.623895925935358, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 227, "content_group": "1262e5f3c76600ee4890fb95593ae752deeffa8e701276183d231c75ceac7e63", "question": {"question_id": "sample_227_a627_q0", "video_id": 227, "video_path": "./videos/sample_227_real.mp4", "annotation_index": 627, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. Simplifying square roots.", "B. Finding least common multiples.", "C. Shifting the decimal point in both numbers.", "D. Converting decimals to fractions."], "answer": "C", "time_stamp_s": 633, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [604, 634], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_227_a627_q0", "video_id": 227, "time_stamp_s": 633, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "da18c4bf1be500f21c9bd55b7b5777233a5f5d0cb9dd9cf0a44ee1a02d6b0b41", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074, 609.0084, 610.0094, 611.0104, 612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0174, 619.0184, 620.0194, 621.0204, 622.0214, 623.0224, 624.0234, 625.0244, 626.0254, 627.0264, 628.0274, 629.0284, 630.0294, 631.0304, 632.0314], "recent_frames_sha256": "22b4ba4b117add82c25fd3fc17cb4943cc5a3a3615a6fd0ca93e21b52a63c266", "num_recent_frames": 30, "tq": 710229.08689851, "t1": 710235.191555613, "ta": 710235.191555613, "te": 710235.23045464, "first_response_s": 6.104657102958299, "answer_total_s": 6.143556130002253, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_227_a627_q0", "video_id": 227, "time_stamp_s": 633, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ae4709ecc45f482bf5312e5e3085b69548497060e533943afd7fcc4f95a83a0f", "condition_order": ["recent", "notes"], "memory": "[360-390s] - A multiplication problem (365 × 24) is displayed with text \"Changed the Numbers\" beside it.\n- The numbers 365 and 24 are highlighted, and \"100×\" and \"10×\" appear next to them, indicating scaling.\n- A man in a \"Math Antics\" shirt appears, gesturing toward the problem, which now shows 10000 × 10 × 10 × 10, with a large result of 8760 below.\n[390-420s] - The multiplication problem 365 × 24 is displayed with intermediate steps (1460, 7300) and final result 8760, all on a grid background.\n- Red arrows point to the numbers 1460 and 7300, indicating their alignment and contribution to the final sum.\n- The final result 8760 is shown with a red underline, and the text \"same amount: opposite direction\" appears below, suggesting a conceptual relationship between the steps.\n[420-450s] - A multiplication problem (3.65 × 2.4) is displayed with intermediate steps and a final result of 8.760.  \n- Red arrows point to the numbers 3.65 and 2.4, highlighting them.  \n- A man in a white t-shirt with \"math Antics\" appears, gesturing toward the problem.\n[450-480s] - A man in a white t-shirt with \"math Antics\" text stands in front of a grid background, gesturing while explaining.\n- The screen displays a multiplication problem (.561 × 4.7) with intermediate steps and the final result (26367), highlighted with colored boxes.\n- Text \"TOTAL SHIFT\" appears in red at the top left, and a red arrow points to the final result at 4:58.\n[480-510s] - A man in a white t-shirt with \"math Antics\" text stands against a grid background, gesturing while explaining.\n- On-screen, a long division problem \"8)2.24\" appears, with intermediate steps shown: \"02\", \"-16\", \"64\", and \"0\" as the result.\n- The problem is visually annotated with labels like \"decimal divisor\" and \"decimal dividend\" appearing near the numbers.\n[510-540s] - A long division problem (4)12.64) is displayed with intermediate steps showing quotient 3.16 and subtraction results.\n- A man in a white t-shirt with \"Math Anness\" appears, gesturing toward the division problem.\n- Text overlays appear, including \"IF\" and \"Both,\" indicating a conditional or comparative mathematical concept.\n[540-570s] - A man in a white t-shirt with \"math Antics\" text stands against a grid background, gesturing toward a division problem.\n- The problem \"1.5)6.45\" appears on screen, with \"simple trick\" and \"SHIFT\" text overlays indicating a method.\n- The number \"1.5\" is circled, and \"ALSO\" appears below, suggesting a related concept or step in the calculation.\n[570-600s] - A red arrow points to the digit '1' in '15' within the division problem '15)6.45'.\n- The text 'ALSO' appears in red below the problem, followed by 'SAME amount' in yellow.\n- The problem '15)6.45' is circled in yellow, with the text 'COOL PART' appearing above it.\n[600-630s] - A man in a white t-shirt with \"math Antics\" text stands beside a grid background, gesturing toward two division problems: 15)64.5 and 1.5)64.5.\n- The text \"same amount same direction\" appears above the problems, highlighting their proportional relationship.\n- The screen transitions to display \"Equivalent Fractions\" as the topic, followed by a visual of 1/2 being multiplied by 10 to become 10/20, with a pie chart illustrating the fraction equivalence.", "history_tokens": 936, "history_utf8_bytes": 3261, "recent_frame_times_s": [603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074, 609.0084, 610.0094, 611.0104, 612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0174, 619.0184, 620.0194, 621.0204, 622.0214, 623.0224, 624.0234, 625.0244, 626.0254, 627.0264, 628.0274, 629.0284, 630.0294, 631.0304, 632.0314], "recent_frames_sha256": "22b4ba4b117add82c25fd3fc17cb4943cc5a3a3615a6fd0ca93e21b52a63c266", "num_recent_frames": 30, "tq": 710434.413740382, "t1": 710436.659464711, "ta": 710436.659464711, "te": 710436.869009727, "first_response_s": 2.245724329026416, "answer_total_s": 2.4552693450823426, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 228, "content_group": "d7a08075502175e851985f08e09e241827043f05ef66b5cd699002034f04afab", "question": {"question_id": "sample_228_a1165_q0", "video_id": 228, "video_path": "./videos/sample_228_real.mp4", "annotation_index": 1165, "question_index": 0, "question": "What is the speaker likely to explain next?", "options": ["A. How to solve the division problem using a different method.", "B. How to add partial quotients.", "C. The concept of division with partial quotients.", "D. The importance of understanding division."], "answer": "C", "time_stamp_s": 11, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_228_a1165_q0", "video_id": 228, "time_stamp_s": 11, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "89eada67f70097a9dc51760e377dcc37e2a73fa131d94f05bdb08f50194dd8e4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01], "recent_frames_sha256": "64fd0a652144d00bbbf34d80cfa2bdf2af6070b110cdcb58a7ec86880f77de1d", "num_recent_frames": 11, "tq": 716624.83072525, "t1": 716635.301797114, "ta": 716635.301797114, "te": 716635.339077505, "first_response_s": 10.471071864012629, "answer_total_s": 10.508352255099453, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_228_a1165_q0", "video_id": 228, "time_stamp_s": 11, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4e647f7d8c1f816c2bf325e0527a40d6a1658e2424e6a3184d3fb69575f9ea41", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01], "recent_frames_sha256": "64fd0a652144d00bbbf34d80cfa2bdf2af6070b110cdcb58a7ec86880f77de1d", "num_recent_frames": 11, "tq": 716664.923983403, "t1": 716669.816051772, "ta": 716669.816051772, "te": 716670.19485043, "first_response_s": 4.8920683689648286, "answer_total_s": 5.2708670269930735, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 228, "content_group": "d7a08075502175e851985f08e09e241827043f05ef66b5cd699002034f04afab", "question": {"question_id": "sample_228_a1166_q0", "video_id": 228, "video_path": "./videos/sample_228_real.mp4", "annotation_index": 1166, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. Multiplying 6 by the divisor.", "B. Subtracting 6 from the dividend.", "C. 2 is too small.", "D. Adding 6 to the quotient."], "answer": "C", "time_stamp_s": 204, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [175, 205], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_228_a1166_q0", "video_id": 228, "time_stamp_s": 204, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f7600d85ccc2ccf73958ce9a193aab70c05f83347229d6fc1f5639adca0003a0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028], "recent_frames_sha256": "3bedd55d976e8fb4149a7d6b5a06c458e10f693472b943e73cbc3cc81a4d08f1", "num_recent_frames": 30, "tq": 716635.350690141, "t1": 716644.22991376, "ta": 716644.22991376, "te": 716644.451078873, "first_response_s": 8.879223619005643, "answer_total_s": 9.100388732040301, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_228_a1166_q0", "video_id": 228, "time_stamp_s": 204, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8be2b4d2f4e994d7cb83e8aa1355c270d68325c2330982279fe79779ceb40c3c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a blue background, gesturing as he speaks.  \n- The word \"Answer\" appears in green with yellow arrows pointing toward it, then fades.  \n- The math problem \"16 ÷ 5\" appears on screen, followed by the word \"Model\" in red, then fades.\n[30-60s] - The equation \"16 ÷ 5\" appears with a red arrow pointing to the division symbol, indicating the operation to be performed.\n- Five red-bordered groups are formed, each containing three circles, with one circle remaining outside the groups, labeled as \"Remainder.\"\n- The final result \"16 ÷ 5 = 3r1\" is displayed, showing the quotient and remainder.\n[60-90s] - A man in a white t-shirt labeled \"math Antics\" gestures toward three stacked screens displaying division methods.  \n- Another man in a sweater points to the text \"Standard Algorithm\" or \"Standard Method\" on the grid background.  \n- The screen transitions to a division problem \"5)16\" with a red arrow indicating \"digit by digit\" and a \"0\" appearing above the division bar.\n[90-120s] - A man in a white \"Math Antics\" t-shirt appears, standing against a grid background, introducing the \"Method of Partial Quotients\" with text overlays.  \n- The video displays a division problem (16 ÷ 5) with partial quotient steps, including a multiplication table and visual grouping of circles representing the quotient.  \n- Text overlays sequentially appear, highlighting \"Advantages\" and \"Disadvantages\" as the man gestures, indicating a comparison of the method's features.\n[120-150s] - A man in a white \"Math Antics\" t-shirt stands beside a grid background, gesturing toward a displayed long division problem (5 into 16) and its solution (3 with remainder 1).\n- The screen shows a multiplication fact: \"3 × 5 = 15,\" illustrating the standard method's step.\n- A multiplication table appears, highlighting the row for 5 and column for 3, with the number 15 marked in red, visually connecting the multiplication to the division problem.\n[150-180s] - The presenter gestures toward the division problem \"5)16\" as red arrows highlight the \"5\" and \"16\" numerals.\n- Text appears below the problem: \"Any Multiple\" followed by \"2×5=10\", with the \"2\" and \"5\" highlighted in yellow.\n- The \"5\" in the division problem is struck through with a red line, indicating it is being canceled or removed.", "history_tokens": 590, "history_utf8_bytes": 2341, "recent_frame_times_s": [174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028], "recent_frames_sha256": "3bedd55d976e8fb4149a7d6b5a06c458e10f693472b943e73cbc3cc81a4d08f1", "num_recent_frames": 30, "tq": 716708.918947736, "t1": 716716.238943092, "ta": 716716.238943092, "te": 716716.467240168, "first_response_s": 7.319995355908759, "answer_total_s": 7.5482924319803715, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 228, "content_group": "d7a08075502175e851985f08e09e241827043f05ef66b5cd699002034f04afab", "question": {"question_id": "sample_228_a1167_q0", "video_id": 228, "video_path": "./videos/sample_228_real.mp4", "annotation_index": 1167, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to subtract the next two numbers.", "B. How to add the remainder to the divisor.", "C. How to multiply 100 by 35 again.", "D. How to choose a number to subtract from 2928."], "answer": "D", "time_stamp_s": 380, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [350, 380], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_228_a1167_q0", "video_id": 228, "time_stamp_s": 380, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "66fefd418b499ee258f9689370f9261e20fe7e9102c489792549c60bde426932", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667], "recent_frames_sha256": "8886fe6a74e06919dab469f01578c5ce59674691584dac098b0981ef8ef50639", "num_recent_frames": 30, "tq": 716644.473220042, "t1": 716650.681614875, "ta": 716650.681614875, "te": 716650.718986415, "first_response_s": 6.2083948330255225, "answer_total_s": 6.24576637300197, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_228_a1167_q0", "video_id": 228, "time_stamp_s": 380, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f96cb23dc7824ed607f15bf1c80f51f782a2d6af8710fc2846ef4f05f12ee501", "condition_order": ["recent", "notes"], "memory": "[90-120s] - A man in a white \"Math Antics\" t-shirt appears, standing against a grid background, introducing the \"Method of Partial Quotients\" with text overlays.  \n- The video displays a division problem (16 ÷ 5) with partial quotient steps, including a multiplication table and visual grouping of circles representing the quotient.  \n- Text overlays sequentially appear, highlighting \"Advantages\" and \"Disadvantages\" as the man gestures, indicating a comparison of the method's features.\n[120-150s] - A man in a white \"Math Antics\" t-shirt stands beside a grid background, gesturing toward a displayed long division problem (5 into 16) and its solution (3 with remainder 1).\n- The screen shows a multiplication fact: \"3 × 5 = 15,\" illustrating the standard method's step.\n- A multiplication table appears, highlighting the row for 5 and column for 3, with the number 15 marked in red, visually connecting the multiplication to the division problem.\n[150-180s] - The presenter gestures toward the division problem \"5)16\" as red arrows highlight the \"5\" and \"16\" numerals.\n- Text appears below the problem: \"Any Multiple\" followed by \"2×5=10\", with the \"2\" and \"5\" highlighted in yellow.\n- The \"5\" in the division problem is struck through with a red line, indicating it is being canceled or removed.\n[180-210s] - A man in a white t-shirt with \"Math Antics\" text stands beside a division problem: 5 into 16, with a red circle over the 5 and a \"2\" written beside it.\n- The problem shows \"2×5=10\" below, then \"10\" subtracted from 16, leaving a remainder of \"6\".\n- Text \"Keep Dividing\" appears above the problem, with a red arrow pointing to the \"2\" and the word \"too small\" appearing below it.\n[210-240s] - A long division problem with 5 as divisor and 162 as dividend is displayed, showing intermediate steps of subtraction and remainder.\n- Red arrows point to the divisor (5) and the remainder (1), highlighting key components of the calculation.\n- A yellow circle encloses the final remainder (1), emphasizing its significance in the division process.\n[240-270s] - A man in a white t-shirt with \"math Antics\" text stands beside a grid background, gesturing toward a division problem.\n- The division problem \"5 into 16\" is displayed with partial quotients: 2 and 1, and a remainder of 3.\n- The number \"3\" appears above the division symbol, indicating the final quotient or remainder.\n[270-300s] - A long division problem (16 ÷ 5) is displayed with a quotient of 3 and a remainder of 1, labeled \"Partial Quotients\" in red text.  \n- The word \"Don't Forget!\" appears in purple text, followed by \"Remainder\" in red, emphasizing the remainder value.  \n- A man in a white t-shirt with \"Math Antics\" printed on it appears, gesturing toward the division problem as it transitions to a \"Standard Method\" format.\n[300-330s] - A man in a white \"Math Antics\" t-shirt stands beside a grid background, gesturing toward a displayed long division problem (35 into 6428).  \n- The screen shows a multiplication table for 35, with products from 1×35 to 9×35, indicating a method for partial quotients.  \n- A large red question mark appears over a grid of numbers, suggesting an unresolved step or concept in the division process.\n[330-360s] - Man in white t-shirt with \"math Antics\" logo stands against grid background, gesturing while text \"Partial Quotients Method\" appears.  \n- Text \"close enough step\" appears in red, followed by \"step\" repeated three times, then the division problem \"35√6428\" is displayed.  \n- Red arrow points to the divisor \"35\" in the division problem, and multiplication equation \"100 × 35 = 3500\" appears below.", "history_tokens": 954, "history_utf8_bytes": 3629, "recent_frame_times_s": [350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667], "recent_frames_sha256": "8886fe6a74e06919dab469f01578c5ce59674691584dac098b0981ef8ef50639", "num_recent_frames": 30, "tq": 716770.520776986, "t1": 716776.195015014, "ta": 716776.195015014, "te": 716776.234452752, "first_response_s": 5.6742380280047655, "answer_total_s": 5.713675766019151, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 228, "content_group": "d7a08075502175e851985f08e09e241827043f05ef66b5cd699002034f04afab", "question": {"question_id": "sample_228_a1168_q0", "video_id": 228, "video_path": "./videos/sample_228_real.mp4", "annotation_index": 1168, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to simplify the calculation further.", "B. The application of division in real-life problems.", "C. Another example using a more complex number.", "D. The advantage of using small steps in division."], "answer": "D", "time_stamp_s": 544, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [525, 555], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_228_a1168_q0", "video_id": 228, "time_stamp_s": 544, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "59043ac96a701f7f34c9bb95044f8331eb310f4f3adcece34da3b114842f2c32", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [514.0135, 515.0145, 516.0155, 517.0165, 518.0175, 519.0185, 520.0195, 521.0205, 522.0215, 523.0225, 524.0235, 525.0245, 526.0255, 527.0265, 528.0275, 529.0285, 530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334], "recent_frames_sha256": "b956de0bfb2fd0b2dd4dab884fe3a26166e7f4b2d5e870839037035a5ffec29f", "num_recent_frames": 30, "tq": 716650.740277085, "t1": 716657.489963305, "ta": 716657.489963305, "te": 716657.527375213, "first_response_s": 6.749686219962314, "answer_total_s": 6.787098127999343, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_228_a1168_q0", "video_id": 228, "time_stamp_s": 544, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "97789e5698428ad4778320094e50b469b4b285324162510f8ce7a0d05c42a512", "condition_order": ["recent", "notes"], "memory": "[270-300s] - A long division problem (16 ÷ 5) is displayed with a quotient of 3 and a remainder of 1, labeled \"Partial Quotients\" in red text.  \n- The word \"Don't Forget!\" appears in purple text, followed by \"Remainder\" in red, emphasizing the remainder value.  \n- A man in a white t-shirt with \"Math Antics\" printed on it appears, gesturing toward the division problem as it transitions to a \"Standard Method\" format.\n[300-330s] - A man in a white \"Math Antics\" t-shirt stands beside a grid background, gesturing toward a displayed long division problem (35 into 6428).  \n- The screen shows a multiplication table for 35, with products from 1×35 to 9×35, indicating a method for partial quotients.  \n- A large red question mark appears over a grid of numbers, suggesting an unresolved step or concept in the division process.\n[330-360s] - Man in white t-shirt with \"math Antics\" logo stands against grid background, gesturing while text \"Partial Quotients Method\" appears.  \n- Text \"close enough step\" appears in red, followed by \"step\" repeated three times, then the division problem \"35√6428\" is displayed.  \n- Red arrow points to the divisor \"35\" in the division problem, and multiplication equation \"100 × 35 = 3500\" appears below.\n[360-390s] - A long division problem (35 into 6428) is displayed with \"100\" as the multiplier and \"3500\" as the product of 100×35.\n- The subtraction step shows \"6428 - 3500 = 2928\" with the result \"2928\" appearing below.\n- A man in a \"math Antics\" t-shirt appears, gesturing toward the problem, with a red question mark appearing next to \"2928\" indicating an unresolved step.\n[390-420s] - The division problem 35 into 6428 is shown with 100 as the first trial quotient.\n- The text \"10×35 = 350\" appears, followed by \"too small?\" indicating the result is insufficient.\n- The text \"double?\" appears next to \"10×35 = 350\", leading to \"20×35 = 700\" as the next trial quotient.\n[420-450s] - A division problem (6428 ÷ 35) is displayed with intermediate steps: 3500 subtracted from 6428, leaving 2928; then 1400 subtracted from 2928, leaving 1528.\n- The text \"double?\" appears next to \"100\" and \"40\", indicating a multiplication check for 20×35=700 and 40×35=1400.\n- The number \"1528\" is highlighted in yellow at the end of\n[450-480s] - A long division problem (6428 ÷ 35) is displayed with intermediate steps and remainders.  \n- The final remainder \"128\" is highlighted in blue, with a yellow circle drawn around it.  \n- The text \"Getting Closer!\" appears in green at the bottom of the screen.\n[480-510s] - The long division problem 6428 ÷ 35 is displayed with intermediate steps and remainders.\n- The final remainder \"58\" is shown below the last subtraction step, indicating the division is not exact.\n- The number \"1\" appears at the bottom right, likely representing the quotient's final digit or a correction step.\n[510-540s] - A long division problem (35 into 6428) is displayed with partial quotients added step-by-step.  \n- The final answer \"183 r23\" appears at the bottom right, labeled \"Final Answer\".  \n- The presenter gestures toward the problem while standing to the right of the screen.", "history_tokens": 948, "history_utf8_bytes": 3145, "recent_frame_times_s": [514.0135, 515.0145, 516.0155, 517.0165, 518.0175, 519.0185, 520.0195, 521.0205, 522.0215, 523.0225, 524.0235, 525.0245, 526.0255, 527.0265, 528.0275, 529.0285, 530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334], "recent_frames_sha256": "b956de0bfb2fd0b2dd4dab884fe3a26166e7f4b2d5e870839037035a5ffec29f", "num_recent_frames": 30, "tq": 716825.998460184, "t1": 716832.327809254, "ta": 716832.327809254, "te": 716832.365870081, "first_response_s": 6.329349070088938, "answer_total_s": 6.3674098970368505, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 228, "content_group": "d7a08075502175e851985f08e09e241827043f05ef66b5cd699002034f04afab", "question": {"question_id": "sample_228_a1169_q0", "video_id": 228, "video_path": "./videos/sample_228_real.mp4", "annotation_index": 1169, "question_index": 0, "question": "What might the teacher explain next?", "options": ["A. How to perform long division.", "B. A different multiplication method for large numbers.", "C. Why use samll steps in division is easier.", "D. Explaining the significance of the answer 49r2."], "answer": "C", "time_stamp_s": 642, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [700, 730], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_228_a1169_q0", "video_id": 228, "time_stamp_s": 642, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "185fafeaedc14ae439e8ac73fff48dc4436a560fbe1cc1c910f2b4177ccc2a1c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0174, 619.0184, 620.0194, 621.0204, 622.0214, 623.0224, 624.0234, 625.0244, 626.0254, 627.0264, 628.0274, 629.0284, 630.0294, 631.0304, 632.0314, 633.0324, 634.0000333333334, 635.0010333333333, 636.0020333333333, 637.0030333333333, 638.0040333333334, 639.0050333333334, 640.0060333333333, 641.0070333333333], "recent_frames_sha256": "c54ec49eaa9c4dd706c1b4a8f354172459e2869caec3fa007bbe6d8d239e41a1", "num_recent_frames": 30, "tq": 716657.551803143, "t1": 716664.873498208, "ta": 716664.873498208, "te": 716664.91250181, "first_response_s": 7.321695065009408, "answer_total_s": 7.360698667005636, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_228_a1169_q0", "video_id": 228, "time_stamp_s": 642, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d7f1a3768f21e21f58bcdd3f823fb53fb160f2f9dd3a6fdb0b082ce66db9f663", "condition_order": ["recent", "notes"], "memory": "[330-360s] - Man in white t-shirt with \"math Antics\" logo stands against grid background, gesturing while text \"Partial Quotients Method\" appears.  \n- Text \"close enough step\" appears in red, followed by \"step\" repeated three times, then the division problem \"35√6428\" is displayed.  \n- Red arrow points to the divisor \"35\" in the division problem, and multiplication equation \"100 × 35 = 3500\" appears below.\n[360-390s] - A long division problem (35 into 6428) is displayed with \"100\" as the multiplier and \"3500\" as the product of 100×35.\n- The subtraction step shows \"6428 - 3500 = 2928\" with the result \"2928\" appearing below.\n- A man in a \"math Antics\" t-shirt appears, gesturing toward the problem, with a red question mark appearing next to \"2928\" indicating an unresolved step.\n[390-420s] - The division problem 35 into 6428 is shown with 100 as the first trial quotient.\n- The text \"10×35 = 350\" appears, followed by \"too small?\" indicating the result is insufficient.\n- The text \"double?\" appears next to \"10×35 = 350\", leading to \"20×35 = 700\" as the next trial quotient.\n[420-450s] - A division problem (6428 ÷ 35) is displayed with intermediate steps: 3500 subtracted from 6428, leaving 2928; then 1400 subtracted from 2928, leaving 1528.\n- The text \"double?\" appears next to \"100\" and \"40\", indicating a multiplication check for 20×35=700 and 40×35=1400.\n- The number \"1528\" is highlighted in yellow at the end of\n[450-480s] - A long division problem (6428 ÷ 35) is displayed with intermediate steps and remainders.  \n- The final remainder \"128\" is highlighted in blue, with a yellow circle drawn around it.  \n- The text \"Getting Closer!\" appears in green at the bottom of the screen.\n[480-510s] - The long division problem 6428 ÷ 35 is displayed with intermediate steps and remainders.\n- The final remainder \"58\" is shown below the last subtraction step, indicating the division is not exact.\n- The number \"1\" appears at the bottom right, likely representing the quotient's final digit or a correction step.\n[510-540s] - A long division problem (35 into 6428) is displayed with partial quotients added step-by-step.  \n- The final answer \"183 r23\" appears at the bottom right, labeled \"Final Answer\".  \n- The presenter gestures toward the problem while standing to the right of the screen.\n[540-570s] - Man in white \"math Antics\" shirt gestures while standing in front of a grid background.  \n- On-screen text displays \"Partial Quotient Method\" and a long division problem (183 ÷ 35).  \n- Text transitions to \"One Advantage\" with multiplication equations (1×35, 2×35, etc.) as the man explains.\n[570-600s] - Man in white \"Math Antics\" shirt gestures toward traditional multiplication steps on screen.\n- On-screen text labels \"Traditional Method\" and equations \"3×35=105\" and \"8×35=280\" appear.\n- Visual arrow points to \"trial and error\" text beneath the multiplication steps.\n[600-630s] - Two long division problems are displayed side by side, with yellow arrows labeled \"Own Path\" and \"One Path\" pointing to different steps in the calculations.  \n- Red arrows highlight specific numbers in the problems, indicating steps or differences in the division process.  \n- A man in a white t-shirt with \"Math Antics\" printed on it appears, gesturing toward the problems as he explains the concepts.", "history_tokens": 985, "history_utf8_bytes": 3322, "recent_frame_times_s": [612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0174, 619.0184, 620.0194, 621.0204, 622.0214, 623.0224, 624.0234, 625.0244, 626.0254, 627.0264, 628.0274, 629.0284, 630.0294, 631.0304, 632.0314, 633.0324, 634.0000333333334, 635.0010333333333, 636.0020333333333, 637.0030333333333, 638.0040333333334, 639.0050333333334, 640.0060333333333, 641.0070333333333], "recent_frames_sha256": "c54ec49eaa9c4dd706c1b4a8f354172459e2869caec3fa007bbe6d8d239e41a1", "num_recent_frames": 30, "tq": 716854.591111463, "t1": 716855.926807387, "ta": 716855.926807387, "te": 716855.963984123, "first_response_s": 1.3356959240045398, "answer_total_s": 1.3728726599365473, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 229, "content_group": "6cdf511a51cd6cddb52ed01d95b3d8746202eb3ed6800418e4ba955aaef74943", "question": {"question_id": "sample_229_a1006_q0", "video_id": 229, "video_path": "./videos/sample_229_real.mp4", "annotation_index": 1006, "question_index": 0, "question": "What mathematical concept will likely be demonstrated next?", "options": ["A. Subtraction.", "B. Addition.", "C. Multiplication.", "D. Division."], "answer": "D", "time_stamp_s": 9, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_229_a1006_q0", "video_id": 229, "time_stamp_s": 9, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "266b7ba11df66c98a7b7d7098d42d4e98ccaefde7840e9b95d4379719e6465c4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008], "recent_frames_sha256": "87a46f11325befea094b5b1f0634221d21092c7360c28835f0f667270d1e9805", "num_recent_frames": 9, "tq": 719410.268817426, "t1": 719418.155260233, "ta": 719418.155260233, "te": 719418.193786197, "first_response_s": 7.886442806920968, "answer_total_s": 7.924968770937994, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_229_a1006_q0", "video_id": 229, "time_stamp_s": 9, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d323ebdf3d63e08d8d1151c78392f6f72ec5b677a5eaf8f838b0530dc0d9b327", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008], "recent_frames_sha256": "87a46f11325befea094b5b1f0634221d21092c7360c28835f0f667270d1e9805", "num_recent_frames": 9, "tq": 719461.595473644, "t1": 719472.419808576, "ta": 719472.419808576, "te": 719472.658774651, "first_response_s": 10.824334932025522, "answer_total_s": 11.063301007030532, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 229, "content_group": "6cdf511a51cd6cddb52ed01d95b3d8746202eb3ed6800418e4ba955aaef74943", "question": {"question_id": "sample_229_a1007_q0", "video_id": 229, "video_path": "./videos/sample_229_real.mp4", "annotation_index": 1007, "question_index": 0, "question": "What is the presenter likely to do next?", "options": ["A. Add 48 to 52.", "B. Multiply 48 by 52.", "C. Divide 48 by 52.", "D. Subtract 48 from 52."], "answer": "D", "time_stamp_s": 192, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [162, 192], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_229_a1007_q0", "video_id": 229, "time_stamp_s": 192, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4b1d1694e617d29a68bc223e61a6bafa6701f84574122338acf65e8c4c4856a3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667], "recent_frames_sha256": "41b00fc0a25d65ce458a3f1f5da7ae8d38f41574865d82cf6b53d95afe1bda33", "num_recent_frames": 30, "tq": 719418.218739515, "t1": 719431.320251391, "ta": 719431.320251391, "te": 719431.358589141, "first_response_s": 13.101511875982396, "answer_total_s": 13.13984962599352, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_229_a1007_q0", "video_id": 229, "time_stamp_s": 192, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e8e2da2d6f20f9922e09fe9c36331bbe6e20f475d06f3fb203ebd29ea6459333", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a white \"Math Antics\" t-shirt stands against a purple textured background, introducing long division with a problem (315,270) displayed on screen.  \n- On-screen text labels appear sequentially: \"step 1\", \"step 2\", \"step 3\", and \"step 4\" as the man explains the process.  \n- The phrase \"Digit by Digit\" appears next to the division problem, indicating the method being taught.\n[30-60s] - Man in white \"Math Antics\" shirt stands against purple textured background, gesturing toward four division problems displayed around him.  \n- Division problems (4÷396, 5÷7255, 2÷6482, 6÷412) appear with divisors and dividends, some with pink highlights.  \n- Background transitions to light blue grid as new division problems (2÷528, 8÷528) appear, with arrows indicating \"same dividend\" and \"1-digit divisor.\"\n[60-90s] - A man in a white \"Math Antics\" t-shirt stands beside a grid background, gesturing toward a division problem: 2)528.  \n- The screen transitions to focus solely on the division problem, with text appearing to ask \"how many 2s fit into 5?\" and a red arrow pointing to the digit '5'.  \n- The number '2' is written above the division symbol, followed by a multiplication step showing 2×2=4, subtracted from 5 to yield 1.\n[90-120s] - Division problem 2528 ÷ 2 shown with intermediate steps: 2528 - 4 = 12, then 12 - 12 = 0.\n- Red arrows point to the subtraction steps and the result \"0\" after subtracting 12 from 12.\n- The quotient \"26\" appears above the division symbol, with \"26 × 2 = 52\" shown as a verification step.\n[120-150s] - A man in a \"Math Antics\" t-shirt stands beside a division problem (264 ÷ 528) on a grid background.\n- The problem is simplified to 8 ÷ 528, with a question mark and red arrows highlighting the \"8\" as too large for the first digit of the divisor.\n- Text appears stating \"8 is too big to fit into 5,\" indicating the next step in the division process.\n[150-180s] - The division problem \"8)528\" is displayed on a grid background.  \n- Red arrows point to the digits '5' and '2' in \"528\", indicating the start of the division process.  \n- The quotient '6' appears above the division symbol, showing the first step of the calculation.", "history_tokens": 634, "history_utf8_bytes": 2193, "recent_frame_times_s": [162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667], "recent_frames_sha256": "41b00fc0a25d65ce458a3f1f5da7ae8d38f41574865d82cf6b53d95afe1bda33", "num_recent_frames": 30, "tq": 719521.770719586, "t1": 719523.521520899, "ta": 719523.521520899, "te": 719523.890479568, "first_response_s": 1.7508013129699975, "answer_total_s": 2.1197599819861352, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 229, "content_group": "6cdf511a51cd6cddb52ed01d95b3d8746202eb3ed6800418e4ba955aaef74943", "question": {"question_id": "sample_229_a1008_q0", "video_id": 229, "video_path": "./videos/sample_229_real.mp4", "annotation_index": 1008, "question_index": 0, "question": "What might the speaker discuss next?", "options": ["A. The steps to perform the division.", "B. The final quotient of the division.", "C. The relevance of the remainder.", "D. How to multiply the dividend."], "answer": "A", "time_stamp_s": 338, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [324, 354], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_229_a1008_q0", "video_id": 229, "time_stamp_s": 338, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "742435cc22bfe07f31567bbae08b575607f60e1bb0f17af05006e0a7930f30fe", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317, 333.0327, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333], "recent_frames_sha256": "4ef3e0817c49575a29deaa14e3b511652189798ecd129447a9dcf3133be62add", "num_recent_frames": 30, "tq": 719431.37784906, "t1": 719442.104264881, "ta": 719442.104264881, "te": 719442.142619544, "first_response_s": 10.726415821001865, "answer_total_s": 10.764770484063774, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_229_a1008_q0", "video_id": 229, "time_stamp_s": 338, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "12e2b82aa520df417dcdabe19f19805bef14ada0fb2842fac686fcc0f154e4b9", "condition_order": ["recent", "notes"], "memory": "[60-90s] - A man in a white \"Math Antics\" t-shirt stands beside a grid background, gesturing toward a division problem: 2)528.  \n- The screen transitions to focus solely on the division problem, with text appearing to ask \"how many 2s fit into 5?\" and a red arrow pointing to the digit '5'.  \n- The number '2' is written above the division symbol, followed by a multiplication step showing 2×2=4, subtracted from 5 to yield 1.\n[90-120s] - Division problem 2528 ÷ 2 shown with intermediate steps: 2528 - 4 = 12, then 12 - 12 = 0.\n- Red arrows point to the subtraction steps and the result \"0\" after subtracting 12 from 12.\n- The quotient \"26\" appears above the division symbol, with \"26 × 2 = 52\" shown as a verification step.\n[120-150s] - A man in a \"Math Antics\" t-shirt stands beside a division problem (264 ÷ 528) on a grid background.\n- The problem is simplified to 8 ÷ 528, with a question mark and red arrows highlighting the \"8\" as too large for the first digit of the divisor.\n- Text appears stating \"8 is too big to fit into 5,\" indicating the next step in the division process.\n[150-180s] - The division problem \"8)528\" is displayed on a grid background.  \n- Red arrows point to the digits '5' and '2' in \"528\", indicating the start of the division process.  \n- The quotient '6' appears above the division symbol, showing the first step of the calculation.\n[180-210s] - A man in a white \"Math Antics\" t-shirt stands against a blue grid background, gesturing toward a division problem displayed on screen.  \n- The division problem \"8 into 528\" is shown with a quotient of \"06\" above the dividend.  \n- The multiplication step \"8 times 6\" appears as \"48\" below the quotient, followed by subtraction to yield \"4\" as the remainder.\n[210-240s] - A man in a white \"math antics\" t-shirt stands beside a grid background, gesturing toward a division problem (264 ÷ 528) and its long division setup (8 ÷ 528).  \n- The screen displays two long division problems side by side: 264 ÷ 528 and 8 ÷ 528, with the latter showing a quotient of 66.  \n- The man appears to be explaining the division process, with the text \"really important\" briefly appearing on screen.\n[240-270s] - Man in white \"math Antics\" shirt gestures toward division problem \"2)41,270\" with \"bigger chunks\" text overlay.  \n- On-screen text displays \"step 1\" and \"step 2\" boxes, followed by two long division examples.  \n- Two men appear side-by-side; one in dark shirt, one in white shirt, facing each other with hands on hips.\n[270-300s] - Man in white \"math Antics\" shirt gestures while speaking, standing against a grid background.  \n- Man in dark blue shirt stands with hands on hips, looking at the other man.  \n- On-screen text displays \"4)37,586\" with \"One Digit\" and \"easier\" appearing below.\n[300-330s] - A man in a white \"Math Antics\" t-shirt stands against a grid background, gesturing toward a division problem: 4)37,586.  \n- The word \"easier\" appears in yellow below the problem, then changes to \"harder\" in red, indicating a shift in difficulty.  \n- A multiplication table (1-10) briefly appears to the left of the man, then disappears, suggesting a tool for calculation.", "history_tokens": 915, "history_utf8_bytes": 3158, "recent_frame_times_s": [308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317, 333.0327, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333], "recent_frames_sha256": "4ef3e0817c49575a29deaa14e3b511652189798ecd129447a9dcf3133be62add", "num_recent_frames": 30, "tq": 719568.15783664, "t1": 719576.105948635, "ta": 719576.105948635, "te": 719576.381635485, "first_response_s": 7.9481119950069115, "answer_total_s": 8.223798844963312, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 229, "content_group": "6cdf511a51cd6cddb52ed01d95b3d8746202eb3ed6800418e4ba955aaef74943", "question": {"question_id": "sample_229_a1009_q0", "video_id": 229, "video_path": "./videos/sample_229_real.mp4", "annotation_index": 1009, "question_index": 0, "question": "What might the speaker do next?", "options": ["A. Subtract 440 from 528.", "B. Divide 528 by 55.", "C. Subtract 88 from 528.", "D. Add 5 to 88."], "answer": "A", "time_stamp_s": 524, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [486, 516], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_229_a1009_q0", "video_id": 229, "time_stamp_s": 524, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2ac265512b5dbf4d1fb7dbb266398a04343c18d6d7ed9695463cfc97ef6bc39f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [494.02686666666665, 495.0278666666667, 496.02886666666666, 497.0298666666667, 498.03086666666667, 499.03186666666664, 500.0328666666667, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0175, 519.0185, 520.0195, 521.0205, 522.0215, 523.0225], "recent_frames_sha256": "952dc5ce570dab71135a1faa8dcc574a2423b3b402c20cb1bb52dd071f1436ac", "num_recent_frames": 30, "tq": 719442.151980768, "t1": 719449.594874622, "ta": 719449.594874622, "te": 719449.633309596, "first_response_s": 7.442893853993155, "answer_total_s": 7.481328828027472, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_229_a1009_q0", "video_id": 229, "time_stamp_s": 524, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "901d93ba30bd031393a72ab47fd379e2b53c8b73ddeadc37af9f9ed1e4e8bb5e", "condition_order": ["recent", "notes"], "memory": "[210-240s] - A man in a white \"math antics\" t-shirt stands beside a grid background, gesturing toward a division problem (264 ÷ 528) and its long division setup (8 ÷ 528).  \n- The screen displays two long division problems side by side: 264 ÷ 528 and 8 ÷ 528, with the latter showing a quotient of 66.  \n- The man appears to be explaining the division process, with the text \"really important\" briefly appearing on screen.\n[240-270s] - Man in white \"math Antics\" shirt gestures toward division problem \"2)41,270\" with \"bigger chunks\" text overlay.  \n- On-screen text displays \"step 1\" and \"step 2\" boxes, followed by two long division examples.  \n- Two men appear side-by-side; one in dark shirt, one in white shirt, facing each other with hands on hips.\n[270-300s] - Man in white \"math Antics\" shirt gestures while speaking, standing against a grid background.  \n- Man in dark blue shirt stands with hands on hips, looking at the other man.  \n- On-screen text displays \"4)37,586\" with \"One Digit\" and \"easier\" appearing below.\n[300-330s] - A man in a white \"Math Antics\" t-shirt stands against a grid background, gesturing toward a division problem: 4)37,586.  \n- The word \"easier\" appears in yellow below the problem, then changes to \"harder\" in red, indicating a shift in difficulty.  \n- A multiplication table (1-10) briefly appears to the left of the man, then disappears, suggesting a tool for calculation.\n[330-360s] - A man in a \"Math Antics\" t-shirt stands beside two division problems: 24)528 and 88)528, with arrows pointing to the 2-digit divisors.\n- The screen transitions to focus solely on 24)528, with red arrows highlighting the divisor (24) and dividend (528).\n- A \"0\" appears above the division symbol, indicating the start of the long division process.\n[360-390s] - Division problem \"24)528\" appears with \"estimating\" text overlay.\n- Calculation \"2 × 25 = 50\" is shown, followed by multiplication steps for 24 × 2.\n- Result \"48\" is subtracted from \"528\", leaving \"4\" as the remainder.\n[390-420s] - A long division problem (24)528 is shown with a quotient of 22 and a remainder of 0.  \n- Red arrows highlight the quotient \"22\" and the subtraction steps.  \n- A man in a \"Math Antics\" shirt appears, standing beside the problem, gesturing toward it.\n[420-450s] - A man in a white \"Math Antics\" t-shirt stands against a grid background, gesturing toward a fraction displayed on screen.\n- The fraction \"88/528\" is shown with red arrows pointing to the numerator and denominator, followed by the text \"Uh oh!\" in pink.\n- The fraction is then circled in yellow, with the text \"whole problem!\" appearing below it in orange.\n[450-480s] - A man in a white \"Math Antics\" t-shirt stands against a grid background, gesturing as a division problem \"952/2476\" appears on screen.  \n- A red arrow points to the \"Math Antics\" logo on the man's shirt, followed by a cartoon calculator with a cape appearing beside him.  \n- The scene transitions to a protest setting with a man holding signs reading \"PEACE\" and \"Calculating is Not a Crime!\" in front of the Lincoln Memorial.\n[480-510s] - Division problem \"88)528\" displayed with a grid background, showing \"estimates\" text below.\n- \"90)500\" appears as an estimate, followed by \"100)500\" with a quotient of \"5\" above it.\n- The problem \"88)528\" is simplified to \"88)5\" with a quotient of \"5\" above, indicating a step in estimation.", "history_tokens": 990, "history_utf8_bytes": 3386, "recent_frame_times_s": [494.02686666666665, 495.0278666666667, 496.02886666666666, 497.0298666666667, 498.03086666666667, 499.03186666666664, 500.0328666666667, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0175, 519.0185, 520.0195, 521.0205, 522.0215, 523.0225], "recent_frames_sha256": "952dc5ce570dab71135a1faa8dcc574a2423b3b402c20cb1bb52dd071f1436ac", "num_recent_frames": 30, "tq": 719626.998213977, "t1": 719633.776295806, "ta": 719633.776295806, "te": 719634.076603349, "first_response_s": 6.778081829077564, "answer_total_s": 7.078389371978119, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 229, "content_group": "6cdf511a51cd6cddb52ed01d95b3d8746202eb3ed6800418e4ba955aaef74943", "question": {"question_id": "sample_229_a1010_q0", "video_id": 229, "video_path": "./videos/sample_229_real.mp4", "annotation_index": 1010, "question_index": 0, "question": "What might the speaker explain next?", "options": ["A. How to address the situation where the remainder is less than the divisor.", "B. How to check the division result.", "C. How to proceed with the next division step.", "D. How to interpret the decimal expansion."], "answer": "A", "time_stamp_s": 690, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "math tutorials", "reference_interval_s": [648, 678], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_229_a1010_q0", "video_id": 229, "time_stamp_s": 690, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5b7ac0aaa8231232fc8ddc62f868e6859d30d01a038364e8efb11f6f40dcfd00", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [660.0260333333333, 661.0270333333333, 662.0280333333334, 663.0290333333334, 664.0300333333333, 665.0310333333333, 666.0320333333333, 667.0330333333334, 668.0006666666667, 669.0016666666667, 670.0026666666666, 671.0036666666666, 672.0046666666667, 673.0056666666667, 674.0066666666667, 675.0076666666666, 676.0086666666666, 677.0096666666667, 678.0106666666667, 679.0116666666667, 680.0126666666666, 681.0136666666667, 682.0146666666667, 683.0156666666667, 684.0166666666667, 685.0176666666666, 686.0186666666667, 687.0196666666667, 688.0206666666667, 689.0216666666666], "recent_frames_sha256": "76e1e8e63124b7f9d2e848a927720cd496c0c888b97a29d6d0afe17ce95f1e6f", "num_recent_frames": 30, "tq": 719449.64589577, "t1": 719461.549372456, "ta": 719461.549372456, "te": 719461.586816198, "first_response_s": 11.90347668598406, "answer_total_s": 11.940920427907258, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_229_a1010_q0", "video_id": 229, "time_stamp_s": 690, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0890ddcccf56e0abaea411da74f78115cdcfb6a97b92f10467fa176df4a2d055", "condition_order": ["recent", "notes"], "memory": "[420-450s] - A man in a white \"Math Antics\" t-shirt stands against a grid background, gesturing toward a fraction displayed on screen.\n- The fraction \"88/528\" is shown with red arrows pointing to the numerator and denominator, followed by the text \"Uh oh!\" in pink.\n- The fraction is then circled in yellow, with the text \"whole problem!\" appearing below it in orange.\n[450-480s] - A man in a white \"Math Antics\" t-shirt stands against a grid background, gesturing as a division problem \"952/2476\" appears on screen.  \n- A red arrow points to the \"Math Antics\" logo on the man's shirt, followed by a cartoon calculator with a cape appearing beside him.  \n- The scene transitions to a protest setting with a man holding signs reading \"PEACE\" and \"Calculating is Not a Crime!\" in front of the Lincoln Memorial.\n[480-510s] - Division problem \"88)528\" displayed with a grid background, showing \"estimates\" text below.\n- \"90)500\" appears as an estimate, followed by \"100)500\" with a quotient of \"5\" above it.\n- The problem \"88)528\" is simplified to \"88)5\" with a quotient of \"5\" above, indicating a step in estimation.\n[510-540s] - Division problem 88 into 528 displayed with quotient 5 and remainder 88.\n- Red arrow points to quotient 5, with text \"too low\" indicating it's underestimated.\n- Text \"remainder > or = divisor\" appears, with \"Underestimated the answer\" highlighted in red.\n[540-570s] - A long division problem (88 into 528) is shown with a quotient of 5, remainder 88, and text indicating \"remainder > divisor\" and \"Underestimated the answer\".\n- The quotient is incremented to 6, and the multiplication 88 × 6 = 528 is displayed, showing the exact division with no remainder.\n- A man in a \"math antics\" t-shirt appears, standing beside a grid background with multiple long division examples, including 264 ÷ 8 and 248 ÷ 8, with intermediate steps visible.\n[570-600s] - A man in a \"Math Antics\" t-shirt stands in front of a grid background, gesturing while speaking.\n- The screen displays a long division problem: 38 divided into 817,152, with the divisor \"38\" underlined.\n- The number \"817,152\" is shown with a blue underline, and a red arrow points to the \"38\" with the text \"how many\" appearing nearby.\n[600-630s] - Division problem: 38 into 817,152 displayed with a question mark above the dividend.\n- Step-by-step calculation begins with estimating 38 into 81 as 2 (since 2×40=80), then subtracting 76 from 81 to get 5.\n- The remainder \"5\" is shown below the subtraction line, indicating the next digit to bring down.\n[630-660s] - The division problem 817,152 ÷ 38 is displayed with a quotient of 21 and a remainder of 19.\n- The subtraction steps show 817,152 minus 76 (from 21×38) yielding 817,152 - 76 = 817,076, then 817,076 - 38 = 817,038, and finally 817,038 - 38 = 817,00\n[660-690s] - A long division problem (817,152 ÷ 38) is displayed with intermediate steps and a quotient of 215.  \n- The number 15 appears as the remainder at the bottom of the division, indicating the final result.  \n- A man in a \"Math Antics\" t-shirt appears, standing in front of the division problem, with arrows pointing to specific parts of the calculation.", "history_tokens": 971, "history_utf8_bytes": 3160, "recent_frame_times_s": [660.0260333333333, 661.0270333333333, 662.0280333333334, 663.0290333333334, 664.0300333333333, 665.0310333333333, 666.0320333333333, 667.0330333333334, 668.0006666666667, 669.0016666666667, 670.0026666666666, 671.0036666666666, 672.0046666666667, 673.0056666666667, 674.0066666666667, 675.0076666666666, 676.0086666666666, 677.0096666666667, 678.0106666666667, 679.0116666666667, 680.0126666666666, 681.0136666666667, 682.0146666666667, 683.0156666666667, 684.0166666666667, 685.0176666666666, 686.0186666666667, 687.0196666666667, 688.0206666666667, 689.0216666666666], "recent_frames_sha256": "76e1e8e63124b7f9d2e848a927720cd496c0c888b97a29d6d0afe17ce95f1e6f", "num_recent_frames": 30, "tq": 719680.676554352, "t1": 719682.533197729, "ta": 719682.533197729, "te": 719682.774054086, "first_response_s": 1.8566433769883588, "answer_total_s": 2.0974997339071706, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 231, "content_group": "e4c46b9d65835a47845847bdf70527c25163dd8a468059081921167be9af9ae3", "question": {"question_id": "sample_231_a1522_q0", "video_id": 231, "video_path": "./videos/sample_231_real.mp4", "annotation_index": 1522, "question_index": 0, "question": "Why is this rabbit dressed in red and white knocking on the door now?", "options": ["A. Because it smells the fish and feels it doesn't taste good.", "B. Because it wants to join the party inside the house.", "C. Because it saw something interesting through the window.", "D. Because it is lost and looking for its way back home."], "answer": "A", "time_stamp_s": 36, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_231_a1522_q0", "video_id": 231, "time_stamp_s": 36, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d579b35e87debaaa473ee90d99f634d0e2ecad13f01b8927b023a6e3a9deaa71", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0, 27.0, 28.0, 29.0, 30.0, 31.0, 32.0, 33.0, 34.0, 35.0, 36.0], "recent_frames_sha256": "8881b5c1850ed8825c3bd98e733d8949cbd326c3d65177c91e75a7977312c6b7", "num_recent_frames": 30, "tq": 719123.708047734, "t1": 719130.543791253, "ta": 719130.543791253, "te": 719130.581115893, "first_response_s": 6.835743519011885, "answer_total_s": 6.873068158980459, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_231_a1522_q0", "video_id": 231, "time_stamp_s": 36, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "95b4d4e3b97bd438654fc0d0a88979e44e0eecc6b567a99fd25111e30960fd2c", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A pink rabbit in a green-striped uniform (number 547) opens a red door, revealing a room with two beds, a toilet, and a cactus, then walks to the door and opens it to reveal two purple fish on plates.\n- A pink rabbit in a red-and-white striped uniform (number 04) is seen holding a plate with a fish, standing near a bed with a red-and-white striped blanket, and later sits on the bed with the plate.\n- The room has blue walls, a ceiling fan, and various posters, including one with Cyrillic text, and a calendar on the wall", "history_tokens": 135, "history_utf8_bytes": 534, "recent_frame_times_s": [7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0, 27.0, 28.0, 29.0, 30.0, 31.0, 32.0, 33.0, 34.0, 35.0, 36.0], "recent_frames_sha256": "8881b5c1850ed8825c3bd98e733d8949cbd326c3d65177c91e75a7977312c6b7", "num_recent_frames": 30, "tq": 718975.578617848, "t1": 718976.467692818, "ta": 718976.467692818, "te": 718976.618515463, "first_response_s": 0.8890749700367451, "answer_total_s": 1.0398976149735972, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 231, "content_group": "e4c46b9d65835a47845847bdf70527c25163dd8a468059081921167be9af9ae3", "question": {"question_id": "sample_231_a1523_q0", "video_id": 231, "video_path": "./videos/sample_231_real.mp4", "annotation_index": 1523, "question_index": 0, "question": "Why is this iron gate cartoon character angry now?", "options": ["A. Because someone tried to paint him a different color.", "B. Because he was just splashed with water by a mischievous cat.", "C. Because the wind blew his hinges, making him squeak loudly.", "D. Because he was just forcibly stuffed a fish by the red rabbit in red and white clothes."], "answer": "D", "time_stamp_s": 58, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [85, 115], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_231_a1523_q0", "video_id": 231, "time_stamp_s": 58, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "09f3b19c00a8a911717d272b4173f950dafebad0c7897b1b07f8a3c845b3438f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [29.0, 30.0, 31.0, 32.0, 33.0, 34.0, 35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0], "recent_frames_sha256": "773d97de0baa39547c6efe2dc71655e764a745458974195d76c170ab72c0df7a", "num_recent_frames": 30, "tq": 719130.596680479, "t1": 719141.733526946, "ta": 719141.733526946, "te": 719141.771094666, "first_response_s": 11.136846467037685, "answer_total_s": 11.174414186971262, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_231_a1523_q0", "video_id": 231, "time_stamp_s": 58, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0a52a893520306ac8230c01d43ff6b3e8ae95f191febb3d4b102ce924c423b63", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A pink rabbit in a green-striped uniform (number 547) opens a red door, revealing a room with two beds, a toilet, and a cactus, then walks to the door and opens it to reveal two purple fish on plates.\n- A pink rabbit in a red-and-white striped uniform (number 04) is seen holding a plate with a fish, standing near a bed with a red-and-white striped blanket, and later sits on the bed with the plate.\n- The room has blue walls, a ceiling fan, and various posters, including one with Cyrillic text, and a calendar on the wall", "history_tokens": 135, "history_utf8_bytes": 534, "recent_frame_times_s": [29.0, 30.0, 31.0, 32.0, 33.0, 34.0, 35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0], "recent_frames_sha256": "773d97de0baa39547c6efe2dc71655e764a745458974195d76c170ab72c0df7a", "num_recent_frames": 30, "tq": 718976.63499012, "t1": 718984.15945485, "ta": 718984.15945485, "te": 718984.391868704, "first_response_s": 7.524464730056934, "answer_total_s": 7.75687858404126, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 231, "content_group": "e4c46b9d65835a47845847bdf70527c25163dd8a468059081921167be9af9ae3", "question": {"question_id": "sample_231_a1524_q0", "video_id": 231, "video_path": "./videos/sample_231_real.mp4", "annotation_index": 1524, "question_index": 0, "question": "Why is this rabbit, dressed in green and white, surprised now?", "options": ["A. Because he found an unexpected egg in the chicken's nest.", "B. Because the chicken suddenly started talking.", "C. Because he can't distinguish the gender of the chicken he is holding now.", "D. Because the chicken he is holding suddenly grew larger."], "answer": "C", "time_stamp_s": 144, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [170, 200], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_231_a1524_q0", "video_id": 231, "time_stamp_s": 144, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3a21efc5d7aa2e77915e00b38e165a6cae9be8a094ac1718afc96d8a6f95ff53", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0], "recent_frames_sha256": "5f8356f03e58fbee4a4a064179a7b095257cc0c957971774d91a2376b5aeab7d", "num_recent_frames": 30, "tq": 719141.777459921, "t1": 719155.818544322, "ta": 719155.818544322, "te": 719155.8565556, "first_response_s": 14.04108440107666, "answer_total_s": 14.07909567898605, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_231_a1524_q0", "video_id": 231, "time_stamp_s": 144, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f988ce2fd2c96621256044cb5f17b2bb3007f12a67fd09c8944a05ea198e9064", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A pink rabbit in a green-striped uniform (number 547) opens a red door, revealing a room with two beds, a toilet, and a cactus, then walks to the door and opens it to reveal two purple fish on plates.\n- A pink rabbit in a red-and-white striped uniform (number 04) is seen holding a plate with a fish, standing near a bed with a red-and-white striped blanket, and later sits on the bed with the plate.\n- The room has blue walls, a ceiling fan, and various posters, including one with Cyrillic text, and a calendar on the wall\n[30-60s] - Pink rabbit in striped outfit holds a blue bowl, then a white plate, standing in a blue-walled room with a door marked \"04\" and various posters.\n- The rabbit approaches a reddish-brown door with a yellow panel, which opens to reveal a small, yellow-eyed creature inside.\n- The rabbit interacts with the door, which has a small window and a lock, and the door's panel changes from yellow to red as the rabbit presses a button.\n[60-90s] - A pink rabbit in a red-and-white striped shirt is seen holding a pair of scissors, attempting to open a metal door with a keypad.\n- The rabbit is later shown cutting a red pepper on a plate, with a green leaf beside it, while wearing a white apron.\n- A green-striped pig is visible in the background, standing near a bed, with a calendar and various posters on the wall.\n[90-120s] - A pink door opens to reveal a green panel with tools and a clock, then transforms into a drawer filled with red, smiling, round objects.\n- A pink, striped character enters the room, approaches the drawer, and picks up a small object from the floor.\n- The drawer opens to reveal a second set of yellow, smiling, round objects, which the character then looks at.", "history_tokens": 418, "history_utf8_bytes": 1726, "recent_frame_times_s": [115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0], "recent_frames_sha256": "5f8356f03e58fbee4a4a064179a7b095257cc0c957971774d91a2376b5aeab7d", "num_recent_frames": 30, "tq": 719003.885913357, "t1": 719005.306542453, "ta": 719005.306542453, "te": 719005.34472596, "first_response_s": 1.4206290959846228, "answer_total_s": 1.4588126030284911, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 231, "content_group": "e4c46b9d65835a47845847bdf70527c25163dd8a468059081921167be9af9ae3", "question": {"question_id": "sample_231_a1525_q0", "video_id": 231, "video_path": "./videos/sample_231_real.mp4", "annotation_index": 1525, "question_index": 0, "question": "Why does this rabbit dressed in green and white want to hide in the toilet?", "options": ["A. Because he accidentally broke a valuable vase and wants to avoid getting caught.", "B. Because he saw a scary shadow moving in the hallway.", "C. Because he is trying to escape from a loud and annoying party.", "D. Because after he opened the door, he found a noose and a skull."], "answer": "D", "time_stamp_s": 199, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [255, 285], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_231_a1525_q0", "video_id": 231, "time_stamp_s": 199, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c084e40b973d9b8dd0ce067cb7d6a82421d5ad7c86d1cdd5bfbfa11e7acfb733", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0], "recent_frames_sha256": "ffe175158690c4a58d1e2cdb9484e380a1bf5ccc774eaea6831941afa0d21987", "num_recent_frames": 30, "tq": 719155.863490785, "t1": 719166.512860802, "ta": 719166.512860802, "te": 719166.552108162, "first_response_s": 10.649370016995817, "answer_total_s": 10.688617376959883, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_231_a1525_q0", "video_id": 231, "time_stamp_s": 199, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "35da808d96594e9ef1f8bb96d855c86435329a5f4d77bce36e1072faabc76730", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A pink rabbit in a green-striped uniform (number 547) opens a red door, revealing a room with two beds, a toilet, and a cactus, then walks to the door and opens it to reveal two purple fish on plates.\n- A pink rabbit in a red-and-white striped uniform (number 04) is seen holding a plate with a fish, standing near a bed with a red-and-white striped blanket, and later sits on the bed with the plate.\n- The room has blue walls, a ceiling fan, and various posters, including one with Cyrillic text, and a calendar on the wall\n[30-60s] - Pink rabbit in striped outfit holds a blue bowl, then a white plate, standing in a blue-walled room with a door marked \"04\" and various posters.\n- The rabbit approaches a reddish-brown door with a yellow panel, which opens to reveal a small, yellow-eyed creature inside.\n- The rabbit interacts with the door, which has a small window and a lock, and the door's panel changes from yellow to red as the rabbit presses a button.\n[60-90s] - A pink rabbit in a red-and-white striped shirt is seen holding a pair of scissors, attempting to open a metal door with a keypad.\n- The rabbit is later shown cutting a red pepper on a plate, with a green leaf beside it, while wearing a white apron.\n- A green-striped pig is visible in the background, standing near a bed, with a calendar and various posters on the wall.\n[90-120s] - A pink door opens to reveal a green panel with tools and a clock, then transforms into a drawer filled with red, smiling, round objects.\n- A pink, striped character enters the room, approaches the drawer, and picks up a small object from the floor.\n- The drawer opens to reveal a second set of yellow, smiling, round objects, which the character then looks at.\n[120-150s] - A rabbit in green stripes stands before a green panel with a yellow chick emerging from a slot.  \n- The rabbit interacts with the panel, pressing buttons and manipulating levers, while chicks are visible in a tray below.  \n- A black hose is seen extending from the panel, and the rabbit appears to be adjusting or operating it.\n[150-180s] - A pink rabbit in a green-and-white striped shirt opens a refrigerator, revealing its contents.  \n- The rabbit then retrieves a yellow object from the fridge and places it on a counter.  \n- A pink rabbit in a red-and-white striped shirt is seen reading a newspaper while standing near a toilet.", "history_tokens": 567, "history_utf8_bytes": 2374, "recent_frame_times_s": [170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0], "recent_frames_sha256": "ffe175158690c4a58d1e2cdb9484e380a1bf5ccc774eaea6831941afa0d21987", "num_recent_frames": 30, "tq": 719025.515248361, "t1": 719033.323021859, "ta": 719033.323021859, "te": 719033.671160443, "first_response_s": 7.807773498003371, "answer_total_s": 8.155912081943825, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 231, "content_group": "e4c46b9d65835a47845847bdf70527c25163dd8a468059081921167be9af9ae3", "question": {"question_id": "sample_231_a1526_q0", "video_id": 231, "video_path": "./videos/sample_231_real.mp4", "annotation_index": 1526, "question_index": 0, "question": "Why did the rabbit dressed in red and white just have to use a pool cue to strike the iron gate lying on the ground?", "options": ["A. Because he wants to get all the balls into the mouth of the iron gate at once.", "B. Because the iron gate blocked his path, and he needed to move it out of the way.", "C. Because he thought the flattened gate would make a perfect ramp for his skateboard.", "D. Because he was trying to impress his friends with a strong trick shot."], "answer": "A", "time_stamp_s": 402, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [340, 370], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_231_a1526_q0", "video_id": 231, "time_stamp_s": 402, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2e537132bcb4ab444991164f568ef517ffc307c7bfb27e0a01d6798f1c122f80", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0], "recent_frames_sha256": "e044dbba346d69bcc339eda1b2840a88a5ab5ea3934b114ab223d6468f2a04f9", "num_recent_frames": 30, "tq": 719166.559115127, "t1": 719176.589927792, "ta": 719176.589927792, "te": 719176.628177784, "first_response_s": 10.030812665005215, "answer_total_s": 10.069062657072209, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_231_a1526_q0", "video_id": 231, "time_stamp_s": 402, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d076628fd4b9737f1a25aab842f10eac0e09814f4f1f8e37323da1758f9412ed", "condition_order": ["notes", "recent"], "memory": "[60-90s] - A pink rabbit in a red-and-white striped shirt is seen holding a pair of scissors, attempting to open a metal door with a keypad.\n- The rabbit is later shown cutting a red pepper on a plate, with a green leaf beside it, while wearing a white apron.\n- A green-striped pig is visible in the background, standing near a bed, with a calendar and various posters on the wall.\n[90-120s] - A pink door opens to reveal a green panel with tools and a clock, then transforms into a drawer filled with red, smiling, round objects.\n- A pink, striped character enters the room, approaches the drawer, and picks up a small object from the floor.\n- The drawer opens to reveal a second set of yellow, smiling, round objects, which the character then looks at.\n[120-150s] - A rabbit in green stripes stands before a green panel with a yellow chick emerging from a slot.  \n- The rabbit interacts with the panel, pressing buttons and manipulating levers, while chicks are visible in a tray below.  \n- A black hose is seen extending from the panel, and the rabbit appears to be adjusting or operating it.\n[150-180s] - A pink rabbit in a green-and-white striped shirt opens a refrigerator, revealing its contents.  \n- The rabbit then retrieves a yellow object from the fridge and places it on a counter.  \n- A pink rabbit in a red-and-white striped shirt is seen reading a newspaper while standing near a toilet.\n[180-210s] - A pink door with heart and star decals opens to reveal a room with two beds and a toilet.  \n- A striped pig character enters the room, approaches the toilet, and looks at a sign showing \"541\" and \"00\".  \n- The door changes to green with a chair and a crown, then reverts to pink as the pig exits.\n[210-240s] - A pink-and-white striped character is seen falling into a toilet bowl, with toilet paper rolls stacked beside it.  \n- A green door with heart and star decals opens to reveal a room with beds and shelves, then transforms into a metallic vault door with symbols.  \n- The pink-and-white striped character reappears, now holding a red cup, standing near a sign that reads \"BOWIE\" and \"BOWIE\" on a wall.\n[240-270s] - A pink rabbit in a red-and-white striped outfit stands before a metal door with circular symbols (including a lightning bolt and a trophy) and presses a button.  \n- The rabbit then turns to face a wall-mounted machine displaying a green \"0\" and a \"P\" symbol, suggesting a payment or selection interface.  \n- The rabbit is later seen sitting on a bed, reading a newspaper, while a purple rabbit sits in a toilet nearby, with the room’s blue walls and posters visible.\n[270-300s] - A pink rabbit with a pink headband is suspended mid-air, visibly sweating, near a toilet and bed in a blue-walled room.  \n- A red-and-white striped character is seen on a bed, reacting to the rabbit’s position.  \n- A blue, spiky beam of light is directed at the rabbit’s head, causing visible droplets to fall from its face.\n[300-330s] - A pink rabbit with green wings is seen holding a green leaf, standing in a room with blue walls and a red door.  \n- The rabbit appears to be in a state of surprise or excitement, with wide eyes and an open mouth.  \n- The red door has a yellow rectangular panel with two white circles, resembling eyes, and a drop of water is visible near it.\n[330-360s] - A pink, rabbit-like character with large eyes is seen inside a bathroom, holding a showerhead and spraying water.  \n- A yellow duck-like character is visible in the background, standing near a toilet, appearing surprised or startled.  \n- The bathroom features blue tiled walls, a wooden door, and various posters and items on shelves, indicating a cluttered, lived-in space.\n[360-390s] - A pink rabbit in a green-striped shirt stands beside a pink door labeled \"04\" with a stick in hand.  \n- A red-and-white striped rabbit lies on a bed, surrounded by books and a cactus, with a \"BANANA\" poster on the wall.  \n- A yellow chicken with six Matryoshka-like heads appears on the bed, then later on a table with a yellow object and red eggs.", "history_tokens": 987, "history_utf8_bytes": 4053, "recent_frame_times_s": [373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0], "recent_frames_sha256": "e044dbba346d69bcc339eda1b2840a88a5ab5ea3934b114ab223d6468f2a04f9", "num_recent_frames": 30, "tq": 719116.60551063, "t1": 719123.640863854, "ta": 719123.640863854, "te": 719123.682525952, "first_response_s": 7.035353224026039, "answer_total_s": 7.077015322051011, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 232, "content_group": "58fe50ef425d66db193112cf07036242eecd2e8b9e6c98b31538588cdf42022d", "question": {"question_id": "sample_232_a1297_q0", "video_id": 232, "video_path": "./videos/sample_232_real.mp4", "annotation_index": 1297, "question_index": 0, "question": "Why does the frog appear from the toilet?", "options": ["A. Because the frog was hiding there to avoid being caught by the rabbit.", "B. Because the frog was attracted by the water and jumped in.", "C. Because the toilet leads to a secret underground pond where the frog lives.", "D. Because the chicken that was just thrown into the toilet is wearing a frog's disguise."], "answer": "D", "time_stamp_s": 17, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_232_a1297_q0", "video_id": 232, "time_stamp_s": 17, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "270de7d7017d3670377ee0df82ae16b44e1cb326eed231752c395f627b4451b7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.04798177083333333, 1.0146484375, 2.0146484375, 3.0146484375, 4.0146484375, 5.0146484375, 6.0146484375, 7.0146484375, 8.0146484375, 9.0146484375, 10.0146484375, 11.0146484375, 12.0146484375, 13.0146484375, 14.0146484375, 15.0146484375, 16.0146484375], "recent_frames_sha256": "9cf1f88f125850a8202287d6718c874ab62f692d82e649910e739ea84531a022", "num_recent_frames": 17, "tq": 717884.192961528, "t1": 717890.291748168, "ta": 717890.291748168, "te": 717890.329085743, "first_response_s": 6.098786639980972, "answer_total_s": 6.136124215088785, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_232_a1297_q0", "video_id": 232, "time_stamp_s": 17, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8cde3a756e371d08b73007e17ba87176fc1ffd37a24b99affb2e6d380cc8bf94", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.04798177083333333, 1.0146484375, 2.0146484375, 3.0146484375, 4.0146484375, 5.0146484375, 6.0146484375, 7.0146484375, 8.0146484375, 9.0146484375, 10.0146484375, 11.0146484375, 12.0146484375, 13.0146484375, 14.0146484375, 15.0146484375, 16.0146484375], "recent_frames_sha256": "9cf1f88f125850a8202287d6718c874ab62f692d82e649910e739ea84531a022", "num_recent_frames": 17, "tq": 717751.026776758, "t1": 717764.57368037, "ta": 717764.57368037, "te": 717764.881507818, "first_response_s": 13.546903611975722, "answer_total_s": 13.854731059982441, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 232, "content_group": "58fe50ef425d66db193112cf07036242eecd2e8b9e6c98b31538588cdf42022d", "question": {"question_id": "sample_232_a1298_q0", "video_id": 232, "video_path": "./videos/sample_232_real.mp4", "annotation_index": 1298, "question_index": 0, "question": "Why does the rabbit dressed in red and white start to become restless?", "options": ["A. Because the fly just disturbed him, he is swatting the fly.", "B. Because he suddenly remembered he left something important outside.", "C. Because he heard a strange noise coming from the next room.", "D. Because he can't find the key to the door and is getting frustrated."], "answer": "A", "time_stamp_s": 86, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [82, 112], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_232_a1298_q0", "video_id": 232, "time_stamp_s": 86, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6e2388b94de700447ec717e78ca53d18aeb2ec8a5fdeacd79a54df0665532981", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [56.0146484375, 57.0146484375, 58.0146484375, 59.0146484375, 60.0146484375, 61.0146484375, 62.0146484375, 63.0146484375, 64.0146484375, 65.0146484375, 66.0146484375, 67.0146484375, 68.0146484375, 69.0146484375, 70.0146484375, 71.0146484375, 72.0146484375, 73.0146484375, 74.0146484375, 75.0146484375, 76.0146484375, 77.0146484375, 78.0146484375, 79.0146484375, 80.0146484375, 81.0146484375, 82.0146484375, 83.0146484375, 84.0146484375, 85.0146484375], "recent_frames_sha256": "592586e2db4829c5a1a2e5894efb9664991da8e9ceb168cdd3c785b80f18f5ba", "num_recent_frames": 30, "tq": 717890.358526461, "t1": 717897.509137915, "ta": 717897.509137915, "te": 717897.548548545, "first_response_s": 7.150611454038881, "answer_total_s": 7.1900220840470865, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_232_a1298_q0", "video_id": 232, "time_stamp_s": 86, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "94ac7a4cc71d172bd4f0729c6341639e2b68c481ea7d7df5361b5914d4300ae2", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Yellow chick with red rope around neck is suspended in a tiled room, then pulled into a bathroom by a pink rabbit holding a fishing rod.  \n- Pink rabbit in striped shirt and green-striped rabbit are in a bathroom, with the pink rabbit holding the chick and the green rabbit holding a green frog.  \n- A pink pig is tied to a bed with rope, and a green frog is on the floor near a toilet, with a calendar and posters on the wall.\n[30-60s] - A green frog sits on a white sink, facing a pink rabbit in a striped outfit.  \n- The rabbit, initially lying on a bed, stands up and holds a white plate, appearing surprised or excited.  \n- The room’s blue walls feature posters, a calendar, and a hanging fish, with a pink balloon near the bed.", "history_tokens": 179, "history_utf8_bytes": 745, "recent_frame_times_s": [56.0146484375, 57.0146484375, 58.0146484375, 59.0146484375, 60.0146484375, 61.0146484375, 62.0146484375, 63.0146484375, 64.0146484375, 65.0146484375, 66.0146484375, 67.0146484375, 68.0146484375, 69.0146484375, 70.0146484375, 71.0146484375, 72.0146484375, 73.0146484375, 74.0146484375, 75.0146484375, 76.0146484375, 77.0146484375, 78.0146484375, 79.0146484375, 80.0146484375, 81.0146484375, 82.0146484375, 83.0146484375, 84.0146484375, 85.0146484375], "recent_frames_sha256": "592586e2db4829c5a1a2e5894efb9664991da8e9ceb168cdd3c785b80f18f5ba", "num_recent_frames": 30, "tq": 717784.939525978, "t1": 717791.795795649, "ta": 717791.795795649, "te": 717792.00041583, "first_response_s": 6.856269670999609, "answer_total_s": 7.0608898520004, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 232, "content_group": "58fe50ef425d66db193112cf07036242eecd2e8b9e6c98b31538588cdf42022d", "question": {"question_id": "sample_232_a1299_q0", "video_id": 232, "video_path": "./videos/sample_232_real.mp4", "annotation_index": 1299, "question_index": 0, "question": "Why is this cartoon chicken very shocked now?", "options": ["A. Because just now another small cartoon chicken was eaten by a frog.", "B. Because it just saw a mirror and didn't recognize its own reflection.", "C. Because a loud noise suddenly scared it from behind.", "D. Because it saw a large shadow pass overhead, thinking it was a predator."], "answer": "A", "time_stamp_s": 174, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [164, 194], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_232_a1299_q0", "video_id": 232, "time_stamp_s": 174, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2c209bb3d51613aadf2a69f19598aa0c2f2aae1e14acd3f6f5436bd879cc36a7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [144.0146484375, 145.0146484375, 146.0146484375, 147.0146484375, 148.0146484375, 149.0146484375, 150.0146484375, 151.0146484375, 152.0146484375, 153.0146484375, 154.0146484375, 155.0146484375, 156.0146484375, 157.0146484375, 158.0146484375, 159.0146484375, 160.0146484375, 161.0146484375, 162.0146484375, 163.0146484375, 164.0146484375, 165.0146484375, 166.0146484375, 167.0146484375, 168.0146484375, 169.0146484375, 170.0146484375, 171.0146484375, 172.0146484375, 173.0146484375], "recent_frames_sha256": "82175016f0f660ebaf77a78c1bf264b15a793f200a313dbeb534b16e50fc2242", "num_recent_frames": 30, "tq": 717897.567327929, "t1": 717910.220387385, "ta": 717910.220387385, "te": 717910.259549551, "first_response_s": 12.65305945603177, "answer_total_s": 12.692221621982753, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_232_a1299_q0", "video_id": 232, "time_stamp_s": 174, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "662a1332ca17ac72748bcc0cb258de7b9b4bfd343ae2521e5db0e766185856fa", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Yellow chick with red rope around neck is suspended in a tiled room, then pulled into a bathroom by a pink rabbit holding a fishing rod.  \n- Pink rabbit in striped shirt and green-striped rabbit are in a bathroom, with the pink rabbit holding the chick and the green rabbit holding a green frog.  \n- A pink pig is tied to a bed with rope, and a green frog is on the floor near a toilet, with a calendar and posters on the wall.\n[30-60s] - A green frog sits on a white sink, facing a pink rabbit in a striped outfit.  \n- The rabbit, initially lying on a bed, stands up and holds a white plate, appearing surprised or excited.  \n- The room’s blue walls feature posters, a calendar, and a hanging fish, with a pink balloon near the bed.\n[60-90s] - A pink pig in a green hat and striped outfit stands in a bathroom, holding a green bowl and appearing to be in distress or surprise.  \n- Another pink pig in a red-and-white striped outfit is seated on a toilet, holding a clipboard and observing the first pig.  \n- The bathroom features blue tiled walls, a sink, a mirror, and a calendar on the wall, with the first pig’s expression changing from shock to a more animated state.\n[90-120s] - A pink rabbit in green stripes holds a green bowl, then drops it as a red-striped rabbit enters and grabs it.\n- The red-striped rabbit opens a refrigerator, revealing food items, then exits while the green-striped rabbit watches.\n- A title card with Japanese text appears over a blue wall with fish decorations and a calendar.\n[120-150s] - A pink rabbit in a green-and-white striped shirt stands in a blue-walled room, facing a glass door leading to a green, spotted frog inside a transparent tank.  \n- The frog, with a wide mouth and pearl necklace, is visible through the glass, appearing to be in a tank with bubbles rising from below.  \n- The rabbit opens the door, revealing the frog inside, and then turns to face the camera, holding a pink object in its hand.", "history_tokens": 460, "history_utf8_bytes": 1965, "recent_frame_times_s": [144.0146484375, 145.0146484375, 146.0146484375, 147.0146484375, 148.0146484375, 149.0146484375, 150.0146484375, 151.0146484375, 152.0146484375, 153.0146484375, 154.0146484375, 155.0146484375, 156.0146484375, 157.0146484375, 158.0146484375, 159.0146484375, 160.0146484375, 161.0146484375, 162.0146484375, 163.0146484375, 164.0146484375, 165.0146484375, 166.0146484375, 167.0146484375, 168.0146484375, 169.0146484375, 170.0146484375, 171.0146484375, 172.0146484375, 173.0146484375], "recent_frames_sha256": "82175016f0f660ebaf77a78c1bf264b15a793f200a313dbeb534b16e50fc2242", "num_recent_frames": 30, "tq": 717817.74554507, "t1": 717825.630089623, "ta": 717825.630089623, "te": 717826.067311884, "first_response_s": 7.884544553002343, "answer_total_s": 8.32176681398414, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 232, "content_group": "58fe50ef425d66db193112cf07036242eecd2e8b9e6c98b31538588cdf42022d", "question": {"question_id": "sample_232_a1300_q0", "video_id": 232, "video_path": "./videos/sample_232_real.mp4", "annotation_index": 1300, "question_index": 0, "question": "Why does the character encounter a heavy legacy robot in the room?", "options": ["A. Because the character turns on a machine.", "B. Because the character follows someone into the room.", "C. Because the character activates a hidden switch.", "D. Because the character reads a comic book."], "answer": "D", "time_stamp_s": 251, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [246, 276], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_232_a1300_q0", "video_id": 232, "time_stamp_s": 251, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "706517fb6e0bff6b92217b7c81bd91e623f8808c151d783bdbb884654a0849ca", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [221.0146484375, 222.0146484375, 223.0146484375, 224.0146484375, 225.0146484375, 226.0146484375, 227.0146484375, 228.0146484375, 229.0146484375, 230.0146484375, 231.0146484375, 232.0146484375, 233.0146484375, 234.0146484375, 235.0146484375, 236.0146484375, 237.0146484375, 238.0146484375, 239.0146484375, 240.0146484375, 241.0146484375, 242.0146484375, 243.0146484375, 244.0146484375, 245.0146484375, 246.0146484375, 247.0146484375, 248.0146484375, 249.0146484375, 250.0146484375], "recent_frames_sha256": "e9ee822496208ee8930c32fac21f8feeb10427fddf85d75dbc7535c5bdaa0c37", "num_recent_frames": 30, "tq": 717910.269746522, "t1": 717920.531632451, "ta": 717920.531632451, "te": 717920.572815181, "first_response_s": 10.261885929037817, "answer_total_s": 10.303068659035489, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_232_a1300_q0", "video_id": 232, "time_stamp_s": 251, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4789acd97343f3eb020b8b0528c8b01e9983ad179a8e38e1ac2c8a2b97fb64ea", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Yellow chick with red rope around neck is suspended in a tiled room, then pulled into a bathroom by a pink rabbit holding a fishing rod.  \n- Pink rabbit in striped shirt and green-striped rabbit are in a bathroom, with the pink rabbit holding the chick and the green rabbit holding a green frog.  \n- A pink pig is tied to a bed with rope, and a green frog is on the floor near a toilet, with a calendar and posters on the wall.\n[30-60s] - A green frog sits on a white sink, facing a pink rabbit in a striped outfit.  \n- The rabbit, initially lying on a bed, stands up and holds a white plate, appearing surprised or excited.  \n- The room’s blue walls feature posters, a calendar, and a hanging fish, with a pink balloon near the bed.\n[60-90s] - A pink pig in a green hat and striped outfit stands in a bathroom, holding a green bowl and appearing to be in distress or surprise.  \n- Another pink pig in a red-and-white striped outfit is seated on a toilet, holding a clipboard and observing the first pig.  \n- The bathroom features blue tiled walls, a sink, a mirror, and a calendar on the wall, with the first pig’s expression changing from shock to a more animated state.\n[90-120s] - A pink rabbit in green stripes holds a green bowl, then drops it as a red-striped rabbit enters and grabs it.\n- The red-striped rabbit opens a refrigerator, revealing food items, then exits while the green-striped rabbit watches.\n- A title card with Japanese text appears over a blue wall with fish decorations and a calendar.\n[120-150s] - A pink rabbit in a green-and-white striped shirt stands in a blue-walled room, facing a glass door leading to a green, spotted frog inside a transparent tank.  \n- The frog, with a wide mouth and pearl necklace, is visible through the glass, appearing to be in a tank with bubbles rising from below.  \n- The rabbit opens the door, revealing the frog inside, and then turns to face the camera, holding a pink object in its hand.\n[150-180s] - A yellow chicken with large eyes and a red bowtie appears in a refrigerator, then emerges into a bathroom setting.  \n- A pink rabbit in green-and-white striped shorts stands beside the chicken, holding a pink object, with a surprised expression.  \n- The chicken’s eyes widen and tears stream down as it looks upward, while the rabbit’s face shows shock or fear.\n[180-210s] - A pink rabbit in a striped shirt holds a camera, standing near a green frog on a bed.  \n- A yellow bird with large eyes and tears appears, floating near the rabbit.  \n- A roasted turkey with a ribbon is placed on a platter, with the rabbit standing beside it.\n[210-240s] - A green-striped pig character stands in a prison cell, holding a green object near a red door with two holes and a small screen.\n- A red-and-white striped pig character lies on a bed, reading a magazine titled \"SAYAYI\" while surrounded by various items like shoes and a calendar.\n- The green-striped pig character is seen falling backward onto the floor, with the red-and-white striped pig character still reading the magazine.", "history_tokens": 715, "history_utf8_bytes": 3058, "recent_frame_times_s": [221.0146484375, 222.0146484375, 223.0146484375, 224.0146484375, 225.0146484375, 226.0146484375, 227.0146484375, 228.0146484375, 229.0146484375, 230.0146484375, 231.0146484375, 232.0146484375, 233.0146484375, 234.0146484375, 235.0146484375, 236.0146484375, 237.0146484375, 238.0146484375, 239.0146484375, 240.0146484375, 241.0146484375, 242.0146484375, 243.0146484375, 244.0146484375, 245.0146484375, 246.0146484375, 247.0146484375, 248.0146484375, 249.0146484375, 250.0146484375], "recent_frames_sha256": "e9ee822496208ee8930c32fac21f8feeb10427fddf85d75dbc7535c5bdaa0c37", "num_recent_frames": 30, "tq": 717875.869282424, "t1": 717877.932603643, "ta": 717877.932603643, "te": 717877.97298063, "first_response_s": 2.0633212190587074, "answer_total_s": 2.103698206017725, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 232, "content_group": "58fe50ef425d66db193112cf07036242eecd2e8b9e6c98b31538588cdf42022d", "question": {"question_id": "sample_232_a1301_q0", "video_id": 232, "video_path": "./videos/sample_232_real.mp4", "annotation_index": 1301, "question_index": 0, "question": "Why is this red rabbit standing in front of the iron gate now?", "options": ["A. Because the red rabbit is trying to figure out how to open the gate.", "B. Because the iron gate suddenly started glowing, and the rabbit is curious.", "C. Because the cartoon character is seeking amusement.", "D. Because the cartoon character on the iron gate has been whistling just now."], "answer": "D", "time_stamp_s": 253, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [328, 358], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_232_a1301_q0", "video_id": 232, "time_stamp_s": 253, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1a1e4507f8451d80f932d5ae41bbd439fd75c718d927684a54c28726d0ca9cb3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [223.0146484375, 224.0146484375, 225.0146484375, 226.0146484375, 227.0146484375, 228.0146484375, 229.0146484375, 230.0146484375, 231.0146484375, 232.0146484375, 233.0146484375, 234.0146484375, 235.0146484375, 236.0146484375, 237.0146484375, 238.0146484375, 239.0146484375, 240.0146484375, 241.0146484375, 242.0146484375, 243.0146484375, 244.0146484375, 245.0146484375, 246.0146484375, 247.0146484375, 248.0146484375, 249.0146484375, 250.0146484375, 251.0146484375, 252.0146484375], "recent_frames_sha256": "2ceffbd86bb914aedad88907cb637931d16bf890e1e888832f4d0c02b123a49e", "num_recent_frames": 30, "tq": 717920.583035186, "t1": 717932.472296064, "ta": 717932.472296064, "te": 717932.512156972, "first_response_s": 11.889260877971537, "answer_total_s": 11.929121785913594, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_232_a1301_q0", "video_id": 232, "time_stamp_s": 253, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0fce866c3467375367b91a56dd213c74a34cf6218c25ac75888043d634f31a5a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Yellow chick with red rope around neck is suspended in a tiled room, then pulled into a bathroom by a pink rabbit holding a fishing rod.  \n- Pink rabbit in striped shirt and green-striped rabbit are in a bathroom, with the pink rabbit holding the chick and the green rabbit holding a green frog.  \n- A pink pig is tied to a bed with rope, and a green frog is on the floor near a toilet, with a calendar and posters on the wall.\n[30-60s] - A green frog sits on a white sink, facing a pink rabbit in a striped outfit.  \n- The rabbit, initially lying on a bed, stands up and holds a white plate, appearing surprised or excited.  \n- The room’s blue walls feature posters, a calendar, and a hanging fish, with a pink balloon near the bed.\n[60-90s] - A pink pig in a green hat and striped outfit stands in a bathroom, holding a green bowl and appearing to be in distress or surprise.  \n- Another pink pig in a red-and-white striped outfit is seated on a toilet, holding a clipboard and observing the first pig.  \n- The bathroom features blue tiled walls, a sink, a mirror, and a calendar on the wall, with the first pig’s expression changing from shock to a more animated state.\n[90-120s] - A pink rabbit in green stripes holds a green bowl, then drops it as a red-striped rabbit enters and grabs it.\n- The red-striped rabbit opens a refrigerator, revealing food items, then exits while the green-striped rabbit watches.\n- A title card with Japanese text appears over a blue wall with fish decorations and a calendar.\n[120-150s] - A pink rabbit in a green-and-white striped shirt stands in a blue-walled room, facing a glass door leading to a green, spotted frog inside a transparent tank.  \n- The frog, with a wide mouth and pearl necklace, is visible through the glass, appearing to be in a tank with bubbles rising from below.  \n- The rabbit opens the door, revealing the frog inside, and then turns to face the camera, holding a pink object in its hand.\n[150-180s] - A yellow chicken with large eyes and a red bowtie appears in a refrigerator, then emerges into a bathroom setting.  \n- A pink rabbit in green-and-white striped shorts stands beside the chicken, holding a pink object, with a surprised expression.  \n- The chicken’s eyes widen and tears stream down as it looks upward, while the rabbit’s face shows shock or fear.\n[180-210s] - A pink rabbit in a striped shirt holds a camera, standing near a green frog on a bed.  \n- A yellow bird with large eyes and tears appears, floating near the rabbit.  \n- A roasted turkey with a ribbon is placed on a platter, with the rabbit standing beside it.\n[210-240s] - A green-striped pig character stands in a prison cell, holding a green object near a red door with two holes and a small screen.\n- A red-and-white striped pig character lies on a bed, reading a magazine titled \"SAYAYI\" while surrounded by various items like shoes and a calendar.\n- The green-striped pig character is seen falling backward onto the floor, with the red-and-white striped pig character still reading the magazine.", "history_tokens": 715, "history_utf8_bytes": 3058, "recent_frame_times_s": [223.0146484375, 224.0146484375, 225.0146484375, 226.0146484375, 227.0146484375, 228.0146484375, 229.0146484375, 230.0146484375, 231.0146484375, 232.0146484375, 233.0146484375, 234.0146484375, 235.0146484375, 236.0146484375, 237.0146484375, 238.0146484375, 239.0146484375, 240.0146484375, 241.0146484375, 242.0146484375, 243.0146484375, 244.0146484375, 245.0146484375, 246.0146484375, 247.0146484375, 248.0146484375, 249.0146484375, 250.0146484375, 251.0146484375, 252.0146484375], "recent_frames_sha256": "2ceffbd86bb914aedad88907cb637931d16bf890e1e888832f4d0c02b123a49e", "num_recent_frames": 30, "tq": 717877.993767914, "t1": 717884.138961281, "ta": 717884.138961281, "te": 717884.180870088, "first_response_s": 6.145193367032334, "answer_total_s": 6.187102174037136, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 233, "content_group": "61b1ac096cc166553e81dd2d08b3279ec8828def9e40c15a8a457795981023a4", "question": {"question_id": "sample_233_a398_q0", "video_id": 233, "video_path": "./videos/sample_233_real.mp4", "annotation_index": 398, "question_index": 0, "question": "Why does the rabbit strike the door with its fist several times?", "options": ["A. Because the rabbit is practicing its strength.", "B. Because the rabbit is knocking to check if someone is inside.", "C. Because the rabbit wants to open the door.", "D. Because the rabbit wants to get food."], "answer": "D", "time_stamp_s": 25, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_233_a398_q0", "video_id": 233, "time_stamp_s": 25, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "13a4bc2c485cfa8f84cffbe52769679a30a3355643b495c49beb87f7c53c04ea", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.04602864583333333, 1.0126953125, 2.0126953125, 3.0126953125, 4.0126953125, 5.0126953125, 6.0126953125, 7.0126953125, 8.0126953125, 9.0126953125, 10.0126953125, 11.0126953125, 12.0126953125, 13.0126953125, 14.0126953125, 15.0126953125, 16.0126953125, 17.0126953125, 18.0126953125, 19.0126953125, 20.0126953125, 21.0126953125, 22.0126953125, 23.0126953125, 24.0126953125], "recent_frames_sha256": "a7fe88c253f6fe0024f687b9bef063be13b86342979bd0f8f1c77bcfb2e0f4c2", "num_recent_frames": 25, "tq": 710385.385248416, "t1": 710390.906830433, "ta": 710390.906830433, "te": 710390.944370731, "first_response_s": 5.521582017070614, "answer_total_s": 5.559122315025888, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_233_a398_q0", "video_id": 233, "time_stamp_s": 25, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7a4a916d85dbeda149ce72fd09f26183362e24ae6646559089555ce66c7a78ff", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.04602864583333333, 1.0126953125, 2.0126953125, 3.0126953125, 4.0126953125, 5.0126953125, 6.0126953125, 7.0126953125, 8.0126953125, 9.0126953125, 10.0126953125, 11.0126953125, 12.0126953125, 13.0126953125, 14.0126953125, 15.0126953125, 16.0126953125, 17.0126953125, 18.0126953125, 19.0126953125, 20.0126953125, 21.0126953125, 22.0126953125, 23.0126953125, 24.0126953125], "recent_frames_sha256": "a7fe88c253f6fe0024f687b9bef063be13b86342979bd0f8f1c77bcfb2e0f4c2", "num_recent_frames": 25, "tq": 710435.333585554, "t1": 710436.659464711, "ta": 710436.659464711, "te": 710436.869009727, "first_response_s": 1.325879156938754, "answer_total_s": 1.5354241729946807, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 233, "content_group": "61b1ac096cc166553e81dd2d08b3279ec8828def9e40c15a8a457795981023a4", "question": {"question_id": "sample_233_a399_q0", "video_id": 233, "video_path": "./videos/sample_233_real.mp4", "annotation_index": 399, "question_index": 0, "question": "Why would the rabbit inside the iron gate be very panicked now?", "options": ["A. Because he just realized the gate is locked, and he can't get out.", "B. Because he heard loud footsteps approaching from outside.", "C. Because the lights suddenly went out, and he is afraid of the dark.", "D. Because the toilet paper he was holding in his hand fell."], "answer": "D", "time_stamp_s": 134, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [89, 119], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_233_a399_q0", "video_id": 233, "time_stamp_s": 134, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "00bb48a41e951be30d8002776be290b4164a148e958f74cb5533bdb47e63ebca", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [104.0126953125, 105.0126953125, 106.0126953125, 107.0126953125, 108.0126953125, 109.0126953125, 110.0126953125, 111.0126953125, 112.0126953125, 113.0126953125, 114.0126953125, 115.0126953125, 116.0126953125, 117.0126953125, 118.0126953125, 119.0126953125, 120.0126953125, 121.0126953125, 122.0126953125, 123.0126953125, 124.0126953125, 125.0126953125, 126.0126953125, 127.0126953125, 128.0126953125, 129.0126953125, 130.0126953125, 131.0126953125, 132.0126953125, 133.0126953125], "recent_frames_sha256": "a82bbca4308561006f6e9069a3a7fa5ef2406f205b3c4e43201047119b6f900e", "num_recent_frames": 30, "tq": 710390.956146344, "t1": 710398.563290593, "ta": 710398.563290593, "te": 710398.600812522, "first_response_s": 7.607144249021076, "answer_total_s": 7.64466617803555, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_233_a399_q0", "video_id": 233, "time_stamp_s": 134, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "af190908b2a18f439741b55dda8eee69089588f374a2b300ac7fb2ea0069852f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pink rabbit in striped uniform (04) stands near a door, then opens it to reveal a plate with food inside.\n- The door has a yellow panel with an eye-like symbol, and water droplets drip from it.\n- A smaller pink pig in green and white striped clothes is visible in the background, partially obscured by the door.\n[30-60s] - Pink rabbit in red-and-white striped shirt opens a brown door to reveal a wooden interior.\n- Rabbit sits at a table with a teacup and a carrot-topped cake, stirring tea with a spoon.\n- Green-striped rabbit sits on a bed in the background, facing away from the camera, with a calendar and posters on the wall.\n[60-90s] - Blue rabbit in green-striped outfit appears, standing in front of a red door, then turns to face the camera with wide eyes.  \n- Pink rabbit, also in green-striped outfit, is seen reading a newspaper, then looks up with a surprised expression.  \n- The blue rabbit opens a yellow mailbox, revealing a surprised face inside, while the pink rabbit remains seated, reading.\n[90-120s] - A pink rabbit character, wearing a green and white striped shirt, is seen reading a newspaper while seated on a toilet in a blue-tiled room.\n- The rabbit's expression changes from calm to surprised as it looks up, then back down at the newspaper, with visible sweat droplets on its face.\n- The rabbit's head is positioned above the toilet, and its body is slightly bent forward, indicating a posture of focus or discomfort.", "history_tokens": 338, "history_utf8_bytes": 1457, "recent_frame_times_s": [104.0126953125, 105.0126953125, 106.0126953125, 107.0126953125, 108.0126953125, 109.0126953125, 110.0126953125, 111.0126953125, 112.0126953125, 113.0126953125, 114.0126953125, 115.0126953125, 116.0126953125, 117.0126953125, 118.0126953125, 119.0126953125, 120.0126953125, 121.0126953125, 122.0126953125, 123.0126953125, 124.0126953125, 125.0126953125, 126.0126953125, 127.0126953125, 128.0126953125, 129.0126953125, 130.0126953125, 131.0126953125, 132.0126953125, 133.0126953125], "recent_frames_sha256": "a82bbca4308561006f6e9069a3a7fa5ef2406f205b3c4e43201047119b6f900e", "num_recent_frames": 30, "tq": 710469.545551677, "t1": 710475.49127646, "ta": 710475.49127646, "te": 710475.638732011, "first_response_s": 5.945724782999605, "answer_total_s": 6.093180333962664, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 233, "content_group": "61b1ac096cc166553e81dd2d08b3279ec8828def9e40c15a8a457795981023a4", "question": {"question_id": "sample_233_a400_q0", "video_id": 233, "video_path": "./videos/sample_233_real.mp4", "annotation_index": 400, "question_index": 0, "question": "What causes the bunny character to react with shock and sweat?", "options": ["A. Because the bunny just realized it forgot something important.", "B. Because a loud noise startled the bunny from behind.", "C. Because the rabbit wearing red and white clothes is perfectly fine.", "D. Because the bunny suddenly noticed a large shadow looming over it."], "answer": "C", "time_stamp_s": 208, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [178, 208], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_233_a400_q0", "video_id": 233, "time_stamp_s": 208, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1c31690d2b128f621f59c669981875bd958fd9a51d0e4507e2577845683415c2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [178.0126953125, 179.0126953125, 180.0126953125, 181.0126953125, 182.0126953125, 183.0126953125, 184.0126953125, 185.0126953125, 186.0126953125, 187.0126953125, 188.0126953125, 189.0126953125, 190.0126953125, 191.0126953125, 192.0126953125, 193.0126953125, 194.0126953125, 195.0126953125, 196.0126953125, 197.0126953125, 198.0126953125, 199.0126953125, 200.0126953125, 201.0126953125, 202.0126953125, 203.0126953125, 204.0126953125, 205.0126953125, 206.0126953125, 207.0126953125], "recent_frames_sha256": "940a969a5ede901876845ff613e4bb95f84b0eab392b3f73d616609385bd0471", "num_recent_frames": 30, "tq": 710398.610941068, "t1": 710410.533193654, "ta": 710410.533193654, "te": 710410.573817156, "first_response_s": 11.922252585995011, "answer_total_s": 11.962876087985933, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_233_a400_q0", "video_id": 233, "time_stamp_s": 208, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0a4e56ce880735f6edc51c204c64f812e66ff7da0ec7e08e69bac40e8ea19eb2", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pink rabbit in striped uniform (04) stands near a door, then opens it to reveal a plate with food inside.\n- The door has a yellow panel with an eye-like symbol, and water droplets drip from it.\n- A smaller pink pig in green and white striped clothes is visible in the background, partially obscured by the door.\n[30-60s] - Pink rabbit in red-and-white striped shirt opens a brown door to reveal a wooden interior.\n- Rabbit sits at a table with a teacup and a carrot-topped cake, stirring tea with a spoon.\n- Green-striped rabbit sits on a bed in the background, facing away from the camera, with a calendar and posters on the wall.\n[60-90s] - Blue rabbit in green-striped outfit appears, standing in front of a red door, then turns to face the camera with wide eyes.  \n- Pink rabbit, also in green-striped outfit, is seen reading a newspaper, then looks up with a surprised expression.  \n- The blue rabbit opens a yellow mailbox, revealing a surprised face inside, while the pink rabbit remains seated, reading.\n[90-120s] - A pink rabbit character, wearing a green and white striped shirt, is seen reading a newspaper while seated on a toilet in a blue-tiled room.\n- The rabbit's expression changes from calm to surprised as it looks up, then back down at the newspaper, with visible sweat droplets on its face.\n- The rabbit's head is positioned above the toilet, and its body is slightly bent forward, indicating a posture of focus or discomfort.\n[120-150s] - A pink rabbit character enters the bathroom, opens the door, and sits on the toilet while reading a newspaper.  \n- The bathroom door has a face with wide eyes and a droplet, which later closes and displays a smiling face with closed eyes.  \n- The scene transitions to a title card with Japanese text and a barbed wire fence, indicating a new segment.\n[150-180s] - A pink rabbit in a green and white striped shirt stands in a bathroom, holding a newspaper with \"BONNIE\" visible on its front.\n- The rabbit's eyes widen in shock as it looks up at a large, ominous black figure with a skull face and crossed eyes, emerging from a heavy metal door.\n- The rabbit's expression shifts to fear as it looks around the bathroom, which has posters on the walls and a toilet visible in the background.", "history_tokens": 527, "history_utf8_bytes": 2259, "recent_frame_times_s": [178.0126953125, 179.0126953125, 180.0126953125, 181.0126953125, 182.0126953125, 183.0126953125, 184.0126953125, 185.0126953125, 186.0126953125, 187.0126953125, 188.0126953125, 189.0126953125, 190.0126953125, 191.0126953125, 192.0126953125, 193.0126953125, 194.0126953125, 195.0126953125, 196.0126953125, 197.0126953125, 198.0126953125, 199.0126953125, 200.0126953125, 201.0126953125, 202.0126953125, 203.0126953125, 204.0126953125, 205.0126953125, 206.0126953125, 207.0126953125], "recent_frames_sha256": "940a969a5ede901876845ff613e4bb95f84b0eab392b3f73d616609385bd0471", "num_recent_frames": 30, "tq": 710491.797685523, "t1": 710499.005872963, "ta": 710499.005872963, "te": 710499.225027274, "first_response_s": 7.208187439944595, "answer_total_s": 7.427341750939377, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 233, "content_group": "61b1ac096cc166553e81dd2d08b3279ec8828def9e40c15a8a457795981023a4", "question": {"question_id": "sample_233_a401_q0", "video_id": 233, "video_path": "./videos/sample_233_real.mp4", "annotation_index": 401, "question_index": 0, "question": "Why do the rectangular characters arm themselves?", "options": ["A. Because they are excited to see the rabbit-like figure.", "B. Because the rabbit-like figure has glowing eyes and a menacing demeanor.", "C. Because they want to celebrate with the rabbit-like figure.", "D. Because they see another group approaching."], "answer": "B", "time_stamp_s": 281, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [267, 297], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_233_a401_q0", "video_id": 233, "time_stamp_s": 281, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8e66061af961019b433bd39554e9bf018ca143f37df730cd9378cc046fabfb08", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [251.0126953125, 252.0126953125, 253.0126953125, 254.0126953125, 255.0126953125, 256.0126953125, 257.0126953125, 258.0126953125, 259.0126953125, 260.0126953125, 261.0126953125, 262.0126953125, 263.0126953125, 264.0126953125, 265.0126953125, 266.0126953125, 267.0126953125, 268.0126953125, 269.0126953125, 270.0126953125, 271.0126953125, 272.0126953125, 273.0126953125, 274.0126953125, 275.0126953125, 276.0126953125, 277.0126953125, 278.0126953125, 279.0126953125, 280.0126953125], "recent_frames_sha256": "b9dbae11adb7527488b45de8b8df21622e9a97cd97a4fecac0b094be43c93fac", "num_recent_frames": 30, "tq": 710410.593242875, "t1": 710423.531331674, "ta": 710423.531331674, "te": 710423.57141571, "first_response_s": 12.938088799011894, "answer_total_s": 12.978172835079022, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_233_a401_q0", "video_id": 233, "time_stamp_s": 281, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b83490a0c4ad3c11ed6a432b49e9ecef83e1953c151ec22d2b95a8f6cce50098", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pink rabbit in striped uniform (04) stands near a door, then opens it to reveal a plate with food inside.\n- The door has a yellow panel with an eye-like symbol, and water droplets drip from it.\n- A smaller pink pig in green and white striped clothes is visible in the background, partially obscured by the door.\n[30-60s] - Pink rabbit in red-and-white striped shirt opens a brown door to reveal a wooden interior.\n- Rabbit sits at a table with a teacup and a carrot-topped cake, stirring tea with a spoon.\n- Green-striped rabbit sits on a bed in the background, facing away from the camera, with a calendar and posters on the wall.\n[60-90s] - Blue rabbit in green-striped outfit appears, standing in front of a red door, then turns to face the camera with wide eyes.  \n- Pink rabbit, also in green-striped outfit, is seen reading a newspaper, then looks up with a surprised expression.  \n- The blue rabbit opens a yellow mailbox, revealing a surprised face inside, while the pink rabbit remains seated, reading.\n[90-120s] - A pink rabbit character, wearing a green and white striped shirt, is seen reading a newspaper while seated on a toilet in a blue-tiled room.\n- The rabbit's expression changes from calm to surprised as it looks up, then back down at the newspaper, with visible sweat droplets on its face.\n- The rabbit's head is positioned above the toilet, and its body is slightly bent forward, indicating a posture of focus or discomfort.\n[120-150s] - A pink rabbit character enters the bathroom, opens the door, and sits on the toilet while reading a newspaper.  \n- The bathroom door has a face with wide eyes and a droplet, which later closes and displays a smiling face with closed eyes.  \n- The scene transitions to a title card with Japanese text and a barbed wire fence, indicating a new segment.\n[150-180s] - A pink rabbit in a green and white striped shirt stands in a bathroom, holding a newspaper with \"BONNIE\" visible on its front.\n- The rabbit's eyes widen in shock as it looks up at a large, ominous black figure with a skull face and crossed eyes, emerging from a heavy metal door.\n- The rabbit's expression shifts to fear as it looks around the bathroom, which has posters on the walls and a toilet visible in the background.\n[180-210s] - A pink rabbit with a green-striped shirt labeled \"541\" stands upright, looking upward with wide eyes.\n- A black, mechanical face with glowing green eyes and dripping water appears above, positioned as if overseeing the scene.\n- The rabbit is suspended upside-down in a metal contraption, with its legs dangling and a chain attached to its ankle.\n[210-240s] - A pink rabbit in a red-and-white striped prison uniform stands in a cell, facing the camera, with a green glow emanating from its body.\n- The rabbit opens a heavy, metallic door with a green light, revealing a dark, industrial interior behind it.\n- The rabbit then turns to face a green, egg-shaped object on a small table, which appears to be a toilet, while the cell walls show signs of wear and tear.\n[240-270s] - A pink, round character with green stripes and the number \"41\" on its back stands near a closed, purple door with a yellow rectangular panel containing two eyes.\n- The door's yellow panel eyes blink and then open, revealing a small, dark interior space behind it.\n- The door opens inward, revealing a room with multiple similar purple doors, each with a yellow panel and eyes, arranged in a row against a blue wall.", "history_tokens": 808, "history_utf8_bytes": 3464, "recent_frame_times_s": [251.0126953125, 252.0126953125, 253.0126953125, 254.0126953125, 255.0126953125, 256.0126953125, 257.0126953125, 258.0126953125, 259.0126953125, 260.0126953125, 261.0126953125, 262.0126953125, 263.0126953125, 264.0126953125, 265.0126953125, 266.0126953125, 267.0126953125, 268.0126953125, 269.0126953125, 270.0126953125, 271.0126953125, 272.0126953125, 273.0126953125, 274.0126953125, 275.0126953125, 276.0126953125, 277.0126953125, 278.0126953125, 279.0126953125, 280.0126953125], "recent_frames_sha256": "b9dbae11adb7527488b45de8b8df21622e9a97cd97a4fecac0b094be43c93fac", "num_recent_frames": 30, "tq": 710523.229034481, "t1": 710524.184184207, "ta": 710524.184184207, "te": 710524.222235838, "first_response_s": 0.955149726010859, "answer_total_s": 0.9932013569632545, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 233, "content_group": "61b1ac096cc166553e81dd2d08b3279ec8828def9e40c15a8a457795981023a4", "question": {"question_id": "sample_233_a402_q0", "video_id": 233, "video_path": "./videos/sample_233_real.mp4", "annotation_index": 402, "question_index": 0, "question": "Why does the rabbit break through the wall to escape?", "options": ["A. Because the rabbit wants to catch a thief.", "B. Because the rabbit is afraid of a predator.", "C. Because the rabbit wants to retrieve the advertisement.", "D. Because the rabbit is inspired by the advertisement for new shoes."], "answer": "D", "time_stamp_s": 376, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [356, 386], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_233_a402_q0", "video_id": 233, "time_stamp_s": 376, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cfd663ad16a0828b3f3eb95ca90223dc3c56f9377ed787f9a546b6a58c249ea4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [346.0126953125, 347.0126953125, 348.0126953125, 349.0126953125, 350.0126953125, 351.0126953125, 352.0126953125, 353.0126953125, 354.0126953125, 355.0126953125, 356.0126953125, 357.0126953125, 358.0126953125, 359.0126953125, 360.0126953125, 361.0126953125, 362.0126953125, 363.0126953125, 364.0126953125, 365.0126953125, 366.0126953125, 367.0126953125, 368.0126953125, 369.0126953125, 370.0126953125, 371.0126953125, 372.0126953125, 373.0126953125, 374.0126953125, 375.0126953125], "recent_frames_sha256": "2168a84c08d56a3f0c91bf2f48922af0c1d61a0ee4adf9dce7b50238ebfa07ff", "num_recent_frames": 30, "tq": 710423.580075655, "t1": 710435.285500089, "ta": 710435.285500089, "te": 710435.325168635, "first_response_s": 11.705424434039742, "answer_total_s": 11.745092979981564, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_233_a402_q0", "video_id": 233, "time_stamp_s": 376, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "306d23a9ad6778581179500258a027d782d6ac8b6d28642f83b80510e983d38e", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Blue rabbit in green-striped outfit appears, standing in front of a red door, then turns to face the camera with wide eyes.  \n- Pink rabbit, also in green-striped outfit, is seen reading a newspaper, then looks up with a surprised expression.  \n- The blue rabbit opens a yellow mailbox, revealing a surprised face inside, while the pink rabbit remains seated, reading.\n[90-120s] - A pink rabbit character, wearing a green and white striped shirt, is seen reading a newspaper while seated on a toilet in a blue-tiled room.\n- The rabbit's expression changes from calm to surprised as it looks up, then back down at the newspaper, with visible sweat droplets on its face.\n- The rabbit's head is positioned above the toilet, and its body is slightly bent forward, indicating a posture of focus or discomfort.\n[120-150s] - A pink rabbit character enters the bathroom, opens the door, and sits on the toilet while reading a newspaper.  \n- The bathroom door has a face with wide eyes and a droplet, which later closes and displays a smiling face with closed eyes.  \n- The scene transitions to a title card with Japanese text and a barbed wire fence, indicating a new segment.\n[150-180s] - A pink rabbit in a green and white striped shirt stands in a bathroom, holding a newspaper with \"BONNIE\" visible on its front.\n- The rabbit's eyes widen in shock as it looks up at a large, ominous black figure with a skull face and crossed eyes, emerging from a heavy metal door.\n- The rabbit's expression shifts to fear as it looks around the bathroom, which has posters on the walls and a toilet visible in the background.\n[180-210s] - A pink rabbit with a green-striped shirt labeled \"541\" stands upright, looking upward with wide eyes.\n- A black, mechanical face with glowing green eyes and dripping water appears above, positioned as if overseeing the scene.\n- The rabbit is suspended upside-down in a metal contraption, with its legs dangling and a chain attached to its ankle.\n[210-240s] - A pink rabbit in a red-and-white striped prison uniform stands in a cell, facing the camera, with a green glow emanating from its body.\n- The rabbit opens a heavy, metallic door with a green light, revealing a dark, industrial interior behind it.\n- The rabbit then turns to face a green, egg-shaped object on a small table, which appears to be a toilet, while the cell walls show signs of wear and tear.\n[240-270s] - A pink, round character with green stripes and the number \"41\" on its back stands near a closed, purple door with a yellow rectangular panel containing two eyes.\n- The door's yellow panel eyes blink and then open, revealing a small, dark interior space behind it.\n- The door opens inward, revealing a room with multiple similar purple doors, each with a yellow panel and eyes, arranged in a row against a blue wall.\n[270-300s] - Red rabbit with glowing eyes and \"04\" tag appears menacingly, standing in a bathroom with tiled walls and a sink.  \n- Brown, rectangular machines with eyes and dripping water are stacked, with green robotic arms extending from them.  \n- The rabbit attacks the machines, causing explosions and debris, while the machines react with visible distress.\n[300-330s] - A pink, striped character with a helmet is seen in a room with blue walls, appearing to be in distress or struggling.\n- A green and white striped character with a number \"541\" on its chest is shown floating or falling through a dark, smoky area.\n- The scene transitions to a red, mechanical-looking door with glowing yellow eyes, suggesting a menacing or threatening presence.\n[330-360s] - A pink rabbit in a striped shirt stands in a room with blue tiled walls, holding a red shoebox and looking surprised.  \n- The rabbit opens the shoebox, revealing a pair of red sneakers with yellow stars, and then holds up a black shoe with a white sole.  \n- The rabbit looks at a poster on the wall that reads \"БОТНИКИ ВОЛК\" (1959) and then turns to look at a magazine titled \"1961.09.21 НОВЫЙ!!\" with a red shoe advertisement.", "history_tokens": 954, "history_utf8_bytes": 4031, "recent_frame_times_s": [346.0126953125, 347.0126953125, 348.0126953125, 349.0126953125, 350.0126953125, 351.0126953125, 352.0126953125, 353.0126953125, 354.0126953125, 355.0126953125, 356.0126953125, 357.0126953125, 358.0126953125, 359.0126953125, 360.0126953125, 361.0126953125, 362.0126953125, 363.0126953125, 364.0126953125, 365.0126953125, 366.0126953125, 367.0126953125, 368.0126953125, 369.0126953125, 370.0126953125, 371.0126953125, 372.0126953125, 373.0126953125, 374.0126953125, 375.0126953125], "recent_frames_sha256": "2168a84c08d56a3f0c91bf2f48922af0c1d61a0ee4adf9dce7b50238ebfa07ff", "num_recent_frames": 30, "tq": 710549.859683016, "t1": 710550.624117245, "ta": 710550.624117245, "te": 710550.81844336, "first_response_s": 0.7644342290004715, "answer_total_s": 0.9587603440741077, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 234, "content_group": "9f6bbdedffa7d1f91b5359a7432545204e126bea8b9d5322fd02e852bb5ea161", "question": {"question_id": "sample_234_a997_q0", "video_id": 234, "video_path": "./videos/sample_234_real.mp4", "annotation_index": 997, "question_index": 0, "question": "Why is Mr. Bean scolded by the older woman?", "options": ["A. Because he was making too much noise.", "B. Because he was late.", "C. Because he was shining a flashlight at the teddy bear.", "D. Because he was not paying attention."], "answer": "A", "time_stamp_s": 27, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_234_a997_q0", "video_id": 234, "time_stamp_s": 27, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "69b9a3239e7979573fbe6984030b1647afdcfed141c6b7c7ac8403ab5bd7c08d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0, 27.0], "recent_frames_sha256": "cba5c891fd8ab10528618ebe9035e88467ead93c545d566664912f14bdb3e5f5", "num_recent_frames": 28, "tq": 710169.272747, "t1": 710181.078727126, "ta": 710181.078727126, "te": 710181.115863814, "first_response_s": 11.805980126024224, "answer_total_s": 11.843116814037785, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_234_a997_q0", "video_id": 234, "time_stamp_s": 27, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a85defaef7ab430868665b6c42adf9016d218a06dec28c46b4826ac1416b3d72", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0, 27.0], "recent_frames_sha256": "cba5c891fd8ab10528618ebe9035e88467ead93c545d566664912f14bdb3e5f5", "num_recent_frames": 28, "tq": 710212.641930744, "t1": 710213.774600515, "ta": 710213.774600515, "te": 710213.812400719, "first_response_s": 1.1326697709737346, "answer_total_s": 1.1704699749825522, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 234, "content_group": "9f6bbdedffa7d1f91b5359a7432545204e126bea8b9d5322fd02e852bb5ea161", "question": {"question_id": "sample_234_a998_q0", "video_id": 234, "video_path": "./videos/sample_234_real.mp4", "annotation_index": 998, "question_index": 0, "question": "Why does the character place the cheese on a plate?", "options": ["A. Because he plans to make a sandwich with the cheese.", "B. Because his refrigerator is empty except for a piece of vegetable.", "C. Because he thinks the cheese will taste better at room temperature.", "D. Because the character organizes the fridge."], "answer": "B", "time_stamp_s": 155, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [122, 152], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_234_a998_q0", "video_id": 234, "time_stamp_s": 155, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e1aa06d35dd89b951cc22cb45e45a75e533065e4f5cf3f6d69032db88355ca12", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0], "recent_frames_sha256": "6906d1dd4be4a0c9b84e99c5c38a793d5f02ec92b5cd3895203c05c31a6ad470", "num_recent_frames": 30, "tq": 710181.132575001, "t1": 710194.019113721, "ta": 710194.019113721, "te": 710194.056734203, "first_response_s": 12.886538719991222, "answer_total_s": 12.924159202026203, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_234_a998_q0", "video_id": 234, "time_stamp_s": 155, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f8f9384f202eb1c22a6b9eaf36b1e2e042aa3887f5e75e0f8dbb4cb88ddb281f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Mr. Bean holds a flashlight and a teddy bear, moving them around while standing in a room with vertical patterned wallpaper.\n- A large, round, brown object (possibly a door or wall) appears in the background as Mr. Bean looks toward it.\n- The title card \"mr Bean with Rowan Atkinson\" appears, followed by the episode title \"All You Can Eat\" and credits for writers Claran Murtagh & Andrew Jones.\n[30-60s] - Mr. Bean watches TV, holding a plate and a small object, while seated in a chair with a checkered pattern.\n- A woman in a yellow coat and red hat approaches a building's door, holding a bottle, and looks at a sign labeled \"Mrs. Wicket.\"\n- An elderly woman with a cane sits on the grass near the building's steps, holding a white bag, as the woman in the yellow coat stands on the steps.\n[60-90s] - Mrs. Bean, wearing a yellow coat and carrying a purse, stands at the door of apartment 2, looking toward the hallway.\n- Mr. Bean, in a red shirt and tie, is seated in a chair with a TV and a small dog beside him, watching the screen.\n- The TV screen shows a cartoon of Mr. Bean in a lab coat, holding a magnifying glass, with a small dog beside him.\n[90-120s] - Mr. Bean stands beside a table with a woman, holding a bottle and a cloth, while the woman looks at a calendar marked \"August\" on the wall.  \n- The woman, wearing glasses and a red hat, is seated at a table with Mr. Bean, who is holding a bottle and a cloth, as they appear to be in a dining room.  \n- Mr. Bean walks away from the table, leaving the woman seated, and the scene transitions to a kitchen with a washing machine and a refrigerator visible.\n[120-150s] - Mr. Bean opens a cabinet, revealing a drawer with a spring-loaded trap mechanism.\n- He pulls out a large slice of cheese, which is then placed on a plate.\n- The cheese is positioned on a spring-loaded trap, indicating it is set to trigger.", "history_tokens": 476, "history_utf8_bytes": 1883, "recent_frame_times_s": [126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0], "recent_frames_sha256": "6906d1dd4be4a0c9b84e99c5c38a793d5f02ec92b5cd3895203c05c31a6ad470", "num_recent_frames": 30, "tq": 710245.640265228, "t1": 710247.176044779, "ta": 710247.176044779, "te": 710247.213026467, "first_response_s": 1.5357795510208234, "answer_total_s": 1.5727612390182912, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 234, "content_group": "9f6bbdedffa7d1f91b5359a7432545204e126bea8b9d5322fd02e852bb5ea161", "question": {"question_id": "sample_234_a999_q0", "video_id": 234, "video_path": "./videos/sample_234_real.mp4", "annotation_index": 999, "question_index": 0, "question": "Why does the man successfully retrieve the bottle from the top shelf?", "options": ["A. Because he uses his shopping cart for support.", "B. Because he asks for assistance from a store employee.", "C. Because he finds a step stool to reach the bottle.", "D. Because he uses a long tool to knock the bottle down."], "answer": "A", "time_stamp_s": 264, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [244, 274], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_234_a999_q0", "video_id": 234, "time_stamp_s": 264, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "26daf095438195f52398b00933b5af1702c238af2db84f54a4f82b9730c1c2aa", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0], "recent_frames_sha256": "5ae87cb31373b5fa7d57f2a8602598fa52ab87b46f64ba3ef2374defd231a0c2", "num_recent_frames": 30, "tq": 710194.07497178, "t1": 710201.343784034, "ta": 710201.343784034, "te": 710201.379930188, "first_response_s": 7.268812254071236, "answer_total_s": 7.304958407999948, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_234_a999_q0", "video_id": 234, "time_stamp_s": 264, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "249a3e214fff22957ec8bd7619e450fc414bb66641c449fcd01381aca5e4d499", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Mr. Bean holds a flashlight and a teddy bear, moving them around while standing in a room with vertical patterned wallpaper.\n- A large, round, brown object (possibly a door or wall) appears in the background as Mr. Bean looks toward it.\n- The title card \"mr Bean with Rowan Atkinson\" appears, followed by the episode title \"All You Can Eat\" and credits for writers Claran Murtagh & Andrew Jones.\n[30-60s] - Mr. Bean watches TV, holding a plate and a small object, while seated in a chair with a checkered pattern.\n- A woman in a yellow coat and red hat approaches a building's door, holding a bottle, and looks at a sign labeled \"Mrs. Wicket.\"\n- An elderly woman with a cane sits on the grass near the building's steps, holding a white bag, as the woman in the yellow coat stands on the steps.\n[60-90s] - Mrs. Bean, wearing a yellow coat and carrying a purse, stands at the door of apartment 2, looking toward the hallway.\n- Mr. Bean, in a red shirt and tie, is seated in a chair with a TV and a small dog beside him, watching the screen.\n- The TV screen shows a cartoon of Mr. Bean in a lab coat, holding a magnifying glass, with a small dog beside him.\n[90-120s] - Mr. Bean stands beside a table with a woman, holding a bottle and a cloth, while the woman looks at a calendar marked \"August\" on the wall.  \n- The woman, wearing glasses and a red hat, is seated at a table with Mr. Bean, who is holding a bottle and a cloth, as they appear to be in a dining room.  \n- Mr. Bean walks away from the table, leaving the woman seated, and the scene transitions to a kitchen with a washing machine and a refrigerator visible.\n[120-150s] - Mr. Bean opens a cabinet, revealing a drawer with a spring-loaded trap mechanism.\n- He pulls out a large slice of cheese, which is then placed on a plate.\n- The cheese is positioned on a spring-loaded trap, indicating it is set to trigger.\n[150-180s] - Mr. Bean stands beside a table with a plate of food, holding a ketchup bottle, then pours it onto the plate.\n- He gestures toward the plate while smiling, then leans in to eat the food with a satisfied expression.\n- A woman with glasses sits across from him at the table, looking at him with a skeptical or unimpressed expression.\n[180-210s] - Mr. Bean, wearing a suit and tie, is seated at a dining table with a woman, both eating from plates while a bottle and a small bear figurine sit on the table.  \n- The woman, wearing glasses and a green top, reacts with surprise as Mr. Bean gestures toward her, then stands up and throws a paper napkin onto the floor.  \n- The scene transitions to an exterior shot of a green house with a yellow car parked in front, followed by a view of a large building labeled \"NORSELS SUPERMARKET\" with several cars parked outside.\n[210-240s] - Mr. Bean pushes a shopping cart past a blue-and-white striped awning, then walks toward a large pyramid of canned goods.  \n- A cartoon logo featuring a man holding a pie appears over the scene, with the word \"PIES\" below it.  \n- Mr. Bean stops in front of the pyramid, looks up at it, and then picks up a can from the top.", "history_tokens": 779, "history_utf8_bytes": 3095, "recent_frame_times_s": [235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0], "recent_frames_sha256": "5ae87cb31373b5fa7d57f2a8602598fa52ab87b46f64ba3ef2374defd231a0c2", "num_recent_frames": 30, "tq": 710272.083086746, "t1": 710272.511965524, "ta": 710272.511965524, "te": 710272.548976078, "first_response_s": 0.42887877800967544, "answer_total_s": 0.4658893320010975, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 234, "content_group": "9f6bbdedffa7d1f91b5359a7432545204e126bea8b9d5322fd02e852bb5ea161", "question": {"question_id": "sample_234_a1000_q0", "video_id": 234, "video_path": "./videos/sample_234_real.mp4", "annotation_index": 1000, "question_index": 0, "question": "Why Mr. Bean is very shocked.", "options": ["A. Because his own pie just fell to the floor.", "B. Because the opponent did a magic trick with the pie.", "C. Because the pie suddenly exploded when the opponent touched it.", "D. Because the opponent finished the pie in one go."], "answer": "D", "time_stamp_s": 400, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [366, 396], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_234_a1000_q0", "video_id": 234, "time_stamp_s": 400, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0d140f086d0fb6379b9a4e9673cfca4cb15a71d7ba67dee966b82299cbe5390f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0], "recent_frames_sha256": "f482ce8678832b82acc9af04e64028cbac2f7c7df32f145bc7028a44e5866ea1", "num_recent_frames": 30, "tq": 710201.403720594, "t1": 710207.467369414, "ta": 710207.467369414, "te": 710207.505265254, "first_response_s": 6.063648820039816, "answer_total_s": 6.101544659934007, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_234_a1000_q0", "video_id": 234, "time_stamp_s": 400, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c3b63ddbf5907a9550289d29ef8176f047fd5d88a6ab12c86f4c0f1bfddf5f40", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Mrs. Bean, wearing a yellow coat and carrying a purse, stands at the door of apartment 2, looking toward the hallway.\n- Mr. Bean, in a red shirt and tie, is seated in a chair with a TV and a small dog beside him, watching the screen.\n- The TV screen shows a cartoon of Mr. Bean in a lab coat, holding a magnifying glass, with a small dog beside him.\n[90-120s] - Mr. Bean stands beside a table with a woman, holding a bottle and a cloth, while the woman looks at a calendar marked \"August\" on the wall.  \n- The woman, wearing glasses and a red hat, is seated at a table with Mr. Bean, who is holding a bottle and a cloth, as they appear to be in a dining room.  \n- Mr. Bean walks away from the table, leaving the woman seated, and the scene transitions to a kitchen with a washing machine and a refrigerator visible.\n[120-150s] - Mr. Bean opens a cabinet, revealing a drawer with a spring-loaded trap mechanism.\n- He pulls out a large slice of cheese, which is then placed on a plate.\n- The cheese is positioned on a spring-loaded trap, indicating it is set to trigger.\n[150-180s] - Mr. Bean stands beside a table with a plate of food, holding a ketchup bottle, then pours it onto the plate.\n- He gestures toward the plate while smiling, then leans in to eat the food with a satisfied expression.\n- A woman with glasses sits across from him at the table, looking at him with a skeptical or unimpressed expression.\n[180-210s] - Mr. Bean, wearing a suit and tie, is seated at a dining table with a woman, both eating from plates while a bottle and a small bear figurine sit on the table.  \n- The woman, wearing glasses and a green top, reacts with surprise as Mr. Bean gestures toward her, then stands up and throws a paper napkin onto the floor.  \n- The scene transitions to an exterior shot of a green house with a yellow car parked in front, followed by a view of a large building labeled \"NORSELS SUPERMARKET\" with several cars parked outside.\n[210-240s] - Mr. Bean pushes a shopping cart past a blue-and-white striped awning, then walks toward a large pyramid of canned goods.  \n- A cartoon logo featuring a man holding a pie appears over the scene, with the word \"PIES\" below it.  \n- Mr. Bean stops in front of the pyramid, looks up at it, and then picks up a can from the top.\n[240-270s] - Mr. Bean, in a suit, pushes a shopping cart through a supermarket aisle lined with bottles.  \n- He reaches for a red bottle labeled \"CHILI\" from a shelf, then holds it up to inspect.  \n- The bottle's label features a cartoon chili pepper with eyes and flames, and he examines it closely.\n[270-300s] - Mr. Bean holds a red bottle, smiling, then gestures with his free hand while standing in a supermarket aisle.\n- He pushes a shopping cart containing the bottle, moving past shelves of beverages.\n- He suddenly trips and falls into a freezer section, landing on his back with a surprised expression.\n[300-330s] - Mr. Bean pushes a shopping cart with a small stuffed bear inside, moving through a canned fish aisle.\n- He stops to inspect a can, then looks at the bear with a puzzled expression while holding a price tag.\n- The bear is later seen falling out of the cart, landing on the floor near a spilled can of fish.\n[330-360s] - A pink, round character is buried under a pile of canned fish boxes, with some cans scattered around.\n- A man in a suit and tie, holding a teddy bear, walks past the canned fish section.\n- The man in the suit is later seen at a counter with meatballs, holding a £6 price tag.\n[360-390s] - Mr. Bean stands beside a table with pies, holding a teddy bear, while a man in a suit gestures excitedly nearby.  \n- A large man in a yellow apron holds a pie, looking surprised as he interacts with Mr. Bean.  \n- The scene shifts to a stage-like setting with \"WIN\" signs and clouds, where Mr. Bean and the suited man appear to be competing or celebrating.", "history_tokens": 976, "history_utf8_bytes": 3881, "recent_frame_times_s": [371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0], "recent_frames_sha256": "f482ce8678832b82acc9af04e64028cbac2f7c7df32f145bc7028a44e5866ea1", "num_recent_frames": 30, "tq": 710320.644013863, "t1": 710326.749073575, "ta": 710326.749073575, "te": 710326.787285377, "first_response_s": 6.105059711961076, "answer_total_s": 6.143271513981745, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 234, "content_group": "9f6bbdedffa7d1f91b5359a7432545204e126bea8b9d5322fd02e852bb5ea161", "question": {"question_id": "sample_234_a1001_q0", "video_id": 234, "video_path": "./videos/sample_234_real.mp4", "annotation_index": 1001, "question_index": 0, "question": "Why does the Mr. Bean look tired or exhausted?", "options": ["A. Because he had to run around the supermarket to find items.", "B. Because he lost the competition in the supermarket.", "C. Because he stayed up all night preparing for the competition.", "D. Because he had to carry heavy bags out of the supermarket."], "answer": "B", "time_stamp_s": 516, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [488, 518], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_234_a1001_q0", "video_id": 234, "time_stamp_s": 516, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8d7a8d674e6d7ff24ef870b8ae9cc9926103482610a720263d8d800d497ebd8c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0, 516.0], "recent_frames_sha256": "1e0987a76fc75385a813bc10a58aff63af8372944520a9450b9e738f606d01b9", "num_recent_frames": 30, "tq": 710207.522804968, "t1": 710212.568594372, "ta": 710212.568594372, "te": 710212.606082771, "first_response_s": 5.04578940407373, "answer_total_s": 5.083277803030796, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_234_a1001_q0", "video_id": 234, "time_stamp_s": 516, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bd735f0380b16008ed4a8ebcdcca823e8ed96e6c5d11b41b24d35ea7d13da4b8", "condition_order": ["recent", "notes"], "memory": "[150-180s] - Mr. Bean stands beside a table with a plate of food, holding a ketchup bottle, then pours it onto the plate.\n- He gestures toward the plate while smiling, then leans in to eat the food with a satisfied expression.\n- A woman with glasses sits across from him at the table, looking at him with a skeptical or unimpressed expression.\n[180-210s] - Mr. Bean, wearing a suit and tie, is seated at a dining table with a woman, both eating from plates while a bottle and a small bear figurine sit on the table.  \n- The woman, wearing glasses and a green top, reacts with surprise as Mr. Bean gestures toward her, then stands up and throws a paper napkin onto the floor.  \n- The scene transitions to an exterior shot of a green house with a yellow car parked in front, followed by a view of a large building labeled \"NORSELS SUPERMARKET\" with several cars parked outside.\n[210-240s] - Mr. Bean pushes a shopping cart past a blue-and-white striped awning, then walks toward a large pyramid of canned goods.  \n- A cartoon logo featuring a man holding a pie appears over the scene, with the word \"PIES\" below it.  \n- Mr. Bean stops in front of the pyramid, looks up at it, and then picks up a can from the top.\n[240-270s] - Mr. Bean, in a suit, pushes a shopping cart through a supermarket aisle lined with bottles.  \n- He reaches for a red bottle labeled \"CHILI\" from a shelf, then holds it up to inspect.  \n- The bottle's label features a cartoon chili pepper with eyes and flames, and he examines it closely.\n[270-300s] - Mr. Bean holds a red bottle, smiling, then gestures with his free hand while standing in a supermarket aisle.\n- He pushes a shopping cart containing the bottle, moving past shelves of beverages.\n- He suddenly trips and falls into a freezer section, landing on his back with a surprised expression.\n[300-330s] - Mr. Bean pushes a shopping cart with a small stuffed bear inside, moving through a canned fish aisle.\n- He stops to inspect a can, then looks at the bear with a puzzled expression while holding a price tag.\n- The bear is later seen falling out of the cart, landing on the floor near a spilled can of fish.\n[330-360s] - A pink, round character is buried under a pile of canned fish boxes, with some cans scattered around.\n- A man in a suit and tie, holding a teddy bear, walks past the canned fish section.\n- The man in the suit is later seen at a counter with meatballs, holding a £6 price tag.\n[360-390s] - Mr. Bean stands beside a table with pies, holding a teddy bear, while a man in a suit gestures excitedly nearby.  \n- A large man in a yellow apron holds a pie, looking surprised as he interacts with Mr. Bean.  \n- The scene shifts to a stage-like setting with \"WIN\" signs and clouds, where Mr. Bean and the suited man appear to be competing or celebrating.\n[390-420s] - Mr. Bean holds tongs over a roasted turkey, visibly startled by its size.  \n- A man in a suit sits at the table, mouth open in surprise, while a woman in a yellow apron eats from a pie.  \n- The scene is framed by \"WIN\" banners and a cartoonish cloud, suggesting a festive or game-show setting.\n[420-450s] - Mr. Bean holds a small brown teddy bear, looking pleased, while standing near a counter with pies and salt/pepper shakers.  \n- A man in a suit stands beside him, holding a phone to his ear, appearing to be in conversation.  \n- A large pile of blue and white boxes, some tipped over, is visible on the floor near a ladder, with a man on it holding a cup.\n[450-480s] - Man in suit holds microphone, appears surprised as he watches the scene unfold.  \n- Elderly man in yellow apron holds a large piece of pie, visibly sweating and looking distressed.  \n- A \"WIN\" star graphic appears above the elderly man’s head, indicating a prize or outcome.\n[480-510s] - Mr. Bean stands outside a green car, holding two white bags, with a frowning expression.\n- A cartoon logo featuring a man holding a pie appears beside him, with the word \"PIES\" below.\n- A woman with glasses peers out from a window above, observing Mr. Bean.", "history_tokens": 1021, "history_utf8_bytes": 4036, "recent_frame_times_s": [487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0, 516.0], "recent_frames_sha256": "1e0987a76fc75385a813bc10a58aff63af8372944520a9450b9e738f606d01b9", "num_recent_frames": 30, "tq": 710359.803657525, "t1": 710360.328122506, "ta": 710360.328122506, "te": 710360.366298366, "first_response_s": 0.5244649810483679, "answer_total_s": 0.562640841002576, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 235, "content_group": "5423f9d4b8e050dcc5fccf7eac550e08f067f1b1b52de917f125f6b336c4a18a", "question": {"question_id": "sample_235_a1240_q0", "video_id": 235, "video_path": "./videos/sample_235_real.mp4", "annotation_index": 1240, "question_index": 0, "question": "Why can thieves enter the room without being detected?", "options": ["A. Because the security system is broken.", "B. Because the masters have all fallen asleep.", "C. Because the door was accidentally left unlocked.", "D. Because the thieves are using a special device to stay silent."], "answer": "B", "time_stamp_s": 124, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_235_a1240_q0", "video_id": 235, "time_stamp_s": 124, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1a2db251dc6f92bc395312e4d7b0a378db78625b305ad3254138171b54fd6d29", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [94.00296875, 95.00296875, 96.00296875, 97.00296875, 98.00296875, 99.00296875, 100.00296875, 101.00296875, 102.00296875, 103.00296875, 104.00296875, 105.00296875, 106.00296875, 107.00296875, 108.00296875, 109.00296875, 110.00296875, 111.00296875, 112.00296875, 113.00296875, 114.00296875, 115.00296875, 116.00296875, 117.00296875, 118.00296875, 119.00296875, 120.00296875, 121.00296875, 122.00296875, 123.00296875], "recent_frames_sha256": "1514390aada5ae2cfe44f6fac002fa3ed11500c19c12eeaf9078ffa29256db1a", "num_recent_frames": 30, "tq": 716670.230157006, "t1": 716676.690231861, "ta": 716676.690231861, "te": 716676.727547175, "first_response_s": 6.460074855014682, "answer_total_s": 6.49739016906824, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_235_a1240_q0", "video_id": 235, "time_stamp_s": 124, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1119738162744c3655e27807c3cc94295ac7029a91a624064587f388bc9bcf83", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Mr. Bean is shown in a laundry room, being playfully attacked by a woman with a green outfit, while a box of \"Mr. Bean\" themed food is presented to him.  \n- The scene transitions to a nighttime suburban setting with a car parked outside a house, followed by a yellow cat running through a hallway with a clock on the wall.  \n- An elderly woman in a pink dress is seated in a chair, watching television, which displays a wrestling match featuring a large wrestler.\n[30-60s] - A cartoon cat with a black tail and yellow body walks across a hallway, passing a staircase and a door with a clock above it.\n- A man in a red cap and white pajamas sits under a blanket in bed, reading a comic book with a teddy bear and a bowl of popcorn beside him.\n- The comic book's cover features bold text \"POW\" and \"NOOOOOSH!\" with cartoon characters and explosions, suggesting action-packed content.\n[60-90s] - A man in bed with red sleep mask and teddy bear, eyes closed, then opens them with a startled expression.\n- Nightstand holds a bowl of eggs, alarm clock, and a magazine, all stationary.\n- A woman sleeps in a recliner, illuminated by a spotlight, with a fishbowl on a nearby table.\n[90-120s] - A cartoon thief in a black mask and suit stealthily climbs a roof at night, then jumps down to a house's window.\n- Inside a bedroom, the thief approaches a sleeping character wearing red eye masks, who is lying in bed with a teddy bear beside them.\n- The thief, now on the floor, looks up at a clock on a nightstand, then turns to face the sleeping character, who remains asleep.", "history_tokens": 382, "history_utf8_bytes": 1575, "recent_frame_times_s": [94.00296875, 95.00296875, 96.00296875, 97.00296875, 98.00296875, 99.00296875, 100.00296875, 101.00296875, 102.00296875, 103.00296875, 104.00296875, 105.00296875, 106.00296875, 107.00296875, 108.00296875, 109.00296875, 110.00296875, 111.00296875, 112.00296875, 113.00296875, 114.00296875, 115.00296875, 116.00296875, 117.00296875, 118.00296875, 119.00296875, 120.00296875, 121.00296875, 122.00296875, 123.00296875], "recent_frames_sha256": "1514390aada5ae2cfe44f6fac002fa3ed11500c19c12eeaf9078ffa29256db1a", "num_recent_frames": 30, "tq": 716740.211880656, "t1": 716741.286306708, "ta": 716741.286306708, "te": 716741.47254456, "first_response_s": 1.0744260520441458, "answer_total_s": 1.2606639040168375, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 235, "content_group": "5423f9d4b8e050dcc5fccf7eac550e08f067f1b1b52de917f125f6b336c4a18a", "question": {"question_id": "sample_235_a1241_q0", "video_id": 235, "video_path": "./videos/sample_235_real.mp4", "annotation_index": 1241, "question_index": 0, "question": "Why does this cat glare viciously at the person in black?", "options": ["A. Because the person in black took away the cat's favorite toy.", "B. Because the person in black is blocking the cat's path.", "C. Because the man in black just stepped on this cat.", "D. Because the person in black made a loud noise that startled the cat."], "answer": "C", "time_stamp_s": 143, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [118, 148], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_235_a1241_q0", "video_id": 235, "time_stamp_s": 143, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "345a717ac05eb4b4b5b82999c1e1930f449eb9ad48c43a463d5d539df38fe72a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [113.00296875, 114.00296875, 115.00296875, 116.00296875, 117.00296875, 118.00296875, 119.00296875, 120.00296875, 121.00296875, 122.00296875, 123.00296875, 124.00296875, 125.00296875, 126.00296875, 127.00296875, 128.00296875, 129.00296875, 130.00296875, 131.00296875, 132.00296875, 133.00296875, 134.00296875, 135.00296875, 136.00296875, 137.00296875, 138.00296875, 139.00296875, 140.00296875, 141.00296875, 142.00296875], "recent_frames_sha256": "c63212bf96a4112cd610d621802d207dadad428addc98f35ea84903e89426f0c", "num_recent_frames": 30, "tq": 716676.753219165, "t1": 716682.96152052, "ta": 716682.96152052, "te": 716683.188232566, "first_response_s": 6.208301355014555, "answer_total_s": 6.435013400972821, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_235_a1241_q0", "video_id": 235, "time_stamp_s": 143, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c4e604492821a4cdf6f68201be4a2cd28a0439763300c602a19fb82932ff0da8", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Mr. Bean is shown in a laundry room, being playfully attacked by a woman with a green outfit, while a box of \"Mr. Bean\" themed food is presented to him.  \n- The scene transitions to a nighttime suburban setting with a car parked outside a house, followed by a yellow cat running through a hallway with a clock on the wall.  \n- An elderly woman in a pink dress is seated in a chair, watching television, which displays a wrestling match featuring a large wrestler.\n[30-60s] - A cartoon cat with a black tail and yellow body walks across a hallway, passing a staircase and a door with a clock above it.\n- A man in a red cap and white pajamas sits under a blanket in bed, reading a comic book with a teddy bear and a bowl of popcorn beside him.\n- The comic book's cover features bold text \"POW\" and \"NOOOOOSH!\" with cartoon characters and explosions, suggesting action-packed content.\n[60-90s] - A man in bed with red sleep mask and teddy bear, eyes closed, then opens them with a startled expression.\n- Nightstand holds a bowl of eggs, alarm clock, and a magazine, all stationary.\n- A woman sleeps in a recliner, illuminated by a spotlight, with a fishbowl on a nearby table.\n[90-120s] - A cartoon thief in a black mask and suit stealthily climbs a roof at night, then jumps down to a house's window.\n- Inside a bedroom, the thief approaches a sleeping character wearing red eye masks, who is lying in bed with a teddy bear beside them.\n- The thief, now on the floor, looks up at a clock on a nightstand, then turns to face the sleeping character, who remains asleep.", "history_tokens": 382, "history_utf8_bytes": 1575, "recent_frame_times_s": [113.00296875, 114.00296875, 115.00296875, 116.00296875, 117.00296875, 118.00296875, 119.00296875, 120.00296875, 121.00296875, 122.00296875, 123.00296875, 124.00296875, 125.00296875, 126.00296875, 127.00296875, 128.00296875, 129.00296875, 130.00296875, 131.00296875, 132.00296875, 133.00296875, 134.00296875, 135.00296875, 136.00296875, 137.00296875, 138.00296875, 139.00296875, 140.00296875, 141.00296875, 142.00296875], "recent_frames_sha256": "c63212bf96a4112cd610d621802d207dadad428addc98f35ea84903e89426f0c", "num_recent_frames": 30, "tq": 716741.489395469, "t1": 716753.536102002, "ta": 716753.536102002, "te": 716753.576706814, "first_response_s": 12.046706533059478, "answer_total_s": 12.087311345036142, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 235, "content_group": "5423f9d4b8e050dcc5fccf7eac550e08f067f1b1b52de917f125f6b336c4a18a", "question": {"question_id": "sample_235_a1242_q0", "video_id": 235, "video_path": "./videos/sample_235_real.mp4", "annotation_index": 1242, "question_index": 0, "question": "Why does the person start searching through his wardrobe?", "options": ["A. Because he wants to clean his room.", "B. Because he is checking if he has lost anything.", "C. Because he is preparing to leave the house.", "D. Because he cannot find his wallet."], "answer": "B", "time_stamp_s": 247, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [236, 266], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_235_a1242_q0", "video_id": 235, "time_stamp_s": 247, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "097abced3d5679c9047af13eaef454cc3a0be7a3229e9755586160069047d376", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [217.00296875, 218.00296875, 219.00296875, 220.00296875, 221.00296875, 222.00296875, 223.00296875, 224.00296875, 225.00296875, 226.00296875, 227.00296875, 228.00296875, 229.00296875, 230.00296875, 231.00296875, 232.00296875, 233.00296875, 234.00296875, 235.00296875, 236.00296875, 237.00296875, 238.00296875, 239.00296875, 240.00296875, 241.00296875, 242.00296875, 243.00296875, 244.00296875, 245.00296875, 246.00296875], "recent_frames_sha256": "b9ee11b1b541e9d67aaa7cbacff6ee49776901ac524534d2de8cee4a0ea76666", "num_recent_frames": 30, "tq": 716683.197778509, "t1": 716690.841588157, "ta": 716690.841588157, "te": 716690.881257151, "first_response_s": 7.643809647997841, "answer_total_s": 7.683478642022237, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_235_a1242_q0", "video_id": 235, "time_stamp_s": 247, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7c3a7cce838f83716301d824ff01d2c80f709e76b635b8613d7661ffa709f5fd", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Mr. Bean is shown in a laundry room, being playfully attacked by a woman with a green outfit, while a box of \"Mr. Bean\" themed food is presented to him.  \n- The scene transitions to a nighttime suburban setting with a car parked outside a house, followed by a yellow cat running through a hallway with a clock on the wall.  \n- An elderly woman in a pink dress is seated in a chair, watching television, which displays a wrestling match featuring a large wrestler.\n[30-60s] - A cartoon cat with a black tail and yellow body walks across a hallway, passing a staircase and a door with a clock above it.\n- A man in a red cap and white pajamas sits under a blanket in bed, reading a comic book with a teddy bear and a bowl of popcorn beside him.\n- The comic book's cover features bold text \"POW\" and \"NOOOOOSH!\" with cartoon characters and explosions, suggesting action-packed content.\n[60-90s] - A man in bed with red sleep mask and teddy bear, eyes closed, then opens them with a startled expression.\n- Nightstand holds a bowl of eggs, alarm clock, and a magazine, all stationary.\n- A woman sleeps in a recliner, illuminated by a spotlight, with a fishbowl on a nearby table.\n[90-120s] - A cartoon thief in a black mask and suit stealthily climbs a roof at night, then jumps down to a house's window.\n- Inside a bedroom, the thief approaches a sleeping character wearing red eye masks, who is lying in bed with a teddy bear beside them.\n- The thief, now on the floor, looks up at a clock on a nightstand, then turns to face the sleeping character, who remains asleep.\n[120-150s] - A masked thief stealthily approaches a sleeping woman in a pink robe, then lifts a fishbowl containing a fish from a table.\n- The thief walks past a yellow cat lying on the floor, then pauses to look at a wall-mounted clock as the woman wakes up.\n- The scene shifts to an exterior view of a house at night, with a yellow car parked on the street.\n[150-180s] - A police officer with a long nose and a black hat stands in a hallway, gesturing with his hands.\n- A man in a suit and tie stands in the hallway, looking at the officer with a surprised expression.\n- A potted plant is visible on the right side of the hallway.\n[180-210s] - Mr. Bean stands in a hallway, looking surprised, then walks toward a staircase while holding a small object.  \n- The scene shifts to a room with police tape, a red telephone, and a clock on the wall, indicating a crime scene.  \n- A police officer holds a \"WANTED\" poster featuring a bearded man, showing it to an elderly woman who is seated in a chair.\n[210-240s] - Mr. Bean enters the room, walks to the bed, and picks up a red telephone lying on the floor.  \n- He then stands beside the bed, holding a blue tablet, and looks at it with a curious expression.  \n- The tablet screen displays a comic book cover titled \"Super Hero Stories\" featuring a superhero in a blue suit.", "history_tokens": 714, "history_utf8_bytes": 2897, "recent_frame_times_s": [217.00296875, 218.00296875, 219.00296875, 220.00296875, 221.00296875, 222.00296875, 223.00296875, 224.00296875, 225.00296875, 226.00296875, 227.00296875, 228.00296875, 229.00296875, 230.00296875, 231.00296875, 232.00296875, 233.00296875, 234.00296875, 235.00296875, 236.00296875, 237.00296875, 238.00296875, 239.00296875, 240.00296875, 241.00296875, 242.00296875, 243.00296875, 244.00296875, 245.00296875, 246.00296875], "recent_frames_sha256": "b9ee11b1b541e9d67aaa7cbacff6ee49776901ac524534d2de8cee4a0ea76666", "num_recent_frames": 30, "tq": 716792.191238517, "t1": 716799.392176986, "ta": 716799.392176986, "te": 716799.667041773, "first_response_s": 7.20093846891541, "answer_total_s": 7.475803255918436, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 235, "content_group": "5423f9d4b8e050dcc5fccf7eac550e08f067f1b1b52de917f125f6b336c4a18a", "question": {"question_id": "sample_235_a1243_q0", "video_id": 235, "video_path": "./videos/sample_235_real.mp4", "annotation_index": 1243, "question_index": 0, "question": "Why does the man offer his underwear to the woman as a replacement bag?", "options": ["A. Because the woman forgot to bring her shopping bag.", "B. Because the man is trying to make the woman laugh with a joke.", "C. Because the lady's shopping bag is torn.", "D. Because the woman mentioned she needed something to carry her things in."], "answer": "C", "time_stamp_s": 360, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [354, 384], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_235_a1243_q0", "video_id": 235, "time_stamp_s": 360, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "16a39b101adc1c88216edb20c4d96f01c4d759fe29c7a6a04700c5ccc7502bf0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [330.00296875, 331.00296875, 332.00296875, 333.00296875, 334.00296875, 335.00296875, 336.00296875, 337.00296875, 338.00296875, 339.00296875, 340.00296875, 341.00296875, 342.00296875, 343.00296875, 344.00296875, 345.00296875, 346.00296875, 347.00296875, 348.00296875, 349.00296875, 350.00296875, 351.00296875, 352.00296875, 353.00296875, 354.00296875, 355.00296875, 356.00296875, 357.00296875, 358.00296875, 359.00296875], "recent_frames_sha256": "8fc1bdbee255fa262d2a3b8c1e2156bfae1136cc4c5b1478caea3d772bf3167a", "num_recent_frames": 30, "tq": 716690.893846043, "t1": 716702.503403554, "ta": 716702.503403554, "te": 716702.544085926, "first_response_s": 11.609557510935701, "answer_total_s": 11.650239882990718, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_235_a1243_q0", "video_id": 235, "time_stamp_s": 360, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "468aa248df11093fbc8c658b3bac366499aa8f3a0027b3088e98f5196078b464", "condition_order": ["recent", "notes"], "memory": "[30-60s] - A cartoon cat with a black tail and yellow body walks across a hallway, passing a staircase and a door with a clock above it.\n- A man in a red cap and white pajamas sits under a blanket in bed, reading a comic book with a teddy bear and a bowl of popcorn beside him.\n- The comic book's cover features bold text \"POW\" and \"NOOOOOSH!\" with cartoon characters and explosions, suggesting action-packed content.\n[60-90s] - A man in bed with red sleep mask and teddy bear, eyes closed, then opens them with a startled expression.\n- Nightstand holds a bowl of eggs, alarm clock, and a magazine, all stationary.\n- A woman sleeps in a recliner, illuminated by a spotlight, with a fishbowl on a nearby table.\n[90-120s] - A cartoon thief in a black mask and suit stealthily climbs a roof at night, then jumps down to a house's window.\n- Inside a bedroom, the thief approaches a sleeping character wearing red eye masks, who is lying in bed with a teddy bear beside them.\n- The thief, now on the floor, looks up at a clock on a nightstand, then turns to face the sleeping character, who remains asleep.\n[120-150s] - A masked thief stealthily approaches a sleeping woman in a pink robe, then lifts a fishbowl containing a fish from a table.\n- The thief walks past a yellow cat lying on the floor, then pauses to look at a wall-mounted clock as the woman wakes up.\n- The scene shifts to an exterior view of a house at night, with a yellow car parked on the street.\n[150-180s] - A police officer with a long nose and a black hat stands in a hallway, gesturing with his hands.\n- A man in a suit and tie stands in the hallway, looking at the officer with a surprised expression.\n- A potted plant is visible on the right side of the hallway.\n[180-210s] - Mr. Bean stands in a hallway, looking surprised, then walks toward a staircase while holding a small object.  \n- The scene shifts to a room with police tape, a red telephone, and a clock on the wall, indicating a crime scene.  \n- A police officer holds a \"WANTED\" poster featuring a bearded man, showing it to an elderly woman who is seated in a chair.\n[210-240s] - Mr. Bean enters the room, walks to the bed, and picks up a red telephone lying on the floor.  \n- He then stands beside the bed, holding a blue tablet, and looks at it with a curious expression.  \n- The tablet screen displays a comic book cover titled \"Super Hero Stories\" featuring a superhero in a blue suit.\n[240-270s] - Mr. Bean holds a blue pillow and a red object while standing beside a bed with a red heart-shaped item on it.\n- He moves to a closet, then to a chair, and later appears through a window holding a red box.\n- He is seen holding a blue pillow in a kitchen setting, then later holding scissors and a red object in a room with wooden paneling.\n[270-300s] - Mr. Bean in superhero costume runs down a street, then stops to confront a man in a blue robe sitting on a chair.  \n- A black cat with a white muzzle leaps from a tree branch toward the man in the robe.  \n- The man in the robe is seated under a tree, facing Mr. Bean, while the cat approaches him from above.\n[300-330s] - Mr. Bean, wearing red goggles, stands beside an elderly woman seated in a chair, gesturing with his hand.\n- A small grey cat is seen clinging to a tree branch, holding a red object, then drops it to the ground.\n- The cat is later shown on the ground, looking up at Mr. Bean, who is now holding the red object.\n[330-360s] - Mr. Bean, wearing red goggles and a cape, appears in a street scene, holding a green tennis racket and a red ball, then leaps into the air.\n- A red van with two occupants is visible behind him, and a yellow car is positioned nearby.\n- A woman in a purple outfit and hat walks past a store window, carrying a paper bag, while Mr. Bean stands near a yellow ball on the sidewalk.", "history_tokens": 960, "history_utf8_bytes": 3810, "recent_frame_times_s": [330.00296875, 331.00296875, 332.00296875, 333.00296875, 334.00296875, 335.00296875, 336.00296875, 337.00296875, 338.00296875, 339.00296875, 340.00296875, 341.00296875, 342.00296875, 343.00296875, 344.00296875, 345.00296875, 346.00296875, 347.00296875, 348.00296875, 349.00296875, 350.00296875, 351.00296875, 352.00296875, 353.00296875, 354.00296875, 355.00296875, 356.00296875, 357.00296875, 358.00296875, 359.00296875], "recent_frames_sha256": "8fc1bdbee255fa262d2a3b8c1e2156bfae1136cc4c5b1478caea3d772bf3167a", "num_recent_frames": 30, "tq": 716831.041559453, "t1": 716832.327809254, "ta": 716832.327809254, "te": 716832.365870081, "first_response_s": 1.2862498010508716, "answer_total_s": 1.3243106279987842, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 235, "content_group": "5423f9d4b8e050dcc5fccf7eac550e08f067f1b1b52de917f125f6b336c4a18a", "question": {"question_id": "sample_235_a1244_q0", "video_id": 235, "video_path": "./videos/sample_235_real.mp4", "annotation_index": 1244, "question_index": 0, "question": "Why does the character hide behind structures on the roof?", "options": ["A. Because he heard a loud noise and got scared.", "B. Because he noticed a helicopter approaching and wanted to stay hidden.", "C. Because the thief in black clothes spotted him and chased after him.", "D. Because he saw the roof starting to collapse and needed to find safety."], "answer": "C", "time_stamp_s": 490, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [472, 502], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_235_a1244_q0", "video_id": 235, "time_stamp_s": 490, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6c8aad9be6c877700c76579ddca37d8d63fba7bcda715f4586167c00d07a0d0e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [460.00296875, 461.00296875, 462.00296875, 463.00296875, 464.00296875, 465.00296875, 466.00296875, 467.00296875, 468.00296875, 469.00296875, 470.00296875, 471.00296875, 472.00296875, 473.00296875, 474.00296875, 475.00296875, 476.00296875, 477.00296875, 478.00296875, 479.00296875, 480.00296875, 481.00296875, 482.00296875, 483.00296875, 484.00296875, 485.00296875, 486.00296875, 487.00296875, 488.00296875, 489.00296875], "recent_frames_sha256": "07608ee8eb7b9243f17b929f78627e055b36f2aab91cf71219162a76f66a6e8b", "num_recent_frames": 30, "tq": 716702.555787049, "t1": 716709.823734225, "ta": 716709.823734225, "te": 716709.862098664, "first_response_s": 7.267947176005691, "answer_total_s": 7.306311615044251, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_235_a1244_q0", "video_id": 235, "time_stamp_s": 490, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5234ec014fe5699a80e51dee5c9bfce9245a0500a807bc8ba678745bd80264aa", "condition_order": ["recent", "notes"], "memory": "[150-180s] - A police officer with a long nose and a black hat stands in a hallway, gesturing with his hands.\n- A man in a suit and tie stands in the hallway, looking at the officer with a surprised expression.\n- A potted plant is visible on the right side of the hallway.\n[180-210s] - Mr. Bean stands in a hallway, looking surprised, then walks toward a staircase while holding a small object.  \n- The scene shifts to a room with police tape, a red telephone, and a clock on the wall, indicating a crime scene.  \n- A police officer holds a \"WANTED\" poster featuring a bearded man, showing it to an elderly woman who is seated in a chair.\n[210-240s] - Mr. Bean enters the room, walks to the bed, and picks up a red telephone lying on the floor.  \n- He then stands beside the bed, holding a blue tablet, and looks at it with a curious expression.  \n- The tablet screen displays a comic book cover titled \"Super Hero Stories\" featuring a superhero in a blue suit.\n[240-270s] - Mr. Bean holds a blue pillow and a red object while standing beside a bed with a red heart-shaped item on it.\n- He moves to a closet, then to a chair, and later appears through a window holding a red box.\n- He is seen holding a blue pillow in a kitchen setting, then later holding scissors and a red object in a room with wooden paneling.\n[270-300s] - Mr. Bean in superhero costume runs down a street, then stops to confront a man in a blue robe sitting on a chair.  \n- A black cat with a white muzzle leaps from a tree branch toward the man in the robe.  \n- The man in the robe is seated under a tree, facing Mr. Bean, while the cat approaches him from above.\n[300-330s] - Mr. Bean, wearing red goggles, stands beside an elderly woman seated in a chair, gesturing with his hand.\n- A small grey cat is seen clinging to a tree branch, holding a red object, then drops it to the ground.\n- The cat is later shown on the ground, looking up at Mr. Bean, who is now holding the red object.\n[330-360s] - Mr. Bean, wearing red goggles and a cape, appears in a street scene, holding a green tennis racket and a red ball, then leaps into the air.\n- A red van with two occupants is visible behind him, and a yellow car is positioned nearby.\n- A woman in a purple outfit and hat walks past a store window, carrying a paper bag, while Mr. Bean stands near a yellow ball on the sidewalk.\n[360-390s] - Mr. Bean, wearing red glasses and a blue coat, is seen running away from a large, cartoonish figure holding a pineapple and a carrot, while a small child in a blue outfit runs alongside him.\n- Mr. Bean is later shown standing outside an electronics shop, gesturing toward the store's window display, which features multiple screens showing him in a news broadcast.\n- A newspaper headline reading \"THIEF!!!\" is visible, with a black-and-white image of a thief in a mask, suggesting Mr. Bean is being portrayed as a criminal in the media.\n[390-420s] - A man in a suit holds a newspaper with \"THIEF!!!\" headline, pointing at a photo of a masked figure.  \n- A masked figure in a blue cape and red mask stands on a rooftop under a large moon, looking down.  \n- A second masked figure in a black suit and hat sits on a ledge below, observing the rooftop figure.\n[420-450s] - A man in a blue suit and red glasses is seen running across rooftops at night, with a large moon in the background.\n- He is being chased by a man in a black suit and sunglasses who is also running across rooftops.\n- The man in the blue suit is seen jumping off a rooftop and landing on the ground, while the man in the black suit is seen jumping off a rooftop and landing on the ground.\n[450-480s] - Mr. Bean, in a superhero outfit, leaps from a rooftop ledge, holding an umbrella, against a starry red sky.\n- He lands on a rooftop, then turns to face a shadowy figure perched on a brick wall, appearing startled.\n- The shadowy figure, wearing a mask and holding a weapon, is positioned above Mr. Bean, suggesting a confrontation.", "history_tokens": 992, "history_utf8_bytes": 3961, "recent_frame_times_s": [460.00296875, 461.00296875, 462.00296875, 463.00296875, 464.00296875, 465.00296875, 466.00296875, 467.00296875, 468.00296875, 469.00296875, 470.00296875, 471.00296875, 472.00296875, 473.00296875, 474.00296875, 475.00296875, 476.00296875, 477.00296875, 478.00296875, 479.00296875, 480.00296875, 481.00296875, 482.00296875, 483.00296875, 484.00296875, 485.00296875, 486.00296875, 487.00296875, 488.00296875, 489.00296875], "recent_frames_sha256": "07608ee8eb7b9243f17b929f78627e055b36f2aab91cf71219162a76f66a6e8b", "num_recent_frames": 30, "tq": 716862.437103923, "t1": 716868.384287447, "ta": 716868.384287447, "te": 716868.543085274, "first_response_s": 5.947183524025604, "answer_total_s": 6.105981351109222, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 236, "content_group": "c5c9cfa564a07f873b31c070b74b7c6287f3e8855df757b3f3dd27c823787f33", "question": {"question_id": "sample_236_a726_q0", "video_id": 236, "video_path": "./videos/sample_236_real.mp4", "annotation_index": 726, "question_index": 0, "question": "Why did the old lady fall?", "options": ["A. Because she stepped on a toy racing car on the ground.", "B. Because she tripped over a loose rug in the hallway.", "C. Because she missed a step while walking down the stairs.", "D. Because she lost her balance while reaching for something on a high shelf."], "answer": "A", "time_stamp_s": 66, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_236_a726_q0", "video_id": 236, "time_stamp_s": 66, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "33c79e77cb0d2858ad42d38d3b2d3acc4bea71d6e536d7728ec4911834766e31", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [36.02296875, 37.02296875, 38.02296875, 39.02296875, 40.02296875, 41.02296875, 42.02296875, 43.02296875, 44.02296875, 45.02296875, 46.02296875, 47.02296875, 48.02296875, 49.02296875, 50.02296875, 51.02296875, 52.02296875, 53.02296875, 54.02296875, 55.02296875, 56.02296875, 57.02296875, 58.02296875, 59.02296875, 60.02296875, 61.02296875, 62.02296875, 63.02296875, 64.02296875, 65.02296875], "recent_frames_sha256": "d4c9ecf89d4f56325487e296c3fa76714d8486f01f733d2aa9dfa2523b19cf10", "num_recent_frames": 30, "tq": 717764.918038231, "t1": 717765.438216335, "ta": 717765.438216335, "te": 717765.476503743, "first_response_s": 0.5201781040523201, "answer_total_s": 0.5584655120037496, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_236_a726_q0", "video_id": 236, "time_stamp_s": 66, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "71b7a359f9bbdfc38d74a47d6439abd2453ed8f54746b8e504afb163b445eca3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean, in a suit, is seen outside a house window, holding a basket of apples, while a cat sits on the windowsill.  \n- Mr. Bean then uses a red device to interact with a clothesline, causing a cat to appear in the window.  \n- A large, grey, overweight man with glasses is seen walking a small orange cat on a leash, followed by a yellow car, in a suburban neighborhood.\n[30-60s] - Mr. Bean stands near a wall clock, holding a small object, then looks up at the clock as it appears to move upward.  \n- A red toy car is positioned on the floor to the left, while a potted plant sits on a small table to the right.  \n- Mr. Bean turns toward the plant, smiling, as a large, dark figure enters the room from the right side.", "history_tokens": 188, "history_utf8_bytes": 730, "recent_frame_times_s": [36.02296875, 37.02296875, 38.02296875, 39.02296875, 40.02296875, 41.02296875, 42.02296875, 43.02296875, 44.02296875, 45.02296875, 46.02296875, 47.02296875, 48.02296875, 49.02296875, 50.02296875, 51.02296875, 52.02296875, 53.02296875, 54.02296875, 55.02296875, 56.02296875, 57.02296875, 58.02296875, 59.02296875, 60.02296875, 61.02296875, 62.02296875, 63.02296875, 64.02296875, 65.02296875], "recent_frames_sha256": "d4c9ecf89d4f56325487e296c3fa76714d8486f01f733d2aa9dfa2523b19cf10", "num_recent_frames": 30, "tq": 717631.527474549, "t1": 717637.572581435, "ta": 717637.572581435, "te": 717637.83475515, "first_response_s": 6.045106885954738, "answer_total_s": 6.307280601002276, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 236, "content_group": "c5c9cfa564a07f873b31c070b74b7c6287f3e8855df757b3f3dd27c823787f33", "question": {"question_id": "sample_236_a727_q0", "video_id": 236, "video_path": "./videos/sample_236_real.mp4", "annotation_index": 727, "question_index": 0, "question": "Why is the old lady lying in the hospital bed now?", "options": ["A. Because she stepped on a toy car and fell down before.", "B. Because she had a sudden illness and needed immediate medical attention.", "C. Because she was involved in a minor car accident.", "D. Because she fainted from low blood pressure while shopping."], "answer": "A", "time_stamp_s": 129, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [121, 151], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_236_a727_q0", "video_id": 236, "time_stamp_s": 129, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "af298870a40beb7a0b9e1bf285bce812afa727c31d924af1a95fa04147fee08b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [99.02296875, 100.02296875, 101.02296875, 102.02296875, 103.02296875, 104.02296875, 105.02296875, 106.02296875, 107.02296875, 108.02296875, 109.02296875, 110.02296875, 111.02296875, 112.02296875, 113.02296875, 114.02296875, 115.02296875, 116.02296875, 117.02296875, 118.02296875, 119.02296875, 120.02296875, 121.02296875, 122.02296875, 123.02296875, 124.02296875, 125.02296875, 126.02296875, 127.02296875, 128.02296875], "recent_frames_sha256": "13e6b27cef4ddf291ff8d2111c5194dcbe4ba1fd7a32cf60175c68b5d4750543", "num_recent_frames": 30, "tq": 717765.48774978, "t1": 717779.693097086, "ta": 717779.693097086, "te": 717779.882814078, "first_response_s": 14.205347306095064, "answer_total_s": 14.395064298063517, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_236_a727_q0", "video_id": 236, "time_stamp_s": 129, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b445c2a77bdc4d716b35b0dfe66a4939fcaac7f4fa8a65be6e0791b09477d4a9", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean, in a suit, is seen outside a house window, holding a basket of apples, while a cat sits on the windowsill.  \n- Mr. Bean then uses a red device to interact with a clothesline, causing a cat to appear in the window.  \n- A large, grey, overweight man with glasses is seen walking a small orange cat on a leash, followed by a yellow car, in a suburban neighborhood.\n[30-60s] - Mr. Bean stands near a wall clock, holding a small object, then looks up at the clock as it appears to move upward.  \n- A red toy car is positioned on the floor to the left, while a potted plant sits on a small table to the right.  \n- Mr. Bean turns toward the plant, smiling, as a large, dark figure enters the room from the right side.\n[60-90s] - Mr. Bean stands on stairs, holding a red-and-white object, looking concerned.  \n- Outside, a large grey object lies on the ground near scattered items, with a yellow cat nearby.  \n- Mr. Bean steps down, approaches the cat, and then looks up as a white van with green stripes drives past.\n[90-120s] - Mr. Bean stands beside a hospital bed, holding a tube connected to a patient's nose, while the patient lies in bed with a bandaged head and reading a newspaper.\n- The patient is in a green hospital gown, positioned under a blue curtain, with a monitor mounted above the bed.\n- Mr. Bean's expression shifts from neutral to concerned as he looks at the patient, then turns his head to the right, possibly observing something off-screen.", "history_tokens": 363, "history_utf8_bytes": 1476, "recent_frame_times_s": [99.02296875, 100.02296875, 101.02296875, 102.02296875, 103.02296875, 104.02296875, 105.02296875, 106.02296875, 107.02296875, 108.02296875, 109.02296875, 110.02296875, 111.02296875, 112.02296875, 113.02296875, 114.02296875, 115.02296875, 116.02296875, 117.02296875, 118.02296875, 119.02296875, 120.02296875, 121.02296875, 122.02296875, 123.02296875, 124.02296875, 125.02296875, 126.02296875, 127.02296875, 128.02296875], "recent_frames_sha256": "13e6b27cef4ddf291ff8d2111c5194dcbe4ba1fd7a32cf60175c68b5d4750543", "num_recent_frames": 30, "tq": 717656.094317397, "t1": 717662.562054957, "ta": 717662.562054957, "te": 717662.718191985, "first_response_s": 6.467737560044043, "answer_total_s": 6.623874588054605, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 236, "content_group": "c5c9cfa564a07f873b31c070b74b7c6287f3e8855df757b3f3dd27c823787f33", "question": {"question_id": "sample_236_a728_q0", "video_id": 236, "video_path": "./videos/sample_236_real.mp4", "annotation_index": 728, "question_index": 0, "question": "Why is the floor of this room completely covered with water now?", "options": ["A. Because a pipe burst under the sink.", "B. Because the faucet was left on, the water overflowed.", "C. Because someone accidentally spilled a large container of water.", "D. Because the washing machine malfunctioned and leaked."], "answer": "B", "time_stamp_s": 275, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [242, 272], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_236_a728_q0", "video_id": 236, "time_stamp_s": 275, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "cdc2beb2c0a57d4967b2996c2854342ef88a694eae73991c7a14fcd30425ac90", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [245.02296875, 246.02296875, 247.02296875, 248.02296875, 249.02296875, 250.02296875, 251.02296875, 252.02296875, 253.02296875, 254.02296875, 255.02296875, 256.02296875, 257.02296875, 258.02296875, 259.02296875, 260.02296875, 261.02296875, 262.02296875, 263.02296875, 264.02296875, 265.02296875, 266.02296875, 267.02296875, 268.02296875, 269.02296875, 270.02296875, 271.02296875, 272.02296875, 273.02296875, 274.02296875], "recent_frames_sha256": "eb81df04ceddd65d64fc61c82c7ebe59b17e8f7debe1d9a4420d9b2deecf50cc", "num_recent_frames": 30, "tq": 717779.895102844, "t1": 717792.669805237, "ta": 717792.669805237, "te": 717792.71049268, "first_response_s": 12.774702392984182, "answer_total_s": 12.815389835974202, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_236_a728_q0", "video_id": 236, "time_stamp_s": 275, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "85f2d401803f51d7b74d36ce3ebd99d55f1ccb44db2f31fcdd3bfec07a2ff6e3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean, in a suit, is seen outside a house window, holding a basket of apples, while a cat sits on the windowsill.  \n- Mr. Bean then uses a red device to interact with a clothesline, causing a cat to appear in the window.  \n- A large, grey, overweight man with glasses is seen walking a small orange cat on a leash, followed by a yellow car, in a suburban neighborhood.\n[30-60s] - Mr. Bean stands near a wall clock, holding a small object, then looks up at the clock as it appears to move upward.  \n- A red toy car is positioned on the floor to the left, while a potted plant sits on a small table to the right.  \n- Mr. Bean turns toward the plant, smiling, as a large, dark figure enters the room from the right side.\n[60-90s] - Mr. Bean stands on stairs, holding a red-and-white object, looking concerned.  \n- Outside, a large grey object lies on the ground near scattered items, with a yellow cat nearby.  \n- Mr. Bean steps down, approaches the cat, and then looks up as a white van with green stripes drives past.\n[90-120s] - Mr. Bean stands beside a hospital bed, holding a tube connected to a patient's nose, while the patient lies in bed with a bandaged head and reading a newspaper.\n- The patient is in a green hospital gown, positioned under a blue curtain, with a monitor mounted above the bed.\n- Mr. Bean's expression shifts from neutral to concerned as he looks at the patient, then turns his head to the right, possibly observing something off-screen.\n[120-150s] - Mr. Bean stands beside a hospital bed, smiling while holding a clipboard, near a patient in a green hospital gown with a cast on their leg.\n- A doctor in a white coat enters the room, approaching Mr. Bean, who is still standing by the bed.\n- The scene transitions to a different room where a large, wrapped-up woman sits in a chair, glaring at Mr. Bean, who is now standing nearby with a smug expression.\n[150-180s] - Mr. Bean holds a long pole with a hook, approaching a seated, bandaged woman in a chair.\n- The pole's hook is lowered toward the woman's head, suggesting an impending interaction.\n- The woman remains seated, visibly annoyed, while Mr. Bean stands beside her, gesturing with the pole.\n[180-210s] - Mrs. Bean is seated in a green armchair, wrapped in white bandages, with a stern expression and a flower in her lap.\n- Mr. Bean stands beside her, gesturing with his hand, then turns away as she remains seated.\n- The scene shifts to Mr. Bean in a kitchen, holding a red pot, then moves to a hallway with a staircase and a hanging clock.\n[210-240s] - Mr. Bean stands in a kitchen, reacting to smoke rising from the stove, with a red box on the floor nearby.  \n- The scene shifts to a living room where Mr. Bean enters, observing a large, wrapped figure seated in a chair with a clock hanging on the wall.  \n- The wrapped figure appears to be in a state of rest or unconsciousness, with a small table beside them holding a pink object.\n[240-270s] - Mr. Bean is in a kitchen, standing in a large puddle of foam, looking distressed and attempting to navigate through it.\n- He is wearing his signature brown suit and red tie, with a medical IV drip visible in the background.\n- The foam appears to be overflowing from a sink or appliance, spreading across the floor and partially obscuring the kitchen appliances.", "history_tokens": 811, "history_utf8_bytes": 3313, "recent_frame_times_s": [245.02296875, 246.02296875, 247.02296875, 248.02296875, 249.02296875, 250.02296875, 251.02296875, 252.02296875, 253.02296875, 254.02296875, 255.02296875, 256.02296875, 257.02296875, 258.02296875, 259.02296875, 260.02296875, 261.02296875, 262.02296875, 263.02296875, 264.02296875, 265.02296875, 266.02296875, 267.02296875, 268.02296875, 269.02296875, 270.02296875, 271.02296875, 272.02296875, 273.02296875, 274.02296875], "recent_frames_sha256": "eb81df04ceddd65d64fc61c82c7ebe59b17e8f7debe1d9a4420d9b2deecf50cc", "num_recent_frames": 30, "tq": 717705.333575, "t1": 717706.905780366, "ta": 717706.905780366, "te": 717706.947604609, "first_response_s": 1.5722053659847006, "answer_total_s": 1.6140296088997275, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 236, "content_group": "c5c9cfa564a07f873b31c070b74b7c6287f3e8855df757b3f3dd27c823787f33", "question": {"question_id": "sample_236_a729_q0", "video_id": 236, "video_path": "./videos/sample_236_real.mp4", "annotation_index": 729, "question_index": 0, "question": "Why does Mr. Bean hit the table with a mop?", "options": ["A. Because he wants to catch that cat.", "B. Because he is trying to kill a bug crawling on the table.", "C. Because he accidentally spilled something and is trying to clean it up.", "D. Because he is frustrated and taking out his anger on the table."], "answer": "A", "time_stamp_s": 390, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [363, 393], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_236_a729_q0", "video_id": 236, "time_stamp_s": 390, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "290d4c66b47046ecd4a97cd1f36ce4b8548e0fa2b18ae182b22ba64925cb1d01", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [360.02296875, 361.02296875, 362.02296875, 363.02296875, 364.02296875, 365.02296875, 366.02296875, 367.02296875, 368.02296875, 369.02296875, 370.02296875, 371.02296875, 372.02296875, 373.02296875, 374.02296875, 375.02296875, 376.02296875, 377.02296875, 378.02296875, 379.02296875, 380.02296875, 381.02296875, 382.02296875, 383.02296875, 384.02296875, 385.02296875, 386.02296875, 387.02296875, 388.02296875, 389.02296875], "recent_frames_sha256": "278d7f3b583c8fc959fde79a496c65f21e6e77589209c2dd22c0aa4b5b85cbed", "num_recent_frames": 30, "tq": 717792.718792769, "t1": 717805.020906341, "ta": 717805.020906341, "te": 717805.059490532, "first_response_s": 12.302113572019152, "answer_total_s": 12.340697763022035, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_236_a729_q0", "video_id": 236, "time_stamp_s": 390, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ffca61e32add8aea6207828856c72d558c6983248dff09d24576d8c3dab2e64f", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Mr. Bean stands on stairs, holding a red-and-white object, looking concerned.  \n- Outside, a large grey object lies on the ground near scattered items, with a yellow cat nearby.  \n- Mr. Bean steps down, approaches the cat, and then looks up as a white van with green stripes drives past.\n[90-120s] - Mr. Bean stands beside a hospital bed, holding a tube connected to a patient's nose, while the patient lies in bed with a bandaged head and reading a newspaper.\n- The patient is in a green hospital gown, positioned under a blue curtain, with a monitor mounted above the bed.\n- Mr. Bean's expression shifts from neutral to concerned as he looks at the patient, then turns his head to the right, possibly observing something off-screen.\n[120-150s] - Mr. Bean stands beside a hospital bed, smiling while holding a clipboard, near a patient in a green hospital gown with a cast on their leg.\n- A doctor in a white coat enters the room, approaching Mr. Bean, who is still standing by the bed.\n- The scene transitions to a different room where a large, wrapped-up woman sits in a chair, glaring at Mr. Bean, who is now standing nearby with a smug expression.\n[150-180s] - Mr. Bean holds a long pole with a hook, approaching a seated, bandaged woman in a chair.\n- The pole's hook is lowered toward the woman's head, suggesting an impending interaction.\n- The woman remains seated, visibly annoyed, while Mr. Bean stands beside her, gesturing with the pole.\n[180-210s] - Mrs. Bean is seated in a green armchair, wrapped in white bandages, with a stern expression and a flower in her lap.\n- Mr. Bean stands beside her, gesturing with his hand, then turns away as she remains seated.\n- The scene shifts to Mr. Bean in a kitchen, holding a red pot, then moves to a hallway with a staircase and a hanging clock.\n[210-240s] - Mr. Bean stands in a kitchen, reacting to smoke rising from the stove, with a red box on the floor nearby.  \n- The scene shifts to a living room where Mr. Bean enters, observing a large, wrapped figure seated in a chair with a clock hanging on the wall.  \n- The wrapped figure appears to be in a state of rest or unconsciousness, with a small table beside them holding a pink object.\n[240-270s] - Mr. Bean is in a kitchen, standing in a large puddle of foam, looking distressed and attempting to navigate through it.\n- He is wearing his signature brown suit and red tie, with a medical IV drip visible in the background.\n- The foam appears to be overflowing from a sink or appliance, spreading across the floor and partially obscuring the kitchen appliances.\n[270-300s] - Mr. Bean stands in a kitchen, surrounded by large clouds of soap suds, holding a toothbrush and looking distressed.  \n- The scene transitions to a hallway with a staircase, a red telephone, a hanging clock, and a potted plant.  \n- Mr. Bean enters a room where an elderly man is seated in a chair, wrapped in bandages, with a small table beside him holding a teapot and plate.\n[300-330s] - A cartoon character in a red outfit is shown on a TV screen, initially lying down and then standing up with a smile.  \n- A man in a suit stands in a room, observing the TV, then turns to face a large, bandaged character seated in a chair.  \n- The bandaged character is connected to an IV drip and has a small table with food and drinks beside them.\n[330-360s] - Mr. Bean stands near a table with food, gesturing toward a seated, bandaged character holding a pink object.  \n- The seated character, wrapped in bandages, appears to be in a reclined position with a purple garment and a dangling pink item.  \n- The room features a green wall, a doorway, and a small table with food, suggesting a domestic setting.\n[360-390s] - Mr. Bean stands in a kitchen with smoke billowing from the stove, holding a mop and bucket, appearing startled.  \n- A yellow cat sits on a shelf, ringing a bell on a pole, then jumps down and lands on Mr. Bean’s head.  \n- The cat then leaps onto the counter, causing Mr. Bean to react with surprise as the cat’s tail swings near a wall outlet.", "history_tokens": 993, "history_utf8_bytes": 4055, "recent_frame_times_s": [360.02296875, 361.02296875, 362.02296875, 363.02296875, 364.02296875, 365.02296875, 366.02296875, 367.02296875, 368.02296875, 369.02296875, 370.02296875, 371.02296875, 372.02296875, 373.02296875, 374.02296875, 375.02296875, 376.02296875, 377.02296875, 378.02296875, 379.02296875, 380.02296875, 381.02296875, 382.02296875, 383.02296875, 384.02296875, 385.02296875, 386.02296875, 387.02296875, 388.02296875, 389.02296875], "recent_frames_sha256": "278d7f3b583c8fc959fde79a496c65f21e6e77589209c2dd22c0aa4b5b85cbed", "num_recent_frames": 30, "tq": 717730.616189794, "t1": 717731.83772679, "ta": 717731.83772679, "te": 717732.02770021, "first_response_s": 1.2215369959594682, "answer_total_s": 1.4115104159573093, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 236, "content_group": "c5c9cfa564a07f873b31c070b74b7c6287f3e8855df757b3f3dd27c823787f33", "question": {"question_id": "sample_236_a730_q0", "video_id": 236, "video_path": "./videos/sample_236_real.mp4", "annotation_index": 730, "question_index": 0, "question": "Why did the character saw a piece of wood?", "options": ["A. Because the character needed firewood for the fireplace.", "B. As materials for a convertible sofa.", "C. Because the character was building a new shelf for the kitchen.", "D. Because the character wanted to repair a broken chair."], "answer": "B", "time_stamp_s": 503, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [484, 514], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_236_a730_q0", "video_id": 236, "time_stamp_s": 503, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e2d6f2041e29ca64be277b1fd8812698365c182ab3ec2ca203b1b8d361b016a2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [473.02296875, 474.02296875, 475.02296875, 476.02296875, 477.02296875, 478.02296875, 479.02296875, 480.02296875, 481.02296875, 482.02296875, 483.02296875, 484.02296875, 485.02296875, 486.02296875, 487.02296875, 488.02296875, 489.02296875, 490.02296875, 491.02296875, 492.02296875, 493.02296875, 494.02296875, 495.02296875, 496.02296875, 497.02296875, 498.02296875, 499.02296875, 500.02296875, 501.02296875, 502.02296875], "recent_frames_sha256": "5cbb987b82f1ffd7dfac166808b3bdbb98401dd2f659692d9bd2a6d91bdf7a13", "num_recent_frames": 30, "tq": 717805.06767983, "t1": 717811.55502436, "ta": 717811.55502436, "te": 717811.593489378, "first_response_s": 6.487344529945403, "answer_total_s": 6.525809547980316, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_236_a730_q0", "video_id": 236, "time_stamp_s": 503, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "18a10f711e7c178b1d22db01abb572ed6578991bee028b7e7739e1fb1577e7fc", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Mr. Bean holds a long pole with a hook, approaching a seated, bandaged woman in a chair.\n- The pole's hook is lowered toward the woman's head, suggesting an impending interaction.\n- The woman remains seated, visibly annoyed, while Mr. Bean stands beside her, gesturing with the pole.\n[180-210s] - Mrs. Bean is seated in a green armchair, wrapped in white bandages, with a stern expression and a flower in her lap.\n- Mr. Bean stands beside her, gesturing with his hand, then turns away as she remains seated.\n- The scene shifts to Mr. Bean in a kitchen, holding a red pot, then moves to a hallway with a staircase and a hanging clock.\n[210-240s] - Mr. Bean stands in a kitchen, reacting to smoke rising from the stove, with a red box on the floor nearby.  \n- The scene shifts to a living room where Mr. Bean enters, observing a large, wrapped figure seated in a chair with a clock hanging on the wall.  \n- The wrapped figure appears to be in a state of rest or unconsciousness, with a small table beside them holding a pink object.\n[240-270s] - Mr. Bean is in a kitchen, standing in a large puddle of foam, looking distressed and attempting to navigate through it.\n- He is wearing his signature brown suit and red tie, with a medical IV drip visible in the background.\n- The foam appears to be overflowing from a sink or appliance, spreading across the floor and partially obscuring the kitchen appliances.\n[270-300s] - Mr. Bean stands in a kitchen, surrounded by large clouds of soap suds, holding a toothbrush and looking distressed.  \n- The scene transitions to a hallway with a staircase, a red telephone, a hanging clock, and a potted plant.  \n- Mr. Bean enters a room where an elderly man is seated in a chair, wrapped in bandages, with a small table beside him holding a teapot and plate.\n[300-330s] - A cartoon character in a red outfit is shown on a TV screen, initially lying down and then standing up with a smile.  \n- A man in a suit stands in a room, observing the TV, then turns to face a large, bandaged character seated in a chair.  \n- The bandaged character is connected to an IV drip and has a small table with food and drinks beside them.\n[330-360s] - Mr. Bean stands near a table with food, gesturing toward a seated, bandaged character holding a pink object.  \n- The seated character, wrapped in bandages, appears to be in a reclined position with a purple garment and a dangling pink item.  \n- The room features a green wall, a doorway, and a small table with food, suggesting a domestic setting.\n[360-390s] - Mr. Bean stands in a kitchen with smoke billowing from the stove, holding a mop and bucket, appearing startled.  \n- A yellow cat sits on a shelf, ringing a bell on a pole, then jumps down and lands on Mr. Bean’s head.  \n- The cat then leaps onto the counter, causing Mr. Bean to react with surprise as the cat’s tail swings near a wall outlet.\n[390-420s] - Mr. Bean, in a kitchen, holds a mop and bucket, then drops the mop and looks frustrated.  \n- He walks into a living room where a man in a hospital bed is reclined, wearing a purple robe and bandages.  \n- Mr. Bean kneels beside the bed, appearing to speak or gesture toward the man, who is holding a phone.\n[420-450s] - Mr. Bean holds a long pole with a bell, standing near a table with a toaster and a shelf of utensils.  \n- An elderly woman in a straw hat enters, carrying a cake, and approaches a bed where a man is lying.  \n- The man in bed, wrapped in bandages, gestures with a hand while seated, and a small table with teacups is beside him.\n[450-480s] - The elderly woman in the purple robe and white scarf sits in a hospital bed with an angry expression, wearing a headband and surrounded by medical equipment.\n- The man in the suit and the woman in the straw hat stand near a small table with a teapot and cups, observing the television.\n- The television screen displays a cartoon of a woman riding a red scooter with a shopping basket, and text indicating \"£10,000 EASY PAY\" appears on the screen.", "history_tokens": 1003, "history_utf8_bytes": 4012, "recent_frame_times_s": [473.02296875, 474.02296875, 475.02296875, 476.02296875, 477.02296875, 478.02296875, 479.02296875, 480.02296875, 481.02296875, 482.02296875, 483.02296875, 484.02296875, 485.02296875, 486.02296875, 487.02296875, 488.02296875, 489.02296875, 490.02296875, 491.02296875, 492.02296875, 493.02296875, 494.02296875, 495.02296875, 496.02296875, 497.02296875, 498.02296875, 499.02296875, 500.02296875, 501.02296875, 502.02296875], "recent_frames_sha256": "5cbb987b82f1ffd7dfac166808b3bdbb98401dd2f659692d9bd2a6d91bdf7a13", "num_recent_frames": 30, "tq": 717756.410762447, "t1": 717764.57368037, "ta": 717764.57368037, "te": 717764.881507818, "first_response_s": 8.162917922949418, "answer_total_s": 8.470745370956138, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 237, "content_group": "04a4d99582589ad69c9a54e605cc439832fc7939e988ae43040110e06b1eaaf5", "question": {"question_id": "sample_237_a296_q0", "video_id": 237, "video_path": "./videos/sample_237_real.mp4", "annotation_index": 296, "question_index": 0, "question": "Why is Mr. Bean constantly posing right now?", "options": ["A. Because he is trying to practice his modeling skills.", "B. Because he is preparing for a photo shoot.", "C. Because he is showing off his new outfit in front of a mirror.", "D. Because he is imitating the characters on the television."], "answer": "D", "time_stamp_s": 64, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_237_a296_q0", "video_id": 237, "time_stamp_s": 64, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2b6b11f2536d0ad9340206057fd2df35a3e948aa0bb3baf1fd828ec5158ba413", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [34.01203125, 35.01203125, 36.01203125, 37.01203125, 38.01203125, 39.01203125, 40.01203125, 41.01203125, 42.01203125, 43.01203125, 44.01203125, 45.01203125, 46.01203125, 47.01203125, 48.01203125, 49.01203125, 50.01203125, 51.01203125, 52.01203125, 53.01203125, 54.01203125, 55.01203125, 56.01203125, 57.01203125, 58.01203125, 59.01203125, 60.01203125, 61.01203125, 62.01203125, 63.01203125], "recent_frames_sha256": "74dd1e6d8feb3ab1470dfa8f7ca4d1eea51c770a6ee8a3e15ecbc1e51678ff90", "num_recent_frames": 30, "tq": 716148.00569573, "t1": 716154.991255448, "ta": 716154.991255448, "te": 716155.028859789, "first_response_s": 6.98555971798487, "answer_total_s": 7.02316405903548, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_237_a296_q0", "video_id": 237, "time_stamp_s": 64, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "17e4448d388e684e69b396555649a8722a2266f6d24a6fa9559af6aceaff8baa", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean, in a suit, gestures while standing beside an elderly man holding a cake, both in a room with a door and windows.  \n- The scene transitions to a yellow car driving past a green house, followed by Mr. Bean watching TV in a room with a teddy bear on his lap.  \n- On the TV screen, Mr. Bean appears in a spy-like setting with a targeting reticle, suggesting surveillance or espionage activity.\n[30-60s] - Mr. Bean watches TV, reacting to a cartoon where a man in a white shirt uses a tool on a dark object.\n- On TV, a cartoon scene shows a man with a mustache and glasses, holding a tool, followed by a scene with a man and a woman in a dark room.\n- Mr. Bean stands up from his chair, looking at the TV, then walks away from the TV.", "history_tokens": 191, "history_utf8_bytes": 748, "recent_frame_times_s": [34.01203125, 35.01203125, 36.01203125, 37.01203125, 38.01203125, 39.01203125, 40.01203125, 41.01203125, 42.01203125, 43.01203125, 44.01203125, 45.01203125, 46.01203125, 47.01203125, 48.01203125, 49.01203125, 50.01203125, 51.01203125, 52.01203125, 53.01203125, 54.01203125, 55.01203125, 56.01203125, 57.01203125, 58.01203125, 59.01203125, 60.01203125, 61.01203125, 62.01203125, 63.01203125], "recent_frames_sha256": "74dd1e6d8feb3ab1470dfa8f7ca4d1eea51c770a6ee8a3e15ecbc1e51678ff90", "num_recent_frames": 30, "tq": 715995.461311481, "t1": 716001.858740793, "ta": 716001.858740793, "te": 716001.898709892, "first_response_s": 6.397429311997257, "answer_total_s": 6.437398410984315, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 237, "content_group": "04a4d99582589ad69c9a54e605cc439832fc7939e988ae43040110e06b1eaaf5", "question": {"question_id": "sample_237_a297_q0", "video_id": 237, "video_path": "./videos/sample_237_real.mp4", "annotation_index": 297, "question_index": 0, "question": "Why does the bed get pulled out through the window?", "options": ["A. Because the man ties the rope to the bed.", "B. Because the bed is on wheels.", "C. Because the window is too large.", "D. Because the bed is not secured properly to the floor."], "answer": "A", "time_stamp_s": 154, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [125, 155], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_237_a297_q0", "video_id": 237, "time_stamp_s": 154, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "09aa4c6e36b02f6621809b5f0fdf7534b4ace5f8923bfc293a6c2027a8c6841b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [124.01203125, 125.01203125, 126.01203125, 127.01203125, 128.01203125, 129.01203125, 130.01203125, 131.01203125, 132.01203125, 133.01203125, 134.01203125, 135.01203125, 136.01203125, 137.01203125, 138.01203125, 139.01203125, 140.01203125, 141.01203125, 142.01203125, 143.01203125, 144.01203125, 145.01203125, 146.01203125, 147.01203125, 148.01203125, 149.01203125, 150.01203125, 151.01203125, 152.01203125, 153.01203125], "recent_frames_sha256": "f2e6cdca35d57fb8020f50965818f4db3888771db48f9fb3bbab59ca43cf34a4", "num_recent_frames": 30, "tq": 716155.049276027, "t1": 716162.902221384, "ta": 716162.902221384, "te": 716162.939361924, "first_response_s": 7.852945356979035, "answer_total_s": 7.8900858969427645, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_237_a297_q0", "video_id": 237, "time_stamp_s": 154, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "46edd88004c0ce579c911ef88137204ced9b11da893268473ff572d4fb49028b", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean, in a suit, gestures while standing beside an elderly man holding a cake, both in a room with a door and windows.  \n- The scene transitions to a yellow car driving past a green house, followed by Mr. Bean watching TV in a room with a teddy bear on his lap.  \n- On the TV screen, Mr. Bean appears in a spy-like setting with a targeting reticle, suggesting surveillance or espionage activity.\n[30-60s] - Mr. Bean watches TV, reacting to a cartoon where a man in a white shirt uses a tool on a dark object.\n- On TV, a cartoon scene shows a man with a mustache and glasses, holding a tool, followed by a scene with a man and a woman in a dark room.\n- Mr. Bean stands up from his chair, looking at the TV, then walks away from the TV.\n[60-90s] - Mr. Bean, in a suit, stands in a room with a TV displaying him, then exits the room holding a box.  \n- He later opens the box on a table, revealing a \"Super Spy\" gadget set with a rose, gun, and other items.  \n- The box is labeled \"Super Spy\" and contains a green-lit device, a rose, and a small black box with \"Super Spy\" branding.\n[90-120s] - Mr. Bean holds a small pink rose and examines it with a curious expression.\n- He looks into a mirror, adjusting his suit and checking his reflection.\n- He then picks up binoculars, peers through them, and appears to scan his surroundings.\n[120-150s] - Mr. Bean holds a magnifying glass and looks out a window, then moves to a bed, pulling a rope.  \n- He swings across a gap between buildings, suspended by the rope, with a house visible in the distance.  \n- The scene transitions to him hanging from the rope, suspended mid-air, with a clear sky and trees below.", "history_tokens": 431, "history_utf8_bytes": 1667, "recent_frame_times_s": [124.01203125, 125.01203125, 126.01203125, 127.01203125, 128.01203125, 129.01203125, 130.01203125, 131.01203125, 132.01203125, 133.01203125, 134.01203125, 135.01203125, 136.01203125, 137.01203125, 138.01203125, 139.01203125, 140.01203125, 141.01203125, 142.01203125, 143.01203125, 144.01203125, 145.01203125, 146.01203125, 147.01203125, 148.01203125, 149.01203125, 150.01203125, 151.01203125, 152.01203125, 153.01203125], "recent_frames_sha256": "f2e6cdca35d57fb8020f50965818f4db3888771db48f9fb3bbab59ca43cf34a4", "num_recent_frames": 30, "tq": 716024.746676787, "t1": 716031.49607016, "ta": 716031.49607016, "te": 716031.681574712, "first_response_s": 6.749393372912891, "answer_total_s": 6.934897925006226, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 237, "content_group": "04a4d99582589ad69c9a54e605cc439832fc7939e988ae43040110e06b1eaaf5", "question": {"question_id": "sample_237_a298_q0", "video_id": 237, "video_path": "./videos/sample_237_real.mp4", "annotation_index": 298, "question_index": 0, "question": "Why does the Mr. Bean peer through the door's mail slot or window?", "options": ["A. Because he lost his keys and is trying to see if anyone is home.", "B. Because he heard a strange noise and wants to check what it is.", "C. Because he wanted to observe the activities of the four people outside.", "D. Because he is waiting for an important package to be delivered."], "answer": "C", "time_stamp_s": 268, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [250, 280], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_237_a298_q0", "video_id": 237, "time_stamp_s": 268, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "794fbfc73ef9fca9926f1d7d0daeea92341ddd4458eb319c94d01188ad37fccd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [238.01203125, 239.01203125, 240.01203125, 241.01203125, 242.01203125, 243.01203125, 244.01203125, 245.01203125, 246.01203125, 247.01203125, 248.01203125, 249.01203125, 250.01203125, 251.01203125, 252.01203125, 253.01203125, 254.01203125, 255.01203125, 256.01203125, 257.01203125, 258.01203125, 259.01203125, 260.01203125, 261.01203125, 262.01203125, 263.01203125, 264.01203125, 265.01203125, 266.01203125, 267.01203125], "recent_frames_sha256": "f8bc1b8644caa4608d33075b49e228b782544f50cc31f5021aedc8182789aa9c", "num_recent_frames": 30, "tq": 716162.953864017, "t1": 716176.539119105, "ta": 716176.539119105, "te": 716176.576655794, "first_response_s": 13.585255087935366, "answer_total_s": 13.622791777015664, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_237_a298_q0", "video_id": 237, "time_stamp_s": 268, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "051db5c3605bb1da4143936d60d455ad011bd5dd95b795d4d2f399c14d817a15", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean, in a suit, gestures while standing beside an elderly man holding a cake, both in a room with a door and windows.  \n- The scene transitions to a yellow car driving past a green house, followed by Mr. Bean watching TV in a room with a teddy bear on his lap.  \n- On the TV screen, Mr. Bean appears in a spy-like setting with a targeting reticle, suggesting surveillance or espionage activity.\n[30-60s] - Mr. Bean watches TV, reacting to a cartoon where a man in a white shirt uses a tool on a dark object.\n- On TV, a cartoon scene shows a man with a mustache and glasses, holding a tool, followed by a scene with a man and a woman in a dark room.\n- Mr. Bean stands up from his chair, looking at the TV, then walks away from the TV.\n[60-90s] - Mr. Bean, in a suit, stands in a room with a TV displaying him, then exits the room holding a box.  \n- He later opens the box on a table, revealing a \"Super Spy\" gadget set with a rose, gun, and other items.  \n- The box is labeled \"Super Spy\" and contains a green-lit device, a rose, and a small black box with \"Super Spy\" branding.\n[90-120s] - Mr. Bean holds a small pink rose and examines it with a curious expression.\n- He looks into a mirror, adjusting his suit and checking his reflection.\n- He then picks up binoculars, peers through them, and appears to scan his surroundings.\n[120-150s] - Mr. Bean holds a magnifying glass and looks out a window, then moves to a bed, pulling a rope.  \n- He swings across a gap between buildings, suspended by the rope, with a house visible in the distance.  \n- The scene transitions to him hanging from the rope, suspended mid-air, with a clear sky and trees below.\n[150-180s] - Mr. Bean walks across a tightrope above a bedroom, showing a determined expression.\n- He lands on a wooden box, then looks up with a surprised expression as a wind turbine appears in the background.\n- He puts on binoculars, focusing on a room with a teddy bear visible through the lenses.\n[180-210s] - Mr. Bean peers through binoculars, observing a bank robbery in progress with a wind turbine in the background.\n- Inside the bank, two large men are seen stealing money while a third man watches from a window.\n- Mr. Bean is later shown on a roof, looking down at a tree with a hook attached to a rope, suggesting he is preparing to use it for a plan.\n[210-240s] - Mr. Bean stands outdoors near a trampoline, then jumps in, with a wheelbarrow and other objects nearby.  \n- Inside a house, Mr. Bean looks out a window at a map, then peeks inside a room with a doghouse.  \n- In a kitchen, Mr. Bean stands before a counter with stacked containers, then looks at a monitor displaying a map.", "history_tokens": 685, "history_utf8_bytes": 2667, "recent_frame_times_s": [238.01203125, 239.01203125, 240.01203125, 241.01203125, 242.01203125, 243.01203125, 244.01203125, 245.01203125, 246.01203125, 247.01203125, 248.01203125, 249.01203125, 250.01203125, 251.01203125, 252.01203125, 253.01203125, 254.01203125, 255.01203125, 256.01203125, 257.01203125, 258.01203125, 259.01203125, 260.01203125, 261.01203125, 262.01203125, 263.01203125, 264.01203125, 265.01203125, 266.01203125, 267.01203125], "recent_frames_sha256": "f8bc1b8644caa4608d33075b49e228b782544f50cc31f5021aedc8182789aa9c", "num_recent_frames": 30, "tq": 716056.972168936, "t1": 716058.064578825, "ta": 716058.064578825, "te": 716058.106075859, "first_response_s": 1.0924098889809102, "answer_total_s": 1.133906923001632, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 237, "content_group": "04a4d99582589ad69c9a54e605cc439832fc7939e988ae43040110e06b1eaaf5", "question": {"question_id": "sample_237_a299_q0", "video_id": 237, "video_path": "./videos/sample_237_real.mp4", "annotation_index": 299, "question_index": 0, "question": "Why does Mr.Bean drop their coat and bag?", "options": ["A. Because he realized he grabbed the wrong coat and bag.", "B. Because he was startled by a sudden loud noise.", "C. Because his disguise mission has ended.", "D. Because he spotted someone he knows and wanted to quickly greet them."], "answer": "C", "time_stamp_s": 387, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [375, 405], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_237_a299_q0", "video_id": 237, "time_stamp_s": 387, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "76868b00793e6bc3cd03c0622c2891e753636bcc04f63f344b84ea59514f0b84", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [357.01203125, 358.01203125, 359.01203125, 360.01203125, 361.01203125, 362.01203125, 363.01203125, 364.01203125, 365.01203125, 366.01203125, 367.01203125, 368.01203125, 369.01203125, 370.01203125, 371.01203125, 372.01203125, 373.01203125, 374.01203125, 375.01203125, 376.01203125, 377.01203125, 378.01203125, 379.01203125, 380.01203125, 381.01203125, 382.01203125, 383.01203125, 384.01203125, 385.01203125, 386.01203125], "recent_frames_sha256": "da488c0ed628525e92e763e3f32f79be97fdccb2a2ae9a19a2d7d6312cf10e08", "num_recent_frames": 30, "tq": 716176.587772197, "t1": 716188.839733877, "ta": 716188.839733877, "te": 716188.877076798, "first_response_s": 12.251961680012755, "answer_total_s": 12.289304601028562, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_237_a299_q0", "video_id": 237, "time_stamp_s": 387, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a5f43c55cd68362d7dd144a33f0fda57094bc196cd921551bc3d5e93366b7de9", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean, in a suit, gestures while standing beside an elderly man holding a cake, both in a room with a door and windows.  \n- The scene transitions to a yellow car driving past a green house, followed by Mr. Bean watching TV in a room with a teddy bear on his lap.  \n- On the TV screen, Mr. Bean appears in a spy-like setting with a targeting reticle, suggesting surveillance or espionage activity.\n[30-60s] - Mr. Bean watches TV, reacting to a cartoon where a man in a white shirt uses a tool on a dark object.\n- On TV, a cartoon scene shows a man with a mustache and glasses, holding a tool, followed by a scene with a man and a woman in a dark room.\n- Mr. Bean stands up from his chair, looking at the TV, then walks away from the TV.\n[60-90s] - Mr. Bean, in a suit, stands in a room with a TV displaying him, then exits the room holding a box.  \n- He later opens the box on a table, revealing a \"Super Spy\" gadget set with a rose, gun, and other items.  \n- The box is labeled \"Super Spy\" and contains a green-lit device, a rose, and a small black box with \"Super Spy\" branding.\n[90-120s] - Mr. Bean holds a small pink rose and examines it with a curious expression.\n- He looks into a mirror, adjusting his suit and checking his reflection.\n- He then picks up binoculars, peers through them, and appears to scan his surroundings.\n[120-150s] - Mr. Bean holds a magnifying glass and looks out a window, then moves to a bed, pulling a rope.  \n- He swings across a gap between buildings, suspended by the rope, with a house visible in the distance.  \n- The scene transitions to him hanging from the rope, suspended mid-air, with a clear sky and trees below.\n[150-180s] - Mr. Bean walks across a tightrope above a bedroom, showing a determined expression.\n- He lands on a wooden box, then looks up with a surprised expression as a wind turbine appears in the background.\n- He puts on binoculars, focusing on a room with a teddy bear visible through the lenses.\n[180-210s] - Mr. Bean peers through binoculars, observing a bank robbery in progress with a wind turbine in the background.\n- Inside the bank, two large men are seen stealing money while a third man watches from a window.\n- Mr. Bean is later shown on a roof, looking down at a tree with a hook attached to a rope, suggesting he is preparing to use it for a plan.\n[210-240s] - Mr. Bean stands outdoors near a trampoline, then jumps in, with a wheelbarrow and other objects nearby.  \n- Inside a house, Mr. Bean looks out a window at a map, then peeks inside a room with a doghouse.  \n- In a kitchen, Mr. Bean stands before a counter with stacked containers, then looks at a monitor displaying a map.\n[240-270s] - Mr. Bean examines a map pinned to a green wall, tracing a red path with his finger toward a circled location.\n- He turns away from the map, then enters a dark room through a door, revealing a dimly lit interior with a table and kitchen appliances.\n- A large man in a white tank top enters the room, holding a white object, and stands near the table with various items on it.\n[270-300s] - Mr. Bean is seen outside a house, looking through a window at a family inside.  \n- The family consists of a large woman in a purple dress, a smaller child in red, and a baby in white, all standing near a door.  \n- Mr. Bean then exits the house, walks down the street, and approaches the family, who are walking away from him.\n[300-330s] - Mr. Bean stands near a tree, looking up with a surprised expression.  \n- A large, round character in a white shirt appears, initially looking down, then turns to face Mr. Bean.  \n- Mr. Bean holds a newspaper and looks at it while the large character approaches him from behind.\n[330-360s] - Mr. Bean stands at a bus stop, reading a newspaper, as a large, round character walks past him.  \n- A charity shop with a sign and displayed items is visible nearby, with a woman in a red coat entering.  \n- A bank building with three characters (two large, one small) outside, and the large character entering the bank.", "history_tokens": 1023, "history_utf8_bytes": 4018, "recent_frame_times_s": [357.01203125, 358.01203125, 359.01203125, 360.01203125, 361.01203125, 362.01203125, 363.01203125, 364.01203125, 365.01203125, 366.01203125, 367.01203125, 368.01203125, 369.01203125, 370.01203125, 371.01203125, 372.01203125, 373.01203125, 374.01203125, 375.01203125, 376.01203125, 377.01203125, 378.01203125, 379.01203125, 380.01203125, 381.01203125, 382.01203125, 383.01203125, 384.01203125, 385.01203125, 386.01203125], "recent_frames_sha256": "da488c0ed628525e92e763e3f32f79be97fdccb2a2ae9a19a2d7d6312cf10e08", "num_recent_frames": 30, "tq": 716094.520602588, "t1": 716095.317713254, "ta": 716095.317713254, "te": 716095.68872223, "first_response_s": 0.7971106660552323, "answer_total_s": 1.168119642068632, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 237, "content_group": "04a4d99582589ad69c9a54e605cc439832fc7939e988ae43040110e06b1eaaf5", "question": {"question_id": "sample_237_a300_q0", "video_id": 237, "video_path": "./videos/sample_237_real.mp4", "annotation_index": 300, "question_index": 0, "question": "Why does the police officer react and possibly make a call for backup or additional assistance?", "options": ["A. Because the police officer needs to record the event.", "B. Because the police officer needs to clock off for the day.", "C. Because the police officer believes the photographs show a potential crime.", "D. Because the police officer wants to review the photos later."], "answer": "C", "time_stamp_s": 525, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [500, 530], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_237_a300_q0", "video_id": 237, "time_stamp_s": 525, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "31e18668efa30f57e39642e02fe2f1c44743dc1b24f4e63754d28fced69d2248", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [495.01203125, 496.01203125, 497.01203125, 498.01203125, 499.01203125, 500.01203125, 501.01203125, 502.01203125, 503.01203125, 504.01203125, 505.01203125, 506.01203125, 507.01203125, 508.01203125, 509.01203125, 510.01203125, 511.01203125, 512.01203125, 513.01203125, 514.01203125, 515.01203125, 516.01203125, 517.01203125, 518.01203125, 519.01203125, 520.01203125, 521.01203125, 522.01203125, 523.01203125, 524.01203125], "recent_frames_sha256": "24c17d003dfe3365310c588c16bfe7dbb262ddc9dd5e9b2b40afd5db5e58a680", "num_recent_frames": 30, "tq": 716188.892857264, "t1": 716199.707385751, "ta": 716199.707385751, "te": 716199.744447853, "first_response_s": 10.814528486924246, "answer_total_s": 10.851590588921681, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_237_a300_q0", "video_id": 237, "time_stamp_s": 525, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "94f902416de3f6268f4b7bea26ec011b1c3e8fe24eaa9a1aab78d4f217ad95ab", "condition_order": ["notes", "recent"], "memory": "[180-210s] - Mr. Bean peers through binoculars, observing a bank robbery in progress with a wind turbine in the background.\n- Inside the bank, two large men are seen stealing money while a third man watches from a window.\n- Mr. Bean is later shown on a roof, looking down at a tree with a hook attached to a rope, suggesting he is preparing to use it for a plan.\n[210-240s] - Mr. Bean stands outdoors near a trampoline, then jumps in, with a wheelbarrow and other objects nearby.  \n- Inside a house, Mr. Bean looks out a window at a map, then peeks inside a room with a doghouse.  \n- In a kitchen, Mr. Bean stands before a counter with stacked containers, then looks at a monitor displaying a map.\n[240-270s] - Mr. Bean examines a map pinned to a green wall, tracing a red path with his finger toward a circled location.\n- He turns away from the map, then enters a dark room through a door, revealing a dimly lit interior with a table and kitchen appliances.\n- A large man in a white tank top enters the room, holding a white object, and stands near the table with various items on it.\n[270-300s] - Mr. Bean is seen outside a house, looking through a window at a family inside.  \n- The family consists of a large woman in a purple dress, a smaller child in red, and a baby in white, all standing near a door.  \n- Mr. Bean then exits the house, walks down the street, and approaches the family, who are walking away from him.\n[300-330s] - Mr. Bean stands near a tree, looking up with a surprised expression.  \n- A large, round character in a white shirt appears, initially looking down, then turns to face Mr. Bean.  \n- Mr. Bean holds a newspaper and looks at it while the large character approaches him from behind.\n[330-360s] - Mr. Bean stands at a bus stop, reading a newspaper, as a large, round character walks past him.  \n- A charity shop with a sign and displayed items is visible nearby, with a woman in a red coat entering.  \n- A bank building with three characters (two large, one small) outside, and the large character entering the bank.\n[360-390s] - A large man in a grey tank top holds a green object while standing near a bank entrance, with a woman in purple nearby.  \n- A small grey mouse with a red hat walks past the bank, then later appears near a red mailbox.  \n- A woman in a red coat and hat walks across a street, followed by the large man, as they pass a \"Reid A Book\" shop.\n[390-420s] - Mr. Bean stands beside a red postbox, appearing to interact with it while holding a small object.  \n- A black taxi drives past the postbox, passing a group of three people (two adults and a child) standing near a jewelry store.  \n- The scene shifts to show the taxi approaching the postbox from the opposite direction, with the postbox remaining stationary.\n[420-450s] - Mr. Bean peers through a red-framed window with wide eyes, then looks surprised as a yellow object (possibly a phone) appears near his face.\n- He is indoors, holding a pink object (likely a phone or device) and looking at it with a puzzled expression.\n- A small green car with a pink rose attached to its side drives past a house, followed by a hand placing a photo of Mr. Bean into a photo frame on a table.\n[450-480s] - Mr. Bean peers through binoculars from a window, observing a delivery truck and two large, overweight individuals outside.\n- The individuals are shown in a close-up, one wearing a purple top and the other in a grey tank top, both appearing to be in a state of distress or discomfort.\n- The scene transitions to a close-up of the individuals' faces, highlighting their expressions and physical features, including tattoos on their arms.\n[480-510s] - A man in a suit holds a stack of framed photos while standing in an office setting.  \n- A police officer with a cap and uniform is seated at a desk, looking at the photos with a stern expression.  \n- The officer’s desk has papers and a sign reading \"GAME ON\" visible in the foreground.", "history_tokens": 974, "history_utf8_bytes": 3941, "recent_frame_times_s": [495.01203125, 496.01203125, 497.01203125, 498.01203125, 499.01203125, 500.01203125, 501.01203125, 502.01203125, 503.01203125, 504.01203125, 505.01203125, 506.01203125, 507.01203125, 508.01203125, 509.01203125, 510.01203125, 511.01203125, 512.01203125, 513.01203125, 514.01203125, 515.01203125, 516.01203125, 517.01203125, 518.01203125, 519.01203125, 520.01203125, 521.01203125, 522.01203125, 523.01203125, 524.01203125], "recent_frames_sha256": "24c17d003dfe3365310c588c16bfe7dbb262ddc9dd5e9b2b40afd5db5e58a680", "num_recent_frames": 30, "tq": 716146.133512381, "t1": 716147.672905931, "ta": 716147.672905931, "te": 716147.974766901, "first_response_s": 1.5393935500178486, "answer_total_s": 1.8412545199971646, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 238, "content_group": "371f0f9929c71a4701dc2c74177ca12520673c1b8d39c89802719f6b9cddd1b8", "question": {"question_id": "sample_238_a357_q0", "video_id": 238, "video_path": "./videos/sample_238_real.mp4", "annotation_index": 357, "question_index": 0, "question": "Why are they two people shaking hands now?", "options": ["A. Because they just reached an important business agreement.", "B. Because they appeared together in a photo when they were young.", "C. Because they are meeting for the first time after many years.", "D. Because they are congratulating each other on a job well done."], "answer": "B", "time_stamp_s": 117, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_238_a357_q0", "video_id": 238, "time_stamp_s": 117, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "776292427ef905a689aceaad81024e51a24b44e999f2c299122e5d0575947246", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0], "recent_frames_sha256": "c919c34a2026ca6f60456772140d40b9e71dc8282c34c4c217b0a6c8e76a2156", "num_recent_frames": 30, "tq": 716214.969534861, "t1": 716221.989902681, "ta": 716221.989902681, "te": 716222.026801351, "first_response_s": 7.020367819932289, "answer_total_s": 7.057266489951871, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_238_a357_q0", "video_id": 238, "time_stamp_s": 117, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "776ec74fe6aa4a2645c23c059ff089967aa4fbec361eec9a7ec36b31906710d0", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Mr. Bean holds a teddy bear and enters a room with a spotlight, then exits as a large man in a yellow uniform appears at the door.\n- A black taxi and a green car are parked side by side on a street in front of a pink building.\n- Mr. Bean runs up a staircase inside a house with a red telephone on a table and two smiling clocks on the wall.\n[30-60s] - Mr. Bean, in a suit, confronts a large man in a yellow coat, gesturing emphatically while the man appears to be in a state of surprise or confusion.\n- The large man, wearing a red cap, stands with arms outstretched, seemingly reacting to Mr. Bean’s actions, as they are positioned in a room with patterned wallpaper.\n- Mr. Bean is later seen carrying two brown suitcases into a room with a bed, dresser, and a tall clock, indicating a transition to a different setting.\n[60-90s] - Mr. Bean, in a yellow coat, is seen holding a bone and a green vegetable, standing near an open refrigerator.\n- He then appears at a table with a plate of food, eating while looking at the refrigerator.\n- Mr. Bean is later shown in a room with sports equipment, holding a red object, while another character (Mr. Bean) is nearby.", "history_tokens": 289, "history_utf8_bytes": 1174, "recent_frame_times_s": [88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0], "recent_frames_sha256": "c919c34a2026ca6f60456772140d40b9e71dc8282c34c4c217b0a6c8e76a2156", "num_recent_frames": 30, "tq": 716301.527419636, "t1": 716307.999101184, "ta": 716307.999101184, "te": 716308.183499262, "first_response_s": 6.471681547933258, "answer_total_s": 6.656079625943676, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 238, "content_group": "371f0f9929c71a4701dc2c74177ca12520673c1b8d39c89802719f6b9cddd1b8", "question": {"question_id": "sample_238_a358_q0", "video_id": 238, "video_path": "./videos/sample_238_real.mp4", "annotation_index": 358, "question_index": 0, "question": "Why is Mr. Bean very angry now?", "options": ["A. Because another person ate all the food in the refrigerator.", "B. Because someone spilled a drink on his favorite chair.", "C. Because his television stopped working during his favorite show.", "D. Because he just realized he lost his wallet."], "answer": "A", "time_stamp_s": 180, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [129, 159], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_238_a358_q0", "video_id": 238, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7d0a4acd158add74ae573f5359ba1a6d064aa2def46db5fdf1f2f1b9b87fff30", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "6d61eb8cdeb102367e95fe365ffe5e7cd43493d47ca7aa84fecb93b6a02a7a36", "num_recent_frames": 30, "tq": 716222.052184398, "t1": 716230.151177161, "ta": 716230.151177161, "te": 716230.188444333, "first_response_s": 8.098992762970738, "answer_total_s": 8.136259934981354, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_238_a358_q0", "video_id": 238, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c36f77334305feb72e51f0570dec81ebc25447198c4f09c075598f1cab4cc125", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Mr. Bean holds a teddy bear and enters a room with a spotlight, then exits as a large man in a yellow uniform appears at the door.\n- A black taxi and a green car are parked side by side on a street in front of a pink building.\n- Mr. Bean runs up a staircase inside a house with a red telephone on a table and two smiling clocks on the wall.\n[30-60s] - Mr. Bean, in a suit, confronts a large man in a yellow coat, gesturing emphatically while the man appears to be in a state of surprise or confusion.\n- The large man, wearing a red cap, stands with arms outstretched, seemingly reacting to Mr. Bean’s actions, as they are positioned in a room with patterned wallpaper.\n- Mr. Bean is later seen carrying two brown suitcases into a room with a bed, dresser, and a tall clock, indicating a transition to a different setting.\n[60-90s] - Mr. Bean, in a yellow coat, is seen holding a bone and a green vegetable, standing near an open refrigerator.\n- He then appears at a table with a plate of food, eating while looking at the refrigerator.\n- Mr. Bean is later shown in a room with sports equipment, holding a red object, while another character (Mr. Bean) is nearby.\n[90-120s] - Mr. Bean, in a suit and cap, gestures toward a large man in a yellow coat who is seated at a desk, appearing to present or discuss something.\n- The large man, holding a framed photograph of a crowd, looks at Mr. Bean with a surprised or amused expression while the photo shows a group of people in front of a building.\n- Mr. Bean, after the large man gestures toward him, looks up with a surprised or confused expression, suggesting a reaction to the photo or the man's actions.\n[120-150s] - The large man in the yellow coat is initially seen lying on a bed, then stands up and walks toward the door.\n- The small man in the suit enters the room, points at the large man, and then gestures toward the door as if to indicate something.\n- The large man turns to face the small man, smiling and appearing to engage in conversation, while the small man looks at him with a surprised expression.\n[150-180s] - Mr. Bean enters the room, holding a red object, and appears to be in a state of frustration or anger.\n- The large man is seen lounging on the couch, eating fruit from a bowl, and later appears to be watching TV while holding a remote.\n- The scene transitions to a kitchen where Mr. Bean approaches the refrigerator, suggesting he is about to retrieve something.", "history_tokens": 587, "history_utf8_bytes": 2451, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "6d61eb8cdeb102367e95fe365ffe5e7cd43493d47ca7aa84fecb93b6a02a7a36", "num_recent_frames": 30, "tq": 716331.806109242, "t1": 716343.677704849, "ta": 716343.677704849, "te": 716343.90011759, "first_response_s": 11.871595607022755, "answer_total_s": 12.094008347950876, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 238, "content_group": "371f0f9929c71a4701dc2c74177ca12520673c1b8d39c89802719f6b9cddd1b8", "question": {"question_id": "sample_238_a359_q0", "video_id": 238, "video_path": "./videos/sample_238_real.mp4", "annotation_index": 359, "question_index": 0, "question": "Why does the person in the smaller bed become annoyed and awake?", "options": ["A. Because the person with a larger build speaks loudly.", "B. Because the snoring sound from sleeping on the ground is too loud.", "C. Because the person in the smaller bed has a nightmare.", "D. Because a noise from outside wakes them up."], "answer": "B", "time_stamp_s": 268, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [258, 288], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_238_a359_q0", "video_id": 238, "time_stamp_s": 268, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "55a3c36798effaba15a930ee8be3614a406512fa50bbc50048d8c9bee9eeee08", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0], "recent_frames_sha256": "05f36d8c0ea5371a02786226adab944b664dfbc5fb4d76317e9a0894b26a8991", "num_recent_frames": 30, "tq": 716230.215743353, "t1": 716237.689663401, "ta": 716237.689663401, "te": 716237.727166292, "first_response_s": 7.4739200479816645, "answer_total_s": 7.511422939016484, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_238_a359_q0", "video_id": 238, "time_stamp_s": 268, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bc93f617aefad4d1f72ca1796443c7a1c967a5a36beaf48426ea15e40199e919", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Mr. Bean holds a teddy bear and enters a room with a spotlight, then exits as a large man in a yellow uniform appears at the door.\n- A black taxi and a green car are parked side by side on a street in front of a pink building.\n- Mr. Bean runs up a staircase inside a house with a red telephone on a table and two smiling clocks on the wall.\n[30-60s] - Mr. Bean, in a suit, confronts a large man in a yellow coat, gesturing emphatically while the man appears to be in a state of surprise or confusion.\n- The large man, wearing a red cap, stands with arms outstretched, seemingly reacting to Mr. Bean’s actions, as they are positioned in a room with patterned wallpaper.\n- Mr. Bean is later seen carrying two brown suitcases into a room with a bed, dresser, and a tall clock, indicating a transition to a different setting.\n[60-90s] - Mr. Bean, in a yellow coat, is seen holding a bone and a green vegetable, standing near an open refrigerator.\n- He then appears at a table with a plate of food, eating while looking at the refrigerator.\n- Mr. Bean is later shown in a room with sports equipment, holding a red object, while another character (Mr. Bean) is nearby.\n[90-120s] - Mr. Bean, in a suit and cap, gestures toward a large man in a yellow coat who is seated at a desk, appearing to present or discuss something.\n- The large man, holding a framed photograph of a crowd, looks at Mr. Bean with a surprised or amused expression while the photo shows a group of people in front of a building.\n- Mr. Bean, after the large man gestures toward him, looks up with a surprised or confused expression, suggesting a reaction to the photo or the man's actions.\n[120-150s] - The large man in the yellow coat is initially seen lying on a bed, then stands up and walks toward the door.\n- The small man in the suit enters the room, points at the large man, and then gestures toward the door as if to indicate something.\n- The large man turns to face the small man, smiling and appearing to engage in conversation, while the small man looks at him with a surprised expression.\n[150-180s] - Mr. Bean enters the room, holding a red object, and appears to be in a state of frustration or anger.\n- The large man is seen lounging on the couch, eating fruit from a bowl, and later appears to be watching TV while holding a remote.\n- The scene transitions to a kitchen where Mr. Bean approaches the refrigerator, suggesting he is about to retrieve something.\n[180-210s] - Mr. Bean, in a suit, sits beside a large man on a couch, gesturing toward a plate with a sandwich.\n- The large man, wearing a yellow coat and red cap, is reclined, holding a remote control and looking at Mr. Bean.\n- A hand reaches into the frame to place an empty white plate on the table between them.\n[210-240s] - Mr. Bean holds a bone, smiling broadly while seated on a couch.\n- A large man in a yellow coat lies on the couch, appearing relaxed and content.\n- Mr. Bean stands in a bedroom, holding a towel, looking toward a bed and a door.", "history_tokens": 736, "history_utf8_bytes": 3007, "recent_frame_times_s": [239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0], "recent_frames_sha256": "05f36d8c0ea5371a02786226adab944b664dfbc5fb4d76317e9a0894b26a8991", "num_recent_frames": 30, "tq": 716363.001851691, "t1": 716369.226643196, "ta": 716369.226643196, "te": 716369.268492929, "first_response_s": 6.224791504908353, "answer_total_s": 6.266641238005832, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 238, "content_group": "371f0f9929c71a4701dc2c74177ca12520673c1b8d39c89802719f6b9cddd1b8", "question": {"question_id": "sample_238_a360_q0", "video_id": 238, "video_path": "./videos/sample_238_real.mp4", "annotation_index": 360, "question_index": 0, "question": "Why is Mr. Bean very angry now?", "options": ["A. Because someone borrowed his car without asking.", "B. Because another person also ate the ice cream that belonged to Mr. Bean.", "C. Because his favorite TV show was canceled.", "D. Because his favorite shirt got ruined in the wash."], "answer": "B", "time_stamp_s": 402, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [387, 417], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_238_a360_q0", "video_id": 238, "time_stamp_s": 402, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6e17b63bd6184f9aec3ce7754f36fee75f04a11d8216b47368a2645de2c22360", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0], "recent_frames_sha256": "eb3e3cfd0dbc4252cea14d00bc0a5cfb424ef08eb3696c03ee921693ddef53e0", "num_recent_frames": 30, "tq": 716237.749331112, "t1": 716274.369340982, "ta": 716274.369340982, "te": 716274.40698839, "first_response_s": 36.620009870035574, "answer_total_s": 36.65765727800317, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_238_a360_q0", "video_id": 238, "time_stamp_s": 402, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8f487683354256f169814ecccbf8d45a9c588bf504376eaca9f2104fde23e4e2", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Mr. Bean, in a yellow coat, is seen holding a bone and a green vegetable, standing near an open refrigerator.\n- He then appears at a table with a plate of food, eating while looking at the refrigerator.\n- Mr. Bean is later shown in a room with sports equipment, holding a red object, while another character (Mr. Bean) is nearby.\n[90-120s] - Mr. Bean, in a suit and cap, gestures toward a large man in a yellow coat who is seated at a desk, appearing to present or discuss something.\n- The large man, holding a framed photograph of a crowd, looks at Mr. Bean with a surprised or amused expression while the photo shows a group of people in front of a building.\n- Mr. Bean, after the large man gestures toward him, looks up with a surprised or confused expression, suggesting a reaction to the photo or the man's actions.\n[120-150s] - The large man in the yellow coat is initially seen lying on a bed, then stands up and walks toward the door.\n- The small man in the suit enters the room, points at the large man, and then gestures toward the door as if to indicate something.\n- The large man turns to face the small man, smiling and appearing to engage in conversation, while the small man looks at him with a surprised expression.\n[150-180s] - Mr. Bean enters the room, holding a red object, and appears to be in a state of frustration or anger.\n- The large man is seen lounging on the couch, eating fruit from a bowl, and later appears to be watching TV while holding a remote.\n- The scene transitions to a kitchen where Mr. Bean approaches the refrigerator, suggesting he is about to retrieve something.\n[180-210s] - Mr. Bean, in a suit, sits beside a large man on a couch, gesturing toward a plate with a sandwich.\n- The large man, wearing a yellow coat and red cap, is reclined, holding a remote control and looking at Mr. Bean.\n- A hand reaches into the frame to place an empty white plate on the table between them.\n[210-240s] - Mr. Bean holds a bone, smiling broadly while seated on a couch.\n- A large man in a yellow coat lies on the couch, appearing relaxed and content.\n- Mr. Bean stands in a bedroom, holding a towel, looking toward a bed and a door.\n[240-270s] - Mr. Bean, in striped pajamas, is shown smiling while holding a small red object near his mouth, then looking at a mirror.\n- The scene transitions to a bathroom with two toothbrushes in cups, positioned between two faucets.\n- Mr. Bean enters a bedroom, standing beside a bed where another character is lying under a blanket, with a clock showing 12:00 on the wall.\n[270-300s] - Mr. Bean is awake in bed, visibly startled and looking toward the doorway.\n- A large, plaid-shirted man enters the room, gesturing toward Mr. Bean with a stern expression.\n- The plaid man then exits the room, leaving Mr. Bean alone in the dimly lit bedroom.\n[300-330s] - Mr. Bean is shown in a bedroom, initially lying in bed under a purple blanket, then waking up and pulling the blanket off himself.  \n- He is later seen standing in a bathroom, brushing his teeth with a toothbrush, reflected in a mirror.  \n- A large, overweight man in blue and white striped pajamas enters the room, holding a white towel, and appears to be speaking to Mr. Bean.\n[330-360s] - Mr. Bean smiles while holding a red toothbrush near two toothbrushes in a sink.  \n- A large man in a striped shirt and sunglasses enters the room, looking surprised as he sees Mr. Bean.  \n- Mr. Bean appears to be in a bathroom, with a toilet and sink visible, and he is holding a toothbrush.\n[360-390s] - Mr. Bean, in a suit, stands beside a large man in a yellow coat, both facing a soft ice cream truck.  \n- The large man gestures toward the ice cream truck while holding a cone, appearing to interact with the vendor.  \n- Mr. Bean looks up at the ice cream truck with a curious expression, seemingly observing the interaction.", "history_tokens": 958, "history_utf8_bytes": 3856, "recent_frame_times_s": [373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0], "recent_frames_sha256": "eb3e3cfd0dbc4252cea14d00bc0a5cfb424ef08eb3696c03ee921693ddef53e0", "num_recent_frames": 30, "tq": 716414.772098916, "t1": 716422.717396094, "ta": 716422.717396094, "te": 716422.918758096, "first_response_s": 7.945297177997418, "answer_total_s": 8.146659180056304, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 238, "content_group": "371f0f9929c71a4701dc2c74177ca12520673c1b8d39c89802719f6b9cddd1b8", "question": {"question_id": "sample_238_a361_q0", "video_id": 238, "video_path": "./videos/sample_238_real.mp4", "annotation_index": 361, "question_index": 0, "question": "Why does Mr. Bean want to escape?", "options": ["A. Because he accidentally broke something in the store.", "B. Because he doesn't want to pay the bill.", "C. Because he saw someone he is trying to avoid.", "D. Because he is late for an important appointment."], "answer": "B", "time_stamp_s": 617, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [516, 546], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_238_a361_q0", "video_id": 238, "time_stamp_s": 617, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "463a62e54aeba650d44ddd7bc784b44f11a6870eebc8edfc348e27746b6d920f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [588.0, 589.0, 590.0, 591.0, 592.0, 593.0, 594.0, 595.0, 596.0, 597.0, 598.0, 599.0, 600.0, 601.0, 602.0, 603.0, 604.0, 605.0, 606.0, 607.0, 608.0, 609.0, 610.0, 611.0, 612.0, 613.0, 614.0, 615.0, 616.0, 617.0], "recent_frames_sha256": "42f276ea4f6a70abb21e568e5ae32df8c6d8bcb4eae927f476cf8172921eb56b", "num_recent_frames": 30, "tq": 716274.424406551, "t1": 716282.480212286, "ta": 716282.480212286, "te": 716282.518962215, "first_response_s": 8.055805734940805, "answer_total_s": 8.09455566399265, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_238_a361_q0", "video_id": 238, "time_stamp_s": 617, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e8d5d0f0e0d4a1acf0d6a65f3d2ff448a0519b11098d22295bc807de29da9cf8", "condition_order": ["recent", "notes"], "memory": "[270-300s] - Mr. Bean is awake in bed, visibly startled and looking toward the doorway.\n- A large, plaid-shirted man enters the room, gesturing toward Mr. Bean with a stern expression.\n- The plaid man then exits the room, leaving Mr. Bean alone in the dimly lit bedroom.\n[300-330s] - Mr. Bean is shown in a bedroom, initially lying in bed under a purple blanket, then waking up and pulling the blanket off himself.  \n- He is later seen standing in a bathroom, brushing his teeth with a toothbrush, reflected in a mirror.  \n- A large, overweight man in blue and white striped pajamas enters the room, holding a white towel, and appears to be speaking to Mr. Bean.\n[330-360s] - Mr. Bean smiles while holding a red toothbrush near two toothbrushes in a sink.  \n- A large man in a striped shirt and sunglasses enters the room, looking surprised as he sees Mr. Bean.  \n- Mr. Bean appears to be in a bathroom, with a toilet and sink visible, and he is holding a toothbrush.\n[360-390s] - Mr. Bean, in a suit, stands beside a large man in a yellow coat, both facing a soft ice cream truck.  \n- The large man gestures toward the ice cream truck while holding a cone, appearing to interact with the vendor.  \n- Mr. Bean looks up at the ice cream truck with a curious expression, seemingly observing the interaction.\n[390-420s] - Mr. Bean holds a coin, looking annoyed, as a hand offers him a small green object.  \n- A large man in a yellow coat and red cap approaches, smiling, then eats an ice cream cone while walking.  \n- Mr. Bean walks through a store aisle, picking up a jar and examining it with a skeptical expression.\n[420-450s] - Mr. Bean stares in shock at a grocery shelf filled with canned goods and bottles.\n- He is later shown in a dimly lit room, surrounded by stacks of plates and food remnants, sitting in a chair.\n- A clock on a side table shows the time as 10:10, and Mr. Bean is seen reading a document with car illustrations.\n[450-480s] - A man in a striped pajama is tied to a rope and pulled across a room, eventually falling onto a pile of plates.\n- A cat is tied to the same rope, also pulled across the room, and ends up on the floor near a potted plant.\n- The man is then shown being pulled up a staircase, still tied to the rope, while the cat is left behind on the floor.\n[480-510s] - Mr. Bean is shown with a surprised expression, standing outside a dark blue car at night.\n- A green car with license plate \"SE 822B\" is seen driving away, with a small dog in the passenger seat.\n- A black taxi with license plate \"D693AXG\" is parked nearby, and Mr. Bean is seen interacting with it, possibly trying to get inside.\n[510-540s] - A large, round man in a beige trench coat walks away from a black taxi, then turns to face a green Mini Cooper.\n- The man in the trench coat is seen carrying a brown suitcase and later appears to be pushing a large, round object with wheels.\n- A neon sign reading \"Restaurant Ray\" is visible in the background as the man in the trench coat turns away from the camera.\n[540-570s] - A large, tan-coated man with a mustache is seen holding a stack of money, smiling broadly while standing near a doorway.\n- A smaller, black-haired man in a suit is holding a photograph and appears to be examining it closely, seated at a table.\n- The setting is an opulent room with pink walls, a round table, and a large painting of a woman in a white dress on the wall behind them.\n[570-600s] - The large man in yellow coat is seated at a table, smiling broadly while holding a fork, with a stack of plates piled high in front of him.\n- The small man (Mr. Bean) is seated across from him, looking at the table with a surprised expression, as the plates are stacked precariously.\n- The background shows a pink room with curtains and a large window, through which a pink cloud-like shape is visible.", "history_tokens": 971, "history_utf8_bytes": 3826, "recent_frame_times_s": [588.0, 589.0, 590.0, 591.0, 592.0, 593.0, 594.0, 595.0, 596.0, 597.0, 598.0, 599.0, 600.0, 601.0, 602.0, 603.0, 604.0, 605.0, 606.0, 607.0, 608.0, 609.0, 610.0, 611.0, 612.0, 613.0, 614.0, 615.0, 616.0, 617.0], "recent_frames_sha256": "42f276ea4f6a70abb21e568e5ae32df8c6d8bcb4eae927f476cf8172921eb56b", "num_recent_frames": 30, "tq": 716480.709057449, "t1": 716487.514245025, "ta": 716487.514245025, "te": 716487.740948395, "first_response_s": 6.805187575984746, "answer_total_s": 7.031890945974737, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 239, "content_group": "b6504144a0337086433505e0c3c02a6b950f8f90179d87faee50367466c92dc1", "question": {"question_id": "sample_239_a657_q0", "video_id": 239, "video_path": "./videos/sample_239_real.mp4", "annotation_index": 657, "question_index": 0, "question": "Why did Mr. Bean turn off the TV?", "options": ["A. Because he thought the show was too boring.", "B. Because he wanted to save electricity.", "C. Because he was afraid that the news about the theft of teddy bears on TV would scare his own teddy bear.", "D. Because he heard a noise outside and wanted to investigate."], "answer": "C", "time_stamp_s": 51, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_239_a657_q0", "video_id": 239, "time_stamp_s": 51, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1bf61c43ef64acd33ec1379a000a2a419443e9d1878c06d9095b2c8289cb3eab", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [22.0, 23.0, 24.0, 25.0, 26.0, 27.0, 28.0, 29.0, 30.0, 31.0, 32.0, 33.0, 34.0, 35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0], "recent_frames_sha256": "4b510e2c19a60f018cd30e5b5d379315e344b531e6aab387af1d9843ee48df3c", "num_recent_frames": 30, "tq": 718716.487863795, "t1": 718729.314485436, "ta": 718729.314485436, "te": 718729.35268376, "first_response_s": 12.826621640939265, "answer_total_s": 12.86481996497605, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_239_a657_q0", "video_id": 239, "time_stamp_s": 51, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a9b2de1358dfdd5613f58b86aee0e27e1b477aba2db23d1d3028640a260fcdd5", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean holds a teddy bear and a red notebook, then looks surprised as a woman enters the room.  \n- Mr. Bean is in a kitchen, holding a phone and a red notebook, with a bag on a table nearby.  \n- Mr. Bean sits on a couch with the teddy bear beside him, holding a phone and notebook, while a TV is on a table in front of him.", "history_tokens": 92, "history_utf8_bytes": 335, "recent_frame_times_s": [22.0, 23.0, 24.0, 25.0, 26.0, 27.0, 28.0, 29.0, 30.0, 31.0, 32.0, 33.0, 34.0, 35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0], "recent_frames_sha256": "4b510e2c19a60f018cd30e5b5d379315e344b531e6aab387af1d9843ee48df3c", "num_recent_frames": 30, "tq": 718560.137212736, "t1": 718567.490237637, "ta": 718567.490237637, "te": 718567.527613279, "first_response_s": 7.353024901007302, "answer_total_s": 7.39040054299403, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 239, "content_group": "b6504144a0337086433505e0c3c02a6b950f8f90179d87faee50367466c92dc1", "question": {"question_id": "sample_239_a658_q0", "video_id": 239, "video_path": "./videos/sample_239_real.mp4", "annotation_index": 658, "question_index": 0, "question": "Why Mr. Bean is shocked now.", "options": ["A. Because he found that his little bear doll was missing.", "B. Because he just realized his wallet is missing.", "C. Because he saw something unexpected on TV.", "D. Because someone knocked on his door unexpectedly."], "answer": "A", "time_stamp_s": 165, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [132, 162], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_239_a658_q0", "video_id": 239, "time_stamp_s": 165, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b440889affb18374136868c23167ba57cce6efd851af51f92e158d25e28759a0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0], "recent_frames_sha256": "e5980e87b1ac10f365ac7b7030845cac7f461c32333e4afb28d967c6f507891f", "num_recent_frames": 30, "tq": 718729.363243395, "t1": 718742.275280427, "ta": 718742.275280427, "te": 718742.314844664, "first_response_s": 12.91203703195788, "answer_total_s": 12.951601268956438, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_239_a658_q0", "video_id": 239, "time_stamp_s": 165, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "14320698d9db346b1240205857d02b2030152f409cbfba318c2008fa22594bf1", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean holds a teddy bear and a red notebook, then looks surprised as a woman enters the room.  \n- Mr. Bean is in a kitchen, holding a phone and a red notebook, with a bag on a table nearby.  \n- Mr. Bean sits on a couch with the teddy bear beside him, holding a phone and notebook, while a TV is on a table in front of him.\n[30-60s] - Police officer holding teddy bear appears on TV screen, shown in close-up with a stern expression.\n- Mr. Bean watches TV from a couch, holding a red phone, with a teddy bear beside him on the couch.\n- TV screen transitions to show two angry faces with numbers \"31251\" and \"31252\" below them, then switches back to the police officer and teddy bear.\n[60-90s] - Mr. Bean holds a red jar with a strawberry label while standing in a supermarket aisle, looking at it with a focused expression.  \n- He then picks up a yellow jar, holding both jars simultaneously, and appears to compare them.  \n- A brown teddy bear sits in a shopping cart beside him, remaining stationary throughout the interaction.\n[90-120s] - Mr. Bean, wearing a tomato hat, picks up a green vegetable from a produce bin and examines it while holding a shopping list.  \n- He places the vegetable on a scale, which is positioned in front of him, to weigh it.  \n- The scale's needle moves as he places the vegetable on it, indicating a measurement.\n[120-150s] - Mr. Bean, in a suit and red hat, holds a shopping basket while standing near produce displays.\n- A woman in a purple dress pushes a stroller with a baby inside, moving through the produce aisle.\n- The baby in the stroller appears to be sleeping or resting, with a pacifier in its mouth.", "history_tokens": 419, "history_utf8_bytes": 1657, "recent_frame_times_s": [136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0], "recent_frames_sha256": "e5980e87b1ac10f365ac7b7030845cac7f461c32333e4afb28d967c6f507891f", "num_recent_frames": 30, "tq": 718593.979378015, "t1": 718595.773688455, "ta": 718595.773688455, "te": 718595.814742536, "first_response_s": 1.7943104399600998, "answer_total_s": 1.8353645210154355, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 239, "content_group": "b6504144a0337086433505e0c3c02a6b950f8f90179d87faee50367466c92dc1", "question": {"question_id": "sample_239_a659_q0", "video_id": 239, "video_path": "./videos/sample_239_real.mp4", "annotation_index": 659, "question_index": 0, "question": "Why is Mr. Bean unhappy now?", "options": ["A. Because his favorite TV show was canceled.", "B. Because he found that his teddy bear doll had changed its appearance.", "C. Because he lost an important document.", "D. Because he was unable to fix a broken appliance."], "answer": "B", "time_stamp_s": 291, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [264, 294], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_239_a659_q0", "video_id": 239, "time_stamp_s": 291, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "37eb78dfaed7a9f211672cce4babeb9dd3a84bcbfc5e132c2333c1e3a08e25c5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0], "recent_frames_sha256": "3c2ea8c5481a08265a098c373a59361cdfdf464e01acb77e48bc863a80618b06", "num_recent_frames": 30, "tq": 718742.325863133, "t1": 718754.292442687, "ta": 718754.292442687, "te": 718754.330704528, "first_response_s": 11.966579554020427, "answer_total_s": 12.004841395071708, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_239_a659_q0", "video_id": 239, "time_stamp_s": 291, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "853f9bf747036b55ce123b50f431a9ccc9a938033fa1c542bd9747dc413aa63b", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean holds a teddy bear and a red notebook, then looks surprised as a woman enters the room.  \n- Mr. Bean is in a kitchen, holding a phone and a red notebook, with a bag on a table nearby.  \n- Mr. Bean sits on a couch with the teddy bear beside him, holding a phone and notebook, while a TV is on a table in front of him.\n[30-60s] - Police officer holding teddy bear appears on TV screen, shown in close-up with a stern expression.\n- Mr. Bean watches TV from a couch, holding a red phone, with a teddy bear beside him on the couch.\n- TV screen transitions to show two angry faces with numbers \"31251\" and \"31252\" below them, then switches back to the police officer and teddy bear.\n[60-90s] - Mr. Bean holds a red jar with a strawberry label while standing in a supermarket aisle, looking at it with a focused expression.  \n- He then picks up a yellow jar, holding both jars simultaneously, and appears to compare them.  \n- A brown teddy bear sits in a shopping cart beside him, remaining stationary throughout the interaction.\n[90-120s] - Mr. Bean, wearing a tomato hat, picks up a green vegetable from a produce bin and examines it while holding a shopping list.  \n- He places the vegetable on a scale, which is positioned in front of him, to weigh it.  \n- The scale's needle moves as he places the vegetable on it, indicating a measurement.\n[120-150s] - Mr. Bean, in a suit and red hat, holds a shopping basket while standing near produce displays.\n- A woman in a purple dress pushes a stroller with a baby inside, moving through the produce aisle.\n- The baby in the stroller appears to be sleeping or resting, with a pacifier in its mouth.\n[150-180s] - Mr. Bean holds a large cardboard box while standing in a supermarket aisle.\n- A large, purple-clad character pushes a blue baby carriage with a small child inside.\n- Mr. Bean is seen holding a tomato and a shopping cart, then later appears to be in distress while holding a red object.\n[180-210s] - A man in a suit runs past a green car with its door open, then jumps into the driver's seat.  \n- A red car with a man in a white hat peeks out from behind a building, then drives away.  \n- A blue van with a teapot and cup on its side drives down a street, followed by a yellow car with a sign reading \"TEA\".\n[210-240s] - Mr. Bean drives a green car with a surprised expression, holding a radio in his hand.\n- A red truck appears behind him, and a large man in a white shirt is seen in the truck's side mirror, looking at Mr. Bean.\n- Mr. Bean looks startled as the red truck approaches, and the scene shifts to show the truck's rear door opening.\n[240-270s] - A red squirrel leaps from a tree branch toward a green car, then lands on the car's hood.\n- The car's driver, a man with a mustache, looks surprised as the squirrel lands on his lap.\n- The scene transitions to a dark forest at night, where the man walks with a startled expression, surrounded by trees and bushes.", "history_tokens": 748, "history_utf8_bytes": 2942, "recent_frame_times_s": [262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0], "recent_frames_sha256": "3c2ea8c5481a08265a098c373a59361cdfdf464e01acb77e48bc863a80618b06", "num_recent_frames": 30, "tq": 718630.821445109, "t1": 718638.135959571, "ta": 718638.135959571, "te": 718638.501530116, "first_response_s": 7.3145144620211795, "answer_total_s": 7.680085006984882, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 239, "content_group": "b6504144a0337086433505e0c3c02a6b950f8f90179d87faee50367466c92dc1", "question": {"question_id": "sample_239_a660_q0", "video_id": 239, "video_path": "./videos/sample_239_real.mp4", "annotation_index": 660, "question_index": 0, "question": "Why does Mr. Bean decide to put up missing posters for his teddy bear?", "options": ["A. Because he thought someone might have stolen his teddy bear.", "B. Because he wanted to warn others about a possible teddy bear thief.", "C. Because he realized the teddy bear he found earlier was not his original teddy bear.", "D. Because he believed his teddy bear had run away and needed help finding it."], "answer": "C", "time_stamp_s": 407, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [396, 426], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_239_a660_q0", "video_id": 239, "time_stamp_s": 407, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b2889aab83fb647e6d4fbe038c0d14dc118083155bbc4d775d43345de6206194", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0], "recent_frames_sha256": "6cedfc43389bfde758f28219b0e962a81664be71396ac457d137c259e90a46cd", "num_recent_frames": 30, "tq": 718754.342340409, "t1": 718768.205037737, "ta": 718768.205037737, "te": 718768.244618101, "first_response_s": 13.862697327975184, "answer_total_s": 13.902277691988274, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_239_a660_q0", "video_id": 239, "time_stamp_s": 407, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4d18719702d479ee45ca5d42c3b41850b7b2f53e80816dbe7a74e4c5b9e0efe7", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Police officer holding teddy bear appears on TV screen, shown in close-up with a stern expression.\n- Mr. Bean watches TV from a couch, holding a red phone, with a teddy bear beside him on the couch.\n- TV screen transitions to show two angry faces with numbers \"31251\" and \"31252\" below them, then switches back to the police officer and teddy bear.\n[60-90s] - Mr. Bean holds a red jar with a strawberry label while standing in a supermarket aisle, looking at it with a focused expression.  \n- He then picks up a yellow jar, holding both jars simultaneously, and appears to compare them.  \n- A brown teddy bear sits in a shopping cart beside him, remaining stationary throughout the interaction.\n[90-120s] - Mr. Bean, wearing a tomato hat, picks up a green vegetable from a produce bin and examines it while holding a shopping list.  \n- He places the vegetable on a scale, which is positioned in front of him, to weigh it.  \n- The scale's needle moves as he places the vegetable on it, indicating a measurement.\n[120-150s] - Mr. Bean, in a suit and red hat, holds a shopping basket while standing near produce displays.\n- A woman in a purple dress pushes a stroller with a baby inside, moving through the produce aisle.\n- The baby in the stroller appears to be sleeping or resting, with a pacifier in its mouth.\n[150-180s] - Mr. Bean holds a large cardboard box while standing in a supermarket aisle.\n- A large, purple-clad character pushes a blue baby carriage with a small child inside.\n- Mr. Bean is seen holding a tomato and a shopping cart, then later appears to be in distress while holding a red object.\n[180-210s] - A man in a suit runs past a green car with its door open, then jumps into the driver's seat.  \n- A red car with a man in a white hat peeks out from behind a building, then drives away.  \n- A blue van with a teapot and cup on its side drives down a street, followed by a yellow car with a sign reading \"TEA\".\n[210-240s] - Mr. Bean drives a green car with a surprised expression, holding a radio in his hand.\n- A red truck appears behind him, and a large man in a white shirt is seen in the truck's side mirror, looking at Mr. Bean.\n- Mr. Bean looks startled as the red truck approaches, and the scene shifts to show the truck's rear door opening.\n[240-270s] - A red squirrel leaps from a tree branch toward a green car, then lands on the car's hood.\n- The car's driver, a man with a mustache, looks surprised as the squirrel lands on his lap.\n- The scene transitions to a dark forest at night, where the man walks with a startled expression, surrounded by trees and bushes.\n[270-300s] - Mr. Bean walks through a dark forest, startled by a nearby tree.\n- He discovers a broken teddy bear on the ground and picks it up.\n- He later sits in a chair at home, holding the teddy bear while watching TV.\n[300-330s] - Mr. Bean, in a red plaid shirt, is kneeling beside a bed, holding a wooden box containing a small dog.  \n- The room has a purple bedspread, a wooden dresser, and a chair, with striped wallpaper.  \n- A \"MISSING\" poster is visible on the wall, indicating a missing person or pet scenario.\n[330-360s] - Mr. Bean holds a green apple and appears to be offering it to a young girl holding a teddy bear.\n- A woman with a duck-like bird on her shoulder looks surprised as Mr. Bean approaches.\n- The girl accepts the apple, smiling, while a \"MISSING\" poster is visible on the wall behind them.\n[360-390s] - A blue cat with a fish-shaped mouth is shown in a book, appearing to be reading or reacting to something.\n- A yellow dog with a toothpick in its mouth is seen standing on a table, looking angry or agitated.\n- A man in a suit is standing in a room with a \"MISSING\" poster on the wall, looking concerned or confused.", "history_tokens": 960, "history_utf8_bytes": 3754, "recent_frame_times_s": [378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0], "recent_frames_sha256": "6cedfc43389bfde758f28219b0e962a81664be71396ac457d137c259e90a46cd", "num_recent_frames": 30, "tq": 718666.313329975, "t1": 718673.913528182, "ta": 718673.913528182, "te": 718673.95103407, "first_response_s": 7.60019820695743, "answer_total_s": 7.637704094988294, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 239, "content_group": "b6504144a0337086433505e0c3c02a6b950f8f90179d87faee50367466c92dc1", "question": {"question_id": "sample_239_a661_q0", "video_id": 239, "video_path": "./videos/sample_239_real.mp4", "annotation_index": 661, "question_index": 0, "question": "Why does the purple bunny character decide to chase Mr. Bean?", "options": ["A. Because Mr. Bean took away all of their dolls.", "B. Because Mr. Bean made fun of the bunny's appearance.", "C. Because Mr. Bean accidentally stepped on the bunny's foot.", "D. Because Mr. Bean broke the bunny's favorite toy."], "answer": "A", "time_stamp_s": 548, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [528, 558], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_239_a661_q0", "video_id": 239, "time_stamp_s": 548, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b538eccbd61a337043e940e7e0385ac3bf6f6ccccae6f45b26cf1c10e67ac73b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0], "recent_frames_sha256": "7ead08f391ccd0999ee2d0cf29eb74b38e2d615ac029f8cced4e1f05fb15b1a1", "num_recent_frames": 30, "tq": 718768.266138911, "t1": 718779.456426325, "ta": 718779.456426325, "te": 718779.494961618, "first_response_s": 11.190287414006889, "answer_total_s": 11.22882270696573, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_239_a661_q0", "video_id": 239, "time_stamp_s": 548, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f963e1e4519f8338d29b616a4f201026294208a13f0c00714a37205bbd5442e3", "condition_order": ["notes", "recent"], "memory": "[180-210s] - A man in a suit runs past a green car with its door open, then jumps into the driver's seat.  \n- A red car with a man in a white hat peeks out from behind a building, then drives away.  \n- A blue van with a teapot and cup on its side drives down a street, followed by a yellow car with a sign reading \"TEA\".\n[210-240s] - Mr. Bean drives a green car with a surprised expression, holding a radio in his hand.\n- A red truck appears behind him, and a large man in a white shirt is seen in the truck's side mirror, looking at Mr. Bean.\n- Mr. Bean looks startled as the red truck approaches, and the scene shifts to show the truck's rear door opening.\n[240-270s] - A red squirrel leaps from a tree branch toward a green car, then lands on the car's hood.\n- The car's driver, a man with a mustache, looks surprised as the squirrel lands on his lap.\n- The scene transitions to a dark forest at night, where the man walks with a startled expression, surrounded by trees and bushes.\n[270-300s] - Mr. Bean walks through a dark forest, startled by a nearby tree.\n- He discovers a broken teddy bear on the ground and picks it up.\n- He later sits in a chair at home, holding the teddy bear while watching TV.\n[300-330s] - Mr. Bean, in a red plaid shirt, is kneeling beside a bed, holding a wooden box containing a small dog.  \n- The room has a purple bedspread, a wooden dresser, and a chair, with striped wallpaper.  \n- A \"MISSING\" poster is visible on the wall, indicating a missing person or pet scenario.\n[330-360s] - Mr. Bean holds a green apple and appears to be offering it to a young girl holding a teddy bear.\n- A woman with a duck-like bird on her shoulder looks surprised as Mr. Bean approaches.\n- The girl accepts the apple, smiling, while a \"MISSING\" poster is visible on the wall behind them.\n[360-390s] - A blue cat with a fish-shaped mouth is shown in a book, appearing to be reading or reacting to something.\n- A yellow dog with a toothpick in its mouth is seen standing on a table, looking angry or agitated.\n- A man in a suit is standing in a room with a \"MISSING\" poster on the wall, looking concerned or confused.\n[390-420s] - Mr. Bean opens a green car door and enters, then exits the vehicle while holding a stack of papers.  \n- He walks toward a storefront labeled \"GRUB-U-LIKE,\" passing by two \"MISSING\" posters on the wall.  \n- He stops near a tree with two \"MISSING\" posters pinned to it, one featuring a cat and the other a bear.\n[420-450s] - Mr. Bean holds two \"MISSING\" posters (cat and bear) while walking toward a police station.  \n- He enters the police station, approaches the reception desk, and presents the posters to an officer.  \n- The officer, seated at the desk, looks at the posters with a stern expression while Mr. Bean stands nearby.\n[450-480s] - A child with a bald head and earrings holds a brown teddy bear, looking angry while standing near a pile of stuffed animals.  \n- The child then picks up a pair of pink socks and places them on a sewing machine, appearing focused.  \n- The child hangs the pink socks on a clothesline, with the teddy bear’s ears now covered in the socks.\n[480-510s] - Mr. Bean stands near a red van with large speakers, holding a stick-like object, appearing to interact with the van's equipment.  \n- A group of children and adults gather around the van, some holding stuffed animals, while a large purple rabbit-like figure stands prominently near Mr. Bean.  \n- The van's side displays a sign with a rabbit icon and the number \"B5\", suggesting a themed or organized event.\n[510-540s] - A large purple rabbit holds a small brown bear while standing near a red van with hanging stuffed animals.  \n- Mr. Bean, in a suit, is seen running away from the van, then later standing on a green bridge holding a rope.  \n- The van’s side displays a clothesline with various stuffed animals, including a panda and a yellow dog, hanging upside down.", "history_tokens": 998, "history_utf8_bytes": 3912, "recent_frame_times_s": [519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0], "recent_frames_sha256": "7ead08f391ccd0999ee2d0cf29eb74b38e2d615ac029f8cced4e1f05fb15b1a1", "num_recent_frames": 30, "tq": 718714.468590094, "t1": 718716.392139028, "ta": 718716.392139028, "te": 718716.436551591, "first_response_s": 1.923548933933489, "answer_total_s": 1.9679614970227703, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 240, "content_group": "d598125b99879f4009c5b43e025df6f8f9e040de6b4466b090ddc9017d448cd8", "question": {"question_id": "sample_240_a101_q0", "video_id": 240, "video_path": "./videos/sample_240_real.mp4", "annotation_index": 101, "question_index": 0, "question": "Where does this letter on the ground come from?", "options": ["A. It was delivered by the postman earlier.", "B. It fell out of someone's pocket as they walked by.", "C. It was dropped by a courier who was in a hurry.", "D. Mr. Bean just stuffed it in."], "answer": "D", "time_stamp_s": 39, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_240_a101_q0", "video_id": 240, "time_stamp_s": 39, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f7a3a71bb78ddd2117a2a03aa7b9c311c5aea7175be0fc0a96ad5f106ddaf916", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0, 27.0, 28.0, 29.0, 30.0, 31.0, 32.0, 33.0, 34.0, 35.0, 36.0, 37.0, 38.0, 39.0], "recent_frames_sha256": "b16d2e71973de3dbc4854c8d2245744653383dd4305a5d9d5d04ab04560e246e", "num_recent_frames": 30, "tq": 717165.541486496, "t1": 717166.230581846, "ta": 717166.230581846, "te": 717166.268046735, "first_response_s": 0.6890953499823809, "answer_total_s": 0.7265602389816195, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_240_a101_q0", "video_id": 240, "time_stamp_s": 39, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ca52fe1b668a359027ad9a5a5dc9f56060125c26d3ca52872b50b59fc2cbad39", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean, holding a teddy bear and a rolled-up blueprint, stands in a doorway with a surprised expression.  \n- He receives a letter addressed to \"Mrs. Wicket, 112 Arbour Road, London N2 3KK\" and a brown box tied with string.  \n- The hallway features a wall clock, a coat rack, and a blue door; Mr. Bean is positioned near the door, holding both items.", "history_tokens": 100, "history_utf8_bytes": 361, "recent_frame_times_s": [10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0, 27.0, 28.0, 29.0, 30.0, 31.0, 32.0, 33.0, 34.0, 35.0, 36.0, 37.0, 38.0, 39.0], "recent_frames_sha256": "b16d2e71973de3dbc4854c8d2245744653383dd4305a5d9d5d04ab04560e246e", "num_recent_frames": 30, "tq": 716960.661123817, "t1": 716967.030433825, "ta": 716967.030433825, "te": 716967.265067114, "first_response_s": 6.36931000801269, "answer_total_s": 6.603943297057413, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 240, "content_group": "d598125b99879f4009c5b43e025df6f8f9e040de6b4466b090ddc9017d448cd8", "question": {"question_id": "sample_240_a102_q0", "video_id": 240, "video_path": "./videos/sample_240_real.mp4", "annotation_index": 102, "question_index": 0, "question": "Why does Mr. Bean's sitting figure react with confusion or surprise?", "options": ["A. Because Mr. Bean interacts with the TV remote.", "B. Because Mr. Bean gets distracted by a phone call.", "C. Because the TV suddenly turns off.", "D. Because Mr. Bean falls asleep while watching TV."], "answer": "A", "time_stamp_s": 149, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [129, 159], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_240_a102_q0", "video_id": 240, "time_stamp_s": 149, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4b43e3d59e5cedde7434a1cdb20d629946e3939cd481a273f8b81ee3b8983977", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0], "recent_frames_sha256": "08f8702887ccc5aa3489427995d8a4e2a0c5d1579629da2cfdd86e0de83e27fd", "num_recent_frames": 30, "tq": 717166.28234157, "t1": 717180.495933239, "ta": 717180.495933239, "te": 717180.533791891, "first_response_s": 14.213591668987647, "answer_total_s": 14.251450320938602, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_240_a102_q0", "video_id": 240, "time_stamp_s": 149, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "88501fe0b1bbaa3f7a49e0eb36c8075af83e98c408e56fcf9ba2cbc951edf724", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean, holding a teddy bear and a rolled-up blueprint, stands in a doorway with a surprised expression.  \n- He receives a letter addressed to \"Mrs. Wicket, 112 Arbour Road, London N2 3KK\" and a brown box tied with string.  \n- The hallway features a wall clock, a coat rack, and a blue door; Mr. Bean is positioned near the door, holding both items.\n[30-60s] - Mr. Bean enters the hallway, holding a letter and a rolled-up document, then drops the letter on the floor.\n- An elderly woman with glasses and a cane picks up the letter, reads it with a stern expression, and then opens a cash register to check the bill.\n- The woman places the letter on a chair beside a sleeping cat, then opens the cash register to examine the contents.\n[60-90s] - Old woman holds a check with £200.00 prominently displayed, showing a gold coin icon and additional figures like +0.701 and +1.1275.\n- Mr. Bean, in a suit, holds a rolled-up document and later unfolds it to reveal a picture of the old woman dressed as a queen.\n- The old woman, now depicted as a queen on a blanket, is shown with a crown and regal attire, while Mr. Bean gestures toward her with a smile.\n[90-120s] - Mr. Bean places a VCR on a table and inserts a tape, then presses play.\n- He sits on a sofa, watching a TV program titled \"The Queen Indoors\" featuring a man in a suit and a woman in a green dress.\n- The TV screen shows a scene with a man in a suit and a woman in a green dress, followed by a scene with a man in a suit and a woman in a green dress.", "history_tokens": 404, "history_utf8_bytes": 1525, "recent_frame_times_s": [120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0], "recent_frames_sha256": "08f8702887ccc5aa3489427995d8a4e2a0c5d1579629da2cfdd86e0de83e27fd", "num_recent_frames": 30, "tq": 716989.194224474, "t1": 716996.712720697, "ta": 716996.712720697, "te": 716996.902057228, "first_response_s": 7.518496223026887, "answer_total_s": 7.707832754007541, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 240, "content_group": "d598125b99879f4009c5b43e025df6f8f9e040de6b4466b090ddc9017d448cd8", "question": {"question_id": "sample_240_a103_q0", "video_id": 240, "video_path": "./videos/sample_240_real.mp4", "annotation_index": 103, "question_index": 0, "question": "Why does the wall have green patterns painted on it?", "options": ["A. Because the wall was decorated with a stencil and green spray paint.", "B. Because the man accidentally spilled green paint while working on a project.", "C. Because the man applied green paint using a teddy bear attached to a stick.", "D. Because the wall was originally green, and someone tried to cover it up but failed."], "answer": "C", "time_stamp_s": 277, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [258, 288], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_240_a103_q0", "video_id": 240, "time_stamp_s": 277, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "780da745e9851765cdf8abc79e0ab2c2668e19048cba6ecc28986400b9aaff8e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0], "recent_frames_sha256": "a83e680cce522b57c8db249323df58b92597ca1dde02612ecc4a774d13a0a822", "num_recent_frames": 30, "tq": 717180.547174944, "t1": 717191.958927242, "ta": 717191.958927242, "te": 717191.996488366, "first_response_s": 11.41175229800865, "answer_total_s": 11.449313422082923, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_240_a103_q0", "video_id": 240, "time_stamp_s": 277, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "575e6aa9cd895649c1ecf204a9b74acec73044d523c880c8578904a04193699a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean, holding a teddy bear and a rolled-up blueprint, stands in a doorway with a surprised expression.  \n- He receives a letter addressed to \"Mrs. Wicket, 112 Arbour Road, London N2 3KK\" and a brown box tied with string.  \n- The hallway features a wall clock, a coat rack, and a blue door; Mr. Bean is positioned near the door, holding both items.\n[30-60s] - Mr. Bean enters the hallway, holding a letter and a rolled-up document, then drops the letter on the floor.\n- An elderly woman with glasses and a cane picks up the letter, reads it with a stern expression, and then opens a cash register to check the bill.\n- The woman places the letter on a chair beside a sleeping cat, then opens the cash register to examine the contents.\n[60-90s] - Old woman holds a check with £200.00 prominently displayed, showing a gold coin icon and additional figures like +0.701 and +1.1275.\n- Mr. Bean, in a suit, holds a rolled-up document and later unfolds it to reveal a picture of the old woman dressed as a queen.\n- The old woman, now depicted as a queen on a blanket, is shown with a crown and regal attire, while Mr. Bean gestures toward her with a smile.\n[90-120s] - Mr. Bean places a VCR on a table and inserts a tape, then presses play.\n- He sits on a sofa, watching a TV program titled \"The Queen Indoors\" featuring a man in a suit and a woman in a green dress.\n- The TV screen shows a scene with a man in a suit and a woman in a green dress, followed by a scene with a man in a suit and a woman in a green dress.\n[120-150s] - Mr. Bean, seated on a couch, holds a remote and a teddy bear, looking surprised as he watches a scene unfold.\n- A man in a green suit and crown (Queen Elizabeth) and a man in a white apron (painter) are shown painting a wall with a ladder nearby.\n- The scene transitions to a close-up of the painter’s face, then back to Mr. Bean, who appears to be reacting to the painting activity.\n[150-180s] - Mr. Bean holds a small white device, looking upward as if inspecting a wall.\n- A large, light-colored fabric-covered object (possibly a tree or prop) dominates the room, with a small figure visible inside it.\n- The wall behind Mr. Bean shows a pattern of small, dark symbols, and a yellowish patch appears on the wall as he moves.\n[180-210s] - Mr. Bean stands beside a ladder, holding a paintbrush and a paint can, preparing to paint a wall.  \n- The wall behind him is cracked and has a large, decaying tree stump-like structure in the center.  \n- A green watering can and a yellow bucket are visible on the floor near the shed.\n[210-240s] - Mr. Bean, in a suit, holds a remote control and looks at a ladder with a paper on it, then turns away with a frown.\n- He crawls under a large, draped fabric covering a tree-like structure, appearing to hide or inspect it.\n- A television screen shows a cartoon scene with a character in a red outfit, while a brown teddy bear sits beside it.\n[240-270s] - Mr. Bean holds a remote and a box, looking at a TV displaying green leaf patterns, while a teddy bear is partially visible beside the TV.\n- The TV screen shows animated green leaves, and Mr. Bean’s expression shifts from surprise to annoyance as he reacts to the screen.\n- Mr. Bean then uses a broom to sweep a teddy bear into a tray of green liquid, then lifts the bear with the broom, revealing it has sprouted leaves.", "history_tokens": 868, "history_utf8_bytes": 3356, "recent_frame_times_s": [248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0], "recent_frames_sha256": "a83e680cce522b57c8db249323df58b92597ca1dde02612ecc4a774d13a0a822", "num_recent_frames": 30, "tq": 717041.294623232, "t1": 717042.557186747, "ta": 717042.557186747, "te": 717042.59870754, "first_response_s": 1.2625635149888694, "answer_total_s": 1.3040843079797924, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 240, "content_group": "d598125b99879f4009c5b43e025df6f8f9e040de6b4466b090ddc9017d448cd8", "question": {"question_id": "sample_240_a104_q0", "video_id": 240, "video_path": "./videos/sample_240_real.mp4", "annotation_index": 104, "question_index": 0, "question": "Why does the person with multiple cameras leave the room?", "options": ["A. Because the person with cameras needed to recharge their equipment.", "B. Because the person with cameras had an urgent phone call.", "C. Because he has finished taking the photos.", "D. Because the person with cameras spotted something interesting in the other room."], "answer": "C", "time_stamp_s": 394, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [387, 417], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_240_a104_q0", "video_id": 240, "time_stamp_s": 394, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "026e6aa9f064a66bf8dc4589de69dfe3945599f4fd77f40dac0523ad30bf423e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0], "recent_frames_sha256": "766f9985744527c19e3cfcd03c63d8b745d97b1e2a7657693dc26fd806c48700", "num_recent_frames": 30, "tq": 717192.009303364, "t1": 717205.586594219, "ta": 717205.586594219, "te": 717205.622802265, "first_response_s": 13.577290854998864, "answer_total_s": 13.61349890101701, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_240_a104_q0", "video_id": 240, "time_stamp_s": 394, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a62ad4ae681a22cdf4ddb533832dd0dc5bda1977920ec73a184563f5c8b1b5f4", "condition_order": ["notes", "recent"], "memory": "[90-120s] - Mr. Bean places a VCR on a table and inserts a tape, then presses play.\n- He sits on a sofa, watching a TV program titled \"The Queen Indoors\" featuring a man in a suit and a woman in a green dress.\n- The TV screen shows a scene with a man in a suit and a woman in a green dress, followed by a scene with a man in a suit and a woman in a green dress.\n[120-150s] - Mr. Bean, seated on a couch, holds a remote and a teddy bear, looking surprised as he watches a scene unfold.\n- A man in a green suit and crown (Queen Elizabeth) and a man in a white apron (painter) are shown painting a wall with a ladder nearby.\n- The scene transitions to a close-up of the painter’s face, then back to Mr. Bean, who appears to be reacting to the painting activity.\n[150-180s] - Mr. Bean holds a small white device, looking upward as if inspecting a wall.\n- A large, light-colored fabric-covered object (possibly a tree or prop) dominates the room, with a small figure visible inside it.\n- The wall behind Mr. Bean shows a pattern of small, dark symbols, and a yellowish patch appears on the wall as he moves.\n[180-210s] - Mr. Bean stands beside a ladder, holding a paintbrush and a paint can, preparing to paint a wall.  \n- The wall behind him is cracked and has a large, decaying tree stump-like structure in the center.  \n- A green watering can and a yellow bucket are visible on the floor near the shed.\n[210-240s] - Mr. Bean, in a suit, holds a remote control and looks at a ladder with a paper on it, then turns away with a frown.\n- He crawls under a large, draped fabric covering a tree-like structure, appearing to hide or inspect it.\n- A television screen shows a cartoon scene with a character in a red outfit, while a brown teddy bear sits beside it.\n[240-270s] - Mr. Bean holds a remote and a box, looking at a TV displaying green leaf patterns, while a teddy bear is partially visible beside the TV.\n- The TV screen shows animated green leaves, and Mr. Bean’s expression shifts from surprise to annoyance as he reacts to the screen.\n- Mr. Bean then uses a broom to sweep a teddy bear into a tray of green liquid, then lifts the bear with the broom, revealing it has sprouted leaves.\n[270-300s] - Mr. Bean walks across a room with a large, draped curtain, then moves to a sofa where a woman is reclining.  \n- He gestures toward the woman while standing beside the sofa, then later appears to be holding a small object near her.  \n- A bathtub filled with pink liquid and a bottle labeled \"Bath Dye\" is visible, with a large, pink-dyed object submerged in it.\n[300-330s] - Mr. Bean stands beside a bathtub filled with pink liquid, holding a pair of tongs.  \n- He uses the tongs to lift a red object from the tub, which appears to be a piece of meat.  \n- The bathtub has splashes of pink liquid and a small red object near the edge, with a faucet above.\n[330-360s] - A man in a crown stands on a red carpet under a wooden archway, facing a large sign reading \"the Palace\" with pineapple decorations.  \n- A woman in a purple dress and glasses is seated at a table, angrily smashing a pink pig figurine with a hammer, surrounded by broken price tags.  \n- A man in a yellow hat and blue shirt stands beside the woman, holding a small object and looking distressed as the pig figurine is destroyed.\n[360-390s] - Mr. Bean, wearing a crown, stands beside a painting easel with a pineapple-shaped object nearby, near \"the Palace\" entrance.  \n- A man in a cowboy hat and sunglasses approaches a red van parked at the palace entrance, holding a camera.  \n- A cartoon character with a microphone and afro hairstyle is shown in a dimly lit room, possibly recording or performing.", "history_tokens": 932, "history_utf8_bytes": 3674, "recent_frame_times_s": [365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0], "recent_frames_sha256": "766f9985744527c19e3cfcd03c63d8b745d97b1e2a7657693dc26fd806c48700", "num_recent_frames": 30, "tq": 717084.065067594, "t1": 717090.490916818, "ta": 717090.490916818, "te": 717090.644596633, "first_response_s": 6.425849223975092, "answer_total_s": 6.579529038979672, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 240, "content_group": "d598125b99879f4009c5b43e025df6f8f9e040de6b4466b090ddc9017d448cd8", "question": {"question_id": "sample_240_a105_q0", "video_id": 240, "video_path": "./videos/sample_240_real.mp4", "annotation_index": 105, "question_index": 0, "question": "Why is the queenly figure angry right now?", "options": ["A. Because someone accidentally spilled tea on her dress.", "B. Because her crown was knocked off by a gust of wind.", "C. Because the Mr.bean pushing the broom past her face.", "D. Because Mr. Bean interrupted her speech with loud noises."], "answer": "C", "time_stamp_s": 515, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [516, 546], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_240_a105_q0", "video_id": 240, "time_stamp_s": 515, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dbd20eda3aa84e56608cd49386ad026261cc035aef00cbc56eb4d83c1502b481", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0], "recent_frames_sha256": "01d2be47e4a9b34297f26a8dae8032c023b8be0243a1b1fc45e135d632256a9e", "num_recent_frames": 30, "tq": 717205.633760926, "t1": 717219.193325713, "ta": 717219.193325713, "te": 717219.380760166, "first_response_s": 13.55956478707958, "answer_total_s": 13.746999240014702, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_240_a105_q0", "video_id": 240, "time_stamp_s": 515, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2451f40e4f331d4bc73f78181306d9ee970fb2a1e353b72527bdd4188030025b", "condition_order": ["notes", "recent"], "memory": "[180-210s] - Mr. Bean stands beside a ladder, holding a paintbrush and a paint can, preparing to paint a wall.  \n- The wall behind him is cracked and has a large, decaying tree stump-like structure in the center.  \n- A green watering can and a yellow bucket are visible on the floor near the shed.\n[210-240s] - Mr. Bean, in a suit, holds a remote control and looks at a ladder with a paper on it, then turns away with a frown.\n- He crawls under a large, draped fabric covering a tree-like structure, appearing to hide or inspect it.\n- A television screen shows a cartoon scene with a character in a red outfit, while a brown teddy bear sits beside it.\n[240-270s] - Mr. Bean holds a remote and a box, looking at a TV displaying green leaf patterns, while a teddy bear is partially visible beside the TV.\n- The TV screen shows animated green leaves, and Mr. Bean’s expression shifts from surprise to annoyance as he reacts to the screen.\n- Mr. Bean then uses a broom to sweep a teddy bear into a tray of green liquid, then lifts the bear with the broom, revealing it has sprouted leaves.\n[270-300s] - Mr. Bean walks across a room with a large, draped curtain, then moves to a sofa where a woman is reclining.  \n- He gestures toward the woman while standing beside the sofa, then later appears to be holding a small object near her.  \n- A bathtub filled with pink liquid and a bottle labeled \"Bath Dye\" is visible, with a large, pink-dyed object submerged in it.\n[300-330s] - Mr. Bean stands beside a bathtub filled with pink liquid, holding a pair of tongs.  \n- He uses the tongs to lift a red object from the tub, which appears to be a piece of meat.  \n- The bathtub has splashes of pink liquid and a small red object near the edge, with a faucet above.\n[330-360s] - A man in a crown stands on a red carpet under a wooden archway, facing a large sign reading \"the Palace\" with pineapple decorations.  \n- A woman in a purple dress and glasses is seated at a table, angrily smashing a pink pig figurine with a hammer, surrounded by broken price tags.  \n- A man in a yellow hat and blue shirt stands beside the woman, holding a small object and looking distressed as the pig figurine is destroyed.\n[360-390s] - Mr. Bean, wearing a crown, stands beside a painting easel with a pineapple-shaped object nearby, near \"the Palace\" entrance.  \n- A man in a cowboy hat and sunglasses approaches a red van parked at the palace entrance, holding a camera.  \n- A cartoon character with a microphone and afro hairstyle is shown in a dimly lit room, possibly recording or performing.\n[390-420s] - A man in a cowboy hat and blue shirt holds a camera, moving toward a red throne with a crown, while another man in a suit stands nearby.\n- The man in the cowboy hat is seen walking away from the throne, carrying a camera, and then approaching a bed with red curtains.\n- The man in the suit is shown standing near the throne, looking at the camera, and then walking away from the throne.\n[420-450s] - The elderly woman, wearing a purple dress and glasses, stands with arms crossed, visibly angry, while holding a cane.  \n- A man in a suit and tie, holding a crown, appears beside her, looking surprised or concerned.  \n- A cowboy character enters the room, carrying a camera, and then exits through a door marked with the number \"2\".\n[450-480s] - The queen, wearing a crown and purple gown, sits on a red throne, holding a golden scepter and gesturing with her right hand while looking at a mirror.\n- A man in a suit and a woman in a hat enter the room, bowing to the queen, who then raises her hand in a commanding gesture.\n- The queen's expression changes from stern to amused as she watches the man and woman, who are now standing before her with bowed heads.\n[480-510s] - A man in a brown coat and glasses holds a camera, photographing a woman in a red dress seated on a throne-like chair.  \n- A man in a black suit and red tie stands beside the woman, holding a broom as if sweeping.  \n- The woman in the red dress is seated on a throne, with a crown on her head, and appears to be the central figure in the scene.", "history_tokens": 1021, "history_utf8_bytes": 4101, "recent_frame_times_s": [486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0], "recent_frames_sha256": "01d2be47e4a9b34297f26a8dae8032c023b8be0243a1b1fc45e135d632256a9e", "num_recent_frames": 30, "tq": 717126.11090989, "t1": 717134.685649512, "ta": 717134.685649512, "te": 717134.996370567, "first_response_s": 8.574739621952176, "answer_total_s": 8.885460676974617, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 241, "content_group": "9a9fc3272d4d4a649bd1eb0f77452a784383b5c3927c80e54f40166940d71b18", "question": {"question_id": "sample_241_a1127_q0", "video_id": 241, "video_path": "./videos/sample_241_real.mp4", "annotation_index": 1127, "question_index": 0, "question": "Why Mr. Bean was previously flipping through boxes?", "options": ["A. Because he was looking for his lost keys.", "B. Because he is looking for his green little hat.", "C. Because he was organizing old photographs.", "D. Because he wanted to find his shopping list."], "answer": "B", "time_stamp_s": 126, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_241_a1127_q0", "video_id": 241, "time_stamp_s": 126, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9d7931d06f50a9dc6ee7b517678d5c6aeffdf1c38d6af32ce249c9016a95c0dd", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0], "recent_frames_sha256": "edabc701cbe338be6e3bdf7211107c0c2dad5d4b68b4a8a1359b41a8b5a210af", "num_recent_frames": 30, "tq": 710018.720387941, "t1": 710020.638007857, "ta": 710020.638007857, "te": 710020.793197314, "first_response_s": 1.9176199160283431, "answer_total_s": 2.0728093730285764, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_241_a1127_q0", "video_id": 241, "time_stamp_s": 126, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "98e4a443166b94e0422ea7d05ce2f90ae3ed4616c45cb385a234c88b270ab176", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Mr. Bean, holding a teddy bear, stands in a room with patterned wallpaper, looking surprised as an elderly woman enters through a doorway.  \n- Mr. Bean is later shown in bed, reading a red book while holding the teddy bear, with a camera on a tripod beside him.  \n- A photo inside the book depicts Mr. Bean in a camping outfit, hugging a teddy bear near a tent, suggesting a theme of camping.\n[30-60s] - Mr. Bean reads a red book in bed, smiling while holding a teddy bear beside him.  \n- The teddy bear appears to be reading the book alongside Mr. Bean, with its head tilted and eyes focused on the pages.  \n- Mr. Bean flips through a photo album, showing images of a tent and a cartoon character, while continuing to read the book.\n[60-90s] - Mr. Bean is in bed, reading a red book with a teddy bear beside him, then closes the book and stretches.\n- The teddy bear is positioned on the bed next to Mr. Bean, initially resting on the book, then moving to the pillow.\n- A camera sits on the nightstand beside the bed, and a lamp is visible on the same surface.\n[90-120s] - Mr. Bean wakes up in bed, startled by a teddy bear on the pillow, then stands up and walks to the window.  \n- He peers out the window, where a cat is sleeping on the windowsill, and then looks back into the room.  \n- The room is shown with scattered items including a book, a lamp, and a television, and Mr. Bean is seen holding a green object while standing near a table.", "history_tokens": 370, "history_utf8_bytes": 1455, "recent_frame_times_s": [97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0], "recent_frames_sha256": "edabc701cbe338be6e3bdf7211107c0c2dad5d4b68b4a8a1359b41a8b5a210af", "num_recent_frames": 30, "tq": 710088.910634641, "t1": 710090.072431229, "ta": 710090.072431229, "te": 710090.256376756, "first_response_s": 1.1617965881014243, "answer_total_s": 1.345742115052417, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 241, "content_group": "9a9fc3272d4d4a649bd1eb0f77452a784383b5c3927c80e54f40166940d71b18", "question": {"question_id": "sample_241_a1128_q0", "video_id": 241, "video_path": "./videos/sample_241_real.mp4", "annotation_index": 1128, "question_index": 0, "question": "Why did the character create a large number of sandwiches?", "options": ["A. Because the character is preparing for a big party.", "B. Because the character plans to donate them to a local shelter.", "C. Because the character intends to go camping.", "D. Because the character wants to start a small sandwich business."], "answer": "C", "time_stamp_s": 222, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [129, 159], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_241_a1128_q0", "video_id": 241, "time_stamp_s": 222, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f612701b88df3048a8de0693ffc75e2982f331162c75ca59d149b35ff185462f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0], "recent_frames_sha256": "bdae5084dc7603d7d038dbff51f640d4909bf31c477432339b160520a6d7f402", "num_recent_frames": 30, "tq": 710020.823619337, "t1": 710028.895189787, "ta": 710028.895189787, "te": 710029.118923049, "first_response_s": 8.071570449974388, "answer_total_s": 8.295303711900488, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_241_a1128_q0", "video_id": 241, "time_stamp_s": 222, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fd5fd0f547753d2a8cf81c0f0bf9292ca16f5ed411a12d8734f0ab15b16f8d08", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Mr. Bean, holding a teddy bear, stands in a room with patterned wallpaper, looking surprised as an elderly woman enters through a doorway.  \n- Mr. Bean is later shown in bed, reading a red book while holding the teddy bear, with a camera on a tripod beside him.  \n- A photo inside the book depicts Mr. Bean in a camping outfit, hugging a teddy bear near a tent, suggesting a theme of camping.\n[30-60s] - Mr. Bean reads a red book in bed, smiling while holding a teddy bear beside him.  \n- The teddy bear appears to be reading the book alongside Mr. Bean, with its head tilted and eyes focused on the pages.  \n- Mr. Bean flips through a photo album, showing images of a tent and a cartoon character, while continuing to read the book.\n[60-90s] - Mr. Bean is in bed, reading a red book with a teddy bear beside him, then closes the book and stretches.\n- The teddy bear is positioned on the bed next to Mr. Bean, initially resting on the book, then moving to the pillow.\n- A camera sits on the nightstand beside the bed, and a lamp is visible on the same surface.\n[90-120s] - Mr. Bean wakes up in bed, startled by a teddy bear on the pillow, then stands up and walks to the window.  \n- He peers out the window, where a cat is sleeping on the windowsill, and then looks back into the room.  \n- The room is shown with scattered items including a book, a lamp, and a television, and Mr. Bean is seen holding a green object while standing near a table.\n[120-150s] - Mr. Bean, in a white shirt and red tie, opens a refrigerator and pulls out a large stack of sandwiches.\n- A brown teddy bear wearing a green cap sits on the counter, looking at a framed picture of Mr. Bean and a dog.\n- Mr. Bean, after retrieving the sandwiches, sets up a tent in the room, with a lamp and a hammer nearby, while a cat watches from the window.\n[150-180s] - Mr. Bean peers out a window, observing a tent-like object on the floor, then exits the room as smoke rises from the tent.\n- He drives a green Mini Cooper past a \"Hawlett's\" store, passing other cars including a red one and a blue van, before stopping in a line.\n- The green car's front end collides with the red car, causing both to tilt backward, while the blue van behind them also tilts backward.\n[180-210s] - Mr. Bean exits a green car, holding a teddy bear, and walks toward a building entrance.\n- He enters a revolving door, then exits again, still holding the teddy bear, while a large man with a mustache watches from inside.\n- The teddy bear is green and yellow with a green bow, and Mr. Bean appears to be smiling as he moves through the door.", "history_tokens": 663, "history_utf8_bytes": 2595, "recent_frame_times_s": [193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0], "recent_frames_sha256": "bdae5084dc7603d7d038dbff51f640d4909bf31c477432339b160520a6d7f402", "num_recent_frames": 30, "tq": 710115.061871399, "t1": 710117.079628138, "ta": 710117.079628138, "te": 710117.123380268, "first_response_s": 2.0177567389328033, "answer_total_s": 2.0615088689373806, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 241, "content_group": "9a9fc3272d4d4a649bd1eb0f77452a784383b5c3927c80e54f40166940d71b18", "question": {"question_id": "sample_241_a1129_q0", "video_id": 241, "video_path": "./videos/sample_241_real.mp4", "annotation_index": 1129, "question_index": 0, "question": "Why does the other character pick up the green cap left on the chair?", "options": ["A. Because the green cap looked like it was expensive.", "B. Because Mr. Bean accidentally left this green hat on the chair just now.", "C. Because the other character needed a cap to shield from the sun.", "D. Because the green cap matches the other character's outfit."], "answer": "B", "time_stamp_s": 290, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [258, 288], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_241_a1129_q0", "video_id": 241, "time_stamp_s": 290, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3b14d3026cbf91ff3dcfe8182361fba4b23a61c81e21c5c5f659e1672f53865a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0], "recent_frames_sha256": "a8d41cbfeca14e9e36aafb23b7fb4cc643502e6f092ad63fe1d264a93ca974e6", "num_recent_frames": 30, "tq": 710029.154945412, "t1": 710036.058577866, "ta": 710036.058577866, "te": 710036.498330462, "first_response_s": 6.9036324539920315, "answer_total_s": 7.343385050073266, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_241_a1129_q0", "video_id": 241, "time_stamp_s": 290, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8117e790c2d3a4ede12007a3c68d03cd4c91913cd5b643af90110b49a32e3006", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Mr. Bean, holding a teddy bear, stands in a room with patterned wallpaper, looking surprised as an elderly woman enters through a doorway.  \n- Mr. Bean is later shown in bed, reading a red book while holding the teddy bear, with a camera on a tripod beside him.  \n- A photo inside the book depicts Mr. Bean in a camping outfit, hugging a teddy bear near a tent, suggesting a theme of camping.\n[30-60s] - Mr. Bean reads a red book in bed, smiling while holding a teddy bear beside him.  \n- The teddy bear appears to be reading the book alongside Mr. Bean, with its head tilted and eyes focused on the pages.  \n- Mr. Bean flips through a photo album, showing images of a tent and a cartoon character, while continuing to read the book.\n[60-90s] - Mr. Bean is in bed, reading a red book with a teddy bear beside him, then closes the book and stretches.\n- The teddy bear is positioned on the bed next to Mr. Bean, initially resting on the book, then moving to the pillow.\n- A camera sits on the nightstand beside the bed, and a lamp is visible on the same surface.\n[90-120s] - Mr. Bean wakes up in bed, startled by a teddy bear on the pillow, then stands up and walks to the window.  \n- He peers out the window, where a cat is sleeping on the windowsill, and then looks back into the room.  \n- The room is shown with scattered items including a book, a lamp, and a television, and Mr. Bean is seen holding a green object while standing near a table.\n[120-150s] - Mr. Bean, in a white shirt and red tie, opens a refrigerator and pulls out a large stack of sandwiches.\n- A brown teddy bear wearing a green cap sits on the counter, looking at a framed picture of Mr. Bean and a dog.\n- Mr. Bean, after retrieving the sandwiches, sets up a tent in the room, with a lamp and a hammer nearby, while a cat watches from the window.\n[150-180s] - Mr. Bean peers out a window, observing a tent-like object on the floor, then exits the room as smoke rises from the tent.\n- He drives a green Mini Cooper past a \"Hawlett's\" store, passing other cars including a red one and a blue van, before stopping in a line.\n- The green car's front end collides with the red car, causing both to tilt backward, while the blue van behind them also tilts backward.\n[180-210s] - Mr. Bean exits a green car, holding a teddy bear, and walks toward a building entrance.\n- He enters a revolving door, then exits again, still holding the teddy bear, while a large man with a mustache watches from inside.\n- The teddy bear is green and yellow with a green bow, and Mr. Bean appears to be smiling as he moves through the door.\n[210-240s] - Mr. Bean holds a small green toy while entering a room with a large man in a suit.\n- The large man reacts with surprise as Mr. Bean points to a \"CAMPING\" sign.\n- Mr. Bean examines a tent priced at 15 euros, then moves to an outdoor scene with camping gear.\n[240-270s] - Mr. Bean is seated in a white recliner inside a red tent, appearing relaxed with a drink beside him.  \n- Two men in suits (one with a hat) enter the scene from outside, approaching the tent.  \n- A large man in a uniform stands near the tent, looking angry and gesturing toward Mr. Bean.", "history_tokens": 818, "history_utf8_bytes": 3165, "recent_frame_times_s": [261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0], "recent_frames_sha256": "a8d41cbfeca14e9e36aafb23b7fb4cc643502e6f092ad63fe1d264a93ca974e6", "num_recent_frames": 30, "tq": 710135.778741775, "t1": 710142.017189018, "ta": 710142.017189018, "te": 710142.055238216, "first_response_s": 6.238447242998518, "answer_total_s": 6.276496440987103, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 241, "content_group": "9a9fc3272d4d4a649bd1eb0f77452a784383b5c3927c80e54f40166940d71b18", "question": {"question_id": "sample_241_a1130_q0", "video_id": 241, "video_path": "./videos/sample_241_real.mp4", "annotation_index": 1130, "question_index": 0, "question": "Why would Mr. Bean buy the things being towed behind his car?", "options": ["A. Because the items were on sale at a huge discount.", "B. Because he only had five yuan on him at that time.", "C. Because he thought they would be fun to use later.", "D. Because he needed them for a project he was working on."], "answer": "B", "time_stamp_s": 409, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [387, 417], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_241_a1130_q0", "video_id": 241, "time_stamp_s": 409, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4b96e95ac6b154ccf7317b03f17c99981ec5997979fb4464074031a0c163d423", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0], "recent_frames_sha256": "9a2265b7f6425f23a1f8ffd0671a2fc3a498bde845a200ef60c0bc33e0b239a2", "num_recent_frames": 30, "tq": 710036.510010217, "t1": 710046.708072352, "ta": 710046.708072352, "te": 710046.745267796, "first_response_s": 10.198062135023065, "answer_total_s": 10.235257579013705, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_241_a1130_q0", "video_id": 241, "time_stamp_s": 409, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2ca1ad882f24d0330bbab0e5e07e8140f9d04e350343bcf4957b2fd9631decd9", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Mr. Bean is in bed, reading a red book with a teddy bear beside him, then closes the book and stretches.\n- The teddy bear is positioned on the bed next to Mr. Bean, initially resting on the book, then moving to the pillow.\n- A camera sits on the nightstand beside the bed, and a lamp is visible on the same surface.\n[90-120s] - Mr. Bean wakes up in bed, startled by a teddy bear on the pillow, then stands up and walks to the window.  \n- He peers out the window, where a cat is sleeping on the windowsill, and then looks back into the room.  \n- The room is shown with scattered items including a book, a lamp, and a television, and Mr. Bean is seen holding a green object while standing near a table.\n[120-150s] - Mr. Bean, in a white shirt and red tie, opens a refrigerator and pulls out a large stack of sandwiches.\n- A brown teddy bear wearing a green cap sits on the counter, looking at a framed picture of Mr. Bean and a dog.\n- Mr. Bean, after retrieving the sandwiches, sets up a tent in the room, with a lamp and a hammer nearby, while a cat watches from the window.\n[150-180s] - Mr. Bean peers out a window, observing a tent-like object on the floor, then exits the room as smoke rises from the tent.\n- He drives a green Mini Cooper past a \"Hawlett's\" store, passing other cars including a red one and a blue van, before stopping in a line.\n- The green car's front end collides with the red car, causing both to tilt backward, while the blue van behind them also tilts backward.\n[180-210s] - Mr. Bean exits a green car, holding a teddy bear, and walks toward a building entrance.\n- He enters a revolving door, then exits again, still holding the teddy bear, while a large man with a mustache watches from inside.\n- The teddy bear is green and yellow with a green bow, and Mr. Bean appears to be smiling as he moves through the door.\n[210-240s] - Mr. Bean holds a small green toy while entering a room with a large man in a suit.\n- The large man reacts with surprise as Mr. Bean points to a \"CAMPING\" sign.\n- Mr. Bean examines a tent priced at 15 euros, then moves to an outdoor scene with camping gear.\n[240-270s] - Mr. Bean is seated in a white recliner inside a red tent, appearing relaxed with a drink beside him.  \n- Two men in suits (one with a hat) enter the scene from outside, approaching the tent.  \n- A large man in a uniform stands near the tent, looking angry and gesturing toward Mr. Bean.\n[270-300s] - Mr. Bean holds a teddy bear while walking past a red tent and a grill, with a campsite setting visible.\n- The large man in uniform stands with arms crossed, observing Mr. Bean, then turns away and walks off-screen.\n- A close-up shows the teddy bear being placed on a white lounge chair, followed by a shot of the man’s hand reaching for it.\n[300-330s] - A green puffer jacket is partially visible in a pocket, with a small yellow and green object peeking out.\n- Mr. Bean's face shows a surprised expression, followed by a grimace, as he looks toward the jacket.\n- The scene transitions to a store setting where a man in a brown uniform is examining green puffer jackets on display.\n[330-360s] - Mr. Bean drives a car, holding the steering wheel with both hands, while a yellow bag with a green hat sits on the passenger seat.\n- The bag's contents are visible, showing a white paper with a red mark, and the bag is secured with a black strap.\n- Mr. Bean's facial expression changes from neutral to surprised as he looks at the bag.\n[360-390s] - A green Mini car with license plate \"S1E 952R\" drives past a \"MOTOR HOMES\" sign, then gets loaded onto a red truck carrying a white caravan.  \n- The car is later shown driving on a road with two white caravans in the background, then the driver, Mr. Bean, leaps out of the car, now wearing a large yellow inflatable ring.  \n- Mr. Bean approaches a white train with a red door, and a man in a yellow suit and tie walks toward him, gesturing with a stick.", "history_tokens": 1018, "history_utf8_bytes": 3934, "recent_frame_times_s": [380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0], "recent_frames_sha256": "9a2265b7f6425f23a1f8ffd0671a2fc3a498bde845a200ef60c0bc33e0b239a2", "num_recent_frames": 30, "tq": 710174.641929235, "t1": 710175.446253593, "ta": 710175.446253593, "te": 710175.483614045, "first_response_s": 0.804324358003214, "answer_total_s": 0.8416848100023344, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 241, "content_group": "9a9fc3272d4d4a649bd1eb0f77452a784383b5c3927c80e54f40166940d71b18", "question": {"question_id": "sample_241_a1131_q0", "video_id": 241, "video_path": "./videos/sample_241_real.mp4", "annotation_index": 1131, "question_index": 0, "question": "Why did Mr. Bean just feed this dog with a sandwich?", "options": ["A. Because Mr. Bean felt sorry for the hungry dog.", "B. Because Mr. Bean had extra sandwiches to spare.", "C. Because Mr. Bean wanted to make friends with the dog.", "D. Because Mr. Bean wants to trick this dog into the house."], "answer": "D", "time_stamp_s": 593, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [516, 546], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_241_a1131_q0", "video_id": 241, "time_stamp_s": 593, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "60cfc90c37a929b758387f1d2a4ecc3be3f7803e20fbff56fbd89ce6a3f2c436", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [564.0, 565.0, 566.0, 567.0, 568.0, 569.0, 570.0, 571.0, 572.0, 573.0, 574.0, 575.0, 576.0, 577.0, 578.0, 579.0, 580.0, 581.0, 582.0, 583.0, 584.0, 585.0, 586.0, 587.0, 588.0, 589.0, 590.0, 591.0, 592.0, 593.0], "recent_frames_sha256": "d3d1618f6ed6b9ada430bfd9a4374d08ad6b4754e21ed2bd43b3b564d9d1c3e9", "num_recent_frames": 30, "tq": 710046.757781135, "t1": 710052.855213154, "ta": 710052.855213154, "te": 710052.89195796, "first_response_s": 6.0974320189561695, "answer_total_s": 6.1341768249403685, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_241_a1131_q0", "video_id": 241, "time_stamp_s": 593, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "915ae1681dde10c2608282c96c1c590cc6458c03c4eb7136347d4f8711708fb5", "condition_order": ["recent", "notes"], "memory": "[240-270s] - Mr. Bean is seated in a white recliner inside a red tent, appearing relaxed with a drink beside him.  \n- Two men in suits (one with a hat) enter the scene from outside, approaching the tent.  \n- A large man in a uniform stands near the tent, looking angry and gesturing toward Mr. Bean.\n[270-300s] - Mr. Bean holds a teddy bear while walking past a red tent and a grill, with a campsite setting visible.\n- The large man in uniform stands with arms crossed, observing Mr. Bean, then turns away and walks off-screen.\n- A close-up shows the teddy bear being placed on a white lounge chair, followed by a shot of the man’s hand reaching for it.\n[300-330s] - A green puffer jacket is partially visible in a pocket, with a small yellow and green object peeking out.\n- Mr. Bean's face shows a surprised expression, followed by a grimace, as he looks toward the jacket.\n- The scene transitions to a store setting where a man in a brown uniform is examining green puffer jackets on display.\n[330-360s] - Mr. Bean drives a car, holding the steering wheel with both hands, while a yellow bag with a green hat sits on the passenger seat.\n- The bag's contents are visible, showing a white paper with a red mark, and the bag is secured with a black strap.\n- Mr. Bean's facial expression changes from neutral to surprised as he looks at the bag.\n[360-390s] - A green Mini car with license plate \"S1E 952R\" drives past a \"MOTOR HOMES\" sign, then gets loaded onto a red truck carrying a white caravan.  \n- The car is later shown driving on a road with two white caravans in the background, then the driver, Mr. Bean, leaps out of the car, now wearing a large yellow inflatable ring.  \n- Mr. Bean approaches a white train with a red door, and a man in a yellow suit and tie walks toward him, gesturing with a stick.\n[390-420s] - Mr. Bean is shown with a key in hand, looking surprised as he approaches a large yellow figure.\n- A red and white bus with a satellite dish on top is seen driving past a fence, with a yellow car nearby.\n- Mr. Bean is inside a house, holding a large piece of meat, while an elderly woman in a white coat stands beside him.\n[420-450s] - A woman in a yellow coat holds a \"FOR SALE\" sign near a caravan, then gestures toward a red truck with a bicycle and blue items.  \n- A man in a suit approaches the woman, holding a green object, and later looks at a bicycle on the truck.  \n- The woman appears to be speaking or reacting to the man, with a chain-link fence behind them and a caravan in the background.\n[450-480s] - An elderly woman in a purple coat stands outside a wooden shed, holding a pair of scissors.  \n- A green car with a red trailer carrying bicycles and tools drives past, with a man in a suit standing beside it.  \n- The shed is shown being lifted into the air by a helicopter at night, suspended above a blue landscape.\n[480-510s] - A green car with a trailer carrying a small house is parked in a grassy field under a clear sky.\n- A man with a red nose and a green suit is seen walking away from the car, carrying a suitcase.\n- A woman in a purple dress and cane walks along a sidewalk in front of a row of houses, appearing to be in motion.\n[510-540s] - Mr. Bean opens a brown suitcase, revealing a stack of sandwiches, then eats one while seated at a table.\n- A large man with a mustache approaches, pulling a black dog on a leash, and stands menacingly near the table.\n- The large man's face is shown in close-up, displaying an angry expression as he looks at Mr. Bean.\n[540-570s] - Mr. Bean sits at a table with a teddy bear, then is startled by a dog holding a newspaper titled \"The Daily Ritz\".\n- Mr. Bean exits his purple caravan, holding the teddy bear, and later appears in a white shirt holding a purple can labeled \"B\".\n- At night, Mr. Bean is in bed, illuminated by a lamp, with the teddy bear beside him, and his face shows a startled expression.", "history_tokens": 993, "history_utf8_bytes": 3899, "recent_frame_times_s": [564.0, 565.0, 566.0, 567.0, 568.0, 569.0, 570.0, 571.0, 572.0, 573.0, 574.0, 575.0, 576.0, 577.0, 578.0, 579.0, 580.0, 581.0, 582.0, 583.0, 584.0, 585.0, 586.0, 587.0, 588.0, 589.0, 590.0, 591.0, 592.0, 593.0], "recent_frames_sha256": "d3d1618f6ed6b9ada430bfd9a4374d08ad6b4754e21ed2bd43b3b564d9d1c3e9", "num_recent_frames": 30, "tq": 710218.64954731, "t1": 710227.782350978, "ta": 710227.782350978, "te": 710227.828134234, "first_response_s": 9.132803668035194, "answer_total_s": 9.178586923982948, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 242, "content_group": "9bb26a7bd078222f2557f21632504bf96c0db22b78d079ad1606987cb295fe96", "question": {"question_id": "sample_242_a580_q0", "video_id": 242, "video_path": "./videos/sample_242_real.mp4", "annotation_index": 580, "question_index": 0, "question": "Why is the teddy bear seen flying in the toy plane in the sky?", "options": ["A. Because someone threw the teddy bear.", "B. Because the wind carried the teddy bear.", "C. Because Mr. Bean uses a remote control to operate the toy plane.", "D. Because the teddy bear has wings."], "answer": "C", "time_stamp_s": 24, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_242_a580_q0", "video_id": 242, "time_stamp_s": 24, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dece3696b5d9e46254da5606d8b8961acfbe679049ad50c98edf73e194ac9395", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0], "recent_frames_sha256": "d7129a7622fa0a14d84ac14e92a79f470ae2dfebf9a04a45689d9759863e668a", "num_recent_frames": 25, "tq": 716214.969207756, "t1": 716221.989902681, "ta": 716221.989902681, "te": 716222.026801351, "first_response_s": 7.020694924984127, "answer_total_s": 7.057593595003709, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_242_a580_q0", "video_id": 242, "time_stamp_s": 24, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ffb9d2f5145005d27c1fd4c1be20044bba4d1ef693cc03f117b699767773415c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0], "recent_frames_sha256": "d7129a7622fa0a14d84ac14e92a79f470ae2dfebf9a04a45689d9759863e668a", "num_recent_frames": 25, "tq": 716282.535344672, "t1": 716288.271390116, "ta": 716288.271390116, "te": 716288.494535285, "first_response_s": 5.736045443918556, "answer_total_s": 5.959190613008104, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 242, "content_group": "9bb26a7bd078222f2557f21632504bf96c0db22b78d079ad1606987cb295fe96", "question": {"question_id": "sample_242_a581_q0", "video_id": 242, "video_path": "./videos/sample_242_real.mp4", "annotation_index": 581, "question_index": 0, "question": "Why does Mr.Bean climb the tree?", "options": ["A. Because Mr.Bean wants to retrieve the toy stuck in the tree.", "B. Because Mr.Bean wants to collect leaves from the tree.", "C. Because Mr.Bean wants a better view from the top of the tree.", "D. Because Mr.Bean is practicing climbing skills."], "answer": "A", "time_stamp_s": 144, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [129, 159], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_242_a581_q0", "video_id": 242, "time_stamp_s": 144, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a8cf994e6370776fd641fd92f27d8f0be0b2e36ad7107a11015a07df0a9c9230", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0], "recent_frames_sha256": "6605c4f587cedfc58a0b80f3cacb5511ae17d651fbf099ce8f14adad3845742e", "num_recent_frames": 30, "tq": 716222.050403774, "t1": 716230.151177161, "ta": 716230.151177161, "te": 716230.188444333, "first_response_s": 8.100773387006484, "answer_total_s": 8.1380405590171, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_242_a581_q0", "video_id": 242, "time_stamp_s": 144, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8562be8ab47da76226da6eac5ada16971a0dcf6d8aa4e7c15b8fee67a4c1066c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Mr. Bean holds a teddy bear and a remote control, then launches a toy helicopter from a car roof.  \n- The helicopter flies away as Mr. Bean watches, then he runs after it in a grassy field.  \n- A large, dark figure appears in a doorway, startling Mr. Bean, who turns to look at it.\n[30-60s] - A magpie perches on a red roof rack, then pecks at a car's rear license plate (STE952R) before flying away.\n- The car's driver, Mr. Bean, is shown outside, holding a remote control, looking up at the car with a surprised expression.\n- The magpie reappears on the car's rear window, pecking at the license plate again, while Mr. Bean watches from a distance.\n[60-90s] - Mr. Bean holds a remote control, aiming it upward while standing on a grassy hill.\n- A black bird with a white beak flies across the sky, appearing to be controlled by the remote.\n- The bird flies toward a small airplane carrying a brown bear, which is also airborne.\n[90-120s] - A magpie is shown perched atop a tree, then flying away with scattered leaves and twigs in its wake.\n- Mr. Bean appears surprised, then follows the magpie’s flight path, holding a small object.\n- The magpie lands inside a red box, which is positioned on the ground, surrounded by fallen leaves and twigs.", "history_tokens": 328, "history_utf8_bytes": 1258, "recent_frame_times_s": [115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0], "recent_frames_sha256": "6605c4f587cedfc58a0b80f3cacb5511ae17d651fbf099ce8f14adad3845742e", "num_recent_frames": 30, "tq": 716312.81507272, "t1": 716320.193731459, "ta": 716320.193731459, "te": 716320.416698296, "first_response_s": 7.3786587389186025, "answer_total_s": 7.601625575916842, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 242, "content_group": "9bb26a7bd078222f2557f21632504bf96c0db22b78d079ad1606987cb295fe96", "question": {"question_id": "sample_242_a582_q0", "video_id": 242, "video_path": "./videos/sample_242_real.mp4", "annotation_index": 582, "question_index": 0, "question": "Why are the books stacked on the floor?", "options": ["A. Because there was no more space on the shelves.", "B. As a step for the bird to walk down from the table.", "C. Because the books were being sorted for donation.", "D. Because they were recently used and not yet put away."], "answer": "B", "time_stamp_s": 253, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [258, 288], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_242_a582_q0", "video_id": 242, "time_stamp_s": 253, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0a42dbf1d8980084aae6e6afac440eedf1cab45e6fb0c0593bb52979e8064617", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0], "recent_frames_sha256": "3a9805cdb9793c0bd120c62d6d2e5554614696319961cbc5ceb46a9cb6e849ec", "num_recent_frames": 30, "tq": 716230.21405158, "t1": 716237.689663401, "ta": 716237.689663401, "te": 716237.727166292, "first_response_s": 7.475611820933409, "answer_total_s": 7.513114711968228, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_242_a582_q0", "video_id": 242, "time_stamp_s": 253, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cc834b189711104e983f08380a9936a83d99623da72bf91e94bbcb273dc0e44f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Mr. Bean holds a teddy bear and a remote control, then launches a toy helicopter from a car roof.  \n- The helicopter flies away as Mr. Bean watches, then he runs after it in a grassy field.  \n- A large, dark figure appears in a doorway, startling Mr. Bean, who turns to look at it.\n[30-60s] - A magpie perches on a red roof rack, then pecks at a car's rear license plate (STE952R) before flying away.\n- The car's driver, Mr. Bean, is shown outside, holding a remote control, looking up at the car with a surprised expression.\n- The magpie reappears on the car's rear window, pecking at the license plate again, while Mr. Bean watches from a distance.\n[60-90s] - Mr. Bean holds a remote control, aiming it upward while standing on a grassy hill.\n- A black bird with a white beak flies across the sky, appearing to be controlled by the remote.\n- The bird flies toward a small airplane carrying a brown bear, which is also airborne.\n[90-120s] - A magpie is shown perched atop a tree, then flying away with scattered leaves and twigs in its wake.\n- Mr. Bean appears surprised, then follows the magpie’s flight path, holding a small object.\n- The magpie lands inside a red box, which is positioned on the ground, surrounded by fallen leaves and twigs.\n[120-150s] - Mr. Bean holds a red box while a small black bird with a white patch pecks at it, then flies away.\n- Mr. Bean drops the box, causing it to fall and break open, revealing a yellow airplane inside.\n- Mr. Bean climbs a tree to retrieve the bird, which is perched in a nest, and then jumps down to the ground.\n[150-180s] - Mr. Bean, in a brown suit, is perched in a tree, holding a magnifying glass and observing a blue bird in a nest.  \n- The bird, with a blue body and yellow feet, is lying on its back in the nest, appearing motionless.  \n- Mr. Bean’s expression shifts from focused to surprised as he examines the bird, which then suddenly transforms into a yellow, segmented creature with white spots.\n[180-210s] - Mr. Bean holds a yellow object and a green ice cream bar, looking at them with a surprised expression.\n- He stands in a kitchen next to a refrigerator, with a countertop and cabinets visible.\n- He appears to be comparing or reacting to the two items, possibly considering which to eat.\n[210-240s] - Mr. Bean gestures with one finger raised while standing near a refrigerator, then points at a magpie on the floor.\n- The magpie, with a large blue eye, is shown lying on its back with a long, wrapped object (possibly a sausage) protruding from its body.\n- Mr. Bean looks at the magpie with a surprised expression, then turns to face the camera with a smug grin, while the magpie remains on the floor.", "history_tokens": 688, "history_utf8_bytes": 2689, "recent_frame_times_s": [224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0], "recent_frames_sha256": "3a9805cdb9793c0bd120c62d6d2e5554614696319961cbc5ceb46a9cb6e849ec", "num_recent_frames": 30, "tq": 716356.55891207, "t1": 716357.431066829, "ta": 716357.431066829, "te": 716357.623203632, "first_response_s": 0.8721547590103, "answer_total_s": 1.0642915619537234, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 242, "content_group": "9bb26a7bd078222f2557f21632504bf96c0db22b78d079ad1606987cb295fe96", "question": {"question_id": "sample_242_a583_q0", "video_id": 242, "video_path": "./videos/sample_242_real.mp4", "annotation_index": 583, "question_index": 0, "question": "Why does the bird fly out of the window with an item?", "options": ["A. Because the bird is building a nest and needs materials.", "B. Because the bird is curious and wants to explore outside.", "C. Because the bird is attracted to shiny objects.", "D. Because this item is very precious, the bird wants to steal it away."], "answer": "D", "time_stamp_s": 413, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [387, 417], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_242_a583_q0", "video_id": 242, "time_stamp_s": 413, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6f24e5e380014c5f8ccace916c363b93138caa2040f7f328d5b94b2899e38ede", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0], "recent_frames_sha256": "b86cec6d3dd002af8c4e830cf9ea0fa0f72bceaedf7df35820183464f733fbdb", "num_recent_frames": 30, "tq": 716237.747123954, "t1": 716274.369340982, "ta": 716274.369340982, "te": 716274.40698839, "first_response_s": 36.622217028052546, "answer_total_s": 36.65986443602014, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_242_a583_q0", "video_id": 242, "time_stamp_s": 413, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b4e12ad8a2f65f275d68886aae14acb03659f0ada495c6041d2c02fee2ea385f", "condition_order": ["recent", "notes"], "memory": "[30-60s] - A magpie perches on a red roof rack, then pecks at a car's rear license plate (STE952R) before flying away.\n- The car's driver, Mr. Bean, is shown outside, holding a remote control, looking up at the car with a surprised expression.\n- The magpie reappears on the car's rear window, pecking at the license plate again, while Mr. Bean watches from a distance.\n[60-90s] - Mr. Bean holds a remote control, aiming it upward while standing on a grassy hill.\n- A black bird with a white beak flies across the sky, appearing to be controlled by the remote.\n- The bird flies toward a small airplane carrying a brown bear, which is also airborne.\n[90-120s] - A magpie is shown perched atop a tree, then flying away with scattered leaves and twigs in its wake.\n- Mr. Bean appears surprised, then follows the magpie’s flight path, holding a small object.\n- The magpie lands inside a red box, which is positioned on the ground, surrounded by fallen leaves and twigs.\n[120-150s] - Mr. Bean holds a red box while a small black bird with a white patch pecks at it, then flies away.\n- Mr. Bean drops the box, causing it to fall and break open, revealing a yellow airplane inside.\n- Mr. Bean climbs a tree to retrieve the bird, which is perched in a nest, and then jumps down to the ground.\n[150-180s] - Mr. Bean, in a brown suit, is perched in a tree, holding a magnifying glass and observing a blue bird in a nest.  \n- The bird, with a blue body and yellow feet, is lying on its back in the nest, appearing motionless.  \n- Mr. Bean’s expression shifts from focused to surprised as he examines the bird, which then suddenly transforms into a yellow, segmented creature with white spots.\n[180-210s] - Mr. Bean holds a yellow object and a green ice cream bar, looking at them with a surprised expression.\n- He stands in a kitchen next to a refrigerator, with a countertop and cabinets visible.\n- He appears to be comparing or reacting to the two items, possibly considering which to eat.\n[210-240s] - Mr. Bean gestures with one finger raised while standing near a refrigerator, then points at a magpie on the floor.\n- The magpie, with a large blue eye, is shown lying on its back with a long, wrapped object (possibly a sausage) protruding from its body.\n- Mr. Bean looks at the magpie with a surprised expression, then turns to face the camera with a smug grin, while the magpie remains on the floor.\n[240-270s] - A penguin with a blue eye and black-and-white plumage is perched atop a stack of books, pecking at coins.\n- Mr. Bean, in a suit, is seen holding a yellow sponge and interacting with the books and penguin.\n- The penguin later flies away, leaving behind scattered coins and a stack of books on the floor.\n[270-300s] - Mr. Bean holds a white cup with a green leaf, smiling while standing near a bed with a stuffed bear.\n- He then sits on a chair, holding a remote control, with a clock and lamp nearby.\n- The TV screen shows a castle, followed by a royal figure, then a cartoonish king with a crown.\n[300-330s] - Mr. Bean smiles while holding a remote control, standing near a TV displaying an owl character.  \n- The TV screen shows a cartoon owl wearing a nurse’s cap, then transitions to a royal crown.  \n- Mr. Bean opens a refrigerator, pulls out a cereal box, and holds up a bowl of cereal.\n[330-360s] - A cartoon owl appears on a TV screen, surrounded by blue zigzag patterns, with a \"000000\" display below.\n- A man in a suit stands beside a door, holding a phone, looking at it with a smirk.\n- A black-and-white bird with glowing eyes peeks from under a blanket in a bed, then hops onto a stack of books.\n[360-390s] - Mr. Bean sleeps peacefully in bed, covered by a purple blanket, with a small dog curled beside him.\n- A black bird with white markings pecks at the window, then flies away, leaving a trail of blue sparkles.\n- A large, dark, shadowy figure with glowing green eyes appears in the hallway, moving toward the kitchen.", "history_tokens": 1016, "history_utf8_bytes": 3947, "recent_frame_times_s": [384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0], "recent_frames_sha256": "b86cec6d3dd002af8c4e830cf9ea0fa0f72bceaedf7df35820183464f733fbdb", "num_recent_frames": 30, "tq": 716400.95831003, "t1": 716407.998515499, "ta": 716407.998515499, "te": 716408.203395126, "first_response_s": 7.040205469005741, "answer_total_s": 7.245085095986724, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 242, "content_group": "9bb26a7bd078222f2557f21632504bf96c0db22b78d079ad1606987cb295fe96", "question": {"question_id": "sample_242_a584_q0", "video_id": 242, "video_path": "./videos/sample_242_real.mp4", "annotation_index": 584, "question_index": 0, "question": "Where did Mr. Bean get all this gold from?", "options": ["A. Mr. Bean won it in a lottery.", "B. Mr. Bean found it buried in his backyard.", "C. The bird kept by Mr. Bean stole from the old lady's house.", "D. Mr. Bean inherited it from a distant relative."], "answer": "C", "time_stamp_s": 487, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [516, 546], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_242_a584_q0", "video_id": 242, "time_stamp_s": 487, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a95570c1faf521f8178007a52669c888d30d09ba8351c9d9d352dafe25e63c0a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0], "recent_frames_sha256": "08f26bf89f707542b52a7bc0ebcb3395b9cf119e39bdf74c74356593d00785c3", "num_recent_frames": 30, "tq": 716274.422639399, "t1": 716282.480212286, "ta": 716282.480212286, "te": 716282.518962215, "first_response_s": 8.057572887046263, "answer_total_s": 8.096322816098109, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_242_a584_q0", "video_id": 242, "time_stamp_s": 487, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "599354ed51d060e141c7ef87b96027a703cb8ba14d070c2c1e6f73f7f09a9c96", "condition_order": ["recent", "notes"], "memory": "[120-150s] - Mr. Bean holds a red box while a small black bird with a white patch pecks at it, then flies away.\n- Mr. Bean drops the box, causing it to fall and break open, revealing a yellow airplane inside.\n- Mr. Bean climbs a tree to retrieve the bird, which is perched in a nest, and then jumps down to the ground.\n[150-180s] - Mr. Bean, in a brown suit, is perched in a tree, holding a magnifying glass and observing a blue bird in a nest.  \n- The bird, with a blue body and yellow feet, is lying on its back in the nest, appearing motionless.  \n- Mr. Bean’s expression shifts from focused to surprised as he examines the bird, which then suddenly transforms into a yellow, segmented creature with white spots.\n[180-210s] - Mr. Bean holds a yellow object and a green ice cream bar, looking at them with a surprised expression.\n- He stands in a kitchen next to a refrigerator, with a countertop and cabinets visible.\n- He appears to be comparing or reacting to the two items, possibly considering which to eat.\n[210-240s] - Mr. Bean gestures with one finger raised while standing near a refrigerator, then points at a magpie on the floor.\n- The magpie, with a large blue eye, is shown lying on its back with a long, wrapped object (possibly a sausage) protruding from its body.\n- Mr. Bean looks at the magpie with a surprised expression, then turns to face the camera with a smug grin, while the magpie remains on the floor.\n[240-270s] - A penguin with a blue eye and black-and-white plumage is perched atop a stack of books, pecking at coins.\n- Mr. Bean, in a suit, is seen holding a yellow sponge and interacting with the books and penguin.\n- The penguin later flies away, leaving behind scattered coins and a stack of books on the floor.\n[270-300s] - Mr. Bean holds a white cup with a green leaf, smiling while standing near a bed with a stuffed bear.\n- He then sits on a chair, holding a remote control, with a clock and lamp nearby.\n- The TV screen shows a castle, followed by a royal figure, then a cartoonish king with a crown.\n[300-330s] - Mr. Bean smiles while holding a remote control, standing near a TV displaying an owl character.  \n- The TV screen shows a cartoon owl wearing a nurse’s cap, then transitions to a royal crown.  \n- Mr. Bean opens a refrigerator, pulls out a cereal box, and holds up a bowl of cereal.\n[330-360s] - A cartoon owl appears on a TV screen, surrounded by blue zigzag patterns, with a \"000000\" display below.\n- A man in a suit stands beside a door, holding a phone, looking at it with a smirk.\n- A black-and-white bird with glowing eyes peeks from under a blanket in a bed, then hops onto a stack of books.\n[360-390s] - Mr. Bean sleeps peacefully in bed, covered by a purple blanket, with a small dog curled beside him.\n- A black bird with white markings pecks at the window, then flies away, leaving a trail of blue sparkles.\n- A large, dark, shadowy figure with glowing green eyes appears in the hallway, moving toward the kitchen.\n[390-420s] - A magpie with glowing eyes flies toward a window, then lands on a table with a treasure chest.  \n- The treasure chest opens to reveal a glowing, golden, cheese-like object.  \n- The magpie pecks at the cheese object, which then glows brighter and emits light.\n[420-450s] - A black bird with a green eye holds a golden watch near a window with purple curtains.\n- A green car drives past a street with buildings, followed by a white van.\n- Mr. Bean wakes up in bed, looking surprised, then smiles as a monkey sleeps beside him.\n[450-480s] - A police officer holds a microphone, standing beside an elderly woman in a purple dress who is holding a red checkered box.\n- The woman is visibly upset, with her eyes closed and mouth open, as if speaking or reacting to the officer.\n- The officer's expression is stern, and he appears to be questioning or confronting the woman.", "history_tokens": 982, "history_utf8_bytes": 3861, "recent_frame_times_s": [458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0], "recent_frames_sha256": "08f26bf89f707542b52a7bc0ebcb3395b9cf119e39bdf74c74356593d00785c3", "num_recent_frames": 30, "tq": 716433.494998642, "t1": 716434.790716855, "ta": 716434.790716855, "te": 716434.982734884, "first_response_s": 1.2957182129612193, "answer_total_s": 1.4877362420083955, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 245, "content_group": "f740ea7d9df9b825f4659fad91169f73f406124b4eb97a84981ccb4091c70d87", "question": {"question_id": "sample_245_a146_q0", "video_id": 245, "video_path": "./videos/sample_245_real.mp4", "annotation_index": 146, "question_index": 0, "question": "Why did the elderly woman step off the bus with a tray of tea?", "options": ["A. To serve tea to the bus driver during his break.", "B. To offer refreshments to passengers waiting at the bus stop.", "C. To deliver food to the elderly lady in a pink dress who has a foot injury.", "D. To serve tea to passengers waiting at the bus stop."], "answer": "C", "time_stamp_s": 21, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_245_a146_q0", "video_id": 245, "time_stamp_s": 21, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "beefd16132e29ca8d97d51d070a6ebc3cdcc9aca1098fcd66af9f54545eedfb0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0], "recent_frames_sha256": "2df6d70377dd53e18928cb90fec129ca26f6d0ac110bc45a6400c1d16b2157c2", "num_recent_frames": 22, "tq": 710720.111167259, "t1": 710720.57827857, "ta": 710720.57827857, "te": 710720.615633766, "first_response_s": 0.4671113109216094, "answer_total_s": 0.50446650700178, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_245_a146_q0", "video_id": 245, "time_stamp_s": 21, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2ea9fda407d70675887967ecc0aabf264c6e5dbcfa112dacd09bc98ceb64be43", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0], "recent_frames_sha256": "2df6d70377dd53e18928cb90fec129ca26f6d0ac110bc45a6400c1d16b2157c2", "num_recent_frames": 22, "tq": 710766.558816965, "t1": 710771.99833694, "ta": 710771.99833694, "te": 710772.151800993, "first_response_s": 5.43951997498516, "answer_total_s": 5.592984028044157, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 245, "content_group": "f740ea7d9df9b825f4659fad91169f73f406124b4eb97a84981ccb4091c70d87", "question": {"question_id": "sample_245_a147_q0", "video_id": 245, "video_path": "./videos/sample_245_real.mp4", "annotation_index": 147, "question_index": 0, "question": "Why is Mr. Bean in the hospital ward?", "options": ["A. Because he is visiting a friend who is a patient.", "B. Because this is his fantasy.", "C. Because he mistakenly walked into the wrong building.", "D. Because he is participating in a medical study."], "answer": "B", "time_stamp_s": 149, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [132, 162], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_245_a147_q0", "video_id": 245, "time_stamp_s": 149, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "24b7b8938caeb801ad4cec3f50d032b9f7b5244af5202ccab14cab6542a14aa3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0], "recent_frames_sha256": "83767dae0d97fd7d819d8212d4fd0f7f323d835fb6e5575aa917e2e26f5ce441", "num_recent_frames": 30, "tq": 710720.632145859, "t1": 710732.229926621, "ta": 710732.229926621, "te": 710732.270713467, "first_response_s": 11.59778076200746, "answer_total_s": 11.638567608082667, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_245_a147_q0", "video_id": 245, "time_stamp_s": 149, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "97e6cc6ec6132e40476022bed83aef539db447340d729709435ae27f58b549db", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Mr. Bean, holding a teddy bear, looks up as a woman in a purple dress enters the room.  \n- An elderly woman with a straw hat and blue dress walks toward a red double-decker bus at a bus stop.  \n- The woman approaches a house with a sign reading \"Mrs Wicket\" and rings the doorbell.\n[30-60s] - Mr. Bean presses a button on a wall-mounted intercom labeled \"Mr. Bean\" while standing in a room with patterned wallpaper.\n- On a TV screen, a chef in a white hat and apron waves beside a large, decorated cake.\n- Mr. Bean, in a suit, walks down stairs, then enters a room with a cat lying on the floor near a small table with a plant, and later looks out a window.\n[60-90s] - Mr. Bean approaches a wheelchair, then sits in it, smiling as he looks upward.  \n- A small, yellow, cat-like creature with a red nose appears above the wheelchair, seemingly floating or jumping.  \n- The wheelchair is positioned near a staircase, with a wall clock visible in the background.\n[90-120s] - Mr. Bean in wheelchair, initially smiling, then grimacing as he struggles with a cat in a wheelchair beside him.\n- Cat in wheelchair, initially looking up at Mr. Bean, then later appears to be in distress or falling backward.\n- Mr. Bean stands up from the wheelchair, holding a bouquet of flowers, while another character (possibly a woman) enters the room with a similar bouquet.", "history_tokens": 337, "history_utf8_bytes": 1362, "recent_frame_times_s": [120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0], "recent_frames_sha256": "83767dae0d97fd7d819d8212d4fd0f7f323d835fb6e5575aa917e2e26f5ce441", "num_recent_frames": 30, "tq": 715187.109496933, "t1": 715189.047552545, "ta": 715189.047552545, "te": 715189.091303915, "first_response_s": 1.938055612030439, "answer_total_s": 1.9818069820757955, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 245, "content_group": "f740ea7d9df9b825f4659fad91169f73f406124b4eb97a84981ccb4091c70d87", "question": {"question_id": "sample_245_a148_q0", "video_id": 245, "video_path": "./videos/sample_245_real.mp4", "annotation_index": 148, "question_index": 0, "question": "Why does the character try to manipulate the thermometer reading?", "options": ["A. To pretend to be sick.", "B. To make the nurse angry.", "C. To make the nurse laugh.", "D. To test the accuracy of the thermometer."], "answer": "A", "time_stamp_s": 287, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [264, 294], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_245_a148_q0", "video_id": 245, "time_stamp_s": 287, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "481287e8c33ab15255e7dfa01a711615cd970a00b00a9572c29ec09e71107012", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0], "recent_frames_sha256": "b4e06e53827c2e441fe435300503715b141f8e02406198917264db6a43bee8d1", "num_recent_frames": 30, "tq": 710732.279074617, "t1": 710743.480899168, "ta": 710743.480899168, "te": 710743.518201238, "first_response_s": 11.201824550982565, "answer_total_s": 11.239126621047035, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_245_a148_q0", "video_id": 245, "time_stamp_s": 287, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "39d4792133969c9f7b850d2f7a5de74759ecabb87583c937a820d97b2f413352", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Mr. Bean, holding a teddy bear, looks up as a woman in a purple dress enters the room.  \n- An elderly woman with a straw hat and blue dress walks toward a red double-decker bus at a bus stop.  \n- The woman approaches a house with a sign reading \"Mrs Wicket\" and rings the doorbell.\n[30-60s] - Mr. Bean presses a button on a wall-mounted intercom labeled \"Mr. Bean\" while standing in a room with patterned wallpaper.\n- On a TV screen, a chef in a white hat and apron waves beside a large, decorated cake.\n- Mr. Bean, in a suit, walks down stairs, then enters a room with a cat lying on the floor near a small table with a plant, and later looks out a window.\n[60-90s] - Mr. Bean approaches a wheelchair, then sits in it, smiling as he looks upward.  \n- A small, yellow, cat-like creature with a red nose appears above the wheelchair, seemingly floating or jumping.  \n- The wheelchair is positioned near a staircase, with a wall clock visible in the background.\n[90-120s] - Mr. Bean in wheelchair, initially smiling, then grimacing as he struggles with a cat in a wheelchair beside him.\n- Cat in wheelchair, initially looking up at Mr. Bean, then later appears to be in distress or falling backward.\n- Mr. Bean stands up from the wheelchair, holding a bouquet of flowers, while another character (possibly a woman) enters the room with a similar bouquet.\n[120-150s] - Mr. Bean carries a vacuum cleaner and a bouquet of flowers, appearing to be in a hallway with green wallpaper and a clock on the wall.\n- A woman in a hat and blue dress is seen holding a large bouquet of pink flowers, interacting with a man in a suit, possibly in a different room.\n- A scene shows a woman in a pink dress and a man in a suit standing beside a bed, with a baby in a crib, suggesting a hospital or nursery setting.\n[150-180s] - A woman in a white gown holds a purple bottle while standing beside a man in a hospital bed, who is smiling and holding a spoon.  \n- A man in a suit stands nearby, holding a small object, with a black bag at his feet.  \n- The scene transitions to a hallway where a man in a suit stands next to a wall-mounted clock, with a wheelchair nearby.\n[180-210s] - Mr. Bean is seen lying on the ground, appearing unconscious or injured, with a green car parked nearby.\n- A man in a suit and tie is standing over Mr. Bean, holding a device (possibly a phone or tool) and looking concerned.\n- The background shows a residential area with houses and greenery, indicating an outdoor setting.\n[210-240s] - A man in a suit holds a blue phone, speaking with a concerned expression.\n- A hospital scene shows a man in a bed with a heart monitor, smiling and gesturing toward a bowl of fruit.\n- A large, cartoonish fish lies in a hospital bed next to the man, mouth open, with a bowl of fruit beside it.\n[240-270s] - Mr. Bean lies in a hospital bed, visibly unwell, with a green blanket covering him and a bowl of grapes on the bedside table.  \n- A nurse enters, holding a thermometer, and proceeds to measure Mr. Bean’s temperature while he reacts with exaggerated discomfort.  \n- Mr. Bean’s face shows distress as the nurse administers the thermometer, and he attempts to move away, indicating resistance to the medical procedure.", "history_tokens": 791, "history_utf8_bytes": 3235, "recent_frame_times_s": [258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0], "recent_frames_sha256": "b4e06e53827c2e441fe435300503715b141f8e02406198917264db6a43bee8d1", "num_recent_frames": 30, "tq": 715229.663114303, "t1": 715235.475585196, "ta": 715235.475585196, "te": 715235.714677287, "first_response_s": 5.81247089302633, "answer_total_s": 6.051562984008342, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 245, "content_group": "f740ea7d9df9b825f4659fad91169f73f406124b4eb97a84981ccb4091c70d87", "question": {"question_id": "sample_245_a149_q0", "video_id": 245, "video_path": "./videos/sample_245_real.mp4", "annotation_index": 149, "question_index": 0, "question": "Why is the patient prepped for surgery?", "options": ["A. Because Mr. Bean tampered with the check, making himself appear very unhealthy.", "B. Because the patient requested the surgery as a precaution.", "C. Because the doctor misread the patient's medical chart.", "D. Because the patient was mistakenly identified as someone else."], "answer": "A", "time_stamp_s": 423, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [396, 426], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_245_a149_q0", "video_id": 245, "time_stamp_s": 423, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a05d0527e465c6f2e322a81a2f238d3523e6b9fea45fd3d52e4cfab74188026c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0, 421.0, 422.0, 423.0], "recent_frames_sha256": "b39bbee95bd83d10ce0a9918e7d05f0a5d55d4ffd95f14cdd1ac6f4d52ac0e3e", "num_recent_frames": 30, "tq": 710743.526814223, "t1": 710756.038871027, "ta": 710756.038871027, "te": 710756.078085563, "first_response_s": 12.512056803912856, "answer_total_s": 12.551271339994855, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_245_a149_q0", "video_id": 245, "time_stamp_s": 423, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5aebd6f3e46cfa44f8a62930e02f3302cb86330b74b3a9842e7fb55b9230d51d", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Mr. Bean in wheelchair, initially smiling, then grimacing as he struggles with a cat in a wheelchair beside him.\n- Cat in wheelchair, initially looking up at Mr. Bean, then later appears to be in distress or falling backward.\n- Mr. Bean stands up from the wheelchair, holding a bouquet of flowers, while another character (possibly a woman) enters the room with a similar bouquet.\n[120-150s] - Mr. Bean carries a vacuum cleaner and a bouquet of flowers, appearing to be in a hallway with green wallpaper and a clock on the wall.\n- A woman in a hat and blue dress is seen holding a large bouquet of pink flowers, interacting with a man in a suit, possibly in a different room.\n- A scene shows a woman in a pink dress and a man in a suit standing beside a bed, with a baby in a crib, suggesting a hospital or nursery setting.\n[150-180s] - A woman in a white gown holds a purple bottle while standing beside a man in a hospital bed, who is smiling and holding a spoon.  \n- A man in a suit stands nearby, holding a small object, with a black bag at his feet.  \n- The scene transitions to a hallway where a man in a suit stands next to a wall-mounted clock, with a wheelchair nearby.\n[180-210s] - Mr. Bean is seen lying on the ground, appearing unconscious or injured, with a green car parked nearby.\n- A man in a suit and tie is standing over Mr. Bean, holding a device (possibly a phone or tool) and looking concerned.\n- The background shows a residential area with houses and greenery, indicating an outdoor setting.\n[210-240s] - A man in a suit holds a blue phone, speaking with a concerned expression.\n- A hospital scene shows a man in a bed with a heart monitor, smiling and gesturing toward a bowl of fruit.\n- A large, cartoonish fish lies in a hospital bed next to the man, mouth open, with a bowl of fruit beside it.\n[240-270s] - Mr. Bean lies in a hospital bed, visibly unwell, with a green blanket covering him and a bowl of grapes on the bedside table.  \n- A nurse enters, holding a thermometer, and proceeds to measure Mr. Bean’s temperature while he reacts with exaggerated discomfort.  \n- Mr. Bean’s face shows distress as the nurse administers the thermometer, and he attempts to move away, indicating resistance to the medical procedure.\n[270-300s] - Nurse forcefully administers a hot beverage to a patient in bed, who is visibly sweating and grimacing.\n- Another patient in a separate bed is shown with a bowl of grapes and a cup, suggesting a different treatment or meal.\n- A nurse walks past a patient in a wheelchair, indicating movement and activity within the hospital ward.\n[300-330s] - Mr. Bean in wheelchair moves toward a \"PRIVATE\" door, then peers inside.  \n- A nurse in white coat is seen on a phone, appearing distressed.  \n- A hospital reception area with \"RECEPTION\" and \"OUT-PATIENTS\" signs is visible, with staff and patients in the background.\n[330-360s] - A nurse in white uniform holds a purple object while standing beside a hospital bed where a man in a light blue shirt lies.\n- The man in the bed, wearing a white coat, is seen holding a phone to his ear and smiling, then looking up with a surprised expression.\n- A nurse in a white uniform with a blue belt is pushing a wheelchair with a man in a white coat, who is holding a phone to his ear and smiling.\n[360-390s] - Mr. Bean in wheelchair ascends green stairs, followed by a nurse pushing him.  \n- At X-ray room, Bean removes his phone and smokes a cigarette, then removes his teddy bear.  \n- Nurse pushes Bean into X-ray machine; Bean sits in chair while nurse operates computer.\n[390-420s] - Mr. Bean is seated in a wheelchair, holding a blue X-ray screen displaying bone images, while a nurse in a white coat observes him.  \n- A small brown teddy bear sits on the floor near a door marked \"OPERATING\" as Mr. Bean is wheeled away.  \n- The X-ray screen shows glowing bone outlines, and a hand is seen typing on a beige computer keyboard.", "history_tokens": 960, "history_utf8_bytes": 3945, "recent_frame_times_s": [394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0, 421.0, 422.0, 423.0], "recent_frames_sha256": "b39bbee95bd83d10ce0a9918e7d05f0a5d55d4ffd95f14cdd1ac6f4d52ac0e3e", "num_recent_frames": 30, "tq": 715273.397127321, "t1": 715274.45918541, "ta": 715274.45918541, "te": 715274.662686484, "first_response_s": 1.0620580890681595, "answer_total_s": 1.2655591630609706, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 245, "content_group": "f740ea7d9df9b825f4659fad91169f73f406124b4eb97a84981ccb4091c70d87", "question": {"question_id": "sample_245_a150_q0", "video_id": 245, "video_path": "./videos/sample_245_real.mp4", "annotation_index": 150, "question_index": 0, "question": "Why do the babies start crying?", "options": ["A. Because they are hungry.", "B. Because they need a diaper change.", "C. Because the person in the wheelchair enters the room.", "D. Because they are tired."], "answer": "C", "time_stamp_s": 556, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [528, 558], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_245_a150_q0", "video_id": 245, "time_stamp_s": 556, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "16ff4f24a77331c8dc73bec6a45177c774bfe81585b43cb74f17a19587853195", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0], "recent_frames_sha256": "094dc8a029893e6e58544288e94f7ecf8c537eee3329a31f034cce9264c0ed72", "num_recent_frames": 30, "tq": 710756.099634297, "t1": 710766.50828864, "ta": 710766.50828864, "te": 710766.549566461, "first_response_s": 10.408654342987575, "answer_total_s": 10.449932164046913, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_245_a150_q0", "video_id": 245, "time_stamp_s": 556, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "86c5cadd4d844eb2641e609f8c923ac0bec33473d2319773af4c004c184c4fb6", "condition_order": ["recent", "notes"], "memory": "[210-240s] - A man in a suit holds a blue phone, speaking with a concerned expression.\n- A hospital scene shows a man in a bed with a heart monitor, smiling and gesturing toward a bowl of fruit.\n- A large, cartoonish fish lies in a hospital bed next to the man, mouth open, with a bowl of fruit beside it.\n[240-270s] - Mr. Bean lies in a hospital bed, visibly unwell, with a green blanket covering him and a bowl of grapes on the bedside table.  \n- A nurse enters, holding a thermometer, and proceeds to measure Mr. Bean’s temperature while he reacts with exaggerated discomfort.  \n- Mr. Bean’s face shows distress as the nurse administers the thermometer, and he attempts to move away, indicating resistance to the medical procedure.\n[270-300s] - Nurse forcefully administers a hot beverage to a patient in bed, who is visibly sweating and grimacing.\n- Another patient in a separate bed is shown with a bowl of grapes and a cup, suggesting a different treatment or meal.\n- A nurse walks past a patient in a wheelchair, indicating movement and activity within the hospital ward.\n[300-330s] - Mr. Bean in wheelchair moves toward a \"PRIVATE\" door, then peers inside.  \n- A nurse in white coat is seen on a phone, appearing distressed.  \n- A hospital reception area with \"RECEPTION\" and \"OUT-PATIENTS\" signs is visible, with staff and patients in the background.\n[330-360s] - A nurse in white uniform holds a purple object while standing beside a hospital bed where a man in a light blue shirt lies.\n- The man in the bed, wearing a white coat, is seen holding a phone to his ear and smiling, then looking up with a surprised expression.\n- A nurse in a white uniform with a blue belt is pushing a wheelchair with a man in a white coat, who is holding a phone to his ear and smiling.\n[360-390s] - Mr. Bean in wheelchair ascends green stairs, followed by a nurse pushing him.  \n- At X-ray room, Bean removes his phone and smokes a cigarette, then removes his teddy bear.  \n- Nurse pushes Bean into X-ray machine; Bean sits in chair while nurse operates computer.\n[390-420s] - Mr. Bean is seated in a wheelchair, holding a blue X-ray screen displaying bone images, while a nurse in a white coat observes him.  \n- A small brown teddy bear sits on the floor near a door marked \"OPERATING\" as Mr. Bean is wheeled away.  \n- The X-ray screen shows glowing bone outlines, and a hand is seen typing on a beige computer keyboard.\n[420-450s] - Two doctors in green surgical caps and masks stand beside a patient on a surgical table, one holding a large bowl of liquid while the other gestures with a syringe.  \n- The patient, wearing green scrubs, lies on the table with a surprised expression, looking up at the doctors.  \n- A bright surgical light illuminates the scene from above, casting shadows on the sterile room background.\n[450-480s] - Mr. Bean lies on a surgical table, visibly anxious, as a surgeon in green scrubs marks his chest with a blue pen.  \n- A second surgeon in white scrubs holds a scalpel, preparing to operate, while a third surgeon in green scrubs holds a syringe.  \n- The surgeon in green scrubs injects a green liquid into Mr. Bean’s arm, causing him to recoil in pain.\n[480-510s] - Mr. Bean, in a white coat, runs past a door marked \"EXIT\" while holding a teddy bear.  \n- He then pushes a wheelchair with the teddy bear seated on it, passing a sign listing \"Bar,\" \"Restaurant,\" and \"Chapel.\"  \n- A nurse in a white coat appears behind him, looking surprised as he continues pushing the wheelchair.\n[510-540s] - Mr. Bean in wheelchair, holding a teddy bear, looks surprised as a woman in white coat pushes him away.  \n- A man in a yellow robe with a cane appears, gesturing dramatically toward a \"CURED CHAPEL\" sign.  \n- The man in the robe then turns and runs away, leaving Mr. Bean in the wheelchair.", "history_tokens": 949, "history_utf8_bytes": 3819, "recent_frame_times_s": [527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0], "recent_frames_sha256": "094dc8a029893e6e58544288e94f7ecf8c537eee3329a31f034cce9264c0ed72", "num_recent_frames": 30, "tq": 715301.755090154, "t1": 715308.157793478, "ta": 715308.157793478, "te": 715308.364600173, "first_response_s": 6.402703323983587, "answer_total_s": 6.609510018955916, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 246, "content_group": "368b158e1ed2ffda7159b1797a005559b90fa5a3e761a73cc45c9015b803d567", "question": {"question_id": "sample_246_a1635_q0", "video_id": 246, "video_path": "./videos/sample_246_real.mp4", "annotation_index": 1635, "question_index": 0, "question": "Why does the character cuddle the teddy bear and smile in bed?", "options": ["A. Because the character is preparing for bedtime.", "B. Because the character is trying to send a message.", "C. Because the character feels comforted by the teddy bear.", "D. Because the character is participating in a game."], "answer": "C", "time_stamp_s": 30, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_246_a1635_q0", "video_id": 246, "time_stamp_s": 30, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4eddd0681c8702f896b932f6fb6b7bf51bdf1f7249c506554f3876a52ed558fb", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0, 27.0, 28.0, 29.0, 30.0], "recent_frames_sha256": "faa488c6395b40b51a08ce4f564b24d543850ad2e6a2ab20bff538314c0a1478", "num_recent_frames": 31, "tq": 718787.188612755, "t1": 718794.066454276, "ta": 718794.066454276, "te": 718794.107435015, "first_response_s": 6.877841520938091, "answer_total_s": 6.91882225999143, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_246_a1635_q0", "video_id": 246, "time_stamp_s": 30, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "540e1a5717537402b3f1d56f833a1a390045b46e26fc02506417c98e53d79c57", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean, in a suit, holds a teddy bear and stands near a door, then turns to face the camera.  \n- A woman in a purple outfit appears in the doorway, looking at Mr. Bean.  \n- Mr. Bean is shown sleeping in bed, clutching the teddy bear, with a clock and lamp visible on the bedside table.", "history_tokens": 82, "history_utf8_bytes": 297, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0, 27.0, 28.0, 29.0, 30.0], "recent_frames_sha256": "faa488c6395b40b51a08ce4f564b24d543850ad2e6a2ab20bff538314c0a1478", "num_recent_frames": 31, "tq": 718636.798999794, "t1": 718638.135959571, "ta": 718638.135959571, "te": 718638.501530116, "first_response_s": 1.3369597770506516, "answer_total_s": 1.7025303220143542, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 246, "content_group": "368b158e1ed2ffda7159b1797a005559b90fa5a3e761a73cc45c9015b803d567", "question": {"question_id": "sample_246_a1636_q0", "video_id": 246, "video_path": "./videos/sample_246_real.mp4", "annotation_index": 1636, "question_index": 0, "question": "Why does Mr. Bean become disturbed?", "options": ["A. Because the worker is whistling loudly.", "B. Because the worker is using a jackhammer.", "C. Because the worker is throwing tools around.", "D. Because the worker is shouting instructions."], "answer": "B", "time_stamp_s": 145, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [132, 162], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_246_a1636_q0", "video_id": 246, "time_stamp_s": 145, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9853e87305b6c41c50da7b9c490f2ac43dc2abacb6a942e0e782fb61db74f5dc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0], "recent_frames_sha256": "4d357b2c0b822c5869acafceef59703ccfb84cc6fce36384827ea66a069ea220", "num_recent_frames": 30, "tq": 718794.119866927, "t1": 718805.135476807, "ta": 718805.135476807, "te": 718805.172921163, "first_response_s": 11.015609879978001, "answer_total_s": 11.053054235992022, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_246_a1636_q0", "video_id": 246, "time_stamp_s": 145, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c6d093f63c1f03aeea90479e8eeb982fbbd015ad7f08be0c8ec7c4361bad8cfd", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean, in a suit, holds a teddy bear and stands near a door, then turns to face the camera.  \n- A woman in a purple outfit appears in the doorway, looking at Mr. Bean.  \n- Mr. Bean is shown sleeping in bed, clutching the teddy bear, with a clock and lamp visible on the bedside table.\n[30-60s] - Mr. Bean wakes up, stretches, and looks at a red alarm clock on the nightstand.\n- He opens a wooden dresser drawer, revealing blue clothes, then looks at a mirror.\n- He stands up, walks to a TV, and appears startled as a clock on the wall shows 7:00.\n[60-90s] - Man in red cap and black suit reads \"The Daily Blah\" while standing outdoors, occasionally glancing up.\n- Woman in pink hat and headphones holds an orange device, looking annoyed and gesturing toward the man.\n- Man in white shirt and striped pants leaps from a window, arms raised, then lands on the ground with a surprised expression.\n[90-120s] - A man in a pink beanie and headphones laughs while standing next to a large, green, round character holding a shovel.  \n- A small, animated character with a white shirt and black hair appears, initially crying, then suddenly standing with arms outstretched in surprise.  \n- The small character later stands barefoot on a porch, holding a patterned apron, and then quickly jumps up as if startled or excited.", "history_tokens": 330, "history_utf8_bytes": 1326, "recent_frame_times_s": [116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0], "recent_frames_sha256": "4d357b2c0b822c5869acafceef59703ccfb84cc6fce36384827ea66a069ea220", "num_recent_frames": 30, "tq": 718660.180745614, "t1": 718661.421396851, "ta": 718661.421396851, "te": 718661.570166757, "first_response_s": 1.2406512369634584, "answer_total_s": 1.3894211429869756, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 246, "content_group": "368b158e1ed2ffda7159b1797a005559b90fa5a3e761a73cc45c9015b803d567", "question": {"question_id": "sample_246_a1637_q0", "video_id": 246, "video_path": "./videos/sample_246_real.mp4", "annotation_index": 1637, "question_index": 0, "question": "Why does the person adjust a lever and press a red button on the machine?", "options": ["A. Because the person wants to power up the machine.", "B. Because the person needs to deflate the tent.", "C. Because the person wants to shut down the machine.", "D. Because the person is testing the lever's mechanism."], "answer": "A", "time_stamp_s": 275, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [264, 294], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_246_a1637_q0", "video_id": 246, "time_stamp_s": 275, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "69dfdac6e374ff53e00d1be660ac4594d2a83e9daa44054d6e0f2cb9dc4540a2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0], "recent_frames_sha256": "199760f1d2e7d5128d26446b87bee5bfebf1bc6a4ccc82e4753286f8b76eb036", "num_recent_frames": 30, "tq": 718805.184208103, "t1": 718817.299697634, "ta": 718817.299697634, "te": 718817.337400759, "first_response_s": 12.115489530959167, "answer_total_s": 12.153192655998282, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_246_a1637_q0", "video_id": 246, "time_stamp_s": 275, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d8ed50221f46eb6d9d61692df4313cb041ad8a46a450b337d4bb3778a8070ec8", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean, in a suit, holds a teddy bear and stands near a door, then turns to face the camera.  \n- A woman in a purple outfit appears in the doorway, looking at Mr. Bean.  \n- Mr. Bean is shown sleeping in bed, clutching the teddy bear, with a clock and lamp visible on the bedside table.\n[30-60s] - Mr. Bean wakes up, stretches, and looks at a red alarm clock on the nightstand.\n- He opens a wooden dresser drawer, revealing blue clothes, then looks at a mirror.\n- He stands up, walks to a TV, and appears startled as a clock on the wall shows 7:00.\n[60-90s] - Man in red cap and black suit reads \"The Daily Blah\" while standing outdoors, occasionally glancing up.\n- Woman in pink hat and headphones holds an orange device, looking annoyed and gesturing toward the man.\n- Man in white shirt and striped pants leaps from a window, arms raised, then lands on the ground with a surprised expression.\n[90-120s] - A man in a pink beanie and headphones laughs while standing next to a large, green, round character holding a shovel.  \n- A small, animated character with a white shirt and black hair appears, initially crying, then suddenly standing with arms outstretched in surprise.  \n- The small character later stands barefoot on a porch, holding a patterned apron, and then quickly jumps up as if startled or excited.\n[120-150s] - A man in a room with a sewing machine is shown sewing a white garment with red lines, then holds up the finished piece with a satisfied expression.\n- The same man is later seen outdoors, operating a large orange power tool while wearing headphones, with a pile of dirt and traffic cones nearby.\n- A man in a red cap sits on the ground reading a newspaper, positioned near the dirt pile, while the power tool operator works nearby.\n[150-180s] - Mr. Bean holds a framed picture of the Leaning Tower of Pisa, then moves to a dresser with a blue bowl and duck figurine on top.\n- He pulls out a drawer, causing it to collapse and spill contents, then uses a stick to break a clock on a table.\n- He picks up a hammer and a small object, then pours a white substance from a jar onto a table.\n[180-210s] - Mr. Bean, in a suit, stands near a wall-mounted picture of a lighthouse, looking annoyed.  \n- A grandfather clock is chained to a table with a computer monitor also chained nearby.  \n- Mr. Bean is seen holding a remote control, aiming it toward a window where a figure is visible outside.\n[210-240s] - Mr. Bean is seen in a room with a clock, a computer, and a wooden cabinet, appearing startled or confused.\n- He then runs toward a large wooden cabinet, which he attempts to push or move, showing effort and determination.\n- Outside, a woman in a pink hat and headphones is seen operating a vacuum cleaner, while a man in a red cap stands nearby, both appearing to be engaged in some outdoor activity.\n[240-270s] - Mr. Bean operates a red walkie-talkie while standing near an orange machine, adjusting its settings.  \n- Two workers, one in a red cap and another in a pink cap, are nearby; the worker in the pink cap holds a yellow manual with a question mark.  \n- The worker in the red cap points at the machine while the other worker looks at the manual, indicating a collaborative task.", "history_tokens": 787, "history_utf8_bytes": 3227, "recent_frame_times_s": [246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0], "recent_frames_sha256": "199760f1d2e7d5128d26446b87bee5bfebf1bc6a4ccc82e4753286f8b76eb036", "num_recent_frames": 30, "tq": 718702.690281069, "t1": 718703.177029081, "ta": 718703.177029081, "te": 718703.325892077, "first_response_s": 0.48674801201559603, "answer_total_s": 0.6356110079213977, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 246, "content_group": "368b158e1ed2ffda7159b1797a005559b90fa5a3e761a73cc45c9015b803d567", "question": {"question_id": "sample_246_a1638_q0", "video_id": 246, "video_path": "./videos/sample_246_real.mp4", "annotation_index": 1638, "question_index": 0, "question": "Why is there an abundance of egg cartons and eggs causing clutter in the house?", "options": ["A. Because the man in the red hat operates heavy machinery.", "B. Because someone is baking a large number of cakes.", "C. Because a delivery of eggs made a mistake.", "D. Because the family is preparing for a party."], "answer": "A", "time_stamp_s": 423, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [396, 426], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_246_a1638_q0", "video_id": 246, "time_stamp_s": 423, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c8e1944b92d7b73eea25fe5d0020b32e4da570f56ade25ace6e6042245787fff", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0, 421.0, 422.0, 423.0], "recent_frames_sha256": "ba199b0ecad80118461aa04ad3b1eef4e8b4d41361f6d63f1a85bd85b2a13530", "num_recent_frames": 30, "tq": 718817.349716725, "t1": 718828.100636635, "ta": 718828.100636635, "te": 718828.138355632, "first_response_s": 10.75091991003137, "answer_total_s": 10.788638907019049, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_246_a1638_q0", "video_id": 246, "time_stamp_s": 423, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9415d406c8772b7da48b88df1fdbfb24b3bd3a0989b249441c3fe221883e9411", "condition_order": ["notes", "recent"], "memory": "[120-150s] - A man in a room with a sewing machine is shown sewing a white garment with red lines, then holds up the finished piece with a satisfied expression.\n- The same man is later seen outdoors, operating a large orange power tool while wearing headphones, with a pile of dirt and traffic cones nearby.\n- A man in a red cap sits on the ground reading a newspaper, positioned near the dirt pile, while the power tool operator works nearby.\n[150-180s] - Mr. Bean holds a framed picture of the Leaning Tower of Pisa, then moves to a dresser with a blue bowl and duck figurine on top.\n- He pulls out a drawer, causing it to collapse and spill contents, then uses a stick to break a clock on a table.\n- He picks up a hammer and a small object, then pours a white substance from a jar onto a table.\n[180-210s] - Mr. Bean, in a suit, stands near a wall-mounted picture of a lighthouse, looking annoyed.  \n- A grandfather clock is chained to a table with a computer monitor also chained nearby.  \n- Mr. Bean is seen holding a remote control, aiming it toward a window where a figure is visible outside.\n[210-240s] - Mr. Bean is seen in a room with a clock, a computer, and a wooden cabinet, appearing startled or confused.\n- He then runs toward a large wooden cabinet, which he attempts to push or move, showing effort and determination.\n- Outside, a woman in a pink hat and headphones is seen operating a vacuum cleaner, while a man in a red cap stands nearby, both appearing to be engaged in some outdoor activity.\n[240-270s] - Mr. Bean operates a red walkie-talkie while standing near an orange machine, adjusting its settings.  \n- Two workers, one in a red cap and another in a pink cap, are nearby; the worker in the pink cap holds a yellow manual with a question mark.  \n- The worker in the red cap points at the machine while the other worker looks at the manual, indicating a collaborative task.\n[270-300s] - A hand presses an orange button on a blue machine, triggering a mechanical response.  \n- A man in a red cap and black coat reads a yellow book while standing beside a woman in a pink headband.  \n- A man in a suit and tie is seen inside a red-and-white striped tent, holding a vacuum cleaner hose.\n[300-330s] - A man in a red cap and green vest holds a yellow book while standing beside a woman in a pink headband, both looking at the book.  \n- A small boy with a red-and-white striped flag appears briefly, then is shown operating a large blue machine with a hose.  \n- A large red-and-white striped tent is pulled into view by the machine, followed by a close-up of a man’s face with wide eyes and a shocked expression.\n[330-360s] - A man in a suit sits in an armchair, watching TV, then turns to look at a lamp as he moves his hand toward it.\n- A cartoon character with a snorkel and mask is submerged in a bathtub, with a teddy bear watching from the edge.\n- The character emerges from the tub, now wearing blue swim trunks, and walks toward a table where a stack of blocks is piled up next to an open refrigerator.\n[360-390s] - Mr. Bean opens a refrigerator filled with egg cartons, revealing a large quantity of eggs inside.\n- He is seen holding a picture frame with a stack of eggs depicted on it, suggesting a visual representation of his egg collection.\n- The scene transitions to him standing in a room with a record player, indicating a shift in setting or activity.\n[390-420s] - Mr. Bean sits in an armchair, holding a teddy bear, then suddenly jumps up in alarm as a large object (possibly a box) falls from above.  \n- A man in a red cap and green pants operates a large machine outdoors, appearing to be in a circus or fair setting, while another man in a pink hat sits nearby with a bottle and cup.  \n- The scene shifts indoors to a kitchen with a refrigerator and table, suggesting a transition from the outdoor circus setting to a domestic environment.", "history_tokens": 933, "history_utf8_bytes": 3883, "recent_frame_times_s": [394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0, 421.0, 422.0, 423.0], "recent_frames_sha256": "ba199b0ecad80118461aa04ad3b1eef4e8b4d41361f6d63f1a85bd85b2a13530", "num_recent_frames": 30, "tq": 718747.944148336, "t1": 718753.440869499, "ta": 718753.440869499, "te": 718753.592399622, "first_response_s": 5.496721163042821, "answer_total_s": 5.648251286009327, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 246, "content_group": "368b158e1ed2ffda7159b1797a005559b90fa5a3e761a73cc45c9015b803d567", "question": {"question_id": "sample_246_a1639_q0", "video_id": 246, "video_path": "./videos/sample_246_real.mp4", "annotation_index": 1639, "question_index": 0, "question": "Why do the workers outside notice an issue with the pipeline?", "options": ["A. Because there was a scheduled maintenance check.", "B. Because the pipeline was leaking due to wear and tear.", "C. Because overheating cooking supplies produced smoke.", "D. Because the workers were alerted by a loud noise."], "answer": "C", "time_stamp_s": 550, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [528, 558], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_246_a1639_q0", "video_id": 246, "time_stamp_s": 550, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cc7169ff14850a452c995d269872a1c82ed3edc1e03b4eb2334779abea3814eb", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0], "recent_frames_sha256": "c9c68c867951981cf87c3fe8ef8a6fc7d26fb290c80304048bcfd00b7711ea5f", "num_recent_frames": 30, "tq": 718828.145987299, "t1": 718836.78095463, "ta": 718836.78095463, "te": 718836.822512742, "first_response_s": 8.634967330959626, "answer_total_s": 8.676525442977436, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_246_a1639_q0", "video_id": 246, "time_stamp_s": 550, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3cbb521733d538ea45e99690da7c4fda1e6ee95debe3b3b1c055eba32203984c", "condition_order": ["notes", "recent"], "memory": "[240-270s] - Mr. Bean operates a red walkie-talkie while standing near an orange machine, adjusting its settings.  \n- Two workers, one in a red cap and another in a pink cap, are nearby; the worker in the pink cap holds a yellow manual with a question mark.  \n- The worker in the red cap points at the machine while the other worker looks at the manual, indicating a collaborative task.\n[270-300s] - A hand presses an orange button on a blue machine, triggering a mechanical response.  \n- A man in a red cap and black coat reads a yellow book while standing beside a woman in a pink headband.  \n- A man in a suit and tie is seen inside a red-and-white striped tent, holding a vacuum cleaner hose.\n[300-330s] - A man in a red cap and green vest holds a yellow book while standing beside a woman in a pink headband, both looking at the book.  \n- A small boy with a red-and-white striped flag appears briefly, then is shown operating a large blue machine with a hose.  \n- A large red-and-white striped tent is pulled into view by the machine, followed by a close-up of a man’s face with wide eyes and a shocked expression.\n[330-360s] - A man in a suit sits in an armchair, watching TV, then turns to look at a lamp as he moves his hand toward it.\n- A cartoon character with a snorkel and mask is submerged in a bathtub, with a teddy bear watching from the edge.\n- The character emerges from the tub, now wearing blue swim trunks, and walks toward a table where a stack of blocks is piled up next to an open refrigerator.\n[360-390s] - Mr. Bean opens a refrigerator filled with egg cartons, revealing a large quantity of eggs inside.\n- He is seen holding a picture frame with a stack of eggs depicted on it, suggesting a visual representation of his egg collection.\n- The scene transitions to him standing in a room with a record player, indicating a shift in setting or activity.\n[390-420s] - Mr. Bean sits in an armchair, holding a teddy bear, then suddenly jumps up in alarm as a large object (possibly a box) falls from above.  \n- A man in a red cap and green pants operates a large machine outdoors, appearing to be in a circus or fair setting, while another man in a pink hat sits nearby with a bottle and cup.  \n- The scene shifts indoors to a kitchen with a refrigerator and table, suggesting a transition from the outdoor circus setting to a domestic environment.\n[420-450s] - Mr. Bean holds a clipboard with \"NO!\" written on it, showing a stern expression.\n- A construction worker in a red cap and another worker with a headset are seen outdoors, with the worker in the headset operating a hose.\n- Mr. Bean walks away from the scene, holding a red and white striped object, possibly a sign or tool.\n[450-480s] - Mr. Bean holds a red clipboard with \"NO!\" written on it, pointing at a man in a suit who is smiling and holding a cane.\n- A woman in a purple dress holds two steaming mugs, standing near a garden with trash cans.\n- Mr. Bean walks toward the woman, holding the clipboard, while a man in a green suit and red hat stands beside a large orange machine.\n[480-510s] - Mr. Bean approaches the construction site holding a tray with food and a cup, offering it to the workers.  \n- The worker in the red cap and green shirt is seated, reading a newspaper, while the worker in the pink hat is operating a vacuum cleaner.  \n- The worker in the pink hat looks up with a surprised expression as Mr. Bean approaches, and the worker in the red cap also looks up, seemingly startled by the interruption.\n[510-540s] - Mr. Bean, in a suit, holds a tray with a large chocolate cake and a smaller cake, smiling as he approaches the construction site.  \n- The construction worker, wearing a red cap and green vest, is seated on the ground with a pink-haired child, both appearing to be engaged in a task near a striped tent and machinery.  \n- Mr. Bean is later shown indoors, sitting in a brown armchair, eating chocolates from a pink box while a teddy bear sits beside him.", "history_tokens": 957, "history_utf8_bytes": 3971, "recent_frame_times_s": [521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0], "recent_frames_sha256": "c9c68c867951981cf87c3fe8ef8a6fc7d26fb290c80304048bcfd00b7711ea5f", "num_recent_frames": 30, "tq": 718785.396070651, "t1": 718787.111146201, "ta": 718787.111146201, "te": 718787.151749914, "first_response_s": 1.7150755500188097, "answer_total_s": 1.7556792630348355, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 247, "content_group": "ba20d9d590f25d608593474b785b4a98f9b0daba94a55cb39be87df29c5e0c9b", "question": {"question_id": "sample_247_a633_q0", "video_id": 247, "video_path": "./videos/sample_247_real.mp4", "annotation_index": 633, "question_index": 0, "question": "Why does the older woman appear annoyed or angry?", "options": ["A. Because the character shouted loudly.", "B. Because the character knocked on the door.", "C. Because the character broke something.", "D. Because the character disturbed her."], "answer": "D", "time_stamp_s": 26, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_247_a633_q0", "video_id": 247, "time_stamp_s": 26, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "83de4e95f750fb30c8a3ad7af08fc4f1b126930b34a5b01d589d63a4740619a3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0], "recent_frames_sha256": "3e59f61f3dfec7c5eb03ac06e9f950bebcc368ab68d8c8fdfab0119fd07bbaac", "num_recent_frames": 27, "tq": 715559.041684626, "t1": 715564.271178549, "ta": 715564.271178549, "te": 715564.314262964, "first_response_s": 5.229493923019618, "answer_total_s": 5.27257833792828, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_247_a633_q0", "video_id": 247, "time_stamp_s": 26, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b352166754b9ee41f3398a55ae3de5ef90e6143fdc0c8f678ba579fe1fc8623f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0], "recent_frames_sha256": "3e59f61f3dfec7c5eb03ac06e9f950bebcc368ab68d8c8fdfab0119fd07bbaac", "num_recent_frames": 27, "tq": 715405.243135412, "t1": 715416.962732609, "ta": 715416.962732609, "te": 715417.000175803, "first_response_s": 11.719597197021358, "answer_total_s": 11.757040390977636, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 247, "content_group": "ba20d9d590f25d608593474b785b4a98f9b0daba94a55cb39be87df29c5e0c9b", "question": {"question_id": "sample_247_a634_q0", "video_id": 247, "video_path": "./videos/sample_247_real.mp4", "annotation_index": 634, "question_index": 0, "question": "Why does the man in the dirty car wave a money?", "options": ["A. Because he wanted Mr. Bean to help him wash his car.", "B. Because he was offering to buy something from Mr. Bean.", "C. Because he wanted to pay Mr. Bean for directions.", "D. Because he was asking Mr. Bean for change."], "answer": "A", "time_stamp_s": 152, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [135, 165], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_247_a634_q0", "video_id": 247, "time_stamp_s": 152, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a41542fc50f2554e30b59253bb44efdf7567b6795b17394c74df925e30f30555", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0], "recent_frames_sha256": "54b250143548def650bfb796288b8f18d3d709afefcc8725481978ae41222ed0", "num_recent_frames": 30, "tq": 715564.331138642, "t1": 715575.725733842, "ta": 715575.725733842, "te": 715575.765102392, "first_response_s": 11.394595199963078, "answer_total_s": 11.43396374990698, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_247_a634_q0", "video_id": 247, "time_stamp_s": 152, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "eee4b60834a868acc38d14d286c4bb9c6e5dd47e84a9c829e44abe7f99c419d8", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean holds a teddy bear and a white cup, then drops the teddy bear and cup on the floor.  \n- Mr. Bean walks away from the teddy bear and cup, then turns back to look at them.  \n- A large, round, purple character enters the room from a doorway, holding a stick.\n[30-60s] - A green Mini car with license plate \"STE 952R\" drives past a row of houses, with a penguin perched on its front bumper.\n- The car stops, and Mr. Bean exits, holding a small object in his hand.\n- The penguin remains on the car's bumper as Mr. Bean stands beside it, looking at the object.\n[60-90s] - Mr. Bean stands beside a green car with mud on its body, holding a blue bucket and a sponge, appearing to clean it.\n- A pigeon lands on the car's hood, then flies away as Mr. Bean looks up, seemingly startled.\n- A large woman in a dark coat and pink scarf approaches Mr. Bean, gesturing toward the car while he looks at her with a confused expression.\n[90-120s] - A hand pours yellow liquid onto a black surface, creating a smear near a grey oval object.  \n- Mr. Bean stands beside a green car, holding a brush and looking at the car’s front, with a blue bag nearby.  \n- A pigeon with purple goggles stands on a black surface, facing forward, near a white pipe.\n[120-150s] - Mr. Bean is washing a green car with soapy water, visibly frustrated as he wipes the hood.\n- The car is parked on a street with a row of green buildings in the background.\n- A brown, muddy car drives past Mr. Bean's green car, causing him to look up and react.", "history_tokens": 401, "history_utf8_bytes": 1522, "recent_frame_times_s": [123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0], "recent_frames_sha256": "54b250143548def650bfb796288b8f18d3d709afefcc8725481978ae41222ed0", "num_recent_frames": 30, "tq": 715449.714449121, "t1": 715456.795758668, "ta": 715456.795758668, "te": 715456.832917, "first_response_s": 7.081309546949342, "answer_total_s": 7.118467879015952, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 247, "content_group": "ba20d9d590f25d608593474b785b4a98f9b0daba94a55cb39be87df29c5e0c9b", "question": {"question_id": "sample_247_a635_q0", "video_id": 247, "video_path": "./videos/sample_247_real.mp4", "annotation_index": 635, "question_index": 0, "question": "Why does the person start pedaling the bicycle?", "options": ["A. Because the person wants to generate electricity for a nearby device.", "B. Because the person is testing the bicycle for a friend.", "C. Because riding a bicycle can start the car wash machine.", "D. Because the person needs to warm up before a race."], "answer": "C", "time_stamp_s": 295, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [270, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_247_a635_q0", "video_id": 247, "time_stamp_s": 295, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a2b41fefe288b4d1232fdf2f9ff422c8d2ff04d32e47eccc75153c36d9bd34d7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0], "recent_frames_sha256": "7652eb183d599a6c7bbae135c395b66f3b58ec44914d75f888d07137a61eb3d4", "num_recent_frames": 30, "tq": 715575.780217132, "t1": 715582.480543973, "ta": 715582.480543973, "te": 715582.517491233, "first_response_s": 6.700326841091737, "answer_total_s": 6.7372741010040045, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_247_a635_q0", "video_id": 247, "time_stamp_s": 295, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f2858f4fe51aa681fafd2803129a0719df51bff7d258a15a229cb6ebdc69fdcc", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean holds a teddy bear and a white cup, then drops the teddy bear and cup on the floor.  \n- Mr. Bean walks away from the teddy bear and cup, then turns back to look at them.  \n- A large, round, purple character enters the room from a doorway, holding a stick.\n[30-60s] - A green Mini car with license plate \"STE 952R\" drives past a row of houses, with a penguin perched on its front bumper.\n- The car stops, and Mr. Bean exits, holding a small object in his hand.\n- The penguin remains on the car's bumper as Mr. Bean stands beside it, looking at the object.\n[60-90s] - Mr. Bean stands beside a green car with mud on its body, holding a blue bucket and a sponge, appearing to clean it.\n- A pigeon lands on the car's hood, then flies away as Mr. Bean looks up, seemingly startled.\n- A large woman in a dark coat and pink scarf approaches Mr. Bean, gesturing toward the car while he looks at her with a confused expression.\n[90-120s] - A hand pours yellow liquid onto a black surface, creating a smear near a grey oval object.  \n- Mr. Bean stands beside a green car, holding a brush and looking at the car’s front, with a blue bag nearby.  \n- A pigeon with purple goggles stands on a black surface, facing forward, near a white pipe.\n[120-150s] - Mr. Bean is washing a green car with soapy water, visibly frustrated as he wipes the hood.\n- The car is parked on a street with a row of green buildings in the background.\n- A brown, muddy car drives past Mr. Bean's green car, causing him to look up and react.\n[150-180s] - Mr. Bean stands in front of a bathroom door, looking at a control panel with buttons.\n- He then enters a bathroom where he is seen pulling out a bathtub, which is positioned next to a toilet.\n- The bathtub is removed from its position, leaving behind tools and a shower curtain.\n[180-210s] - Mr. Bean stands beside a white bathtub in a room with green wallpaper and a staircase, looking surprised or confused.\n- A red rotary phone sits on a wooden table near the staircase, and a clock with a face is mounted on the wall.\n- Mr. Bean is later seen outdoors in a bathtub, with a woman standing nearby and a yellow car parked beside them.\n[210-240s] - Mr. Bean peeks from behind a door in a garden shed, surrounded by tools and a bicycle.  \n- He enters a house, smiling, then walks into a laundry room holding a blanket.  \n- He appears surprised while standing near a washing machine, then looks at a broken mirror.\n[240-270s] - Mr. Bean stands beside a muddy car, gesturing toward it while wearing yellow boots.\n- He uses a broom to sweep the ground near the car, which is parked next to a clothesline.\n- A red bicycle is positioned nearby, connected to a pulley system, suggesting a setup for moving or cleaning the car.", "history_tokens": 703, "history_utf8_bytes": 2755, "recent_frame_times_s": [266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0], "recent_frames_sha256": "7652eb183d599a6c7bbae135c395b66f3b58ec44914d75f888d07137a61eb3d4", "num_recent_frames": 30, "tq": 715485.587173695, "t1": 715491.733990585, "ta": 715491.733990585, "te": 715491.922206508, "first_response_s": 6.1468168899882585, "answer_total_s": 6.335032813018188, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 247, "content_group": "ba20d9d590f25d608593474b785b4a98f9b0daba94a55cb39be87df29c5e0c9b", "question": {"question_id": "sample_247_a636_q0", "video_id": 247, "video_path": "./videos/sample_247_real.mp4", "annotation_index": 636, "question_index": 0, "question": "Why do the woman and the driver sit down to have tea together?", "options": ["A. Because the woman and the driver know each other.", "B. Because the man on the bicycle invited them to tea.", "C. Because the car broke down and they had nothing else to do.", "D. Because the driver's car is being cleaned."], "answer": "D", "time_stamp_s": 418, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [405, 435], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_247_a636_q0", "video_id": 247, "time_stamp_s": 418, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "20259871d4c421a8bf06f5c093d9288e15c1cc7f35d075377c5a4ecfebf2995d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0], "recent_frames_sha256": "6c0a0906392268eb86fd835643efb3b5cc7222e1c611ed65624f815f74493feb", "num_recent_frames": 30, "tq": 715582.525253092, "t1": 715594.006270887, "ta": 715594.006270887, "te": 715594.043988042, "first_response_s": 11.48101779492572, "answer_total_s": 11.518734949990176, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_247_a636_q0", "video_id": 247, "time_stamp_s": 418, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dbad83e2876f411452dbe8320667983a51edec43b39461bb838c97a35beb8b90", "condition_order": ["notes", "recent"], "memory": "[30-60s] - A green Mini car with license plate \"STE 952R\" drives past a row of houses, with a penguin perched on its front bumper.\n- The car stops, and Mr. Bean exits, holding a small object in his hand.\n- The penguin remains on the car's bumper as Mr. Bean stands beside it, looking at the object.\n[60-90s] - Mr. Bean stands beside a green car with mud on its body, holding a blue bucket and a sponge, appearing to clean it.\n- A pigeon lands on the car's hood, then flies away as Mr. Bean looks up, seemingly startled.\n- A large woman in a dark coat and pink scarf approaches Mr. Bean, gesturing toward the car while he looks at her with a confused expression.\n[90-120s] - A hand pours yellow liquid onto a black surface, creating a smear near a grey oval object.  \n- Mr. Bean stands beside a green car, holding a brush and looking at the car’s front, with a blue bag nearby.  \n- A pigeon with purple goggles stands on a black surface, facing forward, near a white pipe.\n[120-150s] - Mr. Bean is washing a green car with soapy water, visibly frustrated as he wipes the hood.\n- The car is parked on a street with a row of green buildings in the background.\n- A brown, muddy car drives past Mr. Bean's green car, causing him to look up and react.\n[150-180s] - Mr. Bean stands in front of a bathroom door, looking at a control panel with buttons.\n- He then enters a bathroom where he is seen pulling out a bathtub, which is positioned next to a toilet.\n- The bathtub is removed from its position, leaving behind tools and a shower curtain.\n[180-210s] - Mr. Bean stands beside a white bathtub in a room with green wallpaper and a staircase, looking surprised or confused.\n- A red rotary phone sits on a wooden table near the staircase, and a clock with a face is mounted on the wall.\n- Mr. Bean is later seen outdoors in a bathtub, with a woman standing nearby and a yellow car parked beside them.\n[210-240s] - Mr. Bean peeks from behind a door in a garden shed, surrounded by tools and a bicycle.  \n- He enters a house, smiling, then walks into a laundry room holding a blanket.  \n- He appears surprised while standing near a washing machine, then looks at a broken mirror.\n[240-270s] - Mr. Bean stands beside a muddy car, gesturing toward it while wearing yellow boots.\n- He uses a broom to sweep the ground near the car, which is parked next to a clothesline.\n- A red bicycle is positioned nearby, connected to a pulley system, suggesting a setup for moving or cleaning the car.\n[270-300s] - Mr. Bean rides a red bicycle connected to a pulley system, pulling a yellow car forward.\n- The car is attached to a wooden frame with a pulley mechanism, and Mr. Bean is pedaling to move it.\n- A blue bucket and orange cone are positioned near the bicycle, indicating a setup for the pulley system.\n[300-330s] - Mr. Bean holds a slice of orange, smiling while standing near a red bicycle and a blue car.  \n- A yellow van is parked nearby, with a dog visible inside.  \n- A wooden contraption with hanging bags and a bathtub filled with soapy water is positioned beside the car.\n[330-360s] - Mr. Bean rides a red bicycle, pulling a blue car with a rope attached to a wooden pulley system.\n- A large, round woman stands nearby, holding a white bag and a blue purse, observing Mr. Bean.\n- The scene transitions to show the blue car covered in orange, sticky substance, with a man inside, while the woman is now seen with a bucket of the same substance.\n[360-390s] - Mr. Bean is seen operating a red and black lawn mower, positioned near a wooden structure on the right side of the scene.\n- The elderly woman is seated in a green armchair, holding a teacup, while the man in the brown suit is seated in a brown armchair, facing her.\n- The orange car is parked on the lawn, with its front end near the woman’s chair and the man in the brown suit standing beside it.", "history_tokens": 971, "history_utf8_bytes": 3854, "recent_frame_times_s": [389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0], "recent_frames_sha256": "6c0a0906392268eb86fd835643efb3b5cc7222e1c611ed65624f815f74493feb", "num_recent_frames": 30, "tq": 715525.189113058, "t1": 715527.217257422, "ta": 715527.217257422, "te": 715527.434934947, "first_response_s": 2.0281443640124053, "answer_total_s": 2.245821889024228, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 247, "content_group": "ba20d9d590f25d608593474b785b4a98f9b0daba94a55cb39be87df29c5e0c9b", "question": {"question_id": "sample_247_a637_q0", "video_id": 247, "video_path": "./videos/sample_247_real.mp4", "annotation_index": 637, "question_index": 0, "question": "Why is Mr. Bean looking for something now?", "options": ["A. Because he wanted to find something to clean the bird droppings that had fallen on the car.", "B. Because he lost his keys and needs to find them.", "C. Because he wants to find a tool to fix a flat tire.", "D. Because he is searching for his misplaced wallet."], "answer": "A", "time_stamp_s": 515, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [540, 570], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_247_a637_q0", "video_id": 247, "time_stamp_s": 515, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c3721f4f945bea836e536e910bb36ecbe46c0d810c80f84d8932d7caaec783da", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0], "recent_frames_sha256": "fc29953a0600b8edb3997b69daaf6d78a3d3d629917e210452e8c00041522429", "num_recent_frames": 30, "tq": 715594.052056926, "t1": 715604.480044372, "ta": 715604.480044372, "te": 715604.513070692, "first_response_s": 10.427987446077168, "answer_total_s": 10.461013766005635, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_247_a637_q0", "video_id": 247, "time_stamp_s": 515, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "64129fd172b6446e09548e7b11bb4bdb95c12b1fec7fe6aa3b8cd667055396e7", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Mr. Bean stands in front of a bathroom door, looking at a control panel with buttons.\n- He then enters a bathroom where he is seen pulling out a bathtub, which is positioned next to a toilet.\n- The bathtub is removed from its position, leaving behind tools and a shower curtain.\n[180-210s] - Mr. Bean stands beside a white bathtub in a room with green wallpaper and a staircase, looking surprised or confused.\n- A red rotary phone sits on a wooden table near the staircase, and a clock with a face is mounted on the wall.\n- Mr. Bean is later seen outdoors in a bathtub, with a woman standing nearby and a yellow car parked beside them.\n[210-240s] - Mr. Bean peeks from behind a door in a garden shed, surrounded by tools and a bicycle.  \n- He enters a house, smiling, then walks into a laundry room holding a blanket.  \n- He appears surprised while standing near a washing machine, then looks at a broken mirror.\n[240-270s] - Mr. Bean stands beside a muddy car, gesturing toward it while wearing yellow boots.\n- He uses a broom to sweep the ground near the car, which is parked next to a clothesline.\n- A red bicycle is positioned nearby, connected to a pulley system, suggesting a setup for moving or cleaning the car.\n[270-300s] - Mr. Bean rides a red bicycle connected to a pulley system, pulling a yellow car forward.\n- The car is attached to a wooden frame with a pulley mechanism, and Mr. Bean is pedaling to move it.\n- A blue bucket and orange cone are positioned near the bicycle, indicating a setup for the pulley system.\n[300-330s] - Mr. Bean holds a slice of orange, smiling while standing near a red bicycle and a blue car.  \n- A yellow van is parked nearby, with a dog visible inside.  \n- A wooden contraption with hanging bags and a bathtub filled with soapy water is positioned beside the car.\n[330-360s] - Mr. Bean rides a red bicycle, pulling a blue car with a rope attached to a wooden pulley system.\n- A large, round woman stands nearby, holding a white bag and a blue purse, observing Mr. Bean.\n- The scene transitions to show the blue car covered in orange, sticky substance, with a man inside, while the woman is now seen with a bucket of the same substance.\n[360-390s] - Mr. Bean is seen operating a red and black lawn mower, positioned near a wooden structure on the right side of the scene.\n- The elderly woman is seated in a green armchair, holding a teacup, while the man in the brown suit is seated in a brown armchair, facing her.\n- The orange car is parked on the lawn, with its front end near the woman’s chair and the man in the brown suit standing beside it.\n[390-420s] - Mrs. Bean is seated in a green armchair, holding a teacup, while Mr. Bean stands nearby, gesturing toward her.\n- A blue vintage car with mud splatters and a red roof is parked on the street, with clothes hanging above it.\n- Mr. Bean is seen pushing a lawnmower, moving furniture, and interacting with Mrs. Bean as they prepare to leave the house.\n[420-450s] - A police officer reads \"The Daily Mail\" with \"PENALTY\" and \"PREMIERE\" headlines while seated in a chair.\n- A woman in a purple dress sits in a green armchair, holding a teapot and a cup, with a small table between them.\n- A pigeon with a purple band around its neck appears, looking at the officer, then turns to face the camera.\n[450-480s] - Mr. Bean is driving a blue car, visibly startled as pigeons fly overhead and strike the vehicle, causing damage.\n- A pigeon with a pink beak and shield emblem is seen flying near the car, suggesting it's part of a delivery or official mission.\n- At a tea party, a man in a uniform hands a teapot to an elderly woman seated on a green couch, indicating a service or hospitality setting.\n[480-510s] - Mr. Bean stands in a kitchen, facing cabinets, with a towel draped over his shoulder.  \n- He opens a cabinet, revealing stacked plates and a teacup, then reaches into a drawer containing a whisk and a bowl.  \n- He is later seen in a cluttered room with a spiderweb, holding a bowl of grey substance, surrounded by cleaning supplies.", "history_tokens": 1015, "history_utf8_bytes": 4054, "recent_frame_times_s": [486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0], "recent_frames_sha256": "fc29953a0600b8edb3997b69daaf6d78a3d3d629917e210452e8c00041522429", "num_recent_frames": 30, "tq": 715557.403020085, "t1": 715558.737168978, "ta": 715558.737168978, "te": 715559.004500252, "first_response_s": 1.3341488930163905, "answer_total_s": 1.6014801670098677, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 248, "content_group": "d63841535d7d9e9371ad3ffdb4ec02687a0ec47884d4bd1dc473b94537783b66", "question": {"question_id": "sample_248_a1393_q0", "video_id": 248, "video_path": "./videos/sample_248_real.mp4", "annotation_index": 1393, "question_index": 0, "question": "Why does the older woman appear annoyed or angry?", "options": ["A. Because the character shouted loudly.", "B. Because the character disturbed her.", "C. Because the character knocked on the door.", "D. Because the character broke something."], "answer": "B", "time_stamp_s": 26, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_248_a1393_q0", "video_id": 248, "time_stamp_s": 26, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c84f3adb52e979707eeff84e7693d28774545b97546683c1b0195a64ad90fd79", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0], "recent_frames_sha256": "0e3d79c48142c59ee1e5752c6a8a00c1c9d1b7c7517fdcc81de7445c8f457d38", "num_recent_frames": 27, "tq": 719576.400760441, "t1": 719582.873890291, "ta": 719582.873890291, "te": 719582.913615423, "first_response_s": 6.473129849997349, "answer_total_s": 6.512854982051067, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_248_a1393_q0", "video_id": 248, "time_stamp_s": 26, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9d867e86bd6ef3b9737612305390e79ada1e411b87b38e954aa9ce5e6ece683f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0], "recent_frames_sha256": "0e3d79c48142c59ee1e5752c6a8a00c1c9d1b7c7517fdcc81de7445c8f457d38", "num_recent_frames": 27, "tq": 719396.186621478, "t1": 719403.807212873, "ta": 719403.807212873, "te": 719403.956558471, "first_response_s": 7.620591395068914, "answer_total_s": 7.769936993019655, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 248, "content_group": "d63841535d7d9e9371ad3ffdb4ec02687a0ec47884d4bd1dc473b94537783b66", "question": {"question_id": "sample_248_a1394_q0", "video_id": 248, "video_path": "./videos/sample_248_real.mp4", "annotation_index": 1394, "question_index": 0, "question": "Why does the taxi drive off?", "options": ["A. Because the passenger instructs the driver to leave.", "B. Because the person just got out of another vehicle.", "C. Because the person gets inside the taxi.", "D. Because the taxi has completed its repairs."], "answer": "C", "time_stamp_s": 151, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [135, 165], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_248_a1394_q0", "video_id": 248, "time_stamp_s": 151, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dbbe4cd6b6cc18530ebad8d8ced3c52f592d6e6d98ae0d383579e8853eaadfbe", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0], "recent_frames_sha256": "bcbac38d7c0596ee554d4360294f88749bfaf3e915998434abf600307bc9ddbe", "num_recent_frames": 30, "tq": 719582.93951939, "t1": 719590.722813605, "ta": 719590.722813605, "te": 719590.761159099, "first_response_s": 7.783294214983471, "answer_total_s": 7.821639709058218, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_248_a1394_q0", "video_id": 248, "time_stamp_s": 151, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "16d7d0fecfb63815b71e763b5275280fbe183272e877f9b0f8e746f0bc42f262", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean, in a suit, holds a teddy bear and a white cup, moving around a room with vertical patterned walls.  \n- A spotlight illuminates Mr. Bean as he walks, then shifts to reveal a large, round, purple character entering through a doorway.  \n- The video transitions to a black screen with white text crediting \"Taxi Bean\" and writers \"Claran Murtagh & Andrew Jones.\"\n[30-60s] - Mr. Bean stands in a living room, holding a yellow phone to his ear while looking at a green object on a black boat-like object on the floor.\n- A brown teddy bear sits on a beige armchair to the right, holding a green screen device.\n- Mr. Bean moves from the boat to the armchair, then back to the boat, appearing to interact with the teddy bear and the green object.\n[60-90s] - Mr. Bean stands beside a toy race track, holding a green bottle, with a teddy bear seated on a cushioned platform at the start line.\n- The teddy bear holds a green bottle, positioned as if ready to start a race, while Mr. Bean gestures toward it.\n- The race track is set up indoors, with books and a lamp visible in the background, and Mr. Bean appears to be preparing for a race.\n[90-120s] - Mr. Bean holds a green object while standing beside a boat filled with books and a teddy bear, appearing to inspect or interact with it.\n- He then enters a room with an elderly woman, carrying a suitcase, and approaches her while holding the teddy bear.\n- Outside, Mr. Bean is seen near a yellow car, inspecting its flat tire, with the teddy bear still in his hand.\n[120-150s] - Mr. Bean stands beside his green car, holding a suitcase, as a black taxi approaches and stops nearby.\n- The taxi driver, wearing a green cap, looks at Mr. Bean while the latter gestures toward the taxi.\n- Inside the taxi, a digital meter displays \"£1.90\" as the driver begins to drive away from the curb.", "history_tokens": 465, "history_utf8_bytes": 1847, "recent_frame_times_s": [122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0], "recent_frames_sha256": "bcbac38d7c0596ee554d4360294f88749bfaf3e915998434abf600307bc9ddbe", "num_recent_frames": 30, "tq": 719436.258479125, "t1": 719443.630645948, "ta": 719443.630645948, "te": 719443.821258813, "first_response_s": 7.372166823013686, "answer_total_s": 7.56277968804352, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 248, "content_group": "d63841535d7d9e9371ad3ffdb4ec02687a0ec47884d4bd1dc473b94537783b66", "question": {"question_id": "sample_248_a1395_q0", "video_id": 248, "video_path": "./videos/sample_248_real.mp4", "annotation_index": 1395, "question_index": 0, "question": "Why Mr. Bean can receive money now?", "options": ["A. Because he impersonated a taxi driver and took the lady to her destination.", "B. Because he found a wallet on the street and returned it for a reward.", "C. Because he won a small lottery prize earlier in the day.", "D. Because he sold some of his belongings at a yard sale."], "answer": "A", "time_stamp_s": 377, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [270, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_248_a1395_q0", "video_id": 248, "time_stamp_s": 377, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "570aa2d302dbca1a4a0ae7d284466c904328122c18fe4d7d3b279808379e2616", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0], "recent_frames_sha256": "b04616ba7227e7511c6073303e9b12c056ce4ed53a3866124531cfc7069bc292", "num_recent_frames": 30, "tq": 719590.77867296, "t1": 719604.407840375, "ta": 719604.407840375, "te": 719604.449116388, "first_response_s": 13.629167414968833, "answer_total_s": 13.670443427981809, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_248_a1395_q0", "video_id": 248, "time_stamp_s": 377, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7fa738a1dc1d8af0a825b45ba700997361cbe33a8e61dc16a89f3ae174cdc0d8", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Mr. Bean stands in a living room, holding a yellow phone to his ear while looking at a green object on a black boat-like object on the floor.\n- A brown teddy bear sits on a beige armchair to the right, holding a green screen device.\n- Mr. Bean moves from the boat to the armchair, then back to the boat, appearing to interact with the teddy bear and the green object.\n[60-90s] - Mr. Bean stands beside a toy race track, holding a green bottle, with a teddy bear seated on a cushioned platform at the start line.\n- The teddy bear holds a green bottle, positioned as if ready to start a race, while Mr. Bean gestures toward it.\n- The race track is set up indoors, with books and a lamp visible in the background, and Mr. Bean appears to be preparing for a race.\n[90-120s] - Mr. Bean holds a green object while standing beside a boat filled with books and a teddy bear, appearing to inspect or interact with it.\n- He then enters a room with an elderly woman, carrying a suitcase, and approaches her while holding the teddy bear.\n- Outside, Mr. Bean is seen near a yellow car, inspecting its flat tire, with the teddy bear still in his hand.\n[120-150s] - Mr. Bean stands beside his green car, holding a suitcase, as a black taxi approaches and stops nearby.\n- The taxi driver, wearing a green cap, looks at Mr. Bean while the latter gestures toward the taxi.\n- Inside the taxi, a digital meter displays \"£1.90\" as the driver begins to drive away from the curb.\n[150-180s] - A black taxi with a driver and passenger (Mr. Bean) passes storefronts including \"Flo's Fleur\" and \"Chips & Chips\" on a street.  \n- The taxi's meter displays a fare of £0.98, then £0.95, indicating a short ride or fare adjustment.  \n- Mr. Bean is seen in the back seat with a teddy bear, looking out the window as the taxi moves through urban and suburban landscapes.\n[180-210s] - Driver in yellow shirt and green cap smiles while steering a black taxi past a gas station.\n- Passenger (Mr. Bean) in the backseat looks out the window, then turns to the driver with a surprised expression.\n- A red café with \"DICKENS CAFÉ\" sign is visible on the right side of the road as the taxi passes.\n[210-240s] - Mr. Bean is in a black taxi, looking annoyed as he observes the surroundings.  \n- The taxi driver, wearing a green cap, is seen at a gas station, pumping fuel into the vehicle.  \n- The taxi passes by a café named \"Duke's Café\" with a red sign, and the driver exits the vehicle near it.\n[240-270s] - Mr. Bean, in a black taxi, looks anxious while holding money, then smiles as he pays at O'Keeffe's Cafe.\n- The cafe's digital display shows £6.05, indicating the cost of the transaction.\n- Mr. Bean's expression shifts from concern to satisfaction after completing the payment.\n[270-300s] - A brown teddy bear is being held by a hand inside a car, positioned near the back seat.  \n- Mr. Bean, in a suit, is seen driving a black taxi, with a brief pause to look at the meter.  \n- The taxi meter displays a fare of £0.50 after a change, indicating a short ride or fare adjustment.\n[300-330s] - Mr. Bean drives a black taxi, looking focused and occasionally glancing at the rearview mirror.  \n- A man in a suit appears in the rearview mirror, smiling and nodding as if acknowledging Mr. Bean.  \n- The taxi passes a café with a sign reading \"O'KEEFFE'S Café\" and a \"OPEN\" sign visible on the window.\n[330-360s] - Mr. Bean drives a black taxi, holding a green £5 note while looking at the passenger.\n- The passenger, an older man, smokes a cigarette and looks out the window.\n- The taxi passes a library building with a red postbox on the sidewalk.", "history_tokens": 953, "history_utf8_bytes": 3634, "recent_frame_times_s": [348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0], "recent_frames_sha256": "b04616ba7227e7511c6073303e9b12c056ce4ed53a3866124531cfc7069bc292", "num_recent_frames": 30, "tq": 719504.835345232, "t1": 719511.508337768, "ta": 719511.508337768, "te": 719511.659584174, "first_response_s": 6.672992535983212, "answer_total_s": 6.82423894200474, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 248, "content_group": "d63841535d7d9e9371ad3ffdb4ec02687a0ec47884d4bd1dc473b94537783b66", "question": {"question_id": "sample_248_a1396_q0", "video_id": 248, "video_path": "./videos/sample_248_real.mp4", "annotation_index": 1396, "question_index": 0, "question": "Why Mr. Bean can receive money now?", "options": ["A. Because he impersonated a taxi driver and took the man to his destination.", "B. Because he found a wallet on the street and returned it for a reward.", "C. Because he won a small lottery prize earlier in the day.", "D. Because he sold some of his belongings at a yard sale."], "answer": "A", "time_stamp_s": 541, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [405, 435], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_248_a1396_q0", "video_id": 248, "time_stamp_s": 541, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "48078708b4d1336ce62918c55b65c8b227df8ef580598a61ad3a6f1f760701c2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0], "recent_frames_sha256": "17f0516279df62a084e72bc58bd150c299d81112615e3c11dd6e9c20b7c8170d", "num_recent_frames": 30, "tq": 719604.467537737, "t1": 719614.802910633, "ta": 719614.802910633, "te": 719614.843034675, "first_response_s": 10.335372896050103, "answer_total_s": 10.375496938009746, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_248_a1396_q0", "video_id": 248, "time_stamp_s": 541, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "445efd559f5419c060566e34b931746a92593c52e18bbcdcb631006556f8fdbd", "condition_order": ["notes", "recent"], "memory": "[180-210s] - Driver in yellow shirt and green cap smiles while steering a black taxi past a gas station.\n- Passenger (Mr. Bean) in the backseat looks out the window, then turns to the driver with a surprised expression.\n- A red café with \"DICKENS CAFÉ\" sign is visible on the right side of the road as the taxi passes.\n[210-240s] - Mr. Bean is in a black taxi, looking annoyed as he observes the surroundings.  \n- The taxi driver, wearing a green cap, is seen at a gas station, pumping fuel into the vehicle.  \n- The taxi passes by a café named \"Duke's Café\" with a red sign, and the driver exits the vehicle near it.\n[240-270s] - Mr. Bean, in a black taxi, looks anxious while holding money, then smiles as he pays at O'Keeffe's Cafe.\n- The cafe's digital display shows £6.05, indicating the cost of the transaction.\n- Mr. Bean's expression shifts from concern to satisfaction after completing the payment.\n[270-300s] - A brown teddy bear is being held by a hand inside a car, positioned near the back seat.  \n- Mr. Bean, in a suit, is seen driving a black taxi, with a brief pause to look at the meter.  \n- The taxi meter displays a fare of £0.50 after a change, indicating a short ride or fare adjustment.\n[300-330s] - Mr. Bean drives a black taxi, looking focused and occasionally glancing at the rearview mirror.  \n- A man in a suit appears in the rearview mirror, smiling and nodding as if acknowledging Mr. Bean.  \n- The taxi passes a café with a sign reading \"O'KEEFFE'S Café\" and a \"OPEN\" sign visible on the window.\n[330-360s] - Mr. Bean drives a black taxi, holding a green £5 note while looking at the passenger.\n- The passenger, an older man, smokes a cigarette and looks out the window.\n- The taxi passes a library building with a red postbox on the sidewalk.\n[360-390s] - Mr. Bean drives a black taxi past a bank, then stops at a café, with a digital display showing £16.30.\n- He eats a snack while driving, looking at the road ahead with a focused expression.\n- A hand offers a £10 bill to a teddy bear, which is inside the taxi, suggesting a transaction or interaction.\n[390-420s] - Mr. Bean smiles while driving a black taxi past O'Keeffe's Cafe, with a digital display showing £--8.58.\n- A blonde woman in a red apron serves a man at the cafe window, while another customer sits nearby.\n- A man in an orange jacket and white cowboy hat stands beside the taxi, holding a camera and smiling.\n[420-450s] - Man in red jacket and white hat is inside a black taxi, smiling and giving thumbs-up to camera.  \n- The taxi drives through a city street with a roundabout, passing a fountain and a tall clock tower.  \n- A camera view shows the man in the hat posing with a white airplane propeller above his head, then jumping with smoke effects behind him.\n[450-480s] - A cartoon character in a red outfit and white hat stands beside a blue guardhouse, facing a British guard in uniform.  \n- The character gestures with his right hand toward the guard, who remains stationary.  \n- A man in a brown suit approaches from the right, holding a camera, then sits down on the ground, looking at the scene.\n[480-510s] - A man in a black suit and hat stands beside a black taxi, gesturing toward a man in an orange shirt and white hat who is holding a camera.  \n- The man in the orange shirt is positioned near the taxi’s front, appearing to take a photo.  \n- A large, ornate building with columns and a gate is visible in the background, suggesting a formal or royal setting.\n[510-540s] - A man in a suit stands beside a black taxi at an airport terminal, holding a green banknote.  \n- A large man in a red jacket and white hat, carrying a camera and suitcase, approaches the taxi and hands the banknote to the suited man.  \n- The taxi's digital display shows a fare of £256.45, indicating the cost of the ride.", "history_tokens": 995, "history_utf8_bytes": 3827, "recent_frame_times_s": [512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0], "recent_frames_sha256": "17f0516279df62a084e72bc58bd150c299d81112615e3c11dd6e9c20b7c8170d", "num_recent_frames": 30, "tq": 719560.619487081, "t1": 719562.50592482, "ta": 719562.50592482, "te": 719562.879214567, "first_response_s": 1.886437739012763, "answer_total_s": 2.259727486060001, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 248, "content_group": "d63841535d7d9e9371ad3ffdb4ec02687a0ec47884d4bd1dc473b94537783b66", "question": {"question_id": "sample_248_a1397_q0", "video_id": 248, "video_path": "./videos/sample_248_real.mp4", "annotation_index": 1397, "question_index": 0, "question": "Why Mr. Bean now only pays 0.85 pounds?", "options": ["A. Because Mr. Bean cleared his mileage before.", "B. Because he used a discount coupon for the purchase.", "C. Because he convinced the cashier to give him a special deal.", "D. Because he found some extra change in his pocket to cover the cost."], "answer": "A", "time_stamp_s": 559, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [540, 570], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_248_a1397_q0", "video_id": 248, "time_stamp_s": 559, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b546f353fbf5147fe0b6eb2bef85008ba6d757d13cc28d6c06682d2d603ac3af", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0], "recent_frames_sha256": "c1a2bd8367f6d567dc5ea16e5bd9819afefdea0062ecce5add3d7262207c4a43", "num_recent_frames": 30, "tq": 719614.857650011, "t1": 719627.508900658, "ta": 719627.508900658, "te": 719627.546160285, "first_response_s": 12.651250647031702, "answer_total_s": 12.688510274048895, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_248_a1397_q0", "video_id": 248, "time_stamp_s": 559, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1a2e6a26675aa4a026796ab65dfd69d2aaacffb4d36437b1949bd9c465d689a2", "condition_order": ["notes", "recent"], "memory": "[180-210s] - Driver in yellow shirt and green cap smiles while steering a black taxi past a gas station.\n- Passenger (Mr. Bean) in the backseat looks out the window, then turns to the driver with a surprised expression.\n- A red café with \"DICKENS CAFÉ\" sign is visible on the right side of the road as the taxi passes.\n[210-240s] - Mr. Bean is in a black taxi, looking annoyed as he observes the surroundings.  \n- The taxi driver, wearing a green cap, is seen at a gas station, pumping fuel into the vehicle.  \n- The taxi passes by a café named \"Duke's Café\" with a red sign, and the driver exits the vehicle near it.\n[240-270s] - Mr. Bean, in a black taxi, looks anxious while holding money, then smiles as he pays at O'Keeffe's Cafe.\n- The cafe's digital display shows £6.05, indicating the cost of the transaction.\n- Mr. Bean's expression shifts from concern to satisfaction after completing the payment.\n[270-300s] - A brown teddy bear is being held by a hand inside a car, positioned near the back seat.  \n- Mr. Bean, in a suit, is seen driving a black taxi, with a brief pause to look at the meter.  \n- The taxi meter displays a fare of £0.50 after a change, indicating a short ride or fare adjustment.\n[300-330s] - Mr. Bean drives a black taxi, looking focused and occasionally glancing at the rearview mirror.  \n- A man in a suit appears in the rearview mirror, smiling and nodding as if acknowledging Mr. Bean.  \n- The taxi passes a café with a sign reading \"O'KEEFFE'S Café\" and a \"OPEN\" sign visible on the window.\n[330-360s] - Mr. Bean drives a black taxi, holding a green £5 note while looking at the passenger.\n- The passenger, an older man, smokes a cigarette and looks out the window.\n- The taxi passes a library building with a red postbox on the sidewalk.\n[360-390s] - Mr. Bean drives a black taxi past a bank, then stops at a café, with a digital display showing £16.30.\n- He eats a snack while driving, looking at the road ahead with a focused expression.\n- A hand offers a £10 bill to a teddy bear, which is inside the taxi, suggesting a transaction or interaction.\n[390-420s] - Mr. Bean smiles while driving a black taxi past O'Keeffe's Cafe, with a digital display showing £--8.58.\n- A blonde woman in a red apron serves a man at the cafe window, while another customer sits nearby.\n- A man in an orange jacket and white cowboy hat stands beside the taxi, holding a camera and smiling.\n[420-450s] - Man in red jacket and white hat is inside a black taxi, smiling and giving thumbs-up to camera.  \n- The taxi drives through a city street with a roundabout, passing a fountain and a tall clock tower.  \n- A camera view shows the man in the hat posing with a white airplane propeller above his head, then jumping with smoke effects behind him.\n[450-480s] - A cartoon character in a red outfit and white hat stands beside a blue guardhouse, facing a British guard in uniform.  \n- The character gestures with his right hand toward the guard, who remains stationary.  \n- A man in a brown suit approaches from the right, holding a camera, then sits down on the ground, looking at the scene.\n[480-510s] - A man in a black suit and hat stands beside a black taxi, gesturing toward a man in an orange shirt and white hat who is holding a camera.  \n- The man in the orange shirt is positioned near the taxi’s front, appearing to take a photo.  \n- A large, ornate building with columns and a gate is visible in the background, suggesting a formal or royal setting.\n[510-540s] - A man in a suit stands beside a black taxi at an airport terminal, holding a green banknote.  \n- A large man in a red jacket and white hat, carrying a camera and suitcase, approaches the taxi and hands the banknote to the suited man.  \n- The taxi's digital display shows a fare of £256.45, indicating the cost of the ride.", "history_tokens": 995, "history_utf8_bytes": 3827, "recent_frame_times_s": [530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0], "recent_frames_sha256": "c1a2bd8367f6d567dc5ea16e5bd9819afefdea0062ecce5add3d7262207c4a43", "num_recent_frames": 30, "tq": 719562.94678729, "t1": 719576.105948635, "ta": 719576.105948635, "te": 719576.381635485, "first_response_s": 13.159161344985478, "answer_total_s": 13.434848194941878, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 249, "content_group": "2374564b3748f9dc0756ab94f16334422021413b834d23817c8847d228241c16", "question": {"question_id": "sample_249_a978_q0", "video_id": 249, "video_path": "./videos/sample_249_real.mp4", "annotation_index": 978, "question_index": 0, "question": "Why does the older woman appear annoyed or angry?", "options": ["A. Because the character shouted loudly.", "B. Because the character disturbed her.", "C. Because the character knocked on the door.", "D. Because the character broke something."], "answer": "B", "time_stamp_s": 26, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_249_a978_q0", "video_id": 249, "time_stamp_s": 26, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7c8ed056471bee439e04f03615484aab48a1eb400643016c3a46416a885a91e0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0], "recent_frames_sha256": "48abac12bb2512aadbb9950f04bff8db5b85e75e3042c4aad1eff33c264754f7", "num_recent_frames": 27, "tq": 719261.582534868, "t1": 719262.167258453, "ta": 719262.167258453, "te": 719262.204726809, "first_response_s": 0.5847235849360004, "answer_total_s": 0.6221919410163537, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_249_a978_q0", "video_id": 249, "time_stamp_s": 26, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c90b9da6b87186f6a00097cd7968cb4a1e499fa20b7542f3ed76333b631a6a44", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0], "recent_frames_sha256": "48abac12bb2512aadbb9950f04bff8db5b85e75e3042c4aad1eff33c264754f7", "num_recent_frames": 27, "tq": 719310.914306631, "t1": 719317.803401794, "ta": 719317.803401794, "te": 719318.019391793, "first_response_s": 6.889095163089223, "answer_total_s": 7.1050851619802415, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 249, "content_group": "2374564b3748f9dc0756ab94f16334422021413b834d23817c8847d228241c16", "question": {"question_id": "sample_249_a979_q0", "video_id": 249, "video_path": "./videos/sample_249_real.mp4", "annotation_index": 979, "question_index": 0, "question": "Why is Mr. Bean under the bed now?", "options": ["A. Because he wanted to snatch back the teddy bear doll that was taken by the cat.", "B. Because he dropped something valuable and is trying to retrieve it.", "C. Because he is hiding from someone who just entered the room.", "D. Because he thought he saw something strange under the bed."], "answer": "A", "time_stamp_s": 145, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [135, 165], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_249_a979_q0", "video_id": 249, "time_stamp_s": 145, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d11d02a937cf3cc9422255906ebe1718d709127297ffbd30dc7c50155548f78d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0], "recent_frames_sha256": "0a3536d44886472ef0a9819d6ad03ff5707cd5a3812ba67a30cd7a0a78166ddb", "num_recent_frames": 30, "tq": 719262.219183635, "t1": 719273.287757651, "ta": 719273.287757651, "te": 719273.324551093, "first_response_s": 11.068574015982449, "answer_total_s": 11.105367458076216, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_249_a979_q0", "video_id": 249, "time_stamp_s": 145, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2877d28e75bfd8e732f8e7c0ceb4b274f4e085473f77d27c71e7706bcdc5886d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Mr. Bean, holding a teddy bear, is illuminated by a spotlight against a striped background, with text \"mr Bean with Rowan Atkinson\" appearing beside him.  \n- Mr. Bean drops the teddy bear, which rolls away, and then gestures toward an open doorway where a large, purple, furry figure appears.  \n- The scene transitions to a black screen with white text reading \"Where Did You Get That Cat? written by Jimmy Hibbert.\"\n[30-60s] - Mr. Bean approaches a large, angry-looking man holding a white document, who is standing near a green car with license plate \"STE 952R\".  \n- Inside a room, the man with the document is seen holding a large, ornate clock that hangs from the ceiling, while Mr. Bean stands nearby, looking up at it.  \n- The man with the document is also seen holding a small potted plant on a table, and later, he is shown holding the clock while Mr. Bean looks at him with a surprised expression.\n[60-90s] - Mrs. Bean holds a white folder and walks toward a wardrobe, then opens it to reveal a cheese slice inside.  \n- She places the cheese slice on top of the wardrobe and then picks up a small round mirror to examine her reflection.  \n- The mirror shows her wearing a cheese slice hat, which she appears to be adjusting or inspecting.\n[90-120s] - Elderly woman in blue coat holds a yellow cheese wedge, then places it on a wooden cabinet.\n- Man in suit enters room, sees cat sleeping on bed, and reacts with surprise.\n- Cat wakes up, looks annoyed, and moves toward the man.", "history_tokens": 364, "history_utf8_bytes": 1497, "recent_frame_times_s": [116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0], "recent_frames_sha256": "0a3536d44886472ef0a9819d6ad03ff5707cd5a3812ba67a30cd7a0a78166ddb", "num_recent_frames": 30, "tq": 719350.381152689, "t1": 719356.271466132, "ta": 719356.271466132, "te": 719356.465741907, "first_response_s": 5.890313443029299, "answer_total_s": 6.084589218022302, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 249, "content_group": "2374564b3748f9dc0756ab94f16334422021413b834d23817c8847d228241c16", "question": {"question_id": "sample_249_a980_q0", "video_id": 249, "video_path": "./videos/sample_249_real.mp4", "annotation_index": 980, "question_index": 0, "question": "Why did the character exit the building and approach a green car?", "options": ["A. Because he forgot something important in the car.", "B. Because he needs to pick up a friend from the nearby station.", "C. Because he wants to drive to the pet hospital to treat his teddy bear doll.", "D. Because he plans to run an errand across town."], "answer": "C", "time_stamp_s": 362, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [270, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_249_a980_q0", "video_id": 249, "time_stamp_s": 362, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "91b148b3d1a0e7e6f7b6c3d62d780233ae475132e5a408fb0f91f38064f80bca", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0], "recent_frames_sha256": "1b993d9882a6adedfb548321d6a73e4616c7615860699ac329fc5cf632a993b4", "num_recent_frames": 30, "tq": 719273.335569958, "t1": 719286.872529103, "ta": 719286.872529103, "te": 719286.909346028, "first_response_s": 13.536959144985303, "answer_total_s": 13.573776070028543, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_249_a980_q0", "video_id": 249, "time_stamp_s": 362, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fba75b951a329a205e9baa44c16fcc16e471db1cc490a59afe86078d4283e70d", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Mr. Bean approaches a large, angry-looking man holding a white document, who is standing near a green car with license plate \"STE 952R\".  \n- Inside a room, the man with the document is seen holding a large, ornate clock that hangs from the ceiling, while Mr. Bean stands nearby, looking up at it.  \n- The man with the document is also seen holding a small potted plant on a table, and later, he is shown holding the clock while Mr. Bean looks at him with a surprised expression.\n[60-90s] - Mrs. Bean holds a white folder and walks toward a wardrobe, then opens it to reveal a cheese slice inside.  \n- She places the cheese slice on top of the wardrobe and then picks up a small round mirror to examine her reflection.  \n- The mirror shows her wearing a cheese slice hat, which she appears to be adjusting or inspecting.\n[90-120s] - Elderly woman in blue coat holds a yellow cheese wedge, then places it on a wooden cabinet.\n- Man in suit enters room, sees cat sleeping on bed, and reacts with surprise.\n- Cat wakes up, looks annoyed, and moves toward the man.\n[120-150s] - A man in a suit is seen bending over a table with a potted plant, then standing upright while holding a remote control.  \n- The man is later shown in a different room, standing near a door, with a clock on the wall and a potted plant on a table.  \n- A dog is sitting on a chair in a bedroom, while a man lies on the floor near a bed, with a lamp and a nightstand visible.\n[150-180s] - A yellow cat is seen peeking out of a window, then jumping to another window where a man with a mustache is visible.\n- The man in the suit is shown walking through a hallway, pointing at a wall clock and then looking up at a hanging clock.\n- The man in the suit is seen walking up a staircase, with a red telephone on a table to his left and a potted plant to his right.\n[180-210s] - Mr. Bean, in a suit, stands near a staircase, gesturing toward a wall-mounted clock and a potted plant.\n- He walks toward a door, then turns back, holding a key, and approaches the clock.\n- A cat with brown and black patches sits in a green armchair, looking up at Mr. Bean as he approaches.\n[210-240s] - Mr. Bean, in a suit, extends his hand toward a cat perched on a chair, which then bites his arm.\n- The cat, after biting, leaps off the chair and lands on the floor, then rolls under a wooden cabinet.\n- Mr. Bean, holding a small teddy bear, looks at the cat and the cabinet, appearing puzzled or concerned.\n[240-270s] - Mr. Bean holds a small brown teddy bear while standing beside a large brown box with a yellow flower-like object at its base.\n- He walks away from the box, then turns to face the camera with a surprised expression, gesturing with his hands.\n- The scene shifts to a kitchen area where Mr. Bean is seen peeking into a storage compartment filled with cleaning supplies.\n[270-300s] - Mr. Bean kneels in a kitchen, holding a brown box while wearing green slippers and a suit.\n- He lifts the box, revealing a long wooden desk that he places on the floor.\n- He then stands beside the desk, holding the box, with a surprised expression.\n[300-330s] - Mr. Bean runs toward a lime-green Mini Cooper, carrying a brown box, and then drops it beside the car.  \n- The car's license plate reads \"STE 992R\" and is parked on a street with buildings in the background.  \n- A yellow cat with black markings is seen lying on the ground near the car, appearing dazed or unconscious.\n[330-360s] - Mr. Bean approaches the reception desk, holding a brown box, and gestures toward the receptionist while speaking.\n- The receptionist, wearing a white coat, stands behind the desk, looking at Mr. Bean with a neutral expression.\n- In the background, a waiting area shows a man with a dog, a child, and a woman holding a baby, all seated on a bench.", "history_tokens": 961, "history_utf8_bytes": 3798, "recent_frame_times_s": [333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0], "recent_frames_sha256": "1b993d9882a6adedfb548321d6a73e4616c7615860699ac329fc5cf632a993b4", "num_recent_frames": 30, "tq": 719415.273941909, "t1": 719417.002035664, "ta": 719417.002035664, "te": 719417.201737663, "first_response_s": 1.7280937550822273, "answer_total_s": 1.9277957540471107, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 249, "content_group": "2374564b3748f9dc0756ab94f16334422021413b834d23817c8847d228241c16", "question": {"question_id": "sample_249_a981_q0", "video_id": 249, "video_path": "./videos/sample_249_real.mp4", "annotation_index": 981, "question_index": 0, "question": "Why Mr. Bean would be very panicked now.", "options": ["A. Because he realized he lost his wallet.", "B. Because he accidentally locked himself out of his house.", "C. Because he found that his teddy bear doll was not in the box.", "D. Because he noticed that his car keys were missing."], "answer": "C", "time_stamp_s": 518, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [405, 435], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_249_a981_q0", "video_id": 249, "time_stamp_s": 518, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1d930c85410c3af0493020d16aad3c4fc89a58f761c5810849997e805edcdc10", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0], "recent_frames_sha256": "69d2ac67965cf8382426c5be5cfdf89e3c5bc9c8cd7b7648638e7bbfd51bb243", "num_recent_frames": 30, "tq": 719286.923176227, "t1": 719300.345462335, "ta": 719300.345462335, "te": 719300.388153907, "first_response_s": 13.422286108019762, "answer_total_s": 13.464977680006996, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_249_a981_q0", "video_id": 249, "time_stamp_s": 518, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2d5148b739e7ec399a43933ce9f0560017b6b5174e56441bb301c51cc5fdf8ab", "condition_order": ["recent", "notes"], "memory": "[150-180s] - A yellow cat is seen peeking out of a window, then jumping to another window where a man with a mustache is visible.\n- The man in the suit is shown walking through a hallway, pointing at a wall clock and then looking up at a hanging clock.\n- The man in the suit is seen walking up a staircase, with a red telephone on a table to his left and a potted plant to his right.\n[180-210s] - Mr. Bean, in a suit, stands near a staircase, gesturing toward a wall-mounted clock and a potted plant.\n- He walks toward a door, then turns back, holding a key, and approaches the clock.\n- A cat with brown and black patches sits in a green armchair, looking up at Mr. Bean as he approaches.\n[210-240s] - Mr. Bean, in a suit, extends his hand toward a cat perched on a chair, which then bites his arm.\n- The cat, after biting, leaps off the chair and lands on the floor, then rolls under a wooden cabinet.\n- Mr. Bean, holding a small teddy bear, looks at the cat and the cabinet, appearing puzzled or concerned.\n[240-270s] - Mr. Bean holds a small brown teddy bear while standing beside a large brown box with a yellow flower-like object at its base.\n- He walks away from the box, then turns to face the camera with a surprised expression, gesturing with his hands.\n- The scene shifts to a kitchen area where Mr. Bean is seen peeking into a storage compartment filled with cleaning supplies.\n[270-300s] - Mr. Bean kneels in a kitchen, holding a brown box while wearing green slippers and a suit.\n- He lifts the box, revealing a long wooden desk that he places on the floor.\n- He then stands beside the desk, holding the box, with a surprised expression.\n[300-330s] - Mr. Bean runs toward a lime-green Mini Cooper, carrying a brown box, and then drops it beside the car.  \n- The car's license plate reads \"STE 992R\" and is parked on a street with buildings in the background.  \n- A yellow cat with black markings is seen lying on the ground near the car, appearing dazed or unconscious.\n[330-360s] - Mr. Bean approaches the reception desk, holding a brown box, and gestures toward the receptionist while speaking.\n- The receptionist, wearing a white coat, stands behind the desk, looking at Mr. Bean with a neutral expression.\n- In the background, a waiting area shows a man with a dog, a child, and a woman holding a baby, all seated on a bench.\n[360-390s] - Mr. Bean, in a brown suit, stands between a boy with a green backpack and a woman holding a white cat in a basket, gesturing with his hands while looking at them.  \n- The woman, wearing a blue dress, smiles slightly while holding the cat, which wears glasses and sits calmly in the basket.  \n- The boy, in a green shirt, stands to Mr. Bean’s left, looking at him with a neutral expression, holding a light blue backpack.\n[390-420s] - Mr. Bean stands beside a woman holding a basket with a white cat, both looking toward the left.  \n- A young boy with a green backpack stands to Mr. Bean’s left, holding a blue suitcase.  \n- The scene transitions to show a waiting room with multiple characters seated, including a man with a dog, a woman with a cat, and Mr. Bean.\n[420-450s] - Mr. Bean, holding a briefcase, looks annoyed while seated on a couch, with a basket of food beside him.  \n- A small boy in a green shirt stands nearby, holding a blue suitcase, appearing concerned.  \n- A large white cat with green eyes is seen sitting in a basket held by an unseen person, later appearing on the floor near the couch.\n[450-480s] - Mr. Bean sits on a long bench, holding a brown box, with a basket of food nearby.  \n- A woman with dark hair stands behind a reception desk, facing Mr. Bean.  \n- Mr. Bean turns and walks toward a door, leaving the bench and box behind.\n[480-510s] - Mr. Bean places a brown box on the table and opens it, revealing an empty interior.\n- The doctor, standing beside the table, watches Mr. Bean's actions with a neutral expression.\n- A small cartoon dog's face is visible on the wall behind them, looking down at the box.", "history_tokens": 1018, "history_utf8_bytes": 4002, "recent_frame_times_s": [489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0], "recent_frames_sha256": "69d2ac67965cf8382426c5be5cfdf89e3c5bc9c8cd7b7648638e7bbfd51bb243", "num_recent_frames": 30, "tq": 719454.9651892, "t1": 719455.918028346, "ta": 719455.918028346, "te": 719456.102941373, "first_response_s": 0.9528391460189596, "answer_total_s": 1.1377521730028093, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 249, "content_group": "2374564b3748f9dc0756ab94f16334422021413b834d23817c8847d228241c16", "question": {"question_id": "sample_249_a982_q0", "video_id": 249, "video_path": "./videos/sample_249_real.mp4", "annotation_index": 982, "question_index": 0, "question": "Why did the character react with noticeable concern after stopping the car?", "options": ["A. Because they remember they left something important behind.", "B. Because they have car trouble and need to check the engine.", "C. Because he thought the one that was flattened was the old lady's cat.", "D. Because they see a strange figure in the distance."], "answer": "C", "time_stamp_s": 617, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [540, 570], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_249_a982_q0", "video_id": 249, "time_stamp_s": 617, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "459be95bc9a27e85ad7647b4614de7d491536422a1eb4288150b925f8d1298db", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [588.0, 589.0, 590.0, 591.0, 592.0, 593.0, 594.0, 595.0, 596.0, 597.0, 598.0, 599.0, 600.0, 601.0, 602.0, 603.0, 604.0, 605.0, 606.0, 607.0, 608.0, 609.0, 610.0, 611.0, 612.0, 613.0, 614.0, 615.0, 616.0, 617.0], "recent_frames_sha256": "f99ff84792e2f5739e61a8680b514deab29d81f5b2c2c4993e9a9be51de521fe", "num_recent_frames": 30, "tq": 719300.399630247, "t1": 719310.866501309, "ta": 719310.866501309, "te": 719310.904161648, "first_response_s": 10.466871061944403, "answer_total_s": 10.504531400976703, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_249_a982_q0", "video_id": 249, "time_stamp_s": 617, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8489f7b8b53a5d0594823e9bc739998e088a7447cc337e628c8663bd970722da", "condition_order": ["recent", "notes"], "memory": "[240-270s] - Mr. Bean holds a small brown teddy bear while standing beside a large brown box with a yellow flower-like object at its base.\n- He walks away from the box, then turns to face the camera with a surprised expression, gesturing with his hands.\n- The scene shifts to a kitchen area where Mr. Bean is seen peeking into a storage compartment filled with cleaning supplies.\n[270-300s] - Mr. Bean kneels in a kitchen, holding a brown box while wearing green slippers and a suit.\n- He lifts the box, revealing a long wooden desk that he places on the floor.\n- He then stands beside the desk, holding the box, with a surprised expression.\n[300-330s] - Mr. Bean runs toward a lime-green Mini Cooper, carrying a brown box, and then drops it beside the car.  \n- The car's license plate reads \"STE 992R\" and is parked on a street with buildings in the background.  \n- A yellow cat with black markings is seen lying on the ground near the car, appearing dazed or unconscious.\n[330-360s] - Mr. Bean approaches the reception desk, holding a brown box, and gestures toward the receptionist while speaking.\n- The receptionist, wearing a white coat, stands behind the desk, looking at Mr. Bean with a neutral expression.\n- In the background, a waiting area shows a man with a dog, a child, and a woman holding a baby, all seated on a bench.\n[360-390s] - Mr. Bean, in a brown suit, stands between a boy with a green backpack and a woman holding a white cat in a basket, gesturing with his hands while looking at them.  \n- The woman, wearing a blue dress, smiles slightly while holding the cat, which wears glasses and sits calmly in the basket.  \n- The boy, in a green shirt, stands to Mr. Bean’s left, looking at him with a neutral expression, holding a light blue backpack.\n[390-420s] - Mr. Bean stands beside a woman holding a basket with a white cat, both looking toward the left.  \n- A young boy with a green backpack stands to Mr. Bean’s left, holding a blue suitcase.  \n- The scene transitions to show a waiting room with multiple characters seated, including a man with a dog, a woman with a cat, and Mr. Bean.\n[420-450s] - Mr. Bean, holding a briefcase, looks annoyed while seated on a couch, with a basket of food beside him.  \n- A small boy in a green shirt stands nearby, holding a blue suitcase, appearing concerned.  \n- A large white cat with green eyes is seen sitting in a basket held by an unseen person, later appearing on the floor near the couch.\n[450-480s] - Mr. Bean sits on a long bench, holding a brown box, with a basket of food nearby.  \n- A woman with dark hair stands behind a reception desk, facing Mr. Bean.  \n- Mr. Bean turns and walks toward a door, leaving the bench and box behind.\n[480-510s] - Mr. Bean places a brown box on the table and opens it, revealing an empty interior.\n- The doctor, standing beside the table, watches Mr. Bean's actions with a neutral expression.\n- A small cartoon dog's face is visible on the wall behind them, looking down at the box.\n[510-540s] - Mr. Bean, in a suit, holds a brown briefcase and gestures toward a doctor in a white coat at a desk.  \n- The doctor, with gray hair, looks unimpressed as Mr. Bean drops the briefcase on the table.  \n- Mr. Bean then exits the scene, leaving the briefcase on the table, and later appears in a green car, looking surprised.\n[540-570s] - Mr. Bean exits a lime-green Mini car, holding a yellow, textured object resembling a large leaf or fabric.\n- He inspects the object closely, then unfolds it to reveal a patterned surface with a circular mark, possibly a tire tread or design.\n- He appears puzzled or amused while examining the object, with his facial expression shifting from curiosity to slight confusion.\n[570-600s] - Mr. Bean enters a house carrying a yellow bird, looking nervous as he approaches the door.\n- The elderly woman with glasses and a purple dress appears at the doorway, observing him with a stern expression.\n- Mr. Bean smiles nervously while holding the bird, then turns to face the woman, who is now partially visible behind the door frame.", "history_tokens": 1010, "history_utf8_bytes": 4066, "recent_frame_times_s": [588.0, 589.0, 590.0, 591.0, 592.0, 593.0, 594.0, 595.0, 596.0, 597.0, 598.0, 599.0, 600.0, 601.0, 602.0, 603.0, 604.0, 605.0, 606.0, 607.0, 608.0, 609.0, 610.0, 611.0, 612.0, 613.0, 614.0, 615.0, 616.0, 617.0], "recent_frames_sha256": "f99ff84792e2f5739e61a8680b514deab29d81f5b2c2c4993e9a9be51de521fe", "num_recent_frames": 30, "tq": 719478.405790661, "t1": 719486.032992815, "ta": 719486.032992815, "te": 719486.3979139, "first_response_s": 7.627202154020779, "answer_total_s": 7.992123238975182, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 250, "content_group": "ae7eef70afb98cfb52f47d0d1151d91b597c7ca778d093029db88b6c0a849b18", "question": {"question_id": "sample_250_a2233_q0", "video_id": 250, "video_path": "./videos/sample_250_real.mp4", "annotation_index": 2233, "question_index": 0, "question": "Why does the older woman appear annoyed or angry?", "options": ["A. Because the character shouted loudly.", "B. Because the character disturbed her.", "C. Because the character knocked on the door.", "D. Because the character broke something."], "answer": "B", "time_stamp_s": 26, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [0, 30], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_250_a2233_q0", "video_id": 250, "time_stamp_s": 26, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1eaf1a0e8ad6f06477c2d90220ce32e1f5d4b14d1c5c5c22658bb9d32f8651d8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0], "recent_frames_sha256": "0795d9359efb90a8e6e7518f93ffd8b77059b658c67ba9ac551da228b7cb5be4", "num_recent_frames": 27, "tq": 718767.195986196, "t1": 718768.205037737, "ta": 718768.205037737, "te": 718768.244618101, "first_response_s": 1.0090515409829095, "answer_total_s": 1.0486319049960002, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_250_a2233_q0", "video_id": 250, "time_stamp_s": 26, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4816e688a5b44e4de8232492f1d383211602df1f1dd167c393514677e0475f88", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0], "recent_frames_sha256": "0795d9359efb90a8e6e7518f93ffd8b77059b658c67ba9ac551da228b7cb5be4", "num_recent_frames": 27, "tq": 718595.8627588, "t1": 718608.374465802, "ta": 718608.374465802, "te": 718608.524943876, "first_response_s": 12.511707001947798, "answer_total_s": 12.662185075925663, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 250, "content_group": "ae7eef70afb98cfb52f47d0d1151d91b597c7ca778d093029db88b6c0a849b18", "question": {"question_id": "sample_250_a2234_q0", "video_id": 250, "video_path": "./videos/sample_250_real.mp4", "annotation_index": 2234, "question_index": 0, "question": "Why is the teddy bear covered in flour?", "options": ["A. Because the teddy bear fell into a bag of flour.", "B. Because Mr. Bean just blew on the flour.", "C. Because Mr. Bean was baking and accidentally spilled flour on it.", "D. Because the teddy bear was used to dust off a surface covered in flour."], "answer": "B", "time_stamp_s": 142, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [129, 159], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_250_a2234_q0", "video_id": 250, "time_stamp_s": 142, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ae64321f3bd497ce7ee44bcb014bc9f6b731a3bc5a4e6ac1b561f47fc71ac7fd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0], "recent_frames_sha256": "ef9db0bd0f3203ca558e87516da1dd434c29dae30f6cd105a2ba01963b7c8046", "num_recent_frames": 30, "tq": 718768.272217758, "t1": 718779.456426325, "ta": 718779.456426325, "te": 718779.494961618, "first_response_s": 11.184208567021415, "answer_total_s": 11.222743859980255, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_250_a2234_q0", "video_id": 250, "time_stamp_s": 142, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "16f9aa2cbceaf0ec70c62874e7c259d1125da910cdd671fa0bf16dc345ba968a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean holds a teddy bear and a flashlight, moving it to illuminate himself and the bear against a patterned background.  \n- The teddy bear is initially held by Mr. Bean, then dropped to the floor, and later picked up again as he moves around.  \n- A large, round, purple character enters the scene from a doorway, appearing to be in a different room or space.\n[30-60s] - Mr. Bean sits at a kitchen table, looking at a pizza box while a small dog sits beside him.  \n- He holds a pizza box labeled \"Don Crustyon's\" and examines it closely, then looks up with a surprised expression.  \n- A cartoon pizza shop named \"Don Crustyon's\" is shown with two workers behind the counter, one holding a pizza and the other looking thoughtful.\n[60-90s] - Mr. Bean stands at a table with a pizza box, looking at it with a curious expression.\n- The pizza box is open, revealing a single pizza slice inside, with a label reading \"The Cusstoni\" visible.\n- The scene is set in a room with a fireplace and a kitchen visible in the background.\n[90-120s] - Mr. Bean sits at a table, visibly distressed, with a \"Penny\" box in front of him and a teddy bear beside him.  \n- He gestures with his hands while looking at the teddy bear, then suddenly reaches out to place a slice of pizza on the bear’s head.  \n- The teddy bear remains stationary, with the pizza slice resting on its head, while Mr. Bean’s expression shifts from confusion to contemplation.", "history_tokens": 359, "history_utf8_bytes": 1444, "recent_frame_times_s": [113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0], "recent_frames_sha256": "ef9db0bd0f3203ca558e87516da1dd434c29dae30f6cd105a2ba01963b7c8046", "num_recent_frames": 30, "tq": 718636.810644523, "t1": 718638.135959571, "ta": 718638.135959571, "te": 718638.501530116, "first_response_s": 1.3253150479868054, "answer_total_s": 1.690885592950508, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 250, "content_group": "ae7eef70afb98cfb52f47d0d1151d91b597c7ca778d093029db88b6c0a849b18", "question": {"question_id": "sample_250_a2235_q0", "video_id": 250, "video_path": "./videos/sample_250_real.mp4", "annotation_index": 2235, "question_index": 0, "question": "Why does the character have a complete list of ingredients for the grocery list?", "options": ["A. Because the character finds a recipe book.", "B. Because the character asks someone else for the list.", "C. Because the character is talking on the phone and writing down ingredients for a grocery list.", "D. Because the character visits each grocery store to check items."], "answer": "C", "time_stamp_s": 282, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [258, 288], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_250_a2235_q0", "video_id": 250, "time_stamp_s": 282, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9105f24496d8baf1caa3739d1ffb6171b4ca1b43785165f263c145f9a6a4dbbc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0], "recent_frames_sha256": "f3d17a6e476ac662e4023dc5b0491dd9b4ce0570872cd2c00c6b9ece9024dde1", "num_recent_frames": 30, "tq": 718779.514205205, "t1": 718794.066454276, "ta": 718794.066454276, "te": 718794.107435015, "first_response_s": 14.55224907095544, "answer_total_s": 14.59322981000878, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_250_a2235_q0", "video_id": 250, "time_stamp_s": 282, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f87dd2d605961c09f63e21264b462f6efe337e24b5ec97b9e6d664f94c3a6915", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mr. Bean holds a teddy bear and a flashlight, moving it to illuminate himself and the bear against a patterned background.  \n- The teddy bear is initially held by Mr. Bean, then dropped to the floor, and later picked up again as he moves around.  \n- A large, round, purple character enters the scene from a doorway, appearing to be in a different room or space.\n[30-60s] - Mr. Bean sits at a kitchen table, looking at a pizza box while a small dog sits beside him.  \n- He holds a pizza box labeled \"Don Crustyon's\" and examines it closely, then looks up with a surprised expression.  \n- A cartoon pizza shop named \"Don Crustyon's\" is shown with two workers behind the counter, one holding a pizza and the other looking thoughtful.\n[60-90s] - Mr. Bean stands at a table with a pizza box, looking at it with a curious expression.\n- The pizza box is open, revealing a single pizza slice inside, with a label reading \"The Cusstoni\" visible.\n- The scene is set in a room with a fireplace and a kitchen visible in the background.\n[90-120s] - Mr. Bean sits at a table, visibly distressed, with a \"Penny\" box in front of him and a teddy bear beside him.  \n- He gestures with his hands while looking at the teddy bear, then suddenly reaches out to place a slice of pizza on the bear’s head.  \n- The teddy bear remains stationary, with the pizza slice resting on its head, while Mr. Bean’s expression shifts from confusion to contemplation.\n[120-150s] - Mr. Bean, in a kitchen, holds a rolling pin and a bowl of flour, preparing to roll out dough.  \n- A teddy bear sits on the counter, watching him, with a box of flour nearby.  \n- The scene transitions to a close-up of Mr. Bean’s face as he looks at the flour box, then to a wider shot of him standing in the kitchen with ingredients on a table.\n[150-180s] - Mr. Bean stands in a kitchen, looking upward with a surprised expression, then turns to face the camera with a smile.  \n- A bear-shaped pizza is shown on a grill, then inside an oven, with Mr. Bean watching from outside.  \n- Mr. Bean sits at a table, eating the bear-shaped pizza while a small teddy bear sits beside him.\n[180-210s] - Mr. Bean eats a slice of pizza while seated at a table with a teddy bear beside him.  \n- The teddy bear remains stationary on the table, positioned to the left of the pizza.  \n- Mr. Bean’s facial expression changes subtly as he chews, indicating he is savoring the food.\n[210-240s] - Mr. Bean, in a suit, sits at a table with a teddy bear, teapot, and a menu featuring pizza and tomato dishes.\n- He looks at the menu with a surprised expression, then the scene shifts to him in a copy shop, gesturing toward a printer while two people stand nearby.\n- A green car with Mr. Bean inside drives past a traffic light, with a cartoonish face on the windshield.\n[240-270s] - Mr. Bean, wearing a green jacket and red scooter, is seen riding past a red truck and a green car with license plate \"STE 952R\" on a city street.  \n- He is later shown inside a kitchen, holding a phone to his ear while standing near a table with a bowl, a teddy bear, and a carton of flour.  \n- He writes \"CHEESE\" on a notepad, which is placed on the counter next to the flour carton, indicating he is making a list.", "history_tokens": 836, "history_utf8_bytes": 3238, "recent_frame_times_s": [253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0], "recent_frames_sha256": "f3d17a6e476ac662e4023dc5b0491dd9b4ce0570872cd2c00c6b9ece9024dde1", "num_recent_frames": 30, "tq": 718672.59817009, "t1": 718673.913528182, "ta": 718673.913528182, "te": 718673.95103407, "first_response_s": 1.3153580919606611, "answer_total_s": 1.3528639799915254, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 250, "content_group": "ae7eef70afb98cfb52f47d0d1151d91b597c7ca778d093029db88b6c0a849b18", "question": {"question_id": "sample_250_a2236_q0", "video_id": 250, "video_path": "./videos/sample_250_real.mp4", "annotation_index": 2236, "question_index": 0, "question": "How did Mr. Bean earn all the money on his desk?", "options": ["A. Earnings from selling pizza.", "B. Earnings from doing odd jobs around the neighborhood.", "C. Earnings from a garage sale he held over the weekend.", "D. Earnings from winning a small bet with a friend."], "answer": "A", "time_stamp_s": 443, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [387, 417], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_250_a2236_q0", "video_id": 250, "time_stamp_s": 443, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "df48c771695b203eaad8192aea369095c0031abdb59e4621633814ac7f4517aa", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0, 421.0, 422.0, 423.0, 424.0, 425.0, 426.0, 427.0, 428.0, 429.0, 430.0, 431.0, 432.0, 433.0, 434.0, 435.0, 436.0, 437.0, 438.0, 439.0, 440.0, 441.0, 442.0, 443.0], "recent_frames_sha256": "d020463946ff46b2ca364b42b083b7d6664ae1634994ff9f8c6c691433db0336", "num_recent_frames": 30, "tq": 718794.116096024, "t1": 718805.135476807, "ta": 718805.135476807, "te": 718805.172921163, "first_response_s": 11.019380782963708, "answer_total_s": 11.056825138977729, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_250_a2236_q0", "video_id": 250, "time_stamp_s": 443, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "58826ec2558599371a6e3def471f3b8e60f054a4b58ef7505a328e8a0e42d52e", "condition_order": ["notes", "recent"], "memory": "[90-120s] - Mr. Bean sits at a table, visibly distressed, with a \"Penny\" box in front of him and a teddy bear beside him.  \n- He gestures with his hands while looking at the teddy bear, then suddenly reaches out to place a slice of pizza on the bear’s head.  \n- The teddy bear remains stationary, with the pizza slice resting on its head, while Mr. Bean’s expression shifts from confusion to contemplation.\n[120-150s] - Mr. Bean, in a kitchen, holds a rolling pin and a bowl of flour, preparing to roll out dough.  \n- A teddy bear sits on the counter, watching him, with a box of flour nearby.  \n- The scene transitions to a close-up of Mr. Bean’s face as he looks at the flour box, then to a wider shot of him standing in the kitchen with ingredients on a table.\n[150-180s] - Mr. Bean stands in a kitchen, looking upward with a surprised expression, then turns to face the camera with a smile.  \n- A bear-shaped pizza is shown on a grill, then inside an oven, with Mr. Bean watching from outside.  \n- Mr. Bean sits at a table, eating the bear-shaped pizza while a small teddy bear sits beside him.\n[180-210s] - Mr. Bean eats a slice of pizza while seated at a table with a teddy bear beside him.  \n- The teddy bear remains stationary on the table, positioned to the left of the pizza.  \n- Mr. Bean’s facial expression changes subtly as he chews, indicating he is savoring the food.\n[210-240s] - Mr. Bean, in a suit, sits at a table with a teddy bear, teapot, and a menu featuring pizza and tomato dishes.\n- He looks at the menu with a surprised expression, then the scene shifts to him in a copy shop, gesturing toward a printer while two people stand nearby.\n- A green car with Mr. Bean inside drives past a traffic light, with a cartoonish face on the windshield.\n[240-270s] - Mr. Bean, wearing a green jacket and red scooter, is seen riding past a red truck and a green car with license plate \"STE 952R\" on a city street.  \n- He is later shown inside a kitchen, holding a phone to his ear while standing near a table with a bowl, a teddy bear, and a carton of flour.  \n- He writes \"CHEESE\" on a notepad, which is placed on the counter next to the flour carton, indicating he is making a list.\n[270-300s] - Mr. Bean is in a kitchen, holding a phone to his ear while standing near a counter with a teddy bear and a bowl.  \n- He looks at a box labeled \"FLOUR\" and then turns to face the camera with a surprised expression.  \n- He walks toward a stove, holding a spoon, and appears to be preparing to cook or stir something.\n[300-330s] - Mr. Bean drives a green car with a teddy bear in the passenger seat, looking concerned.  \n- He exits the car, carrying a pizza box, and approaches a brown door marked with the number 6.  \n- At the door, two hands offer him money, and he accepts it while holding the pizza box.\n[330-360s] - Mr. Bean holds a pen and looks at a large sketch of a machine, with a teapot and a teddy bear nearby.  \n- He then picks up a black device, possibly a phone, in a workshop setting with hanging cable cars.  \n- A large bell hangs from a crane above a conveyor belt, with Mr. Bean observing it closely.\n[360-390s] - Mr. Bean inspects a pizza box with a logo, then picks up a stack of similar boxes from a conveyor belt.  \n- A sleeping man in a green, red, and white striped hat rests on a counter in a pizzeria named \"Don Crustyoni's.\"  \n- The scene transitions from a kitchen setting to an exterior view of a house with a green roof, then to a night sky with stars.\n[390-420s] - Mr. Bean holds a black cordless phone, looking surprised as he stands in a kitchen with appliances and tools.\n- A teddy bear sits at a table with stacks of money, holding the same phone as Mr. Bean.\n- The phone is suspended by a rope, indicating it's being used or manipulated by someone (possibly the bear) in the scene.", "history_tokens": 1006, "history_utf8_bytes": 3833, "recent_frame_times_s": [414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0, 421.0, 422.0, 423.0, 424.0, 425.0, 426.0, 427.0, 428.0, 429.0, 430.0, 431.0, 432.0, 433.0, 434.0, 435.0, 436.0, 437.0, 438.0, 439.0, 440.0, 441.0, 442.0, 443.0], "recent_frames_sha256": "d020463946ff46b2ca364b42b083b7d6664ae1634994ff9f8c6c691433db0336", "num_recent_frames": 30, "tq": 718714.485016316, "t1": 718722.368464475, "ta": 718722.368464475, "te": 718722.516546076, "first_response_s": 7.883448159089312, "answer_total_s": 8.031529760104604, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 250, "content_group": "ae7eef70afb98cfb52f47d0d1151d91b597c7ca778d093029db88b6c0a849b18", "question": {"question_id": "sample_250_a2237_q0", "video_id": 250, "video_path": "./videos/sample_250_real.mp4", "annotation_index": 2237, "question_index": 0, "question": "Why do the two guards fight each other?", "options": ["A. Because Mr. Bean dodged their attack downward, it caused them to attack each other.", "B. Because they misunderstood each other's orders.", "C. Because they were competing to capture Mr. Bean first.", "D. Because they were tricked by Mr. Bean into thinking the other was an enemy."], "answer": "A", "time_stamp_s": 545, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "kids cartoon", "reference_interval_s": [516, 546], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_250_a2237_q0", "video_id": 250, "time_stamp_s": 545, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "61303f9cad4a8593ecefdb564fe4a1c2207edcabcb14a1c7a1a5e9c0d54e2916", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0], "recent_frames_sha256": "de30f33361c695d4ecb9dfb30f5504708fa19d2f4f02247148e4fc11b571c1af", "num_recent_frames": 30, "tq": 718805.180765455, "t1": 718817.299697634, "ta": 718817.299697634, "te": 718817.337400759, "first_response_s": 12.118932178942487, "answer_total_s": 12.156635303981602, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_250_a2237_q0", "video_id": 250, "time_stamp_s": 545, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9237a6bac1732e3c43a7e808ddc33e19b2788ed535888a17e176b797ef7c865f", "condition_order": ["notes", "recent"], "memory": "[210-240s] - Mr. Bean, in a suit, sits at a table with a teddy bear, teapot, and a menu featuring pizza and tomato dishes.\n- He looks at the menu with a surprised expression, then the scene shifts to him in a copy shop, gesturing toward a printer while two people stand nearby.\n- A green car with Mr. Bean inside drives past a traffic light, with a cartoonish face on the windshield.\n[240-270s] - Mr. Bean, wearing a green jacket and red scooter, is seen riding past a red truck and a green car with license plate \"STE 952R\" on a city street.  \n- He is later shown inside a kitchen, holding a phone to his ear while standing near a table with a bowl, a teddy bear, and a carton of flour.  \n- He writes \"CHEESE\" on a notepad, which is placed on the counter next to the flour carton, indicating he is making a list.\n[270-300s] - Mr. Bean is in a kitchen, holding a phone to his ear while standing near a counter with a teddy bear and a bowl.  \n- He looks at a box labeled \"FLOUR\" and then turns to face the camera with a surprised expression.  \n- He walks toward a stove, holding a spoon, and appears to be preparing to cook or stir something.\n[300-330s] - Mr. Bean drives a green car with a teddy bear in the passenger seat, looking concerned.  \n- He exits the car, carrying a pizza box, and approaches a brown door marked with the number 6.  \n- At the door, two hands offer him money, and he accepts it while holding the pizza box.\n[330-360s] - Mr. Bean holds a pen and looks at a large sketch of a machine, with a teapot and a teddy bear nearby.  \n- He then picks up a black device, possibly a phone, in a workshop setting with hanging cable cars.  \n- A large bell hangs from a crane above a conveyor belt, with Mr. Bean observing it closely.\n[360-390s] - Mr. Bean inspects a pizza box with a logo, then picks up a stack of similar boxes from a conveyor belt.  \n- A sleeping man in a green, red, and white striped hat rests on a counter in a pizzeria named \"Don Crustyoni's.\"  \n- The scene transitions from a kitchen setting to an exterior view of a house with a green roof, then to a night sky with stars.\n[390-420s] - Mr. Bean holds a black cordless phone, looking surprised as he stands in a kitchen with appliances and tools.\n- A teddy bear sits at a table with stacks of money, holding the same phone as Mr. Bean.\n- The phone is suspended by a rope, indicating it's being used or manipulated by someone (possibly the bear) in the scene.\n[420-450s] - Mr. Bean is seated at a table, surrounded by stacks of pizza boxes, with a large pile of cash on the table in front of him.  \n- He is holding a black smartphone, looking at it with a satisfied expression while leaning back in his chair.  \n- The room has a window with a blue view and a door with a brown patterned design visible in the background.\n[450-480s] - Mr. Bean stands at a grand blue mansion entrance, holding a key and looking up at the doors.\n- A green car with headlights on approaches the mansion, then stops in front of the entrance.\n- The mansion's facade features large windows, columns, and a central circular window, all illuminated against a dark blue night sky.\n[480-510s] - Mr. Bean stands outside a blue mansion at night, holding a tray, as a yellow car with a spotlight approaches.  \n- Two men in black suits enter the mansion, approaching Mr. Bean from behind.  \n- Inside, a man in a tuxedo sits at a desk reading a paper, then looks up as Mr. Bean approaches him with the tray.\n[510-540s] - Mr. Bean holds a pizza box while flanked by two suited men in a grand hallway.  \n- The elderly man in a suit reclines in a chair, examining a pizza box with a satisfied expression.  \n- A chef figure appears in a doorway, holding a pizza, suggesting a delivery or service context.", "history_tokens": 971, "history_utf8_bytes": 3751, "recent_frame_times_s": [516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0], "recent_frames_sha256": "de30f33361c695d4ecb9dfb30f5504708fa19d2f4f02247148e4fc11b571c1af", "num_recent_frames": 30, "tq": 718760.243821027, "t1": 718767.124132666, "ta": 718767.124132666, "te": 718767.165838117, "first_response_s": 6.880311639048159, "answer_total_s": 6.922017090022564, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 251, "content_group": "fd272805120dffac3e1dbfe22333df8c5f670f96b607425b37c93db16b277f3d", "question": {"question_id": "sample_251_a238_q0", "video_id": 251, "video_path": "./videos/sample_251_real.mp4", "annotation_index": 238, "question_index": 0, "question": "What logo is visible on the gas station sign right now?", "options": ["A. Shell.", "B. Chevron.", "C. Exxon.", "D. BP."], "answer": "A", "time_stamp_s": 5, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_251_a238_q0", "video_id": 251, "time_stamp_s": 5, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2a8b4598cd90e8eb1a938beae1dfcbd4a1de48c36a34d0e3ff168256afe74e83", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "1f68f25ad15a88391c19314ba8b887296b6335aaf0407fc9a7cd8f29751649ec", "num_recent_frames": 6, "tq": 716343.927283956, "t1": 716344.424106311, "ta": 716344.424106311, "te": 716344.572159698, "first_response_s": 0.4968223550822586, "answer_total_s": 0.6448757420293987, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_251_a238_q0", "video_id": 251, "time_stamp_s": 5, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1c50a064de427a66ac612d0d7e37f00e917ed9e8409fa4a684996cb2f6cadfdf", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "1f68f25ad15a88391c19314ba8b887296b6335aaf0407fc9a7cd8f29751649ec", "num_recent_frames": 6, "tq": 716395.158977484, "t1": 716407.998515499, "ta": 716407.998515499, "te": 716408.203395126, "first_response_s": 12.83953801507596, "answer_total_s": 13.044417642056942, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 251, "content_group": "fd272805120dffac3e1dbfe22333df8c5f670f96b607425b37c93db16b277f3d", "question": {"question_id": "sample_251_a239_q0", "video_id": 251, "video_path": "./videos/sample_251_real.mp4", "annotation_index": 239, "question_index": 0, "question": "What brand is the steering wheel right now?", "options": ["A. BMW.", "B. Audi.", "C. Mercedes-Benz.", "D. Porsche."], "answer": "C", "time_stamp_s": 66, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [66, 71], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_251_a239_q0", "video_id": 251, "time_stamp_s": 66, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "60394916a4eb333b29ed23bec0cf6fb1055d46cdf860290f62df2f59dc66242b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0], "recent_frames_sha256": "9338723cbdf070420f31b91b4756cb4dd03c2b13135fdf658528bbb40a19f9fd", "num_recent_frames": 30, "tq": 716344.585028473, "t1": 716358.114392469, "ta": 716358.114392469, "te": 716358.152252199, "first_response_s": 13.52936399600003, "answer_total_s": 13.567223725956865, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_251_a239_q0", "video_id": 251, "time_stamp_s": 66, "ground_truth": "C", "raw_output": "C. Mercedes-Benz.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "a54fb374bdfb2aa9fd178f25d1f090161a9511dfaf751a7317807cd0a0c92c20", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A silver 1993 Mercedes-Benz W124 S65 V12 Biturbo is parked at a gas station, with its doors open and interior visible.  \n- The car's dashboard and steering wheel are shown, with a digital display indicating 700HP and 1000Nm.  \n- The camera pans around the car, highlighting its exterior and interior details, including the seats and center console.\n[30-60s] - Driver wearing blue gloves, hands on steering wheel, navigating a road with greenery on both sides.  \n- Car's dashboard shows speedometer and tachometer, with a visible \"1993\" model year indicator.  \n- Interior features black leather seats, manual gear shift, and a center console with various controls.", "history_tokens": 173, "history_utf8_bytes": 673, "recent_frame_times_s": [37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0], "recent_frames_sha256": "9338723cbdf070420f31b91b4756cb4dd03c2b13135fdf658528bbb40a19f9fd", "num_recent_frames": 30, "tq": 716428.056137941, "t1": 716434.790716855, "ta": 716434.790716855, "te": 716434.982734884, "first_response_s": 6.734578914009035, "answer_total_s": 6.926596943056211, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 251, "content_group": "fd272805120dffac3e1dbfe22333df8c5f670f96b607425b37c93db16b277f3d", "question": {"question_id": "sample_251_a240_q0", "video_id": 251, "video_path": "./videos/sample_251_real.mp4", "annotation_index": 240, "question_index": 0, "question": "What is the current speed of the car right now?", "options": ["A. 150 km/h.", "B. 200 km/h.", "C. 225 km/h.", "D. 250 km/h."], "answer": "B", "time_stamp_s": 136, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [132, 137], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_251_a240_q0", "video_id": 251, "time_stamp_s": 136, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "81372a4e8c2bc0e3c5d20c103d54c42d2d669f4959d60caea93d430968f100c1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0], "recent_frames_sha256": "a15c18b06c04d2ba294a4ff3d5e388bb9c8a1835a0cdce21806cb0540bdd7aeb", "num_recent_frames": 30, "tq": 716358.162618602, "t1": 716369.806740997, "ta": 716369.806740997, "te": 716369.843664772, "first_response_s": 11.644122394965962, "answer_total_s": 11.681046169949695, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_251_a240_q0", "video_id": 251, "time_stamp_s": 136, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d30aca1160e0f2305a98a9485e9ee57899d5126de54eeb13c14804122bcfd3a3", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A silver 1993 Mercedes-Benz W124 S65 V12 Biturbo is parked at a gas station, with its doors open and interior visible.  \n- The car's dashboard and steering wheel are shown, with a digital display indicating 700HP and 1000Nm.  \n- The camera pans around the car, highlighting its exterior and interior details, including the seats and center console.\n[30-60s] - Driver wearing blue gloves, hands on steering wheel, navigating a road with greenery on both sides.  \n- Car's dashboard shows speedometer and tachometer, with a visible \"1993\" model year indicator.  \n- Interior features black leather seats, manual gear shift, and a center console with various controls.\n[60-90s] - Driver's hands, clad in blue gloves, grip the steering wheel with steady control while navigating a winding road.  \n- The car's speedometer shows a consistent speed, indicating smooth driving without abrupt changes.  \n- The dashboard and rearview mirror remain stable, reflecting the driver’s focused attention on the road ahead.\n[90-120s] - Driver's hands in blue gloves grip steering wheel, maintaining steady control.  \n- Speedometer shows consistent speed around 80-90 km/h, with no abrupt changes.  \n- Road ahead is clear, with greenery on both sides and occasional vehicles passing.", "history_tokens": 309, "history_utf8_bytes": 1275, "recent_frame_times_s": [107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0], "recent_frames_sha256": "a15c18b06c04d2ba294a4ff3d5e388bb9c8a1835a0cdce21806cb0540bdd7aeb", "num_recent_frames": 30, "tq": 716456.003270331, "t1": 716463.120744707, "ta": 716463.120744707, "te": 716463.341943747, "first_response_s": 7.117474375991151, "answer_total_s": 7.338673416059464, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 251, "content_group": "fd272805120dffac3e1dbfe22333df8c5f670f96b607425b37c93db16b277f3d", "question": {"question_id": "sample_251_a241_q0", "video_id": 251, "video_path": "./videos/sample_251_real.mp4", "annotation_index": 241, "question_index": 0, "question": "What color are the gloves the driver is wearing right now?", "options": ["A. Red and black.", "B. Blue and black.", "C. Black and white.", "D. Green and black."], "answer": "B", "time_stamp_s": 200, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [198, 203], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_251_a241_q0", "video_id": 251, "time_stamp_s": 200, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "edfa0b8374c0799615bed447695428d2362b61e9321789842261bad67388f479", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0], "recent_frames_sha256": "fdc3a8aef42f7419af2afae7022b877c9e17adffc6fd51e080e716347d5da730", "num_recent_frames": 30, "tq": 716369.854640861, "t1": 716382.887202718, "ta": 716382.887202718, "te": 716382.924879417, "first_response_s": 13.032561856904067, "answer_total_s": 13.070238556014374, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_251_a241_q0", "video_id": 251, "time_stamp_s": 200, "ground_truth": "B", "raw_output": "B. Blue and black.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "840a639cd0aacdb9ca961ac4992e0580e6614c45668314bbc084c2612bfef620", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A silver 1993 Mercedes-Benz W124 S65 V12 Biturbo is parked at a gas station, with its doors open and interior visible.  \n- The car's dashboard and steering wheel are shown, with a digital display indicating 700HP and 1000Nm.  \n- The camera pans around the car, highlighting its exterior and interior details, including the seats and center console.\n[30-60s] - Driver wearing blue gloves, hands on steering wheel, navigating a road with greenery on both sides.  \n- Car's dashboard shows speedometer and tachometer, with a visible \"1993\" model year indicator.  \n- Interior features black leather seats, manual gear shift, and a center console with various controls.\n[60-90s] - Driver's hands, clad in blue gloves, grip the steering wheel with steady control while navigating a winding road.  \n- The car's speedometer shows a consistent speed, indicating smooth driving without abrupt changes.  \n- The dashboard and rearview mirror remain stable, reflecting the driver’s focused attention on the road ahead.\n[90-120s] - Driver's hands in blue gloves grip steering wheel, maintaining steady control.  \n- Speedometer shows consistent speed around 80-90 km/h, with no abrupt changes.  \n- Road ahead is clear, with greenery on both sides and occasional vehicles passing.\n[120-150s] - Driver's hands in blue gloves grip steering wheel, maintaining steady control.  \n- Speedometer shows consistent speed around 80-90 km/h, with no abrupt changes.  \n- Road ahead is clear, with minimal traffic and greenery visible on both sides.\n[150-180s] - Driver's hands in blue gloves grip steering wheel, maintaining steady control.  \n- Speedometer shows consistent speed around 80-90 mph; tachometer indicates engine RPMs.  \n- Road ahead is straight with greenery on sides; no visible lane changes or abrupt maneuvers.", "history_tokens": 443, "history_utf8_bytes": 1810, "recent_frame_times_s": [171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0], "recent_frames_sha256": "fdc3a8aef42f7419af2afae7022b877c9e17adffc6fd51e080e716347d5da730", "num_recent_frames": 30, "tq": 716480.719482302, "t1": 716487.514245025, "ta": 716487.514245025, "te": 716487.740948395, "first_response_s": 6.794762723031454, "answer_total_s": 7.021466093021445, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 251, "content_group": "fd272805120dffac3e1dbfe22333df8c5f670f96b607425b37c93db16b277f3d", "question": {"question_id": "sample_251_a242_q0", "video_id": 251, "video_path": "./videos/sample_251_real.mp4", "annotation_index": 242, "question_index": 0, "question": "What is the current speed of the car right now?", "options": ["A. 150 km/h.", "B. 200 km/h.", "C. 225 km/h.", "D. 250 km/h."], "answer": "D", "time_stamp_s": 263, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [264, 269], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_251_a242_q0", "video_id": 251, "time_stamp_s": 263, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7f57ffa9b4d8bf0a74398af13f1fcd39e3469c0c2af4bb99e0a163e64fff09db", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0], "recent_frames_sha256": "a97e43bd6929b10970f3d814df48859682a132ee04ef3a3fc91df552d862bc5e", "num_recent_frames": 30, "tq": 716382.936889657, "t1": 716395.110657866, "ta": 716395.110657866, "te": 716395.14907566, "first_response_s": 12.173768208944239, "answer_total_s": 12.212186002987437, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_251_a242_q0", "video_id": 251, "time_stamp_s": 263, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "63357ef95efe8b5c54dd4746dff1bbf75532d1b57fe34e7f03513fbfe8ededee", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A silver 1993 Mercedes-Benz W124 S65 V12 Biturbo is parked at a gas station, with its doors open and interior visible.  \n- The car's dashboard and steering wheel are shown, with a digital display indicating 700HP and 1000Nm.  \n- The camera pans around the car, highlighting its exterior and interior details, including the seats and center console.\n[30-60s] - Driver wearing blue gloves, hands on steering wheel, navigating a road with greenery on both sides.  \n- Car's dashboard shows speedometer and tachometer, with a visible \"1993\" model year indicator.  \n- Interior features black leather seats, manual gear shift, and a center console with various controls.\n[60-90s] - Driver's hands, clad in blue gloves, grip the steering wheel with steady control while navigating a winding road.  \n- The car's speedometer shows a consistent speed, indicating smooth driving without abrupt changes.  \n- The dashboard and rearview mirror remain stable, reflecting the driver’s focused attention on the road ahead.\n[90-120s] - Driver's hands in blue gloves grip steering wheel, maintaining steady control.  \n- Speedometer shows consistent speed around 80-90 km/h, with no abrupt changes.  \n- Road ahead is clear, with greenery on both sides and occasional vehicles passing.\n[120-150s] - Driver's hands in blue gloves grip steering wheel, maintaining steady control.  \n- Speedometer shows consistent speed around 80-90 km/h, with no abrupt changes.  \n- Road ahead is clear, with minimal traffic and greenery visible on both sides.\n[150-180s] - Driver's hands in blue gloves grip steering wheel, maintaining steady control.  \n- Speedometer shows consistent speed around 80-90 mph; tachometer indicates engine RPMs.  \n- Road ahead is straight with greenery on sides; no visible lane changes or abrupt maneuvers.\n[180-210s] - Driver's hands in blue gloves grip the steering wheel of a Mercedes-Benz, maintaining a steady position.  \n- Speedometer shows consistent speed around 100-110 km/h, with no significant acceleration or deceleration.  \n- Road ahead is straight with greenery on both sides, and the vehicle remains centered in the lane.\n[210-240s] - Driver's hands in blue gloves grip steering wheel, maintaining steady control.  \n- Speedometer shows consistent speed around 100-110 km/h, with no abrupt changes.  \n- Road ahead is straight with clear lane markings, bordered by green fields and distant trees.", "history_tokens": 592, "history_utf8_bytes": 2413, "recent_frame_times_s": [234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0], "recent_frames_sha256": "a97e43bd6929b10970f3d814df48859682a132ee04ef3a3fc91df552d862bc5e", "num_recent_frames": 30, "tq": 716505.120131322, "t1": 716512.301366922, "ta": 716512.301366922, "te": 716512.449653587, "first_response_s": 7.18123560003005, "answer_total_s": 7.329522265004925, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 253, "content_group": "9a86f6879038e511552a1da8d9985f24ade289d8a0d66398ed5ab99d12e05ccc", "question": {"question_id": "sample_253_a1733_q0", "video_id": 253, "video_path": "./videos/sample_253_real.mp4", "annotation_index": 1733, "question_index": 0, "question": "Which make of car is being driven right now?", "options": ["A. Ferrari.", "B. Lamborghini.", "C. McLaren.", "D. Porsche."], "answer": "D", "time_stamp_s": 35, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_253_a1733_q0", "video_id": 253, "time_stamp_s": 35, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "12e0817f3d24e3d4856a1d816278b00f17c6e3d156b436d328e156c54aea08c9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665, 20.003316666666667, 21.004316666666668, 22.005316666666666, 23.006316666666667, 24.007316666666668, 25.008316666666666, 26.009316666666667, 27.010316666666668, 28.011316666666666, 29.012316666666667, 30.013316666666668, 31.014316666666666, 32.01531666666666, 33.01631666666667, 34.00063333333333], "recent_frames_sha256": "d506a686b23afceb22e9728c02c9d408143b903efba7eab58183aa870f1aeba1", "num_recent_frames": 30, "tq": 718638.534152582, "t1": 718644.322199263, "ta": 718644.322199263, "te": 718644.360037536, "first_response_s": 5.788046680972911, "answer_total_s": 5.82588495395612, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_253_a1733_q0", "video_id": 253, "time_stamp_s": 35, "ground_truth": "D", "raw_output": "D. Porsche.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "23e63197b8e32eba2415f36b7efa55de7c835e8e4536a35c1384c5e86ea1aa80", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's POV inside a Porsche race car, with dashboard displaying telemetry and a small screen showing the track layout.\n- Red race car ahead is closely followed, with other competitors visible on the track, indicating a competitive race environment.\n- The car navigates a turn, with the driver's hands on the steering wheel and the windshield wipers active, suggesting wet or rainy conditions.", "history_tokens": 83, "history_utf8_bytes": 404, "recent_frame_times_s": [5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665, 20.003316666666667, 21.004316666666668, 22.005316666666666, 23.006316666666667, 24.007316666666668, 25.008316666666666, 26.009316666666667, 27.010316666666668, 28.011316666666666, 29.012316666666667, 30.013316666666668, 31.014316666666666, 32.01531666666666, 33.01631666666667, 34.00063333333333], "recent_frames_sha256": "d506a686b23afceb22e9728c02c9d408143b903efba7eab58183aa870f1aeba1", "num_recent_frames": 30, "tq": 718692.770292716, "t1": 718703.177029081, "ta": 718703.177029081, "te": 718703.325892077, "first_response_s": 10.406736365053803, "answer_total_s": 10.555599360959604, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 253, "content_group": "9a86f6879038e511552a1da8d9985f24ade289d8a0d66398ed5ab99d12e05ccc", "question": {"question_id": "sample_253_a1734_q0", "video_id": 253, "video_path": "./videos/sample_253_real.mp4", "annotation_index": 1734, "question_index": 0, "question": "What brand of car is being driven right now?", "options": ["A. Ford.", "B. BMW.", "C. Audi.", "D. Porsche."], "answer": "D", "time_stamp_s": 420, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [466, 471], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_253_a1734_q0", "video_id": 253, "time_stamp_s": 420, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8c5db467768b5becc99390061004bff2f3341d7b764f83c907784facb4cce11b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0009166666667, 419.00191666666666], "recent_frames_sha256": "87655b9fb31f2bb7a5a4b2723e5ccd1c5e93e6911395c9c35f020f13fcb5baae", "num_recent_frames": 30, "tq": 718644.376799633, "t1": 718655.280668726, "ta": 718655.280668726, "te": 718655.318712799, "first_response_s": 10.903869092930108, "answer_total_s": 10.94191316596698, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_253_a1734_q0", "video_id": 253, "time_stamp_s": 420, "ground_truth": "D", "raw_output": "D. Porsche.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "d2c6bfe0581dbe501f15891cbbe48b877469ca71bea2243187c3247715f8de33", "condition_order": ["recent", "notes"], "memory": "[60-90s] - A yellow race car is positioned ahead, slightly to the left, with its front facing the camera's perspective.  \n- The dashboard displays \"N\" for neutral, indicating the car is stationary before the start.  \n- Other cars, including a red and blue one, are visible in the background, lined up on the track.\n[90-120s] - Driver's dashboard displays \"N\" gear and \"0.000\" speed, indicating neutral and stationary position.  \n- A red and blue race car is visible to the right, stationary or moving slowly near the track's edge.  \n- The track ahead shows multiple cars, including a yellow one, with a grandstand and sponsor banners in the background.\n[120-150s] - Driver's dashboard displays \"N\" (neutral) and \"1\" (gear 1) as the car prepares for the race start.\n- A small inset screen shows the race grid with multiple cars lined up, including a red and blue car and a white car.\n- The driver's steering wheel and controls are visible, with a \"5\" logo on the center console.\n[150-180s] - Driver's cockpit view shows a digital dashboard with fluctuating speed and gear indicators, including a visible \"5\" on the speedometer.\n- The steering wheel features multiple buttons and a central Porsche logo, with the driver's gloved hand occasionally adjusting controls.\n- The track ahead curves right, with other race cars visible in the distance, and a small inset screen in the bottom right corner displays a wider view of the circuit.\n[180-210s] - Driver's gloved hand grips the steering wheel, with the Porsche logo visible on the wheel's center.  \n- The digital dashboard displays speed, gear, and lap time, with the car accelerating through turns.  \n- A small screen on the right shows a live race map, indicating the car's position relative to other racers.\n[210-240s] - Driver's hands grip the steering wheel with gloves, actively maneuvering the car.  \n- Dashboard displays fluctuating speed and gear indicators as the car navigates the track.  \n- A small screen on the right shows a live telemetry map of the race track and surrounding cars.\n[240-270s] - Driver's steering wheel with Porsche logo and multiple control buttons is visible, showing active race engagement.  \n- Dashboard displays fluctuating speed and gear indicators, suggesting dynamic acceleration and braking.  \n- A small screen on the right shows a live race map with multiple cars navigating the track, indicating competitive positioning.\n[270-300s] - Driver's steering wheel with Porsche logo and multiple control buttons is visible, showing active race engagement.  \n- Dashboard displays fluctuating speed and gear indicators, suggesting dynamic driving conditions.  \n- Track ahead features multiple cars, including a red and a green vehicle, navigating turns with visible track markings.\n[300-330s] - Driver's cockpit view shows a digital dashboard with shifting gear indicators (e.g., \"5\" at 308s) and a steering wheel with Porsche logo.\n- The car navigates a track with visible curbs, barriers, and other racing cars in the distance.\n- A small inset screen displays a wider track view, showing multiple cars racing ahead, including one with a green livery.\n[330-360s] - Driver's hands grip steering wheel with gloves, actively maneuvering through turns.\n- Dashboard displays fluctuating speed and gear indicators, showing active race dynamics.\n- Trackside barriers and sponsor banners visible through windshield, with cars overtaking in background.\n[360-390s] - Driver's gloved hand grips the steering wheel, with a visible Porsche logo, as the car navigates a turn on the track.  \n- The digital dashboard displays fluctuating speed and gear indicators, showing active race telemetry.  \n- A small inset screen on the right side of the cockpit shows a live race map with multiple cars, including a blue and a red vehicle.\n[390-420s] - Driver's cockpit view shows a Porsche race car with a digital dashboard displaying speed, gear, and lap times; steering wheel has multiple buttons and a Porsche logo.\n- The car is navigating a track with green and red curbs, passing other race cars including a green and white vehicle with \"Bauhaus\" branding.\n- The driver's hands are visible on the steering wheel, actively controlling the vehicle as it maneuvers through the track.", "history_tokens": 960, "history_utf8_bytes": 4246, "recent_frame_times_s": [390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0009166666667, 419.00191666666666], "recent_frames_sha256": "87655b9fb31f2bb7a5a4b2723e5ccd1c5e93e6911395c9c35f020f13fcb5baae", "num_recent_frames": 30, "tq": 718804.613884404, "t1": 718811.563804249, "ta": 718811.563804249, "te": 718811.695475382, "first_response_s": 6.949919845093973, "answer_total_s": 7.0815909780794755, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 253, "content_group": "9a86f6879038e511552a1da8d9985f24ade289d8a0d66398ed5ab99d12e05ccc", "question": {"question_id": "sample_253_a1734_q1", "video_id": 253, "video_path": "./videos/sample_253_real.mp4", "annotation_index": 1734, "question_index": 1, "question": "What is the current oil temperature displayed on the dashboard?", "options": ["A. 87.5.", "B. 85.0.", "C. 94.3.", "D. 98.0."], "answer": "D", "time_stamp_s": 467, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [466, 471], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_253_a1734_q1", "video_id": 253, "time_stamp_s": 467, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1befd4ecb983a0a615872a0728c58dbf67af683c9b1152c62e3fc8a0d26683e4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [437.00323333333336, 438.00423333333333, 439.0052333333333, 440.00623333333334, 441.0072333333333, 442.00823333333335, 443.0092333333333, 444.01023333333336, 445.01123333333334, 446.0122333333333, 447.01323333333335, 448.0142333333333, 449.01523333333336, 450.01623333333333, 451.00055, 452.00155, 453.00255, 454.00355, 455.00455, 456.00555, 457.00655, 458.00755, 459.00855, 460.00955, 461.01055, 462.01155, 463.01255, 464.01355, 465.01455, 466.01555], "recent_frames_sha256": "c4bdd47b9f4b99f981355138daf4b1925fdfa1ebb761d5e69018386a3da20e9f", "num_recent_frames": 30, "tq": 718655.333437041, "t1": 718667.157100005, "ta": 718667.157100005, "te": 718667.194920795, "first_response_s": 11.823662963928655, "answer_total_s": 11.861483754008077, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_253_a1734_q1", "video_id": 253, "time_stamp_s": 467, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0ca388b8773442baa5d49fb3ab26efe7e7cdfb6374a2fd6725a647e95f6f3620", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Driver's dashboard displays \"N\" gear and \"0.000\" speed, indicating neutral and stationary position.  \n- A red and blue race car is visible to the right, stationary or moving slowly near the track's edge.  \n- The track ahead shows multiple cars, including a yellow one, with a grandstand and sponsor banners in the background.\n[120-150s] - Driver's dashboard displays \"N\" (neutral) and \"1\" (gear 1) as the car prepares for the race start.\n- A small inset screen shows the race grid with multiple cars lined up, including a red and blue car and a white car.\n- The driver's steering wheel and controls are visible, with a \"5\" logo on the center console.\n[150-180s] - Driver's cockpit view shows a digital dashboard with fluctuating speed and gear indicators, including a visible \"5\" on the speedometer.\n- The steering wheel features multiple buttons and a central Porsche logo, with the driver's gloved hand occasionally adjusting controls.\n- The track ahead curves right, with other race cars visible in the distance, and a small inset screen in the bottom right corner displays a wider view of the circuit.\n[180-210s] - Driver's gloved hand grips the steering wheel, with the Porsche logo visible on the wheel's center.  \n- The digital dashboard displays speed, gear, and lap time, with the car accelerating through turns.  \n- A small screen on the right shows a live race map, indicating the car's position relative to other racers.\n[210-240s] - Driver's hands grip the steering wheel with gloves, actively maneuvering the car.  \n- Dashboard displays fluctuating speed and gear indicators as the car navigates the track.  \n- A small screen on the right shows a live telemetry map of the race track and surrounding cars.\n[240-270s] - Driver's steering wheel with Porsche logo and multiple control buttons is visible, showing active race engagement.  \n- Dashboard displays fluctuating speed and gear indicators, suggesting dynamic acceleration and braking.  \n- A small screen on the right shows a live race map with multiple cars navigating the track, indicating competitive positioning.\n[270-300s] - Driver's steering wheel with Porsche logo and multiple control buttons is visible, showing active race engagement.  \n- Dashboard displays fluctuating speed and gear indicators, suggesting dynamic driving conditions.  \n- Track ahead features multiple cars, including a red and a green vehicle, navigating turns with visible track markings.\n[300-330s] - Driver's cockpit view shows a digital dashboard with shifting gear indicators (e.g., \"5\" at 308s) and a steering wheel with Porsche logo.\n- The car navigates a track with visible curbs, barriers, and other racing cars in the distance.\n- A small inset screen displays a wider track view, showing multiple cars racing ahead, including one with a green livery.\n[330-360s] - Driver's hands grip steering wheel with gloves, actively maneuvering through turns.\n- Dashboard displays fluctuating speed and gear indicators, showing active race dynamics.\n- Trackside barriers and sponsor banners visible through windshield, with cars overtaking in background.\n[360-390s] - Driver's gloved hand grips the steering wheel, with a visible Porsche logo, as the car navigates a turn on the track.  \n- The digital dashboard displays fluctuating speed and gear indicators, showing active race telemetry.  \n- A small inset screen on the right side of the cockpit shows a live race map with multiple cars, including a blue and a red vehicle.\n[390-420s] - Driver's cockpit view shows a Porsche race car with a digital dashboard displaying speed, gear, and lap times; steering wheel has multiple buttons and a Porsche logo.\n- The car is navigating a track with green and red curbs, passing other race cars including a green and white vehicle with \"Bauhaus\" branding.\n- The driver's hands are visible on the steering wheel, actively controlling the vehicle as it maneuvers through the track.\n[420-450s] - Safety car is visible on track, with driver's dashboard showing lap count decreasing from 5 to 3.\n- On-screen overlay displays \"Safety Car\" and \"Stopped recording\" text, indicating race status.\n- Driver's view shows track ahead with other cars following safety car, and a small inset map showing car positions.", "history_tokens": 961, "history_utf8_bytes": 4255, "recent_frame_times_s": [437.00323333333336, 438.00423333333333, 439.0052333333333, 440.00623333333334, 441.0072333333333, 442.00823333333335, 443.0092333333333, 444.01023333333336, 445.01123333333334, 446.0122333333333, 447.01323333333335, 448.0142333333333, 449.01523333333336, 450.01623333333333, 451.00055, 452.00155, 453.00255, 454.00355, 455.00455, 456.00555, 457.00655, 458.00755, 459.00855, 460.00955, 461.01055, 462.01155, 463.01255, 464.01355, 465.01455, 466.01555], "recent_frames_sha256": "c4bdd47b9f4b99f981355138daf4b1925fdfa1ebb761d5e69018386a3da20e9f", "num_recent_frames": 30, "tq": 718822.143146592, "t1": 718829.679906025, "ta": 718829.679906025, "te": 718829.722059826, "first_response_s": 7.53675943298731, "answer_total_s": 7.578913234057836, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 253, "content_group": "9a86f6879038e511552a1da8d9985f24ade289d8a0d66398ed5ab99d12e05ccc", "question": {"question_id": "sample_253_a1735_q0", "video_id": 253, "video_path": "./videos/sample_253_real.mp4", "annotation_index": 1735, "question_index": 0, "question": "What is the current brake bias setting displayed on the dashboard?", "options": ["A. +1.00.", "B. -0.30.", "C. +2.00.", "D. -3.00."], "answer": "D", "time_stamp_s": 703, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [699, 704], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_253_a1735_q0", "video_id": 253, "time_stamp_s": 703, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a4574ebf7babe8e5dd3c471b22ebeed824db71a42a139dbf89bf9e46bcf78a74", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [673.0056666666667, 674.0066666666667, 675.0076666666666, 676.0086666666666, 677.0096666666667, 678.0106666666667, 679.0116666666667, 680.0126666666666, 681.0136666666667, 682.0146666666667, 683.0156666666667, 684.0166666666667, 685.0009833333334, 686.0019833333333, 687.0029833333333, 688.0039833333333, 689.0049833333334, 690.0059833333333, 691.0069833333333, 692.0079833333333, 693.0089833333334, 694.0099833333334, 695.0109833333333, 696.0119833333333, 697.0129833333333, 698.0139833333334, 699.0149833333334, 700.0159833333333, 701.0003, 702.0013], "recent_frames_sha256": "24a5e0aa61d5be78a65e7a86c44a184df62064229a189b713e686082a964197e", "num_recent_frames": 30, "tq": 718667.209379842, "t1": 718674.983656724, "ta": 718674.983656724, "te": 718675.021226911, "first_response_s": 7.774276881944388, "answer_total_s": 7.811847068951465, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_253_a1735_q0", "video_id": 253, "time_stamp_s": 703, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a1b45621a4f5c992d74e9f77b00f6bc56f7008ecd00535befe5f987016a8891d", "condition_order": ["recent", "notes"], "memory": "[300-330s] - Driver's cockpit view shows a digital dashboard with shifting gear indicators (e.g., \"5\" at 308s) and a steering wheel with Porsche logo.\n- The car navigates a track with visible curbs, barriers, and other racing cars in the distance.\n- A small inset screen displays a wider track view, showing multiple cars racing ahead, including one with a green livery.\n[330-360s] - Driver's hands grip steering wheel with gloves, actively maneuvering through turns.\n- Dashboard displays fluctuating speed and gear indicators, showing active race dynamics.\n- Trackside barriers and sponsor banners visible through windshield, with cars overtaking in background.\n[360-390s] - Driver's gloved hand grips the steering wheel, with a visible Porsche logo, as the car navigates a turn on the track.  \n- The digital dashboard displays fluctuating speed and gear indicators, showing active race telemetry.  \n- A small inset screen on the right side of the cockpit shows a live race map with multiple cars, including a blue and a red vehicle.\n[390-420s] - Driver's cockpit view shows a Porsche race car with a digital dashboard displaying speed, gear, and lap times; steering wheel has multiple buttons and a Porsche logo.\n- The car is navigating a track with green and red curbs, passing other race cars including a green and white vehicle with \"Bauhaus\" branding.\n- The driver's hands are visible on the steering wheel, actively controlling the vehicle as it maneuvers through the track.\n[420-450s] - Safety car is visible on track, with driver's dashboard showing lap count decreasing from 5 to 3.\n- On-screen overlay displays \"Safety Car\" and \"Stopped recording\" text, indicating race status.\n- Driver's view shows track ahead with other cars following safety car, and a small inset map showing car positions.\n[450-480s] - Safety car restart text appears on screen as cars resume racing.  \n- Driver’s dashboard displays lap time and position updates.  \n- Right-side monitor shows live race telemetry with multiple cars on track.\n[480-510s] - Red race car ahead, slightly to the right, maintains a lead position on the track.\n- Driver’s cockpit view shows a digital dashboard with speed and gear indicators, and a steering wheel with multiple buttons.\n- Right-side screen displays a live race map with multiple cars, including the red car, positioned on the track.\n[510-540s] - Driver's steering wheel displays multiple colored buttons and a Porsche logo, with a digital dashboard showing speed, gear, and lap times.\n- The windshield wipers are active, clearing rain from the view of the track ahead, which features red and yellow curbs and green grass.\n- A small inset screen in the lower right corner shows a wider view of the race track with multiple cars navigating turns and straights.\n[540-570s] - Driver's gloved hand grips the steering wheel, with a visible hexagonal pattern on the glove.\n- The digital dashboard displays a speed of 120 km/h and a gear indicator showing gear 2.\n- The car is on a racetrack with other vehicles visible ahead, including a red car in the distance.\n[570-600s] - Driver's hands grip the steering wheel with colorful buttons, actively maneuvering the car through a turn.  \n- The dashboard displays fluctuating speed and gear indicators, showing active race dynamics.  \n- A small screen on the right shows a live race map with multiple cars, including an orange car ahead and a red car to the left.\n[600-630s] - Red race car ahead, slightly to the left, maintains position as the camera car follows.  \n- Dashboard displays fluctuating speed and lap data, indicating active racing conditions.  \n- Right-side screen shows a wider track view with multiple cars, including a yellow and blue vehicle overtaking.\n[630-660s] - Red race car ahead, slightly slower, with driver's car overtaking it on the track.\n- Driver's car dashboard shows gear changes and speed fluctuations, indicating active racing maneuvers.\n- On-screen text \"Braked to late\" appears, suggesting a tactical error or delay in braking.\n[660-690s] - Driver's hands grip the steering wheel, with a digital dashboard displaying speed, gear, and lap times.\n- The car navigates a turn, with the windshield showing other race cars ahead and a red car overtaking.\n- A small inset screen in the lower right corner shows a wider view of the track with multiple cars racing.", "history_tokens": 998, "history_utf8_bytes": 4362, "recent_frame_times_s": [673.0056666666667, 674.0066666666667, 675.0076666666666, 676.0086666666666, 677.0096666666667, 678.0106666666667, 679.0116666666667, 680.0126666666666, 681.0136666666667, 682.0146666666667, 683.0156666666667, 684.0166666666667, 685.0009833333334, 686.0019833333333, 687.0029833333333, 688.0039833333333, 689.0049833333334, 690.0059833333333, 691.0069833333333, 692.0079833333333, 693.0089833333334, 694.0099833333334, 695.0109833333333, 696.0119833333333, 697.0129833333333, 698.0139833333334, 699.0149833333334, 700.0159833333333, 701.0003, 702.0013], "recent_frames_sha256": "24a5e0aa61d5be78a65e7a86c44a184df62064229a189b713e686082a964197e", "num_recent_frames": 30, "tq": 718898.484462597, "t1": 718900.297333752, "ta": 718900.297333752, "te": 718900.498340101, "first_response_s": 1.8128711549798027, "answer_total_s": 2.0138775039231405, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 253, "content_group": "9a86f6879038e511552a1da8d9985f24ade289d8a0d66398ed5ab99d12e05ccc", "question": {"question_id": "sample_253_a1736_q0", "video_id": 253, "video_path": "./videos/sample_253_real.mp4", "annotation_index": 1736, "question_index": 0, "question": "Which brand's logo is visible at the trackside right now?", "options": ["A. Shell.", "B. ExxonMobil.", "C. BP.", "D. TotalEnergies."], "answer": "D", "time_stamp_s": 936, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [932, 937], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_253_a1736_q0", "video_id": 253, "time_stamp_s": 936, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "da6ce510c48789cfb29b09dc82562c382e12b5c00df10f62b742e1afa5af459b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [906.0051, 907.0061, 908.0071, 909.0081, 910.0091, 911.0101, 912.0111, 913.0121, 914.0131, 915.0141, 916.0151, 917.0161, 918.0004166666666, 919.0014166666666, 920.0024166666667, 921.0034166666667, 922.0044166666667, 923.0054166666666, 924.0064166666667, 925.0074166666667, 926.0084166666667, 927.0094166666667, 928.0104166666666, 929.0114166666667, 930.0124166666667, 931.0134166666667, 932.0144166666666, 933.0154166666666, 934.0164166666667, 935.0007333333333], "recent_frames_sha256": "0b6b76235983004ca0a01410e1958949977d05e573b2f0d2bc8903b9f956eebb", "num_recent_frames": 30, "tq": 718675.035788957, "t1": 718686.31317712, "ta": 718686.31317712, "te": 718686.350857059, "first_response_s": 11.277388163027354, "answer_total_s": 11.315068101976067, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_253_a1736_q0", "video_id": 253, "time_stamp_s": 936, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ffebb05670e6bc862d013b1d45c1c0b17b740f37f09909407de25c1f672f6267", "condition_order": ["recent", "notes"], "memory": "[570-600s] - Driver's hands grip the steering wheel with colorful buttons, actively maneuvering the car through a turn.  \n- The dashboard displays fluctuating speed and gear indicators, showing active race dynamics.  \n- A small screen on the right shows a live race map with multiple cars, including an orange car ahead and a red car to the left.\n[600-630s] - Red race car ahead, slightly to the left, maintains position as the camera car follows.  \n- Dashboard displays fluctuating speed and lap data, indicating active racing conditions.  \n- Right-side screen shows a wider track view with multiple cars, including a yellow and blue vehicle overtaking.\n[630-660s] - Red race car ahead, slightly slower, with driver's car overtaking it on the track.\n- Driver's car dashboard shows gear changes and speed fluctuations, indicating active racing maneuvers.\n- On-screen text \"Braked to late\" appears, suggesting a tactical error or delay in braking.\n[660-690s] - Driver's hands grip the steering wheel, with a digital dashboard displaying speed, gear, and lap times.\n- The car navigates a turn, with the windshield showing other race cars ahead and a red car overtaking.\n- A small inset screen in the lower right corner shows a wider view of the track with multiple cars racing.\n[690-720s] - Driver's cockpit view shows a Porsche race car with a digital dashboard displaying speed, gear, and lap time; steering wheel has multiple buttons and a Porsche logo.\n- A red race car is visible ahead on the track, with other cars in the distance, indicating a competitive racing environment.\n- The track features green and yellow curbs, with sponsor banners like \"Michelin\" and \"Liqui Moly\" visible along the sides.\n[720-750s] - Red race car ahead, slightly to the left, maintains a steady pace on the track.  \n- Driver’s hands on steering wheel, with gloves visible, actively maneuvering the vehicle.  \n- Dashboard displays fluctuating speed and gear indicators, suggesting active racing conditions.\n[750-780s] - Driver's cockpit view shows a red race car ahead, with a digital display indicating lap 4 and speed around 220 km/h.\n- The rearview mirror reflects the track and other cars, with a yellow line tracing the driver's path.\n- A small inset screen on the right shows a wider track view, highlighting the race dynamics and overtaking maneuvers.\n[780-810s] - Driver's dashboard displays lap time 5:00 and gear 5, with a digital clock showing 7:00.\n- The driver's POV shows a yellow Porsche 911 GT3 Cup car ahead, navigating a turn with visible trackside barriers.\n- A small inset screen in the bottom right corner shows a wider view of the race track with multiple cars, including an orange and a blue vehicle.\n[810-840s] - Driver's gloved hand grips the steering wheel, with a visible Porsche logo and multiple control buttons.  \n- The dashboard displays shifting gear indicators (4, 3, 2) and telemetry data as the car navigates a turn.  \n- A small screen on the right shows a live race view with multiple cars, including an orange car ahead and a blue car to the right.\n[840-870s] - Driver's steering wheel with Porsche logo and multiple colored buttons is visible, with gloved hands actively manipulating controls.  \n- Dashboard displays fluctuating speed and gear indicators, showing active racing conditions.  \n- A small inset screen on the right shows a wider view of the track, with multiple cars visible, including an orange car ahead.\n[870-900s] - Dashboard displays fluctuating speed (e.g., 5.6, 6.0, 6.8) and gear indicators (e.g., 4, 5, 6) as the car accelerates.\n- Steering wheel features multiple colored buttons and a central Porsche logo, with a visible driver's gloved hand gripping it.\n- Track ahead shows multiple cars, including a red vehicle overtaking, and a yellow safety vehicle approaching from behind.\n[900-930s] - The driver's cockpit view shows a Porsche race car with a digital dashboard displaying lap times and gear positions, including a visible \"S\" for \"Sprint\" mode at 9:22.\n- The car is navigating a track with visible barriers and sponsor banners, including \"Porsche\" and \"Porsche Motorsport\" signage.\n- A small inset screen in the bottom right corner shows a live feed of the race track from a different angle, with cars visible in motion.", "history_tokens": 1013, "history_utf8_bytes": 4275, "recent_frame_times_s": [906.0051, 907.0061, 908.0071, 909.0081, 910.0091, 911.0101, 912.0111, 913.0121, 914.0131, 915.0141, 916.0151, 917.0161, 918.0004166666666, 919.0014166666666, 920.0024166666667, 921.0034166666667, 922.0044166666667, 923.0054166666666, 924.0064166666667, 925.0074166666667, 926.0084166666667, 927.0094166666667, 928.0104166666666, 929.0114166666667, 930.0124166666667, 931.0134166666667, 932.0144166666666, 933.0154166666666, 934.0164166666667, 935.0007333333333], "recent_frames_sha256": "0b6b76235983004ca0a01410e1958949977d05e573b2f0d2bc8903b9f956eebb", "num_recent_frames": 30, "tq": 718990.978688605, "t1": 718997.188256725, "ta": 718997.188256725, "te": 718997.22726233, "first_response_s": 6.209568119957112, "answer_total_s": 6.248573724995367, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 254, "content_group": "dbd3f54f0c2f65c8937a34d9342bfca2abfc1a2a31646916501d34d3160388c9", "question": {"question_id": "sample_254_a717_q0", "video_id": 254, "video_path": "./videos/sample_254_real.mp4", "annotation_index": 717, "question_index": 0, "question": "What is currently written on the sign visible in the video?", "options": ["A. START.", "B. GO!.", "C. MICRO.", "D. WHOOP."], "answer": "D", "time_stamp_s": 3, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_254_a717_q0", "video_id": 254, "time_stamp_s": 3, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7a2e8bd6411c8fa048ffaf14d8d6bf36f6d272f86b7d65ae644c356b0b51581f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002], "recent_frames_sha256": "b9c671bc49d572464bfaea87c433893d968a49df43984053859a9ef6f4c0fb9c", "num_recent_frames": 3, "tq": 718264.72370681, "t1": 718265.321666095, "ta": 718265.321666095, "te": 718265.361342985, "first_response_s": 0.5979592850198969, "answer_total_s": 0.6376361749134958, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_254_a717_q0", "video_id": 254, "time_stamp_s": 3, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "145364417ef51891577047dd8488d472df7ec8cff2d251ac3992ab93bc6e62b0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002], "recent_frames_sha256": "b9c671bc49d572464bfaea87c433893d968a49df43984053859a9ef6f4c0fb9c", "num_recent_frames": 3, "tq": 718185.22025913, "t1": 718196.919270125, "ta": 718196.919270125, "te": 718197.188089094, "first_response_s": 11.699010994983837, "answer_total_s": 11.967829964007251, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 254, "content_group": "dbd3f54f0c2f65c8937a34d9342bfca2abfc1a2a31646916501d34d3160388c9", "question": {"question_id": "sample_254_a718_q0", "video_id": 254, "video_path": "./videos/sample_254_real.mp4", "annotation_index": 718, "question_index": 0, "question": "What is written on the yellow brand visible right now?", "options": ["A. FINISH.", "B. START.", "C. ALERT.", "D. TIMING."], "answer": "D", "time_stamp_s": 52, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [48, 53], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_254_a718_q0", "video_id": 254, "time_stamp_s": 52, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a21d720a62442f6a7b55544a3e0187e63df4b044542e4aebb556119f2b59920f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [22.022, 23.023, 24.024, 25.025, 26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336], "recent_frames_sha256": "bb80867f1f61d6ed953fe8bd4b0776947ed41bd69a3c3c540a005fa2a843aff6", "num_recent_frames": 30, "tq": 718265.375752656, "t1": 718278.454053009, "ta": 718278.454053009, "te": 718278.492323398, "first_response_s": 13.078300353023224, "answer_total_s": 13.116570741985925, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_254_a718_q0", "video_id": 254, "time_stamp_s": 52, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e24ae29c360a9cbc04b42838055306c5fbb3a00dfc9002c0cf2ac475a3860166", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mountain biker rides downhill on a dirt trail, navigating turns and jumps with visible handlebars and front wheel.  \n- Trail is bordered by green tape and branded banners, including \"GoPro\" and \"WOOOP,\" indicating a race or event setting.  \n- Biker's hands grip handlebars with gloves, and the camera perspective shifts slightly as they maneuver through the course.", "history_tokens": 85, "history_utf8_bytes": 375, "recent_frame_times_s": [22.022, 23.023, 24.024, 25.025, 26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336], "recent_frames_sha256": "bb80867f1f61d6ed953fe8bd4b0776947ed41bd69a3c3c540a005fa2a843aff6", "num_recent_frames": 30, "tq": 718207.325869867, "t1": 718210.288159411, "ta": 718210.288159411, "te": 718210.329516989, "first_response_s": 2.9622895440552384, "answer_total_s": 3.0036471219500527, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 254, "content_group": "dbd3f54f0c2f65c8937a34d9342bfca2abfc1a2a31646916501d34d3160388c9", "question": {"question_id": "sample_254_a719_q0", "video_id": 254, "video_path": "./videos/sample_254_real.mp4", "annotation_index": 719, "question_index": 0, "question": "What color predominantly describes the bike's front suspension that is visible right now?", "options": ["A. Orange.", "B. Green.", "C. Blue.", "D. Red."], "answer": "A", "time_stamp_s": 97, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [96, 101], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_254_a719_q0", "video_id": 254, "time_stamp_s": 97, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f0f5d2c58432664ebefb0c302d2e7a0b9912ecb0c2126f5f3543f4409df8c244", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.01726666666667, 85.01826666666666, 86.01926666666667, 87.02026666666667, 88.02126666666666, 89.02226666666667, 90.02326666666667, 91.02426666666666, 92.02526666666667, 93.02626666666667, 94.02726666666666, 95.02826666666667, 96.02926666666667], "recent_frames_sha256": "2b03ea7cef2fd7e86378db107d47f4af42a61f38a4cfc31a22d95e4ff206c38f", "num_recent_frames": 30, "tq": 718278.513088969, "t1": 718286.255827821, "ta": 718286.255827821, "te": 718286.293261964, "first_response_s": 7.742738851928152, "answer_total_s": 7.780172994942404, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_254_a719_q0", "video_id": 254, "time_stamp_s": 97, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1f9bfeb0ee65423efb328b2f2583e7138ae902dcf905c915dbc135c2d6433298", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mountain biker rides downhill on a dirt trail, navigating turns and jumps with visible handlebars and front wheel.  \n- Trail is bordered by green tape and branded banners, including \"GoPro\" and \"WOOOP,\" indicating a race or event setting.  \n- Biker's hands grip handlebars with gloves, and the camera perspective shifts slightly as they maneuver through the course.\n[30-60s] - Rider navigates a dirt trail with visible yellow boundary markers on either side.  \n- Other riders are seen ahead, some on bikes, others standing near the course.  \n- Terrain includes loose dirt, small rocks, and tree-lined sections with occasional jumps or drops.\n[60-90s] - Rider navigates a dirt trail with visible tree roots and loose soil, passing red and yellow markers.  \n- A wooden ramp structure appears ahead, followed by a section with a metal grid surface.  \n- Rider approaches a downhill section with a steep drop-off, surrounded by greenery and distant spectators.", "history_tokens": 216, "history_utf8_bytes": 965, "recent_frame_times_s": [67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.01726666666667, 85.01826666666666, 86.01926666666667, 87.02026666666667, 88.02126666666666, 89.02226666666667, 90.02326666666667, 91.02426666666666, 92.02526666666667, 93.02626666666667, 94.02726666666666, 95.02826666666667, 96.02926666666667], "recent_frames_sha256": "2b03ea7cef2fd7e86378db107d47f4af42a61f38a4cfc31a22d95e4ff206c38f", "num_recent_frames": 30, "tq": 718223.502649367, "t1": 718225.69619201, "ta": 718225.69619201, "te": 718226.039639936, "first_response_s": 2.1935426429845393, "answer_total_s": 2.536990568973124, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 254, "content_group": "dbd3f54f0c2f65c8937a34d9342bfca2abfc1a2a31646916501d34d3160388c9", "question": {"question_id": "sample_254_a720_q0", "video_id": 254, "video_path": "./videos/sample_254_real.mp4", "annotation_index": 720, "question_index": 0, "question": "What color is the barrier predominantly visible on the sides of the track right now?", "options": ["A. Yellow.", "B. Red.", "C. Blue.", "D. Green."], "answer": "A", "time_stamp_s": 147, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [144, 149], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_254_a720_q0", "video_id": 254, "time_stamp_s": 147, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e4aa00814a9640306ef822080b1c3ef2ce156a4c5981c29fa35f73e9bbc3a735", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332], "recent_frames_sha256": "b2ab6926d2bc394eedfefd44d7a677c5abcd820498e7317b1bca71a8ef6ee474", "num_recent_frames": 30, "tq": 718286.311186537, "t1": 718300.097115546, "ta": 718300.097115546, "te": 718300.137629983, "first_response_s": 13.785929008969106, "answer_total_s": 13.826443445985205, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_254_a720_q0", "video_id": 254, "time_stamp_s": 147, "ground_truth": "A", "raw_output": "A. Yellow.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "9c21137b39dc9661d1bda98686f5782e18d78fc38890eb2ddacaa26eccf275d5", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mountain biker rides downhill on a dirt trail, navigating turns and jumps with visible handlebars and front wheel.  \n- Trail is bordered by green tape and branded banners, including \"GoPro\" and \"WOOOP,\" indicating a race or event setting.  \n- Biker's hands grip handlebars with gloves, and the camera perspective shifts slightly as they maneuver through the course.\n[30-60s] - Rider navigates a dirt trail with visible yellow boundary markers on either side.  \n- Other riders are seen ahead, some on bikes, others standing near the course.  \n- Terrain includes loose dirt, small rocks, and tree-lined sections with occasional jumps or drops.\n[60-90s] - Rider navigates a dirt trail with visible tree roots and loose soil, passing red and yellow markers.  \n- A wooden ramp structure appears ahead, followed by a section with a metal grid surface.  \n- Rider approaches a downhill section with a steep drop-off, surrounded by greenery and distant spectators.\n[90-120s] - Rider navigates a dirt trail with visible tree roots and loose soil, passing yellow boundary markers.  \n- A blue banner with \"SHIMANO\" branding is seen on the right side of the trail.  \n- Other riders are visible ahead, with one in red gear approaching a turn.", "history_tokens": 284, "history_utf8_bytes": 1238, "recent_frame_times_s": [117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332], "recent_frames_sha256": "b2ab6926d2bc394eedfefd44d7a677c5abcd820498e7317b1bca71a8ef6ee474", "num_recent_frames": 30, "tq": 718231.612389817, "t1": 718238.863989258, "ta": 718238.863989258, "te": 718239.057082017, "first_response_s": 7.251599440933205, "answer_total_s": 7.444692199933343, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 254, "content_group": "dbd3f54f0c2f65c8937a34d9342bfca2abfc1a2a31646916501d34d3160388c9", "question": {"question_id": "sample_254_a721_q0", "video_id": 254, "video_path": "./videos/sample_254_real.mp4", "annotation_index": 721, "question_index": 0, "question": "What is the name displayed on the white banners on the sides of the track right now?", "options": ["A. BikeLand.", "B. Whoop.", "C. Timing.", "D. Val di Sole."], "answer": "D", "time_stamp_s": 193, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [192, 197], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_254_a721_q0", "video_id": 254, "time_stamp_s": 193, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "686432b76921a95c4341724e64185730b97664dae065d4db729f075fdcb40419", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668], "recent_frames_sha256": "b3bee2fd3b6d02ec98405e5f005801fa236a4c572478b8d5caf0b59e4c7a8c3f", "num_recent_frames": 30, "tq": 718300.158301453, "t1": 718314.777912527, "ta": 718314.777912527, "te": 718314.817485175, "first_response_s": 14.619611073983833, "answer_total_s": 14.659183721989393, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_254_a721_q0", "video_id": 254, "time_stamp_s": 193, "ground_truth": "D", "raw_output": "D. Val di Sole.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "f20f98b3d7287c45dc06ef0bbe9f35e5079bdb4060a0b96658ae524419cc70f0", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mountain biker rides downhill on a dirt trail, navigating turns and jumps with visible handlebars and front wheel.  \n- Trail is bordered by green tape and branded banners, including \"GoPro\" and \"WOOOP,\" indicating a race or event setting.  \n- Biker's hands grip handlebars with gloves, and the camera perspective shifts slightly as they maneuver through the course.\n[30-60s] - Rider navigates a dirt trail with visible yellow boundary markers on either side.  \n- Other riders are seen ahead, some on bikes, others standing near the course.  \n- Terrain includes loose dirt, small rocks, and tree-lined sections with occasional jumps or drops.\n[60-90s] - Rider navigates a dirt trail with visible tree roots and loose soil, passing red and yellow markers.  \n- A wooden ramp structure appears ahead, followed by a section with a metal grid surface.  \n- Rider approaches a downhill section with a steep drop-off, surrounded by greenery and distant spectators.\n[90-120s] - Rider navigates a dirt trail with visible tree roots and loose soil, passing yellow boundary markers.  \n- A blue banner with \"SHIMANO\" branding is seen on the right side of the trail.  \n- Other riders are visible ahead, with one in red gear approaching a turn.\n[120-150s] - Rider navigates a dirt trail with visible tree roots and rocks, passing under a red \"TREK\" banner.  \n- Handlebars show \"FOX\" branding, and the rider's gloved hands grip the controls as they maneuver through the course.  \n- Spectators and event staff are visible along the trail’s edges, with some standing near a blue banner.\n[150-180s] - Rider navigates a dirt trail with visible tree-lined edges and sponsor banners (e.g., \"SHIMANO\", \"Trentino\") on either side.\n- The trail features a mix of straight sections and slight turns, with the rider maintaining a steady pace.\n- Spectators and event staff are visible in the background, positioned along the course boundaries.", "history_tokens": 451, "history_utf8_bytes": 1925, "recent_frame_times_s": [163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668], "recent_frames_sha256": "b3bee2fd3b6d02ec98405e5f005801fa236a4c572478b8d5caf0b59e4c7a8c3f", "num_recent_frames": 30, "tq": 718256.824697311, "t1": 718264.409278805, "ta": 718264.409278805, "te": 718264.675837087, "first_response_s": 7.584581493982114, "answer_total_s": 7.851139775943011, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 255, "content_group": "bb27676aa6719f356a77e044d71e51749a54247ee3bc6bf8bbea977a8522d5cb", "question": {"question_id": "sample_255_a1480_q0", "video_id": 255, "video_path": "./videos/sample_255_real.mp4", "annotation_index": 1480, "question_index": 0, "question": "What is visible near the goal post just now?", "options": ["A. A coach in a fluorescent vest.", "B. A player with a blue and yellow jersey.", "C. A spectator with a hat.", "D. A referee with a flag."], "answer": "D", "time_stamp_s": 6, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "football", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_255_a1480_q0", "video_id": 255, "time_stamp_s": 6, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f58d941fb1da50bb0dd7d5888120b84cc51ed75d4dc11ba786763c2e4e5c94e1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0], "recent_frames_sha256": "d6c259cf8c9d890fc173aefe0ade122d55ee29e7fd63d1b2c526bf15482ddb4e", "num_recent_frames": 7, "tq": 716671.557539283, "t1": 716676.690231861, "ta": 716676.690231861, "te": 716676.727547175, "first_response_s": 5.132692578015849, "answer_total_s": 5.170007892069407, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_255_a1480_q0", "video_id": 255, "time_stamp_s": 6, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8931852e3ee40425eac66bb8a5592c1358b4e333eefe69a1505e2db8d263de0c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0], "recent_frames_sha256": "d6c259cf8c9d890fc173aefe0ade122d55ee29e7fd63d1b2c526bf15482ddb4e", "num_recent_frames": 7, "tq": 716709.874035658, "t1": 716716.238943092, "ta": 716716.238943092, "te": 716716.467240168, "first_response_s": 6.364907433977351, "answer_total_s": 6.593204510048963, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 255, "content_group": "bb27676aa6719f356a77e044d71e51749a54247ee3bc6bf8bbea977a8522d5cb", "question": {"question_id": "sample_255_a1481_q0", "video_id": 255, "video_path": "./videos/sample_255_real.mp4", "annotation_index": 1481, "question_index": 0, "question": "What indicates that the players are taking a break?", "options": ["A. The players are lying down.", "B. The players are leaving the field.", "C. The game is stopped by the referee.", "D. The subtitle mentions it is time for a water break."], "answer": "D", "time_stamp_s": 284, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "football", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_255_a1481_q0", "video_id": 255, "time_stamp_s": 284, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c9fd1f9f6b9df778bda6804ea005a43f50286a01863d62c4151c62f60099700d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0], "recent_frames_sha256": "ed03fc4ce1509782e839b2c7f9329258801ca35aa6fa8507277af20192b8cedb", "num_recent_frames": 30, "tq": 716676.764853029, "t1": 716682.96152052, "ta": 716682.96152052, "te": 716683.188232566, "first_response_s": 6.196667490992695, "answer_total_s": 6.423379536950961, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_255_a1481_q0", "video_id": 255, "time_stamp_s": 284, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5ce93f58af0e83eb1d7f312b8f22966d8fbbfe5d3a419e1c7c1d3e586375bdea", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Player in black jersey controls ball, passes to teammate near goal; goalkeeper in yellow jersey prepares to defend.\n- Player in gray jersey with number 32 runs toward ball, then turns to face opponent; ball is kicked toward goal.\n- Camera perspective shifts to first-person view as player kicks ball, then transitions to street scene with Korean text overlay.\n[30-60s] - A man in a blue jersey gestures toward distant players on a grassy field, indicating team members from Sweden, the U.S., and Canada.  \n- A player in a white jersey stands near blue chairs under a canopy, interacting with others in a relaxed setting.  \n- The camera pans across a wide, green football pitch with players scattered, suggesting pre-game or training activities.\n[60-90s] - A player in a white jersey runs toward the ball, preparing to receive it.  \n- The ball rolls across the grass toward the camera’s perspective.  \n- A shadow of the camera operator is visible on the field, indicating the camera’s position.\n[90-120s] - A player in a dark uniform executes a tackle, causing the ball to be deflected and leading to a goal.  \n- The camera follows the ball’s trajectory as it crosses the goal line, with the word \"GOAL\" displayed on screen.  \n- A replay shows a pass made by the Korean team, followed by a goal scored by the US EU team, with text overlay confirming the first goal.\n[120-150s] - Player in dark kit runs toward ball, preparing to intercept or challenge opponent.  \n- Ball is in motion, being controlled or passed by a player near center of field.  \n- Shadow of camera operator visible on grass, indicating first-person perspective.\n[150-180s] - A player in a blue jersey kicks the ball toward the goal, with teammates and opponents visible in the background.\n- The ball is seen rolling toward the goal as a player in a white jersey runs toward it, suggesting an attempt to score.\n- A player in a white jersey is seen celebrating after a goal, with the text \"Jay GOAL\" displayed on screen.\n[180-210s] - Player in white jersey (Jay) receives pass and executes a body feint before shooting.  \n- Player in dark jersey (Min) attempts to intercept but fails to stop Jay’s shot.  \n- Camera perspective shifts to first-person view, showing the player’s hand reaching toward the ball after the shot.\n[210-240s] - Player in blue jersey (number 30) runs toward the ball, preparing to intercept or pass.\n- A player in a yellow jersey is seen near the ball, possibly preparing to receive or clear it.\n- The camera wearer’s shadow is visible on the grass, indicating their position and movement relative to the action.\n[240-270s] - Player in dark jersey (no. 24) runs toward ball, then kicks it after a pass from teammate.  \n- Player in white jersey (no. 10) receives the ball near sideline, then passes to teammate.  \n- Ball is kicked into goal area, and a player in white jersey celebrates after scoring.", "history_tokens": 684, "history_utf8_bytes": 2912, "recent_frame_times_s": [255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0], "recent_frames_sha256": "ed03fc4ce1509782e839b2c7f9329258801ca35aa6fa8507277af20192b8cedb", "num_recent_frames": 30, "tq": 716797.278280692, "t1": 716799.392176986, "ta": 716799.392176986, "te": 716799.667041773, "first_response_s": 2.113896294031292, "answer_total_s": 2.3887610810343176, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 255, "content_group": "bb27676aa6719f356a77e044d71e51749a54247ee3bc6bf8bbea977a8522d5cb", "question": {"question_id": "sample_255_a1482_q0", "video_id": 255, "video_path": "./videos/sample_255_real.mp4", "annotation_index": 1482, "question_index": 0, "question": "What event are the players celebrating right now?", "options": ["A. Scoring the first goal.", "B. Winning the game.", "C. A penalty kick.", "D. Equalizing the score."], "answer": "D", "time_stamp_s": 580, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "football", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_255_a1482_q0", "video_id": 255, "time_stamp_s": 580, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c8b1c46fbb6fa16ba139e9f546f0472024b2fdfb7df3c9e93c9df75240ca87ce", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0, 561.0, 562.0, 563.0, 564.0, 565.0, 566.0, 567.0, 568.0, 569.0, 570.0, 571.0, 572.0, 573.0, 574.0, 575.0, 576.0, 577.0, 578.0, 579.0, 580.0], "recent_frames_sha256": "8c44a3fe4fcb4b5178c03b8ab47365faa1ff9b56cc85a8cf000134f98abf9ab5", "num_recent_frames": 30, "tq": 716683.206302272, "t1": 716690.841588157, "ta": 716690.841588157, "te": 716690.881257151, "first_response_s": 7.635285884956829, "answer_total_s": 7.674954878981225, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_255_a1482_q0", "video_id": 255, "time_stamp_s": 580, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b3375e3f1c5c2705033d0ccee656da9045e0513b26ad34a74cb4e85a55062ae8", "condition_order": ["recent", "notes"], "memory": "[180-210s] - Player in white jersey (Jay) receives pass and executes a body feint before shooting.  \n- Player in dark jersey (Min) attempts to intercept but fails to stop Jay’s shot.  \n- Camera perspective shifts to first-person view, showing the player’s hand reaching toward the ball after the shot.\n[210-240s] - Player in blue jersey (number 30) runs toward the ball, preparing to intercept or pass.\n- A player in a yellow jersey is seen near the ball, possibly preparing to receive or clear it.\n- The camera wearer’s shadow is visible on the grass, indicating their position and movement relative to the action.\n[240-270s] - Player in dark jersey (no. 24) runs toward ball, then kicks it after a pass from teammate.  \n- Player in white jersey (no. 10) receives the ball near sideline, then passes to teammate.  \n- Ball is kicked into goal area, and a player in white jersey celebrates after scoring.\n[270-300s] - Players in white and dark uniforms actively engage in a soccer match on a grassy field under bright sunlight.\n- A player in a yellow jersey is seen running with the ball, preparing to make a pass or advance.\n- The field is surrounded by trees and a large building, with spectators or staff visible in the background.\n[300-330s] - Player in dark jersey (number 11) runs toward ball, preparing to receive a pass.  \n- Ball is kicked forward by another player, moving toward the center of the field.  \n- A player in green jersey runs toward the ball, positioning for a potential interception or pass.\n[330-360s] - Player in white jersey dribbles ball while teammates move in midfield, with text overlay indicating \"This skill useful in midfield areas\".\n- Player in dark jersey performs a \"Switch Long kick\" after receiving the ball, with teammates positioned to receive the pass.\n- Camera angle shifts to show a wide view of the field, including a player's shadow and distant buildings, with text \"Look around\" appearing.\n[360-390s] - A player in a dark jersey (number 35) runs toward the ball, preparing to intercept or challenge an opponent.  \n- The ball is in motion, being passed or kicked by another player, with the camera following its trajectory.  \n- The field is marked with white lines, and spectators are visible under blue tents in the background.\n[390-420s] - Player in white jersey (Choeol) executes a left-footed cross from outside the penalty area, targeting the goal.\n- Player in dark jersey (Koo) receives the ball near the goal line and scores a goal, as indicated by the replay text.\n- After the goal, Choeol is seen walking away, visibly reacting to the play, while another player (Jay) is nearby, with on-screen text suggesting a humorous exchange about the pass.\n[420-450s] - A player in a blue jersey runs toward the ball, preparing to receive it.  \n- The ball is positioned near the center of the field, with multiple players surrounding it.  \n- A player in a white jersey is seen running toward the ball, possibly attempting to intercept or challenge for possession.\n[450-480s] - A player in a blue jersey runs toward the ball, preparing to kick it.  \n- The ball is positioned near the center of the field, with a player in a black jersey nearby.  \n- A replay label appears on screen, indicating a review of the preceding play.\n[480-510s] - A player in a white jersey is seen walking toward the camera, with a coach in a green vest nearby.  \n- The camera perspective shifts to a first-person view, showing a ball on the grass and a player in a dark jersey approaching.  \n- A text overlay reads \"The end of the first half\" as players gather near the sideline.\n[510-540s] - A player in a dark jersey (number 20) runs toward the ball after a foul call.  \n- The ball is stationary on the grass near the camera’s shadow, indicating a stoppage in play.  \n- The camera’s shadow moves across the field as the player approaches, suggesting a first-person perspective.\n[540-570s] - A player in a dark jersey runs toward the ball, preparing to intercept or challenge an opponent.  \n- The ball is in mid-air, suggesting a pass or shot is being made, with players reacting to its trajectory.  \n- A shadow of the camera operator is visible on the grass, indicating a first-person perspective during the play.", "history_tokens": 1014, "history_utf8_bytes": 4243, "recent_frame_times_s": [551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0, 561.0, 562.0, 563.0, 564.0, 565.0, 566.0, 567.0, 568.0, 569.0, 570.0, 571.0, 572.0, 573.0, 574.0, 575.0, 576.0, 577.0, 578.0, 579.0, 580.0], "recent_frames_sha256": "8c44a3fe4fcb4b5178c03b8ab47365faa1ff9b56cc85a8cf000134f98abf9ab5", "num_recent_frames": 30, "tq": 716875.48317898, "t1": 716887.736507169, "ta": 716887.736507169, "te": 716887.773485189, "first_response_s": 12.253328189020976, "answer_total_s": 12.290306209004484, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 255, "content_group": "bb27676aa6719f356a77e044d71e51749a54247ee3bc6bf8bbea977a8522d5cb", "question": {"question_id": "sample_255_a1483_q0", "video_id": 255, "video_path": "./videos/sample_255_real.mp4", "annotation_index": 1483, "question_index": 0, "question": "What was the player recording this video prepared to do just now?", "options": ["A. Pass the ball.", "B. Tackle the defender.", "C. Block the ball.", "D. Take a shot."], "answer": "D", "time_stamp_s": 848, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "football", "reference_interval_s": [840, 900], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_255_a1483_q0", "video_id": 255, "time_stamp_s": 848, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b2f57f5ba31febd12301257affa147bdc84b1a87a4bff6fbb3f2271779e7b013", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [819.0, 820.0, 821.0, 822.0, 823.0, 824.0, 825.0, 826.0, 827.0, 828.0, 829.0, 830.0, 831.0, 832.0, 833.0, 834.0, 835.0, 836.0, 837.0, 838.0, 839.0, 840.0, 841.0, 842.0, 843.0, 844.0, 845.0, 846.0, 847.0, 848.0], "recent_frames_sha256": "9ef785b93331af6e159822441cdd94f63ffa31ff71bc887a56741228b0cd7469", "num_recent_frames": 30, "tq": 716690.901358506, "t1": 716702.503403554, "ta": 716702.503403554, "te": 716702.544085926, "first_response_s": 11.60204504802823, "answer_total_s": 11.642727420083247, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_255_a1483_q0", "video_id": 255, "time_stamp_s": 848, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "04a24fc0a9505fb8413517aab293b50447074929f84766d649c221b760a5bba1", "condition_order": ["recent", "notes"], "memory": "[450-480s] - A player in a blue jersey runs toward the ball, preparing to kick it.  \n- The ball is positioned near the center of the field, with a player in a black jersey nearby.  \n- A replay label appears on screen, indicating a review of the preceding play.\n[480-510s] - A player in a white jersey is seen walking toward the camera, with a coach in a green vest nearby.  \n- The camera perspective shifts to a first-person view, showing a ball on the grass and a player in a dark jersey approaching.  \n- A text overlay reads \"The end of the first half\" as players gather near the sideline.\n[510-540s] - A player in a dark jersey (number 20) runs toward the ball after a foul call.  \n- The ball is stationary on the grass near the camera’s shadow, indicating a stoppage in play.  \n- The camera’s shadow moves across the field as the player approaches, suggesting a first-person perspective.\n[540-570s] - A player in a dark jersey runs toward the ball, preparing to intercept or challenge an opponent.  \n- The ball is in mid-air, suggesting a pass or shot is being made, with players reacting to its trajectory.  \n- A shadow of the camera operator is visible on the grass, indicating a first-person perspective during the play.\n[570-600s] - Player in blue jersey runs toward ball, preparing for a pass or shot.  \n- Goalkeeper in green jersey stands ready near goalpost, anticipating play.  \n- Ball is in mid-air, indicating a pass or shot is being executed.\n[600-630s] - A player in a blue jersey runs toward the goal, appearing to chase the ball after a pass.  \n- The camera wearer, wearing a white cap, is seen running across the field, likely in pursuit of the ball or reacting to play.  \n- A player in a black shirt is visible near the goal area, possibly preparing to defend or react to the play.\n[630-660s] - Player Jay executes a side movement, then passes to Uram, who scores a goal.  \n- The replay shows Jay’s movement and Uram’s finish, with the text “Wonderful Finish by Uram” appearing.  \n- The scene transitions to a US/EU attack, with players running toward the goal, and a Korean team player is shown losing a point.\n[660-690s] - A player in a white jersey runs toward the ball, preparing to kick it.  \n- The camera perspective shows a first-person view of a player’s feet near the ball, with the ball rolling forward.  \n- Other players are scattered across the field, some in motion, others stationary, near the goal area.\n[690-720s] - Players in dark and light jerseys actively engage in a soccer match on a grass field, with one player in a dark jersey running toward the ball.\n- A text overlay at 698 seconds indicates a \"Water break time,\" suggesting a pause in the game.\n- At 701 seconds, a player in a white jersey is seen walking toward the camera while speaking, with other players visible in the background.\n[720-750s] - A player in a dark shirt runs toward the ball, preparing to kick it.  \n- The ball is positioned near the center of the field, with players scattered around.  \n- A shadow of the camera operator is visible on the grass, indicating a first-person perspective.\n[750-780s] - A white soccer ball rolls across a green field toward a goal, with a goalkeeper in yellow gear positioned to defend.\n- A player in a white jersey (Jay) dribbles the ball 60 meters, evading opponents while running toward the goal.\n- The Korean team’s score is displayed as 6-5, indicating a close match with a lead for the Korean team.\n[780-810s] - A player in a dark jersey is seen running with the ball, then trips and falls on the grass.  \n- Another player in a light-colored jersey is shown standing near the fallen player, appearing to assist or check on them.  \n- The camera angle shifts to a first-person view, showing the player’s legs and feet as they stand up, with text overlay indicating an injury.\n[810-840s] - A player in a white jersey runs toward the ball, preparing to pass or shoot.  \n- The ball is visible on the grass, near the center of the field, with players surrounding it.  \n- A player in a black jersey is seen running toward the ball, possibly to intercept or challenge.", "history_tokens": 1011, "history_utf8_bytes": 4130, "recent_frame_times_s": [819.0, 820.0, 821.0, 822.0, 823.0, 824.0, 825.0, 826.0, 827.0, 828.0, 829.0, 830.0, 831.0, 832.0, 833.0, 834.0, 835.0, 836.0, 837.0, 838.0, 839.0, 840.0, 841.0, 842.0, 843.0, 844.0, 845.0, 846.0, 847.0, 848.0], "recent_frames_sha256": "9ef785b93331af6e159822441cdd94f63ffa31ff71bc887a56741228b0cd7469", "num_recent_frames": 30, "tq": 716952.166712015, "t1": 716953.436541533, "ta": 716953.436541533, "te": 716953.661245674, "first_response_s": 1.2698295179288834, "answer_total_s": 1.4945336589589715, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 255, "content_group": "bb27676aa6719f356a77e044d71e51749a54247ee3bc6bf8bbea977a8522d5cb", "question": {"question_id": "sample_255_a1484_q0", "video_id": 255, "video_path": "./videos/sample_255_real.mp4", "annotation_index": 1484, "question_index": 0, "question": "What is the label on the box on the left?", "options": ["A. Recently upload video.", "B. Click!.", "C. Thanks for watching!.", "D. Recommended Video."], "answer": "D", "time_stamp_s": 1063, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "football", "reference_interval_s": [1020, 1063], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_255_a1484_q0", "video_id": 255, "time_stamp_s": 1063, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7b831a98c79771109e1732e33a3bf11fb416bd4477924c0b655aeaea3f16913a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [1034.0, 1035.0, 1036.0, 1037.0, 1038.0, 1039.0, 1040.0, 1041.0, 1042.0, 1043.0, 1044.0, 1045.0, 1046.0, 1047.0, 1048.0, 1049.0, 1050.0, 1051.0, 1052.0, 1053.0, 1054.0, 1055.0, 1056.0, 1057.0, 1058.0, 1059.0, 1060.0, 1061.0, 1062.0, 1063.0], "recent_frames_sha256": "4e1acc8172b3e148865b73b9ff01fd936c48c97b1cf992e7efa09a264c9363a7", "num_recent_frames": 30, "tq": 716702.565628884, "t1": 716709.823734225, "ta": 716709.823734225, "te": 716709.862098664, "first_response_s": 7.258105340995826, "answer_total_s": 7.296469780034386, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_255_a1484_q0", "video_id": 255, "time_stamp_s": 1063, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "504423759580140be7edb08ff5043dceef10ff9bf8fc12bbdbbb33c4d0af9539", "condition_order": ["recent", "notes"], "memory": "[690-720s] - Players in dark and light jerseys actively engage in a soccer match on a grass field, with one player in a dark jersey running toward the ball.\n- A text overlay at 698 seconds indicates a \"Water break time,\" suggesting a pause in the game.\n- At 701 seconds, a player in a white jersey is seen walking toward the camera while speaking, with other players visible in the background.\n[720-750s] - A player in a dark shirt runs toward the ball, preparing to kick it.  \n- The ball is positioned near the center of the field, with players scattered around.  \n- A shadow of the camera operator is visible on the grass, indicating a first-person perspective.\n[750-780s] - A white soccer ball rolls across a green field toward a goal, with a goalkeeper in yellow gear positioned to defend.\n- A player in a white jersey (Jay) dribbles the ball 60 meters, evading opponents while running toward the goal.\n- The Korean team’s score is displayed as 6-5, indicating a close match with a lead for the Korean team.\n[780-810s] - A player in a dark jersey is seen running with the ball, then trips and falls on the grass.  \n- Another player in a light-colored jersey is shown standing near the fallen player, appearing to assist or check on them.  \n- The camera angle shifts to a first-person view, showing the player’s legs and feet as they stand up, with text overlay indicating an injury.\n[810-840s] - A player in a white jersey runs toward the ball, preparing to pass or shoot.  \n- The ball is visible on the grass, near the center of the field, with players surrounding it.  \n- A player in a black jersey is seen running toward the ball, possibly to intercept or challenge.\n[840-870s] - A player in a white jersey is seen dribbling the ball near the goal line, preparing for a shot.  \n- Another player in a black jersey is positioned near the goal, appearing to defend or react to the play.  \n- The ball is in motion, heading toward the goal, with the goalkeeper in a ready stance to intercept.\n[870-900s] - A player in a black jersey runs toward the ball after a long pass, preparing to receive it.\n- The ball is positioned near the center of the field, with players from both teams scattered around.\n- A text overlay reads \"Korean Drogba GOAL\" as the ball is kicked into the goal.\n[900-930s] - A player in a black jersey with number 35 runs toward the ball, preparing to intercept or pass.  \n- The ball is stationary on the grass near the center line, with the camera wearer’s feet visible nearby.  \n- A player in a white jersey is positioned near the goal, appearing to defend or prepare for a shot.\n[930-960s] - Player in blue jersey (number 28) is seen running across the field, likely in pursuit of the ball or positioning for a play.  \n- A player in a white jersey is actively dribbling the ball, with teammates and opponents nearby, suggesting a dynamic play in progress.  \n- The camera perspective shifts to a first-person view, showing a player’s hand gesturing toward the ball, indicating a pass or switch in play.\n[960-990s] - A player in a white jersey dribbles the ball while being pursued by a defender in a blue jersey.  \n- The camera perspective shifts to show a player’s feet approaching the ball, indicating a potential pass or shot.  \n- A goalkeeper in a green jersey is visible near the goal, reacting to the play.\n[990-1020s] - A player in a dark jersey with the number 9 is seen walking on the field, interacting with teammates.\n- A goalkeeper in a white jersey is positioned near the goal, reacting to a play.\n- The field is marked with white lines, and players are scattered across the grassy pitch.\n[1020-1050s] - A player in a green and white jersey performs a soccer dribble maneuver on a grass field.  \n- Another player in a blue jersey is seen running with the ball, while a hand gestures toward the ball from the camera’s perspective.  \n- The scene transitions to a wide shot of a soccer field with multiple players in motion, suggesting an ongoing game or practice.", "history_tokens": 969, "history_utf8_bytes": 4009, "recent_frame_times_s": [1034.0, 1035.0, 1036.0, 1037.0, 1038.0, 1039.0, 1040.0, 1041.0, 1042.0, 1043.0, 1044.0, 1045.0, 1046.0, 1047.0, 1048.0, 1049.0, 1050.0, 1051.0, 1052.0, 1053.0, 1054.0, 1055.0, 1056.0, 1057.0, 1058.0, 1059.0, 1060.0, 1061.0, 1062.0, 1063.0], "recent_frames_sha256": "4e1acc8172b3e148865b73b9ff01fd936c48c97b1cf992e7efa09a264c9363a7", "num_recent_frames": 30, "tq": 717007.407189748, "t1": 717008.796485214, "ta": 717008.796485214, "te": 717008.836404277, "first_response_s": 1.38929546601139, "answer_total_s": 1.4292145289946347, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 256, "content_group": "596507ca0704c8c9495afe244131621177e44f379ebe8c08120ed16c2d8573e2", "question": {"question_id": "sample_256_a1151_q0", "video_id": 256, "video_path": "./videos/sample_256_real.mp4", "annotation_index": 1151, "question_index": 0, "question": "What does the text on the screen describe right now?", "options": ["A. A training session.", "B. A Neymar challenge.", "C. A match against a rival team.", "D. A skills competition."], "answer": "B", "time_stamp_s": 18, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "football", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_256_a1151_q0", "video_id": 256, "time_stamp_s": 18, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4db5b8bce890d8f676d9c66b3eddd8bbf4fc7398eb6bda4227b0656c32d9ac83", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667], "recent_frames_sha256": "11198dea3a3926de0b1774849290ab2904a8fadfb4a4e2d0ca9a402434e79144", "num_recent_frames": 18, "tq": 716953.696118798, "t1": 716954.598322122, "ta": 716954.598322122, "te": 716954.635669278, "first_response_s": 0.9022033240180463, "answer_total_s": 0.9395504799904302, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_256_a1151_q0", "video_id": 256, "time_stamp_s": 18, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "27708972d0c1ee4e0b9eb942580a1f6d7c728b8d29768cd0b53c00eb36f0ba14", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667], "recent_frames_sha256": "11198dea3a3926de0b1774849290ab2904a8fadfb4a4e2d0ca9a402434e79144", "num_recent_frames": 18, "tq": 716728.854218311, "t1": 716730.096313892, "ta": 716730.096313892, "te": 716730.143182197, "first_response_s": 1.2420955810230225, "answer_total_s": 1.2889638859778643, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 256, "content_group": "596507ca0704c8c9495afe244131621177e44f379ebe8c08120ed16c2d8573e2", "question": {"question_id": "sample_256_a1152_q0", "video_id": 256, "video_path": "./videos/sample_256_real.mp4", "annotation_index": 1152, "question_index": 0, "question": "What action is the player wearing the camera performed just now?", "options": ["A. Pass the ball.", "B. Dribble the ball.", "C. Kick the ball.", "D. Tackle an opponent."], "answer": "C", "time_stamp_s": 219, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "football", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_256_a1152_q0", "video_id": 256, "time_stamp_s": 219, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bed9c3cf8495a2ebb2184a41911857f5d9c9008a52d0fb77a5ed70f100726f3e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666, 218.00111666666666], "recent_frames_sha256": "61c2a72fecb5a98be5829745075a14196ea55e8cc65365c755d36e377ff889ae", "num_recent_frames": 30, "tq": 716954.662024518, "t1": 716968.00109506, "ta": 716968.00109506, "te": 716968.040279441, "first_response_s": 13.339070542016998, "answer_total_s": 13.378254923038185, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_256_a1152_q0", "video_id": 256, "time_stamp_s": 219, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2f9a286f5ee3a8a96a53ff78402e42a9ad55a45c20eecaa700101b9a6810cece", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player in pink shorts dribbles ball past opponents on green turf field.  \n- Player in green jersey performs a soccer move near goalpost with text overlay listing \"Neymar mission\" tasks.  \n- Player in black shorts attempts to control ball while others run around on field, with text indicating \"3rd challenge to play Neymar in Korea\".\n[30-60s] - Player performs a \"Sombra flick\" maneuver, kicking the ball with a quick foot flick while in motion.  \n- Player executes a \"Rainbow flick\" by lifting the ball with a curved foot motion, transitioning it over the ground.  \n- Player attempts a \"V drag back\" move, pulling the ball backward with a dragging motion while maintaining control.\n[60-90s] - A player in a black jersey sits on yellow stadium seats, observing the field.  \n- Another player in a black jersey stands nearby, also watching the game.  \n- The field is illuminated by stadium lights, with players actively engaged in a nighttime soccer match.\n[90-120s] - A player in a blue jersey is seen lying on the grass after a collision, with text indicating the play was not seriously injured.\n- The camera perspective shifts to show a player executing a \"Sombra flick\" successfully, followed by a \"Stepover\" maneuver.\n- The scene transitions to a wide view of the field at night, with players actively moving and a goal visible in the distance.\n[120-150s] - Player in blue jersey attempts a rainbow flick kick, which fails to clear the defender.  \n- Ball is passed long by a teammate, moving it toward the opponent’s goal area.  \n- Player in black jersey runs toward the ball after the long pass, preparing to receive or intercept.\n[150-180s] - Player in blue jersey dribbles ball near sideline, then kicks it toward goal after a defensive block.\n- Keeper in black jersey dives to block shot, but ball rebounds off wall near goalpost.\n- Player in blue jersey follows up with a super save, then runs toward goal area after the rebound.\n[180-210s] - Player in blue jersey dribbles ball near sideline, then passes to teammate.\n- Goalkeeper in black gear blocks shot near goalpost.\n- Player in blue jersey leaps into air for a jump shot, labeled \"Jay catapult mode.\"", "history_tokens": 507, "history_utf8_bytes": 2177, "recent_frame_times_s": [189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666, 218.00111666666666], "recent_frames_sha256": "61c2a72fecb5a98be5829745075a14196ea55e8cc65365c755d36e377ff889ae", "num_recent_frames": 30, "tq": 716792.21312631, "t1": 716799.392176986, "ta": 716799.392176986, "te": 716799.667041773, "first_response_s": 7.1790506759425625, "answer_total_s": 7.453915462945588, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 256, "content_group": "596507ca0704c8c9495afe244131621177e44f379ebe8c08120ed16c2d8573e2", "question": {"question_id": "sample_256_a1153_q0", "video_id": 256, "video_path": "./videos/sample_256_real.mp4", "annotation_index": 1153, "question_index": 0, "question": "What subtitle appeared just now?", "options": ["A. \"Messi The Legend\".", "B. \"Soccer Championship\".", "C. \"Neymar El Clacico in & out success\".", "D. \"Football Highlights\"."], "answer": "C", "time_stamp_s": 418, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "football", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_256_a1153_q0", "video_id": 256, "time_stamp_s": 418, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1217a351048cf6be215b8ddb79bc9439bebb90261fcdc6ab7ce46e7b5268bd08", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166], "recent_frames_sha256": "46a6de691e098714d5ff9516c3d8c3ec5f4d1f887326c106e21ccc23831e9927", "num_recent_frames": 30, "tq": 716968.052448616, "t1": 716978.416750449, "ta": 716978.416750449, "te": 716978.455023361, "first_response_s": 10.364301832974888, "answer_total_s": 10.40257474500686, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_256_a1153_q0", "video_id": 256, "time_stamp_s": 418, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e1b936c76e9f69b7f5698a22cc5063bbebcc0cd301d6a8e5b2a000425603def1", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player in pink shorts dribbles ball past opponents on green turf field.  \n- Player in green jersey performs a soccer move near goalpost with text overlay listing \"Neymar mission\" tasks.  \n- Player in black shorts attempts to control ball while others run around on field, with text indicating \"3rd challenge to play Neymar in Korea\".\n[30-60s] - Player performs a \"Sombra flick\" maneuver, kicking the ball with a quick foot flick while in motion.  \n- Player executes a \"Rainbow flick\" by lifting the ball with a curved foot motion, transitioning it over the ground.  \n- Player attempts a \"V drag back\" move, pulling the ball backward with a dragging motion while maintaining control.\n[60-90s] - A player in a black jersey sits on yellow stadium seats, observing the field.  \n- Another player in a black jersey stands nearby, also watching the game.  \n- The field is illuminated by stadium lights, with players actively engaged in a nighttime soccer match.\n[90-120s] - A player in a blue jersey is seen lying on the grass after a collision, with text indicating the play was not seriously injured.\n- The camera perspective shifts to show a player executing a \"Sombra flick\" successfully, followed by a \"Stepover\" maneuver.\n- The scene transitions to a wide view of the field at night, with players actively moving and a goal visible in the distance.\n[120-150s] - Player in blue jersey attempts a rainbow flick kick, which fails to clear the defender.  \n- Ball is passed long by a teammate, moving it toward the opponent’s goal area.  \n- Player in black jersey runs toward the ball after the long pass, preparing to receive or intercept.\n[150-180s] - Player in blue jersey dribbles ball near sideline, then kicks it toward goal after a defensive block.\n- Keeper in black jersey dives to block shot, but ball rebounds off wall near goalpost.\n- Player in blue jersey follows up with a super save, then runs toward goal area after the rebound.\n[180-210s] - Player in blue jersey dribbles ball near sideline, then passes to teammate.\n- Goalkeeper in black gear blocks shot near goalpost.\n- Player in blue jersey leaps into air for a jump shot, labeled \"Jay catapult mode.\"\n[210-240s] - Player in blue jersey dribbles ball toward goal, evading defenders.  \n- Player in black jersey intercepts ball near sideline, then passes to teammate.  \n- Ball is kicked toward goal after a counterattack, with goalkeeper reacting.\n[240-270s] - Player in blue jersey and pink shorts runs toward the ball, preparing to intercept or challenge.\n- Keeper’s shadow is visible on the field, indicating their position relative to the ball and other players.\n- Ball is in motion, being controlled or kicked by a player near the sideline, with teammates and opponents scattered across the field.\n[270-300s] - Player in blue jersey runs toward the ball, preparing to strike it.  \n- Ball is kicked toward the goal, with a defender in black jersey nearby.  \n- Goalkeeper in blue jersey dives to block the shot, but the ball goes past them.\n[300-330s] - Player in blue jersey runs with ball under pressure, dodging opponents.  \n- Camera wearer (first-person) observes the play, with their feet visible near the ball.  \n- Ball is passed or controlled by the player in blue, moving toward goal area.\n[330-360s] - Player in blue jersey runs toward goal after a pass, preparing to shoot.  \n- Goalkeeper in black gear stands ready, positioned near the goal line.  \n- Ball is kicked toward goal, with keeper’s wall visibly breached as it enters the net.\n[360-390s] - A player in a blue jersey is tackled and falls to the ground, surrounded by teammates checking on them.\n- The camera wearer, wearing black shorts and white shoes, runs toward the fallen player after the tackle.\n- A player in a purple jersey is seen running with the ball, preparing to take a shot at the goal.", "history_tokens": 904, "history_utf8_bytes": 3851, "recent_frame_times_s": [388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166], "recent_frames_sha256": "46a6de691e098714d5ff9516c3d8c3ec5f4d1f887326c106e21ccc23831e9927", "num_recent_frames": 30, "tq": 716849.175022433, "t1": 716855.926807387, "ta": 716855.926807387, "te": 716855.963984123, "first_response_s": 6.751784953987226, "answer_total_s": 6.788961689919233, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 256, "content_group": "596507ca0704c8c9495afe244131621177e44f379ebe8c08120ed16c2d8573e2", "question": {"question_id": "sample_256_a1154_q0", "video_id": 256, "video_path": "./videos/sample_256_real.mp4", "annotation_index": 1154, "question_index": 0, "question": "What is the color of the jersey of the player who performs the nutmeg?", "options": ["A. Yellow.", "B. Red.", "C. Blue.", "D. White."], "answer": "A", "time_stamp_s": 611, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "football", "reference_interval_s": [600, 660], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_256_a1154_q0", "video_id": 256, "time_stamp_s": 611, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ddd3fd5df8e68c972364f2cec399597f4e927c99618c6fa4ba517675bc1ca259", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0000833333334, 585.0010833333333, 586.0020833333333, 587.0030833333333, 588.0040833333334, 589.0050833333333, 590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074, 609.0084, 610.0094], "recent_frames_sha256": "5c699dfbc17468189d57db096e730a68f0600b0a8157f98a7f8d6c056376c5fc", "num_recent_frames": 30, "tq": 716978.469115053, "t1": 716989.87273167, "ta": 716989.87273167, "te": 716989.90974066, "first_response_s": 11.40361661708448, "answer_total_s": 11.440625607036054, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_256_a1154_q0", "video_id": 256, "time_stamp_s": 611, "ground_truth": "A", "raw_output": "C. Blue.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "438ad17555a076ec9a18736296e4d50cb7f44395503624fbf2ab07e4e607bc8a", "condition_order": ["notes", "recent"], "memory": "[180-210s] - Player in blue jersey dribbles ball near sideline, then passes to teammate.\n- Goalkeeper in black gear blocks shot near goalpost.\n- Player in blue jersey leaps into air for a jump shot, labeled \"Jay catapult mode.\"\n[210-240s] - Player in blue jersey dribbles ball toward goal, evading defenders.  \n- Player in black jersey intercepts ball near sideline, then passes to teammate.  \n- Ball is kicked toward goal after a counterattack, with goalkeeper reacting.\n[240-270s] - Player in blue jersey and pink shorts runs toward the ball, preparing to intercept or challenge.\n- Keeper’s shadow is visible on the field, indicating their position relative to the ball and other players.\n- Ball is in motion, being controlled or kicked by a player near the sideline, with teammates and opponents scattered across the field.\n[270-300s] - Player in blue jersey runs toward the ball, preparing to strike it.  \n- Ball is kicked toward the goal, with a defender in black jersey nearby.  \n- Goalkeeper in blue jersey dives to block the shot, but the ball goes past them.\n[300-330s] - Player in blue jersey runs with ball under pressure, dodging opponents.  \n- Camera wearer (first-person) observes the play, with their feet visible near the ball.  \n- Ball is passed or controlled by the player in blue, moving toward goal area.\n[330-360s] - Player in blue jersey runs toward goal after a pass, preparing to shoot.  \n- Goalkeeper in black gear stands ready, positioned near the goal line.  \n- Ball is kicked toward goal, with keeper’s wall visibly breached as it enters the net.\n[360-390s] - A player in a blue jersey is tackled and falls to the ground, surrounded by teammates checking on them.\n- The camera wearer, wearing black shorts and white shoes, runs toward the fallen player after the tackle.\n- A player in a purple jersey is seen running with the ball, preparing to take a shot at the goal.\n[390-420s] - Player in blue jersey runs toward goal after a curl kick, with ball visible near their feet.\n- Goalkeeper in black jersey dives to the right but misses the ball, which enters the net.\n- Camera follows the ball’s trajectory into the goal, with “GOAL” text overlay appearing.\n[420-450s] - A man in a red jersey stands on a field, facing a group of players, with a green board visible nearby.  \n- The group of players, dressed in orange and red jerseys, are gathered around the man, appearing to be in a training or instructional setting.  \n- The scene is set at night under artificial lighting, with a large indoor sports facility visible in the background.\n[450-480s] - A player in a red jersey is seen running with the ball on the left wing, actively engaging in play.  \n- The camera perspective shifts to a first-person view, showing the ball being passed or controlled by the player.  \n- A goalkeeper in a dark uniform makes a save, with the ball bouncing off their leg, indicating a close defensive action.\n[480-510s] - A player in a black uniform runs swiftly across the field, pursued by opponents.  \n- The camera follows a ball being kicked toward the goal, with the ball’s trajectory visible.  \n- A goal is scored, indicated by the word \"GOAL\" on screen, as the ball enters the net.\n[510-540s] - Player Jay maintains balance while positioning himself to assist a teammate near the goal.  \n- A player in a red jersey is seen running toward the goal, while another player in a dark jersey is near the goalpost.  \n- The camera angle shifts to show a player in a dark jersey running with the ball, followed by a goalkeeper diving to make a save.\n[540-570s] - A player in a yellow jersey is seen running with the ball, preparing to make a pass.  \n- The ball is kicked toward a teammate who is positioned near the goal, indicating a coordinated play.  \n- The camera angle shifts to show the ball in motion, suggesting a successful pass leading to a goal.\n[570-600s] - Player in black jersey runs toward ball, then kicks it toward goal.  \n- Ball flies past goalkeeper and enters net; \"GOAL\" text appears.  \n- Camera view shifts to first-person perspective as ball crosses goal line.", "history_tokens": 979, "history_utf8_bytes": 4105, "recent_frame_times_s": [581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0000833333334, 585.0010833333333, 586.0020833333333, 587.0030833333333, 588.0040833333334, 589.0050833333333, 590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074, 609.0084, 610.0094], "recent_frames_sha256": "5c699dfbc17468189d57db096e730a68f0600b0a8157f98a7f8d6c056376c5fc", "num_recent_frames": 30, "tq": 716911.76923423, "t1": 716919.982454833, "ta": 716919.982454833, "te": 716920.135742446, "first_response_s": 8.21322060294915, "answer_total_s": 8.366508215898648, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 256, "content_group": "596507ca0704c8c9495afe244131621177e44f379ebe8c08120ed16c2d8573e2", "question": {"question_id": "sample_256_a1155_q0", "video_id": 256, "video_path": "./videos/sample_256_real.mp4", "annotation_index": 1155, "question_index": 0, "question": "What is the position of the Eiffel Tower relative to the camera in the first-person driving perspective?", "options": ["A. To the left.", "B. Directly ahead.", "C. To the right.", "D. Behind."], "answer": "B", "time_stamp_s": 764, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "football", "reference_interval_s": [720, 778], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_256_a1155_q0", "video_id": 256, "time_stamp_s": 764, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7b1a6e61c8e4312301c6a578df689a936fdde460a8e90f8d57c706e5189c700e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [734.0166166666667, 735.0009333333334, 736.0019333333333, 737.0029333333333, 738.0039333333333, 739.0049333333334, 740.0059333333334, 741.0069333333333, 742.0079333333333, 743.0089333333333, 744.0099333333334, 745.0109333333334, 746.0119333333333, 747.0129333333333, 748.0139333333333, 749.0149333333334, 750.0159333333334, 751.00025, 752.00125, 753.00225, 754.00325, 755.00425, 756.00525, 757.00625, 758.00725, 759.00825, 760.00925, 761.01025, 762.01125, 763.01225], "recent_frames_sha256": "b8e4afe1df5face1a3c6e961887643a5b8f1a793052dabe2eef64587eab16564", "num_recent_frames": 30, "tq": 716989.919707406, "t1": 716997.57231295, "ta": 716997.57231295, "te": 716997.61068827, "first_response_s": 7.6526055440772325, "answer_total_s": 7.690980863990262, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_256_a1155_q0", "video_id": 256, "time_stamp_s": 764, "ground_truth": "B", "raw_output": "B. Directly ahead.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "a34bfa98b0e041989c20570435d9ce22deaa75c58466d9af5b6a94be38e893ec", "condition_order": ["notes", "recent"], "memory": "[330-360s] - Player in blue jersey runs toward goal after a pass, preparing to shoot.  \n- Goalkeeper in black gear stands ready, positioned near the goal line.  \n- Ball is kicked toward goal, with keeper’s wall visibly breached as it enters the net.\n[360-390s] - A player in a blue jersey is tackled and falls to the ground, surrounded by teammates checking on them.\n- The camera wearer, wearing black shorts and white shoes, runs toward the fallen player after the tackle.\n- A player in a purple jersey is seen running with the ball, preparing to take a shot at the goal.\n[390-420s] - Player in blue jersey runs toward goal after a curl kick, with ball visible near their feet.\n- Goalkeeper in black jersey dives to the right but misses the ball, which enters the net.\n- Camera follows the ball’s trajectory into the goal, with “GOAL” text overlay appearing.\n[420-450s] - A man in a red jersey stands on a field, facing a group of players, with a green board visible nearby.  \n- The group of players, dressed in orange and red jerseys, are gathered around the man, appearing to be in a training or instructional setting.  \n- The scene is set at night under artificial lighting, with a large indoor sports facility visible in the background.\n[450-480s] - A player in a red jersey is seen running with the ball on the left wing, actively engaging in play.  \n- The camera perspective shifts to a first-person view, showing the ball being passed or controlled by the player.  \n- A goalkeeper in a dark uniform makes a save, with the ball bouncing off their leg, indicating a close defensive action.\n[480-510s] - A player in a black uniform runs swiftly across the field, pursued by opponents.  \n- The camera follows a ball being kicked toward the goal, with the ball’s trajectory visible.  \n- A goal is scored, indicated by the word \"GOAL\" on screen, as the ball enters the net.\n[510-540s] - Player Jay maintains balance while positioning himself to assist a teammate near the goal.  \n- A player in a red jersey is seen running toward the goal, while another player in a dark jersey is near the goalpost.  \n- The camera angle shifts to show a player in a dark jersey running with the ball, followed by a goalkeeper diving to make a save.\n[540-570s] - A player in a yellow jersey is seen running with the ball, preparing to make a pass.  \n- The ball is kicked toward a teammate who is positioned near the goal, indicating a coordinated play.  \n- The camera angle shifts to show the ball in motion, suggesting a successful pass leading to a goal.\n[570-600s] - Player in black jersey runs toward ball, then kicks it toward goal.  \n- Ball flies past goalkeeper and enters net; \"GOAL\" text appears.  \n- Camera view shifts to first-person perspective as ball crosses goal line.\n[600-630s] - Jay scores a goal after Neymar's pass, with teammates celebrating nearby.  \n- Neymar is seen running with the ball, marked as \"touch success\" on screen.  \n- The camera shifts to a first-person view, showing the ball rolling toward the goal.\n[630-660s] - Jay runs toward an empty space, then quickly penetrates past an opponent.\n- The ball is passed by Jay to Seungghyun Lee, who is positioned near the goal.\n- The pass lacks spin, as indicated by the on-screen text, and the ball is not controlled well.\n[660-690s] - Player in yellow jersey dribbles ball toward goal, then passes to teammate after checking position.\n- Camera perspective shifts to first-person view, showing ball being kicked forward by player in black jersey.\n- Goalkeeper in yellow jersey moves to intercept ball as it approaches goal line.\n[690-720s] - Player in black jersey runs toward ball, then kicks it to teammate after a pass.  \n- Opponent in yellow jersey intercepts the ball, leading to a foul call.  \n- Player’s shadow is visible on the grass, indicating the camera’s first-person perspective.\n[720-750s] - A player in a yellow jersey sprints toward the goal, with teammates and opponents visible in the background.\n- The ball is seen rolling toward the goal after being kicked by the player, with the goalkeeper positioned to defend.\n- The camera shifts to a first-person view, showing the player’s feet and the ball as it enters the net, marked by a \"GOAL\" text overlay.", "history_tokens": 1016, "history_utf8_bytes": 4250, "recent_frame_times_s": [734.0166166666667, 735.0009333333334, 736.0019333333333, 737.0029333333333, 738.0039333333333, 739.0049333333334, 740.0059333333334, 741.0069333333333, 742.0079333333333, 743.0089333333333, 744.0099333333334, 745.0109333333334, 746.0119333333333, 747.0129333333333, 748.0139333333333, 749.0149333333334, 750.0159333333334, 751.00025, 752.00125, 753.00225, 754.00325, 755.00425, 756.00525, 757.00625, 758.00725, 759.00825, 760.00925, 761.01025, 762.01125, 763.01225], "recent_frames_sha256": "b8e4afe1df5face1a3c6e961887643a5b8f1a793052dabe2eef64587eab16564", "num_recent_frames": 30, "tq": 716952.174968078, "t1": 716953.436541533, "ta": 716953.436541533, "te": 716953.661245674, "first_response_s": 1.2615734549472108, "answer_total_s": 1.486277595977299, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 257, "content_group": "2d1405ac0c9665653ba47fb050e4e696df14da8f57766d8dbe678f3332ce18fd", "question": {"question_id": "sample_257_a1890_q0", "video_id": 257, "video_path": "./videos/sample_257_real.mp4", "annotation_index": 1890, "question_index": 0, "question": "What happened in the the video just now?", "options": ["A. Players are shown resting on the sidelines.", "B. The camera focuses on the crowd.", "C. Text overlays hint at a welcoming message related to football.", "D. A player scores a goal."], "answer": "C", "time_stamp_s": 20, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "football", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_257_a1890_q0", "video_id": 257, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c9168aa68aa6d437b8fcebeda2ebbae7d0c41da7c10b7e3b74566f672dc41432", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "6f9c89afc219d4092cebbac8811a7ea26da7fbaba73e87d6b7e3123b7bea33bd", "num_recent_frames": 21, "tq": 710206.096684903, "t1": 710212.568594372, "ta": 710212.568594372, "te": 710212.606082771, "first_response_s": 6.471909468993545, "answer_total_s": 6.509397867950611, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_257_a1890_q0", "video_id": 257, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a32ee8eda80708eeb6e6a091b28c8ffe1ac7ec3656afd5c91edf60960445178d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "6f9c89afc219d4092cebbac8811a7ea26da7fbaba73e87d6b7e3123b7bea33bd", "num_recent_frames": 21, "tq": 710018.719259906, "t1": 710019.571515042, "ta": 710019.571515042, "te": 710019.612949543, "first_response_s": 0.8522551360074431, "answer_total_s": 0.8936896370723844, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 257, "content_group": "2d1405ac0c9665653ba47fb050e4e696df14da8f57766d8dbe678f3332ce18fd", "question": {"question_id": "sample_257_a1891_q0", "video_id": 257, "video_path": "./videos/sample_257_real.mp4", "annotation_index": 1891, "question_index": 0, "question": "What is the camera showing right now?", "options": ["A. Players celebrating a goal.", "B. A player tying their shoelaces.", "C. The ball near the sideline.", "D. The players leaving the field."], "answer": "C", "time_stamp_s": 240, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "football", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_257_a1891_q0", "video_id": 257, "time_stamp_s": 240, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "214c34c57877d2c29996dbeecc13dca3da46fac82196099c6a90b0cb7d84b640", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0], "recent_frames_sha256": "133be6ebe94878185fc0376c175a0504725919673f51b508d77ab32b10415d39", "num_recent_frames": 30, "tq": 710212.638243449, "t1": 710220.021302199, "ta": 710220.021302199, "te": 710220.058793669, "first_response_s": 7.383058749954216, "answer_total_s": 7.420550219947472, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_257_a1891_q0", "video_id": 257, "time_stamp_s": 240, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2262dec32646d1bca8509c2bae21231756e9878561464908db9cad2de9062b87", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A player in a blue jersey dribbles the ball while others move around on the field, with shadows cast by bright sunlight.\n- A child in a yellow shirt runs toward the ball, then dives to the ground near the goal area, suggesting an active play or training drill.\n- The camera perspective shifts to a first-person view, showing the player’s feet and hands as they interact with the ball during a warm-up session.\n[30-60s] - Players in blue and black jerseys engage in dynamic ball control drills on a green turf field, with one player in blue actively dribbling while others position themselves around him.\n- A player in a black jersey with \"BT\" on the back is seen crouching and preparing to receive or intercept the ball, indicating active participation in the warm-up or short game drill.\n- The camera perspective shifts to a first-person view, showing the ball being passed or controlled by the player in the foreground, with shadows of players cast across the field.\n[60-90s] - A player in a blue jersey kicks the ball toward the goal, with the ball visibly moving through the air.  \n- The goalkeeper in black attire dives to the left, attempting to block the shot, but the ball passes by.  \n- The ball enters the net, triggering a \"Goal\" text overlay, and players react with celebration.\n[90-120s] - Player in red jersey dribbles ball near goal line, then scores a goal as indicated by on-screen text.\n- Player in black jersey makes a successful pass to a teammate, with on-screen text confirming \"Good pass.\"\n- Player in black jersey falls to the ground after a tackle or collision, with ball rolling nearby.\n[120-150s] - Player in black shirt and pants is seen kicking a white soccer ball toward the goal.  \n- A player in a red shirt is positioned near the goal, appearing to defend or react to the ball’s trajectory.  \n- The ball is in motion, moving across the green turf field, with shadows of players cast on the ground.\n[150-180s] - Player in red jersey dives to block a shot near goalpost.\n- Player in black jersey scores a goal, with text overlay \"Goal\".\n- Player in blue jersey runs toward the ball after a pass, with shadow cast on green turf.\n[180-210s] - A player in a blue shirt and black shorts is seen dribbling the ball while being pursued by opponents.  \n- The ball is kicked toward the goal, and a goalkeeper in orange gear makes a save.  \n- The camera perspective shifts to show a wide view of the field, including spectators and equipment near the sidelines.\n[210-240s] - A player in a white shirt and black pants dribbles the ball near the sideline, then passes it to a teammate.  \n- A player in a blue striped shirt and black pants approaches the camera, then jumps to celebrate a goal.  \n- The camera wearer, wearing black pants and gray shoes, is seen lying on the ground after a tackle, with the ball nearby.", "history_tokens": 657, "history_utf8_bytes": 2851, "recent_frame_times_s": [211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0], "recent_frames_sha256": "133be6ebe94878185fc0376c175a0504725919673f51b508d77ab32b10415d39", "num_recent_frames": 30, "tq": 710069.454254204, "t1": 710075.038524745, "ta": 710075.038524745, "te": 710075.07519213, "first_response_s": 5.584270540974103, "answer_total_s": 5.620937925996259, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 257, "content_group": "2d1405ac0c9665653ba47fb050e4e696df14da8f57766d8dbe678f3332ce18fd", "question": {"question_id": "sample_257_a1892_q0", "video_id": 257, "video_path": "./videos/sample_257_real.mp4", "annotation_index": 1892, "question_index": 0, "question": "What type of game is being played on the sports field right now?", "options": ["A. A competitive league match.", "B. A casual or friendly game.", "C. A training session.", "D. A tournament final."], "answer": "B", "time_stamp_s": 460, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "football", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_257_a1892_q0", "video_id": 257, "time_stamp_s": 460, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c9d2fd11bbe789d8bd76cb5d7817a1e1c8037e6cfb70efbbd31fb47d01e88dfc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [431.0, 432.0, 433.0, 434.0, 435.0, 436.0, 437.0, 438.0, 439.0, 440.0, 441.0, 442.0, 443.0, 444.0, 445.0, 446.0, 447.0, 448.0, 449.0, 450.0, 451.0, 452.0, 453.0, 454.0, 455.0, 456.0, 457.0, 458.0, 459.0, 460.0], "recent_frames_sha256": "de160aa288870c6b2b89015cd27f97dcceb93342f2f3946a79a48ef42062097e", "num_recent_frames": 30, "tq": 710220.069875635, "t1": 710221.362050748, "ta": 710221.362050748, "te": 710221.402792724, "first_response_s": 1.2921751129906625, "answer_total_s": 1.3329170889919624, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_257_a1892_q0", "video_id": 257, "time_stamp_s": 460, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0d20888297e839a22784e21d34bd5bab282a498ca3d6ce84abd42b7440d488ef", "condition_order": ["notes", "recent"], "memory": "[60-90s] - A player in a blue jersey kicks the ball toward the goal, with the ball visibly moving through the air.  \n- The goalkeeper in black attire dives to the left, attempting to block the shot, but the ball passes by.  \n- The ball enters the net, triggering a \"Goal\" text overlay, and players react with celebration.\n[90-120s] - Player in red jersey dribbles ball near goal line, then scores a goal as indicated by on-screen text.\n- Player in black jersey makes a successful pass to a teammate, with on-screen text confirming \"Good pass.\"\n- Player in black jersey falls to the ground after a tackle or collision, with ball rolling nearby.\n[120-150s] - Player in black shirt and pants is seen kicking a white soccer ball toward the goal.  \n- A player in a red shirt is positioned near the goal, appearing to defend or react to the ball’s trajectory.  \n- The ball is in motion, moving across the green turf field, with shadows of players cast on the ground.\n[150-180s] - Player in red jersey dives to block a shot near goalpost.\n- Player in black jersey scores a goal, with text overlay \"Goal\".\n- Player in blue jersey runs toward the ball after a pass, with shadow cast on green turf.\n[180-210s] - A player in a blue shirt and black shorts is seen dribbling the ball while being pursued by opponents.  \n- The ball is kicked toward the goal, and a goalkeeper in orange gear makes a save.  \n- The camera perspective shifts to show a wide view of the field, including spectators and equipment near the sidelines.\n[210-240s] - A player in a white shirt and black pants dribbles the ball near the sideline, then passes it to a teammate.  \n- A player in a blue striped shirt and black pants approaches the camera, then jumps to celebrate a goal.  \n- The camera wearer, wearing black pants and gray shoes, is seen lying on the ground after a tackle, with the ball nearby.\n[240-270s] - A player in a blue shirt and bright blue shoes kicks the ball toward the goal.  \n- The goalkeeper in an orange jersey dives to the left, attempting to block the shot.  \n- The ball is seen in mid-air, heading toward the goal net, with the word \"Goal\" appearing on screen.\n[270-300s] - Player in gray shirt and black pants dribbles ball while others position around field.  \n- Ball is kicked toward goal by player in white shirt, with goalkeeper in blue jersey reacting.  \n- Player in blue jersey runs toward goal area as others move to intercept or support.\n[300-330s] - A player in a grey shirt and black pants runs toward the ball, preparing to kick it.  \n- The ball is positioned near the center of the field, with a goalkeeper in red gear positioned near the goal.  \n- A player in a blue shirt is seen running toward the ball, possibly attempting to intercept or challenge for possession.\n[330-360s] - Player in red jersey dives to save a shot near goalpost.\n- Player in black tracksuit kicks ball toward goal, while goalkeeper in orange attempts to block.\n- Ball rolls past goalkeeper, and players react as it moves toward goal area.\n[360-390s] - Player in yellow shirt dribbles ball while being pursued by player in black attire.  \n- Player in blue shirt stands near goalpost, observing play.  \n- Ball is passed to player in black who then moves toward goal area.\n[390-420s] - A child in a blue jersey dribbles the ball while being pursued by a child in a yellow jersey.  \n- A child in black attire lies on the ground near the goalpost, possibly having fallen or been tackled.  \n- The camera wearer, wearing black pants and orange shoes, is seen running toward the goal area, likely preparing to defend or attack.\n[420-450s] - Player in yellow jersey dives to the ground near the ball after a tackle.  \n- Player in black shirt and orange shoes stands nearby, observing the play.  \n- Ball is stationary on the turf near the center of the field.", "history_tokens": 920, "history_utf8_bytes": 3832, "recent_frame_times_s": [431.0, 432.0, 433.0, 434.0, 435.0, 436.0, 437.0, 438.0, 439.0, 440.0, 441.0, 442.0, 443.0, 444.0, 445.0, 446.0, 447.0, 448.0, 449.0, 450.0, 451.0, 452.0, 453.0, 454.0, 455.0, 456.0, 457.0, 458.0, 459.0, 460.0], "recent_frames_sha256": "de160aa288870c6b2b89015cd27f97dcceb93342f2f3946a79a48ef42062097e", "num_recent_frames": 30, "tq": 710135.808169, "t1": 710142.017189018, "ta": 710142.017189018, "te": 710142.055238216, "first_response_s": 6.209020017995499, "answer_total_s": 6.247069215984084, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 257, "content_group": "2d1405ac0c9665653ba47fb050e4e696df14da8f57766d8dbe678f3332ce18fd", "question": {"question_id": "sample_257_a1893_q1", "video_id": 257, "video_path": "./videos/sample_257_real.mp4", "annotation_index": 1893, "question_index": 1, "question": "Where are the people who are not playing the game situated in the video?", "options": ["A. Inside the field.", "B. Behind the goalposts.", "C. Along the fence.", "D. Outside the stadium."], "answer": "C", "time_stamp_s": 667, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "football", "reference_interval_s": [660, 720], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_257_a1893_q1", "video_id": 257, "time_stamp_s": 667, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a8ea877a8b4011a3c7df72a0c634fb16c65079d4a9cfd681f4e02a35912af616", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [638.0, 639.0, 640.0, 641.0, 642.0, 643.0, 644.0, 645.0, 646.0, 647.0, 648.0, 649.0, 650.0, 651.0, 652.0, 653.0, 654.0, 655.0, 656.0, 657.0, 658.0, 659.0, 660.0, 661.0, 662.0, 663.0, 664.0, 665.0, 666.0, 667.0], "recent_frames_sha256": "10e5b7b535accca8a28a12637e22631a4793d577083df3448f7721b92bfa2afc", "num_recent_frames": 30, "tq": 710221.438324795, "t1": 710229.033619576, "ta": 710229.033619576, "te": 710229.073084919, "first_response_s": 7.595294781029224, "answer_total_s": 7.634760124026798, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_257_a1893_q1", "video_id": 257, "time_stamp_s": 667, "ground_truth": "C", "raw_output": "C. Along the fence.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "151f7afba08892b34ea7f64c5e45d1afaf4a04452e9b82830b0d99b8c8ebe074", "condition_order": ["notes", "recent"], "memory": "[240-270s] - A player in a blue shirt and bright blue shoes kicks the ball toward the goal.  \n- The goalkeeper in an orange jersey dives to the left, attempting to block the shot.  \n- The ball is seen in mid-air, heading toward the goal net, with the word \"Goal\" appearing on screen.\n[270-300s] - Player in gray shirt and black pants dribbles ball while others position around field.  \n- Ball is kicked toward goal by player in white shirt, with goalkeeper in blue jersey reacting.  \n- Player in blue jersey runs toward goal area as others move to intercept or support.\n[300-330s] - A player in a grey shirt and black pants runs toward the ball, preparing to kick it.  \n- The ball is positioned near the center of the field, with a goalkeeper in red gear positioned near the goal.  \n- A player in a blue shirt is seen running toward the ball, possibly attempting to intercept or challenge for possession.\n[330-360s] - Player in red jersey dives to save a shot near goalpost.\n- Player in black tracksuit kicks ball toward goal, while goalkeeper in orange attempts to block.\n- Ball rolls past goalkeeper, and players react as it moves toward goal area.\n[360-390s] - Player in yellow shirt dribbles ball while being pursued by player in black attire.  \n- Player in blue shirt stands near goalpost, observing play.  \n- Ball is passed to player in black who then moves toward goal area.\n[390-420s] - A child in a blue jersey dribbles the ball while being pursued by a child in a yellow jersey.  \n- A child in black attire lies on the ground near the goalpost, possibly having fallen or been tackled.  \n- The camera wearer, wearing black pants and orange shoes, is seen running toward the goal area, likely preparing to defend or attack.\n[420-450s] - Player in yellow jersey dives to the ground near the ball after a tackle.  \n- Player in black shirt and orange shoes stands nearby, observing the play.  \n- Ball is stationary on the turf near the center of the field.\n[450-480s] - Player in black jersey dives to block a shot near goalpost.\n- Ball is kicked toward goal, and a player in blue jersey runs toward it.\n- Goal is scored, indicated by on-screen text \"Goal\" as players react.\n[480-510s] - A player in a black hoodie and blue pants runs toward the ball, preparing to kick it.  \n- The ball is positioned near the center of the field, with the player’s foot approaching it.  \n- Other players are scattered around the field, some watching the action, others moving into position.\n[510-540s] - A player in a black top and blue pants dribbles the ball while being closely marked by an opponent in a grey top.  \n- A goalkeeper in a blue jersey jumps to catch a ball kicked toward the goal, with spectators seated nearby.  \n- A player in a black top with a visible \"MAGIC\" logo on the back stands near the sideline, observing the play.\n[540-570s] - A player in a blue jacket runs toward the ball, preparing to intercept or pass.  \n- A goalkeeper in black gear dives to the left, attempting to block a shot.  \n- The ball is airborne, heading toward the goal, with spectators watching from the sidelines.\n[570-600s] - Player in black tracksuit with yellow shoes actively dribbles and passes the ball during a game.  \n- Player in blue tracksuit and orange shoes attempts to intercept or challenge the ball near the goal.  \n- Spectators sit along the sidelines, observing the match, with some holding bags or equipment.\n[600-630s] - A player in a white top and black pants dribbles a soccer ball while others watch nearby.  \n- The camera wearer’s hand gestures toward a player in a blue jacket who is standing near the sideline.  \n- A player in a red top and blue shorts runs across the field, then falls to the ground.\n[630-660s] - A player in a light blue shirt and black shorts runs toward the ball, preparing to intercept or pass.  \n- The ball is near the goal line, with a goalkeeper in a dark uniform positioned to defend.  \n- A player in a blue shirt and black shorts is seen diving or sliding to challenge for the ball near the goal area.", "history_tokens": 977, "history_utf8_bytes": 4042, "recent_frame_times_s": [638.0, 639.0, 640.0, 641.0, 642.0, 643.0, 644.0, 645.0, 646.0, 647.0, 648.0, 649.0, 650.0, 651.0, 652.0, 653.0, 654.0, 655.0, 656.0, 657.0, 658.0, 659.0, 660.0, 661.0, 662.0, 663.0, 664.0, 665.0, 666.0, 667.0], "recent_frames_sha256": "10e5b7b535accca8a28a12637e22631a4793d577083df3448f7721b92bfa2afc", "num_recent_frames": 30, "tq": 710198.725829731, "t1": 710199.80747646, "ta": 710199.80747646, "te": 710200.028918857, "first_response_s": 1.0816467290278524, "answer_total_s": 1.3030891260132194, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 257, "content_group": "2d1405ac0c9665653ba47fb050e4e696df14da8f57766d8dbe678f3332ce18fd", "question": {"question_id": "sample_257_a1893_q0", "video_id": 257, "video_path": "./videos/sample_257_real.mp4", "annotation_index": 1893, "question_index": 0, "question": "What action is the player in the yellow jersey performing right now?", "options": ["A. Sitting along the fence.", "B. Running towards the viewer.", "C. Dribbling the ball.", "D. Observing the game."], "answer": "C", "time_stamp_s": 675, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "football", "reference_interval_s": [660, 720], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_257_a1893_q0", "video_id": 257, "time_stamp_s": 675, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "806d28768c0c1ab28862d2f6a755cbe6c938086da358661b6af2438cc58a4a61", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [646.0, 647.0, 648.0, 649.0, 650.0, 651.0, 652.0, 653.0, 654.0, 655.0, 656.0, 657.0, 658.0, 659.0, 660.0, 661.0, 662.0, 663.0, 664.0, 665.0, 666.0, 667.0, 668.0, 669.0, 670.0, 671.0, 672.0, 673.0, 674.0, 675.0], "recent_frames_sha256": "d99f472b0dd75581b2da6dc5d625a131f16cbab5caf6ebd71d20540df6335ff1", "num_recent_frames": 30, "tq": 710229.085031168, "t1": 710235.191555613, "ta": 710235.191555613, "te": 710235.23045464, "first_response_s": 6.106524445000105, "answer_total_s": 6.145423472044058, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_257_a1893_q0", "video_id": 257, "time_stamp_s": 675, "ground_truth": "C", "raw_output": "C. Dribbling the ball.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "0356e15c43cea85b2b1e6005dd6e6e6a601a3d6fed4d7ea54f1f8a872da598a1", "condition_order": ["notes", "recent"], "memory": "[240-270s] - A player in a blue shirt and bright blue shoes kicks the ball toward the goal.  \n- The goalkeeper in an orange jersey dives to the left, attempting to block the shot.  \n- The ball is seen in mid-air, heading toward the goal net, with the word \"Goal\" appearing on screen.\n[270-300s] - Player in gray shirt and black pants dribbles ball while others position around field.  \n- Ball is kicked toward goal by player in white shirt, with goalkeeper in blue jersey reacting.  \n- Player in blue jersey runs toward goal area as others move to intercept or support.\n[300-330s] - A player in a grey shirt and black pants runs toward the ball, preparing to kick it.  \n- The ball is positioned near the center of the field, with a goalkeeper in red gear positioned near the goal.  \n- A player in a blue shirt is seen running toward the ball, possibly attempting to intercept or challenge for possession.\n[330-360s] - Player in red jersey dives to save a shot near goalpost.\n- Player in black tracksuit kicks ball toward goal, while goalkeeper in orange attempts to block.\n- Ball rolls past goalkeeper, and players react as it moves toward goal area.\n[360-390s] - Player in yellow shirt dribbles ball while being pursued by player in black attire.  \n- Player in blue shirt stands near goalpost, observing play.  \n- Ball is passed to player in black who then moves toward goal area.\n[390-420s] - A child in a blue jersey dribbles the ball while being pursued by a child in a yellow jersey.  \n- A child in black attire lies on the ground near the goalpost, possibly having fallen or been tackled.  \n- The camera wearer, wearing black pants and orange shoes, is seen running toward the goal area, likely preparing to defend or attack.\n[420-450s] - Player in yellow jersey dives to the ground near the ball after a tackle.  \n- Player in black shirt and orange shoes stands nearby, observing the play.  \n- Ball is stationary on the turf near the center of the field.\n[450-480s] - Player in black jersey dives to block a shot near goalpost.\n- Ball is kicked toward goal, and a player in blue jersey runs toward it.\n- Goal is scored, indicated by on-screen text \"Goal\" as players react.\n[480-510s] - A player in a black hoodie and blue pants runs toward the ball, preparing to kick it.  \n- The ball is positioned near the center of the field, with the player’s foot approaching it.  \n- Other players are scattered around the field, some watching the action, others moving into position.\n[510-540s] - A player in a black top and blue pants dribbles the ball while being closely marked by an opponent in a grey top.  \n- A goalkeeper in a blue jersey jumps to catch a ball kicked toward the goal, with spectators seated nearby.  \n- A player in a black top with a visible \"MAGIC\" logo on the back stands near the sideline, observing the play.\n[540-570s] - A player in a blue jacket runs toward the ball, preparing to intercept or pass.  \n- A goalkeeper in black gear dives to the left, attempting to block a shot.  \n- The ball is airborne, heading toward the goal, with spectators watching from the sidelines.\n[570-600s] - Player in black tracksuit with yellow shoes actively dribbles and passes the ball during a game.  \n- Player in blue tracksuit and orange shoes attempts to intercept or challenge the ball near the goal.  \n- Spectators sit along the sidelines, observing the match, with some holding bags or equipment.\n[600-630s] - A player in a white top and black pants dribbles a soccer ball while others watch nearby.  \n- The camera wearer’s hand gestures toward a player in a blue jacket who is standing near the sideline.  \n- A player in a red top and blue shorts runs across the field, then falls to the ground.\n[630-660s] - A player in a light blue shirt and black shorts runs toward the ball, preparing to intercept or pass.  \n- The ball is near the goal line, with a goalkeeper in a dark uniform positioned to defend.  \n- A player in a blue shirt and black shorts is seen diving or sliding to challenge for the ball near the goal area.", "history_tokens": 977, "history_utf8_bytes": 4042, "recent_frame_times_s": [646.0, 647.0, 648.0, 649.0, 650.0, 651.0, 652.0, 653.0, 654.0, 655.0, 656.0, 657.0, 658.0, 659.0, 660.0, 661.0, 662.0, 663.0, 664.0, 665.0, 666.0, 667.0, 668.0, 669.0, 670.0, 671.0, 672.0, 673.0, 674.0, 675.0], "recent_frames_sha256": "d99f472b0dd75581b2da6dc5d625a131f16cbab5caf6ebd71d20540df6335ff1", "num_recent_frames": 30, "tq": 710200.06553301, "t1": 710205.782356327, "ta": 710205.782356327, "te": 710206.077702379, "first_response_s": 5.716823316994123, "answer_total_s": 6.0121693689143285, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 258, "content_group": "1266cf5011e772ab19ef68ce09da2a4a72180a740386ae0c69aa1fea5b43d116", "question": {"question_id": "sample_258_a662_q0", "video_id": 258, "video_path": "./videos/sample_258_real.mp4", "annotation_index": 662, "question_index": 0, "question": "What color is the jersey of the approaching player?", "options": ["A. Red and white.", "B. Blue and yellow.", "C. Green and black.", "D. White and black."], "answer": "B", "time_stamp_s": 3, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "football", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_258_a662_q0", "video_id": 258, "time_stamp_s": 3, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dca695105d7c6712f29b5f181d8d65d9220d7bf9e74385f1eb17f714ab24451f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "106f26b1e137495617bbeafbc15e372294fd6b9650601d292ea7ad219609e0e0", "num_recent_frames": 4, "tq": 717512.052065654, "t1": 717517.395550555, "ta": 717517.395550555, "te": 717517.432739802, "first_response_s": 5.343484901008196, "answer_total_s": 5.38067414809484, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_258_a662_q0", "video_id": 258, "time_stamp_s": 3, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "080c22bd4927dc8591c6ff9543d7a45c419e2d498a833bcc3dbe7aad34e1e969", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "106f26b1e137495617bbeafbc15e372294fd6b9650601d292ea7ad219609e0e0", "num_recent_frames": 4, "tq": 717391.195400126, "t1": 717402.743923882, "ta": 717402.743923882, "te": 717402.781608952, "first_response_s": 11.54852375597693, "answer_total_s": 11.586208825930953, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 258, "content_group": "1266cf5011e772ab19ef68ce09da2a4a72180a740386ae0c69aa1fea5b43d116", "question": {"question_id": "sample_258_a663_q0", "video_id": 258, "video_path": "./videos/sample_258_real.mp4", "annotation_index": 663, "question_index": 0, "question": "What object does the camera focus on in the center of the field right now?", "options": ["A. A soccer ball.", "B. A water bottle.", "C. A player's shoe.", "D. A goalpost."], "answer": "A", "time_stamp_s": 123, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "football", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_258_a663_q0", "video_id": 258, "time_stamp_s": 123, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "926711813e0bb07c2de66ef72ea0963e7ac17cfe1e998b850f9be56bea951e94", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0], "recent_frames_sha256": "9714a10bc0e4f4f23edef5a66d8c31099bdf09b82fe880797698254c6112a73b", "num_recent_frames": 30, "tq": 717517.455457109, "t1": 717524.440213429, "ta": 717524.440213429, "te": 717524.4775471, "first_response_s": 6.984756320016459, "answer_total_s": 7.022089991020039, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_258_a663_q0", "video_id": 258, "time_stamp_s": 123, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4d8b48e7e6affe77122daed2256e2638a74be93149eba0e4dd9bd9bc2e90248d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player in blue and yellow uniform actively engages in a soccer match, dribbling and passing the ball while being pursued by opponents.  \n- First-person perspective shows the player’s feet and ball, with shadows cast on the grass, indicating nighttime play under stadium lights.  \n- On-screen text lists three missions: \"Ronaldo Chop,\" \"Step over,\" and \"Knuckle shot,\" suggesting a challenge or tutorial segment.\n[30-60s] - Player in blue jersey (Ronaldo) performs a step-over maneuver while dribbling past opponents.  \n- First-person view shows the player’s feet and ball as they attempt to replicate Ronaldo’s play.  \n- Nighttime match setting with stadium lights and a visible goalpost in the background.\n[60-90s] - Player in blue jersey (number 41) stands near center circle, facing camera, with shadow cast behind them.\n- Ball is stationary on grass near foreground, with player’s feet visible nearby.\n- Camera wearer’s arm extends toward ball, suggesting an imminent interaction or pass.\n[90-120s] - Ronaldo executes a step-over maneuver, evading defenders while advancing toward the goal.\n- The ball is kicked into the air, and a player in a blue jersey runs toward it, suggesting a pass or interception.\n- A player in a yellow jersey is seen near the goal area, possibly preparing to defend or react to the play.", "history_tokens": 301, "history_utf8_bytes": 1339, "recent_frame_times_s": [94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0], "recent_frames_sha256": "9714a10bc0e4f4f23edef5a66d8c31099bdf09b82fe880797698254c6112a73b", "num_recent_frames": 30, "tq": 717432.777072817, "t1": 717440.880113476, "ta": 717440.880113476, "te": 717440.918230511, "first_response_s": 8.103040658985265, "answer_total_s": 8.141157694044523, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 258, "content_group": "1266cf5011e772ab19ef68ce09da2a4a72180a740386ae0c69aa1fea5b43d116", "question": {"question_id": "sample_258_a663_q1", "video_id": 258, "video_path": "./videos/sample_258_real.mp4", "annotation_index": 663, "question_index": 1, "question": "What number is on the back of the player in the blue jersey right now?", "options": ["A. 10.", "B. 8.", "C. 12.", "D. 7."], "answer": "C", "time_stamp_s": 133, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "football", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_258_a663_q1", "video_id": 258, "time_stamp_s": 133, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b36b9c4215b451cde5602c8483f2700a2e47e6cea79a6119e0d61281811aaad3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0], "recent_frames_sha256": "aebca9fd30bee826280e75b916d4741c58cd148222bcd1740d6f4c0b24a6acd9", "num_recent_frames": 30, "tq": 717524.49030839, "t1": 717534.617338792, "ta": 717534.617338792, "te": 717534.654759958, "first_response_s": 10.12703040195629, "answer_total_s": 10.164451568038203, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_258_a663_q1", "video_id": 258, "time_stamp_s": 133, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e894bb9e0c93b6c4b3a4183a4f18a844f6a72f7d61817c23e786ba809f6e1ce3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player in blue and yellow uniform actively engages in a soccer match, dribbling and passing the ball while being pursued by opponents.  \n- First-person perspective shows the player’s feet and ball, with shadows cast on the grass, indicating nighttime play under stadium lights.  \n- On-screen text lists three missions: \"Ronaldo Chop,\" \"Step over,\" and \"Knuckle shot,\" suggesting a challenge or tutorial segment.\n[30-60s] - Player in blue jersey (Ronaldo) performs a step-over maneuver while dribbling past opponents.  \n- First-person view shows the player’s feet and ball as they attempt to replicate Ronaldo’s play.  \n- Nighttime match setting with stadium lights and a visible goalpost in the background.\n[60-90s] - Player in blue jersey (number 41) stands near center circle, facing camera, with shadow cast behind them.\n- Ball is stationary on grass near foreground, with player’s feet visible nearby.\n- Camera wearer’s arm extends toward ball, suggesting an imminent interaction or pass.\n[90-120s] - Ronaldo executes a step-over maneuver, evading defenders while advancing toward the goal.\n- The ball is kicked into the air, and a player in a blue jersey runs toward it, suggesting a pass or interception.\n- A player in a yellow jersey is seen near the goal area, possibly preparing to defend or react to the play.", "history_tokens": 301, "history_utf8_bytes": 1339, "recent_frame_times_s": [104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0], "recent_frames_sha256": "aebca9fd30bee826280e75b916d4741c58cd148222bcd1740d6f4c0b24a6acd9", "num_recent_frames": 30, "tq": 717440.9355516, "t1": 717447.391443616, "ta": 717447.391443616, "te": 717447.688744837, "first_response_s": 6.455892016063444, "answer_total_s": 6.75319323700387, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 258, "content_group": "1266cf5011e772ab19ef68ce09da2a4a72180a740386ae0c69aa1fea5b43d116", "question": {"question_id": "sample_258_a664_q0", "video_id": 258, "video_path": "./videos/sample_258_real.mp4", "annotation_index": 664, "question_index": 0, "question": "What can be seen in the background right now?", "options": ["A. The penalty area.", "B. The goalpost and net.", "C. The midfield line.", "D. The audience stands."], "answer": "B", "time_stamp_s": 244, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "football", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_258_a664_q0", "video_id": 258, "time_stamp_s": 244, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bc7571f8a672028553742d556dcd1473a5bdf029f78414f64960c41518b906fa", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0], "recent_frames_sha256": "10cbaa6e210abcd9471374838977813743ed1f82118ef93ad7d7e9f617e6fb2d", "num_recent_frames": 30, "tq": 717534.668583163, "t1": 717546.625712503, "ta": 717546.625712503, "te": 717546.663272158, "first_response_s": 11.957129340036772, "answer_total_s": 11.994688995066099, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_258_a664_q0", "video_id": 258, "time_stamp_s": 244, "ground_truth": "B", "raw_output": "B. The goalpost and net.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "31f9e181754d86f473dd7f47c4811d9678b8fe565df4306a028175880584a306", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player in blue and yellow uniform actively engages in a soccer match, dribbling and passing the ball while being pursued by opponents.  \n- First-person perspective shows the player’s feet and ball, with shadows cast on the grass, indicating nighttime play under stadium lights.  \n- On-screen text lists three missions: \"Ronaldo Chop,\" \"Step over,\" and \"Knuckle shot,\" suggesting a challenge or tutorial segment.\n[30-60s] - Player in blue jersey (Ronaldo) performs a step-over maneuver while dribbling past opponents.  \n- First-person view shows the player’s feet and ball as they attempt to replicate Ronaldo’s play.  \n- Nighttime match setting with stadium lights and a visible goalpost in the background.\n[60-90s] - Player in blue jersey (number 41) stands near center circle, facing camera, with shadow cast behind them.\n- Ball is stationary on grass near foreground, with player’s feet visible nearby.\n- Camera wearer’s arm extends toward ball, suggesting an imminent interaction or pass.\n[90-120s] - Ronaldo executes a step-over maneuver, evading defenders while advancing toward the goal.\n- The ball is kicked into the air, and a player in a blue jersey runs toward it, suggesting a pass or interception.\n- A player in a yellow jersey is seen near the goal area, possibly preparing to defend or react to the play.\n[120-150s] - A player in a blue jersey (number 12) attempts a \"Ronaldo chop\" but is blocked by the defense.\n- The camera perspective shifts to show a first-person view of a player dribbling the ball, with their shadow cast on the grass.\n- The ball is seen rolling across the field as players move dynamically, with one player in a yellow jersey visible in the background.\n[150-180s] - Player in blue jersey (number 40) runs toward the ball, positioned ahead of the camera’s POV.\n- Camera wearer dribbles the ball near the sideline, moving toward the opponent’s defense.\n- Opponent’s player in yellow jersey intercepts the ball, leading to a clear play.\n[180-210s] - Player in blue jersey (number 16) runs toward the ball, preparing to receive it.  \n- A player in yellow jersey (number 10) is positioned near the ball, appearing to defend.  \n- The ball is stationary on the grass, with shadows of players cast on the field.\n[210-240s] - Player in blue jersey (no. 17) runs toward ball, preparing to receive pass.  \n- Camera operator’s feet and ball are visible in foreground, suggesting first-person perspective.  \n- Field is illuminated by stadium lights; shadows of players cast on grass.", "history_tokens": 601, "history_utf8_bytes": 2537, "recent_frame_times_s": [215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0], "recent_frames_sha256": "10cbaa6e210abcd9471374838977813743ed1f82118ef93ad7d7e9f617e6fb2d", "num_recent_frames": 30, "tq": 717472.386976908, "t1": 717473.818218029, "ta": 717473.818218029, "te": 717474.126979942, "first_response_s": 1.4312411210266873, "answer_total_s": 1.7400030340068042, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 258, "content_group": "1266cf5011e772ab19ef68ce09da2a4a72180a740386ae0c69aa1fea5b43d116", "question": {"question_id": "sample_258_a665_q0", "video_id": 258, "video_path": "./videos/sample_258_real.mp4", "annotation_index": 665, "question_index": 0, "question": "What skill did the person perform to get past the defender?", "options": ["A. Step-over.", "B. Cruyff turn.", "C. Ronaldo’s chop.", "D. Maradona turn."], "answer": "C", "time_stamp_s": 368, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "football", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_258_a665_q0", "video_id": 258, "time_stamp_s": 368, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "40d2edc193327375aa8df8c98be36ef142926b503c325ff9624ceb7592554156", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0], "recent_frames_sha256": "ece02e77486afe3ba6eb26606e23c841134373e4346ba45f7f454e9dd84504aa", "num_recent_frames": 30, "tq": 717546.671055367, "t1": 717557.923483822, "ta": 717557.923483822, "te": 717557.960909536, "first_response_s": 11.252428455045447, "answer_total_s": 11.289854169008322, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_258_a665_q0", "video_id": 258, "time_stamp_s": 368, "ground_truth": "C", "raw_output": "A. Step-over.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "eecd64e43396017faa4b94fe37a5befe19372ff7f464b3f9c724cac271c91d25", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player in blue and yellow uniform actively engages in a soccer match, dribbling and passing the ball while being pursued by opponents.  \n- First-person perspective shows the player’s feet and ball, with shadows cast on the grass, indicating nighttime play under stadium lights.  \n- On-screen text lists three missions: \"Ronaldo Chop,\" \"Step over,\" and \"Knuckle shot,\" suggesting a challenge or tutorial segment.\n[30-60s] - Player in blue jersey (Ronaldo) performs a step-over maneuver while dribbling past opponents.  \n- First-person view shows the player’s feet and ball as they attempt to replicate Ronaldo’s play.  \n- Nighttime match setting with stadium lights and a visible goalpost in the background.\n[60-90s] - Player in blue jersey (number 41) stands near center circle, facing camera, with shadow cast behind them.\n- Ball is stationary on grass near foreground, with player’s feet visible nearby.\n- Camera wearer’s arm extends toward ball, suggesting an imminent interaction or pass.\n[90-120s] - Ronaldo executes a step-over maneuver, evading defenders while advancing toward the goal.\n- The ball is kicked into the air, and a player in a blue jersey runs toward it, suggesting a pass or interception.\n- A player in a yellow jersey is seen near the goal area, possibly preparing to defend or react to the play.\n[120-150s] - A player in a blue jersey (number 12) attempts a \"Ronaldo chop\" but is blocked by the defense.\n- The camera perspective shifts to show a first-person view of a player dribbling the ball, with their shadow cast on the grass.\n- The ball is seen rolling across the field as players move dynamically, with one player in a yellow jersey visible in the background.\n[150-180s] - Player in blue jersey (number 40) runs toward the ball, positioned ahead of the camera’s POV.\n- Camera wearer dribbles the ball near the sideline, moving toward the opponent’s defense.\n- Opponent’s player in yellow jersey intercepts the ball, leading to a clear play.\n[180-210s] - Player in blue jersey (number 16) runs toward the ball, preparing to receive it.  \n- A player in yellow jersey (number 10) is positioned near the ball, appearing to defend.  \n- The ball is stationary on the grass, with shadows of players cast on the field.\n[210-240s] - Player in blue jersey (no. 17) runs toward ball, preparing to receive pass.  \n- Camera operator’s feet and ball are visible in foreground, suggesting first-person perspective.  \n- Field is illuminated by stadium lights; shadows of players cast on grass.\n[240-270s] - Player in blue jersey (Min) executes a precise pass to teammate Jay, who then scores a goal.  \n- The camera follows the ball’s trajectory from Min’s foot to the goal, capturing the goal celebration.  \n- A replay highlights Min’s pass and Jay’s finishing, with on-screen text praising the play.\n[270-300s] - Player in blue jersey (number 12) is seen running towards the ball after a defensive play.\n- A player in yellow jersey (number 5) is positioned near the ball, preparing to receive or intercept.\n- The scoreboard displays \"4-0\" indicating the current score of the match.\n[300-330s] - Player in left wing position dribbles ball, evades defender, and passes to teammate.  \n- Goalkeeper stands near goalpost, observing play.  \n- Camera perspective shifts to first-person view, showing player’s feet and ball movement.\n[330-360s] - Player in blue jersey (no. 34) misses a left-footed shot, as indicated by on-screen text.\n- Player in yellow jersey (no. 25) scores a goal after breaking a step-over maneuver.\n- The camera perspective shifts to a first-person view, showing the ball being controlled and the goal being scored.", "history_tokens": 887, "history_utf8_bytes": 3686, "recent_frame_times_s": [339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0], "recent_frames_sha256": "ece02e77486afe3ba6eb26606e23c841134373e4346ba45f7f454e9dd84504aa", "num_recent_frames": 30, "tq": 717503.484033801, "t1": 717511.460194982, "ta": 717511.460194982, "te": 717512.027282361, "first_response_s": 7.976161180995405, "answer_total_s": 8.543248560046777, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 261, "content_group": "2924859816245e7bdd41b7928a7bec9bfdc576bb23fa7376765b040861ff628e", "question": {"question_id": "sample_261_a1225_q0", "video_id": 261, "video_path": "./videos/sample_261_real.mp4", "annotation_index": 1225, "question_index": 0, "question": "What text is visible on the driver's helmet right now?", "options": ["A. Red Bull.", "B. Monster Energy.", "C. Bell.", "D. Sparco."], "answer": "C", "time_stamp_s": 2, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_261_a1225_q0", "video_id": 261, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cd6350313d748b3c7b49673c06672bc7ceaaaa428064f50b6ce232e33b5df452", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0], "recent_frames_sha256": "eeefed77be71b390db4b0dc5dc100560fb4a5d366de7ddcd539e0a4d60798589", "num_recent_frames": 3, "tq": 716020.427863787, "t1": 716030.723513455, "ta": 716030.723513455, "te": 716030.759994868, "first_response_s": 10.295649667968974, "answer_total_s": 10.332131080911495, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_261_a1225_q0", "video_id": 261, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "C. Bell.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "9f7793f71f28e1de22297505db266f036cf9bdb0a83664391ccd8165750b68b3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0], "recent_frames_sha256": "eeefed77be71b390db4b0dc5dc100560fb4a5d366de7ddcd539e0a4d60798589", "num_recent_frames": 3, "tq": 716077.012345566, "t1": 716082.905374302, "ta": 716082.905374302, "te": 716083.055402884, "first_response_s": 5.893028735998087, "answer_total_s": 6.043057318078354, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 261, "content_group": "2924859816245e7bdd41b7928a7bec9bfdc576bb23fa7376765b040861ff628e", "question": {"question_id": "sample_261_a1226_q0", "video_id": 261, "video_path": "./videos/sample_261_real.mp4", "annotation_index": 1226, "question_index": 0, "question": "What brand logo is visible on the driver's sleeve right now?", "options": ["A. Red Bull.", "B. Monster Energy.", "C. TT.", "D. Sparco."], "answer": "B", "time_stamp_s": 204, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [204, 209], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_261_a1226_q0", "video_id": 261, "time_stamp_s": 204, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "529159a421a1b1f0db429d82a14062ed04ff0cb7a8c34b032fabbe7f273acbac", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0], "recent_frames_sha256": "baed96f873c83d4d0c1c612d4e65247ca20900abcb04c52c3cba9d02b35a465f", "num_recent_frames": 30, "tq": 716030.771434301, "t1": 716042.170694132, "ta": 716042.170694132, "te": 716042.207633216, "first_response_s": 11.399259830941446, "answer_total_s": 11.436198915005662, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_261_a1226_q0", "video_id": 261, "time_stamp_s": 204, "ground_truth": "B", "raw_output": "B. Monster Energy.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "9990688e3f7d48341262b860f2f92b1ff61c82d6c0894197845daf08c40f39c0", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver in green and black racing suit with Monster Energy logo on gloves, gripping steering wheel and shifting gears.  \n- Interior dashboard features analog gauges, radio, and a clipboard with notes; car is a modified classic rally vehicle.  \n- Road ahead is narrow, winding through rural landscape with grassy fields and distant houses; other vehicles visible in background.\n[30-60s] - Driver grips steering wheel, shifting gears with gloved hands while navigating a winding dirt road.  \n- Co-driver holds a paper map or notes, occasionally glancing at it while steering.  \n- Interior dashboard displays multiple gauges and controls; Monster Energy logos visible on steering wheel and door panels.\n[60-90s] - Driver's gloved hands actively steer and manipulate gear shift levers, with occasional glance at dashboard gauges.  \n- The car's interior features a visible notebook on the passenger side, likely containing race strategy or route notes.  \n- The vehicle navigates a dirt road with visible turns, surrounded by grassy terrain and sparse roadside spectators.\n[90-120s] - Driver grips steering wheel, hands adjusting position as vehicle navigates winding dirt road.  \n- Dashboard displays multiple gauges; driver’s left hand occasionally shifts gear lever.  \n- Right side of cabin shows paper notes and gear shift controls; driver’s right hand occasionally adjusts controls.\n[120-150s] - Driver grips steering wheel, hands adjusting position while navigating dirt road.  \n- Dashboard displays active gauges, with gear shifter and control levers visible.  \n- Vehicle moves forward along winding path, with spectators visible on roadside.\n[150-180s] - Driver grips steering wheel, shifting gears with left hand while right hand controls gear shifter.  \n- Dashboard displays fluctuating gauges, including speedometer and tachometer, indicating active driving.  \n- Car navigates a winding dirt road with grassy terrain on both sides, passing spectators in distance.", "history_tokens": 418, "history_utf8_bytes": 1981, "recent_frame_times_s": [175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0], "recent_frames_sha256": "baed96f873c83d4d0c1c612d4e65247ca20900abcb04c52c3cba9d02b35a465f", "num_recent_frames": 30, "tq": 716139.759679637, "t1": 716147.672905931, "ta": 716147.672905931, "te": 716147.974766901, "first_response_s": 7.913226293982007, "answer_total_s": 8.215087263961323, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 261, "content_group": "2924859816245e7bdd41b7928a7bec9bfdc576bb23fa7376765b040861ff628e", "question": {"question_id": "sample_261_a1227_q0", "video_id": 261, "video_path": "./videos/sample_261_real.mp4", "annotation_index": 1227, "question_index": 0, "question": "Which way does the road turn now?", "options": ["A. there's no road at all.", "B. Straight forward.", "C. To the right.", "D. To the left."], "answer": "C", "time_stamp_s": 385, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [408, 413], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_261_a1227_q0", "video_id": 261, "time_stamp_s": 385, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b0d09d1ce89c932f835f8329792524f1370bd506f892691af0614811cb120d87", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0], "recent_frames_sha256": "53641dde88f477e86e8fe922fab5ab5c5edbe4011d7a15030b22927ba5ab314b", "num_recent_frames": 30, "tq": 716042.219061767, "t1": 716050.393615352, "ta": 716050.393615352, "te": 716050.547244757, "first_response_s": 8.174553585005924, "answer_total_s": 8.328182989964262, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_261_a1227_q0", "video_id": 261, "time_stamp_s": 385, "ground_truth": "C", "raw_output": "D. To the left.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "848816f99c43f4392c775211d154b9df2f8547e17f6852a64b1d5a4dc1a04a83", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver in green and black racing suit with Monster Energy logo on gloves, gripping steering wheel and shifting gears.  \n- Interior dashboard features analog gauges, radio, and a clipboard with notes; car is a modified classic rally vehicle.  \n- Road ahead is narrow, winding through rural landscape with grassy fields and distant houses; other vehicles visible in background.\n[30-60s] - Driver grips steering wheel, shifting gears with gloved hands while navigating a winding dirt road.  \n- Co-driver holds a paper map or notes, occasionally glancing at it while steering.  \n- Interior dashboard displays multiple gauges and controls; Monster Energy logos visible on steering wheel and door panels.\n[60-90s] - Driver's gloved hands actively steer and manipulate gear shift levers, with occasional glance at dashboard gauges.  \n- The car's interior features a visible notebook on the passenger side, likely containing race strategy or route notes.  \n- The vehicle navigates a dirt road with visible turns, surrounded by grassy terrain and sparse roadside spectators.\n[90-120s] - Driver grips steering wheel, hands adjusting position as vehicle navigates winding dirt road.  \n- Dashboard displays multiple gauges; driver’s left hand occasionally shifts gear lever.  \n- Right side of cabin shows paper notes and gear shift controls; driver’s right hand occasionally adjusts controls.\n[120-150s] - Driver grips steering wheel, hands adjusting position while navigating dirt road.  \n- Dashboard displays active gauges, with gear shifter and control levers visible.  \n- Vehicle moves forward along winding path, with spectators visible on roadside.\n[150-180s] - Driver grips steering wheel, shifting gears with left hand while right hand controls gear shifter.  \n- Dashboard displays fluctuating gauges, including speedometer and tachometer, indicating active driving.  \n- Car navigates a winding dirt road with grassy terrain on both sides, passing spectators in distance.\n[180-210s] - Driver grips steering wheel, hands adjusting position as vehicle navigates winding gravel road.  \n- Dashboard instruments show active readings, with gear shifter and control levers visible in center console.  \n- Driver’s helmet and gloves feature green Monster Energy branding, matching interior decor.\n[210-240s] - Driver's gloved hands grip the steering wheel, making precise adjustments while navigating a winding dirt road.  \n- The dashboard displays fluctuating gauges, indicating engine performance and vehicle speed.  \n- A notebook rests on the center console, suggesting the driver is referencing a route or strategy.\n[240-270s] - Driver grips steering wheel, hands moving slightly as car navigates winding road.  \n- Dashboard instruments and gear shifter visible, with Monster Energy logos on windshield.  \n- Road ahead curves through grassy terrain, with trees lining the sides.\n[270-300s] - Driver's gloved hands actively steer and shift gears, with left hand on wheel and right hand on gear stick.  \n- Dashboard displays fluctuating gauges, including speedometer and tachometer, indicating active driving.  \n- Interior features Monster Energy logos on windshield and a clipboard with notes on center console.\n[300-330s] - Driver's gloved hands grip the steering wheel, making precise adjustments while navigating a winding road.  \n- The car's dashboard displays fluctuating gauges, indicating active driving conditions.  \n- A notebook rests on the center console, suggesting the driver is referencing route or timing data.\n[330-360s] - Driver grips steering wheel, making precise turns while navigating a winding road.  \n- Dashboard instruments show active readings, with a visible speedometer and tachometer.  \n- Co-driver holds a notebook, likely referencing route details, while seated beside the driver.", "history_tokens": 812, "history_utf8_bytes": 3816, "recent_frame_times_s": [356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0], "recent_frames_sha256": "53641dde88f477e86e8fe922fab5ab5c5edbe4011d7a15030b22927ba5ab314b", "num_recent_frames": 30, "tq": 716194.246303607, "t1": 716201.065702254, "ta": 716201.065702254, "te": 716201.33895287, "first_response_s": 6.8193986469414085, "answer_total_s": 7.092649262980558, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 261, "content_group": "2924859816245e7bdd41b7928a7bec9bfdc576bb23fa7376765b040861ff628e", "question": {"question_id": "sample_261_a1228_q0", "video_id": 261, "video_path": "./videos/sample_261_real.mp4", "annotation_index": 1228, "question_index": 0, "question": "What color are the illuminated gauges on the dashboard right now?", "options": ["A. Blue and green.", "B. Red and blue.", "C. Green and yellow.", "D. White and red."], "answer": "A", "time_stamp_s": 614, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [612, 617], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_261_a1228_q0", "video_id": 261, "time_stamp_s": 614, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b82e3363a4f95d8dc1c900f98c36af65b877f23344051805faa4739b6e30bf6b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [585.0, 586.0, 587.0, 588.0, 589.0, 590.0, 591.0, 592.0, 593.0, 594.0, 595.0, 596.0, 597.0, 598.0, 599.0, 600.0, 601.0, 602.0, 603.0, 604.0, 605.0, 606.0, 607.0, 608.0, 609.0, 610.0, 611.0, 612.0, 613.0, 614.0], "recent_frames_sha256": "8b66eb1b9499e1d241ee1705fa0ceaa849d2de32d1b3518192742a31fce1159b", "num_recent_frames": 30, "tq": 716050.558607254, "t1": 716064.530466097, "ta": 716064.530466097, "te": 716064.569349087, "first_response_s": 13.971858843113296, "answer_total_s": 14.010741833015345, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_261_a1228_q0", "video_id": 261, "time_stamp_s": 614, "ground_truth": "A", "raw_output": "A. Blue and green.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "ce63246332912aea524889c98cd5964646445f8e6b6f4801244870a097b8c290", "condition_order": ["recent", "notes"], "memory": "[120-150s] - Driver grips steering wheel, hands adjusting position while navigating dirt road.  \n- Dashboard displays active gauges, with gear shifter and control levers visible.  \n- Vehicle moves forward along winding path, with spectators visible on roadside.\n[150-180s] - Driver grips steering wheel, shifting gears with left hand while right hand controls gear shifter.  \n- Dashboard displays fluctuating gauges, including speedometer and tachometer, indicating active driving.  \n- Car navigates a winding dirt road with grassy terrain on both sides, passing spectators in distance.\n[180-210s] - Driver grips steering wheel, hands adjusting position as vehicle navigates winding gravel road.  \n- Dashboard instruments show active readings, with gear shifter and control levers visible in center console.  \n- Driver’s helmet and gloves feature green Monster Energy branding, matching interior decor.\n[210-240s] - Driver's gloved hands grip the steering wheel, making precise adjustments while navigating a winding dirt road.  \n- The dashboard displays fluctuating gauges, indicating engine performance and vehicle speed.  \n- A notebook rests on the center console, suggesting the driver is referencing a route or strategy.\n[240-270s] - Driver grips steering wheel, hands moving slightly as car navigates winding road.  \n- Dashboard instruments and gear shifter visible, with Monster Energy logos on windshield.  \n- Road ahead curves through grassy terrain, with trees lining the sides.\n[270-300s] - Driver's gloved hands actively steer and shift gears, with left hand on wheel and right hand on gear stick.  \n- Dashboard displays fluctuating gauges, including speedometer and tachometer, indicating active driving.  \n- Interior features Monster Energy logos on windshield and a clipboard with notes on center console.\n[300-330s] - Driver's gloved hands grip the steering wheel, making precise adjustments while navigating a winding road.  \n- The car's dashboard displays fluctuating gauges, indicating active driving conditions.  \n- A notebook rests on the center console, suggesting the driver is referencing route or timing data.\n[330-360s] - Driver grips steering wheel, making precise turns while navigating a winding road.  \n- Dashboard instruments show active readings, with a visible speedometer and tachometer.  \n- Co-driver holds a notebook, likely referencing route details, while seated beside the driver.\n[360-390s] - Driver adjusts helmet strap while gripping steering wheel.  \n- Dashboard gauges show active vehicle metrics during motion.  \n- Road ahead curves left, with grassy terrain on both sides.\n[390-420s] - Driver grips steering wheel, shifting gears with gloved hands while navigating a winding dirt road.  \n- Dashboard displays fluctuating gauges, with a visible notebook and tools on the center console.  \n- Car’s interior features prominent Monster Energy branding on the windshield and steering wheel.\n[420-450s] - Driver's hands grip steering wheel, making precise adjustments while navigating the dirt road.  \n- Dashboard instruments display active readings, including speedometer and tachometer, indicating vehicle performance.  \n- Interior features visible: gear shifter, control panel, and a notebook on the passenger side, suggesting race preparation or strategy notes.\n[450-480s] - Driver grips steering wheel with gloved hands, making precise turns on winding dirt road.  \n- Dashboard displays fluctuating gauges, indicating active vehicle performance.  \n- Interior features Monster Energy branding and rally-specific controls, with a paper map visible on the right.\n[480-510s] - Driver's gloved hands grip the steering wheel, making precise adjustments while navigating a winding road.  \n- Dashboard instruments and controls remain illuminated, showing active vehicle metrics as the car speeds along.  \n- A text overlay appears, reading \"SWITCHING TO DARK MODE 3,\" indicating a transition to a darker visual theme.\n[510-540s] - Driver's hands are visible on the steering wheel, actively maneuvering the vehicle.  \n- Dashboard lights (green and red) illuminate, indicating operational status.  \n- Road ahead is dimly lit, with reflections from headlights visible on wet pavement.\n[540-570s] - Dashboard lights (green, blue, red) remain illuminated, indicating active systems.  \n- Steering wheel and controls are visible, suggesting driver interaction.  \n- Road ahead is dimly lit, with blurred lights indicating motion at night.\n[570-600s] - Dashboard lights (green, blue, red) remain illuminated, indicating active systems.  \n- Rain streaks across the windshield, obscuring distant road lights.  \n- Steering wheel and gear shift are visible, suggesting vehicle control.", "history_tokens": 1023, "history_utf8_bytes": 4712, "recent_frame_times_s": [585.0, 586.0, 587.0, 588.0, 589.0, 590.0, 591.0, 592.0, 593.0, 594.0, 595.0, 596.0, 597.0, 598.0, 599.0, 600.0, 601.0, 602.0, 603.0, 604.0, 605.0, 606.0, 607.0, 608.0, 609.0, 610.0, 611.0, 612.0, 613.0, 614.0], "recent_frames_sha256": "8b66eb1b9499e1d241ee1705fa0ceaa849d2de32d1b3518192742a31fce1159b", "num_recent_frames": 30, "tq": 716287.368085585, "t1": 716288.271390116, "ta": 716288.271390116, "te": 716288.494535285, "first_response_s": 0.9033045310061425, "answer_total_s": 1.1264497000956908, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 261, "content_group": "2924859816245e7bdd41b7928a7bec9bfdc576bb23fa7376765b040861ff628e", "question": {"question_id": "sample_261_a1229_q0", "video_id": 261, "video_path": "./videos/sample_261_real.mp4", "annotation_index": 1229, "question_index": 0, "question": "What color are the illuminated gauges on the dashboard right now?", "options": ["A. Blue and green.", "B. Red and blue.", "C. Green and yellow.", "D. White and red."], "answer": "A", "time_stamp_s": 819, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [816, 821], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_261_a1229_q0", "video_id": 261, "time_stamp_s": 819, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ee4d748deff5d2e13540c222ffb2d81e083545b964e560e6f4a84cde984784e5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [790.0, 791.0, 792.0, 793.0, 794.0, 795.0, 796.0, 797.0, 798.0, 799.0, 800.0, 801.0, 802.0, 803.0, 804.0, 805.0, 806.0, 807.0, 808.0, 809.0, 810.0, 811.0, 812.0, 813.0, 814.0, 815.0, 816.0, 817.0, 818.0, 819.0], "recent_frames_sha256": "495264f4682bdb925302ea90e4985fd68a664159a5a20de22e588dc38c79be16", "num_recent_frames": 30, "tq": 716064.576900493, "t1": 716076.961999569, "ta": 716076.961999569, "te": 716077.004620918, "first_response_s": 12.385099075967446, "answer_total_s": 12.427720424951985, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_261_a1229_q0", "video_id": 261, "time_stamp_s": 819, "ground_truth": "A", "raw_output": "A. Blue and green.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "156a91cba5401be945011e4eac180f5f1018aa9f030eed72e5d57e4303601b41", "condition_order": ["recent", "notes"], "memory": "[360-390s] - Driver adjusts helmet strap while gripping steering wheel.  \n- Dashboard gauges show active vehicle metrics during motion.  \n- Road ahead curves left, with grassy terrain on both sides.\n[390-420s] - Driver grips steering wheel, shifting gears with gloved hands while navigating a winding dirt road.  \n- Dashboard displays fluctuating gauges, with a visible notebook and tools on the center console.  \n- Car’s interior features prominent Monster Energy branding on the windshield and steering wheel.\n[420-450s] - Driver's hands grip steering wheel, making precise adjustments while navigating the dirt road.  \n- Dashboard instruments display active readings, including speedometer and tachometer, indicating vehicle performance.  \n- Interior features visible: gear shifter, control panel, and a notebook on the passenger side, suggesting race preparation or strategy notes.\n[450-480s] - Driver grips steering wheel with gloved hands, making precise turns on winding dirt road.  \n- Dashboard displays fluctuating gauges, indicating active vehicle performance.  \n- Interior features Monster Energy branding and rally-specific controls, with a paper map visible on the right.\n[480-510s] - Driver's gloved hands grip the steering wheel, making precise adjustments while navigating a winding road.  \n- Dashboard instruments and controls remain illuminated, showing active vehicle metrics as the car speeds along.  \n- A text overlay appears, reading \"SWITCHING TO DARK MODE 3,\" indicating a transition to a darker visual theme.\n[510-540s] - Driver's hands are visible on the steering wheel, actively maneuvering the vehicle.  \n- Dashboard lights (green and red) illuminate, indicating operational status.  \n- Road ahead is dimly lit, with reflections from headlights visible on wet pavement.\n[540-570s] - Dashboard lights (green, blue, red) remain illuminated, indicating active systems.  \n- Steering wheel and controls are visible, suggesting driver interaction.  \n- Road ahead is dimly lit, with blurred lights indicating motion at night.\n[570-600s] - Dashboard lights (green, blue, red) remain illuminated, indicating active systems.  \n- Rain streaks across the windshield, obscuring distant road lights.  \n- Steering wheel and gear shift are visible, suggesting vehicle control.\n[600-630s] - Illuminated cockpit instruments display green and blue lights, with a central circular gauge showing a steady reading.\n- The windshield reveals a dimly lit road ahead, with blurred lights from distant vehicles or streetlights.\n- A notebook or tablet is visible on the right side of the console, partially lit and stationary.\n[630-660s] - Dashboard lights flicker intermittently, including green and red indicators, while the vehicle moves at night.\n- The windshield wipers are active, clearing rain from the glass as the car navigates a wet road.\n- A laptop screen is visible on the right side of the dashboard, displaying content that remains static throughout the segment.\n[660-690s] - Dashboard lights flicker intermittently, indicating system activity or potential malfunction.  \n- Driver’s hands are visible on the steering wheel, making minor adjustments while driving.  \n- Road ahead is wet and reflective, with distant streetlights creating glare on the surface.\n[690-720s] - Dashboard lights (green, blue, red) remain steady, indicating active systems.  \n- Windshield wipers are active, clearing rain from the view.  \n- A small white object (possibly a vehicle or sign) is visible on the road ahead.\n[720-750s] - Dashboard lights (green, blue, red) remain illuminated, indicating active systems.  \n- Windshield wipers are active, clearing rain from the glass.  \n- Road ahead is dimly lit, with blurred streetlights and vehicle lights visible.\n[750-780s] - Illuminated cockpit instruments display green and blue lights, with a central circular gauge showing a reading.\n- A notebook rests on the right side of the console, its pages visible under ambient light.\n- The windshield reveals a dimly lit road ahead, with intermittent bright lights from oncoming traffic or street lamps.\n[780-810s] - Dashboard lights (green, blue, red) remain illuminated, indicating active systems.  \n- Driver’s hand is visible near a white notebook on the right side of the console.  \n- Road ahead is wet and reflects distant vehicle lights, suggesting nighttime driving conditions.", "history_tokens": 967, "history_utf8_bytes": 4377, "recent_frame_times_s": [790.0, 791.0, 792.0, 793.0, 794.0, 795.0, 796.0, 797.0, 798.0, 799.0, 800.0, 801.0, 802.0, 803.0, 804.0, 805.0, 806.0, 807.0, 808.0, 809.0, 810.0, 811.0, 812.0, 813.0, 814.0, 815.0, 816.0, 817.0, 818.0, 819.0], "recent_frames_sha256": "495264f4682bdb925302ea90e4985fd68a664159a5a20de22e588dc38c79be16", "num_recent_frames": 30, "tq": 716342.657068066, "t1": 716343.677704849, "ta": 716343.677704849, "te": 716343.90011759, "first_response_s": 1.0206367830978706, "answer_total_s": 1.2430495240259916, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 262, "content_group": "35d313bb5e8949c2df0ce030846c08e15278df0a9133fa64051838701f068252", "question": {"question_id": "sample_262_a926_q0", "video_id": 262, "video_path": "./videos/sample_262_real.mp4", "annotation_index": 926, "question_index": 0, "question": "What type of car is featured in the video right now?", "options": ["A. Ferrari F8 Tributo.", "B. Lamborghini Huracan.", "C. BMW M4.", "D. Porsche 911 GT3 RS."], "answer": "D", "time_stamp_s": 10, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_262_a926_q0", "video_id": 262, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "36f536eaa06b0aefa38df2fee08074f5660448e396c50e9a9a2fc18000983449", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "9aac69cdf4b064e6b8cd647808c3aaf29d25079470c807a0fa21590288a27e96", "num_recent_frames": 11, "tq": 717826.094337565, "t1": 717861.655079343, "ta": 717861.655079343, "te": 717861.841581743, "first_response_s": 35.560741777997464, "answer_total_s": 35.74724417796824, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_262_a926_q0", "video_id": 262, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8b10d1d03cb0cdcf4f2b2f06f993c64bb60d0764531752a6fdcbe3119c3ef533", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "9aac69cdf4b064e6b8cd647808c3aaf29d25079470c807a0fa21590288a27e96", "num_recent_frames": 11, "tq": 717712.570866579, "t1": 717718.39654139, "ta": 717718.39654139, "te": 717718.435583993, "first_response_s": 5.825674811028875, "answer_total_s": 5.864717414020561, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 262, "content_group": "35d313bb5e8949c2df0ce030846c08e15278df0a9133fa64051838701f068252", "question": {"question_id": "sample_262_a927_q0", "video_id": 262, "video_path": "./videos/sample_262_real.mp4", "annotation_index": 927, "question_index": 0, "question": "What is the current gear level of the car?", "options": ["A. 1.", "B. 2.", "C. 3.", "D. 4."], "answer": "D", "time_stamp_s": 88, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [85, 90], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_262_a927_q0", "video_id": 262, "time_stamp_s": 88, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "16367644acb9765cb002dbe31653833013101f6e8222d105e4e358d3d5deed1c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0], "recent_frames_sha256": "d61b62a8072bb3ed0afee804e349a0bceb161c9975b3632be5115d0f927085e2", "num_recent_frames": 30, "tq": 717861.860729547, "t1": 717870.162362062, "ta": 717870.162362062, "te": 717870.393729626, "first_response_s": 8.301632515038364, "answer_total_s": 8.533000078983605, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_262_a927_q0", "video_id": 262, "time_stamp_s": 88, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8fa8ca44371dddc3413673fb8d65dddf4e92cbcf9726601c0e3d27a01ffec8e1", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Porsche 911 GT3 RS drives on Nürburgring Nordschleife, with dashboard showing speed, gear, and lap time.\n- Driver navigates through turns, with speed fluctuating between 100-200 km/h, and track length displayed as 20.400 km.\n- On-screen graphics include sponsor logos (Michelin, Mobil 1, VBOX) and a map of the track layout.\n[30-60s] - Car speed increases from 118 to 228 km/h while navigating a winding track with trees and barriers.  \n- Dashboard displays track length, lap time, and gear selection, with \"Porsche\" and \"Michelin\" logos visible.  \n- Driver maneuvers through curves, with the car's position shifting relative to the track’s edge and surrounding foliage.", "history_tokens": 187, "history_utf8_bytes": 683, "recent_frame_times_s": [59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0], "recent_frames_sha256": "d61b62a8072bb3ed0afee804e349a0bceb161c9975b3632be5115d0f927085e2", "num_recent_frames": 30, "tq": 717738.456238386, "t1": 717739.323958688, "ta": 717739.323958688, "te": 717739.361801263, "first_response_s": 0.8677203019615263, "answer_total_s": 0.9055628769565374, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 262, "content_group": "35d313bb5e8949c2df0ce030846c08e15278df0a9133fa64051838701f068252", "question": {"question_id": "sample_262_a928_q0", "video_id": 262, "video_path": "./videos/sample_262_real.mp4", "annotation_index": 928, "question_index": 0, "question": "Right now, what is indicated by the green column?", "options": ["A. Braking.", "B. Tire pressure.", "C. Speed.", "D. Throttle."], "answer": "A", "time_stamp_s": 172, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [170, 175], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_262_a928_q0", "video_id": 262, "time_stamp_s": 172, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d1cff913f2aa48528623665abaf37780dfb264791ebf963a60cdcfcefc27b3a6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0], "recent_frames_sha256": "16f16e4c7ebce3e0009d7ca228b4556cc97c383fe5c2b131d588dd942aa75787", "num_recent_frames": 30, "tq": 717870.412441342, "t1": 717877.12159255, "ta": 717877.12159255, "te": 717877.159753538, "first_response_s": 6.709151207935065, "answer_total_s": 6.747312195948325, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_262_a928_q0", "video_id": 262, "time_stamp_s": 172, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "cb7c0a71996d3c0d992a5281a3f2fd928b8d26248606cadfbf734a2092b487f6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Porsche 911 GT3 RS drives on Nürburgring Nordschleife, with dashboard showing speed, gear, and lap time.\n- Driver navigates through turns, with speed fluctuating between 100-200 km/h, and track length displayed as 20.400 km.\n- On-screen graphics include sponsor logos (Michelin, Mobil 1, VBOX) and a map of the track layout.\n[30-60s] - Car speed increases from 118 to 228 km/h while navigating a winding track with trees and barriers.  \n- Dashboard displays track length, lap time, and gear selection, with \"Porsche\" and \"Michelin\" logos visible.  \n- Driver maneuvers through curves, with the car's position shifting relative to the track’s edge and surrounding foliage.\n[60-90s] - Speed fluctuates between 228 and 245 km/h as the car navigates a right-hand turn.  \n- The track layout map on the left shows the current position along the circuit.  \n- The lap time increases from 00:55.23 to 01:03.23, indicating progress through the lap.\n[90-120s] - Speed fluctuates between 210-290 km/h as the car navigates turns on the track.  \n- Lap time progresses from 01:20.23 to 01:22.23, indicating steady performance.  \n- Track map shows progression through turns, with \"BRAS\" and \"MOTUL\" branding visible on screen.\n[120-150s] - Speed fluctuates between 118 and 178 km/h as the car navigates a right-hand turn.\n- The track length and lap time are displayed on-screen, showing progression from 01:55.23 to 02:00.23.\n- The car's gear shifts from 5th to 4th, then to 3rd, as indicated by the gear indicator on the dashboard.", "history_tokens": 462, "history_utf8_bytes": 1528, "recent_frame_times_s": [143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0], "recent_frames_sha256": "16f16e4c7ebce3e0009d7ca228b4556cc97c383fe5c2b131d588dd942aa75787", "num_recent_frames": 30, "tq": 717762.546714729, "t1": 717764.57368037, "ta": 717764.57368037, "te": 717764.881507818, "first_response_s": 2.026965640950948, "answer_total_s": 2.3347930889576674, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 262, "content_group": "35d313bb5e8949c2df0ce030846c08e15278df0a9133fa64051838701f068252", "question": {"question_id": "sample_262_a929_q0", "video_id": 262, "video_path": "./videos/sample_262_real.mp4", "annotation_index": 929, "question_index": 0, "question": "Right now, what gear is the car using?", "options": ["A. 3.", "B. 4.", "C. 6.", "D. 5."], "answer": "D", "time_stamp_s": 260, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [255, 260], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_262_a929_q0", "video_id": 262, "time_stamp_s": 260, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "abc1dc1704ece8bed959f5ea18d8a96ca91d7b9d5ab515e7925a5b6b5ac07484", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0], "recent_frames_sha256": "1402c4c9ad6930714370aacd24edec20a6f35943328490015a7f1bab5ad67892", "num_recent_frames": 30, "tq": 717877.176341117, "t1": 717883.465420767, "ta": 717883.465420767, "te": 717883.504823025, "first_response_s": 6.289079649955966, "answer_total_s": 6.328481907956302, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_262_a929_q0", "video_id": 262, "time_stamp_s": 260, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d7ded456799ad335795ff012494f5220ef47eaa73bc6f77503bb893b349242d3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Porsche 911 GT3 RS drives on Nürburgring Nordschleife, with dashboard showing speed, gear, and lap time.\n- Driver navigates through turns, with speed fluctuating between 100-200 km/h, and track length displayed as 20.400 km.\n- On-screen graphics include sponsor logos (Michelin, Mobil 1, VBOX) and a map of the track layout.\n[30-60s] - Car speed increases from 118 to 228 km/h while navigating a winding track with trees and barriers.  \n- Dashboard displays track length, lap time, and gear selection, with \"Porsche\" and \"Michelin\" logos visible.  \n- Driver maneuvers through curves, with the car's position shifting relative to the track’s edge and surrounding foliage.\n[60-90s] - Speed fluctuates between 228 and 245 km/h as the car navigates a right-hand turn.  \n- The track layout map on the left shows the current position along the circuit.  \n- The lap time increases from 00:55.23 to 01:03.23, indicating progress through the lap.\n[90-120s] - Speed fluctuates between 210-290 km/h as the car navigates turns on the track.  \n- Lap time progresses from 01:20.23 to 01:22.23, indicating steady performance.  \n- Track map shows progression through turns, with \"BRAS\" and \"MOTUL\" branding visible on screen.\n[120-150s] - Speed fluctuates between 118 and 178 km/h as the car navigates a right-hand turn.\n- The track length and lap time are displayed on-screen, showing progression from 01:55.23 to 02:00.23.\n- The car's gear shifts from 5th to 4th, then to 3rd, as indicated by the gear indicator on the dashboard.\n[150-180s] - Speed fluctuates between 148-168 km/h as the motorcycle navigates a winding track with visible guardrails and trees.  \n- The digital dashboard displays lap time progressing from 02:26.23 to 02:28.23, indicating steady lap progression.  \n- Track position remains consistent at \"1\" with no overtaking or significant changes in the vehicle's position relative to the track.\n[180-210s] - Speed fluctuates between 200-230 km/h as the car navigates a winding forest-lined track.  \n- The digital dashboard displays lap time, track length, and gear selection, with gear shifting from 4 to 5.  \n- The car's position on the track is indicated by a map overlay, showing progression along the circuit.\n[210-240s] - Car speed fluctuates between 250-290 km/h as it navigates a winding mountain road.\n- Dashboard displays track length, lap time, and gear position, indicating active racing conditions.\n- Driver maneuvers through curves with visible trackside barriers and trees lining the road.", "history_tokens": 717, "history_utf8_bytes": 2521, "recent_frame_times_s": [231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0], "recent_frames_sha256": "1402c4c9ad6930714370aacd24edec20a6f35943328490015a7f1bab5ad67892", "num_recent_frames": 30, "tq": 717789.988970543, "t1": 717791.795795649, "ta": 717791.795795649, "te": 717792.00041583, "first_response_s": 1.8068251060321927, "answer_total_s": 2.011445287032984, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 262, "content_group": "35d313bb5e8949c2df0ce030846c08e15278df0a9133fa64051838701f068252", "question": {"question_id": "sample_262_a930_q0", "video_id": 262, "video_path": "./videos/sample_262_real.mp4", "annotation_index": 930, "question_index": 0, "question": "Right now, what is the current speed of the car?", "options": ["A. approx 226 km/h.", "B. approx 189 km/h.", "C. approx 190 km/h.", "D. approx 249 km/h."], "answer": "D", "time_stamp_s": 340, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [340, 345], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_262_a930_q0", "video_id": 262, "time_stamp_s": 340, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "65f0956632fa714c53882271ea175c56e31278936f27de2fa63aa4ec50c1e8ca", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0], "recent_frames_sha256": "9348e387068ed0da1c64438eb9882440a3b5d28d907b25103c06c61309054778", "num_recent_frames": 30, "tq": 717883.532178742, "t1": 717890.291748168, "ta": 717890.291748168, "te": 717890.329085743, "first_response_s": 6.759569425950758, "answer_total_s": 6.796907001058571, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_262_a930_q0", "video_id": 262, "time_stamp_s": 340, "ground_truth": "D", "raw_output": "C. approx 190 km/h.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "f76d9c5519be7e554e30257bf83b17fb620392a3bb0a772cfee0e75cac370384", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Porsche 911 GT3 RS drives on Nürburgring Nordschleife, with dashboard showing speed, gear, and lap time.\n- Driver navigates through turns, with speed fluctuating between 100-200 km/h, and track length displayed as 20.400 km.\n- On-screen graphics include sponsor logos (Michelin, Mobil 1, VBOX) and a map of the track layout.\n[30-60s] - Car speed increases from 118 to 228 km/h while navigating a winding track with trees and barriers.  \n- Dashboard displays track length, lap time, and gear selection, with \"Porsche\" and \"Michelin\" logos visible.  \n- Driver maneuvers through curves, with the car's position shifting relative to the track’s edge and surrounding foliage.\n[60-90s] - Speed fluctuates between 228 and 245 km/h as the car navigates a right-hand turn.  \n- The track layout map on the left shows the current position along the circuit.  \n- The lap time increases from 00:55.23 to 01:03.23, indicating progress through the lap.\n[90-120s] - Speed fluctuates between 210-290 km/h as the car navigates turns on the track.  \n- Lap time progresses from 01:20.23 to 01:22.23, indicating steady performance.  \n- Track map shows progression through turns, with \"BRAS\" and \"MOTUL\" branding visible on screen.\n[120-150s] - Speed fluctuates between 118 and 178 km/h as the car navigates a right-hand turn.\n- The track length and lap time are displayed on-screen, showing progression from 01:55.23 to 02:00.23.\n- The car's gear shifts from 5th to 4th, then to 3rd, as indicated by the gear indicator on the dashboard.\n[150-180s] - Speed fluctuates between 148-168 km/h as the motorcycle navigates a winding track with visible guardrails and trees.  \n- The digital dashboard displays lap time progressing from 02:26.23 to 02:28.23, indicating steady lap progression.  \n- Track position remains consistent at \"1\" with no overtaking or significant changes in the vehicle's position relative to the track.\n[180-210s] - Speed fluctuates between 200-230 km/h as the car navigates a winding forest-lined track.  \n- The digital dashboard displays lap time, track length, and gear selection, with gear shifting from 4 to 5.  \n- The car's position on the track is indicated by a map overlay, showing progression along the circuit.\n[210-240s] - Car speed fluctuates between 250-290 km/h as it navigates a winding mountain road.\n- Dashboard displays track length, lap time, and gear position, indicating active racing conditions.\n- Driver maneuvers through curves with visible trackside barriers and trees lining the road.\n[240-270s] - Dashboard displays speed fluctuating between 118-168 km/h, with lap time increasing from 05:56 to 06:03.\n- Track layout shows a left-hand turn followed by a straight section, with the car navigating through trees and barriers.\n- Steering wheel and gear shift indicators visible, with gear changing from 1st to 2nd and back to 1st during the segment.\n[270-300s] - Car speed fluctuates between 145-165 km/h as it navigates a right-hand turn.\n- Track length and lap time display consistent values (06:20.23 to 06:20.27) indicating steady lap progression.\n- Dashboard shows gear selection changing from 3 to 4, with RPM and throttle input adjusting accordingly.\n[300-330s] - Speed fluctuates between 110-160 km/h as the motorcycle navigates a winding track with trees and barriers on both sides.\n- The digital dashboard displays lap time, track length, and gear selection, with the current gear shifting from 3 to 4.\n- The track map on the left shows the route progression, indicating the rider is approaching a turn or straight section.", "history_tokens": 998, "history_utf8_bytes": 3568, "recent_frame_times_s": [311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0], "recent_frames_sha256": "9348e387068ed0da1c64438eb9882440a3b5d28d907b25103c06c61309054778", "num_recent_frames": 30, "tq": 717817.752109069, "t1": 717825.630089623, "ta": 717825.630089623, "te": 717826.067311884, "first_response_s": 7.877980554010719, "answer_total_s": 8.315202814992517, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 263, "content_group": "0229762618404ab7b0c2736ac56f96b9ddf6ba13fae52473e2c011223cb39200", "question": {"question_id": "sample_263_a1203_q0", "video_id": 263, "video_path": "./videos/sample_263_real.mp4", "annotation_index": 1203, "question_index": 0, "question": "What word is currently displayed in the bottom of the screen?", "options": ["A. PORSCHE.", "B. TURBO.", "C. HYBRID.", "D. ONBOARD."], "answer": "D", "time_stamp_s": 5, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_263_a1203_q0", "video_id": 263, "time_stamp_s": 5, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cd1b5d468d6382abe119af8b1a9d1ac6bfc670fb76c57c9823644143454154a9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "78f6dde01a88cc07d62ba90f51d18fda67f2e53d3a28f69d75695ee3a3554bd0", "num_recent_frames": 6, "tq": 718158.943282992, "t1": 718159.759847457, "ta": 718159.759847457, "te": 718159.797575703, "first_response_s": 0.8165644650580361, "answer_total_s": 0.8542927110102028, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_263_a1203_q0", "video_id": 263, "time_stamp_s": 5, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6a245eb2314f82d0e98ad4fc5104b274a9b7a09109ebf2ffcbc1015a57165239", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "78f6dde01a88cc07d62ba90f51d18fda67f2e53d3a28f69d75695ee3a3554bd0", "num_recent_frames": 6, "tq": 718029.750889856, "t1": 718041.738220016, "ta": 718041.738220016, "te": 718041.780709168, "first_response_s": 11.987330159987323, "answer_total_s": 12.029819311923347, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 263, "content_group": "0229762618404ab7b0c2736ac56f96b9ddf6ba13fae52473e2c011223cb39200", "question": {"question_id": "sample_263_a1204_q0", "video_id": 263, "video_path": "./videos/sample_263_real.mp4", "annotation_index": 1204, "question_index": 0, "question": "What brand logo is currently visible on the bridge?", "options": ["A. Michelin.", "B. Pirelli.", "C. Goodyear.", "D. Yokohama."], "answer": "D", "time_stamp_s": 94, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [92, 97], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_263_a1204_q0", "video_id": 263, "time_stamp_s": 94, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "18f9306b242d297b9f8bd4c572137a16cb09ccdf694ce6f084cb579c3fb1bbad", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0], "recent_frames_sha256": "8064da62c77f6845520f5e8d3c3e136271b5964dd559ec923cbe6e5d3d28c04c", "num_recent_frames": 30, "tq": 718159.820062451, "t1": 718172.233494574, "ta": 718172.233494574, "te": 718172.271460486, "first_response_s": 12.413432123023085, "answer_total_s": 12.451398035045713, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_263_a1204_q0", "video_id": 263, "time_stamp_s": 94, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "26f79a1b48f936c8d79a1c5263aab79c454dbaaf1e492a6adea505a7efc90da3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver in racing suit and helmet navigates Nürburgring track, with speedometer and lap timer visible on screen.\n- Track features curbs, barriers, and greenery, with a map outline of the circuit displayed on the right.\n- Vehicle speed increases from 95 km/h to 206 km/h during the lap, as indicated by the on-screen speedometer.\n[30-60s] - Driver in green helmet navigates track with visible speedometer fluctuating between 100-230 km/h.\n- Track features greenery, barriers, and a map overlay indicating \"Paramatra Turbo S-E-Hybrid\" and \"20.832 km\" length.\n- Lap time progresses from 00:22.705 to 00:44.696, showing increasing duration as the car completes the circuit.\n[60-90s] - Driver in green helmet and racing suit navigates wet track with windshield wipers active.  \n- On-screen display shows lap time increasing from 0:05.695 to 0:11.692, with speed fluctuating between 240–278 km/h.  \n- Track map indicates a circuit with a total length of 20.832 km, labeled as \"Paramatra Turbo S-E-Hybrid.\"", "history_tokens": 296, "history_utf8_bytes": 1011, "recent_frame_times_s": [65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0], "recent_frames_sha256": "8064da62c77f6845520f5e8d3c3e136271b5964dd559ec923cbe6e5d3d28c04c", "num_recent_frames": 30, "tq": 718065.546595829, "t1": 718067.24589388, "ta": 718067.24589388, "te": 718067.562926191, "first_response_s": 1.6992980510694906, "answer_total_s": 2.016330362064764, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 263, "content_group": "0229762618404ab7b0c2736ac56f96b9ddf6ba13fae52473e2c011223cb39200", "question": {"question_id": "sample_263_a1205_q0", "video_id": 263, "video_path": "./videos/sample_263_real.mp4", "annotation_index": 1205, "question_index": 0, "question": "What is the current track length displayed on the screen?", "options": ["A. 13.567 km.", "B. 12.935 km.", "C. 18.752 km.", "D. 20.832 km."], "answer": "D", "time_stamp_s": 185, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [184, 189], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_263_a1205_q0", "video_id": 263, "time_stamp_s": 185, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "52a76d18e72dfb9cbdf45704cc69b3a650d9d03b228ce0c7eda6a4a3893ef8bb", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0], "recent_frames_sha256": "cb6a0a0f016d01c238b4b644b616fa2be9216a163efc9d081291d6bf0baffc94", "num_recent_frames": 30, "tq": 718172.278701247, "t1": 718185.65424169, "ta": 718185.65424169, "te": 718185.693835166, "first_response_s": 13.37554044299759, "answer_total_s": 13.415133919101208, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_263_a1205_q0", "video_id": 263, "time_stamp_s": 185, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "96277a35b1db0c519d47decfcf4e441ababee5f6b4fe4b189b15c802bcfc682d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver in racing suit and helmet navigates Nürburgring track, with speedometer and lap timer visible on screen.\n- Track features curbs, barriers, and greenery, with a map outline of the circuit displayed on the right.\n- Vehicle speed increases from 95 km/h to 206 km/h during the lap, as indicated by the on-screen speedometer.\n[30-60s] - Driver in green helmet navigates track with visible speedometer fluctuating between 100-230 km/h.\n- Track features greenery, barriers, and a map overlay indicating \"Paramatra Turbo S-E-Hybrid\" and \"20.832 km\" length.\n- Lap time progresses from 00:22.705 to 00:44.696, showing increasing duration as the car completes the circuit.\n[60-90s] - Driver in green helmet and racing suit navigates wet track with windshield wipers active.  \n- On-screen display shows lap time increasing from 0:05.695 to 0:11.692, with speed fluctuating between 240–278 km/h.  \n- Track map indicates a circuit with a total length of 20.832 km, labeled as \"Paramatra Turbo S-E-Hybrid.\"\n[90-120s] - Driver in green helmet navigates a winding track with visible speedometer readings fluctuating between 93-260 km/h.\n- On-screen display shows lap time increasing from 01:22.690 to 01:47.705 and track length as 20.832 km.\n- Track features green trees, barriers, and a \"YOKOHAMA\" sign visible in the background.\n[120-150s] - Driver in green helmet navigates a wet track with visible raindrops on windshield.\n- Car speed fluctuates between 90-224 km/h as it passes through turns and straightaways.\n- On-screen display shows lap time increasing from 01:57.718 to 02:18.706, with track length fixed at 20.832 km.\n[150-180s] - Driver in green helmet navigates a winding track with visible speed fluctuations (106-168 km/h).  \n- On-screen display shows lap time increasing from 02:22 to 02:45, with track length fixed at 20.832 km.  \n- Track environment features lush green trees, guardrails, and a map of the circuit in the lower right corner.", "history_tokens": 591, "history_utf8_bytes": 1961, "recent_frame_times_s": [156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0], "recent_frames_sha256": "cb6a0a0f016d01c238b4b644b616fa2be9216a163efc9d081291d6bf0baffc94", "num_recent_frames": 30, "tq": 718096.35280834, "t1": 718107.821308526, "ta": 718107.821308526, "te": 718107.866676963, "first_response_s": 11.468500185990706, "answer_total_s": 11.5138686230639, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 263, "content_group": "0229762618404ab7b0c2736ac56f96b9ddf6ba13fae52473e2c011223cb39200", "question": {"question_id": "sample_263_a1206_q0", "video_id": 263, "video_path": "./videos/sample_263_real.mp4", "annotation_index": 1206, "question_index": 0, "question": "What color is the current helmet of the driver?", "options": ["A. Red.", "B. Blue.", "C. Yellow.", "D. Green."], "answer": "D", "time_stamp_s": 276, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [276, 281], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_263_a1206_q0", "video_id": 263, "time_stamp_s": 276, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a468483c07684a24ed8284e498869a442c4868bce00401ce27d35f234fb4d689", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0], "recent_frames_sha256": "915d361668172a9247471eaa33e1c15fecce1f3557fd08f7fa209a1336825e3c", "num_recent_frames": 30, "tq": 718185.702789549, "t1": 718198.086542919, "ta": 718198.086542919, "te": 718198.12635034, "first_response_s": 12.38375337002799, "answer_total_s": 12.423560790950432, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_263_a1206_q0", "video_id": 263, "time_stamp_s": 276, "ground_truth": "D", "raw_output": "D. Green.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "d9a52ae9663bf2ba5073d56e6d22f8b32ea0e110c4b11eebb71886198b400317", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver in racing suit and helmet navigates Nürburgring track, with speedometer and lap timer visible on screen.\n- Track features curbs, barriers, and greenery, with a map outline of the circuit displayed on the right.\n- Vehicle speed increases from 95 km/h to 206 km/h during the lap, as indicated by the on-screen speedometer.\n[30-60s] - Driver in green helmet navigates track with visible speedometer fluctuating between 100-230 km/h.\n- Track features greenery, barriers, and a map overlay indicating \"Paramatra Turbo S-E-Hybrid\" and \"20.832 km\" length.\n- Lap time progresses from 00:22.705 to 00:44.696, showing increasing duration as the car completes the circuit.\n[60-90s] - Driver in green helmet and racing suit navigates wet track with windshield wipers active.  \n- On-screen display shows lap time increasing from 0:05.695 to 0:11.692, with speed fluctuating between 240–278 km/h.  \n- Track map indicates a circuit with a total length of 20.832 km, labeled as \"Paramatra Turbo S-E-Hybrid.\"\n[90-120s] - Driver in green helmet navigates a winding track with visible speedometer readings fluctuating between 93-260 km/h.\n- On-screen display shows lap time increasing from 01:22.690 to 01:47.705 and track length as 20.832 km.\n- Track features green trees, barriers, and a \"YOKOHAMA\" sign visible in the background.\n[120-150s] - Driver in green helmet navigates a wet track with visible raindrops on windshield.\n- Car speed fluctuates between 90-224 km/h as it passes through turns and straightaways.\n- On-screen display shows lap time increasing from 01:57.718 to 02:18.706, with track length fixed at 20.832 km.\n[150-180s] - Driver in green helmet navigates a winding track with visible speed fluctuations (106-168 km/h).  \n- On-screen display shows lap time increasing from 02:22 to 02:45, with track length fixed at 20.832 km.  \n- Track environment features lush green trees, guardrails, and a map of the circuit in the lower right corner.\n[180-210s] - Driver navigates a winding track with visible speed fluctuations (e.g., 190 km/h to 204 km/h) while maintaining control through curves.\n- On-screen display shows lap time increasing from 02:57 to 03:17, indicating progression through the lap.\n- Track layout includes green hills, barriers, and sponsor banners (e.g., Coca-Cola, KASK) along the circuit.\n[210-240s] - Driver in helmet and racing suit navigates a winding track with lush green trees on both sides.\n- On-screen display shows lap time increasing from 03:22.677 to 03:40.653, with speed rising from 138 km/h to 248 km/h.\n- Track map in corner indicates a circuit with a total length of 20.832 km, with a green line marking the current lap path.\n[240-270s] - Driver in green helmet navigates a wet track with visible raindrops on windshield.\n- On-screen display shows lap time increasing from 03:53 to 04:07, speed fluctuating between 174-194 km/h.\n- Track map highlights current position with a green dot moving along the circuit.", "history_tokens": 882, "history_utf8_bytes": 2966, "recent_frame_times_s": [247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0], "recent_frames_sha256": "915d361668172a9247471eaa33e1c15fecce1f3557fd08f7fa209a1336825e3c", "num_recent_frames": 30, "tq": 718131.274731645, "t1": 718132.502641781, "ta": 718132.502641781, "te": 718132.652739478, "first_response_s": 1.2279101359890774, "answer_total_s": 1.3780078330310062, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 263, "content_group": "0229762618404ab7b0c2736ac56f96b9ddf6ba13fae52473e2c011223cb39200", "question": {"question_id": "sample_263_a1207_q0", "video_id": 263, "video_path": "./videos/sample_263_real.mp4", "annotation_index": 1207, "question_index": 0, "question": "What car model is visible in the information panel right now?", "options": ["A. 911 Carrera.", "B. Taycan Turbo S.", "C. Macan S.", "D. Panamera Turbo S E-Hybrid."], "answer": "D", "time_stamp_s": 368, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [368, 373], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_263_a1207_q0", "video_id": 263, "time_stamp_s": 368, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c35420cdd6f2c33cbc50af01239a7627be70f072f50dac327ff8bf6ad4b1d55d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0], "recent_frames_sha256": "a42f0d4c6b1533ca3c9b52aa2c9004a79ad614c4b834fffa462a7e4603c6199c", "num_recent_frames": 30, "tq": 718198.138244549, "t1": 718208.384130818, "ta": 718208.384130818, "te": 718208.421270709, "first_response_s": 10.24588626890909, "answer_total_s": 10.283026159973815, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_263_a1207_q0", "video_id": 263, "time_stamp_s": 368, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e5c51b17d94ac7e676a515d63436fb77e1e610f1b0bdf12b791c8290783b8003", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Driver in green helmet and racing suit navigates wet track with windshield wipers active.  \n- On-screen display shows lap time increasing from 0:05.695 to 0:11.692, with speed fluctuating between 240–278 km/h.  \n- Track map indicates a circuit with a total length of 20.832 km, labeled as \"Paramatra Turbo S-E-Hybrid.\"\n[90-120s] - Driver in green helmet navigates a winding track with visible speedometer readings fluctuating between 93-260 km/h.\n- On-screen display shows lap time increasing from 01:22.690 to 01:47.705 and track length as 20.832 km.\n- Track features green trees, barriers, and a \"YOKOHAMA\" sign visible in the background.\n[120-150s] - Driver in green helmet navigates a wet track with visible raindrops on windshield.\n- Car speed fluctuates between 90-224 km/h as it passes through turns and straightaways.\n- On-screen display shows lap time increasing from 01:57.718 to 02:18.706, with track length fixed at 20.832 km.\n[150-180s] - Driver in green helmet navigates a winding track with visible speed fluctuations (106-168 km/h).  \n- On-screen display shows lap time increasing from 02:22 to 02:45, with track length fixed at 20.832 km.  \n- Track environment features lush green trees, guardrails, and a map of the circuit in the lower right corner.\n[180-210s] - Driver navigates a winding track with visible speed fluctuations (e.g., 190 km/h to 204 km/h) while maintaining control through curves.\n- On-screen display shows lap time increasing from 02:57 to 03:17, indicating progression through the lap.\n- Track layout includes green hills, barriers, and sponsor banners (e.g., Coca-Cola, KASK) along the circuit.\n[210-240s] - Driver in helmet and racing suit navigates a winding track with lush green trees on both sides.\n- On-screen display shows lap time increasing from 03:22.677 to 03:40.653, with speed rising from 138 km/h to 248 km/h.\n- Track map in corner indicates a circuit with a total length of 20.832 km, with a green line marking the current lap path.\n[240-270s] - Driver in green helmet navigates a wet track with visible raindrops on windshield.\n- On-screen display shows lap time increasing from 03:53 to 04:07, speed fluctuating between 174-194 km/h.\n- Track map highlights current position with a green dot moving along the circuit.\n[270-300s] - Driver in green helmet navigates a winding track, with speed fluctuating between 88 and 178 km/h.\n- On-screen display shows lap time progressing from 04:22.663 to 04:45.667, with track length at 20.832 km.\n- Car model identified as \"Panamera Turbo S E-Hybrid\" with a map of the track visible in the corner.\n[300-330s] - Driver in green helmet navigates a winding track with visible speed fluctuations (164 km/h to 122 km/h).\n- On-screen display shows lap time progressing from 04:51 to 05:08, with track length at 20.832 km.\n- Track layout map highlights a green line indicating the current lap path through forested terrain.\n[330-360s] - Driver in racing suit and green face mask navigates a wet track with visible rain.\n- On-screen display shows lap time increasing from 05:22.704 to 05:47.735 and speed fluctuating between 108-168 km/h.\n- Track layout map indicates a circuit with a total length of 20.832 km, with the car currently on a curving section.", "history_tokens": 993, "history_utf8_bytes": 3257, "recent_frame_times_s": [339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0], "recent_frames_sha256": "a42f0d4c6b1533ca3c9b52aa2c9004a79ad614c4b834fffa462a7e4603c6199c", "num_recent_frames": 30, "tq": 718156.920290768, "t1": 718158.690648971, "ta": 718158.690648971, "te": 718158.892708691, "first_response_s": 1.7703582029789686, "answer_total_s": 1.9724179229233414, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 264, "content_group": "398319c10278d15131d6ac03e7a822a258a2a6f9b096352b365f638193f632e9", "question": {"question_id": "sample_264_a1551_q0", "video_id": 264, "video_path": "./videos/sample_264_real.mp4", "annotation_index": 1551, "question_index": 0, "question": "What brand is the black car?", "options": ["A. BMW.", "B. Mercedes.", "C. Audi.", "D. Porsche."], "answer": "D", "time_stamp_s": 5, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_264_a1551_q0", "video_id": 264, "time_stamp_s": 5, "ground_truth": "D", "raw_output": "D. Porsche.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "2f02dc41e7d1a9419291b8d4babe32d42b1d6bdaa86385b23f640ce7f38ffa5b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "9e2f563b63d5b2903cd675387ace25556a4f72ba5383f50282a3a63ba0812cf8", "num_recent_frames": 6, "tq": 716670.218673583, "t1": 716671.373061508, "ta": 716671.373061508, "te": 716671.523736242, "first_response_s": 1.1543879250530154, "answer_total_s": 1.3050626589683816, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_264_a1551_q0", "video_id": 264, "time_stamp_s": 5, "ground_truth": "D", "raw_output": "D. Porsche.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "31f29f307215eb804a8c305c185ebbef34b08e033e8a567737c099d498452476", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "9e2f563b63d5b2903cd675387ace25556a4f72ba5383f50282a3a63ba0812cf8", "num_recent_frames": 6, "tq": 716500.45336539, "t1": 716512.301366922, "ta": 716512.301366922, "te": 716512.449653587, "first_response_s": 11.848001532023773, "answer_total_s": 11.996288196998648, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 264, "content_group": "398319c10278d15131d6ac03e7a822a258a2a6f9b096352b365f638193f632e9", "question": {"question_id": "sample_264_a1552_q0", "video_id": 264, "video_path": "./videos/sample_264_real.mp4", "annotation_index": 1552, "question_index": 0, "question": "What is the logo on the driver's steering wheel right now?", "options": ["A. Ferrari.", "B. Lamborghini.", "C. Mercedes.", "D. Porsche."], "answer": "D", "time_stamp_s": 113, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [113, 118], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_264_a1552_q0", "video_id": 264, "time_stamp_s": 113, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2947f39999e9779a22eba046a0287d6ed16ff60abd8c9579e25564d251166823", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0], "recent_frames_sha256": "53df8505863b16a9437e789d69af4747d07310b4cc3d35ce7c007d06ed07bde9", "num_recent_frames": 30, "tq": 716671.554911957, "t1": 716676.690231861, "ta": 716676.690231861, "te": 716676.727547175, "first_response_s": 5.135319903958589, "answer_total_s": 5.172635218012147, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_264_a1552_q0", "video_id": 264, "time_stamp_s": 113, "ground_truth": "D", "raw_output": "D. Porsche.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "0dbe8b67e9f359ae635cb09c571dbde564f37b4481078948f81d6de364c935df", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A black Porsche 911 (992) GT3 RS is parked, with its rear spoiler visible and a license plate reading \"RS-XG\".  \n- The driver's hand inserts a key into the ignition, then opens the driver's side door, revealing the interior with red accents and a digital dashboard.  \n- The driver sits in the car, gripping the steering wheel, with the dashboard displaying a speedometer reading \"01\" and a digital clock showing \"00:00\".\n[30-60s] - Driver's hands grip steering wheel, shifting gears with right hand while left hand occasionally adjusts controls.  \n- Dashboard displays speedometer reading increasing from 10 to 120+ mph, with digital gauges showing engine RPM and other metrics.  \n- Smartphone mounted on left side of dashboard shows navigation app, with screen orientation changing as vehicle moves.\n[60-90s] - Driver's hands grip steering wheel, maintaining steady control while vehicle accelerates.  \n- Speedometer shows increasing speed from 142 to 223 km/h, indicating rapid acceleration.  \n- Smartphone mounted on left side displays a blue screen with a circular icon, likely a navigation or app interface.", "history_tokens": 262, "history_utf8_bytes": 1122, "recent_frame_times_s": [84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0], "recent_frames_sha256": "53df8505863b16a9437e789d69af4747d07310b4cc3d35ce7c007d06ed07bde9", "num_recent_frames": 30, "tq": 716544.788589842, "t1": 716552.095795839, "ta": 716552.095795839, "te": 716552.244182087, "first_response_s": 7.307205996941775, "answer_total_s": 7.4555922449799255, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 264, "content_group": "398319c10278d15131d6ac03e7a822a258a2a6f9b096352b365f638193f632e9", "question": {"question_id": "sample_264_a1553_q0", "video_id": 264, "video_path": "./videos/sample_264_real.mp4", "annotation_index": 1553, "question_index": 0, "question": "What color is the RPM gauge's maximum range right now?", "options": ["A. Red.", "B. pink.", "C. Blue.", "D. Green."], "answer": "A", "time_stamp_s": 229, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [226, 231], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_264_a1553_q0", "video_id": 264, "time_stamp_s": 229, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f62a77b727593f0cab3535aa1e368561b949320520b9c6b733f2591e4fad1523", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0], "recent_frames_sha256": "fbeaa7f3551679e71e9d163c700818008d2872c816df5557c0d594eb4790c382", "num_recent_frames": 30, "tq": 716676.761269404, "t1": 716682.96152052, "ta": 716682.96152052, "te": 716683.188232566, "first_response_s": 6.200251116068102, "answer_total_s": 6.426963162026368, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_264_a1553_q0", "video_id": 264, "time_stamp_s": 229, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9ffe6c65394b2bab54f12a92924056ffb9c2f6d5c58d906955fcd48c623136ed", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A black Porsche 911 (992) GT3 RS is parked, with its rear spoiler visible and a license plate reading \"RS-XG\".  \n- The driver's hand inserts a key into the ignition, then opens the driver's side door, revealing the interior with red accents and a digital dashboard.  \n- The driver sits in the car, gripping the steering wheel, with the dashboard displaying a speedometer reading \"01\" and a digital clock showing \"00:00\".\n[30-60s] - Driver's hands grip steering wheel, shifting gears with right hand while left hand occasionally adjusts controls.  \n- Dashboard displays speedometer reading increasing from 10 to 120+ mph, with digital gauges showing engine RPM and other metrics.  \n- Smartphone mounted on left side of dashboard shows navigation app, with screen orientation changing as vehicle moves.\n[60-90s] - Driver's hands grip steering wheel, maintaining steady control while vehicle accelerates.  \n- Speedometer shows increasing speed from 142 to 223 km/h, indicating rapid acceleration.  \n- Smartphone mounted on left side displays a blue screen with a circular icon, likely a navigation or app interface.\n[90-120s] - Driver's hands grip the steering wheel as the car accelerates, with speedometer reading fluctuating from 140 to 230 mph.\n- A smartphone mounted on the left side displays a blue interface, likely a navigation or speed tracking app.\n- The car's digital dashboard shows dynamic metrics, including RPM and gear selection, while the exterior view reveals a highway with greenery and occasional passing vehicles.\n[120-150s] - Driver's hands grip steering wheel as speedometer reads 194-232 km/h, with phone mounted on left side.\n- Dashboard displays \"Porsche\" logo and digital gauges, while \"TRENDING\" indicator appears in top-right corner.\n- Road ahead shows greenery and passing vehicles, including a red truck at 2:13.\n[150-180s] - Driver's hands grip the Porsche steering wheel, with speedometer showing decreasing speed from 238 to 109 mph.\n- Smartphone mounted on left side displays a blue circular interface, likely a navigation or speedometer app.\n- Road ahead curves gently, with greenery and a distant white vehicle visible, indicating highway travel.\n[180-210s] - Driver's hands grip steering wheel, shifting gears and adjusting controls while navigating highway curves.\n- Speedometer fluctuates between 120-130 mph, with a digital display showing \"600\" and \"600\" on the dashboard.\n- Smartphone mounted on left side of dashboard displays a blue screen with a circular icon, possibly a navigation or app interface.", "history_tokens": 608, "history_utf8_bytes": 2553, "recent_frame_times_s": [200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0], "recent_frames_sha256": "fbeaa7f3551679e71e9d163c700818008d2872c816df5557c0d594eb4790c382", "num_recent_frames": 30, "tq": 716592.919248528, "t1": 716598.911502488, "ta": 716598.911502488, "te": 716598.948861257, "first_response_s": 5.992253959993832, "answer_total_s": 6.02961272909306, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 264, "content_group": "398319c10278d15131d6ac03e7a822a258a2a6f9b096352b365f638193f632e9", "question": {"question_id": "sample_264_a1554_q0", "video_id": 264, "video_path": "./videos/sample_264_real.mp4", "annotation_index": 1554, "question_index": 0, "question": "What is the current speed shown on the phone's screen right now?", "options": ["A. approx 150 km/h.", "B. approx 210 km/h.", "C. approx 170 km/h.", "D. approx 190 km/h."], "answer": "D", "time_stamp_s": 341, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [339, 344], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_264_a1554_q0", "video_id": 264, "time_stamp_s": 341, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "dfa4eb6b40fb704544e5f48c44c76161933d6d8ad7079c6b9213e713e3d63ed8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0], "recent_frames_sha256": "7df4fe5c3d76351630b83fbfc3e7261c85788d2e2b02f6a9b41ad81fc7c37645", "num_recent_frames": 30, "tq": 716683.202815307, "t1": 716690.841588157, "ta": 716690.841588157, "te": 716690.881257151, "first_response_s": 7.638772850041278, "answer_total_s": 7.678441844065674, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_264_a1554_q0", "video_id": 264, "time_stamp_s": 341, "ground_truth": "D", "raw_output": "D. approx 190 km/h.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "ecc01ab2cf8719686b21dc22976112a5c7f3a26424b7b7bf2b24909937c0c7a6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A black Porsche 911 (992) GT3 RS is parked, with its rear spoiler visible and a license plate reading \"RS-XG\".  \n- The driver's hand inserts a key into the ignition, then opens the driver's side door, revealing the interior with red accents and a digital dashboard.  \n- The driver sits in the car, gripping the steering wheel, with the dashboard displaying a speedometer reading \"01\" and a digital clock showing \"00:00\".\n[30-60s] - Driver's hands grip steering wheel, shifting gears with right hand while left hand occasionally adjusts controls.  \n- Dashboard displays speedometer reading increasing from 10 to 120+ mph, with digital gauges showing engine RPM and other metrics.  \n- Smartphone mounted on left side of dashboard shows navigation app, with screen orientation changing as vehicle moves.\n[60-90s] - Driver's hands grip steering wheel, maintaining steady control while vehicle accelerates.  \n- Speedometer shows increasing speed from 142 to 223 km/h, indicating rapid acceleration.  \n- Smartphone mounted on left side displays a blue screen with a circular icon, likely a navigation or app interface.\n[90-120s] - Driver's hands grip the steering wheel as the car accelerates, with speedometer reading fluctuating from 140 to 230 mph.\n- A smartphone mounted on the left side displays a blue interface, likely a navigation or speed tracking app.\n- The car's digital dashboard shows dynamic metrics, including RPM and gear selection, while the exterior view reveals a highway with greenery and occasional passing vehicles.\n[120-150s] - Driver's hands grip steering wheel as speedometer reads 194-232 km/h, with phone mounted on left side.\n- Dashboard displays \"Porsche\" logo and digital gauges, while \"TRENDING\" indicator appears in top-right corner.\n- Road ahead shows greenery and passing vehicles, including a red truck at 2:13.\n[150-180s] - Driver's hands grip the Porsche steering wheel, with speedometer showing decreasing speed from 238 to 109 mph.\n- Smartphone mounted on left side displays a blue circular interface, likely a navigation or speedometer app.\n- Road ahead curves gently, with greenery and a distant white vehicle visible, indicating highway travel.\n[180-210s] - Driver's hands grip steering wheel, shifting gears and adjusting controls while navigating highway curves.\n- Speedometer fluctuates between 120-130 mph, with a digital display showing \"600\" and \"600\" on the dashboard.\n- Smartphone mounted on left side of dashboard displays a blue screen with a circular icon, possibly a navigation or app interface.\n[210-240s] - Driver's hands grip the Porsche steering wheel, with a smartphone mounted on the left side displaying a blue screen.  \n- Speedometer on the left shows increasing speed from 196 to 238 mph, indicating rapid acceleration.  \n- The car navigates a highway with trees on both sides and a large red truck visible ahead.\n[240-270s] - Driver's hands grip the Porsche steering wheel, with a smartphone mounted on the left side displaying a blue screen.  \n- The car's digital dashboard shows a speedometer reading fluctuating between 219 and 228 mph, with a tachometer indicating engine RPM.  \n- The road ahead is a multi-lane highway with greenery on both sides, and a large truck passes on the right.\n[270-300s] - Driver's hands grip the Porsche steering wheel, maintaining steady control.  \n- Speedometer reads 229 mph, with a digital display showing \"470\" (likely gear or RPM).  \n- A smartphone mounted on the left side displays a blue circular interface, possibly a navigation or tracking app.\n[300-330s] - Driver's hands grip steering wheel, shifting gears as speedometer climbs from 62 to 137 mph.\n- Smartphone mounted on left side displays navigation map with blue route indicator.\n- Dashboard shows digital gauges, including tachometer and speedometer, with red accents and \"GT3\" branding.", "history_tokens": 930, "history_utf8_bytes": 3855, "recent_frame_times_s": [312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0], "recent_frames_sha256": "7df4fe5c3d76351630b83fbfc3e7261c85788d2e2b02f6a9b41ad81fc7c37645", "num_recent_frames": 30, "tq": 716629.822849707, "t1": 716637.165747716, "ta": 716637.165747716, "te": 716637.577046879, "first_response_s": 7.3428980089956895, "answer_total_s": 7.754197172005661, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 264, "content_group": "398319c10278d15131d6ac03e7a822a258a2a6f9b096352b365f638193f632e9", "question": {"question_id": "sample_264_a1555_q0", "video_id": 264, "video_path": "./videos/sample_264_real.mp4", "annotation_index": 1555, "question_index": 0, "question": "What is the current speed shown on the phone's screen right now?", "options": ["A. approx 212 km/h.", "B. approx 222 km/h.", "C. approx 242 km/h.", "D. approx 232 km/h."], "answer": "D", "time_stamp_s": 452, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [452, 457], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_264_a1555_q0", "video_id": 264, "time_stamp_s": 452, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9058f9f119ecffd8150f77612138d3cee9edddf3bf8426e6b611942631b32783", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [423.0, 424.0, 425.0, 426.0, 427.0, 428.0, 429.0, 430.0, 431.0, 432.0, 433.0, 434.0, 435.0, 436.0, 437.0, 438.0, 439.0, 440.0, 441.0, 442.0, 443.0, 444.0, 445.0, 446.0, 447.0, 448.0, 449.0, 450.0, 451.0, 452.0], "recent_frames_sha256": "023abd9c490dc804062ecae1b1f1f4ff65f355932a863b86a0ac488c8d11aeb9", "num_recent_frames": 30, "tq": 716690.897406648, "t1": 716702.503403554, "ta": 716702.503403554, "te": 716702.544085926, "first_response_s": 11.605996905942447, "answer_total_s": 11.646679277997464, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_264_a1555_q0", "video_id": 264, "time_stamp_s": 452, "ground_truth": "D", "raw_output": "D. approx 232 km/h.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "26ca7604b0e4355112ef319045b0f6186e6fad6b882635ca7478cf162c231946", "condition_order": ["notes", "recent"], "memory": "[90-120s] - Driver's hands grip the steering wheel as the car accelerates, with speedometer reading fluctuating from 140 to 230 mph.\n- A smartphone mounted on the left side displays a blue interface, likely a navigation or speed tracking app.\n- The car's digital dashboard shows dynamic metrics, including RPM and gear selection, while the exterior view reveals a highway with greenery and occasional passing vehicles.\n[120-150s] - Driver's hands grip steering wheel as speedometer reads 194-232 km/h, with phone mounted on left side.\n- Dashboard displays \"Porsche\" logo and digital gauges, while \"TRENDING\" indicator appears in top-right corner.\n- Road ahead shows greenery and passing vehicles, including a red truck at 2:13.\n[150-180s] - Driver's hands grip the Porsche steering wheel, with speedometer showing decreasing speed from 238 to 109 mph.\n- Smartphone mounted on left side displays a blue circular interface, likely a navigation or speedometer app.\n- Road ahead curves gently, with greenery and a distant white vehicle visible, indicating highway travel.\n[180-210s] - Driver's hands grip steering wheel, shifting gears and adjusting controls while navigating highway curves.\n- Speedometer fluctuates between 120-130 mph, with a digital display showing \"600\" and \"600\" on the dashboard.\n- Smartphone mounted on left side of dashboard displays a blue screen with a circular icon, possibly a navigation or app interface.\n[210-240s] - Driver's hands grip the Porsche steering wheel, with a smartphone mounted on the left side displaying a blue screen.  \n- Speedometer on the left shows increasing speed from 196 to 238 mph, indicating rapid acceleration.  \n- The car navigates a highway with trees on both sides and a large red truck visible ahead.\n[240-270s] - Driver's hands grip the Porsche steering wheel, with a smartphone mounted on the left side displaying a blue screen.  \n- The car's digital dashboard shows a speedometer reading fluctuating between 219 and 228 mph, with a tachometer indicating engine RPM.  \n- The road ahead is a multi-lane highway with greenery on both sides, and a large truck passes on the right.\n[270-300s] - Driver's hands grip the Porsche steering wheel, maintaining steady control.  \n- Speedometer reads 229 mph, with a digital display showing \"470\" (likely gear or RPM).  \n- A smartphone mounted on the left side displays a blue circular interface, possibly a navigation or tracking app.\n[300-330s] - Driver's hands grip steering wheel, shifting gears as speedometer climbs from 62 to 137 mph.\n- Smartphone mounted on left side displays navigation map with blue route indicator.\n- Dashboard shows digital gauges, including tachometer and speedometer, with red accents and \"GT3\" branding.\n[330-360s] - Driver's hands grip the steering wheel, with a smartphone mounted on the left side displaying a blue interface.  \n- The car's digital dashboard shows fluctuating speed readings, peaking around 190+ mph, with a tachometer indicating engine RPM.  \n- The vehicle travels on a straight road flanked by greenery, with the driver maintaining a steady course.\n[360-390s] - Driver's hands grip the steering wheel, with a smartphone mounted on the left side displaying a circular interface.  \n- Speedometer reads 232 mph, with the tachometer indicating engine RPMs.  \n- Road ahead is straight with greenery on both sides; a vehicle is visible in the distance.\n[390-420s] - Driver's hands grip the Porsche steering wheel, with a smartphone mounted on the left side displaying a blue screen.  \n- The car's digital dashboard shows a speedometer reading fluctuating between 190 and 230 mph, with the tachometer indicating engine RPM.  \n- The road ahead is a straight, tree-lined highway with occasional vehicles passing by, and the car maintains a steady pace.\n[420-450s] - Driver's hands grip the Porsche steering wheel, maintaining control as the car accelerates.  \n- Speedometer reads 228–230 mph, with a digital display showing \"GTR\" and \"228\" mph.  \n- A blue smartphone mounted on the left side displays a circular graphic, possibly a speedometer overlay.", "history_tokens": 1004, "history_utf8_bytes": 4095, "recent_frame_times_s": [423.0, 424.0, 425.0, 426.0, 427.0, 428.0, 429.0, 430.0, 431.0, 432.0, 433.0, 434.0, 435.0, 436.0, 437.0, 438.0, 439.0, 440.0, 441.0, 442.0, 443.0, 444.0, 445.0, 446.0, 447.0, 448.0, 449.0, 450.0, 451.0, 452.0], "recent_frames_sha256": "023abd9c490dc804062ecae1b1f1f4ff65f355932a863b86a0ac488c8d11aeb9", "num_recent_frames": 30, "tq": 716663.609859233, "t1": 716669.816051772, "ta": 716669.816051772, "te": 716670.19485043, "first_response_s": 6.2061925389571115, "answer_total_s": 6.5849911969853565, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 265, "content_group": "5ae804a374928734e35b01318cdfd590c96d36db6a37db78669107aff850db14", "question": {"question_id": "sample_265_a1073_q0", "video_id": 265, "video_path": "./videos/sample_265_real.mp4", "annotation_index": 1073, "question_index": 0, "question": "What is the color of the football prominently featured in the video?", "options": ["A. Blue and white.", "B. Black and white.", "C. Green and white.", "D. Red and white."], "answer": "D", "time_stamp_s": 4, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "football", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_265_a1073_q0", "video_id": 265, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "D. Red and white.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "5fad2c658b7488788b021ef63d1eae047579328a853831a0be38f544b5d7b973", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0], "recent_frames_sha256": "52e53d4962487b6c29f11c699ee43cc5f659e8784f67e82cc24f704799c75320", "num_recent_frames": 5, "tq": 719336.705560603, "t1": 719342.628996058, "ta": 719342.628996058, "te": 719342.851203288, "first_response_s": 5.92343545507174, "answer_total_s": 6.145642685005441, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_265_a1073_q0", "video_id": 265, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "D. Red and white.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "d84f4743b7d630b138dc349ac829846b1b0ee054449a946f2997b6efdae4e201", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0], "recent_frames_sha256": "52e53d4962487b6c29f11c699ee43cc5f659e8784f67e82cc24f704799c75320", "num_recent_frames": 5, "tq": 719383.735251614, "t1": 719394.370705077, "ta": 719394.370705077, "te": 719394.601553242, "first_response_s": 10.635453462949954, "answer_total_s": 10.866301627946086, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 265, "content_group": "5ae804a374928734e35b01318cdfd590c96d36db6a37db78669107aff850db14", "question": {"question_id": "sample_265_a1074_q0", "video_id": 265, "video_path": "./videos/sample_265_real.mp4", "annotation_index": 1074, "question_index": 0, "question": "What text appeared just now?", "options": ["A. \"Nice shot!\".", "B. \"Great goal!\".", "C. \"Well played!\".", "D. \"Good pass Aim!\" and \"Good job!\"."], "answer": "D", "time_stamp_s": 200, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "football", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_265_a1074_q0", "video_id": 265, "time_stamp_s": 200, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9cff0229615372a7f762db8fcc22aaf820586495869fe845d0c31f5995b4a3ff", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0], "recent_frames_sha256": "23af17ab265d34bb4f026760e8610b2c2982b53d2306870fa5a1afa18034c97a", "num_recent_frames": 30, "tq": 719342.875515773, "t1": 719351.05579519, "ta": 719351.05579519, "te": 719351.095675084, "first_response_s": 8.180279417079873, "answer_total_s": 8.220159311080351, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_265_a1074_q0", "video_id": 265, "time_stamp_s": 200, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "44197793f5fcee837625a5799f5577abdfa08e9e6882a5b33a483b8a24b183c2", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A soccer ball is kicked and rolled across a grassy field during a training session, with players in blue and red jerseys actively moving around it.  \n- A young man wearing a white face mask stands in front of a building under construction, speaking to the camera while text overlays identify him as part of Bangkok FC's training team.  \n- The video transitions to an indoor setting showing a bedroom with a blue bed, where a person is seen waking up from sleep, with a view of greenery visible through a window.\n[30-60s] - Person packs a black bag and places it on a dark sofa beside a soccer ball and a laptop.  \n- They exit the room, walk down a hallway, and step onto a bridge leading to a street with parked cars.  \n- They enter a white car, then proceed to a stadium entrance marked by pink-framed glass doors.\n[60-90s] - A person in a blue shirt sits on a mat, smiling and gesturing toward the camera while others are seated nearby.  \n- A man in a white tank top and black shorts stands near a doorway, holding a phone and looking toward the camera.  \n- The setting is an indoor gym with various exercise equipment, mats, and branded walls visible in the background.\n[90-120s] - A person in a blue shirt performs leg exercises on a mat, with a yellow resistance band visible nearby.  \n- A group of athletes in blue shirts gathers on a grass field, standing in formation under an overcast sky.  \n- A coach in black attire stands before the group, gesturing while speaking, with a text overlay indicating \"3-40 PM Field training begins.\"\n[120-150s] - Group of athletes in blue shirts perform agility drills around orange and blue cones on grass field.\n- One athlete in gray shirt briefly interacts with another, possibly adjusting equipment or offering encouragement.\n- Training transitions from agility to pass drills, indicated by on-screen text and change in field setup.\n[150-180s] - A player in blue shorts and black socks kicks a white and red ball toward an orange marker on a grass field.  \n- Another player in blue attire stands near the marker, preparing to receive or react to the pass.  \n- The camera pans to show a netted goal area with spectators and buildings in the background, indicating a training session.", "history_tokens": 504, "history_utf8_bytes": 2238, "recent_frame_times_s": [171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0], "recent_frames_sha256": "23af17ab265d34bb4f026760e8610b2c2982b53d2306870fa5a1afa18034c97a", "num_recent_frames": 30, "tq": 719436.253955035, "t1": 719443.630645948, "ta": 719443.630645948, "te": 719443.821258813, "first_response_s": 7.376690912991762, "answer_total_s": 7.567303778021596, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 265, "content_group": "5ae804a374928734e35b01318cdfd590c96d36db6a37db78669107aff850db14", "question": {"question_id": "sample_265_a1075_q0", "video_id": 265, "video_path": "./videos/sample_265_real.mp4", "annotation_index": 1075, "question_index": 0, "question": "What advertisement is visible right now?", "options": ["A. Honda and Chang.", "B. Nissan.", "C. Ford.", "D. Toyota and Chang."], "answer": "D", "time_stamp_s": 362, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "football", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_265_a1075_q0", "video_id": 265, "time_stamp_s": 362, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "997dbc6e41890137d3b4904d8c5a2993399f23f41818e5bc0bc74f894b55885c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0], "recent_frames_sha256": "37ed598cd8638058394ac160b4330b63e30ded30f3e090d19b56ec40abbd1150", "num_recent_frames": 30, "tq": 719351.108020525, "t1": 719362.6792113, "ta": 719362.6792113, "te": 719362.717847318, "first_response_s": 11.571190775022842, "answer_total_s": 11.609826793079264, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_265_a1075_q0", "video_id": 265, "time_stamp_s": 362, "ground_truth": "D", "raw_output": "A. Honda and Chang.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "ff5c383d649fea73356aa574a2ee736a680ec30b38209501cd17b55c5bc55b49", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A soccer ball is kicked and rolled across a grassy field during a training session, with players in blue and red jerseys actively moving around it.  \n- A young man wearing a white face mask stands in front of a building under construction, speaking to the camera while text overlays identify him as part of Bangkok FC's training team.  \n- The video transitions to an indoor setting showing a bedroom with a blue bed, where a person is seen waking up from sleep, with a view of greenery visible through a window.\n[30-60s] - Person packs a black bag and places it on a dark sofa beside a soccer ball and a laptop.  \n- They exit the room, walk down a hallway, and step onto a bridge leading to a street with parked cars.  \n- They enter a white car, then proceed to a stadium entrance marked by pink-framed glass doors.\n[60-90s] - A person in a blue shirt sits on a mat, smiling and gesturing toward the camera while others are seated nearby.  \n- A man in a white tank top and black shorts stands near a doorway, holding a phone and looking toward the camera.  \n- The setting is an indoor gym with various exercise equipment, mats, and branded walls visible in the background.\n[90-120s] - A person in a blue shirt performs leg exercises on a mat, with a yellow resistance band visible nearby.  \n- A group of athletes in blue shirts gathers on a grass field, standing in formation under an overcast sky.  \n- A coach in black attire stands before the group, gesturing while speaking, with a text overlay indicating \"3-40 PM Field training begins.\"\n[120-150s] - Group of athletes in blue shirts perform agility drills around orange and blue cones on grass field.\n- One athlete in gray shirt briefly interacts with another, possibly adjusting equipment or offering encouragement.\n- Training transitions from agility to pass drills, indicated by on-screen text and change in field setup.\n[150-180s] - A player in blue shorts and black socks kicks a white and red ball toward an orange marker on a grass field.  \n- Another player in blue attire stands near the marker, preparing to receive or react to the pass.  \n- The camera pans to show a netted goal area with spectators and buildings in the background, indicating a training session.\n[180-210s] - A player in blue jersey runs toward a white and red soccer ball positioned on the grass field.  \n- A coach in black attire holds a clipboard and gestures while addressing a group of players in blue jerseys.  \n- The camera perspective shifts to show a player in blue jersey running across the field, with orange cones visible in the background.\n[210-240s] - A player in a blue jersey is seen running with a white object in hand, likely a ball, across a grassy field.  \n- The camera pans to show a wider view of the field where players in blue and red jerseys are positioned for a soccer match.  \n- A player in a blue jersey is seen running towards the ball, while another player in a red jersey is positioned nearby, indicating active gameplay.\n[240-270s] - Player in orange jersey (number 10) controls ball, dribbles forward, and passes to teammate.  \n- Blue team players chase, with one attempting to intercept the pass.  \n- Camera follows ball movement, showing dynamic play across midfield.\n[270-300s] - Player in blue jersey runs toward ball after foul call, then kicks it forward.  \n- Ball is kicked toward goal area as players reposition; camera follows ball’s trajectory.  \n- Goalkeeper in blue jersey dives to block shot, but ball goes into net after “Finish!” call.\n[300-330s] - Player in blue jersey runs toward the ball, preparing to kick it.  \n- Ball is visible on the ground, near the player’s feet, as the camera perspective shifts.  \n- Other players in blue and red jerseys are scattered across the field, actively engaged in the game.\n[330-360s] - Player in blue jersey runs toward ball, then passes it to teammate after a cut-back maneuver.\n- Ball is kicked forward by player in red jersey, leading to a goal celebration.\n- Camera perspective shifts to show players moving across the field during halftime transition.", "history_tokens": 935, "history_utf8_bytes": 4094, "recent_frame_times_s": [333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0], "recent_frames_sha256": "37ed598cd8638058394ac160b4330b63e30ded30f3e090d19b56ec40abbd1150", "num_recent_frames": 30, "tq": 719492.150195942, "t1": 719498.969543892, "ta": 719498.969543892, "te": 719499.191269804, "first_response_s": 6.819347949931398, "answer_total_s": 7.041073861997575, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 265, "content_group": "5ae804a374928734e35b01318cdfd590c96d36db6a37db78669107aff850db14", "question": {"question_id": "sample_265_a1076_q1", "video_id": 265, "video_path": "./videos/sample_265_real.mp4", "annotation_index": 1076, "question_index": 1, "question": "What action does the goalkeeper in red perform as the ball approaches the goal?", "options": ["A. Dives to the ground.", "B. Kicks the ball away.", "C. Jumps to block the ball.", "D. Stands still."], "answer": "A", "time_stamp_s": 548, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "football", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_265_a1076_q1", "video_id": 265, "time_stamp_s": 548, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "57b3670def1d5ebedc235a68d2256a7f219acc9522dd42c1122f5dde7e95a6f8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0], "recent_frames_sha256": "a78b071b1808ebdd92216f7b0a77225876959dc8aef8616ec412af5ffcbe2658", "num_recent_frames": 30, "tq": 719362.731712385, "t1": 719376.118879941, "ta": 719376.118879941, "te": 719376.158104043, "first_response_s": 13.387167555978522, "answer_total_s": 13.426391658023931, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_265_a1076_q1", "video_id": 265, "time_stamp_s": 548, "ground_truth": "A", "raw_output": "A. Dives to the ground.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "1919d8a3b7163f282e38c2ad850253b7f86d967074de83a4c6d161ecf26ceffd", "condition_order": ["recent", "notes"], "memory": "[120-150s] - Group of athletes in blue shirts perform agility drills around orange and blue cones on grass field.\n- One athlete in gray shirt briefly interacts with another, possibly adjusting equipment or offering encouragement.\n- Training transitions from agility to pass drills, indicated by on-screen text and change in field setup.\n[150-180s] - A player in blue shorts and black socks kicks a white and red ball toward an orange marker on a grass field.  \n- Another player in blue attire stands near the marker, preparing to receive or react to the pass.  \n- The camera pans to show a netted goal area with spectators and buildings in the background, indicating a training session.\n[180-210s] - A player in blue jersey runs toward a white and red soccer ball positioned on the grass field.  \n- A coach in black attire holds a clipboard and gestures while addressing a group of players in blue jerseys.  \n- The camera perspective shifts to show a player in blue jersey running across the field, with orange cones visible in the background.\n[210-240s] - A player in a blue jersey is seen running with a white object in hand, likely a ball, across a grassy field.  \n- The camera pans to show a wider view of the field where players in blue and red jerseys are positioned for a soccer match.  \n- A player in a blue jersey is seen running towards the ball, while another player in a red jersey is positioned nearby, indicating active gameplay.\n[240-270s] - Player in orange jersey (number 10) controls ball, dribbles forward, and passes to teammate.  \n- Blue team players chase, with one attempting to intercept the pass.  \n- Camera follows ball movement, showing dynamic play across midfield.\n[270-300s] - Player in blue jersey runs toward ball after foul call, then kicks it forward.  \n- Ball is kicked toward goal area as players reposition; camera follows ball’s trajectory.  \n- Goalkeeper in blue jersey dives to block shot, but ball goes into net after “Finish!” call.\n[300-330s] - Player in blue jersey runs toward the ball, preparing to kick it.  \n- Ball is visible on the ground, near the player’s feet, as the camera perspective shifts.  \n- Other players in blue and red jerseys are scattered across the field, actively engaged in the game.\n[330-360s] - Player in blue jersey runs toward ball, then passes it to teammate after a cut-back maneuver.\n- Ball is kicked forward by player in red jersey, leading to a goal celebration.\n- Camera perspective shifts to show players moving across the field during halftime transition.\n[360-390s] - Player in blue jersey runs toward ball, preparing to kick it.  \n- Ball is stationary on grass near center line, with players positioned around it.  \n- Goalkeeper in orange jersey dives to block shot as ball approaches goal.\n[390-420s] - A player in a blue jersey runs toward the goal after a goal is scored, with the word \"GOAL\" displayed on screen.\n- A player in a red jersey is shown near the goal area, possibly reacting to the goal or preparing for the next play.\n- The camera pans across the field, showing players in blue and red jerseys actively engaged in the game, with spectators visible in the background.\n[420-450s] - Player in red jersey (number 6) runs across the field, moving away from the camera’s perspective.  \n- A player in blue jersey is seen near the center of the field, actively engaged in play.  \n- The camera pans to show the broader field, revealing spectators and goalposts at the edges.\n[450-480s] - A player in a blue jersey runs toward the ball, preparing to kick it.  \n- The ball is positioned near the center of the field, with players from both teams scattered around.  \n- The camera perspective shifts slightly, showing a wider view of the field and surrounding structures.\n[480-510s] - Player in blue jersey runs toward the ball, preparing to kick it forward.  \n- Ball is visible on the grass, positioned near the center of the field.  \n- Other players are scattered across the field, some moving toward the ball, others in defensive positions.\n[510-540s] - A player in blue runs toward the goal, then dives to score a goal as the ball enters the net.  \n- The camera perspective shifts to a first-person view, showing the ball being kicked forward by the player.  \n- The scene transitions to a wide shot of the field, with players moving toward the sideline as the game continues.", "history_tokens": 1011, "history_utf8_bytes": 4374, "recent_frame_times_s": [519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0], "recent_frames_sha256": "a78b071b1808ebdd92216f7b0a77225876959dc8aef8616ec412af5ffcbe2658", "num_recent_frames": 30, "tq": 719547.873340317, "t1": 719548.637594934, "ta": 719548.637594934, "te": 719548.942106765, "first_response_s": 0.7642546169226989, "answer_total_s": 1.068766447948292, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 265, "content_group": "5ae804a374928734e35b01318cdfd590c96d36db6a37db78669107aff850db14", "question": {"question_id": "sample_265_a1076_q0", "video_id": 265, "video_path": "./videos/sample_265_real.mp4", "annotation_index": 1076, "question_index": 0, "question": "What is the player wearing the camera holding right now?", "options": ["A. A soccer ball.", "B. A whistle.", "C. A flag.", "D. A water bottle."], "answer": "D", "time_stamp_s": 550, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "football", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_265_a1076_q0", "video_id": 265, "time_stamp_s": 550, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "878d6c62c7aec5f0bda8c42e6718f0e327045e64a5c1823d829f5276a253d658", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0], "recent_frames_sha256": "be20b288af075422ff16ea850005aaea92abe72b4e410d3cbbccd37a8dd5b9b7", "num_recent_frames": 30, "tq": 719376.177215107, "t1": 719383.676776047, "ta": 719383.676776047, "te": 719383.717149073, "first_response_s": 7.499560939962976, "answer_total_s": 7.539933966007084, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_265_a1076_q0", "video_id": 265, "time_stamp_s": 550, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "961841143dbf9afc798f11303f29a9c93bcaa31ee5fb504f04801bb54107cf5f", "condition_order": ["recent", "notes"], "memory": "[120-150s] - Group of athletes in blue shirts perform agility drills around orange and blue cones on grass field.\n- One athlete in gray shirt briefly interacts with another, possibly adjusting equipment or offering encouragement.\n- Training transitions from agility to pass drills, indicated by on-screen text and change in field setup.\n[150-180s] - A player in blue shorts and black socks kicks a white and red ball toward an orange marker on a grass field.  \n- Another player in blue attire stands near the marker, preparing to receive or react to the pass.  \n- The camera pans to show a netted goal area with spectators and buildings in the background, indicating a training session.\n[180-210s] - A player in blue jersey runs toward a white and red soccer ball positioned on the grass field.  \n- A coach in black attire holds a clipboard and gestures while addressing a group of players in blue jerseys.  \n- The camera perspective shifts to show a player in blue jersey running across the field, with orange cones visible in the background.\n[210-240s] - A player in a blue jersey is seen running with a white object in hand, likely a ball, across a grassy field.  \n- The camera pans to show a wider view of the field where players in blue and red jerseys are positioned for a soccer match.  \n- A player in a blue jersey is seen running towards the ball, while another player in a red jersey is positioned nearby, indicating active gameplay.\n[240-270s] - Player in orange jersey (number 10) controls ball, dribbles forward, and passes to teammate.  \n- Blue team players chase, with one attempting to intercept the pass.  \n- Camera follows ball movement, showing dynamic play across midfield.\n[270-300s] - Player in blue jersey runs toward ball after foul call, then kicks it forward.  \n- Ball is kicked toward goal area as players reposition; camera follows ball’s trajectory.  \n- Goalkeeper in blue jersey dives to block shot, but ball goes into net after “Finish!” call.\n[300-330s] - Player in blue jersey runs toward the ball, preparing to kick it.  \n- Ball is visible on the ground, near the player’s feet, as the camera perspective shifts.  \n- Other players in blue and red jerseys are scattered across the field, actively engaged in the game.\n[330-360s] - Player in blue jersey runs toward ball, then passes it to teammate after a cut-back maneuver.\n- Ball is kicked forward by player in red jersey, leading to a goal celebration.\n- Camera perspective shifts to show players moving across the field during halftime transition.\n[360-390s] - Player in blue jersey runs toward ball, preparing to kick it.  \n- Ball is stationary on grass near center line, with players positioned around it.  \n- Goalkeeper in orange jersey dives to block shot as ball approaches goal.\n[390-420s] - A player in a blue jersey runs toward the goal after a goal is scored, with the word \"GOAL\" displayed on screen.\n- A player in a red jersey is shown near the goal area, possibly reacting to the goal or preparing for the next play.\n- The camera pans across the field, showing players in blue and red jerseys actively engaged in the game, with spectators visible in the background.\n[420-450s] - Player in red jersey (number 6) runs across the field, moving away from the camera’s perspective.  \n- A player in blue jersey is seen near the center of the field, actively engaged in play.  \n- The camera pans to show the broader field, revealing spectators and goalposts at the edges.\n[450-480s] - A player in a blue jersey runs toward the ball, preparing to kick it.  \n- The ball is positioned near the center of the field, with players from both teams scattered around.  \n- The camera perspective shifts slightly, showing a wider view of the field and surrounding structures.\n[480-510s] - Player in blue jersey runs toward the ball, preparing to kick it forward.  \n- Ball is visible on the grass, positioned near the center of the field.  \n- Other players are scattered across the field, some moving toward the ball, others in defensive positions.\n[510-540s] - A player in blue runs toward the goal, then dives to score a goal as the ball enters the net.  \n- The camera perspective shifts to a first-person view, showing the ball being kicked forward by the player.  \n- The scene transitions to a wide shot of the field, with players moving toward the sideline as the game continues.", "history_tokens": 1011, "history_utf8_bytes": 4374, "recent_frame_times_s": [521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0], "recent_frames_sha256": "be20b288af075422ff16ea850005aaea92abe72b4e410d3cbbccd37a8dd5b9b7", "num_recent_frames": 30, "tq": 719548.959329387, "t1": 719562.50592482, "ta": 719562.50592482, "te": 719562.879214567, "first_response_s": 13.546595432912, "answer_total_s": 13.919885179959238, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 266, "content_group": "4153619057d2d33ea8c459e64261c6f2e8abf36ef3c1f2fcfdbcb5aa4f159683", "question": {"question_id": "sample_266_a1316_q0", "video_id": 266, "video_path": "./videos/sample_266_real.mp4", "annotation_index": 1316, "question_index": 0, "question": "Which company's logo is visible on the advertising board to the right?", "options": ["A. Pirelli.", "B. AsahiKASEI.", "C. Shell.", "D. Goodyear."], "answer": "B", "time_stamp_s": 5, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_266_a1316_q0", "video_id": 266, "time_stamp_s": 5, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ed39b8ea72541d448c3e89657ce16cf42fdfa3c72dfc2ff617d3180e64239a62", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "8eaaa75d1b2a44a600ccabaeed120da34ea39334c11eca13f86afb692e796202", "num_recent_frames": 6, "tq": 718536.378167112, "t1": 718537.432234212, "ta": 718537.432234212, "te": 718537.471804474, "first_response_s": 1.0540671000489965, "answer_total_s": 1.0936373620061204, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_266_a1316_q0", "video_id": 266, "time_stamp_s": 5, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fa5172bf7e2e9c460cca4fb023fdb6e31734e6c0617010dea5522f35fac49d34", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "8eaaa75d1b2a44a600ccabaeed120da34ea39334c11eca13f86afb692e796202", "num_recent_frames": 6, "tq": 718444.838419209, "t1": 718451.814707941, "ta": 718451.814707941, "te": 718452.163372718, "first_response_s": 6.976288732024841, "answer_total_s": 7.324953509029001, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 266, "content_group": "4153619057d2d33ea8c459e64261c6f2e8abf36ef3c1f2fcfdbcb5aa4f159683", "question": {"question_id": "sample_266_a1317_q0", "video_id": 266, "video_path": "./videos/sample_266_real.mp4", "annotation_index": 1317, "question_index": 0, "question": "What colors primarily dominate the gloves of the driver right now?", "options": ["A. Red and blue.", "B. Black and blue.", "C. Black, white and red.", "D. Red and green."], "answer": "C", "time_stamp_s": 63, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [63, 68], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_266_a1317_q0", "video_id": 266, "time_stamp_s": 63, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b327672f5b8532a75eb58d1c5d70c716beb78ab9fd74788417ff52b28670f664", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [34.0, 35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0], "recent_frames_sha256": "dfe5411fd5863fffd7f9203d1d62a2e5c91fb33aecf840cce359314c3c5712c5", "num_recent_frames": 30, "tq": 718537.500098791, "t1": 718546.01730977, "ta": 718546.01730977, "te": 718546.055029487, "first_response_s": 8.517210979014635, "answer_total_s": 8.554930696031079, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_266_a1317_q0", "video_id": 266, "time_stamp_s": 63, "ground_truth": "C", "raw_output": "C. Black, white and red.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "42c375ec8c71a7be4c3ee507b43f54ed051f49fbc1e6ccecf913c60baa1bd8df", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver's hands grip a steering wheel with \"Suzuki\" branding, actively turning it to navigate a winding road.  \n- Dashboard displays fluctuating green numbers (e.g., \"2\", \"3\", \"4\") indicating lap or speed metrics, with a central screen showing a map or telemetry.  \n- Exterior view reveals a rural road flanked by stone walls, trees, and spectators, with a red vehicle visible ahead on the road.\n[30-60s] - Driver's hands grip steering wheel, making sharp turns while navigating a winding mountain road.  \n- Dashboard displays fluctuating speed and navigation data, indicating active driving with changing terrain.  \n- Vehicle moves along a narrow, curving road bordered by rocky cliffs and sparse vegetation.", "history_tokens": 161, "history_utf8_bytes": 718, "recent_frame_times_s": [34.0, 35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0, 55.0, 56.0, 57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0], "recent_frames_sha256": "dfe5411fd5863fffd7f9203d1d62a2e5c91fb33aecf840cce359314c3c5712c5", "num_recent_frames": 30, "tq": 718469.395319726, "t1": 718469.978701399, "ta": 718469.978701399, "te": 718470.277013295, "first_response_s": 0.5833816730882972, "answer_total_s": 0.8816935690119863, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 266, "content_group": "4153619057d2d33ea8c459e64261c6f2e8abf36ef3c1f2fcfdbcb5aa4f159683", "question": {"question_id": "sample_266_a1318_q0", "video_id": 266, "video_path": "./videos/sample_266_real.mp4", "annotation_index": 1318, "question_index": 0, "question": "What number is currently displayed on the central screen in the car?", "options": ["A. 3.", "B. 4.", "C. 5.", "D. 6."], "answer": "A", "time_stamp_s": 129, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [126, 131], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_266_a1318_q0", "video_id": 266, "time_stamp_s": 129, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f69a3a3def4a2d3c646b40f366d02db66a049a13696251a65a13c33199486de0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0], "recent_frames_sha256": "e1d67ed4cb245807d7cb740fb4072063c7a6f395a1abfc19d731173b31774d15", "num_recent_frames": 30, "tq": 718546.074678657, "t1": 718553.814152024, "ta": 718553.814152024, "te": 718553.851947962, "first_response_s": 7.739473366993479, "answer_total_s": 7.777269304962829, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_266_a1318_q0", "video_id": 266, "time_stamp_s": 129, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d29edc285ec06782be0e9269a0af3df9c5cf4c15d512392d7d6de2ed64dfef27", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver's hands grip a steering wheel with \"Suzuki\" branding, actively turning it to navigate a winding road.  \n- Dashboard displays fluctuating green numbers (e.g., \"2\", \"3\", \"4\") indicating lap or speed metrics, with a central screen showing a map or telemetry.  \n- Exterior view reveals a rural road flanked by stone walls, trees, and spectators, with a red vehicle visible ahead on the road.\n[30-60s] - Driver's hands grip steering wheel, making sharp turns while navigating a winding mountain road.  \n- Dashboard displays fluctuating speed and navigation data, indicating active driving with changing terrain.  \n- Vehicle moves along a narrow, curving road bordered by rocky cliffs and sparse vegetation.\n[60-90s] - Driver's hands grip steering wheel, making precise turns while navigating a narrow road.  \n- Dashboard displays fluctuating speed and gear indicators, showing active driving dynamics.  \n- Vehicle passes through a village with visible buildings and trees on either side of the road.\n[90-120s] - Driver's hands grip steering wheel, making turns while navigating a winding road.  \n- Dashboard displays fluctuating speed and gear indicators, showing active driving state.  \n- Road scenery shifts from rocky terrain to forested areas, indicating continuous motion.", "history_tokens": 279, "history_utf8_bytes": 1289, "recent_frame_times_s": [100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0], "recent_frames_sha256": "e1d67ed4cb245807d7cb740fb4072063c7a6f395a1abfc19d731173b31774d15", "num_recent_frames": 30, "tq": 718492.471523723, "t1": 718494.325067827, "ta": 718494.325067827, "te": 718494.565280037, "first_response_s": 1.8535441040294245, "answer_total_s": 2.09375631401781, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 266, "content_group": "4153619057d2d33ea8c459e64261c6f2e8abf36ef3c1f2fcfdbcb5aa4f159683", "question": {"question_id": "sample_266_a1319_q0", "video_id": 266, "video_path": "./videos/sample_266_real.mp4", "annotation_index": 1319, "question_index": 0, "question": "Which brand's logo is visible on the bottom part of the steering wheel right now?", "options": ["A. Logitech.", "B. Fanatec.", "C. Sony.", "D. Microsoft."], "answer": "B", "time_stamp_s": 192, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [189, 194], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_266_a1319_q0", "video_id": 266, "time_stamp_s": 192, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "27f6db7efa221c7b7a3db042f0210628ec3e7f76854a0f44c98d758d7052d586", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0], "recent_frames_sha256": "345afa8407f72da3881740171dc04b5a72c505f270ceed83b39cb201df30c42f", "num_recent_frames": 30, "tq": 718553.866896385, "t1": 718566.19860015, "ta": 718566.19860015, "te": 718566.23599514, "first_response_s": 12.331703764968552, "answer_total_s": 12.369098755065352, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_266_a1319_q0", "video_id": 266, "time_stamp_s": 192, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a7d9650693dd70353e88237d8788f7b80e4f37f04a3e4dcdd460b2ff7983b263", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver's hands grip a steering wheel with \"Suzuki\" branding, actively turning it to navigate a winding road.  \n- Dashboard displays fluctuating green numbers (e.g., \"2\", \"3\", \"4\") indicating lap or speed metrics, with a central screen showing a map or telemetry.  \n- Exterior view reveals a rural road flanked by stone walls, trees, and spectators, with a red vehicle visible ahead on the road.\n[30-60s] - Driver's hands grip steering wheel, making sharp turns while navigating a winding mountain road.  \n- Dashboard displays fluctuating speed and navigation data, indicating active driving with changing terrain.  \n- Vehicle moves along a narrow, curving road bordered by rocky cliffs and sparse vegetation.\n[60-90s] - Driver's hands grip steering wheel, making precise turns while navigating a narrow road.  \n- Dashboard displays fluctuating speed and gear indicators, showing active driving dynamics.  \n- Vehicle passes through a village with visible buildings and trees on either side of the road.\n[90-120s] - Driver's hands grip steering wheel, making turns while navigating a winding road.  \n- Dashboard displays fluctuating speed and gear indicators, showing active driving state.  \n- Road scenery shifts from rocky terrain to forested areas, indicating continuous motion.\n[120-150s] - Driver's hands grip steering wheel, shifting gears as speedometer fluctuates between 40-60 mph.\n- Dashboard displays fluctuating gear indicators (N, 3, 4) and a green digital timer counting down.\n- Vehicle navigates a winding mountain road with rocky terrain visible through windshield.\n[150-180s] - Driver's hands actively steer the rally car, adjusting grip and angle as the vehicle navigates a winding, rocky road.\n- Dashboard displays fluctuating speed and gear indicators, showing dynamic changes in driving conditions.\n- The car's interior, including the steering wheel and digital screens, remains consistently visible, reflecting real-time driving data.", "history_tokens": 428, "history_utf8_bytes": 1964, "recent_frame_times_s": [163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0], "recent_frames_sha256": "345afa8407f72da3881740171dc04b5a72c505f270ceed83b39cb201df30c42f", "num_recent_frames": 30, "tq": 718513.536308218, "t1": 718520.291125685, "ta": 718520.291125685, "te": 718520.6034884, "first_response_s": 6.754817466950044, "answer_total_s": 7.0671801819698885, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 266, "content_group": "4153619057d2d33ea8c459e64261c6f2e8abf36ef3c1f2fcfdbcb5aa4f159683", "question": {"question_id": "sample_266_a1320_q0", "video_id": 266, "video_path": "./videos/sample_266_real.mp4", "annotation_index": 1320, "question_index": 0, "question": "What is the current predominant color of the markings on the car's dashboard gauges?", "options": ["A. Blue.", "B. Green.", "C. White.", "D. Red."], "answer": "D", "time_stamp_s": 252, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [252, 257], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_266_a1320_q0", "video_id": 266, "time_stamp_s": 252, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3cb7489dab6e406c0d7500e573f750f832f79c450aaed3b35a607dc0e3233b7b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0], "recent_frames_sha256": "975bee76b58d3a3852974c698332247a73b4d5e5e7e85ef52a65a7fca1b83c70", "num_recent_frames": 30, "tq": 718566.257717969, "t1": 718574.673086064, "ta": 718574.673086064, "te": 718574.710602686, "first_response_s": 8.415368095040321, "answer_total_s": 8.45288471702952, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_266_a1320_q0", "video_id": 266, "time_stamp_s": 252, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "626652a37ebedc38d594cb143c3900be7b7f036d5cebde4194280cc787895c59", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver's hands grip a steering wheel with \"Suzuki\" branding, actively turning it to navigate a winding road.  \n- Dashboard displays fluctuating green numbers (e.g., \"2\", \"3\", \"4\") indicating lap or speed metrics, with a central screen showing a map or telemetry.  \n- Exterior view reveals a rural road flanked by stone walls, trees, and spectators, with a red vehicle visible ahead on the road.\n[30-60s] - Driver's hands grip steering wheel, making sharp turns while navigating a winding mountain road.  \n- Dashboard displays fluctuating speed and navigation data, indicating active driving with changing terrain.  \n- Vehicle moves along a narrow, curving road bordered by rocky cliffs and sparse vegetation.\n[60-90s] - Driver's hands grip steering wheel, making precise turns while navigating a narrow road.  \n- Dashboard displays fluctuating speed and gear indicators, showing active driving dynamics.  \n- Vehicle passes through a village with visible buildings and trees on either side of the road.\n[90-120s] - Driver's hands grip steering wheel, making turns while navigating a winding road.  \n- Dashboard displays fluctuating speed and gear indicators, showing active driving state.  \n- Road scenery shifts from rocky terrain to forested areas, indicating continuous motion.\n[120-150s] - Driver's hands grip steering wheel, shifting gears as speedometer fluctuates between 40-60 mph.\n- Dashboard displays fluctuating gear indicators (N, 3, 4) and a green digital timer counting down.\n- Vehicle navigates a winding mountain road with rocky terrain visible through windshield.\n[150-180s] - Driver's hands actively steer the rally car, adjusting grip and angle as the vehicle navigates a winding, rocky road.\n- Dashboard displays fluctuating speed and gear indicators, showing dynamic changes in driving conditions.\n- The car's interior, including the steering wheel and digital screens, remains consistently visible, reflecting real-time driving data.\n[180-210s] - Driver's hands grip steering wheel, making precise turns while navigating a winding forest road.  \n- Dashboard displays fluctuating speed and gear indicators, showing active driving dynamics.  \n- Vehicle moves along a narrow, rocky path bordered by trees and steep terrain.\n[210-240s] - Driver's hands grip steering wheel, making precise turns while navigating a winding forest road.  \n- Dashboard displays fluctuating speed and gear indicators, with a digital screen showing race-related data.  \n- Vehicle moves along a narrow, rocky path bordered by trees and cliffs, with occasional glimpses of a distant white vehicle ahead.", "history_tokens": 564, "history_utf8_bytes": 2606, "recent_frame_times_s": [223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0], "recent_frames_sha256": "975bee76b58d3a3852974c698332247a73b4d5e5e7e85ef52a65a7fca1b83c70", "num_recent_frames": 30, "tq": 718534.607193281, "t1": 718536.296207599, "ta": 718536.296207599, "te": 718536.337138616, "first_response_s": 1.6890143180498853, "answer_total_s": 1.729945335071534, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 267, "content_group": "edc50095880cef689fd56a3734f4265bb5bc4aa93d429d331f8b5863d6d3d977", "question": {"question_id": "sample_267_a1016_q0", "video_id": 267, "video_path": "./videos/sample_267_real.mp4", "annotation_index": 1016, "question_index": 0, "question": "What is the driver currently doing with his hands?", "options": ["A. Honking the horn.", "B. Shifting gears.", "C. Holding the steering wheel.", "D. Adjusting the dashboard."], "answer": "C", "time_stamp_s": 6, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_267_a1016_q0", "video_id": 267, "time_stamp_s": 6, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "05ef9d2dafb05c63e55dc786b9e3773bcc3309132924210689d05e39d5b9423e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005], "recent_frames_sha256": "6be334b1209b4a4432221250aec52077bfbeaf3e14cfffbfda5ae300f8a6456c", "num_recent_frames": 6, "tq": 710163.54362143, "t1": 710169.217550288, "ta": 710169.217550288, "te": 710169.254643513, "first_response_s": 5.673928857897408, "answer_total_s": 5.711022082949057, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_267_a1016_q0", "video_id": 267, "time_stamp_s": 6, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "76033cceb4a986a320eec9f8f9528514a6223a9d8e0b5f77c4ae236a8141f04d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005], "recent_frames_sha256": "6be334b1209b4a4432221250aec52077bfbeaf3e14cfffbfda5ae300f8a6456c", "num_recent_frames": 6, "tq": 710018.721202903, "t1": 710019.571515042, "ta": 710019.571515042, "te": 710019.612949543, "first_response_s": 0.8503121390240267, "answer_total_s": 0.891746640088968, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 267, "content_group": "edc50095880cef689fd56a3734f4265bb5bc4aa93d429d331f8b5863d6d3d977", "question": {"question_id": "sample_267_a1017_q0", "video_id": 267, "video_path": "./videos/sample_267_real.mp4", "annotation_index": 1017, "question_index": 0, "question": "What logo is visible right now?", "options": ["A. JKS-Racing-Club.", "B. JKS-Sports-Car.", "C. JKS-Classic-Cars.", "D. JKS-Rally-Sport."], "answer": "C", "time_stamp_s": 125, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [124, 129], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_267_a1017_q0", "video_id": 267, "time_stamp_s": 125, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ae88d7257bdcd0c936a55604c930af6452541848ee902bfb006895da75ebe990", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666], "recent_frames_sha256": "dd529c6af41b6c40e76ae3134e569c6d4aed57fb197af4fc66417dc8e70a3cde", "num_recent_frames": 30, "tq": 710169.268898239, "t1": 710181.078727126, "ta": 710181.078727126, "te": 710181.115863814, "first_response_s": 11.809828886995092, "answer_total_s": 11.846965575008653, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_267_a1017_q0", "video_id": 267, "time_stamp_s": 125, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "68881bb866db6f84f42ed1be4e09d3ca7024d6d398b8dbad8e0aa28f50c5a400", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver in red gloves grips steering wheel and gear shift, seated in a car with \"Jack's Classic Cars\" logo on dashboard.  \n- Two individuals stand outside near parked cars, one in blue shirt and another in green shirt, observing the scene.  \n- Car interior shows racing-style steering wheel, manual gear shifter, and a clipboard on the passenger seat.\n[30-60s] - Driver's gloved hands grip steering wheel, shifting gears with right hand while left hand steers.  \n- Dashboard displays \"JACKS-Car-Car\" logo, with gauges and controls visible.  \n- Road ahead curves left, bordered by green fields and distant trees.\n[60-90s] - Driver's hands, clad in red gloves, grip the steering wheel while navigating a winding rural road.  \n- The car's dashboard displays multiple gauges, and a \"JNS Classic Cars\" plaque is visible on the center console.  \n- A notebook rests on the passenger side, with the driver occasionally glancing at it while driving.\n[90-120s] - Driver's hands in red gloves grip steering wheel, making turns on winding road.  \n- Co-driver holds notebook, likely referencing rally route or timing.  \n- Car's dashboard displays \"JFK-Car\" branding, with visible gear shift and controls.", "history_tokens": 285, "history_utf8_bytes": 1200, "recent_frame_times_s": [95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666], "recent_frames_sha256": "dd529c6af41b6c40e76ae3134e569c6d4aed57fb197af4fc66417dc8e70a3cde", "num_recent_frames": 30, "tq": 710045.536392729, "t1": 710051.629946361, "ta": 710051.629946361, "te": 710051.667132196, "first_response_s": 6.093553631915711, "answer_total_s": 6.130739466985688, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 267, "content_group": "edc50095880cef689fd56a3734f4265bb5bc4aa93d429d331f8b5863d6d3d977", "question": {"question_id": "sample_267_a1018_q0", "video_id": 267, "video_path": "./videos/sample_267_real.mp4", "annotation_index": 1018, "question_index": 0, "question": "What is placed in front of the co-driver?", "options": ["A. A map.", "B. A joystick.", "C. A notebook.", "D. A bottle of water."], "answer": "C", "time_stamp_s": 250, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [248, 253], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_267_a1018_q0", "video_id": 267, "time_stamp_s": 250, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c7d9952d91b8f0edd042e1f4cb7c6768fcdec49b577c37f1ac27f0ffdd8dab70", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [220.00311666666667, 221.00411666666668, 222.00511666666668, 223.00611666666666, 224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333], "recent_frames_sha256": "1ca5e8793b96fe522b90243c117d32c4d504dbdeef643362c250365ef1a9ccca", "num_recent_frames": 30, "tq": 710181.127209241, "t1": 710194.019113721, "ta": 710194.019113721, "te": 710194.056734203, "first_response_s": 12.891904479940422, "answer_total_s": 12.929524961975403, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_267_a1018_q0", "video_id": 267, "time_stamp_s": 250, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fe25b048ec95f7b2048514f639b000eeeef9471f58c50926b80f9876e025e5a3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver in red gloves grips steering wheel and gear shift, seated in a car with \"Jack's Classic Cars\" logo on dashboard.  \n- Two individuals stand outside near parked cars, one in blue shirt and another in green shirt, observing the scene.  \n- Car interior shows racing-style steering wheel, manual gear shifter, and a clipboard on the passenger seat.\n[30-60s] - Driver's gloved hands grip steering wheel, shifting gears with right hand while left hand steers.  \n- Dashboard displays \"JACKS-Car-Car\" logo, with gauges and controls visible.  \n- Road ahead curves left, bordered by green fields and distant trees.\n[60-90s] - Driver's hands, clad in red gloves, grip the steering wheel while navigating a winding rural road.  \n- The car's dashboard displays multiple gauges, and a \"JNS Classic Cars\" plaque is visible on the center console.  \n- A notebook rests on the passenger side, with the driver occasionally glancing at it while driving.\n[90-120s] - Driver's hands in red gloves grip steering wheel, making turns on winding road.  \n- Co-driver holds notebook, likely referencing rally route or timing.  \n- Car's dashboard displays \"JFK-Car\" branding, with visible gear shift and controls.\n[120-150s] - Driver's gloved hands grip the steering wheel, making minor adjustments as the car navigates a dirt road.  \n- The car's dashboard displays a \"JRC Classic Car\" logo, with a notebook visible on the passenger side.  \n- The road ahead is flanked by tall green crops, with a white vehicle briefly visible in the distance.\n[150-180s] - Driver's hands in red gloves grip steering wheel, shifting gears with left hand while right hand occasionally adjusts controls.  \n- Right hand briefly touches dashboard buttons near center console, then returns to steering wheel.  \n- Driver's left foot presses accelerator pedal, indicating active driving on dirt road.\n[180-210s] - Driver's gloved hands grip the steering wheel, making minor adjustments while navigating the road.  \n- The car's dashboard displays a \"JCS Classic Car\" logo, with visible gauges and controls.  \n- The vehicle moves along a rural road flanked by green fields and cornstalks, with a red-and-white striped post visible ahead.\n[210-240s] - Driver's hands in red gloves grip steering wheel and gear shift, with right hand occasionally adjusting controls.  \n- Dashboard displays \"JAS Classic Car\" branding, and a clipboard with notes rests on the passenger side.  \n- Road ahead curves gently, flanked by green fields and distant trees under overcast skies.", "history_tokens": 589, "history_utf8_bytes": 2526, "recent_frame_times_s": [220.00311666666667, 221.00411666666668, 222.00511666666668, 223.00611666666666, 224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333], "recent_frames_sha256": "1ca5e8793b96fe522b90243c117d32c4d504dbdeef643362c250365ef1a9ccca", "num_recent_frames": 30, "tq": 710084.017830308, "t1": 710090.072431229, "ta": 710090.072431229, "te": 710090.256376756, "first_response_s": 6.05460092111025, "answer_total_s": 6.238546448061243, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 267, "content_group": "edc50095880cef689fd56a3734f4265bb5bc4aa93d429d331f8b5863d6d3d977", "question": {"question_id": "sample_267_a1019_q0", "video_id": 267, "video_path": "./videos/sample_267_real.mp4", "annotation_index": 1019, "question_index": 0, "question": "What color are the driver's gloves right now?", "options": ["A. Blue.", "B. Red.", "C. Yellow.", "D. Black."], "answer": "B", "time_stamp_s": 374, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [372, 377], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_267_a1019_q0", "video_id": 267, "time_stamp_s": 374, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a408663767a60cf98ecb9a07541987c45406a7224dfe72c9bf9aed9d64787c4a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667], "recent_frames_sha256": "b98461ea58e5e2367408ef510112bbea5d039a857c8ca285cc61d43653f26e31", "num_recent_frames": 30, "tq": 710194.069880875, "t1": 710201.343784034, "ta": 710201.343784034, "te": 710201.379930188, "first_response_s": 7.273903159075417, "answer_total_s": 7.310049313004129, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_267_a1019_q0", "video_id": 267, "time_stamp_s": 374, "ground_truth": "B", "raw_output": "B. Red.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "0bac6b6c3ca8b8eb639db9bb0c7ae45915889e878a8d6028226e51a090756242", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver in red gloves grips steering wheel and gear shift, seated in a car with \"Jack's Classic Cars\" logo on dashboard.  \n- Two individuals stand outside near parked cars, one in blue shirt and another in green shirt, observing the scene.  \n- Car interior shows racing-style steering wheel, manual gear shifter, and a clipboard on the passenger seat.\n[30-60s] - Driver's gloved hands grip steering wheel, shifting gears with right hand while left hand steers.  \n- Dashboard displays \"JACKS-Car-Car\" logo, with gauges and controls visible.  \n- Road ahead curves left, bordered by green fields and distant trees.\n[60-90s] - Driver's hands, clad in red gloves, grip the steering wheel while navigating a winding rural road.  \n- The car's dashboard displays multiple gauges, and a \"JNS Classic Cars\" plaque is visible on the center console.  \n- A notebook rests on the passenger side, with the driver occasionally glancing at it while driving.\n[90-120s] - Driver's hands in red gloves grip steering wheel, making turns on winding road.  \n- Co-driver holds notebook, likely referencing rally route or timing.  \n- Car's dashboard displays \"JFK-Car\" branding, with visible gear shift and controls.\n[120-150s] - Driver's gloved hands grip the steering wheel, making minor adjustments as the car navigates a dirt road.  \n- The car's dashboard displays a \"JRC Classic Car\" logo, with a notebook visible on the passenger side.  \n- The road ahead is flanked by tall green crops, with a white vehicle briefly visible in the distance.\n[150-180s] - Driver's hands in red gloves grip steering wheel, shifting gears with left hand while right hand occasionally adjusts controls.  \n- Right hand briefly touches dashboard buttons near center console, then returns to steering wheel.  \n- Driver's left foot presses accelerator pedal, indicating active driving on dirt road.\n[180-210s] - Driver's gloved hands grip the steering wheel, making minor adjustments while navigating the road.  \n- The car's dashboard displays a \"JCS Classic Car\" logo, with visible gauges and controls.  \n- The vehicle moves along a rural road flanked by green fields and cornstalks, with a red-and-white striped post visible ahead.\n[210-240s] - Driver's hands in red gloves grip steering wheel and gear shift, with right hand occasionally adjusting controls.  \n- Dashboard displays \"JAS Classic Car\" branding, and a clipboard with notes rests on the passenger side.  \n- Road ahead curves gently, flanked by green fields and distant trees under overcast skies.\n[240-270s] - Driver's hands in red gloves grip steering wheel, making turns on winding road.  \n- Dashboard displays \"JKS Classic Cars\" logo; blue gear shifters visible.  \n- Road curves through greenery, with hay bales and rural buildings in background.\n[270-300s] - Driver's gloved hands grip the steering wheel, making precise adjustments as the car navigates a winding forest road.  \n- The car's interior, featuring a \"JAS Classic Car\" badge, shows a manual gear shift and dashboard gauges indicating active driving.  \n- A paper with handwritten notes is held by the driver, likely containing route or timing information for the rally.\n[300-330s] - Driver's gloved hands grip the steering wheel, making slight adjustments as the car navigates a dirt road.  \n- The dashboard displays \"JCS Classic Cars\" branding, with visible gauges and controls.  \n- The vehicle moves forward through a narrow path flanked by tall green crops.\n[330-360s] - Driver's gloved hands grip the steering wheel, with the left hand occasionally adjusting its position.  \n- The car's dashboard displays a \"JCK Classic Cars\" sticker, and the driver's right hand rests near the gear shift.  \n- The vehicle navigates a narrow, rural road flanked by green fields and trees, with occasional roadside markers visible.", "history_tokens": 892, "history_utf8_bytes": 3813, "recent_frame_times_s": [344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667], "recent_frames_sha256": "b98461ea58e5e2367408ef510112bbea5d039a857c8ca285cc61d43653f26e31", "num_recent_frames": 30, "tq": 710122.019631641, "t1": 710123.587533304, "ta": 710123.587533304, "te": 710123.812087844, "first_response_s": 1.567901663016528, "answer_total_s": 1.792456203023903, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 267, "content_group": "edc50095880cef689fd56a3734f4265bb5bc4aa93d429d331f8b5863d6d3d977", "question": {"question_id": "sample_267_a1020_q0", "video_id": 267, "video_path": "./videos/sample_267_real.mp4", "annotation_index": 1020, "question_index": 0, "question": "What brand is visible on the steering wheel right now?", "options": ["A. JKS.", "B. OMP.", "C. Freem.", "D. Classic-Cars."], "answer": "B", "time_stamp_s": 498, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [496, 501], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_267_a1020_q0", "video_id": 267, "time_stamp_s": 498, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1d5c40e5ee624742b7263e4923be7b6a6c2955c2e583b7435d867f9e9229310d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336], "recent_frames_sha256": "1057a0bd126e9a46b01319ca2c9320ba972f479a146a1a0b4119f406dd42593d", "num_recent_frames": 30, "tq": 710201.398537799, "t1": 710207.467369414, "ta": 710207.467369414, "te": 710207.505265254, "first_response_s": 6.0688316150335595, "answer_total_s": 6.10672745492775, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_267_a1020_q0", "video_id": 267, "time_stamp_s": 498, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3dc7c95a4218c0e53336c8b1946a79f5fcbb2e91ed92dd31e1df8be435be65e4", "condition_order": ["notes", "recent"], "memory": "[90-120s] - Driver's hands in red gloves grip steering wheel, making turns on winding road.  \n- Co-driver holds notebook, likely referencing rally route or timing.  \n- Car's dashboard displays \"JFK-Car\" branding, with visible gear shift and controls.\n[120-150s] - Driver's gloved hands grip the steering wheel, making minor adjustments as the car navigates a dirt road.  \n- The car's dashboard displays a \"JRC Classic Car\" logo, with a notebook visible on the passenger side.  \n- The road ahead is flanked by tall green crops, with a white vehicle briefly visible in the distance.\n[150-180s] - Driver's hands in red gloves grip steering wheel, shifting gears with left hand while right hand occasionally adjusts controls.  \n- Right hand briefly touches dashboard buttons near center console, then returns to steering wheel.  \n- Driver's left foot presses accelerator pedal, indicating active driving on dirt road.\n[180-210s] - Driver's gloved hands grip the steering wheel, making minor adjustments while navigating the road.  \n- The car's dashboard displays a \"JCS Classic Car\" logo, with visible gauges and controls.  \n- The vehicle moves along a rural road flanked by green fields and cornstalks, with a red-and-white striped post visible ahead.\n[210-240s] - Driver's hands in red gloves grip steering wheel and gear shift, with right hand occasionally adjusting controls.  \n- Dashboard displays \"JAS Classic Car\" branding, and a clipboard with notes rests on the passenger side.  \n- Road ahead curves gently, flanked by green fields and distant trees under overcast skies.\n[240-270s] - Driver's hands in red gloves grip steering wheel, making turns on winding road.  \n- Dashboard displays \"JKS Classic Cars\" logo; blue gear shifters visible.  \n- Road curves through greenery, with hay bales and rural buildings in background.\n[270-300s] - Driver's gloved hands grip the steering wheel, making precise adjustments as the car navigates a winding forest road.  \n- The car's interior, featuring a \"JAS Classic Car\" badge, shows a manual gear shift and dashboard gauges indicating active driving.  \n- A paper with handwritten notes is held by the driver, likely containing route or timing information for the rally.\n[300-330s] - Driver's gloved hands grip the steering wheel, making slight adjustments as the car navigates a dirt road.  \n- The dashboard displays \"JCS Classic Cars\" branding, with visible gauges and controls.  \n- The vehicle moves forward through a narrow path flanked by tall green crops.\n[330-360s] - Driver's gloved hands grip the steering wheel, with the left hand occasionally adjusting its position.  \n- The car's dashboard displays a \"JCK Classic Cars\" sticker, and the driver's right hand rests near the gear shift.  \n- The vehicle navigates a narrow, rural road flanked by green fields and trees, with occasional roadside markers visible.\n[360-390s] - Driver's hands in red gloves grip steering wheel, occasionally adjusting position.  \n- Dashboard displays \"JKS Classic Cars\" branding; gauges show active vehicle metrics.  \n- Road ahead curves left, bordered by green fields and distant hay bales.\n[390-420s] - Driver's hands in red gloves grip steering wheel, making slight adjustments as car navigates curve.  \n- Dashboard displays \"JCK Classic Cars\" logo, with gauges and controls visible.  \n- Road ahead curves left, bordered by green fields and trees, with a blue car visible in distance.\n[420-450s] - Driver's hands, clad in red gloves, grip the steering wheel while navigating a winding forest road.  \n- The car's interior features a dashboard with three red circular gauges and a \"JNS Classic Cars\" plaque.  \n- A notebook rests on the passenger side, suggesting the driver is referencing route details or notes.\n[450-480s] - Driver's gloved hands grip the steering wheel, making precise turns on a narrow dirt road flanked by tall cornfields.  \n- The car's dashboard displays \"JAS Classic Car\" branding, with red indicator lights visible.  \n- A notebook rests on the passenger side, suggesting the driver is referencing rally notes or strategy.", "history_tokens": 953, "history_utf8_bytes": 4078, "recent_frame_times_s": [468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336], "recent_frames_sha256": "1057a0bd126e9a46b01319ca2c9320ba972f479a146a1a0b4119f406dd42593d", "num_recent_frames": 30, "tq": 710155.795092489, "t1": 710163.04838702, "ta": 710163.04838702, "te": 710163.498883204, "first_response_s": 7.25329453102313, "answer_total_s": 7.703790714964271, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 268, "content_group": "5133a25b6ffd2a09fd8641bcab0bbb9cd1d9e285b1359d6942482d5ca5f651c5", "question": {"question_id": "sample_268_a836_q0", "video_id": 268, "video_path": "./videos/sample_268_real.mp4", "annotation_index": 836, "question_index": 0, "question": "What is the person outside the car holding in their hand right now?", "options": ["A. A notepad.", "B. A radio.", "C. A stopwatch.", "D. A digital device."], "answer": "D", "time_stamp_s": 2, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_268_a836_q0", "video_id": 268, "time_stamp_s": 2, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d7224ecc6be2900ef63f5c624d315bcf8a4de21ee90412bd7230f4655ba4115e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001], "recent_frames_sha256": "8749f98d31f0534c5daba7d7b4b7cc814f594c1fc2e8426e1b085731a5095036", "num_recent_frames": 2, "tq": 710499.272963165, "t1": 710499.828418774, "ta": 710499.828418774, "te": 710499.865578617, "first_response_s": 0.555455608991906, "answer_total_s": 0.5926154520129785, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_268_a836_q0", "video_id": 268, "time_stamp_s": 2, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "85be8a4cad6d197d3bb4b4631f311c7a4e9b0703ebee2c667be9dcabb26688b0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001], "recent_frames_sha256": "8749f98d31f0534c5daba7d7b4b7cc814f594c1fc2e8426e1b085731a5095036", "num_recent_frames": 2, "tq": 710372.923307156, "t1": 710384.968350946, "ta": 710384.968350946, "te": 710385.330086008, "first_response_s": 12.04504379001446, "answer_total_s": 12.406778851989657, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 268, "content_group": "5133a25b6ffd2a09fd8641bcab0bbb9cd1d9e285b1359d6942482d5ca5f651c5", "question": {"question_id": "sample_268_a837_q0", "video_id": 268, "video_path": "./videos/sample_268_real.mp4", "annotation_index": 837, "question_index": 0, "question": "What is the color of the driver's gloves right now?", "options": ["A. Blue.", "B. Green.", "C. Red.", "D. Yellow."], "answer": "C", "time_stamp_s": 98, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [94, 99], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_268_a837_q0", "video_id": 268, "time_stamp_s": 98, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "59fd0a59002c3baf96ea15cdd711a1a728ca1d59b4780beb04de21e5ae07d7b0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333], "recent_frames_sha256": "f6ff22c77c303cea9fec0e1d53b1f5de936387e2f73d474a7e393ca4dc655d2d", "num_recent_frames": 30, "tq": 710499.887135723, "t1": 710511.837895583, "ta": 710511.837895583, "te": 710511.87816997, "first_response_s": 11.950759859988466, "answer_total_s": 11.991034246981144, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_268_a837_q0", "video_id": 268, "time_stamp_s": 98, "ground_truth": "C", "raw_output": "C. Red.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "8ebb3dee1602e11e7e43a48fb057690c0fea185bc719ba5026ef7e130f6d9a9a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver's hands in red gloves grip steering wheel and gear shift, with right hand occasionally moving toward dashboard.  \n- Dashboard displays \"RALLY CAR\" text, and a blue circular icon with white arrow appears on windshield, indicating direction.  \n- Vehicle travels along a narrow road flanked by grassy fields and wooden fences, with distant hills visible under clear sky.\n[30-60s] - Driver's gloved hands grip the steering wheel, making precise turns as the car navigates a winding rural road.  \n- The dashboard displays \"JKS Classic Cars\" and features multiple gauges, with the driver occasionally adjusting controls.  \n- The car's interior is visible, including a racing-style steering wheel and a clipboard on the passenger side, suggesting a rally event.\n[60-90s] - Driver's gloved hands grip the steering wheel, making subtle adjustments as the car navigates a winding rural road.  \n- The dashboard displays \"JKS Classic Cars\" branding, with a clipboard held by the driver for reference.  \n- The road ahead curves gently, bordered by grassy fields and sparse trees, with a red-and-white striped marker visible on the right.", "history_tokens": 249, "history_utf8_bytes": 1141, "recent_frame_times_s": [68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333], "recent_frames_sha256": "f6ff22c77c303cea9fec0e1d53b1f5de936387e2f73d474a7e393ca4dc655d2d", "num_recent_frames": 30, "tq": 710403.120191039, "t1": 710409.513236994, "ta": 710409.513236994, "te": 710409.759063549, "first_response_s": 6.393045954988338, "answer_total_s": 6.638872509938665, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 268, "content_group": "5133a25b6ffd2a09fd8641bcab0bbb9cd1d9e285b1359d6942482d5ca5f651c5", "question": {"question_id": "sample_268_a838_q0", "video_id": 268, "video_path": "./videos/sample_268_real.mp4", "annotation_index": 838, "question_index": 0, "question": "What can be seen through the windshield right now?", "options": ["A. A racetrack.", "B. A dirt path.", "C. A field with trees.", "D. A forest."], "answer": "C", "time_stamp_s": 192, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [188, 193], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_268_a838_q0", "video_id": 268, "time_stamp_s": 192, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9995589f91a93aef0673577084569174013396b6914a1e9b2b93aaf48f1e2abf", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334], "recent_frames_sha256": "84f4ba657d2a727998694c273c384ee1e0e749ff3a981c0f48de732b42ec4f5e", "num_recent_frames": 30, "tq": 710511.892948144, "t1": 710524.738928983, "ta": 710524.738928983, "te": 710524.778348638, "first_response_s": 12.845980838988908, "answer_total_s": 12.885400493978523, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_268_a838_q0", "video_id": 268, "time_stamp_s": 192, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "175939fee3c47fad1b363d3f9c5b327c09d4e730ad51964c55381f87a1e5b8a4", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver's hands in red gloves grip steering wheel and gear shift, with right hand occasionally moving toward dashboard.  \n- Dashboard displays \"RALLY CAR\" text, and a blue circular icon with white arrow appears on windshield, indicating direction.  \n- Vehicle travels along a narrow road flanked by grassy fields and wooden fences, with distant hills visible under clear sky.\n[30-60s] - Driver's gloved hands grip the steering wheel, making precise turns as the car navigates a winding rural road.  \n- The dashboard displays \"JKS Classic Cars\" and features multiple gauges, with the driver occasionally adjusting controls.  \n- The car's interior is visible, including a racing-style steering wheel and a clipboard on the passenger side, suggesting a rally event.\n[60-90s] - Driver's gloved hands grip the steering wheel, making subtle adjustments as the car navigates a winding rural road.  \n- The dashboard displays \"JKS Classic Cars\" branding, with a clipboard held by the driver for reference.  \n- The road ahead curves gently, bordered by grassy fields and sparse trees, with a red-and-white striped marker visible on the right.\n[90-120s] - Driver's gloved hands grip the steering wheel, occasionally adjusting position while navigating the road.  \n- The car's dashboard displays visible gauges and controls, with a \"JRS Classic Cars\" sticker prominently placed.  \n- The vehicle moves along a rural road flanked by vineyards and sparse trees, with occasional roadside structures visible.\n[120-150s] - Driver's hands in red gloves grip steering wheel, making minor adjustments as car navigates winding rural road.  \n- Dashboard displays \"JNS Classic Cars\" logo; gear shift lever is visible to the right of the driver.  \n- Road ahead curves left, bordered by bare trees and a fence, with a small orange marker visible on the right side.\n[150-180s] - Driver's gloved hands adjust steering wheel and gear shift while navigating a winding road.  \n- Dashboard displays \"JHS Classic Cars\" branding; red circular buttons are visible on center console.  \n- Road curves through vineyard landscape with distant hills and sparse trees under clear sky.", "history_tokens": 475, "history_utf8_bytes": 2152, "recent_frame_times_s": [162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334], "recent_frames_sha256": "84f4ba657d2a727998694c273c384ee1e0e749ff3a981c0f48de732b42ec4f5e", "num_recent_frames": 30, "tq": 710434.404764843, "t1": 710436.659464711, "ta": 710436.659464711, "te": 710436.869009727, "first_response_s": 2.2546998679172248, "answer_total_s": 2.4642448839731514, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 268, "content_group": "5133a25b6ffd2a09fd8641bcab0bbb9cd1d9e285b1359d6942482d5ca5f651c5", "question": {"question_id": "sample_268_a839_q0", "video_id": 268, "video_path": "./videos/sample_268_real.mp4", "annotation_index": 839, "question_index": 0, "question": "What can be seen through the windshield right now?", "options": ["A. A dense forest.", "B. City buildings.", "C. A field with rows of poles.", "D. A sandy desert."], "answer": "C", "time_stamp_s": 282, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [282, 287], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_268_a839_q0", "video_id": 268, "time_stamp_s": 282, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9716a59523a3277ca48fa83536a794a0bb8ca0d23b53e61c7f7635bdb51939e9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667], "recent_frames_sha256": "e34d195a10c9360d328e663b04b014c53bd67079cbb23f17b7d4ebf7585ab5ec", "num_recent_frames": 30, "tq": 710524.794166473, "t1": 710537.692957544, "ta": 710537.692957544, "te": 710537.730173792, "first_response_s": 12.898791071027517, "answer_total_s": 12.936007319018245, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_268_a839_q0", "video_id": 268, "time_stamp_s": 282, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3255501f109a77226a08dab909b12c85bc81fd37f3130b458a9f2a00b3275e6a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver's hands in red gloves grip steering wheel and gear shift, with right hand occasionally moving toward dashboard.  \n- Dashboard displays \"RALLY CAR\" text, and a blue circular icon with white arrow appears on windshield, indicating direction.  \n- Vehicle travels along a narrow road flanked by grassy fields and wooden fences, with distant hills visible under clear sky.\n[30-60s] - Driver's gloved hands grip the steering wheel, making precise turns as the car navigates a winding rural road.  \n- The dashboard displays \"JKS Classic Cars\" and features multiple gauges, with the driver occasionally adjusting controls.  \n- The car's interior is visible, including a racing-style steering wheel and a clipboard on the passenger side, suggesting a rally event.\n[60-90s] - Driver's gloved hands grip the steering wheel, making subtle adjustments as the car navigates a winding rural road.  \n- The dashboard displays \"JKS Classic Cars\" branding, with a clipboard held by the driver for reference.  \n- The road ahead curves gently, bordered by grassy fields and sparse trees, with a red-and-white striped marker visible on the right.\n[90-120s] - Driver's gloved hands grip the steering wheel, occasionally adjusting position while navigating the road.  \n- The car's dashboard displays visible gauges and controls, with a \"JRS Classic Cars\" sticker prominently placed.  \n- The vehicle moves along a rural road flanked by vineyards and sparse trees, with occasional roadside structures visible.\n[120-150s] - Driver's hands in red gloves grip steering wheel, making minor adjustments as car navigates winding rural road.  \n- Dashboard displays \"JNS Classic Cars\" logo; gear shift lever is visible to the right of the driver.  \n- Road ahead curves left, bordered by bare trees and a fence, with a small orange marker visible on the right side.\n[150-180s] - Driver's gloved hands adjust steering wheel and gear shift while navigating a winding road.  \n- Dashboard displays \"JHS Classic Cars\" branding; red circular buttons are visible on center console.  \n- Road curves through vineyard landscape with distant hills and sparse trees under clear sky.\n[180-210s] - Driver's gloved hands grip the steering wheel, making slight adjustments as the car navigates a winding rural road.  \n- The dashboard displays a \"JAS Classic Cars\" logo, with a paper map or notes visible on the passenger side.  \n- The road curves through a vineyard landscape, with trees and open fields visible through the windshield.\n[210-240s] - Driver's gloved hands grip the steering wheel, making minor adjustments while navigating the road.  \n- The car's dashboard displays \"JKS Classic Cars\" and features three circular gauges.  \n- The road ahead is lined with vineyard rows, with a slight curve visible as the vehicle progresses.\n[240-270s] - Driver's gloved hands grip the steering wheel and gear shift, navigating a winding rural road.  \n- A \"JKS Classic Cars\" logo is visible on the dashboard, with a paper map or notes placed on the passenger side.  \n- The vehicle's interior features a racing-style steering wheel and analog gauges, with trees and open fields visible through the windshield.", "history_tokens": 712, "history_utf8_bytes": 3171, "recent_frame_times_s": [252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667], "recent_frames_sha256": "e34d195a10c9360d328e663b04b014c53bd67079cbb23f17b7d4ebf7585ab5ec", "num_recent_frames": 30, "tq": 710461.779435488, "t1": 710463.462759465, "ta": 710463.462759465, "te": 710463.741539588, "first_response_s": 1.6833239769330248, "answer_total_s": 1.9621040999190882, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 268, "content_group": "5133a25b6ffd2a09fd8641bcab0bbb9cd1d9e285b1359d6942482d5ca5f651c5", "question": {"question_id": "sample_268_a840_q0", "video_id": 268, "video_path": "./videos/sample_268_real.mp4", "annotation_index": 840, "question_index": 0, "question": "What is visible through the windshield right now?", "options": ["A. A field with rows of poles.", "B. A lake.", "C. A forest path.", "D. A residential area."], "answer": "A", "time_stamp_s": 382, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [376, 381], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_268_a840_q0", "video_id": 268, "time_stamp_s": 382, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6201d3f5c9cae92b99288d736b1aebb2fdc9d8fb83194989aee11ceb6a71ac3b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665], "recent_frames_sha256": "4462423faa3b26438378f867ebd98bab9dfecaa7965cd0fbe44238e5cbe1a6d3", "num_recent_frames": 30, "tq": 710537.747199645, "t1": 710551.630842852, "ta": 710551.630842852, "te": 710551.66759958, "first_response_s": 13.883643207023852, "answer_total_s": 13.920399934984744, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_268_a840_q0", "video_id": 268, "time_stamp_s": 382, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b0a8d366fe34434e73264dbc571af9ea6691b023a0cd5a73894f5cb9a9a11b59", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver's hands in red gloves grip steering wheel and gear shift, with right hand occasionally moving toward dashboard.  \n- Dashboard displays \"RALLY CAR\" text, and a blue circular icon with white arrow appears on windshield, indicating direction.  \n- Vehicle travels along a narrow road flanked by grassy fields and wooden fences, with distant hills visible under clear sky.\n[30-60s] - Driver's gloved hands grip the steering wheel, making precise turns as the car navigates a winding rural road.  \n- The dashboard displays \"JKS Classic Cars\" and features multiple gauges, with the driver occasionally adjusting controls.  \n- The car's interior is visible, including a racing-style steering wheel and a clipboard on the passenger side, suggesting a rally event.\n[60-90s] - Driver's gloved hands grip the steering wheel, making subtle adjustments as the car navigates a winding rural road.  \n- The dashboard displays \"JKS Classic Cars\" branding, with a clipboard held by the driver for reference.  \n- The road ahead curves gently, bordered by grassy fields and sparse trees, with a red-and-white striped marker visible on the right.\n[90-120s] - Driver's gloved hands grip the steering wheel, occasionally adjusting position while navigating the road.  \n- The car's dashboard displays visible gauges and controls, with a \"JRS Classic Cars\" sticker prominently placed.  \n- The vehicle moves along a rural road flanked by vineyards and sparse trees, with occasional roadside structures visible.\n[120-150s] - Driver's hands in red gloves grip steering wheel, making minor adjustments as car navigates winding rural road.  \n- Dashboard displays \"JNS Classic Cars\" logo; gear shift lever is visible to the right of the driver.  \n- Road ahead curves left, bordered by bare trees and a fence, with a small orange marker visible on the right side.\n[150-180s] - Driver's gloved hands adjust steering wheel and gear shift while navigating a winding road.  \n- Dashboard displays \"JHS Classic Cars\" branding; red circular buttons are visible on center console.  \n- Road curves through vineyard landscape with distant hills and sparse trees under clear sky.\n[180-210s] - Driver's gloved hands grip the steering wheel, making slight adjustments as the car navigates a winding rural road.  \n- The dashboard displays a \"JAS Classic Cars\" logo, with a paper map or notes visible on the passenger side.  \n- The road curves through a vineyard landscape, with trees and open fields visible through the windshield.\n[210-240s] - Driver's gloved hands grip the steering wheel, making minor adjustments while navigating the road.  \n- The car's dashboard displays \"JKS Classic Cars\" and features three circular gauges.  \n- The road ahead is lined with vineyard rows, with a slight curve visible as the vehicle progresses.\n[240-270s] - Driver's gloved hands grip the steering wheel and gear shift, navigating a winding rural road.  \n- A \"JKS Classic Cars\" logo is visible on the dashboard, with a paper map or notes placed on the passenger side.  \n- The vehicle's interior features a racing-style steering wheel and analog gauges, with trees and open fields visible through the windshield.\n[270-300s] - Driver's gloved hands grip the steering wheel, making minor adjustments while navigating the road.  \n- The car's dashboard displays \"JKS Classic Cars\" branding, with visible gauges and controls.  \n- The road ahead curves gently, flanked by trees and grassy terrain, with a blue barrel visible on the right side.\n[300-330s] - Driver's hands in red gloves grip steering wheel, making minor adjustments while driving.\n- Car interior shows \"JAS-Classic-Cars\" logo on dashboard, with a paper map visible on the passenger side.\n- Road ahead curves gently, bordered by rows of trees and open fields, with a distant blue vehicle visible.\n[330-360s] - Driver's gloved hands actively steer and adjust controls, with right hand frequently moving toward gear shift.  \n- Steering wheel and dashboard display \"JNS Classic Cars\" branding, indicating vehicle identity.  \n- Road ahead curves left, bordered by dry grass and sparse trees, with a distant orange marker visible.", "history_tokens": 937, "history_utf8_bytes": 4143, "recent_frame_times_s": [352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665], "recent_frames_sha256": "4462423faa3b26438378f867ebd98bab9dfecaa7965cd0fbe44238e5cbe1a6d3", "num_recent_frames": 30, "tq": 710491.765197233, "t1": 710499.005872963, "ta": 710499.005872963, "te": 710499.225027274, "first_response_s": 7.240675730048679, "answer_total_s": 7.45983004104346, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 269, "content_group": "9054cc518343bab021b049faa48564f06a362e8cbb049fcaf2e7dace5bb3f942", "question": {"question_id": "sample_269_a1869_q0", "video_id": 269, "video_path": "./videos/sample_269_real.mp4", "annotation_index": 1869, "question_index": 0, "question": "What information is being displayed on the screen just now?", "options": ["A. Current speed of the cyclist.", "B. Details of Susten Pass (East side).", "C. A map showing the cycling route.", "D. Weather conditions in the area."], "answer": "B", "time_stamp_s": 9, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_269_a1869_q0", "video_id": 269, "time_stamp_s": 9, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b4720e830b2769ace4be8a48e71696e0bab125050dcf441d5113d324acea3ec8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008], "recent_frames_sha256": "5b3dde3bda58f44a196b487db6fa11c163a0ab49d71b00cbb3c69e0b222e18c9", "num_recent_frames": 9, "tq": 717278.559150354, "t1": 717279.333213535, "ta": 717279.333213535, "te": 717279.375132819, "first_response_s": 0.7740631810156628, "answer_total_s": 0.8159824650501832, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_269_a1869_q0", "video_id": 269, "time_stamp_s": 9, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "973af8a6b21009993f2e54eacdd9dde0fa94b637787e4cd3db42e48b301dd7ce", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008], "recent_frames_sha256": "5b3dde3bda58f44a196b487db6fa11c163a0ab49d71b00cbb3c69e0b222e18c9", "num_recent_frames": 9, "tq": 716997.625991402, "t1": 717008.796485214, "ta": 717008.796485214, "te": 717008.836404277, "first_response_s": 11.170493812067434, "answer_total_s": 11.210412875050679, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 269, "content_group": "9054cc518343bab021b049faa48564f06a362e8cbb049fcaf2e7dace5bb3f942", "question": {"question_id": "sample_269_a1870_q0", "video_id": 269, "video_path": "./videos/sample_269_real.mp4", "annotation_index": 1870, "question_index": 0, "question": "What is the position of the guardrail right now?", "options": ["A. On the right side of the road.", "B. Directly behind the cyclist.", "C. On the left side of the road.", "D. Directly ahead of the cyclist."], "answer": "A", "time_stamp_s": 204, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [195, 215], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_269_a1870_q0", "video_id": 269, "time_stamp_s": 204, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6f7f47a73716a373d7a7681daa4364546e6f9e96a1fdf60911f4ecb82cf090d2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.03416666666666, 202.03516666666667, 203.03616666666667], "recent_frames_sha256": "ec34f57e79c15301b8821b6c492d4ba1ecc0360b35704cc42f08cbdc5f382945", "num_recent_frames": 30, "tq": 717279.390152175, "t1": 717291.871459546, "ta": 717291.871459546, "te": 717291.910299144, "first_response_s": 12.481307371053845, "answer_total_s": 12.520146969007328, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_269_a1870_q0", "video_id": 269, "time_stamp_s": 204, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1b2dd8c5856b342e04bf56e689250588da0792712ff7d68e9e32c60de6690f50", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A cyclist rides uphill on a mountain road, with a digital overlay showing time, speed, and gradient data.\n- The cyclist passes through a tunnel, with the overlay updating real-time metrics as they emerge into daylight.\n- The road curves along a cliffside, with mountains and clouds visible in the background, and the cyclist's shadow cast on the pavement.\n[30-60s] - Cyclist in white jersey and black shorts rides uphill on a winding mountain road, leaning forward with effort.\n- On-screen display shows \"APR 45\" (likely date) and fluctuating \"Pace\" values (e.g., 72, 71, 70) alongside \"ELEV\" and \"GAIN\" metrics.\n- Mountainous terrain with rocky cliffs and distant snow-capped peaks under a partly cloudy sky; road curves sharply to the left.\n[60-90s] - Cyclist in white jersey and black shorts rides downhill, leaning forward, with speed decreasing from 45 to 38 mph.\n- Road curves right, bordered by rocky cliffs and sparse vegetation, with a blue car overtaking on the right.\n- On-screen data shows elevation drop from 46 to 38 meters, with a negative gradient (-8 to -11) indicating descent.\n[90-120s] - Cyclist in white jersey and black shorts rides uphill, shadow cast on road.  \n- On-screen metrics show speed fluctuating between 42–45 mph, elevation gain around 280–290 meters.  \n- Road curves along mountain slope; rocky terrain and greenery visible on sides.\n[120-150s] - Cyclist in white jersey and black shorts rides downhill, leaning forward, with speed decreasing from 42 to 30 MPH.\n- Road curves sharply to the right, bordered by steep rocky cliffs and distant mountain peaks under a clear blue sky.\n- On-screen data shows elevation gain decreasing from +6 to -6, with speed and power metrics fluctuating as the cyclist descends.\n[150-180s] - Cyclist maintains steady pace uphill, with speed increasing from 44 to 51 mph and elevation gain rising to 1,229 ft.  \n- Road curves sharply to the right, bordered by steep rocky cliffs and distant snow-capped peaks under a partly cloudy sky.  \n- Shadow of cyclist and bike moves dynamically across asphalt, indicating consistent forward motion and sunlight angle.", "history_tokens": 529, "history_utf8_bytes": 2136, "recent_frame_times_s": [174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.03416666666666, 202.03516666666667, 203.03616666666667], "recent_frames_sha256": "ec34f57e79c15301b8821b6c492d4ba1ecc0360b35704cc42f08cbdc5f382945", "num_recent_frames": 30, "tq": 717064.475769555, "t1": 717066.009951477, "ta": 717066.009951477, "te": 717066.048267121, "first_response_s": 1.5341819220921025, "answer_total_s": 1.5724975659977645, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 269, "content_group": "9054cc518343bab021b049faa48564f06a362e8cbb049fcaf2e7dace5bb3f942", "question": {"question_id": "sample_269_a1871_q0", "video_id": 269, "video_path": "./videos/sample_269_real.mp4", "annotation_index": 1871, "question_index": 0, "question": "Where is the cyclist descending towards right now?", "options": ["A. A dense forest area.", "B. A rocky hill.", "C. An open grassland.", "D. A small village."], "answer": "A", "time_stamp_s": 399, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [390, 410], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_269_a1871_q0", "video_id": 269, "time_stamp_s": 399, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "20747df34fb801c272e7ea3ba65f173cbe5829cdd3146b01c4934db39821a27d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [369.0353333333333, 370.03633333333335, 371.0373333333333, 372.03833333333336, 373.03933333333333, 374.0403333333333, 375.04133333333334, 376.000625, 377.001625, 378.002625, 379.003625, 380.004625, 381.005625, 382.006625, 383.007625, 384.008625, 385.009625, 386.010625, 387.011625, 388.012625, 389.013625, 390.014625, 391.015625, 392.016625, 393.017625, 394.018625, 395.019625, 396.020625, 397.021625, 398.022625], "recent_frames_sha256": "35277f7e87e1c4535f0e072d8f7dfb47f5bbd58da6e5d780d18108b47d5d3e10", "num_recent_frames": 30, "tq": 717291.923762903, "t1": 717304.977129097, "ta": 717304.977129097, "te": 717305.016537565, "first_response_s": 13.053366194013506, "answer_total_s": 13.09277466207277, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_269_a1871_q0", "video_id": 269, "time_stamp_s": 399, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "118f3f13e8bb6c1340b2cacb5e932769ac088550200325a67afc4a6526259631", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Cyclist in white jersey and black shorts rides downhill, leaning forward, with speed decreasing from 45 to 38 mph.\n- Road curves right, bordered by rocky cliffs and sparse vegetation, with a blue car overtaking on the right.\n- On-screen data shows elevation drop from 46 to 38 meters, with a negative gradient (-8 to -11) indicating descent.\n[90-120s] - Cyclist in white jersey and black shorts rides uphill, shadow cast on road.  \n- On-screen metrics show speed fluctuating between 42–45 mph, elevation gain around 280–290 meters.  \n- Road curves along mountain slope; rocky terrain and greenery visible on sides.\n[120-150s] - Cyclist in white jersey and black shorts rides downhill, leaning forward, with speed decreasing from 42 to 30 MPH.\n- Road curves sharply to the right, bordered by steep rocky cliffs and distant mountain peaks under a clear blue sky.\n- On-screen data shows elevation gain decreasing from +6 to -6, with speed and power metrics fluctuating as the cyclist descends.\n[150-180s] - Cyclist maintains steady pace uphill, with speed increasing from 44 to 51 mph and elevation gain rising to 1,229 ft.  \n- Road curves sharply to the right, bordered by steep rocky cliffs and distant snow-capped peaks under a partly cloudy sky.  \n- Shadow of cyclist and bike moves dynamically across asphalt, indicating consistent forward motion and sunlight angle.\n[180-210s] - Cyclist in white jersey and black shorts rides uphill on a winding mountain road, with speed and elevation data displayed on screen.\n- A white van overtakes the cyclist from behind, followed by a black car, indicating traffic on the scenic route.\n- The cyclist maintains a steady pace, with the road curving sharply to the right, bordered by steep cliffs and distant mountain peaks.\n[210-240s] - Cyclist in white jersey and black shorts rides uphill on a winding mountain road, with speed and elevation data displayed on screen.\n- The road curves sharply, bordered by rocky terrain and distant peaks under a partly cloudy sky.\n- On-screen metrics show fluctuating speed (MPH) and elevation gain (PAR), indicating a challenging climb.\n[240-270s] - Cyclist in white jersey and black shorts rides uphill, leaning forward, with speed fluctuating between 47–48 MPH and elevation gain around -8 to -9 meters.\n- Road curves left, bordered by stone walls and green hills, with a silver car overtaking on the right.\n- Shadow of cyclist and bike cast on asphalt, indicating bright sunlight; distant mountains with snow-capped peaks visible.\n[270-300s] - Cyclist in white jersey and black shorts rides uphill, leaning forward, with speedometer showing 52–54 MPH and elevation gain of -8 to -9 feet.\n- Road curves left, bordered by stone wall on left and metal guardrail on right, with mountains in background under partly cloudy sky.\n- Speed fluctuates between 52 and 54 MPH, and elevation gain decreases slightly, indicating steady climb with minor speed adjustments.\n[300-330s] - Cyclist in white jersey rides uphill, maintaining steady pace with speed fluctuating between 52–53 MPH.  \n- Road curves along mountainous terrain with stone wall on left and guardrail on right.  \n- On-screen data shows elevation gain, pace, and heart rate, indicating ongoing performance metrics.\n[330-360s] - Cyclist in white jersey and black shorts rides a bicycle on a winding mountain road, leaning forward in an aerodynamic position.\n- On-screen display shows speed decreasing from 49 to 46 mph, power output fluctuating, and elevation gain increasing.\n- Road curves right, with green hills and distant mountains visible under a partly cloudy sky.\n[360-390s] - Cyclist in white jersey and black shorts rides uphill, leaning forward, with speed decreasing from 90 to 42 MPH.\n- Road curves left, bordered by stone walls and green hills, with a guardrail on the right.\n- On-screen display shows speed, power, and elevation gain, with elevation decreasing from +8 to -8 meters.", "history_tokens": 941, "history_utf8_bytes": 3952, "recent_frame_times_s": [369.0353333333333, 370.03633333333335, 371.0373333333333, 372.03833333333336, 373.03933333333333, 374.0403333333333, 375.04133333333334, 376.000625, 377.001625, 378.002625, 379.003625, 380.004625, 381.005625, 382.006625, 383.007625, 384.008625, 385.009625, 386.010625, 387.011625, 388.012625, 389.013625, 390.014625, 391.015625, 392.016625, 393.017625, 394.018625, 395.019625, 396.020625, 397.021625, 398.022625], "recent_frames_sha256": "35277f7e87e1c4535f0e072d8f7dfb47f5bbd58da6e5d780d18108b47d5d3e10", "num_recent_frames": 30, "tq": 717132.532231508, "t1": 717134.685649512, "ta": 717134.685649512, "te": 717134.996370567, "first_response_s": 2.1534180039307103, "answer_total_s": 2.464139058953151, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 269, "content_group": "9054cc518343bab021b049faa48564f06a362e8cbb049fcaf2e7dace5bb3f942", "question": {"question_id": "sample_269_a1872_q0", "video_id": 269, "video_path": "./videos/sample_269_real.mp4", "annotation_index": 1872, "question_index": 0, "question": "What is the cyclist approaching right now?", "options": ["A. A parking lot.", "B. A bridge.", "C. A small village.", "D. A tunnel."], "answer": "C", "time_stamp_s": 601, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [585, 605], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_269_a1872_q0", "video_id": 269, "time_stamp_s": 601, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d5634b8bb4f1eb6ed5b750efa9dd81e20ee8a92802e9e77e189e5b1d166987ed", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [571.0287916666666, 572.0297916666667, 573.0307916666667, 574.0317916666667, 575.0327916666666, 576.0337916666666, 577.0347916666667, 578.0357916666667, 579.0367916666667, 580.0377916666666, 581.0387916666666, 582.0397916666667, 583.0407916666667, 584.0000833333334, 585.0010833333333, 586.0020833333333, 587.0030833333333, 588.0040833333334, 589.0050833333333, 590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333], "recent_frames_sha256": "7a5b0738da9becbd1f4b85e2e5ca6b5bf4d005676b50cbe0e602cc5f696de6bc", "num_recent_frames": 30, "tq": 717305.030698824, "t1": 717317.766935945, "ta": 717317.766935945, "te": 717317.804536252, "first_response_s": 12.736237121047452, "answer_total_s": 12.77383742807433, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_269_a1872_q0", "video_id": 269, "time_stamp_s": 601, "ground_truth": "C", "raw_output": "C. A small village.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "823e2a1add804413398b549ba9852259d289e474fd4bcf27c20a77ebcde68970", "condition_order": ["notes", "recent"], "memory": "[270-300s] - Cyclist in white jersey and black shorts rides uphill, leaning forward, with speedometer showing 52–54 MPH and elevation gain of -8 to -9 feet.\n- Road curves left, bordered by stone wall on left and metal guardrail on right, with mountains in background under partly cloudy sky.\n- Speed fluctuates between 52 and 54 MPH, and elevation gain decreases slightly, indicating steady climb with minor speed adjustments.\n[300-330s] - Cyclist in white jersey rides uphill, maintaining steady pace with speed fluctuating between 52–53 MPH.  \n- Road curves along mountainous terrain with stone wall on left and guardrail on right.  \n- On-screen data shows elevation gain, pace, and heart rate, indicating ongoing performance metrics.\n[330-360s] - Cyclist in white jersey and black shorts rides a bicycle on a winding mountain road, leaning forward in an aerodynamic position.\n- On-screen display shows speed decreasing from 49 to 46 mph, power output fluctuating, and elevation gain increasing.\n- Road curves right, with green hills and distant mountains visible under a partly cloudy sky.\n[360-390s] - Cyclist in white jersey and black shorts rides uphill, leaning forward, with speed decreasing from 90 to 42 MPH.\n- Road curves left, bordered by stone walls and green hills, with a guardrail on the right.\n- On-screen display shows speed, power, and elevation gain, with elevation decreasing from +8 to -8 meters.\n[390-420s] - Cyclist in white jersey and black shorts rides uphill, shadow cast on road.  \n- Speed fluctuates between 46–49 MPH, elevation gain shown as -8 to -7.  \n- Road curves right, bordered by trees and mountains; a white car passes ahead.\n[420-450s] - Cyclist in white jersey and black shorts rides a road bike, leaning forward with hands on handlebars, on a winding mountain road.\n- On-screen display shows MPH, elevation gain, and power metrics, with values fluctuating as the cyclist ascends.\n- Mountainous landscape with green slopes and trees passes by on both sides of the road, under a partly cloudy sky.\n[450-480s] - Cyclist maintains a steady pace on a mountain road, with speed fluctuating between 50–51 mph and elevation gain around 80–82 meters.  \n- Road curves through green valleys with distant mountains, and a few vehicles appear on the road.  \n- On-screen data shows \"EAS -9\" and \"SPEED 14\" with \"SPEED 14\" and \"SPEED 14\" indicating consistent speed metrics.\n[480-510s] - Cyclist in white jersey and black shorts leans forward, pedaling uphill on a winding mountain road.  \n- On-screen display shows MPH, WATT, and PACE values fluctuating as the cyclist ascends.  \n- Road curves right, bordered by green hills and distant mountains under a partly cloudy sky.\n[510-540s] - Cyclist in white jersey and black shorts rides a road bike, leaning forward with hands on handlebars, moving along a paved mountain road.\n- On-screen display shows speed (MPH) and power (W) fluctuating between 46–48 MPH and 223–275 W, with a negative elevation gain (-8) and time (0:00–0:08) indicating progress.\n- The cyclist passes a small vehicle on the road ahead, with green hills and distant mountains visible under a partly cloudy sky.\n[540-570s] - Cyclist maintains forward motion on a mountain road, with speed and elevation data displayed on screen.\n- A red vehicle passes on the left side of the road, moving in the same direction as the cyclist.\n- The cyclist's position remains consistent, leaning slightly forward while pedaling, with the road curving gently ahead.\n[570-600s] - Cyclist in black shorts and white top rides on asphalt road, maintaining steady pace with speedometer showing 44–42 mph and elevation gain of -8 to -6 ft.  \n- Red car overtakes cyclist from right side, then a silver car follows, both moving at varying speeds.  \n- Landscape features green hills, distant mountains, and scattered houses; cyclist passes through a village with wooden structures.", "history_tokens": 969, "history_utf8_bytes": 3918, "recent_frame_times_s": [571.0287916666666, 572.0297916666667, 573.0307916666667, 574.0317916666667, 575.0327916666666, 576.0337916666666, 577.0347916666667, 578.0357916666667, 579.0367916666667, 580.0377916666666, 581.0387916666666, 582.0397916666667, 583.0407916666667, 584.0000833333334, 585.0010833333333, 586.0020833333333, 587.0030833333333, 588.0040833333334, 589.0050833333333, 590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333], "recent_frames_sha256": "7a5b0738da9becbd1f4b85e2e5ca6b5bf4d005676b50cbe0e602cc5f696de6bc", "num_recent_frames": 30, "tq": 717224.731102829, "t1": 717225.516713165, "ta": 717225.516713165, "te": 717225.74286491, "first_response_s": 0.7856103359954432, "answer_total_s": 1.0117620810633525, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 269, "content_group": "9054cc518343bab021b049faa48564f06a362e8cbb049fcaf2e7dace5bb3f942", "question": {"question_id": "sample_269_a1873_q0", "video_id": 269, "video_path": "./videos/sample_269_real.mp4", "annotation_index": 1873, "question_index": 0, "question": "What is to the right of the cyclist right now?", "options": ["A. A canel.", "B. A concrete wall.", "C. A clear view of mountain and trees.", "D. A lake."], "answer": "C", "time_stamp_s": 786, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [780, 800], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_269_a1873_q0", "video_id": 269, "time_stamp_s": 786, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4ad3edc54204de52bdaafd8eb5e0419356fbb755ebc6ebe5b77798ed64976664", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [756.00525, 757.00625, 758.00725, 759.00825, 760.00925, 761.01025, 762.01125, 763.01225, 764.01325, 765.01425, 766.01525, 767.01625, 768.01725, 769.01825, 770.01925, 771.02025, 772.02125, 773.02225, 774.02325, 775.02425, 776.02525, 777.02625, 778.02725, 779.02825, 780.02925, 781.03025, 782.03125, 783.03225, 784.03325, 785.03425], "recent_frames_sha256": "4e7c6e4db7c0a7d7687a8fb38e330fb5e91b71a8b20ff78bac6d8a535565b370", "num_recent_frames": 30, "tq": 717317.810619411, "t1": 717329.69934778, "ta": 717329.69934778, "te": 717329.738145124, "first_response_s": 11.888728369027376, "answer_total_s": 11.92752571310848, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_269_a1873_q0", "video_id": 269, "time_stamp_s": 786, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "440b7f4f2098b7ee10d94035beb8251a5d125754f6c693d95e6befc270234ea4", "condition_order": ["notes", "recent"], "memory": "[450-480s] - Cyclist maintains a steady pace on a mountain road, with speed fluctuating between 50–51 mph and elevation gain around 80–82 meters.  \n- Road curves through green valleys with distant mountains, and a few vehicles appear on the road.  \n- On-screen data shows \"EAS -9\" and \"SPEED 14\" with \"SPEED 14\" and \"SPEED 14\" indicating consistent speed metrics.\n[480-510s] - Cyclist in white jersey and black shorts leans forward, pedaling uphill on a winding mountain road.  \n- On-screen display shows MPH, WATT, and PACE values fluctuating as the cyclist ascends.  \n- Road curves right, bordered by green hills and distant mountains under a partly cloudy sky.\n[510-540s] - Cyclist in white jersey and black shorts rides a road bike, leaning forward with hands on handlebars, moving along a paved mountain road.\n- On-screen display shows speed (MPH) and power (W) fluctuating between 46–48 MPH and 223–275 W, with a negative elevation gain (-8) and time (0:00–0:08) indicating progress.\n- The cyclist passes a small vehicle on the road ahead, with green hills and distant mountains visible under a partly cloudy sky.\n[540-570s] - Cyclist maintains forward motion on a mountain road, with speed and elevation data displayed on screen.\n- A red vehicle passes on the left side of the road, moving in the same direction as the cyclist.\n- The cyclist's position remains consistent, leaning slightly forward while pedaling, with the road curving gently ahead.\n[570-600s] - Cyclist in black shorts and white top rides on asphalt road, maintaining steady pace with speedometer showing 44–42 mph and elevation gain of -8 to -6 ft.  \n- Red car overtakes cyclist from right side, then a silver car follows, both moving at varying speeds.  \n- Landscape features green hills, distant mountains, and scattered houses; cyclist passes through a village with wooden structures.\n[600-630s] - Cyclist in white jersey and black shorts rides a bicycle on a mountain road, maintaining a steady pace.  \n- A blue SUV is visible ahead, traveling in the same direction, with the cyclist maintaining a safe distance.  \n- The road curves through a scenic valley with green hills and distant snow-capped mountains under a partly cloudy sky.\n[630-660s] - Cyclist in white top and black shorts rides a bicycle on a mountain road, maintaining a steady pace.  \n- A black SUV is visible ahead, following the cyclist on the same road.  \n- The speedometer shows fluctuating speeds, ranging from 40 to 43 mph, with a consistent elevation gain of -8 to -7 meters.\n[660-690s] - Cyclist in white jersey and black shorts rides a bicycle on a winding mountain road, leaning into curves.  \n- A silver car follows closely behind the cyclist, maintaining a consistent distance.  \n- On-screen metrics show speed (MPH) and power (W) fluctuating as the cyclist ascends and descends the road.\n[690-720s] - Cyclist in white top and black shorts rides a bicycle on a winding mountain road, leaning forward with effort.\n- Speedometer shows decreasing speed from 42 to 40 mph, with elevation gain of -6 meters, indicating a descent.\n- Landscape features lush green hills, distant mountains, and a clear blue sky with scattered clouds.\n[720-750s] - Cyclist in white jersey and black shorts rides a road bike, leaning forward with hands on handlebars, moving at 42 MPH.\n- Yellow bus overtakes cyclist from right side, then passes behind, both on same road with green hills and trees on either side.\n- On-screen display shows speed (42 MPH), elevation (67 meters), distance (2.98 km), and grade (-6), with time progressing from 720 to 750 seconds.\n[750-780s] - Cyclist rides uphill, leaning forward, with speed increasing from 42 to 47 MPH and elevation gain rising to 273 feet.\n- Road transitions from open mountain pass to tunnel, with speed stabilizing at 45 MPH and elevation gain at 273 feet.\n- On-screen data shows \"ELEV 273 FT\" and \"ELEV -6\" as cyclist enters tunnel, indicating descent or flat section.", "history_tokens": 1007, "history_utf8_bytes": 3969, "recent_frame_times_s": [756.00525, 757.00625, 758.00725, 759.00825, 760.00925, 761.01025, 762.01125, 763.01225, 764.01325, 765.01425, 766.01525, 767.01625, 768.01725, 769.01825, 770.01925, 771.02025, 772.02125, 773.02225, 774.02325, 775.02425, 776.02525, 777.02625, 778.02725, 779.02825, 780.02925, 781.03025, 782.03125, 783.03225, 784.03325, 785.03425], "recent_frames_sha256": "4e7c6e4db7c0a7d7687a8fb38e330fb5e91b71a8b20ff78bac6d8a535565b370", "num_recent_frames": 30, "tq": 717276.674096072, "t1": 717278.321657743, "ta": 717278.321657743, "te": 717278.525938338, "first_response_s": 1.647561670979485, "answer_total_s": 1.8518422660417855, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 270, "content_group": "544ab3293c2cd6028b2ee9d654af84174208da797ffca78b6a25f003283a783d", "question": {"question_id": "sample_270_a2164_q0", "video_id": 270, "video_path": "./videos/sample_270_real.mp4", "annotation_index": 2164, "question_index": 0, "question": "Where is the game character in the video standing right now?", "options": ["A. Standing in the middle of the highway.", "B. Standing at the entrance of Unit A's building.", "C. Standing on the mountain.", "D. Standing inside the house."], "answer": "B", "time_stamp_s": 10, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_270_a2164_q0", "video_id": 270, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3adea567cc2f011b834f1f0d518eb8e5c0aeacc7aca0a88f8175f5e29b4343e7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "be38ee6358ad5b02d0ecb93a38cf4b0b132ec5355ad5d27ee76c161313b10274", "num_recent_frames": 10, "tq": 715786.812268825, "t1": 715797.541124161, "ta": 715797.541124161, "te": 715797.761999278, "first_response_s": 10.728855335968547, "answer_total_s": 10.949730452965014, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_270_a2164_q0", "video_id": 270, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "03300e2ae8c846ef34e69f9e16fee3e4cf96cc7caca17b8baf3b507c631a083d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "be38ee6358ad5b02d0ecb93a38cf4b0b132ec5355ad5d27ee76c161313b10274", "num_recent_frames": 10, "tq": 715836.590452477, "t1": 715849.805868445, "ta": 715849.805868445, "te": 715850.006745586, "first_response_s": 13.215415967977606, "answer_total_s": 13.416293109068647, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 270, "content_group": "544ab3293c2cd6028b2ee9d654af84174208da797ffca78b6a25f003283a783d", "question": {"question_id": "sample_270_a2165_q0", "video_id": 270, "video_path": "./videos/sample_270_real.mp4", "annotation_index": 2165, "question_index": 0, "question": "What is the man doing right now?", "options": ["A. Sitting on the bench, observing the surroundings.", "B. Lowering himself to sit on the bench.", "C. Walking towards a wooden bench.", "D. Standing up from the bench and preparing to walk."], "answer": "D", "time_stamp_s": 171, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_270_a2165_q0", "video_id": 270, "time_stamp_s": 171, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0396259c5a2a5cfdaacb401ac989957e38eeaee81b6df7f7c46348e91ef52ce7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666], "recent_frames_sha256": "86549d802d5dd7ecad17b5492d5b8e068e0220fa2fafe348509f9953874e4e7f", "num_recent_frames": 30, "tq": 715797.784172964, "t1": 715805.054736573, "ta": 715805.054736573, "te": 715805.092282044, "first_response_s": 7.270563608966768, "answer_total_s": 7.308109079953283, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_270_a2165_q0", "video_id": 270, "time_stamp_s": 171, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f7f39cd7e5c7f8a0a583f8931215155168cfaf94d4cf8e596ff13107351225c2", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Player character walks through a suburban neighborhood with palm trees and apartment buildings, passing by a \"Casa de Apartamentos\" sign.  \n- Streamer in top-left corner reacts to gameplay, occasionally gesturing while wearing headphones.  \n- Chat overlay on right side displays viewer messages and reactions, including a \"SALUDOS\" message.\n[30-60s] - Player character in striped shirt walks on paved surface, facing away from camera, then turns to face forward.\n- In-game UI shows character stats, inventory, and chat window with viewer messages.\n- A small green object (possibly a weapon or tool) appears on the ground near the character's feet.\n[60-90s] - Player character walks on sidewalk, then opens inventory to select a weapon.  \n- A smartphone UI appears, showing app icons, and the player taps an app.  \n- Player character then holds a lit object (possibly a lighter or torch) while standing on the sidewalk.\n[90-120s] - Player character walks on sidewalk, then crosses street, with chat overlay visible.  \n- In-game menu shows character stats and inventory, including a \"Pistol\" item.  \n- Player character appears to be in a city environment with buildings and palm trees.\n[120-150s] - Player character in striped shirt runs along sidewalk, passing pedestrians and palm trees.  \n- A man in blue shirt walks toward player from opposite direction, then turns away.  \n- Player stops near yellow fire hydrant, facing street with traffic and buildings in background.", "history_tokens": 332, "history_utf8_bytes": 1482, "recent_frame_times_s": [141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666], "recent_frames_sha256": "86549d802d5dd7ecad17b5492d5b8e068e0220fa2fafe348509f9953874e4e7f", "num_recent_frames": 30, "tq": 715890.052464, "t1": 715891.64618968, "ta": 715891.64618968, "te": 715892.024500763, "first_response_s": 1.593725680024363, "answer_total_s": 1.9720367630943656, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 270, "content_group": "544ab3293c2cd6028b2ee9d654af84174208da797ffca78b6a25f003283a783d", "question": {"question_id": "sample_270_a2166_q0", "video_id": 270, "video_path": "./videos/sample_270_real.mp4", "annotation_index": 2166, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Selected \"DirectX Version\".", "B. Highlighted \"Pause Game On Focus Loss\".", "C. Changed \"Output Resolution\".", "D. Adjusted \"SETTINGS\"."], "answer": "D", "time_stamp_s": 325, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_270_a2166_q0", "video_id": 270, "time_stamp_s": 325, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a1da6725c33e8ce7b6f87405a89aaa2bd0abdc2798331bd54ee98555e312cbb6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333, 300.01638333333335, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0000166666667, 318.00101666666666, 319.0020166666667, 320.00301666666667, 321.00401666666664, 322.0050166666667, 323.00601666666665, 324.0070166666667], "recent_frames_sha256": "14ea707fcc01fe3bf9b2d390ac8403a04a274037187f20ce5be0f671e02e99ca", "num_recent_frames": 30, "tq": 715805.10315431, "t1": 715816.807319697, "ta": 715816.807319697, "te": 715816.844820886, "first_response_s": 11.704165386967361, "answer_total_s": 11.741666576010175, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_270_a2166_q0", "video_id": 270, "time_stamp_s": 325, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "15d40e4e79b4b38e5ec1e0b28af5cd46a4f8b8551ab5a7d025dadba827be679e", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Player character walks through a suburban neighborhood with palm trees and apartment buildings, passing by a \"Casa de Apartamentos\" sign.  \n- Streamer in top-left corner reacts to gameplay, occasionally gesturing while wearing headphones.  \n- Chat overlay on right side displays viewer messages and reactions, including a \"SALUDOS\" message.\n[30-60s] - Player character in striped shirt walks on paved surface, facing away from camera, then turns to face forward.\n- In-game UI shows character stats, inventory, and chat window with viewer messages.\n- A small green object (possibly a weapon or tool) appears on the ground near the character's feet.\n[60-90s] - Player character walks on sidewalk, then opens inventory to select a weapon.  \n- A smartphone UI appears, showing app icons, and the player taps an app.  \n- Player character then holds a lit object (possibly a lighter or torch) while standing on the sidewalk.\n[90-120s] - Player character walks on sidewalk, then crosses street, with chat overlay visible.  \n- In-game menu shows character stats and inventory, including a \"Pistol\" item.  \n- Player character appears to be in a city environment with buildings and palm trees.\n[120-150s] - Player character in striped shirt runs along sidewalk, passing pedestrians and palm trees.  \n- A man in blue shirt walks toward player from opposite direction, then turns away.  \n- Player stops near yellow fire hydrant, facing street with traffic and buildings in background.\n[150-180s] - Player character in striped shirt walks along sidewalk, approaches a bench, then sits down.  \n- A yellow taxi passes on the street, and a red mailbox is visible nearby.  \n- A man in a pink shirt walks toward the player, then turns away after approaching.\n[180-210s] - Player character walks across a street in a city environment, passing parked cars and buildings.  \n- In-game menu is open, showing \"Game\" settings with \"Graphics\" options like \"Render Distance\" and \"Population Density\" being adjusted.  \n- Streamer is visible in top-left corner, wearing headphones and looking at screen, with chat messages scrolling on right side.\n[210-240s] - Player adjusts game settings, specifically changing \"Vehicle Damage\" from \"Off\" to \"On\" in the \"Game\" tab.  \n- A warning alert appears, prompting the player to confirm if they want to keep new settings.  \n- After confirming, the player exits the settings menu and returns to the in-game environment, walking through a parking lot.\n[240-270s] - Player adjusts in-game settings menu, scrolling through options like \"Image Quality\" and \"Performance\" with slider controls visible.  \n- On-screen display shows \"Video Memory: 200 MB (1280 MB)\" and \"Performance: 100%\" indicating system resource usage.  \n- Chat window on right side displays real-time player interactions and messages, with a visible \"Stream\" tab active.\n[270-300s] - Player adjusts in-game settings, selecting \"Enable VSync\" and \"Enable Anti-Aliasing\" options.  \n- Game interface shows \"Video Settings\" with \"Resolution\" set to 1920x1080 and \"Frame Rate\" at 60 FPS.  \n- Player exits settings menu, returning to the game world where they walk along a sidewalk in a city environment.", "history_tokens": 751, "history_utf8_bytes": 3184, "recent_frame_times_s": [295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333, 300.01638333333335, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0000166666667, 318.00101666666666, 319.0020166666667, 320.00301666666667, 321.00401666666664, 322.0050166666667, 323.00601666666665, 324.0070166666667], "recent_frames_sha256": "14ea707fcc01fe3bf9b2d390ac8403a04a274037187f20ce5be0f671e02e99ca", "num_recent_frames": 30, "tq": 715927.973866184, "t1": 715929.505013855, "ta": 715929.505013855, "te": 715929.696439998, "first_response_s": 1.5311476710485294, "answer_total_s": 1.722573813982308, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 270, "content_group": "544ab3293c2cd6028b2ee9d654af84174208da797ffca78b6a25f003283a783d", "question": {"question_id": "sample_270_a2167_q0", "video_id": 270, "video_path": "./videos/sample_270_real.mp4", "annotation_index": 2167, "question_index": 0, "question": "What is the character doing right now?", "options": ["A. Walking along the sidewalk.", "B. Standing at an intersection.", "C. Climbing a building.", "D. Running along the sidewalk."], "answer": "D", "time_stamp_s": 480, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_270_a2167_q0", "video_id": 270, "time_stamp_s": 480, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dc67c5bb1eacba8e6de92982258d804ce66e01842b626da8187ec5d9e503c3c0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [450.01623333333333, 451.00055, 452.00155, 453.00255, 454.00355, 455.00455, 456.00555, 457.00655, 458.00755, 459.00855, 460.00955, 461.01055, 462.01155, 463.01255, 464.01355, 465.01455, 466.01555, 467.01655, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666], "recent_frames_sha256": "eb87037b4eb84bbd96902a798a4c570498f9e562407035583768788e790a31ed", "num_recent_frames": 30, "tq": 715816.8562259, "t1": 715829.153205709, "ta": 715829.153205709, "te": 715829.19140249, "first_response_s": 12.296979808947071, "answer_total_s": 12.33517659001518, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_270_a2167_q0", "video_id": 270, "time_stamp_s": 480, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "51e54ad60e32357bb98f3d7bb1527d054f24274492def6f81391e996c318357b", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Player character walks on sidewalk, then crosses street, with chat overlay visible.  \n- In-game menu shows character stats and inventory, including a \"Pistol\" item.  \n- Player character appears to be in a city environment with buildings and palm trees.\n[120-150s] - Player character in striped shirt runs along sidewalk, passing pedestrians and palm trees.  \n- A man in blue shirt walks toward player from opposite direction, then turns away.  \n- Player stops near yellow fire hydrant, facing street with traffic and buildings in background.\n[150-180s] - Player character in striped shirt walks along sidewalk, approaches a bench, then sits down.  \n- A yellow taxi passes on the street, and a red mailbox is visible nearby.  \n- A man in a pink shirt walks toward the player, then turns away after approaching.\n[180-210s] - Player character walks across a street in a city environment, passing parked cars and buildings.  \n- In-game menu is open, showing \"Game\" settings with \"Graphics\" options like \"Render Distance\" and \"Population Density\" being adjusted.  \n- Streamer is visible in top-left corner, wearing headphones and looking at screen, with chat messages scrolling on right side.\n[210-240s] - Player adjusts game settings, specifically changing \"Vehicle Damage\" from \"Off\" to \"On\" in the \"Game\" tab.  \n- A warning alert appears, prompting the player to confirm if they want to keep new settings.  \n- After confirming, the player exits the settings menu and returns to the in-game environment, walking through a parking lot.\n[240-270s] - Player adjusts in-game settings menu, scrolling through options like \"Image Quality\" and \"Performance\" with slider controls visible.  \n- On-screen display shows \"Video Memory: 200 MB (1280 MB)\" and \"Performance: 100%\" indicating system resource usage.  \n- Chat window on right side displays real-time player interactions and messages, with a visible \"Stream\" tab active.\n[270-300s] - Player adjusts in-game settings, selecting \"Enable VSync\" and \"Enable Anti-Aliasing\" options.  \n- Game interface shows \"Video Settings\" with \"Resolution\" set to 1920x1080 and \"Frame Rate\" at 60 FPS.  \n- Player exits settings menu, returning to the game world where they walk along a sidewalk in a city environment.\n[300-330s] - Player character in striped shirt runs along sidewalk, passing parked cars and pedestrians.  \n- Streamer in inset view wears beige hoodie and cap, observing gameplay.  \n- Game UI shows chat window and settings menu, with \"Population Density\" slider being adjusted.\n[330-360s] - A man in a white shirt is visible in the top-left corner, smiling and looking at the screen.  \n- The game's settings menu is open, with the \"Graphics\" tab selected and various options like \"Anti-Aliasing\" and \"Texture Quality\" visible.  \n- The \"High Detail\" option is highlighted in the settings menu, indicating it is currently selected or being adjusted.\n[360-390s] - Player is in game menu, adjusting \"Graphics\" settings, specifically selecting \"High\" for \"Graphics Quality\" at 360.5s.  \n- Menu overlay shows \"Video Settings\" with \"Resolution\" set to \"1920x1080\" and \"VSync\" toggled off.  \n- Chat window on right side displays viewer messages, including \"ALERT\" at 375s.\n[390-420s] - Player character walks away from a street corner, passing trash bins and a parked car.  \n- A female NPC walks toward the player from the opposite direction on the sidewalk.  \n- The game's settings menu is open, with \"Video Settings\" and \"Performance\" options visible on screen.\n[420-450s] - Player character walks along a sidewalk, wearing a blue and white striped shirt and light-colored shorts.  \n- A red car passes on the road to the left, while a yellow taxi and other vehicles are visible in the background.  \n- A pedestrian in a red outfit walks toward the player from the right side of the sidewalk.\n[450-480s] - Player character in striped shirt runs away from two pedestrians on sidewalk near palm trees.  \n- Game UI overlay shows map and settings menu, with \"ALERT\" message indicating unsaved changes.  \n- Streamer visible in top-left corner, reacting to gameplay while chat messages scroll on right.", "history_tokens": 1009, "history_utf8_bytes": 4144, "recent_frame_times_s": [450.01623333333333, 451.00055, 452.00155, 453.00255, 454.00355, 455.00455, 456.00555, 457.00655, 458.00755, 459.00855, 460.00955, 461.01055, 462.01155, 463.01255, 464.01355, 465.01455, 466.01555, 467.01655, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666], "recent_frames_sha256": "eb87037b4eb84bbd96902a798a4c570498f9e562407035583768788e790a31ed", "num_recent_frames": 30, "tq": 715970.615535234, "t1": 715977.097102697, "ta": 715977.097102697, "te": 715977.136505326, "first_response_s": 6.481567463022657, "answer_total_s": 6.520970092038624, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 270, "content_group": "544ab3293c2cd6028b2ee9d654af84174208da797ffca78b6a25f003283a783d", "question": {"question_id": "sample_270_a2168_q0", "video_id": 270, "video_path": "./videos/sample_270_real.mp4", "annotation_index": 2168, "question_index": 0, "question": "What is the position of the person in the white and blue striped short-sleeved shirt right now?", "options": ["A. Standing on a concrete sidewalk near a busy crossroads.", "B. Standing in the middle of the road under elevated highways.", "C. Standing next to a palm tree on the side of the road.", "D. Standing on a grassy area near the intersection."], "answer": "A", "time_stamp_s": 603, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_270_a2168_q0", "video_id": 270, "time_stamp_s": 603, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a96d4eda55159f102e75b6859a35637d9151a94b15c7948a92983cfb17893cd4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [573.0057666666667, 574.0067666666666, 575.0077666666666, 576.0087666666667, 577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0000833333334, 585.0010833333333, 586.0020833333333, 587.0030833333333, 588.0040833333334, 589.0050833333333, 590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014], "recent_frames_sha256": "255aae0b74552a9ba20b507d2206d6661f5e45338cd5f2f8600c8e048edca1f2", "num_recent_frames": 30, "tq": 715829.203136817, "t1": 715836.547113761, "ta": 715836.547113761, "te": 715836.584440827, "first_response_s": 7.34397694398649, "answer_total_s": 7.381304010050371, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_270_a2168_q0", "video_id": 270, "time_stamp_s": 603, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dac1b519f0081a5a3f8be2b1335d95f402767bccbf18024a377c3acd099fb9b6", "condition_order": ["recent", "notes"], "memory": "[240-270s] - Player adjusts in-game settings menu, scrolling through options like \"Image Quality\" and \"Performance\" with slider controls visible.  \n- On-screen display shows \"Video Memory: 200 MB (1280 MB)\" and \"Performance: 100%\" indicating system resource usage.  \n- Chat window on right side displays real-time player interactions and messages, with a visible \"Stream\" tab active.\n[270-300s] - Player adjusts in-game settings, selecting \"Enable VSync\" and \"Enable Anti-Aliasing\" options.  \n- Game interface shows \"Video Settings\" with \"Resolution\" set to 1920x1080 and \"Frame Rate\" at 60 FPS.  \n- Player exits settings menu, returning to the game world where they walk along a sidewalk in a city environment.\n[300-330s] - Player character in striped shirt runs along sidewalk, passing parked cars and pedestrians.  \n- Streamer in inset view wears beige hoodie and cap, observing gameplay.  \n- Game UI shows chat window and settings menu, with \"Population Density\" slider being adjusted.\n[330-360s] - A man in a white shirt is visible in the top-left corner, smiling and looking at the screen.  \n- The game's settings menu is open, with the \"Graphics\" tab selected and various options like \"Anti-Aliasing\" and \"Texture Quality\" visible.  \n- The \"High Detail\" option is highlighted in the settings menu, indicating it is currently selected or being adjusted.\n[360-390s] - Player is in game menu, adjusting \"Graphics\" settings, specifically selecting \"High\" for \"Graphics Quality\" at 360.5s.  \n- Menu overlay shows \"Video Settings\" with \"Resolution\" set to \"1920x1080\" and \"VSync\" toggled off.  \n- Chat window on right side displays viewer messages, including \"ALERT\" at 375s.\n[390-420s] - Player character walks away from a street corner, passing trash bins and a parked car.  \n- A female NPC walks toward the player from the opposite direction on the sidewalk.  \n- The game's settings menu is open, with \"Video Settings\" and \"Performance\" options visible on screen.\n[420-450s] - Player character walks along a sidewalk, wearing a blue and white striped shirt and light-colored shorts.  \n- A red car passes on the road to the left, while a yellow taxi and other vehicles are visible in the background.  \n- A pedestrian in a red outfit walks toward the player from the right side of the sidewalk.\n[450-480s] - Player character in striped shirt runs away from two pedestrians on sidewalk near palm trees.  \n- Game UI overlay shows map and settings menu, with \"ALERT\" message indicating unsaved changes.  \n- Streamer visible in top-left corner, reacting to gameplay while chat messages scroll on right.\n[480-510s] - Player character in GTA V is seen running on a sidewalk near a highway, with a large bridge and palm trees in the background.\n- The player opens an inventory screen, showing various items like a knife, a bottle, and a health pack, with a health bar and stamina indicator visible.\n- The player then exits the inventory and holds a smartphone, displaying a home screen with app icons, while standing on the sidewalk.\n[510-540s] - In-game character stands on concrete, wearing striped shirt and shorts, holding a phone.  \n- Game UI shows character stats and a list of vehicles on the right.  \n- Overlay displays a live streamer’s face in top-left corner, with a Twitter app interface appearing on the phone screen.\n[540-570s] - In-game character stands on concrete, holding a phone, with palm trees and a bridge in the background.\n- On-screen overlay shows a live streamer's face in the top-left corner, and a Twitter app interface on the right.\n- Phone screen transitions from Twitter to a home screen with app icons, then to a \"Documents\" folder, indicating user interaction.\n[570-600s] - Player character in GTA V stands on concrete, facing away, holding a phone.  \n- A black car drives past on the road behind the player.  \n- On-screen phone interface shows app icons and a clock reading 10:47.", "history_tokens": 963, "history_utf8_bytes": 3911, "recent_frame_times_s": [573.0057666666667, 574.0067666666666, 575.0077666666666, 576.0087666666667, 577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0000833333334, 585.0010833333333, 586.0020833333333, 587.0030833333333, 588.0040833333334, 589.0050833333333, 590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014], "recent_frames_sha256": "255aae0b74552a9ba20b507d2206d6661f5e45338cd5f2f8600c8e048edca1f2", "num_recent_frames": 30, "tq": 716012.933842657, "t1": 716020.209208873, "ta": 716020.209208873, "te": 716020.395699577, "first_response_s": 7.275366215966642, "answer_total_s": 7.461856920039281, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 271, "content_group": "15e8c5c2aa41aeeb38ba39d0a71602b0a5de20234115366da2b4ac9468b96dc9", "question": {"question_id": "sample_271_a291_q0", "video_id": 271, "video_path": "./videos/sample_271_real.mp4", "annotation_index": 291, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Sit down on a bench.", "B. Running along the sidewalk.", "C. Taking a photograph.", "D. Turning around."], "answer": "B", "time_stamp_s": 14, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_271_a291_q0", "video_id": 271, "time_stamp_s": 14, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a3a2619fa86b17a314b4581efa59581f5b5e5e3dece16a9174ecaf802e995de4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.034, 1.0016333333333334, 2.0026333333333333, 3.003633333333333, 4.0046333333333335, 5.005633333333333, 6.006633333333333, 7.007633333333334, 8.008633333333334, 9.009633333333333, 10.010633333333333, 11.011633333333334, 12.012633333333333, 13.013633333333333], "recent_frames_sha256": "22702623b9accebcfc92d51a553b6162f1c489d71cb18823e2f76ac52357c60b", "num_recent_frames": 14, "tq": 710641.524341222, "t1": 710646.914085858, "ta": 710646.914085858, "te": 710646.952427899, "first_response_s": 5.389744636020623, "answer_total_s": 5.428086676984094, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_271_a291_q0", "video_id": 271, "time_stamp_s": 14, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dc0e872cf67f8edcb452375d5384190bba1370ab725bbf7436331f706641e12f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.034, 1.0016333333333334, 2.0026333333333333, 3.003633333333333, 4.0046333333333335, 5.005633333333333, 6.006633333333333, 7.007633333333334, 8.008633333333334, 9.009633333333333, 10.010633333333333, 11.011633333333334, 12.012633333333333, 13.013633333333333], "recent_frames_sha256": "22702623b9accebcfc92d51a553b6162f1c489d71cb18823e2f76ac52357c60b", "num_recent_frames": 14, "tq": 710698.384388403, "t1": 710704.543464276, "ta": 710704.543464276, "te": 710704.583454713, "first_response_s": 6.159075872972608, "answer_total_s": 6.199066309956834, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 271, "content_group": "15e8c5c2aa41aeeb38ba39d0a71602b0a5de20234115366da2b4ac9468b96dc9", "question": {"question_id": "sample_271_a292_q0", "video_id": 271, "video_path": "./videos/sample_271_real.mp4", "annotation_index": 292, "question_index": 0, "question": "What is located to the right of the person right now?", "options": ["A. A blue construction wall.", "B. A blue car.", "C. A crosswalk.", "D. City buildings with advertisements."], "answer": "B", "time_stamp_s": 177, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_271_a292_q0", "video_id": 271, "time_stamp_s": 177, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "694b5ec09f9f94dd1f7bc47ffb002a9d699ee33af41962b814e5498889be8551", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [147.01416666666665, 148.01516666666666, 149.01616666666666, 150.00048333333334, 151.00148333333334, 152.00248333333334, 153.00348333333332, 154.00448333333333, 155.00548333333333, 156.00648333333334, 157.00748333333334, 158.00848333333334, 159.00948333333332, 160.01048333333333, 161.01148333333333, 162.01248333333334, 163.01348333333334, 164.01448333333335, 165.01548333333332, 166.01648333333333, 167.0008, 168.0018, 169.0028, 170.0038, 171.0048, 172.0058, 173.0068, 174.0078, 175.0088, 176.0098], "recent_frames_sha256": "bcbb18097663168a2e40c1af924d00560ccbf746cba96320fb2a3b394889ded0", "num_recent_frames": 30, "tq": 710646.967235449, "t1": 710660.045304271, "ta": 710660.045304271, "te": 710660.083690782, "first_response_s": 13.078068822040223, "answer_total_s": 13.11645533295814, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_271_a292_q0", "video_id": 271, "time_stamp_s": 177, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bc8e26cbaee9c2ab2889ca20f50ef70402bc5ac06333b88943120707721bc826", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A child in a striped shirt runs along a sidewalk under an overpass, moving away from the camera.  \n- A male character in a beige shirt is visible in a small inset window, appearing to watch the gameplay.  \n- A white car and a dark sedan pass by on the road adjacent to the sidewalk, while a red car is seen further ahead.\n[30-60s] - Player in striped shirt runs along sidewalk, passing trees and urban structures.  \n- Pedestrians and vehicles visible in background; player crosses street at intersection.  \n- Chat overlay shows viewer interactions and game-related messages.\n[60-90s] - Player character in striped shirt runs up concrete stairs toward a blue wall, then turns right onto a paved path.  \n- A red \"TRANSTAS METRO\" sign is visible on the left as the character moves past it.  \n- The character continues walking along a sidewalk with a train track and urban buildings in the background.\n[90-120s] - Player character in GTA V runs along a city street, passing storefronts like \"Liquor\" and \"Dollar Tree\" while wearing a striped shirt.  \n- Map view shows a purple route being followed, with various icons and a list of player names on the right side of the screen.  \n- The player approaches a building entrance, with a red car visible on the road ahead.\n[120-150s] - A player character in a striped shirt runs along a sidewalk past a \"Coca-Cola\" sign, then approaches a parked orange sports car.  \n- The character stops near the car, which is positioned on the street beside a curb, with a silver sedan and a pink car visible in the background.  \n- The character’s view shifts to focus on the orange car’s front, showing its glossy finish and license plate, while the game’s UI remains visible on the right.", "history_tokens": 402, "history_utf8_bytes": 1732, "recent_frame_times_s": [147.01416666666665, 148.01516666666666, 149.01616666666666, 150.00048333333334, 151.00148333333334, 152.00248333333334, 153.00348333333332, 154.00448333333333, 155.00548333333333, 156.00648333333334, 157.00748333333334, 158.00848333333334, 159.00948333333332, 160.01048333333333, 161.01148333333333, 162.01248333333334, 163.01348333333334, 164.01448333333335, 165.01548333333332, 166.01648333333333, 167.0008, 168.0018, 169.0028, 170.0038, 171.0048, 172.0058, 173.0068, 174.0078, 175.0088, 176.0098], "recent_frames_sha256": "bcbb18097663168a2e40c1af924d00560ccbf746cba96320fb2a3b394889ded0", "num_recent_frames": 30, "tq": 710748.573737552, "t1": 710755.225679432, "ta": 710755.225679432, "te": 710755.430330491, "first_response_s": 6.6519418800016865, "answer_total_s": 6.856592939002439, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 271, "content_group": "15e8c5c2aa41aeeb38ba39d0a71602b0a5de20234115366da2b4ac9468b96dc9", "question": {"question_id": "sample_271_a293_q0", "video_id": 271, "video_path": "./videos/sample_271_real.mp4", "annotation_index": 293, "question_index": 0, "question": "What is located near the entrance of the building right now?", "options": ["A. A blue and white booth.", "B. Two potted plants.", "C. A small kiosk.", "D. A security camera."], "answer": "B", "time_stamp_s": 323, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_271_a293_q0", "video_id": 271, "time_stamp_s": 323, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ef83dd01e5c4912dfb3a5d07c4512d817fecf4c2c32773009735c9b3f07f6fcb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [293.0100166666667, 294.01101666666665, 295.0120166666667, 296.01301666666666, 297.0140166666667, 298.01501666666667, 299.01601666666664, 300.00033333333334, 301.0013333333333, 302.00233333333335, 303.00333333333333, 304.0043333333333, 305.00533333333334, 306.0063333333333, 307.00733333333335, 308.0083333333333, 309.00933333333336, 310.01033333333334, 311.0113333333333, 312.01233333333334, 313.0133333333333, 314.01433333333335, 315.01533333333333, 316.0163333333333, 317.00065, 318.00165, 319.00265, 320.00365, 321.00465, 322.00565], "recent_frames_sha256": "64045015c417086ddcefdf58357b8b6fbb8104ec8303e25992ab8f1444da460f", "num_recent_frames": 30, "tq": 710660.103090419, "t1": 710673.915928837, "ta": 710673.915928837, "te": 710673.955144285, "first_response_s": 13.812838418059982, "answer_total_s": 13.852053866023198, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_271_a293_q0", "video_id": 271, "time_stamp_s": 323, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "70d41d187bfaa2907cc7ebfd4048c3df99ee0cd48f8ea4deb68426d1e4af2def", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A child in a striped shirt runs along a sidewalk under an overpass, moving away from the camera.  \n- A male character in a beige shirt is visible in a small inset window, appearing to watch the gameplay.  \n- A white car and a dark sedan pass by on the road adjacent to the sidewalk, while a red car is seen further ahead.\n[30-60s] - Player in striped shirt runs along sidewalk, passing trees and urban structures.  \n- Pedestrians and vehicles visible in background; player crosses street at intersection.  \n- Chat overlay shows viewer interactions and game-related messages.\n[60-90s] - Player character in striped shirt runs up concrete stairs toward a blue wall, then turns right onto a paved path.  \n- A red \"TRANSTAS METRO\" sign is visible on the left as the character moves past it.  \n- The character continues walking along a sidewalk with a train track and urban buildings in the background.\n[90-120s] - Player character in GTA V runs along a city street, passing storefronts like \"Liquor\" and \"Dollar Tree\" while wearing a striped shirt.  \n- Map view shows a purple route being followed, with various icons and a list of player names on the right side of the screen.  \n- The player approaches a building entrance, with a red car visible on the road ahead.\n[120-150s] - A player character in a striped shirt runs along a sidewalk past a \"Coca-Cola\" sign, then approaches a parked orange sports car.  \n- The character stops near the car, which is positioned on the street beside a curb, with a silver sedan and a pink car visible in the background.  \n- The character’s view shifts to focus on the orange car’s front, showing its glossy finish and license plate, while the game’s UI remains visible on the right.\n[150-180s] - A child in a striped shirt runs along a sidewalk next to a blue wall, passing parked cars and crossing a street.  \n- A blue Tesla Model S drives past the child, followed by a white sedan, as the child continues running.  \n- The child approaches a crosswalk, then turns left onto a road with traffic, while a black car passes on the right.\n[180-210s] - Player character in striped shirt runs toward a building entrance, then enters a garage with checkered floor.\n- A vending machine is visible near the entrance, with a green light indicating it's operational.\n- The player character approaches the vending machine, preparing to interact with it.\n[210-240s] - Player character in striped shirt runs from a garage toward a street, passing a \"LS CO\" sign.  \n- Player enters a red building with yellow signs, then accesses in-game menu to adjust key bindings.  \n- On-screen UI shows \"Key Settings\" menu with options like \"Move,\" \"Look,\" and \"Jump,\" indicating customization.\n[240-270s] - Player adjusts in-game settings, specifically audio levels for voice chat and microphone, while seated in a gaming setup.  \n- The game's interface displays a \"STATS\" tab with real-time player data, including \"Live 300\" and \"Live 300\" metrics.  \n- A chat window on the right side shows active player interactions, with a small inset video of a player's face visible in the bottom left corner.\n[270-300s] - Player character views weapon selection menu, highlighting different firearms like \"M9\" and \"M1911\" with stats displayed.  \n- Store clerk stands behind counter, facing player, with a \"THANKS FOR VISITING\" sign visible above the exit.  \n- Player character walks toward the exit after browsing weapons, passing display cases with various firearms.", "history_tokens": 819, "history_utf8_bytes": 3480, "recent_frame_times_s": [293.0100166666667, 294.01101666666665, 295.0120166666667, 296.01301666666666, 297.0140166666667, 298.01501666666667, 299.01601666666664, 300.00033333333334, 301.0013333333333, 302.00233333333335, 303.00333333333333, 304.0043333333333, 305.00533333333334, 306.0063333333333, 307.00733333333335, 308.0083333333333, 309.00933333333336, 310.01033333333334, 311.0113333333333, 312.01233333333334, 313.0133333333333, 314.01433333333335, 315.01533333333333, 316.0163333333333, 317.00065, 318.00165, 319.00265, 320.00365, 321.00465, 322.00565], "recent_frames_sha256": "64045015c417086ddcefdf58357b8b6fbb8104ec8303e25992ab8f1444da460f", "num_recent_frames": 30, "tq": 715186.824733865, "t1": 715189.047552545, "ta": 715189.047552545, "te": 715189.091303915, "first_response_s": 2.222818679991178, "answer_total_s": 2.2665700500365347, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 271, "content_group": "15e8c5c2aa41aeeb38ba39d0a71602b0a5de20234115366da2b4ac9468b96dc9", "question": {"question_id": "sample_271_a294_q0", "video_id": 271, "video_path": "./videos/sample_271_real.mp4", "annotation_index": 294, "question_index": 0, "question": "What is located to the right of the runner as they approach the bridge?", "options": ["A. A blue construction wall.", "B. A red wall.", "C. A pedestrian crossing signal.", "D. A black car."], "answer": "B", "time_stamp_s": 495, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_271_a294_q0", "video_id": 271, "time_stamp_s": 495, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "74dbb7bf946968c85c385edb2d13a920bb47f23ee3d395bb2723c1ed10ee278d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [465.0151833333333, 466.01618333333334, 467.0005, 468.0015, 469.0025, 470.0035, 471.0045, 472.0055, 473.0065, 474.0075, 475.0085, 476.0095, 477.0105, 478.0115, 479.0125, 480.0135, 481.0145, 482.0155, 483.0165, 484.00081666666665, 485.0018166666667, 486.00281666666666, 487.0038166666667, 488.00481666666667, 489.00581666666665, 490.0068166666667, 491.00781666666666, 492.0088166666667, 493.00981666666667, 494.01081666666664], "recent_frames_sha256": "6df0898c0b269337053ef948439ce9b5d489c1e2bfa00c08fa7e70e044d8a3bb", "num_recent_frames": 30, "tq": 710673.98130655, "t1": 710686.96136153, "ta": 710686.96136153, "te": 710687.004103436, "first_response_s": 12.98005498002749, "answer_total_s": 13.02279688604176, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_271_a294_q0", "video_id": 271, "time_stamp_s": 495, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "cb67c82a882991f112336330929fad204af417014c0d6cede49d6ec0de581705", "condition_order": ["recent", "notes"], "memory": "[120-150s] - A player character in a striped shirt runs along a sidewalk past a \"Coca-Cola\" sign, then approaches a parked orange sports car.  \n- The character stops near the car, which is positioned on the street beside a curb, with a silver sedan and a pink car visible in the background.  \n- The character’s view shifts to focus on the orange car’s front, showing its glossy finish and license plate, while the game’s UI remains visible on the right.\n[150-180s] - A child in a striped shirt runs along a sidewalk next to a blue wall, passing parked cars and crossing a street.  \n- A blue Tesla Model S drives past the child, followed by a white sedan, as the child continues running.  \n- The child approaches a crosswalk, then turns left onto a road with traffic, while a black car passes on the right.\n[180-210s] - Player character in striped shirt runs toward a building entrance, then enters a garage with checkered floor.\n- A vending machine is visible near the entrance, with a green light indicating it's operational.\n- The player character approaches the vending machine, preparing to interact with it.\n[210-240s] - Player character in striped shirt runs from a garage toward a street, passing a \"LS CO\" sign.  \n- Player enters a red building with yellow signs, then accesses in-game menu to adjust key bindings.  \n- On-screen UI shows \"Key Settings\" menu with options like \"Move,\" \"Look,\" and \"Jump,\" indicating customization.\n[240-270s] - Player adjusts in-game settings, specifically audio levels for voice chat and microphone, while seated in a gaming setup.  \n- The game's interface displays a \"STATS\" tab with real-time player data, including \"Live 300\" and \"Live 300\" metrics.  \n- A chat window on the right side shows active player interactions, with a small inset video of a player's face visible in the bottom left corner.\n[270-300s] - Player character views weapon selection menu, highlighting different firearms like \"M9\" and \"M1911\" with stats displayed.  \n- Store clerk stands behind counter, facing player, with a \"THANKS FOR VISITING\" sign visible above the exit.  \n- Player character walks toward the exit after browsing weapons, passing display cases with various firearms.\n[300-330s] - Player character in blue-and-white striped shirt runs across a city street, dodging cars and debris.  \n- A large billboard with a man's face is visible on the left side of the screen.  \n- The player approaches a parking lot entrance marked \"24 PARKING\" and enters a gated area.\n[330-360s] - Player character in striped shirt runs across a city street, passing a \"PRIVATE\" marked parking lot.  \n- A pedestrian in a pink top and shorts walks alongside the player, then exits the frame.  \n- Player approaches a building with a yellow \"WILDFIRE\" sign, then turns right onto a brick-paved sidewalk.\n[360-390s] - Player character in striped shirt runs across a paved area near a bridge, then proceeds along a highway.\n- In-game map displayed shows a purple route, indicating planned travel path through urban areas.\n- Player character approaches a street intersection with traffic signs and vehicles visible in the background.\n[390-420s] - Player character walks along a bridge's edge, moving away from the camera, with a striped shirt and shorts.\n- The environment shows urban infrastructure, including traffic, construction barriers, and distant buildings.\n- A live stream overlay displays a streamer's face in the top-left corner, with chat messages scrolling on the right.\n[420-450s] - A child character in a striped shirt runs across a road, then onto train tracks, continuing forward.  \n- The character later runs onto a concrete platform beside the tracks, then proceeds onto a dark, paved area with large metal structures.  \n- The character’s movement is continuous, transitioning from open road to train tracks to a platform, with no visible interaction with other entities.\n[450-480s] - Player character in striped shirt runs across a street, passing a construction site with blue barriers.  \n- A black car is visible on the road ahead, moving in the same direction as the player.  \n- The player approaches a sidewalk with scattered red objects, possibly trash or debris, near a building with a \"Diet Coke\" sign.", "history_tokens": 980, "history_utf8_bytes": 4239, "recent_frame_times_s": [465.0151833333333, 466.01618333333334, 467.0005, 468.0015, 469.0025, 470.0035, 471.0045, 472.0055, 473.0065, 474.0075, 475.0085, 476.0095, 477.0105, 478.0115, 479.0125, 480.0135, 481.0145, 482.0155, 483.0165, 484.00081666666665, 485.0018166666667, 486.00281666666666, 487.0038166666667, 488.00481666666667, 489.00581666666665, 490.0068166666667, 491.00781666666666, 492.0088166666667, 493.00981666666667, 494.01081666666664], "recent_frames_sha256": "6df0898c0b269337053ef948439ce9b5d489c1e2bfa00c08fa7e70e044d8a3bb", "num_recent_frames": 30, "tq": 715229.687668704, "t1": 715235.475585196, "ta": 715235.475585196, "te": 715235.714677287, "first_response_s": 5.787916492088698, "answer_total_s": 6.02700858307071, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 271, "content_group": "15e8c5c2aa41aeeb38ba39d0a71602b0a5de20234115366da2b4ac9468b96dc9", "question": {"question_id": "sample_271_a295_q0", "video_id": 271, "video_path": "./videos/sample_271_real.mp4", "annotation_index": 295, "question_index": 0, "question": "What is the position of the greenery in relation to the character right now?", "options": ["A. On the left side.", "B. On both sides.", "C. Behind the character.", "D. In front of the character."], "answer": "B", "time_stamp_s": 602, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_271_a295_q0", "video_id": 271, "time_stamp_s": 602, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d759224d70a005e30ae031bf60239607f49c1d3101c8497830c2dda4f66d8204", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [572.0054, 573.0064, 574.0074, 575.0084, 576.0094, 577.0104, 578.0114, 579.0124, 580.0134, 581.0144, 582.0154, 583.0164, 584.0007166666667, 585.0017166666667, 586.0027166666666, 587.0037166666667, 588.0047166666667, 589.0057166666667, 590.0067166666666, 591.0077166666666, 592.0087166666667, 593.0097166666667, 594.0107166666667, 595.0117166666666, 596.0127166666666, 597.0137166666667, 598.0147166666667, 599.0157166666667, 600.0000333333334, 601.0010333333333], "recent_frames_sha256": "0e497f6de4bebdd6d7f417e2c09b2c019c404d752c8b28375fbc770730eca70b", "num_recent_frames": 30, "tq": 710687.011156339, "t1": 710698.326547559, "ta": 710698.326547559, "te": 710698.36464347, "first_response_s": 11.315391220035963, "answer_total_s": 11.353487131069414, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_271_a295_q0", "video_id": 271, "time_stamp_s": 602, "ground_truth": "B", "raw_output": "A. On the left side.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "f8bddb715fc519c08b8e612aef117e5b0da8d99f30e3d8ee4a53cfea6b451e44", "condition_order": ["recent", "notes"], "memory": "[210-240s] - Player character in striped shirt runs from a garage toward a street, passing a \"LS CO\" sign.  \n- Player enters a red building with yellow signs, then accesses in-game menu to adjust key bindings.  \n- On-screen UI shows \"Key Settings\" menu with options like \"Move,\" \"Look,\" and \"Jump,\" indicating customization.\n[240-270s] - Player adjusts in-game settings, specifically audio levels for voice chat and microphone, while seated in a gaming setup.  \n- The game's interface displays a \"STATS\" tab with real-time player data, including \"Live 300\" and \"Live 300\" metrics.  \n- A chat window on the right side shows active player interactions, with a small inset video of a player's face visible in the bottom left corner.\n[270-300s] - Player character views weapon selection menu, highlighting different firearms like \"M9\" and \"M1911\" with stats displayed.  \n- Store clerk stands behind counter, facing player, with a \"THANKS FOR VISITING\" sign visible above the exit.  \n- Player character walks toward the exit after browsing weapons, passing display cases with various firearms.\n[300-330s] - Player character in blue-and-white striped shirt runs across a city street, dodging cars and debris.  \n- A large billboard with a man's face is visible on the left side of the screen.  \n- The player approaches a parking lot entrance marked \"24 PARKING\" and enters a gated area.\n[330-360s] - Player character in striped shirt runs across a city street, passing a \"PRIVATE\" marked parking lot.  \n- A pedestrian in a pink top and shorts walks alongside the player, then exits the frame.  \n- Player approaches a building with a yellow \"WILDFIRE\" sign, then turns right onto a brick-paved sidewalk.\n[360-390s] - Player character in striped shirt runs across a paved area near a bridge, then proceeds along a highway.\n- In-game map displayed shows a purple route, indicating planned travel path through urban areas.\n- Player character approaches a street intersection with traffic signs and vehicles visible in the background.\n[390-420s] - Player character walks along a bridge's edge, moving away from the camera, with a striped shirt and shorts.\n- The environment shows urban infrastructure, including traffic, construction barriers, and distant buildings.\n- A live stream overlay displays a streamer's face in the top-left corner, with chat messages scrolling on the right.\n[420-450s] - A child character in a striped shirt runs across a road, then onto train tracks, continuing forward.  \n- The character later runs onto a concrete platform beside the tracks, then proceeds onto a dark, paved area with large metal structures.  \n- The character’s movement is continuous, transitioning from open road to train tracks to a platform, with no visible interaction with other entities.\n[450-480s] - Player character in striped shirt runs across a street, passing a construction site with blue barriers.  \n- A black car is visible on the road ahead, moving in the same direction as the player.  \n- The player approaches a sidewalk with scattered red objects, possibly trash or debris, near a building with a \"Diet Coke\" sign.\n[480-510s] - Player character runs along a sidewalk, wearing a striped shirt and shorts, moving away from a blue wall.  \n- A black car passes on the adjacent road, while the player continues running past traffic lights and palm trees.  \n- The player approaches a crosswalk, then turns right onto a different sidewalk, with a red curb and street signs visible.\n[510-540s] - A child character in a striped shirt runs along a sidewalk under an overpass, moving away from the camera.  \n- The environment features palm trees, urban buildings, and scattered debris on the pavement.  \n- A live stream overlay shows a smiling streamer in a small window, with chat messages scrolling on the right side of the screen.\n[540-570s] - Player character runs along a sidewalk, wearing a striped shirt and white shorts, moving away from a concrete wall.  \n- A yellow pedestrian crossing sign is visible ahead, and the character approaches a street intersection.  \n- A dark SUV passes on the road to the right as the character continues running toward the intersection.\n[570-600s] - Player character in striped shirt runs along sidewalk, passing storefronts and trees.  \n- A blue sports car drives past on the road, then stops near a crosswalk.  \n- Player character crosses the street at the crosswalk, approaching the stopped car.", "history_tokens": 1018, "history_utf8_bytes": 4434, "recent_frame_times_s": [572.0054, 573.0064, 574.0074, 575.0084, 576.0094, 577.0104, 578.0114, 579.0124, 580.0134, 581.0144, 582.0154, 583.0164, 584.0007166666667, 585.0017166666667, 586.0027166666666, 587.0037166666667, 588.0047166666667, 589.0057166666667, 590.0067166666666, 591.0077166666666, 592.0087166666667, 593.0097166666667, 594.0107166666667, 595.0117166666666, 596.0127166666666, 597.0137166666667, 598.0147166666667, 599.0157166666667, 600.0000333333334, 601.0010333333333], "recent_frames_sha256": "0e497f6de4bebdd6d7f417e2c09b2c019c404d752c8b28375fbc770730eca70b", "num_recent_frames": 30, "tq": 715265.368617739, "t1": 715266.898204004, "ta": 715266.898204004, "te": 715267.177435023, "first_response_s": 1.529586265096441, "answer_total_s": 1.8088172840652987, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 272, "content_group": "d365fae4dfbc424c7bf95bbc2e32132a70912d23093f9e5fee3428bb6811b1da", "question": {"question_id": "sample_272_a898_q0", "video_id": 272, "video_path": "./videos/sample_272_real.mp4", "annotation_index": 898, "question_index": 0, "question": "What did the person wearing a striped shirt do just now?", "options": ["A. Grabbed a trash can.", "B. Stopped to tie their shoelaces.", "C. Engaged in a conversation with the pedestrian.", "D. Ran closer to the pedestrian."], "answer": "D", "time_stamp_s": 20, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_272_a898_q0", "video_id": 272, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ce08ce58d92ea3d34fc5d2b17973c5fee06d0a0555545bd7b7f32fea91475dfc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.019, 1.0033166666666666, 2.0043166666666665, 3.005316666666667, 4.006316666666667, 5.007316666666667, 6.0083166666666665, 7.009316666666667, 8.010316666666666, 9.011316666666668, 10.012316666666667, 11.013316666666666, 12.014316666666666, 13.015316666666667, 14.016316666666667, 15.000633333333333, 16.001633333333334, 17.002633333333332, 18.003633333333333, 19.004633333333334], "recent_frames_sha256": "27f1d8b676eb402beeb19a5987b0eccb2b414d50eaaa81d6c967819078cb6448", "num_recent_frames": 20, "tq": 718107.925563833, "t1": 718119.288091172, "ta": 718119.288091172, "te": 718119.325769373, "first_response_s": 11.362527339020744, "answer_total_s": 11.400205540005118, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_272_a898_q0", "video_id": 272, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "42f9c0101bef04218c722b79e28e3490298840442ff7443dace577bbf8a7eabd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.019, 1.0033166666666666, 2.0043166666666665, 3.005316666666667, 4.006316666666667, 5.007316666666667, 6.0083166666666665, 7.009316666666667, 8.010316666666666, 9.011316666666668, 10.012316666666667, 11.013316666666666, 12.014316666666666, 13.015316666666667, 14.016316666666667, 15.000633333333333, 16.001633333333334, 17.002633333333332, 18.003633333333333, 19.004633333333334], "recent_frames_sha256": "27f1d8b676eb402beeb19a5987b0eccb2b414d50eaaa81d6c967819078cb6448", "num_recent_frames": 20, "tq": 717941.098056598, "t1": 717947.971450774, "ta": 717947.971450774, "te": 717948.126925361, "first_response_s": 6.873394176014699, "answer_total_s": 7.028868763009086, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 272, "content_group": "d365fae4dfbc424c7bf95bbc2e32132a70912d23093f9e5fee3428bb6811b1da", "question": {"question_id": "sample_272_a899_q0", "video_id": 272, "video_path": "./videos/sample_272_real.mp4", "annotation_index": 899, "question_index": 0, "question": "What is the relationship between the fire hydrant and the two characters standing near the palm tree?", "options": ["A. The fire hydrant is in front of them.", "B. The fire hydrant is to the right of them.", "C. The fire hydrant is behind them.", "D. The fire hydrant is to the left of them."], "answer": "C", "time_stamp_s": 342, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_272_a899_q0", "video_id": 272, "time_stamp_s": 342, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5b39d16ad718e17977de8bda548ef799f9a7515ef4bbf65dba7ffd8b15b08d75", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [312.0140166666667, 313.01501666666667, 314.01601666666664, 315.00033333333334, 316.0013333333333, 317.00233333333335, 318.00333333333333, 319.0043333333333, 320.00533333333334, 321.0063333333333, 322.00733333333335, 323.0083333333333, 324.00933333333336, 325.01033333333334, 326.0113333333333, 327.01233333333334, 328.0133333333333, 329.01433333333335, 330.01533333333333, 331.0163333333333, 332.00065, 333.00165, 334.00265, 335.00365, 336.00465, 337.00565, 338.00665, 339.00765, 340.00865, 341.00965], "recent_frames_sha256": "c7009c7bc45414a27f3293a7ff324e9c0dbca5e871590a622cd120cb01d9fac8", "num_recent_frames": 30, "tq": 718119.336220395, "t1": 718133.356903115, "ta": 718133.356903115, "te": 718133.395226514, "first_response_s": 14.020682720001787, "answer_total_s": 14.059006118914112, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_272_a899_q0", "video_id": 272, "time_stamp_s": 342, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5bb783f0120772a5c184788c4c1669c037f474529f144613bef8f0e23659f2d1", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player character runs along a sidewalk in a sunny urban environment, wearing a striped shirt and white shorts.  \n- A large monitor in the top-left corner displays a smiling streamer with blonde hair, reacting to gameplay.  \n- The player briefly accesses a map overlay at 0:18, then resumes walking as other pedestrians and vehicles pass by.\n[30-60s] - Player in striped shirt walks toward another character on sidewalk, approaching from behind.  \n- Second character (in black jacket) turns to face player, standing near green hedge.  \n- Streamer in top-left inset reacts with hand gesture while watching gameplay.\n[60-90s] - Player in striped shirt holds phone, facing another player in plaid shirt who gestures with hand.  \n- Both stand on sidewalk near green hedge, with urban buildings and palm trees in background.  \n- On-screen UI shows chat messages and a phone interface with app icons, indicating interactive gameplay.\n[90-120s] - Two male characters stand on a sidewalk, one in a striped shirt and the other in a plaid jacket, facing each other.  \n- The character in the striped shirt turns slightly to his left, then walks forward along the sidewalk.  \n- A smartphone interface briefly appears on the right side of the screen, showing app icons.\n[120-150s] - A player in a striped shirt runs alongside another player in a black shirt, both moving across a sidewalk toward a street intersection.  \n- A third player, dressed as Santa Claus, appears behind them, walking slowly on the sidewalk.  \n- The camera follows the group as they move forward, with the Santa character occasionally turning to face the others.\n[150-180s] - Santa Claus character walks away from the player, moving toward a group of pedestrians on the sidewalk.  \n- A man in a black jacket and jeans approaches the player from behind, then turns to face the player.  \n- The player character remains stationary, observing the interactions as the Santa figure and other pedestrians move in the background.\n[180-210s] - Two male characters stand on a sidewalk, one in a striped shirt and the other in a plaid shirt, facing each other.  \n- A smartphone UI overlay appears on the right, showing app icons and a time display of 11:03.  \n- The character in the striped shirt holds a phone, while the other character looks toward him, with a chat window visible on the right side of the screen.\n[210-240s] - Two male characters stand on a sidewalk, one holding a phone, while a third character walks past in the background.  \n- A smartphone UI overlay displays app icons and a menu, suggesting an in-game interface or modded feature.  \n- The top-left corner shows a live streamer’s face, indicating this is a gameplay livestream with a webcam feed.\n[240-270s] - Two male characters stand on a sidewalk, one in a striped shirt and the other in a plaid shirt, facing each other.  \n- A smartphone interface appears on screen, displaying app icons, suggesting an interaction or action being initiated.  \n- The background shows a city street with palm trees, buildings, and pedestrians moving in the distance.\n[270-300s] - Two male characters stand facing each other on grass near a palm tree, one in a striped shirt and the other in a plaid shirt.  \n- A smartphone UI overlay shows app icons and a clock reading 11:04, with a \"Call History\" menu briefly appearing.  \n- A webcam feed in the top-left corner displays a person with headphones, while a small profile picture appears near the bottom-left.\n[300-330s] - Player's character is shown in a menu interface with a highlighted \"Radar\" option, indicating active selection or interaction.\n- Two in-game characters are visible in the game world, standing near a grassy area with a street and buildings in the background.\n- The player's character is positioned in a virtual environment, with a visible chat window displaying messages from other players or community members.", "history_tokens": 878, "history_utf8_bytes": 3902, "recent_frame_times_s": [312.0140166666667, 313.01501666666667, 314.01601666666664, 315.00033333333334, 316.0013333333333, 317.00233333333335, 318.00333333333333, 319.0043333333333, 320.00533333333334, 321.0063333333333, 322.00733333333335, 323.0083333333333, 324.00933333333336, 325.01033333333334, 326.0113333333333, 327.01233333333334, 328.0133333333333, 329.01433333333335, 330.01533333333333, 331.0163333333333, 332.00065, 333.00165, 334.00265, 335.00365, 336.00465, 337.00565, 338.00665, 339.00765, 340.00865, 341.00965], "recent_frames_sha256": "c7009c7bc45414a27f3293a7ff324e9c0dbca5e871590a622cd120cb01d9fac8", "num_recent_frames": 30, "tq": 718027.242308188, "t1": 718029.511899397, "ta": 718029.511899397, "te": 718029.704772428, "first_response_s": 2.269591209013015, "answer_total_s": 2.4624642400303856, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 272, "content_group": "d365fae4dfbc424c7bf95bbc2e32132a70912d23093f9e5fee3428bb6811b1da", "question": {"question_id": "sample_272_a900_q1", "video_id": 272, "video_path": "./videos/sample_272_real.mp4", "annotation_index": 900, "question_index": 1, "question": "What is the player doing right now?", "options": ["A. Adjusting game settings.", "B. Watching a cutscene.", "C. Driving a car in the game.", "D. Selecting key bindings."], "answer": "C", "time_stamp_s": 495, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_272_a900_q1", "video_id": 272, "time_stamp_s": 495, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8f0874251ae358009f39200a1e187f9671b281fe124cd7a24cafa6981fa7dd8f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [465.0001833333333, 466.00118333333336, 467.00218333333333, 468.0031833333333, 469.00418333333334, 470.0051833333333, 471.00618333333335, 472.00718333333333, 473.0081833333333, 474.00918333333334, 475.0101833333333, 476.01118333333335, 477.0121833333333, 478.01318333333336, 479.01418333333334, 480.0151833333333, 481.01618333333334, 482.0005, 483.0015, 484.0025, 485.0035, 486.0045, 487.0055, 488.0065, 489.0075, 490.0085, 491.0095, 492.0105, 493.0115, 494.0125], "recent_frames_sha256": "57de4aaf7c08c1cf5a8a0a97669b58a0d055da2438c6fffe9738b43edea273d4", "num_recent_frames": 30, "tq": 718133.40567504, "t1": 718143.929230778, "ta": 718143.929230778, "te": 718143.968393106, "first_response_s": 10.52355573803652, "answer_total_s": 10.562718066037633, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_272_a900_q1", "video_id": 272, "time_stamp_s": 495, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e0b2ebf7a44d889a235851a06d4029b66cf6afccb767eeba768203e29fe211cd", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Santa Claus character walks away from the player, moving toward a group of pedestrians on the sidewalk.  \n- A man in a black jacket and jeans approaches the player from behind, then turns to face the player.  \n- The player character remains stationary, observing the interactions as the Santa figure and other pedestrians move in the background.\n[180-210s] - Two male characters stand on a sidewalk, one in a striped shirt and the other in a plaid shirt, facing each other.  \n- A smartphone UI overlay appears on the right, showing app icons and a time display of 11:03.  \n- The character in the striped shirt holds a phone, while the other character looks toward him, with a chat window visible on the right side of the screen.\n[210-240s] - Two male characters stand on a sidewalk, one holding a phone, while a third character walks past in the background.  \n- A smartphone UI overlay displays app icons and a menu, suggesting an in-game interface or modded feature.  \n- The top-left corner shows a live streamer’s face, indicating this is a gameplay livestream with a webcam feed.\n[240-270s] - Two male characters stand on a sidewalk, one in a striped shirt and the other in a plaid shirt, facing each other.  \n- A smartphone interface appears on screen, displaying app icons, suggesting an interaction or action being initiated.  \n- The background shows a city street with palm trees, buildings, and pedestrians moving in the distance.\n[270-300s] - Two male characters stand facing each other on grass near a palm tree, one in a striped shirt and the other in a plaid shirt.  \n- A smartphone UI overlay shows app icons and a clock reading 11:04, with a \"Call History\" menu briefly appearing.  \n- A webcam feed in the top-left corner displays a person with headphones, while a small profile picture appears near the bottom-left.\n[300-330s] - Player's character is shown in a menu interface with a highlighted \"Radar\" option, indicating active selection or interaction.\n- Two in-game characters are visible in the game world, standing near a grassy area with a street and buildings in the background.\n- The player's character is positioned in a virtual environment, with a visible chat window displaying messages from other players or community members.\n[330-360s] - Player in striped shirt approaches and physically interacts with another player in a black plaid shirt near a tree.  \n- The player in the striped shirt then walks away from the interaction, moving along a sidewalk past a fire hydrant.  \n- A large billboard with a smiling face is visible in the background, positioned near a street corner.\n[360-390s] - A blonde character in a striped shirt bends down near a hedge, while a dark-haired man in a suit stands nearby, both facing each other.  \n- The blonde character then walks toward a blue car parked nearby, approaching its driver-side door.  \n- The camera shifts to a third-person view as the car is driven away, with the man in the suit still visible in the background.\n[390-420s] - Blue car navigates a city intersection, passing pedestrians and traffic lights.\n- A black sedan and a red car are seen driving in adjacent lanes, with the blue car overtaking them.\n- The blue car approaches a building with a \"CITY HALL\" sign, stopping near its curb.\n[420-450s] - Blue car is stationary at a street corner, facing forward, with a black car passing by on the left.  \n- Player opens the game's key bindings menu, navigating through options like \"Move Forward\" and \"Move Backward\" with cursor movement.  \n- A large billboard with a blonde woman's image is visible on the left side of the screen, partially obscured by the blue car.\n[450-480s] - A player's in-game character is visible in the top-left corner, wearing headphones and a white shirt, with a blurred background of a city street.  \n- The main screen displays a menu with options like \"CAREER,\" \"AUTO,\" and \"STATS,\" and a list of \"ACTIVITIES\" with checkboxes, including \"Gang War\" and \"Gang War (Light)\" selected.  \n- The bottom-right corner shows a chat window with messages from other players, including one that says \"I'm not sure if I'm in the right place.\"", "history_tokens": 971, "history_utf8_bytes": 4152, "recent_frame_times_s": [465.0001833333333, 466.00118333333336, 467.00218333333333, 468.0031833333333, 469.00418333333334, 470.0051833333333, 471.00618333333335, 472.00718333333333, 473.0081833333333, 474.00918333333334, 475.0101833333333, 476.01118333333335, 477.0121833333333, 478.01318333333336, 479.01418333333334, 480.0151833333333, 481.01618333333334, 482.0005, 483.0015, 484.0025, 485.0035, 486.0045, 487.0055, 488.0065, 489.0075, 490.0085, 491.0095, 492.0105, 493.0115, 494.0125], "recent_frames_sha256": "57de4aaf7c08c1cf5a8a0a97669b58a0d055da2438c6fffe9738b43edea273d4", "num_recent_frames": 30, "tq": 718065.56877039, "t1": 718067.24589388, "ta": 718067.24589388, "te": 718067.562926191, "first_response_s": 1.6771234900224954, "answer_total_s": 1.9941558010177687, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 272, "content_group": "d365fae4dfbc424c7bf95bbc2e32132a70912d23093f9e5fee3428bb6811b1da", "question": {"question_id": "sample_272_a900_q0", "video_id": 272, "video_path": "./videos/sample_272_real.mp4", "annotation_index": 900, "question_index": 0, "question": "Where is the chat message section located on the screen right now?", "options": ["A. In the top-left corner.", "B. On the right side.", "C. At the bottom.", "D. On the left side."], "answer": "B", "time_stamp_s": 500, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_272_a900_q0", "video_id": 272, "time_stamp_s": 500, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e90a08c658b674e6711b44cef9211a19e53989bcb5f166cdb8bfcb8f021a07a8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [470.0051833333333, 471.00618333333335, 472.00718333333333, 473.0081833333333, 474.00918333333334, 475.0101833333333, 476.01118333333335, 477.0121833333333, 478.01318333333336, 479.01418333333334, 480.0151833333333, 481.01618333333334, 482.0005, 483.0015, 484.0025, 485.0035, 486.0045, 487.0055, 488.0065, 489.0075, 490.0085, 491.0095, 492.0105, 493.0115, 494.0125, 495.0135, 496.0145, 497.0155, 498.0165, 499.00081666666665], "recent_frames_sha256": "5bd23efbf63a9575ae9b3ec307b42ceeda6392d4d39c65e294d594a8b7a0d055", "num_recent_frames": 30, "tq": 718143.979755112, "t1": 718151.897138074, "ta": 718151.897138074, "te": 718151.93624282, "first_response_s": 7.9173829620704055, "answer_total_s": 7.956487708026543, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_272_a900_q0", "video_id": 272, "time_stamp_s": 500, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1b63764948fea341ea5b3cda4ac78b7a19f81ef1ab1165b5f2424a1cbeaef5bf", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Santa Claus character walks away from the player, moving toward a group of pedestrians on the sidewalk.  \n- A man in a black jacket and jeans approaches the player from behind, then turns to face the player.  \n- The player character remains stationary, observing the interactions as the Santa figure and other pedestrians move in the background.\n[180-210s] - Two male characters stand on a sidewalk, one in a striped shirt and the other in a plaid shirt, facing each other.  \n- A smartphone UI overlay appears on the right, showing app icons and a time display of 11:03.  \n- The character in the striped shirt holds a phone, while the other character looks toward him, with a chat window visible on the right side of the screen.\n[210-240s] - Two male characters stand on a sidewalk, one holding a phone, while a third character walks past in the background.  \n- A smartphone UI overlay displays app icons and a menu, suggesting an in-game interface or modded feature.  \n- The top-left corner shows a live streamer’s face, indicating this is a gameplay livestream with a webcam feed.\n[240-270s] - Two male characters stand on a sidewalk, one in a striped shirt and the other in a plaid shirt, facing each other.  \n- A smartphone interface appears on screen, displaying app icons, suggesting an interaction or action being initiated.  \n- The background shows a city street with palm trees, buildings, and pedestrians moving in the distance.\n[270-300s] - Two male characters stand facing each other on grass near a palm tree, one in a striped shirt and the other in a plaid shirt.  \n- A smartphone UI overlay shows app icons and a clock reading 11:04, with a \"Call History\" menu briefly appearing.  \n- A webcam feed in the top-left corner displays a person with headphones, while a small profile picture appears near the bottom-left.\n[300-330s] - Player's character is shown in a menu interface with a highlighted \"Radar\" option, indicating active selection or interaction.\n- Two in-game characters are visible in the game world, standing near a grassy area with a street and buildings in the background.\n- The player's character is positioned in a virtual environment, with a visible chat window displaying messages from other players or community members.\n[330-360s] - Player in striped shirt approaches and physically interacts with another player in a black plaid shirt near a tree.  \n- The player in the striped shirt then walks away from the interaction, moving along a sidewalk past a fire hydrant.  \n- A large billboard with a smiling face is visible in the background, positioned near a street corner.\n[360-390s] - A blonde character in a striped shirt bends down near a hedge, while a dark-haired man in a suit stands nearby, both facing each other.  \n- The blonde character then walks toward a blue car parked nearby, approaching its driver-side door.  \n- The camera shifts to a third-person view as the car is driven away, with the man in the suit still visible in the background.\n[390-420s] - Blue car navigates a city intersection, passing pedestrians and traffic lights.\n- A black sedan and a red car are seen driving in adjacent lanes, with the blue car overtaking them.\n- The blue car approaches a building with a \"CITY HALL\" sign, stopping near its curb.\n[420-450s] - Blue car is stationary at a street corner, facing forward, with a black car passing by on the left.  \n- Player opens the game's key bindings menu, navigating through options like \"Move Forward\" and \"Move Backward\" with cursor movement.  \n- A large billboard with a blonde woman's image is visible on the left side of the screen, partially obscured by the blue car.\n[450-480s] - A player's in-game character is visible in the top-left corner, wearing headphones and a white shirt, with a blurred background of a city street.  \n- The main screen displays a menu with options like \"CAREER,\" \"AUTO,\" and \"STATS,\" and a list of \"ACTIVITIES\" with checkboxes, including \"Gang War\" and \"Gang War (Light)\" selected.  \n- The bottom-right corner shows a chat window with messages from other players, including one that says \"I'm not sure if I'm in the right place.\"", "history_tokens": 971, "history_utf8_bytes": 4152, "recent_frame_times_s": [470.0051833333333, 471.00618333333335, 472.00718333333333, 473.0081833333333, 474.00918333333334, 475.0101833333333, 476.01118333333335, 477.0121833333333, 478.01318333333336, 479.01418333333334, 480.0151833333333, 481.01618333333334, 482.0005, 483.0015, 484.0025, 485.0035, 486.0045, 487.0055, 488.0065, 489.0075, 490.0085, 491.0095, 492.0105, 493.0115, 494.0125, 495.0135, 496.0145, 497.0155, 498.0165, 499.00081666666665], "recent_frames_sha256": "5bd23efbf63a9575ae9b3ec307b42ceeda6392d4d39c65e294d594a8b7a0d055", "num_recent_frames": 30, "tq": 718067.602935108, "t1": 718079.748833107, "ta": 718079.748833107, "te": 718079.939788476, "first_response_s": 12.1458979989402, "answer_total_s": 12.336853367974982, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 272, "content_group": "d365fae4dfbc424c7bf95bbc2e32132a70912d23093f9e5fee3428bb6811b1da", "question": {"question_id": "sample_272_a901_q0", "video_id": 272, "video_path": "./videos/sample_272_real.mp4", "annotation_index": 901, "question_index": 0, "question": "Where is the small image of a cat's face located right now?", "options": ["A. Top right of the menu.", "B. Bottom left of the menu.", "C. Center of the menu.", "D. Top left of the menu."], "answer": "A", "time_stamp_s": 590, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_272_a901_q0", "video_id": 272, "time_stamp_s": 590, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9d8125ca5506129106ef2a20b5920f7d148270133ddd0fe69e23d7fc8f67d2e1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [560.0117666666666, 561.0127666666667, 562.0137666666667, 563.0147666666667, 564.0157666666667, 565.0000833333334, 566.0010833333333, 567.0020833333333, 568.0030833333333, 569.0040833333334, 570.0050833333333, 571.0060833333333, 572.0070833333333, 573.0080833333334, 574.0090833333334, 575.0100833333333, 576.0110833333333, 577.0120833333333, 578.0130833333334, 579.0140833333334, 580.0150833333333, 581.0160833333333, 582.0004, 583.0014, 584.0024, 585.0034, 586.0044, 587.0054, 588.0064, 589.0074], "recent_frames_sha256": "96dcc92b064a46c83d18cb1694fe9c288528b5bd7ae1303d563a8b25b6c8de87", "num_recent_frames": 30, "tq": 718151.946793329, "t1": 718159.759847457, "ta": 718159.759847457, "te": 718159.797575703, "first_response_s": 7.813054128084332, "answer_total_s": 7.850782374036498, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_272_a901_q0", "video_id": 272, "time_stamp_s": 590, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8dc573ea392ba75f7f38e791be9070442c1c07b3eab464ea8ad69646a2753104", "condition_order": ["notes", "recent"], "memory": "[210-240s] - Two male characters stand on a sidewalk, one holding a phone, while a third character walks past in the background.  \n- A smartphone UI overlay displays app icons and a menu, suggesting an in-game interface or modded feature.  \n- The top-left corner shows a live streamer’s face, indicating this is a gameplay livestream with a webcam feed.\n[240-270s] - Two male characters stand on a sidewalk, one in a striped shirt and the other in a plaid shirt, facing each other.  \n- A smartphone interface appears on screen, displaying app icons, suggesting an interaction or action being initiated.  \n- The background shows a city street with palm trees, buildings, and pedestrians moving in the distance.\n[270-300s] - Two male characters stand facing each other on grass near a palm tree, one in a striped shirt and the other in a plaid shirt.  \n- A smartphone UI overlay shows app icons and a clock reading 11:04, with a \"Call History\" menu briefly appearing.  \n- A webcam feed in the top-left corner displays a person with headphones, while a small profile picture appears near the bottom-left.\n[300-330s] - Player's character is shown in a menu interface with a highlighted \"Radar\" option, indicating active selection or interaction.\n- Two in-game characters are visible in the game world, standing near a grassy area with a street and buildings in the background.\n- The player's character is positioned in a virtual environment, with a visible chat window displaying messages from other players or community members.\n[330-360s] - Player in striped shirt approaches and physically interacts with another player in a black plaid shirt near a tree.  \n- The player in the striped shirt then walks away from the interaction, moving along a sidewalk past a fire hydrant.  \n- A large billboard with a smiling face is visible in the background, positioned near a street corner.\n[360-390s] - A blonde character in a striped shirt bends down near a hedge, while a dark-haired man in a suit stands nearby, both facing each other.  \n- The blonde character then walks toward a blue car parked nearby, approaching its driver-side door.  \n- The camera shifts to a third-person view as the car is driven away, with the man in the suit still visible in the background.\n[390-420s] - Blue car navigates a city intersection, passing pedestrians and traffic lights.\n- A black sedan and a red car are seen driving in adjacent lanes, with the blue car overtaking them.\n- The blue car approaches a building with a \"CITY HALL\" sign, stopping near its curb.\n[420-450s] - Blue car is stationary at a street corner, facing forward, with a black car passing by on the left.  \n- Player opens the game's key bindings menu, navigating through options like \"Move Forward\" and \"Move Backward\" with cursor movement.  \n- A large billboard with a blonde woman's image is visible on the left side of the screen, partially obscured by the blue car.\n[450-480s] - A player's in-game character is visible in the top-left corner, wearing headphones and a white shirt, with a blurred background of a city street.  \n- The main screen displays a menu with options like \"CAREER,\" \"AUTO,\" and \"STATS,\" and a list of \"ACTIVITIES\" with checkboxes, including \"Gang War\" and \"Gang War (Light)\" selected.  \n- The bottom-right corner shows a chat window with messages from other players, including one that says \"I'm not sure if I'm in the right place.\"\n[480-510s] - Blue car drives straight through an intersection, passing a traffic light and a blue dumpster on the right.  \n- A black sedan overtakes the blue car from the left on a multi-lane road.  \n- The game's HUD displays a speedometer reading 87 mph and a map in the bottom-left corner.\n[510-540s] - Blue car drives forward on a multi-lane road, passing other vehicles and urban infrastructure.  \n- A large billboard displaying \"BAY AREA\" is visible on the right side of the road.  \n- The player's vehicle approaches an underpass, with the road narrowing ahead.\n[540-570s] - Blue car stationary at intersection, facing forward, with traffic lights visible ahead.  \n- Player opens in-game menu, selecting \"Options\" to adjust settings like \"Show HUD\" and \"Show Speedometer.\"  \n- On-screen chat and player stats remain active, indicating live streaming context.", "history_tokens": 1009, "history_utf8_bytes": 4274, "recent_frame_times_s": [560.0117666666666, 561.0127666666667, 562.0137666666667, 563.0147666666667, 564.0157666666667, 565.0000833333334, 566.0010833333333, 567.0020833333333, 568.0030833333333, 569.0040833333334, 570.0050833333333, 571.0060833333333, 572.0070833333333, 573.0080833333334, 574.0090833333334, 575.0100833333333, 576.0110833333333, 577.0120833333333, 578.0130833333334, 579.0140833333334, 580.0150833333333, 581.0160833333333, 582.0004, 583.0014, 584.0024, 585.0034, 586.0044, 587.0054, 588.0064, 589.0074], "recent_frames_sha256": "96dcc92b064a46c83d18cb1694fe9c288528b5bd7ae1303d563a8b25b6c8de87", "num_recent_frames": 30, "tq": 718105.689193269, "t1": 718107.821308526, "ta": 718107.821308526, "te": 718107.866676963, "first_response_s": 2.132115256972611, "answer_total_s": 2.1774836940458044, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 273, "content_group": "865d4a27202909008395f4ccdcb7a6878e283e0e39b8e446153fff9fe2355221", "question": {"question_id": "sample_273_a690_q0", "video_id": 273, "video_path": "./videos/sample_273_real.mp4", "annotation_index": 690, "question_index": 0, "question": "Where is the character controlled by the player now?", "options": ["A. In the blue car.", "B. In the black car.", "C. In the red car.", "D. In the white car."], "answer": "A", "time_stamp_s": 20, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_273_a690_q0", "video_id": 273, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bdae939cc492ed0cc4b4c52cff84cfd87c386e4d64d6c3da08db5a63246ce9af", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.037, 1.0046333333333333, 2.0056333333333334, 3.0066333333333333, 4.007633333333334, 5.008633333333333, 6.009633333333333, 7.010633333333334, 8.011633333333334, 9.012633333333333, 10.013633333333333, 11.014633333333334, 12.015633333333334, 13.016633333333333, 14.00095, 15.00195, 16.00295, 17.00395, 18.00495, 19.00595], "recent_frames_sha256": "e5e0b7c9e5d87f7c8ebbdacd090db9d83e3faee79012b5399ad4e66b872d2ee6", "num_recent_frames": 20, "tq": 710018.719885512, "t1": 710020.638007857, "ta": 710020.638007857, "te": 710020.793197314, "first_response_s": 1.9181223449995741, "answer_total_s": 2.0733118019998074, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_273_a690_q0", "video_id": 273, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "77e07453bb850fac09b79a6f0321b29ba9d34a0dbb5c8e94630b93de34c5f874", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.037, 1.0046333333333333, 2.0056333333333334, 3.0066333333333333, 4.007633333333334, 5.008633333333333, 6.009633333333333, 7.010633333333334, 8.011633333333334, 9.012633333333333, 10.013633333333333, 11.014633333333334, 12.015633333333334, 13.016633333333333, 14.00095, 15.00195, 16.00295, 17.00395, 18.00495, 19.00595], "recent_frames_sha256": "e5e0b7c9e5d87f7c8ebbdacd090db9d83e3faee79012b5399ad4e66b872d2ee6", "num_recent_frames": 20, "tq": 710052.902860244, "t1": 710064.477424292, "ta": 710064.477424292, "te": 710064.703391504, "first_response_s": 11.574564047972672, "answer_total_s": 11.80053125997074, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 273, "content_group": "865d4a27202909008395f4ccdcb7a6878e283e0e39b8e446153fff9fe2355221", "question": {"question_id": "sample_273_a691_q0", "video_id": 273, "video_path": "./videos/sample_273_real.mp4", "annotation_index": 691, "question_index": 0, "question": "What is the car doing right now?", "options": ["A. It exited a tunnel and stopped abruptly.", "B. It drove straight through the tunnel without turning.", "C. It veered left and entered a parking area.", "D. It turned right and sped up on an open road."], "answer": "C", "time_stamp_s": 174, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_273_a691_q0", "video_id": 273, "time_stamp_s": 174, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3d1f89444860c97d2a7fe72e9fddc89d23078357b310f5b62fd1de5ba9ca50d8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [144.01416666666665, 145.01516666666666, 146.01616666666666, 147.00048333333334, 148.00148333333334, 149.00248333333334, 150.00348333333332, 151.00448333333333, 152.00548333333333, 153.00648333333334, 154.00748333333334, 155.00848333333334, 156.00948333333332, 157.01048333333333, 158.01148333333333, 159.01248333333334, 160.01348333333334, 161.01448333333335, 162.01548333333332, 163.01648333333333, 164.0008, 165.0018, 166.0028, 167.0038, 168.0048, 169.0058, 170.0068, 171.0078, 172.0088, 173.0098], "recent_frames_sha256": "4c67a2232129857c6b8ae8fba3baad0508815706b51389e6d7d7d4836fa3ddf9", "num_recent_frames": 30, "tq": 710020.821741878, "t1": 710028.895189787, "ta": 710028.895189787, "te": 710029.118923049, "first_response_s": 8.073447908973321, "answer_total_s": 8.297181170899421, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_273_a691_q0", "video_id": 273, "time_stamp_s": 174, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d7daacae53ed633dc7dd9cde20b51bb150f77e1467cec09b8853da1e9e9af4fe", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A blue car is shown driving on a city street, with a speedometer reading 0:00 at 0:22 and increasing to 0:28.\n- The player's webcam view shows a person with headphones, looking at the screen, while the game interface displays key bindings and a chat window.\n- The game's UI includes a list of players with their names and statuses, and a map in the bottom left corner.\n[30-60s] - Blue car drives through city streets, approaching a crosswalk with traffic lights.  \n- Player character exits vehicle, standing beside it on the road.  \n- In-game menu opens, displaying \"ACTION\" options with \"Toggle Light\" selected and \"Toggle Target\" highlighted.\n[60-90s] - Blue car drives straight through a city intersection, passing traffic lights and crosswalks.  \n- A white car appears on the right side of the screen, moving in the opposite direction.  \n- The game's HUD displays speed, map, and chat messages, with a visible \"Key Bindings\" menu in the background.\n[90-120s] - Blue car drives through city streets, passing other vehicles and crossing intersections.  \n- Player's phone screen appears on right side, showing app icons and a \"Settings\" menu.  \n- Game UI displays speed, map, and player stats; chat messages scroll on right side.\n[120-150s] - Blue car drives through city streets, passing crosswalks and intersections with traffic signs.\n- Player's in-game HUD shows speed and map, while a live stream overlay displays chat messages and viewer count.\n- Camera follows car as it navigates urban roads, including a bridge and a stop sign, with buildings and infrastructure visible.", "history_tokens": 376, "history_utf8_bytes": 1590, "recent_frame_times_s": [144.01416666666665, 145.01516666666666, 146.01616666666666, 147.00048333333334, 148.00148333333334, 149.00248333333334, 150.00348333333332, 151.00448333333333, 152.00548333333333, 153.00648333333334, 154.00748333333334, 155.00848333333334, 156.00948333333332, 157.01048333333333, 158.01148333333333, 159.01248333333334, 160.01348333333334, 161.01448333333335, 162.01548333333332, 163.01648333333333, 164.0008, 165.0018, 166.0028, 167.0038, 168.0048, 169.0058, 170.0068, 171.0078, 172.0088, 173.0098], "recent_frames_sha256": "4c67a2232129857c6b8ae8fba3baad0508815706b51389e6d7d7d4836fa3ddf9", "num_recent_frames": 30, "tq": 710105.749779378, "t1": 710117.079628138, "ta": 710117.079628138, "te": 710117.123380268, "first_response_s": 11.329848760040477, "answer_total_s": 11.373600890045054, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 273, "content_group": "865d4a27202909008395f4ccdcb7a6878e283e0e39b8e446153fff9fe2355221", "question": {"question_id": "sample_273_a692_q0", "video_id": 273, "video_path": "./videos/sample_273_real.mp4", "annotation_index": 692, "question_index": 0, "question": "What did the man wearing a striped shirt do just now?", "options": ["A. Engaged with the person in the military outfit.", "B. Walked away from the person in the military outfit.", "C. Looked at the gray wall behind him.", "D. Spoke to the inset video."], "answer": "B", "time_stamp_s": 332, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_273_a692_q0", "video_id": 273, "time_stamp_s": 332, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "92652ebea2a3d7fb253e85863d3bc6ccb85835e18156e49a0e9929fb58d114aa", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [302.00533333333334, 303.0063333333333, 304.00733333333335, 305.0083333333333, 306.00933333333336, 307.01033333333334, 308.0113333333333, 309.01233333333334, 310.0133333333333, 311.01433333333335, 312.01533333333333, 313.0163333333333, 314.00065, 315.00165, 316.00265, 317.00365, 318.00465, 319.00565, 320.00665, 321.00765, 322.00865, 323.00965, 324.01065, 325.01165, 326.01265, 327.01365, 328.01465, 329.01565, 330.01665, 331.00096666666667], "recent_frames_sha256": "68ad32a08451443ba0488241b401edf0d0943fcff6af1f7a5c9a83058ee6eb7c", "num_recent_frames": 30, "tq": 710029.153012444, "t1": 710036.058577866, "ta": 710036.058577866, "te": 710036.498330462, "first_response_s": 6.905565421911888, "answer_total_s": 7.345318017993122, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_273_a692_q0", "video_id": 273, "time_stamp_s": 332, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "86e108aa73e9a2065a7085dbf027ba62eb4948f44d3eacd90a8fa514a145ec36", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A blue car is shown driving on a city street, with a speedometer reading 0:00 at 0:22 and increasing to 0:28.\n- The player's webcam view shows a person with headphones, looking at the screen, while the game interface displays key bindings and a chat window.\n- The game's UI includes a list of players with their names and statuses, and a map in the bottom left corner.\n[30-60s] - Blue car drives through city streets, approaching a crosswalk with traffic lights.  \n- Player character exits vehicle, standing beside it on the road.  \n- In-game menu opens, displaying \"ACTION\" options with \"Toggle Light\" selected and \"Toggle Target\" highlighted.\n[60-90s] - Blue car drives straight through a city intersection, passing traffic lights and crosswalks.  \n- A white car appears on the right side of the screen, moving in the opposite direction.  \n- The game's HUD displays speed, map, and chat messages, with a visible \"Key Bindings\" menu in the background.\n[90-120s] - Blue car drives through city streets, passing other vehicles and crossing intersections.  \n- Player's phone screen appears on right side, showing app icons and a \"Settings\" menu.  \n- Game UI displays speed, map, and player stats; chat messages scroll on right side.\n[120-150s] - Blue car drives through city streets, passing crosswalks and intersections with traffic signs.\n- Player's in-game HUD shows speed and map, while a live stream overlay displays chat messages and viewer count.\n- Camera follows car as it navigates urban roads, including a bridge and a stop sign, with buildings and infrastructure visible.\n[150-180s] - Player drives a blue car through city streets, entering a tunnel and emerging into daylight.  \n- Camera switches to first-person cockpit view, showing hands on steering wheel and dashboard.  \n- Car exits tunnel, turns right onto a road with palm trees, then parks in a parking lot.\n[180-210s] - Player character in striped shirt walks away from blue car, then approaches a wall with a yellow warning sign.  \n- Player character climbs a set of stairs leading to an upper level, then descends to a lower parking area.  \n- Blue car is parked in a designated spot near a building entrance, with a \"NO PARKING\" sign visible nearby.\n[210-240s] - Player character exits a blue car and walks toward a building entrance.  \n- Character ascends stairs and runs across a rooftop area toward a glass door.  \n- Door labeled \"Union Depository\" is approached as the character enters.\n[240-270s] - Player character in striped shirt runs across a rooftop platform, then jumps down to a lower level.\n- Character lands on a paved street area with yellow bollards, moving toward a parked car.\n- Game UI shows player's health and armor stats, with a map overlay visible in the top-left corner.\n[270-300s] - Player character in striped shirt runs across a parking lot, passing a white van and a green bus.  \n- A police officer named Daniel Armstrong appears, standing near a red vending machine, with a dialogue box open.  \n- The player character approaches the officer, suggesting an interaction or confrontation.\n[300-330s] - Daniel Armstrong, in a police uniform with a helmet, stands facing a player character in a striped shirt, appearing to interact or confront them.  \n- The player character is positioned slightly behind Daniel, with their back to the camera, suggesting a dialogue or interaction sequence.  \n- A smartphone interface is visible on the right side of the screen, displaying a \"Phone\" menu with options like \"Call,\" \"Text,\" and \"Messages,\" indicating an in-game communication feature.", "history_tokens": 829, "history_utf8_bytes": 3587, "recent_frame_times_s": [302.00533333333334, 303.0063333333333, 304.00733333333335, 305.0083333333333, 306.00933333333336, 307.01033333333334, 308.0113333333333, 309.01233333333334, 310.0133333333333, 311.01433333333335, 312.01533333333333, 313.0163333333333, 314.00065, 315.00165, 316.00265, 317.00365, 318.00465, 319.00565, 320.00665, 321.00765, 322.00865, 323.00965, 324.01065, 325.01165, 326.01265, 327.01365, 328.01465, 329.01565, 330.01665, 331.00096666666667], "recent_frames_sha256": "68ad32a08451443ba0488241b401edf0d0943fcff6af1f7a5c9a83058ee6eb7c", "num_recent_frames": 30, "tq": 710161.153161024, "t1": 710163.04838702, "ta": 710163.04838702, "te": 710163.498883204, "first_response_s": 1.8952259960351512, "answer_total_s": 2.345722179976292, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 273, "content_group": "865d4a27202909008395f4ccdcb7a6878e283e0e39b8e446153fff9fe2355221", "question": {"question_id": "sample_273_a693_q0", "video_id": 273, "video_path": "./videos/sample_273_real.mp4", "annotation_index": 693, "question_index": 0, "question": "What did the driver do just now after parking the car in the garage?", "options": ["A. He opened the car trunk.", "B. He walked towards the white van.", "C. He checked the car's tires.", "D. He spoke to someone on the phone."], "answer": "B", "time_stamp_s": 500, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_273_a693_q0", "video_id": 273, "time_stamp_s": 500, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "38742d6430530e4745b502661b357d973721946ac86eaef80fe5289cc73fdbe6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [470.0065, 471.0075, 472.0085, 473.0095, 474.0105, 475.0115, 476.0125, 477.0135, 478.0145, 479.0155, 480.0165, 481.00081666666665, 482.0018166666667, 483.00281666666666, 484.0038166666667, 485.00481666666667, 486.00581666666665, 487.0068166666667, 488.00781666666666, 489.0088166666667, 490.00981666666667, 491.01081666666664, 492.0118166666667, 493.01281666666665, 494.0138166666667, 495.01481666666666, 496.0158166666667, 497.00013333333334, 498.0011333333333, 499.00213333333335], "recent_frames_sha256": "d5776f1b13b411574f8c4f67db9574621b6dcafff3d573760bf102fee3544d06", "num_recent_frames": 30, "tq": 710036.508384953, "t1": 710046.708072352, "ta": 710046.708072352, "te": 710046.745267796, "first_response_s": 10.199687398970127, "answer_total_s": 10.236882842960767, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_273_a693_q0", "video_id": 273, "time_stamp_s": 500, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dd7aceab3489a50fdd8f350636fd6dc380db8857afa2f6bc01581c7082b5098b", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Blue car drives through city streets, passing other vehicles and crossing intersections.  \n- Player's phone screen appears on right side, showing app icons and a \"Settings\" menu.  \n- Game UI displays speed, map, and player stats; chat messages scroll on right side.\n[120-150s] - Blue car drives through city streets, passing crosswalks and intersections with traffic signs.\n- Player's in-game HUD shows speed and map, while a live stream overlay displays chat messages and viewer count.\n- Camera follows car as it navigates urban roads, including a bridge and a stop sign, with buildings and infrastructure visible.\n[150-180s] - Player drives a blue car through city streets, entering a tunnel and emerging into daylight.  \n- Camera switches to first-person cockpit view, showing hands on steering wheel and dashboard.  \n- Car exits tunnel, turns right onto a road with palm trees, then parks in a parking lot.\n[180-210s] - Player character in striped shirt walks away from blue car, then approaches a wall with a yellow warning sign.  \n- Player character climbs a set of stairs leading to an upper level, then descends to a lower parking area.  \n- Blue car is parked in a designated spot near a building entrance, with a \"NO PARKING\" sign visible nearby.\n[210-240s] - Player character exits a blue car and walks toward a building entrance.  \n- Character ascends stairs and runs across a rooftop area toward a glass door.  \n- Door labeled \"Union Depository\" is approached as the character enters.\n[240-270s] - Player character in striped shirt runs across a rooftop platform, then jumps down to a lower level.\n- Character lands on a paved street area with yellow bollards, moving toward a parked car.\n- Game UI shows player's health and armor stats, with a map overlay visible in the top-left corner.\n[270-300s] - Player character in striped shirt runs across a parking lot, passing a white van and a green bus.  \n- A police officer named Daniel Armstrong appears, standing near a red vending machine, with a dialogue box open.  \n- The player character approaches the officer, suggesting an interaction or confrontation.\n[300-330s] - Daniel Armstrong, in a police uniform with a helmet, stands facing a player character in a striped shirt, appearing to interact or confront them.  \n- The player character is positioned slightly behind Daniel, with their back to the camera, suggesting a dialogue or interaction sequence.  \n- A smartphone interface is visible on the right side of the screen, displaying a \"Phone\" menu with options like \"Call,\" \"Text,\" and \"Messages,\" indicating an in-game communication feature.\n[330-360s] - Player character in striped shirt approaches a red \"AREA UNDER SURVEILLANCE\" box, then interacts with a nearby security camera.  \n- A security guard named \"Daniel Alvaro\" appears in a close-up, wearing a helmet and uniform, with a dialogue box indicating he is a \"Security Guard.\"  \n- Player character walks toward a white van with green trim, approaching its driver-side door, which is open.\n[360-390s] - Player character in striped shirt interacts with a smartphone, opening a map interface showing a city layout.  \n- Player approaches a large white and green armored truck labeled \"PUTTING U IN SECURE\" and \"gruppe\" on its side.  \n- Player character crouches near the truck's rear, suggesting stealth or preparation for an action.\n[390-420s] - Player character walks toward a white van with \"gruppe\" branding parked in a lot, then turns to face a concrete pillar.  \n- Map view shows a zoomed-in area around \"San Andreas Avenue\" and \"Downtown\" with multiple colored markers.  \n- Player character approaches the van, then turns to face a white van with \"gruppe\" branding parked in a lot, then turns to face a concrete pillar.\n[420-450s] - Player character in striped shirt runs past a white armored truck with \"Bank of Life\" branding.  \n- Player character ascends a set of stairs leading to an elevated area near a building entrance.  \n- A blue car is parked in the foreground as the player moves toward it.\n[450-480s] - Blue car drives through a parking lot, then turns onto a highway with multiple lanes and overhead structures.\n- Player character exits the car and walks toward a building entrance, then re-enters the vehicle.\n- Game map is displayed, showing the player's location and nearby points of interest, including a beach and city streets.", "history_tokens": 1010, "history_utf8_bytes": 4390, "recent_frame_times_s": [470.0065, 471.0075, 472.0085, 473.0095, 474.0105, 475.0115, 476.0125, 477.0135, 478.0145, 479.0155, 480.0165, 481.00081666666665, 482.0018166666667, 483.00281666666666, 484.0038166666667, 485.00481666666667, 486.00581666666665, 487.0068166666667, 488.00781666666666, 489.0088166666667, 490.00981666666667, 491.01081666666664, 492.0118166666667, 493.01281666666665, 494.0138166666667, 495.01481666666666, 496.0158166666667, 497.00013333333334, 498.0011333333333, 499.00213333333335], "recent_frames_sha256": "d5776f1b13b411574f8c4f67db9574621b6dcafff3d573760bf102fee3544d06", "num_recent_frames": 30, "tq": 710198.758096863, "t1": 710199.80747646, "ta": 710199.80747646, "te": 710200.028918857, "first_response_s": 1.049379596952349, "answer_total_s": 1.2708219939377159, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 273, "content_group": "865d4a27202909008395f4ccdcb7a6878e283e0e39b8e446153fff9fe2355221", "question": {"question_id": "sample_273_a694_q0", "video_id": 273, "video_path": "./videos/sample_273_real.mp4", "annotation_index": 694, "question_index": 0, "question": "What is the spatial relationship between the security personnel and the person in the striped shirt right now?", "options": ["A. The person in the striped shirt is standing behind the security personnel.", "B. The security personnel is standing above the person in the striped shirt.", "C. The person in the striped shirt is standing near a wall-mounted red box, facing the security personnel.", "D. The security personnel is walking away from the person in the striped shirt."], "answer": "C", "time_stamp_s": 594, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_273_a694_q0", "video_id": 273, "time_stamp_s": 594, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4fd6179840af331e960cb2bb20954891f26c698863d486c7c4376a5dfea6789c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [564.0004, 565.0014, 566.0024, 567.0034, 568.0044, 569.0054, 570.0064, 571.0074, 572.0084, 573.0094, 574.0104, 575.0114, 576.0124, 577.0134, 578.0144, 579.0154, 580.0164, 581.0007166666667, 582.0017166666667, 583.0027166666666, 584.0037166666667, 585.0047166666667, 586.0057166666667, 587.0067166666666, 588.0077166666666, 589.0087166666667, 590.0097166666667, 591.0107166666667, 592.0117166666666, 593.0127166666666], "recent_frames_sha256": "e6a1569d22fbca39ebcb90ee26d4d3b360e8f37bf09206bbe496ac671380d13d", "num_recent_frames": 30, "tq": 710046.755849376, "t1": 710052.855213154, "ta": 710052.855213154, "te": 710052.89195796, "first_response_s": 6.099363778019324, "answer_total_s": 6.136108584003523, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_273_a694_q0", "video_id": 273, "time_stamp_s": 594, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "729ac11be399fa030a37aec5e634fa6a2f50203aee5409d83b99a763fed72d6d", "condition_order": ["recent", "notes"], "memory": "[180-210s] - Player character in striped shirt walks away from blue car, then approaches a wall with a yellow warning sign.  \n- Player character climbs a set of stairs leading to an upper level, then descends to a lower parking area.  \n- Blue car is parked in a designated spot near a building entrance, with a \"NO PARKING\" sign visible nearby.\n[210-240s] - Player character exits a blue car and walks toward a building entrance.  \n- Character ascends stairs and runs across a rooftop area toward a glass door.  \n- Door labeled \"Union Depository\" is approached as the character enters.\n[240-270s] - Player character in striped shirt runs across a rooftop platform, then jumps down to a lower level.\n- Character lands on a paved street area with yellow bollards, moving toward a parked car.\n- Game UI shows player's health and armor stats, with a map overlay visible in the top-left corner.\n[270-300s] - Player character in striped shirt runs across a parking lot, passing a white van and a green bus.  \n- A police officer named Daniel Armstrong appears, standing near a red vending machine, with a dialogue box open.  \n- The player character approaches the officer, suggesting an interaction or confrontation.\n[300-330s] - Daniel Armstrong, in a police uniform with a helmet, stands facing a player character in a striped shirt, appearing to interact or confront them.  \n- The player character is positioned slightly behind Daniel, with their back to the camera, suggesting a dialogue or interaction sequence.  \n- A smartphone interface is visible on the right side of the screen, displaying a \"Phone\" menu with options like \"Call,\" \"Text,\" and \"Messages,\" indicating an in-game communication feature.\n[330-360s] - Player character in striped shirt approaches a red \"AREA UNDER SURVEILLANCE\" box, then interacts with a nearby security camera.  \n- A security guard named \"Daniel Alvaro\" appears in a close-up, wearing a helmet and uniform, with a dialogue box indicating he is a \"Security Guard.\"  \n- Player character walks toward a white van with green trim, approaching its driver-side door, which is open.\n[360-390s] - Player character in striped shirt interacts with a smartphone, opening a map interface showing a city layout.  \n- Player approaches a large white and green armored truck labeled \"PUTTING U IN SECURE\" and \"gruppe\" on its side.  \n- Player character crouches near the truck's rear, suggesting stealth or preparation for an action.\n[390-420s] - Player character walks toward a white van with \"gruppe\" branding parked in a lot, then turns to face a concrete pillar.  \n- Map view shows a zoomed-in area around \"San Andreas Avenue\" and \"Downtown\" with multiple colored markers.  \n- Player character approaches the van, then turns to face a white van with \"gruppe\" branding parked in a lot, then turns to face a concrete pillar.\n[420-450s] - Player character in striped shirt runs past a white armored truck with \"Bank of Life\" branding.  \n- Player character ascends a set of stairs leading to an elevated area near a building entrance.  \n- A blue car is parked in the foreground as the player moves toward it.\n[450-480s] - Blue car drives through a parking lot, then turns onto a highway with multiple lanes and overhead structures.\n- Player character exits the car and walks toward a building entrance, then re-enters the vehicle.\n- Game map is displayed, showing the player's location and nearby points of interest, including a beach and city streets.\n[480-510s] - Player character stands beside a white van with green trim, facing away from camera, near parking lot markings.\n- Blue car is parked nearby, visible in background, with its driver's side door open.\n- Player character walks slowly toward the van, passing a red-and-white striped barrier.\n[510-540s] - Player character walks past a white van with \"gruppe\" logo parked in a garage.\n- Player enters a dimly lit indoor corridor, passing a red fire extinguisher cabinet.\n- A security guard in dark uniform stands near a wall, facing away from the player.\n[540-570s] - Player character in striped shirt walks past a red fire extinguisher box in a dimly lit parking garage.  \n- A police officer with a cap and tactical gear approaches the player, initiating an interaction.  \n- Chat messages and a map overlay are visible on the screen, indicating live streaming context.", "history_tokens": 1004, "history_utf8_bytes": 4344, "recent_frame_times_s": [564.0004, 565.0014, 566.0024, 567.0034, 568.0044, 569.0054, 570.0064, 571.0074, 572.0084, 573.0094, 574.0104, 575.0114, 576.0124, 577.0134, 578.0144, 579.0154, 580.0164, 581.0007166666667, 582.0017166666667, 583.0027166666666, 584.0037166666667, 585.0047166666667, 586.0057166666667, 587.0067166666666, 588.0077166666666, 589.0087166666667, 590.0097166666667, 591.0107166666667, 592.0117166666666, 593.0127166666666], "recent_frames_sha256": "e6a1569d22fbca39ebcb90ee26d4d3b360e8f37bf09206bbe496ac671380d13d", "num_recent_frames": 30, "tq": 710218.665866149, "t1": 710227.782350978, "ta": 710227.782350978, "te": 710227.828134234, "first_response_s": 9.116484828991815, "answer_total_s": 9.16226808493957, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 274, "content_group": "9599b2b805c9547769222966f3ac00873ffbf77b725ccd7ddbbe803c43a51996", "question": {"question_id": "sample_274_a2247_q0", "video_id": 274, "video_path": "./videos/sample_274_real.mp4", "annotation_index": 2247, "question_index": 0, "question": "Where is the red fire hose box located right now?", "options": ["A. Hanging on the wall.", "B. Set on the table.", "C. Placed on the shelf.", "D. Attached to the ceiling."], "answer": "A", "time_stamp_s": 6, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_274_a2247_q0", "video_id": 274, "time_stamp_s": 6, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "58506fb89cac035bee5cfb6d82a559807180a29f990ddde7b021d06d9714e2a5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.028, 1.0123166666666668, 2.013316666666667, 3.0143166666666668, 4.015316666666667, 5.0163166666666665], "recent_frames_sha256": "5b815191690d383e31399ced4651aaf87bae35263592063ec8881174f723eda5", "num_recent_frames": 6, "tq": 716422.968558591, "t1": 716423.390978758, "ta": 716423.390978758, "te": 716423.428799937, "first_response_s": 0.4224201670149341, "answer_total_s": 0.46024134603794664, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_274_a2247_q0", "video_id": 274, "time_stamp_s": 6, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5cf3cb45bc1e0c32c54d339f7e6874899ad6c68f6d51babff2378e2eac89bee4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.028, 1.0123166666666668, 2.013316666666667, 3.0143166666666668, 4.015316666666667, 5.0163166666666665], "recent_frames_sha256": "5b815191690d383e31399ced4651aaf87bae35263592063ec8881174f723eda5", "num_recent_frames": 6, "tq": 716475.903173658, "t1": 716487.514245025, "ta": 716487.514245025, "te": 716487.740948395, "first_response_s": 11.61107136704959, "answer_total_s": 11.837774737039581, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 274, "content_group": "9599b2b805c9547769222966f3ac00873ffbf77b725ccd7ddbbe803c43a51996", "question": {"question_id": "sample_274_a2248_q0", "video_id": 274, "video_path": "./videos/sample_274_real.mp4", "annotation_index": 2248, "question_index": 0, "question": "What is the relationship between the power lines and the trees right now?", "options": ["A. The power lines run vertically next to the trees.", "B. The power lines run horizontally across the scene with trees in the background.", "C. The power lines are not visible.", "D. The power lines are beneath the trees."], "answer": "B", "time_stamp_s": 161, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_274_a2248_q0", "video_id": 274, "time_stamp_s": 161, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "02a673bbaa3cf8570213554029101a005ad4df66e74b8240a6df0d11ae89cd28", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [131.00885, 132.00985, 133.01085, 134.01185, 135.01285, 136.01385, 137.01485, 138.01585, 139.00016666666667, 140.00116666666668, 141.00216666666665, 142.00316666666666, 143.00416666666666, 144.00516666666667, 145.00616666666667, 146.00716666666668, 147.00816666666665, 148.00916666666666, 149.01016666666666, 150.01116666666667, 151.01216666666667, 152.01316666666668, 153.01416666666665, 154.01516666666666, 155.01616666666666, 156.00048333333334, 157.00148333333334, 158.00248333333334, 159.00348333333332, 160.00448333333333], "recent_frames_sha256": "f9dda0c2dfdb3d1c1ae511361d12bbce05993a62179c4e6658e55627eb3f83ac", "num_recent_frames": 30, "tq": 716423.439234795, "t1": 716435.657773209, "ta": 716435.657773209, "te": 716435.989621567, "first_response_s": 12.218538413988426, "answer_total_s": 12.550386771908961, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_274_a2248_q0", "video_id": 274, "time_stamp_s": 161, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9b413fe151a8b0f2aa51f4d3d07cdc7c716e0f14c365f9debc6df5d3b7a83f00", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Player in striped shirt stands near red mailbox, interacting with another character in dark attire.  \n- Game UI shows phone interface with app icons and a chat log on the right side of screen.  \n- Player walks away from mailbox down a dimly lit alleyway, passing parked vehicles and concrete structures.\n[30-60s] - Player character approaches a white and green \"gruppe\" van parked in a lot, then walks around its side.  \n- A red mailbox labeled \"POST\" is visible nearby, with a \"CARE\" menu open on the screen.  \n- The player character interacts with the van, possibly opening its door or inspecting it, while the game's UI displays a map and chat.\n[60-90s] - A character in a striped shirt runs toward a black car parked beside a white bus labeled \"gruppe.\"  \n- The character opens the car door and enters, then moves toward the bus's side.  \n- The bus's side panel displays a \"gruppe\" logo, and the scene is set in a dimly lit parking area.\n[90-120s] - Streamer in top-left corner wears a light-colored hoodie and gestures while speaking.  \n- Video player displays a dark, stylized anime scene with a character in a room, then transitions to a game loading screen.  \n- Game interface shows \"Connecting\" with \"Roflcat 4.0-SP\" and \"loading game...\" text, indicating a game startup process.\n[120-150s] - Game screen displays \"VINEWOOD\" sign in teal, appearing over a mountainous terrain.  \n- Player's HUD shows \"loading game files\" at bottom right, with health and inventory icons visible.  \n- Streamer in top-left corner gestures with hands while looking at screen, indicating interaction with game.", "history_tokens": 392, "history_utf8_bytes": 1608, "recent_frame_times_s": [131.00885, 132.00985, 133.01085, 134.01185, 135.01285, 136.01385, 137.01485, 138.01585, 139.00016666666667, 140.00116666666668, 141.00216666666665, 142.00316666666666, 143.00416666666666, 144.00516666666667, 145.00616666666667, 146.00716666666668, 147.00816666666665, 148.00916666666666, 149.01016666666666, 150.01116666666667, 151.01216666666667, 152.01316666666668, 153.01416666666665, 154.01516666666666, 155.01616666666666, 156.00048333333334, 157.00148333333334, 158.00248333333334, 159.00348333333332, 160.00448333333333], "recent_frames_sha256": "f9dda0c2dfdb3d1c1ae511361d12bbce05993a62179c4e6658e55627eb3f83ac", "num_recent_frames": 30, "tq": 716533.223282263, "t1": 716538.612425963, "ta": 716538.612425963, "te": 716538.650154579, "first_response_s": 5.389143700012937, "answer_total_s": 5.426872315932997, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 274, "content_group": "9599b2b805c9547769222966f3ac00873ffbf77b725ccd7ddbbe803c43a51996", "question": {"question_id": "sample_274_a2249_q0", "video_id": 274, "video_path": "./videos/sample_274_real.mp4", "annotation_index": 2249, "question_index": 0, "question": "What was the man in the black jacket and white hoodie doing just now?", "options": ["A. Standing up near the man wearing a striped shirt.", "B. Using a smartphone.", "C. Walking towards the camera.", "D. Talking to a man in a white shirt."], "answer": "A", "time_stamp_s": 330, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_274_a2249_q0", "video_id": 274, "time_stamp_s": 330, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "be834a056916570b64d365f0e8c04e47c55f6ea2899c154e982b5228e20e6e9a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [300.01101666666665, 301.0120166666667, 302.01301666666666, 303.0140166666667, 304.01501666666667, 305.01601666666664, 306.00033333333334, 307.0013333333333, 308.00233333333335, 309.00333333333333, 310.0043333333333, 311.00533333333334, 312.0063333333333, 313.00733333333335, 314.0083333333333, 315.00933333333336, 316.01033333333334, 317.0113333333333, 318.01233333333334, 319.0133333333333, 320.01433333333335, 321.01533333333333, 322.0163333333333, 323.00065, 324.00165, 325.00265, 326.00365, 327.00465, 328.00565, 329.00665], "recent_frames_sha256": "ce50e49012bd57abc2d60954bf9641bd0fcfc56ba8c1c92de088f224693f1781", "num_recent_frames": 30, "tq": 716436.002657594, "t1": 716449.690308575, "ta": 716449.690308575, "te": 716449.727912863, "first_response_s": 13.687650981009938, "answer_total_s": 13.725255268975161, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_274_a2249_q0", "video_id": 274, "time_stamp_s": 330, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c2f3a46d5b2dd40a9d483519268f2dd37cb2ded0c7cea59924e491d4ba041fb8", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Player in striped shirt stands near red mailbox, interacting with another character in dark attire.  \n- Game UI shows phone interface with app icons and a chat log on the right side of screen.  \n- Player walks away from mailbox down a dimly lit alleyway, passing parked vehicles and concrete structures.\n[30-60s] - Player character approaches a white and green \"gruppe\" van parked in a lot, then walks around its side.  \n- A red mailbox labeled \"POST\" is visible nearby, with a \"CARE\" menu open on the screen.  \n- The player character interacts with the van, possibly opening its door or inspecting it, while the game's UI displays a map and chat.\n[60-90s] - A character in a striped shirt runs toward a black car parked beside a white bus labeled \"gruppe.\"  \n- The character opens the car door and enters, then moves toward the bus's side.  \n- The bus's side panel displays a \"gruppe\" logo, and the scene is set in a dimly lit parking area.\n[90-120s] - Streamer in top-left corner wears a light-colored hoodie and gestures while speaking.  \n- Video player displays a dark, stylized anime scene with a character in a room, then transitions to a game loading screen.  \n- Game interface shows \"Connecting\" with \"Roflcat 4.0-SP\" and \"loading game...\" text, indicating a game startup process.\n[120-150s] - Game screen displays \"VINEWOOD\" sign in teal, appearing over a mountainous terrain.  \n- Player's HUD shows \"loading game files\" at bottom right, with health and inventory icons visible.  \n- Streamer in top-left corner gestures with hands while looking at screen, indicating interaction with game.\n[150-180s] - Player's camera pans over a dark, grassy terrain transitioning into a dimly lit indoor environment with glowing blue-green lights.  \n- A large, shadowy creature is visible in the distance within the indoor setting, partially obscured by darkness.  \n- The player's HUD remains static, showing health, ammo, and a map, while chat messages scroll on the right side of the screen.\n[180-210s] - Player character in striped shirt bends down to inspect a white truck labeled \"gruppe\" at night.  \n- Player moves toward a parked black car beside the truck, then proceeds to a circular traffic island.  \n- Map overlay shows \"Santos\" as the current location, with a green arrow indicating direction to \"Santos Central\".\n[210-240s] - Player's in-game map view shows a coastal city with numerous marked locations, including a highlighted area near the water.\n- A small inset window displays the player's webcam feed, showing a person with blonde hair wearing a white shirt.\n- The map interface includes a list of player names and their statuses, with some entries marked as \"Online\" or \"Offline.\"\n[240-270s] - Player character stands beside a black car at night, holding a phone with a visible app interface.  \n- In-game map displays a coastal region with marked locations and a central lake.  \n- Chat window shows active player interactions and messages, including a \"New Message\" notification.\n[270-300s] - Player character in striped shirt approaches a black car near a green cart, then walks toward a security booth.  \n- A security guard in uniform stands near a red panel, and another character in dark clothing appears nearby.  \n- Player character interacts with the security guard, triggering a dialogue box identifying him as \"Daniel Armstrong.\"\n[300-330s] - Player in striped shirt holds phone, walking past others in a dimly lit area.  \n- A man in a black hoodie walks away from the group, moving toward the right side of the screen.  \n- A smartphone UI overlay shows app icons and a \"Download\" prompt, indicating an in-game interaction.", "history_tokens": 858, "history_utf8_bytes": 3656, "recent_frame_times_s": [300.01101666666665, 301.0120166666667, 302.01301666666666, 303.0140166666667, 304.01501666666667, 305.01601666666664, 306.00033333333334, 307.0013333333333, 308.00233333333335, 309.00333333333333, 310.0043333333333, 311.00533333333334, 312.0063333333333, 313.00733333333335, 314.0083333333333, 315.00933333333336, 316.01033333333334, 317.0113333333333, 318.01233333333334, 319.0133333333333, 320.01433333333335, 321.01533333333333, 322.0163333333333, 323.00065, 324.00165, 325.00265, 326.00365, 327.00465, 328.00565, 329.00665], "recent_frames_sha256": "ce50e49012bd57abc2d60954bf9641bd0fcfc56ba8c1c92de088f224693f1781", "num_recent_frames": 30, "tq": 716597.520344209, "t1": 716598.911502488, "ta": 716598.911502488, "te": 716598.948861257, "first_response_s": 1.3911582789150998, "answer_total_s": 1.4285170480143279, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 274, "content_group": "9599b2b805c9547769222966f3ac00873ffbf77b725ccd7ddbbe803c43a51996", "question": {"question_id": "sample_274_a2250_q0", "video_id": 274, "video_path": "./videos/sample_274_real.mp4", "annotation_index": 2250, "question_index": 0, "question": "Where is the character's camera footage positioned on the city map right now?", "options": ["A. In the center of the map.", "B. Near the coast towards the left.", "C. At the top of the map.", "D. In a park towards the right."], "answer": "B", "time_stamp_s": 500, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_274_a2250_q0", "video_id": 274, "time_stamp_s": 500, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f5aa108e43387594cda4a891120c4f18e16fb094a77e956ff93b634ba511822f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [470.01418333333334, 471.0151833333333, 472.01618333333334, 473.0005, 474.0015, 475.0025, 476.0035, 477.0045, 478.0055, 479.0065, 480.0075, 481.0085, 482.0095, 483.0105, 484.0115, 485.0125, 486.0135, 487.0145, 488.0155, 489.0165, 490.00081666666665, 491.0018166666667, 492.00281666666666, 493.0038166666667, 494.00481666666667, 495.00581666666665, 496.0068166666667, 497.00781666666666, 498.0088166666667, 499.00981666666667], "recent_frames_sha256": "7848f9a16291216ee5e801e9a441a755059d3827260d6e4551296a79201e48d3", "num_recent_frames": 30, "tq": 716449.739212039, "t1": 716464.137611179, "ta": 716464.137611179, "te": 716464.174809379, "first_response_s": 14.398399139987305, "answer_total_s": 14.435597339994274, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_274_a2250_q0", "video_id": 274, "time_stamp_s": 500, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f611d8cafb51a46017eaacfc0d1dae5f857a835662df5c7035dc64c1628dad3d", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Streamer in top-left corner wears a light-colored hoodie and gestures while speaking.  \n- Video player displays a dark, stylized anime scene with a character in a room, then transitions to a game loading screen.  \n- Game interface shows \"Connecting\" with \"Roflcat 4.0-SP\" and \"loading game...\" text, indicating a game startup process.\n[120-150s] - Game screen displays \"VINEWOOD\" sign in teal, appearing over a mountainous terrain.  \n- Player's HUD shows \"loading game files\" at bottom right, with health and inventory icons visible.  \n- Streamer in top-left corner gestures with hands while looking at screen, indicating interaction with game.\n[150-180s] - Player's camera pans over a dark, grassy terrain transitioning into a dimly lit indoor environment with glowing blue-green lights.  \n- A large, shadowy creature is visible in the distance within the indoor setting, partially obscured by darkness.  \n- The player's HUD remains static, showing health, ammo, and a map, while chat messages scroll on the right side of the screen.\n[180-210s] - Player character in striped shirt bends down to inspect a white truck labeled \"gruppe\" at night.  \n- Player moves toward a parked black car beside the truck, then proceeds to a circular traffic island.  \n- Map overlay shows \"Santos\" as the current location, with a green arrow indicating direction to \"Santos Central\".\n[210-240s] - Player's in-game map view shows a coastal city with numerous marked locations, including a highlighted area near the water.\n- A small inset window displays the player's webcam feed, showing a person with blonde hair wearing a white shirt.\n- The map interface includes a list of player names and their statuses, with some entries marked as \"Online\" or \"Offline.\"\n[240-270s] - Player character stands beside a black car at night, holding a phone with a visible app interface.  \n- In-game map displays a coastal region with marked locations and a central lake.  \n- Chat window shows active player interactions and messages, including a \"New Message\" notification.\n[270-300s] - Player character in striped shirt approaches a black car near a green cart, then walks toward a security booth.  \n- A security guard in uniform stands near a red panel, and another character in dark clothing appears nearby.  \n- Player character interacts with the security guard, triggering a dialogue box identifying him as \"Daniel Armstrong.\"\n[300-330s] - Player in striped shirt holds phone, walking past others in a dimly lit area.  \n- A man in a black hoodie walks away from the group, moving toward the right side of the screen.  \n- A smartphone UI overlay shows app icons and a \"Download\" prompt, indicating an in-game interaction.\n[330-360s] - A man in a blue and white striped shirt stands facing away from the camera, observing a group of people in a dimly lit corridor.  \n- A man in a black leather jacket stands to the right, facing the group, with a phone in hand.  \n- A map interface appears on screen, showing a city layout with various markers, indicating a location or mission point.\n[360-390s] - Player character in striped shirt runs toward a blue car parked near a building.  \n- Player enters the blue car, which is positioned on a street with yellow lane markings.  \n- Game map view shows a large urban area with roads and water bodies, indicating a location in GTA V.\n[390-420s] - Player drives a blue car through urban streets, passing under bridges and near airport terminals.  \n- Map view shows multiple colored markers across the city, with a list of player names and stats on the right.  \n- Camera angle shifts from overhead map to third-person car view as the player navigates roads.\n[420-450s] - Blue car navigates a city intersection, slowing as it approaches a traffic light.  \n- A yellow \"ONE WAY\" sign is visible on the right, indicating directional traffic flow.  \n- A black car is parked across the street, stationary near a billboard.\n[450-480s] - Blue car navigates urban streets, passing pedestrians and vehicles.  \n- Player checks map overlay, focusing on coastal area near \"La Paz\" with multiple location markers.  \n- Camera briefly shifts to map view, then returns to third-person car perspective.", "history_tokens": 977, "history_utf8_bytes": 4204, "recent_frame_times_s": [470.01418333333334, 471.0151833333333, 472.01618333333334, 473.0005, 474.0015, 475.0025, 476.0035, 477.0045, 478.0055, 479.0065, 480.0075, 481.0085, 482.0095, 483.0105, 484.0115, 485.0125, 486.0135, 487.0145, 488.0155, 489.0165, 490.00081666666665, 491.0018166666667, 492.00281666666666, 493.0038166666667, 494.00481666666667, 495.00581666666665, 496.0068166666667, 497.00781666666666, 498.0088166666667, 499.00981666666667], "recent_frames_sha256": "7848f9a16291216ee5e801e9a441a755059d3827260d6e4551296a79201e48d3", "num_recent_frames": 30, "tq": 716634.669569644, "t1": 716637.165747716, "ta": 716637.165747716, "te": 716637.577046879, "first_response_s": 2.4961780719459057, "answer_total_s": 2.907477234955877, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 274, "content_group": "9599b2b805c9547769222966f3ac00873ffbf77b725ccd7ddbbe803c43a51996", "question": {"question_id": "sample_274_a2251_q0", "video_id": 274, "video_path": "./videos/sample_274_real.mp4", "annotation_index": 2251, "question_index": 0, "question": "What is the character doing right now?", "options": ["A. Running towards a closed garage door.", "B. Stopping in front of a closed garage door.", "C. Walking into the building.", "D. Turning to face the camera."], "answer": "C", "time_stamp_s": 628, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_274_a2251_q0", "video_id": 274, "time_stamp_s": 628, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "171e32c726687dc99c52a4994a19549ab4f5dd8df43585db47973c4d75eac8b9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [598.0087166666667, 599.0097166666667, 600.0107166666667, 601.0117166666666, 602.0127166666666, 603.0137166666667, 604.0147166666667, 605.0157166666667, 606.0000333333334, 607.0010333333333, 608.0020333333333, 609.0030333333333, 610.0040333333334, 611.0050333333334, 612.0060333333333, 613.0070333333333, 614.0080333333333, 615.0090333333334, 616.0100333333334, 617.0110333333333, 618.0120333333333, 619.0130333333333, 620.0140333333334, 621.0150333333333, 622.0160333333333, 623.00035, 624.00135, 625.00235, 626.00335, 627.00435], "recent_frames_sha256": "f663d9cb333aee631147cc855407eabf229aa3320276be00374780f7f6f49e56", "num_recent_frames": 30, "tq": 716464.186336496, "t1": 716475.857660989, "ta": 716475.857660989, "te": 716475.895084649, "first_response_s": 11.671324493014254, "answer_total_s": 11.70874815294519, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_274_a2251_q0", "video_id": 274, "time_stamp_s": 628, "ground_truth": "C", "raw_output": "C. Walking into the building.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "e9a0ed49d141b3c00c1869efc0f92a86e7794a2950f424842b038581b8ca5eb1", "condition_order": ["recent", "notes"], "memory": "[210-240s] - Player's in-game map view shows a coastal city with numerous marked locations, including a highlighted area near the water.\n- A small inset window displays the player's webcam feed, showing a person with blonde hair wearing a white shirt.\n- The map interface includes a list of player names and their statuses, with some entries marked as \"Online\" or \"Offline.\"\n[240-270s] - Player character stands beside a black car at night, holding a phone with a visible app interface.  \n- In-game map displays a coastal region with marked locations and a central lake.  \n- Chat window shows active player interactions and messages, including a \"New Message\" notification.\n[270-300s] - Player character in striped shirt approaches a black car near a green cart, then walks toward a security booth.  \n- A security guard in uniform stands near a red panel, and another character in dark clothing appears nearby.  \n- Player character interacts with the security guard, triggering a dialogue box identifying him as \"Daniel Armstrong.\"\n[300-330s] - Player in striped shirt holds phone, walking past others in a dimly lit area.  \n- A man in a black hoodie walks away from the group, moving toward the right side of the screen.  \n- A smartphone UI overlay shows app icons and a \"Download\" prompt, indicating an in-game interaction.\n[330-360s] - A man in a blue and white striped shirt stands facing away from the camera, observing a group of people in a dimly lit corridor.  \n- A man in a black leather jacket stands to the right, facing the group, with a phone in hand.  \n- A map interface appears on screen, showing a city layout with various markers, indicating a location or mission point.\n[360-390s] - Player character in striped shirt runs toward a blue car parked near a building.  \n- Player enters the blue car, which is positioned on a street with yellow lane markings.  \n- Game map view shows a large urban area with roads and water bodies, indicating a location in GTA V.\n[390-420s] - Player drives a blue car through urban streets, passing under bridges and near airport terminals.  \n- Map view shows multiple colored markers across the city, with a list of player names and stats on the right.  \n- Camera angle shifts from overhead map to third-person car view as the player navigates roads.\n[420-450s] - Blue car navigates a city intersection, slowing as it approaches a traffic light.  \n- A yellow \"ONE WAY\" sign is visible on the right, indicating directional traffic flow.  \n- A black car is parked across the street, stationary near a billboard.\n[450-480s] - Blue car navigates urban streets, passing pedestrians and vehicles.  \n- Player checks map overlay, focusing on coastal area near \"La Paz\" with multiple location markers.  \n- Camera briefly shifts to map view, then returns to third-person car perspective.\n[480-510s] - Player's map view shows a coastal city with roads, buildings, and marked locations, including a highlighted area near the water.\n- The player's character is not visible in the main screen, but the map interface indicates active gameplay with various icons and markers.\n- The map zooms out slightly, revealing more of the city layout and surrounding water, with no visible changes in the player's position or actions.\n[510-540s] - Blue car drives through urban streets, passing under an overpass and approaching a highway intersection.\n- Player’s in-game map is visible in the bottom-left corner, showing route and nearby points of interest.\n- Chat messages appear on the right side of the screen, indicating live viewer interaction.\n[540-570s] - Player's blue car is stationary on a city street, with a map overlay showing route markers and a speedometer reading 78 mph.\n- The player is viewing a large city map with multiple colored markers indicating locations, and a sidebar listing various in-game options and stats.\n- The player's webcam shows them looking at the screen, with a visible headset and a gaming setup in the background.\n[570-600s] - Blue car drives along a street with palm trees and buildings, passing a \"TUNE UP\" shop.  \n- Player's in-game map shows a purple route, indicating planned path.  \n- Game UI displays chat messages and player stats on the right side of screen.", "history_tokens": 963, "history_utf8_bytes": 4232, "recent_frame_times_s": [598.0087166666667, 599.0097166666667, 600.0107166666667, 601.0117166666666, 602.0127166666666, 603.0137166666667, 604.0147166666667, 605.0157166666667, 606.0000333333334, 607.0010333333333, 608.0020333333333, 609.0030333333333, 610.0040333333334, 611.0050333333334, 612.0060333333333, 613.0070333333333, 614.0080333333333, 615.0090333333334, 616.0100333333334, 617.0110333333333, 618.0120333333333, 619.0130333333333, 620.0140333333334, 621.0150333333333, 622.0160333333333, 623.00035, 624.00135, 625.00235, 626.00335, 627.00435], "recent_frames_sha256": "f663d9cb333aee631147cc855407eabf229aa3320276be00374780f7f6f49e56", "num_recent_frames": 30, "tq": 716663.625576897, "t1": 716669.816051772, "ta": 716669.816051772, "te": 716670.19485043, "first_response_s": 6.19047487503849, "answer_total_s": 6.569273533066735, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 275, "content_group": "6be2776c57e68156936fee988e6f34024038a1524f3ebaf31d664537d8ff0d6e", "question": {"question_id": "sample_275_a158_q0", "video_id": 275, "video_path": "./videos/sample_275_real.mp4", "annotation_index": 158, "question_index": 0, "question": "What is the character doing right now?", "options": ["A. Running towards the center of the dealership.", "B. Stopping in the showroom area.", "C. Interacting with the computer terminal.", "D. Viewing the car selection interface."], "answer": "D", "time_stamp_s": 17, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_275_a158_q0", "video_id": 275, "time_stamp_s": 17, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2c38b13d3bd51c08c5e63ceec8cb7c0076fdb31a5ae2182fcf1190cc2e8c3c28", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.034, 1.0016333333333334, 2.0026333333333333, 3.003633333333333, 4.0046333333333335, 5.005633333333333, 6.006633333333333, 7.007633333333334, 8.008633333333334, 9.009633333333333, 10.010633333333333, 11.011633333333334, 12.012633333333333, 13.013633333333333, 14.014633333333334, 15.015633333333334, 16.016633333333335], "recent_frames_sha256": "ac07607382d2a8b31bc701a66e7354b89c22f382f6d9d60f56264bd3548b3fc9", "num_recent_frames": 17, "tq": 718984.418688587, "t1": 718985.259925696, "ta": 718985.259925696, "te": 718985.298165679, "first_response_s": 0.8412371089216322, "answer_total_s": 0.8794770919485018, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_275_a158_q0", "video_id": 275, "time_stamp_s": 17, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "65ee541decd96347d4b1feeda804db39b77a9dca861d3cd100f477d70c6aa216", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.034, 1.0016333333333334, 2.0026333333333333, 3.003633333333333, 4.0046333333333335, 5.005633333333333, 6.006633333333333, 7.007633333333334, 8.008633333333334, 9.009633333333333, 10.010633333333333, 11.011633333333334, 12.012633333333333, 13.013633333333333, 14.014633333333334, 15.015633333333334, 16.016633333333335], "recent_frames_sha256": "ac07607382d2a8b31bc701a66e7354b89c22f382f6d9d60f56264bd3548b3fc9", "num_recent_frames": 17, "tq": 718779.516835375, "t1": 718787.111146201, "ta": 718787.111146201, "te": 718787.151749914, "first_response_s": 7.594310826039873, "answer_total_s": 7.634914539055899, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 275, "content_group": "6be2776c57e68156936fee988e6f34024038a1524f3ebaf31d664537d8ff0d6e", "question": {"question_id": "sample_275_a159_q0", "video_id": 275, "video_path": "./videos/sample_275_real.mp4", "annotation_index": 159, "question_index": 0, "question": "What is the player doing right now?", "options": ["A. Interacting with the chat window.", "B. Selecting a game character.", "C. Browsing the job options list.", "D. Customizing the game character's appearance."], "answer": "C", "time_stamp_s": 144, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_275_a159_q0", "video_id": 275, "time_stamp_s": 144, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6a1f18fdcf74344fb4f91c5ff31593c3486864928a179f9c3219c94aea3dffb6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [114.01453333333333, 115.01553333333334, 116.01653333333333, 117.00085, 118.00185, 119.00285, 120.00385, 121.00485, 122.00585, 123.00685, 124.00785, 125.00885, 126.00985, 127.01085, 128.01185, 129.01285, 130.01385, 131.01485, 132.01585, 133.00016666666667, 134.00116666666668, 135.00216666666665, 136.00316666666666, 137.00416666666666, 138.00516666666667, 139.00616666666667, 140.00716666666668, 141.00816666666665, 142.00916666666666, 143.01016666666666], "recent_frames_sha256": "090154adc92c8ea84253306050803137d96856062a88a0fe23dfb408618d4760", "num_recent_frames": 30, "tq": 718985.317856592, "t1": 718998.327208059, "ta": 718998.327208059, "te": 718998.365394765, "first_response_s": 13.009351467015222, "answer_total_s": 13.047538173035719, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_275_a159_q0", "video_id": 275, "time_stamp_s": 144, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8dc4c4e3b7ce1775799f1ec44cf1f2bfe7ea5fff7bb5c8988c4937e95934af64", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player character in striped shirt walks toward a car dealership counter, then selects a black sports car from the inventory.  \n- A blonde-haired streamer sits at a desk, observing the gameplay, with a chat overlay showing viewer messages.  \n- The player exits the dealership, transitioning to an outdoor street scene with parked cars and palm trees visible.\n[30-60s] - A character in a striped shirt approaches a man in a green vest near a \"NO PARKING\" sign, then hands him a phone.  \n- The man in the green vest, identified as \"Buddy Wrench,\" stands near a wall with a tire and boxes, then turns to face the player character.  \n- The player character walks toward a parked blue car, then stops near it, while the man in the green vest remains stationary nearby.\n[60-90s] - Player in striped shirt walks toward a building, then approaches a tire and cardboard boxes near a wall.  \n- A new character (Robby Winters) appears in a green vest and cap, standing against the wall, with a chat overlay visible.  \n- The player’s phone screen shows a notification for \"GTA V\" with a \"Download\" button, indicating an in-game action or update.\n[90-120s] - A player in a green \"AIR FORCE\" hoodie stands facing the camera, with a chat log and map visible on the right side of the screen.\n- Another player with blonde hair approaches from the left, interacting with the first player, who then turns to face them.\n- The first player's face is shown in close-up, with a visible \"CUTSCENE\" indicator on the screen, suggesting an in-game event or transition.", "history_tokens": 364, "history_utf8_bytes": 1552, "recent_frame_times_s": [114.01453333333333, 115.01553333333334, 116.01653333333333, 117.00085, 118.00185, 119.00285, 120.00385, 121.00485, 122.00585, 123.00685, 124.00785, 125.00885, 126.00985, 127.01085, 128.01185, 129.01285, 130.01385, 131.01485, 132.01585, 133.00016666666667, 134.00116666666668, 135.00216666666665, 136.00316666666666, 137.00416666666666, 138.00516666666667, 139.00616666666667, 140.00716666666668, 141.00816666666665, 142.00916666666666, 143.01016666666666], "recent_frames_sha256": "090154adc92c8ea84253306050803137d96856062a88a0fe23dfb408618d4760", "num_recent_frames": 30, "tq": 718822.155627675, "t1": 718829.679906025, "ta": 718829.679906025, "te": 718829.722059826, "first_response_s": 7.524278349941596, "answer_total_s": 7.566432151012123, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 275, "content_group": "6be2776c57e68156936fee988e6f34024038a1524f3ebaf31d664537d8ff0d6e", "question": {"question_id": "sample_275_a160_q0", "video_id": 275, "video_path": "./videos/sample_275_real.mp4", "annotation_index": 160, "question_index": 0, "question": "What is the person in the webcam window doing right now?", "options": ["A. Narrating and interacting with a digital map.", "B. Reacting to a tram station scene.", "C. Waiting for the game to finish loading..", "D. Switching between different screens."], "answer": "C", "time_stamp_s": 300, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_275_a160_q0", "video_id": 275, "time_stamp_s": 300, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a4037e17bf08cfc89e6abb61d7c7cc7c4470dd1c78dceff66cffcc7c7a3eef5f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [270.0037, 271.0047, 272.0057, 273.0067, 274.0077, 275.0087, 276.0097, 277.0107, 278.0117, 279.0127, 280.0137, 281.0147, 282.0157, 283.0000166666667, 284.00101666666666, 285.0020166666667, 286.00301666666667, 287.00401666666664, 288.0050166666667, 289.00601666666665, 290.0070166666667, 291.00801666666666, 292.00901666666664, 293.0100166666667, 294.01101666666665, 295.0120166666667, 296.01301666666666, 297.0140166666667, 298.01501666666667, 299.01601666666664], "recent_frames_sha256": "563bd64c16db5716cb26e8880d1089fa079bda7c625a0c98bb26816c7b2a5858", "num_recent_frames": 30, "tq": 718998.393510242, "t1": 719006.390497056, "ta": 719006.390497056, "te": 719006.428503736, "first_response_s": 7.996986813959666, "answer_total_s": 8.03499349404592, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_275_a160_q0", "video_id": 275, "time_stamp_s": 300, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "09aea2b9e4f1cd9b2cb0cee147e9df77f350deebeff0ffc2c166e811a6842f36", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player character in striped shirt walks toward a car dealership counter, then selects a black sports car from the inventory.  \n- A blonde-haired streamer sits at a desk, observing the gameplay, with a chat overlay showing viewer messages.  \n- The player exits the dealership, transitioning to an outdoor street scene with parked cars and palm trees visible.\n[30-60s] - A character in a striped shirt approaches a man in a green vest near a \"NO PARKING\" sign, then hands him a phone.  \n- The man in the green vest, identified as \"Buddy Wrench,\" stands near a wall with a tire and boxes, then turns to face the player character.  \n- The player character walks toward a parked blue car, then stops near it, while the man in the green vest remains stationary nearby.\n[60-90s] - Player in striped shirt walks toward a building, then approaches a tire and cardboard boxes near a wall.  \n- A new character (Robby Winters) appears in a green vest and cap, standing against the wall, with a chat overlay visible.  \n- The player’s phone screen shows a notification for \"GTA V\" with a \"Download\" button, indicating an in-game action or update.\n[90-120s] - A player in a green \"AIR FORCE\" hoodie stands facing the camera, with a chat log and map visible on the right side of the screen.\n- Another player with blonde hair approaches from the left, interacting with the first player, who then turns to face them.\n- The first player's face is shown in close-up, with a visible \"CUTSCENE\" indicator on the screen, suggesting an in-game event or transition.\n[120-150s] - A male character in a green \"AIR FORCE\" hoodie stands facing slightly right, with a neutral expression, against a textured wall background.\n- A smartphone UI overlay appears on the right side of the screen, showing app icons and a notification panel, indicating an in-game or virtual interface.\n- The streamer's webcam feed is visible in the top-left corner, showing a person with blonde hair wearing headphones, seated in a room with shelves and equipment.\n[150-180s] - Player character wears green \"AIR FORCE\" hoodie, standing against textured wall.  \n- Chat window displays viewer messages and streamer's reactions.  \n- Inventory menu opens, showing character customization options with a dog icon highlighted.\n[180-210s] - In-game character wears green \"AIR FORCE\" hoodie, standing against textured wall.  \n- Streamer in top-left inset wears light-colored hoodie, seated in dimly lit room with shelves.  \n- Chat window on right displays active messages, including user \"Crazy\" and \"Crazy\" reacting to \"Crazy\" in chat.\n[210-240s] - Streamer in top-left webcam view smiles while holding a controller.  \n- Video player displays an anime scene with a character in a dimly lit room.  \n- A \"Connecting\" dialog box from \"Roflcopter 4.0.0\" appears centered on screen.\n[240-270s] - Game screen shows a dark, forested area with a small building visible on the right, under a greenish sky.  \n- Player's webcam feed displays a person in a light-colored hoodie, gesturing with hands while speaking.  \n- Chat window on the right lists viewer messages, including one about \"Rust\" and another about \"Rust\" being \"the best game.\"\n[270-300s] - Player's webcam view shows a person in a white hoodie, looking at the screen.  \n- Game map displays a city layout with various icons and a highlighted area near the top right.  \n- Game transitions to an underwater scene with a green tint, showing a submerged city environment.", "history_tokens": 823, "history_utf8_bytes": 3472, "recent_frame_times_s": [270.0037, 271.0047, 272.0057, 273.0067, 274.0077, 275.0087, 276.0097, 277.0107, 278.0117, 279.0127, 280.0137, 281.0147, 282.0157, 283.0000166666667, 284.00101666666666, 285.0020166666667, 286.00301666666667, 287.00401666666664, 288.0050166666667, 289.00601666666665, 290.0070166666667, 291.00801666666666, 292.00901666666664, 293.0100166666667, 294.01101666666665, 295.0120166666667, 296.01301666666666, 297.0140166666667, 298.01501666666667, 299.01601666666664], "recent_frames_sha256": "563bd64c16db5716cb26e8880d1089fa079bda7c625a0c98bb26816c7b2a5858", "num_recent_frames": 30, "tq": 718880.624387741, "t1": 718882.19344091, "ta": 718882.19344091, "te": 718882.383624536, "first_response_s": 1.5690531689906493, "answer_total_s": 1.7592367950128391, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 275, "content_group": "6be2776c57e68156936fee988e6f34024038a1524f3ebaf31d664537d8ff0d6e", "question": {"question_id": "sample_275_a161_q0", "video_id": 275, "video_path": "./videos/sample_275_real.mp4", "annotation_index": 161, "question_index": 0, "question": "What is the car doing right now?", "options": ["A. Turning left at the intersection.", "B. Moving forward through the crosswalk.", "C. Driving straight under an overpass.", "D. Veering slightly to the right into a parking area."], "answer": "D", "time_stamp_s": 433, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_275_a161_q0", "video_id": 275, "time_stamp_s": 433, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f525cc972e9fdd5fb6a9b8b9ee1862a8375e568c755ccbd2bbf2c1b9f3836b31", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [403.00323333333336, 404.00423333333333, 405.0052333333333, 406.00623333333334, 407.0072333333333, 408.00823333333335, 409.0092333333333, 410.01023333333336, 411.01123333333334, 412.0122333333333, 413.01323333333335, 414.0142333333333, 415.01523333333336, 416.01623333333333, 417.00055, 418.00155, 419.00255, 420.00355, 421.00455, 422.00555, 423.00655, 424.00755, 425.00855, 426.00955, 427.01055, 428.01155, 429.01255, 430.01355, 431.01455, 432.01555], "recent_frames_sha256": "59a6d5a5b71019fa8bb248b5d738342d13381a03be4d2319f9707dfa38d584cb", "num_recent_frames": 30, "tq": 719006.445824334, "t1": 719019.316975786, "ta": 719019.316975786, "te": 719019.355246354, "first_response_s": 12.871151451952755, "answer_total_s": 12.909422019962221, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_275_a161_q0", "video_id": 275, "time_stamp_s": 433, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6222b3ac255a3ddf3f7748261dfea1679c5b08fd18ced8009b7df8098e3f5576", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Player in striped shirt walks toward a building, then approaches a tire and cardboard boxes near a wall.  \n- A new character (Robby Winters) appears in a green vest and cap, standing against the wall, with a chat overlay visible.  \n- The player’s phone screen shows a notification for \"GTA V\" with a \"Download\" button, indicating an in-game action or update.\n[90-120s] - A player in a green \"AIR FORCE\" hoodie stands facing the camera, with a chat log and map visible on the right side of the screen.\n- Another player with blonde hair approaches from the left, interacting with the first player, who then turns to face them.\n- The first player's face is shown in close-up, with a visible \"CUTSCENE\" indicator on the screen, suggesting an in-game event or transition.\n[120-150s] - A male character in a green \"AIR FORCE\" hoodie stands facing slightly right, with a neutral expression, against a textured wall background.\n- A smartphone UI overlay appears on the right side of the screen, showing app icons and a notification panel, indicating an in-game or virtual interface.\n- The streamer's webcam feed is visible in the top-left corner, showing a person with blonde hair wearing headphones, seated in a room with shelves and equipment.\n[150-180s] - Player character wears green \"AIR FORCE\" hoodie, standing against textured wall.  \n- Chat window displays viewer messages and streamer's reactions.  \n- Inventory menu opens, showing character customization options with a dog icon highlighted.\n[180-210s] - In-game character wears green \"AIR FORCE\" hoodie, standing against textured wall.  \n- Streamer in top-left inset wears light-colored hoodie, seated in dimly lit room with shelves.  \n- Chat window on right displays active messages, including user \"Crazy\" and \"Crazy\" reacting to \"Crazy\" in chat.\n[210-240s] - Streamer in top-left webcam view smiles while holding a controller.  \n- Video player displays an anime scene with a character in a dimly lit room.  \n- A \"Connecting\" dialog box from \"Roflcopter 4.0.0\" appears centered on screen.\n[240-270s] - Game screen shows a dark, forested area with a small building visible on the right, under a greenish sky.  \n- Player's webcam feed displays a person in a light-colored hoodie, gesturing with hands while speaking.  \n- Chat window on the right lists viewer messages, including one about \"Rust\" and another about \"Rust\" being \"the best game.\"\n[270-300s] - Player's webcam view shows a person in a white hoodie, looking at the screen.  \n- Game map displays a city layout with various icons and a highlighted area near the top right.  \n- Game transitions to an underwater scene with a green tint, showing a submerged city environment.\n[300-330s] - Player navigates a dimly lit, futuristic interior with glowing blue panels and statues.\n- Camera pans to reveal a map interface showing \"Savannah\" as the current location.\n- Player exits the scene, transitioning to an outdoor setting with palm trees and a truck visible.\n[330-360s] - Player character walks past stacked cardboard boxes labeled \"PRIORITY MAIL\" and \"FEDERAL EXPRESS\" near a building.  \n- Player character turns and runs along a sidewalk past palm trees and storefronts, heading toward a street corner.  \n- Player character approaches a red car parked near a curb, with a \"PLEASE DO NOT ENTER\" sign visible nearby.\n[360-390s] - Player character walks toward a blue car, then opens its door and enters.  \n- The car is parked on the side of a street with palm trees and traffic lights visible.  \n- A smartphone interface is displayed on the right, showing app icons and a chat window with viewer messages.\n[390-420s] - Blue car drives through city streets, passing traffic lights and buildings, with speed fluctuating between 80-100 mph.\n- Player's avatar, wearing a white hoodie, is visible in a small inset window on the top left, reacting to gameplay.\n- A red Santa hat icon appears briefly on screen, indicating a possible in-game event or notification.", "history_tokens": 948, "history_utf8_bytes": 3982, "recent_frame_times_s": [403.00323333333336, 404.00423333333333, 405.0052333333333, 406.00623333333334, 407.0072333333333, 408.00823333333335, 409.0092333333333, 410.01023333333336, 411.01123333333334, 412.0122333333333, 413.01323333333335, 414.0142333333333, 415.01523333333336, 416.01623333333333, 417.00055, 418.00155, 419.00255, 420.00355, 421.00455, 422.00555, 423.00655, 424.00755, 425.00855, 426.00955, 427.01055, 428.01155, 429.01255, 430.01355, 431.01455, 432.01555], "recent_frames_sha256": "59a6d5a5b71019fa8bb248b5d738342d13381a03be4d2319f9707dfa38d584cb", "num_recent_frames": 30, "tq": 718941.616256152, "t1": 718956.230546355, "ta": 718956.230546355, "te": 718956.389687987, "first_response_s": 14.614290202967823, "answer_total_s": 14.77343183499761, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 275, "content_group": "6be2776c57e68156936fee988e6f34024038a1524f3ebaf31d664537d8ff0d6e", "question": {"question_id": "sample_275_a162_q0", "video_id": 275, "video_path": "./videos/sample_275_real.mp4", "annotation_index": 162, "question_index": 0, "question": "What is the car doing right now?", "options": ["A. Speeding down the street.", "B. Hit an electric scooter and stopping on the dark street.", "C. Turning at an intersection.", "D. Parking in a garage."], "answer": "B", "time_stamp_s": 561, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_275_a162_q0", "video_id": 275, "time_stamp_s": 561, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "396c3b404919031c3dc4a3b0792a55f815dd18a9a255e6d5dcb366049f4b2640", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [531.01445, 532.01545, 533.01645, 534.0007666666667, 535.0017666666666, 536.0027666666666, 537.0037666666667, 538.0047666666667, 539.0057666666667, 540.0067666666666, 541.0077666666666, 542.0087666666667, 543.0097666666667, 544.0107666666667, 545.0117666666666, 546.0127666666667, 547.0137666666667, 548.0147666666667, 549.0157666666667, 550.0000833333334, 551.0010833333333, 552.0020833333333, 553.0030833333333, 554.0040833333334, 555.0050833333333, 556.0060833333333, 557.0070833333333, 558.0080833333334, 559.0090833333334, 560.0100833333333], "recent_frames_sha256": "2b0c702aa3ca8f7bdd59f9c68a59bbf36d57fe7f4631fdbecc01e68aec550cbd", "num_recent_frames": 30, "tq": 719019.370148697, "t1": 719034.532677797, "ta": 719034.532677797, "te": 719034.569701575, "first_response_s": 15.162529099965468, "answer_total_s": 15.199552877922542, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_275_a162_q0", "video_id": 275, "time_stamp_s": 561, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9e7a6f887a0a1002202fa876fbb2fc96ce9bbaaccaaf9b0948b187fd2398e767", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Player character wears green \"AIR FORCE\" hoodie, standing against textured wall.  \n- Chat window displays viewer messages and streamer's reactions.  \n- Inventory menu opens, showing character customization options with a dog icon highlighted.\n[180-210s] - In-game character wears green \"AIR FORCE\" hoodie, standing against textured wall.  \n- Streamer in top-left inset wears light-colored hoodie, seated in dimly lit room with shelves.  \n- Chat window on right displays active messages, including user \"Crazy\" and \"Crazy\" reacting to \"Crazy\" in chat.\n[210-240s] - Streamer in top-left webcam view smiles while holding a controller.  \n- Video player displays an anime scene with a character in a dimly lit room.  \n- A \"Connecting\" dialog box from \"Roflcopter 4.0.0\" appears centered on screen.\n[240-270s] - Game screen shows a dark, forested area with a small building visible on the right, under a greenish sky.  \n- Player's webcam feed displays a person in a light-colored hoodie, gesturing with hands while speaking.  \n- Chat window on the right lists viewer messages, including one about \"Rust\" and another about \"Rust\" being \"the best game.\"\n[270-300s] - Player's webcam view shows a person in a white hoodie, looking at the screen.  \n- Game map displays a city layout with various icons and a highlighted area near the top right.  \n- Game transitions to an underwater scene with a green tint, showing a submerged city environment.\n[300-330s] - Player navigates a dimly lit, futuristic interior with glowing blue panels and statues.\n- Camera pans to reveal a map interface showing \"Savannah\" as the current location.\n- Player exits the scene, transitioning to an outdoor setting with palm trees and a truck visible.\n[330-360s] - Player character walks past stacked cardboard boxes labeled \"PRIORITY MAIL\" and \"FEDERAL EXPRESS\" near a building.  \n- Player character turns and runs along a sidewalk past palm trees and storefronts, heading toward a street corner.  \n- Player character approaches a red car parked near a curb, with a \"PLEASE DO NOT ENTER\" sign visible nearby.\n[360-390s] - Player character walks toward a blue car, then opens its door and enters.  \n- The car is parked on the side of a street with palm trees and traffic lights visible.  \n- A smartphone interface is displayed on the right, showing app icons and a chat window with viewer messages.\n[390-420s] - Blue car drives through city streets, passing traffic lights and buildings, with speed fluctuating between 80-100 mph.\n- Player's avatar, wearing a white hoodie, is visible in a small inset window on the top left, reacting to gameplay.\n- A red Santa hat icon appears briefly on screen, indicating a possible in-game event or notification.\n[420-450s] - Blue car drives through urban streets, passing under an overpass and approaching a roundabout.  \n- Two male characters stand near the roundabout; one in a striped shirt walks toward the other.  \n- A white van is parked near the roundabout, with a character in dark clothing standing beside it.\n[450-480s] - Player in striped shirt interacts with a red fire extinguisher mounted on a wall.  \n- Two men in dark jackets stand nearby, observing the interaction.  \n- A smartphone interface appears on screen, showing app icons and a clock reading 8:35.\n[480-510s] - Player in striped shirt holds phone, standing near a red fire hydrant in a dimly lit alleyway.  \n- A man in a black hoodie stands nearby, facing the player, with a white cap and dark clothing.  \n- A third person in a green outfit is visible in the background, standing near a closed metal door.\n[510-540s] - Player character in striped shirt walks through a parking garage, passing a red fire extinguisher cabinet.  \n- A man in a black jacket stands near a pillar, facing away from the player.  \n- Player approaches a blue car parked in the lot, preparing to enter it.", "history_tokens": 938, "history_utf8_bytes": 3874, "recent_frame_times_s": [531.01445, 532.01545, 533.01645, 534.0007666666667, 535.0017666666666, 536.0027666666666, 537.0037666666667, 538.0047666666667, 539.0057666666667, 540.0067666666666, 541.0077666666666, 542.0087666666667, 543.0097666666667, 544.0107666666667, 545.0117666666666, 546.0127666666667, 547.0137666666667, 548.0147666666667, 549.0157666666667, 550.0000833333334, 551.0010833333333, 552.0020833333333, 553.0030833333333, 554.0040833333334, 555.0050833333333, 556.0060833333333, 557.0070833333333, 558.0080833333334, 559.0090833333334, 560.0100833333333], "recent_frames_sha256": "2b0c702aa3ca8f7bdd59f9c68a59bbf36d57fe7f4631fdbecc01e68aec550cbd", "num_recent_frames": 30, "tq": 718982.988121557, "t1": 718984.15945485, "ta": 718984.15945485, "te": 718984.391868704, "first_response_s": 1.171333292964846, "answer_total_s": 1.403747146949172, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 276, "content_group": "fe41119c21849d2af1806e69249b9df98664b89761facd2f936cfa60c1c3b1db", "question": {"question_id": "sample_276_a1388_q0", "video_id": 276, "video_path": "./videos/sample_276_real.mp4", "annotation_index": 1388, "question_index": 0, "question": "What did the blue car do just now?", "options": ["A. It struck the motorcyclist.", "B. It started moving.", "C. It stopped at the intersection.", "D. It swerved to avoid debris."], "answer": "A", "time_stamp_s": 8, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_276_a1388_q0", "video_id": 276, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "19adfc1db8021cb54cd78d19f5bceb1bc5fe10fb2bcbe10ea87a7eee71e96f02", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007], "recent_frames_sha256": "dcfc805f21e848ff4ae7f69ef5fde90eb2c1a4d0e494f99d1642b20d53fbbe63", "num_recent_frames": 8, "tq": 715247.411906277, "t1": 715248.094340173, "ta": 715248.094340173, "te": 715248.13349058, "first_response_s": 0.6824338959995657, "answer_total_s": 0.7215843030717224, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_276_a1388_q0", "video_id": 276, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1812e2f70d803ef3973956716f78661798c5a5302f2ad1039d0fc161a164d94e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007], "recent_frames_sha256": "dcfc805f21e848ff4ae7f69ef5fde90eb2c1a4d0e494f99d1642b20d53fbbe63", "num_recent_frames": 8, "tq": 710673.98520946, "t1": 710686.01249829, "ta": 710686.01249829, "te": 710686.363187837, "first_response_s": 12.02728883002419, "answer_total_s": 12.377978376927786, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 276, "content_group": "fe41119c21849d2af1806e69249b9df98664b89761facd2f936cfa60c1c3b1db", "question": {"question_id": "sample_276_a1389_q0", "video_id": 276, "video_path": "./videos/sample_276_real.mp4", "annotation_index": 1389, "question_index": 0, "question": "What is the blonde-haired man doing right now?", "options": ["A. Looking at his phone.", "B. Kneeling beside the person on the ground.", "C. Talking to the man with dark hair.", "D. Walking away from the scene."], "answer": "A", "time_stamp_s": 159, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_276_a1389_q0", "video_id": 276, "time_stamp_s": 159, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a39dda17de7fc5ed95ee0eeaa6871de6defdc1e117705794cd04e008b35051f6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785], "recent_frames_sha256": "7a9a7266a837852a963647f434dfb24d817b5163d87b31b088faaa0820a53c67", "num_recent_frames": 30, "tq": 715248.148702852, "t1": 715261.07844818, "ta": 715261.07844818, "te": 715261.118916999, "first_response_s": 12.929745328030549, "answer_total_s": 12.970214147004299, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_276_a1389_q0", "video_id": 276, "time_stamp_s": 159, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "34e4d3e79644855310ca800d173f5e7cafa01a204981b3f93e59b45c7299907b", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Blue car crashes into a wall, causing a passenger to be ejected and lie on the road.  \n- A pedestrian approaches the crashed car, then walks away after a brief interaction.  \n- Game UI elements show player stats, a mini-map, and a chat log with player names and messages.\n[30-60s] - Blue car is stationary with two characters lying on the road nearby, one in a white shirt and another in a dark shirt.  \n- A third character in a striped shirt approaches the downed individuals, then kneels beside them.  \n- The character in the dark shirt stands up and moves toward the striped-shirt character, who remains kneeling.\n[60-90s] - Two characters kneel beside a third character lying motionless on asphalt, appearing to perform first aid.  \n- The character in the striped shirt is actively engaged in the aid, while the other character in blue observes or assists.  \n- A large truck is visible in the background, and the scene remains static with no significant movement or environmental change.\n[90-120s] - Two male characters in a game are kneeling beside a third character lying on the road, appearing to assist or check on him.  \n- The character in the striped shirt is positioned slightly behind the one in the dark shirt, both leaning over the prone character.  \n- A smartphone interface displaying a clock reading \"16:08\" appears in the bottom right corner of the screen.\n[120-150s] - Two characters in striped and patterned shirts lie motionless on asphalt, while a third character in dark clothing kneels beside them.  \n- A black car is parked nearby, with its rear facing the camera, and the scene transitions to a street-level view under an overpass.  \n- The player’s webcam shows a smiling individual in a beige hoodie, with a chat window and mobile phone interface visible on screen.", "history_tokens": 403, "history_utf8_bytes": 1804, "recent_frame_times_s": [129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785], "recent_frames_sha256": "7a9a7266a837852a963647f434dfb24d817b5163d87b31b088faaa0820a53c67", "num_recent_frames": 30, "tq": 710725.381488015, "t1": 710731.673352597, "ta": 710731.673352597, "te": 710731.858731501, "first_response_s": 6.291864582104608, "answer_total_s": 6.477243486093357, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 276, "content_group": "fe41119c21849d2af1806e69249b9df98664b89761facd2f936cfa60c1c3b1db", "question": {"question_id": "sample_276_a1390_q0", "video_id": 276, "video_path": "./videos/sample_276_real.mp4", "annotation_index": 1390, "question_index": 0, "question": "What is the man in the patterned shirt doing right now?", "options": ["A. Sitting on the scooter, looking towards the road.", "B. Walking away from the scooter.", "C. Standing still near the scooter.", "D. Interacting with the blue car."], "answer": "A", "time_stamp_s": 356, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_276_a1390_q0", "video_id": 276, "time_stamp_s": 356, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0ab35768481e375b05bea171743630e948819c79f095fe9bedd0fb62ad9901d4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [326.00901666666664, 327.0100166666667, 328.01101666666665, 329.0120166666667, 330.01301666666666, 331.0140166666667, 332.01501666666667, 333.01601666666664, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465], "recent_frames_sha256": "f543ec96d5cc84f12c525df319cca5e42736a5598e02e680d1f31e26e731db78", "num_recent_frames": 30, "tq": 715261.13618302, "t1": 715268.117564094, "ta": 715268.117564094, "te": 715268.159261048, "first_response_s": 6.981381074059755, "answer_total_s": 7.023078027996235, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_276_a1390_q0", "video_id": 276, "time_stamp_s": 356, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fb729c5d36fe9439c897adbf2a7bfa8b2e493f7cf556da41de055d0259e8b833", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Blue car crashes into a wall, causing a passenger to be ejected and lie on the road.  \n- A pedestrian approaches the crashed car, then walks away after a brief interaction.  \n- Game UI elements show player stats, a mini-map, and a chat log with player names and messages.\n[30-60s] - Blue car is stationary with two characters lying on the road nearby, one in a white shirt and another in a dark shirt.  \n- A third character in a striped shirt approaches the downed individuals, then kneels beside them.  \n- The character in the dark shirt stands up and moves toward the striped-shirt character, who remains kneeling.\n[60-90s] - Two characters kneel beside a third character lying motionless on asphalt, appearing to perform first aid.  \n- The character in the striped shirt is actively engaged in the aid, while the other character in blue observes or assists.  \n- A large truck is visible in the background, and the scene remains static with no significant movement or environmental change.\n[90-120s] - Two male characters in a game are kneeling beside a third character lying on the road, appearing to assist or check on him.  \n- The character in the striped shirt is positioned slightly behind the one in the dark shirt, both leaning over the prone character.  \n- A smartphone interface displaying a clock reading \"16:08\" appears in the bottom right corner of the screen.\n[120-150s] - Two characters in striped and patterned shirts lie motionless on asphalt, while a third character in dark clothing kneels beside them.  \n- A black car is parked nearby, with its rear facing the camera, and the scene transitions to a street-level view under an overpass.  \n- The player’s webcam shows a smiling individual in a beige hoodie, with a chat window and mobile phone interface visible on screen.\n[150-180s] - A man in a blue shirt kneels beside an unconscious character, appearing to check or assist them.  \n- Another man in a striped shirt stands nearby, holding a phone and observing the scene.  \n- A black SUV is parked nearby, with its rear facing the camera, and a motorcycle is visible further down the road.\n[180-210s] - A man in a blue shirt kneels beside a prone character, appearing to assist or check on them.  \n- Another man in a striped shirt stands nearby, observing the situation.  \n- The prone character is lying on the ground, with a visible orange glow or effect around them, suggesting an in-game status or interaction.\n[210-240s] - Two players kneel beside a third player lying on the ground, appearing to assist or restrain them.  \n- The camera angle shifts slightly, revealing a city street environment with buildings and traffic lights in the background.  \n- A triangular orange arrow graphic appears on the road, indicating a directional or navigational cue.\n[240-270s] - A man in a blue shirt kneels beside a motionless character on the street, appearing to check on them.  \n- Another man in a striped shirt stands nearby, observing the scene.  \n- A smartphone interface is visible on the screen, displaying app icons and a time of 10:27.\n[270-300s] - A man in a blue shirt and gray pants kneels beside a man in a floral shirt, appearing to assist him.  \n- The man in the floral shirt stands up, revealing a large, muscular build, while the kneeling man remains in a crouched position.  \n- The scene transitions to a street with a blue car parked nearby, and the camera pans slightly to show the environment.\n[300-330s] - A man in a floral shirt stands near a blue car, observing as another man in a blue shirt kneels beside a third man on the ground.  \n- The man in the blue shirt stands up and walks away, leaving the kneeling man and the man in the floral shirt standing near the blue car.  \n- A white car drives past in the background, and a traffic light changes from red to green.", "history_tokens": 885, "history_utf8_bytes": 3820, "recent_frame_times_s": [326.00901666666664, 327.0100166666667, 328.01101666666665, 329.0120166666667, 330.01301666666666, 331.0140166666667, 332.01501666666667, 333.01601666666664, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465], "recent_frames_sha256": "f543ec96d5cc84f12c525df319cca5e42736a5598e02e680d1f31e26e731db78", "num_recent_frames": 30, "tq": 710776.668218429, "t1": 710787.482996463, "ta": 710787.482996463, "te": 710787.520451054, "first_response_s": 10.814778033993207, "answer_total_s": 10.852232625009492, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 276, "content_group": "fe41119c21849d2af1806e69249b9df98664b89761facd2f936cfa60c1c3b1db", "question": {"question_id": "sample_276_a1391_q0", "video_id": 276, "video_path": "./videos/sample_276_real.mp4", "annotation_index": 1391, "question_index": 0, "question": "What is the man in the striped shirt doing right now?", "options": ["A. Walking away from the blue car.", "B. Standing by the blue car.", "C. Talking to the man in the blue jacket.", "D. Gesturing with his hands."], "answer": "A", "time_stamp_s": 480, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_276_a1391_q0", "video_id": 276, "time_stamp_s": 480, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "007a7ac3e95bb5a025aaa632cb578f746dd94017e4358b6346143a1c338e1065", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [450.01623333333333, 451.00055, 452.00155, 453.00255, 454.00355, 455.00455, 456.00555, 457.00655, 458.00755, 459.00855, 460.00955, 461.01055, 462.01155, 463.01255, 464.01355, 465.01455, 466.01555, 467.01655, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666], "recent_frames_sha256": "2bb2dcbb2f7325c6f44a2714b9316bf868b2135249d6b68cbd3fefaab8f4174a", "num_recent_frames": 30, "tq": 715268.169926157, "t1": 715280.812721673, "ta": 715280.812721673, "te": 715280.976882349, "first_response_s": 12.642795516061597, "answer_total_s": 12.806956192012876, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_276_a1391_q0", "video_id": 276, "time_stamp_s": 480, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "cad1a1e84df407878590ae934aebf19e8e9edc1087eeb61f6eabfd97f533ff41", "condition_order": ["notes", "recent"], "memory": "[90-120s] - Two male characters in a game are kneeling beside a third character lying on the road, appearing to assist or check on him.  \n- The character in the striped shirt is positioned slightly behind the one in the dark shirt, both leaning over the prone character.  \n- A smartphone interface displaying a clock reading \"16:08\" appears in the bottom right corner of the screen.\n[120-150s] - Two characters in striped and patterned shirts lie motionless on asphalt, while a third character in dark clothing kneels beside them.  \n- A black car is parked nearby, with its rear facing the camera, and the scene transitions to a street-level view under an overpass.  \n- The player’s webcam shows a smiling individual in a beige hoodie, with a chat window and mobile phone interface visible on screen.\n[150-180s] - A man in a blue shirt kneels beside an unconscious character, appearing to check or assist them.  \n- Another man in a striped shirt stands nearby, holding a phone and observing the scene.  \n- A black SUV is parked nearby, with its rear facing the camera, and a motorcycle is visible further down the road.\n[180-210s] - A man in a blue shirt kneels beside a prone character, appearing to assist or check on them.  \n- Another man in a striped shirt stands nearby, observing the situation.  \n- The prone character is lying on the ground, with a visible orange glow or effect around them, suggesting an in-game status or interaction.\n[210-240s] - Two players kneel beside a third player lying on the ground, appearing to assist or restrain them.  \n- The camera angle shifts slightly, revealing a city street environment with buildings and traffic lights in the background.  \n- A triangular orange arrow graphic appears on the road, indicating a directional or navigational cue.\n[240-270s] - A man in a blue shirt kneels beside a motionless character on the street, appearing to check on them.  \n- Another man in a striped shirt stands nearby, observing the scene.  \n- A smartphone interface is visible on the screen, displaying app icons and a time of 10:27.\n[270-300s] - A man in a blue shirt and gray pants kneels beside a man in a floral shirt, appearing to assist him.  \n- The man in the floral shirt stands up, revealing a large, muscular build, while the kneeling man remains in a crouched position.  \n- The scene transitions to a street with a blue car parked nearby, and the camera pans slightly to show the environment.\n[300-330s] - A man in a floral shirt stands near a blue car, observing as another man in a blue shirt kneels beside a third man on the ground.  \n- The man in the blue shirt stands up and walks away, leaving the kneeling man and the man in the floral shirt standing near the blue car.  \n- A white car drives past in the background, and a traffic light changes from red to green.\n[330-360s] - A man in a striped shirt stands near a blue car, observing others.  \n- A man in a floral shirt is on a scooter, moving toward a black SUV.  \n- A man in a dark shirt walks toward the black SUV as the scooter rider approaches it.\n[360-390s] - Player character in striped shirt stands beside a black SUV, then walks toward a blue car.  \n- Blue car drives away from the player, moving along a city street with buildings and traffic.  \n- A scooter with a rider appears on the left side of the road, stationary near the curb.\n[390-420s] - Blue car accelerates on multi-lane road, passing white and black vehicles.  \n- Driver’s face is visible in top-left corner, wearing light-colored hoodie.  \n- Road transitions from urban streets to industrial area with visible buildings and rail tracks.\n[420-450s] - Blue car accelerates on highway, passing multiple vehicles including a red sedan and a silver convertible.  \n- Driver's HUD shows speed increasing from 84 to 128 mph, with a map and timer visible.  \n- Right side of screen displays live chat messages and player names, indicating multiplayer interaction.\n[450-480s] - Blue car drives onto a paved area with orange traffic cones and barriers, then slows to a stop near a yellow \"CLOCKIN BELL\" truck.  \n- A man in a striped shirt walks toward the car from the left side of the screen.  \n- The car's speedometer shows decreasing speed as it approaches the parking area.", "history_tokens": 1012, "history_utf8_bytes": 4248, "recent_frame_times_s": [450.01623333333333, 451.00055, 452.00155, 453.00255, 454.00355, 455.00455, 456.00555, 457.00655, 458.00755, 459.00855, 460.00955, 461.01055, 462.01155, 463.01255, 464.01355, 465.01455, 466.01555, 467.01655, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666], "recent_frames_sha256": "2bb2dcbb2f7325c6f44a2714b9316bf868b2135249d6b68cbd3fefaab8f4174a", "num_recent_frames": 30, "tq": 715216.359789603, "t1": 715223.732193409, "ta": 715223.732193409, "te": 715223.884785692, "first_response_s": 7.372403805959038, "answer_total_s": 7.524996088934131, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 276, "content_group": "fe41119c21849d2af1806e69249b9df98664b89761facd2f936cfa60c1c3b1db", "question": {"question_id": "sample_276_a1392_q0", "video_id": 276, "video_path": "./videos/sample_276_real.mp4", "annotation_index": 1392, "question_index": 0, "question": "What is the driver doing right now?", "options": ["A. Navigating through moderately empty streets.", "B. Adjusting the rearview mirror.", "C. Honking the horn.", "D. Switching on the headlights."], "answer": "A", "time_stamp_s": 619, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_276_a1392_q0", "video_id": 276, "time_stamp_s": 619, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3717d94e1803b25b15ada5a9b1407d8a4e2c7c44c94133865f199c2d13ef1a3c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [589.0050833333333, 590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074, 609.0084, 610.0094, 611.0104, 612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0007166666667], "recent_frames_sha256": "4ac7de151592d66bcd458db262a32c8af73eb06422982ddfb8e7607378fafef1", "num_recent_frames": 30, "tq": 715280.989341899, "t1": 715288.58785044, "ta": 715288.58785044, "te": 715288.829652904, "first_response_s": 7.59850854089018, "answer_total_s": 7.840311004896648, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_276_a1392_q0", "video_id": 276, "time_stamp_s": 619, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d2215e325fd8a7cb9aa044ddbe330154ef260610291d703d788ff0aef1c5968d", "condition_order": ["notes", "recent"], "memory": "[210-240s] - Two players kneel beside a third player lying on the ground, appearing to assist or restrain them.  \n- The camera angle shifts slightly, revealing a city street environment with buildings and traffic lights in the background.  \n- A triangular orange arrow graphic appears on the road, indicating a directional or navigational cue.\n[240-270s] - A man in a blue shirt kneels beside a motionless character on the street, appearing to check on them.  \n- Another man in a striped shirt stands nearby, observing the scene.  \n- A smartphone interface is visible on the screen, displaying app icons and a time of 10:27.\n[270-300s] - A man in a blue shirt and gray pants kneels beside a man in a floral shirt, appearing to assist him.  \n- The man in the floral shirt stands up, revealing a large, muscular build, while the kneeling man remains in a crouched position.  \n- The scene transitions to a street with a blue car parked nearby, and the camera pans slightly to show the environment.\n[300-330s] - A man in a floral shirt stands near a blue car, observing as another man in a blue shirt kneels beside a third man on the ground.  \n- The man in the blue shirt stands up and walks away, leaving the kneeling man and the man in the floral shirt standing near the blue car.  \n- A white car drives past in the background, and a traffic light changes from red to green.\n[330-360s] - A man in a striped shirt stands near a blue car, observing others.  \n- A man in a floral shirt is on a scooter, moving toward a black SUV.  \n- A man in a dark shirt walks toward the black SUV as the scooter rider approaches it.\n[360-390s] - Player character in striped shirt stands beside a black SUV, then walks toward a blue car.  \n- Blue car drives away from the player, moving along a city street with buildings and traffic.  \n- A scooter with a rider appears on the left side of the road, stationary near the curb.\n[390-420s] - Blue car accelerates on multi-lane road, passing white and black vehicles.  \n- Driver’s face is visible in top-left corner, wearing light-colored hoodie.  \n- Road transitions from urban streets to industrial area with visible buildings and rail tracks.\n[420-450s] - Blue car accelerates on highway, passing multiple vehicles including a red sedan and a silver convertible.  \n- Driver's HUD shows speed increasing from 84 to 128 mph, with a map and timer visible.  \n- Right side of screen displays live chat messages and player names, indicating multiplayer interaction.\n[450-480s] - Blue car drives onto a paved area with orange traffic cones and barriers, then slows to a stop near a yellow \"CLOCKIN BELL\" truck.  \n- A man in a striped shirt walks toward the car from the left side of the screen.  \n- The car's speedometer shows decreasing speed as it approaches the parking area.\n[480-510s] - A man in a blue hoodie walks toward the camera, approaching the player character.  \n- The player character, wearing a striped shirt, stands near a blue car, facing the approaching man.  \n- A large yellow \"CLUCKIN' BELL\" sign is visible in the background, with industrial structures behind it.\n[510-540s] - A blue car is parked in a lot; its driver's side door opens as a character in a striped shirt approaches.  \n- The character in the striped shirt gets into the driver's seat, then drives the car forward, passing other vehicles.  \n- The camera view shifts to a third-person perspective as the car moves, showing the surrounding industrial area and distant structures.\n[540-570s] - Blue car drives on highway, passing trucks and other vehicles, with speedometer showing 87+ mph.\n- Orange car is stationary on the road, positioned ahead of the blue car, possibly damaged or disabled.\n- Game UI displays player stats, chat messages, and a map, indicating multiplayer gameplay with visible player names and scores.\n[570-600s] - Blue car drives under a large steel bridge, then exits onto a city street with traffic lights and buildings.  \n- A white car overtakes the blue car on the right lane.  \n- The blue car continues forward, passing a concrete barrier and approaching a traffic light.", "history_tokens": 982, "history_utf8_bytes": 4106, "recent_frame_times_s": [589.0050833333333, 590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054, 607.0064, 608.0074, 609.0084, 610.0094, 611.0104, 612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0007166666667], "recent_frames_sha256": "4ac7de151592d66bcd458db262a32c8af73eb06422982ddfb8e7607378fafef1", "num_recent_frames": 30, "tq": 715246.015418437, "t1": 715247.199529736, "ta": 715247.199529736, "te": 715247.392849093, "first_response_s": 1.1841112989932299, "answer_total_s": 1.3774306559935212, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 277, "content_group": "da4f03e1349a42e0362e998e94e3f2a48594152f8a4524d76cb8c8fe7a227274", "question": {"question_id": "sample_277_a907_q0", "video_id": 277, "video_path": "./videos/sample_277_real.mp4", "annotation_index": 907, "question_index": 0, "question": "What did the car do just now?", "options": ["A. It stopped at a traffic light.", "B. It turned left at an intersection.", "C. It parked near a shopping center.", "D. It reversed into a parking space."], "answer": "C", "time_stamp_s": 13, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_277_a907_q0", "video_id": 277, "time_stamp_s": 13, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "cfefb21239710a9339c16931573bbef1df2593b173f61a4a04a08820e9b2ab5f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.034, 1.0016333333333334, 2.0026333333333333, 3.003633333333333, 4.0046333333333335, 5.005633333333333, 6.006633333333333, 7.007633333333334, 8.008633333333334, 9.009633333333333, 10.010633333333333, 11.011633333333334, 12.012633333333333], "recent_frames_sha256": "6f655e4236e6e15d2abeb083e170ed288b4b0285e8fca8cac082dca702171a07", "num_recent_frames": 13, "tq": 717991.505909187, "t1": 717997.896461531, "ta": 717997.896461531, "te": 717997.934120561, "first_response_s": 6.390552344033495, "answer_total_s": 6.4282113739755005, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_277_a907_q0", "video_id": 277, "time_stamp_s": 13, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "16e7754ee961f54cff2af3b8938543f3345d746d027064f36770f1b71f0e7d26", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.034, 1.0016333333333334, 2.0026333333333333, 3.003633333333333, 4.0046333333333335, 5.005633333333333, 6.006633333333333, 7.007633333333334, 8.008633333333334, 9.009633333333333, 10.010633333333333, 11.011633333333334, 12.012633333333333], "recent_frames_sha256": "6f655e4236e6e15d2abeb083e170ed288b4b0285e8fca8cac082dca702171a07", "num_recent_frames": 13, "tq": 718035.833335248, "t1": 718041.738220016, "ta": 718041.738220016, "te": 718041.780709168, "first_response_s": 5.904884767951444, "answer_total_s": 5.947373919887468, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 277, "content_group": "da4f03e1349a42e0362e998e94e3f2a48594152f8a4524d76cb8c8fe7a227274", "question": {"question_id": "sample_277_a908_q0", "video_id": 277, "video_path": "./videos/sample_277_real.mp4", "annotation_index": 908, "question_index": 0, "question": "What is the car doing right now?", "options": ["A. Preparing to make a right turn.", "B. Driving on a multi-lane bridge.", "C. Completing a right turn at the intersection.", "D. Stopping at a red light."], "answer": "C", "time_stamp_s": 164, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_277_a908_q0", "video_id": 277, "time_stamp_s": 164, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9c515f0fd11bf9f4f3bb149622e0c349fb2b0b774ec5b7bd3bdee646e072ae12", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [134.00116666666668, 135.00216666666665, 136.00316666666666, 137.00416666666666, 138.00516666666667, 139.00616666666667, 140.00716666666668, 141.00816666666665, 142.00916666666666, 143.01016666666666, 144.01116666666667, 145.01216666666667, 146.01316666666668, 147.01416666666665, 148.01516666666666, 149.01616666666666, 150.00048333333334, 151.00148333333334, 152.00248333333334, 153.00348333333332, 154.00448333333333, 155.00548333333333, 156.00648333333334, 157.00748333333334, 158.00848333333334, 159.00948333333332, 160.01048333333333, 161.01148333333333, 162.01248333333334, 163.01348333333334], "recent_frames_sha256": "8b9b4ba8b190397c37fc3997a8438a0ace192296d0ee329f5e9c77f6af5330a0", "num_recent_frames": 30, "tq": 717997.956109491, "t1": 718005.716390698, "ta": 718005.716390698, "te": 718005.756182358, "first_response_s": 7.760281207039952, "answer_total_s": 7.80007286707405, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_277_a908_q0", "video_id": 277, "time_stamp_s": 164, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3a18a5a061367706845725f3863d2aca559d98936c345b0f326d3aef11caa75a", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Blue car drives through a city street, stops at a crosswalk, and parks near a \"clickers\" store.  \n- Player character (in striped shirt) enters the store, approaches a counter, and interacts with a clerk.  \n- In-game menu displays various items like \"Bottle of Water,\" \"Cigarettes,\" and \"Glasses,\" with a \"Buy\" button visible.\n[30-60s] - Player selects \"Razer Blade\" laptop in store interface, then switches to \"Razer Blade\" in inventory grid.  \n- Player navigates to \"Razer Blade\" in store, then selects \"Razer Blade\" in inventory grid.  \n- Player views \"Razer Blade\" in store, then selects \"Razer Blade\" in inventory grid.\n[60-90s] - Player selects \"Dress\" item from inventory, then navigates to \"clickers Electronic Store\" in-game.  \n- In-store, player interacts with a cashier at the counter while other players stand nearby.  \n- Player opens a menu to view \"Dress\" item details, then exits to the store's main interface.\n[90-120s] - Player character in striped shirt gets into a blue car parked in a lot, then drives away.\n- The car moves through city streets lined with palm trees and buildings, with a map and speedometer visible.\n- A chat window on the right side of the screen shows viewer messages and a small webcam feed in the top-left corner.\n[120-150s] - Blue car drives through urban streets, passing palm trees and traffic lights, with speedometer showing decreasing speed.\n- A cartoonish green character with a red hat appears on the road ahead, moving slowly.\n- The car navigates a turn, then continues straight, approaching a construction zone with barriers and industrial structures.", "history_tokens": 393, "history_utf8_bytes": 1612, "recent_frame_times_s": [134.00116666666668, 135.00216666666665, 136.00316666666666, 137.00416666666666, 138.00516666666667, 139.00616666666667, 140.00716666666668, 141.00816666666665, 142.00916666666666, 143.01016666666666, 144.01116666666667, 145.01216666666667, 146.01316666666668, 147.01416666666665, 148.01516666666666, 149.01616666666666, 150.00048333333334, 151.00148333333334, 152.00248333333334, 153.00348333333332, 154.00448333333333, 155.00548333333333, 156.00648333333334, 157.00748333333334, 158.00848333333334, 159.00948333333332, 160.01048333333333, 161.01148333333333, 162.01248333333334, 163.01348333333334], "recent_frames_sha256": "8b9b4ba8b190397c37fc3997a8438a0ace192296d0ee329f5e9c77f6af5330a0", "num_recent_frames": 30, "tq": 718078.249418418, "t1": 718079.748833107, "ta": 718079.748833107, "te": 718079.939788476, "first_response_s": 1.4994146889075637, "answer_total_s": 1.6903700579423457, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 277, "content_group": "da4f03e1349a42e0362e998e94e3f2a48594152f8a4524d76cb8c8fe7a227274", "question": {"question_id": "sample_277_a909_q0", "video_id": 277, "video_path": "./videos/sample_277_real.mp4", "annotation_index": 909, "question_index": 0, "question": "What is the individual in the blue hoodie doing right now?", "options": ["A. Checking their reflection in a window.", "B. Writing on a piece of paper.", "C. Holding and looking at a tablet.", "D. Adjusting their clothing."], "answer": "C", "time_stamp_s": 332, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_277_a909_q0", "video_id": 277, "time_stamp_s": 332, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "74aa688adf9dcd459b9ef25a01afdba5a0e85994d019f791ce6b571d0a4d2e84", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [302.00233333333335, 303.00333333333333, 304.0043333333333, 305.00533333333334, 306.0063333333333, 307.00733333333335, 308.0083333333333, 309.00933333333336, 310.01033333333334, 311.0113333333333, 312.01233333333334, 313.0133333333333, 314.01433333333335, 315.01533333333333, 316.0163333333333, 317.00065, 318.00165, 319.00265, 320.00365, 321.00465, 322.00565, 323.00665, 324.00765, 325.00865, 326.00965, 327.01065, 328.01165, 329.01265, 330.01365, 331.01465], "recent_frames_sha256": "c14b5736547211f0c604a812c02e1ce2ffec3673051f1d6814630db14c1b4d52", "num_recent_frames": 30, "tq": 718005.781092803, "t1": 718017.461091209, "ta": 718017.461091209, "te": 718017.503271728, "first_response_s": 11.679998405976221, "answer_total_s": 11.722178925061598, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_277_a909_q0", "video_id": 277, "time_stamp_s": 332, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c40c1d33ac4a6dd8f6729a84069f9ad1cce908bad56b0d057708a47adff7da7c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Blue car drives through a city street, stops at a crosswalk, and parks near a \"clickers\" store.  \n- Player character (in striped shirt) enters the store, approaches a counter, and interacts with a clerk.  \n- In-game menu displays various items like \"Bottle of Water,\" \"Cigarettes,\" and \"Glasses,\" with a \"Buy\" button visible.\n[30-60s] - Player selects \"Razer Blade\" laptop in store interface, then switches to \"Razer Blade\" in inventory grid.  \n- Player navigates to \"Razer Blade\" in store, then selects \"Razer Blade\" in inventory grid.  \n- Player views \"Razer Blade\" in store, then selects \"Razer Blade\" in inventory grid.\n[60-90s] - Player selects \"Dress\" item from inventory, then navigates to \"clickers Electronic Store\" in-game.  \n- In-store, player interacts with a cashier at the counter while other players stand nearby.  \n- Player opens a menu to view \"Dress\" item details, then exits to the store's main interface.\n[90-120s] - Player character in striped shirt gets into a blue car parked in a lot, then drives away.\n- The car moves through city streets lined with palm trees and buildings, with a map and speedometer visible.\n- A chat window on the right side of the screen shows viewer messages and a small webcam feed in the top-left corner.\n[120-150s] - Blue car drives through urban streets, passing palm trees and traffic lights, with speedometer showing decreasing speed.\n- A cartoonish green character with a red hat appears on the road ahead, moving slowly.\n- The car navigates a turn, then continues straight, approaching a construction zone with barriers and industrial structures.\n[150-180s] - Blue car accelerates on a multi-lane road, passing other vehicles and approaching an industrial area.  \n- A red car overtakes the blue car on the right lane, followed by a white car.  \n- The blue car continues driving under a large bridge, with city lights visible in the distance.\n[180-210s] - Blue car drives on highway, speed decreasing from 128 to 89 mph as it approaches a bridge.\n- Red car overtakes blue car on the right lane, then exits the highway onto a ramp.\n- Blue car enters a construction zone with orange barriers and parked vehicles, slowing to 87 mph.\n[210-240s] - Blue car drives past industrial area, then stops near brick wall; player exits vehicle.\n- Player approaches and interacts with a man in a white shirt near a wooden crate, triggering a \"Friend\" interaction prompt.\n- Player character, wearing striped shirt, stands beside the man while a phone interface appears, showing app icons and a red object on the ground nearby.\n[240-270s] - Player in blue hoodie bends over, interacting with another player near a brick wall.  \n- Player in striped shirt holds a phone, standing beside the bent-over player.  \n- A red bottle lies on the ground near the wall, with a chat overlay showing viewer messages.\n[270-300s] - Player in blue hoodie stands beside a striped-shirted character near a brick wall, both facing a uniformed officer.  \n- Officer holds a phone, possibly interacting with the other two characters.  \n- A red bottle lies on the ground near the wall, and a chat window displays viewer messages.\n[300-330s] - Player character in striped shirt stands facing a man in blue jacket near a brick wall, while another man in white shirt stands nearby holding a phone.  \n- A smartphone UI overlay appears, showing app icons and a clock reading 11:34, indicating a pause or menu interaction.  \n- The player opens a menu displaying character stats and inventory, with a \"Purchased\" notification visible, suggesting an in-game purchase or item acquisition.", "history_tokens": 859, "history_utf8_bytes": 3603, "recent_frame_times_s": [302.00233333333335, 303.00333333333333, 304.0043333333333, 305.00533333333334, 306.0063333333333, 307.00733333333335, 308.0083333333333, 309.00933333333336, 310.01033333333334, 311.0113333333333, 312.01233333333334, 313.0133333333333, 314.01433333333335, 315.01533333333333, 316.0163333333333, 317.00065, 318.00165, 319.00265, 320.00365, 321.00465, 322.00565, 323.00665, 324.00765, 325.00865, 326.00965, 327.01065, 328.01165, 329.01265, 330.01365, 331.01465], "recent_frames_sha256": "c14b5736547211f0c604a812c02e1ce2ffec3673051f1d6814630db14c1b4d52", "num_recent_frames": 30, "tq": 718131.26344216, "t1": 718132.502641781, "ta": 718132.502641781, "te": 718132.652739478, "first_response_s": 1.2391996210208163, "answer_total_s": 1.389297318062745, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 277, "content_group": "da4f03e1349a42e0362e998e94e3f2a48594152f8a4524d76cb8c8fe7a227274", "question": {"question_id": "sample_277_a910_q0", "video_id": 277, "video_path": "./videos/sample_277_real.mp4", "annotation_index": 910, "question_index": 0, "question": "What did the player do just now?", "options": ["A. Exiting the driver's seat.", "B. Driving the vehicle.", "C. Finalizing inventory management.", "D. Interacting with another character."], "answer": "C", "time_stamp_s": 500, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_277_a910_q0", "video_id": 277, "time_stamp_s": 500, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "51ded5461388bd06cb8335022c65be75607f1b7af2e8ae96d8808bde39bfcb16", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [470.0035, 471.0045, 472.0055, 473.0065, 474.0075, 475.0085, 476.0095, 477.0105, 478.0115, 479.0125, 480.0135, 481.0145, 482.0155, 483.0165, 484.00081666666665, 485.0018166666667, 486.00281666666666, 487.0038166666667, 488.00481666666667, 489.00581666666665, 490.0068166666667, 491.00781666666666, 492.0088166666667, 493.00981666666667, 494.01081666666664, 495.0118166666667, 496.01281666666665, 497.0138166666667, 498.01481666666666, 499.0158166666667], "recent_frames_sha256": "18625252661322ddabd642ccd5dd25a09671a52627ce14458da4fb5544ca73a0", "num_recent_frames": 30, "tq": 718017.521426548, "t1": 718027.980116642, "ta": 718027.980116642, "te": 718028.017821886, "first_response_s": 10.458690093946643, "answer_total_s": 10.496395337977447, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_277_a910_q0", "video_id": 277, "time_stamp_s": 500, "ground_truth": "C", "raw_output": "B. Driving the vehicle.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "8a4161613fa7e3e21fcb9e527b09eca7baa2dc4242cb51213276406009a55fd3", "condition_order": ["recent", "notes"], "memory": "[120-150s] - Blue car drives through urban streets, passing palm trees and traffic lights, with speedometer showing decreasing speed.\n- A cartoonish green character with a red hat appears on the road ahead, moving slowly.\n- The car navigates a turn, then continues straight, approaching a construction zone with barriers and industrial structures.\n[150-180s] - Blue car accelerates on a multi-lane road, passing other vehicles and approaching an industrial area.  \n- A red car overtakes the blue car on the right lane, followed by a white car.  \n- The blue car continues driving under a large bridge, with city lights visible in the distance.\n[180-210s] - Blue car drives on highway, speed decreasing from 128 to 89 mph as it approaches a bridge.\n- Red car overtakes blue car on the right lane, then exits the highway onto a ramp.\n- Blue car enters a construction zone with orange barriers and parked vehicles, slowing to 87 mph.\n[210-240s] - Blue car drives past industrial area, then stops near brick wall; player exits vehicle.\n- Player approaches and interacts with a man in a white shirt near a wooden crate, triggering a \"Friend\" interaction prompt.\n- Player character, wearing striped shirt, stands beside the man while a phone interface appears, showing app icons and a red object on the ground nearby.\n[240-270s] - Player in blue hoodie bends over, interacting with another player near a brick wall.  \n- Player in striped shirt holds a phone, standing beside the bent-over player.  \n- A red bottle lies on the ground near the wall, with a chat overlay showing viewer messages.\n[270-300s] - Player in blue hoodie stands beside a striped-shirted character near a brick wall, both facing a uniformed officer.  \n- Officer holds a phone, possibly interacting with the other two characters.  \n- A red bottle lies on the ground near the wall, and a chat window displays viewer messages.\n[300-330s] - Player character in striped shirt stands facing a man in blue jacket near a brick wall, while another man in white shirt stands nearby holding a phone.  \n- A smartphone UI overlay appears, showing app icons and a clock reading 11:34, indicating a pause or menu interaction.  \n- The player opens a menu displaying character stats and inventory, with a \"Purchased\" notification visible, suggesting an in-game purchase or item acquisition.\n[330-360s] - Player character in striped shirt approaches a man in a white shirt near a brick wall, then walks toward a black van.  \n- The van, marked with \"grime\" branding, is parked near industrial structures; the player enters it.  \n- A map overlay is visible in the corner, showing a location with a yellow highlighted area.\n[360-390s] - Black van with glowing orange trim drives through an industrial area at dusk, passing warehouses and rail tracks.  \n- Player’s speedometer shows fluctuating speeds (e.g., 817, 825, 831, 841, 839, 831, 836, 831, 836, 831, 836, 831, 836, 831, 836, 831, 836, 831, 83\n[390-420s] - Player drives a black van with orange glowing side panels along a multi-lane highway at dusk, passing under an overpass.  \n- A red car is visible ahead on the right lane, and the van maintains a steady speed, indicated by the speedometer reading around 85 mph.  \n- The game’s HUD shows a mini-map, speed, and a list of players or objectives on the right side of the screen.\n[420-450s] - Player drives a black van with glowing green dashboard lights through a city street at night, passing traffic lights and buildings.  \n- The van's speed fluctuates between 85 and 90 mph as it navigates intersections and turns.  \n- A map and game HUD are visible in the bottom-left corner, while a chat window and player list appear on the right.\n[450-480s] - Van with glowing orange trim drives through city streets at night, speed fluctuating between 84 to 87 mph.\n- Driver's face is visible in top-left corner, wearing headphones and smiling while looking at screen.\n- Right side of screen shows live chat with viewer messages and a leaderboard, indicating active multiplayer session.", "history_tokens": 1016, "history_utf8_bytes": 4034, "recent_frame_times_s": [470.0035, 471.0045, 472.0055, 473.0065, 474.0075, 475.0085, 476.0095, 477.0105, 478.0115, 479.0125, 480.0135, 481.0145, 482.0155, 483.0165, 484.00081666666665, 485.0018166666667, 486.00281666666666, 487.0038166666667, 488.00481666666667, 489.00581666666665, 490.0068166666667, 491.00781666666666, 492.0088166666667, 493.00981666666667, 494.01081666666664, 495.0118166666667, 496.01281666666665, 497.0138166666667, 498.01481666666666, 499.0158166666667], "recent_frames_sha256": "18625252661322ddabd642ccd5dd25a09671a52627ce14458da4fb5544ca73a0", "num_recent_frames": 30, "tq": 718170.338058976, "t1": 718171.725021004, "ta": 718171.725021004, "te": 718171.951945163, "first_response_s": 1.3869620279874653, "answer_total_s": 1.6138861869694665, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 277, "content_group": "da4f03e1349a42e0362e998e94e3f2a48594152f8a4524d76cb8c8fe7a227274", "question": {"question_id": "sample_277_a911_q0", "video_id": 277, "video_path": "./videos/sample_277_real.mp4", "annotation_index": 911, "question_index": 0, "question": "What is the person in the blue hoodie doing right now?", "options": ["A. Walking on the sidewalk.", "B. Stopping at the rear of the vehicle.", "C. Turning towards the dark vehicle.", "D. Puting the goods into the trunk of the car."], "answer": "D", "time_stamp_s": 607, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_277_a911_q0", "video_id": 277, "time_stamp_s": 607, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "046c90e2da585f22ae05f5052c179c39eda9bec91fbcf4c8342601bfd19f966b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [577.0104, 578.0114, 579.0124, 580.0134, 581.0144, 582.0154, 583.0164, 584.0007166666667, 585.0017166666667, 586.0027166666666, 587.0037166666667, 588.0047166666667, 589.0057166666667, 590.0067166666666, 591.0077166666666, 592.0087166666667, 593.0097166666667, 594.0107166666667, 595.0117166666666, 596.0127166666666, 597.0137166666667, 598.0147166666667, 599.0157166666667, 600.0000333333334, 601.0010333333333, 602.0020333333333, 603.0030333333333, 604.0040333333334, 605.0050333333334, 606.0060333333333], "recent_frames_sha256": "db684bd7b4b3de41aa922838625e370315d870359b386ac52e5afba1ec2bc305", "num_recent_frames": 30, "tq": 718028.029210405, "t1": 718035.784141565, "ta": 718035.784141565, "te": 718035.822568828, "first_response_s": 7.754931160015985, "answer_total_s": 7.79335842304863, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_277_a911_q0", "video_id": 277, "time_stamp_s": 607, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d6d005890c0543fafa7b5b74edcd0ca016a21e23882e466c05e9423890a115ce", "condition_order": ["recent", "notes"], "memory": "[270-300s] - Player in blue hoodie stands beside a striped-shirted character near a brick wall, both facing a uniformed officer.  \n- Officer holds a phone, possibly interacting with the other two characters.  \n- A red bottle lies on the ground near the wall, and a chat window displays viewer messages.\n[300-330s] - Player character in striped shirt stands facing a man in blue jacket near a brick wall, while another man in white shirt stands nearby holding a phone.  \n- A smartphone UI overlay appears, showing app icons and a clock reading 11:34, indicating a pause or menu interaction.  \n- The player opens a menu displaying character stats and inventory, with a \"Purchased\" notification visible, suggesting an in-game purchase or item acquisition.\n[330-360s] - Player character in striped shirt approaches a man in a white shirt near a brick wall, then walks toward a black van.  \n- The van, marked with \"grime\" branding, is parked near industrial structures; the player enters it.  \n- A map overlay is visible in the corner, showing a location with a yellow highlighted area.\n[360-390s] - Black van with glowing orange trim drives through an industrial area at dusk, passing warehouses and rail tracks.  \n- Player’s speedometer shows fluctuating speeds (e.g., 817, 825, 831, 841, 839, 831, 836, 831, 836, 831, 836, 831, 836, 831, 836, 831, 836, 831, 83\n[390-420s] - Player drives a black van with orange glowing side panels along a multi-lane highway at dusk, passing under an overpass.  \n- A red car is visible ahead on the right lane, and the van maintains a steady speed, indicated by the speedometer reading around 85 mph.  \n- The game’s HUD shows a mini-map, speed, and a list of players or objectives on the right side of the screen.\n[420-450s] - Player drives a black van with glowing green dashboard lights through a city street at night, passing traffic lights and buildings.  \n- The van's speed fluctuates between 85 and 90 mph as it navigates intersections and turns.  \n- A map and game HUD are visible in the bottom-left corner, while a chat window and player list appear on the right.\n[450-480s] - Van with glowing orange trim drives through city streets at night, speed fluctuating between 84 to 87 mph.\n- Driver's face is visible in top-left corner, wearing headphones and smiling while looking at screen.\n- Right side of screen shows live chat with viewer messages and a leaderboard, indicating active multiplayer session.\n[480-510s] - Two characters stand beside a dark van; one in striped shirt, other in blue jacket, both facing van's rear.\n- Player opens inventory, showing character stats and equipped items, with \"Pistol\" and \"Handcuffs\" highlighted.\n- Chat window displays viewer messages, including \"I'm not a fan of this\" and \"I'm not a fan of this\" repeated.\n[510-540s] - Two characters stand beside a dark van at night; one in striped shirt approaches the rear, while the other in blue jacket stands nearby.  \n- The van's rear door opens as the character in the striped shirt enters, then the van drives forward on a city street.  \n- A chat window and game UI elements are visible on the right, with a small inset showing a smiling face in the top-left corner.\n[540-570s] - Player character exits van and walks toward building entrance at dusk.\n- NPC \"Harry Miller\" appears at building entrance, standing near glass doors.\n- Player approaches Harry Miller, initiating interaction with him.\n[570-600s] - Player character in striped shirt walks away from a building entrance, carrying a box, while another character in blue walks ahead.  \n- The environment is a dimly lit urban street at night with parked cars and illuminated buildings in the background.  \n- A chat window on the right side of the screen shows viewer messages, including one from \"Drew\" and another from \"Drew\" with a red notification.", "history_tokens": 973, "history_utf8_bytes": 3838, "recent_frame_times_s": [577.0104, 578.0114, 579.0124, 580.0134, 581.0144, 582.0154, 583.0164, 584.0007166666667, 585.0017166666667, 586.0027166666666, 587.0037166666667, 588.0047166666667, 589.0057166666667, 590.0067166666666, 591.0077166666666, 592.0087166666667, 593.0097166666667, 594.0107166666667, 595.0117166666666, 596.0127166666666, 597.0137166666667, 598.0147166666667, 599.0157166666667, 600.0000333333334, 601.0010333333333, 602.0020333333333, 603.0030333333333, 604.0040333333334, 605.0050333333334, 606.0060333333333], "recent_frames_sha256": "db684bd7b4b3de41aa922838625e370315d870359b386ac52e5afba1ec2bc305", "num_recent_frames": 30, "tq": 718207.344183313, "t1": 718210.288159411, "ta": 718210.288159411, "te": 718210.329516989, "first_response_s": 2.943976098089479, "answer_total_s": 2.9853336759842932, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 278, "content_group": "fb1a44d69b6720940a0e90f45ea4c64a2d46c22a99d44caac3b90b5e03c111b8", "question": {"question_id": "sample_278_a306_q0", "video_id": 278, "video_path": "./videos/sample_278_real.mp4", "annotation_index": 306, "question_index": 0, "question": "What is the person in the striped shirt doing right now?", "options": ["A. Walking briskly towards the front of the vehicle.", "B. Standing beside the vehicle and looking at their device.", "C. Conversing with the individual in the blue hoodie.", "D. Observing the background elements."], "answer": "A", "time_stamp_s": 18, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_278_a306_q0", "video_id": 278, "time_stamp_s": 18, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5759bb90bbb3188e9493f1f9e3c97550b30ab8c5cfdcbb13ed52b613f7034125", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.039, 1.0066333333333333, 2.007633333333333, 3.0086333333333335, 4.009633333333333, 5.010633333333334, 6.011633333333333, 7.0126333333333335, 8.013633333333333, 9.014633333333334, 10.015633333333334, 11.016633333333333, 12.00095, 13.00195, 14.00295, 15.00395, 16.00495, 17.00595], "recent_frames_sha256": "a606e7a3aec9a96bcf1ff2ff8c4bc9189eb9d4dfc11d8b350a0a854219355254", "num_recent_frames": 18, "tq": 719318.04029639, "t1": 719318.492331661, "ta": 719318.492331661, "te": 719318.529739687, "first_response_s": 0.4520352710969746, "answer_total_s": 0.48944329703226686, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_278_a306_q0", "video_id": 278, "time_stamp_s": 18, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f814bc364aec7170fd79856dd756412c28d0beed3c47d49a4ce04247b09cc4c5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.039, 1.0066333333333333, 2.007633333333333, 3.0086333333333335, 4.009633333333333, 5.010633333333334, 6.011633333333333, 7.0126333333333335, 8.013633333333333, 9.014633333333334, 10.015633333333334, 11.016633333333333, 12.00095, 13.00195, 14.00295, 15.00395, 16.00495, 17.00595], "recent_frames_sha256": "a606e7a3aec9a96bcf1ff2ff8c4bc9189eb9d4dfc11d8b350a0a854219355254", "num_recent_frames": 18, "tq": 719130.596987933, "t1": 719131.334933819, "ta": 719131.334933819, "te": 719131.372820489, "first_response_s": 0.7379458859795704, "answer_total_s": 0.7758325559552759, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 278, "content_group": "fb1a44d69b6720940a0e90f45ea4c64a2d46c22a99d44caac3b90b5e03c111b8", "question": {"question_id": "sample_278_a307_q0", "video_id": 278, "video_path": "./videos/sample_278_real.mp4", "annotation_index": 307, "question_index": 0, "question": "What did the character do just now?", "options": ["A. Put away his phone.", "B. Open the driver's side door.", "C. Crouch next to the vehicle.", "D. Toggle the engine."], "answer": "A", "time_stamp_s": 174, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_278_a307_q0", "video_id": 278, "time_stamp_s": 174, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "47da30c730aa2faf903681fdaaca811fb4c4d7f4f34c811974586b70b512e67c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [144.01616666666666, 145.00048333333334, 146.00148333333334, 147.00248333333334, 148.00348333333332, 149.00448333333333, 150.00548333333333, 151.00648333333334, 152.00748333333334, 153.00848333333334, 154.00948333333332, 155.01048333333333, 156.01148333333333, 157.01248333333334, 158.01348333333334, 159.01448333333335, 160.01548333333332, 161.01648333333333, 162.0008, 163.0018, 164.0028, 165.0038, 166.0048, 167.0058, 168.0068, 169.0078, 170.0088, 171.0098, 172.0108, 173.0118], "recent_frames_sha256": "5e10f9882f59bca9080a904315f60a395994f7d45a3adf290aaaf3870d5ef115", "num_recent_frames": 30, "tq": 719318.547502955, "t1": 719331.602815231, "ta": 719331.602815231, "te": 719331.640132362, "first_response_s": 13.055312276002951, "answer_total_s": 13.092629407066852, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_278_a307_q0", "video_id": 278, "time_stamp_s": 174, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "df3ec4e5cdc7aa78c6cee76aa159fd847006e9de8cebbea45a24499bb0a3e396", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Two in-game characters stand beside a dark van at night; one holds a phone displaying a smartphone interface.  \n- The van's rear door opens, and the character in the striped shirt walks away from it, then drives the van forward on a city street.  \n- The game's HUD shows a map, speedometer, and chat window with viewer messages, while the streamer's webcam view is visible in the top-left corner.\n[30-60s] - Player's character is in a third-person view, driving a dark vehicle with glowing orange trim along a city street at night.\n- The vehicle's speedometer shows fluctuating speeds, indicating movement through traffic and intersections.\n- A map and various game UI elements are visible on the screen, including a mini-map, speedometer, and a chat window with viewer messages.\n[60-90s] - Player drives a black vehicle with orange glowing edges through a city at night, passing traffic and buildings.  \n- The vehicle's speed fluctuates between 85 and 89 mph as it navigates streets and intersections.  \n- A small map in the bottom left corner shows the route, and a chat window on the right displays viewer messages.\n[90-120s] - Player drives a black vehicle with glowing orange trim through a city at night, passing under bridges and near palm trees.  \n- The vehicle's speed fluctuates between 85 to 90 mph as it navigates intersections and traffic lights.  \n- A live stream overlay shows a person wearing headphones, with chat messages scrolling on the right side of the screen.\n[120-150s] - A dark van with glowing orange trim drives through city streets at night, passing under illuminated bridges and traffic lights.  \n- The van approaches a crosswalk, slows down, and then proceeds straight through the intersection.  \n- A pedestrian appears on the sidewalk to the right, standing near a red-and-yellow striped umbrella.", "history_tokens": 413, "history_utf8_bytes": 1838, "recent_frame_times_s": [144.01616666666666, 145.00048333333334, 146.00148333333334, 147.00248333333334, 148.00348333333332, 149.00448333333333, 150.00548333333333, 151.00648333333334, 152.00748333333334, 153.00848333333334, 154.00948333333332, 155.01048333333333, 156.01148333333333, 157.01248333333334, 158.01348333333334, 159.01448333333335, 160.01548333333332, 161.01648333333333, 162.0008, 163.0018, 164.0028, 165.0038, 166.0048, 167.0058, 168.0068, 169.0078, 170.0088, 171.0098, 172.0108, 173.0118], "recent_frames_sha256": "5e10f9882f59bca9080a904315f60a395994f7d45a3adf290aaaf3870d5ef115", "num_recent_frames": 30, "tq": 719176.232191221, "t1": 719178.228163334, "ta": 719178.228163334, "te": 719178.267583976, "first_response_s": 1.9959721129853278, "answer_total_s": 2.0353927550604567, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 278, "content_group": "fb1a44d69b6720940a0e90f45ea4c64a2d46c22a99d44caac3b90b5e03c111b8", "question": {"question_id": "sample_278_a308_q0", "video_id": 278, "video_path": "./videos/sample_278_real.mp4", "annotation_index": 308, "question_index": 0, "question": "What is the person near the van doing right now?", "options": ["A. Handling items in the back of the van.", "B. Standing near the van without any movement.", "C. Opening the van's side door.", "D. Walking towards the street."], "answer": "A", "time_stamp_s": 328, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_278_a308_q0", "video_id": 278, "time_stamp_s": 328, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "811b3a5caa81763337be439c97675d404a1c2d41fcc39b5a308b32f5d3d1e043", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [298.00333333333333, 299.0043333333333, 300.00533333333334, 301.0063333333333, 302.00733333333335, 303.0083333333333, 304.00933333333336, 305.01033333333334, 306.0113333333333, 307.01233333333334, 308.0133333333333, 309.01433333333335, 310.01533333333333, 311.0163333333333, 312.00065, 313.00165, 314.00265, 315.00365, 316.00465, 317.00565, 318.00665, 319.00765, 320.00865, 321.00965, 322.01065, 323.01165, 324.01265, 325.01365, 326.01465, 327.01565], "recent_frames_sha256": "cceccac5f3ad2beb7ceddb3ae3c3ef8846bd8e3867c526cea8b489fc685716c5", "num_recent_frames": 30, "tq": 719331.652149376, "t1": 719342.628996058, "ta": 719342.628996058, "te": 719342.851203288, "first_response_s": 10.976846682024188, "answer_total_s": 11.19905391195789, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_278_a308_q0", "video_id": 278, "time_stamp_s": 328, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "77b3c1e8a8ffa8ee0500c0fb202ed5737fe91dde0f71cb0b2638f9ade6ad075f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Two in-game characters stand beside a dark van at night; one holds a phone displaying a smartphone interface.  \n- The van's rear door opens, and the character in the striped shirt walks away from it, then drives the van forward on a city street.  \n- The game's HUD shows a map, speedometer, and chat window with viewer messages, while the streamer's webcam view is visible in the top-left corner.\n[30-60s] - Player's character is in a third-person view, driving a dark vehicle with glowing orange trim along a city street at night.\n- The vehicle's speedometer shows fluctuating speeds, indicating movement through traffic and intersections.\n- A map and various game UI elements are visible on the screen, including a mini-map, speedometer, and a chat window with viewer messages.\n[60-90s] - Player drives a black vehicle with orange glowing edges through a city at night, passing traffic and buildings.  \n- The vehicle's speed fluctuates between 85 and 89 mph as it navigates streets and intersections.  \n- A small map in the bottom left corner shows the route, and a chat window on the right displays viewer messages.\n[90-120s] - Player drives a black vehicle with glowing orange trim through a city at night, passing under bridges and near palm trees.  \n- The vehicle's speed fluctuates between 85 to 90 mph as it navigates intersections and traffic lights.  \n- A live stream overlay shows a person wearing headphones, with chat messages scrolling on the right side of the screen.\n[120-150s] - A dark van with glowing orange trim drives through city streets at night, passing under illuminated bridges and traffic lights.  \n- The van approaches a crosswalk, slows down, and then proceeds straight through the intersection.  \n- A pedestrian appears on the sidewalk to the right, standing near a red-and-yellow striped umbrella.\n[150-180s] - Player character approaches a dark storefront with an \"OPEN\" sign, then opens a menu to inspect inventory.  \n- Player character walks toward a large black vehicle, then opens a phone app, possibly to check messages or notifications.  \n- Player character interacts with the vehicle, opening its side door, suggesting preparation to enter or inspect it.\n[180-210s] - Player drives a black van with glowing orange side panels through a city street at night, passing traffic lights and buildings.  \n- A small inset video shows a second person (likely a co-streamer) in a separate room, wearing headphones and a light-colored shirt.  \n- The game’s HUD displays a map, speedometer, and a chat window with viewer messages on the right side of the screen.\n[210-240s] - A black van with orange glowing side lights drives through a city at night, passing under bridges and along roads with streetlights.  \n- The driver, visible in a small inset, wears headphones and appears focused on the game.  \n- The game’s HUD displays speed (85-86 mph), a map, and a timer (2:40-2:42), while chat messages scroll on the right.\n[240-270s] - Player drives a black vehicle with glowing orange trim on a highway at night, maintaining speed around 86 mph.\n- City lights and bridge structures are visible in the background, with occasional passing cars.\n- On-screen UI elements show speed, map, and chat messages, with a small inset of the player's face in the top-left corner.\n[270-300s] - Truck with glowing orange outline drives on a highway at night, speed fluctuating between 86 and 84 mph.\n- A smaller vehicle is seen ahead, moving in the same direction.\n- Road signs and city lights are visible in the background as the truck navigates curves and intersections.", "history_tokens": 830, "history_utf8_bytes": 3597, "recent_frame_times_s": [298.00333333333333, 299.0043333333333, 300.00533333333334, 301.0063333333333, 302.00733333333335, 303.0083333333333, 304.00933333333336, 305.01033333333334, 306.0113333333333, 307.01233333333334, 308.0133333333333, 309.01433333333335, 310.01533333333333, 311.0163333333333, 312.00065, 313.00165, 314.00265, 315.00365, 316.00465, 317.00565, 318.00665, 319.00765, 320.00865, 321.00965, 322.01065, 323.01165, 324.01265, 325.01365, 326.01465, 327.01565], "recent_frames_sha256": "cceccac5f3ad2beb7ceddb3ae3c3ef8846bd8e3867c526cea8b489fc685716c5", "num_recent_frames": 30, "tq": 719225.547267369, "t1": 719232.678683315, "ta": 719232.678683315, "te": 719232.716851359, "first_response_s": 7.13141594605986, "answer_total_s": 7.169583990005776, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 278, "content_group": "fb1a44d69b6720940a0e90f45ea4c64a2d46c22a99d44caac3b90b5e03c111b8", "question": {"question_id": "sample_278_a309_q0", "video_id": 278, "video_path": "./videos/sample_278_real.mp4", "annotation_index": 309, "question_index": 0, "question": "What did the driver do just now?", "options": ["A. Exiting the van.", "B. Entering the van.", "C. Turning on the headlights.", "D. Navigating the alley."], "answer": "A", "time_stamp_s": 495, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_278_a309_q0", "video_id": 278, "time_stamp_s": 495, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "eb78f8f89e86da888f58747dad6ef9a23b642d84e4394ff0a97df733ac8b45f4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [465.0035, 466.0045, 467.0055, 468.0065, 469.0075, 470.0085, 471.0095, 472.0105, 473.0115, 474.0125, 475.0135, 476.0145, 477.0155, 478.0165, 479.00081666666665, 480.0018166666667, 481.00281666666666, 482.0038166666667, 483.00481666666667, 484.00581666666665, 485.0068166666667, 486.00781666666666, 487.0088166666667, 488.00981666666667, 489.01081666666664, 490.0118166666667, 491.01281666666665, 492.0138166666667, 493.01481666666666, 494.0158166666667], "recent_frames_sha256": "d69b6bb8af8e50094da5cc130dfefe1e3a7ed3710d76253a3160ad3ef18fc7da", "num_recent_frames": 30, "tq": 719342.871725905, "t1": 719351.05579519, "ta": 719351.05579519, "te": 719351.095675084, "first_response_s": 8.184069285052828, "answer_total_s": 8.223949179053307, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_278_a309_q0", "video_id": 278, "time_stamp_s": 495, "ground_truth": "A", "raw_output": "B. Entering the van.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "04e2d10807e42c5578b2c30680141375895e441a1f5557e1c8ba6cf57020ee30", "condition_order": ["notes", "recent"], "memory": "[120-150s] - A dark van with glowing orange trim drives through city streets at night, passing under illuminated bridges and traffic lights.  \n- The van approaches a crosswalk, slows down, and then proceeds straight through the intersection.  \n- A pedestrian appears on the sidewalk to the right, standing near a red-and-yellow striped umbrella.\n[150-180s] - Player character approaches a dark storefront with an \"OPEN\" sign, then opens a menu to inspect inventory.  \n- Player character walks toward a large black vehicle, then opens a phone app, possibly to check messages or notifications.  \n- Player character interacts with the vehicle, opening its side door, suggesting preparation to enter or inspect it.\n[180-210s] - Player drives a black van with glowing orange side panels through a city street at night, passing traffic lights and buildings.  \n- A small inset video shows a second person (likely a co-streamer) in a separate room, wearing headphones and a light-colored shirt.  \n- The game’s HUD displays a map, speedometer, and a chat window with viewer messages on the right side of the screen.\n[210-240s] - A black van with orange glowing side lights drives through a city at night, passing under bridges and along roads with streetlights.  \n- The driver, visible in a small inset, wears headphones and appears focused on the game.  \n- The game’s HUD displays speed (85-86 mph), a map, and a timer (2:40-2:42), while chat messages scroll on the right.\n[240-270s] - Player drives a black vehicle with glowing orange trim on a highway at night, maintaining speed around 86 mph.\n- City lights and bridge structures are visible in the background, with occasional passing cars.\n- On-screen UI elements show speed, map, and chat messages, with a small inset of the player's face in the top-left corner.\n[270-300s] - Truck with glowing orange outline drives on a highway at night, speed fluctuating between 86 and 84 mph.\n- A smaller vehicle is seen ahead, moving in the same direction.\n- Road signs and city lights are visible in the background as the truck navigates curves and intersections.\n[300-330s] - A black van with orange glowing trim drives through a city at night, passing under streetlights and traffic signals.\n- The van approaches a building with illuminated windows, then stops near a sidewalk where a pedestrian is visible.\n- The game's HUD shows a speedometer reading around 84-87 mph, with a map and chat window visible on screen.\n[330-360s] - A black delivery van with \"grime\" branding is driving on a dark urban road at night, its headlights illuminating the pavement.\n- The van is shown from a third-person perspective, moving forward along a multi-lane street with traffic lights and street signs visible.\n- A smartphone interface appears on the right side of the screen, displaying various app icons and notifications, including a \"New Message\" alert.\n[360-390s] - Player drives a dark van with glowing orange rear lights through a city at night, passing traffic lights and intersections.  \n- The game's HUD shows speed, map, and fuel gauge, with chat messages scrolling on the right.  \n- The van navigates curves and straight roads, with city lights and buildings visible in the background.\n[390-420s] - Player drives a dark van with glowing orange rear lights through a city at night, navigating intersections and traffic.\n- The van's speed fluctuates between 84 and 86 mph as it maneuvers around cars and turns.\n- A live stream interface shows a streamer in a white shirt and headset, with chat messages scrolling on the right side of the screen.\n[420-450s] - Player drives a dark truck with glowing orange rear lights through a city at night, passing cars and streetlights.  \n- The truck enters a tunnel with red lighting, transitioning from outdoor to indoor environment.  \n- A map and speedometer are visible in the bottom-left corner, showing the truck's route and speed.\n[450-480s] - A character in a striped shirt runs toward a black van parked on a red-lit platform.  \n- The van's rear doors are open, revealing a dark interior with glowing orange lights.  \n- The character approaches the van from the side, moving toward the open rear doors.", "history_tokens": 969, "history_utf8_bytes": 4186, "recent_frame_times_s": [465.0035, 466.0045, 467.0055, 468.0065, 469.0075, 470.0085, 471.0095, 472.0105, 473.0115, 474.0125, 475.0135, 476.0145, 477.0155, 478.0165, 479.00081666666665, 480.0018166666667, 481.00281666666666, 482.0038166666667, 483.00481666666667, 484.00581666666665, 485.0068166666667, 486.00781666666666, 487.0088166666667, 488.00981666666667, 489.01081666666664, 490.0118166666667, 491.01281666666665, 492.0138166666667, 493.01481666666666, 494.0158166666667], "recent_frames_sha256": "d69b6bb8af8e50094da5cc130dfefe1e3a7ed3710d76253a3160ad3ef18fc7da", "num_recent_frames": 30, "tq": 719278.795594455, "t1": 719286.018335262, "ta": 719286.018335262, "te": 719286.327300633, "first_response_s": 7.2227408069884405, "answer_total_s": 7.531706177978776, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 278, "content_group": "fb1a44d69b6720940a0e90f45ea4c64a2d46c22a99d44caac3b90b5e03c111b8", "question": {"question_id": "sample_278_a310_q0", "video_id": 278, "video_path": "./videos/sample_278_real.mp4", "annotation_index": 310, "question_index": 0, "question": "What is the player focusing on right now?", "options": ["A. Driving a truck on the road.", "B. Adjusting the game settings.", "C. Quiting the game.", "D. Watching a cut scene."], "answer": "A", "time_stamp_s": 583, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_278_a310_q0", "video_id": 278, "time_stamp_s": 583, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "100ea19b51febba411cf48239cdd9597a8229c51d5a30e5ca24900f6f5f5a97e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [553.0080833333334, 554.0090833333334, 555.0100833333333, 556.0110833333333, 557.0120833333333, 558.0130833333334, 559.0140833333334, 560.0150833333333, 561.0160833333333, 562.0004, 563.0014, 564.0024, 565.0034, 566.0044, 567.0054, 568.0064, 569.0074, 570.0084, 571.0094, 572.0104, 573.0114, 574.0124, 575.0134, 576.0144, 577.0154, 578.0164, 579.0007166666667, 580.0017166666667, 581.0027166666666, 582.0037166666667], "recent_frames_sha256": "fbc1ca391539e0c56d72f83da22b6be034850dffb08e710d3340de74c310ed09", "num_recent_frames": 30, "tq": 719351.104276025, "t1": 719362.6792113, "ta": 719362.6792113, "te": 719362.717847318, "first_response_s": 11.574935275013559, "answer_total_s": 11.613571293069981, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_278_a310_q0", "video_id": 278, "time_stamp_s": 583, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5edbec6bb8f75ed65b09adc88df14071c63d43898296e051d768f11665a45552", "condition_order": ["notes", "recent"], "memory": "[210-240s] - A black van with orange glowing side lights drives through a city at night, passing under bridges and along roads with streetlights.  \n- The driver, visible in a small inset, wears headphones and appears focused on the game.  \n- The game’s HUD displays speed (85-86 mph), a map, and a timer (2:40-2:42), while chat messages scroll on the right.\n[240-270s] - Player drives a black vehicle with glowing orange trim on a highway at night, maintaining speed around 86 mph.\n- City lights and bridge structures are visible in the background, with occasional passing cars.\n- On-screen UI elements show speed, map, and chat messages, with a small inset of the player's face in the top-left corner.\n[270-300s] - Truck with glowing orange outline drives on a highway at night, speed fluctuating between 86 and 84 mph.\n- A smaller vehicle is seen ahead, moving in the same direction.\n- Road signs and city lights are visible in the background as the truck navigates curves and intersections.\n[300-330s] - A black van with orange glowing trim drives through a city at night, passing under streetlights and traffic signals.\n- The van approaches a building with illuminated windows, then stops near a sidewalk where a pedestrian is visible.\n- The game's HUD shows a speedometer reading around 84-87 mph, with a map and chat window visible on screen.\n[330-360s] - A black delivery van with \"grime\" branding is driving on a dark urban road at night, its headlights illuminating the pavement.\n- The van is shown from a third-person perspective, moving forward along a multi-lane street with traffic lights and street signs visible.\n- A smartphone interface appears on the right side of the screen, displaying various app icons and notifications, including a \"New Message\" alert.\n[360-390s] - Player drives a dark van with glowing orange rear lights through a city at night, passing traffic lights and intersections.  \n- The game's HUD shows speed, map, and fuel gauge, with chat messages scrolling on the right.  \n- The van navigates curves and straight roads, with city lights and buildings visible in the background.\n[390-420s] - Player drives a dark van with glowing orange rear lights through a city at night, navigating intersections and traffic.\n- The van's speed fluctuates between 84 and 86 mph as it maneuvers around cars and turns.\n- A live stream interface shows a streamer in a white shirt and headset, with chat messages scrolling on the right side of the screen.\n[420-450s] - Player drives a dark truck with glowing orange rear lights through a city at night, passing cars and streetlights.  \n- The truck enters a tunnel with red lighting, transitioning from outdoor to indoor environment.  \n- A map and speedometer are visible in the bottom-left corner, showing the truck's route and speed.\n[450-480s] - A character in a striped shirt runs toward a black van parked on a red-lit platform.  \n- The van's rear doors are open, revealing a dark interior with glowing orange lights.  \n- The character approaches the van from the side, moving toward the open rear doors.\n[480-510s] - Player character stands near a dark vehicle in a dimly lit garage, observing two other characters conversing nearby.  \n- A chat window displays live viewer messages, including one about a \"new car\" and another about \"the new car.\"  \n- The player’s character remains stationary, facing the group, while the camera angle shifts slightly to show the interaction.\n[510-540s] - Player character in striped shirt approaches and enters a dark Amazon delivery van.  \n- Another character in blue clothing is visible inside the van, partially obscured by darkness.  \n- Van drives away from a dark street at night, with city lights and traffic signs visible in the background.\n[540-570s] - Player drives a black van with glowing orange rear lights through a city at night, passing traffic and intersections.  \n- Speedometer shows fluctuating speeds around 85–90 mph, with a map in the bottom left indicating route.  \n- Chat window on the right displays viewer messages, including one about \"the best car\" and another about \"the best car in the game.\"", "history_tokens": 963, "history_utf8_bytes": 4134, "recent_frame_times_s": [553.0080833333334, 554.0090833333334, 555.0100833333333, 556.0110833333333, 557.0120833333333, 558.0130833333334, 559.0140833333334, 560.0150833333333, 561.0160833333333, 562.0004, 563.0014, 564.0024, 565.0034, 566.0044, 567.0054, 568.0064, 569.0074, 570.0084, 571.0094, 572.0104, 573.0114, 574.0124, 575.0134, 576.0144, 577.0154, 578.0164, 579.0007166666667, 580.0017166666667, 581.0027166666666, 582.0037166666667], "recent_frames_sha256": "fbc1ca391539e0c56d72f83da22b6be034850dffb08e710d3340de74c310ed09", "num_recent_frames": 30, "tq": 719310.22627322, "t1": 719317.803401794, "ta": 719317.803401794, "te": 719318.019391793, "first_response_s": 7.577128574019298, "answer_total_s": 7.793118572910316, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 279, "content_group": "f45cdf443dac921d499ae1b9bcd1c704572db64f3a6bd4ce6a99015c2e5875a6", "question": {"question_id": "sample_279_a1137_q0", "video_id": 279, "video_path": "./videos/sample_279_real.mp4", "annotation_index": 1137, "question_index": 0, "question": "What is the vehicle doing right now?", "options": ["A. Driving straight ahead on the street at night.", "B. Stopping at a traffic signal.", "C. Driving under a bridge.", "D. Parking by the side of the road."], "answer": "A", "time_stamp_s": 20, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_279_a1137_q0", "video_id": 279, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a670483cc5d719ff03d05213fd2ba69fa149ad80f3271375000de33be2d53078", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.031, 1.0153166666666666, 2.0163166666666665, 3.0006333333333335, 4.001633333333333, 5.002633333333334, 6.003633333333333, 7.0046333333333335, 8.005633333333334, 9.006633333333333, 10.007633333333333, 11.008633333333334, 12.009633333333333, 13.010633333333333, 14.011633333333334, 15.012633333333333, 16.013633333333335, 17.014633333333332, 18.015633333333334, 19.016633333333335], "recent_frames_sha256": "9862835a41cdbcb4e3a6af78b985d25c2d1135b58208f0c2e1f209659e74e3b6", "num_recent_frames": 20, "tq": 719394.637420223, "t1": 719395.929816793, "ta": 719395.929816793, "te": 719396.15752306, "first_response_s": 1.2923965699737892, "answer_total_s": 1.5201028370065615, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_279_a1137_q0", "video_id": 279, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "17cab445e06b97ff604324fa4dc9b36d3555ae8a9f1393e512974e2cd833f263", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.031, 1.0153166666666666, 2.0163166666666665, 3.0006333333333335, 4.001633333333333, 5.002633333333334, 6.003633333333333, 7.0046333333333335, 8.005633333333334, 9.006633333333333, 10.007633333333333, 11.008633333333334, 12.009633333333333, 13.010633333333333, 14.011633333333334, 15.012633333333333, 16.013633333333335, 17.014633333333332, 18.015633333333334, 19.016633333333335], "recent_frames_sha256": "9862835a41cdbcb4e3a6af78b985d25c2d1135b58208f0c2e1f209659e74e3b6", "num_recent_frames": 20, "tq": 719208.587490254, "t1": 719218.919252544, "ta": 719218.919252544, "te": 719218.956553429, "first_response_s": 10.331762289977632, "answer_total_s": 10.369063175050542, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 279, "content_group": "f45cdf443dac921d499ae1b9bcd1c704572db64f3a6bd4ce6a99015c2e5875a6", "question": {"question_id": "sample_279_a1138_q0", "video_id": 279, "video_path": "./videos/sample_279_real.mp4", "annotation_index": 1138, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Opened a detailed view of a specific job.", "B. Selected a new job from the menu.", "C. Closed the chat overlay.", "D. Started a new game session."], "answer": "A", "time_stamp_s": 180, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_279_a1138_q0", "video_id": 279, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5680b906405dc27066cb187afbe11ce004ce79f14f26236329215c0544fd2d57", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.01416666666665, 151.01516666666666, 152.01616666666666, 153.00048333333334, 154.00148333333334, 155.00248333333334, 156.00348333333332, 157.00448333333333, 158.00548333333333, 159.00648333333334, 160.00748333333334, 161.00848333333334, 162.00948333333332, 163.01048333333333, 164.01148333333333, 165.01248333333334, 166.01348333333334, 167.01448333333335, 168.01548333333332, 169.01648333333333, 170.0008, 171.0018, 172.0028, 173.0038, 174.0048, 175.0058, 176.0068, 177.0078, 178.0088, 179.0098], "recent_frames_sha256": "78f97bf11f76c4d905b7f329d1f5a517a0f971bd373b35687beb0ba9165d41e2", "num_recent_frames": 30, "tq": 719396.186255834, "t1": 719402.983737386, "ta": 719402.983737386, "te": 719403.020583063, "first_response_s": 6.797481551999226, "answer_total_s": 6.834327229065821, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_279_a1138_q0", "video_id": 279, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ce40b152cae0005061275a147410c1772b814112309672354ca88c35dc88a585", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A black van with glowing orange rectangular lights on its rear drives through a city at night, passing traffic lights and street signs.  \n- The driver, visible in a small inset, wears headphones and appears focused on the game.  \n- The game's HUD displays a speedometer, map, and a chat window with viewer messages on the right side of the screen.\n[30-60s] - Van with glowing orange rear lights drives at night on a city street, speed fluctuating between 83-87 mph.  \n- Player’s in-game map and speedometer are visible in the bottom left corner; a digital clock shows 00:06.  \n- Chat window on the right displays viewer messages, including “I’m not sure if I’m in the right place.”\n[60-90s] - Player drives a black vehicle with glowing orange rear lights through a city at night, passing traffic lights and illuminated buildings.  \n- The vehicle's speed fluctuates between 85 and 87 mph as it navigates the road.  \n- A small map and speedometer are visible in the bottom-left corner, while a chat window displays viewer messages on the right.\n[90-120s] - A black van with glowing orange rectangular lights on its rear is driving at night on a multi-lane highway, passing under streetlights and approaching an intersection.\n- The van's speed fluctuates between 87 and 94 mph as it navigates curves and straightaways, with the camera maintaining a rear-view perspective.\n- The game's HUD displays a map, speedometer, and a chat window with player names and messages on the right side of the screen.\n[120-150s] - Van with glowing orange outline drives through a dark urban area, passing a yellow \"LIVE\" sign.  \n- Player character exits the van, walks toward a building, and interacts with a nearby object.  \n- On-screen UI displays a phone interface with a clock reading \"00:16\" and a list of in-game items or options.\n[150-180s] - Player opens inventory, revealing character stats and equipped items.  \n- Game interface displays \"Towing Progression\" with six vehicle upgrade options, each showing cost and level.  \n- Player hovers over a vehicle upgrade option, triggering a brief visual highlight or selection indicator.", "history_tokens": 504, "history_utf8_bytes": 2139, "recent_frame_times_s": [150.01416666666665, 151.01516666666666, 152.01616666666666, 153.00048333333334, 154.00148333333334, 155.00248333333334, 156.00348333333332, 157.00448333333333, 158.00548333333333, 159.00648333333334, 160.00748333333334, 161.00848333333334, 162.00948333333332, 163.01048333333333, 164.01148333333333, 165.01248333333334, 166.01348333333334, 167.01448333333335, 168.01548333333332, 169.01648333333333, 170.0008, 171.0018, 172.0028, 173.0038, 174.0048, 175.0058, 176.0068, 177.0078, 178.0088, 179.0098], "recent_frames_sha256": "78f97bf11f76c4d905b7f329d1f5a517a0f971bd373b35687beb0ba9165d41e2", "num_recent_frames": 30, "tq": 719267.067754633, "t1": 719272.744403054, "ta": 719272.744403054, "te": 719272.782827818, "first_response_s": 5.6766484209802, "answer_total_s": 5.7150731849251315, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 279, "content_group": "f45cdf443dac921d499ae1b9bcd1c704572db64f3a6bd4ce6a99015c2e5875a6", "question": {"question_id": "sample_279_a1139_q0", "video_id": 279, "video_path": "./videos/sample_279_real.mp4", "annotation_index": 1139, "question_index": 0, "question": "What is the person in dark hair and white T-shirt doing right now?", "options": ["A. Standing against a wall with a clipboard.", "B. Talking to the person in a striped shirt.", "C. Walking towards the blue door.", "D. Interacting with the shirtless individual."], "answer": "A", "time_stamp_s": 340, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_279_a1139_q0", "video_id": 279, "time_stamp_s": 340, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7503303ea8278996023bdae9d47bf1cb7120457c7584f88d62d3ff6d2e792d39", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [310.00733333333335, 311.0083333333333, 312.00933333333336, 313.01033333333334, 314.0113333333333, 315.01233333333334, 316.0133333333333, 317.01433333333335, 318.01533333333333, 319.0163333333333, 320.00065, 321.00165, 322.00265, 323.00365, 324.00465, 325.00565, 326.00665, 327.00765, 328.00865, 329.00965, 330.01065, 331.01165, 332.01265, 333.01365, 334.01465, 335.01565, 336.01665, 337.00096666666667, 338.00196666666665, 339.0029666666667], "recent_frames_sha256": "e1fa25d22f7a25b61b4609f7d78198626cb365807551067e88d0ba173068c15b", "num_recent_frames": 30, "tq": 719403.044329478, "t1": 719410.20769029, "ta": 719410.20769029, "te": 719410.245209479, "first_response_s": 7.163360811886378, "answer_total_s": 7.200880000949837, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_279_a1139_q0", "video_id": 279, "time_stamp_s": 340, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5c616f9983644bdb5d2d8a95ce34a001467480c628e332c1d3126232d26e3a50", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A black van with glowing orange rectangular lights on its rear drives through a city at night, passing traffic lights and street signs.  \n- The driver, visible in a small inset, wears headphones and appears focused on the game.  \n- The game's HUD displays a speedometer, map, and a chat window with viewer messages on the right side of the screen.\n[30-60s] - Van with glowing orange rear lights drives at night on a city street, speed fluctuating between 83-87 mph.  \n- Player’s in-game map and speedometer are visible in the bottom left corner; a digital clock shows 00:06.  \n- Chat window on the right displays viewer messages, including “I’m not sure if I’m in the right place.”\n[60-90s] - Player drives a black vehicle with glowing orange rear lights through a city at night, passing traffic lights and illuminated buildings.  \n- The vehicle's speed fluctuates between 85 and 87 mph as it navigates the road.  \n- A small map and speedometer are visible in the bottom-left corner, while a chat window displays viewer messages on the right.\n[90-120s] - A black van with glowing orange rectangular lights on its rear is driving at night on a multi-lane highway, passing under streetlights and approaching an intersection.\n- The van's speed fluctuates between 87 and 94 mph as it navigates curves and straightaways, with the camera maintaining a rear-view perspective.\n- The game's HUD displays a map, speedometer, and a chat window with player names and messages on the right side of the screen.\n[120-150s] - Van with glowing orange outline drives through a dark urban area, passing a yellow \"LIVE\" sign.  \n- Player character exits the van, walks toward a building, and interacts with a nearby object.  \n- On-screen UI displays a phone interface with a clock reading \"00:16\" and a list of in-game items or options.\n[150-180s] - Player opens inventory, revealing character stats and equipped items.  \n- Game interface displays \"Towing Progression\" with six vehicle upgrade options, each showing cost and level.  \n- Player hovers over a vehicle upgrade option, triggering a brief visual highlight or selection indicator.\n[180-210s] - Player character in game interface shows \"Tuning Progression\" with six vehicle tuning options, each displaying price and upgrade details.  \n- Game scene shifts to nighttime alleyway where three characters stand near a brick wall, one holding a glowing object.  \n- On-screen overlay displays a smartphone interface with app icons, suggesting a mobile device interaction or cheat code reference.\n[210-240s] - Player character interacts with two NPCs near a brick wall at night, with one NPC holding a glowing object.  \n- A \"Friend Killer\" notification appears, indicating a game event or interaction.  \n- The player opens an inventory screen showing a \"Toughing Progression\" menu with various weapon upgrades.\n[240-270s] - A male streamer with blonde hair and headphones is visible in a small inset window, smiling and looking at the screen.  \n- The main screen displays a \"Towing Progression\" menu with six vehicle options, each showing stats like \"Towing Capacity\" and \"Towing Weight.\"  \n- The streamer's cursor moves to click on the \"Towing Progression\" menu, transitioning to a new screen showing \"Towing Progression\" with three categories: \"Towing,\" \"Towing,\" and \"Towing,\" alongside a large image of a white semi-truck.\n[270-300s] - Three characters stand in a dimly lit urban area, with one in a blue jacket and another in a white shirt facing each other.  \n- A blue car passes by in the background, moving from left to right across the scene.  \n- The camera angle shifts slightly, revealing more of the surrounding environment including a brick wall and distant city lights.\n[300-330s] - Streamer in top-left corner smiles and gestures while speaking, with a lit background and chat overlay visible.  \n- In-game, two characters stand facing each other in a dimly lit outdoor area, with a blue car and building in the background.  \n- A third character enters from the right, approaching the two, while the streamer’s chat window displays active messages.", "history_tokens": 955, "history_utf8_bytes": 4114, "recent_frame_times_s": [310.00733333333335, 311.0083333333333, 312.00933333333336, 313.01033333333334, 314.0113333333333, 315.01233333333334, 316.0133333333333, 317.01433333333335, 318.01533333333333, 319.0163333333333, 320.00065, 321.00165, 322.00265, 323.00365, 324.00465, 325.00565, 326.00665, 327.00765, 328.00865, 329.00965, 330.01065, 331.01165, 332.01265, 333.01365, 334.01465, 335.01565, 336.01665, 337.00096666666667, 338.00196666666665, 339.0029666666667], "recent_frames_sha256": "e1fa25d22f7a25b61b4609f7d78198626cb365807551067e88d0ba173068c15b", "num_recent_frames": 30, "tq": 719315.843691242, "t1": 719325.299633655, "ta": 719325.299633655, "te": 719325.33779213, "first_response_s": 9.455942412954755, "answer_total_s": 9.494100887910463, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 279, "content_group": "f45cdf443dac921d499ae1b9bcd1c704572db64f3a6bd4ce6a99015c2e5875a6", "question": {"question_id": "sample_279_a1140_q0", "video_id": 279, "video_path": "./videos/sample_279_real.mp4", "annotation_index": 1140, "question_index": 0, "question": "What is the vehicle doing right now?", "options": ["A. Driving parallel to another car.", "B. Making a left turn.", "C. Stopping at a traffic light.", "D. Reversing into a parking space."], "answer": "A", "time_stamp_s": 497, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_279_a1140_q0", "video_id": 279, "time_stamp_s": 497, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3c212130b3c5ee5dd3c67cbd383d317b3acc250d2ee55c2e484b3f909d05fe2d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [467.01418333333334, 468.0151833333333, 469.01618333333334, 470.0005, 471.0015, 472.0025, 473.0035, 474.0045, 475.0055, 476.0065, 477.0075, 478.0085, 479.0095, 480.0105, 481.0115, 482.0125, 483.0135, 484.0145, 485.0155, 486.0165, 487.00081666666665, 488.0018166666667, 489.00281666666666, 490.0038166666667, 491.00481666666667, 492.00581666666665, 493.0068166666667, 494.00781666666666, 495.0088166666667, 496.00981666666667], "recent_frames_sha256": "8fa3ab5ce3b4d64160b313047f36635bc8313bb41a673c462108870ff8c8bbd6", "num_recent_frames": 30, "tq": 719410.268527671, "t1": 719418.155260233, "ta": 719418.155260233, "te": 719418.193786197, "first_response_s": 7.886732561979443, "answer_total_s": 7.925258525996469, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_279_a1140_q0", "video_id": 279, "time_stamp_s": 497, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7567f4174b752f9b4ae77638b966ecc35731101e7cce5b8da9e4aee5381393fa", "condition_order": ["notes", "recent"], "memory": "[120-150s] - Van with glowing orange outline drives through a dark urban area, passing a yellow \"LIVE\" sign.  \n- Player character exits the van, walks toward a building, and interacts with a nearby object.  \n- On-screen UI displays a phone interface with a clock reading \"00:16\" and a list of in-game items or options.\n[150-180s] - Player opens inventory, revealing character stats and equipped items.  \n- Game interface displays \"Towing Progression\" with six vehicle upgrade options, each showing cost and level.  \n- Player hovers over a vehicle upgrade option, triggering a brief visual highlight or selection indicator.\n[180-210s] - Player character in game interface shows \"Tuning Progression\" with six vehicle tuning options, each displaying price and upgrade details.  \n- Game scene shifts to nighttime alleyway where three characters stand near a brick wall, one holding a glowing object.  \n- On-screen overlay displays a smartphone interface with app icons, suggesting a mobile device interaction or cheat code reference.\n[210-240s] - Player character interacts with two NPCs near a brick wall at night, with one NPC holding a glowing object.  \n- A \"Friend Killer\" notification appears, indicating a game event or interaction.  \n- The player opens an inventory screen showing a \"Toughing Progression\" menu with various weapon upgrades.\n[240-270s] - A male streamer with blonde hair and headphones is visible in a small inset window, smiling and looking at the screen.  \n- The main screen displays a \"Towing Progression\" menu with six vehicle options, each showing stats like \"Towing Capacity\" and \"Towing Weight.\"  \n- The streamer's cursor moves to click on the \"Towing Progression\" menu, transitioning to a new screen showing \"Towing Progression\" with three categories: \"Towing,\" \"Towing,\" and \"Towing,\" alongside a large image of a white semi-truck.\n[270-300s] - Three characters stand in a dimly lit urban area, with one in a blue jacket and another in a white shirt facing each other.  \n- A blue car passes by in the background, moving from left to right across the scene.  \n- The camera angle shifts slightly, revealing more of the surrounding environment including a brick wall and distant city lights.\n[300-330s] - Streamer in top-left corner smiles and gestures while speaking, with a lit background and chat overlay visible.  \n- In-game, two characters stand facing each other in a dimly lit outdoor area, with a blue car and building in the background.  \n- A third character enters from the right, approaching the two, while the streamer’s chat window displays active messages.\n[330-360s] - A player in a blue hoodie stands near a group of three men, facing away from the camera, in a dimly lit outdoor area at night.\n- The player in the blue hoodie is holding a weapon, possibly a pistol, and appears to be in a tense or confrontational stance.\n- A red \"WANTED\" sign is visible on a nearby wall, indicating a high-stakes situation or mission objective.\n[360-390s] - Streamer in top-left corner smiles while wearing headphones and a light-colored shirt.  \n- Game scene shows three characters standing in a dark outdoor area with buildings and parked cars in the background.  \n- A smartphone UI overlay appears on the right side of the screen, displaying app icons and a time of 00:29.\n[390-420s] - Player character walks toward a blue car parked near a yellow \"Limpet Bell\" truck at night.  \n- Streamer in top-left corner smiles while holding a phone, occasionally glancing at the screen.  \n- On-screen UI shows a smartphone interface with \"GTA V\" app icons and a \"GTA V\" notification at 01:09.\n[420-450s] - Player character walks toward a dark vehicle at night, approaching from behind.  \n- Vehicle's headlights illuminate the road as player character reaches it.  \n- Player character enters the vehicle, which is parked near a building with visible streetlights.\n[450-480s] - Player drives a black vehicle with glowing red rear lights along a dark urban road at night.\n- The vehicle's speedometer shows decreasing speed as it navigates the road, indicating slowing down.\n- A chat window on the right side of the screen displays viewer messages and reactions.", "history_tokens": 980, "history_utf8_bytes": 4180, "recent_frame_times_s": [467.01418333333334, 468.0151833333333, 469.01618333333334, 470.0005, 471.0015, 472.0025, 473.0035, 474.0045, 475.0055, 476.0065, 477.0075, 478.0085, 479.0095, 480.0105, 481.0115, 482.0125, 483.0135, 484.0145, 485.0155, 486.0165, 487.00081666666665, 488.0018166666667, 489.00281666666666, 490.0038166666667, 491.00481666666667, 492.00581666666665, 493.0068166666667, 494.00781666666666, 495.0088166666667, 496.00981666666667], "recent_frames_sha256": "8fa3ab5ce3b4d64160b313047f36635bc8313bb41a673c462108870ff8c8bbd6", "num_recent_frames": 30, "tq": 719368.828599202, "t1": 719370.151655767, "ta": 719370.151655767, "te": 719370.342457786, "first_response_s": 1.3230565650155768, "answer_total_s": 1.5138585839886218, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 279, "content_group": "f45cdf443dac921d499ae1b9bcd1c704572db64f3a6bd4ce6a99015c2e5875a6", "question": {"question_id": "sample_279_a1141_q0", "video_id": 279, "video_path": "./videos/sample_279_real.mp4", "annotation_index": 1141, "question_index": 0, "question": "What did the character do just now?", "options": ["A. Dropped a box into the truck's cargo area.", "B. Interacted with the inventory screen.", "C. Walked away from the truck.", "D. Opened a virtual interface labeled \"Harry Miller.\"."], "answer": "A", "time_stamp_s": 593, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_279_a1141_q0", "video_id": 279, "time_stamp_s": 593, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9764f37f34f74c41b723054adb7ffa76339fcf0b068913f97157229c243ca6eb", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [563.0100833333333, 564.0110833333333, 565.0120833333333, 566.0130833333334, 567.0140833333334, 568.0150833333333, 569.0160833333333, 570.0004, 571.0014, 572.0024, 573.0034, 574.0044, 575.0054, 576.0064, 577.0074, 578.0084, 579.0094, 580.0104, 581.0114, 582.0124, 583.0134, 584.0144, 585.0154, 586.0164, 587.0007166666667, 588.0017166666667, 589.0027166666666, 590.0037166666667, 591.0047166666667, 592.0057166666667], "recent_frames_sha256": "f0732ad6934932ede31b0d6b627f1995716a1bf6ee1aff392bb1f76d9d68cbd3", "num_recent_frames": 30, "tq": 719418.216895584, "t1": 719431.320251391, "ta": 719431.320251391, "te": 719431.358589141, "first_response_s": 13.103355807019398, "answer_total_s": 13.141693557030521, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_279_a1141_q0", "video_id": 279, "time_stamp_s": 593, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "10c8cb5bba3c0d67db4c0894c89c77496f1a3aaf96548991bbfd4d34e269261a", "condition_order": ["notes", "recent"], "memory": "[210-240s] - Player character interacts with two NPCs near a brick wall at night, with one NPC holding a glowing object.  \n- A \"Friend Killer\" notification appears, indicating a game event or interaction.  \n- The player opens an inventory screen showing a \"Toughing Progression\" menu with various weapon upgrades.\n[240-270s] - A male streamer with blonde hair and headphones is visible in a small inset window, smiling and looking at the screen.  \n- The main screen displays a \"Towing Progression\" menu with six vehicle options, each showing stats like \"Towing Capacity\" and \"Towing Weight.\"  \n- The streamer's cursor moves to click on the \"Towing Progression\" menu, transitioning to a new screen showing \"Towing Progression\" with three categories: \"Towing,\" \"Towing,\" and \"Towing,\" alongside a large image of a white semi-truck.\n[270-300s] - Three characters stand in a dimly lit urban area, with one in a blue jacket and another in a white shirt facing each other.  \n- A blue car passes by in the background, moving from left to right across the scene.  \n- The camera angle shifts slightly, revealing more of the surrounding environment including a brick wall and distant city lights.\n[300-330s] - Streamer in top-left corner smiles and gestures while speaking, with a lit background and chat overlay visible.  \n- In-game, two characters stand facing each other in a dimly lit outdoor area, with a blue car and building in the background.  \n- A third character enters from the right, approaching the two, while the streamer’s chat window displays active messages.\n[330-360s] - A player in a blue hoodie stands near a group of three men, facing away from the camera, in a dimly lit outdoor area at night.\n- The player in the blue hoodie is holding a weapon, possibly a pistol, and appears to be in a tense or confrontational stance.\n- A red \"WANTED\" sign is visible on a nearby wall, indicating a high-stakes situation or mission objective.\n[360-390s] - Streamer in top-left corner smiles while wearing headphones and a light-colored shirt.  \n- Game scene shows three characters standing in a dark outdoor area with buildings and parked cars in the background.  \n- A smartphone UI overlay appears on the right side of the screen, displaying app icons and a time of 00:29.\n[390-420s] - Player character walks toward a blue car parked near a yellow \"Limpet Bell\" truck at night.  \n- Streamer in top-left corner smiles while holding a phone, occasionally glancing at the screen.  \n- On-screen UI shows a smartphone interface with \"GTA V\" app icons and a \"GTA V\" notification at 01:09.\n[420-450s] - Player character walks toward a dark vehicle at night, approaching from behind.  \n- Vehicle's headlights illuminate the road as player character reaches it.  \n- Player character enters the vehicle, which is parked near a building with visible streetlights.\n[450-480s] - Player drives a black vehicle with glowing red rear lights along a dark urban road at night.\n- The vehicle's speedometer shows decreasing speed as it navigates the road, indicating slowing down.\n- A chat window on the right side of the screen displays viewer messages and reactions.\n[480-510s] - Player drives a black vehicle with glowing orange rear lights on a city street at night.  \n- The vehicle's speed fluctuates between 85 and 90 mph as it navigates traffic and turns.  \n- A map and speedometer are visible in the bottom-left corner, while a chat log appears on the right.\n[510-540s] - Player drives a van with glowing orange rear lights at night, passing city streets with illuminated buildings.  \n- A green laser sight appears on the dashboard, indicating a weapon or tool activation.  \n- The van's speed fluctuates between 86 and 89 mph as it navigates urban roads.\n[540-570s] - Player navigates a dark urban street at night in a vehicle with glowing orange rear lights.  \n- Map overlay shows route and speed, with speed fluctuating between 60–85 mph.  \n- Vehicle approaches a red traffic light, then proceeds through intersections.", "history_tokens": 964, "history_utf8_bytes": 4013, "recent_frame_times_s": [563.0100833333333, 564.0110833333333, 565.0120833333333, 566.0130833333334, 567.0140833333334, 568.0150833333333, 569.0160833333333, 570.0004, 571.0014, 572.0024, 573.0034, 574.0044, 575.0054, 576.0064, 577.0074, 578.0084, 579.0094, 580.0104, 581.0114, 582.0124, 583.0134, 584.0144, 585.0154, 586.0164, 587.0007166666667, 588.0017166666667, 589.0027166666666, 590.0037166666667, 591.0047166666667, 592.0057166666667], "recent_frames_sha256": "f0732ad6934932ede31b0d6b627f1995716a1bf6ee1aff392bb1f76d9d68cbd3", "num_recent_frames": 30, "tq": 719392.880129799, "t1": 719394.370705077, "ta": 719394.370705077, "te": 719394.601553242, "first_response_s": 1.4905752779450268, "answer_total_s": 1.721423442941159, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 280, "content_group": "34970fe310b85fe7896a2effd53fc257de00657d1f7570afdfd97d0485c2bdb9", "question": {"question_id": "sample_280_a1566_q0", "video_id": 280, "video_path": "./videos/sample_280_real.mp4", "annotation_index": 1566, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Opening the back door of the vehicle.", "B. Interacting with the back door of the vehicle.", "C. Loading items into the vehicle.", "D. Checking the inventory screen."], "answer": "B", "time_stamp_s": 6, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_280_a1566_q0", "video_id": 280, "time_stamp_s": 6, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8510a6844925733b041fc5bf0ddb4fc2bafea02b9df1a4f38ee2c0ac9abfd4c4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.038, 1.0056333333333334, 2.0066333333333333, 3.007633333333333, 4.008633333333333, 5.009633333333333], "recent_frames_sha256": "838eacc1d7568bd72629fbd1ed85806497c15a96dbb85ed42cf75348dea1d6c5", "num_recent_frames": 6, "tq": 710187.846776827, "t1": 710194.019113721, "ta": 710194.019113721, "te": 710194.056734203, "first_response_s": 6.172336893971078, "answer_total_s": 6.209957376006059, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_280_a1566_q0", "video_id": 280, "time_stamp_s": 6, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d837f7f4d62264b19f0f19047def6107ef933e959e0d30ce002967492fc862d4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.038, 1.0056333333333334, 2.0066333333333333, 3.007633333333333, 4.008633333333333, 5.009633333333333], "recent_frames_sha256": "838eacc1d7568bd72629fbd1ed85806497c15a96dbb85ed42cf75348dea1d6c5", "num_recent_frames": 6, "tq": 710018.720116607, "t1": 710019.571515042, "ta": 710019.571515042, "te": 710019.612949543, "first_response_s": 0.8513984349556267, "answer_total_s": 0.892832936020568, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 280, "content_group": "34970fe310b85fe7896a2effd53fc257de00657d1f7570afdfd97d0485c2bdb9", "question": {"question_id": "sample_280_a1567_q0", "video_id": 280, "video_path": "./videos/sample_280_real.mp4", "annotation_index": 1567, "question_index": 0, "question": "What is the controlled character doing right now?", "options": ["A. Walking past the ATM.", "B. Opening the door of the truck.", "C. Walking towards two characters.", "D. Standing in front of the store."], "answer": "B", "time_stamp_s": 173, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_280_a1567_q0", "video_id": 280, "time_stamp_s": 173, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b2b34bf4fd56feff416ad034052c4479f80c9b861bcd0343f394e3ba9864ff92", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [143.01416666666665, 144.01516666666666, 145.01616666666666, 146.00048333333334, 147.00148333333334, 148.00248333333334, 149.00348333333332, 150.00448333333333, 151.00548333333333, 152.00648333333334, 153.00748333333334, 154.00848333333334, 155.00948333333332, 156.01048333333333, 157.01148333333333, 158.01248333333334, 159.01348333333334, 160.01448333333335, 161.01548333333332, 162.01648333333333, 163.0008, 164.0018, 165.0028, 166.0038, 167.0048, 168.0058, 169.0068, 170.0078, 171.0088, 172.0098], "recent_frames_sha256": "7edac66633fde3b61be3b80936b9c4e929117b3ebac52204617d7c83de6c0d8e", "num_recent_frames": 30, "tq": 710194.076669056, "t1": 710201.343784034, "ta": 710201.343784034, "te": 710201.379930188, "first_response_s": 7.267114978050813, "answer_total_s": 7.303261131979525, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_280_a1567_q0", "video_id": 280, "time_stamp_s": 173, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "753e967301a42ff77b8cb26ed9d5dc1780842660a600e12338e6571174e88a3c", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player character in game interface shows health, stamina, and inventory slots with items like \"Pistol\" and \"Rifle\" visible.  \n- Player navigates to a dark outdoor area, then opens a phone app displaying a grid of icons, including \"Exit\" text on the ground.  \n- Game screen transitions to a \"Tuning Progression\" menu showing six vehicle upgrade options with prices and descriptions.\n[30-60s] - Player drives a black van at night through city streets, passing traffic lights and buildings.  \n- A small inset shows a person in a white hoodie reacting to gameplay.  \n- On-screen UI displays speed, map, and chat messages, with a clock showing 11:42.\n[60-90s] - Player's car navigates through a city street at night, passing under illuminated buildings and traffic lights.  \n- A red traffic light is visible ahead, and the car slows as it approaches.  \n- The car's dashboard displays a speed of 85-87 mph, with a fuel gauge indicating 85% remaining.\n[90-120s] - Player drives a black vehicle with glowing orange rear lights through a city at night, passing under bridges and intersections.  \n- The vehicle navigates urban streets with visible traffic lights and other cars, maintaining a steady speed.  \n- On-screen UI elements show a map, speedometer, and chat messages, indicating an active live stream or multiplayer session.\n[120-150s] - Player exits van, approaches \"BINO\" bin, and interacts with a trash receptacle.  \n- A character named \"Harry Miller\" appears in a dialogue box, indicating a mission or interaction.  \n- Player opens inventory, revealing items like \"Pistol\" and \"Handcuffs,\" suggesting preparation for an upcoming task.", "history_tokens": 389, "history_utf8_bytes": 1647, "recent_frame_times_s": [143.01416666666665, 144.01516666666666, 145.01616666666666, 146.00048333333334, 147.00148333333334, 148.00248333333334, 149.00348333333332, 150.00448333333333, 151.00548333333333, 152.00648333333334, 153.00748333333334, 154.00848333333334, 155.00948333333332, 156.01048333333333, 157.01148333333333, 158.01248333333334, 159.01348333333334, 160.01448333333335, 161.01548333333332, 162.01648333333333, 163.0008, 164.0018, 165.0028, 166.0038, 167.0048, 168.0058, 169.0068, 170.0078, 171.0088, 172.0098], "recent_frames_sha256": "7edac66633fde3b61be3b80936b9c4e929117b3ebac52204617d7c83de6c0d8e", "num_recent_frames": 30, "tq": 710051.045337712, "t1": 710051.629946361, "ta": 710051.629946361, "te": 710051.667132196, "first_response_s": 0.5846086489036679, "answer_total_s": 0.6217944839736447, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 280, "content_group": "34970fe310b85fe7896a2effd53fc257de00657d1f7570afdfd97d0485c2bdb9", "question": {"question_id": "sample_280_a1568_q0", "video_id": 280, "video_path": "./videos/sample_280_real.mp4", "annotation_index": 1568, "question_index": 0, "question": "What is the avatar doing right now?", "options": ["A. Changing clothing options.", "B. Picking out clothes.", "C. Rotating in place.", "D. Walking across the room."], "answer": "B", "time_stamp_s": 335, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_280_a1568_q0", "video_id": 280, "time_stamp_s": 335, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f21471c4ea7a4581509dac50daba886813cf0f15fd411e12ce85531738310e95", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [305.00933333333336, 306.01033333333334, 307.0113333333333, 308.01233333333334, 309.0133333333333, 310.01433333333335, 311.01533333333333, 312.0163333333333, 313.00065, 314.00165, 315.00265, 316.00365, 317.00465, 318.00565, 319.00665, 320.00765, 321.00865, 322.00965, 323.01065, 324.01165, 325.01265, 326.01365, 327.01465, 328.01565, 329.01665, 330.00096666666667, 331.00196666666665, 332.0029666666667, 333.00396666666666, 334.0049666666667], "recent_frames_sha256": "556519571f3c4653a4a1fc8f392af55d8f106d170af8b4f923d671742ad0886d", "num_recent_frames": 30, "tq": 710201.405334951, "t1": 710207.467369414, "ta": 710207.467369414, "te": 710207.505265254, "first_response_s": 6.062034463044256, "answer_total_s": 6.099930302938446, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_280_a1568_q0", "video_id": 280, "time_stamp_s": 335, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "cbd7fed32c01f430fe6417d8495140b666ffa711793ad91f4f87c7b83603263d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player character in game interface shows health, stamina, and inventory slots with items like \"Pistol\" and \"Rifle\" visible.  \n- Player navigates to a dark outdoor area, then opens a phone app displaying a grid of icons, including \"Exit\" text on the ground.  \n- Game screen transitions to a \"Tuning Progression\" menu showing six vehicle upgrade options with prices and descriptions.\n[30-60s] - Player drives a black van at night through city streets, passing traffic lights and buildings.  \n- A small inset shows a person in a white hoodie reacting to gameplay.  \n- On-screen UI displays speed, map, and chat messages, with a clock showing 11:42.\n[60-90s] - Player's car navigates through a city street at night, passing under illuminated buildings and traffic lights.  \n- A red traffic light is visible ahead, and the car slows as it approaches.  \n- The car's dashboard displays a speed of 85-87 mph, with a fuel gauge indicating 85% remaining.\n[90-120s] - Player drives a black vehicle with glowing orange rear lights through a city at night, passing under bridges and intersections.  \n- The vehicle navigates urban streets with visible traffic lights and other cars, maintaining a steady speed.  \n- On-screen UI elements show a map, speedometer, and chat messages, indicating an active live stream or multiplayer session.\n[120-150s] - Player exits van, approaches \"BINO\" bin, and interacts with a trash receptacle.  \n- A character named \"Harry Miller\" appears in a dialogue box, indicating a mission or interaction.  \n- Player opens inventory, revealing items like \"Pistol\" and \"Handcuffs,\" suggesting preparation for an upcoming task.\n[150-180s] - Player character approaches a black van with \"prime\" logo, then enters it.  \n- Van drives away from the curb, headlights on, navigating city streets at night.  \n- On-screen UI shows map, time (02:07), and chat messages from viewers.\n[180-210s] - Black van with glowing orange outline drives through city streets at night, passing illuminated buildings and traffic.\n- Player’s minimap and speedometer show movement along a route with changing speed (e.g., 83.8 to 84.3 mph).\n- Chat window on right side displays viewer messages, including “I’m not sure if I’m in the right place.”\n[210-240s] - Player drives a black vehicle with glowing orange outlines through a city at night, passing under bridges and intersections.  \n- The vehicle navigates through traffic, including a red car, and enters a tunnel with artificial lighting.  \n- A small inset shows a person in a white hoodie reacting to gameplay, with a chat overlay displaying viewer messages.\n[240-270s] - Player drives a black vehicle with glowing orange rear lights through a city at night, passing traffic lights and intersections.\n- The vehicle's speed fluctuates between 84 to 90 mph as it navigates streets with visible road markings and illuminated buildings.\n- A small inset window shows a person with blonde hair reacting to gameplay, while the main screen displays a map and game stats in the lower-left corner.\n[270-300s] - Player character enters a store, wearing a blue and white striped shirt, and interacts with a menu interface.  \n- The store interior features wooden counters, shelves with goods, and other NPCs browsing or working.  \n- A chat window on the right displays viewer messages, including one about \"Benny\" and another about \"Benny's\" location.\n[300-330s] - Player character in GTA V wears a blue and white striped shirt, standing indoors near a door.  \n- In-game UI shows inventory with various clothing items and a chat log on the right.  \n- Streamer in top-left corner is wearing a light-colored hoodie and appears to be speaking.", "history_tokens": 864, "history_utf8_bytes": 3688, "recent_frame_times_s": [305.00933333333336, 306.01033333333334, 307.0113333333333, 308.01233333333334, 309.0133333333333, 310.01433333333335, 311.01533333333333, 312.0163333333333, 313.00065, 314.00165, 315.00265, 316.00365, 317.00465, 318.00565, 319.00665, 320.00765, 321.00865, 322.00965, 323.01065, 324.01165, 325.01265, 326.01365, 327.01465, 328.01565, 329.01665, 330.00096666666667, 331.00196666666665, 332.0029666666667, 333.00396666666666, 334.0049666666667], "recent_frames_sha256": "556519571f3c4653a4a1fc8f392af55d8f106d170af8b4f923d671742ad0886d", "num_recent_frames": 30, "tq": 710105.741451764, "t1": 710117.079628138, "ta": 710117.079628138, "te": 710117.123380268, "first_response_s": 11.33817637397442, "answer_total_s": 11.381928503978997, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 280, "content_group": "34970fe310b85fe7896a2effd53fc257de00657d1f7570afdfd97d0485c2bdb9", "question": {"question_id": "sample_280_a1569_q0", "video_id": 280, "video_path": "./videos/sample_280_real.mp4", "annotation_index": 1569, "question_index": 0, "question": "What is the blonde character doing right now?", "options": ["A. Walking towards a window.", "B. Observing items around the room.", "C. Talking to the woman nearby.", "D. Picking up clothes."], "answer": "D", "time_stamp_s": 500, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_280_a1569_q0", "video_id": 280, "time_stamp_s": 500, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b2ea6c6622aae0117a899194ccfe81cdce4e1357d632e1bc3788ca57dd2f0edf", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [470.0075, 471.0085, 472.0095, 473.0105, 474.0115, 475.0125, 476.0135, 477.0145, 478.0155, 479.0165, 480.00081666666665, 481.0018166666667, 482.00281666666666, 483.0038166666667, 484.00481666666667, 485.00581666666665, 486.0068166666667, 487.00781666666666, 488.0088166666667, 489.00981666666667, 490.01081666666664, 491.0118166666667, 492.01281666666665, 493.0138166666667, 494.01481666666666, 495.0158166666667, 496.00013333333334, 497.0011333333333, 498.00213333333335, 499.0031333333333], "recent_frames_sha256": "c6c818900cc299809030834fc0893c7366dcebe58853a9fe27a1bcaffe737196", "num_recent_frames": 30, "tq": 710207.52465575, "t1": 710212.568594372, "ta": 710212.568594372, "te": 710212.606082771, "first_response_s": 5.043938621995039, "answer_total_s": 5.0814270209521055, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_280_a1569_q0", "video_id": 280, "time_stamp_s": 500, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b4828afa2050aaa4008532702dcab25f61183fcd51ec3296191ccbebd37fda3f", "condition_order": ["notes", "recent"], "memory": "[120-150s] - Player exits van, approaches \"BINO\" bin, and interacts with a trash receptacle.  \n- A character named \"Harry Miller\" appears in a dialogue box, indicating a mission or interaction.  \n- Player opens inventory, revealing items like \"Pistol\" and \"Handcuffs,\" suggesting preparation for an upcoming task.\n[150-180s] - Player character approaches a black van with \"prime\" logo, then enters it.  \n- Van drives away from the curb, headlights on, navigating city streets at night.  \n- On-screen UI shows map, time (02:07), and chat messages from viewers.\n[180-210s] - Black van with glowing orange outline drives through city streets at night, passing illuminated buildings and traffic.\n- Player’s minimap and speedometer show movement along a route with changing speed (e.g., 83.8 to 84.3 mph).\n- Chat window on right side displays viewer messages, including “I’m not sure if I’m in the right place.”\n[210-240s] - Player drives a black vehicle with glowing orange outlines through a city at night, passing under bridges and intersections.  \n- The vehicle navigates through traffic, including a red car, and enters a tunnel with artificial lighting.  \n- A small inset shows a person in a white hoodie reacting to gameplay, with a chat overlay displaying viewer messages.\n[240-270s] - Player drives a black vehicle with glowing orange rear lights through a city at night, passing traffic lights and intersections.\n- The vehicle's speed fluctuates between 84 to 90 mph as it navigates streets with visible road markings and illuminated buildings.\n- A small inset window shows a person with blonde hair reacting to gameplay, while the main screen displays a map and game stats in the lower-left corner.\n[270-300s] - Player character enters a store, wearing a blue and white striped shirt, and interacts with a menu interface.  \n- The store interior features wooden counters, shelves with goods, and other NPCs browsing or working.  \n- A chat window on the right displays viewer messages, including one about \"Benny\" and another about \"Benny's\" location.\n[300-330s] - Player character in GTA V wears a blue and white striped shirt, standing indoors near a door.  \n- In-game UI shows inventory with various clothing items and a chat log on the right.  \n- Streamer in top-left corner is wearing a light-colored hoodie and appears to be speaking.\n[330-360s] - Player character wears a dark jacket over a black top and light pants, standing in a dimly lit room with a door visible behind them.  \n- In-game inventory UI is open on the right, displaying multiple clothing items with a \"CLOTHING\" tab active, showing various tops, bottoms, and accessories.  \n- Streamer's webcam view shows them smiling and looking at the screen, with a small inset image of a different character briefly appearing near the top left.\n[360-390s] - Player character in GTA V wears a black polo shirt and stands indoors near a door, with inventory UI visible on the right.\n- Streamer in top-left corner wears headphones and looks toward the screen, reacting to gameplay.\n- Inventory grid cycles through clothing items, with a green arrow icon indicating selection or movement of items.\n[390-420s] - Streamer in top-left corner smiles while holding a microphone, reacting to gameplay.  \n- In-game character (blond, gray t-shirt) stands in a dimly lit room, facing right, then turns slightly.  \n- Right-side UI displays inventory and chat, with \"CLOTHING\" tab active, showing various outfit options.\n[420-450s] - Player character in GTA V wears a grey t-shirt and jeans, standing in a room with a visible inventory UI on the right.\n- The player cycles through clothing items in the inventory, changing from a grey t-shirt to a dark polo shirt.\n- A webcam feed in the top-left corner shows a person smiling while watching the gameplay.\n[450-480s] - Player character in dark polo shirt and jeans stands in a room with server racks, facing right, while the UI menu is open on the right side of screen.\n- In the top-left corner, a webcam feed shows a person with light-colored hair and a white shirt, looking at the screen.\n- The game's inventory or customization menu is visible, displaying various clothing items and accessories, with a \"Character Creator\" label at the top.", "history_tokens": 989, "history_utf8_bytes": 4254, "recent_frame_times_s": [470.0075, 471.0085, 472.0095, 473.0105, 474.0115, 475.0125, 476.0135, 477.0145, 478.0155, 479.0165, 480.00081666666665, 481.0018166666667, 482.00281666666666, 483.0038166666667, 484.00481666666667, 485.00581666666665, 486.0068166666667, 487.00781666666666, 488.0088166666667, 489.00981666666667, 490.01081666666664, 491.0118166666667, 492.01281666666665, 493.0138166666667, 494.01481666666666, 495.0158166666667, 496.00013333333334, 497.0011333333333, 498.00213333333335, 499.0031333333333], "recent_frames_sha256": "c6c818900cc299809030834fc0893c7366dcebe58853a9fe27a1bcaffe737196", "num_recent_frames": 30, "tq": 710150.572723643, "t1": 710151.645792765, "ta": 710151.645792765, "te": 710151.860824554, "first_response_s": 1.073069121921435, "answer_total_s": 1.2881009109551087, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 280, "content_group": "34970fe310b85fe7896a2effd53fc257de00657d1f7570afdfd97d0485c2bdb9", "question": {"question_id": "sample_280_a1570_q0", "video_id": 280, "video_path": "./videos/sample_280_real.mp4", "annotation_index": 1570, "question_index": 0, "question": "What is the outermost piece of clothing currently being worn on the upper body?", "options": ["A. A pair of glasses.", "B. A high-visibility vest.", "C. A grey polo shirt.", "D. A new hairstyle."], "answer": "B", "time_stamp_s": 589, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_280_a1570_q0", "video_id": 280, "time_stamp_s": 589, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0a1780f9c0cfc42e90ffae8b5c0413912c1b3294a57d8c0af88070882c67a499", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [559.0130833333334, 560.0140833333334, 561.0150833333333, 562.0160833333333, 563.0004, 564.0014, 565.0024, 566.0034, 567.0044, 568.0054, 569.0064, 570.0074, 571.0084, 572.0094, 573.0104, 574.0114, 575.0124, 576.0134, 577.0144, 578.0154, 579.0164, 580.0007166666667, 581.0017166666667, 582.0027166666666, 583.0037166666667, 584.0047166666667, 585.0057166666667, 586.0067166666666, 587.0077166666666, 588.0087166666667], "recent_frames_sha256": "84df8eb8e2bb2285c3db0ccae1393c5b3f854b333b8aa090e54a4f7eca533a64", "num_recent_frames": 30, "tq": 710212.644266396, "t1": 710220.021302199, "ta": 710220.021302199, "te": 710220.058793669, "first_response_s": 7.377035803045146, "answer_total_s": 7.414527273038402, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_280_a1570_q0", "video_id": 280, "time_stamp_s": 589, "ground_truth": "B", "raw_output": "C. A grey polo shirt.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "c4073cdbdf3f95a84eb9ac89ca9fa954d9b12660175a442531f6503d8d651772", "condition_order": ["notes", "recent"], "memory": "[240-270s] - Player drives a black vehicle with glowing orange rear lights through a city at night, passing traffic lights and intersections.\n- The vehicle's speed fluctuates between 84 to 90 mph as it navigates streets with visible road markings and illuminated buildings.\n- A small inset window shows a person with blonde hair reacting to gameplay, while the main screen displays a map and game stats in the lower-left corner.\n[270-300s] - Player character enters a store, wearing a blue and white striped shirt, and interacts with a menu interface.  \n- The store interior features wooden counters, shelves with goods, and other NPCs browsing or working.  \n- A chat window on the right displays viewer messages, including one about \"Benny\" and another about \"Benny's\" location.\n[300-330s] - Player character in GTA V wears a blue and white striped shirt, standing indoors near a door.  \n- In-game UI shows inventory with various clothing items and a chat log on the right.  \n- Streamer in top-left corner is wearing a light-colored hoodie and appears to be speaking.\n[330-360s] - Player character wears a dark jacket over a black top and light pants, standing in a dimly lit room with a door visible behind them.  \n- In-game inventory UI is open on the right, displaying multiple clothing items with a \"CLOTHING\" tab active, showing various tops, bottoms, and accessories.  \n- Streamer's webcam view shows them smiling and looking at the screen, with a small inset image of a different character briefly appearing near the top left.\n[360-390s] - Player character in GTA V wears a black polo shirt and stands indoors near a door, with inventory UI visible on the right.\n- Streamer in top-left corner wears headphones and looks toward the screen, reacting to gameplay.\n- Inventory grid cycles through clothing items, with a green arrow icon indicating selection or movement of items.\n[390-420s] - Streamer in top-left corner smiles while holding a microphone, reacting to gameplay.  \n- In-game character (blond, gray t-shirt) stands in a dimly lit room, facing right, then turns slightly.  \n- Right-side UI displays inventory and chat, with \"CLOTHING\" tab active, showing various outfit options.\n[420-450s] - Player character in GTA V wears a grey t-shirt and jeans, standing in a room with a visible inventory UI on the right.\n- The player cycles through clothing items in the inventory, changing from a grey t-shirt to a dark polo shirt.\n- A webcam feed in the top-left corner shows a person smiling while watching the gameplay.\n[450-480s] - Player character in dark polo shirt and jeans stands in a room with server racks, facing right, while the UI menu is open on the right side of screen.\n- In the top-left corner, a webcam feed shows a person with light-colored hair and a white shirt, looking at the screen.\n- The game's inventory or customization menu is visible, displaying various clothing items and accessories, with a \"Character Creator\" label at the top.\n[480-510s] - Player character in game wears dark polo shirt, denim shorts, and white shoes, standing in a dimly lit room with shelves and crates.  \n- Right side of screen shows character customization menu with clothing options, including pants and tops, with a \"Select\" button visible.  \n- Top-right corner displays a list of online players with avatars and names, including \"KARL\" and \"KARL2\", indicating multiplayer context.\n[510-540s] - Player character in game wears dark shirt, pants, and white shoes, standing in a cluttered room with shelves and tools.  \n- Right side of screen shows an open clothing menu with multiple outfit options, including camouflage pants and striped pants.  \n- Top-right corner displays a list of items or characters with icons and names, including \"CRAZY\" and \"CRAZY\" again, suggesting a possible duplicate or error.\n[540-570s] - Player character in game wears dark shirt, jeans, and white shoes, standing in a dimly lit room with shelves and equipment.\n- Right side of screen shows inventory UI with multiple slots, some containing items like weapons or clothing, and a \"Tactical\" tab highlighted.\n- Top-right corner displays a list of player stats or items with icons, including \"Tactical\" and \"Tactical\" again, suggesting a menu or selection interface.", "history_tokens": 977, "history_utf8_bytes": 4258, "recent_frame_times_s": [559.0130833333334, 560.0140833333334, 561.0150833333333, 562.0160833333333, 563.0004, 564.0014, 565.0024, 566.0034, 567.0044, 568.0054, 569.0064, 570.0074, 571.0084, 572.0094, 573.0104, 574.0114, 575.0124, 576.0134, 577.0144, 578.0154, 579.0164, 580.0007166666667, 581.0017166666667, 582.0027166666666, 583.0037166666667, 584.0047166666667, 585.0057166666667, 586.0067166666666, 587.0077166666666, 588.0087166666667], "recent_frames_sha256": "84df8eb8e2bb2285c3db0ccae1393c5b3f854b333b8aa090e54a4f7eca533a64", "num_recent_frames": 30, "tq": 710180.256698996, "t1": 710187.481614602, "ta": 710187.481614602, "te": 710187.815963848, "first_response_s": 7.224915606086142, "answer_total_s": 7.559264852083288, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 281, "content_group": "01ca8532ad0229c92646d787b119a289970c99b0f621bf700f57f71a98ddc65b", "question": {"question_id": "sample_281_a177_q0", "video_id": 281, "video_path": "./videos/sample_281_real.mp4", "annotation_index": 177, "question_index": 0, "question": "What is the person with blond hair doing right now?", "options": ["A. Changing clothing.", "B. Sitting at a desk.", "C. Walking around the room.", "D. Exiting through the metal gate."], "answer": "A", "time_stamp_s": 20, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_281_a177_q0", "video_id": 281, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2917f6f21845c5bd6042ed581d51cadeaf26fabaeedc6ec981aae903625a35ff", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.027, 1.0113166666666666, 2.0123166666666665, 3.013316666666667, 4.014316666666667, 5.015316666666667, 6.0163166666666665, 7.000633333333333, 8.001633333333332, 9.002633333333334, 10.003633333333333, 11.004633333333333, 12.005633333333334, 13.006633333333333, 14.007633333333333, 15.008633333333334, 16.009633333333333, 17.010633333333335, 18.011633333333332, 19.012633333333333], "recent_frames_sha256": "c301d2ddec5b6de5f347206276f368a64b8678a65d625bc6f2fd78b4492109d0", "num_recent_frames": 20, "tq": 710213.836289784, "t1": 710220.021302199, "ta": 710220.021302199, "te": 710220.058793669, "first_response_s": 6.185012414935045, "answer_total_s": 6.222503884928301, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_281_a177_q0", "video_id": 281, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5f236bb8c022a4ffe4f8b7f098269f814c29284863fc719bcc9e773d0ce20e79", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.027, 1.0113166666666666, 2.0123166666666665, 3.013316666666667, 4.014316666666667, 5.015316666666667, 6.0163166666666665, 7.000633333333333, 8.001633333333332, 9.002633333333334, 10.003633333333333, 11.004633333333333, 12.005633333333334, 13.006633333333333, 14.007633333333333, 15.008633333333334, 16.009633333333333, 17.010633333333335, 18.011633333333332, 19.012633333333333], "recent_frames_sha256": "c301d2ddec5b6de5f347206276f368a64b8678a65d625bc6f2fd78b4492109d0", "num_recent_frames": 20, "tq": 710018.719607868, "t1": 710019.571515042, "ta": 710019.571515042, "te": 710019.612949543, "first_response_s": 0.8519071739865467, "answer_total_s": 0.893341675051488, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 281, "content_group": "01ca8532ad0229c92646d787b119a289970c99b0f621bf700f57f71a98ddc65b", "question": {"question_id": "sample_281_a178_q0", "video_id": 281, "video_path": "./videos/sample_281_real.mp4", "annotation_index": 178, "question_index": 0, "question": "What is the character doing right now?", "options": ["A. Standing still in a room.", "B. Walking towards the exit.", "C. Interacting with the chat section.", "D. Changing clothing."], "answer": "B", "time_stamp_s": 199, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_281_a178_q0", "video_id": 281, "time_stamp_s": 199, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9a3076daf150905a9adfa8d71b4ad7c6ba3eebc068642536474b1eee2be679f1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [169.01248333333334, 170.01348333333334, 171.01448333333335, 172.01548333333332, 173.01648333333333, 174.0008, 175.0018, 176.0028, 177.0038, 178.0048, 179.0058, 180.0068, 181.0078, 182.0088, 183.0098, 184.0108, 185.0118, 186.0128, 187.0138, 188.0148, 189.0158, 190.00011666666666, 191.00111666666666, 192.00211666666667, 193.00311666666667, 194.00411666666668, 195.00511666666668, 196.00611666666666, 197.00711666666666, 198.00811666666667], "recent_frames_sha256": "02dc13a74eeafa27c253cc067cb68775358d0394a51deeafba9bad10dc7ac1b6", "num_recent_frames": 30, "tq": 710220.082901242, "t1": 710221.362050748, "ta": 710221.362050748, "te": 710221.402792724, "first_response_s": 1.2791495060082525, "answer_total_s": 1.3198914820095524, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_281_a178_q0", "video_id": 281, "time_stamp_s": 199, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "77941af699d34edfebe1115f6e1ab87c98a9578fd960e51ed3c411fe21859a61", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player character in GTA V's garage interface, wearing a yellow-striped vest and cap, interacts with inventory UI.  \n- Streamer with blonde hair visible in top-left corner, watching gameplay.  \n- Right side of screen shows character stats and inventory grid with various items, including weapons and tools.\n[30-60s] - Player character in game wears green vest, dark pants, and white shoes, standing in a dimly lit room with shelves and tools.  \n- Right side of screen shows inventory grid with various items, including weapons and gear, and a character profile with stats.  \n- Top-left corner displays a live webcam feed of a person with light-colored hair, wearing a white shirt, looking at the screen.\n[60-90s] - Player character in green vest and cap stands still, facing away from camera, near shelves with items.  \n- Another character in dark clothing is partially visible to the right, standing still.  \n- Inventory UI on right side shows equipped gear and items, with \"COSTUME\" tab active.\n[90-120s] - Player character stands in a dimly lit store, facing a female NPC who is partially visible behind shelves.  \n- Inventory UI is open on the right, showing various items and a highlighted \"Chest\" slot.  \n- The player character’s head is turned slightly to the left, suggesting interaction or observation of the environment.\n[120-150s] - Player character stands in a store, facing a female NPC in a purple top and black pants near the back.  \n- Inventory UI is open, showing various items like weapons and clothing, with a highlighted \"Tactical Vest\" option.  \n- A small clock on the wall behind the player indicates the time, though its exact reading is unclear.\n[150-180s] - Player character in yellow vest and helmet stands still, facing camera, with inventory UI visible on right.\n- Another character in dark clothing stands in background, facing away from camera, near a doorway.\n- Chat window on right side displays live messages, including \"SOMETHING'S WRONG\" and \"I'M NOT SURE WHAT TO DO.\"", "history_tokens": 459, "history_utf8_bytes": 2014, "recent_frame_times_s": [169.01248333333334, 170.01348333333334, 171.01448333333335, 172.01548333333332, 173.01648333333333, 174.0008, 175.0018, 176.0028, 177.0038, 178.0048, 179.0058, 180.0068, 181.0078, 182.0088, 183.0098, 184.0108, 185.0118, 186.0128, 187.0138, 188.0148, 189.0158, 190.00011666666666, 191.00111666666666, 192.00211666666667, 193.00311666666667, 194.00411666666668, 195.00511666666668, 196.00611666666666, 197.00711666666666, 198.00811666666667], "recent_frames_sha256": "02dc13a74eeafa27c253cc067cb68775358d0394a51deeafba9bad10dc7ac1b6", "num_recent_frames": 30, "tq": 710057.453531141, "t1": 710064.477424292, "ta": 710064.477424292, "te": 710064.703391504, "first_response_s": 7.0238931509666145, "answer_total_s": 7.249860362964682, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 281, "content_group": "01ca8532ad0229c92646d787b119a289970c99b0f621bf700f57f71a98ddc65b", "question": {"question_id": "sample_281_a179_q0", "video_id": 281, "video_path": "./videos/sample_281_real.mp4", "annotation_index": 179, "question_index": 0, "question": "What did the driver do just now?", "options": ["A. Turned the van left onto a street.", "B. Stopped at a traffic light.", "C. Drove straight down the street.", "D. Checked the dashboard."], "answer": "A", "time_stamp_s": 368, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_281_a179_q0", "video_id": 281, "time_stamp_s": 368, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c638a54f8c46bcb09fcd96be701239d4f0bf9933c8d7f3379307ea4790454056", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [338.01465, 339.01565, 340.01665, 341.00096666666667, 342.00196666666665, 343.0029666666667, 344.00396666666666, 345.0049666666667, 346.00596666666667, 347.00696666666664, 348.0079666666667, 349.00896666666665, 350.0099666666667, 351.01096666666666, 352.0119666666667, 353.01296666666667, 354.01396666666665, 355.0149666666667, 356.01596666666666, 357.00028333333336, 358.00128333333333, 359.0022833333333, 360.00328333333334, 361.0042833333333, 362.00528333333335, 363.00628333333333, 364.0072833333333, 365.00828333333334, 366.0092833333333, 367.01028333333335], "recent_frames_sha256": "9b4e01bf172ed7187a96fef807017890eb1ea017e158a963f7480bfc3882107c", "num_recent_frames": 30, "tq": 710221.448433811, "t1": 710229.033619576, "ta": 710229.033619576, "te": 710229.073084919, "first_response_s": 7.5851857650559396, "answer_total_s": 7.624651108053513, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_281_a179_q0", "video_id": 281, "time_stamp_s": 368, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1198ab452438045c3b35ddbc8c9d650d06b703ed95ee31eede01c2f2ba3bb2cc", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player character in GTA V's garage interface, wearing a yellow-striped vest and cap, interacts with inventory UI.  \n- Streamer with blonde hair visible in top-left corner, watching gameplay.  \n- Right side of screen shows character stats and inventory grid with various items, including weapons and tools.\n[30-60s] - Player character in game wears green vest, dark pants, and white shoes, standing in a dimly lit room with shelves and tools.  \n- Right side of screen shows inventory grid with various items, including weapons and gear, and a character profile with stats.  \n- Top-left corner displays a live webcam feed of a person with light-colored hair, wearing a white shirt, looking at the screen.\n[60-90s] - Player character in green vest and cap stands still, facing away from camera, near shelves with items.  \n- Another character in dark clothing is partially visible to the right, standing still.  \n- Inventory UI on right side shows equipped gear and items, with \"COSTUME\" tab active.\n[90-120s] - Player character stands in a dimly lit store, facing a female NPC who is partially visible behind shelves.  \n- Inventory UI is open on the right, showing various items and a highlighted \"Chest\" slot.  \n- The player character’s head is turned slightly to the left, suggesting interaction or observation of the environment.\n[120-150s] - Player character stands in a store, facing a female NPC in a purple top and black pants near the back.  \n- Inventory UI is open, showing various items like weapons and clothing, with a highlighted \"Tactical Vest\" option.  \n- A small clock on the wall behind the player indicates the time, though its exact reading is unclear.\n[150-180s] - Player character in yellow vest and helmet stands still, facing camera, with inventory UI visible on right.\n- Another character in dark clothing stands in background, facing away from camera, near a doorway.\n- Chat window on right side displays live messages, including \"SOMETHING'S WRONG\" and \"I'M NOT SURE WHAT TO DO.\"\n[180-210s] - Player character, wearing a yellow vest and goggles, opens an inventory menu while standing indoors.  \n- Streamer in top-left corner is seen smiling and gesturing, with a lit background.  \n- Player character exits the room, walks toward a dark van parked outside, and approaches its side.\n[210-240s] - Player character in a shop, wearing a yellow safety vest and goggles, stands near a counter while browsing an open inventory menu.  \n- A female character in a black outfit is partially visible to the left, standing near a vending machine.  \n- The inventory menu displays various clothing and gear items, with the player selecting and previewing different headgear options.\n[240-270s] - Player character stands in a shop, wearing a yellow safety vest and goggles, facing a UI menu for gear selection.  \n- A blonde woman in a beige top is visible to the left, partially turned away, near a counter with shelves behind her.  \n- The UI menu displays various armor and weapon options, with a highlighted \"Chest\" slot and a \"Backpack\" section visible.\n[270-300s] - Player character in yellow safety vest and goggles stands facing a counter, with inventory UI open on right side.  \n- Female NPC in beige top and dark shorts stands to left of player, partially visible behind counter.  \n- Inventory UI displays various items including weapons, tools, and consumables, with \"Buy\" option highlighted for a specific item.\n[300-330s] - Player character in yellow vest and helmet stands in a dimly lit room with shelves and a counter, facing a UI inventory grid.  \n- A small inset window shows a smiling streamer in a hoodie, reacting to gameplay.  \n- The inventory UI displays various items, including weapons and tools, with a \"Use\" button visible at the bottom.\n[330-360s] - Player character exits a dimly lit shop, passing a woman in a white top and black shorts who is standing near a counter.  \n- Player character approaches a dark van with \"gring\" visible on its side, then enters the vehicle.  \n- Player character drives the van through a nighttime urban street, with a map and speedometer visible on screen.", "history_tokens": 945, "history_utf8_bytes": 4133, "recent_frame_times_s": [338.01465, 339.01565, 340.01665, 341.00096666666667, 342.00196666666665, 343.0029666666667, 344.00396666666666, 345.0049666666667, 346.00596666666667, 347.00696666666664, 348.0079666666667, 349.00896666666665, 350.0099666666667, 351.01096666666666, 352.0119666666667, 353.01296666666667, 354.01396666666665, 355.0149666666667, 356.01596666666666, 357.00028333333336, 358.00128333333333, 359.0022833333333, 360.00328333333334, 361.0042833333333, 362.00528333333335, 363.00628333333333, 364.0072833333333, 365.00828333333334, 366.0092833333333, 367.01028333333335], "recent_frames_sha256": "9b4e01bf172ed7187a96fef807017890eb1ea017e158a963f7480bfc3882107c", "num_recent_frames": 30, "tq": 710115.068604448, "t1": 710117.079628138, "ta": 710117.079628138, "te": 710117.123380268, "first_response_s": 2.011023689992726, "answer_total_s": 2.054775819997303, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 281, "content_group": "01ca8532ad0229c92646d787b119a289970c99b0f621bf700f57f71a98ddc65b", "question": {"question_id": "sample_281_a180_q0", "video_id": 281, "video_path": "./videos/sample_281_real.mp4", "annotation_index": 180, "question_index": 0, "question": "What did the character just do?", "options": ["A. Walked towards a white car.", "B. Opened the door of the van and climbed into the driver's seat.", "C. Stood in front of a building with Harry Miller.", "D. Placed items in a cardboard box."], "answer": "B", "time_stamp_s": 555, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_281_a180_q0", "video_id": 281, "time_stamp_s": 555, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "06ddfd79b0bfb98a18159907e337dd0e3b023f496bb684af6e342a408cd1d2b5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [525.00145, 526.00245, 527.00345, 528.00445, 529.00545, 530.00645, 531.00745, 532.00845, 533.00945, 534.01045, 535.01145, 536.01245, 537.01345, 538.01445, 539.01545, 540.01645, 541.0007666666667, 542.0017666666666, 543.0027666666666, 544.0037666666667, 545.0047666666667, 546.0057666666667, 547.0067666666666, 548.0077666666666, 549.0087666666667, 550.0097666666667, 551.0107666666667, 552.0117666666666, 553.0127666666667, 554.0137666666667], "recent_frames_sha256": "42964edd98165219faaeba9a38892b37750f3eb3f808cf6485bb5b1b0af5f717", "num_recent_frames": 30, "tq": 710229.090321791, "t1": 710235.191555613, "ta": 710235.191555613, "te": 710235.23045464, "first_response_s": 6.101233821944334, "answer_total_s": 6.140132848988287, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_281_a180_q0", "video_id": 281, "time_stamp_s": 555, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2215e09557aaed3c771472d5634d9f8e8f9f4fec32f13a4ad47c0d9654914831", "condition_order": ["notes", "recent"], "memory": "[180-210s] - Player character, wearing a yellow vest and goggles, opens an inventory menu while standing indoors.  \n- Streamer in top-left corner is seen smiling and gesturing, with a lit background.  \n- Player character exits the room, walks toward a dark van parked outside, and approaches its side.\n[210-240s] - Player character in a shop, wearing a yellow safety vest and goggles, stands near a counter while browsing an open inventory menu.  \n- A female character in a black outfit is partially visible to the left, standing near a vending machine.  \n- The inventory menu displays various clothing and gear items, with the player selecting and previewing different headgear options.\n[240-270s] - Player character stands in a shop, wearing a yellow safety vest and goggles, facing a UI menu for gear selection.  \n- A blonde woman in a beige top is visible to the left, partially turned away, near a counter with shelves behind her.  \n- The UI menu displays various armor and weapon options, with a highlighted \"Chest\" slot and a \"Backpack\" section visible.\n[270-300s] - Player character in yellow safety vest and goggles stands facing a counter, with inventory UI open on right side.  \n- Female NPC in beige top and dark shorts stands to left of player, partially visible behind counter.  \n- Inventory UI displays various items including weapons, tools, and consumables, with \"Buy\" option highlighted for a specific item.\n[300-330s] - Player character in yellow vest and helmet stands in a dimly lit room with shelves and a counter, facing a UI inventory grid.  \n- A small inset window shows a smiling streamer in a hoodie, reacting to gameplay.  \n- The inventory UI displays various items, including weapons and tools, with a \"Use\" button visible at the bottom.\n[330-360s] - Player character exits a dimly lit shop, passing a woman in a white top and black shorts who is standing near a counter.  \n- Player character approaches a dark van with \"gring\" visible on its side, then enters the vehicle.  \n- Player character drives the van through a nighttime urban street, with a map and speedometer visible on screen.\n[360-390s] - Player drives a black van with glowing orange trim through a city at night, passing under an overpass.\n- The van accelerates past traffic lights, with speedometer showing increasing speeds (e.g., 85 mph).\n- A red traffic light is visible ahead, and the player stops briefly before proceeding.\n[390-420s] - Player drives black van with orange trim through city streets at night, passing illuminated signs and traffic lights.\n- Van stops at a gas station; player enters, then exits to a convenience store where a character in a vest stands near the counter.\n- Player interacts with store interface, showing inventory and character stats, while another character in blue jeans and white shirt stands near the counter.\n[420-450s] - Player character exits a building, carrying a cardboard box, then approaches a black van parked outside.  \n- Van is driven away from the building, moving along a city street at night, with streetlights and buildings visible.  \n- Player character is seen in a small inset window, wearing headphones and reacting to gameplay, while the main screen shows the van’s movement.\n[450-480s] - Player drives a glowing green vehicle through a city at night, with speedometer showing 85+ mph.\n- The vehicle passes under an overpass, then turns left onto a street with illuminated buildings.\n- A map in the bottom-left corner displays route guidance, and a chat window is visible on the right side of the screen.\n[480-510s] - A black vehicle with glowing orange rectangular outlines on its rear is driving through a city at night, passing under a bridge and through a tunnel.  \n- The vehicle's speed fluctuates between 86.5 and 87.8 mph as it navigates urban streets with traffic lights and palm trees.  \n- The driver, visible in a small inset, is wearing headphones and appears to be reacting to the gameplay.\n[510-540s] - A black van with glowing orange trim drives through a city at night, passing traffic lights and buildings.  \n- The driver, visible in a small inset, wears headphones and reacts to gameplay.  \n- The van approaches a crosswalk, stops at a red light, then proceeds forward after the light turns green.", "history_tokens": 976, "history_utf8_bytes": 4272, "recent_frame_times_s": [525.00145, 526.00245, 527.00345, 528.00445, 529.00545, 530.00645, 531.00745, 532.00845, 533.00945, 534.01045, 535.01145, 536.01245, 537.01345, 538.01445, 539.01545, 540.01645, 541.0007666666667, 542.0017666666666, 543.0027666666666, 544.0037666666667, 545.0047666666667, 546.0057666666667, 547.0067666666666, 548.0077666666666, 549.0087666666667, 550.0097666666667, 551.0107666666667, 552.0117666666666, 553.0127666666667, 554.0137666666667], "recent_frames_sha256": "42964edd98165219faaeba9a38892b37750f3eb3f808cf6485bb5b1b0af5f717", "num_recent_frames": 30, "tq": 710168.594107869, "t1": 710175.446253593, "ta": 710175.446253593, "te": 710175.483614045, "first_response_s": 6.852145723998547, "answer_total_s": 6.889506175997667, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 281, "content_group": "01ca8532ad0229c92646d787b119a289970c99b0f621bf700f57f71a98ddc65b", "question": {"question_id": "sample_281_a181_q0", "video_id": 281, "video_path": "./videos/sample_281_real.mp4", "annotation_index": 181, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Standing by a corner of a building.", "B. Moving to the right side of the frame.", "C. Inspecting or interacting with a black object.", "D. Organizing items within an inventory interface."], "answer": "D", "time_stamp_s": 698, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_281_a181_q0", "video_id": 281, "time_stamp_s": 698, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9e253764d959244a92113d9ef844e897b2fa8e1435bc201beec94380bace0d48", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [668.0109833333333, 669.0119833333333, 670.0129833333333, 671.0139833333334, 672.0149833333334, 673.0159833333333, 674.0003, 675.0013, 676.0023, 677.0033, 678.0043, 679.0053, 680.0063, 681.0073, 682.0083, 683.0093, 684.0103, 685.0113, 686.0123, 687.0133, 688.0143, 689.0153, 690.0163, 691.0006166666667, 692.0016166666667, 693.0026166666667, 694.0036166666666, 695.0046166666667, 696.0056166666667, 697.0066166666667], "recent_frames_sha256": "c0e929fa826e34f47d729082e8f7c24cde1b59791156709a9202af837037caa2", "num_recent_frames": 30, "tq": 710235.248379549, "t1": 710246.444775297, "ta": 710246.444775297, "te": 710246.515528338, "first_response_s": 11.196395747945644, "answer_total_s": 11.267148789018393, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_281_a181_q0", "video_id": 281, "time_stamp_s": 698, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "10c4d6e7938207a96b410f6a68c3796c86805bec93c25e884e8da02a24e46e09", "condition_order": ["notes", "recent"], "memory": "[330-360s] - Player character exits a dimly lit shop, passing a woman in a white top and black shorts who is standing near a counter.  \n- Player character approaches a dark van with \"gring\" visible on its side, then enters the vehicle.  \n- Player character drives the van through a nighttime urban street, with a map and speedometer visible on screen.\n[360-390s] - Player drives a black van with glowing orange trim through a city at night, passing under an overpass.\n- The van accelerates past traffic lights, with speedometer showing increasing speeds (e.g., 85 mph).\n- A red traffic light is visible ahead, and the player stops briefly before proceeding.\n[390-420s] - Player drives black van with orange trim through city streets at night, passing illuminated signs and traffic lights.\n- Van stops at a gas station; player enters, then exits to a convenience store where a character in a vest stands near the counter.\n- Player interacts with store interface, showing inventory and character stats, while another character in blue jeans and white shirt stands near the counter.\n[420-450s] - Player character exits a building, carrying a cardboard box, then approaches a black van parked outside.  \n- Van is driven away from the building, moving along a city street at night, with streetlights and buildings visible.  \n- Player character is seen in a small inset window, wearing headphones and reacting to gameplay, while the main screen shows the van’s movement.\n[450-480s] - Player drives a glowing green vehicle through a city at night, with speedometer showing 85+ mph.\n- The vehicle passes under an overpass, then turns left onto a street with illuminated buildings.\n- A map in the bottom-left corner displays route guidance, and a chat window is visible on the right side of the screen.\n[480-510s] - A black vehicle with glowing orange rectangular outlines on its rear is driving through a city at night, passing under a bridge and through a tunnel.  \n- The vehicle's speed fluctuates between 86.5 and 87.8 mph as it navigates urban streets with traffic lights and palm trees.  \n- The driver, visible in a small inset, is wearing headphones and appears to be reacting to the gameplay.\n[510-540s] - A black van with glowing orange trim drives through a city at night, passing traffic lights and buildings.  \n- The driver, visible in a small inset, wears headphones and reacts to gameplay.  \n- The van approaches a crosswalk, stops at a red light, then proceeds forward after the light turns green.\n[540-570s] - Player character stands beside a dark van, interacting with its rear hatch.\n- Game UI displays character stats, inventory, and a map overlay showing the player's location.\n- Player opens the game menu, revealing options like \"Game,\" \"Options,\" and \"Stats,\" with \"Options\" highlighted.\n[570-600s] - Player drives a black van with orange glowing outlines through a city at night, passing under illuminated streetlights and buildings.  \n- The van’s speed fluctuates between 84 and 87 mph as it navigates intersections and turns.  \n- A live chat overlay on the right side of the screen shows viewer messages and a leaderboard with player names and scores.\n[600-630s] - A black delivery van with orange glowing edges drives through a city street at night, passing buildings and traffic lights.  \n- The van's speed fluctuates between 86 and 88 mph as it navigates intersections and turns.  \n- A live stream overlay shows a player wearing headphones, with chat messages scrolling on the right side of the screen.\n[630-660s] - Player character approaches a dark van parked on a city street at night, then opens its rear door.\n- A male NPC in a white shirt and hat stands nearby, interacting with the player, possibly offering a task or item.\n- The player character enters the van, which has a glowing orange outline around its rear, and the camera shifts to a third-person view from behind the van as it begins to drive away.\n[660-690s] - Player drives a dark van with glowing orange trim through a city street at night, passing billboards and traffic.\n- The van navigates intersections, including a red light, and continues forward past a \"MOTEL\" sign.\n- On-screen UI shows a map, speedometer, and chat window with viewer messages, while the player's face is visible in a top-left webcam feed.", "history_tokens": 992, "history_utf8_bytes": 4307, "recent_frame_times_s": [668.0109833333333, 669.0119833333333, 670.0129833333333, 671.0139833333334, 672.0149833333334, 673.0159833333333, 674.0003, 675.0013, 676.0023, 677.0033, 678.0043, 679.0053, 680.0063, 681.0073, 682.0083, 683.0093, 684.0103, 685.0113, 686.0123, 687.0133, 688.0143, 689.0153, 690.0163, 691.0006166666667, 692.0016166666667, 693.0026166666667, 694.0036166666666, 695.0046166666667, 696.0056166666667, 697.0066166666667], "recent_frames_sha256": "c0e929fa826e34f47d729082e8f7c24cde1b59791156709a9202af837037caa2", "num_recent_frames": 30, "tq": 710211.244686921, "t1": 710213.774600515, "ta": 710213.774600515, "te": 710213.812400719, "first_response_s": 2.5299135940149426, "answer_total_s": 2.5677137980237603, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 282, "content_group": "3bf4d7537f6f6f822dc6fb77c55053cb865333edcfe3946f8edb3539f02253cd", "question": {"question_id": "sample_282_a628_q0", "video_id": 282, "video_path": "./videos/sample_282_real.mp4", "annotation_index": 628, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. watching his phone.", "B. Turning on the headlights of the van.", "C. Closing the van's rear door.", "D. Opening the van's side door."], "answer": "A", "time_stamp_s": 8, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_282_a628_q0", "video_id": 282, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "118512f71a63094dba0d5bcd6f817de359be1947f75990531810b7896f9f9336", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007], "recent_frames_sha256": "ae82395c0fe0c2aa3c7ac1a06ebcaaa03ca1d3315bbc85cca031132b1bc15a4d", "num_recent_frames": 8, "tq": 716664.936061312, "t1": 716671.373061508, "ta": 716671.373061508, "te": 716671.523736242, "first_response_s": 6.437000196077861, "answer_total_s": 6.587674929993227, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_282_a628_q0", "video_id": 282, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ea49587a2e84b5777b2d3e507c4cadc207968c1ceb4b7c5b38f9eadd94d1cb46", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007], "recent_frames_sha256": "ae82395c0fe0c2aa3c7ac1a06ebcaaa03ca1d3315bbc85cca031132b1bc15a4d", "num_recent_frames": 8, "tq": 716702.557643247, "t1": 716703.57536613, "ta": 716703.57536613, "te": 716703.764062667, "first_response_s": 1.0177228830289096, "answer_total_s": 1.2064194200793281, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 282, "content_group": "3bf4d7537f6f6f822dc6fb77c55053cb865333edcfe3946f8edb3539f02253cd", "question": {"question_id": "sample_282_a629_q0", "video_id": 282, "video_path": "./videos/sample_282_real.mp4", "annotation_index": 629, "question_index": 0, "question": "What is the person in the reflective vest doing right now?", "options": ["A. Checking the stock list.", "B. Inspecting the vehicle.", "C. Chatting with the live streamer.", "D. Walking away from the vehicle."], "answer": "A", "time_stamp_s": 210, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_282_a629_q0", "video_id": 282, "time_stamp_s": 210, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5167e77c0c6d39c6638ffc1492efce9bfb9df2aca98e0a8efb3ac3509a9078b3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088], "recent_frames_sha256": "db4682ab6bd69ee8ea4a5ab547ae52637621ac74d642c746d4ce26b4cb1a8874", "num_recent_frames": 30, "tq": 716671.552659385, "t1": 716676.690231861, "ta": 716676.690231861, "te": 716676.727547175, "first_response_s": 5.137572475941852, "answer_total_s": 5.1748877899954095, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_282_a629_q0", "video_id": 282, "time_stamp_s": 210, "ground_truth": "A", "raw_output": "D. Walking away from the vehicle.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "be752e9d711457e0e9ecef2a56389ec1f82b47392e58aa3bf05f1159bed3fcaa", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A player character runs toward a black van parked on a street at night, then approaches it as the game transitions to a map view.  \n- The player's phone screen displays a live chat and notifications, including a message from \"Soul\" and a \"Soul\" notification.  \n- The game interface shows a \"Tuning Progression\" menu with various vehicle upgrades, and the player's character is seen driving the van down a city street.\n[30-60s] - Player drives a black delivery truck with orange glowing edges through city streets at dusk, passing traffic lights and buildings.  \n- The truck enters a tunnel with overhead lights, then exits into a wider road with visible lane markings and distant cityscape.  \n- On-screen UI shows speed, map, and chat messages; a Santa hat icon appears briefly on the top-left corner.\n[60-90s] - A dark-colored van with glowing orange trim drives through city streets at night, passing traffic lights and intersections.  \n- The van’s rear is visible, showing a rectangular shape with illuminated edges, as it navigates urban roads.  \n- The game’s HUD displays speed, map, and player stats, while a live stream overlay shows a player’s face and chat interactions.\n[90-120s] - Player character walks toward a building entrance, then pauses near a trash can.  \n- A second player character runs past the main character in the opposite direction.  \n- The player opens an inventory screen, revealing equipped gear and health stats.\n[120-150s] - Player character runs toward a building entrance, then exits into an outdoor area with palm trees and parked vehicles.  \n- A \"Henry Miller\" NPC appears at the entrance, offering a \"Treat\" item.  \n- Player character approaches a green military truck parked on the street, with a \"Treat\" item visible in the inventory.\n[150-180s] - Player character stands beside a large black vehicle, holding a phone displaying a notification about a \"New Message\" from \"Morgan\" at 10:40 PM.\n- In-game UI shows \"Tuning Progression\" screen with multiple vehicle tuning options, including \"Tuning\" and \"Upgrades\" tabs.\n- Chat window on right side displays live viewer messages, including \"Morgan\" and \"Morgan\" again, indicating ongoing interaction.\n[180-210s] - Player character exits a black van and walks toward a supermarket entrance.  \n- Van drives away from the supermarket, turning onto a street with palm trees and traffic lights.  \n- Player character approaches a store with a \"SUPERMARKET\" sign as the van departs.", "history_tokens": 569, "history_utf8_bytes": 2476, "recent_frame_times_s": [180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088], "recent_frames_sha256": "db4682ab6bd69ee8ea4a5ab547ae52637621ac74d642c746d4ce26b4cb1a8874", "num_recent_frames": 30, "tq": 716758.670425459, "t1": 716764.793359171, "ta": 716764.793359171, "te": 716765.088390415, "first_response_s": 6.122933711973019, "answer_total_s": 6.417964955908246, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 282, "content_group": "3bf4d7537f6f6f822dc6fb77c55053cb865333edcfe3946f8edb3539f02253cd", "question": {"question_id": "sample_282_a630_q0", "video_id": 282, "video_path": "./videos/sample_282_real.mp4", "annotation_index": 630, "question_index": 0, "question": "What is the man doing right now?", "options": ["A. Driving a van through a city street.", "B. Standing behind a box truck.", "C. Walking toward a dark van.", "D. Trying to open a box."], "answer": "A", "time_stamp_s": 340, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_282_a630_q0", "video_id": 282, "time_stamp_s": 340, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "539bbe4975545a18cdf5c631d237d352fbe5b802416073cb43621e468b23b204", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0000166666667, 318.00101666666666, 319.0020166666667, 320.00301666666667, 321.00401666666664, 322.0050166666667, 323.00601666666665, 324.0070166666667, 325.00801666666666, 326.00901666666664, 327.0100166666667, 328.01101666666665, 329.0120166666667, 330.01301666666666, 331.0140166666667, 332.01501666666667, 333.01601666666664, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334], "recent_frames_sha256": "7483ed66945f4f557e2c437016bce4271907774705635adc7e6176fe72ef1b2a", "num_recent_frames": 30, "tq": 716676.759641128, "t1": 716682.96152052, "ta": 716682.96152052, "te": 716683.188232566, "first_response_s": 6.201879392028786, "answer_total_s": 6.428591437987052, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_282_a630_q0", "video_id": 282, "time_stamp_s": 340, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ee06cb0410ea31621648b9a5666c490f52c2bf5f11a02a1373a02001f99d8552", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A player character runs toward a black van parked on a street at night, then approaches it as the game transitions to a map view.  \n- The player's phone screen displays a live chat and notifications, including a message from \"Soul\" and a \"Soul\" notification.  \n- The game interface shows a \"Tuning Progression\" menu with various vehicle upgrades, and the player's character is seen driving the van down a city street.\n[30-60s] - Player drives a black delivery truck with orange glowing edges through city streets at dusk, passing traffic lights and buildings.  \n- The truck enters a tunnel with overhead lights, then exits into a wider road with visible lane markings and distant cityscape.  \n- On-screen UI shows speed, map, and chat messages; a Santa hat icon appears briefly on the top-left corner.\n[60-90s] - A dark-colored van with glowing orange trim drives through city streets at night, passing traffic lights and intersections.  \n- The van’s rear is visible, showing a rectangular shape with illuminated edges, as it navigates urban roads.  \n- The game’s HUD displays speed, map, and player stats, while a live stream overlay shows a player’s face and chat interactions.\n[90-120s] - Player character walks toward a building entrance, then pauses near a trash can.  \n- A second player character runs past the main character in the opposite direction.  \n- The player opens an inventory screen, revealing equipped gear and health stats.\n[120-150s] - Player character runs toward a building entrance, then exits into an outdoor area with palm trees and parked vehicles.  \n- A \"Henry Miller\" NPC appears at the entrance, offering a \"Treat\" item.  \n- Player character approaches a green military truck parked on the street, with a \"Treat\" item visible in the inventory.\n[150-180s] - Player character stands beside a large black vehicle, holding a phone displaying a notification about a \"New Message\" from \"Morgan\" at 10:40 PM.\n- In-game UI shows \"Tuning Progression\" screen with multiple vehicle tuning options, including \"Tuning\" and \"Upgrades\" tabs.\n- Chat window on right side displays live viewer messages, including \"Morgan\" and \"Morgan\" again, indicating ongoing interaction.\n[180-210s] - Player character exits a black van and walks toward a supermarket entrance.  \n- Van drives away from the supermarket, turning onto a street with palm trees and traffic lights.  \n- Player character approaches a store with a \"SUPERMARKET\" sign as the van departs.\n[210-240s] - Player character (Henry) exits a building, carrying a large cardboard box, then approaches a black van.  \n- The player drives the van through a city street at dusk, passing under an overpass and navigating intersections.  \n- The game UI shows a map, inventory, and chat window, with the player’s health and armor status visible.\n[240-270s] - Player drives a black vehicle with glowing orange rear lights along city streets, passing traffic lights and buildings.  \n- Speedometer shows consistent speed around 85–87 mph; map indicates route progression.  \n- Right-side UI displays chat messages, player stats, and a mini-map with location markers.\n[270-300s] - A black vehicle with glowing orange edges drives through a city street, passing palm trees and buildings.  \n- The vehicle's speed fluctuates between 86 and 94 mph as it navigates turns and intersections.  \n- A map and speedometer are visible in the bottom-left corner, while a chat window appears on the right side of the screen.\n[300-330s] - A black van with \"crime\" text on its side is parked on a city street, with a red traffic light ahead.  \n- A character in a green vest exits the van and walks toward a \"7-Eleven\" store.  \n- The character approaches a man in sunglasses, who appears to be a game NPC, near a street corner.", "history_tokens": 886, "history_utf8_bytes": 3782, "recent_frame_times_s": [310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0000166666667, 318.00101666666666, 319.0020166666667, 320.00301666666667, 321.00401666666664, 322.0050166666667, 323.00601666666665, 324.0070166666667, 325.00801666666666, 326.00901666666664, 327.0100166666667, 328.01101666666665, 329.0120166666667, 330.01301666666666, 331.0140166666667, 332.01501666666667, 333.01601666666664, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334], "recent_frames_sha256": "7483ed66945f4f557e2c437016bce4271907774705635adc7e6176fe72ef1b2a", "num_recent_frames": 30, "tq": 716805.914657122, "t1": 716811.62598531, "ta": 716811.62598531, "te": 716811.664641625, "first_response_s": 5.711328187957406, "answer_total_s": 5.749984503025189, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 282, "content_group": "3bf4d7537f6f6f822dc6fb77c55053cb865333edcfe3946f8edb3539f02253cd", "question": {"question_id": "sample_282_a631_q0", "video_id": 282, "video_path": "./videos/sample_282_real.mp4", "annotation_index": 631, "question_index": 0, "question": "How did the environment change just now?", "options": ["A. The vision turned neon green due to the activation of night vision.", "B. The vehicle stopped at a traffic light.", "C. The driver switched to a different lane.", "D. The car encountered a roadblock."], "answer": "A", "time_stamp_s": 498, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_282_a631_q0", "video_id": 282, "time_stamp_s": 498, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8db298c3db9b40cf1833413d3dafe5c120c161b49bc2c38e112e9c691aaf9cb6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336], "recent_frames_sha256": "ddf10b705dba8d0a6566b72767bb64d5fb67a3f869ed52c8a88d21917c30060c", "num_recent_frames": 30, "tq": 716683.20106325, "t1": 716690.841588157, "ta": 716690.841588157, "te": 716690.881257151, "first_response_s": 7.640524907037616, "answer_total_s": 7.680193901062012, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_282_a631_q0", "video_id": 282, "time_stamp_s": 498, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5090d6247bf2bf5e56aa3b8bfc3ac7b2739a0f1e94316bcd522f17f1d8bb5c86", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Player character walks toward a building entrance, then pauses near a trash can.  \n- A second player character runs past the main character in the opposite direction.  \n- The player opens an inventory screen, revealing equipped gear and health stats.\n[120-150s] - Player character runs toward a building entrance, then exits into an outdoor area with palm trees and parked vehicles.  \n- A \"Henry Miller\" NPC appears at the entrance, offering a \"Treat\" item.  \n- Player character approaches a green military truck parked on the street, with a \"Treat\" item visible in the inventory.\n[150-180s] - Player character stands beside a large black vehicle, holding a phone displaying a notification about a \"New Message\" from \"Morgan\" at 10:40 PM.\n- In-game UI shows \"Tuning Progression\" screen with multiple vehicle tuning options, including \"Tuning\" and \"Upgrades\" tabs.\n- Chat window on right side displays live viewer messages, including \"Morgan\" and \"Morgan\" again, indicating ongoing interaction.\n[180-210s] - Player character exits a black van and walks toward a supermarket entrance.  \n- Van drives away from the supermarket, turning onto a street with palm trees and traffic lights.  \n- Player character approaches a store with a \"SUPERMARKET\" sign as the van departs.\n[210-240s] - Player character (Henry) exits a building, carrying a large cardboard box, then approaches a black van.  \n- The player drives the van through a city street at dusk, passing under an overpass and navigating intersections.  \n- The game UI shows a map, inventory, and chat window, with the player’s health and armor status visible.\n[240-270s] - Player drives a black vehicle with glowing orange rear lights along city streets, passing traffic lights and buildings.  \n- Speedometer shows consistent speed around 85–87 mph; map indicates route progression.  \n- Right-side UI displays chat messages, player stats, and a mini-map with location markers.\n[270-300s] - A black vehicle with glowing orange edges drives through a city street, passing palm trees and buildings.  \n- The vehicle's speed fluctuates between 86 and 94 mph as it navigates turns and intersections.  \n- A map and speedometer are visible in the bottom-left corner, while a chat window appears on the right side of the screen.\n[300-330s] - A black van with \"crime\" text on its side is parked on a city street, with a red traffic light ahead.  \n- A character in a green vest exits the van and walks toward a \"7-Eleven\" store.  \n- The character approaches a man in sunglasses, who appears to be a game NPC, near a street corner.\n[330-360s] - Black vehicle with orange glowing outline drives through city streets, passing traffic lights and intersections.  \n- Player’s minimap and in-game HUD display speed, time, and mission objectives.  \n- A red car appears ahead, and the black vehicle approaches a crosswalk before turning left.\n[360-390s] - Black box vehicle with glowing orange outline drives through city streets, passing traffic lights and palm trees.  \n- Driver’s face visible in top-left corner, wearing headphones and a light-colored shirt.  \n- On-screen UI shows map, speed (83–87 mph), and chat messages on right side.\n[390-420s] - A black truck with orange glowing side panels drives along a road, passing under a bridge and through a residential area with palm trees.  \n- The truck approaches a stop sign at an intersection, then continues driving past a street with parked cars and a building with a \"SUV\" sign.  \n- The game's minimap and speedometer are visible in the bottom left and right corners, respectively, showing the truck's speed and direction.\n[420-450s] - Black van with orange glowing rear lights drives along a road lined with palm trees and utility poles.  \n- The van turns right onto a road with a speedometer showing 84.4 mph, then slows to 83.8 mph as it approaches a curve.  \n- The van veers off the road onto a dirt path, with the camera angle shifting to show the vehicle's side and rear as it continues forward.\n[450-480s] - Black van with orange trim drives on highway, speed fluctuating between 83-85 mph.\n- Player's webcam shows a smiling individual in a white hoodie, reacting to gameplay.\n- Roadside vegetation and distant hills visible as van navigates multi-lane highway.", "history_tokens": 1024, "history_utf8_bytes": 4280, "recent_frame_times_s": [468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336], "recent_frames_sha256": "ddf10b705dba8d0a6566b72767bb64d5fb67a3f869ed52c8a88d21917c30060c", "num_recent_frames": 30, "tq": 716849.217336126, "t1": 716855.926807387, "ta": 716855.926807387, "te": 716855.963984123, "first_response_s": 6.709471261012368, "answer_total_s": 6.746647996944375, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 282, "content_group": "3bf4d7537f6f6f822dc6fb77c55053cb865333edcfe3946f8edb3539f02253cd", "question": {"question_id": "sample_282_a632_q0", "video_id": 282, "video_path": "./videos/sample_282_real.mp4", "annotation_index": 632, "question_index": 0, "question": "What did the van do just now?", "options": ["A. Turned left onto a straight road.", "B. Pulled into a rest area.", "C. Stopped at a red light.", "D. Entered a tunnel."], "answer": "A", "time_stamp_s": 607, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_282_a632_q0", "video_id": 282, "time_stamp_s": 607, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "df196dff795d30074c395e6d227420c76afeee414d0666220be2522decbe5026", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0000833333334, 585.0010833333333, 586.0020833333333, 587.0030833333333, 588.0040833333334, 589.0050833333333, 590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054], "recent_frames_sha256": "0a923ed8754f66ff8d1c39b1059774a9f4339e50a96dbda768e8134d147ee55f", "num_recent_frames": 30, "tq": 716690.8956053, "t1": 716702.503403554, "ta": 716702.503403554, "te": 716702.544085926, "first_response_s": 11.607798254000954, "answer_total_s": 11.64848062605597, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_282_a632_q0", "video_id": 282, "time_stamp_s": 607, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d96ba95b441807435852a98a64ebd1d2d8715c551b349e7bffad9c143975b6a6", "condition_order": ["recent", "notes"], "memory": "[240-270s] - Player drives a black vehicle with glowing orange rear lights along city streets, passing traffic lights and buildings.  \n- Speedometer shows consistent speed around 85–87 mph; map indicates route progression.  \n- Right-side UI displays chat messages, player stats, and a mini-map with location markers.\n[270-300s] - A black vehicle with glowing orange edges drives through a city street, passing palm trees and buildings.  \n- The vehicle's speed fluctuates between 86 and 94 mph as it navigates turns and intersections.  \n- A map and speedometer are visible in the bottom-left corner, while a chat window appears on the right side of the screen.\n[300-330s] - A black van with \"crime\" text on its side is parked on a city street, with a red traffic light ahead.  \n- A character in a green vest exits the van and walks toward a \"7-Eleven\" store.  \n- The character approaches a man in sunglasses, who appears to be a game NPC, near a street corner.\n[330-360s] - Black vehicle with orange glowing outline drives through city streets, passing traffic lights and intersections.  \n- Player’s minimap and in-game HUD display speed, time, and mission objectives.  \n- A red car appears ahead, and the black vehicle approaches a crosswalk before turning left.\n[360-390s] - Black box vehicle with glowing orange outline drives through city streets, passing traffic lights and palm trees.  \n- Driver’s face visible in top-left corner, wearing headphones and a light-colored shirt.  \n- On-screen UI shows map, speed (83–87 mph), and chat messages on right side.\n[390-420s] - A black truck with orange glowing side panels drives along a road, passing under a bridge and through a residential area with palm trees.  \n- The truck approaches a stop sign at an intersection, then continues driving past a street with parked cars and a building with a \"SUV\" sign.  \n- The game's minimap and speedometer are visible in the bottom left and right corners, respectively, showing the truck's speed and direction.\n[420-450s] - Black van with orange glowing rear lights drives along a road lined with palm trees and utility poles.  \n- The van turns right onto a road with a speedometer showing 84.4 mph, then slows to 83.8 mph as it approaches a curve.  \n- The van veers off the road onto a dirt path, with the camera angle shifting to show the vehicle's side and rear as it continues forward.\n[450-480s] - Black van with orange trim drives on highway, speed fluctuating between 83-85 mph.\n- Player's webcam shows a smiling individual in a white hoodie, reacting to gameplay.\n- Roadside vegetation and distant hills visible as van navigates multi-lane highway.\n[480-510s] - Player drives a futuristic vehicle on a highway with a green-lit dashboard display.  \n- A large overhead bridge spans the road ahead, with power lines visible on the right.  \n- The vehicle's speed fluctuates slightly between 85 and 86 mph as it navigates the highway.\n[510-540s] - Player drives a black vehicle with orange trim on a highway, passing power lines and billboards.  \n- The vehicle's dashboard displays a green glowing object, possibly a weapon or tool, held by the player's hands.  \n- A map and speedometer are visible in the lower-left corner, showing the vehicle's route and speed.\n[540-570s] - Player character approaches a 7-Eleven store, interacting with a store employee who is holding a red box.  \n- The player character then opens a black van with \"grime\" branding, revealing a smartphone interface displaying a map and notifications.  \n- The player character is seen inside the van, with the game's HUD showing a map, health, and inventory, while the streamer is visible in a small inset window.\n[570-600s] - Player's black van with orange trim drives through a gas station lot, then exits onto a highway.\n- The van navigates a curved road, passing a bridge and approaching a highway interchange.\n- A smartphone screen displaying the iOS home screen is visible in the top right corner of the video frame.", "history_tokens": 957, "history_utf8_bytes": 3995, "recent_frame_times_s": [577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0000833333334, 585.0010833333333, 586.0020833333333, 587.0030833333333, 588.0040833333334, 589.0050833333333, 590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054], "recent_frames_sha256": "0a923ed8754f66ff8d1c39b1059774a9f4339e50a96dbda768e8134d147ee55f", "num_recent_frames": 30, "tq": 716892.207194011, "t1": 716898.911517205, "ta": 716898.911517205, "te": 716899.348247637, "first_response_s": 6.704323193989694, "answer_total_s": 7.141053626080975, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 283, "content_group": "3cf00f4320fab84f0a6a21afb1c24bb851979445b5a475772b9f62015e6bd223", "question": {"question_id": "sample_283_a182_q0", "video_id": 283, "video_path": "./videos/sample_283_real.mp4", "annotation_index": 182, "question_index": 0, "question": "What is the driver doing right now?", "options": ["A. Talking to a passenger.", "B. Looking at the road ahead.", "C. Adjusting the rearview mirror.", "D. Selecting media options."], "answer": "D", "time_stamp_s": 16, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_283_a182_q0", "video_id": 283, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "657ed2c8286308de5807f20b6e71207e26e52cc51228383a14a735ab3cba6ef9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.02, 1.0043166666666667, 2.005316666666667, 3.0063166666666667, 4.007316666666667, 5.0083166666666665, 6.009316666666667, 7.010316666666666, 8.011316666666668, 9.012316666666667, 10.013316666666666, 11.014316666666666, 12.015316666666667, 13.016316666666667, 14.000633333333333, 15.001633333333332], "recent_frames_sha256": "a06d956f1001e7bad4a5f44ca7c17c4b9d1ba2e611ba393a02c3e4ece1b7f79f", "num_recent_frames": 16, "tq": 710422.710398755, "t1": 710423.531331674, "ta": 710423.531331674, "te": 710423.57141571, "first_response_s": 0.820932918926701, "answer_total_s": 0.8610169549938291, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_283_a182_q0", "video_id": 283, "time_stamp_s": 16, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "78181716c63f7fa2a09c9b86cdae0262059394f7e84015f5287589cb4cee1993", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.02, 1.0043166666666667, 2.005316666666667, 3.0063166666666667, 4.007316666666667, 5.0083166666666665, 6.009316666666667, 7.010316666666666, 8.011316666666668, 9.012316666666667, 10.013316666666666, 11.014316666666666, 12.015316666666667, 13.016316666666667, 14.000633333333333, 15.001633333333332], "recent_frames_sha256": "a06d956f1001e7bad4a5f44ca7c17c4b9d1ba2e611ba393a02c3e4ece1b7f79f", "num_recent_frames": 16, "tq": 710227.892679661, "t1": 710233.951134756, "ta": 710233.951134756, "te": 710233.989652649, "first_response_s": 6.058455094927922, "answer_total_s": 6.096972987987101, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 283, "content_group": "3cf00f4320fab84f0a6a21afb1c24bb851979445b5a475772b9f62015e6bd223", "question": {"question_id": "sample_283_a183_q0", "video_id": 283, "video_path": "./videos/sample_283_real.mp4", "annotation_index": 183, "question_index": 0, "question": "What is the person on the right doing right now?", "options": ["A. Gesturing animatedly.", "B. Walking towards the building.", "C. Sitting near the potted plant.", "D. Standing still."], "answer": "D", "time_stamp_s": 180, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_283_a183_q0", "video_id": 283, "time_stamp_s": 180, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "016adfbe380297d394a79f46dbf4a152264685a600211024db935612eb74b90f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.00316666666666, 151.00416666666666, 152.00516666666667, 153.00616666666667, 154.00716666666668, 155.00816666666665, 156.00916666666666, 157.01016666666666, 158.01116666666667, 159.01216666666667, 160.01316666666668, 161.01416666666665, 162.01516666666666, 163.01616666666666, 164.00048333333334, 165.00148333333334, 166.00248333333334, 167.00348333333332, 168.00448333333333, 169.00548333333333, 170.00648333333334, 171.00748333333334, 172.00848333333334, 173.00948333333332, 174.01048333333333, 175.01148333333333, 176.01248333333334, 177.01348333333334, 178.01448333333335, 179.01548333333332], "recent_frames_sha256": "b16d3603c7c5152809f5ebe2b2139a00c68fa3f1d6f335f3f6a31f9aa623f020", "num_recent_frames": 30, "tq": 710423.587489883, "t1": 710435.285500089, "ta": 710435.285500089, "te": 710435.325168635, "first_response_s": 11.698010206106119, "answer_total_s": 11.737678752047941, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_283_a183_q0", "video_id": 283, "time_stamp_s": 180, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7cbb3941fbe79fbacc3c35757640b58f6472155fa7c8638f5f2a8554589a9f69", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A black truck with orange trim drives on a highway, passing other vehicles and approaching an overpass.  \n- The driver, visible in a small inset, wears headphones and appears focused on the game.  \n- A green screen overlay briefly appears, displaying a menu with options like \"Activate\" and \"Exit,\" suggesting an in-game pause or selection screen.\n[30-60s] - Black box vehicle with orange trim drives on highway, occasionally triggering a blue screen effect.  \n- Other cars (including red and white sedans) are visible on adjacent lanes, moving in opposite directions.  \n- City skyline and power lines appear in background as vehicle progresses along elevated roadway.\n[60-90s] - A black rectangular object (likely a game vehicle or cargo) moves steadily forward on a multi-lane highway, passing other cars and road signs.  \n- The vehicle navigates through urban infrastructure, including overpasses and intersections, with palm trees and buildings visible on the sides.  \n- The game’s HUD displays speed, map, and player stats, while a live streamer’s face is visible in the top-left corner.\n[90-120s] - Player exits a dark van and runs toward a building entrance, passing a manhole cover.  \n- The player enters a building, transitioning to an interior view with a character menu overlay.  \n- A character named \"Harry Vitor\" is displayed in the menu, indicating a character selection or customization screen.\n[120-150s] - A male character in a yellow safety vest stands outside a building, facing a female character in shorts and a striped shirt.  \n- The female character walks toward the male character, then stops, facing him directly.  \n- The male character turns slightly to his left, observing the female character while standing still.\n[150-180s] - A man in a yellow safety vest stands facing a woman in a striped shirt, both stationary on a paved plaza.  \n- The woman is positioned slightly to the right of the man, appearing to engage in conversation or interaction.  \n- A large digital clock in the bottom right corner displays \"07:29\" and \"07:30\" as the scene progresses.", "history_tokens": 470, "history_utf8_bytes": 2096, "recent_frame_times_s": [150.00316666666666, 151.00416666666666, 152.00516666666667, 153.00616666666667, 154.00716666666668, 155.00816666666665, 156.00916666666666, 157.01016666666666, 158.01116666666667, 159.01216666666667, 160.01316666666668, 161.01416666666665, 162.01516666666666, 163.01616666666666, 164.00048333333334, 165.00148333333334, 166.00248333333334, 167.00348333333332, 168.00448333333333, 169.00548333333333, 170.00648333333334, 171.00748333333334, 172.00848333333334, 173.00948333333332, 174.01048333333333, 175.01148333333333, 176.01248333333334, 177.01348333333334, 178.01448333333335, 179.01548333333332], "recent_frames_sha256": "b16d3603c7c5152809f5ebe2b2139a00c68fa3f1d6f335f3f6a31f9aa623f020", "num_recent_frames": 30, "tq": 710284.151111065, "t1": 710291.251893003, "ta": 710291.251893003, "te": 710291.451039305, "first_response_s": 7.100781938061118, "answer_total_s": 7.2999282400123775, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 283, "content_group": "3cf00f4320fab84f0a6a21afb1c24bb851979445b5a475772b9f62015e6bd223", "question": {"question_id": "sample_283_a184_q0", "video_id": 283, "video_path": "./videos/sample_283_real.mp4", "annotation_index": 184, "question_index": 0, "question": "What did the driver do just now?", "options": ["A. Drove out of the parking area.", "B. Reached the parking entrance.", "C. Entered the small control booth.", "D. Got out of the van."], "answer": "D", "time_stamp_s": 341, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_283_a184_q0", "video_id": 283, "time_stamp_s": 341, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "88f1336e0acd5d6508e57019b41c4c292933a6a536477414c233e03da40d591d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [311.0140166666667, 312.01501666666667, 313.01601666666664, 314.00033333333334, 315.0013333333333, 316.00233333333335, 317.00333333333333, 318.0043333333333, 319.00533333333334, 320.0063333333333, 321.00733333333335, 322.0083333333333, 323.00933333333336, 324.01033333333334, 325.0113333333333, 326.01233333333334, 327.0133333333333, 328.01433333333335, 329.01533333333333, 330.0163333333333, 331.00065, 332.00165, 333.00265, 334.00365, 335.00465, 336.00565, 337.00665, 338.00765, 339.00865, 340.00965], "recent_frames_sha256": "d1b444de4b2d60c23b1e977d9a6c2c9299bfce06299262671a68679503d2d405", "num_recent_frames": 30, "tq": 710435.340949754, "t1": 710443.754010078, "ta": 710443.754010078, "te": 710443.793767014, "first_response_s": 8.413060324033722, "answer_total_s": 8.452817260054871, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_283_a184_q0", "video_id": 283, "time_stamp_s": 341, "ground_truth": "D", "raw_output": "A. Drove out of the parking area.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "c7fa06eeda1ae21ebe6bb92f6fc47a518d5917f48176b894ce39f0417c00798a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A black truck with orange trim drives on a highway, passing other vehicles and approaching an overpass.  \n- The driver, visible in a small inset, wears headphones and appears focused on the game.  \n- A green screen overlay briefly appears, displaying a menu with options like \"Activate\" and \"Exit,\" suggesting an in-game pause or selection screen.\n[30-60s] - Black box vehicle with orange trim drives on highway, occasionally triggering a blue screen effect.  \n- Other cars (including red and white sedans) are visible on adjacent lanes, moving in opposite directions.  \n- City skyline and power lines appear in background as vehicle progresses along elevated roadway.\n[60-90s] - A black rectangular object (likely a game vehicle or cargo) moves steadily forward on a multi-lane highway, passing other cars and road signs.  \n- The vehicle navigates through urban infrastructure, including overpasses and intersections, with palm trees and buildings visible on the sides.  \n- The game’s HUD displays speed, map, and player stats, while a live streamer’s face is visible in the top-left corner.\n[90-120s] - Player exits a dark van and runs toward a building entrance, passing a manhole cover.  \n- The player enters a building, transitioning to an interior view with a character menu overlay.  \n- A character named \"Harry Vitor\" is displayed in the menu, indicating a character selection or customization screen.\n[120-150s] - A male character in a yellow safety vest stands outside a building, facing a female character in shorts and a striped shirt.  \n- The female character walks toward the male character, then stops, facing him directly.  \n- The male character turns slightly to his left, observing the female character while standing still.\n[150-180s] - A man in a yellow safety vest stands facing a woman in a striped shirt, both stationary on a paved plaza.  \n- The woman is positioned slightly to the right of the man, appearing to engage in conversation or interaction.  \n- A large digital clock in the bottom right corner displays \"07:29\" and \"07:30\" as the scene progresses.\n[180-210s] - A male character in a yellow safety vest stands facing a female character in a striped shirt and shorts, both stationary on a paved plaza.  \n- The male character turns and walks away from the female character toward a dark-colored van parked nearby.  \n- The van is positioned to the left of the male character as he approaches it, with its rear doors open.\n[210-240s] - Player character approaches a black van parked on street, opens door, and enters vehicle.  \n- In-game UI displays \"Fucking Progression\" menu with multiple weapon options, including \"Glock 18\" and \"M4A1\".  \n- Player's in-game map shows location near palm trees and buildings, with a visible \"08:00\" time indicator.\n[240-270s] - A dark gray delivery van drives forward on a city street, passing under an overpass and approaching a traffic light.  \n- The driver, visible in a small inset window, wears a light-colored hoodie and looks forward while driving.  \n- The game’s HUD displays a map, speedometer, and a chat log with viewer messages on the right side of the screen.\n[270-300s] - Player drives a vehicle through an urban environment with palm trees and city buildings visible.  \n- The vehicle passes under a bridge and exits into a wider street with traffic lights and signage.  \n- A large \"SUBURBAN\" billboard is visible on the right side of the road as the player continues forward.\n[300-330s] - Player drives a dark van along a street with palm trees and buildings, passing a red fire hydrant.  \n- The van approaches a red garage door with \"We aim not to...\" text visible, then collides with a red barrier.  \n- A small animated character appears on the road ahead, near a parked white car.", "history_tokens": 877, "history_utf8_bytes": 3779, "recent_frame_times_s": [311.0140166666667, 312.01501666666667, 313.01601666666664, 314.00033333333334, 315.0013333333333, 316.00233333333335, 317.00333333333333, 318.0043333333333, 319.00533333333334, 320.0063333333333, 321.00733333333335, 322.0083333333333, 323.00933333333336, 324.01033333333334, 325.0113333333333, 326.01233333333334, 327.0133333333333, 328.01433333333335, 329.01533333333333, 330.0163333333333, 331.00065, 332.00165, 333.00265, 334.00365, 335.00465, 336.00565, 337.00665, 338.00765, 339.00865, 340.00965], "recent_frames_sha256": "d1b444de4b2d60c23b1e977d9a6c2c9299bfce06299262671a68679503d2d405", "num_recent_frames": 30, "tq": 710335.803837524, "t1": 710342.448997139, "ta": 710342.448997139, "te": 710342.852057736, "first_response_s": 6.645159614970908, "answer_total_s": 7.048220211989246, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 283, "content_group": "3cf00f4320fab84f0a6a21afb1c24bb851979445b5a475772b9f62015e6bd223", "question": {"question_id": "sample_283_a185_q0", "video_id": 283, "video_path": "./videos/sample_283_real.mp4", "annotation_index": 185, "question_index": 0, "question": "What is the van doing right now?", "options": ["A. Stopping at a red traffic light.", "B. Reversing towards the intersection.", "C. Turning left at the intersection.", "D. Moving forward past the intersection."], "answer": "D", "time_stamp_s": 495, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_283_a185_q0", "video_id": 283, "time_stamp_s": 495, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "91f256cb96fe5b8a5c755d74f35a15814794974ef2089872014928c72f3a1d84", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [465.00118333333336, 466.00218333333333, 467.0031833333333, 468.00418333333334, 469.0051833333333, 470.00618333333335, 471.00718333333333, 472.0081833333333, 473.00918333333334, 474.0101833333333, 475.01118333333335, 476.0121833333333, 477.01318333333336, 478.01418333333334, 479.0151833333333, 480.01618333333334, 481.0005, 482.0015, 483.0025, 484.0035, 485.0045, 486.0055, 487.0065, 488.0075, 489.0085, 490.0095, 491.0105, 492.0115, 493.0125, 494.0135], "recent_frames_sha256": "c3b34a4b9d5600ef121c897b636587ef8441c016d063d257cfa4a2c2a0a53d1a", "num_recent_frames": 30, "tq": 710443.81713055, "t1": 710456.66247623, "ta": 710456.66247623, "te": 710456.700402172, "first_response_s": 12.845345679903403, "answer_total_s": 12.88327162200585, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_283_a185_q0", "video_id": 283, "time_stamp_s": 495, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "48a93a319a99c7bb3b41000a0ff64716d88766da72689937bf1b47bb30c27e26", "condition_order": ["notes", "recent"], "memory": "[120-150s] - A male character in a yellow safety vest stands outside a building, facing a female character in shorts and a striped shirt.  \n- The female character walks toward the male character, then stops, facing him directly.  \n- The male character turns slightly to his left, observing the female character while standing still.\n[150-180s] - A man in a yellow safety vest stands facing a woman in a striped shirt, both stationary on a paved plaza.  \n- The woman is positioned slightly to the right of the man, appearing to engage in conversation or interaction.  \n- A large digital clock in the bottom right corner displays \"07:29\" and \"07:30\" as the scene progresses.\n[180-210s] - A male character in a yellow safety vest stands facing a female character in a striped shirt and shorts, both stationary on a paved plaza.  \n- The male character turns and walks away from the female character toward a dark-colored van parked nearby.  \n- The van is positioned to the left of the male character as he approaches it, with its rear doors open.\n[210-240s] - Player character approaches a black van parked on street, opens door, and enters vehicle.  \n- In-game UI displays \"Fucking Progression\" menu with multiple weapon options, including \"Glock 18\" and \"M4A1\".  \n- Player's in-game map shows location near palm trees and buildings, with a visible \"08:00\" time indicator.\n[240-270s] - A dark gray delivery van drives forward on a city street, passing under an overpass and approaching a traffic light.  \n- The driver, visible in a small inset window, wears a light-colored hoodie and looks forward while driving.  \n- The game’s HUD displays a map, speedometer, and a chat log with viewer messages on the right side of the screen.\n[270-300s] - Player drives a vehicle through an urban environment with palm trees and city buildings visible.  \n- The vehicle passes under a bridge and exits into a wider street with traffic lights and signage.  \n- A large \"SUBURBAN\" billboard is visible on the right side of the road as the player continues forward.\n[300-330s] - Player drives a dark van along a street with palm trees and buildings, passing a red fire hydrant.  \n- The van approaches a red garage door with \"We aim not to...\" text visible, then collides with a red barrier.  \n- A small animated character appears on the road ahead, near a parked white car.\n[330-360s] - Player character approaches a large grey van with \"gr\" logo, then opens its side door.\n- Player character enters the van, revealing an interior inventory screen with various items and a character model.\n- Player character exits the van, walking toward a utility box while another character in a white shirt stands nearby.\n[360-390s] - Player character, wearing a reflective vest, approaches a large dark truck and opens its rear door.\n- In-game UI displays character stats, inventory, and a chat log with viewer messages.\n- Player character picks up a cardboard box from the truck bed and walks toward a nearby wall.\n[390-420s] - Player character in yellow vest walks toward a dark gray storage unit, then turns to face a red brick wall with a yellow warning sign.  \n- A man in a white shirt and cap (labeled \"Henry Miller\") stands near a parked vehicle, facing the player.  \n- The player opens the storage unit, revealing a grid of slots with various items, including food and tools, and interacts with the interface.\n[420-450s] - A black delivery van drives through urban streets, passing buildings and palm trees, with a map and speedometer visible on-screen.\n- The van navigates intersections and turns, with traffic signs and road markings clearly visible.\n- A player character in a reflective vest stands beside the van before it departs, with a chat overlay on the right side of the screen.\n[450-480s] - A black van drives forward on a multi-lane road, passing traffic lights and other vehicles.  \n- The road transitions from urban streets to a highway with hills in the background.  \n- A digital map and speedometer are visible in the bottom-left corner, showing the van's route and speed.", "history_tokens": 954, "history_utf8_bytes": 4066, "recent_frame_times_s": [465.00118333333336, 466.00218333333333, 467.0031833333333, 468.00418333333334, 469.0051833333333, 470.00618333333335, 471.00718333333333, 472.0081833333333, 473.00918333333334, 474.0101833333333, 475.01118333333335, 476.0121833333333, 477.01318333333336, 478.01418333333334, 479.0151833333333, 480.01618333333334, 481.0005, 482.0015, 483.0025, 484.0035, 485.0045, 486.0055, 487.0065, 488.0075, 489.0085, 490.0095, 491.0105, 492.0115, 493.0125, 494.0135], "recent_frames_sha256": "c3b34a4b9d5600ef121c897b636587ef8441c016d063d257cfa4a2c2a0a53d1a", "num_recent_frames": 30, "tq": 710383.255807818, "t1": 710384.968350946, "ta": 710384.968350946, "te": 710385.330086008, "first_response_s": 1.712543127941899, "answer_total_s": 2.074278189917095, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 283, "content_group": "3cf00f4320fab84f0a6a21afb1c24bb851979445b5a475772b9f62015e6bd223", "question": {"question_id": "sample_283_a186_q0", "video_id": 283, "video_path": "./videos/sample_283_real.mp4", "annotation_index": 186, "question_index": 0, "question": "What is the person in the white shirt doing right now?", "options": ["A. Scrolling through a menu.", "B. Navigating the \"Trucking Progression\" interface.", "C. Discussing missions with another person.", "D. Checking something on a clipboard."], "answer": "D", "time_stamp_s": 626, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_283_a186_q0", "video_id": 283, "time_stamp_s": 626, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "72e183bb947200a21951d5f4a4e3dfeb723daa7bbb97d396bebc2fb3375edc84", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [596.0154, 597.0164, 598.0007166666667, 599.0017166666667, 600.0027166666666, 601.0037166666667, 602.0047166666667, 603.0057166666667, 604.0067166666666, 605.0077166666666, 606.0087166666667, 607.0097166666667, 608.0107166666667, 609.0117166666666, 610.0127166666666, 611.0137166666667, 612.0147166666667, 613.0157166666667, 614.0000333333334, 615.0010333333333, 616.0020333333333, 617.0030333333333, 618.0040333333334, 619.0050333333334, 620.0060333333333, 621.0070333333333, 622.0080333333333, 623.0090333333334, 624.0100333333334, 625.0110333333333], "recent_frames_sha256": "e74f10175f5f24b12cfd51954de0ff2259762228b69421678247433a0accfe14", "num_recent_frames": 30, "tq": 710456.717067166, "t1": 710464.279491253, "ta": 710464.279491253, "te": 710464.317938597, "first_response_s": 7.5624240869656205, "answer_total_s": 7.600871431059204, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_283_a186_q0", "video_id": 283, "time_stamp_s": 626, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ee50ce09460c3593b2016e7202c5d30eeda93512692bf8c931c79773243837cd", "condition_order": ["notes", "recent"], "memory": "[210-240s] - Player character approaches a black van parked on street, opens door, and enters vehicle.  \n- In-game UI displays \"Fucking Progression\" menu with multiple weapon options, including \"Glock 18\" and \"M4A1\".  \n- Player's in-game map shows location near palm trees and buildings, with a visible \"08:00\" time indicator.\n[240-270s] - A dark gray delivery van drives forward on a city street, passing under an overpass and approaching a traffic light.  \n- The driver, visible in a small inset window, wears a light-colored hoodie and looks forward while driving.  \n- The game’s HUD displays a map, speedometer, and a chat log with viewer messages on the right side of the screen.\n[270-300s] - Player drives a vehicle through an urban environment with palm trees and city buildings visible.  \n- The vehicle passes under a bridge and exits into a wider street with traffic lights and signage.  \n- A large \"SUBURBAN\" billboard is visible on the right side of the road as the player continues forward.\n[300-330s] - Player drives a dark van along a street with palm trees and buildings, passing a red fire hydrant.  \n- The van approaches a red garage door with \"We aim not to...\" text visible, then collides with a red barrier.  \n- A small animated character appears on the road ahead, near a parked white car.\n[330-360s] - Player character approaches a large grey van with \"gr\" logo, then opens its side door.\n- Player character enters the van, revealing an interior inventory screen with various items and a character model.\n- Player character exits the van, walking toward a utility box while another character in a white shirt stands nearby.\n[360-390s] - Player character, wearing a reflective vest, approaches a large dark truck and opens its rear door.\n- In-game UI displays character stats, inventory, and a chat log with viewer messages.\n- Player character picks up a cardboard box from the truck bed and walks toward a nearby wall.\n[390-420s] - Player character in yellow vest walks toward a dark gray storage unit, then turns to face a red brick wall with a yellow warning sign.  \n- A man in a white shirt and cap (labeled \"Henry Miller\") stands near a parked vehicle, facing the player.  \n- The player opens the storage unit, revealing a grid of slots with various items, including food and tools, and interacts with the interface.\n[420-450s] - A black delivery van drives through urban streets, passing buildings and palm trees, with a map and speedometer visible on-screen.\n- The van navigates intersections and turns, with traffic signs and road markings clearly visible.\n- A player character in a reflective vest stands beside the van before it departs, with a chat overlay on the right side of the screen.\n[450-480s] - A black van drives forward on a multi-lane road, passing traffic lights and other vehicles.  \n- The road transitions from urban streets to a highway with hills in the background.  \n- A digital map and speedometer are visible in the bottom-left corner, showing the van's route and speed.\n[480-510s] - A black, box-shaped object (likely a game item) is stationary on the road, facing forward.  \n- The player's vehicle is not visible; the camera is positioned behind the object, showing the road ahead.  \n- The environment includes urban streets, buildings, and a traffic light that changes from red to green.\n[510-540s] - A black, boxy vehicle drives forward on a multi-lane road, passing under a large metal bridge structure.  \n- The vehicle maintains a steady speed, with a speedometer reading around 76-78 mph.  \n- A large, dark-colored truck is visible ahead on the road, moving in the same direction.\n[540-570s] - Black van drives on multi-lane highway, speed decreasing from 82 to 68 mph.\n- Driver's face visible in top-left inset, wearing light-colored hoodie.\n- Roadside signs and palm trees visible; van passes under \"Duck Entrance\" sign.\n[570-600s] - Player character walks toward a blue van parked near a yellow \"LUCKYIN\" trailer.  \n- A man in a white uniform (Frank Vilar) approaches the player character, initiating an interaction.  \n- On-screen UI shows a smartphone interface with app icons, suggesting a phone call or message interaction.", "history_tokens": 1004, "history_utf8_bytes": 4189, "recent_frame_times_s": [596.0154, 597.0164, 598.0007166666667, 599.0017166666667, 600.0027166666666, 601.0037166666667, 602.0047166666667, 603.0057166666667, 604.0067166666666, 605.0077166666666, 606.0087166666667, 607.0097166666667, 608.0107166666667, 609.0117166666666, 610.0127166666666, 611.0137166666667, 612.0147166666667, 613.0157166666667, 614.0000333333334, 615.0010333333333, 616.0020333333333, 617.0030333333333, 618.0040333333334, 619.0050333333334, 620.0060333333333, 621.0070333333333, 622.0080333333333, 623.0090333333334, 624.0100333333334, 625.0110333333333], "recent_frames_sha256": "e74f10175f5f24b12cfd51954de0ff2259762228b69421678247433a0accfe14", "num_recent_frames": 30, "tq": 710416.417654782, "t1": 710422.639812261, "ta": 710422.639812261, "te": 710422.679130061, "first_response_s": 6.2221574790310115, "answer_total_s": 6.261475278995931, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 285, "content_group": "88cefadcabe5894450100429f94cd8892be57a7b4e7cff4328479b8b9c24b3cc", "question": {"question_id": "sample_285_a1307_q0", "video_id": 285, "video_path": "./videos/sample_285_real.mp4", "annotation_index": 1307, "question_index": 0, "question": "What is the character wearing right now?", "options": ["A. Blue jacket and black hat.", "B. Dark green hoodie and dark gray cap.", "C. Red hoodie and blue cap.", "D. Black jacket and white cap."], "answer": "B", "time_stamp_s": 12, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_285_a1307_q0", "video_id": 285, "time_stamp_s": 12, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4b26f31a6669af8dd7d416f4fd84b177a0db5a5b0783d3a9162f3b3185b56add", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.026, 1.0103166666666668, 2.0113166666666666, 3.0123166666666665, 4.013316666666666, 5.014316666666667, 6.015316666666667, 7.0163166666666665, 8.000633333333333, 9.001633333333332, 10.002633333333334, 11.003633333333333], "recent_frames_sha256": "c435e9c18bf1d94c8d21d83d8e6f64fbe5f1cacf3ba76d3858bbb61b2537cf1b", "num_recent_frames": 12, "tq": 715752.298081842, "t1": 715753.04296662, "ta": 715753.04296662, "te": 715753.080506796, "first_response_s": 0.7448847779305652, "answer_total_s": 0.7824249539989978, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_285_a1307_q0", "video_id": 285, "time_stamp_s": 12, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ed26d433631e7db96159ff8ea1f940ad4ab7e4e20e744756f89c1c25cb291af1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.026, 1.0103166666666668, 2.0113166666666666, 3.0123166666666665, 4.013316666666666, 5.014316666666667, 6.015316666666667, 7.0163166666666665, 8.000633333333333, 9.001633333333332, 10.002633333333334, 11.003633333333333], "recent_frames_sha256": "c435e9c18bf1d94c8d21d83d8e6f64fbe5f1cacf3ba76d3858bbb61b2537cf1b", "num_recent_frames": 12, "tq": 715575.780530911, "t1": 715581.921869431, "ta": 715581.921869431, "te": 715582.117701872, "first_response_s": 6.141338519984856, "answer_total_s": 6.337170960963704, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 285, "content_group": "88cefadcabe5894450100429f94cd8892be57a7b4e7cff4328479b8b9c24b3cc", "question": {"question_id": "sample_285_a1308_q0", "video_id": 285, "video_path": "./videos/sample_285_real.mp4", "annotation_index": 1308, "question_index": 0, "question": "What is the individual in the safety vest doing right now?", "options": ["A. Observing the group conversation.", "B. Operating a piece of machinery.", "C. Cleaning the area.", "D. Fixing a car engine."], "answer": "A", "time_stamp_s": 153, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_285_a1308_q0", "video_id": 285, "time_stamp_s": 153, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6f19d50a199aa0e732d6179598f3e8a3d040d98b10e930e4af7f5a16fc621298", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [123.01553333333334, 124.01653333333333, 125.00085, 126.00185, 127.00285, 128.00385, 129.00485, 130.00585, 131.00685, 132.00785, 133.00885, 134.00985, 135.01085, 136.01185, 137.01285, 138.01385, 139.01485, 140.01585, 141.00016666666667, 142.00116666666668, 143.00216666666665, 144.00316666666666, 145.00416666666666, 146.00516666666667, 147.00616666666667, 148.00716666666668, 149.00816666666665, 150.00916666666666, 151.01016666666666, 152.01116666666667], "recent_frames_sha256": "ebcc6e682e7e568c53360191380d06e856d1ee01d502727f80b8346066c9d1c7", "num_recent_frames": 30, "tq": 715753.098102647, "t1": 715766.972670728, "ta": 715766.972670728, "te": 715767.010104876, "first_response_s": 13.874568080995232, "answer_total_s": 13.912002229015343, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_285_a1308_q0", "video_id": 285, "time_stamp_s": 153, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c11e39cf1892ff5aca3aa883f9302bf82fee150453936f1d45a6335c3aa56a39", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Streamer in top-left corner holds a book, observing gameplay.  \n- In-game character (Rusty Wrench) walks through a parking lot, carrying a box, then enters a diner.  \n- Game UI displays inventory items (yellow bottles, tools) and player stats on right side.\n[30-60s] - Player character in yellow vest stands at a counter, interacting with a clerk in a suit near a desk with papers and a phone.  \n- A car customization menu is open on the left, displaying multiple vehicle models, with a red car highlighted and a dark gray sedan selected.  \n- The environment shows a checkered floor, shelves with items, and a sign reading \"TICKETS\" on a stand near the counter.\n[60-90s] - Player character sits at a counter, facing a clerk in a dark suit who stands behind the counter.  \n- The player character is wearing a green vest and has a backpack; they are positioned near a red, yellow, and blue box on the counter.  \n- The environment includes a checkered floor, shelves with books, and a visible \"KEEP OUT\" sign on a door to the left.\n[90-120s] - Player character walks from desk area toward a white door marked \"AUTHORIZED PERSONNEL ONLY\" with a red sign.  \n- A man in a suit stands near the desk, observing the player character.  \n- The player character approaches the door, preparing to enter a restricted area.\n[120-150s] - Player character walks past a workbench with tools and a red toolbox, then approaches a vending machine labeled \"Coca-Cola\" and \"CANDY\".  \n- Player enters a room with blue chairs and a water cooler, then exits into a garage-like area with a large metal door.  \n- Player exits the building, stepping onto a cracked concrete surface with a wooden structure and a parked car visible in the background.", "history_tokens": 410, "history_utf8_bytes": 1730, "recent_frame_times_s": [123.01553333333334, 124.01653333333333, 125.00085, 126.00185, 127.00285, 128.00385, 129.00485, 130.00585, 131.00685, 132.00785, 133.00885, 134.00985, 135.01085, 136.01185, 137.01285, 138.01385, 139.01485, 140.01585, 141.00016666666667, 142.00116666666668, 143.00216666666665, 144.00316666666666, 145.00416666666666, 146.00516666666667, 147.00616666666667, 148.00716666666668, 149.00816666666665, 150.00916666666666, 151.01016666666666, 152.01116666666667], "recent_frames_sha256": "ebcc6e682e7e568c53360191380d06e856d1ee01d502727f80b8346066c9d1c7", "num_recent_frames": 30, "tq": 715623.013399201, "t1": 715624.806312965, "ta": 715624.806312965, "te": 715624.969616134, "first_response_s": 1.7929137640167028, "answer_total_s": 1.9562169329728931, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 285, "content_group": "88cefadcabe5894450100429f94cd8892be57a7b4e7cff4328479b8b9c24b3cc", "question": {"question_id": "sample_285_a1309_q0", "video_id": 285, "video_path": "./videos/sample_285_real.mp4", "annotation_index": 1309, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Walking towards a parking lot.", "B. Choosing an option from a contextual menu.", "C. Cleaning the blue car.", "D. Holding a cardboard box."], "answer": "C", "time_stamp_s": 290, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_285_a1309_q0", "video_id": 285, "time_stamp_s": 290, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6786dbd7a88d2a1ae72c8e2b215507a70f9bc07b7ceb7c385ca41595ecd5c7dd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [260.00238333333334, 261.0033833333333, 262.00438333333335, 263.0053833333333, 264.00638333333336, 265.00738333333334, 266.0083833333333, 267.00938333333335, 268.0103833333333, 269.01138333333336, 270.01238333333333, 271.0133833333333, 272.01438333333334, 273.0153833333333, 274.01638333333335, 275.0007, 276.0017, 277.0027, 278.0037, 279.0047, 280.0057, 281.0067, 282.0077, 283.0087, 284.0097, 285.0107, 286.0117, 287.0127, 288.0137, 289.0147], "recent_frames_sha256": "1d11b8f1a5fb1dd98c6b4eb9cf5f209ac265e0aa67101223ff8735bfa85304df", "num_recent_frames": 30, "tq": 715767.023213242, "t1": 715779.333556684, "ta": 715779.333556684, "te": 715779.371204333, "first_response_s": 12.310343442019075, "answer_total_s": 12.347991091082804, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_285_a1309_q0", "video_id": 285, "time_stamp_s": 290, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a48f4cdbaf7089fa8a5193edcb142b1669f617d00a90b79a2bedca636cad7eb1", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Streamer in top-left corner holds a book, observing gameplay.  \n- In-game character (Rusty Wrench) walks through a parking lot, carrying a box, then enters a diner.  \n- Game UI displays inventory items (yellow bottles, tools) and player stats on right side.\n[30-60s] - Player character in yellow vest stands at a counter, interacting with a clerk in a suit near a desk with papers and a phone.  \n- A car customization menu is open on the left, displaying multiple vehicle models, with a red car highlighted and a dark gray sedan selected.  \n- The environment shows a checkered floor, shelves with items, and a sign reading \"TICKETS\" on a stand near the counter.\n[60-90s] - Player character sits at a counter, facing a clerk in a dark suit who stands behind the counter.  \n- The player character is wearing a green vest and has a backpack; they are positioned near a red, yellow, and blue box on the counter.  \n- The environment includes a checkered floor, shelves with books, and a visible \"KEEP OUT\" sign on a door to the left.\n[90-120s] - Player character walks from desk area toward a white door marked \"AUTHORIZED PERSONNEL ONLY\" with a red sign.  \n- A man in a suit stands near the desk, observing the player character.  \n- The player character approaches the door, preparing to enter a restricted area.\n[120-150s] - Player character walks past a workbench with tools and a red toolbox, then approaches a vending machine labeled \"Coca-Cola\" and \"CANDY\".  \n- Player enters a room with blue chairs and a water cooler, then exits into a garage-like area with a large metal door.  \n- Player exits the building, stepping onto a cracked concrete surface with a wooden structure and a parked car visible in the background.\n[150-180s] - Player character runs past a blue car and approaches a gas station, then stops near a red gas pump.  \n- A character named \"Butty Wrench\" appears in a cutscene, wearing a green hoodie and cap, with a menu overlay showing items like \"Burger\" and \"Coke.\"  \n- The player character continues running along the sidewalk, passing palm trees and street signs, heading toward the gas station.\n[180-210s] - Player character stands before ATM, selecting \"Personal Account\" option on screen.  \n- Banking interface displays account details, including \"Total: $0.00\" and \"Available: $0.00\".  \n- Player's avatar is positioned near the ATM, with a shopping cart visible nearby.\n[210-240s] - Player navigates to Personal Account screen, selects \"Edit Profile,\" and inputs new name \"Kev\" in the \"Display Name\" field.\n- After confirming changes, the screen transitions to a loading state before returning to the main account menu.\n- Player exits the menu and walks outdoors, passing a gas station and street, with a visible \"HAIR & BEAUTY\" sign in the background.\n[240-270s] - Player character approaches a man in a green vest near a wall with \"NO TRESPASSING\" signs.  \n- The man, identified as \"Busty Wrench,\" is shown in a menu displaying items like \"Wrench\" and \"Bottle of Oil.\"  \n- Player character interacts with Busty Wrench, who then opens an inventory screen showing equipment and health stats.", "history_tokens": 757, "history_utf8_bytes": 3127, "recent_frame_times_s": [260.00238333333334, 261.0033833333333, 262.00438333333335, 263.0053833333333, 264.00638333333336, 265.00738333333334, 266.0083833333333, 267.00938333333335, 268.0103833333333, 269.01138333333336, 270.01238333333333, 271.0133833333333, 272.01438333333334, 273.0153833333333, 274.01638333333335, 275.0007, 276.0017, 277.0027, 278.0037, 279.0047, 280.0057, 281.0067, 282.0077, 283.0087, 284.0097, 285.0107, 286.0117, 287.0127, 288.0137, 289.0147], "recent_frames_sha256": "1d11b8f1a5fb1dd98c6b4eb9cf5f209ac265e0aa67101223ff8735bfa85304df", "num_recent_frames": 30, "tq": 715690.005816698, "t1": 715691.669053876, "ta": 715691.669053876, "te": 715691.863138813, "first_response_s": 1.6632371779996902, "answer_total_s": 1.8573221149854362, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 285, "content_group": "88cefadcabe5894450100429f94cd8892be57a7b4e7cff4328479b8b9c24b3cc", "question": {"question_id": "sample_285_a1310_q0", "video_id": 285, "video_path": "./videos/sample_285_real.mp4", "annotation_index": 1310, "question_index": 0, "question": "How did the man in the dark coat emphasized his point just now?", "options": ["A. By changing his position.", "B. By gesturing with his left hand.", "C. By raising his voice.", "D. By walking away."], "answer": "B", "time_stamp_s": 436, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_285_a1310_q0", "video_id": 285, "time_stamp_s": 436, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "83375d2f436fe63f515522361bc73aab96a22120f94d943f19fd0c0344b11793", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [406.0149166666667, 407.01591666666667, 408.0002333333333, 409.00123333333335, 410.0022333333333, 411.00323333333336, 412.00423333333333, 413.0052333333333, 414.00623333333334, 415.0072333333333, 416.00823333333335, 417.0092333333333, 418.01023333333336, 419.01123333333334, 420.0122333333333, 421.01323333333335, 422.0142333333333, 423.01523333333336, 424.01623333333333, 425.00055, 426.00155, 427.00255, 428.00355, 429.00455, 430.00555, 431.00655, 432.00755, 433.00855, 434.00955, 435.01055], "recent_frames_sha256": "93774bed3fd22929326ec86af96f53cb30ca499e9a42cd5ea5da340c23a48387", "num_recent_frames": 30, "tq": 715779.385879129, "t1": 715786.569495165, "ta": 715786.569495165, "te": 715786.792541095, "first_response_s": 7.183616035967134, "answer_total_s": 7.406661966000684, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_285_a1310_q0", "video_id": 285, "time_stamp_s": 436, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e668c924b3570bd61e35c1148ecaac2a0e93315eebfebefb3ec9b664c7dacd9a", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Player character sits at a counter, facing a clerk in a dark suit who stands behind the counter.  \n- The player character is wearing a green vest and has a backpack; they are positioned near a red, yellow, and blue box on the counter.  \n- The environment includes a checkered floor, shelves with books, and a visible \"KEEP OUT\" sign on a door to the left.\n[90-120s] - Player character walks from desk area toward a white door marked \"AUTHORIZED PERSONNEL ONLY\" with a red sign.  \n- A man in a suit stands near the desk, observing the player character.  \n- The player character approaches the door, preparing to enter a restricted area.\n[120-150s] - Player character walks past a workbench with tools and a red toolbox, then approaches a vending machine labeled \"Coca-Cola\" and \"CANDY\".  \n- Player enters a room with blue chairs and a water cooler, then exits into a garage-like area with a large metal door.  \n- Player exits the building, stepping onto a cracked concrete surface with a wooden structure and a parked car visible in the background.\n[150-180s] - Player character runs past a blue car and approaches a gas station, then stops near a red gas pump.  \n- A character named \"Butty Wrench\" appears in a cutscene, wearing a green hoodie and cap, with a menu overlay showing items like \"Burger\" and \"Coke.\"  \n- The player character continues running along the sidewalk, passing palm trees and street signs, heading toward the gas station.\n[180-210s] - Player character stands before ATM, selecting \"Personal Account\" option on screen.  \n- Banking interface displays account details, including \"Total: $0.00\" and \"Available: $0.00\".  \n- Player's avatar is positioned near the ATM, with a shopping cart visible nearby.\n[210-240s] - Player navigates to Personal Account screen, selects \"Edit Profile,\" and inputs new name \"Kev\" in the \"Display Name\" field.\n- After confirming changes, the screen transitions to a loading state before returning to the main account menu.\n- Player exits the menu and walks outdoors, passing a gas station and street, with a visible \"HAIR & BEAUTY\" sign in the background.\n[240-270s] - Player character approaches a man in a green vest near a wall with \"NO TRESPASSING\" signs.  \n- The man, identified as \"Busty Wrench,\" is shown in a menu displaying items like \"Wrench\" and \"Bottle of Oil.\"  \n- Player character interacts with Busty Wrench, who then opens an inventory screen showing equipment and health stats.\n[270-300s] - Player character approaches a blue car, interacts with it, and then moves toward a black car nearby.  \n- A \"NO TRESPASSING\" sign is visible on a wall behind the player.  \n- The player character is wearing a green vest and appears to be in a parking lot with multiple vehicles.\n[300-330s] - Player character holds a yellow object above a blue car, then drops it to the ground.  \n- Player character turns away from the car, walks toward two parked black vehicles.  \n- A man in a suit and hat approaches the player character from behind.\n[330-360s] - Player character stands beside a black car, facing a man in a black coat and hat who approaches from the right.  \n- The player character turns slightly toward the approaching man, appearing to interact or prepare to engage.  \n- A yellow bollard is visible to the left of the player, and another black car is parked behind the main vehicle.\n[360-390s] - Player in green vest stands beside black car, facing man in black coat who is also near the car.  \n- Player raises yellow object (possibly money) toward the car's roof, then lowers it.  \n- Man in black coat remains stationary, observing the player’s actions.\n[390-420s] - A man in a black robe and hat stands beside a black car, facing the player character.  \n- The player character, wearing a yellow safety vest, stands near the car’s open door, facing the robed man.  \n- A third character in a white shirt and headphones stands to the left, near a green dumpster, observing the interaction.", "history_tokens": 960, "history_utf8_bytes": 3966, "recent_frame_times_s": [406.0149166666667, 407.01591666666667, 408.0002333333333, 409.00123333333335, 410.0022333333333, 411.00323333333336, 412.00423333333333, 413.0052333333333, 414.00623333333334, 415.0072333333333, 416.00823333333335, 417.0092333333333, 418.01023333333336, 419.01123333333334, 420.0122333333333, 421.01323333333335, 422.0142333333333, 423.01523333333336, 424.01623333333333, 425.00055, 426.00155, 427.00255, 428.00355, 429.00455, 430.00555, 431.00655, 432.00755, 433.00855, 434.00955, 435.01055], "recent_frames_sha256": "93774bed3fd22929326ec86af96f53cb30ca499e9a42cd5ea5da340c23a48387", "num_recent_frames": 30, "tq": 715724.064491653, "t1": 715724.98066641, "ta": 715724.98066641, "te": 715725.23956413, "first_response_s": 0.9161747569451109, "answer_total_s": 1.1750724769663066, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 285, "content_group": "88cefadcabe5894450100429f94cd8892be57a7b4e7cff4328479b8b9c24b3cc", "question": {"question_id": "sample_285_a1311_q0", "video_id": 285, "video_path": "./videos/sample_285_real.mp4", "annotation_index": 1311, "question_index": 0, "question": "What is the man with the reflective safety vest doing right now?", "options": ["A. Adjusting his headphones.", "B. Looking into the driver's window of the car.", "C. Speaking with another individual near the wall.", "D. Picking up the scattered debris on the ground."], "answer": "B", "time_stamp_s": 520, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_285_a1311_q0", "video_id": 285, "time_stamp_s": 520, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9e7f8fd109a82cafc85cb5f7ea20435ea0372d3e6e4ce5c54733401d52dc4a69", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [490.0155, 491.0165, 492.00081666666665, 493.0018166666667, 494.00281666666666, 495.0038166666667, 496.00481666666667, 497.00581666666665, 498.0068166666667, 499.00781666666666, 500.0088166666667, 501.00981666666667, 502.01081666666664, 503.0118166666667, 504.01281666666665, 505.0138166666667, 506.01481666666666, 507.0158166666667, 508.00013333333334, 509.0011333333333, 510.00213333333335, 511.0031333333333, 512.0041333333334, 513.0051333333333, 514.0061333333333, 515.0071333333333, 516.0081333333334, 517.0091333333334, 518.0101333333333, 519.0111333333333], "recent_frames_sha256": "d26ed167807dab5149259f46ac4a523bc548a4cc2b44ea01c5d69b68587414a0", "num_recent_frames": 30, "tq": 715786.808483664, "t1": 715797.541124161, "ta": 715797.541124161, "te": 715797.761999278, "first_response_s": 10.73264049703721, "answer_total_s": 10.953515614033677, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_285_a1311_q0", "video_id": 285, "time_stamp_s": 520, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0c3f5e6a567fd678ed892c3effd1a7ff1dda8d52d6169cebfde6672de484aaba", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Player character runs past a blue car and approaches a gas station, then stops near a red gas pump.  \n- A character named \"Butty Wrench\" appears in a cutscene, wearing a green hoodie and cap, with a menu overlay showing items like \"Burger\" and \"Coke.\"  \n- The player character continues running along the sidewalk, passing palm trees and street signs, heading toward the gas station.\n[180-210s] - Player character stands before ATM, selecting \"Personal Account\" option on screen.  \n- Banking interface displays account details, including \"Total: $0.00\" and \"Available: $0.00\".  \n- Player's avatar is positioned near the ATM, with a shopping cart visible nearby.\n[210-240s] - Player navigates to Personal Account screen, selects \"Edit Profile,\" and inputs new name \"Kev\" in the \"Display Name\" field.\n- After confirming changes, the screen transitions to a loading state before returning to the main account menu.\n- Player exits the menu and walks outdoors, passing a gas station and street, with a visible \"HAIR & BEAUTY\" sign in the background.\n[240-270s] - Player character approaches a man in a green vest near a wall with \"NO TRESPASSING\" signs.  \n- The man, identified as \"Busty Wrench,\" is shown in a menu displaying items like \"Wrench\" and \"Bottle of Oil.\"  \n- Player character interacts with Busty Wrench, who then opens an inventory screen showing equipment and health stats.\n[270-300s] - Player character approaches a blue car, interacts with it, and then moves toward a black car nearby.  \n- A \"NO TRESPASSING\" sign is visible on a wall behind the player.  \n- The player character is wearing a green vest and appears to be in a parking lot with multiple vehicles.\n[300-330s] - Player character holds a yellow object above a blue car, then drops it to the ground.  \n- Player character turns away from the car, walks toward two parked black vehicles.  \n- A man in a suit and hat approaches the player character from behind.\n[330-360s] - Player character stands beside a black car, facing a man in a black coat and hat who approaches from the right.  \n- The player character turns slightly toward the approaching man, appearing to interact or prepare to engage.  \n- A yellow bollard is visible to the left of the player, and another black car is parked behind the main vehicle.\n[360-390s] - Player in green vest stands beside black car, facing man in black coat who is also near the car.  \n- Player raises yellow object (possibly money) toward the car's roof, then lowers it.  \n- Man in black coat remains stationary, observing the player’s actions.\n[390-420s] - A man in a black robe and hat stands beside a black car, facing the player character.  \n- The player character, wearing a yellow safety vest, stands near the car’s open door, facing the robed man.  \n- A third character in a white shirt and headphones stands to the left, near a green dumpster, observing the interaction.\n[420-450s] - A man in a black hat and robe stands beside a black car, facing a man in a reflective vest.  \n- The man in the vest is positioned slightly behind the car, facing the man in the robe.  \n- A third man in a beige shirt stands to the left, near a green dumpster, observing the interaction.\n[450-480s] - A man in a black robe and hat stands beside a black car, gesturing toward its open door.  \n- Another man in a yellow safety vest stands facing him, near a yellow bollard.  \n- A third man in a beige shirt leans against a wall, observing the interaction.\n[480-510s] - A black sedan is parked in a paved lot, with its driver-side door open and a character standing beside it.  \n- A yellow bollard is positioned near the front right wheel of the car.  \n- A green dumpster is visible to the left of the car, near a building with a closed garage door.", "history_tokens": 933, "history_utf8_bytes": 3765, "recent_frame_times_s": [490.0155, 491.0165, 492.00081666666665, 493.0018166666667, 494.00281666666666, 495.0038166666667, 496.00481666666667, 497.00581666666665, 498.0068166666667, 499.00781666666666, 500.0088166666667, 501.00981666666667, 502.01081666666664, 503.0118166666667, 504.01281666666665, 505.0138166666667, 506.01481666666666, 507.0158166666667, 508.00013333333334, 509.0011333333333, 510.00213333333335, 511.0031333333333, 512.0041333333334, 513.0051333333333, 514.0061333333333, 515.0071333333333, 516.0081333333334, 517.0091333333334, 518.0101333333333, 519.0111333333333], "recent_frames_sha256": "d26ed167807dab5149259f46ac4a523bc548a4cc2b44ea01c5d69b68587414a0", "num_recent_frames": 30, "tq": 715750.305104511, "t1": 715752.019430933, "ta": 715752.019430933, "te": 715752.255979725, "first_response_s": 1.7143264220794663, "answer_total_s": 1.950875214068219, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 286, "content_group": "ebe6de093b407624549d423bdab2924ea5f1b3a8ed212b393267e00a9fff5a07", "question": {"question_id": "sample_286_a2187_q0", "video_id": 286, "video_path": "./videos/sample_286_real.mp4", "annotation_index": 2187, "question_index": 0, "question": "What is the person in the green vest doing right now?", "options": ["A. Standing next to the black car.", "B. Adjusting their headphones.", "C. Walking towards a man with white hair and wearing white T-shirt.", "D. Talking to the driver in the black car."], "answer": "C", "time_stamp_s": 17, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_286_a2187_q0", "video_id": 286, "time_stamp_s": 17, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "65dd1cee9d9f22af71d0a93602067068f16656513b3df7a0752deb6bc90fc099", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.037, 1.0046333333333333, 2.0056333333333334, 3.0066333333333333, 4.007633333333334, 5.008633333333333, 6.009633333333333, 7.010633333333334, 8.011633333333334, 9.012633333333333, 10.013633333333333, 11.014633333333334, 12.015633333333334, 13.016633333333333, 14.00095, 15.00195, 16.00295], "recent_frames_sha256": "df0de722533e1f90e5de7476acad9b49231ef3719ee19dcdaa0dc7b0502ddf8d", "num_recent_frames": 17, "tq": 716637.61130991, "t1": 716644.22991376, "ta": 716644.22991376, "te": 716644.451078873, "first_response_s": 6.61860385001637, "answer_total_s": 6.8397689630510285, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_286_a2187_q0", "video_id": 286, "time_stamp_s": 17, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dbd6d8a79bf36059683c329aebccfca302ac939a51f3e615bc2c8939205fe41e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.037, 1.0046333333333333, 2.0056333333333334, 3.0066333333333333, 4.007633333333334, 5.008633333333333, 6.009633333333333, 7.010633333333334, 8.011633333333334, 9.012633333333333, 10.013633333333333, 11.014633333333334, 12.015633333333334, 13.016633333333333, 14.00095, 15.00195, 16.00295], "recent_frames_sha256": "df0de722533e1f90e5de7476acad9b49231ef3719ee19dcdaa0dc7b0502ddf8d", "num_recent_frames": 17, "tq": 716436.005266033, "t1": 716448.797322794, "ta": 716448.797322794, "te": 716448.998387333, "first_response_s": 12.792056760983542, "answer_total_s": 12.99312130000908, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 286, "content_group": "ebe6de093b407624549d423bdab2924ea5f1b3a8ed212b393267e00a9fff5a07", "question": {"question_id": "sample_286_a2188_q0", "video_id": 286, "video_path": "./videos/sample_286_real.mp4", "annotation_index": 2188, "question_index": 0, "question": "What is the person in the reflective vest doing right now?", "options": ["A. Adjusting his headset.", "B. Pointing to the person behind him with his finger.", "C. Picking up a map.", "D. Sitting down on the car's hood."], "answer": "B", "time_stamp_s": 163, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_286_a2188_q0", "video_id": 286, "time_stamp_s": 163, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0dba7707ed790f37139965b6cabd8471da087a34ce3b70be92f820ea1cd6c9c5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [133.00316666666666, 134.00416666666666, 135.00516666666667, 136.00616666666667, 137.00716666666668, 138.00816666666665, 139.00916666666666, 140.01016666666666, 141.01116666666667, 142.01216666666667, 143.01316666666668, 144.01416666666665, 145.01516666666666, 146.01616666666666, 147.00048333333334, 148.00148333333334, 149.00248333333334, 150.00348333333332, 151.00448333333333, 152.00548333333333, 153.00648333333334, 154.00748333333334, 155.00848333333334, 156.00948333333332, 157.01048333333333, 158.01148333333333, 159.01248333333334, 160.01348333333334, 161.01448333333335, 162.01548333333332], "recent_frames_sha256": "859c28069d48cf4ed1e5d6a17ce9f9eb73e90813a3482ec4d6d862aca00c7da3", "num_recent_frames": 30, "tq": 716644.47698018, "t1": 716650.681614875, "ta": 716650.681614875, "te": 716650.718986415, "first_response_s": 6.204634694964625, "answer_total_s": 6.242006234941073, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_286_a2188_q0", "video_id": 286, "time_stamp_s": 163, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e7c0cc2ce1c241299fa1b3a6edad1f8ffe11048bb58b8395ac238f4e1db64e2a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A player character in a yellow safety vest stands near a black car, observing surroundings.  \n- Another player character in a white shirt walks into the frame from the right, approaching the first character.  \n- A blue car drives past in the background, and a yellow bollard is visible near the foreground.\n[30-60s] - A man in a reflective vest stands facing another man in a white shirt, near a blue car and a large truck.  \n- The man in the white shirt walks away, then turns back toward the man in the vest.  \n- A third man (Buddy Wrench) appears behind a wall, partially obscured, with a \"NO TRESPASSING\" sign visible nearby.\n[60-90s] - Player character in green hoodie stands near wall, facing camera, with inventory UI showing \"Rusty Wrench\" and three items: \"Wrench,\" \"Oil Can,\" and \"Tire Iron.\"\n- In-game character with blonde hair and yellow vest walks toward a gray car parked near a building, then stops beside it.\n- A second character in green uniform stands nearby, holding a tire, while the player character remains stationary, observing the scene.\n[90-120s] - A man in a yellow safety vest stands beside a gray sedan, facing the driver's side, as the car remains stationary.  \n- Two men in white shirts are visible in the background, one near a green dumpster and another closer to the car, both appearing to observe or interact with the scene.  \n- The environment includes palm trees, parked cars, and industrial-style buildings, with a clear sky and bright daylight.\n[120-150s] - Player character stands beside a gray sedan, facing two men near a green dumpster.  \n- One man in a gray suit stands slightly behind the other, who is near a white wall with pipes.  \n- A menu overlay on the right shows character stats and options, while a small portrait of a character appears in the bottom-left corner.", "history_tokens": 427, "history_utf8_bytes": 1827, "recent_frame_times_s": [133.00316666666666, 134.00416666666666, 135.00516666666667, 136.00616666666667, 137.00716666666668, 138.00816666666665, 139.00916666666666, 140.01016666666666, 141.01116666666667, 142.01216666666667, 143.01316666666668, 144.01416666666665, 145.01516666666666, 146.01616666666666, 147.00048333333334, 148.00148333333334, 149.00248333333334, 150.00348333333332, 151.00448333333333, 152.00548333333333, 153.00648333333334, 154.00748333333334, 155.00848333333334, 156.00948333333332, 157.01048333333333, 158.01148333333333, 159.01248333333334, 160.01348333333334, 161.01448333333335, 162.01548333333332], "recent_frames_sha256": "859c28069d48cf4ed1e5d6a17ce9f9eb73e90813a3482ec4d6d862aca00c7da3", "num_recent_frames": 30, "tq": 716486.063195076, "t1": 716487.514245025, "ta": 716487.514245025, "te": 716487.740948395, "first_response_s": 1.451049949042499, "answer_total_s": 1.6777533190324903, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 286, "content_group": "ebe6de093b407624549d423bdab2924ea5f1b3a8ed212b393267e00a9fff5a07", "question": {"question_id": "sample_286_a2189_q0", "video_id": 286, "video_path": "./videos/sample_286_real.mp4", "annotation_index": 2189, "question_index": 0, "question": "What is the person in the reflective vest doing right now?", "options": ["A. Gesturing with their hand.", "B. Talking with the person in front of him.", "C. Leaning against the wall.", "D. Listening intently."], "answer": "B", "time_stamp_s": 334, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_286_a2189_q0", "video_id": 286, "time_stamp_s": 334, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "40141f83bfba234d28b6e73e56ace9b16860988bf36973b8b674e278f9c71eb8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [304.00733333333335, 305.0083333333333, 306.00933333333336, 307.01033333333334, 308.0113333333333, 309.01233333333334, 310.0133333333333, 311.01433333333335, 312.01533333333333, 313.0163333333333, 314.00065, 315.00165, 316.00265, 317.00365, 318.00465, 319.00565, 320.00665, 321.00765, 322.00865, 323.00965, 324.01065, 325.01165, 326.01265, 327.01365, 328.01465, 329.01565, 330.01665, 331.00096666666667, 332.00196666666665, 333.0029666666667], "recent_frames_sha256": "2a84177e439aee9f4ff210dff29535d3348f3385ed2fd5404d0a5055e56b65e8", "num_recent_frames": 30, "tq": 716650.744070092, "t1": 716657.489963305, "ta": 716657.489963305, "te": 716657.527375213, "first_response_s": 6.745893212966621, "answer_total_s": 6.78330512100365, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_286_a2189_q0", "video_id": 286, "time_stamp_s": 334, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a681256ddf67d65cfb3566db4868a83683b7f65698b1eb0cf2308ef58fe4900a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A player character in a yellow safety vest stands near a black car, observing surroundings.  \n- Another player character in a white shirt walks into the frame from the right, approaching the first character.  \n- A blue car drives past in the background, and a yellow bollard is visible near the foreground.\n[30-60s] - A man in a reflective vest stands facing another man in a white shirt, near a blue car and a large truck.  \n- The man in the white shirt walks away, then turns back toward the man in the vest.  \n- A third man (Buddy Wrench) appears behind a wall, partially obscured, with a \"NO TRESPASSING\" sign visible nearby.\n[60-90s] - Player character in green hoodie stands near wall, facing camera, with inventory UI showing \"Rusty Wrench\" and three items: \"Wrench,\" \"Oil Can,\" and \"Tire Iron.\"\n- In-game character with blonde hair and yellow vest walks toward a gray car parked near a building, then stops beside it.\n- A second character in green uniform stands nearby, holding a tire, while the player character remains stationary, observing the scene.\n[90-120s] - A man in a yellow safety vest stands beside a gray sedan, facing the driver's side, as the car remains stationary.  \n- Two men in white shirts are visible in the background, one near a green dumpster and another closer to the car, both appearing to observe or interact with the scene.  \n- The environment includes palm trees, parked cars, and industrial-style buildings, with a clear sky and bright daylight.\n[120-150s] - Player character stands beside a gray sedan, facing two men near a green dumpster.  \n- One man in a gray suit stands slightly behind the other, who is near a white wall with pipes.  \n- A menu overlay on the right shows character stats and options, while a small portrait of a character appears in the bottom-left corner.\n[150-180s] - A man in a yellow safety vest stands beside a gray sedan, facing two other men near a green dumpster.  \n- The man in the vest turns slightly, then walks toward the car’s driver’s side, while the two men remain stationary.  \n- The car’s hood is open, and the man in the vest appears to be inspecting or preparing to interact with it.\n[180-210s] - Player character stands beside a gray sedan, facing two men near a green dumpster.  \n- One man in a white shirt and cap walks away from the car toward the building entrance.  \n- The player character turns slightly, revealing a yellow safety vest and dark pants.\n[210-240s] - Player character stands beside a gray sedan, facing its driver’s side, with a yellow \"CASH\" sign visible on the car’s hood.\n- A white-shirted NPC walks toward the player from the background, while another NPC stands near a blue car further back.\n- The player character gestures toward the car’s hood, then turns slightly, as the \"CASH\" sign remains visible on the hood.\n[240-270s] - Player character in yellow vest stands beside a dark gray car, holding a yellow cloth.  \n- Another character in a white shirt approaches and gestures toward the car while holding a yellow cloth.  \n- The car’s rear bumper and license plate are visible, with a green dumpster and yellow poles in the background.\n[270-300s] - Player wipes car's front bumper with yellow cloth, moving from left to right.  \n- Player turns to face car's side after finishing front bumper.  \n- Another player in white shirt stands nearby, observing the cleaning.\n[300-330s] - A character in a yellow safety vest stands beside a dark gray sedan, observing its surroundings.  \n- Another character in a light gray shirt approaches and engages in conversation with the first character near the car.  \n- The sedan’s driver-side door is open, and the car appears stationary in a paved lot with scattered debris.", "history_tokens": 873, "history_utf8_bytes": 3743, "recent_frame_times_s": [304.00733333333335, 305.0083333333333, 306.00933333333336, 307.01033333333334, 308.0113333333333, 309.01233333333334, 310.0133333333333, 311.01433333333335, 312.01533333333333, 313.0163333333333, 314.00065, 315.00165, 316.00265, 317.00365, 318.00465, 319.00565, 320.00665, 321.00765, 322.00865, 323.00965, 324.01065, 325.01165, 326.01265, 327.01365, 328.01465, 329.01565, 330.01665, 331.00096666666667, 332.00196666666665, 333.0029666666667], "recent_frames_sha256": "2a84177e439aee9f4ff210dff29535d3348f3385ed2fd5404d0a5055e56b65e8", "num_recent_frames": 30, "tq": 716537.720252317, "t1": 716538.612425963, "ta": 716538.612425963, "te": 716538.650154579, "first_response_s": 0.892173646017909, "answer_total_s": 0.9299022619379684, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 286, "content_group": "ebe6de093b407624549d423bdab2924ea5f1b3a8ed212b393267e00a9fff5a07", "question": {"question_id": "sample_286_a2190_q0", "video_id": 286, "video_path": "./videos/sample_286_real.mp4", "annotation_index": 2190, "question_index": 0, "question": "What is the person in the green safety vest doing right now?", "options": ["A. Standing near a man with a tablet.", "B. Holding a tablet near a parked black car.", "C. Running towards a large black van.", "D. Selecting a job listing from the screen."], "answer": "C", "time_stamp_s": 494, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_286_a2190_q0", "video_id": 286, "time_stamp_s": 494, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6de5d589be819ab3fb3c811bd1a8980a9df28370f9da3bfaf11104939ae1226c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [464.0005, 465.0015, 466.0025, 467.0035, 468.0045, 469.0055, 470.0065, 471.0075, 472.0085, 473.0095, 474.0105, 475.0115, 476.0125, 477.0135, 478.0145, 479.0155, 480.0165, 481.00081666666665, 482.0018166666667, 483.00281666666666, 484.0038166666667, 485.00481666666667, 486.00581666666665, 487.0068166666667, 488.00781666666666, 489.0088166666667, 490.00981666666667, 491.01081666666664, 492.0118166666667, 493.01281666666665], "recent_frames_sha256": "851617e9fa19dc56f63ed25e14e66515fef956c5f769fa793a34a831208b5d30", "num_recent_frames": 30, "tq": 716657.555392069, "t1": 716664.873498208, "ta": 716664.873498208, "te": 716664.91250181, "first_response_s": 7.318106138962321, "answer_total_s": 7.357109740958549, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_286_a2190_q0", "video_id": 286, "time_stamp_s": 494, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f7b01f630c826d3a018c507a162aa6f56ad909b12e6074c6b71f7a5860ebc78d", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A man in a yellow safety vest stands beside a gray sedan, facing the driver's side, as the car remains stationary.  \n- Two men in white shirts are visible in the background, one near a green dumpster and another closer to the car, both appearing to observe or interact with the scene.  \n- The environment includes palm trees, parked cars, and industrial-style buildings, with a clear sky and bright daylight.\n[120-150s] - Player character stands beside a gray sedan, facing two men near a green dumpster.  \n- One man in a gray suit stands slightly behind the other, who is near a white wall with pipes.  \n- A menu overlay on the right shows character stats and options, while a small portrait of a character appears in the bottom-left corner.\n[150-180s] - A man in a yellow safety vest stands beside a gray sedan, facing two other men near a green dumpster.  \n- The man in the vest turns slightly, then walks toward the car’s driver’s side, while the two men remain stationary.  \n- The car’s hood is open, and the man in the vest appears to be inspecting or preparing to interact with it.\n[180-210s] - Player character stands beside a gray sedan, facing two men near a green dumpster.  \n- One man in a white shirt and cap walks away from the car toward the building entrance.  \n- The player character turns slightly, revealing a yellow safety vest and dark pants.\n[210-240s] - Player character stands beside a gray sedan, facing its driver’s side, with a yellow \"CASH\" sign visible on the car’s hood.\n- A white-shirted NPC walks toward the player from the background, while another NPC stands near a blue car further back.\n- The player character gestures toward the car’s hood, then turns slightly, as the \"CASH\" sign remains visible on the hood.\n[240-270s] - Player character in yellow vest stands beside a dark gray car, holding a yellow cloth.  \n- Another character in a white shirt approaches and gestures toward the car while holding a yellow cloth.  \n- The car’s rear bumper and license plate are visible, with a green dumpster and yellow poles in the background.\n[270-300s] - Player wipes car's front bumper with yellow cloth, moving from left to right.  \n- Player turns to face car's side after finishing front bumper.  \n- Another player in white shirt stands nearby, observing the cleaning.\n[300-330s] - A character in a yellow safety vest stands beside a dark gray sedan, observing its surroundings.  \n- Another character in a light gray shirt approaches and engages in conversation with the first character near the car.  \n- The sedan’s driver-side door is open, and the car appears stationary in a paved lot with scattered debris.\n[330-360s] - A man in a white shirt walks away from a gray car toward a blue car parked near a gate.  \n- A man in a yellow safety vest stands beside the gray car, facing the man in white.  \n- A blue car is parked near a gate, with its driver-side door open, and a man in a white shirt approaches it.\n[360-390s] - Player character in green hoodie stands near wall with \"NO PARKING\" sign, then walks toward blue car.  \n- Blue car is parked on street, doors open, and player approaches it.  \n- Player drives blue car down street, passing traffic and buildings, with speedometer visible.\n[390-420s] - Blue car drives across a wide bridge with arches, passing other vehicles and pedestrians.  \n- A large truck is visible ahead, and the car maneuvers around it on the highway.  \n- The car approaches an intersection with traffic lights, where a pedestrian is crossing the street.\n[420-450s] - Blue car drives on a highway, passing trucks and other vehicles, with a large bridge visible in the background.\n- The car accelerates, crossing a bridge with ocean views on the right side, and continues along a coastal road.\n- A black car overtakes the blue car on the right lane, and the blue car maintains a steady speed while navigating the road.\n[450-480s] - Blue car drives through a highway intersection, then turns right into a parking lot with a silver car nearby.\n- Player character exits the blue car, walks toward a man in a blue uniform, and interacts with him near a brick wall.\n- On-screen phone displays a clock reading 15:02, showing a digital interface with app icons.", "history_tokens": 999, "history_utf8_bytes": 4243, "recent_frame_times_s": [464.0005, 465.0015, 466.0025, 467.0035, 468.0045, 469.0055, 470.0065, 471.0075, 472.0085, 473.0095, 474.0105, 475.0115, 476.0125, 477.0135, 478.0145, 479.0155, 480.0165, 481.00081666666665, 482.0018166666667, 483.00281666666666, 484.0038166666667, 485.00481666666667, 486.00581666666665, 487.0068166666667, 488.00781666666666, 489.0088166666667, 490.00981666666667, 491.01081666666664, 492.0118166666667, 493.01281666666665], "recent_frames_sha256": "851617e9fa19dc56f63ed25e14e66515fef956c5f769fa793a34a831208b5d30", "num_recent_frames": 30, "tq": 716592.914654121, "t1": 716598.911502488, "ta": 716598.911502488, "te": 716598.948861257, "first_response_s": 5.996848366921768, "answer_total_s": 6.034207136020996, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 286, "content_group": "ebe6de093b407624549d423bdab2924ea5f1b3a8ed212b393267e00a9fff5a07", "question": {"question_id": "sample_286_a2191_q0", "video_id": 286, "video_path": "./videos/sample_286_real.mp4", "annotation_index": 2191, "question_index": 0, "question": "What is the large grey van doing right now?", "options": ["A. Stopping at a red light.", "B. Making a left turn at an intersection.", "C. Driving straight through an intersection.", "D. Parked on the side of the street."], "answer": "B", "time_stamp_s": 601, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_286_a2191_q0", "video_id": 286, "time_stamp_s": 601, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bc57550050fe5263e06d4c451f365589e5b0f7fa2eaac05d46f8013c27a2c65a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [571.0074, 572.0084, 573.0094, 574.0104, 575.0114, 576.0124, 577.0134, 578.0144, 579.0154, 580.0164, 581.0007166666667, 582.0017166666667, 583.0027166666666, 584.0037166666667, 585.0047166666667, 586.0057166666667, 587.0067166666666, 588.0077166666666, 589.0087166666667, 590.0097166666667, 591.0107166666667, 592.0117166666666, 593.0127166666666, 594.0137166666667, 595.0147166666667, 596.0157166666667, 597.0000333333334, 598.0010333333333, 599.0020333333333, 600.0030333333333], "recent_frames_sha256": "9a841c8cc41cac09cc4fe437dcb7b650c3ed45da2a477b519e6062a2065e2eaa", "num_recent_frames": 30, "tq": 716664.927951292, "t1": 716671.373061508, "ta": 716671.373061508, "te": 716671.523736242, "first_response_s": 6.445110216038302, "answer_total_s": 6.595784949953668, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_286_a2191_q0", "video_id": 286, "time_stamp_s": 601, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1e929b69d604372661066af60f8be7b8542471bed2b173241082c9a9e9631721", "condition_order": ["notes", "recent"], "memory": "[210-240s] - Player character stands beside a gray sedan, facing its driver’s side, with a yellow \"CASH\" sign visible on the car’s hood.\n- A white-shirted NPC walks toward the player from the background, while another NPC stands near a blue car further back.\n- The player character gestures toward the car’s hood, then turns slightly, as the \"CASH\" sign remains visible on the hood.\n[240-270s] - Player character in yellow vest stands beside a dark gray car, holding a yellow cloth.  \n- Another character in a white shirt approaches and gestures toward the car while holding a yellow cloth.  \n- The car’s rear bumper and license plate are visible, with a green dumpster and yellow poles in the background.\n[270-300s] - Player wipes car's front bumper with yellow cloth, moving from left to right.  \n- Player turns to face car's side after finishing front bumper.  \n- Another player in white shirt stands nearby, observing the cleaning.\n[300-330s] - A character in a yellow safety vest stands beside a dark gray sedan, observing its surroundings.  \n- Another character in a light gray shirt approaches and engages in conversation with the first character near the car.  \n- The sedan’s driver-side door is open, and the car appears stationary in a paved lot with scattered debris.\n[330-360s] - A man in a white shirt walks away from a gray car toward a blue car parked near a gate.  \n- A man in a yellow safety vest stands beside the gray car, facing the man in white.  \n- A blue car is parked near a gate, with its driver-side door open, and a man in a white shirt approaches it.\n[360-390s] - Player character in green hoodie stands near wall with \"NO PARKING\" sign, then walks toward blue car.  \n- Blue car is parked on street, doors open, and player approaches it.  \n- Player drives blue car down street, passing traffic and buildings, with speedometer visible.\n[390-420s] - Blue car drives across a wide bridge with arches, passing other vehicles and pedestrians.  \n- A large truck is visible ahead, and the car maneuvers around it on the highway.  \n- The car approaches an intersection with traffic lights, where a pedestrian is crossing the street.\n[420-450s] - Blue car drives on a highway, passing trucks and other vehicles, with a large bridge visible in the background.\n- The car accelerates, crossing a bridge with ocean views on the right side, and continues along a coastal road.\n- A black car overtakes the blue car on the right lane, and the blue car maintains a steady speed while navigating the road.\n[450-480s] - Blue car drives through a highway intersection, then turns right into a parking lot with a silver car nearby.\n- Player character exits the blue car, walks toward a man in a blue uniform, and interacts with him near a brick wall.\n- On-screen phone displays a clock reading 15:02, showing a digital interface with app icons.\n[480-510s] - Player character approaches a black van parked near industrial containers, then enters it.  \n- Van's interior is briefly shown as the player sits inside, with a view of the exterior environment through the windshield.  \n- The player drives the van forward on a paved lot, passing by large shipping containers and industrial structures.\n[510-540s] - Player drives a dark van through a port area, passing containers and barriers, with a map overlay showing location and player stats.\n- The van approaches a toll booth with red-and-white striped barriers, then proceeds through a checkpoint with a sign indicating \"EXIT\".\n- The camera angle shifts to a top-down view as the van navigates a paved road with orange cones and industrial structures in the background.\n[540-570s] - Player drives a truck along a multi-lane highway under a red bridge, passing other vehicles.  \n- A digital map and player stats are visible on the screen, showing route and team information.  \n- The truck’s speedometer indicates increasing speed as it moves forward on the road.\n[570-600s] - Player drives a gray van along a road with train tracks parallel to the right, passing various vehicles including a red car and a white sedan.  \n- The van navigates through urban streets with buildings, palm trees, and traffic signs, maintaining a steady speed.  \n- A map and game HUD are visible in the bottom left, while a chat window and player stats appear on the right side of the screen.", "history_tokens": 1000, "history_utf8_bytes": 4336, "recent_frame_times_s": [571.0074, 572.0084, 573.0094, 574.0104, 575.0114, 576.0124, 577.0134, 578.0144, 579.0154, 580.0164, 581.0007166666667, 582.0017166666667, 583.0027166666666, 584.0037166666667, 585.0047166666667, 586.0057166666667, 587.0067166666666, 588.0077166666666, 589.0087166666667, 590.0097166666667, 591.0107166666667, 592.0117166666666, 593.0127166666666, 594.0137166666667, 595.0147166666667, 596.0157166666667, 597.0000333333334, 598.0010333333333, 599.0020333333333, 600.0030333333333], "recent_frames_sha256": "9a841c8cc41cac09cc4fe437dcb7b650c3ed45da2a477b519e6062a2065e2eaa", "num_recent_frames": 30, "tq": 716629.816646295, "t1": 716637.165747716, "ta": 716637.165747716, "te": 716637.577046879, "first_response_s": 7.349101420957595, "answer_total_s": 7.7604005839675665, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 287, "content_group": "dd99a1b0573b4cb8e1e50f66f4d4532a187829284f9f30802ff56f560dbb86ce", "question": {"question_id": "sample_287_a740_q0", "video_id": 287, "video_path": "./videos/sample_287_real.mp4", "annotation_index": 740, "question_index": 0, "question": "What is the person in the smaller window doing right now?", "options": ["A. Talking on the phone.", "B. Concentrating on his screens.", "C. Writing notes on a paper.", "D. Drinking coffee."], "answer": "B", "time_stamp_s": 11, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_287_a740_q0", "video_id": 287, "time_stamp_s": 11, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "13d4678f5449ef62bfd903ddd7a9ee02944ebcf0e81653f246305bd71012c103", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.032, 1.0163166666666668, 2.0006333333333335, 3.0016333333333334, 4.002633333333334, 5.003633333333333, 6.0046333333333335, 7.005633333333333, 8.006633333333333, 9.007633333333333, 10.008633333333334], "recent_frames_sha256": "e79b3e11bfc9b52f6d7ac508282b189dcf3f8417ce789204c6c10e37f3bda9e8", "num_recent_frames": 11, "tq": 718396.782759404, "t1": 718402.269641055, "ta": 718402.269641055, "te": 718402.590154953, "first_response_s": 5.486881650984287, "answer_total_s": 5.807395548908971, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_287_a740_q0", "video_id": 287, "time_stamp_s": 11, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ff893d735762cae621d34e99d76d45fa18c1481af7331c75a38e86ff169cd47a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.032, 1.0163166666666668, 2.0006333333333335, 3.0016333333333334, 4.002633333333334, 5.003633333333333, 6.0046333333333335, 7.005633333333333, 8.006633333333333, 9.007633333333333, 10.008633333333334], "recent_frames_sha256": "e79b3e11bfc9b52f6d7ac508282b189dcf3f8417ce789204c6c10e37f3bda9e8", "num_recent_frames": 11, "tq": 718210.375017093, "t1": 718218.78657583, "ta": 718218.78657583, "te": 718218.826176454, "first_response_s": 8.411558736930601, "answer_total_s": 8.45115936093498, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 287, "content_group": "dd99a1b0573b4cb8e1e50f66f4d4532a187829284f9f30802ff56f560dbb86ce", "question": {"question_id": "sample_287_a741_q0", "video_id": 287, "video_path": "./videos/sample_287_real.mp4", "annotation_index": 741, "question_index": 0, "question": "What is the delivery van doing right now?", "options": ["A. Stopped at an intersection.", "B. Waiting for a truck to pass.", "C. Moving forward through the intersection.", "D. Turning right at the intersection."], "answer": "C", "time_stamp_s": 188, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_287_a741_q0", "video_id": 287, "time_stamp_s": 188, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "635a728f78ce02c7c7f745277345481bd872b10b5bd12c501b349ba02b7b6800", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [158.00648333333334, 159.00748333333334, 160.00848333333334, 161.00948333333332, 162.01048333333333, 163.01148333333333, 164.01248333333334, 165.01348333333334, 166.01448333333335, 167.01548333333332, 168.01648333333333, 169.0008, 170.0018, 171.0028, 172.0038, 173.0048, 174.0058, 175.0068, 176.0078, 177.0088, 178.0098, 179.0108, 180.0118, 181.0128, 182.0138, 183.0148, 184.0158, 185.00011666666666, 186.00111666666666, 187.00211666666667], "recent_frames_sha256": "00e77c2a0d76d374f651b34001154e31060b9635e2d822021053bada1771a04f", "num_recent_frames": 30, "tq": 718402.60651422, "t1": 718414.465833676, "ta": 718414.465833676, "te": 718414.505505494, "first_response_s": 11.859319456038065, "answer_total_s": 11.898991273948923, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_287_a741_q0", "video_id": 287, "time_stamp_s": 188, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2b9107fd5801cf799e9dca8be7c718890274172ba13ca30471d30d646e46984a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player drives a black van through a city street, passing traffic lights and palm trees, then stops at a parking lot entrance.  \n- A blonde character in a vest approaches the van, and the player opens the vehicle's inventory to interact with them.  \n- The player's inventory screen displays various items and a character model, with a chat log visible on the right side of the screen.\n[30-60s] - Player character in game carries a large box while walking near a parked van.  \n- Game UI displays inventory and character stats, including a health bar and equipped items.  \n- A \"Fueling Progression\" menu is open, showing fuel levels and vehicle status for multiple vehicles.\n[60-90s] - Player navigates a dark gray van through a city intersection, stopping at a crosswalk with pedestrians nearby.  \n- The \"Trucking Progression\" menu is open, displaying six truck options with prices and descriptions, including a white semi-truck image.  \n- A chat window on the right side shows active player interactions, with messages from users like \"Drew\" and \"Kenny.\"\n[90-120s] - A dark gray van with \"91\" on its side is stationary at a street corner, facing away from the camera.\n- A player character in a yellow vest approaches the van from the side, standing near its rear.\n- The game's UI displays a chat window with messages and a phone interface showing app icons, indicating an interactive session.\n[120-150s] - Player opens vehicle's side door, revealing interior and cargo space.\n- Player accesses inventory screen, displaying character stats, equipped items, and a grid of slots.\n- Player navigates to a map interface showing \"Loading Progress\" with various locations and their respective progress bars.\n[150-180s] - A black van is stationary at a street intersection, facing forward with its rear visible to the camera.  \n- A smartphone interface appears on the right side of the screen, displaying app icons and a clock reading 15:58.  \n- The game's HUD shows a map, speedometer, and a list of in-game items or upgrades on the left side.", "history_tokens": 469, "history_utf8_bytes": 2045, "recent_frame_times_s": [158.00648333333334, 159.00748333333334, 160.00848333333334, 161.00948333333332, 162.01048333333333, 163.01148333333333, 164.01248333333334, 165.01348333333334, 166.01448333333335, 167.01548333333332, 168.01648333333333, 169.0008, 170.0018, 171.0028, 172.0038, 173.0048, 174.0058, 175.0068, 176.0078, 177.0088, 178.0098, 179.0108, 180.0118, 181.0128, 182.0138, 183.0148, 184.0158, 185.00011666666666, 186.00111666666666, 187.00211666666667], "recent_frames_sha256": "00e77c2a0d76d374f651b34001154e31060b9635e2d822021053bada1771a04f", "num_recent_frames": 30, "tq": 718262.342296516, "t1": 718264.409278805, "ta": 718264.409278805, "te": 718264.675837087, "first_response_s": 2.0669822889612988, "answer_total_s": 2.333540570922196, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 287, "content_group": "dd99a1b0573b4cb8e1e50f66f4d4532a187829284f9f30802ff56f560dbb86ce", "question": {"question_id": "sample_287_a742_q0", "video_id": 287, "video_path": "./videos/sample_287_real.mp4", "annotation_index": 742, "question_index": 0, "question": "What is the person who is near the black van doing right now?", "options": ["A. Walking away from the van.", "B. Running towards the front of the van.", "C. Moving to the car's door.", "D. Getting into the passenger seat of the van."], "answer": "C", "time_stamp_s": 352, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_287_a742_q0", "video_id": 287, "time_stamp_s": 352, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "61c95ef53527551081a4bd9729aad71b5f18e7491ca839463e903c7a9a93a330", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [322.00365, 323.00465, 324.00565, 325.00665, 326.00765, 327.00865, 328.00965, 329.01065, 330.01165, 331.01265, 332.01365, 333.01465, 334.01565, 335.01665, 336.00096666666667, 337.00196666666665, 338.0029666666667, 339.00396666666666, 340.0049666666667, 341.00596666666667, 342.00696666666664, 343.0079666666667, 344.00896666666665, 345.0099666666667, 346.01096666666666, 347.0119666666667, 348.01296666666667, 349.01396666666665, 350.0149666666667, 351.01596666666666], "recent_frames_sha256": "3057db85c517359a2e59e2358844d56d888fd97b0bf356ac62925668be674c57", "num_recent_frames": 30, "tq": 718414.519341931, "t1": 718422.37148366, "ta": 718422.37148366, "te": 718422.40969982, "first_response_s": 7.8521417289739475, "answer_total_s": 7.890357889002189, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_287_a742_q0", "video_id": 287, "time_stamp_s": 352, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d53044f5d2668fb6cb6844b99f6f5eab6ee3de9aee7a164ff5ecb9ba2a168fc7", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player drives a black van through a city street, passing traffic lights and palm trees, then stops at a parking lot entrance.  \n- A blonde character in a vest approaches the van, and the player opens the vehicle's inventory to interact with them.  \n- The player's inventory screen displays various items and a character model, with a chat log visible on the right side of the screen.\n[30-60s] - Player character in game carries a large box while walking near a parked van.  \n- Game UI displays inventory and character stats, including a health bar and equipped items.  \n- A \"Fueling Progression\" menu is open, showing fuel levels and vehicle status for multiple vehicles.\n[60-90s] - Player navigates a dark gray van through a city intersection, stopping at a crosswalk with pedestrians nearby.  \n- The \"Trucking Progression\" menu is open, displaying six truck options with prices and descriptions, including a white semi-truck image.  \n- A chat window on the right side shows active player interactions, with messages from users like \"Drew\" and \"Kenny.\"\n[90-120s] - A dark gray van with \"91\" on its side is stationary at a street corner, facing away from the camera.\n- A player character in a yellow vest approaches the van from the side, standing near its rear.\n- The game's UI displays a chat window with messages and a phone interface showing app icons, indicating an interactive session.\n[120-150s] - Player opens vehicle's side door, revealing interior and cargo space.\n- Player accesses inventory screen, displaying character stats, equipped items, and a grid of slots.\n- Player navigates to a map interface showing \"Loading Progress\" with various locations and their respective progress bars.\n[150-180s] - A black van is stationary at a street intersection, facing forward with its rear visible to the camera.  \n- A smartphone interface appears on the right side of the screen, displaying app icons and a clock reading 15:58.  \n- The game's HUD shows a map, speedometer, and a list of in-game items or upgrades on the left side.\n[180-210s] - A black van drives forward on a paved road, passing through urban streets with palm trees and buildings.  \n- The van approaches a railroad crossing, then continues past it, with a train track visible on the left.  \n- The environment transitions from sunny urban streets to a more open, possibly coastal area with distant hills.\n[210-240s] - Player drives a black van on a multi-lane highway, passing other vehicles and approaching a bridge.  \n- A large red steel bridge spans the road ahead, with industrial structures and shipping containers visible in the background.  \n- The game’s HUD displays a speedometer, minimap, and player stats, with a chat window showing player interactions.\n[240-270s] - A dark gray van drives along a coastal highway, passing palm trees and ocean views.  \n- The van approaches a bridge, then enters a large industrial area with warehouses and shipping containers.  \n- The van turns right into a parking lot, passing a blue car and a person standing near a fence.\n[270-300s] - Player character approaches a dark gray van with \"grime\" branding, then crouches beside it.  \n- Three pedestrians stand near a brick wall, observing the player's movement.  \n- A blue car and a silver sedan are parked nearby, with a large industrial building in the background.\n[300-330s] - Player character stands near a large black delivery van with \"grime\" logo, then approaches a smaller blue van parked nearby.  \n- Player interacts with the blue van, which is positioned in a lot with other vehicles and industrial buildings.  \n- A small white vehicle is visible in the background, parked near a building with a sign reading \"KEEP EAST\".", "history_tokens": 847, "history_utf8_bytes": 3709, "recent_frame_times_s": [322.00365, 323.00465, 324.00565, 325.00665, 326.00765, 327.00865, 328.00965, 329.01065, 330.01165, 331.01265, 332.01365, 333.01465, 334.01565, 335.01665, 336.00096666666667, 337.00196666666665, 338.0029666666667, 339.00396666666666, 340.0049666666667, 341.00596666666667, 342.00696666666664, 343.0079666666667, 344.00896666666665, 345.0099666666667, 346.01096666666666, 347.0119666666667, 348.01296666666667, 349.01396666666665, 350.0149666666667, 351.01596666666666], "recent_frames_sha256": "3057db85c517359a2e59e2358844d56d888fd97b0bf356ac62925668be674c57", "num_recent_frames": 30, "tq": 718305.839939101, "t1": 718313.461055767, "ta": 718313.461055767, "te": 718313.654761956, "first_response_s": 7.621116666006856, "answer_total_s": 7.814822854939848, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 287, "content_group": "dd99a1b0573b4cb8e1e50f66f4d4532a187829284f9f30802ff56f560dbb86ce", "question": {"question_id": "sample_287_a743_q0", "video_id": 287, "video_path": "./videos/sample_287_real.mp4", "annotation_index": 743, "question_index": 0, "question": "What did the black delivery van do just now?", "options": ["A. Stopped at a red traffic light.", "B. Turned right at an intersection.", "C. Parked near a booth labeled \"24hr Parking\".", "D. Entered the booth to talk to a security officer."], "answer": "C", "time_stamp_s": 494, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_287_a743_q0", "video_id": 287, "time_stamp_s": 494, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f85a639bb5d0c6727866f3de8bdb650325380ff204053407e060c91ed87f96e4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [464.0121833333333, 465.01318333333336, 466.01418333333334, 467.0151833333333, 468.01618333333334, 469.0005, 470.0015, 471.0025, 472.0035, 473.0045, 474.0055, 475.0065, 476.0075, 477.0085, 478.0095, 479.0105, 480.0115, 481.0125, 482.0135, 483.0145, 484.0155, 485.0165, 486.00081666666665, 487.0018166666667, 488.00281666666666, 489.0038166666667, 490.00481666666667, 491.00581666666665, 492.0068166666667, 493.00781666666666], "recent_frames_sha256": "cd94d3f8b12b8192fa5355600ff2ff0e398c86c4b9f613702a380864c80469a8", "num_recent_frames": 30, "tq": 718422.422843223, "t1": 718432.835648519, "ta": 718432.835648519, "te": 718432.872409701, "first_response_s": 10.412805296014994, "answer_total_s": 10.4495664780261, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_287_a743_q0", "video_id": 287, "time_stamp_s": 494, "ground_truth": "C", "raw_output": "B. Turned right at an intersection.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "fc99978cbf3bba9379d50b62adeb4703cea7744be61272ad11ab7c015499934b", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A dark gray van with \"91\" on its side is stationary at a street corner, facing away from the camera.\n- A player character in a yellow vest approaches the van from the side, standing near its rear.\n- The game's UI displays a chat window with messages and a phone interface showing app icons, indicating an interactive session.\n[120-150s] - Player opens vehicle's side door, revealing interior and cargo space.\n- Player accesses inventory screen, displaying character stats, equipped items, and a grid of slots.\n- Player navigates to a map interface showing \"Loading Progress\" with various locations and their respective progress bars.\n[150-180s] - A black van is stationary at a street intersection, facing forward with its rear visible to the camera.  \n- A smartphone interface appears on the right side of the screen, displaying app icons and a clock reading 15:58.  \n- The game's HUD shows a map, speedometer, and a list of in-game items or upgrades on the left side.\n[180-210s] - A black van drives forward on a paved road, passing through urban streets with palm trees and buildings.  \n- The van approaches a railroad crossing, then continues past it, with a train track visible on the left.  \n- The environment transitions from sunny urban streets to a more open, possibly coastal area with distant hills.\n[210-240s] - Player drives a black van on a multi-lane highway, passing other vehicles and approaching a bridge.  \n- A large red steel bridge spans the road ahead, with industrial structures and shipping containers visible in the background.  \n- The game’s HUD displays a speedometer, minimap, and player stats, with a chat window showing player interactions.\n[240-270s] - A dark gray van drives along a coastal highway, passing palm trees and ocean views.  \n- The van approaches a bridge, then enters a large industrial area with warehouses and shipping containers.  \n- The van turns right into a parking lot, passing a blue car and a person standing near a fence.\n[270-300s] - Player character approaches a dark gray van with \"grime\" branding, then crouches beside it.  \n- Three pedestrians stand near a brick wall, observing the player's movement.  \n- A blue car and a silver sedan are parked nearby, with a large industrial building in the background.\n[300-330s] - Player character stands near a large black delivery van with \"grime\" logo, then approaches a smaller blue van parked nearby.  \n- Player interacts with the blue van, which is positioned in a lot with other vehicles and industrial buildings.  \n- A small white vehicle is visible in the background, parked near a building with a sign reading \"KEEP EAST\".\n[330-360s] - A blue \"prime\" delivery van is parked near a loading dock with a person standing beside it.  \n- The van's rear door opens, revealing a cargo area, and the person approaches it.  \n- The van is positioned near shipping containers and industrial structures, with other vehicles visible in the background.\n[360-390s] - Amazon van drives forward on paved lot, passing shipping containers and industrial structures.  \n- Player’s minimap and HUD show vehicle stats and nearby objectives.  \n- Van turns right onto highway, approaching exit signs with traffic cones and barriers.\n[390-420s] - Brown van drives on multi-lane highway, passing cars and crossing a red-steel bridge.  \n- Traffic lights and road signs (e.g., \"EXIT\") are visible ahead; van maintains steady speed.  \n- Driver’s face is shown in top-left corner, wearing headphones and reacting to gameplay.\n[420-450s] - A brown box truck drives along a multi-lane road with train tracks on the left, passing other vehicles and urban structures.  \n- The truck’s rear displays a visible \"Amazon\" logo, indicating its cargo or branding.  \n- The game’s HUD shows a speedometer reading around 60-68 mph, with a map and chat interface visible on the screen.\n[450-480s] - A dark gray Amazon Prime delivery van drives along a paved road, passing under an overpass and turning onto a street lined with palm trees and commercial buildings.  \n- The van’s rear is visible, showing the “Amazon Prime” logo, as it navigates through a suburban area with construction zones and utility poles.  \n- The game’s HUD displays a map, speedometer, and player stats, while a webcam feed in the top-left corner shows a person wearing headphones.", "history_tokens": 1003, "history_utf8_bytes": 4346, "recent_frame_times_s": [464.0121833333333, 465.01318333333336, 466.01418333333334, 467.0151833333333, 468.01618333333334, 469.0005, 470.0015, 471.0025, 472.0035, 473.0045, 474.0055, 475.0065, 476.0075, 477.0085, 478.0095, 479.0105, 480.0115, 481.0125, 482.0135, 483.0145, 484.0155, 485.0165, 486.00081666666665, 487.0018166666667, 488.00281666666666, 489.0038166666667, 490.00481666666667, 491.00581666666665, 492.0068166666667, 493.00781666666666], "recent_frames_sha256": "cd94d3f8b12b8192fa5355600ff2ff0e398c86c4b9f613702a380864c80469a8", "num_recent_frames": 30, "tq": 718349.325826844, "t1": 718357.063801637, "ta": 718357.063801637, "te": 718357.406452712, "first_response_s": 7.737974793068133, "answer_total_s": 8.080625868053176, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 287, "content_group": "dd99a1b0573b4cb8e1e50f66f4d4532a187829284f9f30802ff56f560dbb86ce", "question": {"question_id": "sample_287_a744_q0", "video_id": 287, "video_path": "./videos/sample_287_real.mp4", "annotation_index": 744, "question_index": 0, "question": "What is the van doing right now?", "options": ["A. Moving in reverse.", "B. Parking in a designated area.", "C. Waiting at a checkpoint.", "D. Loading items from green bins."], "answer": "B", "time_stamp_s": 639, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_287_a744_q0", "video_id": 287, "time_stamp_s": 639, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "66556d7159606963ec6cd6e13be3562955c35ee36ed4f40429033db4cd0e64ea", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [609.0070333333333, 610.0080333333333, 611.0090333333334, 612.0100333333334, 613.0110333333333, 614.0120333333333, 615.0130333333333, 616.0140333333334, 617.0150333333333, 618.0160333333333, 619.00035, 620.00135, 621.00235, 622.00335, 623.00435, 624.00535, 625.00635, 626.00735, 627.00835, 628.00935, 629.01035, 630.01135, 631.01235, 632.01335, 633.01435, 634.01535, 635.01635, 636.0006666666667, 637.0016666666667, 638.0026666666666], "recent_frames_sha256": "22970520c0aa628a7d25b3e6e2549b63c6c6fcbaf43a7b67d2f3e1c6b42575a1", "num_recent_frames": 30, "tq": 718432.881942763, "t1": 718444.788244509, "ta": 718444.788244509, "te": 718444.826382072, "first_response_s": 11.906301746028475, "answer_total_s": 11.944439308950678, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_287_a744_q0", "video_id": 287, "time_stamp_s": 639, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3df054592f5f9dcb9a397688329a9a91ef65cca5c21d4875d5f8114883fbfe8c", "condition_order": ["notes", "recent"], "memory": "[270-300s] - Player character approaches a dark gray van with \"grime\" branding, then crouches beside it.  \n- Three pedestrians stand near a brick wall, observing the player's movement.  \n- A blue car and a silver sedan are parked nearby, with a large industrial building in the background.\n[300-330s] - Player character stands near a large black delivery van with \"grime\" logo, then approaches a smaller blue van parked nearby.  \n- Player interacts with the blue van, which is positioned in a lot with other vehicles and industrial buildings.  \n- A small white vehicle is visible in the background, parked near a building with a sign reading \"KEEP EAST\".\n[330-360s] - A blue \"prime\" delivery van is parked near a loading dock with a person standing beside it.  \n- The van's rear door opens, revealing a cargo area, and the person approaches it.  \n- The van is positioned near shipping containers and industrial structures, with other vehicles visible in the background.\n[360-390s] - Amazon van drives forward on paved lot, passing shipping containers and industrial structures.  \n- Player’s minimap and HUD show vehicle stats and nearby objectives.  \n- Van turns right onto highway, approaching exit signs with traffic cones and barriers.\n[390-420s] - Brown van drives on multi-lane highway, passing cars and crossing a red-steel bridge.  \n- Traffic lights and road signs (e.g., \"EXIT\") are visible ahead; van maintains steady speed.  \n- Driver’s face is shown in top-left corner, wearing headphones and reacting to gameplay.\n[420-450s] - A brown box truck drives along a multi-lane road with train tracks on the left, passing other vehicles and urban structures.  \n- The truck’s rear displays a visible \"Amazon\" logo, indicating its cargo or branding.  \n- The game’s HUD shows a speedometer reading around 60-68 mph, with a map and chat interface visible on the screen.\n[450-480s] - A dark gray Amazon Prime delivery van drives along a paved road, passing under an overpass and turning onto a street lined with palm trees and commercial buildings.  \n- The van’s rear is visible, showing the “Amazon Prime” logo, as it navigates through a suburban area with construction zones and utility poles.  \n- The game’s HUD displays a map, speedometer, and player stats, while a webcam feed in the top-left corner shows a person wearing headphones.\n[480-510s] - Player character exits van, approaches parking gate with \"PARKING\" sign, then interacts with a bald man named \"Henry Miller\" at the gate.  \n- Game UI shows inventory with \"Pistol\" and \"Rifle\" equipped, and a \"Parked\" status indicating the van is parked.  \n- Player character is seen in a yellow vest, standing near green bushes beside the parking gate.\n[510-540s] - Player character approaches a dark gray Amazon van parked at a curb, then opens its rear door.  \n- A \"Cruising Progression\" menu is displayed, showing various vehicle upgrades with prices and requirements.  \n- The player's smartphone screen is visible, showing app icons and a notification for \"Amazon Prime\" at 12:00 PM.\n[540-570s] - A black van with a large rectangular front grille drives down a city street, passing under an overpass.  \n- The player’s HUD shows a speed of 67 mph and a map indicating the route.  \n- A chat window on the right displays viewer messages, including one about a \"new car\" and another about \"a new map.\"\n[570-600s] - A black Amazon Prime delivery van drives through urban streets, passing under an overpass and navigating intersections with traffic lights.  \n- The driver, visible in a small inset, is wearing a white hoodie and appears focused on the road.  \n- The van’s side displays the “Amazon Prime” logo, and the vehicle’s speed fluctuates between 64–68 mph as it maneuvers through city traffic.\n[600-630s] - A dark-colored van drives down a city street, passing palm trees and buildings, with a speedometer showing decreasing speed.  \n- The player's webcam view shows a person wearing headphones, reacting to gameplay.  \n- A red building with a \"MAY-GLASS\" sign is visible ahead as the van approaches a parking area.", "history_tokens": 975, "history_utf8_bytes": 4102, "recent_frame_times_s": [609.0070333333333, 610.0080333333333, 611.0090333333334, 612.0100333333334, 613.0110333333333, 614.0120333333333, 615.0130333333333, 616.0140333333334, 617.0150333333333, 618.0160333333333, 619.00035, 620.00135, 621.00235, 622.00335, 623.00435, 624.00535, 625.00635, 626.00735, 627.00835, 628.00935, 629.01035, 630.01135, 631.01235, 632.01335, 633.01435, 634.01535, 635.01635, 636.0006666666667, 637.0016666666667, 638.0026666666666], "recent_frames_sha256": "22970520c0aa628a7d25b3e6e2549b63c6c6fcbaf43a7b67d2f3e1c6b42575a1", "num_recent_frames": 30, "tq": 718395.238995444, "t1": 718396.707160487, "ta": 718396.707160487, "te": 718396.746174137, "first_response_s": 1.4681650429265574, "answer_total_s": 1.507178692962043, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 288, "content_group": "cbf4c5fabbf1530a0138a9be2a578cb59816d4f3af44019736784056a63a88f3", "question": {"question_id": "sample_288_a277_q0", "video_id": 288, "video_path": "./videos/sample_288_real.mp4", "annotation_index": 277, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Organizing items in the virtual inventory.", "B. Carrying a large cardboard box.", "C. Walking towards the building.", "D. Interacting with the delivery person and delivering the goods."], "answer": "D", "time_stamp_s": 18, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_288_a277_q0", "video_id": 288, "time_stamp_s": 18, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "47a5e5cb2f133d6d478d7c8b07807b366b012054ef2f88637f279a0f00e97191", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667], "recent_frames_sha256": "2ee54b6fba9fdc73bb2abc3fbc6c935597a61b07c5785a0e1007a3523a097aa3", "num_recent_frames": 18, "tq": 715612.752157183, "t1": 715618.009564272, "ta": 715618.009564272, "te": 715618.048549116, "first_response_s": 5.2574070889968425, "answer_total_s": 5.296391932992265, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_288_a277_q0", "video_id": 288, "time_stamp_s": 18, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e1ecd616e2d127564b5afa09b1dcad9873f2b39de48f29abda8ed42e81603fad", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667], "recent_frames_sha256": "2ee54b6fba9fdc73bb2abc3fbc6c935597a61b07c5785a0e1007a3523a097aa3", "num_recent_frames": 18, "tq": 715418.068893019, "t1": 715423.400664121, "ta": 715423.400664121, "te": 715423.660331196, "first_response_s": 5.331771102035418, "answer_total_s": 5.591438177041709, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 288, "content_group": "cbf4c5fabbf1530a0138a9be2a578cb59816d4f3af44019736784056a63a88f3", "question": {"question_id": "sample_288_a278_q0", "video_id": 288, "video_path": "./videos/sample_288_real.mp4", "annotation_index": 278, "question_index": 0, "question": "What is the driver doing right now?", "options": ["A. Turning left at an intersection.", "B. Slowing down to stop at a traffic light.", "C. Driving on a straight road.", "D. Parking the vehicle on the side of the road."], "answer": "C", "time_stamp_s": 160, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_288_a278_q0", "video_id": 288, "time_stamp_s": 160, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "57b8fdda58120d0595e8d1c124c50fe356ec729d24e17dd8cfa2ab7ac271ed17", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885], "recent_frames_sha256": "b9552491fa1ee118aa20136b461d6f6d635317c8676d6992b2ed278688bb2dee", "num_recent_frames": 30, "tq": 715618.057699791, "t1": 715660.762966203, "ta": 715660.762966203, "te": 715660.800471808, "first_response_s": 42.70526641199831, "answer_total_s": 42.74277201690711, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_288_a278_q0", "video_id": 288, "time_stamp_s": 160, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "95780c315369094bd7cc54309502e8070c57773bea920a404c765cbdf04fa08e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player character, wearing a yellow vest, interacts with a security guard near a van, then approaches a large black van marked \"grin\" for loading.  \n- Security guard, in uniform and cap, stands near the van, observing the player character's actions.  \n- Player character opens the van's rear door, revealing a loading area, and proceeds to enter the vehicle.\n[30-60s] - Van drives past a gas station, then turns right onto a street with palm trees and buildings.  \n- A black car overtakes the van on the right side of the road.  \n- The van continues forward, passing a crosswalk and approaching a traffic light.\n[60-90s] - A black van with a blue logo drives through city streets, passing under bridges and near construction sites.  \n- The van navigates intersections, occasionally stopping at traffic lights, with other vehicles visible in the surrounding traffic.  \n- The game's HUD displays speed, fuel, and a map, while a live stream overlay shows a player's face in the top-left corner.\n[90-120s] - A black, box-shaped vehicle with \"Uber\" branding drives along a street with tram tracks, passing traffic lights and palm trees.  \n- The vehicle maintains a steady speed, navigating through urban streets with buildings and storefronts on either side.  \n- A small inset screen in the top-left corner shows a person wearing headphones, likely the streamer, with a blurred background.\n[120-150s] - A black van with \"grime\" branding drives along a city street, passing other vehicles and pedestrians.  \n- The van navigates through traffic, including a silver sedan and a blue car, while maintaining a steady pace.  \n- The game's HUD displays a speedometer reading around 40-50 mph, with a map and chat window visible on the screen.", "history_tokens": 401, "history_utf8_bytes": 1739, "recent_frame_times_s": [130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885], "recent_frames_sha256": "b9552491fa1ee118aa20136b461d6f6d635317c8676d6992b2ed278688bb2dee", "num_recent_frames": 30, "tq": 715461.438393677, "t1": 715468.17711533, "ta": 715468.17711533, "te": 715468.215849514, "first_response_s": 6.738721653004177, "answer_total_s": 6.777455837000161, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 288, "content_group": "cbf4c5fabbf1530a0138a9be2a578cb59816d4f3af44019736784056a63a88f3", "question": {"question_id": "sample_288_a279_q0", "video_id": 288, "video_path": "./videos/sample_288_real.mp4", "annotation_index": 279, "question_index": 0, "question": "What is the delivery person doing right now?", "options": ["A. Walking away from Frank.", "B. Run towards the harvester in white clothes.", "C. Engaging in a conversation with Frank.", "D. Running towards the building."], "answer": "B", "time_stamp_s": 380, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_288_a279_q0", "video_id": 288, "time_stamp_s": 380, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a251f3a3373bdb4591dce100a946605b3271de221f1fffc3db243e8b1e3a8af5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667], "recent_frames_sha256": "4a19138e4fa7347918514b5458585a6b0ea878a9ad9aa95e4aecbd846c79ce9e", "num_recent_frames": 30, "tq": 715660.809828844, "t1": 715672.498010905, "ta": 715672.498010905, "te": 715672.536636053, "first_response_s": 11.688182060956024, "answer_total_s": 11.726807208964601, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_288_a279_q0", "video_id": 288, "time_stamp_s": 380, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d3381afa535d275ef080f65013941829efd2108d4576ce7f54e63f01d5e0c4f8", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player character, wearing a yellow vest, interacts with a security guard near a van, then approaches a large black van marked \"grin\" for loading.  \n- Security guard, in uniform and cap, stands near the van, observing the player character's actions.  \n- Player character opens the van's rear door, revealing a loading area, and proceeds to enter the vehicle.\n[30-60s] - Van drives past a gas station, then turns right onto a street with palm trees and buildings.  \n- A black car overtakes the van on the right side of the road.  \n- The van continues forward, passing a crosswalk and approaching a traffic light.\n[60-90s] - A black van with a blue logo drives through city streets, passing under bridges and near construction sites.  \n- The van navigates intersections, occasionally stopping at traffic lights, with other vehicles visible in the surrounding traffic.  \n- The game's HUD displays speed, fuel, and a map, while a live stream overlay shows a player's face in the top-left corner.\n[90-120s] - A black, box-shaped vehicle with \"Uber\" branding drives along a street with tram tracks, passing traffic lights and palm trees.  \n- The vehicle maintains a steady speed, navigating through urban streets with buildings and storefronts on either side.  \n- A small inset screen in the top-left corner shows a person wearing headphones, likely the streamer, with a blurred background.\n[120-150s] - A black van with \"grime\" branding drives along a city street, passing other vehicles and pedestrians.  \n- The van navigates through traffic, including a silver sedan and a blue car, while maintaining a steady pace.  \n- The game's HUD displays a speedometer reading around 40-50 mph, with a map and chat window visible on the screen.\n[150-180s] - A dark gray van with \"Syne\" branding drives along a multi-lane road, passing other vehicles and infrastructure.  \n- The van navigates through urban streets, approaching a large red bridge structure with visible traffic and signage.  \n- A small inset window shows a person wearing headphones, seemingly observing the gameplay.\n[180-210s] - Black box-like vehicle drives on highway, passing cars and palm trees.  \n- Vehicle enters bridge over ocean, then exits onto a road with construction barriers.  \n- Player’s in-game speedometer shows decreasing speed as vehicle approaches a tunnel.\n[210-240s] - Player character walks toward a parked van with \"prime\" branding, then approaches a blue car parked nearby.  \n- A map interface is opened, showing a detailed city layout with various locations marked.  \n- The player character stands near a white car, facing a group of parked vehicles including a red car and a black van.\n[240-270s] - Player character in yellow vest runs toward a large black Amazon van, then jumps onto its roof.  \n- Another character in a blue jersey labeled \"RAMOS 29\" stands nearby, observing the action.  \n- The scene shifts to a parking lot with multiple vehicles, including a white sedan and a red car, parked near industrial buildings.\n[270-300s] - Player character in yellow vest stands near blue car, facing two men in blue jerseys and a masked figure.  \n- Two dark gray delivery vans are parked nearby, with one van partially obscured by a black object.  \n- A white car and a blue car are visible in the background, with a red vehicle further away.\n[300-330s] - Player character approaches a large grey Amazon Prime delivery van, then walks toward a second van parked nearby.  \n- A man in a white shirt stands near the second van, observing the player.  \n- The player character moves toward a blue car parked behind the vans, then turns to face a brick wall.\n[330-360s] - A man in a white coat labeled \"Frank Miller\" stands near a brick wall, facing the camera.  \n- A large black van with \"grime\" branding is parked nearby, with several players gathered around it.  \n- A blue car is driven into a parking area with yellow-and-black bollards, then positioned near the van.", "history_tokens": 917, "history_utf8_bytes": 3954, "recent_frame_times_s": [350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667], "recent_frames_sha256": "4a19138e4fa7347918514b5458585a6b0ea878a9ad9aa95e4aecbd846c79ce9e", "num_recent_frames": 30, "tq": 715520.677455434, "t1": 715527.217257422, "ta": 715527.217257422, "te": 715527.434934947, "first_response_s": 6.539801988052204, "answer_total_s": 6.757479513064027, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 288, "content_group": "cbf4c5fabbf1530a0138a9be2a578cb59816d4f3af44019736784056a63a88f3", "question": {"question_id": "sample_288_a280_q0", "video_id": 288, "video_path": "./videos/sample_288_real.mp4", "annotation_index": 280, "question_index": 0, "question": "What are the three people in the video doing now?", "options": ["A. Standing quietly.", "B. Deployed a tripwire next to the van.", "C. Talking to each other.", "D. Interacted with another character in the background."], "answer": "A", "time_stamp_s": 500, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_288_a280_q0", "video_id": 288, "time_stamp_s": 500, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bd7728a7199416836ed9ecdf0005f634f31f658d8d5d3493b2a541f1fd107653", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336, 498.01418333333334, 499.0151833333333], "recent_frames_sha256": "3aea3ec0d42783f5de4ed53ee350ac3296930592e2ff4f35cc044a72580778c1", "num_recent_frames": 30, "tq": 715672.547238465, "t1": 715683.778555871, "ta": 715683.778555871, "te": 715683.816753163, "first_response_s": 11.23131740593817, "answer_total_s": 11.269514697953127, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_288_a280_q0", "video_id": 288, "time_stamp_s": 500, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "df67d37d64367bc80dadf2b42711a83758f5b66081432dcee0dda8e6489f93d2", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A black, box-shaped vehicle with \"Uber\" branding drives along a street with tram tracks, passing traffic lights and palm trees.  \n- The vehicle maintains a steady speed, navigating through urban streets with buildings and storefronts on either side.  \n- A small inset screen in the top-left corner shows a person wearing headphones, likely the streamer, with a blurred background.\n[120-150s] - A black van with \"grime\" branding drives along a city street, passing other vehicles and pedestrians.  \n- The van navigates through traffic, including a silver sedan and a blue car, while maintaining a steady pace.  \n- The game's HUD displays a speedometer reading around 40-50 mph, with a map and chat window visible on the screen.\n[150-180s] - A dark gray van with \"Syne\" branding drives along a multi-lane road, passing other vehicles and infrastructure.  \n- The van navigates through urban streets, approaching a large red bridge structure with visible traffic and signage.  \n- A small inset window shows a person wearing headphones, seemingly observing the gameplay.\n[180-210s] - Black box-like vehicle drives on highway, passing cars and palm trees.  \n- Vehicle enters bridge over ocean, then exits onto a road with construction barriers.  \n- Player’s in-game speedometer shows decreasing speed as vehicle approaches a tunnel.\n[210-240s] - Player character walks toward a parked van with \"prime\" branding, then approaches a blue car parked nearby.  \n- A map interface is opened, showing a detailed city layout with various locations marked.  \n- The player character stands near a white car, facing a group of parked vehicles including a red car and a black van.\n[240-270s] - Player character in yellow vest runs toward a large black Amazon van, then jumps onto its roof.  \n- Another character in a blue jersey labeled \"RAMOS 29\" stands nearby, observing the action.  \n- The scene shifts to a parking lot with multiple vehicles, including a white sedan and a red car, parked near industrial buildings.\n[270-300s] - Player character in yellow vest stands near blue car, facing two men in blue jerseys and a masked figure.  \n- Two dark gray delivery vans are parked nearby, with one van partially obscured by a black object.  \n- A white car and a blue car are visible in the background, with a red vehicle further away.\n[300-330s] - Player character approaches a large grey Amazon Prime delivery van, then walks toward a second van parked nearby.  \n- A man in a white shirt stands near the second van, observing the player.  \n- The player character moves toward a blue car parked behind the vans, then turns to face a brick wall.\n[330-360s] - A man in a white coat labeled \"Frank Miller\" stands near a brick wall, facing the camera.  \n- A large black van with \"grime\" branding is parked nearby, with several players gathered around it.  \n- A blue car is driven into a parking area with yellow-and-black bollards, then positioned near the van.\n[360-390s] - A blue car is parked on concrete near a black van, with a character in a blue jersey (Ramos 29) standing beside it.  \n- Two other characters, one in a reflective vest and another in a black mask, are nearby, facing each other.  \n- The map overlay shows a city layout with a crosshair, indicating a location selection or navigation interface.\n[390-420s] - A dark blue van is parked on the road, with a man in a black hoodie and mask standing near it, facing two other characters.\n- The man in the blue jersey (Ramos 29) and the man in the yellow safety vest are standing close to each other, facing the masked man.\n- The masked man turns slightly to his left, appearing to interact with the two men, while the van remains stationary in the background.\n[420-450s] - Player in blue jersey (HAMOS 29) stands near a blue car, facing two others in a dockyard setting.  \n- Player in green vest runs toward a large black trailer, then turns back toward the group.  \n- On-screen UI shows character stats and inventory, with a chat log visible on the right side.\n[450-480s] - Player character approaches a dark gray van with \"grime\" logo, standing near its rear wheel.\n- A second van is visible nearby, positioned to the left of the first van.\n- Player character interacts with the van, triggering a UI overlay showing vehicle details and options.", "history_tokens": 1020, "history_utf8_bytes": 4304, "recent_frame_times_s": [470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336, 498.01418333333334, 499.0151833333333], "recent_frames_sha256": "3aea3ec0d42783f5de4ed53ee350ac3296930592e2ff4f35cc044a72580778c1", "num_recent_frames": 30, "tq": 715557.382689631, "t1": 715558.737168978, "ta": 715558.737168978, "te": 715559.004500252, "first_response_s": 1.3544793470064178, "answer_total_s": 1.621810620999895, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 288, "content_group": "cbf4c5fabbf1530a0138a9be2a578cb59816d4f3af44019736784056a63a88f3", "question": {"question_id": "sample_288_a281_q0", "video_id": 288, "video_path": "./videos/sample_288_real.mp4", "annotation_index": 281, "question_index": 0, "question": "What is the camera doing right now?", "options": ["A. Zooming in on the truck.", "B. Focusing on the streaming individual.", "C. Panning across the park-like setting.", "D. Capturing the rabbit sitting on the road."], "answer": "C", "time_stamp_s": 639, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_288_a281_q0", "video_id": 288, "time_stamp_s": 639, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1664bc99c4e7c091f6d5635027585ca80b2849aa23ad9cf9fecbc9912f81a1cb", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [609.0084, 610.0094, 611.0104, 612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0007166666667, 619.0017166666667, 620.0027166666666, 621.0037166666667, 622.0047166666667, 623.0057166666667, 624.0067166666666, 625.0077166666666, 626.0087166666667, 627.0097166666667, 628.0107166666667, 629.0117166666666, 630.0127166666666, 631.0137166666667, 632.0147166666667, 633.0157166666667, 634.0000333333334, 635.0010333333333, 636.0020333333333, 637.0030333333333, 638.0040333333334], "recent_frames_sha256": "5410dfdcd47b17028a4552ff6489f6b279378f850e3693819902648013145b61", "num_recent_frames": 30, "tq": 715683.827825654, "t1": 715697.784182685, "ta": 715697.784182685, "te": 715697.968296485, "first_response_s": 13.956357031012885, "answer_total_s": 14.14047083107289, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_288_a281_q0", "video_id": 288, "time_stamp_s": 639, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d4b239aa0a049e8459e003d333e93f730ebf3b92fbd9c6309693b36a12269fba", "condition_order": ["notes", "recent"], "memory": "[270-300s] - Player character in yellow vest stands near blue car, facing two men in blue jerseys and a masked figure.  \n- Two dark gray delivery vans are parked nearby, with one van partially obscured by a black object.  \n- A white car and a blue car are visible in the background, with a red vehicle further away.\n[300-330s] - Player character approaches a large grey Amazon Prime delivery van, then walks toward a second van parked nearby.  \n- A man in a white shirt stands near the second van, observing the player.  \n- The player character moves toward a blue car parked behind the vans, then turns to face a brick wall.\n[330-360s] - A man in a white coat labeled \"Frank Miller\" stands near a brick wall, facing the camera.  \n- A large black van with \"grime\" branding is parked nearby, with several players gathered around it.  \n- A blue car is driven into a parking area with yellow-and-black bollards, then positioned near the van.\n[360-390s] - A blue car is parked on concrete near a black van, with a character in a blue jersey (Ramos 29) standing beside it.  \n- Two other characters, one in a reflective vest and another in a black mask, are nearby, facing each other.  \n- The map overlay shows a city layout with a crosshair, indicating a location selection or navigation interface.\n[390-420s] - A dark blue van is parked on the road, with a man in a black hoodie and mask standing near it, facing two other characters.\n- The man in the blue jersey (Ramos 29) and the man in the yellow safety vest are standing close to each other, facing the masked man.\n- The masked man turns slightly to his left, appearing to interact with the two men, while the van remains stationary in the background.\n[420-450s] - Player in blue jersey (HAMOS 29) stands near a blue car, facing two others in a dockyard setting.  \n- Player in green vest runs toward a large black trailer, then turns back toward the group.  \n- On-screen UI shows character stats and inventory, with a chat log visible on the right side.\n[450-480s] - Player character approaches a dark gray van with \"grime\" logo, standing near its rear wheel.\n- A second van is visible nearby, positioned to the left of the first van.\n- Player character interacts with the van, triggering a UI overlay showing vehicle details and options.\n[480-510s] - Player character stands beside a gray van with \"grime\" logo, facing its side; van is stationary.  \n- Player character walks around the van, inspecting its side and rear, with scattered red items on the ground nearby.  \n- Player character approaches the rear of the van, then turns to face the front, with a small green icon appearing near their feet.\n[510-540s] - Player character in game stands near a manhole cover, holding a phone displaying a map interface.  \n- A second character in a white shirt approaches and interacts with the player, possibly handing over an item.  \n- Game UI shows a map of the city with various locations marked, indicating navigation or mission-related activity.\n[540-570s] - A \"Connecting\" dialog box from \"RofNet 4.0-SP\" appears, indicating network setup for a game session.  \n- The user interface shows a dark, futuristic game environment with minimal visible objects or characters.  \n- The streamer's webcam view shows them holding a small object, likely a controller or accessory, while seated.\n[570-600s] - Player character stands in a dimly lit, futuristic corridor with glowing blue panels and statues in the background.\n- Camera pans right, revealing a dark, forested outdoor area with a small structure and a faint green glow in the distance.\n- UI elements show \"loading game 100%\" and a chat log with viewer messages on the right side of the screen.\n[600-630s] - Player character moves through a dimly lit, green-tinted urban environment with visible street signs and parked vehicles.  \n- A large white bus is parked on the road, with a license plate reading \"85KM005\" visible.  \n- The player's HUD shows a \"loading game\" message, indicating a transition or game state change.", "history_tokens": 969, "history_utf8_bytes": 4020, "recent_frame_times_s": [609.0084, 610.0094, 611.0104, 612.0114, 613.0124, 614.0134, 615.0144, 616.0154, 617.0164, 618.0007166666667, 619.0017166666667, 620.0027166666666, 621.0037166666667, 622.0047166666667, 623.0057166666667, 624.0067166666666, 625.0077166666666, 626.0087166666667, 627.0097166666667, 628.0107166666667, 629.0117166666666, 630.0127166666666, 631.0137166666667, 632.0147166666667, 633.0157166666667, 634.0000333333334, 635.0010333333333, 636.0020333333333, 637.0030333333333, 638.0040333333334], "recent_frames_sha256": "5410dfdcd47b17028a4552ff6489f6b279378f850e3693819902648013145b61", "num_recent_frames": 30, "tq": 715598.50111401, "t1": 715612.399032491, "ta": 715612.399032491, "te": 715612.712896724, "first_response_s": 13.897918481030501, "answer_total_s": 14.211782714002766, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 289, "content_group": "109aaa67a9f22dc114059da1119267d56f8ef6e68505fd7b8dcd46e89e9c60ae", "question": {"question_id": "sample_289_a1681_q0", "video_id": 289, "video_path": "./videos/sample_289_real.mp4", "annotation_index": 1681, "question_index": 0, "question": "What is the character on the ground doing right now?", "options": ["A. Lying motionless.", "B. Beginning to stand up.", "C. Running away.", "D. Adjusting their goggles."], "answer": "B", "time_stamp_s": 16, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_289_a1681_q0", "video_id": 289, "time_stamp_s": 16, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6a412fc6d70a86be04c3be587bbbb3a3d4549d5639ce80593ec10559ad207711", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.037, 1.0046333333333333, 2.0056333333333334, 3.0066333333333333, 4.007633333333334, 5.008633333333333, 6.009633333333333, 7.010633333333334, 8.011633333333334, 9.012633333333333, 10.013633333333333, 11.014633333333334, 12.015633333333334, 13.016633333333333, 14.00095, 15.00195], "recent_frames_sha256": "f96a08a9ac45efff92b390132c7352767102c1776e2202d109dc4e85c5fc7501", "num_recent_frames": 16, "tq": 718969.222746294, "t1": 718977.639666417, "ta": 718977.639666417, "te": 718977.841230657, "first_response_s": 8.416920123039745, "answer_total_s": 8.618484362959862, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_289_a1681_q0", "video_id": 289, "time_stamp_s": 16, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fca1febbabea4a8ede073ef4dd9c0e033730b427475a00f27d9da3aeaac2e5be", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.037, 1.0046333333333333, 2.0056333333333334, 3.0066333333333333, 4.007633333333334, 5.008633333333333, 6.009633333333333, 7.010633333333334, 8.011633333333334, 9.012633333333333, 10.013633333333333, 11.014633333333334, 12.015633333333334, 13.016633333333333, 14.00095, 15.00195], "recent_frames_sha256": "f96a08a9ac45efff92b390132c7352767102c1776e2202d109dc4e85c5fc7501", "num_recent_frames": 16, "tq": 719019.36419014, "t1": 719033.323021859, "ta": 719033.323021859, "te": 719033.671160443, "first_response_s": 13.958831719006412, "answer_total_s": 14.306970302946866, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 289, "content_group": "109aaa67a9f22dc114059da1119267d56f8ef6e68505fd7b8dcd46e89e9c60ae", "question": {"question_id": "sample_289_a1682_q0", "video_id": 289, "video_path": "./videos/sample_289_real.mp4", "annotation_index": 1682, "question_index": 0, "question": "What is the vehicle doing right now?", "options": ["A. Making a left turn.", "B. Approaching the exit road.", "C. Passing yellow barriers.", "D. Driving through parking zones."], "answer": "B", "time_stamp_s": 180, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_289_a1682_q0", "video_id": 289, "time_stamp_s": 180, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bd3781c38ba7d0a1e32ca7c01076f5f57403fe739c44fcc1efd5a2ccc41280a7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.00348333333332, 151.00448333333333, 152.00548333333333, 153.00648333333334, 154.00748333333334, 155.00848333333334, 156.00948333333332, 157.01048333333333, 158.01148333333333, 159.01248333333334, 160.01348333333334, 161.01448333333335, 162.01548333333332, 163.01648333333333, 164.0008, 165.0018, 166.0028, 167.0038, 168.0048, 169.0058, 170.0068, 171.0078, 172.0088, 173.0098, 174.0108, 175.0118, 176.0128, 177.0138, 178.0148, 179.0158], "recent_frames_sha256": "ea82dc1d75a95e4e64b25fedc6d86aab5ba05100dec4a4d013c8e4794436bb54", "num_recent_frames": 30, "tq": 718977.868877138, "t1": 718985.259925696, "ta": 718985.259925696, "te": 718985.298165679, "first_response_s": 7.391048557939939, "answer_total_s": 7.429288540966809, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_289_a1682_q0", "video_id": 289, "time_stamp_s": 180, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d067a99c4f8e34f9b3f3a29d1716c0b63429e376fc47d4a20ccde5000523a838", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Player character in a dimly lit room, then transitions to an outdoor port area with shipping containers and cranes.  \n- A second character in a yellow vest and helmet is seen bending over, then standing near the first character, both in an industrial setting.  \n- A smartphone interface appears on screen, displaying app icons and a clock reading 7:04, suggesting a mobile device interaction within the game.\n[30-60s] - Player in green vest walks toward a man in a white shirt and cap, who is standing near a brick wall.  \n- The man in the cap, identified as \"Frank Vilar,\" has a dialogue box open showing his name and a \"Talk\" option.  \n- A smartphone UI overlay on the right side of the screen displays a menu with options like \"Phone,\" \"Messages,\" and \"Settings.\"\n[60-90s] - Player character stands near a brick wall, facing a police officer who is partially turned away.  \n- A smartphone UI overlay shows a \"Phone\" menu with options like \"Messages\" and \"Settings,\" indicating an active mobile interface.  \n- The game's \"Farming Progression\" menu is open, displaying six farming-related items with prices and descriptions.\n[90-120s] - Player character stands near a blue car in an open area, facing away from camera.  \n- Several NPCs walk past the player, including one in a green vest and another in a brown shirt.  \n- A smartphone interface is visible on the right side of the screen, showing app icons and a time display of 19:30.\n[120-150s] - Player character in yellow vest interacts with masked NPC near brick wall, then moves toward industrial area.  \n- On-screen phone displays time changing from 11:22 to 11:27, showing app icons and notifications.  \n- Game UI shows \"Trolling Progression\" menu with six purchasable items, each with price and description.\n[150-180s] - A black van drives forward on a paved road, passing through an industrial area with shipping containers and cranes.  \n- The van's rear is visible, showing a dark, boxy shape with no visible markings or lights.  \n- The game's HUD displays a speedometer, map, and chat window with player messages on the right side of the screen.", "history_tokens": 508, "history_utf8_bytes": 2118, "recent_frame_times_s": [150.00348333333332, 151.00448333333333, 152.00548333333333, 153.00648333333334, 154.00748333333334, 155.00848333333334, 156.00948333333332, 157.01048333333333, 158.01148333333333, 159.01248333333334, 160.01348333333334, 161.01448333333335, 162.01548333333332, 163.01648333333333, 164.0008, 165.0018, 166.0028, 167.0038, 168.0048, 169.0058, 170.0068, 171.0078, 172.0088, 173.0098, 174.0108, 175.0118, 176.0128, 177.0138, 178.0148, 179.0158], "recent_frames_sha256": "ea82dc1d75a95e4e64b25fedc6d86aab5ba05100dec4a4d013c8e4794436bb54", "num_recent_frames": 30, "tq": 719105.226588327, "t1": 719110.815182574, "ta": 719110.815182574, "te": 719110.852771925, "first_response_s": 5.588594247004949, "answer_total_s": 5.626183598069474, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 289, "content_group": "109aaa67a9f22dc114059da1119267d56f8ef6e68505fd7b8dcd46e89e9c60ae", "question": {"question_id": "sample_289_a1683_q0", "video_id": 289, "video_path": "./videos/sample_289_real.mp4", "annotation_index": 1683, "question_index": 0, "question": "What did the vehicle do just now?", "options": ["A. Stopped at a red light.", "B. Turned left onto another street.", "C. Continued along the new street.", "D. Reversed into a parking space."], "answer": "C", "time_stamp_s": 325, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_289_a1683_q0", "video_id": 289, "time_stamp_s": 325, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "afbb7e00e8e0ebb0e1d86f1b194c1deb1a7f86f68849089742137de2d877b540", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [295.01501666666667, 296.01601666666664, 297.00033333333334, 298.0013333333333, 299.00233333333335, 300.00333333333333, 301.0043333333333, 302.00533333333334, 303.0063333333333, 304.00733333333335, 305.0083333333333, 306.00933333333336, 307.01033333333334, 308.0113333333333, 309.01233333333334, 310.0133333333333, 311.01433333333335, 312.01533333333333, 313.0163333333333, 314.00065, 315.00165, 316.00265, 317.00365, 318.00465, 319.00565, 320.00665, 321.00765, 322.00865, 323.00965, 324.01065], "recent_frames_sha256": "02225df7460de6707e48ee2de6230b94f6673e941d0e4067242839bf3456c3d6", "num_recent_frames": 30, "tq": 718985.312544087, "t1": 718998.327208059, "ta": 718998.327208059, "te": 718998.365394765, "first_response_s": 13.01466397207696, "answer_total_s": 13.052850678097457, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_289_a1683_q0", "video_id": 289, "time_stamp_s": 325, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9328f8f6ce80eb9da5b3dcd9f7cb1328b72dde8f948fd38faab11d9349d8dfcd", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Player character in a dimly lit room, then transitions to an outdoor port area with shipping containers and cranes.  \n- A second character in a yellow vest and helmet is seen bending over, then standing near the first character, both in an industrial setting.  \n- A smartphone interface appears on screen, displaying app icons and a clock reading 7:04, suggesting a mobile device interaction within the game.\n[30-60s] - Player in green vest walks toward a man in a white shirt and cap, who is standing near a brick wall.  \n- The man in the cap, identified as \"Frank Vilar,\" has a dialogue box open showing his name and a \"Talk\" option.  \n- A smartphone UI overlay on the right side of the screen displays a menu with options like \"Phone,\" \"Messages,\" and \"Settings.\"\n[60-90s] - Player character stands near a brick wall, facing a police officer who is partially turned away.  \n- A smartphone UI overlay shows a \"Phone\" menu with options like \"Messages\" and \"Settings,\" indicating an active mobile interface.  \n- The game's \"Farming Progression\" menu is open, displaying six farming-related items with prices and descriptions.\n[90-120s] - Player character stands near a blue car in an open area, facing away from camera.  \n- Several NPCs walk past the player, including one in a green vest and another in a brown shirt.  \n- A smartphone interface is visible on the right side of the screen, showing app icons and a time display of 19:30.\n[120-150s] - Player character in yellow vest interacts with masked NPC near brick wall, then moves toward industrial area.  \n- On-screen phone displays time changing from 11:22 to 11:27, showing app icons and notifications.  \n- Game UI shows \"Trolling Progression\" menu with six purchasable items, each with price and description.\n[150-180s] - A black van drives forward on a paved road, passing through an industrial area with shipping containers and cranes.  \n- The van's rear is visible, showing a dark, boxy shape with no visible markings or lights.  \n- The game's HUD displays a speedometer, map, and chat window with player messages on the right side of the screen.\n[180-210s] - Player drives a brown van on a multi-lane highway, passing other vehicles and approaching a large red bridge.  \n- The van's speed fluctuates between 50-60 mph as it navigates the road, with a map and speedometer visible in the UI.  \n- A \"EXIT\" sign and \"US 395\" highway marker are visible ahead, indicating an upcoming exit or route change.\n[210-240s] - A dark-colored van drives along a multi-lane road with train tracks running parallel to the road, passing other vehicles and urban infrastructure.  \n- The van continues forward, crossing a bridge with palm trees and distant buildings visible, maintaining a steady speed.  \n- The game's HUD displays a speedometer, map, and chat window with viewer messages, indicating an active live stream.\n[240-270s] - A black box-like object is mounted on the roof of a vehicle, moving forward on a paved road.  \n- The vehicle navigates through a suburban area with palm trees, traffic lights, and commercial buildings.  \n- A small inset screen in the top-left corner shows a person wearing headphones, seemingly observing the gameplay.\n[270-300s] - Player drives a black van through urban streets, passing under bridges and near palm trees.  \n- A large black speaker is mounted on the van’s roof, visible throughout the drive.  \n- The game’s HUD shows a map, speedometer, and player stats, with chat messages scrolling on the right.", "history_tokens": 838, "history_utf8_bytes": 3509, "recent_frame_times_s": [295.01501666666667, 296.01601666666664, 297.00033333333334, 298.0013333333333, 299.00233333333335, 300.00333333333333, 301.0043333333333, 302.00533333333334, 303.0063333333333, 304.00733333333335, 305.0083333333333, 306.00933333333336, 307.01033333333334, 308.0113333333333, 309.01233333333334, 310.0133333333333, 311.01433333333335, 312.01533333333333, 313.0163333333333, 314.00065, 315.00165, 316.00265, 317.00365, 318.00465, 319.00565, 320.00665, 321.00765, 322.00865, 323.00965, 324.01065], "recent_frames_sha256": "02225df7460de6707e48ee2de6230b94f6673e941d0e4067242839bf3456c3d6", "num_recent_frames": 30, "tq": 719147.233509662, "t1": 719155.09806883, "ta": 719155.09806883, "te": 719155.485258681, "first_response_s": 7.864559167996049, "answer_total_s": 8.2517490190221, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 289, "content_group": "109aaa67a9f22dc114059da1119267d56f8ef6e68505fd7b8dcd46e89e9c60ae", "question": {"question_id": "sample_289_a1684_q0", "video_id": 289, "video_path": "./videos/sample_289_real.mp4", "annotation_index": 1684, "question_index": 0, "question": "What did the truck do just now?", "options": ["A. Approached a bend to the right on a highway.", "B. Exited the main highway and steered onto an exit lane.", "C. Entered a less busy road bordered by greenery.", "D. Passed a red car traveling at a similar pace."], "answer": "C", "time_stamp_s": 493, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_289_a1684_q0", "video_id": 289, "time_stamp_s": 493, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5201be49c63d773811cc87b45a8b58683c2f08bca0cfcd69be72a37777a6f3eb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [463.01618333333334, 464.0005, 465.0015, 466.0025, 467.0035, 468.0045, 469.0055, 470.0065, 471.0075, 472.0085, 473.0095, 474.0105, 475.0115, 476.0125, 477.0135, 478.0145, 479.0155, 480.0165, 481.00081666666665, 482.0018166666667, 483.00281666666666, 484.0038166666667, 485.00481666666667, 486.00581666666665, 487.0068166666667, 488.00781666666666, 489.0088166666667, 490.00981666666667, 491.01081666666664, 492.0118166666667], "recent_frames_sha256": "f59c258ece62686d38bb944713b47e03a57915922c4ba1c3dbda6954e5c091a2", "num_recent_frames": 30, "tq": 718998.386275133, "t1": 719006.390497056, "ta": 719006.390497056, "te": 719006.428503736, "first_response_s": 8.00422192295082, "answer_total_s": 8.042228603037074, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_289_a1684_q0", "video_id": 289, "time_stamp_s": 493, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b5bdf7a667b852f77b196d27d5b3892c5ed8d16bcba535b8e839e4b442061e7c", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Player character stands near a blue car in an open area, facing away from camera.  \n- Several NPCs walk past the player, including one in a green vest and another in a brown shirt.  \n- A smartphone interface is visible on the right side of the screen, showing app icons and a time display of 19:30.\n[120-150s] - Player character in yellow vest interacts with masked NPC near brick wall, then moves toward industrial area.  \n- On-screen phone displays time changing from 11:22 to 11:27, showing app icons and notifications.  \n- Game UI shows \"Trolling Progression\" menu with six purchasable items, each with price and description.\n[150-180s] - A black van drives forward on a paved road, passing through an industrial area with shipping containers and cranes.  \n- The van's rear is visible, showing a dark, boxy shape with no visible markings or lights.  \n- The game's HUD displays a speedometer, map, and chat window with player messages on the right side of the screen.\n[180-210s] - Player drives a brown van on a multi-lane highway, passing other vehicles and approaching a large red bridge.  \n- The van's speed fluctuates between 50-60 mph as it navigates the road, with a map and speedometer visible in the UI.  \n- A \"EXIT\" sign and \"US 395\" highway marker are visible ahead, indicating an upcoming exit or route change.\n[210-240s] - A dark-colored van drives along a multi-lane road with train tracks running parallel to the road, passing other vehicles and urban infrastructure.  \n- The van continues forward, crossing a bridge with palm trees and distant buildings visible, maintaining a steady speed.  \n- The game's HUD displays a speedometer, map, and chat window with viewer messages, indicating an active live stream.\n[240-270s] - A black box-like object is mounted on the roof of a vehicle, moving forward on a paved road.  \n- The vehicle navigates through a suburban area with palm trees, traffic lights, and commercial buildings.  \n- A small inset screen in the top-left corner shows a person wearing headphones, seemingly observing the gameplay.\n[270-300s] - Player drives a black van through urban streets, passing under bridges and near palm trees.  \n- A large black speaker is mounted on the van’s roof, visible throughout the drive.  \n- The game’s HUD shows a map, speedometer, and player stats, with chat messages scrolling on the right.\n[300-330s] - Player drives a black van through a city street, passing cars and buildings.  \n- A traffic light cycles from green to red as the van approaches an intersection.  \n- The van continues forward, navigating through a crosswalk and onto a different road.\n[330-360s] - Player drives a large gray truck through a city street, passing traffic and buildings.  \n- At 3:52, the player stops near a building with a \"Coca-Cola\" sign, then exits the truck.  \n- The player opens an inventory screen showing a character model and various items.\n[360-390s] - Player character approaches a dark gray van, then opens its side door to interact with it.  \n- The player character is wearing a yellow safety vest and stands beside the van on a city street.  \n- The van is parked on a sidewalk near traffic, with cars passing by in the background.\n[390-420s] - A black van with a large brown cargo box drives through city streets, passing under an overpass.  \n- A black sedan is seen driving alongside the van on the right side of the road.  \n- The van continues forward, navigating through traffic and passing various urban structures and signs.\n[420-450s] - A brown speaker is positioned in the center of the road, stationary, with a digital speedometer showing 65-68 mph.\n- The game's HUD displays a map, speed, and a timer counting down from 0:27 to 0:26.\n- The environment features urban infrastructure, including overpasses and distant buildings, under clear daylight conditions.\n[450-480s] - A black, box-shaped vehicle drives steadily on a multi-lane highway under an overpass.  \n- The vehicle's speedometer shows a consistent speed around 66-68 mph.  \n- Road signs for \"Santa Monica Blvd\" and \"Santa Monica\" are visible overhead.", "history_tokens": 1003, "history_utf8_bytes": 4101, "recent_frame_times_s": [463.01618333333334, 464.0005, 465.0015, 466.0025, 467.0035, 468.0045, 469.0055, 470.0065, 471.0075, 472.0085, 473.0095, 474.0105, 475.0115, 476.0125, 477.0135, 478.0145, 479.0155, 480.0165, 481.00081666666665, 482.0018166666667, 483.00281666666666, 484.0038166666667, 485.00481666666667, 486.00581666666665, 487.0068166666667, 488.00781666666666, 489.0088166666667, 490.00981666666667, 491.01081666666664, 492.0118166666667], "recent_frames_sha256": "f59c258ece62686d38bb944713b47e03a57915922c4ba1c3dbda6954e5c091a2", "num_recent_frames": 30, "tq": 719206.703794875, "t1": 719208.500523847, "ta": 719208.500523847, "te": 719208.542483767, "first_response_s": 1.7967289719963446, "answer_total_s": 1.8386888920795172, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 289, "content_group": "109aaa67a9f22dc114059da1119267d56f8ef6e68505fd7b8dcd46e89e9c60ae", "question": {"question_id": "sample_289_a1685_q0", "video_id": 289, "video_path": "./videos/sample_289_real.mp4", "annotation_index": 1685, "question_index": 0, "question": "What is the person wearing a safety vest and headphones doing right now?", "options": ["A. Walking to the rear of the parked van.", "B. Reversing the van into the parking area.", "C. Operating the control panel.", "D. Standing quietly."], "answer": "A", "time_stamp_s": 646, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_289_a1685_q0", "video_id": 289, "time_stamp_s": 646, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d1c50ed5cec96a328ffcc3873ccd10c20658a4989489ed11ed786b733abe3582", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [616.00235, 617.00335, 618.00435, 619.00535, 620.00635, 621.00735, 622.00835, 623.00935, 624.01035, 625.01135, 626.01235, 627.01335, 628.01435, 629.01535, 630.01635, 631.0006666666667, 632.0016666666667, 633.0026666666666, 634.0036666666666, 635.0046666666667, 636.0056666666667, 637.0066666666667, 638.0076666666666, 639.0086666666666, 640.0096666666667, 641.0106666666667, 642.0116666666667, 643.0126666666666, 644.0136666666667, 645.0146666666667], "recent_frames_sha256": "2f45a90727ce34cab6803458b78115e0f9ff0e027087ca976ad7137b64320cdc", "num_recent_frames": 30, "tq": 719006.440611187, "t1": 719019.316975786, "ta": 719019.316975786, "te": 719019.355246354, "first_response_s": 12.876364598982036, "answer_total_s": 12.914635166991502, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_289_a1685_q0", "video_id": 289, "time_stamp_s": 646, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ac924fabfad294100b73931c6ea4af438525cd72515adaad75741b42e1334729", "condition_order": ["recent", "notes"], "memory": "[240-270s] - A black box-like object is mounted on the roof of a vehicle, moving forward on a paved road.  \n- The vehicle navigates through a suburban area with palm trees, traffic lights, and commercial buildings.  \n- A small inset screen in the top-left corner shows a person wearing headphones, seemingly observing the gameplay.\n[270-300s] - Player drives a black van through urban streets, passing under bridges and near palm trees.  \n- A large black speaker is mounted on the van’s roof, visible throughout the drive.  \n- The game’s HUD shows a map, speedometer, and player stats, with chat messages scrolling on the right.\n[300-330s] - Player drives a black van through a city street, passing cars and buildings.  \n- A traffic light cycles from green to red as the van approaches an intersection.  \n- The van continues forward, navigating through a crosswalk and onto a different road.\n[330-360s] - Player drives a large gray truck through a city street, passing traffic and buildings.  \n- At 3:52, the player stops near a building with a \"Coca-Cola\" sign, then exits the truck.  \n- The player opens an inventory screen showing a character model and various items.\n[360-390s] - Player character approaches a dark gray van, then opens its side door to interact with it.  \n- The player character is wearing a yellow safety vest and stands beside the van on a city street.  \n- The van is parked on a sidewalk near traffic, with cars passing by in the background.\n[390-420s] - A black van with a large brown cargo box drives through city streets, passing under an overpass.  \n- A black sedan is seen driving alongside the van on the right side of the road.  \n- The van continues forward, navigating through traffic and passing various urban structures and signs.\n[420-450s] - A brown speaker is positioned in the center of the road, stationary, with a digital speedometer showing 65-68 mph.\n- The game's HUD displays a map, speed, and a timer counting down from 0:27 to 0:26.\n- The environment features urban infrastructure, including overpasses and distant buildings, under clear daylight conditions.\n[450-480s] - A black, box-shaped vehicle drives steadily on a multi-lane highway under an overpass.  \n- The vehicle's speedometer shows a consistent speed around 66-68 mph.  \n- Road signs for \"Santa Monica Blvd\" and \"Santa Monica\" are visible overhead.\n[480-510s] - A brown van drives along a highway, passing other vehicles and approaching an intersection with traffic lights.  \n- A pedestrian in a white shirt and green vest walks across the street near a storefront, seemingly unaware of the approaching van.  \n- The van slows down as it approaches the intersection, with traffic lights changing from red to green.\n[510-540s] - Player character in white lab coat stands in front of a dark, futuristic interface displaying \"Tuning Progression\" with multiple vehicle upgrade options.  \n- A small inset window shows a live streamer with blonde hair, wearing a white hoodie, reacting to the screen.  \n- The game world outside the UI shows a street scene with a white car and a dark van parked nearby, with pedestrians walking around.\n[540-570s] - A dark van drives along a highway, passing other vehicles and approaching a city skyline.  \n- The driver's face is visible in a small inset screen, showing a person with light hair and a white shirt.  \n- A smartphone interface appears on the right side of the screen, displaying app icons and a chat window with messages.\n[570-600s] - A black box-like object is mounted on the roof of a vehicle, moving along a highway.\n- The vehicle navigates through multiple lanes, passing other cars and approaching an intersection.\n- The game's HUD displays a map, speed, and a chat window with viewer messages on the right side.\n[600-630s] - A dark-colored van drives down a city street, passing parked cars and pedestrians.  \n- The van approaches a traffic light and stops briefly before continuing forward.  \n- A yellow taxi is visible on the right side of the road, moving in the same direction as the van.", "history_tokens": 956, "history_utf8_bytes": 4052, "recent_frame_times_s": [616.00235, 617.00335, 618.00435, 619.00535, 620.00635, 621.00735, 622.00835, 623.00935, 624.01035, 625.01135, 626.01235, 627.01335, 628.01435, 629.01535, 630.01635, 631.0006666666667, 632.0016666666667, 633.0026666666666, 634.0036666666666, 635.0046666666667, 636.0056666666667, 637.0066666666667, 638.0076666666666, 639.0086666666666, 640.0096666666667, 641.0106666666667, 642.0116666666667, 643.0126666666666, 644.0136666666667, 645.0146666666667], "recent_frames_sha256": "2f45a90727ce34cab6803458b78115e0f9ff0e027087ca976ad7137b64320cdc", "num_recent_frames": 30, "tq": 719250.006846657, "t1": 719261.368619554, "ta": 719261.368619554, "te": 719261.557378473, "first_response_s": 11.36177289695479, "answer_total_s": 11.550531815970317, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 290, "content_group": "c06f6f247cd2339b6cae4d4af4add3ae409e323d73707e54242f53342e16cf81", "question": {"question_id": "sample_290_a1980_q0", "video_id": 290, "video_path": "./videos/sample_290_real.mp4", "annotation_index": 1980, "question_index": 0, "question": "What did the character do just now?", "options": ["A. Closed the door of the truck.", "B. Inspected the utility boxes.", "C. Handed the package to Harry Miller.", "D. Opened the side door of the truck and entered the truck."], "answer": "D", "time_stamp_s": 11, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_290_a1980_q0", "video_id": 290, "time_stamp_s": 11, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0f6dad63e3edb000a1b33185b5723b9f9e4d29bf92892c54ef48c373c3b369a7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.036, 1.0036333333333334, 2.0046333333333335, 3.0056333333333334, 4.006633333333333, 5.007633333333334, 6.008633333333333, 7.009633333333333, 8.010633333333333, 9.011633333333334, 10.012633333333333], "recent_frames_sha256": "4ac152a73ac56f2e62366804d69166accf62abd90941febbe13f8b7547fb4b7d", "num_recent_frames": 11, "tq": 718481.461607309, "t1": 718487.325105805, "ta": 718487.325105805, "te": 718487.363509784, "first_response_s": 5.863498496008106, "answer_total_s": 5.901902475045063, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_290_a1980_q0", "video_id": 290, "time_stamp_s": 11, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "26fad23c42749cee12001ae072362717a3422bcfe066f6c35847ec0bb230d111", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.036, 1.0036333333333334, 2.0046333333333335, 3.0056333333333334, 4.006633333333333, 5.007633333333334, 6.008633333333333, 7.009633333333333, 8.010633333333333, 9.011633333333334, 10.012633333333333], "recent_frames_sha256": "4ac152a73ac56f2e62366804d69166accf62abd90941febbe13f8b7547fb4b7d", "num_recent_frames": 11, "tq": 718314.841467722, "t1": 718328.044503436, "ta": 718328.044503436, "te": 718328.235868288, "first_response_s": 13.203035713988356, "answer_total_s": 13.394400566001423, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 290, "content_group": "c06f6f247cd2339b6cae4d4af4add3ae409e323d73707e54242f53342e16cf81", "question": {"question_id": "sample_290_a1981_q0", "video_id": 290, "video_path": "./videos/sample_290_real.mp4", "annotation_index": 1981, "question_index": 0, "question": "What is the person in the inset video doing right now?", "options": ["A. Doing nothing.", "B. Adjusting the headset.", "C. Typing on a keyboard.", "D. Reacting with expressions while speaking."], "answer": "D", "time_stamp_s": 142, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_290_a1981_q0", "video_id": 290, "time_stamp_s": 142, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "db8eb5b3a09f0912ee5ca4a53081600868139de8e067d5811172d5d790236828", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [112.01453333333333, 113.01553333333334, 114.01653333333333, 115.00085, 116.00185, 117.00285, 118.00385, 119.00485, 120.00585, 121.00685, 122.00785, 123.00885, 124.00985, 125.01085, 126.01185, 127.01285, 128.01385, 129.01485, 130.01585, 131.00016666666667, 132.00116666666668, 133.00216666666665, 134.00316666666666, 135.00416666666666, 136.00516666666667, 137.00616666666667, 138.00716666666668, 139.00816666666665, 140.00916666666666, 141.01016666666666], "recent_frames_sha256": "c54af1ad791a5d37d17db8ea64e5a1f7b5a9387a508ac35851577a366b555113", "num_recent_frames": 30, "tq": 718487.372504632, "t1": 718499.985694521, "ta": 718499.985694521, "te": 718500.026296337, "first_response_s": 12.61318988900166, "answer_total_s": 12.653791705030017, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_290_a1981_q0", "video_id": 290, "time_stamp_s": 142, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8aeeb0c7df7dbf15cd89b03494e5edccb42c969912458b8e460f69b831fc802f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player character walks toward a bald man in a white shirt, then enters a van.  \n- Van drives through a city street with palm trees and buildings, passing a red brick wall.  \n- Player character's inventory screen is briefly shown, displaying items like \"Pistol\" and \"Rifle\" in a grid layout.\n[30-60s] - A brown, boxy vehicle drives forward on a multi-lane road, passing traffic lights and street signs.  \n- The vehicle turns right at an intersection, then continues straight through a bridge area with palm trees.  \n- A blue bus and other cars are visible on the road, with the vehicle maintaining a steady speed.\n[60-90s] - A black, box-shaped object (likely a game item) is stationary on the road, facing forward, with a small white car passing by on the left.\n- The player's vehicle is positioned behind the object, moving slowly forward along the road, with the object remaining stationary.\n- The environment features industrial buildings, fences, and a bridge overhead, with the road marked by traffic lines and a yellow line on the right.\n[90-120s] - Player drives a black van on a city road, passing traffic and infrastructure.  \n- Camera shifts to first-person view inside the van, showing hands on the steering wheel and dashboard.  \n- A green glowing object is visible on the dashboard, possibly a game UI element or vehicle feature.", "history_tokens": 308, "history_utf8_bytes": 1352, "recent_frame_times_s": [112.01453333333333, 113.01553333333334, 114.01653333333333, 115.00085, 116.00185, 117.00285, 118.00385, 119.00485, 120.00585, 121.00685, 122.00785, 123.00885, 124.00985, 125.01085, 126.01185, 127.01285, 128.01385, 129.01485, 130.01585, 131.00016666666667, 132.00116666666668, 133.00216666666665, 134.00316666666666, 135.00416666666666, 136.00516666666667, 137.00616666666667, 138.00716666666668, 139.00816666666665, 140.00916666666666, 141.01016666666666], "recent_frames_sha256": "c54af1ad791a5d37d17db8ea64e5a1f7b5a9387a508ac35851577a366b555113", "num_recent_frames": 30, "tq": 718355.550406891, "t1": 718357.063801637, "ta": 718357.063801637, "te": 718357.406452712, "first_response_s": 1.5133947459980845, "answer_total_s": 1.8560458209831268, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 290, "content_group": "c06f6f247cd2339b6cae4d4af4add3ae409e323d73707e54242f53342e16cf81", "question": {"question_id": "sample_290_a1982_q0", "video_id": 290, "video_path": "./videos/sample_290_real.mp4", "annotation_index": 1982, "question_index": 0, "question": "What is the black van doing right now?", "options": ["A. Stopping at a traffic light.", "B. Making a left turn.", "C. Reversing back to the previous street.", "D. Continuing driving straight after the intersection."], "answer": "D", "time_stamp_s": 301, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_290_a1982_q0", "video_id": 290, "time_stamp_s": 301, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "231f86bf265bf761345f8c9de37e4b4e765ba31f555635ab0efb3aec0ea1339e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [271.0067, 272.0077, 273.0087, 274.0097, 275.0107, 276.0117, 277.0127, 278.0137, 279.0147, 280.0157, 281.0000166666667, 282.00101666666666, 283.0020166666667, 284.00301666666667, 285.00401666666664, 286.0050166666667, 287.00601666666665, 288.0070166666667, 289.00801666666666, 290.00901666666664, 291.0100166666667, 292.01101666666665, 293.0120166666667, 294.01301666666666, 295.0140166666667, 296.01501666666667, 297.01601666666664, 298.00033333333334, 299.0013333333333, 300.00233333333335], "recent_frames_sha256": "050ade120e8290ba226aa8128aa0fca652aaf371b6cddac6b583e8a90956f386", "num_recent_frames": 30, "tq": 718500.03734959, "t1": 718514.400814429, "ta": 718514.400814429, "te": 718514.441299104, "first_response_s": 14.363464839057997, "answer_total_s": 14.40394951403141, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_290_a1982_q0", "video_id": 290, "time_stamp_s": 301, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "59266d02d1c82b3994c2d56db0f59d5e5ca94eee7562876f009e2d344612e9d4", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player character walks toward a bald man in a white shirt, then enters a van.  \n- Van drives through a city street with palm trees and buildings, passing a red brick wall.  \n- Player character's inventory screen is briefly shown, displaying items like \"Pistol\" and \"Rifle\" in a grid layout.\n[30-60s] - A brown, boxy vehicle drives forward on a multi-lane road, passing traffic lights and street signs.  \n- The vehicle turns right at an intersection, then continues straight through a bridge area with palm trees.  \n- A blue bus and other cars are visible on the road, with the vehicle maintaining a steady speed.\n[60-90s] - A black, box-shaped object (likely a game item) is stationary on the road, facing forward, with a small white car passing by on the left.\n- The player's vehicle is positioned behind the object, moving slowly forward along the road, with the object remaining stationary.\n- The environment features industrial buildings, fences, and a bridge overhead, with the road marked by traffic lines and a yellow line on the right.\n[90-120s] - Player drives a black van on a city road, passing traffic and infrastructure.  \n- Camera shifts to first-person view inside the van, showing hands on the steering wheel and dashboard.  \n- A green glowing object is visible on the dashboard, possibly a game UI element or vehicle feature.\n[120-150s] - Player drives a large brown van on a highway, passing other vehicles and palm trees.  \n- The van's rear is visible, showing a \"GTA\" logo, as it moves along the road.  \n- The player's hands are on the steering wheel, with a green glowing button visible on the dashboard.\n[150-180s] - Player character exits truck and approaches a brick wall near a loading dock area.  \n- A second character in a white shirt stands nearby, facing the player.  \n- In-game menu opens, displaying \"Camping\" options with a list of available camping spots.\n[180-210s] - Player character runs toward a white car parked near industrial buildings, then approaches a man in a white coat standing by a brick wall.  \n- The man in the white coat is seen holding a clipboard and appears to be interacting with the player character.  \n- A \"Towing Progression\" menu is displayed on screen, showing various vehicle towing options with prices, indicating a transaction or upgrade selection.\n[210-240s] - Player character walks toward a large brown delivery van, then approaches and interacts with it.  \n- The van is later shown driving forward on a paved road, with its rear lights glowing orange.  \n- The environment features industrial structures and a setting sun, with the van moving along marked lanes.\n[240-270s] - A black truck with orange trim drives along a multi-lane highway, passing under a large steel bridge.  \n- The truck maintains a steady speed, navigating through traffic including a black sedan and a white van.  \n- The game’s HUD displays a map, speedometer, and a chat window with viewer messages on the right side of the screen.\n[270-300s] - Black box vehicle with orange trim drives along a road beside train tracks, passing cars and buildings.  \n- The vehicle veers off the road, collides with a white box truck, and flips over.  \n- After flipping, the vehicle rights itself and continues driving, with the sun setting in the background.", "history_tokens": 758, "history_utf8_bytes": 3293, "recent_frame_times_s": [271.0067, 272.0077, 273.0087, 274.0097, 275.0107, 276.0117, 277.0127, 278.0137, 279.0147, 280.0157, 281.0000166666667, 282.00101666666666, 283.0020166666667, 284.00301666666667, 285.00401666666664, 286.0050166666667, 287.00601666666665, 288.0070166666667, 289.00801666666666, 290.00901666666664, 291.0100166666667, 292.01101666666665, 293.0120166666667, 294.01301666666666, 295.0140166666667, 296.01501666666667, 297.01601666666664, 298.00033333333334, 299.0013333333333, 300.00233333333335], "recent_frames_sha256": "050ade120e8290ba226aa8128aa0fca652aaf371b6cddac6b583e8a90956f386", "num_recent_frames": 30, "tq": 718401.483805333, "t1": 718408.669609403, "ta": 718408.669609403, "te": 718408.85929898, "first_response_s": 7.185804069973528, "answer_total_s": 7.375493646948598, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 290, "content_group": "c06f6f247cd2339b6cae4d4af4add3ae409e323d73707e54242f53342e16cf81", "question": {"question_id": "sample_290_a1983_q0", "video_id": 290, "video_path": "./videos/sample_290_real.mp4", "annotation_index": 1983, "question_index": 0, "question": "What is the truck doing right now?", "options": ["A. It starting to drive back.", "B. It passing through an hospital.", "C. It parking on the mountain.", "D. It caming to a stop at the intersection."], "answer": "D", "time_stamp_s": 436, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_290_a1983_q0", "video_id": 290, "time_stamp_s": 436, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "367b3441177e1c72ae9a32e49de14468ed9639e848f7456726d289ec67fe6bf5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [406.00823333333335, 407.0092333333333, 408.01023333333336, 409.01123333333334, 410.0122333333333, 411.01323333333335, 412.0142333333333, 413.01523333333336, 414.01623333333333, 415.00055, 416.00155, 417.00255, 418.00355, 419.00455, 420.00555, 421.00655, 422.00755, 423.00855, 424.00955, 425.01055, 426.01155, 427.01255, 428.01355, 429.01455, 430.01555, 431.01655, 432.00086666666664, 433.0018666666667, 434.00286666666665, 435.0038666666667], "recent_frames_sha256": "8d5805a260666fe258cc11da3eaa7f8e3ad29919d92e2253a96b5207ea260ab2", "num_recent_frames": 30, "tq": 718514.453332081, "t1": 718521.594697035, "ta": 718521.594697035, "te": 718521.633845577, "first_response_s": 7.1413649540627375, "answer_total_s": 7.180513496045023, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_290_a1983_q0", "video_id": 290, "time_stamp_s": 436, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d7cd44400c59a8bced18c816de8970ba6ddc23c94ef715db95998c763b393b73", "condition_order": ["notes", "recent"], "memory": "[30-60s] - A brown, boxy vehicle drives forward on a multi-lane road, passing traffic lights and street signs.  \n- The vehicle turns right at an intersection, then continues straight through a bridge area with palm trees.  \n- A blue bus and other cars are visible on the road, with the vehicle maintaining a steady speed.\n[60-90s] - A black, box-shaped object (likely a game item) is stationary on the road, facing forward, with a small white car passing by on the left.\n- The player's vehicle is positioned behind the object, moving slowly forward along the road, with the object remaining stationary.\n- The environment features industrial buildings, fences, and a bridge overhead, with the road marked by traffic lines and a yellow line on the right.\n[90-120s] - Player drives a black van on a city road, passing traffic and infrastructure.  \n- Camera shifts to first-person view inside the van, showing hands on the steering wheel and dashboard.  \n- A green glowing object is visible on the dashboard, possibly a game UI element or vehicle feature.\n[120-150s] - Player drives a large brown van on a highway, passing other vehicles and palm trees.  \n- The van's rear is visible, showing a \"GTA\" logo, as it moves along the road.  \n- The player's hands are on the steering wheel, with a green glowing button visible on the dashboard.\n[150-180s] - Player character exits truck and approaches a brick wall near a loading dock area.  \n- A second character in a white shirt stands nearby, facing the player.  \n- In-game menu opens, displaying \"Camping\" options with a list of available camping spots.\n[180-210s] - Player character runs toward a white car parked near industrial buildings, then approaches a man in a white coat standing by a brick wall.  \n- The man in the white coat is seen holding a clipboard and appears to be interacting with the player character.  \n- A \"Towing Progression\" menu is displayed on screen, showing various vehicle towing options with prices, indicating a transaction or upgrade selection.\n[210-240s] - Player character walks toward a large brown delivery van, then approaches and interacts with it.  \n- The van is later shown driving forward on a paved road, with its rear lights glowing orange.  \n- The environment features industrial structures and a setting sun, with the van moving along marked lanes.\n[240-270s] - A black truck with orange trim drives along a multi-lane highway, passing under a large steel bridge.  \n- The truck maintains a steady speed, navigating through traffic including a black sedan and a white van.  \n- The game’s HUD displays a map, speedometer, and a chat window with viewer messages on the right side of the screen.\n[270-300s] - Black box vehicle with orange trim drives along a road beside train tracks, passing cars and buildings.  \n- The vehicle veers off the road, collides with a white box truck, and flips over.  \n- After flipping, the vehicle rights itself and continues driving, with the sun setting in the background.\n[300-330s] - Black delivery van with orange trim drives down city streets, passing palm trees and buildings.  \n- Player’s in-game HUD shows speed, map, and time (e.g., 0:58, 0:66, 0:67).  \n- Chat window on right displays viewer messages, including “I’m not sure if I’m in the right place.”\n[330-360s] - Player character walks toward a building entrance, passing a parked white SUV and a large white truck.  \n- A police officer in uniform stands near the building entrance, observing the player.  \n- Player opens an inventory screen, revealing health, armor, and equipped items, then exits the menu.\n[360-390s] - Player character stands beside a blue car, facing it, with a green vest and headphones visible.  \n- A large billboard with a blonde man's face is prominently displayed in the background.  \n- The game's HUD shows a map, player stats, and chat window on the right side of the screen.\n[390-420s] - Player character stands beside a blue car, facing away from camera, near a street with traffic.\n- A large brown truck passes by on the road, moving from right to left.\n- Player character opens inventory screen, revealing equipment and health stats, then exits to street.", "history_tokens": 979, "history_utf8_bytes": 4180, "recent_frame_times_s": [406.00823333333335, 407.0092333333333, 408.01023333333336, 409.01123333333334, 410.0122333333333, 411.01323333333335, 412.0142333333333, 413.01523333333336, 414.01623333333333, 415.00055, 416.00155, 417.00255, 418.00355, 419.00455, 420.00555, 421.00655, 422.00755, 423.00855, 424.00955, 425.01055, 426.01155, 427.01255, 428.01355, 429.01455, 430.01555, 431.01655, 432.00086666666664, 433.0018666666667, 434.00286666666665, 435.0038666666667], "recent_frames_sha256": "8d5805a260666fe258cc11da3eaa7f8e3ad29919d92e2253a96b5207ea260ab2", "num_recent_frames": 30, "tq": 718437.962657849, "t1": 718438.97332018, "ta": 718438.97332018, "te": 718439.011235954, "first_response_s": 1.010662331013009, "answer_total_s": 1.0485781050520018, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 290, "content_group": "c06f6f247cd2339b6cae4d4af4add3ae409e323d73707e54242f53342e16cf81", "question": {"question_id": "sample_290_a1984_q0", "video_id": 290, "video_path": "./videos/sample_290_real.mp4", "annotation_index": 1984, "question_index": 0, "question": "What is the character in the game doing right now?", "options": ["A. Running away from the wall.", "B. Driving a vehicle.", "C. Shooting at a target.", "D. Using his phone."], "answer": "D", "time_stamp_s": 575, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_290_a1984_q0", "video_id": 290, "time_stamp_s": 575, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ad1509f474740a60a76fec62f50f2db5ac66d94fd6a52b4ff18011f4f8895e0b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [545.0137666666667, 546.0147666666667, 547.0157666666667, 548.0000833333334, 549.0010833333333, 550.0020833333333, 551.0030833333333, 552.0040833333334, 553.0050833333333, 554.0060833333333, 555.0070833333333, 556.0080833333334, 557.0090833333334, 558.0100833333333, 559.0110833333333, 560.0120833333333, 561.0130833333334, 562.0140833333334, 563.0150833333333, 564.0160833333333, 565.0004, 566.0014, 567.0024, 568.0034, 569.0044, 570.0054, 571.0064, 572.0074, 573.0084, 574.0094], "recent_frames_sha256": "855b7acdd50701efae9b61c302833bafb9b7413ed14bfab1d2b612f30207849a", "num_recent_frames": 30, "tq": 718521.649160217, "t1": 718537.432234212, "ta": 718537.432234212, "te": 718537.471804474, "first_response_s": 15.783073995029554, "answer_total_s": 15.822644256986678, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_290_a1984_q0", "video_id": 290, "time_stamp_s": 575, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8b86d0acb8d3afc8e4fcfb141d7923e57bffe134846be94d2b6cfe8708044cfe", "condition_order": ["notes", "recent"], "memory": "[180-210s] - Player character runs toward a white car parked near industrial buildings, then approaches a man in a white coat standing by a brick wall.  \n- The man in the white coat is seen holding a clipboard and appears to be interacting with the player character.  \n- A \"Towing Progression\" menu is displayed on screen, showing various vehicle towing options with prices, indicating a transaction or upgrade selection.\n[210-240s] - Player character walks toward a large brown delivery van, then approaches and interacts with it.  \n- The van is later shown driving forward on a paved road, with its rear lights glowing orange.  \n- The environment features industrial structures and a setting sun, with the van moving along marked lanes.\n[240-270s] - A black truck with orange trim drives along a multi-lane highway, passing under a large steel bridge.  \n- The truck maintains a steady speed, navigating through traffic including a black sedan and a white van.  \n- The game’s HUD displays a map, speedometer, and a chat window with viewer messages on the right side of the screen.\n[270-300s] - Black box vehicle with orange trim drives along a road beside train tracks, passing cars and buildings.  \n- The vehicle veers off the road, collides with a white box truck, and flips over.  \n- After flipping, the vehicle rights itself and continues driving, with the sun setting in the background.\n[300-330s] - Black delivery van with orange trim drives down city streets, passing palm trees and buildings.  \n- Player’s in-game HUD shows speed, map, and time (e.g., 0:58, 0:66, 0:67).  \n- Chat window on right displays viewer messages, including “I’m not sure if I’m in the right place.”\n[330-360s] - Player character walks toward a building entrance, passing a parked white SUV and a large white truck.  \n- A police officer in uniform stands near the building entrance, observing the player.  \n- Player opens an inventory screen, revealing health, armor, and equipped items, then exits the menu.\n[360-390s] - Player character stands beside a blue car, facing it, with a green vest and headphones visible.  \n- A large billboard with a blonde man's face is prominently displayed in the background.  \n- The game's HUD shows a map, player stats, and chat window on the right side of the screen.\n[390-420s] - Player character stands beside a blue car, facing away from camera, near a street with traffic.\n- A large brown truck passes by on the road, moving from right to left.\n- Player character opens inventory screen, revealing equipment and health stats, then exits to street.\n[420-450s] - Player drives a black truck with orange trim through city streets, passing traffic lights and intersections.  \n- A smartphone interface overlay shows a notification for \"New Message\" from \"Mikaela\" at 11:59 AM.  \n- The truck approaches a gas station with multiple pumps and red-and-white pillars, with a map and speedometer visible in the game UI.\n[450-480s] - Player character approaches a large brown vehicle, standing beside it with a tool in hand.  \n- A green \"Repair\" prompt appears near the vehicle, indicating an interactive option.  \n- The player character's inventory is open, showing various tools and items, including a wrench.\n[480-510s] - Player character stands beside a large brown vehicle, facing its side, with a tool in hand.  \n- In-game UI shows a list of items and a chat window with viewer messages.  \n- Player’s character model has a yellow safety vest and headphones, with a visible health bar.\n[510-540s] - Player character stands beside a large brown vehicle, holding a tool, with a \"Repair\" prompt visible on the vehicle's side.\n- In the top-left corner, a streamer with blonde hair and headphones is visible, reacting to gameplay.\n- The environment shows a gas station with pumps and orange traffic cones, and the player's inventory and health stats are displayed on-screen.\n[540-570s] - Player character, wearing safety vest and goggles, holds a phone and interacts with a wall-mounted interface near a gas pump.  \n- In-game UI shows \"Randy's Note\" and a Twitter app overlay with a \"New Post\" prompt, indicating social media interaction.  \n- Streamer in top-left corner reacts to gameplay, with chat messages scrolling on the right side of screen.", "history_tokens": 1003, "history_utf8_bytes": 4273, "recent_frame_times_s": [545.0137666666667, 546.0147666666667, 547.0157666666667, 548.0000833333334, 549.0010833333333, 550.0020833333333, 551.0030833333333, 552.0040833333334, 553.0050833333333, 554.0060833333333, 555.0070833333333, 556.0080833333334, 557.0090833333334, 558.0100833333333, 559.0110833333333, 560.0120833333333, 561.0130833333334, 562.0140833333334, 563.0150833333333, 564.0160833333333, 565.0004, 566.0014, 567.0024, 568.0034, 569.0044, 570.0054, 571.0064, 572.0074, 573.0084, 574.0094], "recent_frames_sha256": "855b7acdd50701efae9b61c302833bafb9b7413ed14bfab1d2b612f30207849a", "num_recent_frames": 30, "tq": 718479.929636923, "t1": 718481.104342625, "ta": 718481.104342625, "te": 718481.441540692, "first_response_s": 1.1747057019965723, "answer_total_s": 1.5119037689873949, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 291, "content_group": "457ed4399a66eb25ff8f84d4c29114b3341c0d032bdadf7a8c8eb0927b407c69", "question": {"question_id": "sample_291_a1363_q0", "video_id": 291, "video_path": "./videos/sample_291_real.mp4", "annotation_index": 1363, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Interacting with a parked vehicle.", "B. Walking towards a gas pump.", "C. Driving away from the gas station.", "D. Holding the nozzle at the gas pump."], "answer": "A", "time_stamp_s": 9, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_291_a1363_q0", "video_id": 291, "time_stamp_s": 9, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5bec442f5bf4feba2c8e266af5a7e5b8ec2ff9207d6c7e24b3fa592851fd453d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.024, 1.0083166666666667, 2.009316666666667, 3.0103166666666668, 4.011316666666667, 5.012316666666667, 6.013316666666666, 7.014316666666667, 8.015316666666667], "recent_frames_sha256": "ef35e1a6b1e60131dcdcb08734e2174aa00fe595095d6a65d71017f1cb351e7a", "num_recent_frames": 9, "tq": 715892.064100754, "t1": 715898.75055371, "ta": 715898.75055371, "te": 715898.787656978, "first_response_s": 6.686452956055291, "answer_total_s": 6.723556224023923, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_291_a1363_q0", "video_id": 291, "time_stamp_s": 9, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c288b6b51f3e37e05aa6f4de01b481d1368663dafd3bff6cf0b645a452fe14b7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.024, 1.0083166666666667, 2.009316666666667, 3.0103166666666668, 4.011316666666667, 5.012316666666667, 6.013316666666666, 7.014316666666667, 8.015316666666667], "recent_frames_sha256": "ef35e1a6b1e60131dcdcb08734e2174aa00fe595095d6a65d71017f1cb351e7a", "num_recent_frames": 9, "tq": 715711.709485513, "t1": 715724.98066641, "ta": 715724.98066641, "te": 715725.23956413, "first_response_s": 13.271180896903388, "answer_total_s": 13.530078616924584, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 291, "content_group": "457ed4399a66eb25ff8f84d4c29114b3341c0d032bdadf7a8c8eb0927b407c69", "question": {"question_id": "sample_291_a1364_q0", "video_id": 291, "video_path": "./videos/sample_291_real.mp4", "annotation_index": 1364, "question_index": 0, "question": "What is the person in the high-visibility vest doing right now?", "options": ["A. Turning to face the van as if preparing to move.", "B. Standing still and listening.", "C. Walking towards the metal gate.", "D. Gesturing animatedly towards the concrete walls."], "answer": "A", "time_stamp_s": 132, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_291_a1364_q0", "video_id": 291, "time_stamp_s": 132, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bb1ed58c7e1cc9435191b3d2db4799ee2dcbeb24e4d4ea3e74230c13e5b8836e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [102.00921666666666, 103.01021666666666, 104.01121666666667, 105.01221666666666, 106.01321666666666, 107.01421666666667, 108.01521666666666, 109.01621666666666, 110.00053333333334, 111.00153333333333, 112.00253333333333, 113.00353333333334, 114.00453333333333, 115.00553333333333, 116.00653333333334, 117.00753333333333, 118.00853333333333, 119.00953333333334, 120.01053333333333, 121.01153333333333, 122.01253333333334, 123.01353333333333, 124.01453333333333, 125.01553333333334, 126.01653333333333, 127.00085, 128.00185, 129.00285, 130.00385, 131.00485], "recent_frames_sha256": "af3f5c5d344f27a5af170223c6320d46aeec1be168032434663a2e8ae947b554", "num_recent_frames": 30, "tq": 715898.802034764, "t1": 715905.066947566, "ta": 715905.066947566, "te": 715905.104406866, "first_response_s": 6.264912802027538, "answer_total_s": 6.302372102043591, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_291_a1364_q0", "video_id": 291, "time_stamp_s": 132, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "11898b2ddc8283d9222ee0fb8e929806595001779953d5fa761bd1b95749cdc8", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player character in green vest stands at gas pump, then walks toward a dark vehicle parked nearby.  \n- Player drives a black car with orange-lit rear, navigating city streets past traffic signs and buildings.  \n- On-screen UI shows map, chat, and player stats; a red \"CASH\" icon appears on road ahead.\n[30-60s] - Black vehicle with orange glowing rear panel drives through city streets, passing traffic lights and palm trees.  \n- Player navigates under an overpass, then exits into a wider road with multiple lanes and distant buildings.  \n- Vehicle continues forward, maintaining speed as it approaches a highway intersection with visible road signs.\n[60-90s] - Black delivery box with orange glowing edges moves forward on city streets, passing traffic lights and crosswalks.  \n- Player’s minimap in bottom-left corner shows route and location, with speedometer indicating 85+ mph.  \n- Right-side chat window displays viewer messages and reactions, including emojis and text comments.\n[90-120s] - Player's van is maneuvered into a garage with red clearance barriers, then positioned under a yellow \"MAX. CLEARANCE\" sign.  \n- Player exits the van, approaches a large black box, and opens its inventory to view equipped gear and health stats.  \n- Inventory screen displays character stats, equipped items, and a list of available gear, with the player selecting a \"Tactical\" item.", "history_tokens": 309, "history_utf8_bytes": 1392, "recent_frame_times_s": [102.00921666666666, 103.01021666666666, 104.01121666666667, 105.01221666666666, 106.01321666666666, 107.01421666666667, 108.01521666666666, 109.01621666666666, 110.00053333333334, 111.00153333333333, 112.00253333333333, 113.00353333333334, 114.00453333333333, 115.00553333333333, 116.00653333333334, 117.00753333333333, 118.00853333333333, 119.00953333333334, 120.01053333333333, 121.01153333333333, 122.01253333333334, 123.01353333333333, 124.01453333333333, 125.01553333333334, 126.01653333333333, 127.00085, 128.00185, 129.00285, 130.00385, 131.00485], "recent_frames_sha256": "af3f5c5d344f27a5af170223c6320d46aeec1be168032434663a2e8ae947b554", "num_recent_frames": 30, "tq": 715758.653708588, "t1": 715765.932281693, "ta": 715765.932281693, "te": 715766.303399792, "first_response_s": 7.278573104995303, "answer_total_s": 7.64969120407477, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 291, "content_group": "457ed4399a66eb25ff8f84d4c29114b3341c0d032bdadf7a8c8eb0927b407c69", "question": {"question_id": "sample_291_a1365_q0", "video_id": 291, "video_path": "./videos/sample_291_real.mp4", "annotation_index": 1365, "question_index": 0, "question": "What is the player doing right now?", "options": ["A. Moving the vehicle slowly forward.", "B. Turning the vehicle sharply.", "C. Speeding up rapidly.", "D. Stopping the vehicle completely."], "answer": "A", "time_stamp_s": 265, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_291_a1365_q0", "video_id": 291, "time_stamp_s": 265, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7cbec2d1783bb378cb058ca3a10b9454caaafac9ee1d56b2337695389ce85ffe", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [235.00875, 236.00975, 237.01075, 238.01175, 239.01275, 240.01375, 241.01475, 242.01575, 243.00006666666667, 244.00106666666667, 245.00206666666668, 246.00306666666665, 247.00406666666666, 248.00506666666666, 249.00606666666667, 250.00706666666667, 251.00806666666668, 252.00906666666666, 253.01006666666666, 254.01106666666666, 255.01206666666667, 256.01306666666665, 257.0140666666667, 258.01506666666666, 259.0160666666667, 260.00038333333333, 261.0013833333333, 262.00238333333334, 263.0033833333333, 264.00438333333335], "recent_frames_sha256": "9ae4d6cc388a74ea27e8a934a2b952ada29a3abe4e8ff33dfc8bf6e56455ffdc", "num_recent_frames": 30, "tq": 715905.11715243, "t1": 715912.482594413, "ta": 715912.482594413, "te": 715912.519277332, "first_response_s": 7.3654419829836115, "answer_total_s": 7.402124902000651, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_291_a1365_q0", "video_id": 291, "time_stamp_s": 265, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6432b0d27a99115488980f2b2a00e81360cc5f7d2675592c27912fd71434c76e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Player character in green vest stands at gas pump, then walks toward a dark vehicle parked nearby.  \n- Player drives a black car with orange-lit rear, navigating city streets past traffic signs and buildings.  \n- On-screen UI shows map, chat, and player stats; a red \"CASH\" icon appears on road ahead.\n[30-60s] - Black vehicle with orange glowing rear panel drives through city streets, passing traffic lights and palm trees.  \n- Player navigates under an overpass, then exits into a wider road with multiple lanes and distant buildings.  \n- Vehicle continues forward, maintaining speed as it approaches a highway intersection with visible road signs.\n[60-90s] - Black delivery box with orange glowing edges moves forward on city streets, passing traffic lights and crosswalks.  \n- Player’s minimap in bottom-left corner shows route and location, with speedometer indicating 85+ mph.  \n- Right-side chat window displays viewer messages and reactions, including emojis and text comments.\n[90-120s] - Player's van is maneuvered into a garage with red clearance barriers, then positioned under a yellow \"MAX. CLEARANCE\" sign.  \n- Player exits the van, approaches a large black box, and opens its inventory to view equipped gear and health stats.  \n- Inventory screen displays character stats, equipped items, and a list of available gear, with the player selecting a \"Tactical\" item.\n[120-150s] - Player character in yellow vest stands near a wall, facing two other characters.  \n- One character in a dark hoodie walks past the player, then stops to face them.  \n- A third character in a white shirt and dark pants stands behind the player, partially obscured.\n[150-180s] - Player character in reflective vest walks toward a black van, then enters it.  \n- Van drives through city streets, passing traffic lights and buildings, with orange glowing rear lights.  \n- Game UI shows map, speed, and chat messages; player’s face is visible in top-left corner.\n[180-210s] - A black vehicle with glowing orange edges drives forward on a city street, passing traffic lights and palm trees.  \n- The vehicle approaches a bridge, then continues along a road with visible lane markings and traffic signs.  \n- A small map in the bottom left corner shows the vehicle’s route, with a speedometer indicating increasing speed.\n[210-240s] - A black vehicle with glowing orange edges drives forward on a snowy road, passing under an overpass.  \n- The vehicle's speed fluctuates between 872 and 876 mph, as shown on the in-game speedometer.  \n- The game's HUD displays a map, chat messages, and a timer, while the streamer's face is visible in a small window.", "history_tokens": 610, "history_utf8_bytes": 2651, "recent_frame_times_s": [235.00875, 236.00975, 237.01075, 238.01175, 239.01275, 240.01375, 241.01475, 242.01575, 243.00006666666667, 244.00106666666667, 245.00206666666668, 246.00306666666665, 247.00406666666666, 248.00506666666666, 249.00606666666667, 250.00706666666667, 251.00806666666668, 252.00906666666666, 253.01006666666666, 254.01106666666666, 255.01206666666667, 256.01306666666665, 257.0140666666667, 258.01506666666666, 259.0160666666667, 260.00038333333333, 261.0013833333333, 262.00238333333334, 263.0033833333333, 264.00438333333335], "recent_frames_sha256": "9ae4d6cc388a74ea27e8a934a2b952ada29a3abe4e8ff33dfc8bf6e56455ffdc", "num_recent_frames": 30, "tq": 715796.74828897, "t1": 715804.318693306, "ta": 715804.318693306, "te": 715804.508195709, "first_response_s": 7.570404335972853, "answer_total_s": 7.759906738996506, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 291, "content_group": "457ed4399a66eb25ff8f84d4c29114b3341c0d032bdadf7a8c8eb0927b407c69", "question": {"question_id": "sample_291_a1366_q0", "video_id": 291, "video_path": "./videos/sample_291_real.mp4", "annotation_index": 1366, "question_index": 0, "question": "What is the viewer doing right now?", "options": ["A. Interacting with an interface.", "B. Running towards a van.", "C. Standing next to a group of people.", "D. Observing the postal worker."], "answer": "A", "time_stamp_s": 434, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_291_a1366_q0", "video_id": 291, "time_stamp_s": 434, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "32a0e5a99fce742ee74f550855ace4372b3b40182942ccad60777ff166a4306f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [404.0109166666667, 405.01191666666665, 406.0129166666667, 407.01391666666666, 408.0149166666667, 409.01591666666667, 410.0002333333333, 411.00123333333335, 412.0022333333333, 413.00323333333336, 414.00423333333333, 415.0052333333333, 416.00623333333334, 417.0072333333333, 418.00823333333335, 419.0092333333333, 420.01023333333336, 421.01123333333334, 422.0122333333333, 423.01323333333335, 424.0142333333333, 425.01523333333336, 426.01623333333333, 427.00055, 428.00155, 429.00255, 430.00355, 431.00455, 432.00555, 433.00655], "recent_frames_sha256": "591521c7ee6cd2cbc0f463d8a0e205f156ad2e1bee33f717e09f75520a590562", "num_recent_frames": 30, "tq": 715912.5301394, "t1": 715923.331123032, "ta": 715923.331123032, "te": 715923.368685668, "first_response_s": 10.8009836319834, "answer_total_s": 10.838546267943457, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_291_a1366_q0", "video_id": 291, "time_stamp_s": 434, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dc867a0c161149f26079bd19e8fa8d9f5786f912d2389ef86c82a341fe94114f", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Black delivery box with orange glowing edges moves forward on city streets, passing traffic lights and crosswalks.  \n- Player’s minimap in bottom-left corner shows route and location, with speedometer indicating 85+ mph.  \n- Right-side chat window displays viewer messages and reactions, including emojis and text comments.\n[90-120s] - Player's van is maneuvered into a garage with red clearance barriers, then positioned under a yellow \"MAX. CLEARANCE\" sign.  \n- Player exits the van, approaches a large black box, and opens its inventory to view equipped gear and health stats.  \n- Inventory screen displays character stats, equipped items, and a list of available gear, with the player selecting a \"Tactical\" item.\n[120-150s] - Player character in yellow vest stands near a wall, facing two other characters.  \n- One character in a dark hoodie walks past the player, then stops to face them.  \n- A third character in a white shirt and dark pants stands behind the player, partially obscured.\n[150-180s] - Player character in reflective vest walks toward a black van, then enters it.  \n- Van drives through city streets, passing traffic lights and buildings, with orange glowing rear lights.  \n- Game UI shows map, speed, and chat messages; player’s face is visible in top-left corner.\n[180-210s] - A black vehicle with glowing orange edges drives forward on a city street, passing traffic lights and palm trees.  \n- The vehicle approaches a bridge, then continues along a road with visible lane markings and traffic signs.  \n- A small map in the bottom left corner shows the vehicle’s route, with a speedometer indicating increasing speed.\n[210-240s] - A black vehicle with glowing orange edges drives forward on a snowy road, passing under an overpass.  \n- The vehicle's speed fluctuates between 872 and 876 mph, as shown on the in-game speedometer.  \n- The game's HUD displays a map, chat messages, and a timer, while the streamer's face is visible in a small window.\n[240-270s] - A black vehicle with glowing orange accents drives through a city street at dusk, passing buildings and traffic lights.  \n- The player’s in-game map and speedometer are visible in the bottom-left corner, showing a speed of 876 mph.  \n- A chat window appears on the right side of the screen, displaying viewer messages and notifications.\n[270-300s] - Player drives a vehicle on a highway at dusk, with a red traffic light ahead.  \n- A smartphone interface appears on the right, showing a messaging app and later switching to a calculator.  \n- The game's HUD displays a speedometer reading around 80-90 mph and a map in the bottom-left corner.\n[300-330s] - A black vehicle with glowing orange edges is stationary on a highway at dusk, facing forward.\n- The game's HUD displays a speedometer reading 0 mph and a map in the bottom-left corner.\n- A mobile phone interface appears on the right side of the screen, showing a calculator and later switching to a messaging app.\n[330-360s] - A black vehicle with glowing orange lights drives on a multi-lane highway at dusk, passing under a \"PORT AUTHORITY\" sign.  \n- The game's HUD displays a speedometer reading around 60-70 mph and a mini-map in the bottom-left corner.  \n- A smartphone interface on the right shows a calculator with \"2025.00\" and a \"Calculate\" button, suggesting a financial or in-game calculation.\n[360-390s] - Player drives a black truck with orange glowing rear lights on a highway at dusk, passing other vehicles.\n- A smartphone interface appears on the right, showing a chat window with messages and a \"New Message\" input field.\n- The game's HUD displays a map, speedometer, and a list of players or objectives on the right side of the screen.\n[390-420s] - A black truck with orange glowing edges drives on a highway at dusk, passing other vehicles including a white van and a red car.  \n- The truck enters a curved road leading to an industrial area with warehouses and buildings, where pedestrians are visible near a red car.  \n- The game’s UI shows a mini-map, speedometer, and player stats, with a chat log on the right side of the screen.", "history_tokens": 978, "history_utf8_bytes": 4116, "recent_frame_times_s": [404.0109166666667, 405.01191666666665, 406.0129166666667, 407.01391666666666, 408.0149166666667, 409.01591666666667, 410.0002333333333, 411.00123333333335, 412.0022333333333, 413.00323333333336, 414.00423333333333, 415.0052333333333, 416.00623333333334, 417.0072333333333, 418.00823333333335, 419.0092333333333, 420.01023333333336, 421.01123333333334, 422.0122333333333, 423.01323333333335, 424.0142333333333, 425.01523333333336, 426.01623333333333, 427.00055, 428.00155, 429.00255, 430.00355, 431.00455, 432.00555, 433.00655], "recent_frames_sha256": "591521c7ee6cd2cbc0f463d8a0e205f156ad2e1bee33f717e09f75520a590562", "num_recent_frames": 30, "tq": 715855.2917734, "t1": 715856.085932479, "ta": 715856.085932479, "te": 715856.123458362, "first_response_s": 0.7941590789705515, "answer_total_s": 0.8316849619150162, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 291, "content_group": "457ed4399a66eb25ff8f84d4c29114b3341c0d032bdadf7a8c8eb0927b407c69", "question": {"question_id": "sample_291_a1367_q0", "video_id": 291, "video_path": "./videos/sample_291_real.mp4", "annotation_index": 1367, "question_index": 0, "question": "What is the car doing right now?", "options": ["A. Driving around on the roads at night.", "B. Making a U-turn.", "C. Stopping at a crosswalk.", "D. Reversing into a parking spot."], "answer": "A", "time_stamp_s": 548, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_291_a1367_q0", "video_id": 291, "time_stamp_s": 548, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0463fb3b761bcbc48e6810004203ca61c1727e15fb1bd7013d3268b890d1bb21", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [518.0081333333334, 519.0091333333334, 520.0101333333333, 521.0111333333333, 522.0121333333333, 523.0131333333334, 524.0141333333333, 525.0151333333333, 526.0161333333333, 527.00045, 528.00145, 529.00245, 530.00345, 531.00445, 532.00545, 533.00645, 534.00745, 535.00845, 536.00945, 537.01045, 538.01145, 539.01245, 540.01345, 541.01445, 542.01545, 543.01645, 544.0007666666667, 545.0017666666666, 546.0027666666666, 547.0037666666667], "recent_frames_sha256": "c5d88ac2684958b0b22cf5abbf3055737b42f27d8a7c9f00db1d5b435d4f15d3", "num_recent_frames": 30, "tq": 715923.38047535, "t1": 715930.639161457, "ta": 715930.639161457, "te": 715930.676759459, "first_response_s": 7.258686107001267, "answer_total_s": 7.296284109004773, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_291_a1367_q0", "video_id": 291, "time_stamp_s": 548, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8fb4596caaf84a2c331410602426cf8f1a84f0e1b97d955c7ecc9d6f308b87a5", "condition_order": ["notes", "recent"], "memory": "[180-210s] - A black vehicle with glowing orange edges drives forward on a city street, passing traffic lights and palm trees.  \n- The vehicle approaches a bridge, then continues along a road with visible lane markings and traffic signs.  \n- A small map in the bottom left corner shows the vehicle’s route, with a speedometer indicating increasing speed.\n[210-240s] - A black vehicle with glowing orange edges drives forward on a snowy road, passing under an overpass.  \n- The vehicle's speed fluctuates between 872 and 876 mph, as shown on the in-game speedometer.  \n- The game's HUD displays a map, chat messages, and a timer, while the streamer's face is visible in a small window.\n[240-270s] - A black vehicle with glowing orange accents drives through a city street at dusk, passing buildings and traffic lights.  \n- The player’s in-game map and speedometer are visible in the bottom-left corner, showing a speed of 876 mph.  \n- A chat window appears on the right side of the screen, displaying viewer messages and notifications.\n[270-300s] - Player drives a vehicle on a highway at dusk, with a red traffic light ahead.  \n- A smartphone interface appears on the right, showing a messaging app and later switching to a calculator.  \n- The game's HUD displays a speedometer reading around 80-90 mph and a map in the bottom-left corner.\n[300-330s] - A black vehicle with glowing orange edges is stationary on a highway at dusk, facing forward.\n- The game's HUD displays a speedometer reading 0 mph and a map in the bottom-left corner.\n- A mobile phone interface appears on the right side of the screen, showing a calculator and later switching to a messaging app.\n[330-360s] - A black vehicle with glowing orange lights drives on a multi-lane highway at dusk, passing under a \"PORT AUTHORITY\" sign.  \n- The game's HUD displays a speedometer reading around 60-70 mph and a mini-map in the bottom-left corner.  \n- A smartphone interface on the right shows a calculator with \"2025.00\" and a \"Calculate\" button, suggesting a financial or in-game calculation.\n[360-390s] - Player drives a black truck with orange glowing rear lights on a highway at dusk, passing other vehicles.\n- A smartphone interface appears on the right, showing a chat window with messages and a \"New Message\" input field.\n- The game's HUD displays a map, speedometer, and a list of players or objectives on the right side of the screen.\n[390-420s] - A black truck with orange glowing edges drives on a highway at dusk, passing other vehicles including a white van and a red car.  \n- The truck enters a curved road leading to an industrial area with warehouses and buildings, where pedestrians are visible near a red car.  \n- The game’s UI shows a mini-map, speedometer, and player stats, with a chat log on the right side of the screen.\n[420-450s] - Player character approaches a brick wall where a man in a blue cap stands, holding a phone.  \n- The player opens a phone interface, then navigates to a \"Trucking Progression\" menu showing various truck upgrade options.  \n- After viewing the menu, the player exits the interface and walks toward a blue car parked near industrial structures.\n[450-480s] - Blue car drives on highway at dusk, speed fluctuating between 89 and 90 mph.\n- Game UI shows speedometer, mini-map, and chat messages on right side.\n- Road transitions from urban streets to highway with bridge overhead.\n[480-510s] - Blue car drives on wet city street, speed decreasing as it approaches a corner.\n- Player's HUD shows speedometer reading around 80-90 mph, with a mini-map and chat overlay visible.\n- Cityscape with buildings and streetlights in background, indicating evening or night setting.\n[510-540s] - Blue car drives through an industrial area, passing gates and containers, with brake lights illuminated.  \n- Player’s in-game HUD shows speedometer reading around 83 mph and a mini-map in the bottom-left corner.  \n- Chat window on the right displays active viewer messages, including “BRO” and “WOW” reactions.", "history_tokens": 970, "history_utf8_bytes": 4024, "recent_frame_times_s": [518.0081333333334, 519.0091333333334, 520.0101333333333, 521.0111333333333, 522.0121333333333, 523.0131333333334, 524.0141333333333, 525.0151333333333, 526.0161333333333, 527.00045, 528.00145, 529.00245, 530.00345, 531.00445, 532.00545, 533.00645, 534.00745, 535.00845, 536.00945, 537.01045, 538.01145, 539.01245, 540.01345, 541.01445, 542.01545, 543.01645, 544.0007666666667, 545.0017666666666, 546.0027666666666, 547.0037666666667], "recent_frames_sha256": "c5d88ac2684958b0b22cf5abbf3055737b42f27d8a7c9f00db1d5b435d4f15d3", "num_recent_frames": 30, "tq": 715890.040447045, "t1": 715891.64618968, "ta": 715891.64618968, "te": 715892.024500763, "first_response_s": 1.6057426349725574, "answer_total_s": 1.98405371804256, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 292, "content_group": "849063677946663156bcb1b02d0e0c3557e7a69b3be619f9373ea3333a7972e8", "question": {"question_id": "sample_292_a1188_q0", "video_id": 292, "video_path": "./videos/sample_292_real.mp4", "annotation_index": 1188, "question_index": 0, "question": "What is the blue car doing right now?", "options": ["A. Turning at an intersection.", "B. Driving down a busy street.", "C. Parked and waiting.", "D. Speeding through a residential area."], "answer": "C", "time_stamp_s": 19, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_292_a1188_q0", "video_id": 292, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "02b496ae9a82a22e59a48e6310b56018ab1972f0f468387a85a25ce5c51efc21", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.02, 1.0043166666666667, 2.005316666666667, 3.0063166666666667, 4.007316666666667, 5.0083166666666665, 6.009316666666667, 7.010316666666666, 8.011316666666668, 9.012316666666667, 10.013316666666666, 11.014316666666666, 12.015316666666667, 13.016316666666667, 14.000633333333333, 15.001633333333332, 16.002633333333332, 17.003633333333333, 18.004633333333334], "recent_frames_sha256": "c9fa23de810ade0d886bacd05dae878a00293407b75300d8a4ad3bc8026b9883", "num_recent_frames": 19, "tq": 715745.463244574, "t1": 715753.04296662, "ta": 715753.04296662, "te": 715753.080506796, "first_response_s": 7.579722045920789, "answer_total_s": 7.617262221989222, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_292_a1188_q0", "video_id": 292, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2204a1a8ef4ad04cb7c4f780ad01f780253f1136cff6491031e9c78b650b50e3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.02, 1.0043166666666667, 2.005316666666667, 3.0063166666666667, 4.007316666666667, 5.0083166666666665, 6.009316666666667, 7.010316666666666, 8.011316666666668, 9.012316666666667, 10.013316666666666, 11.014316666666666, 12.015316666666667, 13.016316666666667, 14.000633333333333, 15.001633333333332, 16.002633333333332, 17.003633333333333, 18.004633333333334], "recent_frames_sha256": "c9fa23de810ade0d886bacd05dae878a00293407b75300d8a4ad3bc8026b9883", "num_recent_frames": 19, "tq": 715797.776581124, "t1": 715804.318693306, "ta": 715804.318693306, "te": 715804.508195709, "first_response_s": 6.542112181894481, "answer_total_s": 6.731614584918134, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 292, "content_group": "849063677946663156bcb1b02d0e0c3557e7a69b3be619f9373ea3333a7972e8", "question": {"question_id": "sample_292_a1189_q0", "video_id": 292, "video_path": "./videos/sample_292_real.mp4", "annotation_index": 1189, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Browsing his personal account from the interface.", "B. Typing a comment in the chat feed.", "C. Closing the account interface.", "D. Logging out of the personal account."], "answer": "A", "time_stamp_s": 180, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_292_a1189_q0", "video_id": 292, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "299fb48773429be459726711401398401310cf71b149c3f9ebcd86f334735587", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.00316666666666, 151.00416666666666, 152.00516666666667, 153.00616666666667, 154.00716666666668, 155.00816666666665, 156.00916666666666, 157.01016666666666, 158.01116666666667, 159.01216666666667, 160.01316666666668, 161.01416666666665, 162.01516666666666, 163.01616666666666, 164.00048333333334, 165.00148333333334, 166.00248333333334, 167.00348333333332, 168.00448333333333, 169.00548333333333, 170.00648333333334, 171.00748333333334, 172.00848333333334, 173.00948333333332, 174.01048333333333, 175.01148333333333, 176.01248333333334, 177.01348333333334, 178.01448333333335, 179.01548333333332], "recent_frames_sha256": "b5f578a11f1977efaabb640cf48a5367a2fa6ad031f584ae07c0b7d96fbca6ea", "num_recent_frames": 30, "tq": 715753.096135664, "t1": 715766.972670728, "ta": 715766.972670728, "te": 715767.010104876, "first_response_s": 13.876535063958727, "answer_total_s": 13.913969211978838, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_292_a1189_q0", "video_id": 292, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "387c13ced6e19b75a57a1ca266ee336d31f97c7bbe159078cad30a9de54dae34", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Blue car drives through city streets at night, slowing down near a gray sedan parked on the side.  \n- Gray sedan remains stationary while the blue car approaches, then stops beside it.  \n- Game UI elements show speedometer, map, and chat messages, with a player's face visible in a webcam feed.\n[30-60s] - Blue car drives past a gray sedan, then veers left onto a street with visible traffic lights and crosswalks.\n- Gray sedan is parked on the right side of the road, stationary, while the blue car moves forward.\n- Camera angle shifts to a third-person view behind the blue car as it navigates the street, with a building labeled \"LAMBERT'S\" visible ahead.\n[60-90s] - Blue car drives past a white car parked on the side of the road, then veers left onto a street with palm trees and buildings.  \n- A chat window opens on the right side of the screen, displaying messages and user interactions.  \n- The game's minimap and speedometer remain visible in the bottom left corner, showing the car's position and speed.\n[90-120s] - A blue car is stationary on a street at night, with its rear lights illuminated.  \n- A character in a yellow vest approaches the car, then interacts with a circular object on the pavement.  \n- The character walks toward the blue car, which then begins to move forward as the camera follows.\n[120-150s] - Blue car stops at a gas station, then drives away after refueling.\n- Player character exits the car and walks into a convenience store, browsing shelves.\n- Store interior shows various products on shelves, with a counter and cashier visible.\n[150-180s] - Player character stands near ATM in store, facing screen with \"Banking\" interface.  \n- Banking menu displays \"Personal Account\" with multiple account options and balances.  \n- Player hovers cursor over \"Personal Account\" and then selects \"Banking\" option.", "history_tokens": 434, "history_utf8_bytes": 1851, "recent_frame_times_s": [150.00316666666666, 151.00416666666666, 152.00516666666667, 153.00616666666667, 154.00716666666668, 155.00816666666665, 156.00916666666666, 157.01016666666666, 158.01116666666667, 159.01216666666667, 160.01316666666668, 161.01416666666665, 162.01516666666666, 163.01616666666666, 164.00048333333334, 165.00148333333334, 166.00248333333334, 167.00348333333332, 168.00448333333333, 169.00548333333333, 170.00648333333334, 171.00748333333334, 172.00848333333334, 173.00948333333332, 174.01048333333333, 175.01148333333333, 176.01248333333334, 177.01348333333334, 178.01448333333335, 179.01548333333332], "recent_frames_sha256": "b5f578a11f1977efaabb640cf48a5367a2fa6ad031f584ae07c0b7d96fbca6ea", "num_recent_frames": 30, "tq": 715860.738401348, "t1": 715866.719221053, "ta": 715866.719221053, "te": 715866.904577165, "first_response_s": 5.980819704942405, "answer_total_s": 6.166175817023031, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 292, "content_group": "849063677946663156bcb1b02d0e0c3557e7a69b3be619f9373ea3333a7972e8", "question": {"question_id": "sample_292_a1190_q0", "video_id": 292, "video_path": "./videos/sample_292_real.mp4", "annotation_index": 1190, "question_index": 0, "question": "What is the driver doing right now?", "options": ["A. Turning off the car.", "B. Parking near a gas station.", "C. Driving through dark city streets.", "D. Entering a brightly lit store."], "answer": "C", "time_stamp_s": 380, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_292_a1190_q0", "video_id": 292, "time_stamp_s": 380, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9e26ff6ed816ab45d237f616841c22c7877709ba4715112aa181d5c43f9dfebf", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [350.0029666666667, 351.00396666666666, 352.0049666666667, 353.00596666666667, 354.00696666666664, 355.0079666666667, 356.00896666666665, 357.0099666666667, 358.01096666666666, 359.0119666666667, 360.01296666666667, 361.01396666666665, 362.0149666666667, 363.01596666666666, 364.00028333333336, 365.00128333333333, 366.0022833333333, 367.00328333333334, 368.0042833333333, 369.00528333333335, 370.00628333333333, 371.0072833333333, 372.00828333333334, 373.0092833333333, 374.01028333333335, 375.0112833333333, 376.01228333333336, 377.01328333333333, 378.0142833333333, 379.01528333333334], "recent_frames_sha256": "6998529e4e6548cd157d06fa7f7afe7ead81883de0418bf4fc1fda9905fbbc3f", "num_recent_frames": 30, "tq": 715767.021607467, "t1": 715779.333556684, "ta": 715779.333556684, "te": 715779.371204333, "first_response_s": 12.311949216993526, "answer_total_s": 12.349596866057254, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_292_a1190_q0", "video_id": 292, "time_stamp_s": 380, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b9676081c15221e43d43bb0c70e18f25795db92a2ee6cdef1f88ac74bf26672b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Blue car drives through city streets at night, slowing down near a gray sedan parked on the side.  \n- Gray sedan remains stationary while the blue car approaches, then stops beside it.  \n- Game UI elements show speedometer, map, and chat messages, with a player's face visible in a webcam feed.\n[30-60s] - Blue car drives past a gray sedan, then veers left onto a street with visible traffic lights and crosswalks.\n- Gray sedan is parked on the right side of the road, stationary, while the blue car moves forward.\n- Camera angle shifts to a third-person view behind the blue car as it navigates the street, with a building labeled \"LAMBERT'S\" visible ahead.\n[60-90s] - Blue car drives past a white car parked on the side of the road, then veers left onto a street with palm trees and buildings.  \n- A chat window opens on the right side of the screen, displaying messages and user interactions.  \n- The game's minimap and speedometer remain visible in the bottom left corner, showing the car's position and speed.\n[90-120s] - A blue car is stationary on a street at night, with its rear lights illuminated.  \n- A character in a yellow vest approaches the car, then interacts with a circular object on the pavement.  \n- The character walks toward the blue car, which then begins to move forward as the camera follows.\n[120-150s] - Blue car stops at a gas station, then drives away after refueling.\n- Player character exits the car and walks into a convenience store, browsing shelves.\n- Store interior shows various products on shelves, with a counter and cashier visible.\n[150-180s] - Player character stands near ATM in store, facing screen with \"Banking\" interface.  \n- Banking menu displays \"Personal Account\" with multiple account options and balances.  \n- Player hovers cursor over \"Personal Account\" and then selects \"Banking\" option.\n[180-210s] - Player character exits a convenience store, carrying a backpack, and walks toward a blue car parked at a gas station.  \n- The blue car is positioned at a gas pump, with its driver-side door open, suggesting the player is preparing to enter or has just exited.  \n- The player drives the blue car away from the gas station, navigating through city streets at night, with traffic lights and street signs visible.\n[210-240s] - Blue car drives through city streets at night, passing traffic lights and buildings.  \n- Player’s minimap shows route toward a marked destination, with a purple icon indicating target location.  \n- Chat window displays viewer messages, including “I’m not sure if I’m in the right place.”\n[240-270s] - Blue car parked outside \"Suds Law Laundry\" at 02:40, then drives into the laundromat at 02:43.\n- Player character enters laundromat, approaches a man in a dark shirt and jeans near a pipe at 02:45.\n- Player character walks through laundromat interior, passing washing machines and a blue shopping cart at 02:50.\n[270-300s] - Player character approaches a vending machine near a counter with a man in a suit standing beside it.  \n- Player selects \"Dollar Store\" from a menu, then exits the building toward a blue car parked outside.  \n- Blue car is positioned near a \"Dollar Plus\" store at night, with streetlights and a \"Exit\" sign visible.\n[300-330s] - Blue car drives through city streets at night, passing traffic lights and palm trees.  \n- Player’s in-game speed fluctuates between 80–90 mph as they navigate intersections.  \n- Chat window and messages panel remain visible on right side of screen, with viewer interactions scrolling.\n[330-360s] - Blue car drives through a city street at night, passing a \"STOP\" sign and traffic lights.\n- Player's minimap and speedometer show the car's movement and current speed.\n- A large billboard with a blonde woman's image is visible on the left side of the road.", "history_tokens": 917, "history_utf8_bytes": 3811, "recent_frame_times_s": [350.0029666666667, 351.00396666666666, 352.0049666666667, 353.00596666666667, 354.00696666666664, 355.0079666666667, 356.00896666666665, 357.0099666666667, 358.01096666666666, 359.0119666666667, 360.01296666666667, 361.01396666666665, 362.0149666666667, 363.01596666666666, 364.00028333333336, 365.00128333333333, 366.0022833333333, 367.00328333333334, 368.0042833333333, 369.00528333333335, 370.00628333333333, 371.0072833333333, 372.00828333333334, 373.0092833333333, 374.01028333333335, 375.0112833333333, 376.01228333333336, 377.01328333333333, 378.0142833333333, 379.01528333333334], "recent_frames_sha256": "6998529e4e6548cd157d06fa7f7afe7ead81883de0418bf4fc1fda9905fbbc3f", "num_recent_frames": 30, "tq": 715916.737351226, "t1": 715917.492745164, "ta": 715917.492745164, "te": 715917.864602596, "first_response_s": 0.7553939379286021, "answer_total_s": 1.127251369995065, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 292, "content_group": "849063677946663156bcb1b02d0e0c3557e7a69b3be619f9373ea3333a7972e8", "question": {"question_id": "sample_292_a1191_q0", "video_id": 292, "video_path": "./videos/sample_292_real.mp4", "annotation_index": 1191, "question_index": 0, "question": "What did the person driving the car just do?", "options": ["A. Turned right at the intersection.", "B. Stopped at a traffic light.", "C. Turned left at the intersection.", "D. Keep going straight on the road."], "answer": "D", "time_stamp_s": 500, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_292_a1191_q0", "video_id": 292, "time_stamp_s": 500, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "47c0a36666610db3de0baa3ea6e7dd1f32da2eec20ae4acfe510cc2235cdb3ae", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [470.00618333333335, 471.00718333333333, 472.0081833333333, 473.00918333333334, 474.0101833333333, 475.01118333333335, 476.0121833333333, 477.01318333333336, 478.01418333333334, 479.0151833333333, 480.01618333333334, 481.0005, 482.0015, 483.0025, 484.0035, 485.0045, 486.0055, 487.0065, 488.0075, 489.0085, 490.0095, 491.0105, 492.0115, 493.0125, 494.0135, 495.0145, 496.0155, 497.0165, 498.00081666666665, 499.0018166666667], "recent_frames_sha256": "00fc8679006e808dc81e58edd2ed986a19d6d22f736c850ed5b035ecc6e15e91", "num_recent_frames": 30, "tq": 715779.383202891, "t1": 715786.569495165, "ta": 715786.569495165, "te": 715786.792541095, "first_response_s": 7.18629227404017, "answer_total_s": 7.40933820407372, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_292_a1191_q0", "video_id": 292, "time_stamp_s": 500, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c1efc8d79eb0c0df2deb4da8ee5cc2c103bdd99f5bf341cd9237cb3d3f962f9b", "condition_order": ["recent", "notes"], "memory": "[90-120s] - A blue car is stationary on a street at night, with its rear lights illuminated.  \n- A character in a yellow vest approaches the car, then interacts with a circular object on the pavement.  \n- The character walks toward the blue car, which then begins to move forward as the camera follows.\n[120-150s] - Blue car stops at a gas station, then drives away after refueling.\n- Player character exits the car and walks into a convenience store, browsing shelves.\n- Store interior shows various products on shelves, with a counter and cashier visible.\n[150-180s] - Player character stands near ATM in store, facing screen with \"Banking\" interface.  \n- Banking menu displays \"Personal Account\" with multiple account options and balances.  \n- Player hovers cursor over \"Personal Account\" and then selects \"Banking\" option.\n[180-210s] - Player character exits a convenience store, carrying a backpack, and walks toward a blue car parked at a gas station.  \n- The blue car is positioned at a gas pump, with its driver-side door open, suggesting the player is preparing to enter or has just exited.  \n- The player drives the blue car away from the gas station, navigating through city streets at night, with traffic lights and street signs visible.\n[210-240s] - Blue car drives through city streets at night, passing traffic lights and buildings.  \n- Player’s minimap shows route toward a marked destination, with a purple icon indicating target location.  \n- Chat window displays viewer messages, including “I’m not sure if I’m in the right place.”\n[240-270s] - Blue car parked outside \"Suds Law Laundry\" at 02:40, then drives into the laundromat at 02:43.\n- Player character enters laundromat, approaches a man in a dark shirt and jeans near a pipe at 02:45.\n- Player character walks through laundromat interior, passing washing machines and a blue shopping cart at 02:50.\n[270-300s] - Player character approaches a vending machine near a counter with a man in a suit standing beside it.  \n- Player selects \"Dollar Store\" from a menu, then exits the building toward a blue car parked outside.  \n- Blue car is positioned near a \"Dollar Plus\" store at night, with streetlights and a \"Exit\" sign visible.\n[300-330s] - Blue car drives through city streets at night, passing traffic lights and palm trees.  \n- Player’s in-game speed fluctuates between 80–90 mph as they navigate intersections.  \n- Chat window and messages panel remain visible on right side of screen, with viewer interactions scrolling.\n[330-360s] - Blue car drives through a city street at night, passing a \"STOP\" sign and traffic lights.\n- Player's minimap and speedometer show the car's movement and current speed.\n- A large billboard with a blonde woman's image is visible on the left side of the road.\n[360-390s] - Blue car drives through city streets at night, passing billboards and intersections.  \n- Player’s in-game speed fluctuates between 80-90 mph as they navigate traffic.  \n- On-screen UI shows map, speedometer, and chat messages; a phone interface is visible on the right.\n[390-420s] - Blue car drives through city streets at night, passing intersections and traffic lights.\n- Player’s speed fluctuates between 85–90 mph as they navigate turns and straightaways.\n- A pedestrian appears on the sidewalk, briefly crossing the street ahead of the car.\n[420-450s] - Blue car stops at intersection; traffic light turns red, then green.\n- Two male characters approach the car; one wears a yellow vest, the other dark clothing.\n- A phone interface appears on screen, showing a \"Call\" option for \"Carter\" with a \"Call\" button.\n[450-480s] - Two male characters stand beside a blue car on a city street at night, one wearing a vest and the other in dark clothing.  \n- The player character (in vest) turns toward the car, then walks toward it as the camera follows.  \n- A red building with \"INDOOR SHOOTING RANGE\" signage is visible in the background, with city lights illuminating the scene.", "history_tokens": 972, "history_utf8_bytes": 3984, "recent_frame_times_s": [470.00618333333335, 471.00718333333333, 472.0081833333333, 473.00918333333334, 474.0101833333333, 475.01118333333335, 476.0121833333333, 477.01318333333336, 478.01418333333334, 479.0151833333333, 480.01618333333334, 481.0005, 482.0015, 483.0025, 484.0035, 485.0045, 486.0055, 487.0065, 488.0075, 489.0085, 490.0095, 491.0105, 492.0115, 493.0125, 494.0135, 495.0145, 496.0155, 497.0165, 498.00081666666665, 499.0018166666667], "recent_frames_sha256": "00fc8679006e808dc81e58edd2ed986a19d6d22f736c850ed5b035ecc6e15e91", "num_recent_frames": 30, "tq": 715947.186983235, "t1": 715954.376440917, "ta": 715954.376440917, "te": 715954.413194926, "first_response_s": 7.189457682077773, "answer_total_s": 7.226211691042408, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 292, "content_group": "849063677946663156bcb1b02d0e0c3557e7a69b3be619f9373ea3333a7972e8", "question": {"question_id": "sample_292_a1192_q0", "video_id": 292, "video_path": "./videos/sample_292_real.mp4", "annotation_index": 1192, "question_index": 0, "question": "What did the two individuals do just now?", "options": ["A. Had a face-to-face conversation while standing.", "B. Adjust their headphones.", "C. Pick up a backpack from the shelf.", "D. Remove their vest."], "answer": "A", "time_stamp_s": 610, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_292_a1192_q0", "video_id": 292, "time_stamp_s": 610, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "26e5c751deb7c24b1a109a1fa51da07414429dd0237fdd2d200a2fd6c4a1500a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [580.0160833333333, 581.0004, 582.0014, 583.0024, 584.0034, 585.0044, 586.0054, 587.0064, 588.0074, 589.0084, 590.0094, 591.0104, 592.0114, 593.0124, 594.0134, 595.0144, 596.0154, 597.0164, 598.0007166666667, 599.0017166666667, 600.0027166666666, 601.0037166666667, 602.0047166666667, 603.0057166666667, 604.0067166666666, 605.0077166666666, 606.0087166666667, 607.0097166666667, 608.0107166666667, 609.0117166666666], "recent_frames_sha256": "a11cabd7bb6ac8af66749e41268d921ea971265ed87fe62fc77daa186a9e2524", "num_recent_frames": 30, "tq": 715786.806678416, "t1": 715797.541124161, "ta": 715797.541124161, "te": 715797.761999278, "first_response_s": 10.734445745008998, "answer_total_s": 10.955320862005465, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_292_a1192_q0", "video_id": 292, "time_stamp_s": 610, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "492c929535028ba43565a3699bfcefd6a305901296ff8dc0a459308a09e97c77", "condition_order": ["recent", "notes"], "memory": "[210-240s] - Blue car drives through city streets at night, passing traffic lights and buildings.  \n- Player’s minimap shows route toward a marked destination, with a purple icon indicating target location.  \n- Chat window displays viewer messages, including “I’m not sure if I’m in the right place.”\n[240-270s] - Blue car parked outside \"Suds Law Laundry\" at 02:40, then drives into the laundromat at 02:43.\n- Player character enters laundromat, approaches a man in a dark shirt and jeans near a pipe at 02:45.\n- Player character walks through laundromat interior, passing washing machines and a blue shopping cart at 02:50.\n[270-300s] - Player character approaches a vending machine near a counter with a man in a suit standing beside it.  \n- Player selects \"Dollar Store\" from a menu, then exits the building toward a blue car parked outside.  \n- Blue car is positioned near a \"Dollar Plus\" store at night, with streetlights and a \"Exit\" sign visible.\n[300-330s] - Blue car drives through city streets at night, passing traffic lights and palm trees.  \n- Player’s in-game speed fluctuates between 80–90 mph as they navigate intersections.  \n- Chat window and messages panel remain visible on right side of screen, with viewer interactions scrolling.\n[330-360s] - Blue car drives through a city street at night, passing a \"STOP\" sign and traffic lights.\n- Player's minimap and speedometer show the car's movement and current speed.\n- A large billboard with a blonde woman's image is visible on the left side of the road.\n[360-390s] - Blue car drives through city streets at night, passing billboards and intersections.  \n- Player’s in-game speed fluctuates between 80-90 mph as they navigate traffic.  \n- On-screen UI shows map, speedometer, and chat messages; a phone interface is visible on the right.\n[390-420s] - Blue car drives through city streets at night, passing intersections and traffic lights.\n- Player’s speed fluctuates between 85–90 mph as they navigate turns and straightaways.\n- A pedestrian appears on the sidewalk, briefly crossing the street ahead of the car.\n[420-450s] - Blue car stops at intersection; traffic light turns red, then green.\n- Two male characters approach the car; one wears a yellow vest, the other dark clothing.\n- A phone interface appears on screen, showing a \"Call\" option for \"Carter\" with a \"Call\" button.\n[450-480s] - Two male characters stand beside a blue car on a city street at night, one wearing a vest and the other in dark clothing.  \n- The player character (in vest) turns toward the car, then walks toward it as the camera follows.  \n- A red building with \"INDOOR SHOOTING RANGE\" signage is visible in the background, with city lights illuminating the scene.\n[480-510s] - Blue car drives through city streets at night, passing traffic lights and buildings.  \n- Driver is visible in the car, steering through intersections.  \n- Game UI shows speed, map, and chat messages on screen.\n[510-540s] - Blue car accelerates on city street at night, passing traffic lights and billboards.  \n- Player character exits car and walks briefly before re-entering.  \n- Game UI shows speedometer, map, and chat messages on right side.\n[540-570s] - Player character in reflective vest stands near glass display cases in a store, facing a male NPC in dark clothing.  \n- Store interior features illuminated shelves with various items, an American flag, and a \"THANKS FOR VISITING\" sign above a door.  \n- Player character remains stationary, observing the NPC who is also stationary, with no visible interaction or movement between them.\n[570-600s] - Player character in green vest stands facing a store clerk near display cases.  \n- Store clerk in dark shirt gestures toward red double doors marked \"THANKS FOR\".  \n- Background shows \"THANKS FOR VISITING\" sign and \"Burger King\" poster on wall.", "history_tokens": 955, "history_utf8_bytes": 3850, "recent_frame_times_s": [580.0160833333333, 581.0004, 582.0014, 583.0024, 584.0034, 585.0044, 586.0054, 587.0064, 588.0074, 589.0084, 590.0094, 591.0104, 592.0114, 593.0124, 594.0134, 595.0144, 596.0154, 597.0164, 598.0007166666667, 599.0017166666667, 600.0027166666666, 601.0037166666667, 602.0047166666667, 603.0057166666667, 604.0067166666666, 605.0077166666666, 606.0087166666667, 607.0097166666667, 608.0107166666667, 609.0117166666666], "recent_frames_sha256": "a11cabd7bb6ac8af66749e41268d921ea971265ed87fe62fc77daa186a9e2524", "num_recent_frames": 30, "tq": 715983.089572747, "t1": 715989.214514814, "ta": 715989.214514814, "te": 715989.252077882, "first_response_s": 6.124942066962831, "answer_total_s": 6.162505134940147, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 293, "content_group": "fb785866696fd34ba3857721e54b8a0fd8d98db44ce0cc48f7cc2f9433acf8d3", "question": {"question_id": "sample_293_a846_q0", "video_id": 293, "video_path": "./videos/sample_293_real.mp4", "annotation_index": 846, "question_index": 0, "question": "What is the both persons doing right now?", "options": ["A. Looking at the display cases.", "B. Having a face-to-face conversation while standing.", "C. Walking towards the exit.", "D. Talking on the phone."], "answer": "B", "time_stamp_s": 20, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_293_a846_q0", "video_id": 293, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3e225e4a3fba01911109e5ba93a223abd68cf88d7bb99203187f159c76e81555", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.028, 1.0123166666666668, 2.013316666666667, 3.0143166666666668, 4.015316666666667, 5.0163166666666665, 6.000633333333333, 7.001633333333333, 8.002633333333334, 9.003633333333333, 10.004633333333333, 11.005633333333334, 12.006633333333333, 13.007633333333333, 14.008633333333334, 15.009633333333333, 16.010633333333335, 17.011633333333332, 18.012633333333333, 19.013633333333335], "recent_frames_sha256": "f010cba363f430894aaf81ac583b7bead08a4f34a83af977ddc3fe7ca22a379f", "num_recent_frames": 20, "tq": 717278.563239582, "t1": 717279.333213535, "ta": 717279.333213535, "te": 717279.375132819, "first_response_s": 0.7699739530216902, "answer_total_s": 0.8118932370562106, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_293_a846_q0", "video_id": 293, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "878df394c5dad52290993b9d1c0bfbaf89eb9f144efe8c028c516132cdc40339", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.028, 1.0123166666666668, 2.013316666666667, 3.0143166666666668, 4.015316666666667, 5.0163166666666665, 6.000633333333333, 7.001633333333333, 8.002633333333334, 9.003633333333333, 10.004633333333333, 11.005633333333334, 12.006633333333333, 13.007633333333333, 14.008633333333334, 15.009633333333333, 16.010633333333335, 17.011633333333332, 18.012633333333333, 19.013633333333335], "recent_frames_sha256": "f010cba363f430894aaf81ac583b7bead08a4f34a83af977ddc3fe7ca22a379f", "num_recent_frames": 20, "tq": 716996.943980349, "t1": 717008.796485214, "ta": 717008.796485214, "te": 717008.836404277, "first_response_s": 11.852504865033552, "answer_total_s": 11.892423928016797, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 293, "content_group": "fb785866696fd34ba3857721e54b8a0fd8d98db44ce0cc48f7cc2f9433acf8d3", "question": {"question_id": "sample_293_a847_q0", "video_id": 293, "video_path": "./videos/sample_293_real.mp4", "annotation_index": 847, "question_index": 0, "question": "What is the car doing right now?", "options": ["A. Driving straight through a major intersection.", "B. Turning left onto a side road.", "C. Keep going straight on the road.", "D. Stopping at a stop sign."], "answer": "C", "time_stamp_s": 210, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_293_a847_q0", "video_id": 293, "time_stamp_s": 210, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0dd81c6c09029ba4907326d9cce8e890c8daab4cb5938b0b9a045ae235615b57", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [180.0078, 181.0088, 182.0098, 183.0108, 184.0118, 185.0128, 186.0138, 187.0148, 188.0158, 189.00011666666666, 190.00111666666666, 191.00211666666667, 192.00311666666667, 193.00411666666668, 194.00511666666668, 195.00611666666666, 196.00711666666666, 197.00811666666667, 198.00911666666667, 199.01011666666668, 200.01111666666668, 201.01211666666666, 202.01311666666666, 203.01411666666667, 204.01511666666667, 205.01611666666668, 206.00043333333332, 207.00143333333332, 208.00243333333333, 209.00343333333333], "recent_frames_sha256": "1b3e42c644dcae307d88bf2604734ac6e40368b3d20a571a33a25c7a01ea2af9", "num_recent_frames": 30, "tq": 717279.391944324, "t1": 717291.871459546, "ta": 717291.871459546, "te": 717291.910299144, "first_response_s": 12.479515222017653, "answer_total_s": 12.518354819971137, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_293_a847_q0", "video_id": 293, "time_stamp_s": 210, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "da97e2685c49ab52044622683587b1435def91b4c3bb5d45603c0b3de2db68a6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A player character in a yellow vest stands facing another character in a dark shirt, both stationary in a gun shop with shelves of firearms and a \"THANKS FOR VISITING\" sign visible.  \n- The streamer in the top-left corner is wearing a white hoodie and appears to be speaking or reacting to the game.  \n- A red vending machine labeled \"E\" is visible on the right side of the shop, near the American flag and a wall-mounted gun display.\n[30-60s] - Player character in green vest stands facing a store clerk near display cases.  \n- Store clerk in black shirt and cap stands still, facing the player, with a red \"THANKS FOR\" sign visible behind them.  \n- A small inset video shows a person in a white hoodie holding a book or tablet, with a chat log visible on the right side of the screen.\n[60-90s] - Player in green vest stands near display cases, facing another player in black shirt.  \n- Store interior features illuminated shelves with firearms and a \"THANKS FOR VISITING\" sign on the wall.  \n- On-screen UI shows player stats, chat, and a phone interface with app icons visible.\n[90-120s] - Player in green vest stands near display cases, facing a man in black attire who appears to be interacting with the environment.  \n- The setting is a dimly lit store with illuminated shelves, featuring various items and a \"Thanks for Shopping\" sign on the wall.  \n- A red vending machine labeled \"Burger King\" is visible to the right, with a small screen showing a cartoon character.\n[120-150s] - Player character stands in a store with \"THINGS FOR VETERANS\" sign, facing a counter with weapons displayed.  \n- Player interacts with a weapon display, then opens a menu showing four weapon options (knife, baton, pistol, and rifle) with stats.  \n- Player's inventory screen is visible, showing selected weapon options and a \"Buy\" button, indicating a purchase action.\n[150-180s] - Player character exits a store, walking toward a red door marked \"WARNING FOR\" before stepping outside into a dark urban street.  \n- A blue car is parked nearby, and the player approaches it, then drives away from the store area.  \n- The player's vehicle accelerates on a highway at night, with city lights visible in the background.\n[180-210s] - Blue car drives through city streets at night, slowing down near a \"STOP\" sign.\n- Player's in-game speed fluctuates between 85 to 84 mph as they navigate intersections.\n- Game UI shows map, speedometer, and chat messages on right side of screen.", "history_tokens": 591, "history_utf8_bytes": 2474, "recent_frame_times_s": [180.0078, 181.0088, 182.0098, 183.0108, 184.0118, 185.0128, 186.0138, 187.0148, 188.0158, 189.00011666666666, 190.00111666666666, 191.00211666666667, 192.00311666666667, 193.00411666666668, 194.00511666666668, 195.00611666666666, 196.00711666666666, 197.00811666666667, 198.00911666666667, 199.01011666666668, 200.01111666666668, 201.01211666666666, 202.01311666666666, 203.01411666666667, 204.01511666666667, 205.01611666666668, 206.00043333333332, 207.00143333333332, 208.00243333333333, 209.00343333333333], "recent_frames_sha256": "1b3e42c644dcae307d88bf2604734ac6e40368b3d20a571a33a25c7a01ea2af9", "num_recent_frames": 30, "tq": 717071.697461097, "t1": 717078.828524628, "ta": 717078.828524628, "te": 717078.867377077, "first_response_s": 7.131063530920073, "answer_total_s": 7.169915979960933, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 293, "content_group": "fb785866696fd34ba3857721e54b8a0fd8d98db44ce0cc48f7cc2f9433acf8d3", "question": {"question_id": "sample_293_a848_q0", "video_id": 293, "video_path": "./videos/sample_293_real.mp4", "annotation_index": 848, "question_index": 0, "question": "What did the walker do just now?", "options": ["A. Adjusted the car's mirror.", "B. Walked past the blue car.", "C. Opened the passenger door and entered the car.", "D. Signaled another car to stop."], "answer": "C", "time_stamp_s": 414, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_293_a848_q0", "video_id": 293, "time_stamp_s": 414, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ccc63190fb38c24591bfc674336007b03c98acf699e6e34e47a02be987b86a9a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [384.0116, 385.0126, 386.0136, 387.0146, 388.0156, 389.0166, 390.0009166666667, 391.00191666666666, 392.0029166666667, 393.00391666666667, 394.00491666666665, 395.0059166666667, 396.00691666666665, 397.0079166666667, 398.00891666666666, 399.00991666666664, 400.0109166666667, 401.01191666666665, 402.0129166666667, 403.01391666666666, 404.0149166666667, 405.01591666666667, 406.0002333333333, 407.00123333333335, 408.0022333333333, 409.00323333333336, 410.00423333333333, 411.0052333333333, 412.00623333333334, 413.0072333333333], "recent_frames_sha256": "202b1eb052735c798b545a0e016328c187b49403c27e6a38f0d9990f82987cba", "num_recent_frames": 30, "tq": 717291.926027108, "t1": 717304.977129097, "ta": 717304.977129097, "te": 717305.016537565, "first_response_s": 13.051101988996379, "answer_total_s": 13.090510457055643, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_293_a848_q0", "video_id": 293, "time_stamp_s": 414, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c1a95d8e7f7f5db4dc4e05d05500280984731e8c64c310e7ef521161b40e08ca", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Player character in green vest stands facing a store clerk near display cases.  \n- Store clerk in black shirt and cap stands still, facing the player, with a red \"THANKS FOR\" sign visible behind them.  \n- A small inset video shows a person in a white hoodie holding a book or tablet, with a chat log visible on the right side of the screen.\n[60-90s] - Player in green vest stands near display cases, facing another player in black shirt.  \n- Store interior features illuminated shelves with firearms and a \"THANKS FOR VISITING\" sign on the wall.  \n- On-screen UI shows player stats, chat, and a phone interface with app icons visible.\n[90-120s] - Player in green vest stands near display cases, facing a man in black attire who appears to be interacting with the environment.  \n- The setting is a dimly lit store with illuminated shelves, featuring various items and a \"Thanks for Shopping\" sign on the wall.  \n- A red vending machine labeled \"Burger King\" is visible to the right, with a small screen showing a cartoon character.\n[120-150s] - Player character stands in a store with \"THINGS FOR VETERANS\" sign, facing a counter with weapons displayed.  \n- Player interacts with a weapon display, then opens a menu showing four weapon options (knife, baton, pistol, and rifle) with stats.  \n- Player's inventory screen is visible, showing selected weapon options and a \"Buy\" button, indicating a purchase action.\n[150-180s] - Player character exits a store, walking toward a red door marked \"WARNING FOR\" before stepping outside into a dark urban street.  \n- A blue car is parked nearby, and the player approaches it, then drives away from the store area.  \n- The player's vehicle accelerates on a highway at night, with city lights visible in the background.\n[180-210s] - Blue car drives through city streets at night, slowing down near a \"STOP\" sign.\n- Player's in-game speed fluctuates between 85 to 84 mph as they navigate intersections.\n- Game UI shows map, speedometer, and chat messages on right side of screen.\n[210-240s] - Blue car drives through city streets at night, headlights illuminating road ahead.\n- Player's avatar, wearing white hoodie and headphones, watches gameplay in top-left corner.\n- Game UI shows speedometer, map, and chat messages on right side of screen.\n[240-270s] - A child character in a striped shirt approaches a dark circular hole on the ground, then stands beside an adult male character.  \n- The adult male character, wearing a black shirt and pants, stands nearby, facing the child.  \n- The scene transitions to a nighttime street with a blue car parked nearby and a black car approaching from the distance.\n[270-300s] - Two characters stand on a sidewalk at night, facing away from the camera, near a blue car parked on the street.  \n- The character on the left wears a green vest and has blonde hair, while the one on the right is in a black shirt and cap.  \n- A chat window with viewer messages is visible on the right side of the screen, and a webcam feed of a streamer is in the top-left corner.\n[300-330s] - Two in-game characters stand on a sidewalk at night, facing away from the camera, with one wearing a green vest and the other in a black shirt.  \n- A blue car is parked on the street behind them, and a building with illuminated windows is visible in the background.  \n- The game’s UI displays a chat log on the right and a minimap in the top-right corner, with a clock showing 20:16 in the bottom-right.\n[330-360s] - Streamer in webcam view wears headphones and looks toward screen, reacting to game events.  \n- Two in-game characters stand on sidewalk, facing away from camera, near a blue car and streetlamp.  \n- Game UI shows chat messages, player stats, and a phone interface overlay with app icons.\n[360-390s] - Two male characters stand on a sidewalk at night; one wears a green vest, the other a black shirt, facing each other.  \n- The character in the black shirt gestures toward the ground, then walks away slightly while the other remains stationary.  \n- A \"24\" sign is visible on a nearby building, and the environment features streetlights and distant neon signs.", "history_tokens": 988, "history_utf8_bytes": 4141, "recent_frame_times_s": [384.0116, 385.0126, 386.0136, 387.0146, 388.0156, 389.0166, 390.0009166666667, 391.00191666666666, 392.0029166666667, 393.00391666666667, 394.00491666666665, 395.0059166666667, 396.00691666666665, 397.0079166666667, 398.00891666666666, 399.00991666666664, 400.0109166666667, 401.01191666666665, 402.0129166666667, 403.01391666666666, 404.0149166666667, 405.01591666666667, 406.0002333333333, 407.00123333333335, 408.0022333333333, 409.00323333333336, 410.00423333333333, 411.0052333333333, 412.00623333333334, 413.0072333333333], "recent_frames_sha256": "202b1eb052735c798b545a0e016328c187b49403c27e6a38f0d9990f82987cba", "num_recent_frames": 30, "tq": 717132.549217708, "t1": 717134.685649512, "ta": 717134.685649512, "te": 717134.996370567, "first_response_s": 2.136431804043241, "answer_total_s": 2.4471528590656817, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 293, "content_group": "fb785866696fd34ba3857721e54b8a0fd8d98db44ce0cc48f7cc2f9433acf8d3", "question": {"question_id": "sample_293_a849_q0", "video_id": 293, "video_path": "./videos/sample_293_real.mp4", "annotation_index": 849, "question_index": 0, "question": "What is the person in the pink attire doing right now?", "options": ["A. Looking downwards.", "B. Making a gesture.", "C. Moving slightly.", "D. Standing still."], "answer": "D", "time_stamp_s": 620, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_293_a849_q0", "video_id": 293, "time_stamp_s": 620, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "954e8a701ee1123730eb4e1f28805a42f66ee1c7ae42675004c749ca1f10ba00", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [590.0007166666667, 591.0017166666667, 592.0027166666666, 593.0037166666667, 594.0047166666667, 595.0057166666667, 596.0067166666666, 597.0077166666666, 598.0087166666667, 599.0097166666667, 600.0107166666667, 601.0117166666666, 602.0127166666666, 603.0137166666667, 604.0147166666667, 605.0157166666667, 606.0000333333334, 607.0010333333333, 608.0020333333333, 609.0030333333333, 610.0040333333334, 611.0050333333334, 612.0060333333333, 613.0070333333333, 614.0080333333333, 615.0090333333334, 616.0100333333334, 617.0110333333333, 618.0120333333333, 619.0130333333333], "recent_frames_sha256": "db0ceb6185b016202264956619abb737bfe53467c9673a5e5f857f7566921dde", "num_recent_frames": 30, "tq": 717305.037720553, "t1": 717317.766935945, "ta": 717317.766935945, "te": 717317.804536252, "first_response_s": 12.729215392027982, "answer_total_s": 12.76681569905486, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_293_a849_q0", "video_id": 293, "time_stamp_s": 620, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4d5f1a37e6ed3559e2e81a6a247dfb95217c093b98f5120d03c20c40ee12899d", "condition_order": ["notes", "recent"], "memory": "[210-240s] - Blue car drives through city streets at night, headlights illuminating road ahead.\n- Player's avatar, wearing white hoodie and headphones, watches gameplay in top-left corner.\n- Game UI shows speedometer, map, and chat messages on right side of screen.\n[240-270s] - A child character in a striped shirt approaches a dark circular hole on the ground, then stands beside an adult male character.  \n- The adult male character, wearing a black shirt and pants, stands nearby, facing the child.  \n- The scene transitions to a nighttime street with a blue car parked nearby and a black car approaching from the distance.\n[270-300s] - Two characters stand on a sidewalk at night, facing away from the camera, near a blue car parked on the street.  \n- The character on the left wears a green vest and has blonde hair, while the one on the right is in a black shirt and cap.  \n- A chat window with viewer messages is visible on the right side of the screen, and a webcam feed of a streamer is in the top-left corner.\n[300-330s] - Two in-game characters stand on a sidewalk at night, facing away from the camera, with one wearing a green vest and the other in a black shirt.  \n- A blue car is parked on the street behind them, and a building with illuminated windows is visible in the background.  \n- The game’s UI displays a chat log on the right and a minimap in the top-right corner, with a clock showing 20:16 in the bottom-right.\n[330-360s] - Streamer in webcam view wears headphones and looks toward screen, reacting to game events.  \n- Two in-game characters stand on sidewalk, facing away from camera, near a blue car and streetlamp.  \n- Game UI shows chat messages, player stats, and a phone interface overlay with app icons.\n[360-390s] - Two male characters stand on a sidewalk at night; one wears a green vest, the other a black shirt, facing each other.  \n- The character in the black shirt gestures toward the ground, then walks away slightly while the other remains stationary.  \n- A \"24\" sign is visible on a nearby building, and the environment features streetlights and distant neon signs.\n[390-420s] - Player in yellow vest gets into blue car, then drives away from sidewalk.  \n- Player in black shirt remains standing on sidewalk as blue car departs.  \n- Game UI shows speedometer and map, with chat window visible on right side.\n[420-450s] - Blue car accelerates on a wet road at night, passing traffic lights and intersections.\n- Player's in-game speedometer shows increasing speed from 84 to 100 mph.\n- \"MAX WIN!\" text appears on screen, indicating a race completion or achievement.\n[450-480s] - Blue car drives through city streets at night, speed fluctuating between 85–90 mph.\n- Player’s HUD shows map, speed, and a chat log with viewer messages.\n- Car passes intersections and turns, with streetlights and buildings visible in background.\n[480-510s] - Blue car drives on highway at night, speed fluctuating between 118-97 mph.\n- Player's webcam shows a person with headphones, looking at screen.\n- Game UI displays speedometer, map, and leaderboard with player names and scores.\n[510-540s] - Player character in yellow vest walks toward a damaged blue car, then approaches a group of NPCs near a yellow truck.  \n- A player in a blue jersey with \"DING\" and number 28 walks past the group, moving toward the right side of the screen.  \n- The camera pans slightly to follow the player in the yellow vest as they move toward a parked white car, with other characters visible in the background.\n[540-570s] - A player character in a yellow vest stands near a white car, facing a group of pedestrians.  \n- A female character in a pink outfit walks toward the player character, approaching from the right.  \n- The player character turns to face the female character, initiating interaction as the camera angle shifts slightly.\n[570-600s] - A player character in a yellow vest stands near a blue car, facing two female characters.  \n- One female character in a pink outfit is positioned to the right of the blue car, while another in a black outfit stands behind her.  \n- The player character’s UI shows a red circle with a green arrow icon, indicating an interactive option.", "history_tokens": 1004, "history_utf8_bytes": 4203, "recent_frame_times_s": [590.0007166666667, 591.0017166666667, 592.0027166666666, 593.0037166666667, 594.0047166666667, 595.0057166666667, 596.0067166666666, 597.0077166666666, 598.0087166666667, 599.0097166666667, 600.0107166666667, 601.0117166666666, 602.0127166666666, 603.0137166666667, 604.0147166666667, 605.0157166666667, 606.0000333333334, 607.0010333333333, 608.0020333333333, 609.0030333333333, 610.0040333333334, 611.0050333333334, 612.0060333333333, 613.0070333333333, 614.0080333333333, 615.0090333333334, 616.0100333333334, 617.0110333333333, 618.0120333333333, 619.0130333333333], "recent_frames_sha256": "db0ceb6185b016202264956619abb737bfe53467c9673a5e5f857f7566921dde", "num_recent_frames": 30, "tq": 717224.739427959, "t1": 717225.516713165, "ta": 717225.516713165, "te": 717225.74286491, "first_response_s": 0.7772852060152218, "answer_total_s": 1.0034369510831311, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 293, "content_group": "fb785866696fd34ba3857721e54b8a0fd8d98db44ce0cc48f7cc2f9433acf8d3", "question": {"question_id": "sample_293_a850_q0", "video_id": 293, "video_path": "./videos/sample_293_real.mp4", "annotation_index": 850, "question_index": 0, "question": "What is the person doing right now?", "options": ["A. Walking away from the brick wall.", "B. Engaging with the interaction menu.", "C. Standing and observing the environment.", "D. Adjusting their position against the wall."], "answer": "B", "time_stamp_s": 803, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "live_streams", "reference_interval_s": null, "split": "test"}, "recent": {"method": "recent", "question_id": "sample_293_a850_q0", "video_id": 293, "time_stamp_s": 803, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ffe102eb779c5b2b5462ec99585da83977708612f1ab2284b0c38023ea90ec52", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [773.0002, 774.0012, 775.0022, 776.0032, 777.0042, 778.0052, 779.0062, 780.0072, 781.0082, 782.0092, 783.0102, 784.0112, 785.0122, 786.0132, 787.0142, 788.0152, 789.0162, 790.0005166666666, 791.0015166666667, 792.0025166666667, 793.0035166666667, 794.0045166666666, 795.0055166666667, 796.0065166666667, 797.0075166666667, 798.0085166666667, 799.0095166666666, 800.0105166666667, 801.0115166666667, 802.0125166666667], "recent_frames_sha256": "88e077f749586496d65b0ca4da929655138d39d9372b7f50993648372f72afca", "num_recent_frames": 30, "tq": 717317.812304766, "t1": 717329.69934778, "ta": 717329.69934778, "te": 717329.738145124, "first_response_s": 11.887043013935909, "answer_total_s": 11.925840358017012, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_293_a850_q0", "video_id": 293, "time_stamp_s": 803, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "24129b62e19130b13aad8dbb19564e8cc2135df62ea2216247511eb4ea943949", "condition_order": ["notes", "recent"], "memory": "[420-450s] - Blue car accelerates on a wet road at night, passing traffic lights and intersections.\n- Player's in-game speedometer shows increasing speed from 84 to 100 mph.\n- \"MAX WIN!\" text appears on screen, indicating a race completion or achievement.\n[450-480s] - Blue car drives through city streets at night, speed fluctuating between 85–90 mph.\n- Player’s HUD shows map, speed, and a chat log with viewer messages.\n- Car passes intersections and turns, with streetlights and buildings visible in background.\n[480-510s] - Blue car drives on highway at night, speed fluctuating between 118-97 mph.\n- Player's webcam shows a person with headphones, looking at screen.\n- Game UI displays speedometer, map, and leaderboard with player names and scores.\n[510-540s] - Player character in yellow vest walks toward a damaged blue car, then approaches a group of NPCs near a yellow truck.  \n- A player in a blue jersey with \"DING\" and number 28 walks past the group, moving toward the right side of the screen.  \n- The camera pans slightly to follow the player in the yellow vest as they move toward a parked white car, with other characters visible in the background.\n[540-570s] - A player character in a yellow vest stands near a white car, facing a group of pedestrians.  \n- A female character in a pink outfit walks toward the player character, approaching from the right.  \n- The player character turns to face the female character, initiating interaction as the camera angle shifts slightly.\n[570-600s] - A player character in a yellow vest stands near a blue car, facing two female characters.  \n- One female character in a pink outfit is positioned to the right of the blue car, while another in a black outfit stands behind her.  \n- The player character’s UI shows a red circle with a green arrow icon, indicating an interactive option.\n[600-630s] - A character in a yellow safety vest stands facing two other characters near a blue car, observing their interaction.  \n- One character in a pink outfit is positioned to the right, facing the other two.  \n- The blue car is parked beside a silver car, with both vehicles stationary in the dimly lit urban environment.\n[630-660s] - A player in a blue jersey with \"RAMOS 25\" on the back stands near a blue car, facing a group of players.  \n- A player in a yellow safety vest is positioned between the blue car and the group, appearing to interact with others.  \n- The scene is set at night in an urban environment with illuminated buildings and parked vehicles, including a white police car.\n[660-690s] - A group of five players stands in a dimly lit outdoor area at night, facing each other in a loose circle.  \n- The player in the center wears a yellow vest and appears to be speaking or gesturing toward others.  \n- A small green and brown animated graphic appears briefly in the lower-left corner, possibly indicating a game-related event or item.\n[690-720s] - A player in a yellow vest stands near others in a dark urban area, facing a group.  \n- The player in the black hoodie with a mask is positioned to the right, gesturing toward the group.  \n- Chat messages scroll on the right, indicating player interactions, with a visible \"11:52\" timestamp.\n[720-750s] - Streamer in top-left inset smiles while wearing headphones, facing camera.  \n- In-game scene: five characters stand in a dark outdoor area, one in blue jersey, another in yellow vest, and one in black suit.  \n- Right-side chat window displays active viewer messages, including “I’m not sure what’s going on” and “I’m not sure what’s going on.”\n[750-780s] - Streamer in top-left inset wears a hoodie and speaks while showing a \"Cooling Progression\" menu with six items, each displaying a price and a \"Buy\" button.\n- In the main game view, four characters stand in a dark outdoor area; one character in a black suit and mask is facing the others, while another character in a yellow vest stands near the center.\n- A smartphone UI overlay appears on the right side of the screen, showing a clock that ticks from 01:48 to 01:50, with app icons visible on its home screen.", "history_tokens": 988, "history_utf8_bytes": 4111, "recent_frame_times_s": [773.0002, 774.0012, 775.0022, 776.0032, 777.0042, 778.0052, 779.0062, 780.0072, 781.0082, 782.0092, 783.0102, 784.0112, 785.0122, 786.0132, 787.0142, 788.0152, 789.0162, 790.0005166666666, 791.0015166666667, 792.0025166666667, 793.0035166666667, 794.0045166666666, 795.0055166666667, 796.0065166666667, 797.0075166666667, 798.0085166666667, 799.0095166666666, 800.0105166666667, 801.0115166666667, 802.0125166666667], "recent_frames_sha256": "88e077f749586496d65b0ca4da929655138d39d9372b7f50993648372f72afca", "num_recent_frames": 30, "tq": 717276.684572502, "t1": 717278.321657743, "ta": 717278.321657743, "te": 717278.525938338, "first_response_s": 1.637085240916349, "answer_total_s": 1.8413658359786496, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 294, "content_group": "f26ba14218e16ddda32d0fa22bf86631f35eb8f8bc638e97afffcc04b42f882c", "question": {"question_id": "sample_294_a1235_q0", "video_id": 294, "video_path": "./videos/sample_294_real.mp4", "annotation_index": 1235, "question_index": 0, "question": "What is the main text on roadside sign right now?", "options": ["A. Valentino.", "B. Coll d'Ordino, Andorra.", "C. Alpes, Spain.", "D. Pyrenees, France."], "answer": "B", "time_stamp_s": 7, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_294_a1235_q0", "video_id": 294, "time_stamp_s": 7, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "70d210324bb192b17acb764e2dd2d594e2e55569a170f2a86f8af4bfa3a078d4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006], "recent_frames_sha256": "9af38d4dc8a0b4481f4633ed167c7814025d8937913b35d21b44cb8655944c25", "num_recent_frames": 7, "tq": 718882.412318298, "t1": 718893.996887749, "ta": 718893.996887749, "te": 718894.036648972, "first_response_s": 11.584569450933486, "answer_total_s": 11.624330673948862, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_294_a1235_q0", "video_id": 294, "time_stamp_s": 7, "ground_truth": "B", "raw_output": "B. Coll d'Ordino, Andorra.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "09e84d3417d34442d18f689d3529f1aa6cca2b245c27531e0f7fa4f207eda6a1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006], "recent_frames_sha256": "9af38d4dc8a0b4481f4633ed167c7814025d8937913b35d21b44cb8655944c25", "num_recent_frames": 7, "tq": 718675.041816101, "t1": 718687.565771037, "ta": 718687.565771037, "te": 718687.975526645, "first_response_s": 12.523954936070368, "answer_total_s": 12.933710544020869, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 294, "content_group": "f26ba14218e16ddda32d0fa22bf86631f35eb8f8bc638e97afffcc04b42f882c", "question": {"question_id": "sample_294_a1236_q0", "video_id": 294, "video_path": "./videos/sample_294_real.mp4", "annotation_index": 1236, "question_index": 0, "question": "What is the feature on the left side of the road right now?", "options": ["A. A fence.", "B. A river.", "C. A mountain.", "D. A sidewalk."], "answer": "A", "time_stamp_s": 155, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [155, 175], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_294_a1236_q0", "video_id": 294, "time_stamp_s": 155, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d584bfe4a3e3df224366a10daed9f7e3c90343cd694d25a76882aed08fca98e4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [125.04158333333334, 126.000875, 127.001875, 128.002875, 129.003875, 130.004875, 131.005875, 132.006875, 133.007875, 134.008875, 135.009875, 136.010875, 137.011875, 138.012875, 139.013875, 140.014875, 141.015875, 142.016875, 143.017875, 144.018875, 145.019875, 146.020875, 147.021875, 148.022875, 149.023875, 150.024875, 151.025875, 152.026875, 153.027875, 154.028875], "recent_frames_sha256": "5dc4b1a10f29501422e60009f6b8d94055f39f09e6b9cadcd43f08d2a32473ea", "num_recent_frames": 30, "tq": 718894.052783748, "t1": 718906.048738458, "ta": 718906.048738458, "te": 718906.086142028, "first_response_s": 11.995954709942453, "answer_total_s": 12.033358279964887, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_294_a1236_q0", "video_id": 294, "time_stamp_s": 155, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c314e1f0b6f505d6360d1b8ddd08c416abe9e1f340ef1379e59a08745d0e321f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclist in helmet and cycling gear stands beside a road sign indicating \"Cappella di San Giuseppe\" with a map, then walks away from the sign.  \n- Aerial view shows a winding road through a forested mountain range with a town visible in the valley below.  \n- Cyclist later seen from behind, walking along the roadside, with a map on a post nearby, before turning and moving away from the camera.\n[30-60s] - Cyclist in grey shirt and black shorts walks toward bike, then mounts it, with app overlay showing route and stats.  \n- First-person view shows cyclist riding uphill, with speed and elevation data displayed on screen.  \n- Aerial shot reveals winding road through green hills, with parked cars and distant mountains visible.\n[60-90s] - Cyclist in dark attire rides ahead on a paved road, maintaining steady pace through forested terrain.  \n- On-screen metrics show increasing speed (e.g., 45 mph) and elevation gain (e.g., 1.1% gradient) as the ride progresses.  \n- Road curves gently to the right, with guardrails visible on the right side, indicating a maintained route through scenic landscape.\n[90-120s] - Cyclist ahead maintains steady pace, slightly adjusting position on road.  \n- On-screen metrics show speed fluctuating between 47–49 MPH and elevation gain around 21–25 feet.  \n- Road curves gently to the right, bordered by dense greenery and guardrails.\n[120-150s] - Cyclist ahead maintains steady pace, slightly leaning into turns while riding on paved road bordered by trees.\n- On-screen metrics show speed fluctuating between 45–74 mph, power output varying from 72–123 watts, and elevation gain increasing.\n- Road curves leftward, with guardrail visible on right side, and cyclist’s position relative to camera remains consistent throughout segment.", "history_tokens": 421, "history_utf8_bytes": 1789, "recent_frame_times_s": [125.04158333333334, 126.000875, 127.001875, 128.002875, 129.003875, 130.004875, 131.005875, 132.006875, 133.007875, 134.008875, 135.009875, 136.010875, 137.011875, 138.012875, 139.013875, 140.014875, 141.015875, 142.016875, 143.017875, 144.018875, 145.019875, 146.020875, 147.021875, 148.022875, 149.023875, 150.024875, 151.025875, 152.026875, 153.027875, 154.028875], "recent_frames_sha256": "5dc4b1a10f29501422e60009f6b8d94055f39f09e6b9cadcd43f08d2a32473ea", "num_recent_frames": 30, "tq": 718728.729713213, "t1": 718735.420999038, "ta": 718735.420999038, "te": 718735.569425869, "first_response_s": 6.691285824985243, "answer_total_s": 6.839712655986659, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 294, "content_group": "f26ba14218e16ddda32d0fa22bf86631f35eb8f8bc638e97afffcc04b42f882c", "question": {"question_id": "sample_294_a1237_q0", "video_id": 294, "video_path": "./videos/sample_294_real.mp4", "annotation_index": 1237, "question_index": 0, "question": "Where is the cyclist currently riding relative to the road?", "options": ["A. On the shoulder of the road.", "B. In the center of the road.", "C. On the left side of the road.", "D. In the right side of the road."], "answer": "C", "time_stamp_s": 330, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [310, 330], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_294_a1237_q0", "video_id": 294, "time_stamp_s": 330, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1c1d5cd6883f7a8229c43c80aabc085bf4029189071a48fc520654d4fa2fc8c4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [300.00804166666666, 301.0090416666667, 302.01004166666667, 303.01104166666664, 304.0120416666667, 305.01304166666665, 306.0140416666667, 307.01504166666666, 308.0160416666667, 309.01704166666667, 310.01804166666665, 311.0190416666667, 312.02004166666666, 313.0210416666667, 314.02204166666667, 315.02304166666664, 316.0240416666667, 317.02504166666665, 318.0260416666667, 319.02704166666666, 320.02804166666664, 321.02904166666667, 322.03004166666665, 323.0310416666667, 324.03204166666666, 325.0330416666667, 326.03404166666667, 327.03504166666664, 328.0360416666667, 329.03704166666665], "recent_frames_sha256": "175904c57fb6b49cfad680123e7490dc84825b6b68ffc96c9ea18216f69f4f2e", "num_recent_frames": 30, "tq": 718906.098324522, "t1": 718948.266261113, "ta": 718948.266261113, "te": 718948.46118, "first_response_s": 42.16793659096584, "answer_total_s": 42.362855477957055, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_294_a1237_q0", "video_id": 294, "time_stamp_s": 330, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9f2fa8d4f578b98c6cad837ee74495a46fd4a189dc7c3bd9ec765670974b3972", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclist in helmet and cycling gear stands beside a road sign indicating \"Cappella di San Giuseppe\" with a map, then walks away from the sign.  \n- Aerial view shows a winding road through a forested mountain range with a town visible in the valley below.  \n- Cyclist later seen from behind, walking along the roadside, with a map on a post nearby, before turning and moving away from the camera.\n[30-60s] - Cyclist in grey shirt and black shorts walks toward bike, then mounts it, with app overlay showing route and stats.  \n- First-person view shows cyclist riding uphill, with speed and elevation data displayed on screen.  \n- Aerial shot reveals winding road through green hills, with parked cars and distant mountains visible.\n[60-90s] - Cyclist in dark attire rides ahead on a paved road, maintaining steady pace through forested terrain.  \n- On-screen metrics show increasing speed (e.g., 45 mph) and elevation gain (e.g., 1.1% gradient) as the ride progresses.  \n- Road curves gently to the right, with guardrails visible on the right side, indicating a maintained route through scenic landscape.\n[90-120s] - Cyclist ahead maintains steady pace, slightly adjusting position on road.  \n- On-screen metrics show speed fluctuating between 47–49 MPH and elevation gain around 21–25 feet.  \n- Road curves gently to the right, bordered by dense greenery and guardrails.\n[120-150s] - Cyclist ahead maintains steady pace, slightly leaning into turns while riding on paved road bordered by trees.\n- On-screen metrics show speed fluctuating between 45–74 mph, power output varying from 72–123 watts, and elevation gain increasing.\n- Road curves leftward, with guardrail visible on right side, and cyclist’s position relative to camera remains consistent throughout segment.\n[150-180s] - Cyclist ahead maintains steady pace, slightly uphill, with speed increasing from 27 to 42 mph.\n- Rider’s handlebars show a digital display updating speed, cadence, and power metrics.\n- Road curves gently to the right, flanked by green trees and guardrails, with a map overlay visible on screen.\n[180-210s] - Cyclist ahead maintains steady pace, speed fluctuating between 45–55 mph while navigating curves.\n- GPS display shows elevation gain and distance, with terrain map visible on right side of screen.\n- Handlebars and front bike components remain in focus, indicating first-person perspective from a following cyclist.\n[210-240s] - Cyclist ahead maintains steady pace, slightly increasing speed from 34 to 69 mph while navigating curves.\n- Rider in foreground shows fluctuating power output (e.g., 100W to 127W) and cadence (e.g., 62 to 70 RPM) as they follow the lead cyclist.\n- Road surface and surrounding trees blur due to motion, indicating high speed and consistent forward trajectory.\n[240-270s] - Cyclist ahead maintains steady pace, slightly ahead of the camera rider on a winding road.  \n- Speed and elevation data fluctuate, indicating a climb or descent; power output increases as the rider ascends.  \n- Roadside trees and guardrails blur past, suggesting high speed and continuous motion.\n[270-300s] - Cyclist in black attire rides ahead, maintaining steady pace on a winding road.\n- GPS display shows speed fluctuating between 43–47 mph, with elevation gain and battery level indicators.\n- Road curves through green forested terrain, with guardrails visible on the right side.\n[300-330s] - Cyclist ahead maintains steady pace, slightly elevated on winding road.  \n- Rider’s handlebars show fluctuating speed and elevation data (e.g., 38–42 MPH, 64–66% gradient).  \n- Road curves right, bordered by guardrails and dense greenery; distant hills visible.", "history_tokens": 889, "history_utf8_bytes": 3684, "recent_frame_times_s": [300.00804166666666, 301.0090416666667, 302.01004166666667, 303.01104166666664, 304.0120416666667, 305.01304166666665, 306.0140416666667, 307.01504166666666, 308.0160416666667, 309.01704166666667, 310.01804166666665, 311.0190416666667, 312.02004166666666, 313.0210416666667, 314.02204166666667, 315.02304166666664, 316.0240416666667, 317.02504166666665, 318.0260416666667, 319.02704166666666, 320.02804166666664, 321.02904166666667, 322.03004166666665, 323.0310416666667, 324.03204166666666, 325.0330416666667, 326.03404166666667, 327.03504166666664, 328.0360416666667, 329.03704166666665], "recent_frames_sha256": "175904c57fb6b49cfad680123e7490dc84825b6b68ffc96c9ea18216f69f4f2e", "num_recent_frames": 30, "tq": 718778.392633927, "t1": 718787.111146201, "ta": 718787.111146201, "te": 718787.151749914, "first_response_s": 8.718512273975648, "answer_total_s": 8.759115986991674, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 294, "content_group": "f26ba14218e16ddda32d0fa22bf86631f35eb8f8bc638e97afffcc04b42f882c", "question": {"question_id": "sample_294_a1238_q0", "video_id": 294, "video_path": "./videos/sample_294_real.mp4", "annotation_index": 1238, "question_index": 0, "question": "What is the feature on the right side of the road right now?", "options": ["A. A fence.", "B. A river.", "C. A mountain.", "D. A sidewalk."], "answer": "A", "time_stamp_s": 466, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [465, 485], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_294_a1238_q0", "video_id": 294, "time_stamp_s": 466, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "103f817167bfaa9a103aba5e6c721dc3ac37449962c4b887c6aac5ed1b0d78c6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [436.01891666666666, 437.0199166666667, 438.02091666666666, 439.02191666666664, 440.0229166666667, 441.02391666666665, 442.0249166666667, 443.02591666666666, 444.0269166666667, 445.02791666666667, 446.02891666666665, 447.0299166666667, 448.03091666666666, 449.0319166666667, 450.03291666666667, 451.03391666666664, 452.0349166666667, 453.03591666666665, 454.0369166666667, 455.03791666666666, 456.0389166666667, 457.03991666666667, 458.04091666666665, 459.0002083333333, 460.00120833333335, 461.00220833333333, 462.00320833333336, 463.00420833333334, 464.0052083333333, 465.00620833333335], "recent_frames_sha256": "cdba64e6a660cd8a09c77e4b388ff39889dfcbb62a07961e96fc019d3a6a5f23", "num_recent_frames": 30, "tq": 718948.472756636, "t1": 718957.394729589, "ta": 718957.394729589, "te": 718957.433479589, "first_response_s": 8.921972953015938, "answer_total_s": 8.960722952964716, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_294_a1238_q0", "video_id": 294, "time_stamp_s": 466, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "636d71306999f5d0f8b19df81656cda51bdc5e8528e18951b54ecdcaba18c1dd", "condition_order": ["notes", "recent"], "memory": "[90-120s] - Cyclist ahead maintains steady pace, slightly adjusting position on road.  \n- On-screen metrics show speed fluctuating between 47–49 MPH and elevation gain around 21–25 feet.  \n- Road curves gently to the right, bordered by dense greenery and guardrails.\n[120-150s] - Cyclist ahead maintains steady pace, slightly leaning into turns while riding on paved road bordered by trees.\n- On-screen metrics show speed fluctuating between 45–74 mph, power output varying from 72–123 watts, and elevation gain increasing.\n- Road curves leftward, with guardrail visible on right side, and cyclist’s position relative to camera remains consistent throughout segment.\n[150-180s] - Cyclist ahead maintains steady pace, slightly uphill, with speed increasing from 27 to 42 mph.\n- Rider’s handlebars show a digital display updating speed, cadence, and power metrics.\n- Road curves gently to the right, flanked by green trees and guardrails, with a map overlay visible on screen.\n[180-210s] - Cyclist ahead maintains steady pace, speed fluctuating between 45–55 mph while navigating curves.\n- GPS display shows elevation gain and distance, with terrain map visible on right side of screen.\n- Handlebars and front bike components remain in focus, indicating first-person perspective from a following cyclist.\n[210-240s] - Cyclist ahead maintains steady pace, slightly increasing speed from 34 to 69 mph while navigating curves.\n- Rider in foreground shows fluctuating power output (e.g., 100W to 127W) and cadence (e.g., 62 to 70 RPM) as they follow the lead cyclist.\n- Road surface and surrounding trees blur due to motion, indicating high speed and consistent forward trajectory.\n[240-270s] - Cyclist ahead maintains steady pace, slightly ahead of the camera rider on a winding road.  \n- Speed and elevation data fluctuate, indicating a climb or descent; power output increases as the rider ascends.  \n- Roadside trees and guardrails blur past, suggesting high speed and continuous motion.\n[270-300s] - Cyclist in black attire rides ahead, maintaining steady pace on a winding road.\n- GPS display shows speed fluctuating between 43–47 mph, with elevation gain and battery level indicators.\n- Road curves through green forested terrain, with guardrails visible on the right side.\n[300-330s] - Cyclist ahead maintains steady pace, slightly elevated on winding road.  \n- Rider’s handlebars show fluctuating speed and elevation data (e.g., 38–42 MPH, 64–66% gradient).  \n- Road curves right, bordered by guardrails and dense greenery; distant hills visible.\n[330-360s] - Cyclist ahead maintains steady pace, slightly ahead of the camera rider on a winding road.  \n- Camera rider’s speed fluctuates between 27–32 mph, with power output varying from 103–138 watts.  \n- Road curves right, with guardrails visible on the left and trees lining the roadside.\n[360-390s] - Cyclist ahead maintains steady pace, slightly leaning into curves while riding uphill.\n- Rider’s handlebars show a mounted device displaying real-time metrics like speed, power, and elevation.\n- Road curves through forested terrain with guardrails on the left and rocky slopes on the right.\n[390-420s] - Cyclist ahead maintains steady pace, slightly ahead of the camera rider on a winding road.  \n- Camera rider’s speed fluctuates between 40–48 mph, with power output varying from 62–72 watts.  \n- Road curves through greenery with mountains in the background; a red car briefly appears on the road.\n[420-450s] - Cyclist in front maintains steady pace, slightly ahead of the camera rider.  \n- Camera rider’s speed fluctuates between 15–38 mph, with elevation gain shown as 0.0% to 7.3%.  \n- Road curves left, bordered by guardrails and dense greenery, with a map overlay visible on screen.", "history_tokens": 940, "history_utf8_bytes": 3787, "recent_frame_times_s": [436.01891666666666, 437.0199166666667, 438.02091666666666, 439.02191666666664, 440.0229166666667, 441.02391666666665, 442.0249166666667, 443.02591666666666, 444.0269166666667, 445.02791666666667, 446.02891666666665, 447.0299166666667, 448.03091666666666, 449.0319166666667, 450.03291666666667, 451.03391666666664, 452.0349166666667, 453.03591666666665, 454.0369166666667, 455.03791666666666, 456.0389166666667, 457.03991666666667, 458.04091666666665, 459.0002083333333, 460.00120833333335, 461.00220833333333, 462.00320833333336, 463.00420833333334, 464.0052083333333, 465.00620833333335], "recent_frames_sha256": "cdba64e6a660cd8a09c77e4b388ff39889dfcbb62a07961e96fc019d3a6a5f23", "num_recent_frames": 30, "tq": 718822.135091212, "t1": 718829.679906025, "ta": 718829.679906025, "te": 718829.722059826, "first_response_s": 7.54481481295079, "answer_total_s": 7.586968614021316, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 294, "content_group": "f26ba14218e16ddda32d0fa22bf86631f35eb8f8bc638e97afffcc04b42f882c", "question": {"question_id": "sample_294_a1239_q0", "video_id": 294, "video_path": "./videos/sample_294_real.mp4", "annotation_index": 1239, "question_index": 0, "question": "What is the position of the orange car right now?", "options": ["A. Directly ahead.", "B. On the left side of the road.", "C. On the right side of the road.", "D. Directly behind."], "answer": "B", "time_stamp_s": 632, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [620, 640], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_294_a1239_q0", "video_id": 294, "time_stamp_s": 632, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "23bdbacda223b5cd881a678c99d9bf59b689a57170c32445199a81bd842f4aa6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [602.0180833333334, 603.0190833333334, 604.0200833333333, 605.0210833333333, 606.0220833333333, 607.0230833333334, 608.0240833333334, 609.0250833333333, 610.0260833333333, 611.0270833333333, 612.0280833333334, 613.0290833333333, 614.0300833333333, 615.0310833333333, 616.0320833333334, 617.0330833333334, 618.0340833333333, 619.0350833333333, 620.0360833333333, 621.0370833333334, 622.0380833333334, 623.0390833333333, 624.0400833333333, 625.0410833333333, 626.000375, 627.001375, 628.002375, 629.003375, 630.004375, 631.005375], "recent_frames_sha256": "fe315d0894eb33d333ebe39f42ecf882c7430d1e147cde1be64bad1b2cdc0bf5", "num_recent_frames": 30, "tq": 718957.453094791, "t1": 718969.152901651, "ta": 718969.152901651, "te": 718969.19263267, "first_response_s": 11.699806859949604, "answer_total_s": 11.739537879009731, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_294_a1239_q0", "video_id": 294, "time_stamp_s": 632, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "84573b526ea55c88c2e18ce65874a363978aebd2bae052b3f05b57a242e6a4cb", "condition_order": ["notes", "recent"], "memory": "[270-300s] - Cyclist in black attire rides ahead, maintaining steady pace on a winding road.\n- GPS display shows speed fluctuating between 43–47 mph, with elevation gain and battery level indicators.\n- Road curves through green forested terrain, with guardrails visible on the right side.\n[300-330s] - Cyclist ahead maintains steady pace, slightly elevated on winding road.  \n- Rider’s handlebars show fluctuating speed and elevation data (e.g., 38–42 MPH, 64–66% gradient).  \n- Road curves right, bordered by guardrails and dense greenery; distant hills visible.\n[330-360s] - Cyclist ahead maintains steady pace, slightly ahead of the camera rider on a winding road.  \n- Camera rider’s speed fluctuates between 27–32 mph, with power output varying from 103–138 watts.  \n- Road curves right, with guardrails visible on the left and trees lining the roadside.\n[360-390s] - Cyclist ahead maintains steady pace, slightly leaning into curves while riding uphill.\n- Rider’s handlebars show a mounted device displaying real-time metrics like speed, power, and elevation.\n- Road curves through forested terrain with guardrails on the left and rocky slopes on the right.\n[390-420s] - Cyclist ahead maintains steady pace, slightly ahead of the camera rider on a winding road.  \n- Camera rider’s speed fluctuates between 40–48 mph, with power output varying from 62–72 watts.  \n- Road curves through greenery with mountains in the background; a red car briefly appears on the road.\n[420-450s] - Cyclist in front maintains steady pace, slightly ahead of the camera rider.  \n- Camera rider’s speed fluctuates between 15–38 mph, with elevation gain shown as 0.0% to 7.3%.  \n- Road curves left, bordered by guardrails and dense greenery, with a map overlay visible on screen.\n[450-480s] - Cyclist ahead maintains steady pace, slightly ahead of the camera rider on a winding road.  \n- On-screen metrics show increasing speed (e.g., 32 to 45 mph) and power output (e.g., 62 to 80 W) as the ride progresses.  \n- Road curves to the right, with trees and guardrails visible on the left side of the road.\n[480-510s] - Cyclist ahead maintains steady pace, slightly ahead of the camera rider on a winding road.  \n- Roadside traffic includes a white van passing on the right.  \n- On-screen metrics show speed fluctuating between 38–49 MPH, with elevation gain around 1.8% and battery level at 20–28%.\n[510-540s] - Cyclist ahead maintains steady pace, averaging 67–74 mph with slight elevation changes (0.5–1.2% grade).  \n- Road transitions from rural to urban, with passing vehicles and buildings visible.  \n- On-screen metrics show fluctuating speed, power output, and elevation, indicating dynamic ride conditions.\n[540-570s] - Cyclist ahead maintains steady pace, slightly increasing speed from 39 to 45 mph.\n- Roadside vehicles (cars, trucks) pass by in varying directions, including a white car and a blue van.\n- GPS display shows elevation gain and distance, with a map overlay indicating route progress.\n[570-600s] - Cyclist ahead maintains steady pace, navigating through town streets with visible buildings and parked cars.  \n- On-screen display shows fluctuating speed (e.g., 34–37 mph) and elevation gain (e.g., 0–2.5%), indicating terrain changes.  \n- Road curves and straightaways alternate, with the cyclist’s position relative to the camera shifting as they pass through residential areas.\n[600-630s] - Cyclist ahead maintains steady pace, navigating through town streets with visible speed and elevation changes.  \n- On-screen metrics show fluctuating speed (e.g., 42 to 25 mph) and elevation gain (e.g., +108 to +78 ft), indicating varied terrain.  \n- Roadside vehicles and buildings pass by, with a white van and parked cars visible as the cyclist moves through urban areas.", "history_tokens": 973, "history_utf8_bytes": 3809, "recent_frame_times_s": [602.0180833333334, 603.0190833333334, 604.0200833333333, 605.0210833333333, 606.0220833333333, 607.0230833333334, 608.0240833333334, 609.0250833333333, 610.0260833333333, 611.0270833333333, 612.0280833333334, 613.0290833333333, 614.0300833333333, 615.0310833333333, 616.0320833333334, 617.0330833333334, 618.0340833333333, 619.0350833333333, 620.0360833333333, 621.0370833333334, 622.0380833333334, 623.0390833333333, 624.0400833333333, 625.0410833333333, 626.000375, 627.001375, 628.002375, 629.003375, 630.004375, 631.005375], "recent_frames_sha256": "fe315d0894eb33d333ebe39f42ecf882c7430d1e147cde1be64bad1b2cdc0bf5", "num_recent_frames": 30, "tq": 718880.609786994, "t1": 718882.19344091, "ta": 718882.19344091, "te": 718882.383624536, "first_response_s": 1.583653915906325, "answer_total_s": 1.7738375419285148, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 295, "content_group": "dee3545690cd6667ea52a1dad0d9dcf2a995a1dab622f7b0a00ab369ba3771d4", "question": {"question_id": "sample_295_a1398_q0", "video_id": 295, "video_path": "./videos/sample_295_real.mp4", "annotation_index": 1398, "question_index": 0, "question": "What is the displayed speed of the leading cyclist right now?", "options": ["A. 40 km/h.", "B. 39 km/h.", "C. 38 km/h.", "D. 37 km/h."], "answer": "C", "time_stamp_s": 8, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_295_a1398_q0", "video_id": 295, "time_stamp_s": 8, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ad10916ff51450211617b1b234346062c5e2d12d1b7a150341f590d2dfb47ec4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0], "recent_frames_sha256": "344d2834b5df3a30dc0dcbc4d7700d612abe0ad569ab05af369e331a7de36ed1", "num_recent_frames": 9, "tq": 717706.998590258, "t1": 717712.512564579, "ta": 717712.512564579, "te": 717712.550471905, "first_response_s": 5.513974321074784, "answer_total_s": 5.551881647086702, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_295_a1398_q0", "video_id": 295, "time_stamp_s": 8, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8057a3523b3e23647ecd1a03df8690cd4546f5b40073df37cc8437212322be70", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0], "recent_frames_sha256": "344d2834b5df3a30dc0dcbc4d7700d612abe0ad569ab05af369e331a7de36ed1", "num_recent_frames": 9, "tq": 717756.98813353, "t1": 717764.57368037, "ta": 717764.57368037, "te": 717764.881507818, "first_response_s": 7.585546839982271, "answer_total_s": 7.8933742879889905, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 295, "content_group": "dee3545690cd6667ea52a1dad0d9dcf2a995a1dab622f7b0a00ab369ba3771d4", "question": {"question_id": "sample_295_a1399_q0", "video_id": 295, "video_path": "./videos/sample_295_real.mp4", "annotation_index": 1399, "question_index": 0, "question": "What is the position of the yellow sign and black arrow right now?", "options": ["A. Directly behind the cyclists.", "B. On the right side of the road.", "C. Directly ahead of the cyclists.", "D. On the left side of the road."], "answer": "D", "time_stamp_s": 54, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [41, 61], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_295_a1399_q0", "video_id": 295, "time_stamp_s": 54, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "46a528b3b10b5f6194fdf37a1eb96de2e1560295c39540f21e16146ccc6a5807", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [25.0, 26.0, 27.0, 28.0, 29.0, 30.0, 31.0, 32.0, 33.0, 34.0, 35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0], "recent_frames_sha256": "f95117e2875ce0b513243f31409dcab03f4e5bdcc7fc45ba545b7f009d3214c7", "num_recent_frames": 30, "tq": 717712.57060425, "t1": 717719.036990323, "ta": 717719.036990323, "te": 717719.074837464, "first_response_s": 6.466386073036119, "answer_total_s": 6.504233214072883, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_295_a1399_q0", "video_id": 295, "time_stamp_s": 54, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a962e09ff53149746ad20c1d461486b6282dea6d6e6f7b4f21209f57ad498f85", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cyclist in black attire rides a road bike, with a GPS overlay showing route and speed (e.g., 38 mph, 40 mph, 73 mph) and heart rate (114 bpm, 117 bpm).\n- The rider navigates a paved road lined with trees, passing other cyclists and road signs, with shadows cast by the sun.\n- On-screen metrics display distance (e.g., 5.8 km, 5.7 km, 5.6 km) and power output (e.g., 98 W, 99 W, 0 W),", "history_tokens": 135, "history_utf8_bytes": 393, "recent_frame_times_s": [25.0, 26.0, 27.0, 28.0, 29.0, 30.0, 31.0, 32.0, 33.0, 34.0, 35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0, 49.0, 50.0, 51.0, 52.0, 53.0, 54.0], "recent_frames_sha256": "f95117e2875ce0b513243f31409dcab03f4e5bdcc7fc45ba545b7f009d3214c7", "num_recent_frames": 30, "tq": 717777.537308575, "t1": 717778.814259359, "ta": 717778.814259359, "te": 717779.043319657, "first_response_s": 1.2769507840275764, "answer_total_s": 1.5060110819758847, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 295, "content_group": "dee3545690cd6667ea52a1dad0d9dcf2a995a1dab622f7b0a00ab369ba3771d4", "question": {"question_id": "sample_295_a1400_q0", "video_id": 295, "video_path": "./videos/sample_295_real.mp4", "annotation_index": 1400, "question_index": 0, "question": "What is the position of the yellow traffic cones right now?", "options": ["A. Directly in front of the cyclist.", "B. To the left of the cyclist.", "C. Directly behind the cyclist.", "D. To the right of the cyclist."], "answer": "B", "time_stamp_s": 86, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [82, 102], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_295_a1400_q0", "video_id": 295, "time_stamp_s": 86, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "51bc45cdb29bed805353bddc734713a3e5ba3ed89b380cda53857c20bae80bd1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0], "recent_frames_sha256": "330d17ab48b493151e1fff8cee870b2ee00ec62a1f44d5c371bcfe25347793c4", "num_recent_frames": 30, "tq": 717719.087109021, "t1": 717732.693218926, "ta": 717732.693218926, "te": 717732.730468339, "first_response_s": 13.60610990494024, "answer_total_s": 13.643359318026341, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_295_a1400_q0", "video_id": 295, "time_stamp_s": 86, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3db77afa97d8fdb5c5c2dd512bd8e719734f0dafbb104614497fb92df1e1c7fa", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cyclist in black attire rides a road bike, with a GPS overlay showing route and speed (e.g., 38 mph, 40 mph, 73 mph) and heart rate (114 bpm, 117 bpm).\n- The rider navigates a paved road lined with trees, passing other cyclists and road signs, with shadows cast by the sun.\n- On-screen metrics display distance (e.g., 5.8 km, 5.7 km, 5.6 km) and power output (e.g., 98 W, 99 W, 0 W),\n[30-60s] - Cyclist in front maintains steady pace, slightly ahead of others, with shadow cast by sun.\n- Group of cyclists follows, with varying cadence and position, navigating a winding road.\n- On-screen metrics show fluctuating speed and cadence, indicating dynamic effort levels during ride.", "history_tokens": 200, "history_utf8_bytes": 688, "recent_frame_times_s": [57.0, 58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0], "recent_frames_sha256": "330d17ab48b493151e1fff8cee870b2ee00ec62a1f44d5c371bcfe25347793c4", "num_recent_frames": 30, "tq": 717789.959546975, "t1": 717791.795795649, "ta": 717791.795795649, "te": 717792.00041583, "first_response_s": 1.8362486740807071, "answer_total_s": 2.0408688550814986, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 295, "content_group": "dee3545690cd6667ea52a1dad0d9dcf2a995a1dab622f7b0a00ab369ba3771d4", "question": {"question_id": "sample_295_a1401_q0", "video_id": 295, "video_path": "./videos/sample_295_real.mp4", "annotation_index": 1401, "question_index": 0, "question": "What is to the left of the cyclists right now?", "options": ["A. Open farmland.", "B. Dense forest.", "C. Fence bordering trees.", "D. River."], "answer": "C", "time_stamp_s": 143, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [123, 143], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_295_a1401_q0", "video_id": 295, "time_stamp_s": 143, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "562d3629f9bfe0e68e4a50ca17765b0f16d823c5e26b7b1603b156fa610ce910", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0], "recent_frames_sha256": "d1764438bad6a4cb8272a14a8a2dd033a07a14c33bfcb46cdec19f351bb583c9", "num_recent_frames": 30, "tq": 717732.740542583, "t1": 717744.43421427, "ta": 717744.43421427, "te": 717744.478128269, "first_response_s": 11.693671686924063, "answer_total_s": 11.737585685914382, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_295_a1401_q0", "video_id": 295, "time_stamp_s": 143, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5267364d4c3222ebf9b2c127584ba712e29bcda4bf24291cce8460d8958317bf", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cyclist in black attire rides a road bike, with a GPS overlay showing route and speed (e.g., 38 mph, 40 mph, 73 mph) and heart rate (114 bpm, 117 bpm).\n- The rider navigates a paved road lined with trees, passing other cyclists and road signs, with shadows cast by the sun.\n- On-screen metrics display distance (e.g., 5.8 km, 5.7 km, 5.6 km) and power output (e.g., 98 W, 99 W, 0 W),\n[30-60s] - Cyclist in front maintains steady pace, slightly ahead of others, with shadow cast by sun.\n- Group of cyclists follows, with varying cadence and position, navigating a winding road.\n- On-screen metrics show fluctuating speed and cadence, indicating dynamic effort levels during ride.\n[60-90s] - Cyclist in front maintains steady pace, slightly ahead of group, with speed fluctuating between 44-50 km/h.  \n- Road curves right, lined with trees and orange cones, indicating a controlled route.  \n- Shadow of cyclist stretches long on pavement, suggesting midday sun angle.\n[90-120s] - Cyclist in front maintains steady pace, slightly ahead of group, with shadow cast on road.  \n- Group of cyclists follows, with one cyclist slightly behind and to the right, adjusting position.  \n- On-screen metrics show speed fluctuating between 23–45 km/h, cadence around 117–119 rpm, and power output varying.", "history_tokens": 356, "history_utf8_bytes": 1303, "recent_frame_times_s": [114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0], "recent_frames_sha256": "d1764438bad6a4cb8272a14a8a2dd033a07a14c33bfcb46cdec19f351bb583c9", "num_recent_frames": 30, "tq": 717810.88498598, "t1": 717812.389896759, "ta": 717812.389896759, "te": 717812.576987084, "first_response_s": 1.5049107789527625, "answer_total_s": 1.6920011040056124, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 295, "content_group": "dee3545690cd6667ea52a1dad0d9dcf2a995a1dab622f7b0a00ab369ba3771d4", "question": {"question_id": "sample_295_a1402_q0", "video_id": 295, "video_path": "./videos/sample_295_real.mp4", "annotation_index": 1402, "question_index": 0, "question": "Where is the cyclist positioned in the lane right now?", "options": ["A. On the far left side.", "B. On the left side of the lane.", "C. On the far right side.", "D. On the shoulder of the road."], "answer": "B", "time_stamp_s": 176, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [164, 184], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_295_a1402_q0", "video_id": 295, "time_stamp_s": 176, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6266127438021fadb3b46c0bbc9642c5ca04dc6e3374907217a62fa2d51bef11", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0], "recent_frames_sha256": "2e775c644b684d2c70cb15fefbbc6a0023ac2182fe71f4c03f75f570e0b5a7f0", "num_recent_frames": 30, "tq": 717744.48817891, "t1": 717756.942654172, "ta": 717756.942654172, "te": 717756.980657234, "first_response_s": 12.454475261969492, "answer_total_s": 12.49247832398396, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_295_a1402_q0", "video_id": 295, "time_stamp_s": 176, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a9fe07594c22a3e572960e0870ca138848389b7b7e7d33e914bb120a520f4027", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cyclist in black attire rides a road bike, with a GPS overlay showing route and speed (e.g., 38 mph, 40 mph, 73 mph) and heart rate (114 bpm, 117 bpm).\n- The rider navigates a paved road lined with trees, passing other cyclists and road signs, with shadows cast by the sun.\n- On-screen metrics display distance (e.g., 5.8 km, 5.7 km, 5.6 km) and power output (e.g., 98 W, 99 W, 0 W),\n[30-60s] - Cyclist in front maintains steady pace, slightly ahead of others, with shadow cast by sun.\n- Group of cyclists follows, with varying cadence and position, navigating a winding road.\n- On-screen metrics show fluctuating speed and cadence, indicating dynamic effort levels during ride.\n[60-90s] - Cyclist in front maintains steady pace, slightly ahead of group, with speed fluctuating between 44-50 km/h.  \n- Road curves right, lined with trees and orange cones, indicating a controlled route.  \n- Shadow of cyclist stretches long on pavement, suggesting midday sun angle.\n[90-120s] - Cyclist in front maintains steady pace, slightly ahead of group, with shadow cast on road.  \n- Group of cyclists follows, with one cyclist slightly behind and to the right, adjusting position.  \n- On-screen metrics show speed fluctuating between 23–45 km/h, cadence around 117–119 rpm, and power output varying.\n[120-150s] - Cyclist in black jersey and shorts rides ahead, maintaining steady pace with fluctuating speed (56–62 km/h) and cadence (115–117 rpm).  \n- Group of cyclists follows closely behind, with one rider slightly ahead and others in formation, all on paved road with trees lining both sides.  \n- Road surface shows clear lane markings, and a bridge structure is visible ahead as the group approaches.", "history_tokens": 456, "history_utf8_bytes": 1713, "recent_frame_times_s": [147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0], "recent_frames_sha256": "2e775c644b684d2c70cb15fefbbc6a0023ac2182fe71f4c03f75f570e0b5a7f0", "num_recent_frames": 30, "tq": 717822.68316683, "t1": 717825.630089623, "ta": 717825.630089623, "te": 717826.067311884, "first_response_s": 2.9469227930530906, "answer_total_s": 3.3841450540348887, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 296, "content_group": "8494c2598c586cade2785f997075ec6348401e577016e01eee6baf22f44db197", "question": {"question_id": "sample_296_a1797_q0", "video_id": 296, "video_path": "./videos/sample_296_real.mp4", "annotation_index": 1797, "question_index": 0, "question": "What is located on the right side of the road right now?", "options": ["A. A white house.", "B. Several cars.", "C. A cafe.", "D. A bank."], "answer": "A", "time_stamp_s": 22, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_296_a1797_q0", "video_id": 296, "time_stamp_s": 22, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e41317d62f4bf4a612ae5022f45e53ac4993bd833e205c8f40ed4cbc10a33986", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019, 20.02, 21.021], "recent_frames_sha256": "2fdd866604b24039d5a337188760f4752ae5b9d4ec595e372d4921e12cb4c156", "num_recent_frames": 22, "tq": 715189.105382712, "t1": 715194.488397776, "ta": 715194.488397776, "te": 715194.526287389, "first_response_s": 5.383015064056963, "answer_total_s": 5.420904677012004, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_296_a1797_q0", "video_id": 296, "time_stamp_s": 22, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d7258b56e4685c806b28647b414c5910b9c6818ba913d475107f9da20c21d6f3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019, 20.02, 21.021], "recent_frames_sha256": "2fdd866604b24039d5a337188760f4752ae5b9d4ec595e372d4921e12cb4c156", "num_recent_frames": 22, "tq": 710550.850046794, "t1": 710562.234069753, "ta": 710562.234069753, "te": 710562.49249655, "first_response_s": 11.384022958925925, "answer_total_s": 11.642449755920097, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 296, "content_group": "8494c2598c586cade2785f997075ec6348401e577016e01eee6baf22f44db197", "question": {"question_id": "sample_296_a1798_q0", "video_id": 296, "video_path": "./videos/sample_296_real.mp4", "annotation_index": 1798, "question_index": 0, "question": "What is the cyclist approaching right now?", "options": ["A. A sharp left curve.", "B. A steep incline.", "C. A sharp right curve.", "D. A flat, straight road."], "answer": "A", "time_stamp_s": 233, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [218, 238], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_296_a1798_q0", "video_id": 296, "time_stamp_s": 233, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1f644a7ecd329d24090f0a9cede96f6086cd075575862bd250e45c2a490cd201", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [203.03616666666667, 204.03716666666668, 205.03816666666665, 206.03916666666666, 207.04016666666666, 208.04116666666667, 209.00045833333334, 210.00145833333335, 211.00245833333332, 212.00345833333333, 213.00445833333333, 214.00545833333334, 215.00645833333334, 216.00745833333335, 217.00845833333332, 218.00945833333333, 219.01045833333333, 220.01145833333334, 221.01245833333334, 222.01345833333335, 223.01445833333332, 224.01545833333333, 225.01645833333333, 226.01745833333334, 227.01845833333334, 228.01945833333335, 229.02045833333332, 230.02145833333333, 231.02245833333333, 232.02345833333334], "recent_frames_sha256": "2ba03c2efb4cd84576d8f722baf57a7ac7b9139986645bb37003065e8bf1f372", "num_recent_frames": 30, "tq": 715194.540148918, "t1": 715206.11277631, "ta": 715206.11277631, "te": 715206.317823757, "first_response_s": 11.572627391899005, "answer_total_s": 11.777674838900566, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_296_a1798_q0", "video_id": 296, "time_stamp_s": 233, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bf845214ffbc0a05b49413806017c9c33bb7c30950972938845ecefa3046d4fe", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclist in black jersey and white helmet adjusts gloves before starting to pedal uphill.  \n- On-screen overlay shows route progress (e.g., \"Mtn 19\", \"Dist 21\") as cyclist rides along a winding mountain road.  \n- Cyclist passes a roadside building and continues uphill, with a truck visible ahead on the road.\n[30-60s] - Cyclist in dark jersey and helmet rides uphill on a mountain road, with speed and elevation data displayed on screen.\n- Road curves through alpine terrain with distant mountains and sparse vegetation; a few vehicles are visible ahead.\n- On-screen overlay at 0:55 shows \"FURKA PASS (WEST SIDE)\" with climb stats including time, gradient, distance, average speed, and max speed.\n[60-90s] - Cyclist rides uphill on a winding mountain road, wearing dark cycling gear and a backpack.  \n- On-screen data shows elevation gain, distance, and speed metrics, indicating a steep climb.  \n- Road curves along a grassy slope with distant mountains visible under a partly cloudy sky.\n[90-120s] - Cyclist rides uphill, speed increasing from 36 to 45 mph, with elevation gain shown as -3 to -9 meters.\n- Road curves along mountainous terrain, with a car briefly passing in the opposite direction.\n- On-screen data displays real-time metrics: distance, elevation, and pace, with a map outline of the route.\n[120-150s] - Cyclist maintains steady pace on winding mountain road, with speed and elevation data displayed on screen.\n- Road curves sharply to the right, with rocky terrain and sparse vegetation on the roadside.\n- Shadow of cyclist is visible on the road surface, indicating bright daylight conditions.\n[150-180s] - Cyclist maintains steady pace uphill, with speed fluctuating between 38–40 mph and elevation gain around 200–230 meters.  \n- Road curves sharply to the right, with guardrails visible on the right side and rocky terrain on the left.  \n- On-screen metrics show consistent power output (480–500 W) and negative elevation change (-7 to -8 meters).\n[180-210s] - Cyclist in black attire rides uphill, maintaining steady pace with speedometer showing 25–30 mph and elevation gain of -5 to -7%.\n- Road curves sharply, with guardrails on right and mountainside on left; occasional vehicles pass in opposite direction.\n- On-screen data displays cumulative distance (e.g., 4.2 miles) and elevation (e.g., 298 ft), indicating ongoing ascent.", "history_tokens": 578, "history_utf8_bytes": 2375, "recent_frame_times_s": [203.03616666666667, 204.03716666666668, 205.03816666666665, 206.03916666666666, 207.04016666666666, 208.04116666666667, 209.00045833333334, 210.00145833333335, 211.00245833333332, 212.00345833333333, 213.00445833333333, 214.00545833333334, 215.00645833333334, 216.00745833333335, 217.00845833333332, 218.00945833333333, 219.01045833333333, 220.01145833333334, 221.01245833333334, 222.01345833333335, 223.01445833333332, 224.01545833333333, 225.01645833333333, 226.01745833333334, 227.01845833333334, 228.01945833333335, 229.02045833333332, 230.02145833333333, 231.02245833333333, 232.02345833333334], "recent_frames_sha256": "2ba03c2efb4cd84576d8f722baf57a7ac7b9139986645bb37003065e8bf1f372", "num_recent_frames": 30, "tq": 710615.639148463, "t1": 710616.344973627, "ta": 710616.344973627, "te": 710616.382378062, "first_response_s": 0.7058251639828086, "answer_total_s": 0.7432295989710838, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 296, "content_group": "8494c2598c586cade2785f997075ec6348401e577016e01eee6baf22f44db197", "question": {"question_id": "sample_296_a1799_q0", "video_id": 296, "video_path": "./videos/sample_296_real.mp4", "annotation_index": 1799, "question_index": 0, "question": "Which of the following best describes the road's layout right now?", "options": ["A. The road is straight with a slight downhill grade.", "B. The road is curving sharply to the left.", "C. The road is curving gently to the right.", "D. The road is straight with a slight uphill grade."], "answer": "A", "time_stamp_s": 442, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [436, 456], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_296_a1799_q0", "video_id": 296, "time_stamp_s": 442, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a9dbb1e704f7de5300baf9a945e9aa5259a4e83b76991dabac175712dfe1e6cb", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [412.036625, 413.037625, 414.038625, 415.039625, 416.040625, 417.041625, 418.0009166666667, 419.00191666666666, 420.0029166666667, 421.00391666666667, 422.00491666666665, 423.0059166666667, 424.00691666666665, 425.0079166666667, 426.00891666666666, 427.00991666666664, 428.0109166666667, 429.01191666666665, 430.0129166666667, 431.01391666666666, 432.0149166666667, 433.01591666666667, 434.01691666666665, 435.0179166666667, 436.01891666666666, 437.0199166666667, 438.02091666666666, 439.02191666666664, 440.0229166666667, 441.02391666666665], "recent_frames_sha256": "58b8866c1a055601860b016017614007acbc4acbd87afd9132f1e47c8c3194d6", "num_recent_frames": 30, "tq": 715206.332783277, "t1": 715217.222261554, "ta": 715217.222261554, "te": 715217.266714214, "first_response_s": 10.889478276949376, "answer_total_s": 10.933930936967954, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_296_a1799_q0", "video_id": 296, "time_stamp_s": 442, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ac46f97b0c67a443dd02e6177da7ae5fa17b7e8420ee1f0dc40ea57cb6557e73", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Cyclist rides uphill on a winding mountain road, wearing dark cycling gear and a backpack.  \n- On-screen data shows elevation gain, distance, and speed metrics, indicating a steep climb.  \n- Road curves along a grassy slope with distant mountains visible under a partly cloudy sky.\n[90-120s] - Cyclist rides uphill, speed increasing from 36 to 45 mph, with elevation gain shown as -3 to -9 meters.\n- Road curves along mountainous terrain, with a car briefly passing in the opposite direction.\n- On-screen data displays real-time metrics: distance, elevation, and pace, with a map outline of the route.\n[120-150s] - Cyclist maintains steady pace on winding mountain road, with speed and elevation data displayed on screen.\n- Road curves sharply to the right, with rocky terrain and sparse vegetation on the roadside.\n- Shadow of cyclist is visible on the road surface, indicating bright daylight conditions.\n[150-180s] - Cyclist maintains steady pace uphill, with speed fluctuating between 38–40 mph and elevation gain around 200–230 meters.  \n- Road curves sharply to the right, with guardrails visible on the right side and rocky terrain on the left.  \n- On-screen metrics show consistent power output (480–500 W) and negative elevation change (-7 to -8 meters).\n[180-210s] - Cyclist in black attire rides uphill, maintaining steady pace with speedometer showing 25–30 mph and elevation gain of -5 to -7%.\n- Road curves sharply, with guardrails on right and mountainside on left; occasional vehicles pass in opposite direction.\n- On-screen data displays cumulative distance (e.g., 4.2 miles) and elevation (e.g., 298 ft), indicating ongoing ascent.\n[210-240s] - Cyclist in black attire rides uphill on a winding mountain road, with speed and elevation data displayed on screen.\n- Road curves sharply to the right, bordered by rocky cliffs and distant snow-capped peaks under a partly cloudy sky.\n- On-screen metrics show decreasing speed and elevation gain, indicating a steep climb with negative elevation change.\n[240-270s] - Cyclist rides uphill on a winding mountain road, with speed fluctuating between 49–59 mph.  \n- Road curves sharply, bordered by steep rocky cliffs and distant snow-capped peaks.  \n- On-screen data shows elevation gain, distance, and temperature, indicating a challenging climb.\n[270-300s] - Cyclist ahead maintains steady pace on winding mountain road, gradually increasing distance from camera vehicle.  \n- Road curves sharply to the right, with guardrail on right side and steep mountain slope on left.  \n- On-screen display shows speed decreasing from 54 to 32 mph, elevation gain dropping from 0 to -8 meters, and distance to destination increasing.\n[300-330s] - Cyclist in black attire rides uphill, with speed and elevation data displayed on screen.\n- Road curves right, bordered by stone wall on right and mountains in background.\n- On-screen metrics show decreasing elevation gain and increasing pace as cyclist ascends.\n[330-360s] - Cyclist in black shorts and jersey rides uphill, leaning forward, with speed and elevation data displayed on screen.\n- Road curves right, bordered by stone wall on left and guardrail on right, with mountains in background.\n- On-screen metrics show increasing speed (e.g., 31 mph to 46 mph) and elevation gain (e.g., 660m to 730m) as cyclist ascends.\n[360-390s] - Cyclist in dark jersey and shorts rides a road bike on a winding mountain road, leaning into turns.\n- On-screen display shows real-time metrics: average speed (MPH), distance (MILES), and elevation gain (FEET), with a dynamic change in values.\n- Road curves through green hillsides with guardrails visible, and the cyclist maintains a steady pace.\n[390-420s] - Cyclist rides uphill on a winding mountain road, wearing a dark jersey and shorts with a backpack.  \n- On-screen data shows increasing elevation (e.g., 40m to 44m) and distance (e.g., 423m to 432m), with a steady descent in elevation gain.  \n- The road curves left, bordered by steep, rocky terrain and sparse vegetation under a partly cloudy sky.", "history_tokens": 990, "history_utf8_bytes": 4063, "recent_frame_times_s": [412.036625, 413.037625, 414.038625, 415.039625, 416.040625, 417.041625, 418.0009166666667, 419.00191666666666, 420.0029166666667, 421.00391666666667, 422.00491666666665, 423.0059166666667, 424.00691666666665, 425.0079166666667, 426.00891666666666, 427.00991666666664, 428.0109166666667, 429.01191666666665, 430.0129166666667, 431.01391666666666, 432.0149166666667, 433.01591666666667, 434.01691666666665, 435.0179166666667, 436.01891666666666, 437.0199166666667, 438.02091666666666, 439.02191666666664, 440.0229166666667, 441.02391666666665], "recent_frames_sha256": "58b8866c1a055601860b016017614007acbc4acbd87afd9132f1e47c8c3194d6", "num_recent_frames": 30, "tq": 710678.922658492, "t1": 710686.01249829, "ta": 710686.01249829, "te": 710686.363187837, "first_response_s": 7.08983979804907, "answer_total_s": 7.440529344952665, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 296, "content_group": "8494c2598c586cade2785f997075ec6348401e577016e01eee6baf22f44db197", "question": {"question_id": "sample_296_a1800_q0", "video_id": 296, "video_path": "./videos/sample_296_real.mp4", "annotation_index": 1800, "question_index": 0, "question": "Which of the following best describes the road's layout right now?", "options": ["A. The road is curving sharply to the right.", "B. The road is curving gently to the right.", "C. The road is straight with a slight downhill grade.", "D. The road is straight with a slight uphill grade."], "answer": "A", "time_stamp_s": 673, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [654, 674], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_296_a1800_q0", "video_id": 296, "time_stamp_s": 673, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a210319c498877c42db4f97294a34c3713533933e7bc996f40249e65edd0c052", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [643.017375, 644.018375, 645.019375, 646.020375, 647.021375, 648.022375, 649.023375, 650.024375, 651.025375, 652.026375, 653.027375, 654.028375, 655.029375, 656.030375, 657.031375, 658.032375, 659.033375, 660.034375, 661.035375, 662.036375, 663.037375, 664.038375, 665.039375, 666.040375, 667.041375, 668.0006666666667, 669.0016666666667, 670.0026666666666, 671.0036666666666, 672.0046666666667], "recent_frames_sha256": "4e420d4fddd6fb1a91f5b70e3147be0d2900826e188510fa47ad87553dca9f12", "num_recent_frames": 30, "tq": 715217.279687861, "t1": 715224.747961907, "ta": 715224.747961907, "te": 715224.785131959, "first_response_s": 7.468274045968428, "answer_total_s": 7.505444098031148, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_296_a1800_q0", "video_id": 296, "time_stamp_s": 673, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5f47cbc598f44ccb083f330e4971dfdb1fa7c3216fa2797eaedc8ea332c83477", "condition_order": ["notes", "recent"], "memory": "[330-360s] - Cyclist in black shorts and jersey rides uphill, leaning forward, with speed and elevation data displayed on screen.\n- Road curves right, bordered by stone wall on left and guardrail on right, with mountains in background.\n- On-screen metrics show increasing speed (e.g., 31 mph to 46 mph) and elevation gain (e.g., 660m to 730m) as cyclist ascends.\n[360-390s] - Cyclist in dark jersey and shorts rides a road bike on a winding mountain road, leaning into turns.\n- On-screen display shows real-time metrics: average speed (MPH), distance (MILES), and elevation gain (FEET), with a dynamic change in values.\n- Road curves through green hillsides with guardrails visible, and the cyclist maintains a steady pace.\n[390-420s] - Cyclist rides uphill on a winding mountain road, wearing a dark jersey and shorts with a backpack.  \n- On-screen data shows increasing elevation (e.g., 40m to 44m) and distance (e.g., 423m to 432m), with a steady descent in elevation gain.  \n- The road curves left, bordered by steep, rocky terrain and sparse vegetation under a partly cloudy sky.\n[420-450s] - Cyclist in dark jersey and shorts rides uphill on a paved mountain road, maintaining steady pace.\n- On-screen data shows increasing elevation gain (e.g., +600 ft) and decreasing average speed (e.g., 48 mph to 47 mph).\n- Road curves rightward, with guardrails on the right and mountainside vegetation on the left.\n[450-480s] - Cyclist in dark attire rides a bicycle on a mountain road, maintaining a steady pace.  \n- On-screen display shows speed increasing from 50 to 51 MPH and elevation gain of 0 feet.  \n- Road curves to the right, with a metal guardrail on the right side and mountains in the background.\n[480-510s] - Cyclist in black attire leans into a right-hand curve, maintaining speed while navigating the mountain road.  \n- On-screen data shows speed fluctuating between 48–52 MPH and elevation gain of 0 feet, with a -8 to -10 gradient.  \n- Roadside guardrail and rocky terrain flank the asphalt, with distant mountains visible under a partly cloudy sky.\n[510-540s] - Cyclist in black attire rides a bicycle on a winding mountain road, leaning into curves.  \n- On-screen metrics show speed (MPH), distance (MILES), and elevation gain (FEET) changing dynamically.  \n- A stone wall runs alongside the road, with distant mountains and greenery visible in the background.\n[540-570s] - Cyclist in dark jersey and shorts rides uphill, maintaining steady pace with speedometer showing increasing mph (40–47) and power (65–78W).  \n- Road curves along mountainous terrain with guardrails; a car passes in opposite direction at 5:52.  \n- On-screen data displays elevation gain, distance, and cadence, with cadence decreasing from -3 to -9.\n[570-600s] - Cyclist in black jersey and shorts rides a road bike, leaning into a curve with motion blur indicating high speed.\n- On-screen data shows \"MIN 50\" and \"PAR 80\" at 570s, transitioning to \"MIN 49\" and \"PAR 78\" at 572s, with \"DASH -8\" and \"WIND 14\" visible.\n- The road curves left, bordered by guardrails and rocky terrain, with the cyclist maintaining a steady pace.\n[600-630s] - Cyclist rides downhill past a stone building with green shutters, then enters a town with red-roofed buildings.  \n- On-screen metrics show decreasing average speed (e.g., 39 min/km to 32 min/km) and increasing power output (e.g., 224 W to 300 W).  \n- The cyclist maintains a steady pace, navigating curves and straightaways with minimal visible effort.\n[630-660s] - Cyclist rides uphill, speed decreasing from 33 to 32 mph, elevation gain increasing from 286 to 302 ft.\n- Road curves left, then right, with guardrails and rocky terrain on both sides.\n- On-screen display shows \"ELEV -2\" to \"ELEV -5\" as the cyclist ascends.", "history_tokens": 1019, "history_utf8_bytes": 3760, "recent_frame_times_s": [643.017375, 644.018375, 645.019375, 646.020375, 647.021375, 648.022375, 649.023375, 650.024375, 651.025375, 652.026375, 653.027375, 654.028375, 655.029375, 656.030375, 657.031375, 658.032375, 659.033375, 660.034375, 661.035375, 662.036375, 663.037375, 664.038375, 665.039375, 666.040375, 667.041375, 668.0006666666667, 669.0016666666667, 670.0026666666666, 671.0036666666666, 672.0046666666667], "recent_frames_sha256": "4e420d4fddd6fb1a91f5b70e3147be0d2900826e188510fa47ad87553dca9f12", "num_recent_frames": 30, "tq": 710753.325931882, "t1": 710755.225679432, "ta": 710755.225679432, "te": 710755.430330491, "first_response_s": 1.899747550021857, "answer_total_s": 2.10439860902261, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 296, "content_group": "8494c2598c586cade2785f997075ec6348401e577016e01eee6baf22f44db197", "question": {"question_id": "sample_296_a1801_q0", "video_id": 296, "video_path": "./videos/sample_296_real.mp4", "annotation_index": 1801, "question_index": 0, "question": "Where is the car relative to the cyclist right now?", "options": ["A. In front of the cyclist.", "B. Behind the cyclist.", "C. Beside the cyclist on the left.", "D. Beside the cyclist on the right."], "answer": "A", "time_stamp_s": 861, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [872, 892], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_296_a1801_q0", "video_id": 296, "time_stamp_s": 861, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7d57f7093a927fe4beac964a9fdb9ddf3eb1f57d25f9c3e7349396023d3899cb", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [831.0385416666667, 832.0395416666667, 833.0405416666666, 834.0415416666667, 835.0008333333334, 836.0018333333334, 837.0028333333333, 838.0038333333333, 839.0048333333333, 840.0058333333334, 841.0068333333334, 842.0078333333333, 843.0088333333333, 844.0098333333333, 845.0108333333334, 846.0118333333334, 847.0128333333333, 848.0138333333333, 849.0148333333333, 850.0158333333334, 851.0168333333334, 852.0178333333333, 853.0188333333333, 854.0198333333333, 855.0208333333334, 856.0218333333333, 857.0228333333333, 858.0238333333333, 859.0248333333333, 860.0258333333334], "recent_frames_sha256": "70ed634aa758190e916b4338581097408ce768ee237297ba8ef1a5b34999481d", "num_recent_frames": 30, "tq": 715224.796192735, "t1": 715236.436739087, "ta": 715236.436739087, "te": 715236.474735733, "first_response_s": 11.640546352020465, "answer_total_s": 11.678542998037301, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_296_a1801_q0", "video_id": 296, "time_stamp_s": 861, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ccba7b62b0cffb9f0ef6822168e252b283e2157fdeb258a00ad946218d06e733", "condition_order": ["notes", "recent"], "memory": "[540-570s] - Cyclist in dark jersey and shorts rides uphill, maintaining steady pace with speedometer showing increasing mph (40–47) and power (65–78W).  \n- Road curves along mountainous terrain with guardrails; a car passes in opposite direction at 5:52.  \n- On-screen data displays elevation gain, distance, and cadence, with cadence decreasing from -3 to -9.\n[570-600s] - Cyclist in black jersey and shorts rides a road bike, leaning into a curve with motion blur indicating high speed.\n- On-screen data shows \"MIN 50\" and \"PAR 80\" at 570s, transitioning to \"MIN 49\" and \"PAR 78\" at 572s, with \"DASH -8\" and \"WIND 14\" visible.\n- The road curves left, bordered by guardrails and rocky terrain, with the cyclist maintaining a steady pace.\n[600-630s] - Cyclist rides downhill past a stone building with green shutters, then enters a town with red-roofed buildings.  \n- On-screen metrics show decreasing average speed (e.g., 39 min/km to 32 min/km) and increasing power output (e.g., 224 W to 300 W).  \n- The cyclist maintains a steady pace, navigating curves and straightaways with minimal visible effort.\n[630-660s] - Cyclist rides uphill, speed decreasing from 33 to 32 mph, elevation gain increasing from 286 to 302 ft.\n- Road curves left, then right, with guardrails and rocky terrain on both sides.\n- On-screen display shows \"ELEV -2\" to \"ELEV -5\" as the cyclist ascends.\n[660-690s] - Cyclist rides downhill, speed decreasing from 39 to 26 mph as elevation drops from 100 to 157 ft.  \n- Road curves sharply; cyclist leans into turns, passing a white van and blue car.  \n- On-screen data shows negative elevation gain (-8 to -12 ft) and changing speed/altitude metrics.\n[690-720s] - Cyclist in black jersey rides uphill, passing a black SUV and a large truck on a mountain road.  \n- On-screen data shows decreasing elevation gain and negative climb percentage as the cyclist ascends.  \n- Road curves sharply, with rocky terrain on one side and guardrails on the other, indicating a steep, winding ascent.\n[720-750s] - Cyclist in black attire rides a road bike, leaning into a curve with visible motion blur.  \n- On-screen data shows speed increasing from 20 to 52 mph, elevation gain rising from 0 to 84 ft, and climb percentage fluctuating.  \n- Mountainous terrain with green slopes and stone retaining walls lines the road, with another cyclist visible ahead.\n[750-780s] - Cyclist maintains steady pace on winding mountain road, with speed fluctuating between 56 and 48 mph.  \n- Road passes through a tunnel, then emerges into a forested section with trees lining the right side.  \n- On-screen metrics show elevation gain, distance, and pace changing dynamically as the ride progresses.\n[780-810s] - Cyclist in dark jersey and helmet rides uphill, speed fluctuating between 37–41 mph, with elevation gain shown as +226 ft to +265 ft.\n- Road curves left, bordered by dense trees and rocky terrain, with a white van and black SUV passing in opposite direction.\n- On-screen display shows \"ELEVATION GAIN\" and \"SPEED\" metrics, with a \"CASA\" indicator and \"-2\" to \"-10\" value changing as the cyclist ascends.\n[810-840s] - Cyclist in dark jersey and shorts rides a road bike, leaning into curves with motion blur indicating speed.\n- On-screen display shows fluctuating speed (MPH) and distance (MILES) with a cumulative total of 102 miles at 810 seconds, increasing to 106 miles at 838 seconds.\n- Road is flanked by dense trees and mountains; occasional vehicles pass in the opposite direction.", "history_tokens": 949, "history_utf8_bytes": 3500, "recent_frame_times_s": [831.0385416666667, 832.0395416666667, 833.0405416666666, 834.0415416666667, 835.0008333333334, 836.0018333333334, 837.0028333333333, 838.0038333333333, 839.0048333333333, 840.0058333333334, 841.0068333333334, 842.0078333333333, 843.0088333333333, 844.0098333333333, 845.0108333333334, 846.0118333333334, 847.0128333333333, 848.0138333333333, 849.0148333333333, 850.0158333333334, 851.0168333333334, 852.0178333333333, 853.0188333333333, 854.0198333333333, 855.0208333333334, 856.0218333333333, 857.0228333333333, 858.0238333333333, 859.0248333333333, 860.0258333333334], "recent_frames_sha256": "70ed634aa758190e916b4338581097408ce768ee237297ba8ef1a5b34999481d", "num_recent_frames": 30, "tq": 715186.101222228, "t1": 715189.047552545, "ta": 715189.047552545, "te": 715189.091303915, "first_response_s": 2.9463303169468418, "answer_total_s": 2.9900816869921982, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 297, "content_group": "ff1ba24ceca7339a3e63f51747df47c7bfdfb3e296e2ecf9adf799e7ae4ac74f", "question": {"question_id": "sample_297_a483_q0", "video_id": 297, "video_path": "./videos/sample_297_real.mp4", "annotation_index": 483, "question_index": 0, "question": "Where is the hotel in relation to the cyclist right now?", "options": ["A. On the right side.", "B. On the left side.", "C. Behind the cyclist.", "D. Directly ahead."], "answer": "A", "time_stamp_s": 19, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_297_a483_q0", "video_id": 297, "time_stamp_s": 19, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b99172fd98da4063ed0911688bb0f5514a03f6684017e32e82e22f7270a2986e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018], "recent_frames_sha256": "b3f07fced370cd6cc844d6874dcecb51108303c707e0498c1d5c856e8f37ed43", "num_recent_frames": 19, "tq": 717496.90867187, "t1": 717497.701208367, "ta": 717497.701208367, "te": 717498.087500015, "first_response_s": 0.7925364969996735, "answer_total_s": 1.178828145028092, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_297_a483_q0", "video_id": 297, "time_stamp_s": 19, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d47d623646b694e86ad93df4d7a4f0c21c02c09fcf44389ddc420643a11ebd45", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018], "recent_frames_sha256": "b3f07fced370cd6cc844d6874dcecb51108303c707e0498c1d5c856e8f37ed43", "num_recent_frames": 19, "tq": 717269.600457304, "t1": 717278.321657743, "ta": 717278.321657743, "te": 717278.525938338, "first_response_s": 8.72120043891482, "answer_total_s": 8.925481033977121, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 297, "content_group": "ff1ba24ceca7339a3e63f51747df47c7bfdfb3e296e2ecf9adf799e7ae4ac74f", "question": {"question_id": "sample_297_a484_q0", "video_id": 297, "video_path": "./videos/sample_297_real.mp4", "annotation_index": 484, "question_index": 0, "question": "Where is the yellow vehicle located right now?", "options": ["A. On the right side of the road.", "B. Directly behind the cyclist.", "C. Directly in front of the cyclist.", "D. On the left side of the cyclist."], "answer": "A", "time_stamp_s": 224, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [212, 232], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_297_a484_q0", "video_id": 297, "time_stamp_s": 224, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "450bd4da6e26e27ae60e5a80d60fc84750c73809a82cecd0304223987159e3e5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.03416666666666, 202.03516666666667, 203.03616666666667, 204.03716666666668, 205.03816666666665, 206.03916666666666, 207.04016666666666, 208.04116666666667, 209.00045833333334, 210.00145833333335, 211.00245833333332, 212.00345833333333, 213.00445833333333, 214.00545833333334, 215.00645833333334, 216.00745833333335, 217.00845833333332, 218.00945833333333, 219.01045833333333, 220.01145833333334, 221.01245833333334, 222.01345833333335, 223.01445833333332], "recent_frames_sha256": "99e4be926a9acf1c19a24b8ed1625d0c789c8fb5fa8f86d7fbde59f25ef8933a", "num_recent_frames": 30, "tq": 717498.105166744, "t1": 717510.121384572, "ta": 717510.121384572, "te": 717510.159766039, "first_response_s": 12.016217828029767, "answer_total_s": 12.054599295021035, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_297_a484_q0", "video_id": 297, "time_stamp_s": 224, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "cd6cedae9f140fa587f02af2c517dde8f45161e076c15b3bd4da49f1e03c0001", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Cyclist in blue jersey rides uphill, followed by a POV rider, with speed and elevation data displayed on screen.  \n- A pedestrian in blue shirt walks across the road, briefly crossing in front of the cyclists.  \n- Roadside buildings and parked vehicles are visible as the cyclists ascend a mountain pass.\n[30-60s] - Cyclist in blue jersey rides uphill on a winding mountain road, with a white van overtaking from behind.  \n- On-screen data shows average gradient of 6.8% and distance of 16.1 km (10 mi) for Grimsel Pass.  \n- Rider’s hands and handlebars are visible in first-person view, with speed and elevation metrics displayed.\n[60-90s] - Cyclist in blue jersey rides ahead, maintaining steady pace on mountain road.  \n- Road curves right, with a red car visible in distance, indicating traffic presence.  \n- On-screen metrics show increasing speed (MPH) and elevation gain (feet), suggesting uphill climb.\n[90-120s] - Cyclist in blue jersey rides uphill, maintaining steady pace with GPS data showing speed and elevation gain.\n- Road curves along rocky mountain terrain, with clear sky and distant hills visible in background.\n- On-screen metrics fluctuate, indicating changing speed and elevation, with a consistent -8 elevation gain displayed.\n[120-150s] - Cyclist in blue jersey rides uphill, speed decreasing from 41 to 37 mph.\n- Road curves right, with a white van overtaking the cyclist.\n- Mountainous terrain with lake visible to the right, and a power line tower in the distance.\n[150-180s] - Cyclist in blue jersey maintains a steady pace, leaning into curves while riding uphill.  \n- On-screen metrics show speed decreasing from 46 to 30 mph and elevation gain increasing from 0 to 680 feet.  \n- Roadside scenery includes rocky cliffs, a lake, and passing vehicles, with the camera positioned behind the cyclist.\n[180-210s] - Cyclist in blue jersey rides uphill, leaning forward, with speedometer showing increasing mph (36 to 47) and elevation gain (278 to 295 ft).  \n- Road curves left, bordered by steep rocky cliffs and a lake on the left, with a concrete barrier separating the road from the cliffside.  \n- Handlebars and rider’s gloved hands are visible in foreground, with a GPS device mounted on the bike’s stem.", "history_tokens": 545, "history_utf8_bytes": 2251, "recent_frame_times_s": [194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.03416666666666, 202.03516666666667, 203.03616666666667, 204.03716666666668, 205.03816666666665, 206.03916666666666, 207.04016666666666, 208.04116666666667, 209.00045833333334, 210.00145833333335, 211.00245833333332, 212.00345833333333, 213.00445833333333, 214.00545833333334, 215.00645833333334, 216.00745833333335, 217.00845833333332, 218.00945833333333, 219.01045833333333, 220.01145833333334, 221.01245833333334, 222.01345833333335, 223.01445833333332], "recent_frames_sha256": "99e4be926a9acf1c19a24b8ed1625d0c789c8fb5fa8f86d7fbde59f25ef8933a", "num_recent_frames": 30, "tq": 717341.067290714, "t1": 717342.904094589, "ta": 717342.904094589, "te": 717343.350649344, "first_response_s": 1.8368038749322295, "answer_total_s": 2.2833586300257593, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 297, "content_group": "ff1ba24ceca7339a3e63f51747df47c7bfdfb3e296e2ecf9adf799e7ae4ac74f", "question": {"question_id": "sample_297_a485_q0", "video_id": 297, "video_path": "./videos/sample_297_real.mp4", "annotation_index": 485, "question_index": 0, "question": "What is located on the left side, parallel to the cyclists right now?", "options": ["A. A safety railing.", "B. A parking lot.", "C. A rest area.", "D. A grass field."], "answer": "A", "time_stamp_s": 438, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [424, 444], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_297_a485_q0", "video_id": 297, "time_stamp_s": 438, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a9ca85e1b01465083a34ab1a117f1722f6e6988d29dd33b156970ff19afbb6b3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [408.032625, 409.033625, 410.034625, 411.035625, 412.036625, 413.037625, 414.038625, 415.039625, 416.040625, 417.041625, 418.0009166666667, 419.00191666666666, 420.0029166666667, 421.00391666666667, 422.00491666666665, 423.0059166666667, 424.00691666666665, 425.0079166666667, 426.00891666666666, 427.00991666666664, 428.0109166666667, 429.01191666666665, 430.0129166666667, 431.01391666666666, 432.0149166666667, 433.01591666666667, 434.01691666666665, 435.0179166666667, 436.01891666666666, 437.0199166666667], "recent_frames_sha256": "c49d1d9966bbe3bfaee5052a1a6723e73504f0ef682d823abe1e6f5f744e1bf9", "num_recent_frames": 30, "tq": 717510.179370211, "t1": 717517.395550555, "ta": 717517.395550555, "te": 717517.432739802, "first_response_s": 7.216180343995802, "answer_total_s": 7.253369591082446, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_297_a485_q0", "video_id": 297, "time_stamp_s": 438, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5398d9578f01f8be37e440a73956000659f28cf63b3babd8488d322c2cfd7034", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Cyclist in blue jersey rides uphill on a winding mountain road, with a white van overtaking from behind.  \n- On-screen data shows average gradient of 6.8% and distance of 16.1 km (10 mi) for Grimsel Pass.  \n- Rider’s hands and handlebars are visible in first-person view, with speed and elevation metrics displayed.\n[60-90s] - Cyclist in blue jersey rides ahead, maintaining steady pace on mountain road.  \n- Road curves right, with a red car visible in distance, indicating traffic presence.  \n- On-screen metrics show increasing speed (MPH) and elevation gain (feet), suggesting uphill climb.\n[90-120s] - Cyclist in blue jersey rides uphill, maintaining steady pace with GPS data showing speed and elevation gain.\n- Road curves along rocky mountain terrain, with clear sky and distant hills visible in background.\n- On-screen metrics fluctuate, indicating changing speed and elevation, with a consistent -8 elevation gain displayed.\n[120-150s] - Cyclist in blue jersey rides uphill, speed decreasing from 41 to 37 mph.\n- Road curves right, with a white van overtaking the cyclist.\n- Mountainous terrain with lake visible to the right, and a power line tower in the distance.\n[150-180s] - Cyclist in blue jersey maintains a steady pace, leaning into curves while riding uphill.  \n- On-screen metrics show speed decreasing from 46 to 30 mph and elevation gain increasing from 0 to 680 feet.  \n- Roadside scenery includes rocky cliffs, a lake, and passing vehicles, with the camera positioned behind the cyclist.\n[180-210s] - Cyclist in blue jersey rides uphill, leaning forward, with speedometer showing increasing mph (36 to 47) and elevation gain (278 to 295 ft).  \n- Road curves left, bordered by steep rocky cliffs and a lake on the left, with a concrete barrier separating the road from the cliffside.  \n- Handlebars and rider’s gloved hands are visible in foreground, with a GPS device mounted on the bike’s stem.\n[210-240s] - Cyclist in blue jersey and helmet rides uphill, leaning forward, with handlebars and bike frame visible in foreground.\n- On-screen display shows fluctuating speed (e.g., 46 to 35 mph) and elevation gain (e.g., +2 to -4 ft), indicating dynamic terrain.\n- Road curves past rocky cliffs and tunnels, with a yellow truck passing in the distance.\n[240-270s] - Cyclist in blue jersey rides uphill, leaning forward, with speed and elevation data displayed on screen.\n- Road curves sharply to the right, bordered by rocky cliffs and sparse vegetation.\n- Camera perspective from a second cyclist’s handlebars, showing both riders in motion with changing speed metrics.\n[270-300s] - Cyclist in blue jersey rides ahead, maintaining steady pace on winding mountain road.\n- Camera perspective shows handlebars and rider’s gloved hands, indicating first-person view.\n- On-screen metrics display speed, elevation gain, and distance, with values fluctuating as terrain changes.\n[300-330s] - Cyclist in blue jersey rides ahead, maintaining steady pace on mountain road.  \n- On-screen data shows speed fluctuating between 46–48 mph and elevation gain of 1.8–2.2 miles.  \n- Road curves through rocky terrain with sparse vegetation, and a red car passes in the distance.\n[330-360s] - Cyclist in blue jersey rides ahead, maintaining pace on mountain road.\n- Tunnel entrance approaches; interior darkens as cyclists enter.\n- Speedometer shows fluctuating speeds (e.g., 46 to 40 mph) and elevation changes.\n[360-390s] - Cyclist in blue jersey and shorts rides ahead, leaning forward on a road with mountains and a lake in the background.\n- On-screen display shows speed decreasing from 35 to 34 mph, elevation gain of 560 ft, and distance of 4.5 miles.\n- Road curves right, with a truck passing in the opposite direction, and the cyclist maintains a steady pace.\n[390-420s] - Cyclist in blue jersey maintains steady pace, leaning slightly forward while riding uphill.\n- On-screen metrics show speed fluctuating between 32–34 mph and elevation gain increasing steadily.\n- Road curves rightward, bordered by rocky terrain and sparse vegetation, with a distant vehicle visible ahead.", "history_tokens": 1001, "history_utf8_bytes": 4117, "recent_frame_times_s": [408.032625, 409.033625, 410.034625, 411.035625, 412.036625, 413.037625, 414.038625, 415.039625, 416.040625, 417.041625, 418.0009166666667, 419.00191666666666, 420.0029166666667, 421.00391666666667, 422.00491666666665, 423.0059166666667, 424.00691666666665, 425.0079166666667, 426.00891666666666, 427.00991666666664, 428.0109166666667, 429.01191666666665, 430.0129166666667, 431.01391666666666, 432.0149166666667, 433.01591666666667, 434.01691666666665, 435.0179166666667, 436.01891666666666, 437.0199166666667], "recent_frames_sha256": "c49d1d9966bbe3bfaee5052a1a6723e73504f0ef682d823abe1e6f5f744e1bf9", "num_recent_frames": 30, "tq": 717388.676973357, "t1": 717390.137101016, "ta": 717390.137101016, "te": 717390.439507261, "first_response_s": 1.460127659025602, "answer_total_s": 1.7625339040532708, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 297, "content_group": "ff1ba24ceca7339a3e63f51747df47c7bfdfb3e296e2ecf9adf799e7ae4ac74f", "question": {"question_id": "sample_297_a486_q0", "video_id": 297, "video_path": "./videos/sample_297_real.mp4", "annotation_index": 486, "question_index": 0, "question": "What is located to the right side of the cyclist right now?", "options": ["A. An open field.", "B. A dense forest.", "C. A lake.", "D. A mountain range."], "answer": "A", "time_stamp_s": 655, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [636, 656], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_297_a486_q0", "video_id": 297, "time_stamp_s": 655, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c1c1653ff99b21429bb60ad1f73f57ad1a73b216182a4b6ceaad6f8659368ccf", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [625.0410833333333, 626.000375, 627.001375, 628.002375, 629.003375, 630.004375, 631.005375, 632.006375, 633.007375, 634.008375, 635.009375, 636.010375, 637.011375, 638.012375, 639.013375, 640.014375, 641.015375, 642.016375, 643.017375, 644.018375, 645.019375, 646.020375, 647.021375, 648.022375, 649.023375, 650.024375, 651.025375, 652.026375, 653.027375, 654.028375], "recent_frames_sha256": "ed241ce8e240c3e8c48d8acf89ea800746c8e0cb03c320bdf3395e6ce0181e60", "num_recent_frames": 30, "tq": 717517.45376895, "t1": 717524.440213429, "ta": 717524.440213429, "te": 717524.4775471, "first_response_s": 6.986444479087368, "answer_total_s": 7.023778150090948, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_297_a486_q0", "video_id": 297, "time_stamp_s": 655, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ec2d426b9d6fa507fa1147b82153433bc3c2713ec404645a96d7a385e32d4769", "condition_order": ["notes", "recent"], "memory": "[210-240s] - Cyclist in blue jersey and helmet rides uphill, leaning forward, with handlebars and bike frame visible in foreground.\n- On-screen display shows fluctuating speed (e.g., 46 to 35 mph) and elevation gain (e.g., +2 to -4 ft), indicating dynamic terrain.\n- Road curves past rocky cliffs and tunnels, with a yellow truck passing in the distance.\n[240-270s] - Cyclist in blue jersey rides uphill, leaning forward, with speed and elevation data displayed on screen.\n- Road curves sharply to the right, bordered by rocky cliffs and sparse vegetation.\n- Camera perspective from a second cyclist’s handlebars, showing both riders in motion with changing speed metrics.\n[270-300s] - Cyclist in blue jersey rides ahead, maintaining steady pace on winding mountain road.\n- Camera perspective shows handlebars and rider’s gloved hands, indicating first-person view.\n- On-screen metrics display speed, elevation gain, and distance, with values fluctuating as terrain changes.\n[300-330s] - Cyclist in blue jersey rides ahead, maintaining steady pace on mountain road.  \n- On-screen data shows speed fluctuating between 46–48 mph and elevation gain of 1.8–2.2 miles.  \n- Road curves through rocky terrain with sparse vegetation, and a red car passes in the distance.\n[330-360s] - Cyclist in blue jersey rides ahead, maintaining pace on mountain road.\n- Tunnel entrance approaches; interior darkens as cyclists enter.\n- Speedometer shows fluctuating speeds (e.g., 46 to 40 mph) and elevation changes.\n[360-390s] - Cyclist in blue jersey and shorts rides ahead, leaning forward on a road with mountains and a lake in the background.\n- On-screen display shows speed decreasing from 35 to 34 mph, elevation gain of 560 ft, and distance of 4.5 miles.\n- Road curves right, with a truck passing in the opposite direction, and the cyclist maintains a steady pace.\n[390-420s] - Cyclist in blue jersey maintains steady pace, leaning slightly forward while riding uphill.\n- On-screen metrics show speed fluctuating between 32–34 mph and elevation gain increasing steadily.\n- Road curves rightward, bordered by rocky terrain and sparse vegetation, with a distant vehicle visible ahead.\n[420-450s] - Cyclist in blue jersey leans forward, pedaling uphill on a winding mountain road.  \n- On-screen display shows speed fluctuating between 32–45 MPH and elevation gain of 205–290 feet.  \n- Rocky terrain and sparse vegetation flank the road, with occasional vehicles passing in the opposite direction.\n[450-480s] - Cyclist in blue jersey rides ahead, leaning into curves on mountain road.  \n- First-person view shows handlebars and gloved hands, with speed and elevation data displayed.  \n- Road winds through rocky terrain, with a guardrail visible on the right side.\n[480-510s] - Cyclist in blue jersey rides ahead, leaning into curves on mountain road.  \n- Camera wearer follows closely, with handlebars and feet visible in foreground.  \n- On-screen data shows speed increasing from 42 to 47 mph and elevation gain fluctuating.\n[510-540s] - Cyclist in blue jersey rides uphill, maintaining steady pace with speedometer showing 46–48 MPH.\n- Road curves through mountainous terrain with sparse vegetation and rocky cliffs on either side.\n- Other cyclists appear ahead, with one overtaking the main rider as they navigate the winding road.\n[540-570s] - Cyclist in black jersey and helmet rides ahead, maintaining pace through tunnel.\n- Tunnel interior features yellow lighting and concrete walls, with speedometer showing increasing mph.\n- On-screen display shows elevation gain and distance, indicating steady progress through the tunnel.\n[570-600s] - Cyclist in black jersey accelerates through tunnel, speed rising from 51 to 59 mph.\n- Tunnel walls show consistent lighting; exit visible ahead with bright daylight.\n- After tunnel, cyclist exits onto mountain road, following another rider in blue jersey.\n[600-630s] - Cyclist in blue jersey and shorts rides ahead, leaning into curves on mountain road.  \n- Camera wearer’s handlebars and gloved hands are visible, showing steady pursuit.  \n- On-screen display shows speed increasing from 28 to 47 mph and elevation gain from -6 to -2 feet.", "history_tokens": 1002, "history_utf8_bytes": 4191, "recent_frame_times_s": [625.0410833333333, 626.000375, 627.001375, 628.002375, 629.003375, 630.004375, 631.005375, 632.006375, 633.007375, 634.008375, 635.009375, 636.010375, 637.011375, 638.012375, 639.013375, 640.014375, 641.015375, 642.016375, 643.017375, 644.018375, 645.019375, 646.020375, 647.021375, 648.022375, 649.023375, 650.024375, 651.025375, 652.026375, 653.027375, 654.028375], "recent_frames_sha256": "ed241ce8e240c3e8c48d8acf89ea800746c8e0cb03c320bdf3395e6ce0181e60", "num_recent_frames": 30, "tq": 717439.858922747, "t1": 717440.880113476, "ta": 717440.880113476, "te": 717440.918230511, "first_response_s": 1.0211907289922237, "answer_total_s": 1.059307764051482, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 297, "content_group": "ff1ba24ceca7339a3e63f51747df47c7bfdfb3e296e2ecf9adf799e7ae4ac74f", "question": {"question_id": "sample_297_a487_q0", "video_id": 297, "video_path": "./videos/sample_297_real.mp4", "annotation_index": 487, "question_index": 0, "question": "What is on the right side of the cyclists right now?", "options": ["A. A brick wall.", "B. A bush.", "C. A field.", "D. A dense forest."], "answer": "A", "time_stamp_s": 847, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [848, 868], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_297_a487_q0", "video_id": 297, "time_stamp_s": 847, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "87e1f5145df43c2f4d7426e100b8096290213fa5733210197909e888a5766962", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [817.0245416666667, 818.0255416666666, 819.0265416666666, 820.0275416666667, 821.0285416666667, 822.0295416666667, 823.0305416666666, 824.0315416666666, 825.0325416666667, 826.0335416666667, 827.0345416666667, 828.0355416666666, 829.0365416666667, 830.0375416666667, 831.0385416666667, 832.0395416666667, 833.0405416666666, 834.0415416666667, 835.0008333333334, 836.0018333333334, 837.0028333333333, 838.0038333333333, 839.0048333333333, 840.0058333333334, 841.0068333333334, 842.0078333333333, 843.0088333333333, 844.0098333333333, 845.0108333333334, 846.0118333333334], "recent_frames_sha256": "6efcd19b1b44be9348b5c896a95579dd9108564a42782874af1b2e8ceb84a128", "num_recent_frames": 30, "tq": 717524.488143705, "t1": 717534.617338792, "ta": 717534.617338792, "te": 717534.654759958, "first_response_s": 10.129195087007247, "answer_total_s": 10.16661625308916, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_297_a487_q0", "video_id": 297, "time_stamp_s": 847, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "71447801705276081cfebac6b27af4732c6094f2cb7de5a1c9e96d874abad5ef", "condition_order": ["notes", "recent"], "memory": "[420-450s] - Cyclist in blue jersey leans forward, pedaling uphill on a winding mountain road.  \n- On-screen display shows speed fluctuating between 32–45 MPH and elevation gain of 205–290 feet.  \n- Rocky terrain and sparse vegetation flank the road, with occasional vehicles passing in the opposite direction.\n[450-480s] - Cyclist in blue jersey rides ahead, leaning into curves on mountain road.  \n- First-person view shows handlebars and gloved hands, with speed and elevation data displayed.  \n- Road winds through rocky terrain, with a guardrail visible on the right side.\n[480-510s] - Cyclist in blue jersey rides ahead, leaning into curves on mountain road.  \n- Camera wearer follows closely, with handlebars and feet visible in foreground.  \n- On-screen data shows speed increasing from 42 to 47 mph and elevation gain fluctuating.\n[510-540s] - Cyclist in blue jersey rides uphill, maintaining steady pace with speedometer showing 46–48 MPH.\n- Road curves through mountainous terrain with sparse vegetation and rocky cliffs on either side.\n- Other cyclists appear ahead, with one overtaking the main rider as they navigate the winding road.\n[540-570s] - Cyclist in black jersey and helmet rides ahead, maintaining pace through tunnel.\n- Tunnel interior features yellow lighting and concrete walls, with speedometer showing increasing mph.\n- On-screen display shows elevation gain and distance, indicating steady progress through the tunnel.\n[570-600s] - Cyclist in black jersey accelerates through tunnel, speed rising from 51 to 59 mph.\n- Tunnel walls show consistent lighting; exit visible ahead with bright daylight.\n- After tunnel, cyclist exits onto mountain road, following another rider in blue jersey.\n[600-630s] - Cyclist in blue jersey and shorts rides ahead, leaning into curves on mountain road.  \n- Camera wearer’s handlebars and gloved hands are visible, showing steady pursuit.  \n- On-screen display shows speed increasing from 28 to 47 mph and elevation gain from -6 to -2 feet.\n[630-660s] - Cyclist in blue jersey and helmet rides ahead, maintaining a steady posture on a paved road flanked by mountains.\n- On-screen display shows MPH, time, and elevation changes, indicating a continuous ride with fluctuating speed.\n- A dark-colored vehicle passes on the road to the left, moving in the same direction as the cyclist.\n[660-690s] - Cyclist in blue jersey rides ahead on paved road, surrounded by forested mountains.\n- On-screen display shows speed (MPH) and elevation (M) changing dynamically.\n- Road curves left, with vehicles and roadside signs visible in background.\n[690-720s] - Cyclist in blue jersey rides ahead, maintaining pace as camera follows from behind.  \n- Tunnel entrance is approached, then entered; interior lights illuminate the path.  \n- After exiting tunnel, road curves sharply; speed drops as cyclist navigates descent.\n[720-750s] - Cyclist in blue jersey rides ahead, leaning into curves on mountain road.  \n- First cyclist’s handlebars and gloved hands visible, with GPS display showing speed and elevation.  \n- Road bordered by trees and rocky cliffs, with a white van passing in the distance.\n[750-780s] - Cyclist in blue jersey and cap rides ahead, maintaining a steady pace on a winding mountain road.  \n- First-person view shows handlebars and a mounted device displaying speed (MPH) and elevation (ft) changing dynamically.  \n- Road flanked by dense pine trees and rocky mountains, with occasional passing vehicles visible.\n[780-810s] - Cyclist in blue jersey rides ahead, leaning forward, as camera follows from behind.  \n- Tunnel entrance visible ahead; interior has yellow walls and overhead lights.  \n- On-screen data shows increasing speed (MPH) and distance (miles) as cyclist enters tunnel.\n[810-840s] - Cyclist in blue jersey and shorts rides uphill, leaning forward, with speed decreasing from 46 to 36 mph.\n- Road curves through forested mountainside, with a white car overtaking the cyclist.\n- On-screen display shows elevation gain, distance, and speed, with a lightning bolt icon indicating a steep climb.", "history_tokens": 962, "history_utf8_bytes": 4084, "recent_frame_times_s": [817.0245416666667, 818.0255416666666, 819.0265416666666, 820.0275416666667, 821.0285416666667, 822.0295416666667, 823.0305416666666, 824.0315416666666, 825.0325416666667, 826.0335416666667, 827.0345416666667, 828.0355416666666, 829.0365416666667, 830.0375416666667, 831.0385416666667, 832.0395416666667, 833.0405416666666, 834.0415416666667, 835.0008333333334, 836.0018333333334, 837.0028333333333, 838.0038333333333, 839.0048333333333, 840.0058333333334, 841.0068333333334, 842.0078333333333, 843.0088333333333, 844.0098333333333, 845.0108333333334, 846.0118333333334], "recent_frames_sha256": "6efcd19b1b44be9348b5c896a95579dd9108564a42782874af1b2e8ceb84a128", "num_recent_frames": 30, "tq": 717484.916960691, "t1": 717496.845049438, "ta": 717496.845049438, "te": 717496.883920626, "first_response_s": 11.928088746964931, "answer_total_s": 11.9669599350309, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 298, "content_group": "041da1546378fc4599288459e23efbab8b3344cf044552b66a8a5140ea7bad7e", "question": {"question_id": "sample_298_a680_q0", "video_id": 298, "video_path": "./videos/sample_298_real.mp4", "annotation_index": 680, "question_index": 0, "question": "What is the position of the lake right now?", "options": ["A. On the left side.", "B. Behind the cyclist.", "C. Parallel to the road.", "D. At the foot of the mountains ahead.."], "answer": "D", "time_stamp_s": 6, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_298_a680_q0", "video_id": 298, "time_stamp_s": 6, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "85019ded6c8e1f817c51957179347c43c80634ff4bbdca43a1f11ade1f6b2ac5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0], "recent_frames_sha256": "3add6a72c2bef30927b927bc408c92f513faee2c23bd6fc4c6756b2b0f6f8d07", "num_recent_frames": 7, "tq": 718977.86943049, "t1": 718985.259925696, "ta": 718985.259925696, "te": 718985.298165679, "first_response_s": 7.390495205996558, "answer_total_s": 7.428735189023428, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_298_a680_q0", "video_id": 298, "time_stamp_s": 6, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "47652394fe422073d473bc9475d87e67ab5476aa96a8f4491c17b2eee633e0a8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0], "recent_frames_sha256": "3add6a72c2bef30927b927bc408c92f513faee2c23bd6fc4c6756b2b0f6f8d07", "num_recent_frames": 7, "tq": 719034.58523322, "t1": 719045.821756909, "ta": 719045.821756909, "te": 719045.860518555, "first_response_s": 11.236523689003661, "answer_total_s": 11.275285335024819, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 298, "content_group": "041da1546378fc4599288459e23efbab8b3344cf044552b66a8a5140ea7bad7e", "question": {"question_id": "sample_298_a681_q0", "video_id": 298, "video_path": "./videos/sample_298_real.mp4", "annotation_index": 681, "question_index": 0, "question": "Where is the cyclist heading right now?", "options": ["A. Back to the starting point.", "B. Towards an open field.", "C. Down a paved road.", "D. Towards a dense forest."], "answer": "D", "time_stamp_s": 194, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [175, 195], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_298_a681_q0", "video_id": 298, "time_stamp_s": 194, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b9acd45551066b4f7570abe518179a4fb658bd3ec0a0a1f5287587a444f6f877", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0], "recent_frames_sha256": "43cd59ce5eb5988cee70de92cb02363f0e2644d14a355534de3434f8c736aa6e", "num_recent_frames": 30, "tq": 718985.316037168, "t1": 718998.327208059, "ta": 718998.327208059, "te": 718998.365394765, "first_response_s": 13.011170890997164, "answer_total_s": 13.04935759701766, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_298_a681_q0", "video_id": 298, "time_stamp_s": 194, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c4bf74d236813a8874276959da275161f5865e5763cafdbc29a8905db559f123", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Rider in blue sleeves navigates rocky terrain, then descends a steep forest trail with trees on both sides.  \n- Transition to a wooden bridge over a stream, followed by a rapid descent through dense forest.  \n- Rider approaches a cliff edge with a panoramic view of a valley and distant mountains, hands gripping handlebars.\n[30-60s] - Mountain biker descends steep, rocky cliffside with handlebars visible, overlooking a valley and river below.  \n- Rider navigates narrow, uneven terrain with exposed red rock formations and sparse vegetation.  \n- Scene transitions to sunlit, snow-dusted landscape with distant peaks, suggesting a change in location or time of day.\n[60-90s] - Rider's hands grip handlebars with \"SINJ\" branding, navigating a narrow, mossy trail.  \n- Forested path surrounded by tall trees, with a small stream visible ahead.  \n- Trail transitions from rocky terrain to a dirt path, with the rider leaning into turns.\n[90-120s] - Rider descends a rocky, water-slicked trail with a mountain bike, navigating over wet stones and flowing water.\n- Hands grip handlebars as the bike moves forward, passing through a forested area with dense greenery on both sides.\n- The rider transitions from a steep, rocky descent to a more gradual, forested path, maintaining control while descending.\n[120-150s] - Rider's hands grip handlebars as bike traverses rocky terrain with forested background.\n- Bike descends steep, uneven path with visible moss and fallen leaves.\n- Landscape shifts to open vista with mountains and valley visible beyond rocky outcrop.\n[150-180s] - Rider's hands grip handlebars with \"SCHWALBE\" branding, navigating a narrow, mossy trail.  \n- Trail transitions from rocky terrain to dense forest, with trees lining both sides.  \n- Bike moves forward over uneven ground, passing under tree branches and over small rocks.", "history_tokens": 427, "history_utf8_bytes": 1857, "recent_frame_times_s": [165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0], "recent_frames_sha256": "43cd59ce5eb5988cee70de92cb02363f0e2644d14a355534de3434f8c736aa6e", "num_recent_frames": 30, "tq": 719121.336613325, "t1": 719123.640863854, "ta": 719123.640863854, "te": 719123.682525952, "first_response_s": 2.3042505289195105, "answer_total_s": 2.3459126269444823, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 298, "content_group": "041da1546378fc4599288459e23efbab8b3344cf044552b66a8a5140ea7bad7e", "question": {"question_id": "sample_298_a682_q0", "video_id": 298, "video_path": "./videos/sample_298_real.mp4", "annotation_index": 682, "question_index": 0, "question": "Where is the yellow caution sign located right now?", "options": ["A. On a tree to the right.", "B. Ahead on the ground.", "C. Behind the cyclist.", "D. On a tree to the left."], "answer": "D", "time_stamp_s": 352, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [350, 370], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_298_a682_q0", "video_id": 298, "time_stamp_s": 352, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0b09210626a60d415a0967551f22a735388ce8c730b8b8e9fcc5e58c1a663fe2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0], "recent_frames_sha256": "f5878030756ccb54964887f3567897850c1331963db9212db43459bf9b199761", "num_recent_frames": 30, "tq": 718998.390583613, "t1": 719006.390497056, "ta": 719006.390497056, "te": 719006.428503736, "first_response_s": 7.999913442996331, "answer_total_s": 8.037920123082586, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_298_a682_q0", "video_id": 298, "time_stamp_s": 352, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7aa1a6fa7e0c1042f9c0819ef6d06b0b078b0f7e076294ee2b11226671a355d3", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Rider in blue sleeves navigates rocky terrain, then descends a steep forest trail with trees on both sides.  \n- Transition to a wooden bridge over a stream, followed by a rapid descent through dense forest.  \n- Rider approaches a cliff edge with a panoramic view of a valley and distant mountains, hands gripping handlebars.\n[30-60s] - Mountain biker descends steep, rocky cliffside with handlebars visible, overlooking a valley and river below.  \n- Rider navigates narrow, uneven terrain with exposed red rock formations and sparse vegetation.  \n- Scene transitions to sunlit, snow-dusted landscape with distant peaks, suggesting a change in location or time of day.\n[60-90s] - Rider's hands grip handlebars with \"SINJ\" branding, navigating a narrow, mossy trail.  \n- Forested path surrounded by tall trees, with a small stream visible ahead.  \n- Trail transitions from rocky terrain to a dirt path, with the rider leaning into turns.\n[90-120s] - Rider descends a rocky, water-slicked trail with a mountain bike, navigating over wet stones and flowing water.\n- Hands grip handlebars as the bike moves forward, passing through a forested area with dense greenery on both sides.\n- The rider transitions from a steep, rocky descent to a more gradual, forested path, maintaining control while descending.\n[120-150s] - Rider's hands grip handlebars as bike traverses rocky terrain with forested background.\n- Bike descends steep, uneven path with visible moss and fallen leaves.\n- Landscape shifts to open vista with mountains and valley visible beyond rocky outcrop.\n[150-180s] - Rider's hands grip handlebars with \"SCHWALBE\" branding, navigating a narrow, mossy trail.  \n- Trail transitions from rocky terrain to dense forest, with trees lining both sides.  \n- Bike moves forward over uneven ground, passing under tree branches and over small rocks.\n[180-210s] - Rider's hands grip handlebars with \"SPECIALIZED\" branding, navigating a rocky trail.  \n- Bike traverses a steep, wet rock face, then descends a forested dirt path with scattered logs.  \n- Scene shifts to a wide, open rock ridge with distant mountains visible, suggesting a transition in terrain.\n[210-240s] - Rider navigates rocky terrain with visible hands gripping handlebars, moving forward over uneven ground.\n- Bike traverses a narrow wooden bridge spanning a gap, with trees and distant mountains visible in background.\n- Scene transitions to forest trail with dense greenery, showing rider descending a steep, rocky slope.\n[240-270s] - Rider grips handlebars of a mountain bike, navigating a rocky, forested trail with visible tree trunks and uneven terrain.  \n- The scene transitions from daylight to nighttime, with the rider’s headlight illuminating the path ahead in darkness.  \n- The bike’s front wheel and handlebars are consistently visible, indicating continuous forward motion along the trail.\n[270-300s] - Rider's hands grip handlebars, steering a mountain bike along a narrow, tree-lined trail at night.  \n- Headlight illuminates the path ahead, revealing mossy ground and dense foliage on either side.  \n- Trail curves slightly, with the rider navigating through uneven terrain and occasional tree roots.\n[300-330s] - Rider’s hands grip handlebars with visible brake levers and gear shifters as they descend a rocky trail.  \n- The trail transitions from a steep, narrow path to a wider, more open rocky descent with sparse vegetation.  \n- A distant figure in red clothing is visible ahead on the trail, suggesting a companion or marker.", "history_tokens": 803, "history_utf8_bytes": 3532, "recent_frame_times_s": [323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0], "recent_frames_sha256": "f5878030756ccb54964887f3567897850c1331963db9212db43459bf9b199761", "num_recent_frames": 30, "tq": 719171.286839165, "t1": 719178.228163334, "ta": 719178.228163334, "te": 719178.267583976, "first_response_s": 6.941324168932624, "answer_total_s": 6.980744811007753, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 298, "content_group": "041da1546378fc4599288459e23efbab8b3344cf044552b66a8a5140ea7bad7e", "question": {"question_id": "sample_298_a683_q0", "video_id": 298, "video_path": "./videos/sample_298_real.mp4", "annotation_index": 683, "question_index": 0, "question": "Where is the cyclist heading right now?", "options": ["A. Up a steep hill.", "B. Across a wooden bridge.", "C. Through an open field.", "D. Down a narrow trail."], "answer": "D", "time_stamp_s": 535, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [525, 545], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_298_a683_q0", "video_id": 298, "time_stamp_s": 535, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d52f11a167f7e6875b45d61248061f0a1defa2fc030d6d3a4546fd7e702c82fc", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0], "recent_frames_sha256": "0b8c6ee6e02ba620b9be109c215236bff2b114128d5a54c72ce5e179da479e17", "num_recent_frames": 30, "tq": 719006.444036299, "t1": 719019.316975786, "ta": 719019.316975786, "te": 719019.355246354, "first_response_s": 12.872939486987889, "answer_total_s": 12.911210054997355, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_298_a683_q0", "video_id": 298, "time_stamp_s": 535, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d4d8af8224c7888df7eec496023de1f7a3ff38053c7d0688dc4a063e071c3fc0", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Rider descends a rocky, water-slicked trail with a mountain bike, navigating over wet stones and flowing water.\n- Hands grip handlebars as the bike moves forward, passing through a forested area with dense greenery on both sides.\n- The rider transitions from a steep, rocky descent to a more gradual, forested path, maintaining control while descending.\n[120-150s] - Rider's hands grip handlebars as bike traverses rocky terrain with forested background.\n- Bike descends steep, uneven path with visible moss and fallen leaves.\n- Landscape shifts to open vista with mountains and valley visible beyond rocky outcrop.\n[150-180s] - Rider's hands grip handlebars with \"SCHWALBE\" branding, navigating a narrow, mossy trail.  \n- Trail transitions from rocky terrain to dense forest, with trees lining both sides.  \n- Bike moves forward over uneven ground, passing under tree branches and over small rocks.\n[180-210s] - Rider's hands grip handlebars with \"SPECIALIZED\" branding, navigating a rocky trail.  \n- Bike traverses a steep, wet rock face, then descends a forested dirt path with scattered logs.  \n- Scene shifts to a wide, open rock ridge with distant mountains visible, suggesting a transition in terrain.\n[210-240s] - Rider navigates rocky terrain with visible hands gripping handlebars, moving forward over uneven ground.\n- Bike traverses a narrow wooden bridge spanning a gap, with trees and distant mountains visible in background.\n- Scene transitions to forest trail with dense greenery, showing rider descending a steep, rocky slope.\n[240-270s] - Rider grips handlebars of a mountain bike, navigating a rocky, forested trail with visible tree trunks and uneven terrain.  \n- The scene transitions from daylight to nighttime, with the rider’s headlight illuminating the path ahead in darkness.  \n- The bike’s front wheel and handlebars are consistently visible, indicating continuous forward motion along the trail.\n[270-300s] - Rider's hands grip handlebars, steering a mountain bike along a narrow, tree-lined trail at night.  \n- Headlight illuminates the path ahead, revealing mossy ground and dense foliage on either side.  \n- Trail curves slightly, with the rider navigating through uneven terrain and occasional tree roots.\n[300-330s] - Rider’s hands grip handlebars with visible brake levers and gear shifters as they descend a rocky trail.  \n- The trail transitions from a steep, narrow path to a wider, more open rocky descent with sparse vegetation.  \n- A distant figure in red clothing is visible ahead on the trail, suggesting a companion or marker.\n[330-360s] - Rider's hands grip handlebars with \"SPECIALIZED\" branding, navigating rocky terrain.  \n- Bike traverses a narrow, mossy path flanked by tall trees and dense undergrowth.  \n- Path transitions from rocky to wooden bridge, then to dirt trail with visible roots and stones.\n[360-390s] - Rider's hands grip handlebars with \"Dirt\" branding, wearing a watch on left wrist.  \n- Bike traverses a narrow, rocky trail flanked by dense green trees.  \n- Trail transitions from wooden planks to natural dirt path, with a yellow warning sign visible ahead.\n[390-420s] - Rider's hands grip handlebars of a blue mountain bike as it traverses a mossy, rocky terrain.  \n- The bike moves over a wooden plank bridge, then descends a steep, tree-lined trail.  \n- Rider approaches a large rock formation, with the bike's front wheel positioned near its edge.\n[420-450s] - Rider's hands grip handlebars as bike descends steep, rocky slope with mossy terrain.  \n- Bike traverses narrow, uneven path bordered by dense green trees and exposed rock faces.  \n- Rider leans into turns, navigating rocky outcrops with visible mountainous backdrop.\n[450-480s] - Rider's hands grip handlebars of a blue mountain bike as they descend a mossy rock face.  \n- Bike transitions from rocky terrain to a forest trail covered in fallen leaves.  \n- Forest path winds through tall trees with visible green undergrowth and scattered autumn foliage.\n[480-510s] - Rider's hands grip handlebars of a mountain bike, navigating a mossy, rocky trail through dense forest.  \n- Trail features uneven terrain with visible roots, rocks, and patches of moss, requiring careful maneuvering.  \n- Camera angle shifts slightly as the rider descends, revealing a narrow path flanked by tall trees and underbrush.", "history_tokens": 1013, "history_utf8_bytes": 4352, "recent_frame_times_s": [506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0], "recent_frames_sha256": "0b8c6ee6e02ba620b9be109c215236bff2b114128d5a54c72ce5e179da479e17", "num_recent_frames": 30, "tq": 719230.380749181, "t1": 719232.678683315, "ta": 719232.678683315, "te": 719232.716851359, "first_response_s": 2.2979341340251267, "answer_total_s": 2.3361021779710427, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 298, "content_group": "041da1546378fc4599288459e23efbab8b3344cf044552b66a8a5140ea7bad7e", "question": {"question_id": "sample_298_a684_q0", "video_id": 298, "video_path": "./videos/sample_298_real.mp4", "annotation_index": 684, "question_index": 0, "question": "What is the cyclist approaching right now?", "options": ["A. A rocky path.", "B. A steep uphill.", "C. A narrow bridge.", "D. Some fallen trees."], "answer": "D", "time_stamp_s": 709, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [700, 720], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_298_a684_q0", "video_id": 298, "time_stamp_s": 709, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4adddff8d69d720c1bb6f9f9d33daa76ada59b63ae2d83707a62c4a91bc34709", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [680.0, 681.0, 682.0, 683.0, 684.0, 685.0, 686.0, 687.0, 688.0, 689.0, 690.0, 691.0, 692.0, 693.0, 694.0, 695.0, 696.0, 697.0, 698.0, 699.0, 700.0, 701.0, 702.0, 703.0, 704.0, 705.0, 706.0, 707.0, 708.0, 709.0], "recent_frames_sha256": "dde07e583fab5bf258668b2f699ab7ff67a1d6ea8c372a8dc786b630bf5e2cce", "num_recent_frames": 30, "tq": 719019.368119505, "t1": 719034.532677797, "ta": 719034.532677797, "te": 719034.569701575, "first_response_s": 15.164558292017318, "answer_total_s": 15.201582069974393, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_298_a684_q0", "video_id": 298, "time_stamp_s": 709, "ground_truth": "D", "raw_output": "A. A rocky path.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "15b0f2315addab7d656b5f5566cfa833bce919ed0fa400e2a4623ead3a7972e2", "condition_order": ["recent", "notes"], "memory": "[270-300s] - Rider's hands grip handlebars, steering a mountain bike along a narrow, tree-lined trail at night.  \n- Headlight illuminates the path ahead, revealing mossy ground and dense foliage on either side.  \n- Trail curves slightly, with the rider navigating through uneven terrain and occasional tree roots.\n[300-330s] - Rider’s hands grip handlebars with visible brake levers and gear shifters as they descend a rocky trail.  \n- The trail transitions from a steep, narrow path to a wider, more open rocky descent with sparse vegetation.  \n- A distant figure in red clothing is visible ahead on the trail, suggesting a companion or marker.\n[330-360s] - Rider's hands grip handlebars with \"SPECIALIZED\" branding, navigating rocky terrain.  \n- Bike traverses a narrow, mossy path flanked by tall trees and dense undergrowth.  \n- Path transitions from rocky to wooden bridge, then to dirt trail with visible roots and stones.\n[360-390s] - Rider's hands grip handlebars with \"Dirt\" branding, wearing a watch on left wrist.  \n- Bike traverses a narrow, rocky trail flanked by dense green trees.  \n- Trail transitions from wooden planks to natural dirt path, with a yellow warning sign visible ahead.\n[390-420s] - Rider's hands grip handlebars of a blue mountain bike as it traverses a mossy, rocky terrain.  \n- The bike moves over a wooden plank bridge, then descends a steep, tree-lined trail.  \n- Rider approaches a large rock formation, with the bike's front wheel positioned near its edge.\n[420-450s] - Rider's hands grip handlebars as bike descends steep, rocky slope with mossy terrain.  \n- Bike traverses narrow, uneven path bordered by dense green trees and exposed rock faces.  \n- Rider leans into turns, navigating rocky outcrops with visible mountainous backdrop.\n[450-480s] - Rider's hands grip handlebars of a blue mountain bike as they descend a mossy rock face.  \n- Bike transitions from rocky terrain to a forest trail covered in fallen leaves.  \n- Forest path winds through tall trees with visible green undergrowth and scattered autumn foliage.\n[480-510s] - Rider's hands grip handlebars of a mountain bike, navigating a mossy, rocky trail through dense forest.  \n- Trail features uneven terrain with visible roots, rocks, and patches of moss, requiring careful maneuvering.  \n- Camera angle shifts slightly as the rider descends, revealing a narrow path flanked by tall trees and underbrush.\n[510-540s] - Rider's hands grip handlebars with blue sleeves, navigating a forest trail.  \n- Bike's front wheel passes over a mossy log, with trees lining the narrow path.  \n- Trail surface transitions from dirt to rocky terrain, with rider adjusting grip.\n[540-570s] - Rider's hands grip handlebars with visible watch on left wrist, navigating a forest trail.  \n- Trail transitions from mossy ground to rocky, uneven terrain with sparse vegetation.  \n- Background shows dense trees and distant mountains, indicating a steep descent.\n[570-600s] - Biker's hands grip handlebars with \"SINOSKE\" branding, navigating a rocky trail.  \n- Trail winds along a cliffside with trees and a lake visible below, bathed in golden sunset light.  \n- Biker leans into turns, with camera angle shifting to show rocky terrain and sparse vegetation.\n[600-630s] - Rider's hands grip handlebars with \"PRO\" branding, navigating a dirt trail through dense forest.  \n- Bike traverses a wooden boardwalk section, then descends a rocky, root-filled slope.  \n- Forest canopy overhead shifts as rider moves forward, with trees and underbrush visible on either side.\n[630-660s] - Rider navigates a rocky, forested trail with visible tree roots and uneven terrain.  \n- A wooden bridge is crossed, followed by a steep, rocky descent with exposed rock faces.  \n- A yellow warning sign is briefly visible on the right side of the trail, indicating a hazard or steep section.\n[660-690s] - Rider's hands grip handlebars of a mountain bike as they navigate a steep, rocky trail through a forest.  \n- The trail transitions from dense greenery to an open area with visible tree stumps and fallen logs.  \n- Distant mountains and a lake are visible in the background as the rider descends a rugged, dirt path.", "history_tokens": 995, "history_utf8_bytes": 4182, "recent_frame_times_s": [680.0, 681.0, 682.0, 683.0, 684.0, 685.0, 686.0, 687.0, 688.0, 689.0, 690.0, 691.0, 692.0, 693.0, 694.0, 695.0, 696.0, 697.0, 698.0, 699.0, 700.0, 701.0, 702.0, 703.0, 704.0, 705.0, 706.0, 707.0, 708.0, 709.0], "recent_frames_sha256": "dde07e583fab5bf258668b2f699ab7ff67a1d6ea8c372a8dc786b630bf5e2cce", "num_recent_frames": 30, "tq": 719278.823571276, "t1": 719286.018335262, "ta": 719286.018335262, "te": 719286.327300633, "first_response_s": 7.194763985928148, "answer_total_s": 7.503729356918484, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 299, "content_group": "a5b55d78e7940f1016830c09adc479fd85389215597d1fcdc3db530439cc3bb4", "question": {"question_id": "sample_299_a1495_q0", "video_id": 299, "video_path": "./videos/sample_299_real.mp4", "annotation_index": 1495, "question_index": 0, "question": "Which structure is visible overhead right now?", "options": ["A. A traffic signal.", "B. A restaurant sign.", "C. A store roof.", "D. A pedestrian bridge."], "answer": "D", "time_stamp_s": 13, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_299_a1495_q0", "video_id": 299, "time_stamp_s": 13, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "143b3473e8d75efffb23a3e62b3b1f5fd0669b7c5844ffe416cd1bbb158654f2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0], "recent_frames_sha256": "dd00f3118a74c22eb0ec6d084a8d3b037959f6275503aaff88fb7affbd3a57d9", "num_recent_frames": 14, "tq": 719657.080221928, "t1": 719662.50073323, "ta": 719662.50073323, "te": 719662.538149719, "first_response_s": 5.420511302072555, "answer_total_s": 5.457927791052498, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_299_a1495_q0", "video_id": 299, "time_stamp_s": 13, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cf33c4b022fc14c4ce3f06050eee34c291c26bcc170b2cc8487894e8f30c22f7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0], "recent_frames_sha256": "dd00f3118a74c22eb0ec6d084a8d3b037959f6275503aaff88fb7affbd3a57d9", "num_recent_frames": 14, "tq": 719517.691911189, "t1": 719523.521520899, "ta": 719523.521520899, "te": 719523.890479568, "first_response_s": 5.82960971002467, "answer_total_s": 6.1985683790408075, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 299, "content_group": "a5b55d78e7940f1016830c09adc479fd85389215597d1fcdc3db530439cc3bb4", "question": {"question_id": "sample_299_a1496_q0", "video_id": 299, "video_path": "./videos/sample_299_real.mp4", "annotation_index": 1496, "question_index": 0, "question": "What is directly ahead of the motorcyclists right now?", "options": ["A. A construction crane.", "B. A green building.", "C. A hospital.", "D. A Michelin sign."], "answer": "D", "time_stamp_s": 121, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [115, 135], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_299_a1496_q0", "video_id": 299, "time_stamp_s": 121, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "80912b29a07a9bb0275d92ce762b0ca6f91818195b3f67d0cb1b143fd543425c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0], "recent_frames_sha256": "a60029dabd80d331887c58103244855e51feb70fad71403b8e3a4b24a337ea11", "num_recent_frames": 30, "tq": 719662.546403589, "t1": 719675.895893172, "ta": 719675.895893172, "te": 719675.934426056, "first_response_s": 13.349489583051763, "answer_total_s": 13.38802246702835, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_299_a1496_q0", "video_id": 299, "time_stamp_s": 121, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ef5fc47f62a42c96da28babaf3cc29c70cb44510d620e9f5563ff2099e5f65f7", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rider Lukas Maurer on a green motorcycle leads a pack through a city street circuit, overtaking competitors.  \n- The camera shows a first-person view with a digital dashboard displaying speed and lap time, indicating active racing.  \n- Yellow barriers line the track, with urban buildings and spectators visible in the background as the race progresses.\n[30-60s] - Motorcyclist in red gear leans into turns, closely following another rider on a green bike.  \n- Yellow barriers line the track, with buildings and trees visible in the background.  \n- Camera perspective shows the green motorcycle’s dashboard, indicating speed and gear changes.\n[60-90s] - Motorcyclist ahead leans into a right turn, maintaining speed past yellow barriers.  \n- Camera rider follows closely, navigating a similar curve with blurred surroundings.  \n- Urban buildings and trees line the track, with sunlight casting sharp shadows.\n[90-120s] - A rider on a red motorcycle leans into a turn, closely followed by a green motorcycle with a visible rider's shadow.  \n- Yellow and red striped barriers line the track, with urban buildings and trees visible in the background.  \n- Text overlay at 1:07 states \"Rider is okay,\" indicating a safety check or reassurance during the race.", "history_tokens": 276, "history_utf8_bytes": 1266, "recent_frame_times_s": [92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0], "recent_frames_sha256": "a60029dabd80d331887c58103244855e51feb70fad71403b8e3a4b24a337ea11", "num_recent_frames": 30, "tq": 719560.584803468, "t1": 719562.50592482, "ta": 719562.50592482, "te": 719562.879214567, "first_response_s": 1.921121352002956, "answer_total_s": 2.294411099050194, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 299, "content_group": "a5b55d78e7940f1016830c09adc479fd85389215597d1fcdc3db530439cc3bb4", "question": {"question_id": "sample_299_a1497_q0", "video_id": 299, "video_path": "./videos/sample_299_real.mp4", "annotation_index": 1497, "question_index": 0, "question": "Where are the yellow and black barriers located right now?", "options": ["A. Only on the left side of the road.", "B. Only on the right side of the road.", "C. In the middle of the road.", "D. On both sides of the road."], "answer": "D", "time_stamp_s": 246, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [230, 250], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_299_a1497_q0", "video_id": 299, "time_stamp_s": 246, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "727673369c3044657c6704c791a333c8f6f4923ea881974550a226418f83a005", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0], "recent_frames_sha256": "8774de42b0a2b0e245b6ef5597a702c4d5ddd5dcd657d3826a95017c8243be61", "num_recent_frames": 30, "tq": 719675.944687689, "t1": 719683.506727062, "ta": 719683.506727062, "te": 719683.546203185, "first_response_s": 7.562039373093285, "answer_total_s": 7.601515496033244, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_299_a1497_q0", "video_id": 299, "time_stamp_s": 246, "ground_truth": "D", "raw_output": "D. On both sides of the road.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "851bd65bdcc7f0e340fc1ddf64eb2fa0878967553711b4cdf10611af19f0d305", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rider Lukas Maurer on a green motorcycle leads a pack through a city street circuit, overtaking competitors.  \n- The camera shows a first-person view with a digital dashboard displaying speed and lap time, indicating active racing.  \n- Yellow barriers line the track, with urban buildings and spectators visible in the background as the race progresses.\n[30-60s] - Motorcyclist in red gear leans into turns, closely following another rider on a green bike.  \n- Yellow barriers line the track, with buildings and trees visible in the background.  \n- Camera perspective shows the green motorcycle’s dashboard, indicating speed and gear changes.\n[60-90s] - Motorcyclist ahead leans into a right turn, maintaining speed past yellow barriers.  \n- Camera rider follows closely, navigating a similar curve with blurred surroundings.  \n- Urban buildings and trees line the track, with sunlight casting sharp shadows.\n[90-120s] - A rider on a red motorcycle leans into a turn, closely followed by a green motorcycle with a visible rider's shadow.  \n- Yellow and red striped barriers line the track, with urban buildings and trees visible in the background.  \n- Text overlay at 1:07 states \"Rider is okay,\" indicating a safety check or reassurance during the race.\n[120-150s] - Rider Lukas Maurer follows a lead motorcycle through a city street circuit, maintaining a consistent distance.  \n- The camera perspective is from a green motorcycle, showing dashboard indicators and the rider’s view.  \n- Yellow and black barriers line the track, with urban buildings and a bridge visible in the background.\n[150-180s] - Rider Lukas Mauser speeds along a city track, with sun glare visible through the windshield.  \n- The camera captures a blurred urban environment, including buildings and barriers, as the motorcycle navigates turns.  \n- A digital dashboard displays speed and gear information, indicating high velocity during the ride.\n[180-210s] - Rider Lukas Maurer speeds along a city street, with blurred buildings and yellow barriers on either side.  \n- The sun glints off the road ahead, casting long shadows as the rider navigates through urban infrastructure.  \n- The camera angle shifts slightly, showing the rider’s silhouette against the bright sky as they pass under an overpass.\n[210-240s] - Rider Lukas Maurer on teal motorcycle navigates a winding urban track bordered by yellow-and-black barriers.  \n- The track curves through a cityscape with modern buildings and greenery, under clear blue skies.  \n- Camera follows from a low angle, capturing motion blur as the motorcycle speeds along the road.", "history_tokens": 571, "history_utf8_bytes": 2617, "recent_frame_times_s": [217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0], "recent_frames_sha256": "8774de42b0a2b0e245b6ef5597a702c4d5ddd5dcd657d3826a95017c8243be61", "num_recent_frames": 30, "tq": 719596.377836515, "t1": 719597.571674799, "ta": 719597.571674799, "te": 719597.922607878, "first_response_s": 1.1938382840016857, "answer_total_s": 1.5447713630273938, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 299, "content_group": "a5b55d78e7940f1016830c09adc479fd85389215597d1fcdc3db530439cc3bb4", "question": {"question_id": "sample_299_a1498_q0", "video_id": 299, "video_path": "./videos/sample_299_real.mp4", "annotation_index": 1498, "question_index": 0, "question": "Where are the red and white barriers located right now?", "options": ["A. On both sides of the road.", "B. Only on the right side of the road.", "C. In the middle of the road.", "D. Only on the left side of the road."], "answer": "D", "time_stamp_s": 347, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [345, 365], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_299_a1498_q0", "video_id": 299, "time_stamp_s": 347, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8403076fce3870ea2f79c6adfc29010b107bf48e6c6bf2186fa0d03f206a2e2c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0], "recent_frames_sha256": "11a10e72db73db277240556d43abf6681d891fbcbd6c3bfbec3c10aaa2ae80e1", "num_recent_frames": 30, "tq": 719683.557861907, "t1": 719690.521297242, "ta": 719690.521297242, "te": 719690.559561343, "first_response_s": 6.963435335084796, "answer_total_s": 7.001699436106719, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_299_a1498_q0", "video_id": 299, "time_stamp_s": 347, "ground_truth": "D", "raw_output": "A. On both sides of the road.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "d3c4683a6e52a6d8c91e3c53c3b60c01ea7e4991508d0d8b4240d616c645afdf", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rider Lukas Maurer on a green motorcycle leads a pack through a city street circuit, overtaking competitors.  \n- The camera shows a first-person view with a digital dashboard displaying speed and lap time, indicating active racing.  \n- Yellow barriers line the track, with urban buildings and spectators visible in the background as the race progresses.\n[30-60s] - Motorcyclist in red gear leans into turns, closely following another rider on a green bike.  \n- Yellow barriers line the track, with buildings and trees visible in the background.  \n- Camera perspective shows the green motorcycle’s dashboard, indicating speed and gear changes.\n[60-90s] - Motorcyclist ahead leans into a right turn, maintaining speed past yellow barriers.  \n- Camera rider follows closely, navigating a similar curve with blurred surroundings.  \n- Urban buildings and trees line the track, with sunlight casting sharp shadows.\n[90-120s] - A rider on a red motorcycle leans into a turn, closely followed by a green motorcycle with a visible rider's shadow.  \n- Yellow and red striped barriers line the track, with urban buildings and trees visible in the background.  \n- Text overlay at 1:07 states \"Rider is okay,\" indicating a safety check or reassurance during the race.\n[120-150s] - Rider Lukas Maurer follows a lead motorcycle through a city street circuit, maintaining a consistent distance.  \n- The camera perspective is from a green motorcycle, showing dashboard indicators and the rider’s view.  \n- Yellow and black barriers line the track, with urban buildings and a bridge visible in the background.\n[150-180s] - Rider Lukas Mauser speeds along a city track, with sun glare visible through the windshield.  \n- The camera captures a blurred urban environment, including buildings and barriers, as the motorcycle navigates turns.  \n- A digital dashboard displays speed and gear information, indicating high velocity during the ride.\n[180-210s] - Rider Lukas Maurer speeds along a city street, with blurred buildings and yellow barriers on either side.  \n- The sun glints off the road ahead, casting long shadows as the rider navigates through urban infrastructure.  \n- The camera angle shifts slightly, showing the rider’s silhouette against the bright sky as they pass under an overpass.\n[210-240s] - Rider Lukas Maurer on teal motorcycle navigates a winding urban track bordered by yellow-and-black barriers.  \n- The track curves through a cityscape with modern buildings and greenery, under clear blue skies.  \n- Camera follows from a low angle, capturing motion blur as the motorcycle speeds along the road.\n[240-270s] - Rider Lukas Maurer navigates a city street at high speed, leaning into turns with a motorcycle.\n- Yellow and black barriers line the road, blurred by motion, indicating rapid movement.\n- Urban buildings and trees pass by quickly, suggesting a dynamic, fast-paced ride through a city environment.\n[270-300s] - Rider Lukas Maurer speeds through urban streets, navigating sharp turns with blurred surroundings.  \n- Yellow and black barriers line the road, indicating a controlled racing environment.  \n- Buildings and infrastructure, including bridges and construction sites, pass by rapidly as the motorcycle accelerates.\n[300-330s] - Rider Lukas Maurer speeds along a highway, passing under a bridge with construction cranes visible in the distance.\n- The sun sets behind urban buildings, casting long shadows and creating a golden glow on the road.\n- The motorcycle's dashboard displays speed and gear information, indicating high-speed travel through city infrastructure.", "history_tokens": 779, "history_utf8_bytes": 3603, "recent_frame_times_s": [318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0], "recent_frames_sha256": "11a10e72db73db277240556d43abf6681d891fbcbd6c3bfbec3c10aaa2ae80e1", "num_recent_frames": 30, "tq": 719620.316911549, "t1": 719621.555676194, "ta": 719621.555676194, "te": 719621.898151704, "first_response_s": 1.2387646450661123, "answer_total_s": 1.5812401550356299, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 299, "content_group": "a5b55d78e7940f1016830c09adc479fd85389215597d1fcdc3db530439cc3bb4", "question": {"question_id": "sample_299_a1499_q0", "video_id": 299, "video_path": "./videos/sample_299_real.mp4", "annotation_index": 1499, "question_index": 0, "question": "Where is the bridge in relation to the rider right now?", "options": ["A. Above the rider.", "B. To the right of the rider.", "C. In front of the rider.", "D. Behind the rider."], "answer": "D", "time_stamp_s": 474, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [460, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_299_a1499_q0", "video_id": 299, "time_stamp_s": 474, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6259744662670e9b089150ef3ceacc3451b33675fb6be816369478e072c57abd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [445.0, 446.0, 447.0, 448.0, 449.0, 450.0, 451.0, 452.0, 453.0, 454.0, 455.0, 456.0, 457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0], "recent_frames_sha256": "cd81278265479e47a71971f129c09e891787ba793fd939a4598dbb928640c462", "num_recent_frames": 30, "tq": 719690.567821204, "t1": 719700.139940417, "ta": 719700.139940417, "te": 719700.180415517, "first_response_s": 9.572119213058613, "answer_total_s": 9.612594312988222, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_299_a1499_q0", "video_id": 299, "time_stamp_s": 474, "ground_truth": "D", "raw_output": "C. In front of the rider.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "48cc6867758b989f4a8275495ca93d41314dfbaf8e1218dfc125fa7ac05ff602", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Motorcyclist in red gear leans into turns, closely following another rider on a green bike.  \n- Yellow barriers line the track, with buildings and trees visible in the background.  \n- Camera perspective shows the green motorcycle’s dashboard, indicating speed and gear changes.\n[60-90s] - Motorcyclist ahead leans into a right turn, maintaining speed past yellow barriers.  \n- Camera rider follows closely, navigating a similar curve with blurred surroundings.  \n- Urban buildings and trees line the track, with sunlight casting sharp shadows.\n[90-120s] - A rider on a red motorcycle leans into a turn, closely followed by a green motorcycle with a visible rider's shadow.  \n- Yellow and red striped barriers line the track, with urban buildings and trees visible in the background.  \n- Text overlay at 1:07 states \"Rider is okay,\" indicating a safety check or reassurance during the race.\n[120-150s] - Rider Lukas Maurer follows a lead motorcycle through a city street circuit, maintaining a consistent distance.  \n- The camera perspective is from a green motorcycle, showing dashboard indicators and the rider’s view.  \n- Yellow and black barriers line the track, with urban buildings and a bridge visible in the background.\n[150-180s] - Rider Lukas Mauser speeds along a city track, with sun glare visible through the windshield.  \n- The camera captures a blurred urban environment, including buildings and barriers, as the motorcycle navigates turns.  \n- A digital dashboard displays speed and gear information, indicating high velocity during the ride.\n[180-210s] - Rider Lukas Maurer speeds along a city street, with blurred buildings and yellow barriers on either side.  \n- The sun glints off the road ahead, casting long shadows as the rider navigates through urban infrastructure.  \n- The camera angle shifts slightly, showing the rider’s silhouette against the bright sky as they pass under an overpass.\n[210-240s] - Rider Lukas Maurer on teal motorcycle navigates a winding urban track bordered by yellow-and-black barriers.  \n- The track curves through a cityscape with modern buildings and greenery, under clear blue skies.  \n- Camera follows from a low angle, capturing motion blur as the motorcycle speeds along the road.\n[240-270s] - Rider Lukas Maurer navigates a city street at high speed, leaning into turns with a motorcycle.\n- Yellow and black barriers line the road, blurred by motion, indicating rapid movement.\n- Urban buildings and trees pass by quickly, suggesting a dynamic, fast-paced ride through a city environment.\n[270-300s] - Rider Lukas Maurer speeds through urban streets, navigating sharp turns with blurred surroundings.  \n- Yellow and black barriers line the road, indicating a controlled racing environment.  \n- Buildings and infrastructure, including bridges and construction sites, pass by rapidly as the motorcycle accelerates.\n[300-330s] - Rider Lukas Maurer speeds along a highway, passing under a bridge with construction cranes visible in the distance.\n- The sun sets behind urban buildings, casting long shadows and creating a golden glow on the road.\n- The motorcycle's dashboard displays speed and gear information, indicating high-speed travel through city infrastructure.\n[330-360s] - Rider Lukas Maurer speeds through urban streets, with sun glare dominating the view.  \n- Yellow and black barriers line the road, indicating a controlled or race environment.  \n- The rider navigates under bridges and past tall buildings, maintaining a steady pace.\n[360-390s] - Rider Lukas Maurer on a motorcycle speeds along a city street, passing buildings and barriers.  \n- The camera captures a first-person perspective, showing motion blur from high speed.  \n- Yellow and black safety barriers line the road, with trees and urban structures visible in the background.\n[390-420s] - Rider Lukas Maurer on a teal motorcycle speeds along a city street, passing yellow-and-black barriers.  \n- The rider navigates turns, with buildings and trees lining the road, and other motorcycles visible ahead.  \n- A red-and-white barrier appears briefly, indicating a change in the track’s boundary or lane.\n[420-450s] - Rider Lukas Maurer on a teal motorcycle overtakes another rider in a city street race, with blurred motion indicating high speed.\n- Yellow and black barriers line the track, with a \"MICHELIN\" sign visible in the background as the race proceeds.\n- The camera follows from a trailing motorcycle, capturing the dynamic movement and urban environment as the riders navigate the course.", "history_tokens": 996, "history_utf8_bytes": 4546, "recent_frame_times_s": [445.0, 446.0, 447.0, 448.0, 449.0, 450.0, 451.0, 452.0, 453.0, 454.0, 455.0, 456.0, 457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0], "recent_frames_sha256": "cd81278265479e47a71971f129c09e891787ba793fd939a4598dbb928640c462", "num_recent_frames": 30, "tq": 719655.702657339, "t1": 719656.722139754, "ta": 719656.722139754, "te": 719657.055281199, "first_response_s": 1.0194824149366468, "answer_total_s": 1.3526238600024953, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 300, "content_group": "b364b9b5c02d0d242ff096c2ba349f535622c66f564307d8fc95db8bca93d8c3", "question": {"question_id": "sample_300_a1160_q0", "video_id": 300, "video_path": "./videos/sample_300_real.mp4", "annotation_index": 1160, "question_index": 0, "question": "Where is the motorcycle parked right now?", "options": ["A. In a parking lot.", "B. In a gas station.", "C. On a roadside.", "D. In a garage."], "answer": "B", "time_stamp_s": 10, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_300_a1160_q0", "video_id": 300, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "122483ea09cae79821d563aba4c844e0bc7132c6653a28715b76110292071835", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "e64a92241f62ef7d6c7f102c02c11d031fe003c3315dc266b5b68cb101383564", "num_recent_frames": 10, "tq": 715468.257734774, "t1": 715468.998129943, "ta": 715468.998129943, "te": 715469.035426417, "first_response_s": 0.7403951690066606, "answer_total_s": 0.7776916429866105, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_300_a1160_q0", "video_id": 300, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "03b328b3d7c875d387d749cb2d0c89baf425d20f02e6d36dd5682bed9b6fdec2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "e64a92241f62ef7d6c7f102c02c11d031fe003c3315dc266b5b68cb101383564", "num_recent_frames": 10, "tq": 715308.416331834, "t1": 715320.190721521, "ta": 715320.190721521, "te": 715320.386717607, "first_response_s": 11.774389686994255, "answer_total_s": 11.970385772990994, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 300, "content_group": "b364b9b5c02d0d242ff096c2ba349f535622c66f564307d8fc95db8bca93d8c3", "question": {"question_id": "sample_300_a1161_q0", "video_id": 300, "video_path": "./videos/sample_300_real.mp4", "annotation_index": 1161, "question_index": 0, "question": "Where is the McDonald's sign located relative to the motorcyclist right now?", "options": ["A. Ahead on the left side.", "B. Ahead on the right side.", "C. Directly behind.", "D. Floating above."], "answer": "A", "time_stamp_s": 145, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [137, 157], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_300_a1161_q0", "video_id": 300, "time_stamp_s": 145, "ground_truth": "A", "raw_output": "A. Ahead on the left side.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "cb37ed8259cb87f93b009eed3bbcfa73879d0950b80f62a856c8593e7dd40c93", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334], "recent_frames_sha256": "737a2f040f70e7c1ef1fd0cb2ff1136672516978e2810384671b4563af1911a7", "num_recent_frames": 30, "tq": 715469.050775339, "t1": 715479.661393034, "ta": 715479.661393034, "te": 715479.95818103, "first_response_s": 10.610617695027031, "answer_total_s": 10.907405690988526, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_300_a1161_q0", "video_id": 300, "time_stamp_s": 145, "ground_truth": "A", "raw_output": "A. Ahead on the left side.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "bce2ef2da7466a4fa1ed614fc1bb34eae09c08bc00cee16d031eed93fc2d9506", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rider checks fuel receipt and places it on motorcycle tank while standing beside it.  \n- Rider uses smartphone to scan or interact with motorcycle's digital display, possibly for fueling or diagnostics.  \n- Rider adjusts or interacts with motorcycle's fuel cap or tank area, indicating preparation for departure.\n[30-60s] - Rider's gloved hands grip handlebars as motorcycle's dashboard lights illuminate with green and blue indicators.  \n- Motorcycle is stationary at a gas station, with fuel pump nozzle inserted into tank, surrounded by branded signage.  \n- After refueling, rider accelerates onto highway at night, dashboard gauges active as vehicle moves forward.\n[60-90s] - A black motorcycle with glowing green dashboard lights is stationary at a crosswalk, facing an orange Repsol motorcycle that has stopped beside it.  \n- The orange motorcycle, bearing \"REPSOL\" branding, is positioned to the left of the black motorcycle, with its rider partially visible.  \n- Both motorcycles are parked on a wet road at night, with streetlights and traffic signals visible in the background.\n[90-120s] - Motorcycle with glowing dashboard lights proceeds through a nighttime urban intersection, passing a white bus ahead.  \n- Road markings and traffic cones are visible on the right side of the lane, indicating construction or lane changes.  \n- The motorcycle’s speedometer shows increasing speed as it moves forward on a multi-lane road under streetlights.", "history_tokens": 305, "history_utf8_bytes": 1465, "recent_frame_times_s": [115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334], "recent_frames_sha256": "737a2f040f70e7c1ef1fd0cb2ff1136672516978e2810384671b4563af1911a7", "num_recent_frames": 30, "tq": 715351.658667533, "t1": 715353.374962573, "ta": 715353.374962573, "te": 715353.695504222, "first_response_s": 1.7162950400961563, "answer_total_s": 2.036836688988842, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 300, "content_group": "b364b9b5c02d0d242ff096c2ba349f535622c66f564307d8fc95db8bca93d8c3", "question": {"question_id": "sample_300_a1162_q0", "video_id": 300, "video_path": "./videos/sample_300_real.mp4", "annotation_index": 1162, "question_index": 0, "question": "What type of vehicle is directly ahead of the cyclist right now?", "options": ["A. A white minivan.", "B. A yellow taxi.", "C. A blue sedan.", "D. A red sports car."], "answer": "B", "time_stamp_s": 292, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [274, 294], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_300_a1162_q0", "video_id": 300, "time_stamp_s": 292, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "923848d18c2cdf9c5db5d08e141fbd95fc95221f7c0441f5163e382d209f6c09", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.00038333333333, 285.0013833333333, 286.00238333333334, 287.0033833333333, 288.00438333333335, 289.0053833333333, 290.00638333333336, 291.00738333333334], "recent_frames_sha256": "e6613024d996a9189078da4477d789368a1153c79a7be0c8806aa9b211689500", "num_recent_frames": 30, "tq": 715479.972213701, "t1": 715492.549179781, "ta": 715492.549179781, "te": 715492.586781921, "first_response_s": 12.576966079999693, "answer_total_s": 12.614568219985813, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_300_a1162_q0", "video_id": 300, "time_stamp_s": 292, "ground_truth": "B", "raw_output": "A. A white minivan.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "ba832f3dd0bd54331918f7331c11e8979002e41ab225eeb380dd7f82aec75bfd", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rider checks fuel receipt and places it on motorcycle tank while standing beside it.  \n- Rider uses smartphone to scan or interact with motorcycle's digital display, possibly for fueling or diagnostics.  \n- Rider adjusts or interacts with motorcycle's fuel cap or tank area, indicating preparation for departure.\n[30-60s] - Rider's gloved hands grip handlebars as motorcycle's dashboard lights illuminate with green and blue indicators.  \n- Motorcycle is stationary at a gas station, with fuel pump nozzle inserted into tank, surrounded by branded signage.  \n- After refueling, rider accelerates onto highway at night, dashboard gauges active as vehicle moves forward.\n[60-90s] - A black motorcycle with glowing green dashboard lights is stationary at a crosswalk, facing an orange Repsol motorcycle that has stopped beside it.  \n- The orange motorcycle, bearing \"REPSOL\" branding, is positioned to the left of the black motorcycle, with its rider partially visible.  \n- Both motorcycles are parked on a wet road at night, with streetlights and traffic signals visible in the background.\n[90-120s] - Motorcycle with glowing dashboard lights proceeds through a nighttime urban intersection, passing a white bus ahead.  \n- Road markings and traffic cones are visible on the right side of the lane, indicating construction or lane changes.  \n- The motorcycle’s speedometer shows increasing speed as it moves forward on a multi-lane road under streetlights.\n[120-150s] - Motorcycle follows a white van with red brake lights, navigating through a nighttime urban intersection with traffic cones and crosswalk markings.\n- A large truck passes on the left, and a McDonald's sign is visible in the distance as the motorcycle continues forward.\n- The motorcycle's dashboard displays illuminated gauges, indicating active navigation through the city streets at night.\n[150-180s] - Motorcycle's dashboard lights glow with green and blue indicators while cruising at night.\n- A red sedan is directly ahead, maintaining a steady distance as the motorcycle follows.\n- Road markings and streetlights blur past, indicating high speed on a multi-lane highway.\n[180-210s] - Motorcycle with glowing dashboard lights moves forward on a dark road, passing a white sedan ahead.\n- The rider approaches a crosswalk, stops at a red light, then proceeds through the intersection.\n- A bright orange motorcycle appears on the right side of the road, moving in the same direction as the rider.\n[210-240s] - Motorcycle rider waits at a crosswalk under red light, dashboard illuminated with green indicators.\n- Traffic flows past on the opposite side, including a black sedan and a white car, as the rider remains stationary.\n- Rider accelerates forward after the light turns green, moving along a multi-lane road under an overpass.\n[240-270s] - Motorcycle rider approaches a crosswalk at night, stopping before pedestrians.\n- A white van is visible ahead, navigating through traffic cones.\n- Streetlights and illuminated signs reflect off the motorcycle’s dashboard.", "history_tokens": 644, "history_utf8_bytes": 3050, "recent_frame_times_s": [262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.00038333333333, 285.0013833333333, 286.00238333333334, 287.0033833333333, 288.00438333333335, 289.0053833333333, 290.00638333333336, 291.00738333333334], "recent_frames_sha256": "e6613024d996a9189078da4477d789368a1153c79a7be0c8806aa9b211689500", "num_recent_frames": 30, "tq": 715387.251607626, "t1": 715392.062675603, "ta": 715392.062675603, "te": 715392.327248595, "first_response_s": 4.811067976988852, "answer_total_s": 5.075640968978405, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 300, "content_group": "b364b9b5c02d0d242ff096c2ba349f535622c66f564307d8fc95db8bca93d8c3", "question": {"question_id": "sample_300_a1163_q0", "video_id": 300, "video_path": "./videos/sample_300_real.mp4", "annotation_index": 1163, "question_index": 0, "question": "Where is the person photographing the motorcycles standing right now?", "options": ["A. On the sidewalk.", "B. In the middle of the street.", "C. On the motorcycle.", "D. In the next shop."], "answer": "B", "time_stamp_s": 422, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [411, 431], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_300_a1163_q0", "video_id": 300, "time_stamp_s": 422, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d0f87b0f647adc3f3c454fc809950d974ca67615a7b73c3877dc57f0689d71b7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0009166666667, 419.00191666666666, 420.0029166666667, 421.00391666666667], "recent_frames_sha256": "83af5ba3e6d39553e92188a7c98ff96f561099a4e78e248f4cbbc1023f5acedb", "num_recent_frames": 30, "tq": 715492.598658332, "t1": 715504.042247013, "ta": 715504.042247013, "te": 715504.07978043, "first_response_s": 11.443588680936955, "answer_total_s": 11.481122097931802, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_300_a1163_q0", "video_id": 300, "time_stamp_s": 422, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fd7b6391286fef972befa6d1259b869bd417163d5d4881f4163d2533f09469d5", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rider checks fuel receipt and places it on motorcycle tank while standing beside it.  \n- Rider uses smartphone to scan or interact with motorcycle's digital display, possibly for fueling or diagnostics.  \n- Rider adjusts or interacts with motorcycle's fuel cap or tank area, indicating preparation for departure.\n[30-60s] - Rider's gloved hands grip handlebars as motorcycle's dashboard lights illuminate with green and blue indicators.  \n- Motorcycle is stationary at a gas station, with fuel pump nozzle inserted into tank, surrounded by branded signage.  \n- After refueling, rider accelerates onto highway at night, dashboard gauges active as vehicle moves forward.\n[60-90s] - A black motorcycle with glowing green dashboard lights is stationary at a crosswalk, facing an orange Repsol motorcycle that has stopped beside it.  \n- The orange motorcycle, bearing \"REPSOL\" branding, is positioned to the left of the black motorcycle, with its rider partially visible.  \n- Both motorcycles are parked on a wet road at night, with streetlights and traffic signals visible in the background.\n[90-120s] - Motorcycle with glowing dashboard lights proceeds through a nighttime urban intersection, passing a white bus ahead.  \n- Road markings and traffic cones are visible on the right side of the lane, indicating construction or lane changes.  \n- The motorcycle’s speedometer shows increasing speed as it moves forward on a multi-lane road under streetlights.\n[120-150s] - Motorcycle follows a white van with red brake lights, navigating through a nighttime urban intersection with traffic cones and crosswalk markings.\n- A large truck passes on the left, and a McDonald's sign is visible in the distance as the motorcycle continues forward.\n- The motorcycle's dashboard displays illuminated gauges, indicating active navigation through the city streets at night.\n[150-180s] - Motorcycle's dashboard lights glow with green and blue indicators while cruising at night.\n- A red sedan is directly ahead, maintaining a steady distance as the motorcycle follows.\n- Road markings and streetlights blur past, indicating high speed on a multi-lane highway.\n[180-210s] - Motorcycle with glowing dashboard lights moves forward on a dark road, passing a white sedan ahead.\n- The rider approaches a crosswalk, stops at a red light, then proceeds through the intersection.\n- A bright orange motorcycle appears on the right side of the road, moving in the same direction as the rider.\n[210-240s] - Motorcycle rider waits at a crosswalk under red light, dashboard illuminated with green indicators.\n- Traffic flows past on the opposite side, including a black sedan and a white car, as the rider remains stationary.\n- Rider accelerates forward after the light turns green, moving along a multi-lane road under an overpass.\n[240-270s] - Motorcycle rider approaches a crosswalk at night, stopping before pedestrians.\n- A white van is visible ahead, navigating through traffic cones.\n- Streetlights and illuminated signs reflect off the motorcycle’s dashboard.\n[270-300s] - Motorcycle approaches a crosswalk with construction barriers and workers in high-visibility vests.  \n- Traffic ahead includes a white van and a taxi, with a police car visible in the distance.  \n- Road signs and orange traffic cones indicate lane closures or detours.\n[300-330s] - Motorcyclist approaches a yellow taxi at a traffic stop, with orange cones marking the lane.  \n- The taxi's rear lights are illuminated, and it is positioned ahead of the motorcyclist in the same lane.  \n- A white bus passes on the right side of the road, moving in the opposite direction.\n[330-360s] - Motorcycle's dashboard displays shifting speed and gear indicators as it navigates city streets.  \n- Pedestrians and vehicles, including a white van and a bus, are visible on the road and sidewalks.  \n- Streetlights and illuminated signs from nearby buildings create a bright, urban nighttime environment.\n[360-390s] - Motorcycle dashboard displays speed and RPMs, with green and blue LED indicators active.  \n- Streetlights and neon signs illuminate the urban night scene, with pedestrians and vehicles passing by.  \n- The rider navigates through intersections, passing orange traffic cones and crossing marked crosswalks.\n[390-420s] - Rider’s hand holds phone, displaying camera interface, with shadow cast on road.  \n- Phone screen shows live view of street scene, including a parked orange motorcycle.  \n- Rider’s wristwatch and chain bracelet are visible as hand moves phone slightly.", "history_tokens": 979, "history_utf8_bytes": 4541, "recent_frame_times_s": [392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0009166666667, 419.00191666666666, 420.0029166666667, 421.00391666666667], "recent_frames_sha256": "83af5ba3e6d39553e92188a7c98ff96f561099a4e78e248f4cbbc1023f5acedb", "num_recent_frames": 30, "tq": 715428.052378097, "t1": 715434.089745, "ta": 715434.089745, "te": 715434.127919304, "first_response_s": 6.037366903037764, "answer_total_s": 6.075541206984781, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 300, "content_group": "b364b9b5c02d0d242ff096c2ba349f535622c66f564307d8fc95db8bca93d8c3", "question": {"question_id": "sample_300_a1164_q0", "video_id": 300, "video_path": "./videos/sample_300_real.mp4", "annotation_index": 1164, "question_index": 0, "question": "What type of vehicle is directly ahead of the cyclist right now?", "options": ["A. A white minivan.", "B. A yellow taxi.", "C. A blue sedan.", "D. A red sports car."], "answer": "C", "time_stamp_s": 586, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "cycling", "reference_interval_s": [548, 568], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_300_a1164_q0", "video_id": 300, "time_stamp_s": 586, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6b604dd1ef65d3b4fc2b296e0735d89c64f3f02ee7f7b85899db52710776d311", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [556.00545, 557.00645, 558.00745, 559.00845, 560.00945, 561.01045, 562.01145, 563.01245, 564.01345, 565.01445, 566.01545, 567.01645, 568.0007666666667, 569.0017666666666, 570.0027666666666, 571.0037666666667, 572.0047666666667, 573.0057666666667, 574.0067666666666, 575.0077666666666, 576.0087666666667, 577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0000833333334, 585.0010833333333], "recent_frames_sha256": "c55794889ee07d06e2b4e49c473898c9633afe110943d2d3d57f8dcb2ed98cc7", "num_recent_frames": 30, "tq": 715504.089432406, "t1": 715515.730438744, "ta": 715515.730438744, "te": 715515.767799435, "first_response_s": 11.641006337944418, "answer_total_s": 11.678367028944194, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_300_a1164_q0", "video_id": 300, "time_stamp_s": 586, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "00348167443e056c2f780acbb1f3c5973b3123641fd23fe740e1b077f1cd3d76", "condition_order": ["notes", "recent"], "memory": "[120-150s] - Motorcycle follows a white van with red brake lights, navigating through a nighttime urban intersection with traffic cones and crosswalk markings.\n- A large truck passes on the left, and a McDonald's sign is visible in the distance as the motorcycle continues forward.\n- The motorcycle's dashboard displays illuminated gauges, indicating active navigation through the city streets at night.\n[150-180s] - Motorcycle's dashboard lights glow with green and blue indicators while cruising at night.\n- A red sedan is directly ahead, maintaining a steady distance as the motorcycle follows.\n- Road markings and streetlights blur past, indicating high speed on a multi-lane highway.\n[180-210s] - Motorcycle with glowing dashboard lights moves forward on a dark road, passing a white sedan ahead.\n- The rider approaches a crosswalk, stops at a red light, then proceeds through the intersection.\n- A bright orange motorcycle appears on the right side of the road, moving in the same direction as the rider.\n[210-240s] - Motorcycle rider waits at a crosswalk under red light, dashboard illuminated with green indicators.\n- Traffic flows past on the opposite side, including a black sedan and a white car, as the rider remains stationary.\n- Rider accelerates forward after the light turns green, moving along a multi-lane road under an overpass.\n[240-270s] - Motorcycle rider approaches a crosswalk at night, stopping before pedestrians.\n- A white van is visible ahead, navigating through traffic cones.\n- Streetlights and illuminated signs reflect off the motorcycle’s dashboard.\n[270-300s] - Motorcycle approaches a crosswalk with construction barriers and workers in high-visibility vests.  \n- Traffic ahead includes a white van and a taxi, with a police car visible in the distance.  \n- Road signs and orange traffic cones indicate lane closures or detours.\n[300-330s] - Motorcyclist approaches a yellow taxi at a traffic stop, with orange cones marking the lane.  \n- The taxi's rear lights are illuminated, and it is positioned ahead of the motorcyclist in the same lane.  \n- A white bus passes on the right side of the road, moving in the opposite direction.\n[330-360s] - Motorcycle's dashboard displays shifting speed and gear indicators as it navigates city streets.  \n- Pedestrians and vehicles, including a white van and a bus, are visible on the road and sidewalks.  \n- Streetlights and illuminated signs from nearby buildings create a bright, urban nighttime environment.\n[360-390s] - Motorcycle dashboard displays speed and RPMs, with green and blue LED indicators active.  \n- Streetlights and neon signs illuminate the urban night scene, with pedestrians and vehicles passing by.  \n- The rider navigates through intersections, passing orange traffic cones and crossing marked crosswalks.\n[390-420s] - Rider’s hand holds phone, displaying camera interface, with shadow cast on road.  \n- Phone screen shows live view of street scene, including a parked orange motorcycle.  \n- Rider’s wristwatch and chain bracelet are visible as hand moves phone slightly.\n[420-450s] - Hand holding phone captures motorcycle rider’s shadow on wet pavement at night.  \n- Motorcycle’s dashboard glows with blue and green lights as it moves forward.  \n- Tokyo Tower’s illuminated structure appears in background as rider approaches.\n[450-480s] - Motorcyclist approaches a crosswalk under a lit bridge structure at night.\n- Traffic lights change to green, allowing the motorcyclist to proceed through the intersection.\n- Other vehicles, including cars and motorcycles, are visible in motion on the road.\n[480-510s] - Motorcyclist in foreground rides through intersection, dashboard lights glowing blue and green.\n- Orange motorcycle passes on left, then merges into traffic ahead.\n- Red light ahead, followed by a cyclist on a red bike in the distance.\n[510-540s] - Motorcycle with glowing dashboard lights moves forward on a well-lit highway at night.\n- A silver car passes on the left, followed by a black pickup truck ahead.\n- Road markings and overhead lights blur due to speed, indicating motion along a multi-lane elevated roadway.\n[540-570s] - Motorcycle with glowing dashboard lights travels on a bridge at night, passing under illuminated overhead structures.\n- A red-lit motorcycle overtakes the camera’s vehicle on the right side of the road.\n- Text overlay appears in Japanese and English: \"お台場 Odaiba,\" indicating the location as Odaiba.", "history_tokens": 987, "history_utf8_bytes": 4463, "recent_frame_times_s": [556.00545, 557.00645, 558.00745, 559.00845, 560.00945, 561.01045, 562.01145, 563.01245, 564.01345, 565.01445, 566.01545, 567.01645, 568.0007666666667, 569.0017666666666, 570.0027666666666, 571.0037666666667, 572.0047666666667, 573.0057666666667, 574.0067666666666, 575.0077666666666, 576.0087666666667, 577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0000833333334, 585.0010833333333], "recent_frames_sha256": "c55794889ee07d06e2b4e49c473898c9633afe110943d2d3d57f8dcb2ed98cc7", "num_recent_frames": 30, "tq": 715466.613871689, "t1": 715468.17711533, "ta": 715468.17711533, "te": 715468.215849514, "first_response_s": 1.563243641052395, "answer_total_s": 1.6019778250483796, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 301, "content_group": "dac49cd4da4e05862ba811e6cb38832b411a264d0a6b22f76d810df9c5f4a28e", "question": {"question_id": "sample_301_a1815_q0", "video_id": 301, "video_path": "./videos/sample_301_real.mp4", "annotation_index": 1815, "question_index": 0, "question": "How many red vehicles are shown as parked on the street?", "options": ["A. Two.", "B. One.", "C. Four.", "D. Five."], "answer": "B", "time_stamp_s": 15, "task_type": "Counting", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_301_a1815_q0", "video_id": 301, "time_stamp_s": 15, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8cf1ea298b7dc3853ca7ea3c5488e725ba12e354c693708fcfbb9612aee0f8ff", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014], "recent_frames_sha256": "11a299511460b421c394e871ee3c9c270e123a17ff482f2563ee658fe845b26b", "num_recent_frames": 15, "tq": 717965.622243468, "t1": 717970.898976493, "ta": 717970.898976493, "te": 717970.936709567, "first_response_s": 5.276733025093563, "answer_total_s": 5.314466099021956, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_301_a1815_q0", "video_id": 301, "time_stamp_s": 15, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3a946607c77c79525ced83c2ff8f29fdc7a3f969cd21cc15c8f16e91c1bd0673", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014], "recent_frames_sha256": "11a299511460b421c394e871ee3c9c270e123a17ff482f2563ee658fe845b26b", "num_recent_frames": 15, "tq": 717870.98689698, "t1": 717877.932603643, "ta": 717877.932603643, "te": 717877.97298063, "first_response_s": 6.945706663071178, "answer_total_s": 6.986083650030196, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 301, "content_group": "dac49cd4da4e05862ba811e6cb38832b411a264d0a6b22f76d810df9c5f4a28e", "question": {"question_id": "sample_301_a1816_q0", "video_id": 301, "video_path": "./videos/sample_301_real.mp4", "annotation_index": 1816, "question_index": 0, "question": "What is on the right-hand side of the pathway right now?", "options": ["A. A row of houses.", "B. A stone wall.", "C. A row of parked cars.", "D. A flower garden."], "answer": "C", "time_stamp_s": 84, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_301_a1816_q0", "video_id": 301, "time_stamp_s": 84, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "063e207fbc7f35777359559aae0214cb178e7990fc035bd734dc7edecb706d90", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [54.01229166666667, 55.01329166666667, 56.014291666666665, 57.01529166666667, 58.01629166666667, 59.017291666666665, 60.01829166666667, 61.01929166666667, 62.020291666666665, 63.02129166666667, 64.02229166666666, 65.02329166666667, 66.02429166666667, 67.02529166666666, 68.02629166666667, 69.02729166666667, 70.02829166666666, 71.02929166666667, 72.03029166666667, 73.03129166666666, 74.03229166666667, 75.03329166666667, 76.03429166666666, 77.03529166666667, 78.03629166666667, 79.03729166666666, 80.03829166666667, 81.03929166666667, 82.04029166666666, 83.04129166666667], "recent_frames_sha256": "6bfd6bf563fd704da3e36a56382bd4090a08d312403867614a1d751eac97ee85", "num_recent_frames": 30, "tq": 717970.946066015, "t1": 717985.958609061, "ta": 717985.958609061, "te": 717985.998852532, "first_response_s": 15.012543045915663, "answer_total_s": 15.052786516956985, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_301_a1816_q0", "video_id": 301, "time_stamp_s": 84, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f9af8e662ef975d0cccb2617ca652773cd578c94d4178834f70e1dcae6ca634f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A white van drives past parked cars on a sunny residential street lined with trees and houses.  \n- A yellow taxi passes by, followed by an orange car, both moving along the road.  \n- A gravel path runs alongside the street, bordered by greenery and a chain-link fence near a house.\n[30-60s] - A sidewalk runs parallel to parked cars, shaded by large leafy trees.  \n- Residential houses with varied facades and fences line the street, some with manicured gardens.  \n- A green lamppost stands near the sidewalk, with a parked car visible in the distance.", "history_tokens": 134, "history_utf8_bytes": 562, "recent_frame_times_s": [54.01229166666667, 55.01329166666667, 56.014291666666665, 57.01529166666667, 58.01629166666667, 59.017291666666665, 60.01829166666667, 61.01929166666667, 62.020291666666665, 63.02129166666667, 64.02229166666666, 65.02329166666667, 66.02429166666667, 67.02529166666666, 68.02629166666667, 69.02729166666667, 70.02829166666666, 71.02929166666667, 72.03029166666667, 73.03129166666666, 74.03229166666667, 75.03329166666667, 76.03429166666666, 77.03529166666667, 78.03629166666667, 79.03729166666666, 80.03829166666667, 81.03929166666667, 82.04029166666666, 83.04129166666667], "recent_frames_sha256": "6bfd6bf563fd704da3e36a56382bd4090a08d312403867614a1d751eac97ee85", "num_recent_frames": 30, "tq": 717889.152605974, "t1": 717892.003292199, "ta": 717892.003292199, "te": 717892.20161401, "first_response_s": 2.850686224992387, "answer_total_s": 3.049008036032319, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 301, "content_group": "dac49cd4da4e05862ba811e6cb38832b411a264d0a6b22f76d810df9c5f4a28e", "question": {"question_id": "sample_301_a1816_q1", "video_id": 301, "video_path": "./videos/sample_301_real.mp4", "annotation_index": 1816, "question_index": 1, "question": "What new element becomes visible in the video now?", "options": ["A. A school.", "B. other houses.", "C. A playground.", "D. A park."], "answer": "B", "time_stamp_s": 100, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_301_a1816_q1", "video_id": 301, "time_stamp_s": 100, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7d53fb7223259e8654bf39e33d90dae8656763a4bdf4ef95a6d3f5f90971823f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [70.02829166666666, 71.02929166666667, 72.03029166666667, 73.03129166666666, 74.03229166666667, 75.03329166666667, 76.03429166666666, 77.03529166666667, 78.03629166666667, 79.03729166666666, 80.03829166666667, 81.03929166666667, 82.04029166666666, 83.04129166666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334], "recent_frames_sha256": "42f7624ad6c8bc30c2d0c9761d38c85f5679925e11d57f95428fd45cdf80e7d9", "num_recent_frames": 30, "tq": 717986.010059222, "t1": 717997.896461531, "ta": 717997.896461531, "te": 717997.934120561, "first_response_s": 11.886402309057303, "answer_total_s": 11.924061338999309, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_301_a1816_q1", "video_id": 301, "time_stamp_s": 100, "ground_truth": "B", "raw_output": "B. other houses.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "1416f65c21fe004fee9df8633f4f380d0060eaa8080879278b262f06bbe87095", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A white van drives past parked cars on a sunny residential street lined with trees and houses.  \n- A yellow taxi passes by, followed by an orange car, both moving along the road.  \n- A gravel path runs alongside the street, bordered by greenery and a chain-link fence near a house.\n[30-60s] - A sidewalk runs parallel to parked cars, shaded by large leafy trees.  \n- Residential houses with varied facades and fences line the street, some with manicured gardens.  \n- A green lamppost stands near the sidewalk, with a parked car visible in the distance.\n[60-90s] - A sidewalk runs parallel to parked cars, flanked by lush greenery and trees.  \n- A house with a sloped roof and white trim is visible on the left, partially obscured by bushes.  \n- The camera moves forward, revealing more trees and a changing array of foliage along the street.", "history_tokens": 203, "history_utf8_bytes": 851, "recent_frame_times_s": [70.02829166666666, 71.02929166666667, 72.03029166666667, 73.03129166666666, 74.03229166666667, 75.03329166666667, 76.03429166666666, 77.03529166666667, 78.03629166666667, 79.03729166666666, 80.03829166666667, 81.03929166666667, 82.04029166666666, 83.04129166666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334], "recent_frames_sha256": "42f7624ad6c8bc30c2d0c9761d38c85f5679925e11d57f95428fd45cdf80e7d9", "num_recent_frames": 30, "tq": 717902.773424879, "t1": 717909.387145085, "ta": 717909.387145085, "te": 717909.579642956, "first_response_s": 6.613720206078142, "answer_total_s": 6.806218077079393, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 301, "content_group": "dac49cd4da4e05862ba811e6cb38832b411a264d0a6b22f76d810df9c5f4a28e", "question": {"question_id": "sample_301_a1817_q0", "video_id": 301, "video_path": "./videos/sample_301_real.mp4", "annotation_index": 1817, "question_index": 0, "question": "What is located between the white picket fence and the brown wooden fence?", "options": ["A. A stone path.", "B. A grassy area.", "C. A concrete wall.", "D. A small pond."], "answer": "B", "time_stamp_s": 162, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_301_a1817_q0", "video_id": 301, "time_stamp_s": 162, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8fa220cc825bf7214def6f4845e1736c5e089c96fe2ced4c6b04ba5cab21838b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [132.006875, 133.007875, 134.008875, 135.009875, 136.010875, 137.011875, 138.012875, 139.013875, 140.014875, 141.015875, 142.016875, 143.017875, 144.018875, 145.019875, 146.020875, 147.021875, 148.022875, 149.023875, 150.024875, 151.025875, 152.026875, 153.027875, 154.028875, 155.029875, 156.030875, 157.031875, 158.032875, 159.033875, 160.034875, 161.035875], "recent_frames_sha256": "8e798977b4535acc7f503fae36bb5d5fb53a719ca9ff1ab6a556a5214c9868e1", "num_recent_frames": 30, "tq": 717997.950321874, "t1": 718005.716390698, "ta": 718005.716390698, "te": 718005.756182358, "first_response_s": 7.766068823984824, "answer_total_s": 7.805860484018922, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_301_a1817_q0", "video_id": 301, "time_stamp_s": 162, "ground_truth": "B", "raw_output": "B. A grassy area.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "445d12a263000bdf79e080df63966757214f407450bdb4983311274095626499", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A white van drives past parked cars on a sunny residential street lined with trees and houses.  \n- A yellow taxi passes by, followed by an orange car, both moving along the road.  \n- A gravel path runs alongside the street, bordered by greenery and a chain-link fence near a house.\n[30-60s] - A sidewalk runs parallel to parked cars, shaded by large leafy trees.  \n- Residential houses with varied facades and fences line the street, some with manicured gardens.  \n- A green lamppost stands near the sidewalk, with a parked car visible in the distance.\n[60-90s] - A sidewalk runs parallel to parked cars, flanked by lush greenery and trees.  \n- A house with a sloped roof and white trim is visible on the left, partially obscured by bushes.  \n- The camera moves forward, revealing more trees and a changing array of foliage along the street.\n[90-120s] - A paved sidewalk runs alongside a residential area, bordered by a metal fence and greenery, leading toward a road intersection.  \n- A large tree with dense foliage partially obscures the view, casting shadows on the path and nearby parked cars.  \n- Red flowering plants and a hedge line the sidewalk, transitioning into a more open area with a road sign and distant trees under a clear blue sky.\n[120-150s] - A white van is parked on the right side of the road, near a curb lined with trees and bushes.  \n- A sidewalk runs parallel to the road, bordered by grass and shrubs, leading toward a residential area.  \n- A green street sign reading \"Barnes\" is visible on a pole near the intersection, indicating the street name.", "history_tokens": 374, "history_utf8_bytes": 1586, "recent_frame_times_s": [132.006875, 133.007875, 134.008875, 135.009875, 136.010875, 137.011875, 138.012875, 139.013875, 140.014875, 141.015875, 142.016875, 143.017875, 144.018875, 145.019875, 146.020875, 147.021875, 148.022875, 149.023875, 150.024875, 151.025875, 152.026875, 153.027875, 154.028875, 155.029875, 156.030875, 157.031875, 158.032875, 159.033875, 160.034875, 161.035875], "recent_frames_sha256": "8e798977b4535acc7f503fae36bb5d5fb53a719ca9ff1ab6a556a5214c9868e1", "num_recent_frames": 30, "tq": 717925.139994199, "t1": 717926.316939172, "ta": 717926.316939172, "te": 717926.585516188, "first_response_s": 1.1769449729472399, "answer_total_s": 1.4455219889059663, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 301, "content_group": "dac49cd4da4e05862ba811e6cb38832b411a264d0a6b22f76d810df9c5f4a28e", "question": {"question_id": "sample_301_a1818_q0", "video_id": 301, "video_path": "./videos/sample_301_real.mp4", "annotation_index": 1818, "question_index": 0, "question": "What is the nature of the shadows on the sidewalk shown right now?", "options": ["A. Shadows from parked cars.", "B. Shadows from street signs.", "C. Shadows from the tree canopy.", "D. Shadows from buildings."], "answer": "B", "time_stamp_s": 246, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_301_a1818_q0", "video_id": 301, "time_stamp_s": 246, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "68d5d81540a2cbd942ecf5b7dff5cae10ccea198d4e79b4fc43d372e728b090b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [216.00745833333335, 217.00845833333332, 218.00945833333333, 219.01045833333333, 220.01145833333334, 221.01245833333334, 222.01345833333335, 223.01445833333332, 224.01545833333333, 225.01645833333333, 226.01745833333334, 227.01845833333334, 228.01945833333335, 229.02045833333332, 230.02145833333333, 231.02245833333333, 232.02345833333334, 233.02445833333334, 234.02545833333335, 235.02645833333332, 236.02745833333333, 237.02845833333333, 238.02945833333334, 239.03045833333334, 240.03145833333335, 241.03245833333332, 242.03345833333333, 243.03445833333333, 244.03545833333334, 245.03645833333334], "recent_frames_sha256": "ed8cdae7f3a6b78e4d4ba073ef54d87ceea272eacf4564996f55dbc0f2882734", "num_recent_frames": 30, "tq": 718005.775232436, "t1": 718017.461091209, "ta": 718017.461091209, "te": 718017.503271728, "first_response_s": 11.685858772951178, "answer_total_s": 11.728039292036556, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_301_a1818_q0", "video_id": 301, "time_stamp_s": 246, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5a5b14d2d3097b97b46c5bad9f26a7304fd5377efac210d18bd187f35bfbbbcf", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A white van drives past parked cars on a sunny residential street lined with trees and houses.  \n- A yellow taxi passes by, followed by an orange car, both moving along the road.  \n- A gravel path runs alongside the street, bordered by greenery and a chain-link fence near a house.\n[30-60s] - A sidewalk runs parallel to parked cars, shaded by large leafy trees.  \n- Residential houses with varied facades and fences line the street, some with manicured gardens.  \n- A green lamppost stands near the sidewalk, with a parked car visible in the distance.\n[60-90s] - A sidewalk runs parallel to parked cars, flanked by lush greenery and trees.  \n- A house with a sloped roof and white trim is visible on the left, partially obscured by bushes.  \n- The camera moves forward, revealing more trees and a changing array of foliage along the street.\n[90-120s] - A paved sidewalk runs alongside a residential area, bordered by a metal fence and greenery, leading toward a road intersection.  \n- A large tree with dense foliage partially obscures the view, casting shadows on the path and nearby parked cars.  \n- Red flowering plants and a hedge line the sidewalk, transitioning into a more open area with a road sign and distant trees under a clear blue sky.\n[120-150s] - A white van is parked on the right side of the road, near a curb lined with trees and bushes.  \n- A sidewalk runs parallel to the road, bordered by grass and shrubs, leading toward a residential area.  \n- A green street sign reading \"Barnes\" is visible on a pole near the intersection, indicating the street name.\n[150-180s] - A white picket fence runs along the left side of the sidewalk, transitioning to a brown wooden fence as the camera moves forward.  \n- A two-story house with a dark roof and white siding is visible, featuring a front porch and steps leading up to the entrance.  \n- The sidewalk curves gently to the right, bordered by green hedges and trees, with parked cars visible on the street to the right.\n[180-210s] - A paved sidewalk runs straight ahead, flanked by lush greenery and parked cars on the right.  \n- Trees with dense foliage cast dappled shadows across the path, with sunlight filtering through leaves.  \n- Residential houses with varied facades and front yards appear in the distance, partially obscured by trees and hedges.\n[210-240s] - A black SUV is parked on the street, partially obscured by a tree and hedge.  \n- A wooden arbor with climbing plants is visible on the left, leading to a pathway.  \n- The camera moves forward along a paved sidewalk, passing through a tree-lined area with residential houses on either side.", "history_tokens": 616, "history_utf8_bytes": 2632, "recent_frame_times_s": [216.00745833333335, 217.00845833333332, 218.00945833333333, 219.01045833333333, 220.01145833333334, 221.01245833333334, 222.01345833333335, 223.01445833333332, 224.01545833333333, 225.01645833333333, 226.01745833333334, 227.01845833333334, 228.01945833333335, 229.02045833333332, 230.02145833333333, 231.02245833333333, 232.02345833333334, 233.02445833333334, 234.02545833333335, 235.02645833333332, 236.02745833333333, 237.02845833333333, 238.02945833333334, 239.03045833333334, 240.03145833333335, 241.03245833333332, 242.03345833333333, 243.03445833333333, 244.03545833333334, 245.03645833333334], "recent_frames_sha256": "ed8cdae7f3a6b78e4d4ba073ef54d87ceea272eacf4564996f55dbc0f2882734", "num_recent_frames": 30, "tq": 717958.052661699, "t1": 717965.571328207, "ta": 717965.571328207, "te": 717965.611126124, "first_response_s": 7.51866650802549, "answer_total_s": 7.55846442503389, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 302, "content_group": "2621921baa64f16876bb6713ea0c5108bbf9dbaffa3a77dba9017608c220626a", "question": {"question_id": "sample_302_a931_q0", "video_id": 302, "video_path": "./videos/sample_302_real.mp4", "annotation_index": 931, "question_index": 0, "question": "What notable feature is seen in the middle of the street as the camera moves forward?", "options": ["A. A tall evergreen tree.", "B. A parked truck.", "C. A street vendor.", "D. A bicycle lane."], "answer": "A", "time_stamp_s": 8, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_302_a931_q0", "video_id": 302, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ce7e3066bf5013ab41d2848cbc577ada086a95e9c12d2664587992799551696f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007], "recent_frames_sha256": "08f8b8ba37b69bce1321fbfed1d2c643afb5200f912af30cdc9b70e6f631abfc", "num_recent_frames": 8, "tq": 718272.531160733, "t1": 718278.454053009, "ta": 718278.454053009, "te": 718278.492323398, "first_response_s": 5.922892276081257, "answer_total_s": 5.9611626650439575, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_302_a931_q0", "video_id": 302, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "13dab5e6f56d92370739a153e5963b23148cad6ef62d3fc5ebf149fbc4ed653d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007], "recent_frames_sha256": "08f8b8ba37b69bce1321fbfed1d2c643afb5200f912af30cdc9b70e6f631abfc", "num_recent_frames": 8, "tq": 718326.801983946, "t1": 718328.044503436, "ta": 718328.044503436, "te": 718328.235868288, "first_response_s": 1.242519489955157, "answer_total_s": 1.4338843419682235, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 302, "content_group": "2621921baa64f16876bb6713ea0c5108bbf9dbaffa3a77dba9017608c220626a", "question": {"question_id": "sample_302_a932_q0", "video_id": 302, "video_path": "./videos/sample_302_real.mp4", "annotation_index": 932, "question_index": 0, "question": "What does the camera capture after showing the manicured shrubs and bushes?", "options": ["A. A stone pathway flanked by garden beds.", "B. A wooden bridge over a stream.", "C. A large fountain in a central plaza.", "D. An open field with wildflowers."], "answer": "A", "time_stamp_s": 93, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_302_a932_q0", "video_id": 302, "time_stamp_s": 93, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "60d444d2ce86aafd733a2c245917134e9d9276b41963336fb1038f85e788c6d9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.01726666666667, 85.01826666666666, 86.01926666666667, 87.02026666666667, 88.02126666666666, 89.02226666666667, 90.02326666666667, 91.02426666666666, 92.02526666666667], "recent_frames_sha256": "2075ef54a95b88305f1e9a9f879b33e62152ad85a323bd64be393851123e7bd3", "num_recent_frames": 30, "tq": 718278.514756263, "t1": 718286.255827821, "ta": 718286.255827821, "te": 718286.293261964, "first_response_s": 7.741071557975374, "answer_total_s": 7.778505700989626, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_302_a932_q0", "video_id": 302, "time_stamp_s": 93, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f59f63cc7ecad26416531eb4f847bbbb86f868b3f6911ef685f8bacec1277723", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A black Fiat 500 is parked on the right side of a residential street, facing the camera, with its license plate visible.  \n- The camera pans left, revealing a white sedan driving away from the viewer down the road, passing a street sign and a large evergreen tree.  \n- The view shifts to a stone retaining wall and a wooden walkway leading up to a two-story house with light-colored siding and a sloped roof, surrounded by greenery.\n[30-60s] - A stone retaining wall with a house behind it, featuring a white porch and arched windows, is visible at 30s.  \n- The camera pans right, revealing a row of houses with varying architectural styles, including a modern wooden structure at 35s.  \n- A white signpost with text is seen at 40s, positioned near a stone wall and pathway, indicating a residential area.\n[60-90s] - A beige two-story house with white trim and a porch is visible, partially obscured by trees and shrubs.  \n- A tall, mature tree with a thick trunk stands prominently in the foreground, casting shadows on the grass.  \n- The camera pans left, revealing a sidewalk and a row of parked cars along the street, with a silver SUV visible.", "history_tokens": 277, "history_utf8_bytes": 1158, "recent_frame_times_s": [63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.01726666666667, 85.01826666666666, 86.01926666666667, 87.02026666666667, 88.02126666666666, 89.02226666666667, 90.02326666666667, 91.02426666666666, 92.02526666666667], "recent_frames_sha256": "2075ef54a95b88305f1e9a9f879b33e62152ad85a323bd64be393851123e7bd3", "num_recent_frames": 30, "tq": 718355.542059666, "t1": 718357.063801637, "ta": 718357.063801637, "te": 718357.406452712, "first_response_s": 1.521741971024312, "answer_total_s": 1.8643930460093543, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 302, "content_group": "2621921baa64f16876bb6713ea0c5108bbf9dbaffa3a77dba9017608c220626a", "question": {"question_id": "sample_302_a933_q0", "video_id": 302, "video_path": "./videos/sample_302_real.mp4", "annotation_index": 933, "question_index": 0, "question": "What becomes visible past the dense part of the hedge now?", "options": ["A. A park.", "B. A row of shops.", "C. The garden and houses.", "D. A busy street."], "answer": "C", "time_stamp_s": 173, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_302_a933_q0", "video_id": 302, "time_stamp_s": 173, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "40228f1ed5155c260b55454d37afa4029b715b3c8b0a978ae238a9a600f8b754", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667], "recent_frames_sha256": "b3ee03e4d275e711e82e8e4431710413535a3063cfb2f0fe5371edc09b0814ef", "num_recent_frames": 30, "tq": 718286.313062617, "t1": 718300.097115546, "ta": 718300.097115546, "te": 718300.137629983, "first_response_s": 13.784052929026075, "answer_total_s": 13.824567366042174, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_302_a933_q0", "video_id": 302, "time_stamp_s": 173, "ground_truth": "C", "raw_output": "C. The garden and houses.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "20d38343740462b2a186c1ba877809261181fdbfa7f467f25889bc26ba3b7675", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A black Fiat 500 is parked on the right side of a residential street, facing the camera, with its license plate visible.  \n- The camera pans left, revealing a white sedan driving away from the viewer down the road, passing a street sign and a large evergreen tree.  \n- The view shifts to a stone retaining wall and a wooden walkway leading up to a two-story house with light-colored siding and a sloped roof, surrounded by greenery.\n[30-60s] - A stone retaining wall with a house behind it, featuring a white porch and arched windows, is visible at 30s.  \n- The camera pans right, revealing a row of houses with varying architectural styles, including a modern wooden structure at 35s.  \n- A white signpost with text is seen at 40s, positioned near a stone wall and pathway, indicating a residential area.\n[60-90s] - A beige two-story house with white trim and a porch is visible, partially obscured by trees and shrubs.  \n- A tall, mature tree with a thick trunk stands prominently in the foreground, casting shadows on the grass.  \n- The camera pans left, revealing a sidewalk and a row of parked cars along the street, with a silver SUV visible.\n[90-120s] - A gravel driveway leads to a two-story house with a wooden fence and lattice gate, partially obscured by trees.  \n- The camera pans right, revealing a wooden fence with diamond-patterned lattice along its top, running parallel to a sidewalk.  \n- A street corner with parked cars and a crosswalk is visible in the distance, framed by greenery and a clear blue sky.\n[120-150s] - A white car drives slowly along the left side of the road, passing parked vehicles.  \n- A sidewalk runs parallel to the road, bordered by grass and trees, with a hedge on the right.  \n- A street sign for “Barnes Street” is visible at the corner, indicating the intersection.", "history_tokens": 436, "history_utf8_bytes": 1826, "recent_frame_times_s": [143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667], "recent_frames_sha256": "b3ee03e4d275e711e82e8e4431710413535a3063cfb2f0fe5371edc09b0814ef", "num_recent_frames": 30, "tq": 718377.631247471, "t1": 718384.484848761, "ta": 718384.484848761, "te": 718384.860995503, "first_response_s": 6.853601290029474, "answer_total_s": 7.229748032055795, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 302, "content_group": "2621921baa64f16876bb6713ea0c5108bbf9dbaffa3a77dba9017608c220626a", "question": {"question_id": "sample_302_a934_q0", "video_id": 302, "video_path": "./videos/sample_302_real.mp4", "annotation_index": 934, "question_index": 0, "question": "What distinguishes the car closest to the camera now?", "options": ["A. It has red stripes on the hood.", "B. It has green stripes on the hood.", "C. It has yellow stripes on the hood.", "D. It has blue stripes on the hood."], "answer": "D", "time_stamp_s": 247, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_302_a934_q0", "video_id": 302, "time_stamp_s": 247, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7770632c63706f65bf25b5e65cee8e309eec7d6c818f9615f30eb958a03f655b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332], "recent_frames_sha256": "956fdb3422d90d741864e14bab89ec75261b4f60eb263ccf41f922a1211a23bd", "num_recent_frames": 30, "tq": 718300.160053537, "t1": 718314.777912527, "ta": 718314.777912527, "te": 718314.817485175, "first_response_s": 14.61785898997914, "answer_total_s": 14.6574316379847, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_302_a934_q0", "video_id": 302, "time_stamp_s": 247, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "547af980c97f38abce61e2506686b15e25bdb00687afe8f5e8e3a83d21bdd20a", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A black Fiat 500 is parked on the right side of a residential street, facing the camera, with its license plate visible.  \n- The camera pans left, revealing a white sedan driving away from the viewer down the road, passing a street sign and a large evergreen tree.  \n- The view shifts to a stone retaining wall and a wooden walkway leading up to a two-story house with light-colored siding and a sloped roof, surrounded by greenery.\n[30-60s] - A stone retaining wall with a house behind it, featuring a white porch and arched windows, is visible at 30s.  \n- The camera pans right, revealing a row of houses with varying architectural styles, including a modern wooden structure at 35s.  \n- A white signpost with text is seen at 40s, positioned near a stone wall and pathway, indicating a residential area.\n[60-90s] - A beige two-story house with white trim and a porch is visible, partially obscured by trees and shrubs.  \n- A tall, mature tree with a thick trunk stands prominently in the foreground, casting shadows on the grass.  \n- The camera pans left, revealing a sidewalk and a row of parked cars along the street, with a silver SUV visible.\n[90-120s] - A gravel driveway leads to a two-story house with a wooden fence and lattice gate, partially obscured by trees.  \n- The camera pans right, revealing a wooden fence with diamond-patterned lattice along its top, running parallel to a sidewalk.  \n- A street corner with parked cars and a crosswalk is visible in the distance, framed by greenery and a clear blue sky.\n[120-150s] - A white car drives slowly along the left side of the road, passing parked vehicles.  \n- A sidewalk runs parallel to the road, bordered by grass and trees, with a hedge on the right.  \n- A street sign for “Barnes Street” is visible at the corner, indicating the intersection.\n[150-180s] - A wooden pathway runs alongside a dense green hedge, leading toward parked cars on the left.  \n- The hedge is bordered by tall grasses and purple flowering plants, with a tree providing shade overhead.  \n- A residential house with a sloped roof and porch is visible in the background, partially obscured by foliage.\n[180-210s] - A large evergreen tree stands prominently in the foreground, partially obscuring the view of the houses behind it.  \n- The camera pans left, revealing a row of modern, multi-story houses with dark roofs and wooden exteriors, set against a clear blue sky.  \n- A stone and black metal fence runs along the left side of the frame, separating the property from a sidewalk and adjacent greenery.\n[210-240s] - A black car is parked on the side of a road, partially shaded by trees.  \n- A \"No Parking\" sign is visible near the car, indicating restricted parking.  \n- The background features distant mountains under a clear blue sky, with greenery lining the road.", "history_tokens": 668, "history_utf8_bytes": 2825, "recent_frame_times_s": [217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332], "recent_frames_sha256": "956fdb3422d90d741864e14bab89ec75261b4f60eb263ccf41f922a1211a23bd", "num_recent_frames": 30, "tq": 718407.422027278, "t1": 718408.669609403, "ta": 718408.669609403, "te": 718408.85929898, "first_response_s": 1.2475821250118315, "answer_total_s": 1.4372717019869015, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 302, "content_group": "2621921baa64f16876bb6713ea0c5108bbf9dbaffa3a77dba9017608c220626a", "question": {"question_id": "sample_302_a934_q1", "video_id": 302, "video_path": "./videos/sample_302_real.mp4", "annotation_index": 934, "question_index": 1, "question": "What is the position of the house relative to the white car?", "options": ["A. To the right, behind the car.", "B. To the left, in front of the car.", "C. To the left, beside the car.", "D. To the right, beside the car."], "answer": "C", "time_stamp_s": 253, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_302_a934_q1", "video_id": 302, "time_stamp_s": 253, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "591e49c1af38f09f4cb2761c70d5ab96f2ce61ba12ddc18fb3d99022c40106f7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332], "recent_frames_sha256": "6eda173611deb28c2b75bc27a624e43c59475e85dbd80099ffb110ff818c7412", "num_recent_frames": 30, "tq": 718314.832912638, "t1": 718326.750269897, "ta": 718326.750269897, "te": 718326.791026949, "first_response_s": 11.917357259080745, "answer_total_s": 11.958114310982637, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_302_a934_q1", "video_id": 302, "time_stamp_s": 253, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d93c0501a88abb0e357f6dbea2a86b0482b9b4e3b45c8cc2ba75bdca850cad63", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A black Fiat 500 is parked on the right side of a residential street, facing the camera, with its license plate visible.  \n- The camera pans left, revealing a white sedan driving away from the viewer down the road, passing a street sign and a large evergreen tree.  \n- The view shifts to a stone retaining wall and a wooden walkway leading up to a two-story house with light-colored siding and a sloped roof, surrounded by greenery.\n[30-60s] - A stone retaining wall with a house behind it, featuring a white porch and arched windows, is visible at 30s.  \n- The camera pans right, revealing a row of houses with varying architectural styles, including a modern wooden structure at 35s.  \n- A white signpost with text is seen at 40s, positioned near a stone wall and pathway, indicating a residential area.\n[60-90s] - A beige two-story house with white trim and a porch is visible, partially obscured by trees and shrubs.  \n- A tall, mature tree with a thick trunk stands prominently in the foreground, casting shadows on the grass.  \n- The camera pans left, revealing a sidewalk and a row of parked cars along the street, with a silver SUV visible.\n[90-120s] - A gravel driveway leads to a two-story house with a wooden fence and lattice gate, partially obscured by trees.  \n- The camera pans right, revealing a wooden fence with diamond-patterned lattice along its top, running parallel to a sidewalk.  \n- A street corner with parked cars and a crosswalk is visible in the distance, framed by greenery and a clear blue sky.\n[120-150s] - A white car drives slowly along the left side of the road, passing parked vehicles.  \n- A sidewalk runs parallel to the road, bordered by grass and trees, with a hedge on the right.  \n- A street sign for “Barnes Street” is visible at the corner, indicating the intersection.\n[150-180s] - A wooden pathway runs alongside a dense green hedge, leading toward parked cars on the left.  \n- The hedge is bordered by tall grasses and purple flowering plants, with a tree providing shade overhead.  \n- A residential house with a sloped roof and porch is visible in the background, partially obscured by foliage.\n[180-210s] - A large evergreen tree stands prominently in the foreground, partially obscuring the view of the houses behind it.  \n- The camera pans left, revealing a row of modern, multi-story houses with dark roofs and wooden exteriors, set against a clear blue sky.  \n- A stone and black metal fence runs along the left side of the frame, separating the property from a sidewalk and adjacent greenery.\n[210-240s] - A black car is parked on the side of a road, partially shaded by trees.  \n- A \"No Parking\" sign is visible near the car, indicating restricted parking.  \n- The background features distant mountains under a clear blue sky, with greenery lining the road.", "history_tokens": 668, "history_utf8_bytes": 2825, "recent_frame_times_s": [223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332], "recent_frames_sha256": "6eda173611deb28c2b75bc27a624e43c59475e85dbd80099ffb110ff818c7412", "num_recent_frames": 30, "tq": 718408.8876409, "t1": 718421.400263057, "ta": 718421.400263057, "te": 718421.641468298, "first_response_s": 12.512622156995349, "answer_total_s": 12.753827398060821, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 303, "content_group": "29cc6590ab01062f2512f835332c568dcf91e304740d78433ece273a020e0fd7", "question": {"question_id": "sample_303_a2173_q0", "video_id": 303, "video_path": "./videos/sample_303_real.mp4", "annotation_index": 2173, "question_index": 0, "question": "What does the text overlay \"CREIL Metro Station\" indicate in the video?", "options": ["A. The start of a parade.", "B. An advertisement for a new restaurant.", "C. The title of a music video.", "D. The location of the current scene."], "answer": "D", "time_stamp_s": 14, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_303_a2173_q0", "video_id": 303, "time_stamp_s": 14, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5ed9a63bfd5c369f606f52a615d5e756db1e1a1960232d438f8d52303049916e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0], "recent_frames_sha256": "db8b1302be23540397042cf76800b688ca0992501bf9c6491b940b45ea126598", "num_recent_frames": 15, "tq": 717877.994233279, "t1": 717883.465420767, "ta": 717883.465420767, "te": 717883.504823025, "first_response_s": 5.471187487943098, "answer_total_s": 5.5105897459434345, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_303_a2173_q0", "video_id": 303, "time_stamp_s": 14, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "82f417f3cab1d499a7c23dfcc6ca2f58a4c9b5642ec1b8439a8c03ccc5ec674f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0], "recent_frames_sha256": "db8b1302be23540397042cf76800b688ca0992501bf9c6491b940b45ea126598", "num_recent_frames": 15, "tq": 717920.581098316, "t1": 717926.316939172, "ta": 717926.316939172, "te": 717926.585516188, "first_response_s": 5.735840855981223, "answer_total_s": 6.00441787193995, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 303, "content_group": "29cc6590ab01062f2512f835332c568dcf91e304740d78433ece273a020e0fd7", "question": {"question_id": "sample_303_a2174_q0", "video_id": 303, "video_path": "./videos/sample_303_real.mp4", "annotation_index": 2174, "question_index": 0, "question": "What is displayed through the shop windows?", "options": ["A. Books and paintings.", "B. Electronics and gadgets.", "C. Food and beverages.", "D. Various items and mannequins."], "answer": "D", "time_stamp_s": 257, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_303_a2174_q0", "video_id": 303, "time_stamp_s": 257, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7ee7f0d21143f7b4869d85b0f5c9934ae9bae8943080ea346b65899c023d5597", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0], "recent_frames_sha256": "a48b712b9a01989ee53aa856b6378f4cc782433980a01b8e1d1f5bbf2fd24f55", "num_recent_frames": 30, "tq": 717883.540728495, "t1": 717890.291748168, "ta": 717890.291748168, "te": 717890.329085743, "first_response_s": 6.751019672956318, "answer_total_s": 6.7883572480641305, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_303_a2174_q0", "video_id": 303, "time_stamp_s": 257, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8fc3d60bae5b70bc68bb8ec6d41b006b3664daca07417dd0bc744dd549a3bb50", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A blue and green train with \"Haute-de-France\" branding is stationary at the Creil Metro Station platform, with passengers boarding or alighting.  \n- A person in a blue jacket walks toward the train, while another individual with a blue bag stands near the platform edge.  \n- The station features overhead power lines, a covered platform, and a sign indicating \"Creil Metro Station\" overlaid on the video.\n[30-60s] - Train interior features rows of pink and white seats with passengers seated or standing near windows.  \n- A woman in a blue jacket sits on the left, engrossed in her phone, while others walk or stand near the aisle.  \n- The train moves forward, with visible windows showing passing scenery and overhead lighting illuminating the cabin.\n[60-90s] - Train interior shows pink and purple striped seats with a \"Mata views\" watermark on the window.  \n- Outside, a station platform with covered walkways and people walking is visible as the train passes.  \n- The train moves past industrial areas with multiple railway tracks and graffiti-covered walls.\n[90-120s] - A green and blue train passes by the station platform, with \"Société des Transports du Nord\" branding visible on its side.  \n- The station platform is lined with overhead power lines and modern architectural structures, including a glass-covered waiting area.  \n- A sign reading \"PARIS NORD Metro Station\" appears overlaid on the video, indicating the location.\n[120-150s] - Train interior shows red and purple seats with striped headrests, passengers seated or standing, and a staff member in uniform near the aisle.\n- Exterior view from train window shows a green and blue train at a station platform, with people walking on the platform and overhead power lines.\n- Platform scene includes a sign reading \"MADRID\" and a person in a dark jacket walking toward the train doors, with wet ground indicating recent rain.\n[150-180s] - Passengers walk along a platform beside a green and blue SNCF train, some carrying bags or bikes.  \n- A man in a dark coat walks toward the camera, passing a pillar with graffiti.  \n- The camera pans to show a large, open station interior with high ceilings and multiple tracks, including a red train on an adjacent track.\n[180-210s] - A large digital display board shows train schedules and platform information above the station concourse.  \n- People walk through the station, some carrying bags or wearing winter coats, under a high, arched glass roof.  \n- The camera pans to show a street outside the station with pedestrians, a closed shop, and a bus parked along the curb.\n[210-240s] - A woman in a white coat holds a black umbrella while walking on a wet sidewalk, near a black metal gate with graffiti.  \n- A man in a dark jacket and beige pants walks past a bus stop, carrying a blue bag, as a blue bus passes by on the street.  \n- A storefront with green doors and signage for \"Sangeetha\" and \"Clinique\" is visible, with a poster advertising \"Sangeetha Vegetarian\" and \"Clinique Vichy\" on its windows.", "history_tokens": 697, "history_utf8_bytes": 3029, "recent_frame_times_s": [228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0], "recent_frames_sha256": "a48b712b9a01989ee53aa856b6378f4cc782433980a01b8e1d1f5bbf2fd24f55", "num_recent_frames": 30, "tq": 717997.091221175, "t1": 718004.440231309, "ta": 718004.440231309, "te": 718004.705132218, "first_response_s": 7.3490101339994, "answer_total_s": 7.613911042921245, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 303, "content_group": "29cc6590ab01062f2512f835332c568dcf91e304740d78433ece273a020e0fd7", "question": {"question_id": "sample_303_a2175_q0", "video_id": 303, "video_path": "./videos/sample_303_real.mp4", "annotation_index": 2175, "question_index": 0, "question": "What is the condition of the pavement on the commercial street?", "options": ["A. Dry.", "B. Covered in leaves.", "C. Snowy.", "D. Wet from recent rain."], "answer": "D", "time_stamp_s": 485, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_303_a2175_q0", "video_id": 303, "time_stamp_s": 485, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8ac2119773b98b9386f0467f55b0c6da4bca0585b12469063e8f8c7a8fbd4939", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [456.0, 457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0], "recent_frames_sha256": "464f74b61de9fbdb8a8a324091b9617351d623abb897bd0d8e230d509571efb9", "num_recent_frames": 30, "tq": 717890.356080009, "t1": 717897.509137915, "ta": 717897.509137915, "te": 717897.548548545, "first_response_s": 7.153057905961759, "answer_total_s": 7.192468535969965, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_303_a2175_q0", "video_id": 303, "time_stamp_s": 485, "ground_truth": "D", "raw_output": "D. Wet from recent rain.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "b05b1290091f3edb14344d517ad1d8f3aa0dc2215becd10c1e0e110fe7c6df17", "condition_order": ["recent", "notes"], "memory": "[150-180s] - Passengers walk along a platform beside a green and blue SNCF train, some carrying bags or bikes.  \n- A man in a dark coat walks toward the camera, passing a pillar with graffiti.  \n- The camera pans to show a large, open station interior with high ceilings and multiple tracks, including a red train on an adjacent track.\n[180-210s] - A large digital display board shows train schedules and platform information above the station concourse.  \n- People walk through the station, some carrying bags or wearing winter coats, under a high, arched glass roof.  \n- The camera pans to show a street outside the station with pedestrians, a closed shop, and a bus parked along the curb.\n[210-240s] - A woman in a white coat holds a black umbrella while walking on a wet sidewalk, near a black metal gate with graffiti.  \n- A man in a dark jacket and beige pants walks past a bus stop, carrying a blue bag, as a blue bus passes by on the street.  \n- A storefront with green doors and signage for \"Sangeetha\" and \"Clinique\" is visible, with a poster advertising \"Sangeetha Vegetarian\" and \"Clinique Vichy\" on its windows.\n[240-270s] - A dark green van with \"VOLVO\" branding is parked on the street, partially obstructing the sidewalk.  \n- A man in a white coat and khaki pants walks past the van, heading toward a storefront with a \"SAIL A C\" sign.  \n- A person in a red jacket and dark pants walks briskly along the sidewalk, carrying a blue bag, near a \"SAIL A C\" store window.\n[270-300s] - A \"MADIAN SUPER MARKET\" storefront displays colorful product packaging and a blue-themed window display.  \n- A red door of a neighboring \"RESTAURANT RAPIDE\" is open, with a person in an orange hoodie exiting.  \n- A wet street shows pedestrians walking past shops, including a blue-painted building with a \"Maison de la Culture\" sign.\n[300-330s] - A white taxi with \"DUTAS\" branding drives leftward across a wet street, passing pedestrians and storefronts.  \n- A man in a red coat walks rightward across a crosswalk, followed by a cyclist and other pedestrians.  \n- A shopfront with \"CHOLLA VOYAGE\" signage and mannequins is visible on the right, with a \"NO STOPPING\" traffic sign above.\n[330-360s] - A white van passes by a street corner with a \"PARIS LAND\" sign, moving left to right.  \n- A fruit stand with striped awning displays produce, positioned near a crosswalk.  \n- Pedestrians cross the wet street at the crosswalk, with one person walking toward the camera.\n[360-390s] - A man in a dark jacket and jeans walks along the wet sidewalk, holding an umbrella.  \n- A white car passes by on the street, followed by a black car.  \n- A red storefront with \"XEVEREST\" signage is visible, displaying various products through its glass windows.\n[390-420s] - A man in a red jacket walks past storefronts on a wet sidewalk, moving from left to right.  \n- A woman in a light blue coat walks toward the camera, passing a bakery with colorful displays.  \n- A fruit and vegetable stand is visible with a blue awning, positioned between a bakery and a shop with a wooden door.\n[420-450s] - A woman in a yellow raincoat walks past a storefront with large facial images displayed in the window.  \n- A blue tram passes by on the street, with its doors open and passengers boarding.  \n- A closed shop with a blue facade and a partially open shutter is visible, with a poster on the window.\n[450-480s] - A black SUV drives past storefronts on a wet street, passing a \"Restaurant Chatin\" sign.  \n- Pedestrians walk along the sidewalk, some carrying bags or umbrellas, near a \"Vente de Vêtements\" shop.  \n- A blue \"Place de la République\" sign is visible above a tree-lined street with parked cars and a bus.", "history_tokens": 945, "history_utf8_bytes": 3691, "recent_frame_times_s": [456.0, 457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0], "recent_frames_sha256": "464f74b61de9fbdb8a8a324091b9617351d623abb897bd0d8e230d509571efb9", "num_recent_frames": 30, "tq": 718057.307393306, "t1": 718058.851668002, "ta": 718058.851668002, "te": 718059.124262861, "first_response_s": 1.5442746959161013, "answer_total_s": 1.8168695549247786, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 303, "content_group": "29cc6590ab01062f2512f835332c568dcf91e304740d78433ece273a020e0fd7", "question": {"question_id": "sample_303_a2175_q1", "video_id": 303, "video_path": "./videos/sample_303_real.mp4", "annotation_index": 2175, "question_index": 1, "question": "What is the man in the dark jacket doing near the shop entrance?", "options": ["A. Talking on the phone.", "B. Waiting for a bus.", "C. Drinking coffee.", "D. Browsing the items."], "answer": "D", "time_stamp_s": 498, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_303_a2175_q1", "video_id": 303, "time_stamp_s": 498, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "df810f8dd30de6fd30a543f633baa4b313629e3d2a23a725cdec299c54450219", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0], "recent_frames_sha256": "5023b432f9e46d9c08d400def1c9728f6e1173699bbd998a0a6b77e36bab9bfc", "num_recent_frames": 30, "tq": 717897.565266425, "t1": 717910.220387385, "ta": 717910.220387385, "te": 717910.259549551, "first_response_s": 12.6551209599711, "answer_total_s": 12.694283125922084, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_303_a2175_q1", "video_id": 303, "time_stamp_s": 498, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "11878851d65b39f9b91953b65e34154c22d6e0abbcaa90bc8370ad8693e53380", "condition_order": ["recent", "notes"], "memory": "[150-180s] - Passengers walk along a platform beside a green and blue SNCF train, some carrying bags or bikes.  \n- A man in a dark coat walks toward the camera, passing a pillar with graffiti.  \n- The camera pans to show a large, open station interior with high ceilings and multiple tracks, including a red train on an adjacent track.\n[180-210s] - A large digital display board shows train schedules and platform information above the station concourse.  \n- People walk through the station, some carrying bags or wearing winter coats, under a high, arched glass roof.  \n- The camera pans to show a street outside the station with pedestrians, a closed shop, and a bus parked along the curb.\n[210-240s] - A woman in a white coat holds a black umbrella while walking on a wet sidewalk, near a black metal gate with graffiti.  \n- A man in a dark jacket and beige pants walks past a bus stop, carrying a blue bag, as a blue bus passes by on the street.  \n- A storefront with green doors and signage for \"Sangeetha\" and \"Clinique\" is visible, with a poster advertising \"Sangeetha Vegetarian\" and \"Clinique Vichy\" on its windows.\n[240-270s] - A dark green van with \"VOLVO\" branding is parked on the street, partially obstructing the sidewalk.  \n- A man in a white coat and khaki pants walks past the van, heading toward a storefront with a \"SAIL A C\" sign.  \n- A person in a red jacket and dark pants walks briskly along the sidewalk, carrying a blue bag, near a \"SAIL A C\" store window.\n[270-300s] - A \"MADIAN SUPER MARKET\" storefront displays colorful product packaging and a blue-themed window display.  \n- A red door of a neighboring \"RESTAURANT RAPIDE\" is open, with a person in an orange hoodie exiting.  \n- A wet street shows pedestrians walking past shops, including a blue-painted building with a \"Maison de la Culture\" sign.\n[300-330s] - A white taxi with \"DUTAS\" branding drives leftward across a wet street, passing pedestrians and storefronts.  \n- A man in a red coat walks rightward across a crosswalk, followed by a cyclist and other pedestrians.  \n- A shopfront with \"CHOLLA VOYAGE\" signage and mannequins is visible on the right, with a \"NO STOPPING\" traffic sign above.\n[330-360s] - A white van passes by a street corner with a \"PARIS LAND\" sign, moving left to right.  \n- A fruit stand with striped awning displays produce, positioned near a crosswalk.  \n- Pedestrians cross the wet street at the crosswalk, with one person walking toward the camera.\n[360-390s] - A man in a dark jacket and jeans walks along the wet sidewalk, holding an umbrella.  \n- A white car passes by on the street, followed by a black car.  \n- A red storefront with \"XEVEREST\" signage is visible, displaying various products through its glass windows.\n[390-420s] - A man in a red jacket walks past storefronts on a wet sidewalk, moving from left to right.  \n- A woman in a light blue coat walks toward the camera, passing a bakery with colorful displays.  \n- A fruit and vegetable stand is visible with a blue awning, positioned between a bakery and a shop with a wooden door.\n[420-450s] - A woman in a yellow raincoat walks past a storefront with large facial images displayed in the window.  \n- A blue tram passes by on the street, with its doors open and passengers boarding.  \n- A closed shop with a blue facade and a partially open shutter is visible, with a poster on the window.\n[450-480s] - A black SUV drives past storefronts on a wet street, passing a \"Restaurant Chatin\" sign.  \n- Pedestrians walk along the sidewalk, some carrying bags or umbrellas, near a \"Vente de Vêtements\" shop.  \n- A blue \"Place de la République\" sign is visible above a tree-lined street with parked cars and a bus.", "history_tokens": 945, "history_utf8_bytes": 3691, "recent_frame_times_s": [469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0], "recent_frames_sha256": "5023b432f9e46d9c08d400def1c9728f6e1173699bbd998a0a6b77e36bab9bfc", "num_recent_frames": 30, "tq": 718059.166275355, "t1": 718067.24589388, "ta": 718067.24589388, "te": 718067.562926191, "first_response_s": 8.079618524992839, "answer_total_s": 8.396650835988112, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 303, "content_group": "29cc6590ab01062f2512f835332c568dcf91e304740d78433ece273a020e0fd7", "question": {"question_id": "sample_303_a2176_q0", "video_id": 303, "video_path": "./videos/sample_303_real.mp4", "annotation_index": 2176, "question_index": 0, "question": "What item is visible in the hands of a woman passing by a storefront with a pink and white sign?", "options": ["A. An umbrella.", "B. A fruit juice.", "C. A newspaper.", "D. A green bag."], "answer": "D", "time_stamp_s": 737, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [720, 780], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_303_a2176_q0", "video_id": 303, "time_stamp_s": 737, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9d06603140b1bc24c29bdb4ca71f8025341a9b846fb1366bf29d882312d3bacc", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [708.0, 709.0, 710.0, 711.0, 712.0, 713.0, 714.0, 715.0, 716.0, 717.0, 718.0, 719.0, 720.0, 721.0, 722.0, 723.0, 724.0, 725.0, 726.0, 727.0, 728.0, 729.0, 730.0, 731.0, 732.0, 733.0, 734.0, 735.0, 736.0, 737.0], "recent_frames_sha256": "ed2017e20c94bc0e6a22c3e428433c418cf0e663bf311d3a8b570ddf334f382e", "num_recent_frames": 30, "tq": 717910.267856411, "t1": 717920.531632451, "ta": 717920.531632451, "te": 717920.572815181, "first_response_s": 10.263776039937511, "answer_total_s": 10.304958769935183, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_303_a2176_q0", "video_id": 303, "time_stamp_s": 737, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "18451ae460487d5c59c5b155f937559daa03eb47e413e933f5e66142bdf25a88", "condition_order": ["recent", "notes"], "memory": "[360-390s] - A man in a dark jacket and jeans walks along the wet sidewalk, holding an umbrella.  \n- A white car passes by on the street, followed by a black car.  \n- A red storefront with \"XEVEREST\" signage is visible, displaying various products through its glass windows.\n[390-420s] - A man in a red jacket walks past storefronts on a wet sidewalk, moving from left to right.  \n- A woman in a light blue coat walks toward the camera, passing a bakery with colorful displays.  \n- A fruit and vegetable stand is visible with a blue awning, positioned between a bakery and a shop with a wooden door.\n[420-450s] - A woman in a yellow raincoat walks past a storefront with large facial images displayed in the window.  \n- A blue tram passes by on the street, with its doors open and passengers boarding.  \n- A closed shop with a blue facade and a partially open shutter is visible, with a poster on the window.\n[450-480s] - A black SUV drives past storefronts on a wet street, passing a \"Restaurant Chatin\" sign.  \n- Pedestrians walk along the sidewalk, some carrying bags or umbrellas, near a \"Vente de Vêtements\" shop.  \n- A blue \"Place de la République\" sign is visible above a tree-lined street with parked cars and a bus.\n[480-510s] - A man in a blue shirt walks past a brightly lit clothing store window displaying mannequins in colorful dresses.  \n- A bus stop with a blue advertisement poster is visible on the sidewalk, positioned near the street corner.  \n- A street vendor stands behind a blue-topped cart filled with fresh produce, while pedestrians walk along the wet pavement.\n[510-540s] - A man in a plaid shirt walks past a \"VS CO\" store, carrying a large bag.  \n- Pedestrians cross a wet street with white crosswalk lines, some pulling suitcases.  \n- A \"Mara Vives\" bus is parked on the right side of the road, near a tree.\n[540-570s] - A cyclist in a blue jacket rides past a wet street with a white taxi and a red car visible.  \n- A pedestrian with a backpack walks along the sidewalk near a red storefront labeled \"MOHAN JEWELLERY.\"  \n- A white van with \"COURIER\" text drives past, while a red car stops at a crosswalk.\n[570-600s] - A man pushes a scooter past a red storefront with jewelry displays, moving from right to left.  \n- A blue storefront with \"Maison de la Mode\" signage is visible, displaying clothing items in its window.  \n- A wet sidewalk runs alongside the shops, with a black metal railing separating it from the street.\n[600-630s] - A woman in a beige dress walks away from the camera along a wet sidewalk, passing storefronts with visible signage like \"COPPER\" and \"BONNAR TRAVEL\".  \n- A man in a dark jacket and jeans walks toward the camera, holding a phone to his ear, near a black metal barrier.  \n- A storefront with a yellow sign reading \"Maison de la Mode\" displays clothing items, with a person in a white shirt briefly visible inside.\n[630-660s] - A person in a dark coat walks away from the camera along a wet sidewalk past a \"SOUNDAR TRAVEL\" shop.  \n- A black SUV drives past storefronts including \"BOUCHERIE\" and \"MÉDECINE\" on a rainy street.  \n- A green awning with \"MÉDECINE\" signage is visible, with people standing near its entrance.\n[660-690s] - A man in a grey shirt and cap walks past a green storefront with \"VIL\" visible on its sign.  \n- A cyclist rides across a wet street, passing a parked orange van and a metal barrier.  \n- A blue banner with \"Maitre Vieux\" text hangs above a red storefront displaying food images.\n[690-720s] - A man in a blue jacket walks along a wet sidewalk, passing a food stall with an orange awning.  \n- A blue bus is visible on the street, moving away from the camera’s perspective.  \n- A white van with \"Groupe A\" branding drives past, followed by a white car and a yellow taxi.", "history_tokens": 978, "history_utf8_bytes": 3773, "recent_frame_times_s": [708.0, 709.0, 710.0, 711.0, 712.0, 713.0, 714.0, 715.0, 716.0, 717.0, 718.0, 719.0, 720.0, 721.0, 722.0, 723.0, 724.0, 725.0, 726.0, 727.0, 728.0, 729.0, 730.0, 731.0, 732.0, 733.0, 734.0, 735.0, 736.0, 737.0], "recent_frames_sha256": "ed2017e20c94bc0e6a22c3e428433c418cf0e663bf311d3a8b570ddf334f382e", "num_recent_frames": 30, "tq": 718137.952928045, "t1": 718145.089504227, "ta": 718145.089504227, "te": 718145.128240516, "first_response_s": 7.13657618209254, "answer_total_s": 7.175312470993958, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 304, "content_group": "c6b327480f3338564fe0d799b1c326fc81200e8682b5f0b2c964db80fb056aa7", "question": {"question_id": "sample_304_a695_q0", "video_id": 304, "video_path": "./videos/sample_304_real.mp4", "annotation_index": 695, "question_index": 0, "question": "What is prominently displayed on the large green street signs?", "options": ["A. \"Broadway\" and \"5th Ave\" and \"Broadway\".", "B. \"Main St\" and \"1st Ave\".", "C. \"Central Park\" and \"7th Ave\".", "D. \"Union Square West\" and \"E 17 st \" and \"Broadway\"."], "answer": "D", "time_stamp_s": 20, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_304_a695_q0", "video_id": 304, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "21036763cc550f1084f4631a3d1c444f635c611e0a5216624286a301c3452c42", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "b94545a2ea7a6cd1f68d8bf0aeeb855ee97873c0457226a30dbeab3e41171111", "num_recent_frames": 21, "tq": 716954.662365751, "t1": 716968.00109506, "ta": 716968.00109506, "te": 716968.040279441, "first_response_s": 13.338729309034534, "answer_total_s": 13.37791369005572, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_304_a695_q0", "video_id": 304, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8e0be19b54c6c1224eab361f00c90e76faa90e96619c5ac865087303b6dc4cef", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "b94545a2ea7a6cd1f68d8bf0aeeb855ee97873c0457226a30dbeab3e41171111", "num_recent_frames": 21, "tq": 717009.2340858, "t1": 717019.949628685, "ta": 717019.949628685, "te": 717019.987328497, "first_response_s": 10.7155428850092, "answer_total_s": 10.753242696984671, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 304, "content_group": "c6b327480f3338564fe0d799b1c326fc81200e8682b5f0b2c964db80fb056aa7", "question": {"question_id": "sample_304_a696_q0", "video_id": 304, "video_path": "./videos/sample_304_real.mp4", "annotation_index": 696, "question_index": 0, "question": "What is the pedestrian on the left side of the screen holding?", "options": ["A. A black bag.", "B. A green backpack.", "C. A yellow tote bag.", "D. A red and white patterned bag."], "answer": "D", "time_stamp_s": 143, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_304_a696_q0", "video_id": 304, "time_stamp_s": 143, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "62f4efafcf8a1380dd9de84eb2217645cac3d2fe0c5c1f4c6935d39e8f08b33c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0], "recent_frames_sha256": "3c0de81e47dd0ca745555cd68e2c732d9185be98fbfeca3023b20f1243809d05", "num_recent_frames": 30, "tq": 716968.054088351, "t1": 716978.416750449, "ta": 716978.416750449, "te": 716978.455023361, "first_response_s": 10.362662098021246, "answer_total_s": 10.400935010053217, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_304_a696_q0", "video_id": 304, "time_stamp_s": 143, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bb8e29323c802a87f49b098d70ce2f83107c02e3cb407a89c98a2371b2183ee9", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pedestrians cross a street at a crosswalk as traffic lights change, with orange traffic cones marking a construction zone.  \n- A red-brick building with a corner storefront and illuminated windows stands at the intersection, alongside a taller building with a clock tower.  \n- Street signs for \"BROADWAY\" and \"W 14TH ST\" are visible, indicating the location, with a \"No Left Turn\" sign also present.\n[30-60s] - A man in a white t-shirt with a colorful back design walks away from the camera along the sidewalk, passing storefronts.  \n- A cyclist rides past on the street, moving in the same direction as the pedestrian.  \n- A \"Cafe\" sign is visible on a building, with outdoor seating and tables arranged on the sidewalk.\n[60-90s] - A yellow taxi cab is visible on the street, moving along the road.  \n- A pedestrian wearing a white shirt and shorts walks away from the camera on the sidewalk.  \n- A green street sign reading \"BROADWAY\" is visible at the intersection.\n[90-120s] - A man in a blue jacket and orange cap walks away from the camera, carrying a red shopping bag, along a sidewalk lined with tall buildings.  \n- A yellow taxi is parked on the left side of the street, with its headlights on, near a crosswalk where pedestrians are crossing.  \n- A black trash bin is visible on the sidewalk, positioned near the curb, with a black trash bag inside.", "history_tokens": 327, "history_utf8_bytes": 1369, "recent_frame_times_s": [114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0], "recent_frames_sha256": "3c0de81e47dd0ca745555cd68e2c732d9185be98fbfeca3023b20f1243809d05", "num_recent_frames": 30, "tq": 717059.987236281, "t1": 717066.009951477, "ta": 717066.009951477, "te": 717066.048267121, "first_response_s": 6.022715196013451, "answer_total_s": 6.061030839919113, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 304, "content_group": "c6b327480f3338564fe0d799b1c326fc81200e8682b5f0b2c964db80fb056aa7", "question": {"question_id": "sample_304_a697_q0", "video_id": 304, "video_path": "./videos/sample_304_real.mp4", "annotation_index": 697, "question_index": 0, "question": "What number is prominently displayed above an entrance just now?", "options": ["A. 819.", "B. 731.", "C. 129.", "D. 913."], "answer": "D", "time_stamp_s": 300, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_304_a697_q0", "video_id": 304, "time_stamp_s": 300, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5b99bcac16f07eb97ca682dc33a88eb1e8b92c2822a8fb14e53aa30decc94a4b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0], "recent_frames_sha256": "52cd4b22d8e11b6e92be31f3d1686bebc7333a7110f363cefdc88694f1b94c92", "num_recent_frames": 30, "tq": 716978.471402863, "t1": 716989.87273167, "ta": 716989.87273167, "te": 716989.90974066, "first_response_s": 11.401328806998208, "answer_total_s": 11.438337796949781, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_304_a697_q0", "video_id": 304, "time_stamp_s": 300, "ground_truth": "D", "raw_output": "D. 913.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "9f759fafb5fb4d8c00e42c62eba09970471edfc4c37dc4a04ed034f8304dbf7f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pedestrians cross a street at a crosswalk as traffic lights change, with orange traffic cones marking a construction zone.  \n- A red-brick building with a corner storefront and illuminated windows stands at the intersection, alongside a taller building with a clock tower.  \n- Street signs for \"BROADWAY\" and \"W 14TH ST\" are visible, indicating the location, with a \"No Left Turn\" sign also present.\n[30-60s] - A man in a white t-shirt with a colorful back design walks away from the camera along the sidewalk, passing storefronts.  \n- A cyclist rides past on the street, moving in the same direction as the pedestrian.  \n- A \"Cafe\" sign is visible on a building, with outdoor seating and tables arranged on the sidewalk.\n[60-90s] - A yellow taxi cab is visible on the street, moving along the road.  \n- A pedestrian wearing a white shirt and shorts walks away from the camera on the sidewalk.  \n- A green street sign reading \"BROADWAY\" is visible at the intersection.\n[90-120s] - A man in a blue jacket and orange cap walks away from the camera, carrying a red shopping bag, along a sidewalk lined with tall buildings.  \n- A yellow taxi is parked on the left side of the street, with its headlights on, near a crosswalk where pedestrians are crossing.  \n- A black trash bin is visible on the sidewalk, positioned near the curb, with a black trash bag inside.\n[120-150s] - A man in a blue jacket walks leftward on the sidewalk, carrying a red shopping bag.  \n- A woman in a black top walks beside him, holding a phone.  \n- A street sign reading \"BROADWAY\" and \"W 42ND ST\" is visible at the intersection.\n[150-180s] - A man in a blue jacket walks with a red bag, crossing the street at a crosswalk near a red-brick building.  \n- A yellow taxi passes by, its headlights illuminating the street as it moves from right to left.  \n- A storefront with a red neon sign reading \"Café\" is visible, with people gathered outside, some seated at outdoor tables.\n[180-210s] - A man in a blue jacket and orange cap walks leftward, holding a phone, passing a blue trash bin.  \n- A yellow taxi cab moves rightward along the street, passing parked cars and a cyclist.  \n- A cyclist rides rightward on the sidewalk, near a bus stop with a digital display.\n[210-240s] - A yellow taxi cab crosses the street from left to right, passing a red convertible car.\n- Pedestrians walk across a crosswalk as traffic lights change from red to green.\n- A street sign for \"BROADWAY\" is visible at the intersection, with a \"ONE WAY\" sign indicating traffic direction.\n[240-270s] - Pedestrians cross a crosswalk as traffic lights change from green to red.  \n- Cyclists navigate the street, with one rider wearing a yellow jacket.  \n- A storefront with black awnings and illuminated windows is visible on the left.\n[270-300s] - A white arched walkway with illuminated panels extends along the sidewalk, housing pedestrians walking toward the camera.  \n- A red car is parked on the street, positioned near the curb, with its headlights off.  \n- A man in a white t-shirt and glasses walks past the camera, looking down at his phone.", "history_tokens": 770, "history_utf8_bytes": 3107, "recent_frame_times_s": [271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0], "recent_frames_sha256": "52cd4b22d8e11b6e92be31f3d1686bebc7333a7110f363cefdc88694f1b94c92", "num_recent_frames": 30, "tq": 717121.170588324, "t1": 717134.685649512, "ta": 717134.685649512, "te": 717134.996370567, "first_response_s": 13.515061188023537, "answer_total_s": 13.825782243045978, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 304, "content_group": "c6b327480f3338564fe0d799b1c326fc81200e8682b5f0b2c964db80fb056aa7", "question": {"question_id": "sample_304_a698_q0", "video_id": 304, "video_path": "./videos/sample_304_real.mp4", "annotation_index": 698, "question_index": 0, "question": "What colors are the sky exhibiting now?", "options": ["A. Blue and yellow.", "B. Orange and red.", "C. Green and blue.", "D. Pink and blue."], "answer": "D", "time_stamp_s": 428, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_304_a698_q0", "video_id": 304, "time_stamp_s": 428, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fbeb770130b217fa8ff303917193f792e2d18f00c83259ce57b04eeec7e94e26", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0, 421.0, 422.0, 423.0, 424.0, 425.0, 426.0, 427.0, 428.0], "recent_frames_sha256": "777f6547fa33748afada656f8954f589f457a455c758cadea15ebee4ab49808e", "num_recent_frames": 30, "tq": 716989.921442971, "t1": 716997.57231295, "ta": 716997.57231295, "te": 716997.61068827, "first_response_s": 7.650869979057461, "answer_total_s": 7.689245298970491, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_304_a698_q0", "video_id": 304, "time_stamp_s": 428, "ground_truth": "D", "raw_output": "D. Pink and blue.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "baeb88cc612fd8675a080d0c3fb1ccc0d35ec3b061bf78e639f80b3bba9278fc", "condition_order": ["recent", "notes"], "memory": "[30-60s] - A man in a white t-shirt with a colorful back design walks away from the camera along the sidewalk, passing storefronts.  \n- A cyclist rides past on the street, moving in the same direction as the pedestrian.  \n- A \"Cafe\" sign is visible on a building, with outdoor seating and tables arranged on the sidewalk.\n[60-90s] - A yellow taxi cab is visible on the street, moving along the road.  \n- A pedestrian wearing a white shirt and shorts walks away from the camera on the sidewalk.  \n- A green street sign reading \"BROADWAY\" is visible at the intersection.\n[90-120s] - A man in a blue jacket and orange cap walks away from the camera, carrying a red shopping bag, along a sidewalk lined with tall buildings.  \n- A yellow taxi is parked on the left side of the street, with its headlights on, near a crosswalk where pedestrians are crossing.  \n- A black trash bin is visible on the sidewalk, positioned near the curb, with a black trash bag inside.\n[120-150s] - A man in a blue jacket walks leftward on the sidewalk, carrying a red shopping bag.  \n- A woman in a black top walks beside him, holding a phone.  \n- A street sign reading \"BROADWAY\" and \"W 42ND ST\" is visible at the intersection.\n[150-180s] - A man in a blue jacket walks with a red bag, crossing the street at a crosswalk near a red-brick building.  \n- A yellow taxi passes by, its headlights illuminating the street as it moves from right to left.  \n- A storefront with a red neon sign reading \"Café\" is visible, with people gathered outside, some seated at outdoor tables.\n[180-210s] - A man in a blue jacket and orange cap walks leftward, holding a phone, passing a blue trash bin.  \n- A yellow taxi cab moves rightward along the street, passing parked cars and a cyclist.  \n- A cyclist rides rightward on the sidewalk, near a bus stop with a digital display.\n[210-240s] - A yellow taxi cab crosses the street from left to right, passing a red convertible car.\n- Pedestrians walk across a crosswalk as traffic lights change from red to green.\n- A street sign for \"BROADWAY\" is visible at the intersection, with a \"ONE WAY\" sign indicating traffic direction.\n[240-270s] - Pedestrians cross a crosswalk as traffic lights change from green to red.  \n- Cyclists navigate the street, with one rider wearing a yellow jacket.  \n- A storefront with black awnings and illuminated windows is visible on the left.\n[270-300s] - A white arched walkway with illuminated panels extends along the sidewalk, housing pedestrians walking toward the camera.  \n- A red car is parked on the street, positioned near the curb, with its headlights off.  \n- A man in a white t-shirt and glasses walks past the camera, looking down at his phone.\n[300-330s] - White arched canopy structure frames the view, with vertical pillars casting shadows on the sidewalk.  \n- Pedestrians cross the street at a marked crosswalk as traffic lights change from red to green.  \n- A tall building with illuminated windows stands in the background, contrasting with the soft pink and orange hues of the twilight sky.\n[330-360s] - A man in a white shirt walks leftward, looking at his phone, passing a \"BAGEL\" shop sign.  \n- A woman in a patterned dress walks rightward, carrying a white bag, near a tree-lined sidewalk.  \n- A tall building with a construction crane is visible in the background, under a pink-orange sky.\n[360-390s] - Pedestrians walk along a sidewalk lined with potted plants and trees, passing storefronts with awnings.  \n- A yellow taxi and other vehicles move along the street, with traffic lights and street signs visible.  \n- The sky displays a pinkish-orange hue, indicating dusk, with tall buildings in the background.\n[390-420s] - Yellow umbrellas and outdoor seating areas are visible along the sidewalk, with people seated and walking by.  \n- A tall building with a lit-up sign is prominent in the background against a pinkish twilight sky.  \n- Bicycles are parked near flower planters, and pedestrians move along the sidewalk.", "history_tokens": 978, "history_utf8_bytes": 3988, "recent_frame_times_s": [399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0, 421.0, 422.0, 423.0, 424.0, 425.0, 426.0, 427.0, 428.0], "recent_frames_sha256": "777f6547fa33748afada656f8954f589f457a455c758cadea15ebee4ab49808e", "num_recent_frames": 30, "tq": 717198.245148351, "t1": 717204.492895719, "ta": 717204.492895719, "te": 717204.755299172, "first_response_s": 6.247747368062846, "answer_total_s": 6.510150821064599, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 304, "content_group": "c6b327480f3338564fe0d799b1c326fc81200e8682b5f0b2c964db80fb056aa7", "question": {"question_id": "sample_304_a698_q1", "video_id": 304, "video_path": "./videos/sample_304_real.mp4", "annotation_index": 698, "question_index": 1, "question": "Where is the T-Mobile storefront located in relation to the white circular thing?", "options": ["A. Center of the white circular thing.", "B. Right side of the white circular thing.", "C. Left side of the white circular thing.", "D. Not visible in the white circular thing."], "answer": "C", "time_stamp_s": 433, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_304_a698_q1", "video_id": 304, "time_stamp_s": 433, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d811432d8649c7f836df09d4c5c9837d0c6bd257d9d1efc5e6b6a7f3cddfeeaf", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0, 421.0, 422.0, 423.0, 424.0, 425.0, 426.0, 427.0, 428.0, 429.0, 430.0, 431.0, 432.0, 433.0], "recent_frames_sha256": "2abd7a8529d6edb5f2dfe88ff1b0c3f243205c9c4071a4549ccaa20ae87b2b5f", "num_recent_frames": 30, "tq": 716997.623745353, "t1": 717009.190656217, "ta": 717009.190656217, "te": 717009.227905607, "first_response_s": 11.566910864086822, "answer_total_s": 11.604160254006274, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_304_a698_q1", "video_id": 304, "time_stamp_s": 433, "ground_truth": "C", "raw_output": "C. Left side of the white circular thing.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "f345e7a76accb488f2d5c477cd403c7493fbd8027141889158dc8959f5666fab", "condition_order": ["recent", "notes"], "memory": "[30-60s] - A man in a white t-shirt with a colorful back design walks away from the camera along the sidewalk, passing storefronts.  \n- A cyclist rides past on the street, moving in the same direction as the pedestrian.  \n- A \"Cafe\" sign is visible on a building, with outdoor seating and tables arranged on the sidewalk.\n[60-90s] - A yellow taxi cab is visible on the street, moving along the road.  \n- A pedestrian wearing a white shirt and shorts walks away from the camera on the sidewalk.  \n- A green street sign reading \"BROADWAY\" is visible at the intersection.\n[90-120s] - A man in a blue jacket and orange cap walks away from the camera, carrying a red shopping bag, along a sidewalk lined with tall buildings.  \n- A yellow taxi is parked on the left side of the street, with its headlights on, near a crosswalk where pedestrians are crossing.  \n- A black trash bin is visible on the sidewalk, positioned near the curb, with a black trash bag inside.\n[120-150s] - A man in a blue jacket walks leftward on the sidewalk, carrying a red shopping bag.  \n- A woman in a black top walks beside him, holding a phone.  \n- A street sign reading \"BROADWAY\" and \"W 42ND ST\" is visible at the intersection.\n[150-180s] - A man in a blue jacket walks with a red bag, crossing the street at a crosswalk near a red-brick building.  \n- A yellow taxi passes by, its headlights illuminating the street as it moves from right to left.  \n- A storefront with a red neon sign reading \"Café\" is visible, with people gathered outside, some seated at outdoor tables.\n[180-210s] - A man in a blue jacket and orange cap walks leftward, holding a phone, passing a blue trash bin.  \n- A yellow taxi cab moves rightward along the street, passing parked cars and a cyclist.  \n- A cyclist rides rightward on the sidewalk, near a bus stop with a digital display.\n[210-240s] - A yellow taxi cab crosses the street from left to right, passing a red convertible car.\n- Pedestrians walk across a crosswalk as traffic lights change from red to green.\n- A street sign for \"BROADWAY\" is visible at the intersection, with a \"ONE WAY\" sign indicating traffic direction.\n[240-270s] - Pedestrians cross a crosswalk as traffic lights change from green to red.  \n- Cyclists navigate the street, with one rider wearing a yellow jacket.  \n- A storefront with black awnings and illuminated windows is visible on the left.\n[270-300s] - A white arched walkway with illuminated panels extends along the sidewalk, housing pedestrians walking toward the camera.  \n- A red car is parked on the street, positioned near the curb, with its headlights off.  \n- A man in a white t-shirt and glasses walks past the camera, looking down at his phone.\n[300-330s] - White arched canopy structure frames the view, with vertical pillars casting shadows on the sidewalk.  \n- Pedestrians cross the street at a marked crosswalk as traffic lights change from red to green.  \n- A tall building with illuminated windows stands in the background, contrasting with the soft pink and orange hues of the twilight sky.\n[330-360s] - A man in a white shirt walks leftward, looking at his phone, passing a \"BAGEL\" shop sign.  \n- A woman in a patterned dress walks rightward, carrying a white bag, near a tree-lined sidewalk.  \n- A tall building with a construction crane is visible in the background, under a pink-orange sky.\n[360-390s] - Pedestrians walk along a sidewalk lined with potted plants and trees, passing storefronts with awnings.  \n- A yellow taxi and other vehicles move along the street, with traffic lights and street signs visible.  \n- The sky displays a pinkish-orange hue, indicating dusk, with tall buildings in the background.\n[390-420s] - Yellow umbrellas and outdoor seating areas are visible along the sidewalk, with people seated and walking by.  \n- A tall building with a lit-up sign is prominent in the background against a pinkish twilight sky.  \n- Bicycles are parked near flower planters, and pedestrians move along the sidewalk.", "history_tokens": 978, "history_utf8_bytes": 3988, "recent_frame_times_s": [404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0, 421.0, 422.0, 423.0, 424.0, 425.0, 426.0, 427.0, 428.0, 429.0, 430.0, 431.0, 432.0, 433.0], "recent_frames_sha256": "2abd7a8529d6edb5f2dfe88ff1b0c3f243205c9c4071a4549ccaa20ae87b2b5f", "num_recent_frames": 30, "tq": 717204.785150252, "t1": 717213.01731775, "ta": 717213.01731775, "te": 717213.40812459, "first_response_s": 8.232167497975752, "answer_total_s": 8.622974337893538, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 305, "content_group": "1a0d74ed5d84328d64293309a6924ad04be3e3c04fa696403b1411cbf49890a9", "question": {"question_id": "sample_305_a2243_q0", "video_id": 305, "video_path": "./videos/sample_305_real.mp4", "annotation_index": 2243, "question_index": 0, "question": "What is the color of the sky now?", "options": ["A. Blue and white.", "B. Pale yellow to deep red and purple.", "C. Grey and yellow.", "D. Orange and blue."], "answer": "B", "time_stamp_s": 3, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_305_a2243_q0", "video_id": 305, "time_stamp_s": 3, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b92c21da7455fc04bbd1533ffd74401812c74b0c8b5ccfca6b4b6aba9a16b66a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.033984375, 1.0006510416666667, 2.0006510416666665], "recent_frames_sha256": "2e17fdd1aad27fdcc4e9d041afb69fc0a3e26f9c495f77472359fe3433dac7b1", "num_recent_frames": 3, "tq": 719130.597221629, "t1": 719141.733526946, "ta": 719141.733526946, "te": 719141.771094666, "first_response_s": 11.136305317049846, "answer_total_s": 11.173873036983423, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_305_a2243_q0", "video_id": 305, "time_stamp_s": 3, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "05b16e493b21a115cab25a562a7844cb0228043f4605a26d7bf3b1f9f92c2b04", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.033984375, 1.0006510416666667, 2.0006510416666665], "recent_frames_sha256": "2e17fdd1aad27fdcc4e9d041afb69fc0a3e26f9c495f77472359fe3433dac7b1", "num_recent_frames": 3, "tq": 719184.245057496, "t1": 719195.2113471, "ta": 719195.2113471, "te": 719195.588329063, "first_response_s": 10.966289603966288, "answer_total_s": 11.343271567020565, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 305, "content_group": "1a0d74ed5d84328d64293309a6924ad04be3e3c04fa696403b1411cbf49890a9", "question": {"question_id": "sample_305_a2243_q1", "video_id": 305, "video_path": "./videos/sample_305_real.mp4", "annotation_index": 2243, "question_index": 1, "question": "Where is the dog seen when the perspective shifts to the right?", "options": ["A. In a park.", "B. On a leash.", "C. In a car.", "D. At a storefront."], "answer": "B", "time_stamp_s": 14, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_305_a2243_q1", "video_id": 305, "time_stamp_s": 14, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "70b57e795ffdd244eb6638d01866d49ac58ba9c2a399b2d2cb409d5f9aedadd7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.033984375, 1.0006510416666667, 2.0006510416666665, 3.0006510416666665, 4.000651041666667, 5.000651041666667, 6.000651041666667, 7.000651041666667, 8.000651041666666, 9.000651041666666, 10.000651041666666, 11.000651041666666, 12.000651041666666, 13.000651041666666], "recent_frames_sha256": "8cf8096ed317a460e921a8d012818bd7c12b2c9e463cb502506ae8e5595a6c09", "num_recent_frames": 14, "tq": 719141.779082312, "t1": 719155.818544322, "ta": 719155.818544322, "te": 719155.8565556, "first_response_s": 14.03946201002691, "answer_total_s": 14.0774732879363, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_305_a2243_q1", "video_id": 305, "time_stamp_s": 14, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "25e03db46063be25877606323b3b111a956fc5a498c6aa4dbca4a935861cead3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.033984375, 1.0006510416666667, 2.0006510416666665, 3.0006510416666665, 4.000651041666667, 5.000651041666667, 6.000651041666667, 7.000651041666667, 8.000651041666666, 9.000651041666666, 10.000651041666666, 11.000651041666666, 12.000651041666666, 13.000651041666666], "recent_frames_sha256": "8cf8096ed317a460e921a8d012818bd7c12b2c9e463cb502506ae8e5595a6c09", "num_recent_frames": 14, "tq": 719195.603055124, "t1": 719208.500523847, "ta": 719208.500523847, "te": 719208.542483767, "first_response_s": 12.897468722891062, "answer_total_s": 12.939428642974235, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 305, "content_group": "1a0d74ed5d84328d64293309a6924ad04be3e3c04fa696403b1411cbf49890a9", "question": {"question_id": "sample_305_a2244_q0", "video_id": 305, "video_path": "./videos/sample_305_real.mp4", "annotation_index": 2244, "question_index": 0, "question": "What number is displayed prominently on the building with large glass windows just now", "options": ["A. 5.", "B. 7.", "C. 10.", "D. 12."], "answer": "C", "time_stamp_s": 144, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_305_a2244_q0", "video_id": 305, "time_stamp_s": 144, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e0539cbe5429182b13f1d2b720bf777a73a8d35a24b548cebdf74e2d96a279fc", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [114.00065104166667, 115.00065104166667, 116.00065104166667, 117.00065104166667, 118.00065104166667, 119.00065104166667, 120.00065104166667, 121.00065104166667, 122.00065104166667, 123.00065104166667, 124.00065104166667, 125.00065104166667, 126.00065104166667, 127.00065104166667, 128.00065104166666, 129.00065104166666, 130.00065104166666, 131.00065104166666, 132.00065104166666, 133.00065104166666, 134.00065104166666, 135.00065104166666, 136.00065104166666, 137.00065104166666, 138.00065104166666, 139.00065104166666, 140.00065104166666, 141.00065104166666, 142.00065104166666, 143.00065104166666], "recent_frames_sha256": "e9e7e826cb6836c27c9881f59ee094e661e748dd37a8fc324bdab09ed93a0931", "num_recent_frames": 30, "tq": 719155.865496989, "t1": 719166.512860802, "ta": 719166.512860802, "te": 719166.552108162, "first_response_s": 10.647363813011907, "answer_total_s": 10.686611172975972, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_305_a2244_q0", "video_id": 305, "time_stamp_s": 144, "ground_truth": "C", "raw_output": "C. 10.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "3fd4c3bd5f7a13dace005967838f2b8d9a6c96490742d7058284e17eccb76569", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Sunset casts warm orange glow over city streets as pedestrians cross at intersections with red traffic lights.  \n- A man in a red shirt walks toward camera on sidewalk, carrying a black backpack, while a white dog runs beside him.  \n- Yellow taxis and other vehicles move along streets lined with tall buildings, some with illuminated windows, as people walk or stand near storefronts.\n[30-60s] - Pedestrians cross a street at a crosswalk under a vibrant orange sunset sky.  \n- A yellow taxi and other vehicles navigate the intersection as traffic flows.  \n- A \"ONE WAY\" street sign is visible on the right, indicating directional traffic flow.\n[60-90s] - A yellow taxi cab moves rightward across the street, passing a red bus and other vehicles.  \n- A tall, ornate clock tower building is visible in the background, illuminated by dusk light.  \n- A green-lit food truck with a menu board is parked near a sidewalk, with pedestrians walking past.\n[90-120s] - A golden clock tower stands prominently at a street corner, its face illuminated against the twilight sky.  \n- Pedestrians cross a zebra-striped crosswalk beneath a white arched walkway, with a \"FATALY\" sign visible overhead.  \n- A \"PORCELANOSA\" building facade glows in the background, while a \"PUMA\" store entrance is visible on the left side of the street.", "history_tokens": 312, "history_utf8_bytes": 1328, "recent_frame_times_s": [114.00065104166667, 115.00065104166667, 116.00065104166667, 117.00065104166667, 118.00065104166667, 119.00065104166667, 120.00065104166667, 121.00065104166667, 122.00065104166667, 123.00065104166667, 124.00065104166667, 125.00065104166667, 126.00065104166667, 127.00065104166667, 128.00065104166666, 129.00065104166666, 130.00065104166666, 131.00065104166666, 132.00065104166666, 133.00065104166666, 134.00065104166666, 135.00065104166666, 136.00065104166666, 137.00065104166666, 138.00065104166666, 139.00065104166666, 140.00065104166666, 141.00065104166666, 142.00065104166666, 143.00065104166666], "recent_frames_sha256": "e9e7e826cb6836c27c9881f59ee094e661e748dd37a8fc324bdab09ed93a0931", "num_recent_frames": 30, "tq": 719237.686772739, "t1": 719244.442685422, "ta": 719244.442685422, "te": 719244.664715695, "first_response_s": 6.755912682972848, "answer_total_s": 6.977942955913022, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 305, "content_group": "1a0d74ed5d84328d64293309a6924ad04be3e3c04fa696403b1411cbf49890a9", "question": {"question_id": "sample_305_a2245_q0", "video_id": 305, "video_path": "./videos/sample_305_real.mp4", "annotation_index": 2245, "question_index": 0, "question": "Which sign is prominently displayed on the left side of the street now?", "options": ["A. BROADWAY PLAZA HOTEL.", "B. CITY LIBRARY.", "C. CENTRAL PARK CAFE.", "D. GRAND THEATER."], "answer": "A", "time_stamp_s": 296, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_305_a2245_q0", "video_id": 305, "time_stamp_s": 296, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "080fbda62c1e51820bc51cdc7867dfc98e00401c676cfcd11bacdf873c5dac85", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [266.0006510416667, 267.0006510416667, 268.0006510416667, 269.0006510416667, 270.0006510416667, 271.0006510416667, 272.0006510416667, 273.0006510416667, 274.0006510416667, 275.0006510416667, 276.0006510416667, 277.0006510416667, 278.0006510416667, 279.0006510416667, 280.0006510416667, 281.0006510416667, 282.0006510416667, 283.0006510416667, 284.0006510416667, 285.0006510416667, 286.0006510416667, 287.0006510416667, 288.0006510416667, 289.0006510416667, 290.0006510416667, 291.0006510416667, 292.0006510416667, 293.0006510416667, 294.0006510416667, 295.0006510416667], "recent_frames_sha256": "caed2d99c548e1058e21567d4e7b1251d0f02c2365f8c1d48b65bf7e7c6d7d46", "num_recent_frames": 30, "tq": 719166.561146621, "t1": 719176.589927792, "ta": 719176.589927792, "te": 719176.628177784, "first_response_s": 10.02878117095679, "answer_total_s": 10.067031163023785, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_305_a2245_q0", "video_id": 305, "time_stamp_s": 296, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5a7adda98ca868d030208bb88eee30496cebf3c957fa386747778a1ca76cb55a", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Sunset casts warm orange glow over city streets as pedestrians cross at intersections with red traffic lights.  \n- A man in a red shirt walks toward camera on sidewalk, carrying a black backpack, while a white dog runs beside him.  \n- Yellow taxis and other vehicles move along streets lined with tall buildings, some with illuminated windows, as people walk or stand near storefronts.\n[30-60s] - Pedestrians cross a street at a crosswalk under a vibrant orange sunset sky.  \n- A yellow taxi and other vehicles navigate the intersection as traffic flows.  \n- A \"ONE WAY\" street sign is visible on the right, indicating directional traffic flow.\n[60-90s] - A yellow taxi cab moves rightward across the street, passing a red bus and other vehicles.  \n- A tall, ornate clock tower building is visible in the background, illuminated by dusk light.  \n- A green-lit food truck with a menu board is parked near a sidewalk, with pedestrians walking past.\n[90-120s] - A golden clock tower stands prominently at a street corner, its face illuminated against the twilight sky.  \n- Pedestrians cross a zebra-striped crosswalk beneath a white arched walkway, with a \"FATALY\" sign visible overhead.  \n- A \"PORCELANOSA\" building facade glows in the background, while a \"PUMA\" store entrance is visible on the left side of the street.\n[120-150s] - A woman in a red dress walks past a PetSmart store, holding a phone.  \n- A family walks away from the camera, with a child in a white shirt and a man in a green shirt.  \n- A \"PORCELANOSA\" building sign is visible in the background, with illuminated windows.\n[150-180s] - A family of three walks away from the camera along a sidewalk, with the child in a white shirt and the adults in casual attire.  \n- A purple banner hangs from a building on the left, and a street sign reading \"BROADWAY\" is visible at the intersection.  \n- Traffic lights change from green to red as pedestrians cross the street, with a white car passing by on the right.\n[180-210s] - A man and a child cross a street at a crosswalk, with the man holding the child’s hand.  \n- A red traffic light is visible at the intersection, indicating stop for vehicles.  \n- Outdoor café seating with green umbrellas and tables is lined along the sidewalk, illuminated by ambient streetlights.\n[210-240s] - A man in a beige t-shirt walks away from the camera, followed by a child in a white shirt.  \n- The street is lined with tall buildings, some with lit windows, and outdoor café tables under umbrellas.  \n- A hanging flower basket swings slightly as the camera moves forward.\n[240-270s] - Pedestrians cross a street at a crosswalk as traffic lights change, with a black car and a red vehicle passing by.\n- A covered walkway with scaffolding and illuminated signs (e.g., \"ALMUNIA\" and \"MALIN+GOETZ\") shelters people walking along the sidewalk.\n- A street sign reading \"BROADWAY\" is visible, indicating the location near a major urban thoroughfare.", "history_tokens": 719, "history_utf8_bytes": 2954, "recent_frame_times_s": [266.0006510416667, 267.0006510416667, 268.0006510416667, 269.0006510416667, 270.0006510416667, 271.0006510416667, 272.0006510416667, 273.0006510416667, 274.0006510416667, 275.0006510416667, 276.0006510416667, 277.0006510416667, 278.0006510416667, 279.0006510416667, 280.0006510416667, 281.0006510416667, 282.0006510416667, 283.0006510416667, 284.0006510416667, 285.0006510416667, 286.0006510416667, 287.0006510416667, 288.0006510416667, 289.0006510416667, 290.0006510416667, 291.0006510416667, 292.0006510416667, 293.0006510416667, 294.0006510416667, 295.0006510416667], "recent_frames_sha256": "caed2d99c548e1058e21567d4e7b1251d0f02c2365f8c1d48b65bf7e7c6d7d46", "num_recent_frames": 30, "tq": 719283.936400341, "t1": 719286.018335262, "ta": 719286.018335262, "te": 719286.327300633, "first_response_s": 2.081934920977801, "answer_total_s": 2.390900291968137, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 305, "content_group": "1a0d74ed5d84328d64293309a6924ad04be3e3c04fa696403b1411cbf49890a9", "question": {"question_id": "sample_305_a2246_q0", "video_id": 305, "video_path": "./videos/sample_305_real.mp4", "annotation_index": 2246, "question_index": 0, "question": "What action is the person near the sidewalk doing now?", "options": ["A. Walking a dog.", "B. Talking on the phone.", "C. Taking a photo or video.", "D. Eating at a table."], "answer": "C", "time_stamp_s": 440, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_305_a2246_q0", "video_id": 305, "time_stamp_s": 440, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c49d6249a042b20888cf517811da2226285dde423468ca7c3005e7a21afdaf64", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [410.0006510416667, 411.0006510416667, 412.0006510416667, 413.0006510416667, 414.0006510416667, 415.0006510416667, 416.0006510416667, 417.0006510416667, 418.0006510416667, 419.0006510416667, 420.0006510416667, 421.0006510416667, 422.0006510416667, 423.0006510416667, 424.0006510416667, 425.0006510416667, 426.0006510416667, 427.0006510416667, 428.0006510416667, 429.0006510416667, 430.0006510416667, 431.0006510416667, 432.0006510416667, 433.0006510416667, 434.0006510416667, 435.0006510416667, 436.0006510416667, 437.0006510416667, 438.0006510416667, 439.0006510416667], "recent_frames_sha256": "be5b66a4e84fc0ac41b296ce9b0ee9a1f54f14a2b01bc3f1aa9155eb0758f5d4", "num_recent_frames": 30, "tq": 719176.637366121, "t1": 719184.200236427, "ta": 719184.200236427, "te": 719184.2374507, "first_response_s": 7.562870305962861, "answer_total_s": 7.600084578967653, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_305_a2246_q0", "video_id": 305, "time_stamp_s": 440, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dddf6aa73bb92a3edcff9e75469949160bb26f90fa5ce0f768fe73e2e97612d6", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Pedestrians cross a street at a crosswalk under a vibrant orange sunset sky.  \n- A yellow taxi and other vehicles navigate the intersection as traffic flows.  \n- A \"ONE WAY\" street sign is visible on the right, indicating directional traffic flow.\n[60-90s] - A yellow taxi cab moves rightward across the street, passing a red bus and other vehicles.  \n- A tall, ornate clock tower building is visible in the background, illuminated by dusk light.  \n- A green-lit food truck with a menu board is parked near a sidewalk, with pedestrians walking past.\n[90-120s] - A golden clock tower stands prominently at a street corner, its face illuminated against the twilight sky.  \n- Pedestrians cross a zebra-striped crosswalk beneath a white arched walkway, with a \"FATALY\" sign visible overhead.  \n- A \"PORCELANOSA\" building facade glows in the background, while a \"PUMA\" store entrance is visible on the left side of the street.\n[120-150s] - A woman in a red dress walks past a PetSmart store, holding a phone.  \n- A family walks away from the camera, with a child in a white shirt and a man in a green shirt.  \n- A \"PORCELANOSA\" building sign is visible in the background, with illuminated windows.\n[150-180s] - A family of three walks away from the camera along a sidewalk, with the child in a white shirt and the adults in casual attire.  \n- A purple banner hangs from a building on the left, and a street sign reading \"BROADWAY\" is visible at the intersection.  \n- Traffic lights change from green to red as pedestrians cross the street, with a white car passing by on the right.\n[180-210s] - A man and a child cross a street at a crosswalk, with the man holding the child’s hand.  \n- A red traffic light is visible at the intersection, indicating stop for vehicles.  \n- Outdoor café seating with green umbrellas and tables is lined along the sidewalk, illuminated by ambient streetlights.\n[210-240s] - A man in a beige t-shirt walks away from the camera, followed by a child in a white shirt.  \n- The street is lined with tall buildings, some with lit windows, and outdoor café tables under umbrellas.  \n- A hanging flower basket swings slightly as the camera moves forward.\n[240-270s] - Pedestrians cross a street at a crosswalk as traffic lights change, with a black car and a red vehicle passing by.\n- A covered walkway with scaffolding and illuminated signs (e.g., \"ALMUNIA\" and \"MALIN+GOETZ\") shelters people walking along the sidewalk.\n- A street sign reading \"BROADWAY\" is visible, indicating the location near a major urban thoroughfare.\n[270-300s] - A group of pedestrians walks along a sidewalk under a covered walkway, passing storefronts like \"OCTA\" and \"WALMART+GOETZ\".\n- A digital billboard displays an advertisement for \"Burger King\" with a \"Burger King\" logo and text.\n- The camera pans right, revealing more storefronts, including \"FELTOWEARS\" and \"MCDONALD'S\", with people walking and dining outside.\n[300-330s] - A woman in a white dress walks across the street, holding a phone, while others cross nearby.  \n- A red-lit restaurant with outdoor seating is visible on the left, with people seated inside.  \n- A traffic light at the intersection shows green, allowing vehicles and pedestrians to move.\n[330-360s] - A woman in a white dress walks across the street, crossing the crosswalk as traffic lights turn red.  \n- A man in a dark suit stands near the corner, observing the street while holding a phone.  \n- Yellow umbrellas and outdoor seating are visible along the sidewalk, with people dining under them.\n[360-390s] - A man in a black jacket walks past a brightly lit \"Cafe\" storefront on the left.  \n- Yellow umbrellas shade outdoor seating at a café on the right, with patrons seated.  \n- A blue \"P\" parking sign is visible on the sidewalk near the street corner.\n[390-420s] - Yellow taxi cab moves leftward across crosswalk, passing pedestrians waiting at intersection.\n- Pedestrians cross street at marked crosswalk as traffic lights change to green.\n- Modern glass building with illuminated signage stands on left, while older brick buildings line right side of street.", "history_tokens": 1019, "history_utf8_bytes": 4113, "recent_frame_times_s": [410.0006510416667, 411.0006510416667, 412.0006510416667, 413.0006510416667, 414.0006510416667, 415.0006510416667, 416.0006510416667, 417.0006510416667, 418.0006510416667, 419.0006510416667, 420.0006510416667, 421.0006510416667, 422.0006510416667, 423.0006510416667, 424.0006510416667, 425.0006510416667, 426.0006510416667, 427.0006510416667, 428.0006510416667, 429.0006510416667, 430.0006510416667, 431.0006510416667, 432.0006510416667, 433.0006510416667, 434.0006510416667, 435.0006510416667, 436.0006510416667, 437.0006510416667, 438.0006510416667, 439.0006510416667], "recent_frames_sha256": "be5b66a4e84fc0ac41b296ce9b0ee9a1f54f14a2b01bc3f1aa9155eb0758f5d4", "num_recent_frames": 30, "tq": 719330.995264254, "t1": 719336.634913304, "ta": 719336.634913304, "te": 719336.675912446, "first_response_s": 5.639649049961008, "answer_total_s": 5.680648191948421, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 306, "content_group": "a082f9d9c6e45b37f2d8391bb2fbd7beb097308fa72358ffadc7388d801bed15", "question": {"question_id": "sample_306_a533_q0", "video_id": 306, "video_path": "./videos/sample_306_real.mp4", "annotation_index": 533, "question_index": 0, "question": "What are some pedestrians seen doing as they walk along the sidewalk?", "options": ["A. Riding bikes.", "B. Taking pictures.", "C. Carrying umbrellas.", "D. Jogging."], "answer": "C", "time_stamp_s": 15, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_306_a533_q0", "video_id": 306, "time_stamp_s": 15, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5d0ed74311486642c432986f2ab90aab4cf8f0f82242ba288469fecaeb77968e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.01796875, 1.0013020833333333, 2.0013020833333335, 3.0013020833333335, 4.001302083333333, 5.001302083333333, 6.001302083333333, 7.001302083333333, 8.001302083333334, 9.001302083333334, 10.001302083333334, 11.001302083333334, 12.001302083333334, 13.001302083333334, 14.001302083333334], "recent_frames_sha256": "2678846618c56918bc3e346bccb388e1a7b1f166ea22bdb029fa7683764d6cad", "num_recent_frames": 15, "tq": 719370.380021393, "t1": 719376.118879941, "ta": 719376.118879941, "te": 719376.158104043, "first_response_s": 5.738858547993004, "answer_total_s": 5.778082650038414, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_306_a533_q0", "video_id": 306, "time_stamp_s": 15, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1c38014fb2d46d3f2ed3d0b43dfad70a0d195528aa04456d0bc9c09839b98fa1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.01796875, 1.0013020833333333, 2.0013020833333335, 3.0013020833333335, 4.001302083333333, 5.001302083333333, 6.001302083333333, 7.001302083333333, 8.001302083333334, 9.001302083333334, 10.001302083333334, 11.001302083333334, 12.001302083333334, 13.001302083333334, 14.001302083333334], "recent_frames_sha256": "2678846618c56918bc3e346bccb388e1a7b1f166ea22bdb029fa7683764d6cad", "num_recent_frames": 15, "tq": 719410.261046299, "t1": 719417.002035664, "ta": 719417.002035664, "te": 719417.201737663, "first_response_s": 6.740989365032874, "answer_total_s": 6.940691363997757, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 306, "content_group": "a082f9d9c6e45b37f2d8391bb2fbd7beb097308fa72358ffadc7388d801bed15", "question": {"question_id": "sample_306_a534_q0", "video_id": 306, "video_path": "./videos/sample_306_real.mp4", "annotation_index": 534, "question_index": 0, "question": "What is the name on the food truck?", "options": ["A. Marco's Delights.", "B. Shanif's Famous.", "C. Tasty Treats.", "D. City Eats."], "answer": "B", "time_stamp_s": 149, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_306_a534_q0", "video_id": 306, "time_stamp_s": 149, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6c1543a35b7043e9e631c071883ed3d6f9bd19822dce72316ef58dff12394052", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [119.00130208333333, 120.00130208333333, 121.00130208333333, 122.00130208333333, 123.00130208333333, 124.00130208333333, 125.00130208333333, 126.00130208333333, 127.00130208333333, 128.00130208333334, 129.00130208333334, 130.00130208333334, 131.00130208333334, 132.00130208333334, 133.00130208333334, 134.00130208333334, 135.00130208333334, 136.00130208333334, 137.00130208333334, 138.00130208333334, 139.00130208333334, 140.00130208333334, 141.00130208333334, 142.00130208333334, 143.00130208333334, 144.00130208333334, 145.00130208333334, 146.00130208333334, 147.00130208333334, 148.00130208333334], "recent_frames_sha256": "69a34fb43f4c040f90317d2bd8be105281f866130b898a710bce040f32096ad9", "num_recent_frames": 30, "tq": 719376.185219229, "t1": 719383.676776047, "ta": 719383.676776047, "te": 719383.717149073, "first_response_s": 7.491556818014942, "answer_total_s": 7.53192984405905, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_306_a534_q0", "video_id": 306, "time_stamp_s": 149, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4a0df4fedd302a9cb133c013408b7f56398717a83ddc7b12151552d7d44abd5c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pedestrians walk along a sidewalk beside a Virgin store, some carrying umbrellas as rain appears.  \n- A row of blue bicycles is parked along the curb, with a black car parked nearby.  \n- Street signs and illuminated building facades, including a \"CITY HALL\" sign, are visible as the camera pans right.\n[30-60s] - Yellow taxi cab moves rightward across street, passing traffic light at intersection.\n- Pedestrian in white shirt walks leftward along sidewalk, near storefront with illuminated sign.\n- Traffic light changes from red to green, allowing vehicles to proceed through intersection.\n[60-90s] - A person in a bright green outfit stands near a crosswalk, observing traffic.  \n- Yellow umbrellas shade outdoor seating areas along the sidewalk, with patrons seated.  \n- A white SUV passes through the intersection, momentarily obscuring the view of the street.\n[90-120s] - Pedestrians walk along the sidewalk, some moving toward the camera, others away, near a building with vertical columns.  \n- A blue car is parked on the street, with a white SUV and black sedan following behind it.  \n- A green street sign is visible near the center of the frame, with a crosswalk and traffic lights in the distance.", "history_tokens": 278, "history_utf8_bytes": 1218, "recent_frame_times_s": [119.00130208333333, 120.00130208333333, 121.00130208333333, 122.00130208333333, 123.00130208333333, 124.00130208333333, 125.00130208333333, 126.00130208333333, 127.00130208333333, 128.00130208333334, 129.00130208333334, 130.00130208333334, 131.00130208333334, 132.00130208333334, 133.00130208333334, 134.00130208333334, 135.00130208333334, 136.00130208333334, 137.00130208333334, 138.00130208333334, 139.00130208333334, 140.00130208333334, 141.00130208333334, 142.00130208333334, 143.00130208333334, 144.00130208333334, 145.00130208333334, 146.00130208333334, 147.00130208333334, 148.00130208333334], "recent_frames_sha256": "69a34fb43f4c040f90317d2bd8be105281f866130b898a710bce040f32096ad9", "num_recent_frames": 30, "tq": 719441.49861831, "t1": 719443.630645948, "ta": 719443.630645948, "te": 719443.821258813, "first_response_s": 2.132027638028376, "answer_total_s": 2.32264050305821, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 306, "content_group": "a082f9d9c6e45b37f2d8391bb2fbd7beb097308fa72358ffadc7388d801bed15", "question": {"question_id": "sample_306_a535_q0", "video_id": 306, "video_path": "./videos/sample_306_real.mp4", "annotation_index": 535, "question_index": 0, "question": "What is the general atmosphere of the street right now?", "options": ["A. Calm and quiet.", "B. Busy and vibrant.", "C. Deserted and eerie.", "D. Tense and chaotic."], "answer": "B", "time_stamp_s": 294, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_306_a535_q0", "video_id": 306, "time_stamp_s": 294, "ground_truth": "B", "raw_output": "B. Busy and vibrant.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "c8963fd54db556cb4dc5fa3799d1470c0e4c2e1a485278910ec07ca298348930", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [264.0013020833333, 265.0013020833333, 266.0013020833333, 267.0013020833333, 268.0013020833333, 269.0013020833333, 270.0013020833333, 271.0013020833333, 272.0013020833333, 273.0013020833333, 274.0013020833333, 275.0013020833333, 276.0013020833333, 277.0013020833333, 278.0013020833333, 279.0013020833333, 280.0013020833333, 281.0013020833333, 282.0013020833333, 283.0013020833333, 284.0013020833333, 285.0013020833333, 286.0013020833333, 287.0013020833333, 288.0013020833333, 289.0013020833333, 290.0013020833333, 291.0013020833333, 292.0013020833333, 293.0013020833333], "recent_frames_sha256": "ef8583764a6d106854a63fad6145ae0901a71f9762e400e4a2625d4904140525", "num_recent_frames": 30, "tq": 719383.743225397, "t1": 719395.929816793, "ta": 719395.929816793, "te": 719396.15752306, "first_response_s": 12.186591395991854, "answer_total_s": 12.414297663024627, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_306_a535_q0", "video_id": 306, "time_stamp_s": 294, "ground_truth": "B", "raw_output": "B. Busy and vibrant.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "47ef419b36ac84e0b479e9a6bdd317d9f491afd1b49130e4e8bb966d4a80f2f3", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pedestrians walk along a sidewalk beside a Virgin store, some carrying umbrellas as rain appears.  \n- A row of blue bicycles is parked along the curb, with a black car parked nearby.  \n- Street signs and illuminated building facades, including a \"CITY HALL\" sign, are visible as the camera pans right.\n[30-60s] - Yellow taxi cab moves rightward across street, passing traffic light at intersection.\n- Pedestrian in white shirt walks leftward along sidewalk, near storefront with illuminated sign.\n- Traffic light changes from red to green, allowing vehicles to proceed through intersection.\n[60-90s] - A person in a bright green outfit stands near a crosswalk, observing traffic.  \n- Yellow umbrellas shade outdoor seating areas along the sidewalk, with patrons seated.  \n- A white SUV passes through the intersection, momentarily obscuring the view of the street.\n[90-120s] - Pedestrians walk along the sidewalk, some moving toward the camera, others away, near a building with vertical columns.  \n- A blue car is parked on the street, with a white SUV and black sedan following behind it.  \n- A green street sign is visible near the center of the frame, with a crosswalk and traffic lights in the distance.\n[120-150s] - A red food truck with \"NEW YORK\" signage is parked along the sidewalk, partially obscured by scaffolding.  \n- Pedestrians walk along the sidewalk under metal scaffolding, some moving toward the camera, others away.  \n- A cyclist in a yellow shirt rides past the scaffolding, heading toward the right side of the frame.\n[150-180s] - A woman in a patterned dress stands near a red food truck, holding a phone to her ear.  \n- Pedestrians walk along the sidewalk, some carrying bags, as the camera pans left past storefronts.  \n- A white police car is parked on the street, with a red and white ambulance visible further down the road.\n[180-210s] - A red food truck labeled \"SUSHI\" is parked near a crosswalk, with people queuing nearby.  \n- A white and red ice cream truck is visible on the right side of the street, stationary near a traffic light.  \n- Pedestrians are crossing the street at a crosswalk, with some holding umbrellas, indicating possible rain or overcast conditions.\n[210-240s] - A man in a white shirt and cap stands near a kiosk, looking at a phone.  \n- People walk along a tree-lined sidewalk with outdoor seating and potted plants.  \n- A bronze monument is visible in the center of a plaza, surrounded by greenery and pedestrians.\n[240-270s] - A group of pedestrians crosses a wet street at dusk, with a police car visible on the right side of the frame.\n- A large building with a prominent clock face is centered in the background, flanked by illuminated street signs indicating \"West 33rd St\" and \"West 34th St.\"\n- The sidewalk is lined with trees and outdoor seating areas, with a green trash bin and a \"No Smoking\" sign visible on the left.", "history_tokens": 694, "history_utf8_bytes": 2894, "recent_frame_times_s": [264.0013020833333, 265.0013020833333, 266.0013020833333, 267.0013020833333, 268.0013020833333, 269.0013020833333, 270.0013020833333, 271.0013020833333, 272.0013020833333, 273.0013020833333, 274.0013020833333, 275.0013020833333, 276.0013020833333, 277.0013020833333, 278.0013020833333, 279.0013020833333, 280.0013020833333, 281.0013020833333, 282.0013020833333, 283.0013020833333, 284.0013020833333, 285.0013020833333, 286.0013020833333, 287.0013020833333, 288.0013020833333, 289.0013020833333, 290.0013020833333, 291.0013020833333, 292.0013020833333, 293.0013020833333], "recent_frames_sha256": "ef8583764a6d106854a63fad6145ae0901a71f9762e400e4a2625d4904140525", "num_recent_frames": 30, "tq": 719483.586867472, "t1": 719486.032992815, "ta": 719486.032992815, "te": 719486.3979139, "first_response_s": 2.446125342976302, "answer_total_s": 2.8110464279307052, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 306, "content_group": "a082f9d9c6e45b37f2d8391bb2fbd7beb097308fa72358ffadc7388d801bed15", "question": {"question_id": "sample_306_a536_q0", "video_id": 306, "video_path": "./videos/sample_306_real.mp4", "annotation_index": 536, "question_index": 0, "question": "Which station entrance was shown just now?", "options": ["A. Times Square Station.", "B. 34th Street-Herald Sq Station.", "C. Grand Central Station.", "D. Union Square Station."], "answer": "B", "time_stamp_s": 438, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_306_a536_q0", "video_id": 306, "time_stamp_s": 438, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d45b59e33c4465761762de1e02b0ddc0f1ba198f17674f87db0ff9c8b16be9eb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [408.0013020833333, 409.0013020833333, 410.0013020833333, 411.0013020833333, 412.0013020833333, 413.0013020833333, 414.0013020833333, 415.0013020833333, 416.0013020833333, 417.0013020833333, 418.0013020833333, 419.0013020833333, 420.0013020833333, 421.0013020833333, 422.0013020833333, 423.0013020833333, 424.0013020833333, 425.0013020833333, 426.0013020833333, 427.0013020833333, 428.0013020833333, 429.0013020833333, 430.0013020833333, 431.0013020833333, 432.0013020833333, 433.0013020833333, 434.0013020833333, 435.0013020833333, 436.0013020833333, 437.0013020833333], "recent_frames_sha256": "19f8b527550496e8b4247d5d65a3b46e7b284bedab33bba906e01ceb97b6756c", "num_recent_frames": 30, "tq": 719396.178164422, "t1": 719402.983737386, "ta": 719402.983737386, "te": 719403.020583063, "first_response_s": 6.8055729639017954, "answer_total_s": 6.84241864096839, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_306_a536_q0", "video_id": 306, "time_stamp_s": 438, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a367bb43f3e5fa92f95d07814971088014ac83e4fa6fe63354fa5bb28cfb278d", "condition_order": ["recent", "notes"], "memory": "[60-90s] - A person in a bright green outfit stands near a crosswalk, observing traffic.  \n- Yellow umbrellas shade outdoor seating areas along the sidewalk, with patrons seated.  \n- A white SUV passes through the intersection, momentarily obscuring the view of the street.\n[90-120s] - Pedestrians walk along the sidewalk, some moving toward the camera, others away, near a building with vertical columns.  \n- A blue car is parked on the street, with a white SUV and black sedan following behind it.  \n- A green street sign is visible near the center of the frame, with a crosswalk and traffic lights in the distance.\n[120-150s] - A red food truck with \"NEW YORK\" signage is parked along the sidewalk, partially obscured by scaffolding.  \n- Pedestrians walk along the sidewalk under metal scaffolding, some moving toward the camera, others away.  \n- A cyclist in a yellow shirt rides past the scaffolding, heading toward the right side of the frame.\n[150-180s] - A woman in a patterned dress stands near a red food truck, holding a phone to her ear.  \n- Pedestrians walk along the sidewalk, some carrying bags, as the camera pans left past storefronts.  \n- A white police car is parked on the street, with a red and white ambulance visible further down the road.\n[180-210s] - A red food truck labeled \"SUSHI\" is parked near a crosswalk, with people queuing nearby.  \n- A white and red ice cream truck is visible on the right side of the street, stationary near a traffic light.  \n- Pedestrians are crossing the street at a crosswalk, with some holding umbrellas, indicating possible rain or overcast conditions.\n[210-240s] - A man in a white shirt and cap stands near a kiosk, looking at a phone.  \n- People walk along a tree-lined sidewalk with outdoor seating and potted plants.  \n- A bronze monument is visible in the center of a plaza, surrounded by greenery and pedestrians.\n[240-270s] - A group of pedestrians crosses a wet street at dusk, with a police car visible on the right side of the frame.\n- A large building with a prominent clock face is centered in the background, flanked by illuminated street signs indicating \"West 33rd St\" and \"West 34th St.\"\n- The sidewalk is lined with trees and outdoor seating areas, with a green trash bin and a \"No Smoking\" sign visible on the left.\n[270-300s] - A yellow taxi cab is parked on the street, facing the camera, with its rear lights illuminated.  \n- A large Macy’s sign with a red star is visible on the left side of the frame, adjacent to a bus stop.  \n- Pedestrians are walking along the sidewalk, some carrying bags, while others are standing near outdoor seating areas with blue umbrellas.\n[300-330s] - Yellow taxis line the street, some stationary, others moving slowly, with one taxi prominently displaying \"NYC\" on its side.  \n- Pedestrians walk along the sidewalk, some carrying umbrellas, others holding shopping bags, near a brightly lit storefront with large glass windows.  \n- A street vendor’s cart with an orange umbrella is visible, positioned near the sidewalk, with people passing by or stopping to look at goods.\n[330-360s] - A yellow taxi cab passes by pedestrians on a crosswalk near a brightly lit Macy’s store sign.  \n- A group of people, including a man in a yellow shirt, walks across the street, moving away from the camera.  \n- A street vendor’s cart with a yellow umbrella is visible on the sidewalk, near a “Coca-Cola” sign.\n[360-390s] - A white USPS truck drives across the street, passing pedestrians at a crosswalk.  \n- A yellow taxi cab moves along the street, navigating traffic near the Macy’s store.  \n- A pink food truck is parked on the sidewalk, with people walking past it and a red-and-white barrier nearby.\n[390-420s] - A \"sunglass hut\" storefront with bright yellow signage is visible on a bustling street corner.  \n- A \"Capitol 7\" bank building stands adjacent to the street, with pedestrians walking past.  \n- The Empire State Building is prominently visible in the background, illuminated against the evening sky.", "history_tokens": 968, "history_utf8_bytes": 4029, "recent_frame_times_s": [408.0013020833333, 409.0013020833333, 410.0013020833333, 411.0013020833333, 412.0013020833333, 413.0013020833333, 414.0013020833333, 415.0013020833333, 416.0013020833333, 417.0013020833333, 418.0013020833333, 419.0013020833333, 420.0013020833333, 421.0013020833333, 422.0013020833333, 423.0013020833333, 424.0013020833333, 425.0013020833333, 426.0013020833333, 427.0013020833333, 428.0013020833333, 429.0013020833333, 430.0013020833333, 431.0013020833333, 432.0013020833333, 433.0013020833333, 434.0013020833333, 435.0013020833333, 436.0013020833333, 437.0013020833333], "recent_frames_sha256": "19f8b527550496e8b4247d5d65a3b46e7b284bedab33bba906e01ceb97b6756c", "num_recent_frames": 30, "tq": 719528.425801466, "t1": 719535.07743277, "ta": 719535.07743277, "te": 719535.226230772, "first_response_s": 6.651631304062903, "answer_total_s": 6.8004293059930205, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 306, "content_group": "a082f9d9c6e45b37f2d8391bb2fbd7beb097308fa72358ffadc7388d801bed15", "question": {"question_id": "sample_306_a537_q0", "video_id": 306, "video_path": "./videos/sample_306_real.mp4", "annotation_index": 537, "question_index": 0, "question": "What is the primary color of the subway train?", "options": ["A. Blue.", "B. Green.", "C. Silver.", "D. Red."], "answer": "C", "time_stamp_s": 534, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [480, 535], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_306_a537_q0", "video_id": 306, "time_stamp_s": 534, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "90f872bfedb3784d5484f37413a550e5a16b2c87ba9404a59675a7b61846d68e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [504.0013020833333, 505.0013020833333, 506.0013020833333, 507.0013020833333, 508.0013020833333, 509.0013020833333, 510.0013020833333, 511.0013020833333, 512.0013020833334, 513.0013020833334, 514.0013020833334, 515.0013020833334, 516.0013020833334, 517.0013020833334, 518.0013020833334, 519.0013020833334, 520.0013020833334, 521.0013020833334, 522.0013020833334, 523.0013020833334, 524.0013020833334, 525.0013020833334, 526.0013020833334, 527.0013020833334, 528.0013020833334, 529.0013020833334, 530.0013020833334, 531.0013020833334, 532.0013020833334, 533.0013020833334], "recent_frames_sha256": "405ed1342f28c026ff48e7021e3dada5ec5b0dd7e4fc674934a3b41c26347fd2", "num_recent_frames": 30, "tq": 719403.036501772, "t1": 719410.20769029, "ta": 719410.20769029, "te": 719410.245209479, "first_response_s": 7.171188517939299, "answer_total_s": 7.208707707002759, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_306_a537_q0", "video_id": 306, "time_stamp_s": 534, "ground_truth": "C", "raw_output": "C. Silver.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "f8699f89f72c68363c6db30bea2f2fe2625ece14331808c22c9bed0842d77de8", "condition_order": ["recent", "notes"], "memory": "[180-210s] - A red food truck labeled \"SUSHI\" is parked near a crosswalk, with people queuing nearby.  \n- A white and red ice cream truck is visible on the right side of the street, stationary near a traffic light.  \n- Pedestrians are crossing the street at a crosswalk, with some holding umbrellas, indicating possible rain or overcast conditions.\n[210-240s] - A man in a white shirt and cap stands near a kiosk, looking at a phone.  \n- People walk along a tree-lined sidewalk with outdoor seating and potted plants.  \n- A bronze monument is visible in the center of a plaza, surrounded by greenery and pedestrians.\n[240-270s] - A group of pedestrians crosses a wet street at dusk, with a police car visible on the right side of the frame.\n- A large building with a prominent clock face is centered in the background, flanked by illuminated street signs indicating \"West 33rd St\" and \"West 34th St.\"\n- The sidewalk is lined with trees and outdoor seating areas, with a green trash bin and a \"No Smoking\" sign visible on the left.\n[270-300s] - A yellow taxi cab is parked on the street, facing the camera, with its rear lights illuminated.  \n- A large Macy’s sign with a red star is visible on the left side of the frame, adjacent to a bus stop.  \n- Pedestrians are walking along the sidewalk, some carrying bags, while others are standing near outdoor seating areas with blue umbrellas.\n[300-330s] - Yellow taxis line the street, some stationary, others moving slowly, with one taxi prominently displaying \"NYC\" on its side.  \n- Pedestrians walk along the sidewalk, some carrying umbrellas, others holding shopping bags, near a brightly lit storefront with large glass windows.  \n- A street vendor’s cart with an orange umbrella is visible, positioned near the sidewalk, with people passing by or stopping to look at goods.\n[330-360s] - A yellow taxi cab passes by pedestrians on a crosswalk near a brightly lit Macy’s store sign.  \n- A group of people, including a man in a yellow shirt, walks across the street, moving away from the camera.  \n- A street vendor’s cart with a yellow umbrella is visible on the sidewalk, near a “Coca-Cola” sign.\n[360-390s] - A white USPS truck drives across the street, passing pedestrians at a crosswalk.  \n- A yellow taxi cab moves along the street, navigating traffic near the Macy’s store.  \n- A pink food truck is parked on the sidewalk, with people walking past it and a red-and-white barrier nearby.\n[390-420s] - A \"sunglass hut\" storefront with bright yellow signage is visible on a bustling street corner.  \n- A \"Capitol 7\" bank building stands adjacent to the street, with pedestrians walking past.  \n- The Empire State Building is prominently visible in the background, illuminated against the evening sky.\n[420-450s] - A woman in a dark coat walks down a subway staircase carrying a white bag, heading toward the 34 Street-Herald Sq station entrance.  \n- A Burger King sign is visible on the left wall of the subway tunnel, with a yellow caution cone nearby.  \n- The station sign above reads “34 Street-Herald Sq Station” with subway line indicators for the 6, 7, 8, 9, 1, 2, 3, 4, 5, 6, 7, 8, 9, 1, 2, 3, 4, \n[450-480s] - A woman in a blue top and white pants walks down a staircase toward a green-lit area, carrying a black backpack.  \n- A large banner reading \"CULTURE'S BIGGEST AWARDS 2024\" is prominently displayed above the staircase entrance.  \n- A person in a green shirt and dark pants is seen ascending the stairs, moving away from the camera.\n[480-510s] - A train marked \"5116\" with an American flag sticker is stationary at the platform, passengers boarding.  \n- Platform signage indicates \"34 St\" and \"N Q\" lines, with a yellow safety line along the edge.  \n- A group of people, including a woman in a white top and black skirt, are seen walking toward the train doors.", "history_tokens": 979, "history_utf8_bytes": 3847, "recent_frame_times_s": [504.0013020833333, 505.0013020833333, 506.0013020833333, 507.0013020833333, 508.0013020833333, 509.0013020833333, 510.0013020833333, 511.0013020833333, 512.0013020833334, 513.0013020833334, 514.0013020833334, 515.0013020833334, 516.0013020833334, 517.0013020833334, 518.0013020833334, 519.0013020833334, 520.0013020833334, 521.0013020833334, 522.0013020833334, 523.0013020833334, 524.0013020833334, 525.0013020833334, 526.0013020833334, 527.0013020833334, 528.0013020833334, 529.0013020833334, 530.0013020833334, 531.0013020833334, 532.0013020833334, 533.0013020833334], "recent_frames_sha256": "405ed1342f28c026ff48e7021e3dada5ec5b0dd7e4fc674934a3b41c26347fd2", "num_recent_frames": 30, "tq": 719568.118052972, "t1": 719576.105948635, "ta": 719576.105948635, "te": 719576.381635485, "first_response_s": 7.9878956630127504, "answer_total_s": 8.263582512969151, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 307, "content_group": "af5580d4de1efe55925a6106e0eeff23eee0fa6d39e05d021b5bab21f10bebc3", "question": {"question_id": "sample_307_a67_q0", "video_id": 307, "video_path": "./videos/sample_307_real.mp4", "annotation_index": 67, "question_index": 0, "question": "What movement is depicted from the first-person perspective in the video?", "options": ["A. Moving backward on the street.", "B. Moving sideways on the sidewalk.", "C. Progressing forward down the street.", "D. Standing still."], "answer": "C", "time_stamp_s": 18, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_307_a67_q0", "video_id": 307, "time_stamp_s": 18, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4fb94c42791b17525405f7e58c6ff090d77f104e40dc06b13c5420ea4ee63f65", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0], "recent_frames_sha256": "8646e12613e64d61402d3c70c80da32fb6ed87f90feeef22857195384ba8de49", "num_recent_frames": 19, "tq": 719472.689241772, "t1": 719473.324782666, "ta": 719473.324782666, "te": 719473.362736733, "first_response_s": 0.6355408939998597, "answer_total_s": 0.6734949609963223, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_307_a67_q0", "video_id": 307, "time_stamp_s": 18, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f7763895739d21be88e11749256ed5beb8914587f62db55167412083cff6b4a0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0], "recent_frames_sha256": "8646e12613e64d61402d3c70c80da32fb6ed87f90feeef22857195384ba8de49", "num_recent_frames": 19, "tq": 719238.380927835, "t1": 719244.442685422, "ta": 719244.442685422, "te": 719244.664715695, "first_response_s": 6.061757587012835, "answer_total_s": 6.283787859953009, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 307, "content_group": "af5580d4de1efe55925a6106e0eeff23eee0fa6d39e05d021b5bab21f10bebc3", "question": {"question_id": "sample_307_a68_q0", "video_id": 307, "video_path": "./videos/sample_307_real.mp4", "annotation_index": 68, "question_index": 0, "question": "What was on the left side of the street now?", "options": ["A. A series of tall trees.", "B. A brick building with large windows.", "C. A wooden fence.", "D. A row of parked cars."], "answer": "C", "time_stamp_s": 272, "task_type": "Spatial Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_307_a68_q0", "video_id": 307, "time_stamp_s": 272, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "db8642f33a3281176bc3028a9b5121eafb74993a5470768f32285f0b0af7b0c8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0], "recent_frames_sha256": "a5d884ed9a508bef93b7434e7be9c010f3587ee863fb58070037effcb7ec7b66", "num_recent_frames": 30, "tq": 719473.37724538, "t1": 719484.200269945, "ta": 719484.200269945, "te": 719484.238100616, "first_response_s": 10.823024565004744, "answer_total_s": 10.860855236067437, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_307_a68_q0", "video_id": 307, "time_stamp_s": 272, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "61597a2e0474741f01c12a4db2169c53794ff0823835fed7ac7e3a5db9f7d013", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Wet asphalt street with white lane marking, flanked by residential buildings and greenery, reflecting overcast sky.  \n- Several parked cars covered with tarps, including one near a white utility box and another beside a brick wall.  \n- Bicycles parked along a sidewalk on the left, with a utility pole and power lines running parallel to the street.\n[30-60s] - Wet asphalt street reflects overcast sky, flanked by residential buildings with varied facades and greenery.  \n- A dark blue car is parked at the end of the alley, partially obscured by foliage and a stone wall.  \n- Utility poles and wires run parallel to the street, with a yellow trash bin visible near a brick wall on the right.\n[60-90s] - A white van is parked at the end of a narrow, wet street, with its front facing the camera.  \n- A person in dark clothing is standing near the van’s driver’s side, appearing to interact with the vehicle or its surroundings.  \n- The street is flanked by modern residential buildings, with a brick wall and greenery on the right and a paved sidewalk on the left.\n[90-120s] - Wet asphalt street with white lane markings and parked cars on both sides, including a black SUV and a white sedan.  \n- A narrow alleyway with residential buildings, some featuring brick facades and others with modern designs, flanking the street.  \n- White rope barriers and potted plants line the sidewalks, with a small white vehicle visible in the distance.\n[120-150s] - Wet asphalt road with white lane markings, flanked by residential buildings and fences.  \n- A narrow alleyway extends into the distance, lined with brick walls and greenery.  \n- A person in orange attire walks away from the camera down the alley, moving toward the background.\n[150-180s] - A black SUV is parked on the left side of the wet street, partially obscured by a tiled wall.  \n- A red fire hydrant is visible on the right side of the road, near a black fence.  \n- The camera moves forward along the street, passing a utility pole with a yellow and white striped base.\n[180-210s] - A person holding a green umbrella walks down the wet street, moving away from the camera.  \n- A silver car is parked on the left side, partially obscured by a hedge.  \n- The road surface is wet and reflective, with white lane markings and a yellow traffic sign visible.\n[210-240s] - A dark van with orange stripes drives forward, passing a red-and-blue traffic sign, then turns right onto a wet street.  \n- The camera pans left, revealing a narrow residential street lined with green hedges and parked bicycles, with a distant orange vehicle visible ahead.  \n- A white building with a red mailbox and a parked bicycle on the right side of the street is seen as the camera continues moving forward.\n[240-270s] - Rain-soaked asphalt road with white lane markings, flanked by residential buildings and utility poles.  \n- A white car is parked on the left side of the road near a brick building.  \n- A red mailbox and a green signpost are visible on the right side of the road.", "history_tokens": 704, "history_utf8_bytes": 3029, "recent_frame_times_s": [243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0], "recent_frames_sha256": "a5d884ed9a508bef93b7434e7be9c010f3587ee863fb58070037effcb7ec7b66", "num_recent_frames": 30, "tq": 719315.849049764, "t1": 719325.299633655, "ta": 719325.299633655, "te": 719325.33779213, "first_response_s": 9.450583891011775, "answer_total_s": 9.488742365967482, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 307, "content_group": "af5580d4de1efe55925a6106e0eeff23eee0fa6d39e05d021b5bab21f10bebc3", "question": {"question_id": "sample_307_a69_q1", "video_id": 307, "video_path": "./videos/sample_307_real.mp4", "annotation_index": 69, "question_index": 1, "question": "What is to the left of the two people walking on the sidewalk now?", "options": ["A. A green P parking sign.", "B. A red vending machine and building signage.", "C. Parked bicycles and scooters.", "D. A garbage truck."], "answer": "B", "time_stamp_s": 523, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_307_a69_q1", "video_id": 307, "time_stamp_s": 523, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dc56cc6240a131308ac7efd40a309266aad039be4e0df53262f62978b6bd983e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0], "recent_frames_sha256": "9e9866af9ba098236b382adc62d331f338bb47256885391fdcb1c1fe57436915", "num_recent_frames": 30, "tq": 719484.250597404, "t1": 719492.803552596, "ta": 719492.803552596, "te": 719492.840979724, "first_response_s": 8.552955192048103, "answer_total_s": 8.590382319991477, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_307_a69_q1", "video_id": 307, "time_stamp_s": 523, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8b8e68d6400fb8199b327ebac20e6cfb05d1ec835077ac764855d392877e950a", "condition_order": ["notes", "recent"], "memory": "[120-150s] - Wet asphalt road with white lane markings, flanked by residential buildings and fences.  \n- A narrow alleyway extends into the distance, lined with brick walls and greenery.  \n- A person in orange attire walks away from the camera down the alley, moving toward the background.\n[150-180s] - A black SUV is parked on the left side of the wet street, partially obscured by a tiled wall.  \n- A red fire hydrant is visible on the right side of the road, near a black fence.  \n- The camera moves forward along the street, passing a utility pole with a yellow and white striped base.\n[180-210s] - A person holding a green umbrella walks down the wet street, moving away from the camera.  \n- A silver car is parked on the left side, partially obscured by a hedge.  \n- The road surface is wet and reflective, with white lane markings and a yellow traffic sign visible.\n[210-240s] - A dark van with orange stripes drives forward, passing a red-and-blue traffic sign, then turns right onto a wet street.  \n- The camera pans left, revealing a narrow residential street lined with green hedges and parked bicycles, with a distant orange vehicle visible ahead.  \n- A white building with a red mailbox and a parked bicycle on the right side of the street is seen as the camera continues moving forward.\n[240-270s] - Rain-soaked asphalt road with white lane markings, flanked by residential buildings and utility poles.  \n- A white car is parked on the left side of the road near a brick building.  \n- A red mailbox and a green signpost are visible on the right side of the road.\n[270-300s] - A white car is parked in a driveway behind a gate, partially obscured by a yellow building.  \n- The road is wet from rain, with white lane markings and a pedestrian crossing symbol visible.  \n- A red and black pole with a green sign stands near the road’s edge, adjacent to a building with large windows.\n[300-330s] - A man in a white shirt and dark pants walks away from the camera, holding a white umbrella, along a wet, tiled sidewalk.  \n- Parked vehicles, including a black car and a green van, line the street beside the sidewalk, with a \"S.RIDE\" sign visible on a parked car.  \n- A red bicycle is parked near a storefront with Japanese signage, and a \"PARK\" sign is visible on a building to the left.\n[330-360s] - A person walks away from the camera holding a blue umbrella, moving along a wet brick sidewalk.  \n- A \"Royal Host PARK\" sign with an arrow is visible on the left, near a building entrance.  \n- A vending machine and a trash bin are positioned on the sidewalk near the building’s steps.\n[360-390s] - Rain-soaked brick sidewalk reflects ambient light as pedestrians walk past storefronts.  \n- A black van is parked along the curb, partially obscured by greenery.  \n- A person in a dark coat walks away from the camera, heading down the street.\n[390-420s] - A person with a blue umbrella stands at a crosswalk, waiting to cross the street.  \n- Rainwater reflects on the wet pavement, showing painted blue arrows indicating traffic direction.  \n- A white van and other vehicles are visible on the road, moving in the rain.\n[420-450s] - Person in dark coat holds blue umbrella, standing at crosswalk, waiting to cross.\n- Pedestrian in yellow hooded jacket and blue jeans walks across crosswalk with white umbrella.\n- Another pedestrian in dark coat and white pants crosses with white umbrella, moving toward camera’s right.\n[450-480s] - A person in white pants and dark jacket walks away from the camera, holding a transparent umbrella, crossing a wet pedestrian crossing.  \n- The camera pans left, revealing a storefront with a red \"Baker\" sign and a wet brick sidewalk.  \n- A yellow tactile paving strip runs along the sidewalk, leading toward a building entrance with a glass facade.\n[480-510s] - A person in a yellow jacket rides a bicycle along the wet sidewalk, moving away from the camera.  \n- A pedestrian with a transparent umbrella walks toward the camera, passing a bus stop.  \n- A red sign with \"2600\" is visible on a building corner, indicating a price or code.", "history_tokens": 979, "history_utf8_bytes": 4084, "recent_frame_times_s": [494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0], "recent_frames_sha256": "9e9866af9ba098236b382adc62d331f338bb47256885391fdcb1c1fe57436915", "num_recent_frames": 30, "tq": 719388.063767373, "t1": 719394.370705077, "ta": 719394.370705077, "te": 719394.601553242, "first_response_s": 6.306937703979202, "answer_total_s": 6.537785868975334, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 307, "content_group": "af5580d4de1efe55925a6106e0eeff23eee0fa6d39e05d021b5bab21f10bebc3", "question": {"question_id": "sample_307_a69_q0", "video_id": 307, "video_path": "./videos/sample_307_real.mp4", "annotation_index": 69, "question_index": 0, "question": "What color is the jacket worn by the person on the left?", "options": ["A. Blue.", "B. Red.", "C. Green.", "D. Yellow."], "answer": "C", "time_stamp_s": 544, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_307_a69_q0", "video_id": 307, "time_stamp_s": 544, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b62287077f1cc592523633a50082157cd28739c128db6397b90aaa7d02872fd4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0], "recent_frames_sha256": "4a228d288a73102b9358c227131004304c30a75e896c58283a73b6524e4697fa", "num_recent_frames": 30, "tq": 719492.851411425, "t1": 719505.494806388, "ta": 719505.494806388, "te": 719505.532388857, "first_response_s": 12.643394963000901, "answer_total_s": 12.680977431940846, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_307_a69_q0", "video_id": 307, "time_stamp_s": 544, "ground_truth": "C", "raw_output": "D. Yellow.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "b7ac4e614ca9729a830b2d20809027a2cc2b55650992983cff283de8c84dfc04", "condition_order": ["notes", "recent"], "memory": "[150-180s] - A black SUV is parked on the left side of the wet street, partially obscured by a tiled wall.  \n- A red fire hydrant is visible on the right side of the road, near a black fence.  \n- The camera moves forward along the street, passing a utility pole with a yellow and white striped base.\n[180-210s] - A person holding a green umbrella walks down the wet street, moving away from the camera.  \n- A silver car is parked on the left side, partially obscured by a hedge.  \n- The road surface is wet and reflective, with white lane markings and a yellow traffic sign visible.\n[210-240s] - A dark van with orange stripes drives forward, passing a red-and-blue traffic sign, then turns right onto a wet street.  \n- The camera pans left, revealing a narrow residential street lined with green hedges and parked bicycles, with a distant orange vehicle visible ahead.  \n- A white building with a red mailbox and a parked bicycle on the right side of the street is seen as the camera continues moving forward.\n[240-270s] - Rain-soaked asphalt road with white lane markings, flanked by residential buildings and utility poles.  \n- A white car is parked on the left side of the road near a brick building.  \n- A red mailbox and a green signpost are visible on the right side of the road.\n[270-300s] - A white car is parked in a driveway behind a gate, partially obscured by a yellow building.  \n- The road is wet from rain, with white lane markings and a pedestrian crossing symbol visible.  \n- A red and black pole with a green sign stands near the road’s edge, adjacent to a building with large windows.\n[300-330s] - A man in a white shirt and dark pants walks away from the camera, holding a white umbrella, along a wet, tiled sidewalk.  \n- Parked vehicles, including a black car and a green van, line the street beside the sidewalk, with a \"S.RIDE\" sign visible on a parked car.  \n- A red bicycle is parked near a storefront with Japanese signage, and a \"PARK\" sign is visible on a building to the left.\n[330-360s] - A person walks away from the camera holding a blue umbrella, moving along a wet brick sidewalk.  \n- A \"Royal Host PARK\" sign with an arrow is visible on the left, near a building entrance.  \n- A vending machine and a trash bin are positioned on the sidewalk near the building’s steps.\n[360-390s] - Rain-soaked brick sidewalk reflects ambient light as pedestrians walk past storefronts.  \n- A black van is parked along the curb, partially obscured by greenery.  \n- A person in a dark coat walks away from the camera, heading down the street.\n[390-420s] - A person with a blue umbrella stands at a crosswalk, waiting to cross the street.  \n- Rainwater reflects on the wet pavement, showing painted blue arrows indicating traffic direction.  \n- A white van and other vehicles are visible on the road, moving in the rain.\n[420-450s] - Person in dark coat holds blue umbrella, standing at crosswalk, waiting to cross.\n- Pedestrian in yellow hooded jacket and blue jeans walks across crosswalk with white umbrella.\n- Another pedestrian in dark coat and white pants crosses with white umbrella, moving toward camera’s right.\n[450-480s] - A person in white pants and dark jacket walks away from the camera, holding a transparent umbrella, crossing a wet pedestrian crossing.  \n- The camera pans left, revealing a storefront with a red \"Baker\" sign and a wet brick sidewalk.  \n- A yellow tactile paving strip runs along the sidewalk, leading toward a building entrance with a glass facade.\n[480-510s] - A person in a yellow jacket rides a bicycle along the wet sidewalk, moving away from the camera.  \n- A pedestrian with a transparent umbrella walks toward the camera, passing a bus stop.  \n- A red sign with \"2600\" is visible on a building corner, indicating a price or code.\n[510-540s] - Two pedestrians walk along a wet sidewalk, one holding a patterned umbrella and the other a clear one, moving away from the camera.  \n- They cross a zebra crossing as vehicles, including a green truck and a black taxi, pass by on the adjacent road.  \n- A red vending machine and a building with a blue sign are visible on the left side of the sidewalk.", "history_tokens": 1000, "history_utf8_bytes": 4160, "recent_frame_times_s": [515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0], "recent_frames_sha256": "4a228d288a73102b9358c227131004304c30a75e896c58283a73b6524e4697fa", "num_recent_frames": 30, "tq": 719401.804385456, "t1": 719403.807212873, "ta": 719403.807212873, "te": 719403.956558471, "first_response_s": 2.002827416989021, "answer_total_s": 2.1521730149397627, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 307, "content_group": "af5580d4de1efe55925a6106e0eeff23eee0fa6d39e05d021b5bab21f10bebc3", "question": {"question_id": "sample_307_a70_q0", "video_id": 307, "video_path": "./videos/sample_307_real.mp4", "annotation_index": 70, "question_index": 0, "question": "What was visible on the left-hand side of the street just now?", "options": ["A. A coffee shop.", "B. A brightly lit signboard of a restaurant.", "C. A bookstore.", "D. A clothing store."], "answer": "B", "time_stamp_s": 786, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [780, 840], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_307_a70_q0", "video_id": 307, "time_stamp_s": 786, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e05d53f01f78629d8656357aa3b0b49f7244e3cf9644e2c5a7c7b125d934745f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [757.0, 758.0, 759.0, 760.0, 761.0, 762.0, 763.0, 764.0, 765.0, 766.0, 767.0, 768.0, 769.0, 770.0, 771.0, 772.0, 773.0, 774.0, 775.0, 776.0, 777.0, 778.0, 779.0, 780.0, 781.0, 782.0, 783.0, 784.0, 785.0, 786.0], "recent_frames_sha256": "caf12ba635335fc42e86a92c484e60881d44a3c8087549254d68c24b1c26ef9d", "num_recent_frames": 30, "tq": 719505.542053721, "t1": 719517.636954471, "ta": 719517.636954471, "te": 719517.674716429, "first_response_s": 12.094900749973021, "answer_total_s": 12.132662707939744, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_307_a70_q0", "video_id": 307, "time_stamp_s": 786, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "af305449f7c5009c98793affed1ea4e37c3c57e5b1fde45327da4f5ed645feda", "condition_order": ["notes", "recent"], "memory": "[390-420s] - A person with a blue umbrella stands at a crosswalk, waiting to cross the street.  \n- Rainwater reflects on the wet pavement, showing painted blue arrows indicating traffic direction.  \n- A white van and other vehicles are visible on the road, moving in the rain.\n[420-450s] - Person in dark coat holds blue umbrella, standing at crosswalk, waiting to cross.\n- Pedestrian in yellow hooded jacket and blue jeans walks across crosswalk with white umbrella.\n- Another pedestrian in dark coat and white pants crosses with white umbrella, moving toward camera’s right.\n[450-480s] - A person in white pants and dark jacket walks away from the camera, holding a transparent umbrella, crossing a wet pedestrian crossing.  \n- The camera pans left, revealing a storefront with a red \"Baker\" sign and a wet brick sidewalk.  \n- A yellow tactile paving strip runs along the sidewalk, leading toward a building entrance with a glass facade.\n[480-510s] - A person in a yellow jacket rides a bicycle along the wet sidewalk, moving away from the camera.  \n- A pedestrian with a transparent umbrella walks toward the camera, passing a bus stop.  \n- A red sign with \"2600\" is visible on a building corner, indicating a price or code.\n[510-540s] - Two pedestrians walk along a wet sidewalk, one holding a patterned umbrella and the other a clear one, moving away from the camera.  \n- They cross a zebra crossing as vehicles, including a green truck and a black taxi, pass by on the adjacent road.  \n- A red vending machine and a building with a blue sign are visible on the left side of the sidewalk.\n[540-570s] - Two pedestrians walk away from the camera under umbrellas along a wet sidewalk, flanked by buildings and parked vehicles.  \n- A blue SUV and a white truck are visible on the street, with a red car passing by in the background.  \n- A vending machine and a bicycle rack are positioned near the sidewalk’s edge, with a green sign indicating “No Parking” nearby.\n[570-600s] - A white bus with red stripes moves along the wet street, passing by a sidewalk where pedestrians walk with umbrellas.  \n- A white van with red markings is parked near the curb, partially obscured by a yellow barrier.  \n- A vending machine labeled \"ARIN\" stands on the sidewalk, adjacent to a building with a blue and white facade.\n[600-630s] - A person in dark clothing walks away from the camera, holding a white umbrella, on a wet brick sidewalk.  \n- A white SUV is parked on the right side of the street, partially obscured by a yellow barrier.  \n- Orange traffic cones are placed near a building entrance on the left, indicating a restricted or caution zone.\n[630-660s] - Two pedestrians walk away from camera under a clear umbrella along a wet brick sidewalk, passing a closed storefront.  \n- A black car and a red truck pass on the wet road, with blue directional arrows painted on the pavement.  \n- A bus approaches from the right, partially visible as it moves along the street.\n[660-690s] - Pedestrians walk along a wet, tiled sidewalk beside a stone barrier, some carrying umbrellas.  \n- A narrow canal with greenery runs parallel to the sidewalk, bordered by modern buildings.  \n- A bus and other vehicles are visible on the road adjacent to the sidewalk, with traffic moving.\n[690-720s] - A man walks away from the camera holding a transparent umbrella, moving along a wet sidewalk beside a stone wall.  \n- A white SUV is parked on the left, near a row of bicycle racks, while a red-and-white bus is stopped on the right.  \n- The sidewalk is tiled with red and gray patterns, reflecting rainwater, and a yellow line marks the edge near the bus.\n[720-750s] - A person in a white coat walks briskly on the sidewalk, moving away from the camera.  \n- Two pedestrians with umbrellas cross the wet street at a marked crosswalk, heading toward the camera’s right.  \n- A white van is parked on the left side of the road, near a construction barrier.\n[750-780s] - A man in dark clothing walks away from the camera, holding a white umbrella, along a wet brick sidewalk.  \n- A woman in a black coat and white shoes walks toward the camera, holding a blue umbrella, on the same sidewalk.  \n- The sidewalk is lined with potted plants and storefronts, with traffic and buildings visible in the background.", "history_tokens": 1014, "history_utf8_bytes": 4292, "recent_frame_times_s": [757.0, 758.0, 759.0, 760.0, 761.0, 762.0, 763.0, 764.0, 765.0, 766.0, 767.0, 768.0, 769.0, 770.0, 771.0, 772.0, 773.0, 774.0, 775.0, 776.0, 777.0, 778.0, 779.0, 780.0, 781.0, 782.0, 783.0, 784.0, 785.0, 786.0], "recent_frames_sha256": "caf12ba635335fc42e86a92c484e60881d44a3c8087549254d68c24b1c26ef9d", "num_recent_frames": 30, "tq": 719460.883594583, "t1": 719472.419808576, "ta": 719472.419808576, "te": 719472.658774651, "first_response_s": 11.536213992978446, "answer_total_s": 11.775180067983456, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 308, "content_group": "df4b644bd2e6b0d9098361e2486513bb35aadc9a50307e22c83445b64dbe2a82", "question": {"question_id": "sample_308_a311_q0", "video_id": 308, "video_path": "./videos/sample_308_real.mp4", "annotation_index": 311, "question_index": 0, "question": "What prominent feature is located in the center of the outdoor plaza?", "options": ["A. A large fountain.", "B. A metallic globe sculpture.", "C. A statue of a person.", "D. A giant screen."], "answer": "B", "time_stamp_s": 5, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_308_a311_q0", "video_id": 308, "time_stamp_s": 5, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9ffc92f62cd76f974d0661fb32257f210bae323a9112b050df8e9b68e784e88a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004], "recent_frames_sha256": "743ba8512a653ac48f200fc62a8f0b5c8d2a7b5bd3c8d314913a473f998b5703", "num_recent_frames": 5, "tq": 717812.596501684, "t1": 717823.440897305, "ta": 717823.440897305, "te": 717823.479337785, "first_response_s": 10.844395620981231, "answer_total_s": 10.88283610099461, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_308_a311_q0", "video_id": 308, "time_stamp_s": 5, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "179237be1697a01772148c9d4764abebd04e7d60b60885fee63a56c50b844f42", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004], "recent_frames_sha256": "743ba8512a653ac48f200fc62a8f0b5c8d2a7b5bd3c8d314913a473f998b5703", "num_recent_frames": 5, "tq": 717883.528279017, "t1": 717884.138961281, "ta": 717884.138961281, "te": 717884.180870088, "first_response_s": 0.6106822640867904, "answer_total_s": 0.6525910710915923, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 308, "content_group": "df4b644bd2e6b0d9098361e2486513bb35aadc9a50307e22c83445b64dbe2a82", "question": {"question_id": "sample_308_a311_q1", "video_id": 308, "video_path": "./videos/sample_308_real.mp4", "annotation_index": 311, "question_index": 1, "question": "What word is encircling the large metallic globe sculpture?", "options": ["A. UNIVERSAL.", "B. GLOBAL.", "C. EARTH.", "D. WORLD."], "answer": "A", "time_stamp_s": 10, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_308_a311_q1", "video_id": 308, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "A. UNIVERSAL.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "859335e6f0f6ca3d48bacbe01c6653159373ed6faabe80f09f1ef807b7f28b43", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "4bd43c0adbaec26fd1b8b3a0ec6daa18faac54b7f4149eea2ee4d87a37b5bcd4", "num_recent_frames": 10, "tq": 717823.497904248, "t1": 717861.655079343, "ta": 717861.655079343, "te": 717861.841581743, "first_response_s": 38.15717509505339, "answer_total_s": 38.34367749502417, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_308_a311_q1", "video_id": 308, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "A. UNIVERSAL.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "053f55bd5d8e545c682d0ff3014560f0fd320735792156f46b957ffb5fd6117c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "4bd43c0adbaec26fd1b8b3a0ec6daa18faac54b7f4149eea2ee4d87a37b5bcd4", "num_recent_frames": 10, "tq": 717884.197186461, "t1": 717892.003292199, "ta": 717892.003292199, "te": 717892.20161401, "first_response_s": 7.80610573804006, "answer_total_s": 8.004427549079992, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 308, "content_group": "df4b644bd2e6b0d9098361e2486513bb35aadc9a50307e22c83445b64dbe2a82", "question": {"question_id": "sample_308_a312_q0", "video_id": 308, "video_path": "./videos/sample_308_real.mp4", "annotation_index": 312, "question_index": 0, "question": "What was the name of the café shown just now?", "options": ["A. The Green Café.", "B. The Fun Café.", "C. Power Up Café.", "D. Stage 52 Café."], "answer": "C", "time_stamp_s": 184, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_308_a312_q0", "video_id": 308, "time_stamp_s": 184, "ground_truth": "C", "raw_output": "C. Power Up Café.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "06beaa882c7c91432a1a294e81aa6a4137a954776138a4bcd5fadfdab1b93981", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666], "recent_frames_sha256": "1142e16255db323912430654b67c4e50f6938de7ada8b4e9f194900cc4691afd", "num_recent_frames": 30, "tq": 717861.857245443, "t1": 717870.162362062, "ta": 717870.162362062, "te": 717870.393729626, "first_response_s": 8.305116618983448, "answer_total_s": 8.536484182928689, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_308_a312_q0", "video_id": 308, "time_stamp_s": 184, "ground_truth": "C", "raw_output": "C. Power Up Café.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "c2adc6a786b12fdd1c640ae2179ecb8551aed41115b9f9e84bf47143abe78ccf", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A large metallic globe fountain with \"WORLD OF DISNEY\" lettering sprays water, surrounded by palm trees and pedestrians.  \n- A red carpet stretches toward a grand archway labeled \"WORLD OF DISNEY,\" flanked by palm trees and street lamps.  \n- People walk along the red carpet, including a woman with a child in a stroller approaching the archway.\n[30-60s] - A large archway with \"Beverly Hills\" inscribed above, flanked by palm trees and a red carpet leading toward it.  \n- A central fountain sculpture depicting a figure with a rope and pulley system, surrounded by pedestrians.  \n- The fountain is positioned at a street intersection, with shops like \"Saks Fifth Avenue\" and \"Beverly Hills\" visible on either side.\n[60-90s] - A child in red pants walks away from the camera down the center of the street, moving toward the \"Universal Studios\" entrance.  \n- Palm trees line both sides of the street, casting shadows on the pavement under a partly cloudy sky.  \n- Storefronts with colorful displays, including \"Universal Studios\" and \"Disney,\" are visible along the walkway.\n[90-120s] - A yellow vintage taxi is parked near the entrance of \"Theater of the Stars\" building, with its front facing the street.  \n- Palm trees line the sidewalk, casting shadows on the paved walkway as the camera moves forward.  \n- A few pedestrians are visible walking along the street, with some near the storefronts and others further down the path.\n[120-150s] - \"ILLUMINATION\" building's arched entrance is central, with people entering and exiting.  \n- A tall, slender tower structure is visible in the distance, flanked by palm trees.  \n- Pedestrians walk along the street, some near storefronts with awnings, others near red carpeted areas.\n[150-180s] - A red umbrella is positioned over the entrance of the \"POWER UP\" store, which features a cartoonish logo and a yellow sign.  \n- A person in a yellow shirt is seen standing near the store's entrance, possibly interacting with the environment or waiting.  \n- The camera pans right, revealing a street corner with a green building labeled \"SUNSET\" and a blue building with a \"POWER UP\" sign, both with visible storefronts and signage.", "history_tokens": 519, "history_utf8_bytes": 2180, "recent_frame_times_s": [154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666], "recent_frames_sha256": "1142e16255db323912430654b67c4e50f6938de7ada8b4e9f194900cc4691afd", "num_recent_frames": 30, "tq": 717931.962118555, "t1": 717940.798892206, "ta": 717940.798892206, "te": 717941.044356915, "first_response_s": 8.836773651069961, "answer_total_s": 9.08223836007528, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 308, "content_group": "df4b644bd2e6b0d9098361e2486513bb35aadc9a50307e22c83445b64dbe2a82", "question": {"question_id": "sample_308_a313_q0", "video_id": 308, "video_path": "./videos/sample_308_real.mp4", "annotation_index": 313, "question_index": 0, "question": "What is one of the activities that people were doing on the zebra crossing just now?", "options": ["A. Jogging.", "B. Pushing a stroller.", "C. Riding a bicycle.", "D. Selling goods."], "answer": "B", "time_stamp_s": 329, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_308_a313_q0", "video_id": 308, "time_stamp_s": 329, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "51b6ae0124f045e0541c241c24bd4ff2ae804fbb7d482a67d4607205cb8aced8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277], "recent_frames_sha256": "0e73fb16ef7dc2c3a5229873c9291d48b079b5e601e7fd7647956c7783b64b11", "num_recent_frames": 30, "tq": 717870.408453592, "t1": 717877.12159255, "ta": 717877.12159255, "te": 717877.159753538, "first_response_s": 6.71313895797357, "answer_total_s": 6.75129994598683, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_308_a313_q0", "video_id": 308, "time_stamp_s": 329, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "126c3d1a97b5dfb6792616c0e256c2e8b1674c48f590e0ce67e84cb1a0ecf232", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A large metallic globe fountain with \"WORLD OF DISNEY\" lettering sprays water, surrounded by palm trees and pedestrians.  \n- A red carpet stretches toward a grand archway labeled \"WORLD OF DISNEY,\" flanked by palm trees and street lamps.  \n- People walk along the red carpet, including a woman with a child in a stroller approaching the archway.\n[30-60s] - A large archway with \"Beverly Hills\" inscribed above, flanked by palm trees and a red carpet leading toward it.  \n- A central fountain sculpture depicting a figure with a rope and pulley system, surrounded by pedestrians.  \n- The fountain is positioned at a street intersection, with shops like \"Saks Fifth Avenue\" and \"Beverly Hills\" visible on either side.\n[60-90s] - A child in red pants walks away from the camera down the center of the street, moving toward the \"Universal Studios\" entrance.  \n- Palm trees line both sides of the street, casting shadows on the pavement under a partly cloudy sky.  \n- Storefronts with colorful displays, including \"Universal Studios\" and \"Disney,\" are visible along the walkway.\n[90-120s] - A yellow vintage taxi is parked near the entrance of \"Theater of the Stars\" building, with its front facing the street.  \n- Palm trees line the sidewalk, casting shadows on the paved walkway as the camera moves forward.  \n- A few pedestrians are visible walking along the street, with some near the storefronts and others further down the path.\n[120-150s] - \"ILLUMINATION\" building's arched entrance is central, with people entering and exiting.  \n- A tall, slender tower structure is visible in the distance, flanked by palm trees.  \n- Pedestrians walk along the street, some near storefronts with awnings, others near red carpeted areas.\n[150-180s] - A red umbrella is positioned over the entrance of the \"POWER UP\" store, which features a cartoonish logo and a yellow sign.  \n- A person in a yellow shirt is seen standing near the store's entrance, possibly interacting with the environment or waiting.  \n- The camera pans right, revealing a street corner with a green building labeled \"SUNSET\" and a blue building with a \"POWER UP\" sign, both with visible storefronts and signage.\n[180-210s] - A red and white striped awning with \"POPCORN\", \"SNACKS\", and \"DRINKS\" signs is visible above a glass storefront.  \n- A large, circular, red mushroom logo (Toad) is centered on the glass, with yellow pillars on either side.  \n- A neon flower sign with green leaves and a yellow center is displayed on a wall inside the store, near a checkered floor.\n[210-240s] - A red beverage in a plastic cup with a mushroom-shaped straw lid sits on a table outdoors.  \n- A Shrek character in a costume walks through a crowded street, interacting with people and gesturing with hands.  \n- The Shrek character moves from left to right across the frame, passing by pedestrians and storefronts.\n[240-270s] - Shrek character walks away from camera, turning right toward a themed storefront with red-and-white striped awning.  \n- A group of people, including children, walks across the street, some carrying bags or wearing costumes.  \n- A man in a blue shirt and cap stands near a red rope barrier, observing the street scene.\n[270-300s] - A blue and yellow van with cartoonish design is parked on the street, surrounded by a crowd of people.  \n- A large, ornate building with a red neon sign reading \"MUSICAL\" is visible, with people walking past its entrance.  \n- A green umbrella is propped up next to the van, and a man in a blue shirt is seen gesturing toward it.", "history_tokens": 860, "history_utf8_bytes": 3543, "recent_frame_times_s": [299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277], "recent_frames_sha256": "0e73fb16ef7dc2c3a5229873c9291d48b079b5e601e7fd7647956c7783b64b11", "num_recent_frames": 30, "tq": 717977.171188285, "t1": 717979.032945268, "ta": 717979.032945268, "te": 717979.436060009, "first_response_s": 1.861756982980296, "answer_total_s": 2.264871723949909, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 308, "content_group": "df4b644bd2e6b0d9098361e2486513bb35aadc9a50307e22c83445b64dbe2a82", "question": {"question_id": "sample_308_a314_q0", "video_id": 308, "video_path": "./videos/sample_308_real.mp4", "annotation_index": 314, "question_index": 0, "question": "What material are the stairs made of?", "options": ["A. Metal.", "B. Wood.", "C. Marble.", "D. Concrete."], "answer": "B", "time_stamp_s": 483, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_308_a314_q0", "video_id": 308, "time_stamp_s": 483, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f6a27487296c8ed061f7ffd30a480fc6879e813dba4adbd6339b04875367fcba", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [453.0192333333333, 454.02023333333335, 455.0212333333333, 456.02223333333336, 457.02323333333334, 458.0242333333333, 459.02523333333335, 460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665], "recent_frames_sha256": "aeeb5445d4805b7538addcadbc960844836cdfaad01d101597d1aeacaf0f99c4", "num_recent_frames": 30, "tq": 717877.172667927, "t1": 717883.465420767, "ta": 717883.465420767, "te": 717883.504823025, "first_response_s": 6.292752839974128, "answer_total_s": 6.332155097974464, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_308_a314_q0", "video_id": 308, "time_stamp_s": 483, "ground_truth": "B", "raw_output": "B. Wood.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "ec1fc322c492b3ee7a7c2a36adf6535ec1f0f15f29c16206cf92516b265af0c8", "condition_order": ["recent", "notes"], "memory": "[150-180s] - A red umbrella is positioned over the entrance of the \"POWER UP\" store, which features a cartoonish logo and a yellow sign.  \n- A person in a yellow shirt is seen standing near the store's entrance, possibly interacting with the environment or waiting.  \n- The camera pans right, revealing a street corner with a green building labeled \"SUNSET\" and a blue building with a \"POWER UP\" sign, both with visible storefronts and signage.\n[180-210s] - A red and white striped awning with \"POPCORN\", \"SNACKS\", and \"DRINKS\" signs is visible above a glass storefront.  \n- A large, circular, red mushroom logo (Toad) is centered on the glass, with yellow pillars on either side.  \n- A neon flower sign with green leaves and a yellow center is displayed on a wall inside the store, near a checkered floor.\n[210-240s] - A red beverage in a plastic cup with a mushroom-shaped straw lid sits on a table outdoors.  \n- A Shrek character in a costume walks through a crowded street, interacting with people and gesturing with hands.  \n- The Shrek character moves from left to right across the frame, passing by pedestrians and storefronts.\n[240-270s] - Shrek character walks away from camera, turning right toward a themed storefront with red-and-white striped awning.  \n- A group of people, including children, walks across the street, some carrying bags or wearing costumes.  \n- A man in a blue shirt and cap stands near a red rope barrier, observing the street scene.\n[270-300s] - A blue and yellow van with cartoonish design is parked on the street, surrounded by a crowd of people.  \n- A large, ornate building with a red neon sign reading \"MUSICAL\" is visible, with people walking past its entrance.  \n- A green umbrella is propped up next to the van, and a man in a blue shirt is seen gesturing toward it.\n[300-330s] - A Scooby-Doo van is parked on the street, cordoned off by green ropes, with a person in a Scooby-Doo costume standing beside it.  \n- Pedestrians walk along the sidewalk, some pausing to look at the van or the costume.  \n- A bright green umbrella is visible on a stand near the van, and the street features brick buildings with storefronts like a laundromat and a toy store.\n[330-360s] - A group of pedestrians walks down a street lined with colorful, stylized buildings, including a blue storefront and a brick building with a balcony.  \n- A white rabbit figurine is mounted on the balcony of a brick building, positioned above a purple storefront with a yellow sign.  \n- The camera pans slightly to the right, revealing more of the street scene, including a café with green umbrellas and a man in a white shirt walking away.\n[360-390s] - A purple storefront with \"THE WASHINGTON\" sign is visible, with people walking past and a green umbrella shading outdoor seating.  \n- A dark, gothic-style building with \"MICE\" signage stands prominently in the background, surrounded by pedestrians.  \n- The camera pans left, revealing more colorful buildings and a street scene with people moving in various directions.\n[390-420s] - A red brick building with green trim and a \"PETS ON-LEASH\" sign is visible, with people walking past its entrance.  \n- A wooden reception desk with a floral arrangement and informational brochures is positioned near a \"ATTRACTION ENTRANCE\" sign.  \n- A door marked \"DOOR OF CHICKEN\" with a diamond-patterned grille is seen behind blue velvet ropes, suggesting restricted access.\n[420-450s] - A wooden door with gold lattice and a \"OUT OF ORDER\" sign is centrally framed by a wooden archway.  \n- The camera pans right, revealing a hallway with blue doors and exposed brick walls.  \n- A teal armchair and framed artwork are visible in a tiled room adjacent to the door.\n[450-480s] - A person in blue jeans and dark top ascends a wooden staircase with metal railings, moving away from the camera.  \n- The staircase is flanked by beige walls and a red brick wall on the right, with a blue door visible at the top landing.  \n- The camera follows the person’s upward movement, capturing the perspective from below as they climb.", "history_tokens": 983, "history_utf8_bytes": 4067, "recent_frame_times_s": [453.0192333333333, 454.02023333333335, 455.0212333333333, 456.02223333333336, 457.02323333333334, 458.0242333333333, 459.02523333333335, 460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665], "recent_frames_sha256": "aeeb5445d4805b7538addcadbc960844836cdfaad01d101597d1aeacaf0f99c4", "num_recent_frames": 30, "tq": 718022.810977908, "t1": 718029.511899397, "ta": 718029.511899397, "te": 718029.704772428, "first_response_s": 6.70092148904223, "answer_total_s": 6.8937945200596005, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 309, "content_group": "0225c85cc608bab029bdb97aebcd146f55974b75eccb1045283fd505a45e5045", "question": {"question_id": "sample_309_a774_q0", "video_id": 309, "video_path": "./videos/sample_309_real.mp4", "annotation_index": 774, "question_index": 0, "question": "What color is the door of Katner's Deli?", "options": ["A. Blue.", "B. Green.", "C. Red.", "D. Yellow."], "answer": "C", "time_stamp_s": 10, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_309_a774_q0", "video_id": 309, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "977aeb88706c51eccd321fccd16cf94fdbd942f3c168345fc641f6837bbbdbe4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.038, 1.0056333333333334, 2.0066333333333333, 3.007633333333333, 4.008633333333333, 5.009633333333333, 6.010633333333334, 7.011633333333333, 8.012633333333333, 9.013633333333333], "recent_frames_sha256": "542f10d86d7f2cb54bc4363425c5f76ff564af704f2e86269bdf7303e8381c60", "num_recent_frames": 10, "tq": 716899.39238344, "t1": 716899.924462559, "ta": 716899.924462559, "te": 716899.961414107, "first_response_s": 0.5320791190024465, "answer_total_s": 0.569030666956678, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_309_a774_q0", "video_id": 309, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ee8fbffb854483c7888bb2a8ac01ce860349b02821840cc3d46d3d5822bac821", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.038, 1.0056333333333334, 2.0066333333333333, 3.007633333333333, 4.008633333333333, 5.009633333333333, 6.010633333333334, 7.011633333333333, 8.012633333333333, 9.013633333333333], "recent_frames_sha256": "542f10d86d7f2cb54bc4363425c5f76ff564af704f2e86269bdf7303e8381c60", "num_recent_frames": 10, "tq": 716730.18647988, "t1": 716741.286306708, "ta": 716741.286306708, "te": 716741.47254456, "first_response_s": 11.099826827994548, "answer_total_s": 11.28606467996724, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 309, "content_group": "0225c85cc608bab029bdb97aebcd146f55974b75eccb1045283fd505a45e5045", "question": {"question_id": "sample_309_a774_q1", "video_id": 309, "video_path": "./videos/sample_309_real.mp4", "annotation_index": 774, "question_index": 1, "question": "What appears to be part of the theme park attraction?", "options": ["A. A large animatronic dog hanging from a crane.", "B. A live music performance.", "C. A magic show.", "D. A water fountain display."], "answer": "A", "time_stamp_s": 11, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_309_a774_q1", "video_id": 309, "time_stamp_s": 11, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8454646ff322df280b1fa32250b512cd6c7279c1a629f2d948c3b5e36026de48", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.038, 1.0056333333333334, 2.0066333333333333, 3.007633333333333, 4.008633333333333, 5.009633333333333, 6.010633333333334, 7.011633333333333, 8.012633333333333, 9.013633333333333, 10.014633333333334], "recent_frames_sha256": "61ba2a0bf17287718f98465f0314aa2aab15b1c9c75ce24ab4a87eee5698309b", "num_recent_frames": 11, "tq": 716899.973877538, "t1": 716912.761676153, "ta": 716912.761676153, "te": 716912.990924321, "first_response_s": 12.78779861505609, "answer_total_s": 13.017046783003025, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_309_a774_q1", "video_id": 309, "time_stamp_s": 11, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1aea11f2e74224b98de7df8ce3a20117d6eb3a220fcffc23fa1d1eccd2f15811", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.038, 1.0056333333333334, 2.0066333333333333, 3.007633333333333, 4.008633333333333, 5.009633333333333, 6.010633333333334, 7.011633333333333, 8.012633333333333, 9.013633333333333, 10.014633333333334], "recent_frames_sha256": "61ba2a0bf17287718f98465f0314aa2aab15b1c9c75ce24ab4a87eee5698309b", "num_recent_frames": 11, "tq": 716741.480670327, "t1": 716753.536102002, "ta": 716753.536102002, "te": 716753.576706814, "first_response_s": 12.055431675049476, "answer_total_s": 12.09603648702614, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 309, "content_group": "0225c85cc608bab029bdb97aebcd146f55974b75eccb1045283fd505a45e5045", "question": {"question_id": "sample_309_a775_q0", "video_id": 309, "video_path": "./videos/sample_309_real.mp4", "annotation_index": 775, "question_index": 0, "question": "What is displayed on the screen now?", "options": ["A. A lion.", "B. A tiger.", "C. A pug.", "D. A cat."], "answer": "A", "time_stamp_s": 160, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_309_a775_q0", "video_id": 309, "time_stamp_s": 160, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "056728e99ea1f7744a1645bcef3083bc2a698c7f8be87ec4aaf87264d016da8b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [130.00116666666668, 131.00216666666665, 132.00316666666666, 133.00416666666666, 134.00516666666667, 135.00616666666667, 136.00716666666668, 137.00816666666665, 138.00916666666666, 139.01016666666666, 140.01116666666667, 141.01216666666667, 142.01316666666668, 143.01416666666665, 144.01516666666666, 145.01616666666666, 146.01716666666667, 147.01816666666667, 148.01916666666668, 149.02016666666665, 150.02116666666666, 151.02216666666666, 152.02316666666667, 153.02416666666667, 154.02516666666668, 155.02616666666665, 156.02716666666666, 157.02816666666666, 158.02916666666667, 159.03016666666667], "recent_frames_sha256": "7b677d6679de6594b4ee4f930071ebb3ce1b65670d394fb7a1849acf44090d73", "num_recent_frames": 30, "tq": 716913.006996914, "t1": 716921.157571683, "ta": 716921.157571683, "te": 716921.197597676, "first_response_s": 8.150574769009836, "answer_total_s": 8.1906007619109, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_309_a775_q0", "video_id": 309, "time_stamp_s": 160, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "25c5e7c728e864e18dba064cf54d704df5e56e8cf67061f113e9f8fd9a597e6d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A large, illuminated display window showcases a glowing, circular design with text above it, set against a dark, architectural backdrop.  \n- The camera pans right, revealing a vibrant, themed street with colorful storefronts, including \"Katie's Deli\" and \"Burger Joint,\" under warm, ambient lighting.  \n- A whimsical, animated train with a smiling face moves along a track through the center of the scene, passing by wooden crates and decorative elements.\n[30-60s] - A white cat with a black nose sits atop stacked crates in a brick-walled alcove, illuminated by purple light.  \n- A green trash bin filled with debris and a white cloth is positioned near a brick wall, with a window above showing a blue-lit exterior.  \n- The camera pans right, revealing a dimly lit alleyway with a red fire hydrant and a storefront labeled \"DOWNWARD DOG YOGA\" with silhouetted figures inside.\n[60-90s] - A green barrel sits centrally under hanging laundry, surrounded by stacked crates and buckets.  \n- Laundry items, including shirts and bags, are suspended by ropes from the ceiling, creating a cluttered, industrial aesthetic.  \n- The camera pans right, revealing shelves stocked with colorful toys and boxes, suggesting a storage or display area.\n[90-120s] - A robotic arm swings a glowing object near a curtain with red and blue patterns.  \n- A large, colorful mural depicting a character in a red outfit is visible on a wall behind stacked boxes.  \n- A sign reading \"BANANA BANANAS\" is mounted on a brick wall above a display of items.\n[120-150s] - A figure in a white robe stands atop a pile of fireworks, holding a torch, as smoke and sparks erupt around them.  \n- The background features a large brick building with arched windows, illuminated by dynamic, colorful light projections.  \n- The scene transitions to a street view with a shopfront labeled \"Bakery\" and a tree with red leaves, partially obscured by smoke and firelight.", "history_tokens": 448, "history_utf8_bytes": 1935, "recent_frame_times_s": [130.00116666666668, 131.00216666666665, 132.00316666666666, 133.00416666666666, 134.00516666666667, 135.00616666666667, 136.00716666666668, 137.00816666666665, 138.00916666666666, 139.01016666666666, 140.01116666666667, 141.01216666666667, 142.01316666666668, 143.01416666666665, 144.01516666666666, 145.01616666666666, 146.01716666666667, 147.01816666666667, 148.01916666666668, 149.02016666666665, 150.02116666666666, 151.02216666666666, 152.02316666666667, 153.02416666666667, 154.02516666666668, 155.02616666666665, 156.02716666666666, 157.02816666666666, 158.02916666666667, 159.03016666666667], "recent_frames_sha256": "7b677d6679de6594b4ee4f930071ebb3ce1b65670d394fb7a1849acf44090d73", "num_recent_frames": 30, "tq": 716797.28235478, "t1": 716799.392176986, "ta": 716799.392176986, "te": 716799.667041773, "first_response_s": 2.1098222059663385, "answer_total_s": 2.384686992969364, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 309, "content_group": "0225c85cc608bab029bdb97aebcd146f55974b75eccb1045283fd505a45e5045", "question": {"question_id": "sample_309_a776_q0", "video_id": 309, "video_path": "./videos/sample_309_real.mp4", "annotation_index": 776, "question_index": 0, "question": "What is written above the brightly colored entrance now?", "options": ["A. Home for Children.", "B. Welcome to the Park.", "C. Home for Girls.", "D. Fun Land."], "answer": "C", "time_stamp_s": 326, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_309_a776_q0", "video_id": 309, "time_stamp_s": 326, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "429a20cf9d4996ecaa4f3c619a1d4b544511085e26e062aa71ff4a22853b8572", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [296.00033333333334, 297.0013333333333, 298.00233333333335, 299.00333333333333, 300.0043333333333, 301.00533333333334, 302.0063333333333, 303.00733333333335, 304.0083333333333, 305.00933333333336, 306.01033333333334, 307.0113333333333, 308.01233333333334, 309.0133333333333, 310.01433333333335, 311.01533333333333, 312.0163333333333, 313.01733333333334, 314.0183333333333, 315.01933333333335, 316.0203333333333, 317.02133333333336, 318.02233333333334, 319.0233333333333, 320.02433333333335, 321.0253333333333, 322.02633333333335, 323.02733333333333, 324.0283333333333, 325.02933333333334], "recent_frames_sha256": "dfd229b22514210a11316e866b7026cf67b20f45a8860677e57c7ba3c7b4eb5b", "num_recent_frames": 30, "tq": 716921.210882414, "t1": 716935.17222729, "ta": 716935.17222729, "te": 716935.209594958, "first_response_s": 13.961344875977375, "answer_total_s": 13.998712543980218, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_309_a776_q0", "video_id": 309, "time_stamp_s": 326, "ground_truth": "C", "raw_output": "C. Home for Girls.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "856a59a60eb556c308cbb5420b552d5f1f07c77cbf27441b71074dab85710e1b", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A large, illuminated display window showcases a glowing, circular design with text above it, set against a dark, architectural backdrop.  \n- The camera pans right, revealing a vibrant, themed street with colorful storefronts, including \"Katie's Deli\" and \"Burger Joint,\" under warm, ambient lighting.  \n- A whimsical, animated train with a smiling face moves along a track through the center of the scene, passing by wooden crates and decorative elements.\n[30-60s] - A white cat with a black nose sits atop stacked crates in a brick-walled alcove, illuminated by purple light.  \n- A green trash bin filled with debris and a white cloth is positioned near a brick wall, with a window above showing a blue-lit exterior.  \n- The camera pans right, revealing a dimly lit alleyway with a red fire hydrant and a storefront labeled \"DOWNWARD DOG YOGA\" with silhouetted figures inside.\n[60-90s] - A green barrel sits centrally under hanging laundry, surrounded by stacked crates and buckets.  \n- Laundry items, including shirts and bags, are suspended by ropes from the ceiling, creating a cluttered, industrial aesthetic.  \n- The camera pans right, revealing shelves stocked with colorful toys and boxes, suggesting a storage or display area.\n[90-120s] - A robotic arm swings a glowing object near a curtain with red and blue patterns.  \n- A large, colorful mural depicting a character in a red outfit is visible on a wall behind stacked boxes.  \n- A sign reading \"BANANA BANANAS\" is mounted on a brick wall above a display of items.\n[120-150s] - A figure in a white robe stands atop a pile of fireworks, holding a torch, as smoke and sparks erupt around them.  \n- The background features a large brick building with arched windows, illuminated by dynamic, colorful light projections.  \n- The scene transitions to a street view with a shopfront labeled \"Bakery\" and a tree with red leaves, partially obscured by smoke and firelight.\n[150-180s] - A white, round-faced character stands on a pedestal near a display of snack packages.  \n- A large, illuminated aquarium with a blue glow is visible to the right, featuring a floating clock and a small, glowing object above the water.  \n- The camera pans left, revealing shelves stocked with colorful snack boxes and a wooden counter with a screen displaying a cartoon image.\n[180-210s] - A large, glowing jellyfish hovers above a blue-lit aquarium tank, with a clock visible on the wall nearby.  \n- A display screen shows a \"TICKET\" graphic, positioned to the right of a large, orange, star-shaped clock.  \n- The camera pans right, revealing a counter area with multiple screens and a large, striped candy cane-like structure behind it.\n[210-240s] - A cartoon dog appears on a screen, initially sitting on a yellow couch, then standing and waving.  \n- The screen transitions to display a blue background with the text \"You look amazing!\" and a silhouette of a cat.  \n- A family of four (two adults, two children) is shown walking in a hallway, with the children holding hands and the adults walking beside them.\n[240-270s] - A brightly lit, balloon-decorated room with a \"HOME\" sign and a blue couch is visible, suggesting a themed exhibit or stage.  \n- The camera pans to reveal a stage area with various props, including a large cardboard box and scattered toys, indicating a playful or interactive setup.  \n- A hallway with a \"Museum\" sign and people walking through it is seen, suggesting a transition or pathway within the exhibit.\n[270-300s] - A man in a black shirt walks away from the camera, carrying a yellow bag, through a brightly lit store aisle.  \n- The store features shelves stocked with plush toys and decorative items, with a sign reading \"The Pet Center\" on the right wall.  \n- The camera pans left, revealing an exit doorway leading to an outdoor pedestrian street with colorful buildings and pedestrians.", "history_tokens": 895, "history_utf8_bytes": 3874, "recent_frame_times_s": [296.00033333333334, 297.0013333333333, 298.00233333333335, 299.00333333333333, 300.0043333333333, 301.00533333333334, 302.0063333333333, 303.00733333333335, 304.0083333333333, 305.00933333333336, 306.01033333333334, 307.0113333333333, 308.01233333333334, 309.0133333333333, 310.01433333333335, 311.01533333333333, 312.0163333333333, 313.01733333333334, 314.0183333333333, 315.01933333333335, 316.0203333333333, 317.02133333333336, 318.02233333333334, 319.0233333333333, 320.02433333333335, 321.0253333333333, 322.02633333333335, 323.02733333333333, 324.0283333333333, 325.02933333333334], "recent_frames_sha256": "dfd229b22514210a11316e866b7026cf67b20f45a8860677e57c7ba3c7b4eb5b", "num_recent_frames": 30, "tq": 716843.732278468, "t1": 716844.711355589, "ta": 716844.711355589, "te": 716845.030996997, "first_response_s": 0.9790771210100502, "answer_total_s": 1.298718529054895, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 309, "content_group": "0225c85cc608bab029bdb97aebcd146f55974b75eccb1045283fd505a45e5045", "question": {"question_id": "sample_309_a777_q0", "video_id": 309, "video_path": "./videos/sample_309_real.mp4", "annotation_index": 777, "question_index": 0, "question": "Where is the green tower with spiral decorations located relative to the walkway?", "options": ["A. To the left.", "B. To the right.", "C. In the center.", "D. In the background."], "answer": "A", "time_stamp_s": 484, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_309_a777_q0", "video_id": 309, "time_stamp_s": 484, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "72022f20356e3ed7acc9946112a584c528992af302906f00ff9a84d8932964b3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [454.02486666666664, 455.0258666666667, 456.02686666666665, 457.0278666666667, 458.02886666666666, 459.0298666666667, 460.03086666666667, 461.03186666666664, 462.0328666666667, 463.0005, 464.0015, 465.0025, 466.0035, 467.0045, 468.0055, 469.0065, 470.0075, 471.0085, 472.0095, 473.0105, 474.0115, 475.0125, 476.0135, 477.0145, 478.0155, 479.0165, 480.0175, 481.0185, 482.0195, 483.0205], "recent_frames_sha256": "f796b04519e10d15e631fae97879311e4a3d8bb10d62203b64b22774a2390e02", "num_recent_frames": 30, "tq": 716935.233981732, "t1": 716947.504275046, "ta": 716947.504275046, "te": 716947.540657955, "first_response_s": 12.270293314009905, "answer_total_s": 12.30667622294277, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_309_a777_q0", "video_id": 309, "time_stamp_s": 484, "ground_truth": "A", "raw_output": "D. In the background.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "dc07ac114b78d3a77ee2cd74c8336b8fa952d096cb80c5d3103cd27140338f45", "condition_order": ["notes", "recent"], "memory": "[150-180s] - A white, round-faced character stands on a pedestal near a display of snack packages.  \n- A large, illuminated aquarium with a blue glow is visible to the right, featuring a floating clock and a small, glowing object above the water.  \n- The camera pans left, revealing shelves stocked with colorful snack boxes and a wooden counter with a screen displaying a cartoon image.\n[180-210s] - A large, glowing jellyfish hovers above a blue-lit aquarium tank, with a clock visible on the wall nearby.  \n- A display screen shows a \"TICKET\" graphic, positioned to the right of a large, orange, star-shaped clock.  \n- The camera pans right, revealing a counter area with multiple screens and a large, striped candy cane-like structure behind it.\n[210-240s] - A cartoon dog appears on a screen, initially sitting on a yellow couch, then standing and waving.  \n- The screen transitions to display a blue background with the text \"You look amazing!\" and a silhouette of a cat.  \n- A family of four (two adults, two children) is shown walking in a hallway, with the children holding hands and the adults walking beside them.\n[240-270s] - A brightly lit, balloon-decorated room with a \"HOME\" sign and a blue couch is visible, suggesting a themed exhibit or stage.  \n- The camera pans to reveal a stage area with various props, including a large cardboard box and scattered toys, indicating a playful or interactive setup.  \n- A hallway with a \"Museum\" sign and people walking through it is seen, suggesting a transition or pathway within the exhibit.\n[270-300s] - A man in a black shirt walks away from the camera, carrying a yellow bag, through a brightly lit store aisle.  \n- The store features shelves stocked with plush toys and decorative items, with a sign reading \"The Pet Center\" on the right wall.  \n- The camera pans left, revealing an exit doorway leading to an outdoor pedestrian street with colorful buildings and pedestrians.\n[300-330s] - Minion characters stand near a gate, interacting with visitors.  \n- A person in a large, plush costume (possibly Gru) is seen near the gate, engaging with guests.  \n- A yellow umbrella is positioned near the entrance, providing shade for visitors.\n[330-360s] - A line of visitors queues near a \"Candyland\" themed building with yellow awnings and a \"Candyland\" sign.  \n- The camera pans to reveal a large, colorful \"Fun Land\" castle archway with green spires and whimsical decorations.  \n- A Minion statue in a sailor outfit sits atop a white pedestal beside a green trash can, near the castle entrance.\n[360-390s] - A Minion character in a Scottish kilt stands atop a white machine near a purple structure, holding a broom.  \n- A green trash can with a smiling face is positioned beside the Minion.  \n- People walk past under green umbrellas and colorful festival decorations, with a large blue archway labeled \"Silly Scary\" visible in the background.\n[390-420s] - A woman with a camera and a child walk past Minion statues near a \"NO STROLLER PARKING\" sign.  \n- A colorful playground with slides and climbing structures is visible, featuring a sign indicating \"MINIONS\" and \"MINION'S PLAYGROUND.\"  \n- A long banner with cartoon characters and a row of green trash bins line the walkway, under a string of triangular flags.\n[420-450s] - Blue and white wave-patterned wall with cartoon characters and signs (e.g., \"Duck\" and \"Duck\" with flags) visible at top.\n- Camera pans right, revealing a cityscape with trees, buildings, and distant mountains under a partly cloudy sky.\n- A tall green pole with a yellow stripe stands near the wall, partially obscuring the view.\n[450-480s] - A child in a white shirt runs across the paved area, moving from right to left.  \n- A stroller with a child inside is visible on the right side, stationary near a green planter.  \n- A metal barricade stands in the center of the path, separating the walkway from an adjacent area.", "history_tokens": 938, "history_utf8_bytes": 3911, "recent_frame_times_s": [454.02486666666664, 455.0258666666667, 456.02686666666665, 457.0278666666667, 458.02886666666666, 459.0298666666667, 460.03086666666667, 461.03186666666664, 462.0328666666667, 463.0005, 464.0015, 465.0025, 466.0035, 467.0045, 468.0055, 469.0065, 470.0075, 471.0085, 472.0095, 473.0105, 474.0115, 475.0125, 476.0135, 477.0145, 478.0155, 479.0165, 480.0175, 481.0185, 482.0195, 483.0205], "recent_frames_sha256": "f796b04519e10d15e631fae97879311e4a3d8bb10d62203b64b22774a2390e02", "num_recent_frames": 30, "tq": 716892.220396049, "t1": 716898.911517205, "ta": 716898.911517205, "te": 716899.348247637, "first_response_s": 6.6911211559781805, "answer_total_s": 7.127851588069461, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 310, "content_group": "efc472850d1d346798bc06aa86c43b008eb23eb31619b06e4a73c9fb2c0c797a", "question": {"question_id": "sample_310_a1263_q0", "video_id": 310, "video_path": "./videos/sample_310_real.mp4", "annotation_index": 1263, "question_index": 0, "question": "What are people doing near the storefronts?", "options": ["A. Running.", "B. Playing with balloons.", "C. Climbing the structure.", "D. Standing and sitting."], "answer": "D", "time_stamp_s": 7, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_310_a1263_q0", "video_id": 310, "time_stamp_s": 7, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "31b2a977679be1d4d09637dfdea129041f44dc4564b72223625b2cd44b068d17", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.048, 1.0156333333333334, 2.0166333333333335, 3.0176333333333334, 4.018633333333334, 5.019633333333333, 6.0206333333333335], "recent_frames_sha256": "9521b4b0df24d21ad4185a158123da365ee2d354e1a0702ed0653ffa738ae3dd", "num_recent_frames": 7, "tq": 715691.91268896, "t1": 715697.784182685, "ta": 715697.784182685, "te": 715697.968296485, "first_response_s": 5.871493724989705, "answer_total_s": 6.055607525049709, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_310_a1263_q0", "video_id": 310, "time_stamp_s": 7, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d285bd4a6aab23b2b73287f4efdfc11263b0a4235e94ba3bfd34600f01137eed", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.048, 1.0156333333333334, 2.0166333333333335, 3.0176333333333334, 4.018633333333334, 5.019633333333333, 6.0206333333333335], "recent_frames_sha256": "9521b4b0df24d21ad4185a158123da365ee2d354e1a0702ed0653ffa738ae3dd", "num_recent_frames": 7, "tq": 715515.783050908, "t1": 715527.217257422, "ta": 715527.217257422, "te": 715527.434934947, "first_response_s": 11.434206514037214, "answer_total_s": 11.651884039049037, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 310, "content_group": "efc472850d1d346798bc06aa86c43b008eb23eb31619b06e4a73c9fb2c0c797a", "question": {"question_id": "sample_310_a1264_q0", "video_id": 310, "video_path": "./videos/sample_310_real.mp4", "annotation_index": 1264, "question_index": 0, "question": "What is the architectural style of the buildings along the street?", "options": ["A. Victorian.", "B. Modern.", "C. Gothic.", "D. Medieval."], "answer": "D", "time_stamp_s": 169, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_310_a1264_q0", "video_id": 310, "time_stamp_s": 169, "ground_truth": "D", "raw_output": "D. Medieval.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "165be124094ea3719f5e534ad1cd0856c417df42ddfe990e091b7c68ac610e90", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [139.02016666666665, 140.02116666666666, 141.02216666666666, 142.02316666666667, 143.02416666666667, 144.02516666666668, 145.02616666666665, 146.02716666666666, 147.02816666666666, 148.02916666666667, 149.03016666666667, 150.03116666666668, 151.03216666666665, 152.03316666666666, 153.0008, 154.0018, 155.0028, 156.0038, 157.0048, 158.0058, 159.0068, 160.0078, 161.0088, 162.0098, 163.0108, 164.0118, 165.0128, 166.0138, 167.0148, 168.0158], "recent_frames_sha256": "31ebf9259d2769c3db2a59c3dbd3b345866752c4a3b7d466cb94efe8eb64e770", "num_recent_frames": 30, "tq": 715697.997917515, "t1": 715704.417071724, "ta": 715704.417071724, "te": 715704.564879631, "first_response_s": 6.4191542089683935, "answer_total_s": 6.566962116048671, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_310_a1264_q0", "video_id": 310, "time_stamp_s": 169, "ground_truth": "D", "raw_output": "C. Gothic.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "cd6751246376022dfdf07bf4fc47ee3bca9f363416e08bce47d33bdf1f8b536a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A large \"Fast & Furious\" movie poster with a car image is displayed on a black wall, visible from 0:14 to 0:20.  \n- A vendor holds a cluster of colorful, character-decorated balloons near the center of the frame, visible from 0:22 to 0:28.  \n- People walk along a paved path, some carrying bags or wearing casual attire, moving past the poster and balloon vendor.\n[30-60s] - A large stone archway with a clock face is central, framed by people walking through it.  \n- To the right, a red steam locomotive (Hogwarts Express) is stationary, with people gathered nearby.  \n- The background reveals colorful, pointed-roof buildings and a clear sky, indicating an outdoor theme park setting.\n[60-90s] - A red train with a black smokestack is stationary at a tunnel entrance, with two people posing in front of it.  \n- The camera pans left, revealing a bustling street lined with whimsical, snow-dusted buildings featuring green shutters and signs like \"Hogwarts Express\" and \"Ollivanders.\"  \n- Pedestrians walk along the cobblestone path, some stopping to look at storefronts, while others move toward the distant castle-like structures.\n[90-120s] - Green-painted shop interior with checkered floor, displaying candy and snacks in glass jars and shelves.  \n- Customers browse items near the counter, with one person in a blue shirt visible near the entrance.  \n- A purple display case with glassware is positioned to the right of the main counter.\n[120-150s] - A person in a blue shirt walks past a green shelf stocked with packaged goods.  \n- The camera pans right, revealing more shelves filled with colorful candies and confectionery.  \n- An exit sign is visible above a doorway leading to an outdoor area with people walking.", "history_tokens": 418, "history_utf8_bytes": 1734, "recent_frame_times_s": [139.02016666666665, 140.02116666666666, 141.02216666666666, 142.02316666666667, 143.02416666666667, 144.02516666666668, 145.02616666666665, 146.02716666666666, 147.02816666666666, 148.02916666666667, 149.03016666666667, 150.03116666666668, 151.03216666666665, 152.03316666666666, 153.0008, 154.0018, 155.0028, 156.0038, 157.0048, 158.0058, 159.0068, 160.0078, 161.0088, 162.0098, 163.0108, 164.0118, 165.0128, 166.0138, 167.0148, 168.0158], "recent_frames_sha256": "31ebf9259d2769c3db2a59c3dbd3b345866752c4a3b7d466cb94efe8eb64e770", "num_recent_frames": 30, "tq": 715563.383328474, "t1": 715570.027434431, "ta": 715570.027434431, "te": 715570.329131914, "first_response_s": 6.644105957006104, "answer_total_s": 6.94580343994312, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 310, "content_group": "efc472850d1d346798bc06aa86c43b008eb23eb31619b06e4a73c9fb2c0c797a", "question": {"question_id": "sample_310_a1265_q0", "video_id": 310, "video_path": "./videos/sample_310_real.mp4", "annotation_index": 1265, "question_index": 0, "question": "What is the shop labeled in the outdoor setting?", "options": ["A. OWL NEST.", "B. OWL SHOP.", "C. OWL HOUSE.", "D. OWL POST."], "answer": "D", "time_stamp_s": 321, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_310_a1265_q0", "video_id": 310, "time_stamp_s": 321, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fd99903d7d41733c210746b398024dd2546bd5d24eb2bd79dce59053f0ea67b8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [291.00533333333334, 292.0063333333333, 293.00733333333335, 294.0083333333333, 295.00933333333336, 296.01033333333334, 297.0113333333333, 298.01233333333334, 299.0133333333333, 300.01433333333335, 301.01533333333333, 302.0163333333333, 303.01733333333334, 304.0183333333333, 305.01933333333335, 306.0203333333333, 307.02133333333336, 308.02233333333334, 309.0233333333333, 310.02433333333335, 311.0253333333333, 312.02633333333335, 313.02733333333333, 314.0283333333333, 315.02933333333334, 316.0303333333333, 317.03133333333335, 318.0323333333333, 319.03333333333336, 320.00096666666667], "recent_frames_sha256": "37e5910f25bb094f8b51cf7f43a56a9ddf25eec5d6dd0897663cf9c5dbf3a585", "num_recent_frames": 30, "tq": 715704.579021907, "t1": 715718.320813692, "ta": 715718.320813692, "te": 715718.504858677, "first_response_s": 13.741791784996167, "answer_total_s": 13.925836770096794, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_310_a1265_q0", "video_id": 310, "time_stamp_s": 321, "ground_truth": "D", "raw_output": "A. OWL NEST.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "ea364ccd0eb558f9d82bc4596d234e2208f7c685b4e412efb57c855afeeb293d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A large \"Fast & Furious\" movie poster with a car image is displayed on a black wall, visible from 0:14 to 0:20.  \n- A vendor holds a cluster of colorful, character-decorated balloons near the center of the frame, visible from 0:22 to 0:28.  \n- People walk along a paved path, some carrying bags or wearing casual attire, moving past the poster and balloon vendor.\n[30-60s] - A large stone archway with a clock face is central, framed by people walking through it.  \n- To the right, a red steam locomotive (Hogwarts Express) is stationary, with people gathered nearby.  \n- The background reveals colorful, pointed-roof buildings and a clear sky, indicating an outdoor theme park setting.\n[60-90s] - A red train with a black smokestack is stationary at a tunnel entrance, with two people posing in front of it.  \n- The camera pans left, revealing a bustling street lined with whimsical, snow-dusted buildings featuring green shutters and signs like \"Hogwarts Express\" and \"Ollivanders.\"  \n- Pedestrians walk along the cobblestone path, some stopping to look at storefronts, while others move toward the distant castle-like structures.\n[90-120s] - Green-painted shop interior with checkered floor, displaying candy and snacks in glass jars and shelves.  \n- Customers browse items near the counter, with one person in a blue shirt visible near the entrance.  \n- A purple display case with glassware is positioned to the right of the main counter.\n[120-150s] - A person in a blue shirt walks past a green shelf stocked with packaged goods.  \n- The camera pans right, revealing more shelves filled with colorful candies and confectionery.  \n- An exit sign is visible above a doorway leading to an outdoor area with people walking.\n[150-180s] - A red \"Brewery\" cart with barrels is stationary near a cobblestone street, surrounded by pedestrians.  \n- People are walking past or near the cart, some carrying bags or pushing strollers.  \n- The background features distinctive, pointed-roofed buildings under a partly cloudy sky.\n[180-210s] - A wooden signpost with \"HAVE YOU SEEN THIS WIZARD?\" and a portrait image is prominently displayed, surrounded by black ropes.  \n- Tourists walk past the signpost, some pausing to look at it, while others continue moving through the courtyard.  \n- A stone building with pointed roofs and arched windows stands in the background, with people gathered near its entrance.\n[210-240s] - Wooden beams and arched ceilings dominate the interior, with hanging chandeliers illuminating the space.  \n- Patrons are seated at tables, some engaged in conversation, while others are dining or walking through the area.  \n- A second-floor balcony with wooden railings overlooks the main dining area, where people are visible moving or standing.\n[240-270s] - A group of people are seated at tables, some engaged in conversation or eating.  \n- A bar area with wooden stools and a bartender is visible, with patrons standing nearby.  \n- The room features stone walls, wooden beams, and a large chandelier, with an exit sign visible near the back.\n[270-300s] - A group of tourists exits a darkened interior through an open doorway marked \"EXIT\" into a sunlit courtyard.  \n- The courtyard features stone pillars, a paved walkway, and a row of tall, slender poles arranged in a line.  \n- A large, ornate building with a steeply pitched, snow-covered roof and stone walls dominates the background, surrounded by other visitors and market stalls.", "history_tokens": 822, "history_utf8_bytes": 3464, "recent_frame_times_s": [291.00533333333334, 292.0063333333333, 293.00733333333335, 294.0083333333333, 295.00933333333336, 296.01033333333334, 297.0113333333333, 298.01233333333334, 299.0133333333333, 300.01433333333335, 301.01533333333333, 302.0163333333333, 303.01733333333334, 304.0183333333333, 305.01933333333335, 306.0203333333333, 307.02133333333336, 308.02233333333334, 309.0233333333333, 310.02433333333335, 311.0253333333333, 312.02633333333335, 313.02733333333333, 314.0283333333333, 315.02933333333334, 316.0303333333333, 317.03133333333335, 318.0323333333333, 319.03333333333336, 320.00096666666667], "recent_frames_sha256": "37e5910f25bb094f8b51cf7f43a56a9ddf25eec5d6dd0897663cf9c5dbf3a585", "num_recent_frames": 30, "tq": 715610.199478387, "t1": 715612.399032491, "ta": 715612.399032491, "te": 715612.712896724, "first_response_s": 2.199554104008712, "answer_total_s": 2.513418336980976, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 310, "content_group": "efc472850d1d346798bc06aa86c43b008eb23eb31619b06e4a73c9fb2c0c797a", "question": {"question_id": "sample_310_a1265_q1", "video_id": 310, "video_path": "./videos/sample_310_real.mp4", "annotation_index": 1265, "question_index": 1, "question": "What initials are visible on the sweaters displayed in the clothing section now?", "options": ["A. A and B.", "B. M and N.", "C. L and P.", "D. H and G."], "answer": "D", "time_stamp_s": 335, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_310_a1265_q1", "video_id": 310, "time_stamp_s": 335, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8063f88c098ef784b758e1921ed9e1e2015d31a0dd80d3b02d1b3c43e6087ec2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [305.01933333333335, 306.0203333333333, 307.02133333333336, 308.02233333333334, 309.0233333333333, 310.02433333333335, 311.0253333333333, 312.02633333333335, 313.02733333333333, 314.0283333333333, 315.02933333333334, 316.0303333333333, 317.03133333333335, 318.0323333333333, 319.03333333333336, 320.00096666666667, 321.00196666666665, 322.0029666666667, 323.00396666666666, 324.0049666666667, 325.00596666666667, 326.00696666666664, 327.0079666666667, 328.00896666666665, 329.0099666666667, 330.01096666666666, 331.0119666666667, 332.01296666666667, 333.01396666666665, 334.0149666666667], "recent_frames_sha256": "13679d5eeb41bc73fa29ac05500e9fcc1b4dbbac45b007cb30d7aa46afaf87e6", "num_recent_frames": 30, "tq": 715718.519928388, "t1": 715730.901248203, "ta": 715730.901248203, "te": 715731.08572732, "first_response_s": 12.381319815060124, "answer_total_s": 12.565798932104371, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_310_a1265_q1", "video_id": 310, "time_stamp_s": 335, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ae1168449157bece8936fb8b2d5831461e3845456ac152921c9da7f6bb2dfe07", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A large \"Fast & Furious\" movie poster with a car image is displayed on a black wall, visible from 0:14 to 0:20.  \n- A vendor holds a cluster of colorful, character-decorated balloons near the center of the frame, visible from 0:22 to 0:28.  \n- People walk along a paved path, some carrying bags or wearing casual attire, moving past the poster and balloon vendor.\n[30-60s] - A large stone archway with a clock face is central, framed by people walking through it.  \n- To the right, a red steam locomotive (Hogwarts Express) is stationary, with people gathered nearby.  \n- The background reveals colorful, pointed-roof buildings and a clear sky, indicating an outdoor theme park setting.\n[60-90s] - A red train with a black smokestack is stationary at a tunnel entrance, with two people posing in front of it.  \n- The camera pans left, revealing a bustling street lined with whimsical, snow-dusted buildings featuring green shutters and signs like \"Hogwarts Express\" and \"Ollivanders.\"  \n- Pedestrians walk along the cobblestone path, some stopping to look at storefronts, while others move toward the distant castle-like structures.\n[90-120s] - Green-painted shop interior with checkered floor, displaying candy and snacks in glass jars and shelves.  \n- Customers browse items near the counter, with one person in a blue shirt visible near the entrance.  \n- A purple display case with glassware is positioned to the right of the main counter.\n[120-150s] - A person in a blue shirt walks past a green shelf stocked with packaged goods.  \n- The camera pans right, revealing more shelves filled with colorful candies and confectionery.  \n- An exit sign is visible above a doorway leading to an outdoor area with people walking.\n[150-180s] - A red \"Brewery\" cart with barrels is stationary near a cobblestone street, surrounded by pedestrians.  \n- People are walking past or near the cart, some carrying bags or pushing strollers.  \n- The background features distinctive, pointed-roofed buildings under a partly cloudy sky.\n[180-210s] - A wooden signpost with \"HAVE YOU SEEN THIS WIZARD?\" and a portrait image is prominently displayed, surrounded by black ropes.  \n- Tourists walk past the signpost, some pausing to look at it, while others continue moving through the courtyard.  \n- A stone building with pointed roofs and arched windows stands in the background, with people gathered near its entrance.\n[210-240s] - Wooden beams and arched ceilings dominate the interior, with hanging chandeliers illuminating the space.  \n- Patrons are seated at tables, some engaged in conversation, while others are dining or walking through the area.  \n- A second-floor balcony with wooden railings overlooks the main dining area, where people are visible moving or standing.\n[240-270s] - A group of people are seated at tables, some engaged in conversation or eating.  \n- A bar area with wooden stools and a bartender is visible, with patrons standing nearby.  \n- The room features stone walls, wooden beams, and a large chandelier, with an exit sign visible near the back.\n[270-300s] - A group of tourists exits a darkened interior through an open doorway marked \"EXIT\" into a sunlit courtyard.  \n- The courtyard features stone pillars, a paved walkway, and a row of tall, slender poles arranged in a line.  \n- A large, ornate building with a steeply pitched, snow-covered roof and stone walls dominates the background, surrounded by other visitors and market stalls.\n[300-330s] - Crowded cobblestone street with tourists walking past distinctive stone buildings with steep, snow-dusted roofs.  \n- A red-roofed cart is visible on the left, partially obscured by pedestrians.  \n- People are seen carrying bags and wearing casual attire, moving in various directions along the street.", "history_tokens": 893, "history_utf8_bytes": 3779, "recent_frame_times_s": [305.01933333333335, 306.0203333333333, 307.02133333333336, 308.02233333333334, 309.0233333333333, 310.02433333333335, 311.0253333333333, 312.02633333333335, 313.02733333333333, 314.0283333333333, 315.02933333333334, 316.0303333333333, 317.03133333333335, 318.0323333333333, 319.03333333333336, 320.00096666666667, 321.00196666666665, 322.0029666666667, 323.00396666666666, 324.0049666666667, 325.00596666666667, 326.00696666666664, 327.0079666666667, 328.00896666666665, 329.0099666666667, 330.01096666666666, 331.0119666666667, 332.01296666666667, 333.01396666666665, 334.0149666666667], "recent_frames_sha256": "13679d5eeb41bc73fa29ac05500e9fcc1b4dbbac45b007cb30d7aa46afaf87e6", "num_recent_frames": 30, "tq": 715622.991214021, "t1": 715624.806312965, "ta": 715624.806312965, "te": 715624.969616134, "first_response_s": 1.8150989440036938, "answer_total_s": 1.978402112959884, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 310, "content_group": "efc472850d1d346798bc06aa86c43b008eb23eb31619b06e4a73c9fb2c0c797a", "question": {"question_id": "sample_310_a1266_q0", "video_id": 310, "video_path": "./videos/sample_310_real.mp4", "annotation_index": 1266, "question_index": 0, "question": "What colors are visible on the boxes stacked on the shelves right now?", "options": ["A. Green, yellow, black, and red.", "B. White, purple, orange, and silver.", "C. Red, blue, green, and white.", "D. Grey, pink, blue black, and gold."], "answer": "D", "time_stamp_s": 492, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_310_a1266_q0", "video_id": 310, "time_stamp_s": 492, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "835eff35197e2225ebdfcc2f942067863755060c5b80c61c58ed1579184be807", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [462.0095, 463.0105, 464.0115, 465.0125, 466.0135, 467.0145, 468.0155, 469.0165, 470.0175, 471.0185, 472.0195, 473.0205, 474.0215, 475.0225, 476.0235, 477.0245, 478.0255, 479.0265, 480.0275, 481.0285, 482.0295, 483.0305, 484.0315, 485.0325, 486.00013333333334, 487.0011333333333, 488.00213333333335, 489.0031333333333, 490.00413333333336, 491.00513333333333], "recent_frames_sha256": "ea18a91e23ab8e9287247f8bf473db1a3970df29bb1ab62300bb1d86c3e15433", "num_recent_frames": 30, "tq": 715731.097842998, "t1": 715745.29033752, "ta": 715745.29033752, "te": 715745.437517745, "first_response_s": 14.192494521965273, "answer_total_s": 14.33967474696692, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_310_a1266_q0", "video_id": 310, "time_stamp_s": 492, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fb1dc82460066cf2fe76a74285c008d7f5e8dc152f1e732b916e5ee2cbb415c4", "condition_order": ["notes", "recent"], "memory": "[90-120s] - Green-painted shop interior with checkered floor, displaying candy and snacks in glass jars and shelves.  \n- Customers browse items near the counter, with one person in a blue shirt visible near the entrance.  \n- A purple display case with glassware is positioned to the right of the main counter.\n[120-150s] - A person in a blue shirt walks past a green shelf stocked with packaged goods.  \n- The camera pans right, revealing more shelves filled with colorful candies and confectionery.  \n- An exit sign is visible above a doorway leading to an outdoor area with people walking.\n[150-180s] - A red \"Brewery\" cart with barrels is stationary near a cobblestone street, surrounded by pedestrians.  \n- People are walking past or near the cart, some carrying bags or pushing strollers.  \n- The background features distinctive, pointed-roofed buildings under a partly cloudy sky.\n[180-210s] - A wooden signpost with \"HAVE YOU SEEN THIS WIZARD?\" and a portrait image is prominently displayed, surrounded by black ropes.  \n- Tourists walk past the signpost, some pausing to look at it, while others continue moving through the courtyard.  \n- A stone building with pointed roofs and arched windows stands in the background, with people gathered near its entrance.\n[210-240s] - Wooden beams and arched ceilings dominate the interior, with hanging chandeliers illuminating the space.  \n- Patrons are seated at tables, some engaged in conversation, while others are dining or walking through the area.  \n- A second-floor balcony with wooden railings overlooks the main dining area, where people are visible moving or standing.\n[240-270s] - A group of people are seated at tables, some engaged in conversation or eating.  \n- A bar area with wooden stools and a bartender is visible, with patrons standing nearby.  \n- The room features stone walls, wooden beams, and a large chandelier, with an exit sign visible near the back.\n[270-300s] - A group of tourists exits a darkened interior through an open doorway marked \"EXIT\" into a sunlit courtyard.  \n- The courtyard features stone pillars, a paved walkway, and a row of tall, slender poles arranged in a line.  \n- A large, ornate building with a steeply pitched, snow-covered roof and stone walls dominates the background, surrounded by other visitors and market stalls.\n[300-330s] - Crowded cobblestone street with tourists walking past distinctive stone buildings with steep, snow-dusted roofs.  \n- A red-roofed cart is visible on the left, partially obscured by pedestrians.  \n- People are seen carrying bags and wearing casual attire, moving in various directions along the street.\n[330-360s] - Wooden shelves display white owl figurines across multiple levels, with a chandelier hanging above.  \n- A doorway leads into a clothing section with hanging shirts featuring \"H\" and \"C\" logos.  \n- Visitors walk through the space, some near the counter, others browsing items on shelves.\n[360-390s] - A man in a red shirt walks past wooden display shelves filled with jackets and accessories.  \n- Through an open doorway, people are visible in a brightly lit retail space with a counter and merchandise displays.  \n- The camera pans to reveal a large, ornate room with stacked wooden crates and a mannequin wearing a dark coat.\n[390-420s] - A display of t-shirts and glassware hangs from a central pole, with a red shirt reading \"Gryffindor\" and a blue shirt with \"Hogwarts\" visible.  \n- The camera pans upward, revealing a high ceiling with exposed pipes and a large, ornate chandelier.  \n- A wooden table with a leather belt and a red object rests inside a metal cage, illuminated by focused lighting.\n[420-450s] - A metal cage contains a furry, padded surface with a leather belt and a red object resting on it.  \n- The cage is positioned under a sign reading \"DANGER BOOK MAY BITE!\" with a glowing effect.  \n- The scene transitions to an outdoor area with a stone building and crowds of people walking around.\n[450-480s] - Two individuals wearing \"ANTI SOCIAL CLUB\" shirts enter the shop through a blue-framed doorway.  \n- Inside, the shop features a vibrant blue ceiling with hanging ornate globes and a display of merchandise on shelves and racks.  \n- A sign with \"ANTI SOCIAL CLUB\" is visible on the wall near the entrance, indicating the shop's branding.", "history_tokens": 1011, "history_utf8_bytes": 4311, "recent_frame_times_s": [462.0095, 463.0105, 464.0115, 465.0125, 466.0135, 467.0145, 468.0155, 469.0165, 470.0175, 471.0185, 472.0195, 473.0205, 474.0215, 475.0225, 476.0235, 477.0245, 478.0255, 479.0265, 480.0275, 481.0285, 482.0295, 483.0305, 484.0315, 485.0325, 486.00013333333334, 487.0011333333333, 488.00213333333335, 489.0031333333333, 490.00413333333336, 491.00513333333333], "recent_frames_sha256": "ea18a91e23ab8e9287247f8bf473db1a3970df29bb1ab62300bb1d86c3e15433", "num_recent_frames": 30, "tq": 715690.020948945, "t1": 715691.669053876, "ta": 715691.669053876, "te": 715691.863138813, "first_response_s": 1.6481049309950322, "answer_total_s": 1.8421898679807782, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 312, "content_group": "f36487e0269541d9049e6102a709070b72d9709f48dc8d94311fee89d3b0610d", "question": {"question_id": "sample_312_a427_q0", "video_id": 312, "video_path": "./videos/sample_312_real.mp4", "annotation_index": 427, "question_index": 0, "question": "What was the name of the food stand shown just now?", "options": ["A. TASTY TREATS.", "B. REEL TREATS.", "C. SWEET SNACKS.", "D. FOOD HAVEN."], "answer": "B", "time_stamp_s": 164, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_312_a427_q0", "video_id": 312, "time_stamp_s": 164, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a2ce0bdc71c0b7c5397a5e807455fb063049e22e17b0c84345fcdc7f7048fc25", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [134.01116666666667, 135.01216666666667, 136.01316666666668, 137.01416666666665, 138.01516666666666, 139.01616666666666, 140.01716666666667, 141.01816666666667, 142.01916666666668, 143.02016666666665, 144.02116666666666, 145.02216666666666, 146.02316666666667, 147.02416666666667, 148.02516666666668, 149.02616666666665, 150.02716666666666, 151.02816666666666, 152.02916666666667, 153.03016666666667, 154.03116666666668, 155.03216666666665, 156.03316666666666, 157.0008, 158.0018, 159.0028, 160.0038, 161.0048, 162.0058, 163.0068], "recent_frames_sha256": "9f17092ced1b01ba473a0e4acdca95d586b4d935c1a0f7cf804f663406d84c6d", "num_recent_frames": 30, "tq": 717612.488186263, "t1": 717618.272170997, "ta": 717618.272170997, "te": 717618.310378789, "first_response_s": 5.783984733978286, "answer_total_s": 5.82219252595678, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_312_a427_q0", "video_id": 312, "time_stamp_s": 164, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b3cac813f75c34c1995b508f71ef5afc07f3802bb9919f9c49cb9eee481ffaf5", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A large screen displays animated characters, including Bart Simpson, above shelves stocked with yellow-themed merchandise.  \n- A sign reading \"JACKPOT POT\" is visible near a display of blue t-shirts, with a circular \"EVERYDAY\" sign nearby.  \n- The camera pans across shelves filled with various Simpsons-themed items, including plush toys and apparel, under bright lighting.\n[30-60s] - A clown figure in a pink outfit and green pants stands near the \"Springfield Department of Motor Vehicles\" entrance, interacting with visitors.  \n- A large, colorful mural depicting cartoon characters is visible on the wall behind the counter.  \n- The interior features shelves stocked with various products, including cans and packaged goods, arranged in a retail setting.\n[60-90s] - A crowd of visitors walks through the entrance of Studio Tour, passing under a large archway with \"STUDIO TOUR\" signage.  \n- Palm trees line the pathway, and people are seen moving in various directions, some carrying bags or children.  \n- The sky is partly cloudy, and the area appears lively with people entering the attraction.\n[90-120s] - A group of pedestrians walks along a paved bridge, moving away from the camera toward a distant cityscape.  \n- Blue banners with promotional imagery hang from the bridge’s railings, displaying advertisements for attractions.  \n- The sky above is partly cloudy, with mountains visible in the background, suggesting an elevated viewpoint.\n[120-150s] - A \"STUDIO TOUR\" banner is prominently displayed above a food cart, indicating an event or attraction.  \n- People are walking along a paved pathway, some carrying bags or wearing casual attire, suggesting a public outing.  \n- A green, curved glass structure is visible to the right, possibly part of a building or attraction entrance.", "history_tokens": 389, "history_utf8_bytes": 1809, "recent_frame_times_s": [134.01116666666667, 135.01216666666667, 136.01316666666668, 137.01416666666665, 138.01516666666666, 139.01616666666666, 140.01716666666667, 141.01816666666667, 142.01916666666668, 143.02016666666665, 144.02116666666666, 145.02216666666666, 146.02316666666667, 147.02416666666667, 148.02516666666668, 149.02616666666665, 150.02716666666666, 151.02816666666666, 152.02916666666667, 153.03016666666667, 154.03116666666668, 155.03216666666665, 156.03316666666666, 157.0008, 158.0018, 159.0028, 160.0038, 161.0048, 162.0058, 163.0068], "recent_frames_sha256": "9f17092ced1b01ba473a0e4acdca95d586b4d935c1a0f7cf804f663406d84c6d", "num_recent_frames": 30, "tq": 717705.337794867, "t1": 717706.905780366, "ta": 717706.905780366, "te": 717706.947604609, "first_response_s": 1.5679854990448803, "answer_total_s": 1.6098097419599071, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 312, "content_group": "f36487e0269541d9049e6102a709070b72d9709f48dc8d94311fee89d3b0610d", "question": {"question_id": "sample_312_a428_q0", "video_id": 312, "video_path": "./videos/sample_312_real.mp4", "annotation_index": 428, "question_index": 0, "question": "What kind of area is visible through the tram's windows during the journey?", "options": ["A. A sandy beach.", "B. A wooded area with trees.", "C. A bustling city street.", "D. A snowy mountain path."], "answer": "B", "time_stamp_s": 330, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_312_a428_q0", "video_id": 312, "time_stamp_s": 330, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a31034e3cf5d8583a25d377fbe291e5b218281833aa188170e0e9a966c0c9aae", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [300.01033333333334, 301.0113333333333, 302.01233333333334, 303.0133333333333, 304.01433333333335, 305.01533333333333, 306.0163333333333, 307.01733333333334, 308.0183333333333, 309.01933333333335, 310.0203333333333, 311.02133333333336, 312.02233333333334, 313.0233333333333, 314.02433333333335, 315.0253333333333, 316.02633333333335, 317.02733333333333, 318.0283333333333, 319.02933333333334, 320.0303333333333, 321.03133333333335, 322.0323333333333, 323.03333333333336, 324.00096666666667, 325.00196666666665, 326.0029666666667, 327.00396666666666, 328.0049666666667, 329.00596666666667], "recent_frames_sha256": "16f3bb6e83d480a607d46aa2fc71b77cf41cba935de6ba8c422d5d622cc1b6b1", "num_recent_frames": 30, "tq": 717618.324439848, "t1": 717626.810951799, "ta": 717626.810951799, "te": 717626.850651523, "first_response_s": 8.486511951079592, "answer_total_s": 8.52621167502366, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_312_a428_q0", "video_id": 312, "time_stamp_s": 330, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e5c49d118a4e552a4b6c4314ece9a9f85f4d2eeb2be767d30d6b54d28fd1fb56", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A large screen displays animated characters, including Bart Simpson, above shelves stocked with yellow-themed merchandise.  \n- A sign reading \"JACKPOT POT\" is visible near a display of blue t-shirts, with a circular \"EVERYDAY\" sign nearby.  \n- The camera pans across shelves filled with various Simpsons-themed items, including plush toys and apparel, under bright lighting.\n[30-60s] - A clown figure in a pink outfit and green pants stands near the \"Springfield Department of Motor Vehicles\" entrance, interacting with visitors.  \n- A large, colorful mural depicting cartoon characters is visible on the wall behind the counter.  \n- The interior features shelves stocked with various products, including cans and packaged goods, arranged in a retail setting.\n[60-90s] - A crowd of visitors walks through the entrance of Studio Tour, passing under a large archway with \"STUDIO TOUR\" signage.  \n- Palm trees line the pathway, and people are seen moving in various directions, some carrying bags or children.  \n- The sky is partly cloudy, and the area appears lively with people entering the attraction.\n[90-120s] - A group of pedestrians walks along a paved bridge, moving away from the camera toward a distant cityscape.  \n- Blue banners with promotional imagery hang from the bridge’s railings, displaying advertisements for attractions.  \n- The sky above is partly cloudy, with mountains visible in the background, suggesting an elevated viewpoint.\n[120-150s] - A \"STUDIO TOUR\" banner is prominently displayed above a food cart, indicating an event or attraction.  \n- People are walking along a paved pathway, some carrying bags or wearing casual attire, suggesting a public outing.  \n- A green, curved glass structure is visible to the right, possibly part of a building or attraction entrance.\n[150-180s] - People are ascending an escalator under a curved glass canopy, moving toward a lower level.  \n- A sign reading \"STUDIO TOUR\" is visible on the right side of the escalator.  \n- The escalator leads to a plaza area with people walking and a visible \"ICE COLD DRINKS\" cart nearby.\n[180-210s] - A large \"STUDIO TOUR\" sign with animated imagery is prominently displayed above a crowd of visitors.  \n- People are walking through an entrance area under a modern, arched glass canopy.  \n- Screens above the entrance show still images of individuals, likely related to the studio tour.\n[210-240s] - A long, open-sided shuttle bus with blue and silver seats moves leftward across the frame, passing a red and yellow striped road.  \n- The bus has a roof structure and is flanked by other similar vehicles, with banners visible on poles nearby.  \n- The background shows a distant cityscape and mountains under a clear blue sky.\n[240-270s] - Passengers seated inside a tram, some facing forward, others looking out the windows.  \n- A digital display above the front shows route number \"297\" and destination \"Casa Grande\".  \n- Exterior view reveals a paved station area with blue canopies, greenery, and a white wall with ivy along the side.\n[270-300s] - Two screens above the front display animated graphics with a mountain and sun motif, likely for entertainment or route information.  \n- Passengers are seated facing forward, with some wearing hats or casual attire, suggesting a tour or transit setting.  \n- The bus interior has overhead storage compartments and a visible \"Coca-Cola\" logo on the ceiling, indicating branding or sponsorship.\n[300-330s] - Passengers seated and standing on a bus, with some heads visible in the foreground.\n- Overhead digital displays show route information, including \"B10\" and \"B11\" route numbers.\n- Exterior view through windows shows trees and a road, with the bus moving along a route.", "history_tokens": 847, "history_utf8_bytes": 3734, "recent_frame_times_s": [300.01033333333334, 301.0113333333333, 302.01233333333334, 303.0133333333333, 304.01433333333335, 305.01533333333333, 306.0163333333333, 307.01733333333334, 308.0183333333333, 309.01933333333335, 310.0203333333333, 311.02133333333336, 312.02233333333334, 313.0233333333333, 314.02433333333335, 315.0253333333333, 316.02633333333335, 317.02733333333333, 318.0283333333333, 319.02933333333334, 320.0303333333333, 321.03133333333335, 322.0323333333333, 323.03333333333336, 324.00096666666667, 325.00196666666665, 326.0029666666667, 327.00396666666666, 328.0049666666667, 329.00596666666667], "recent_frames_sha256": "16f3bb6e83d480a607d46aa2fc71b77cf41cba935de6ba8c422d5d622cc1b6b1", "num_recent_frames": 30, "tq": 717749.478631346, "t1": 717750.788741721, "ta": 717750.788741721, "te": 717750.979019662, "first_response_s": 1.3101103749359027, "answer_total_s": 1.5003883159952238, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 312, "content_group": "f36487e0269541d9049e6102a709070b72d9709f48dc8d94311fee89d3b0610d", "question": {"question_id": "sample_312_a428_q1", "video_id": 312, "video_path": "./videos/sample_312_real.mp4", "annotation_index": 428, "question_index": 1, "question": "How is the road next to the tram bordered?", "options": ["A. With a wooden fence.", "B. With stone walls.", "C. With metallic guardrails.", "D. With hedges."], "answer": "C", "time_stamp_s": 346, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_312_a428_q1", "video_id": 312, "time_stamp_s": 346, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e9cc77bab1962035ad17b42a25bdf6897813fabb4a24732b41094bee775734bd", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [316.02633333333335, 317.02733333333333, 318.0283333333333, 319.02933333333334, 320.0303333333333, 321.03133333333335, 322.0323333333333, 323.03333333333336, 324.00096666666667, 325.00196666666665, 326.0029666666667, 327.00396666666666, 328.0049666666667, 329.00596666666667, 330.00696666666664, 331.0079666666667, 332.00896666666665, 333.0099666666667, 334.01096666666666, 335.0119666666667, 336.01296666666667, 337.01396666666665, 338.0149666666667, 339.01596666666666, 340.0169666666667, 341.01796666666667, 342.01896666666664, 343.0199666666667, 344.02096666666665, 345.0219666666667], "recent_frames_sha256": "b0b0db94fdde44ba1f16ae5afcde1f7149769548be39a879adfcfc4a6d76700c", "num_recent_frames": 30, "tq": 717626.859442841, "t1": 717638.386417719, "ta": 717638.386417719, "te": 717638.424172381, "first_response_s": 11.526974877924658, "answer_total_s": 11.564729540026747, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_312_a428_q1", "video_id": 312, "time_stamp_s": 346, "ground_truth": "C", "raw_output": "C. With metallic guardrails.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "7924f962f038a8291f11e3e90ab1dffc47ccede53c42302e0ea21498900ef7e3", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A large screen displays animated characters, including Bart Simpson, above shelves stocked with yellow-themed merchandise.  \n- A sign reading \"JACKPOT POT\" is visible near a display of blue t-shirts, with a circular \"EVERYDAY\" sign nearby.  \n- The camera pans across shelves filled with various Simpsons-themed items, including plush toys and apparel, under bright lighting.\n[30-60s] - A clown figure in a pink outfit and green pants stands near the \"Springfield Department of Motor Vehicles\" entrance, interacting with visitors.  \n- A large, colorful mural depicting cartoon characters is visible on the wall behind the counter.  \n- The interior features shelves stocked with various products, including cans and packaged goods, arranged in a retail setting.\n[60-90s] - A crowd of visitors walks through the entrance of Studio Tour, passing under a large archway with \"STUDIO TOUR\" signage.  \n- Palm trees line the pathway, and people are seen moving in various directions, some carrying bags or children.  \n- The sky is partly cloudy, and the area appears lively with people entering the attraction.\n[90-120s] - A group of pedestrians walks along a paved bridge, moving away from the camera toward a distant cityscape.  \n- Blue banners with promotional imagery hang from the bridge’s railings, displaying advertisements for attractions.  \n- The sky above is partly cloudy, with mountains visible in the background, suggesting an elevated viewpoint.\n[120-150s] - A \"STUDIO TOUR\" banner is prominently displayed above a food cart, indicating an event or attraction.  \n- People are walking along a paved pathway, some carrying bags or wearing casual attire, suggesting a public outing.  \n- A green, curved glass structure is visible to the right, possibly part of a building or attraction entrance.\n[150-180s] - People are ascending an escalator under a curved glass canopy, moving toward a lower level.  \n- A sign reading \"STUDIO TOUR\" is visible on the right side of the escalator.  \n- The escalator leads to a plaza area with people walking and a visible \"ICE COLD DRINKS\" cart nearby.\n[180-210s] - A large \"STUDIO TOUR\" sign with animated imagery is prominently displayed above a crowd of visitors.  \n- People are walking through an entrance area under a modern, arched glass canopy.  \n- Screens above the entrance show still images of individuals, likely related to the studio tour.\n[210-240s] - A long, open-sided shuttle bus with blue and silver seats moves leftward across the frame, passing a red and yellow striped road.  \n- The bus has a roof structure and is flanked by other similar vehicles, with banners visible on poles nearby.  \n- The background shows a distant cityscape and mountains under a clear blue sky.\n[240-270s] - Passengers seated inside a tram, some facing forward, others looking out the windows.  \n- A digital display above the front shows route number \"297\" and destination \"Casa Grande\".  \n- Exterior view reveals a paved station area with blue canopies, greenery, and a white wall with ivy along the side.\n[270-300s] - Two screens above the front display animated graphics with a mountain and sun motif, likely for entertainment or route information.  \n- Passengers are seated facing forward, with some wearing hats or casual attire, suggesting a tour or transit setting.  \n- The bus interior has overhead storage compartments and a visible \"Coca-Cola\" logo on the ceiling, indicating branding or sponsorship.\n[300-330s] - Passengers seated and standing on a bus, with some heads visible in the foreground.\n- Overhead digital displays show route information, including \"B10\" and \"B11\" route numbers.\n- Exterior view through windows shows trees and a road, with the bus moving along a route.", "history_tokens": 847, "history_utf8_bytes": 3734, "recent_frame_times_s": [316.02633333333335, 317.02733333333333, 318.0283333333333, 319.02933333333334, 320.0303333333333, 321.03133333333335, 322.0323333333333, 323.03333333333336, 324.00096666666667, 325.00196666666665, 326.0029666666667, 327.00396666666666, 328.0049666666667, 329.00596666666667, 330.00696666666664, 331.0079666666667, 332.00896666666665, 333.0099666666667, 334.01096666666666, 335.0119666666667, 336.01296666666667, 337.01396666666665, 338.0149666666667, 339.01596666666666, 340.0169666666667, 341.01796666666667, 342.01896666666664, 343.0199666666667, 344.02096666666665, 345.0219666666667], "recent_frames_sha256": "b0b0db94fdde44ba1f16ae5afcde1f7149769548be39a879adfcfc4a6d76700c", "num_recent_frames": 30, "tq": 717751.021542919, "t1": 717764.57368037, "ta": 717764.57368037, "te": 717764.881507818, "first_response_s": 13.55213745101355, "answer_total_s": 13.85996489902027, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 312, "content_group": "f36487e0269541d9049e6102a709070b72d9709f48dc8d94311fee89d3b0610d", "question": {"question_id": "sample_312_a429_q1", "video_id": 312, "video_path": "./videos/sample_312_real.mp4", "annotation_index": 429, "question_index": 1, "question": "What is the perspective of the view as the vehicle drives along the road?", "options": ["A. Aerial view.", "B. First-person perspective.", "C. Third-person perspective.", "D. Rear view."], "answer": "B", "time_stamp_s": 490, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_312_a429_q1", "video_id": 312, "time_stamp_s": 490, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a64cc5fa169144f91db9ae8595b3d990aea461399ac043b48a470c3a6b907cb6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [460.0035, 461.0045, 462.0055, 463.0065, 464.0075, 465.0085, 466.0095, 467.0105, 468.0115, 469.0125, 470.0135, 471.0145, 472.0155, 473.0165, 474.0175, 475.0185, 476.0195, 477.0205, 478.0215, 479.0225, 480.0235, 481.0245, 482.0255, 483.0265, 484.0275, 485.0285, 486.0295, 487.0305, 488.0315, 489.0325], "recent_frames_sha256": "11cac9c61a95bbf5ed060705a4c6ad83b5edcbe9a446dde5d929829908f7f34c", "num_recent_frames": 30, "tq": 717638.432984315, "t1": 717650.782424919, "ta": 717650.782424919, "te": 717650.821366879, "first_response_s": 12.349440603982657, "answer_total_s": 12.388382564065978, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_312_a429_q1", "video_id": 312, "time_stamp_s": 490, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f181a5ebadea08447cd2c94cd5991326ff07aa9f026317f7fcffe1742afc2ee0", "condition_order": ["recent", "notes"], "memory": "[120-150s] - A \"STUDIO TOUR\" banner is prominently displayed above a food cart, indicating an event or attraction.  \n- People are walking along a paved pathway, some carrying bags or wearing casual attire, suggesting a public outing.  \n- A green, curved glass structure is visible to the right, possibly part of a building or attraction entrance.\n[150-180s] - People are ascending an escalator under a curved glass canopy, moving toward a lower level.  \n- A sign reading \"STUDIO TOUR\" is visible on the right side of the escalator.  \n- The escalator leads to a plaza area with people walking and a visible \"ICE COLD DRINKS\" cart nearby.\n[180-210s] - A large \"STUDIO TOUR\" sign with animated imagery is prominently displayed above a crowd of visitors.  \n- People are walking through an entrance area under a modern, arched glass canopy.  \n- Screens above the entrance show still images of individuals, likely related to the studio tour.\n[210-240s] - A long, open-sided shuttle bus with blue and silver seats moves leftward across the frame, passing a red and yellow striped road.  \n- The bus has a roof structure and is flanked by other similar vehicles, with banners visible on poles nearby.  \n- The background shows a distant cityscape and mountains under a clear blue sky.\n[240-270s] - Passengers seated inside a tram, some facing forward, others looking out the windows.  \n- A digital display above the front shows route number \"297\" and destination \"Casa Grande\".  \n- Exterior view reveals a paved station area with blue canopies, greenery, and a white wall with ivy along the side.\n[270-300s] - Two screens above the front display animated graphics with a mountain and sun motif, likely for entertainment or route information.  \n- Passengers are seated facing forward, with some wearing hats or casual attire, suggesting a tour or transit setting.  \n- The bus interior has overhead storage compartments and a visible \"Coca-Cola\" logo on the ceiling, indicating branding or sponsorship.\n[300-330s] - Passengers seated and standing on a bus, with some heads visible in the foreground.\n- Overhead digital displays show route information, including \"B10\" and \"B11\" route numbers.\n- Exterior view through windows shows trees and a road, with the bus moving along a route.\n[330-360s] - A red \"STOP\" sign is visible near a green bush, with a \"Kirk Douglas Blvd\" street sign nearby.  \n- The camera pans left, revealing a concrete overpass and a paved road beneath it.  \n- The view shifts to show a mix of greenery, including a weeping willow tree, and distant urban structures under a partly cloudy sky.\n[360-390s] - A concrete overpass dominates the left side of the frame, casting shadows on the ground.  \n- Multiple colorful banners, including one for \"1925\" and another for \"WEST HILLS,\" are mounted along the roadside.  \n- The camera pans right, revealing a mix of greenery, a paved path, and distant buildings under a partly cloudy sky.\n[390-420s] - A large \"MAGIC\" sign with a movie poster for \"The Greater the Spy\" is visible on a building wall, partially obscured by bushes.  \n- A \"NO PARKING\" sign is positioned near the base of the building, adjacent to a yellow post.  \n- The camera pans left, revealing a tall cylindrical sign for \"The Magic\" with a movie poster, set against a backdrop of palm trees and a white building.\n[420-450s] - A red sports car is parked near a white building with large garage doors, positioned beside a red curb.  \n- A beige Jeep is parked in a designated spot near a green fence, with a black car behind it.  \n- A tall flagpole with an American flag stands near the building, with trees and a clear sky in the background.\n[450-480s] - A train moves past a series of large, vertically oriented posters mounted on a beige corrugated metal fence, featuring images of actors and movie titles like \"Apollo 13\" and \"The Godfather.\"\n- The posters are arranged in a line along the fence, with some showing characters in costume or dramatic poses, and others displaying text such as \"EDDIE MURPHY\" and \"GLADYS ZIL.\"\n- The train's interior is partially visible, with passengers seated and looking out the window, while the exterior environment includes trees, a red curb, and distant buildings under a partly cloudy sky.", "history_tokens": 1021, "history_utf8_bytes": 4248, "recent_frame_times_s": [460.0035, 461.0045, 462.0055, 463.0065, 464.0075, 465.0085, 466.0095, 467.0105, 468.0115, 469.0125, 470.0135, 471.0145, 472.0155, 473.0165, 474.0175, 475.0185, 476.0195, 477.0205, 478.0215, 479.0225, 480.0235, 481.0245, 482.0255, 483.0265, 484.0275, 485.0285, 486.0295, 487.0305, 488.0315, 489.0325], "recent_frames_sha256": "11cac9c61a95bbf5ed060705a4c6ad83b5edcbe9a446dde5d929829908f7f34c", "num_recent_frames": 30, "tq": 717804.371243324, "t1": 717806.125178634, "ta": 717806.125178634, "te": 717806.495973214, "first_response_s": 1.7539353099418804, "answer_total_s": 2.1247298900270835, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 312, "content_group": "f36487e0269541d9049e6102a709070b72d9709f48dc8d94311fee89d3b0610d", "question": {"question_id": "sample_312_a429_q0", "video_id": 312, "video_path": "./videos/sample_312_real.mp4", "annotation_index": 429, "question_index": 0, "question": "What types of advertisements were seen on the billboards just now?", "options": ["A. Food products.", "B. Clothing brands.", "C. Movie promotions.", "D. Electronics."], "answer": "C", "time_stamp_s": 496, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_312_a429_q0", "video_id": 312, "time_stamp_s": 496, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2a0c26c546a8f6a12c6f05ab1eef20a46a19a4993d38905efa5d06354c21c973", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [466.0095, 467.0105, 468.0115, 469.0125, 470.0135, 471.0145, 472.0155, 473.0165, 474.0175, 475.0185, 476.0195, 477.0205, 478.0215, 479.0225, 480.0235, 481.0245, 482.0255, 483.0265, 484.0275, 485.0285, 486.0295, 487.0305, 488.0315, 489.0325, 490.00013333333334, 491.0011333333333, 492.00213333333335, 493.0031333333333, 494.00413333333336, 495.00513333333333], "recent_frames_sha256": "c527c8d013c147cc8c36b89c4afc239ad23751deca6118eb7256c13d8634075e", "num_recent_frames": 30, "tq": 717650.831192454, "t1": 717663.635675557, "ta": 717663.635675557, "te": 717663.674468765, "first_response_s": 12.804483102983795, "answer_total_s": 12.843276311061345, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_312_a429_q0", "video_id": 312, "time_stamp_s": 496, "ground_truth": "C", "raw_output": "C. Movie promotions.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "00dc8118d9579cca80ca55d3b389dd7987faf6193560024e39f17341ae8e7ec5", "condition_order": ["recent", "notes"], "memory": "[120-150s] - A \"STUDIO TOUR\" banner is prominently displayed above a food cart, indicating an event or attraction.  \n- People are walking along a paved pathway, some carrying bags or wearing casual attire, suggesting a public outing.  \n- A green, curved glass structure is visible to the right, possibly part of a building or attraction entrance.\n[150-180s] - People are ascending an escalator under a curved glass canopy, moving toward a lower level.  \n- A sign reading \"STUDIO TOUR\" is visible on the right side of the escalator.  \n- The escalator leads to a plaza area with people walking and a visible \"ICE COLD DRINKS\" cart nearby.\n[180-210s] - A large \"STUDIO TOUR\" sign with animated imagery is prominently displayed above a crowd of visitors.  \n- People are walking through an entrance area under a modern, arched glass canopy.  \n- Screens above the entrance show still images of individuals, likely related to the studio tour.\n[210-240s] - A long, open-sided shuttle bus with blue and silver seats moves leftward across the frame, passing a red and yellow striped road.  \n- The bus has a roof structure and is flanked by other similar vehicles, with banners visible on poles nearby.  \n- The background shows a distant cityscape and mountains under a clear blue sky.\n[240-270s] - Passengers seated inside a tram, some facing forward, others looking out the windows.  \n- A digital display above the front shows route number \"297\" and destination \"Casa Grande\".  \n- Exterior view reveals a paved station area with blue canopies, greenery, and a white wall with ivy along the side.\n[270-300s] - Two screens above the front display animated graphics with a mountain and sun motif, likely for entertainment or route information.  \n- Passengers are seated facing forward, with some wearing hats or casual attire, suggesting a tour or transit setting.  \n- The bus interior has overhead storage compartments and a visible \"Coca-Cola\" logo on the ceiling, indicating branding or sponsorship.\n[300-330s] - Passengers seated and standing on a bus, with some heads visible in the foreground.\n- Overhead digital displays show route information, including \"B10\" and \"B11\" route numbers.\n- Exterior view through windows shows trees and a road, with the bus moving along a route.\n[330-360s] - A red \"STOP\" sign is visible near a green bush, with a \"Kirk Douglas Blvd\" street sign nearby.  \n- The camera pans left, revealing a concrete overpass and a paved road beneath it.  \n- The view shifts to show a mix of greenery, including a weeping willow tree, and distant urban structures under a partly cloudy sky.\n[360-390s] - A concrete overpass dominates the left side of the frame, casting shadows on the ground.  \n- Multiple colorful banners, including one for \"1925\" and another for \"WEST HILLS,\" are mounted along the roadside.  \n- The camera pans right, revealing a mix of greenery, a paved path, and distant buildings under a partly cloudy sky.\n[390-420s] - A large \"MAGIC\" sign with a movie poster for \"The Greater the Spy\" is visible on a building wall, partially obscured by bushes.  \n- A \"NO PARKING\" sign is positioned near the base of the building, adjacent to a yellow post.  \n- The camera pans left, revealing a tall cylindrical sign for \"The Magic\" with a movie poster, set against a backdrop of palm trees and a white building.\n[420-450s] - A red sports car is parked near a white building with large garage doors, positioned beside a red curb.  \n- A beige Jeep is parked in a designated spot near a green fence, with a black car behind it.  \n- A tall flagpole with an American flag stands near the building, with trees and a clear sky in the background.\n[450-480s] - A train moves past a series of large, vertically oriented posters mounted on a beige corrugated metal fence, featuring images of actors and movie titles like \"Apollo 13\" and \"The Godfather.\"\n- The posters are arranged in a line along the fence, with some showing characters in costume or dramatic poses, and others displaying text such as \"EDDIE MURPHY\" and \"GLADYS ZIL.\"\n- The train's interior is partially visible, with passengers seated and looking out the window, while the exterior environment includes trees, a red curb, and distant buildings under a partly cloudy sky.", "history_tokens": 1021, "history_utf8_bytes": 4248, "recent_frame_times_s": [466.0095, 467.0105, 468.0115, 469.0125, 470.0135, 471.0145, 472.0155, 473.0165, 474.0175, 475.0185, 476.0195, 477.0205, 478.0215, 479.0225, 480.0235, 481.0245, 482.0255, 483.0265, 484.0275, 485.0285, 486.0295, 487.0305, 488.0315, 489.0325, 490.00013333333334, 491.0011333333333, 492.00213333333335, 493.0031333333333, 494.00413333333336, 495.00513333333333], "recent_frames_sha256": "c527c8d013c147cc8c36b89c4afc239ad23751deca6118eb7256c13d8634075e", "num_recent_frames": 30, "tq": 717806.530782014, "t1": 717812.389896759, "ta": 717812.389896759, "te": 717812.576987084, "first_response_s": 5.859114744933322, "answer_total_s": 6.046205069986172, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 314, "content_group": "17fe57658fa4462a97e09abb84e1a47cdea4fd89d62619b1294800d5f6cfa3b1", "question": {"question_id": "sample_314_a841_q0", "video_id": 314, "video_path": "./videos/sample_314_real.mp4", "annotation_index": 841, "question_index": 0, "question": "What color is the vintage car parked right side to the red vehicle under a canopy?", "options": ["A. Blue.", "B. Yellow.", "C. Green.", "D. Black."], "answer": "B", "time_stamp_s": 11, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_314_a841_q0", "video_id": 314, "time_stamp_s": 11, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c6e5631d32b17cdba09a1ba8278950f0fa9c72d39cd2e463954223070facbec2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.055, 1.0226333333333333, 2.023633333333333, 3.0246333333333335, 4.025633333333333, 5.026633333333334, 6.027633333333333, 7.0286333333333335, 8.029633333333333, 9.030633333333334, 10.031633333333334], "recent_frames_sha256": "d2415c2a1a442070445548fbfe3a519d5ec6b9134fe572d9620ebc686deac61e", "num_recent_frames": 11, "tq": 716868.571770072, "t1": 716869.198862648, "ta": 716869.198862648, "te": 716869.238896237, "first_response_s": 0.6270925760036334, "answer_total_s": 0.6671261650044471, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_314_a841_q0", "video_id": 314, "time_stamp_s": 11, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "21f418de5eea15e5991f8b165247312e3645e6ff9063e638fe02255095387bed", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.055, 1.0226333333333333, 2.023633333333333, 3.0246333333333335, 4.025633333333333, 5.026633333333334, 6.027633333333333, 7.0286333333333335, 8.029633333333333, 9.030633333333334, 10.031633333333334], "recent_frames_sha256": "d2415c2a1a442070445548fbfe3a519d5ec6b9134fe572d9620ebc686deac61e", "num_recent_frames": 11, "tq": 716913.002697496, "t1": 716919.982454833, "ta": 716919.982454833, "te": 716920.135742446, "first_response_s": 6.9797573370160535, "answer_total_s": 7.1330449499655515, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 314, "content_group": "17fe57658fa4462a97e09abb84e1a47cdea4fd89d62619b1294800d5f6cfa3b1", "question": {"question_id": "sample_314_a842_q0", "video_id": 314, "video_path": "./videos/sample_314_real.mp4", "annotation_index": 842, "question_index": 0, "question": "What is written on the building with a white facade?", "options": ["A. MERCADO.", "B. LIBRERÍA.", "C. CAFETERÍA.", "D. BANCO."], "answer": "A", "time_stamp_s": 180, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_314_a842_q0", "video_id": 314, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A. MERCADO.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "2bbe038d3ce392a982f43b648eb7a284b77c84f0399caa0873dda103594a929d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.0048, 151.0058, 152.0068, 153.0078, 154.0088, 155.0098, 156.0108, 157.0118, 158.0128, 159.0138, 160.0148, 161.0158, 162.0168, 163.0178, 164.0188, 165.0198, 166.0208, 167.0218, 168.0228, 169.0238, 170.0248, 171.0258, 172.0268, 173.0278, 174.0288, 175.0298, 176.0308, 177.0318, 178.0328, 179.00043333333332], "recent_frames_sha256": "1c35e734402c404dd371564ad6ef0e210560f85cd136f027929663e327a870ea", "num_recent_frames": 30, "tq": 716869.253028144, "t1": 716882.66372491, "ta": 716882.66372491, "te": 716882.886682224, "first_response_s": 13.410696765989996, "answer_total_s": 13.63365407998208, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_314_a842_q0", "video_id": 314, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A. MERCADO.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "347ec35cf0e165091c09c570a09084afdc505d597b3e42edc95365e1b65dd144", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A yellow vintage car is parked on gravel under a canopy, positioned near a large concrete planter.  \n- A row of classic cars, including red, black, and blue models, is displayed in a line under the same canopy, with some cars partially obscured by logs.  \n- The background features a black banner with \"Ferrari\" logos, suggesting a themed automotive display or event.\n[30-60s] - A red convertible car is parked under a canopy, positioned to the left of a light blue vintage car.  \n- A green SUV is parked next to a dark-colored pickup truck, both under the same canopy.  \n- A beige boat on a trailer is parked near a tan military vehicle, with a yellow sign visible nearby.\n[60-90s] - A yellow dome-shaped structure is partially obscured by green foliage and red berries on a bush.  \n- A black mailbox with white lettering is visible near the edge of the frame, positioned beside a tree.  \n- The camera pans right, revealing a dirt path leading toward a green fence and a parked vehicle behind dense vegetation.\n[90-120s] - A green military-style truck with a flatbed is parked near a blue shed, surrounded by barrels and bricks.  \n- A yellow and green trailer with a net draped over it is positioned next to the truck, partially obscured by foliage.  \n- A red metal gate or structure is visible in the background, surrounded by dense greenery and trees.\n[120-150s] - A train with passengers moves along a paved path, passing by a pile of discarded wooden furniture and debris.  \n- The train continues through a landscaped area with cacti and succulents, then approaches a small building with a white roof.  \n- The train’s path curves gently, revealing more greenery and a distant view of hills and a parked vehicle.\n[150-180s] - A small, weathered building with a faded sign reading \"CASA DE LA VIDA\" stands on the left, partially obscured by trees.  \n- A wooden structure with a small roof and a staircase is positioned near the center, surrounded by muddy terrain and scattered rocks.  \n- The ground is uneven and covered in mud, with visible puddles and a stone-lined ditch running along the right side.", "history_tokens": 491, "history_utf8_bytes": 2119, "recent_frame_times_s": [150.0048, 151.0058, 152.0068, 153.0078, 154.0088, 155.0098, 156.0108, 157.0118, 158.0128, 159.0138, 160.0148, 161.0158, 162.0168, 163.0178, 164.0188, 165.0198, 166.0208, 167.0218, 168.0228, 169.0238, 170.0248, 171.0258, 172.0268, 173.0278, 174.0288, 175.0298, 176.0308, 177.0318, 178.0328, 179.00043333333332], "recent_frames_sha256": "1c35e734402c404dd371564ad6ef0e210560f85cd136f027929663e327a870ea", "num_recent_frames": 30, "tq": 716965.364981285, "t1": 716967.030433825, "ta": 716967.030433825, "te": 716967.265067114, "first_response_s": 1.6654525400372222, "answer_total_s": 1.9000858290819451, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 314, "content_group": "17fe57658fa4462a97e09abb84e1a47cdea4fd89d62619b1294800d5f6cfa3b1", "question": {"question_id": "sample_314_a843_q0", "video_id": 314, "video_path": "./videos/sample_314_real.mp4", "annotation_index": 843, "question_index": 0, "question": "What type of building is labeled \"DILLERS BOARDING HOUSE\"?", "options": ["A. A single-story house.", "B. A two-story wooden building.", "C. A warehouse.", "D. A three-story apartment."], "answer": "B", "time_stamp_s": 320, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_314_a843_q0", "video_id": 314, "time_stamp_s": 320, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ae4cb2617f1a47df8aba54259bb461629f43946629edd56e8b93f7b1c39a3bce", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [290.0113333333333, 291.01233333333334, 292.0133333333333, 293.01433333333335, 294.01533333333333, 295.0163333333333, 296.01733333333334, 297.0183333333333, 298.01933333333335, 299.0203333333333, 300.02133333333336, 301.02233333333334, 302.0233333333333, 303.02433333333335, 304.0253333333333, 305.02633333333335, 306.02733333333333, 307.0283333333333, 308.02933333333334, 309.0303333333333, 310.03133333333335, 311.0323333333333, 312.03333333333336, 313.00096666666667, 314.00196666666665, 315.0029666666667, 316.00396666666666, 317.0049666666667, 318.00596666666667, 319.00696666666664], "recent_frames_sha256": "51ed437ef844b15208bbe23fbbb0eee99bcf8b9964d21292342111e22c10889c", "num_recent_frames": 30, "tq": 716882.902871679, "t1": 716892.861659332, "ta": 716892.861659332, "te": 716892.900131825, "first_response_s": 9.958787652896717, "answer_total_s": 9.997260145959444, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_314_a843_q0", "video_id": 314, "time_stamp_s": 320, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "926e122de160c82d6acfc3661e535437fa83780316894d6fab8afe62e1c21212", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A yellow vintage car is parked on gravel under a canopy, positioned near a large concrete planter.  \n- A row of classic cars, including red, black, and blue models, is displayed in a line under the same canopy, with some cars partially obscured by logs.  \n- The background features a black banner with \"Ferrari\" logos, suggesting a themed automotive display or event.\n[30-60s] - A red convertible car is parked under a canopy, positioned to the left of a light blue vintage car.  \n- A green SUV is parked next to a dark-colored pickup truck, both under the same canopy.  \n- A beige boat on a trailer is parked near a tan military vehicle, with a yellow sign visible nearby.\n[60-90s] - A yellow dome-shaped structure is partially obscured by green foliage and red berries on a bush.  \n- A black mailbox with white lettering is visible near the edge of the frame, positioned beside a tree.  \n- The camera pans right, revealing a dirt path leading toward a green fence and a parked vehicle behind dense vegetation.\n[90-120s] - A green military-style truck with a flatbed is parked near a blue shed, surrounded by barrels and bricks.  \n- A yellow and green trailer with a net draped over it is positioned next to the truck, partially obscured by foliage.  \n- A red metal gate or structure is visible in the background, surrounded by dense greenery and trees.\n[120-150s] - A train with passengers moves along a paved path, passing by a pile of discarded wooden furniture and debris.  \n- The train continues through a landscaped area with cacti and succulents, then approaches a small building with a white roof.  \n- The train’s path curves gently, revealing more greenery and a distant view of hills and a parked vehicle.\n[150-180s] - A small, weathered building with a faded sign reading \"CASA DE LA VIDA\" stands on the left, partially obscured by trees.  \n- A wooden structure with a small roof and a staircase is positioned near the center, surrounded by muddy terrain and scattered rocks.  \n- The ground is uneven and covered in mud, with visible puddles and a stone-lined ditch running along the right side.\n[180-210s] - A weathered white building with faded graffiti stands left of center, partially obscured by trees.  \n- A wooden cart with a metal frame sits stationary near a muddy, rocky foreground.  \n- Tall green trees frame the background, with a small structure visible behind the cart.\n[210-240s] - Water surges forcefully from a white building’s opening, creating a turbulent, foamy cascade over a stone-lined channel.  \n- The water flows rapidly past a wooden structure and a concrete embankment, then curves around a bend toward a paved walkway.  \n- A bus is visible on the right side of the frame, stationary near the walkway, as the water continues its path.\n[240-270s] - A stone bridge with flowing water is visible, leading to a building with a sign reading \"ATLAS ZOO\" on its facade.  \n- The camera pans right, revealing a rustic, ivy-covered building with wooden doors and windows, surrounded by desert plants.  \n- The scene transitions to a wider view of a cobblestone street with old-style buildings, including a red wagon parked near a structure with a bell tower.\n[270-300s] - Tour bus interior shows passengers seated, with one person wearing a yellow cap visible in the rear.  \n- Exterior view reveals a row of wooden storefronts with porches and signs like \"SIMON'S MERCANTILE\" and \"OCEAN HOUSE.\"  \n- The bus moves forward along a paved street, passing by buildings with brick facades and wooden balconies under a clear blue sky.", "history_tokens": 834, "history_utf8_bytes": 3569, "recent_frame_times_s": [290.0113333333333, 291.01233333333334, 292.0133333333333, 293.01433333333335, 294.01533333333333, 295.0163333333333, 296.01733333333334, 297.0183333333333, 298.01933333333335, 299.0203333333333, 300.02133333333336, 301.02233333333334, 302.0233333333333, 303.02433333333335, 304.0253333333333, 305.02633333333335, 306.02733333333333, 307.0283333333333, 308.02933333333334, 309.0303333333333, 310.03133333333335, 311.0323333333333, 312.03333333333336, 313.00096666666667, 314.00196666666665, 315.0029666666667, 316.00396666666666, 317.0049666666667, 318.00596666666667, 319.00696666666664], "recent_frames_sha256": "51ed437ef844b15208bbe23fbbb0eee99bcf8b9964d21292342111e22c10889c", "num_recent_frames": 30, "tq": 717002.381569225, "t1": 717008.796485214, "ta": 717008.796485214, "te": 717008.836404277, "first_response_s": 6.414915989036672, "answer_total_s": 6.4548350520199165, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 314, "content_group": "17fe57658fa4462a97e09abb84e1a47cdea4fd89d62619b1294800d5f6cfa3b1", "question": {"question_id": "sample_314_a844_q0", "video_id": 314, "video_path": "./videos/sample_314_real.mp4", "annotation_index": 844, "question_index": 0, "question": "What is the sign reading on the large geometric-shaped buildin right now?", "options": ["A. 25.", "B. 30.", "C. 50.", "D. 75."], "answer": "C", "time_stamp_s": 485, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_314_a844_q0", "video_id": 314, "time_stamp_s": 485, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "01ea8289df0f84a5e8a6663746585277964f548e7074a558240a4eb29e728951", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [455.0095, 456.0105, 457.0115, 458.0125, 459.0135, 460.0145, 461.0155, 462.0165, 463.0175, 464.0185, 465.0195, 466.0205, 467.0215, 468.0225, 469.0235, 470.0245, 471.0255, 472.0265, 473.0275, 474.0285, 475.0295, 476.0305, 477.0315, 478.0325, 479.00013333333334, 480.0011333333333, 481.00213333333335, 482.0031333333333, 483.00413333333336, 484.00513333333333], "recent_frames_sha256": "2db223c0bbe6cbd7e52551e214cb38e045c37dfcdf6c4e6df3d6fff000a28b16", "num_recent_frames": 30, "tq": 716892.912226462, "t1": 716899.924462559, "ta": 716899.924462559, "te": 716899.961414107, "first_response_s": 7.0122360970126465, "answer_total_s": 7.049187644966878, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_314_a844_q0", "video_id": 314, "time_stamp_s": 485, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6f7bcf06a4207b92ff5139b5c57e7c7ddba1b6351b700ebd4c63c456f0c19a5c", "condition_order": ["recent", "notes"], "memory": "[120-150s] - A train with passengers moves along a paved path, passing by a pile of discarded wooden furniture and debris.  \n- The train continues through a landscaped area with cacti and succulents, then approaches a small building with a white roof.  \n- The train’s path curves gently, revealing more greenery and a distant view of hills and a parked vehicle.\n[150-180s] - A small, weathered building with a faded sign reading \"CASA DE LA VIDA\" stands on the left, partially obscured by trees.  \n- A wooden structure with a small roof and a staircase is positioned near the center, surrounded by muddy terrain and scattered rocks.  \n- The ground is uneven and covered in mud, with visible puddles and a stone-lined ditch running along the right side.\n[180-210s] - A weathered white building with faded graffiti stands left of center, partially obscured by trees.  \n- A wooden cart with a metal frame sits stationary near a muddy, rocky foreground.  \n- Tall green trees frame the background, with a small structure visible behind the cart.\n[210-240s] - Water surges forcefully from a white building’s opening, creating a turbulent, foamy cascade over a stone-lined channel.  \n- The water flows rapidly past a wooden structure and a concrete embankment, then curves around a bend toward a paved walkway.  \n- A bus is visible on the right side of the frame, stationary near the walkway, as the water continues its path.\n[240-270s] - A stone bridge with flowing water is visible, leading to a building with a sign reading \"ATLAS ZOO\" on its facade.  \n- The camera pans right, revealing a rustic, ivy-covered building with wooden doors and windows, surrounded by desert plants.  \n- The scene transitions to a wider view of a cobblestone street with old-style buildings, including a red wagon parked near a structure with a bell tower.\n[270-300s] - Tour bus interior shows passengers seated, with one person wearing a yellow cap visible in the rear.  \n- Exterior view reveals a row of wooden storefronts with porches and signs like \"SIMON'S MERCANTILE\" and \"OCEAN HOUSE.\"  \n- The bus moves forward along a paved street, passing by buildings with brick facades and wooden balconies under a clear blue sky.\n[300-330s] - Passengers seated inside a moving bus, with one person in a red plaid shirt visible in the foreground.\n- The bus travels along a narrow street lined with historic brick and wooden buildings, including a \"BOARDING HOUSE\" with a wooden porch.\n- The street scene includes a green-painted building with large windows and a brick building with a balcony, under a clear blue sky.\n[330-360s] - Camera pans right, revealing a large white building with \"330\" signage and palm trees in front.  \n- Road curves left, bordered by green trees and a small wooden structure on the right.  \n- Sky is blue with scattered clouds; shadows cast by trees and buildings are visible on the pavement.\n[360-390s] - Vehicle moves along paved road bordered by dense greenery and trees, passing a bend toward residential area.  \n- A white tour train with passengers appears on the left, stationary near a beige building with dark windows.  \n- Road surface is smooth asphalt; right side shows a metal pole and part of a red patterned object (possibly seat or bag) inside the vehicle.\n[390-420s] - A blue and white tram moves along a cobblestone street, passing by pastel-colored buildings with awnings and shutters.  \n- The camera perspective is from inside the tram, showing the front of the vehicle and the street ahead.  \n- Buildings on the right feature decorative window frames and some have balconies with plants.\n[420-450s] - A cobblestone street curves through a colorful, European-style town with pastel buildings and wrought-iron railings.  \n- A green and white tour bus is parked on the left, while a blue building with a red door and flower boxes stands on the right.  \n- The camera pans right, revealing a wider street intersection with more buildings in varied hues, under a partly cloudy sky.\n[450-480s] - A black utility vehicle with a long extendable boom arm is parked on a dirt area beside a stone building.  \n- The vehicle’s boom arm is extended horizontally, suggesting it is set up for work or display.  \n- A paved road curves around the scene, with trees and other buildings visible in the background.", "history_tokens": 1007, "history_utf8_bytes": 4314, "recent_frame_times_s": [455.0095, 456.0105, 457.0115, 458.0125, 459.0135, 460.0145, 461.0155, 462.0165, 463.0175, 464.0185, 465.0195, 466.0205, 467.0215, 468.0225, 469.0235, 470.0245, 471.0255, 472.0265, 473.0275, 474.0285, 475.0295, 476.0305, 477.0315, 478.0325, 479.00013333333334, 480.0011333333333, 481.00213333333335, 482.0031333333333, 483.00413333333336, 484.00513333333333], "recent_frames_sha256": "2db223c0bbe6cbd7e52551e214cb38e045c37dfcdf6c4e6df3d6fff000a28b16", "num_recent_frames": 30, "tq": 717064.490885583, "t1": 717066.009951477, "ta": 717066.009951477, "te": 717066.048267121, "first_response_s": 1.5190658940700814, "answer_total_s": 1.5573815379757434, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 314, "content_group": "17fe57658fa4462a97e09abb84e1a47cdea4fd89d62619b1294800d5f6cfa3b1", "question": {"question_id": "sample_314_a845_q0", "video_id": 314, "video_path": "./videos/sample_314_real.mp4", "annotation_index": 845, "question_index": 0, "question": "What does the sign with an illustration of a person swimming in blue water indicate?", "options": ["A. \"Pool Open\".", "B. \"No Swimming\".", "C. \"Beach Closed\".", "D. \"Swim at Your Own Risk\"."], "answer": "C", "time_stamp_s": 593, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [540, 596], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_314_a845_q0", "video_id": 314, "time_stamp_s": 593, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b9cee45016efd938021630b8b69ed666374f3c75dafe808e7527d7dd13aa96d3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [563.0174, 564.0184, 565.0194, 566.0204, 567.0214, 568.0224, 569.0234, 570.0244, 571.0254, 572.0264, 573.0274, 574.0284, 575.0294, 576.0304, 577.0314, 578.0324, 579.0000333333334, 580.0010333333333, 581.0020333333333, 582.0030333333333, 583.0040333333334, 584.0050333333334, 585.0060333333333, 586.0070333333333, 587.0080333333333, 588.0090333333334, 589.0100333333334, 590.0110333333333, 591.0120333333333, 592.0130333333333], "recent_frames_sha256": "18ef95cbe0f5ff7c3c0512d812d7056893b8cf4693df3d2b68b3af5eec99d973", "num_recent_frames": 30, "tq": 716899.970137715, "t1": 716912.761676153, "ta": 716912.761676153, "te": 716912.990924321, "first_response_s": 12.791538438061252, "answer_total_s": 13.020786606008187, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_314_a845_q0", "video_id": 314, "time_stamp_s": 593, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d8337d1bec6a67089f82098e8f698e581fd92332a4455422e53489c5b009b42e", "condition_order": ["recent", "notes"], "memory": "[210-240s] - Water surges forcefully from a white building’s opening, creating a turbulent, foamy cascade over a stone-lined channel.  \n- The water flows rapidly past a wooden structure and a concrete embankment, then curves around a bend toward a paved walkway.  \n- A bus is visible on the right side of the frame, stationary near the walkway, as the water continues its path.\n[240-270s] - A stone bridge with flowing water is visible, leading to a building with a sign reading \"ATLAS ZOO\" on its facade.  \n- The camera pans right, revealing a rustic, ivy-covered building with wooden doors and windows, surrounded by desert plants.  \n- The scene transitions to a wider view of a cobblestone street with old-style buildings, including a red wagon parked near a structure with a bell tower.\n[270-300s] - Tour bus interior shows passengers seated, with one person wearing a yellow cap visible in the rear.  \n- Exterior view reveals a row of wooden storefronts with porches and signs like \"SIMON'S MERCANTILE\" and \"OCEAN HOUSE.\"  \n- The bus moves forward along a paved street, passing by buildings with brick facades and wooden balconies under a clear blue sky.\n[300-330s] - Passengers seated inside a moving bus, with one person in a red plaid shirt visible in the foreground.\n- The bus travels along a narrow street lined with historic brick and wooden buildings, including a \"BOARDING HOUSE\" with a wooden porch.\n- The street scene includes a green-painted building with large windows and a brick building with a balcony, under a clear blue sky.\n[330-360s] - Camera pans right, revealing a large white building with \"330\" signage and palm trees in front.  \n- Road curves left, bordered by green trees and a small wooden structure on the right.  \n- Sky is blue with scattered clouds; shadows cast by trees and buildings are visible on the pavement.\n[360-390s] - Vehicle moves along paved road bordered by dense greenery and trees, passing a bend toward residential area.  \n- A white tour train with passengers appears on the left, stationary near a beige building with dark windows.  \n- Road surface is smooth asphalt; right side shows a metal pole and part of a red patterned object (possibly seat or bag) inside the vehicle.\n[390-420s] - A blue and white tram moves along a cobblestone street, passing by pastel-colored buildings with awnings and shutters.  \n- The camera perspective is from inside the tram, showing the front of the vehicle and the street ahead.  \n- Buildings on the right feature decorative window frames and some have balconies with plants.\n[420-450s] - A cobblestone street curves through a colorful, European-style town with pastel buildings and wrought-iron railings.  \n- A green and white tour bus is parked on the left, while a blue building with a red door and flower boxes stands on the right.  \n- The camera pans right, revealing a wider street intersection with more buildings in varied hues, under a partly cloudy sky.\n[450-480s] - A black utility vehicle with a long extendable boom arm is parked on a dirt area beside a stone building.  \n- The vehicle’s boom arm is extended horizontally, suggesting it is set up for work or display.  \n- A paved road curves around the scene, with trees and other buildings visible in the background.\n[480-510s] - A white van is parked near the building's entrance, positioned beside a white truck.  \n- Yellow bollards and a red fire extinguisher are visible on the pavement near the van.  \n- A large white building with a dark lower section dominates the background, with a green fence partially visible to its right.\n[510-540s] - Black barricades with orange bases line a paved area, partially obscuring a large white building in the background.  \n- A blue canopy tent is positioned behind the barricades, with construction materials and wooden frames visible nearby.  \n- Wooden scaffolding structures and metal frames are stacked on pallets to the left, under a clear blue sky.\n[540-570s] - Wooden buildings under construction with exposed frames and weathered siding, some with boarded-up windows.  \n- Blue traffic cones line the unpaved street, indicating a construction or staging area.  \n- A white golf cart passes by, moving from right to left across the frame.", "history_tokens": 983, "history_utf8_bytes": 4240, "recent_frame_times_s": [563.0174, 564.0184, 565.0194, 566.0204, 567.0214, 568.0224, 569.0234, 570.0244, 571.0254, 572.0264, 573.0274, 574.0284, 575.0294, 576.0304, 577.0314, 578.0324, 579.0000333333334, 580.0010333333333, 581.0020333333333, 582.0030333333333, 583.0040333333334, 584.0050333333334, 585.0060333333333, 586.0070333333333, 587.0080333333333, 588.0090333333334, 589.0100333333334, 590.0110333333333, 591.0120333333333, 592.0130333333333], "recent_frames_sha256": "18ef95cbe0f5ff7c3c0512d812d7056893b8cf4693df3d2b68b3af5eec99d973", "num_recent_frames": 30, "tq": 717095.502286158, "t1": 717103.568390434, "ta": 717103.568390434, "te": 717103.720781551, "first_response_s": 8.066104275989346, "answer_total_s": 8.218495392939076, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 315, "content_group": "64ba319d431e0ff64e1acae7124bdad475435534240e3381e71037d0b8831341", "question": {"question_id": "sample_315_a1874_q0", "video_id": 315, "video_path": "./videos/sample_315_real.mp4", "annotation_index": 1874, "question_index": 0, "question": "What sign is visible on the rightmost building in the video?", "options": ["A. \"No Fishing\".", "B. \"No Boats\".", "C. \"No Swimming\".", "D. \"No Parking\"."], "answer": "C", "time_stamp_s": 20, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_315_a1874_q0", "video_id": 315, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b52404cb782ff806301ed508ce614c0a0dd287cca0f673857cf5706e95ec9187", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.046, 1.0136333333333334, 2.0146333333333333, 3.015633333333333, 4.016633333333333, 5.017633333333333, 6.018633333333334, 7.019633333333333, 8.020633333333333, 9.021633333333334, 10.022633333333333, 11.023633333333333, 12.024633333333334, 13.025633333333333, 14.026633333333333, 15.027633333333334, 16.02863333333333, 17.029633333333333, 18.030633333333334, 19.031633333333332], "recent_frames_sha256": "73a2a2802b523c6b5cce36c9d15503c79b2df24939e105d10c154e2a76b08529", "num_recent_frames": 20, "tq": 716182.733615227, "t1": 716188.839733877, "ta": 716188.839733877, "te": 716188.877076798, "first_response_s": 6.1061186499428, "answer_total_s": 6.143461570958607, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_315_a1874_q0", "video_id": 315, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a0d4d93371d27c5102a6ac472415cedc8d385f30eda7c7a55ca3a6898f1f44c3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.046, 1.0136333333333334, 2.0146333333333333, 3.015633333333333, 4.016633333333333, 5.017633333333333, 6.018633333333334, 7.019633333333333, 8.020633333333333, 9.021633333333334, 10.022633333333333, 11.023633333333333, 12.024633333333334, 13.025633333333333, 14.026633333333333, 15.027633333333334, 16.02863333333333, 17.029633333333333, 18.030633333333334, 19.031633333333332], "recent_frames_sha256": "73a2a2802b523c6b5cce36c9d15503c79b2df24939e105d10c154e2a76b08529", "num_recent_frames": 20, "tq": 715989.270400079, "t1": 716001.858740793, "ta": 716001.858740793, "te": 716001.898709892, "first_response_s": 12.588340713991784, "answer_total_s": 12.628309812978841, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 315, "content_group": "64ba319d431e0ff64e1acae7124bdad475435534240e3381e71037d0b8831341", "question": {"question_id": "sample_315_a1874_q1", "video_id": 315, "video_path": "./videos/sample_315_real.mp4", "annotation_index": 1874, "question_index": 1, "question": "What has the video primarily captured so far?", "options": ["A. A bustling harbor with many boats arriving and departing.", "B. A serene waterfront scene with calm water and minimal movement.", "C. A stormy sea with waves crashing into the docks.", "D. A busy marketplace with people shopping and trading."], "answer": "B", "time_stamp_s": 20, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_315_a1874_q1", "video_id": 315, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ce4aba52ccf7b003b68ac8802b838d2bb68cc981655506d2a0c93dd8eb136885", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.046, 1.0136333333333334, 2.0146333333333333, 3.015633333333333, 4.016633333333333, 5.017633333333333, 6.018633333333334, 7.019633333333333, 8.020633333333333, 9.021633333333334, 10.022633333333333, 11.023633333333333, 12.024633333333334, 13.025633333333333, 14.026633333333333, 15.027633333333334, 16.02863333333333, 17.029633333333333, 18.030633333333334, 19.031633333333332], "recent_frames_sha256": "73a2a2802b523c6b5cce36c9d15503c79b2df24939e105d10c154e2a76b08529", "num_recent_frames": 20, "tq": 716188.900224575, "t1": 716199.707385751, "ta": 716199.707385751, "te": 716199.744447853, "first_response_s": 10.807161175995134, "answer_total_s": 10.844223277992569, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_315_a1874_q1", "video_id": 315, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3d06c632234cf71983fc527cbd9b00266a0fc3300be4b036352c1881b68dfb7c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.046, 1.0136333333333334, 2.0146333333333333, 3.015633333333333, 4.016633333333333, 5.017633333333333, 6.018633333333334, 7.019633333333333, 8.020633333333333, 9.021633333333334, 10.022633333333333, 11.023633333333333, 12.024633333333334, 13.025633333333333, 14.026633333333333, 15.027633333333334, 16.02863333333333, 17.029633333333333, 18.030633333333334, 19.031633333333332], "recent_frames_sha256": "73a2a2802b523c6b5cce36c9d15503c79b2df24939e105d10c154e2a76b08529", "num_recent_frames": 20, "tq": 716001.930013918, "t1": 716007.781769109, "ta": 716007.781769109, "te": 716007.819714131, "first_response_s": 5.851755190989934, "answer_total_s": 5.889700212981552, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 315, "content_group": "64ba319d431e0ff64e1acae7124bdad475435534240e3381e71037d0b8831341", "question": {"question_id": "sample_315_a1875_q0", "video_id": 315, "video_path": "./videos/sample_315_real.mp4", "annotation_index": 1875, "question_index": 0, "question": "What color is the tram ceiling?", "options": ["A. Blue.", "B. White.", "C. Grey.", "D. Black."], "answer": "B", "time_stamp_s": 175, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_315_a1875_q0", "video_id": 315, "time_stamp_s": 175, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "656da507cd56ab85bb1580c070ce282dda036eb763004d072b242174f6cf8f55", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [145.02416666666667, 146.02516666666668, 147.02616666666665, 148.02716666666666, 149.02816666666666, 150.02916666666667, 151.03016666666667, 152.03116666666668, 153.03216666666665, 154.03316666666666, 155.0008, 156.0018, 157.0028, 158.0038, 159.0048, 160.0058, 161.0068, 162.0078, 163.0088, 164.0098, 165.0108, 166.0118, 167.0128, 168.0138, 169.0148, 170.0158, 171.0168, 172.0178, 173.0188, 174.0198], "recent_frames_sha256": "bd1dfdc8c3618b9e7dc1b059f91b257ee9941e7a7c05ffaa1f48653b62e28fbc", "num_recent_frames": 30, "tq": 716199.76265751, "t1": 716207.413469216, "ta": 716207.413469216, "te": 716207.450836338, "first_response_s": 7.650811705971137, "answer_total_s": 7.688178827986121, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_315_a1875_q0", "video_id": 315, "time_stamp_s": 175, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8a95c6634fd0a74b9e9ed9bccccf20d303a79700de6723a1dadff3fc2e574f12", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Calm water reflects surrounding buildings and trees, with boats moored along the edges.  \n- A wooden walkway with chains runs along the foreground, leading toward the water.  \n- Small structures and docks line the water’s edge, with some boats stationary and others slightly moving.\n[30-60s] - A red and blue boat is docked near the left edge of the frame, stationary in calm water.  \n- A wooden pier extends from the right, with a white cylindrical structure and red equipment mounted on it.  \n- A sudden burst of orange flames erupts from the water near the center, indicating an unexpected event.\n[60-90s] - Fire erupts from structures on the dock, with flames and smoke rising into the air.  \n- A large shark emerges from the water, moving toward the dock and creating splashes.  \n- The water surface reflects the burning structures and the shark’s movement, indicating a dynamic scene.\n[90-120s] - A white boat with red seats is docked along the yellow-painted curb near the water's edge.  \n- A green tour bus with \"DISNEY\" branding is parked on the paved path, facing away from the water.  \n- The camera pans right, revealing a calm waterway bordered by trees and buildings, with a small wooden pier extending into the water.\n[120-150s] - Passengers seated on a bus, facing forward, with some wearing backpacks and casual attire.\n- Bus interior features overhead displays showing route information and advertisements along the ceiling.\n- Exterior view through windows shows a rural landscape with trees and a road, indicating movement along a scenic route.", "history_tokens": 355, "history_utf8_bytes": 1576, "recent_frame_times_s": [145.02416666666667, 146.02516666666668, 147.02616666666665, 148.02716666666666, 149.02816666666666, 150.02916666666667, 151.03016666666667, 152.03116666666668, 153.03216666666665, 154.03316666666666, 155.0008, 156.0018, 157.0028, 158.0038, 159.0048, 160.0058, 161.0068, 162.0078, 163.0088, 164.0098, 165.0108, 166.0118, 167.0128, 168.0138, 169.0148, 170.0158, 171.0168, 172.0178, 173.0188, 174.0198], "recent_frames_sha256": "bd1dfdc8c3618b9e7dc1b059f91b257ee9941e7a7c05ffaa1f48653b62e28fbc", "num_recent_frames": 30, "tq": 716049.861122351, "t1": 716058.064578825, "ta": 716058.064578825, "te": 716058.106075859, "first_response_s": 8.20345647400245, "answer_total_s": 8.244953508023173, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 315, "content_group": "64ba319d431e0ff64e1acae7124bdad475435534240e3381e71037d0b8831341", "question": {"question_id": "sample_315_a1876_q0", "video_id": 315, "video_path": "./videos/sample_315_real.mp4", "annotation_index": 1876, "question_index": 0, "question": "What type of windows does the blue building have?", "options": ["A. Metal-framed windows.", "B. No windows.", "C. White-framed windows.", "D. Wooden-framed windows."], "answer": "C", "time_stamp_s": 326, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_315_a1876_q0", "video_id": 315, "time_stamp_s": 326, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "156e0dafa1023ffd766255841701613aaa71693014c7628867f0ac09b7d67f8c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [296.0083333333333, 297.00933333333336, 298.01033333333334, 299.0113333333333, 300.01233333333334, 301.0133333333333, 302.01433333333335, 303.01533333333333, 304.0163333333333, 305.01733333333334, 306.0183333333333, 307.01933333333335, 308.0203333333333, 309.02133333333336, 310.02233333333334, 311.0233333333333, 312.02433333333335, 313.0253333333333, 314.02633333333335, 315.02733333333333, 316.0283333333333, 317.02933333333334, 318.0303333333333, 319.03133333333335, 320.0323333333333, 321.03333333333336, 322.00096666666667, 323.00196666666665, 324.0029666666667, 325.00396666666666], "recent_frames_sha256": "923fefc662c998fd9d0540b65c97ec1fa3bb51bfb391ee8bc197b9c2ccb96b74", "num_recent_frames": 30, "tq": 716207.469225675, "t1": 716214.893809049, "ta": 716214.893809049, "te": 716214.931446692, "first_response_s": 7.424583374056965, "answer_total_s": 7.462221016990952, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_315_a1876_q0", "video_id": 315, "time_stamp_s": 326, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "978481c8315e2bb0dba3c2516fe437cbe33233d50730927dc3e35a5b323ad5ca", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Calm water reflects surrounding buildings and trees, with boats moored along the edges.  \n- A wooden walkway with chains runs along the foreground, leading toward the water.  \n- Small structures and docks line the water’s edge, with some boats stationary and others slightly moving.\n[30-60s] - A red and blue boat is docked near the left edge of the frame, stationary in calm water.  \n- A wooden pier extends from the right, with a white cylindrical structure and red equipment mounted on it.  \n- A sudden burst of orange flames erupts from the water near the center, indicating an unexpected event.\n[60-90s] - Fire erupts from structures on the dock, with flames and smoke rising into the air.  \n- A large shark emerges from the water, moving toward the dock and creating splashes.  \n- The water surface reflects the burning structures and the shark’s movement, indicating a dynamic scene.\n[90-120s] - A white boat with red seats is docked along the yellow-painted curb near the water's edge.  \n- A green tour bus with \"DISNEY\" branding is parked on the paved path, facing away from the water.  \n- The camera pans right, revealing a calm waterway bordered by trees and buildings, with a small wooden pier extending into the water.\n[120-150s] - Passengers seated on a bus, facing forward, with some wearing backpacks and casual attire.\n- Bus interior features overhead displays showing route information and advertisements along the ceiling.\n- Exterior view through windows shows a rural landscape with trees and a road, indicating movement along a scenic route.\n[150-180s] - Passengers seated facing forward, some with backpacks, as bus moves along a tree-lined road.\n- A green exit sign is visible on the bus’s interior ceiling.\n- Exterior view shows a grassy hillside with trees and a house on the right side of the road.\n[180-210s] - A white house with a dark roof and porch is visible on the right side of the road, with trees and greenery around it.  \n- The camera moves forward along a paved road, passing by a grassy area with rocks and a tree.  \n- A small wooden structure, possibly a shed or playhouse, is seen on the right side of the road, near the white house.\n[210-240s] - A tour bus moves along a residential street, passing houses with varied architectural styles and well-maintained lawns.  \n- A woman with curly hair, wearing a purple top, is visible on the bus’s left side, looking out the window.  \n- The street curves gently, revealing a row of blue-painted houses with white trim and green lawns, bordered by sidewalks and trees.\n[240-270s] - A blue car is parked in front of a gray house with a white porch.  \n- The camera pans left, revealing a white fence and green trees lining the street.  \n- A yellow house with a green roof appears on the right, followed by a brown fence and grassy area.\n[270-300s] - A green trash bin is parked on the sidewalk, positioned near a residential street lined with trees and houses.  \n- The camera pans right, revealing a row of single-family homes with varied architectural styles and well-maintained lawns.  \n- A white bus is visible on the left side of the road, parked or moving slowly along the street.", "history_tokens": 752, "history_utf8_bytes": 3184, "recent_frame_times_s": [296.0083333333333, 297.00933333333336, 298.01033333333334, 299.0113333333333, 300.01233333333334, 301.0133333333333, 302.01433333333335, 303.01533333333333, 304.0163333333333, 305.01733333333334, 306.0183333333333, 307.01933333333335, 308.0203333333333, 309.02133333333336, 310.02233333333334, 311.0233333333333, 312.02433333333335, 313.0253333333333, 314.02633333333335, 315.02733333333333, 316.0283333333333, 317.02933333333334, 318.0303333333333, 319.03133333333335, 320.0323333333333, 321.03333333333336, 322.00096666666667, 323.00196666666665, 324.0029666666667, 325.00396666666666], "recent_frames_sha256": "923fefc662c998fd9d0540b65c97ec1fa3bb51bfb391ee8bc197b9c2ccb96b74", "num_recent_frames": 30, "tq": 716100.403382248, "t1": 716108.803631728, "ta": 716108.803631728, "te": 716108.844322858, "first_response_s": 8.400249480037019, "answer_total_s": 8.440940610016696, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 315, "content_group": "64ba319d431e0ff64e1acae7124bdad475435534240e3381e71037d0b8831341", "question": {"question_id": "sample_315_a1877_q0", "video_id": 315, "video_path": "./videos/sample_315_real.mp4", "annotation_index": 1877, "question_index": 0, "question": "What word is prominently displayed on the facade of the old-west-style building right now?", "options": ["A. \"Tickets\".", "B. \"Rides\".", "C. \"Games\".", "D. \"Food\"."], "answer": "A", "time_stamp_s": 583, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [540, 596], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_315_a1877_q0", "video_id": 315, "time_stamp_s": 583, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c3c6635c04fd6bc4d3f545688249908b52fa7ac6e4ac700b40c4599df9cc0093", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [553.0317666666666, 554.0327666666667, 555.0004, 556.0014, 557.0024, 558.0034, 559.0044, 560.0054, 561.0064, 562.0074, 563.0084, 564.0094, 565.0104, 566.0114, 567.0124, 568.0134, 569.0144, 570.0154, 571.0164, 572.0174, 573.0184, 574.0194, 575.0204, 576.0214, 577.0224, 578.0234, 579.0244, 580.0254, 581.0264, 582.0274], "recent_frames_sha256": "3eb871f86432c4507e65033540d0bca011aa0be5f41fa89be895ba3d84a76897", "num_recent_frames": 30, "tq": 716214.959347875, "t1": 716221.989902681, "ta": 716221.989902681, "te": 716222.026801351, "first_response_s": 7.03055480599869, "answer_total_s": 7.067453476018272, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_315_a1877_q0", "video_id": 315, "time_stamp_s": 583, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "493ae51be35cde7f4c4e39c17e89039b8b32c73105974e0a43939463eb5dde6c", "condition_order": ["notes", "recent"], "memory": "[180-210s] - A white house with a dark roof and porch is visible on the right side of the road, with trees and greenery around it.  \n- The camera moves forward along a paved road, passing by a grassy area with rocks and a tree.  \n- A small wooden structure, possibly a shed or playhouse, is seen on the right side of the road, near the white house.\n[210-240s] - A tour bus moves along a residential street, passing houses with varied architectural styles and well-maintained lawns.  \n- A woman with curly hair, wearing a purple top, is visible on the bus’s left side, looking out the window.  \n- The street curves gently, revealing a row of blue-painted houses with white trim and green lawns, bordered by sidewalks and trees.\n[240-270s] - A blue car is parked in front of a gray house with a white porch.  \n- The camera pans left, revealing a white fence and green trees lining the street.  \n- A yellow house with a green roof appears on the right, followed by a brown fence and grassy area.\n[270-300s] - A green trash bin is parked on the sidewalk, positioned near a residential street lined with trees and houses.  \n- The camera pans right, revealing a row of single-family homes with varied architectural styles and well-maintained lawns.  \n- A white bus is visible on the left side of the road, parked or moving slowly along the street.\n[300-330s] - A light blue two-story house with white trim and a porch is visible, featuring an American flag on its front lawn.  \n- A white ladder leans against the house’s side, suggesting recent or ongoing maintenance.  \n- A white van is parked on the street near the house, partially visible on the left side of the frame.\n[330-360s] - A \"NO ENTRY\" sign is visible near a grassy slope with trees, indicating restricted access.  \n- A green construction fence with duck-themed graphics runs along the roadside, separating the area from the road.  \n- The vehicle moves past utility boxes and poles, suggesting an infrastructure or construction zone.\n[360-390s] - Green mesh fence with cut-out whale shapes runs along a paved road, supported by orange traffic cones.  \n- A white bus with passengers is parked on the left side of the road, near a building with a green roof.  \n- The camera pans right, revealing a beige building with a sloped roof and a green gate at its end.\n[390-420s] - A white sedan is parked in a lot near a row of wooden buildings with orange-painted trim.  \n- The camera pans left, revealing a grassy hill with trees and a road curving around it.  \n- A large metal gate with a grated bottom is visible at the edge of the paved area.\n[420-450s] - A two-story wooden house with a porch and decorative trim stands near a paved path, partially obscured by trees and a wooden fence.  \n- A tour tram passes by the house, moving along the path, with passengers visible inside.  \n- A large pile of wrecked vehicles and debris, including cars and trailers, lies behind a chain-link fence, with smoke rising from some wreckage.\n[450-480s] - A large, partially collapsed blue structure lies amidst scattered debris, with a chain-link fence in the foreground.  \n- A white house with a damaged roof and broken windows is surrounded by fallen furniture and construction materials.  \n- A blue car is parked near the house, partially obscured by debris and surrounded by scattered items.\n[480-510s] - A house with beige siding and a brown roof is visibly damaged, with debris scattered across its lawn and sidewalk.  \n- Trees and a wooden fence are visible in the background, partially obscured by the debris.  \n- The scene is viewed from inside a moving vehicle, with the camera capturing the destruction as it passes by.\n[510-540s] - A two-story house with beige siding and white trim shows severe structural damage, including collapsed sections and exposed interiors.  \n- Debris, including broken furniture and scattered materials, is strewn across the lawn and sidewalk.  \n- Two rusted, burnt-out cars are parked on the street adjacent to the damaged house, with one partially crushed and the other showing significant fire damage.\n[540-570s] - A white van drives past a landscaped area with a large green hat sculpture.  \n- A paved road curves around a grassy mound with orange traffic cones and a tree.  \n- A tour bus with passengers enters the frame from the left, approaching a building with a yellow roof.", "history_tokens": 1022, "history_utf8_bytes": 4366, "recent_frame_times_s": [553.0317666666666, 554.0327666666667, 555.0004, 556.0014, 557.0024, 558.0034, 559.0044, 560.0054, 561.0064, 562.0074, 563.0084, 564.0094, 565.0104, 566.0114, 567.0124, 568.0134, 569.0144, 570.0154, 571.0164, 572.0174, 573.0184, 574.0194, 575.0204, 576.0214, 577.0224, 578.0234, 579.0244, 580.0254, 581.0264, 582.0274], "recent_frames_sha256": "3eb871f86432c4507e65033540d0bca011aa0be5f41fa89be895ba3d84a76897", "num_recent_frames": 30, "tq": 716181.054510478, "t1": 716182.548078556, "ta": 716182.548078556, "te": 716182.698342072, "first_response_s": 1.4935680779162794, "answer_total_s": 1.6438315939158201, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 317, "content_group": "812d9a610d0faf75bf7a50e06a829d7283ab059e6251fb7103cd4f1b3ef2c640", "question": {"question_id": "sample_317_a1914_q0", "video_id": 317, "video_path": "./videos/sample_317_real.mp4", "annotation_index": 1914, "question_index": 0, "question": "What color are the tops of the booths around the plaza?", "options": ["A. Red.", "B. Blue.", "C. Green.", "D. Yellow."], "answer": "B", "time_stamp_s": 2, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_317_a1914_q0", "video_id": 317, "time_stamp_s": 2, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "22da2aab8db175b226a0cf39e29368fb64974329cf2f9983b5e0dbb34104eb7c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.042, 1.0096333333333334], "recent_frames_sha256": "2700fe577d5f42f266c0729aa15ffed831c736969355c47b44ab4579f58b15fb", "num_recent_frames": 2, "tq": 716296.459132834, "t1": 716302.302538897, "ta": 716302.302538897, "te": 716302.339993312, "first_response_s": 5.843406063038856, "answer_total_s": 5.880860478035174, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_317_a1914_q0", "video_id": 317, "time_stamp_s": 2, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "36fd8fc46b14f7e57303c857fed7163c1123d2e33d43de00fe48140c4db68ef8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.042, 1.0096333333333334], "recent_frames_sha256": "2700fe577d5f42f266c0729aa15ffed831c736969355c47b44ab4579f58b15fb", "num_recent_frames": 2, "tq": 716344.580082903, "t1": 716357.431066829, "ta": 716357.431066829, "te": 716357.623203632, "first_response_s": 12.850983925978653, "answer_total_s": 13.043120728922077, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 317, "content_group": "812d9a610d0faf75bf7a50e06a829d7283ab059e6251fb7103cd4f1b3ef2c640", "question": {"question_id": "sample_317_a1914_q1", "video_id": 317, "video_path": "./videos/sample_317_real.mp4", "annotation_index": 1914, "question_index": 1, "question": "What does the mural depict?", "options": ["A. A large beige building.", "B. Palm trees and blue-topped booths.", "C. A multi-car tram.", "D. A famous Hollywood sign and surrounding landscape."], "answer": "D", "time_stamp_s": 13, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_317_a1914_q1", "video_id": 317, "time_stamp_s": 13, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e834242369e07064d2f1fac19b754d0d113a9bc87e0ca9d8c823889b68e9ec21", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.042, 1.0096333333333334, 2.0106333333333333, 3.011633333333333, 4.0126333333333335, 5.013633333333333, 6.014633333333333, 7.015633333333334, 8.016633333333333, 9.017633333333333, 10.018633333333334, 11.019633333333333, 12.020633333333333], "recent_frames_sha256": "aaa97925f05ce50d0278e38c3a5430275e0af9daefd70330778acd60ff2b1ebb", "num_recent_frames": 13, "tq": 716302.362933516, "t1": 716313.671154489, "ta": 716313.671154489, "te": 716313.708688021, "first_response_s": 11.308220973005518, "answer_total_s": 11.345754505018704, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_317_a1914_q1", "video_id": 317, "time_stamp_s": 13, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "616d8a16a18c09df254223dc2514f0ded445d6d4e1c962e82acf22930ba4d3ab", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.042, 1.0096333333333334, 2.0106333333333333, 3.011633333333333, 4.0126333333333335, 5.013633333333333, 6.014633333333333, 7.015633333333334, 8.016633333333333, 9.017633333333333, 10.018633333333334, 11.019633333333333, 12.020633333333333], "recent_frames_sha256": "aaa97925f05ce50d0278e38c3a5430275e0af9daefd70330778acd60ff2b1ebb", "num_recent_frames": 13, "tq": 716357.632953508, "t1": 716369.226643196, "ta": 716369.226643196, "te": 716369.268492929, "first_response_s": 11.59368968801573, "answer_total_s": 11.635539421113208, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 317, "content_group": "812d9a610d0faf75bf7a50e06a829d7283ab059e6251fb7103cd4f1b3ef2c640", "question": {"question_id": "sample_317_a1915_q0", "video_id": 317, "video_path": "./videos/sample_317_real.mp4", "annotation_index": 1915, "question_index": 0, "question": "What is indicated by the \"Lower Lot\" sign seen in the background?", "options": ["A. The name of a ride.", "B. The name of the area.", "C. The name of a restaurant.", "D. The name of a shop."], "answer": "B", "time_stamp_s": 147, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_317_a1915_q0", "video_id": 317, "time_stamp_s": 147, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f4089df8104745c2e93f3efe029a112e33a6ea3c3cbae5b040f3658803edd89a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [117.02553333333333, 118.02653333333333, 119.02753333333334, 120.02853333333333, 121.02953333333333, 122.03053333333334, 123.03153333333333, 124.03253333333333, 125.00016666666667, 126.00116666666666, 127.00216666666667, 128.00316666666666, 129.00416666666666, 130.00516666666667, 131.00616666666667, 132.00716666666668, 133.00816666666665, 134.00916666666666, 135.01016666666666, 136.01116666666667, 137.01216666666667, 138.01316666666668, 139.01416666666665, 140.01516666666666, 141.01616666666666, 142.01716666666667, 143.01816666666667, 144.01916666666668, 145.02016666666665, 146.02116666666666], "recent_frames_sha256": "3f8eb89521bc046f8e526fabbe4f0eeee45b1848c11e74adc103a11a43e449e0", "num_recent_frames": 30, "tq": 716313.732552714, "t1": 716321.129359339, "ta": 716321.129359339, "te": 716321.166591904, "first_response_s": 7.396806625067256, "answer_total_s": 7.434039190062322, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_317_a1915_q0", "video_id": 317, "time_stamp_s": 147, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "26f51391cffdd40858dee0d657f06c28ac896c9790b4eff52bde66922086e27c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A large \"HOLLYWOOD\" sign mural is visible on a wall, with palm trees and a green highway sign below it.  \n- People walk along a paved pathway under a blue canopy, passing by colorful, themed structures and banners.  \n- The camera pans to show a wide, sloped road with a tree-lined view of a cityscape and buildings in the distance.\n[30-60s] - A man in a blue shirt walks alongside a child in a blue shirt, both moving forward on a paved path.  \n- Palm trees line the path, with banners for \"Universal Studios\" visible on poles.  \n- The group approaches a plaza area with more people, benches, and trees, under a partly cloudy sky.\n[60-90s] - A crowd of people walks along a paved street lined with trees and buildings, moving toward a storefront with a \"STILL DISCO\" sign.  \n- A blue trash bin and a water fountain are visible near a beige building with a \"STUDIOS\" sign, where a person in a white shirt walks past.  \n- A large banner with \"STUDIOS\" text hangs above the entrance, and a signboard displays \"STUDIOS\" with a list of names or titles below it.\n[90-120s] - A yellow \"Kwik-E-Mart\" storefront with a \"Jack-Pot\" sign is visible on the right, with people walking past it.  \n- A large, colorful \"Scooby-Doo\" themed ride structure is prominent in the background, with crowds moving toward it.  \n- A blue trash bin and a small cart are positioned near the Kwik-E-Mart entrance, with people passing by.", "history_tokens": 361, "history_utf8_bytes": 1416, "recent_frame_times_s": [117.02553333333333, 118.02653333333333, 119.02753333333334, 120.02853333333333, 121.02953333333333, 122.03053333333334, 123.03153333333333, 124.03253333333333, 125.00016666666667, 126.00116666666666, 127.00216666666667, 128.00316666666666, 129.00416666666666, 130.00516666666667, 131.00616666666667, 132.00716666666668, 133.00816666666665, 134.00916666666666, 135.01016666666666, 136.01116666666667, 137.01216666666667, 138.01316666666668, 139.01416666666665, 140.01516666666666, 141.01616666666666, 142.01716666666667, 143.01816666666667, 144.01916666666668, 145.02016666666665, 146.02116666666666], "recent_frames_sha256": "3f8eb89521bc046f8e526fabbe4f0eeee45b1848c11e74adc103a11a43e449e0", "num_recent_frames": 30, "tq": 716400.978330121, "t1": 716407.998515499, "ta": 716407.998515499, "te": 716408.203395126, "first_response_s": 7.020185378030874, "answer_total_s": 7.225065005011857, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 317, "content_group": "812d9a610d0faf75bf7a50e06a829d7283ab059e6251fb7103cd4f1b3ef2c640", "question": {"question_id": "sample_317_a1916_q0", "video_id": 317, "video_path": "./videos/sample_317_real.mp4", "annotation_index": 1916, "question_index": 0, "question": "What is the relative position of the potted plant in the video right now?", "options": ["A. In the center of the screen.", "B. In the upper left corner.", "C. In the lower right side.", "D. In the bottom center."], "answer": "C", "time_stamp_s": 283, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_317_a1916_q0", "video_id": 317, "time_stamp_s": 283, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "948c719a88c0de246d66a2166584ce9bf360ef4b98bb82e9a70116578163e3e3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [253.02806666666666, 254.02906666666667, 255.03006666666667, 256.0310666666667, 257.03206666666665, 258.0330666666667, 259.0007, 260.0017, 261.0027, 262.0037, 263.0047, 264.0057, 265.0067, 266.0077, 267.0087, 268.0097, 269.0107, 270.0117, 271.0127, 272.0137, 273.0147, 274.0157, 275.0167, 276.0177, 277.0187, 278.0197, 279.0207, 280.0217, 281.0227, 282.0237], "recent_frames_sha256": "f59305ba86222cc627c787f7ff4b0d501cae16379d2d4554ea84e303d662f651", "num_recent_frames": 30, "tq": 716321.180891939, "t1": 716332.171141247, "ta": 716332.171141247, "te": 716332.209396431, "first_response_s": 10.990249308058992, "answer_total_s": 11.02850449201651, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_317_a1916_q0", "video_id": 317, "time_stamp_s": 283, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9efe9e9120199e59bdaf30f35e4e38cd418c696a37a72b1189edf53c0b336fd4", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A large \"HOLLYWOOD\" sign mural is visible on a wall, with palm trees and a green highway sign below it.  \n- People walk along a paved pathway under a blue canopy, passing by colorful, themed structures and banners.  \n- The camera pans to show a wide, sloped road with a tree-lined view of a cityscape and buildings in the distance.\n[30-60s] - A man in a blue shirt walks alongside a child in a blue shirt, both moving forward on a paved path.  \n- Palm trees line the path, with banners for \"Universal Studios\" visible on poles.  \n- The group approaches a plaza area with more people, benches, and trees, under a partly cloudy sky.\n[60-90s] - A crowd of people walks along a paved street lined with trees and buildings, moving toward a storefront with a \"STILL DISCO\" sign.  \n- A blue trash bin and a water fountain are visible near a beige building with a \"STUDIOS\" sign, where a person in a white shirt walks past.  \n- A large banner with \"STUDIOS\" text hangs above the entrance, and a signboard displays \"STUDIOS\" with a list of names or titles below it.\n[90-120s] - A yellow \"Kwik-E-Mart\" storefront with a \"Jack-Pot\" sign is visible on the right, with people walking past it.  \n- A large, colorful \"Scooby-Doo\" themed ride structure is prominent in the background, with crowds moving toward it.  \n- A blue trash bin and a small cart are positioned near the Kwik-E-Mart entrance, with people passing by.\n[120-150s] - \"Sesame Street\" and \"Bugs Bunny\" themed structures are visible in the background, with a large clown head sculpture prominently displayed.  \n- A \"Lower Los Angeles\" archway is seen in the distance, with people walking toward it.  \n- A food vendor with a red umbrella is positioned on the right side of the frame, near the archway.\n[150-180s] - A glass-domed structure with curved roof and red umbrellas is centrally located, surrounded by pedestrians.  \n- People are seen walking along a paved pathway with railings, some seated on benches near potted plants.  \n- The sky above is partly cloudy, with distant hills and cityscape visible in the background.\n[180-210s] - A man in a black shirt rides an escalator upward, moving away from the camera.  \n- The escalator is enclosed by a transparent glass roof and metal framework, with a view of a suburban landscape below.  \n- A blue banner with white text is visible on the right side of the frame, partially obscured by trees.\n[210-240s] - A person in a wheelchair ascends a moving walkway, moving upward toward a higher level.  \n- The walkway is enclosed by a glass and metal structure, with other pedestrians visible on adjacent paths.  \n- The surrounding environment includes greenery and urban infrastructure, such as roads and parked vehicles, visible through the transparent roof.\n[240-270s] - A man in a black shirt pushes a stroller down a moving walkway, moving away from the camera.  \n- A large informational sign labeled \"SCENIC VIEW\" is mounted on a railing, displaying a cityscape image.  \n- The camera pans to reveal a panoramic view of a city with mountains in the distance, including a prominent building with two towers.", "history_tokens": 760, "history_utf8_bytes": 3116, "recent_frame_times_s": [253.02806666666666, 254.02906666666667, 255.03006666666667, 256.0310666666667, 257.03206666666665, 258.0330666666667, 259.0007, 260.0017, 261.0027, 262.0037, 263.0047, 264.0057, 265.0067, 266.0077, 267.0087, 268.0097, 269.0107, 270.0117, 271.0127, 272.0137, 273.0147, 274.0157, 275.0167, 276.0177, 277.0187, 278.0197, 279.0207, 280.0217, 281.0227, 282.0237], "recent_frames_sha256": "f59305ba86222cc627c787f7ff4b0d501cae16379d2d4554ea84e303d662f651", "num_recent_frames": 30, "tq": 716447.073359305, "t1": 716448.797322794, "ta": 716448.797322794, "te": 716448.998387333, "first_response_s": 1.7239634889410809, "answer_total_s": 1.9250280279666185, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 317, "content_group": "812d9a610d0faf75bf7a50e06a829d7283ab059e6251fb7103cd4f1b3ef2c640", "question": {"question_id": "sample_317_a1917_q0", "video_id": 317, "video_path": "./videos/sample_317_real.mp4", "annotation_index": 1917, "question_index": 0, "question": "What is visible on the right side of the escalator?", "options": ["A. A fountain.", "B. A park.", "C. A parking lot.", "D. A large building with colorful billboards."], "answer": "D", "time_stamp_s": 431, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_317_a1917_q0", "video_id": 317, "time_stamp_s": 431, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "902daa2ad9e5a9ca93de3a1cd35120fa0acb853ccc5c248210c89ffe3c79f109", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [401.0092333333333, 402.01023333333336, 403.01123333333334, 404.0122333333333, 405.01323333333335, 406.0142333333333, 407.01523333333336, 408.01623333333333, 409.0172333333333, 410.01823333333334, 411.0192333333333, 412.02023333333335, 413.0212333333333, 414.02223333333336, 415.02323333333334, 416.0242333333333, 417.02523333333335, 418.0262333333333, 419.02723333333336, 420.02823333333333, 421.0292333333333, 422.03023333333334, 423.0312333333333, 424.03223333333335, 425.0332333333333, 426.00086666666664, 427.0018666666667, 428.00286666666665, 429.0038666666667, 430.00486666666666], "recent_frames_sha256": "fa16b3d4ee47a392844d38552446176321d05b017f76d4fd5013139f15210526", "num_recent_frames": 30, "tq": 716332.21762058, "t1": 716344.424106311, "ta": 716344.424106311, "te": 716344.572159698, "first_response_s": 12.206485731061548, "answer_total_s": 12.354539118008688, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_317_a1917_q0", "video_id": 317, "time_stamp_s": 431, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9242f12e793ba7e083066dd6a86d43cbe35bf3864be5cfd1bb2128cbf63846a2", "condition_order": ["recent", "notes"], "memory": "[60-90s] - A crowd of people walks along a paved street lined with trees and buildings, moving toward a storefront with a \"STILL DISCO\" sign.  \n- A blue trash bin and a water fountain are visible near a beige building with a \"STUDIOS\" sign, where a person in a white shirt walks past.  \n- A large banner with \"STUDIOS\" text hangs above the entrance, and a signboard displays \"STUDIOS\" with a list of names or titles below it.\n[90-120s] - A yellow \"Kwik-E-Mart\" storefront with a \"Jack-Pot\" sign is visible on the right, with people walking past it.  \n- A large, colorful \"Scooby-Doo\" themed ride structure is prominent in the background, with crowds moving toward it.  \n- A blue trash bin and a small cart are positioned near the Kwik-E-Mart entrance, with people passing by.\n[120-150s] - \"Sesame Street\" and \"Bugs Bunny\" themed structures are visible in the background, with a large clown head sculpture prominently displayed.  \n- A \"Lower Los Angeles\" archway is seen in the distance, with people walking toward it.  \n- A food vendor with a red umbrella is positioned on the right side of the frame, near the archway.\n[150-180s] - A glass-domed structure with curved roof and red umbrellas is centrally located, surrounded by pedestrians.  \n- People are seen walking along a paved pathway with railings, some seated on benches near potted plants.  \n- The sky above is partly cloudy, with distant hills and cityscape visible in the background.\n[180-210s] - A man in a black shirt rides an escalator upward, moving away from the camera.  \n- The escalator is enclosed by a transparent glass roof and metal framework, with a view of a suburban landscape below.  \n- A blue banner with white text is visible on the right side of the frame, partially obscured by trees.\n[210-240s] - A person in a wheelchair ascends a moving walkway, moving upward toward a higher level.  \n- The walkway is enclosed by a glass and metal structure, with other pedestrians visible on adjacent paths.  \n- The surrounding environment includes greenery and urban infrastructure, such as roads and parked vehicles, visible through the transparent roof.\n[240-270s] - A man in a black shirt pushes a stroller down a moving walkway, moving away from the camera.  \n- A large informational sign labeled \"SCENIC VIEW\" is mounted on a railing, displaying a cityscape image.  \n- The camera pans to reveal a panoramic view of a city with mountains in the distance, including a prominent building with two towers.\n[270-300s] - A family stands near a railing, observing the cityscape below with a child pointing upward.  \n- A glass-domed structure is visible on the left, with people walking around its base.  \n- The camera pans to reveal a wide urban area with industrial buildings and green fields in the distance.\n[300-330s] - Two men ride an escalator upward, with one holding a camera, moving from lower to higher elevation.  \n- The escalator has a glass ceiling and metal railings, offering a panoramic view of a sprawling urban area below.  \n- The cityscape includes large buildings, greenery, and colorful structures, with a prominent dark building and a white-roofed structure visible.\n[330-360s] - A large beige building with a flat roof and colorful murals on its side dominates the foreground, viewed from a high vantage point.  \n- A dark, modern skyscraper stands in the mid-ground, contrasting with the surrounding low-rise structures.  \n- The camera pans slightly, revealing more of the urban landscape, including greenery and distant hills under a partly cloudy sky.\n[360-390s] - A man with dark hair is seen looking out from a high vantage point, holding a camera or phone.  \n- The view includes a large building with a white roof and colorful structures below, suggesting a commercial or entertainment area.  \n- Other people are visible walking along a glass-enclosed walkway, indicating a public observation deck or elevated walkway.\n[390-420s] - A man in a black shirt pushes a stroller while walking on a covered walkway.  \n- People are seen ascending and descending escalators within the modern glass-enclosed structure.  \n- The walkway overlooks a large urban area with buildings, greenery, and construction zones below.", "history_tokens": 997, "history_utf8_bytes": 4204, "recent_frame_times_s": [401.0092333333333, 402.01023333333336, 403.01123333333334, 404.0122333333333, 405.01323333333335, 406.0142333333333, 407.01523333333336, 408.01623333333333, 409.0172333333333, 410.01823333333334, 411.0192333333333, 412.02023333333335, 413.0212333333333, 414.02223333333336, 415.02323333333334, 416.0242333333333, 417.02523333333335, 418.0262333333333, 419.02723333333336, 420.02823333333333, 421.0292333333333, 422.03023333333334, 423.0312333333333, 424.03223333333335, 425.0332333333333, 426.00086666666664, 427.0018666666667, 428.00286666666665, 429.0038666666667, 430.00486666666666], "recent_frames_sha256": "fa16b3d4ee47a392844d38552446176321d05b017f76d4fd5013139f15210526", "num_recent_frames": 30, "tq": 716494.363594056, "t1": 716500.375996317, "ta": 716500.375996317, "te": 716500.413976226, "first_response_s": 6.012402261025272, "answer_total_s": 6.050382170011289, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 319, "content_group": "f5c5295ed8ccdef298f3cff2170c9abb5064e129d03fbbc2b8613d15eabd9e93", "question": {"question_id": "sample_319_a805_q0", "video_id": 319, "video_path": "./videos/sample_319_real.mp4", "annotation_index": 805, "question_index": 0, "question": "What item is prominently displayed in the center of the store?", "options": ["A. A large stone pillar.", "B. A wooden shelf with potted plants.", "C. A mirror reflecting part of the store.", "D. A kiddie ride-on vehicle."], "answer": "D", "time_stamp_s": 8, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_319_a805_q0", "video_id": 319, "time_stamp_s": 8, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "27ffbebdc4f3cc03fff7216f8858f7ea32d3f543912a08a343f09d35063aa521", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.055, 1.0226333333333333, 2.023633333333333, 3.0246333333333335, 4.025633333333333, 5.026633333333334, 6.027633333333333, 7.0286333333333335], "recent_frames_sha256": "f26cdf3819eac6e2e47531022b7c92111d0a601ebe238bc74dbb8f0316507907", "num_recent_frames": 8, "tq": 715382.064191845, "t1": 715382.87623093, "ta": 715382.87623093, "te": 715382.916206524, "first_response_s": 0.8120390849653631, "answer_total_s": 0.8520146789960563, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_319_a805_q0", "video_id": 319, "time_stamp_s": 8, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8b803af26bb248aefd8dd77cd9af084010b9eab985748eb46fd68a136b5c3eae", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.055, 1.0226333333333333, 2.023633333333333, 3.0246333333333335, 4.025633333333333, 5.026633333333334, 6.027633333333333, 7.0286333333333335], "recent_frames_sha256": "f26cdf3819eac6e2e47531022b7c92111d0a601ebe238bc74dbb8f0316507907", "num_recent_frames": 8, "tq": 715261.142097755, "t1": 715266.898204004, "ta": 715266.898204004, "te": 715267.177435023, "first_response_s": 5.7561062490567565, "answer_total_s": 6.035337268025614, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 319, "content_group": "f5c5295ed8ccdef298f3cff2170c9abb5064e129d03fbbc2b8613d15eabd9e93", "question": {"question_id": "sample_319_a806_q0", "video_id": 319, "video_path": "./videos/sample_319_real.mp4", "annotation_index": 806, "question_index": 0, "question": "What material is the hallway floor made of?", "options": ["A. Carpet.", "B. Wood.", "C. silver.", "D. Glossy black material."], "answer": "D", "time_stamp_s": 145, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_319_a806_q0", "video_id": 319, "time_stamp_s": 145, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f8d59bd88852beecd2d063d91f7674bca83d00642866644bd398ebe6549a74a9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [115.00316666666667, 116.00416666666666, 117.00516666666667, 118.00616666666667, 119.00716666666666, 120.00816666666667, 121.00916666666667, 122.01016666666666, 123.01116666666667, 124.01216666666667, 125.01316666666666, 126.01416666666667, 127.01516666666667, 128.01616666666666, 129.01716666666667, 130.01816666666667, 131.01916666666668, 132.02016666666665, 133.02116666666666, 134.02216666666666, 135.02316666666667, 136.02416666666667, 137.02516666666668, 138.02616666666665, 139.02716666666666, 140.02816666666666, 141.02916666666667, 142.03016666666667, 143.03116666666668, 144.03216666666665], "recent_frames_sha256": "96bb44df30e256ed3716cf89553f8101f89cf589b628ee3bbb3046e495e03907", "num_recent_frames": 30, "tq": 715382.935567853, "t1": 715393.112077452, "ta": 715393.112077452, "te": 715393.150181042, "first_response_s": 10.17650959896855, "answer_total_s": 10.21461318898946, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_319_a806_q0", "video_id": 319, "time_stamp_s": 145, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b191f386780abb3d7f2c818568ff172138208148055745d3e0385cec9033f10d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Camera pans from a merchandise store interior, revealing shelves with colorful clothing and a Jurassic-themed toy car display.  \n- The view transitions to an outdoor plaza with a \"DINOSAUR\" sign, showing a bustling walkway with palm trees and visitors.  \n- A large \"DINOSAUR\" archway frames the entrance to an outdoor area, with people walking and shops visible in the background.\n[30-60s] - \"Jurassic World\" archway is prominently displayed at the entrance, with visitors walking beneath it.  \n- \"Mummy\" theater facade features large statues of mummies on either side of the entrance.  \n- Starbucks Coffee storefront is visible on the right, with outdoor seating and patrons nearby.\n[60-90s] - A group of people walks toward the entrance of the \"Starbucks\" building, with some carrying bags or wearing jackets.  \n- A large mural depicting a fiery, dynamic scene is visible on the building wall, positioned above the entrance.  \n- The street is lined with palm trees and outdoor seating areas, with a few individuals seated under red umbrellas.\n[90-120s] - A large, fiery mural of two Transformers battling dominates the building facade, with \"Transformers: The Ride\" text below.  \n- People walk toward the entrance, some carrying bags or wearing themed hats, under bright daylight.  \n- A dark, recessed entrance with a \"DESTINATION\" sign and a Transformers logo is visible on the left side of the building.", "history_tokens": 323, "history_utf8_bytes": 1417, "recent_frame_times_s": [115.00316666666667, 116.00416666666666, 117.00516666666667, 118.00616666666667, 119.00716666666666, 120.00816666666667, 121.00916666666667, 122.01016666666666, 123.01116666666667, 124.01216666666667, 125.01316666666666, 126.01416666666667, 127.01516666666667, 128.01616666666666, 129.01716666666667, 130.01816666666667, 131.01916666666668, 132.02016666666665, 133.02116666666666, 134.02216666666666, 135.02316666666667, 136.02416666666667, 137.02516666666668, 138.02616666666665, 139.02716666666666, 140.02816666666666, 141.02916666666667, 142.03016666666667, 143.03116666666668, 144.03216666666665], "recent_frames_sha256": "96bb44df30e256ed3716cf89553f8101f89cf589b628ee3bbb3046e495e03907", "num_recent_frames": 30, "tq": 715301.747287945, "t1": 715308.157793478, "ta": 715308.157793478, "te": 715308.364600173, "first_response_s": 6.410505532985553, "answer_total_s": 6.617312227957882, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 319, "content_group": "f5c5295ed8ccdef298f3cff2170c9abb5064e129d03fbbc2b8613d15eabd9e93", "question": {"question_id": "sample_319_a807_q0", "video_id": 319, "video_path": "./videos/sample_319_real.mp4", "annotation_index": 807, "question_index": 0, "question": "What objects are primarily featured in the video scene right now?", "options": ["A. Cars.", "B. Humans.", "C. Animals.", "D. Robots."], "answer": "D", "time_stamp_s": 295, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_319_a807_q0", "video_id": 319, "time_stamp_s": 295, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a0ad1f2ab5cbe382456a8a1c6e073066d658cb077c629eaa51dc68adc326425a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [265.0197, 266.0207, 267.0217, 268.0227, 269.0237, 270.0247, 271.0257, 272.0267, 273.0277, 274.0287, 275.0297, 276.0307, 277.0317, 278.0327, 279.00033333333334, 280.0013333333333, 281.00233333333335, 282.00333333333333, 283.0043333333333, 284.00533333333334, 285.0063333333333, 286.00733333333335, 287.0083333333333, 288.00933333333336, 289.01033333333334, 290.0113333333333, 291.01233333333334, 292.0133333333333, 293.01433333333335, 294.01533333333333], "recent_frames_sha256": "84de70f466966fd05b462aa2ce22ca0047899a3dfd99843b7684a41edfc10d5b", "num_recent_frames": 30, "tq": 715393.170672632, "t1": 715403.043713549, "ta": 715403.043713549, "te": 715403.08136513, "first_response_s": 9.873040916980244, "answer_total_s": 9.910692497971468, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_319_a807_q0", "video_id": 319, "time_stamp_s": 295, "ground_truth": "D", "raw_output": "D. Robots.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "a9d0bf99501d42991b9c571f467f6cb5e35a045e274182ad4cf9696d02d27f04", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Camera pans from a merchandise store interior, revealing shelves with colorful clothing and a Jurassic-themed toy car display.  \n- The view transitions to an outdoor plaza with a \"DINOSAUR\" sign, showing a bustling walkway with palm trees and visitors.  \n- A large \"DINOSAUR\" archway frames the entrance to an outdoor area, with people walking and shops visible in the background.\n[30-60s] - \"Jurassic World\" archway is prominently displayed at the entrance, with visitors walking beneath it.  \n- \"Mummy\" theater facade features large statues of mummies on either side of the entrance.  \n- Starbucks Coffee storefront is visible on the right, with outdoor seating and patrons nearby.\n[60-90s] - A group of people walks toward the entrance of the \"Starbucks\" building, with some carrying bags or wearing jackets.  \n- A large mural depicting a fiery, dynamic scene is visible on the building wall, positioned above the entrance.  \n- The street is lined with palm trees and outdoor seating areas, with a few individuals seated under red umbrellas.\n[90-120s] - A large, fiery mural of two Transformers battling dominates the building facade, with \"Transformers: The Ride\" text below.  \n- People walk toward the entrance, some carrying bags or wearing themed hats, under bright daylight.  \n- A dark, recessed entrance with a \"DESTINATION\" sign and a Transformers logo is visible on the left side of the building.\n[120-150s] - Hallway features metallic walls, recessed lighting, and multiple mounted screens displaying dynamic content.  \n- A \"TRASH\" sign with a bin icon is visible on the left wall, near a service area.  \n- The camera pans right, revealing a curved walkway with railings and a distant blue-lit exit sign.\n[150-180s] - A central cylindrical structure emits blue light, surrounded by a circular railing, with control panels and doors on adjacent walls.  \n- Doors labeled \"E3\" and \"E4\" are visible, with \"E4\" showing a glowing blue interior and a screen displaying a vehicle.  \n- The corridor features metallic railings, illuminated signage, and a \"WARNING\" sign on the wall near the entrance.\n[180-210s] - Red-lit corridor with multiple monitors displaying data and control panels, leading to a control room.  \n- Hallway with textured walls, metal railings, and an \"EXIT\" sign illuminated in red, indicating a directional path.  \n- A \"WARNING\" sign is visible on a door, suggesting restricted access or safety protocols.\n[210-240s] - Camera moves down a narrow, dimly lit corridor with textured walls and overhead lighting fixtures.  \n- A red \"EXIT\" sign is visible on the right wall near a door, with a trash bin positioned beside it.  \n- The corridor features metal handrails along both sides and a sign reading \"LEVEL 03\" on the right wall.\n[240-270s] - A large screen displays a dynamic, futuristic battle scene with glowing blue and white effects, featuring mechanical structures and explosions.  \n- A yellow vehicle with orange lights is positioned in the foreground, partially obstructing the view of the screen.  \n- The camera pans slightly, revealing more of the room’s industrial design, including a staircase and illuminated panels on the walls.", "history_tokens": 733, "history_utf8_bytes": 3178, "recent_frame_times_s": [265.0197, 266.0207, 267.0217, 268.0227, 269.0237, 270.0247, 271.0257, 272.0267, 273.0277, 274.0287, 275.0297, 276.0307, 277.0317, 278.0327, 279.00033333333334, 280.0013333333333, 281.00233333333335, 282.00333333333333, 283.0043333333333, 284.00533333333334, 285.0063333333333, 286.00733333333335, 287.0083333333333, 288.00933333333336, 289.01033333333334, 290.0113333333333, 291.01233333333334, 292.0133333333333, 293.01433333333335, 294.01533333333333], "recent_frames_sha256": "84de70f466966fd05b462aa2ce22ca0047899a3dfd99843b7684a41edfc10d5b", "num_recent_frames": 30, "tq": 715339.755819934, "t1": 715341.608336119, "ta": 715341.608336119, "te": 715341.769639125, "first_response_s": 1.8525161850266159, "answer_total_s": 2.013819191022776, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 319, "content_group": "f5c5295ed8ccdef298f3cff2170c9abb5064e129d03fbbc2b8613d15eabd9e93", "question": {"question_id": "sample_319_a807_q1", "video_id": 319, "video_path": "./videos/sample_319_real.mp4", "annotation_index": 807, "question_index": 1, "question": "What are the predominant colors in the visuals of the video?", "options": ["A. Red and yellow.", "B. Green and purple.", "C. Black and white.", "D. Orange and blue."], "answer": "D", "time_stamp_s": 300, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_319_a807_q1", "video_id": 319, "time_stamp_s": 300, "ground_truth": "D", "raw_output": "D. Orange and blue.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "f35c88025f9ff3ea45989cfd79b5ea7c3eb89f67295f2c01918b64cc1f64f429", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [270.0247, 271.0257, 272.0267, 273.0277, 274.0287, 275.0297, 276.0307, 277.0317, 278.0327, 279.00033333333334, 280.0013333333333, 281.00233333333335, 282.00333333333333, 283.0043333333333, 284.00533333333334, 285.0063333333333, 286.00733333333335, 287.0083333333333, 288.00933333333336, 289.01033333333334, 290.0113333333333, 291.01233333333334, 292.0133333333333, 293.01433333333335, 294.01533333333333, 295.0163333333333, 296.01733333333334, 297.0183333333333, 298.01933333333335, 299.0203333333333], "recent_frames_sha256": "ec5cf5530d53e8cdeca0ff99d62d7de33b7b80892d21695a4020f833c953ed3c", "num_recent_frames": 30, "tq": 715403.095613636, "t1": 715411.001028481, "ta": 715411.001028481, "te": 715411.224139312, "first_response_s": 7.905414845095947, "answer_total_s": 8.128525676089339, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_319_a807_q1", "video_id": 319, "time_stamp_s": 300, "ground_truth": "D", "raw_output": "D. Orange and blue.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "46c26c4d30e1512c9142ba5726ac27c047198cb9d8bab1ad8c0cfbc472ecec8f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Camera pans from a merchandise store interior, revealing shelves with colorful clothing and a Jurassic-themed toy car display.  \n- The view transitions to an outdoor plaza with a \"DINOSAUR\" sign, showing a bustling walkway with palm trees and visitors.  \n- A large \"DINOSAUR\" archway frames the entrance to an outdoor area, with people walking and shops visible in the background.\n[30-60s] - \"Jurassic World\" archway is prominently displayed at the entrance, with visitors walking beneath it.  \n- \"Mummy\" theater facade features large statues of mummies on either side of the entrance.  \n- Starbucks Coffee storefront is visible on the right, with outdoor seating and patrons nearby.\n[60-90s] - A group of people walks toward the entrance of the \"Starbucks\" building, with some carrying bags or wearing jackets.  \n- A large mural depicting a fiery, dynamic scene is visible on the building wall, positioned above the entrance.  \n- The street is lined with palm trees and outdoor seating areas, with a few individuals seated under red umbrellas.\n[90-120s] - A large, fiery mural of two Transformers battling dominates the building facade, with \"Transformers: The Ride\" text below.  \n- People walk toward the entrance, some carrying bags or wearing themed hats, under bright daylight.  \n- A dark, recessed entrance with a \"DESTINATION\" sign and a Transformers logo is visible on the left side of the building.\n[120-150s] - Hallway features metallic walls, recessed lighting, and multiple mounted screens displaying dynamic content.  \n- A \"TRASH\" sign with a bin icon is visible on the left wall, near a service area.  \n- The camera pans right, revealing a curved walkway with railings and a distant blue-lit exit sign.\n[150-180s] - A central cylindrical structure emits blue light, surrounded by a circular railing, with control panels and doors on adjacent walls.  \n- Doors labeled \"E3\" and \"E4\" are visible, with \"E4\" showing a glowing blue interior and a screen displaying a vehicle.  \n- The corridor features metallic railings, illuminated signage, and a \"WARNING\" sign on the wall near the entrance.\n[180-210s] - Red-lit corridor with multiple monitors displaying data and control panels, leading to a control room.  \n- Hallway with textured walls, metal railings, and an \"EXIT\" sign illuminated in red, indicating a directional path.  \n- A \"WARNING\" sign is visible on a door, suggesting restricted access or safety protocols.\n[210-240s] - Camera moves down a narrow, dimly lit corridor with textured walls and overhead lighting fixtures.  \n- A red \"EXIT\" sign is visible on the right wall near a door, with a trash bin positioned beside it.  \n- The corridor features metal handrails along both sides and a sign reading \"LEVEL 03\" on the right wall.\n[240-270s] - A large screen displays a dynamic, futuristic battle scene with glowing blue and white effects, featuring mechanical structures and explosions.  \n- A yellow vehicle with orange lights is positioned in the foreground, partially obstructing the view of the screen.  \n- The camera pans slightly, revealing more of the room’s industrial design, including a staircase and illuminated panels on the walls.\n[270-300s] - A large, fiery robot (Bumblebee) is projected onto a wall, surrounded by glowing blue energy effects.  \n- The camera pans right, revealing a futuristic interior with orange lighting and a visible exit sign.  \n- A blue robot (Optimus Prime) appears on a screen, standing in a cityscape with glowing buildings and vehicles.", "history_tokens": 813, "history_utf8_bytes": 3513, "recent_frame_times_s": [270.0247, 271.0257, 272.0267, 273.0277, 274.0287, 275.0297, 276.0307, 277.0317, 278.0327, 279.00033333333334, 280.0013333333333, 281.00233333333335, 282.00333333333333, 283.0043333333333, 284.00533333333334, 285.0063333333333, 286.00733333333335, 287.0083333333333, 288.00933333333336, 289.01033333333334, 290.0113333333333, 291.01233333333334, 292.0133333333333, 293.01433333333335, 294.01533333333333, 295.0163333333333, 296.01733333333334, 297.0183333333333, 298.01933333333335, 299.0203333333333], "recent_frames_sha256": "ec5cf5530d53e8cdeca0ff99d62d7de33b7b80892d21695a4020f833c953ed3c", "num_recent_frames": 30, "tq": 715351.649957014, "t1": 715353.374962573, "ta": 715353.374962573, "te": 715353.695504222, "first_response_s": 1.7250055590411648, "answer_total_s": 2.0455472079338506, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 319, "content_group": "f5c5295ed8ccdef298f3cff2170c9abb5064e129d03fbbc2b8613d15eabd9e93", "question": {"question_id": "sample_319_a808_q0", "video_id": 319, "video_path": "./videos/sample_319_real.mp4", "annotation_index": 808, "question_index": 0, "question": "What is prominently featured on the screen right now?", "options": ["A. A large tree.", "B. A blue vehicle.", "C. A group of people.", "D. A yellow and silver robot."], "answer": "D", "time_stamp_s": 420, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_319_a808_q0", "video_id": 319, "time_stamp_s": 420, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fb7799a2e9ebc969b32943ae629ef8a2e0845ec35e76a0b5186f5dd70cacfdf7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [390.01123333333334, 391.0122333333333, 392.01323333333335, 393.0142333333333, 394.01523333333336, 395.01623333333333, 396.0172333333333, 397.01823333333334, 398.0192333333333, 399.02023333333335, 400.0212333333333, 401.02223333333336, 402.02323333333334, 403.0242333333333, 404.02523333333335, 405.0262333333333, 406.02723333333336, 407.02823333333333, 408.0292333333333, 409.03023333333334, 410.0312333333333, 411.03223333333335, 412.0332333333333, 413.00086666666664, 414.0018666666667, 415.00286666666665, 416.0038666666667, 417.00486666666666, 418.0058666666667, 419.00686666666667], "recent_frames_sha256": "8aac6c4eff5ef9e73242f481ec1b42a5717110d7720e1cc5c25c5d2b6d8b6bb1", "num_recent_frames": 30, "tq": 715411.235935652, "t1": 715418.010670198, "ta": 715418.010670198, "te": 715418.048041616, "first_response_s": 6.774734545964748, "answer_total_s": 6.812105963937938, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_319_a808_q0", "video_id": 319, "time_stamp_s": 420, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "34c7ab2d875822ac027871bb2a9f382daec7a6e56c9c713fd055fc00db714761", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A large, fiery mural of two Transformers battling dominates the building facade, with \"Transformers: The Ride\" text below.  \n- People walk toward the entrance, some carrying bags or wearing themed hats, under bright daylight.  \n- A dark, recessed entrance with a \"DESTINATION\" sign and a Transformers logo is visible on the left side of the building.\n[120-150s] - Hallway features metallic walls, recessed lighting, and multiple mounted screens displaying dynamic content.  \n- A \"TRASH\" sign with a bin icon is visible on the left wall, near a service area.  \n- The camera pans right, revealing a curved walkway with railings and a distant blue-lit exit sign.\n[150-180s] - A central cylindrical structure emits blue light, surrounded by a circular railing, with control panels and doors on adjacent walls.  \n- Doors labeled \"E3\" and \"E4\" are visible, with \"E4\" showing a glowing blue interior and a screen displaying a vehicle.  \n- The corridor features metallic railings, illuminated signage, and a \"WARNING\" sign on the wall near the entrance.\n[180-210s] - Red-lit corridor with multiple monitors displaying data and control panels, leading to a control room.  \n- Hallway with textured walls, metal railings, and an \"EXIT\" sign illuminated in red, indicating a directional path.  \n- A \"WARNING\" sign is visible on a door, suggesting restricted access or safety protocols.\n[210-240s] - Camera moves down a narrow, dimly lit corridor with textured walls and overhead lighting fixtures.  \n- A red \"EXIT\" sign is visible on the right wall near a door, with a trash bin positioned beside it.  \n- The corridor features metal handrails along both sides and a sign reading \"LEVEL 03\" on the right wall.\n[240-270s] - A large screen displays a dynamic, futuristic battle scene with glowing blue and white effects, featuring mechanical structures and explosions.  \n- A yellow vehicle with orange lights is positioned in the foreground, partially obstructing the view of the screen.  \n- The camera pans slightly, revealing more of the room’s industrial design, including a staircase and illuminated panels on the walls.\n[270-300s] - A large, fiery robot (Bumblebee) is projected onto a wall, surrounded by glowing blue energy effects.  \n- The camera pans right, revealing a futuristic interior with orange lighting and a visible exit sign.  \n- A blue robot (Optimus Prime) appears on a screen, standing in a cityscape with glowing buildings and vehicles.\n[300-330s] - A large, glowing, mechanical creature with multiple limbs and glowing eyes is shown in a dimly lit, industrial setting, surrounded by debris and sparks.  \n- The creature appears to be in motion, possibly attacking or moving through a damaged environment, with its body partially obscured by smoke and light effects.  \n- The scene is viewed from a low angle, suggesting the camera is positioned near the ground or inside a vehicle, with blurred background elements indicating rapid movement or chaos.\n[330-360s] - A large, dynamic digital screen displays a futuristic, glowing cityscape with neon lights and abstract structures, framed by wooden scaffolding.  \n- The screen's imagery shifts rapidly, showing a mix of urban and organic elements, including what appears to be a glowing tree or plant structure.  \n- The camera pans across the scene, revealing the screen's scale and the surrounding scaffolding, which is illuminated with warm orange lights.\n[360-390s] - A large, metallic, multi-limbed creature with glowing green and blue accents moves through a neon-lit urban environment, causing destruction.  \n- Sparks and debris fly as the creature interacts with buildings and structures, suggesting intense combat or movement.  \n- The creature’s form shifts dynamically, with parts of its body glowing brighter and darker, indicating active energy or transformation.\n[390-420s] - A large, metallic, blue-lit robot-like entity is shown in a dynamic, explosive state, with sparks and debris flying around it.  \n- The entity appears to be in a chaotic, industrial environment with cranes and structures, suggesting a battle or destruction sequence.  \n- The robot's form is fragmented and shifting, indicating intense movement or disintegration, with bright light sources illuminating its parts.", "history_tokens": 951, "history_utf8_bytes": 4269, "recent_frame_times_s": [390.01123333333334, 391.0122333333333, 392.01323333333335, 393.0142333333333, 394.01523333333336, 395.01623333333333, 396.0172333333333, 397.01823333333334, 398.0192333333333, 399.02023333333335, 400.0212333333333, 401.02223333333336, 402.02323333333334, 403.0242333333333, 404.02523333333335, 405.0262333333333, 406.02723333333336, 407.02823333333333, 408.0292333333333, 409.03023333333334, 410.0312333333333, 411.03223333333335, 412.0332333333333, 413.00086666666664, 414.0018666666667, 415.00286666666665, 416.0038666666667, 417.00486666666666, 418.0058666666667, 419.00686666666667], "recent_frames_sha256": "8aac6c4eff5ef9e73242f481ec1b42a5717110d7720e1cc5c25c5d2b6d8b6bb1", "num_recent_frames": 30, "tq": 715380.603635406, "t1": 715381.833266126, "ta": 715381.833266126, "te": 715382.024409856, "first_response_s": 1.2296307199867442, "answer_total_s": 1.4207744499435648, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 320, "content_group": "b1fe5ddf60ac31a1ba54e98d01ad5874fa6f1a6913ad9f2e588cc36e1a4b7c3c", "question": {"question_id": "sample_320_a856_q0", "video_id": 320, "video_path": "./videos/sample_320_real.mp4", "annotation_index": 856, "question_index": 0, "question": "What is labeled on the large green tunnel people are heading toward?", "options": ["A. \"Mario Kart: Bowser's Challenge\".", "B. \"Super Mario World\".", "C. \"Luigi's Mansion\".", "D. \"Princess Peach's Castle\"."], "answer": "A", "time_stamp_s": 11, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_320_a856_q0", "video_id": 320, "time_stamp_s": 11, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f6dc67a2b705ba64690b28d4382a95e9cdde4867b0ff39dd7d4c855e5930ba5b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.043, 1.0106333333333333, 2.011633333333333, 3.0126333333333335, 4.013633333333333, 5.014633333333333, 6.015633333333334, 7.016633333333333, 8.017633333333333, 9.018633333333334, 10.019633333333333], "recent_frames_sha256": "a6e2474352116a9664279c34ee62ef86d3a0386c382d8be44001fbc5d974fe6c", "num_recent_frames": 11, "tq": 716435.00283191, "t1": 716435.657773209, "ta": 716435.657773209, "te": 716435.989621567, "first_response_s": 0.6549412989988923, "answer_total_s": 0.9867896569194272, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_320_a856_q0", "video_id": 320, "time_stamp_s": 11, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "89c2d150eaf43634cda6a6b2380a888f8735d87239c9969857ba696154140984", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.043, 1.0106333333333333, 2.011633333333333, 3.0126333333333335, 4.013633333333333, 5.014633333333333, 6.015633333333334, 7.016633333333333, 8.017633333333333, 9.018633333333334, 10.019633333333333], "recent_frames_sha256": "a6e2474352116a9664279c34ee62ef86d3a0386c382d8be44001fbc5d974fe6c", "num_recent_frames": 11, "tq": 716281.259875022, "t1": 716288.271390116, "ta": 716288.271390116, "te": 716288.494535285, "first_response_s": 7.0115150939673185, "answer_total_s": 7.234660263056867, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 320, "content_group": "b1fe5ddf60ac31a1ba54e98d01ad5874fa6f1a6913ad9f2e588cc36e1a4b7c3c", "question": {"question_id": "sample_320_a857_q0", "video_id": 320, "video_path": "./videos/sample_320_real.mp4", "annotation_index": 857, "question_index": 0, "question": "What was the group doing just now?", "options": ["A. Standing in a queue.", "B. Sitting on a theme park ride.", "C. Entering a theater.", "D. Walking through a dimly lit corridor."], "answer": "D", "time_stamp_s": 146, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_320_a857_q0", "video_id": 320, "time_stamp_s": 146, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4d317a2b7ac26edf3b5964e6470adfd98938e350198097e9a260d2a4a0502b6e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [116.02553333333333, 117.02653333333333, 118.02753333333334, 119.02853333333333, 120.02953333333333, 121.03053333333334, 122.03153333333333, 123.03253333333333, 124.00016666666667, 125.00116666666666, 126.00216666666667, 127.00316666666667, 128.00416666666666, 129.00516666666667, 130.00616666666667, 131.00716666666668, 132.00816666666665, 133.00916666666666, 134.01016666666666, 135.01116666666667, 136.01216666666667, 137.01316666666668, 138.01416666666665, 139.01516666666666, 140.01616666666666, 141.01716666666667, 142.01816666666667, 143.01916666666668, 144.02016666666665, 145.02116666666666], "recent_frames_sha256": "7babb4a9935c2115fd95cc71cc24ffbcb22627dc96c9d24b35a50cb8fd50b2aa", "num_recent_frames": 30, "tq": 716436.004839068, "t1": 716449.690308575, "ta": 716449.690308575, "te": 716449.727912863, "first_response_s": 13.685469507006928, "answer_total_s": 13.723073794972152, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_320_a857_q0", "video_id": 320, "time_stamp_s": 146, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c2c6238f9ce311a64be3ae5f52a850a9f99724c203040061a7fd67b0d0eb99c3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mario Kart-themed building with colorful, cartoonish architecture and a green tunnel entrance, where visitors enter at 0:12.  \n- Inside the tunnel, the environment transitions to a pink, whimsical interior with glowing geometric structures and a dark, cave-like section at 0:22.  \n- Exit signs are visible in a dimly lit area with blue-lit doors, suggesting a transition point within the attraction.\n[30-60s] - A group of people walks through a dimly lit, fantastical tunnel with glowing mushroom-like structures and crystal formations.  \n- The tunnel features green railings and a path that curves through the space, with walls displaying dynamic, colorful patterns.  \n- A staircase with purple lighting leads upward, where two individuals are seen ascending, one carrying a red bag.\n[60-90s] - A green character (possibly Yoshi) appears through a brick archway, positioned below a large tree with red lights.  \n- The camera pans upward, revealing a pink, cloud-like staircase with green railings, leading toward a brightly lit area.  \n- A group of people in dark clothing are seen ascending the stairs, moving away from the camera’s perspective.\n[90-120s] - A person in dark clothing walks through a tunnel with brick walls and metal railings, moving toward a brightly lit outdoor area.  \n- The camera pans to reveal a colorful, themed amusement park with large structures, including a green and blue building and a castle-like facade.  \n- A large, detailed stone sculpture of a creature is visible inside a darkened entrance, with people walking past it toward the park.", "history_tokens": 347, "history_utf8_bytes": 1585, "recent_frame_times_s": [116.02553333333333, 117.02653333333333, 118.02753333333334, 119.02853333333333, 120.02953333333333, 121.03053333333334, 122.03153333333333, 123.03253333333333, 124.00016666666667, 125.00116666666666, 126.00216666666667, 127.00316666666667, 128.00416666666666, 129.00516666666667, 130.00616666666667, 131.00716666666668, 132.00816666666665, 133.00916666666666, 134.01016666666666, 135.01116666666667, 136.01216666666667, 137.01316666666668, 138.01416666666665, 139.01516666666666, 140.01616666666666, 141.01716666666667, 142.01816666666667, 143.01916666666668, 144.02016666666665, 145.02116666666666], "recent_frames_sha256": "7babb4a9935c2115fd95cc71cc24ffbcb22627dc96c9d24b35a50cb8fd50b2aa", "num_recent_frames": 30, "tq": 716312.811219663, "t1": 716320.193731459, "ta": 716320.193731459, "te": 716320.416698296, "first_response_s": 7.382511795964092, "answer_total_s": 7.605478632962331, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 320, "content_group": "b1fe5ddf60ac31a1ba54e98d01ad5874fa6f1a6913ad9f2e588cc36e1a4b7c3c", "question": {"question_id": "sample_320_a858_q0", "video_id": 320, "video_path": "./videos/sample_320_real.mp4", "annotation_index": 858, "question_index": 0, "question": "What is the large fish chasing the small fishes?", "options": ["A. Blue fish.", "B. Green fish.", "C. Red fish.", "D. Yellow fish."], "answer": "C", "time_stamp_s": 282, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_320_a858_q0", "video_id": 320, "time_stamp_s": 282, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c74f81011323e1ea94daf5515ae3a96cb2d3889ca77e8470829190582aa0599e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [252.02806666666666, 253.02906666666667, 254.03006666666667, 255.03106666666667, 256.03206666666665, 257.0330666666667, 258.0007, 259.0017, 260.0027, 261.0037, 262.0047, 263.0057, 264.0067, 265.0077, 266.0087, 267.0097, 268.0107, 269.0117, 270.0127, 271.0137, 272.0147, 273.0157, 274.0167, 275.0177, 276.0187, 277.0197, 278.0207, 279.0217, 280.0227, 281.0237], "recent_frames_sha256": "8db2d2877d20f25e7176dec3c627ba286b3a1735cda94b08cc425065a656d220", "num_recent_frames": 30, "tq": 716449.741310222, "t1": 716464.137611179, "ta": 716464.137611179, "te": 716464.174809379, "first_response_s": 14.396300957072526, "answer_total_s": 14.433499157079495, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_320_a858_q0", "video_id": 320, "time_stamp_s": 282, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "27a6de23959ecd6781a344ea2eafa4531b8725a5ffd6ffaa1f83b5898f70cd77", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Mario Kart-themed building with colorful, cartoonish architecture and a green tunnel entrance, where visitors enter at 0:12.  \n- Inside the tunnel, the environment transitions to a pink, whimsical interior with glowing geometric structures and a dark, cave-like section at 0:22.  \n- Exit signs are visible in a dimly lit area with blue-lit doors, suggesting a transition point within the attraction.\n[30-60s] - A group of people walks through a dimly lit, fantastical tunnel with glowing mushroom-like structures and crystal formations.  \n- The tunnel features green railings and a path that curves through the space, with walls displaying dynamic, colorful patterns.  \n- A staircase with purple lighting leads upward, where two individuals are seen ascending, one carrying a red bag.\n[60-90s] - A green character (possibly Yoshi) appears through a brick archway, positioned below a large tree with red lights.  \n- The camera pans upward, revealing a pink, cloud-like staircase with green railings, leading toward a brightly lit area.  \n- A group of people in dark clothing are seen ascending the stairs, moving away from the camera’s perspective.\n[90-120s] - A person in dark clothing walks through a tunnel with brick walls and metal railings, moving toward a brightly lit outdoor area.  \n- The camera pans to reveal a colorful, themed amusement park with large structures, including a green and blue building and a castle-like facade.  \n- A large, detailed stone sculpture of a creature is visible inside a darkened entrance, with people walking past it toward the park.\n[120-150s] - A large, white, stone-like statue of Bowser dominates the center of the room, with outstretched arms and a menacing expression.  \n- Behind the statue, a glowing red circular emblem featuring a stylized, menacing face is mounted on a stone wall.  \n- Visitors walk through a corridor with screens displaying game-related imagery, transitioning into a brightly lit, colorful area with a patterned floor.\n[150-180s] - A child in a red shirt runs past a display of Nintendo character statues, including Mario, Luigi, and Yoshi, with a green carpeted floor beneath.  \n- The scene transitions to a dark, stone-walled ride entrance with glowing orange lights and a menacing face above the archway, where guests in ride vehicles are seated.  \n- Inside the ride, illuminated circular screens show animated characters like Mario, Luigi, and Yoshi, with a \"Carnival\" sign visible on one screen.\n[180-210s] - Mario Kart characters (e.g., Mario, Luigi, Bowser) appear as floating stickers around a central screen displaying a racing game.\n- The central screen shows a green track with a red circular target, suggesting a racing or targeting game.\n- Stickers move dynamically around the screen, with some appearing to float or drift in the air, indicating an interactive or animated display.\n[210-240s] - Mario and Luigi race in a kart, with Mario in front, navigating a dark, castle-themed track with glowing torches and stone walls.\n- A large, menacing face emblem appears on a green archway as the racers pass through a tunnel-like section.\n- The camera pans to show a red arrow sign on the right side of the track, indicating a turn or direction change ahead.\n[240-270s] - A menacing, glowing skull emblem is prominently displayed above a green archway, suggesting a boss or gate.\n- Characters including Mario, Luigi, and Toad are seen navigating a dark, industrial-themed level with pipes and platforms.\n- Red and white mushroom enemies (Piranha Plants) are suspended in mid-air, some firing projectiles, while others are positioned near waterfalls or pipes.", "history_tokens": 812, "history_utf8_bytes": 3647, "recent_frame_times_s": [252.02806666666666, 253.02906666666667, 254.03006666666667, 255.03106666666667, 256.03206666666665, 257.0330666666667, 258.0007, 259.0017, 260.0027, 261.0037, 262.0047, 263.0057, 264.0067, 265.0077, 266.0087, 267.0097, 268.0107, 269.0117, 270.0127, 271.0137, 272.0147, 273.0157, 274.0167, 275.0177, 276.0187, 277.0197, 278.0207, 279.0217, 280.0227, 281.0237], "recent_frames_sha256": "8db2d2877d20f25e7176dec3c627ba286b3a1735cda94b08cc425065a656d220", "num_recent_frames": 30, "tq": 716362.983397003, "t1": 716369.226643196, "ta": 716369.226643196, "te": 716369.268492929, "first_response_s": 6.243246192927472, "answer_total_s": 6.285095926024951, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 320, "content_group": "b1fe5ddf60ac31a1ba54e98d01ad5874fa6f1a6913ad9f2e588cc36e1a4b7c3c", "question": {"question_id": "sample_320_a859_q0", "video_id": 320, "video_path": "./videos/sample_320_real.mp4", "annotation_index": 859, "question_index": 0, "question": "What action does Bowser Jr. perform as they steer onto the rainbow-colored track?", "options": ["A. Jumps.", "B. Throws a shell.", "C. Activates a boost.", "D. Unfurls a glider."], "answer": "D", "time_stamp_s": 426, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_320_a859_q0", "video_id": 320, "time_stamp_s": 426, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "53b29f26d57ae3edff279a5328d941cf1f858dacb9c710212d7783cb87f10841", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [396.0052333333333, 397.00623333333334, 398.0072333333333, 399.00823333333335, 400.0092333333333, 401.01023333333336, 402.01123333333334, 403.0122333333333, 404.01323333333335, 405.0142333333333, 406.01523333333336, 407.01623333333333, 408.0172333333333, 409.01823333333334, 410.0192333333333, 411.02023333333335, 412.0212333333333, 413.02223333333336, 414.02323333333334, 415.0242333333333, 416.02523333333335, 417.0262333333333, 418.02723333333336, 419.02823333333333, 420.0292333333333, 421.03023333333334, 422.0312333333333, 423.03223333333335, 424.0332333333333, 425.00086666666664], "recent_frames_sha256": "83ea22157a9f6e0b807a7f678859c4d50f698cf4ef661af5b4289ab1a6373a9f", "num_recent_frames": 30, "tq": 716464.188192106, "t1": 716475.857660989, "ta": 716475.857660989, "te": 716475.895084649, "first_response_s": 11.669468883075751, "answer_total_s": 11.706892543006688, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_320_a859_q0", "video_id": 320, "time_stamp_s": 426, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b34ff45143596ce00a1dc1192ccbe4c9ebe59844d6cda911de7d178b209b6be1", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A person in dark clothing walks through a tunnel with brick walls and metal railings, moving toward a brightly lit outdoor area.  \n- The camera pans to reveal a colorful, themed amusement park with large structures, including a green and blue building and a castle-like facade.  \n- A large, detailed stone sculpture of a creature is visible inside a darkened entrance, with people walking past it toward the park.\n[120-150s] - A large, white, stone-like statue of Bowser dominates the center of the room, with outstretched arms and a menacing expression.  \n- Behind the statue, a glowing red circular emblem featuring a stylized, menacing face is mounted on a stone wall.  \n- Visitors walk through a corridor with screens displaying game-related imagery, transitioning into a brightly lit, colorful area with a patterned floor.\n[150-180s] - A child in a red shirt runs past a display of Nintendo character statues, including Mario, Luigi, and Yoshi, with a green carpeted floor beneath.  \n- The scene transitions to a dark, stone-walled ride entrance with glowing orange lights and a menacing face above the archway, where guests in ride vehicles are seated.  \n- Inside the ride, illuminated circular screens show animated characters like Mario, Luigi, and Yoshi, with a \"Carnival\" sign visible on one screen.\n[180-210s] - Mario Kart characters (e.g., Mario, Luigi, Bowser) appear as floating stickers around a central screen displaying a racing game.\n- The central screen shows a green track with a red circular target, suggesting a racing or targeting game.\n- Stickers move dynamically around the screen, with some appearing to float or drift in the air, indicating an interactive or animated display.\n[210-240s] - Mario and Luigi race in a kart, with Mario in front, navigating a dark, castle-themed track with glowing torches and stone walls.\n- A large, menacing face emblem appears on a green archway as the racers pass through a tunnel-like section.\n- The camera pans to show a red arrow sign on the right side of the track, indicating a turn or direction change ahead.\n[240-270s] - A menacing, glowing skull emblem is prominently displayed above a green archway, suggesting a boss or gate.\n- Characters including Mario, Luigi, and Toad are seen navigating a dark, industrial-themed level with pipes and platforms.\n- Red and white mushroom enemies (Piranha Plants) are suspended in mid-air, some firing projectiles, while others are positioned near waterfalls or pipes.\n[270-300s] - A large, red, cartoonish fish with sharp teeth and a white face appears, partially obscured by a white, ghost-like figure.  \n- A group of colorful, cartoonish characters (including a yellow one with a hat) swim near the fish, surrounded by bubbles and aquatic plants.  \n- The scene transitions to a dark underwater cave with glowing jellyfish and starfish-like creatures, illuminated by beams of light.\n[300-330s] - Bubbles float upward through a dark, underwater-like environment with glowing fish and skeletal creatures.  \n- A character in a red hat and blue outfit swims near the center, surrounded by bubbles and glowing fish.  \n- The scene transitions to a dimly lit, ornate interior with floating ghost-like figures and glowing objects.\n[330-360s] - A glowing pink beam sweeps across a dark, bookshelf-lined room, illuminating floating character projections.  \n- Characters like Mario and Luigi appear on screens, while a stack of yellow Koopa Troopas stands near the center.  \n- The scene transitions to a surreal, cloud-filled environment with floating platforms and a large, rotating clock-like structure.\n[360-390s] - A small, yellow, cartoonish character rides a rocket-like vehicle through a dark, cloud-filled environment.  \n- The vehicle emits sparks and fire as it moves, suggesting propulsion or combat.  \n- A large, glowing, fiery explosion occurs nearby, with bright light and debris flying outward.\n[390-420s] - A glowing, golden, star-shaped object appears and moves across a dark, textured red surface.  \n- Bright, streaking light trails radiate outward from a central point, suggesting rapid motion or explosion.  \n- A colorful, cartoonish vehicle with a purple roof and red body is seen speeding through the scene, surrounded by light streaks.", "history_tokens": 957, "history_utf8_bytes": 4267, "recent_frame_times_s": [396.0052333333333, 397.00623333333334, 398.0072333333333, 399.00823333333335, 400.0092333333333, 401.01023333333336, 402.01123333333334, 403.0122333333333, 404.01323333333335, 405.0142333333333, 406.01523333333336, 407.01623333333333, 408.0172333333333, 409.01823333333334, 410.0192333333333, 411.02023333333335, 412.0212333333333, 413.02223333333336, 414.02323333333334, 415.0242333333333, 416.02523333333335, 417.0262333333333, 418.02723333333336, 419.02823333333333, 420.0292333333333, 421.03023333333334, 422.0312333333333, 423.03223333333335, 424.0332333333333, 425.00086666666664], "recent_frames_sha256": "83ea22157a9f6e0b807a7f678859c4d50f698cf4ef661af5b4289ab1a6373a9f", "num_recent_frames": 30, "tq": 716414.764103395, "t1": 716422.717396094, "ta": 716422.717396094, "te": 716422.918758096, "first_response_s": 7.953292698948644, "answer_total_s": 8.15465470100753, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 320, "content_group": "b1fe5ddf60ac31a1ba54e98d01ad5874fa6f1a6913ad9f2e588cc36e1a4b7c3c", "question": {"question_id": "sample_320_a859_q1", "video_id": 320, "video_path": "./videos/sample_320_real.mp4", "annotation_index": 859, "question_index": 1, "question": "What is the main event happening as Bowser Jr. reaches the finish line?", "options": ["A. Bowser Jr. avoids obstacles.", "B. Bowser Jr. prepares to glide.", "C. Tanooki Mario joins the race.", "D. Excited celebratory signs and sparkles appear."], "answer": "D", "time_stamp_s": 433, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_320_a859_q1", "video_id": 320, "time_stamp_s": 433, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1594c9275c2af9e4b7f89dfe1835a28a8cfd813ecb786aec72deb514dc2a506c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [403.0122333333333, 404.01323333333335, 405.0142333333333, 406.01523333333336, 407.01623333333333, 408.0172333333333, 409.01823333333334, 410.0192333333333, 411.02023333333335, 412.0212333333333, 413.02223333333336, 414.02323333333334, 415.0242333333333, 416.02523333333335, 417.0262333333333, 418.02723333333336, 419.02823333333333, 420.0292333333333, 421.03023333333334, 422.0312333333333, 423.03223333333335, 424.0332333333333, 425.00086666666664, 426.0018666666667, 427.00286666666665, 428.0038666666667, 429.00486666666666, 430.0058666666667, 431.00686666666667, 432.00786666666664], "recent_frames_sha256": "26c37aa026b375ccf832245dd06fd00f5b67722de9accd29085e0ef9c7deba37", "num_recent_frames": 30, "tq": 716475.905118229, "t1": 716488.263467247, "ta": 716488.263467247, "te": 716488.299883432, "first_response_s": 12.358349018031731, "answer_total_s": 12.394765203003772, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_320_a859_q1", "video_id": 320, "time_stamp_s": 433, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d5b025aae028e539140272e373b8afbcc75cbe4af57cb3606396fbd8ab859c1a", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A person in dark clothing walks through a tunnel with brick walls and metal railings, moving toward a brightly lit outdoor area.  \n- The camera pans to reveal a colorful, themed amusement park with large structures, including a green and blue building and a castle-like facade.  \n- A large, detailed stone sculpture of a creature is visible inside a darkened entrance, with people walking past it toward the park.\n[120-150s] - A large, white, stone-like statue of Bowser dominates the center of the room, with outstretched arms and a menacing expression.  \n- Behind the statue, a glowing red circular emblem featuring a stylized, menacing face is mounted on a stone wall.  \n- Visitors walk through a corridor with screens displaying game-related imagery, transitioning into a brightly lit, colorful area with a patterned floor.\n[150-180s] - A child in a red shirt runs past a display of Nintendo character statues, including Mario, Luigi, and Yoshi, with a green carpeted floor beneath.  \n- The scene transitions to a dark, stone-walled ride entrance with glowing orange lights and a menacing face above the archway, where guests in ride vehicles are seated.  \n- Inside the ride, illuminated circular screens show animated characters like Mario, Luigi, and Yoshi, with a \"Carnival\" sign visible on one screen.\n[180-210s] - Mario Kart characters (e.g., Mario, Luigi, Bowser) appear as floating stickers around a central screen displaying a racing game.\n- The central screen shows a green track with a red circular target, suggesting a racing or targeting game.\n- Stickers move dynamically around the screen, with some appearing to float or drift in the air, indicating an interactive or animated display.\n[210-240s] - Mario and Luigi race in a kart, with Mario in front, navigating a dark, castle-themed track with glowing torches and stone walls.\n- A large, menacing face emblem appears on a green archway as the racers pass through a tunnel-like section.\n- The camera pans to show a red arrow sign on the right side of the track, indicating a turn or direction change ahead.\n[240-270s] - A menacing, glowing skull emblem is prominently displayed above a green archway, suggesting a boss or gate.\n- Characters including Mario, Luigi, and Toad are seen navigating a dark, industrial-themed level with pipes and platforms.\n- Red and white mushroom enemies (Piranha Plants) are suspended in mid-air, some firing projectiles, while others are positioned near waterfalls or pipes.\n[270-300s] - A large, red, cartoonish fish with sharp teeth and a white face appears, partially obscured by a white, ghost-like figure.  \n- A group of colorful, cartoonish characters (including a yellow one with a hat) swim near the fish, surrounded by bubbles and aquatic plants.  \n- The scene transitions to a dark underwater cave with glowing jellyfish and starfish-like creatures, illuminated by beams of light.\n[300-330s] - Bubbles float upward through a dark, underwater-like environment with glowing fish and skeletal creatures.  \n- A character in a red hat and blue outfit swims near the center, surrounded by bubbles and glowing fish.  \n- The scene transitions to a dimly lit, ornate interior with floating ghost-like figures and glowing objects.\n[330-360s] - A glowing pink beam sweeps across a dark, bookshelf-lined room, illuminating floating character projections.  \n- Characters like Mario and Luigi appear on screens, while a stack of yellow Koopa Troopas stands near the center.  \n- The scene transitions to a surreal, cloud-filled environment with floating platforms and a large, rotating clock-like structure.\n[360-390s] - A small, yellow, cartoonish character rides a rocket-like vehicle through a dark, cloud-filled environment.  \n- The vehicle emits sparks and fire as it moves, suggesting propulsion or combat.  \n- A large, glowing, fiery explosion occurs nearby, with bright light and debris flying outward.\n[390-420s] - A glowing, golden, star-shaped object appears and moves across a dark, textured red surface.  \n- Bright, streaking light trails radiate outward from a central point, suggesting rapid motion or explosion.  \n- A colorful, cartoonish vehicle with a purple roof and red body is seen speeding through the scene, surrounded by light streaks.", "history_tokens": 957, "history_utf8_bytes": 4267, "recent_frame_times_s": [403.0122333333333, 404.01323333333335, 405.0142333333333, 406.01523333333336, 407.01623333333333, 408.0172333333333, 409.01823333333334, 410.0192333333333, 411.02023333333335, 412.0212333333333, 413.02223333333336, 414.02323333333334, 415.0242333333333, 416.02523333333335, 417.0262333333333, 418.02723333333336, 419.02823333333333, 420.0292333333333, 421.03023333333334, 422.0312333333333, 423.03223333333335, 424.0332333333333, 425.00086666666664, 426.0018666666667, 427.00286666666665, 428.0038666666667, 429.00486666666666, 430.0058666666667, 431.00686666666667, 432.00786666666664], "recent_frames_sha256": "26c37aa026b375ccf832245dd06fd00f5b67722de9accd29085e0ef9c7deba37", "num_recent_frames": 30, "tq": 716422.947504882, "t1": 716434.790716855, "ta": 716434.790716855, "te": 716434.982734884, "first_response_s": 11.843211972969584, "answer_total_s": 12.03523000201676, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 321, "content_group": "36a3440a72b5c86064e8e466c919b5619762c44e2d2331563078d459c0adc0cd", "question": {"question_id": "sample_321_a1383_q0", "video_id": 321, "video_path": "./videos/sample_321_real.mp4", "annotation_index": 1383, "question_index": 0, "question": "What is the pattern of the wallpaper in the room?", "options": ["A. Striped pattern in red and beige.", "B. Diamond pattern in shades of yellow ,orange and beige.", "C. Floral pattern in shades of red and green.", "D. Geometric pattern in shades of green and beige."], "answer": "B", "time_stamp_s": 20, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_321_a1383_q0", "video_id": 321, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b7ae2f26b9a42f8a79b92aae3dbf2c9225ead9cc087c9455cbf4c086bb689622", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.043, 1.0106333333333333, 2.011633333333333, 3.0126333333333335, 4.013633333333333, 5.014633333333333, 6.015633333333334, 7.016633333333333, 8.017633333333333, 9.018633333333334, 10.019633333333333, 11.020633333333333, 12.021633333333334, 13.022633333333333, 14.023633333333333, 15.024633333333334, 16.02563333333333, 17.026633333333333, 18.027633333333334, 19.02863333333333], "recent_frames_sha256": "940c60371d0e5fd598567f2867abf831d98965745a24d1ea99f611f457c11ae2", "num_recent_frames": 20, "tq": 719756.258367471, "t1": 719756.536832642, "ta": 719756.536832642, "te": 719756.574434031, "first_response_s": 0.2784651709953323, "answer_total_s": 0.31606655998621136, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_321_a1383_q0", "video_id": 321, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1bdc4cc328ac11a101f1824c903302b47bda976a8cf2802ced39bc3baadfecd5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.043, 1.0106333333333333, 2.011633333333333, 3.0126333333333335, 4.013633333333333, 5.014633333333333, 6.015633333333334, 7.016633333333333, 8.017633333333333, 9.018633333333334, 10.019633333333333, 11.020633333333333, 12.021633333333334, 13.022633333333333, 14.023633333333333, 15.024633333333334, 16.02563333333333, 17.026633333333333, 18.027633333333334, 19.02863333333333], "recent_frames_sha256": "940c60371d0e5fd598567f2867abf831d98965745a24d1ea99f611f457c11ae2", "num_recent_frames": 20, "tq": 719621.930670978, "t1": 719633.776295806, "ta": 719633.776295806, "te": 719634.076603349, "first_response_s": 11.84562482801266, "answer_total_s": 12.145932370913215, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 321, "content_group": "36a3440a72b5c86064e8e466c919b5619762c44e2d2331563078d459c0adc0cd", "question": {"question_id": "sample_321_a1384_q0", "video_id": 321, "video_path": "./videos/sample_321_real.mp4", "annotation_index": 1384, "question_index": 0, "question": "What is visible on the green pipes in the amusement park area?", "options": ["A. Coins.", "B. Stars.", "C. \"POW\".", "D. \"1UP\"."], "answer": "C", "time_stamp_s": 165, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_321_a1384_q0", "video_id": 321, "time_stamp_s": 165, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "09461239b5d60dba9ef49e476ca13fd23ba7482af634d6f06a509e776f142532", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [135.01116666666667, 136.01216666666667, 137.01316666666668, 138.01416666666665, 139.01516666666666, 140.01616666666666, 141.01716666666667, 142.01816666666667, 143.01916666666668, 144.02016666666665, 145.02116666666666, 146.02216666666666, 147.02316666666667, 148.02416666666667, 149.02516666666668, 150.02616666666665, 151.02716666666666, 152.02816666666666, 153.02916666666667, 154.03016666666667, 155.03116666666668, 156.03216666666665, 157.03316666666666, 158.0008, 159.0018, 160.0028, 161.0038, 162.0048, 163.0058, 164.0068], "recent_frames_sha256": "3ed07225a1f1df38ecb790b5bb38fb56d17e92878988556d428dabe315411466", "num_recent_frames": 30, "tq": 719756.583149948, "t1": 719760.132140075, "ta": 719760.132140075, "te": 719760.169553527, "first_response_s": 3.54899012693204, "answer_total_s": 3.5864035789854825, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_321_a1384_q0", "video_id": 321, "time_stamp_s": 165, "ground_truth": "C", "raw_output": "C. \"POW\".", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "a2eae02605a2b8c50c9fec272bd65b9854c074597fd932d763fc3a15412a244a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Wooden interior with diamond-patterned walls, green carpet, and rope barriers, featuring a fireplace with a Mario poster above it.  \n- Windows display animated scenes, possibly from a game or attraction, while people walk through the space.  \n- A counter area with multiple screens and a large, round, red object (possibly a game or interactive display) is visible in the background.\n[30-60s] - Large, striped, candy-themed booths and tables are arranged in a circular layout, with some occupied by guests.  \n- Decorative, oversized barrels and candy cane pillars are positioned around the room, enhancing the whimsical theme.  \n- The ceiling features circular lights and a central green-and-white candy-themed fixture, contributing to the playful ambiance.\n[60-90s] - A Super Star Lemon Squash drink with a yellow straw sits on a wooden table, priced at $10.  \n- A Bowser’s Fireball Challenge dish, featuring a fried pastry and sauce, is displayed with a price tag of $24.99.  \n- A Mt. Beanoole Cake slice, garnished with a small flag, rests on a plate beside the drink, priced at $9.99.\n[90-120s] - A red-and-white mushroom-shaped \"Tenderfoot Cafe\" sign is prominent at the entrance, with people walking past.  \n- A large, stylized blue lamp post with a green base stands near the entrance, adjacent to a stone-like statue.  \n- The \"Mario Kart\" sign is visible on a building with green roofs and checkered flags, indicating a themed area.\n[120-150s] - A yellow, cartoonish character (possibly a Toad) stands atop a green platform with a \"POW\" sign, holding a golden coin and appearing to jump or move slightly.  \n- The character is positioned above a large green pipe, with a backdrop of brown, textured walls resembling a video game level.  \n- Red-and-white tents and crowds of visitors are visible in the foreground, indicating a themed park or event setting.", "history_tokens": 443, "history_utf8_bytes": 1875, "recent_frame_times_s": [135.01116666666667, 136.01216666666667, 137.01316666666668, 138.01416666666665, 139.01516666666666, 140.01616666666666, 141.01716666666667, 142.01816666666667, 143.01916666666668, 144.02016666666665, 145.02116666666666, 146.02216666666666, 147.02316666666667, 148.02416666666667, 149.02516666666668, 150.02616666666665, 151.02716666666666, 152.02816666666666, 153.02916666666667, 154.03016666666667, 155.03116666666668, 156.03216666666665, 157.03316666666666, 158.0008, 159.0018, 160.0028, 161.0038, 162.0048, 163.0058, 164.0068], "recent_frames_sha256": "3ed07225a1f1df38ecb790b5bb38fb56d17e92878988556d428dabe315411466", "num_recent_frames": 30, "tq": 719675.471982018, "t1": 719682.533197729, "ta": 719682.533197729, "te": 719682.774054086, "first_response_s": 7.061215711059049, "answer_total_s": 7.302072067977861, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 321, "content_group": "36a3440a72b5c86064e8e466c919b5619762c44e2d2331563078d459c0adc0cd", "question": {"question_id": "sample_321_a1385_q0", "video_id": 321, "video_path": "./videos/sample_321_real.mp4", "annotation_index": 1385, "question_index": 0, "question": "Where are the metal railings located while descending the stairs?", "options": ["A. On the left side.", "B. On the right side.", "C. On both sides.", "D. At the bottom only."], "answer": "C", "time_stamp_s": 325, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_321_a1385_q0", "video_id": 321, "time_stamp_s": 325, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b02ff4ea360675d2a212d72050061489a1e2e54cdcb950fbd0c820cf4858dbb3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [295.0043333333333, 296.00533333333334, 297.0063333333333, 298.00733333333335, 299.0083333333333, 300.00933333333336, 301.01033333333334, 302.0113333333333, 303.01233333333334, 304.0133333333333, 305.01433333333335, 306.01533333333333, 307.0163333333333, 308.01733333333334, 309.0183333333333, 310.01933333333335, 311.0203333333333, 312.02133333333336, 313.02233333333334, 314.0233333333333, 315.02433333333335, 316.0253333333333, 317.02633333333335, 318.02733333333333, 319.0283333333333, 320.02933333333334, 321.0303333333333, 322.03133333333335, 323.0323333333333, 324.03333333333336], "recent_frames_sha256": "9c3e9cc262aa19a75ae096411fa32f6242a0b400199879dd9a2089527ef5ddd5", "num_recent_frames": 30, "tq": 719760.178028038, "t1": 719763.508159151, "ta": 719763.508159151, "te": 719763.547676584, "first_response_s": 3.3301311129471287, "answer_total_s": 3.3696485459804535, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_321_a1385_q0", "video_id": 321, "time_stamp_s": 325, "ground_truth": "C", "raw_output": "C. On both sides.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "13d70a71ed1c9b240fdbcebc88107c7e142198ef53c46c165b4f2333e6e7cb1f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Wooden interior with diamond-patterned walls, green carpet, and rope barriers, featuring a fireplace with a Mario poster above it.  \n- Windows display animated scenes, possibly from a game or attraction, while people walk through the space.  \n- A counter area with multiple screens and a large, round, red object (possibly a game or interactive display) is visible in the background.\n[30-60s] - Large, striped, candy-themed booths and tables are arranged in a circular layout, with some occupied by guests.  \n- Decorative, oversized barrels and candy cane pillars are positioned around the room, enhancing the whimsical theme.  \n- The ceiling features circular lights and a central green-and-white candy-themed fixture, contributing to the playful ambiance.\n[60-90s] - A Super Star Lemon Squash drink with a yellow straw sits on a wooden table, priced at $10.  \n- A Bowser’s Fireball Challenge dish, featuring a fried pastry and sauce, is displayed with a price tag of $24.99.  \n- A Mt. Beanoole Cake slice, garnished with a small flag, rests on a plate beside the drink, priced at $9.99.\n[90-120s] - A red-and-white mushroom-shaped \"Tenderfoot Cafe\" sign is prominent at the entrance, with people walking past.  \n- A large, stylized blue lamp post with a green base stands near the entrance, adjacent to a stone-like statue.  \n- The \"Mario Kart\" sign is visible on a building with green roofs and checkered flags, indicating a themed area.\n[120-150s] - A yellow, cartoonish character (possibly a Toad) stands atop a green platform with a \"POW\" sign, holding a golden coin and appearing to jump or move slightly.  \n- The character is positioned above a large green pipe, with a backdrop of brown, textured walls resembling a video game level.  \n- Red-and-white tents and crowds of visitors are visible in the foreground, indicating a themed park or event setting.\n[150-180s] - A yellow, cartoonish character (likely a Mario-like figure) stands atop a green pipe, holding a golden coin, with a \"POW\" sign beneath it.  \n- The character remains stationary as the camera pans right, revealing a crowd of visitors gathered below, some near red-and-white tents.  \n- The scene transitions to a stone castle entrance with blue pillars and question mark blocks, where people are entering through a doorway.\n[180-210s] - A person in dark clothing walks up a stone staircase, moving away from the camera.  \n- The staircase has metal railings and is flanked by textured stone walls with embedded lighting.  \n- As the camera ascends, the environment transitions to a dimly lit area with blue ambient lighting and more stone walls.\n[210-240s] - Stone-walled entrance opens to a vibrant, block-themed Mario-themed area with visitors walking through.  \n- A large, colorful mushroom-shaped structure with a \"Story\" sign and a character statue is centrally positioned.  \n- The scene transitions to a wide view of the themed area, featuring bright buildings, green hills, and crowds of people.\n[240-270s] - A yellow turtle-like character stands atop a blue \"POW\" block, facing right, with a golden coin above its head.  \n- The character is positioned on a green platform with brown stone walls, surrounded by pipes and other game elements.  \n- The scene is part of a larger, crowded amusement park attraction with multiple levels and visitors visible below.\n[270-300s] - Yellow character stands on green grassy platform, facing upward toward a glowing purple object above.\n- Platform is part of a larger inflatable structure with brown earth and stone textures, resembling a game level.\n- Camera pans right, revealing a blue stone-walled corridor with two doors and a floating yellow question mark block.", "history_tokens": 849, "history_utf8_bytes": 3697, "recent_frame_times_s": [295.0043333333333, 296.00533333333334, 297.0063333333333, 298.00733333333335, 299.0083333333333, 300.00933333333336, 301.01033333333334, 302.0113333333333, 303.01233333333334, 304.0133333333333, 305.01433333333335, 306.01533333333333, 307.0163333333333, 308.01733333333334, 309.0183333333333, 310.01933333333335, 311.0203333333333, 312.02133333333336, 313.02233333333334, 314.0233333333333, 315.02433333333335, 316.0253333333333, 317.02633333333335, 318.02733333333333, 319.0283333333333, 320.02933333333334, 321.0303333333333, 322.03133333333335, 323.0323333333333, 324.03333333333336], "recent_frames_sha256": "9c3e9cc262aa19a75ae096411fa32f6242a0b400199879dd9a2089527ef5ddd5", "num_recent_frames": 30, "tq": 719711.869704487, "t1": 719712.908195081, "ta": 719712.908195081, "te": 719713.135636506, "first_response_s": 1.0384905940154567, "answer_total_s": 1.2659320189850405, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 321, "content_group": "36a3440a72b5c86064e8e466c919b5619762c44e2d2331563078d459c0adc0cd", "question": {"question_id": "sample_321_a1386_q0", "video_id": 321, "video_path": "./videos/sample_321_real.mp4", "annotation_index": 1386, "question_index": 0, "question": "What does the \"EXIT\" sign point to in the amusement park?", "options": ["A. Right.", "B. Up.", "C. Down.", "D. Left."], "answer": "D", "time_stamp_s": 497, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_321_a1386_q0", "video_id": 321, "time_stamp_s": 497, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3497f6e5b78541c92d05181a8e83857bacebafff9d46c574591bc7a20b442619", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [467.0095, 468.0105, 469.0115, 470.0125, 471.0135, 472.0145, 473.0155, 474.0165, 475.0175, 476.0185, 477.0195, 478.0205, 479.0215, 480.0225, 481.0235, 482.0245, 483.0255, 484.0265, 485.0275, 486.0285, 487.0295, 488.0305, 489.0315, 490.0325, 491.00013333333334, 492.0011333333333, 493.00213333333335, 494.0031333333333, 495.00413333333336, 496.00513333333333], "recent_frames_sha256": "d105867074a063a06e2f5ad7e9b9830f1f5104d1c2749a82230ba0d16bd622fd", "num_recent_frames": 30, "tq": 719763.556935754, "t1": 719767.742818558, "ta": 719767.742818558, "te": 719767.775459639, "first_response_s": 4.185882803983986, "answer_total_s": 4.218523885007016, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_321_a1386_q0", "video_id": 321, "time_stamp_s": 497, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "451a5e277dd021ae81e641874e944eca2bb56be2b1520ec0f61763e5110313ce", "condition_order": ["notes", "recent"], "memory": "[120-150s] - A yellow, cartoonish character (possibly a Toad) stands atop a green platform with a \"POW\" sign, holding a golden coin and appearing to jump or move slightly.  \n- The character is positioned above a large green pipe, with a backdrop of brown, textured walls resembling a video game level.  \n- Red-and-white tents and crowds of visitors are visible in the foreground, indicating a themed park or event setting.\n[150-180s] - A yellow, cartoonish character (likely a Mario-like figure) stands atop a green pipe, holding a golden coin, with a \"POW\" sign beneath it.  \n- The character remains stationary as the camera pans right, revealing a crowd of visitors gathered below, some near red-and-white tents.  \n- The scene transitions to a stone castle entrance with blue pillars and question mark blocks, where people are entering through a doorway.\n[180-210s] - A person in dark clothing walks up a stone staircase, moving away from the camera.  \n- The staircase has metal railings and is flanked by textured stone walls with embedded lighting.  \n- As the camera ascends, the environment transitions to a dimly lit area with blue ambient lighting and more stone walls.\n[210-240s] - Stone-walled entrance opens to a vibrant, block-themed Mario-themed area with visitors walking through.  \n- A large, colorful mushroom-shaped structure with a \"Story\" sign and a character statue is centrally positioned.  \n- The scene transitions to a wide view of the themed area, featuring bright buildings, green hills, and crowds of people.\n[240-270s] - A yellow turtle-like character stands atop a blue \"POW\" block, facing right, with a golden coin above its head.  \n- The character is positioned on a green platform with brown stone walls, surrounded by pipes and other game elements.  \n- The scene is part of a larger, crowded amusement park attraction with multiple levels and visitors visible below.\n[270-300s] - Yellow character stands on green grassy platform, facing upward toward a glowing purple object above.\n- Platform is part of a larger inflatable structure with brown earth and stone textures, resembling a game level.\n- Camera pans right, revealing a blue stone-walled corridor with two doors and a floating yellow question mark block.\n[300-330s] - Camera moves through a stone-walled corridor with wooden doors and ceiling lights, approaching a staircase.  \n- Staircase descends into a dimly lit area with warm lighting, leading toward a brightly lit exit.  \n- At 308, camera enters a room with wooden walls and a glowing orange door, then proceeds down a stone staircase.\n[330-360s] - A large, mushroom-shaped structure dominates the left side of the scene, with people walking beneath its wide cap.  \n- A red-and-white striped tent with \"POKE\" signage is positioned near the right edge, adjacent to a green, brick-style building.  \n- A blue, ornate lamppost stands prominently in the foreground, partially obscuring the view of the crowd as they move through the area.\n[360-390s] - Large mushroom structures with red caps and white spots dominate the foreground, supporting themed walkways.  \n- A crowd of visitors moves through the area, some queuing near a building with a cartoonish, layered facade.  \n- A character resembling Toad peeks out from a window on the building, positioned above the crowd.\n[390-420s] - A large, cartoonish castle with red-roofed towers and stone walls is central, surrounded by crowds and red ropes.  \n- A green, grassy hill with a tree and a small figure (possibly Mario) is visible in the background.  \n- People are walking toward the castle entrance, some carrying umbrellas, under a clear blue sky.\n[420-450s] - A yellow question mark block is mounted on a brick wall, glowing with a white question mark symbol.  \n- A vertical stack of three glowing question mark blocks is visible on the left wall, with the top block labeled \"DOW\" in red text.  \n- The camera pans slightly to the right, revealing a doorway leading to an outdoor area with greenery visible beyond.\n[450-480s] - A child in a red shirt walks toward a wooden doorway with a yellow question mark sign above it.  \n- A group of people, including adults and children, are seen walking through a themed entrance area with stone walls and rope barriers.  \n- The scene transitions to an outdoor area with colorful, cartoonish buildings under a clear blue sky, featuring a large green hill and whimsical architecture.", "history_tokens": 1013, "history_utf8_bytes": 4421, "recent_frame_times_s": [467.0095, 468.0105, 469.0115, 470.0125, 471.0135, 472.0145, 473.0155, 474.0165, 475.0175, 476.0185, 477.0195, 478.0205, 479.0215, 480.0225, 481.0235, 482.0245, 483.0255, 484.0265, 485.0275, 486.0285, 487.0295, 488.0305, 489.0315, 490.0325, 491.00013333333334, 492.0011333333333, 493.00213333333335, 494.0031333333333, 495.00413333333336, 496.00513333333333], "recent_frames_sha256": "d105867074a063a06e2f5ad7e9b9830f1f5104d1c2749a82230ba0d16bd622fd", "num_recent_frames": 30, "tq": 719739.146869706, "t1": 719743.842989713, "ta": 719743.842989713, "te": 719744.028703894, "first_response_s": 4.696120006963611, "answer_total_s": 4.881834188010544, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 321, "content_group": "36a3440a72b5c86064e8e466c919b5619762c44e2d2331563078d459c0adc0cd", "question": {"question_id": "sample_321_a1387_q0", "video_id": 321, "video_path": "./videos/sample_321_real.mp4", "annotation_index": 1387, "question_index": 0, "question": "What becomes more prominent as the viewer ascends the escalator right now?", "options": ["A. The plants on the left side.", "B. The large wall with the dinosaur logo .", "C. The transparent curved glass structure.", "D. The parallel stationary escalator."], "answer": "B", "time_stamp_s": 583, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [540, 583], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_321_a1387_q0", "video_id": 321, "time_stamp_s": 583, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c7990f2d95889da11f04b4801d4648b25cb3c5a7c4b4f446337ae41de95f18d2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [553.0287666666667, 554.0297666666667, 555.0307666666666, 556.0317666666666, 557.0327666666667, 558.0004, 559.0014, 560.0024, 561.0034, 562.0044, 563.0054, 564.0064, 565.0074, 566.0084, 567.0094, 568.0104, 569.0114, 570.0124, 571.0134, 572.0144, 573.0154, 574.0164, 575.0174, 576.0184, 577.0194, 578.0204, 579.0214, 580.0224, 581.0234, 582.0244], "recent_frames_sha256": "ed0d5da9f3f3762fd89fd9a536c86ea2a53e3282af693b5dc08d79c7463607bc", "num_recent_frames": 30, "tq": 719767.781137739, "t1": 719772.788860615, "ta": 719772.788860615, "te": 719772.821862412, "first_response_s": 5.007722876034677, "answer_total_s": 5.0407246730756015, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_321_a1387_q0", "video_id": 321, "time_stamp_s": 583, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "da04753b2bab15aacc21aac53352efa4da9bde7b440e23562541856d03a45db1", "condition_order": ["notes", "recent"], "memory": "[210-240s] - Stone-walled entrance opens to a vibrant, block-themed Mario-themed area with visitors walking through.  \n- A large, colorful mushroom-shaped structure with a \"Story\" sign and a character statue is centrally positioned.  \n- The scene transitions to a wide view of the themed area, featuring bright buildings, green hills, and crowds of people.\n[240-270s] - A yellow turtle-like character stands atop a blue \"POW\" block, facing right, with a golden coin above its head.  \n- The character is positioned on a green platform with brown stone walls, surrounded by pipes and other game elements.  \n- The scene is part of a larger, crowded amusement park attraction with multiple levels and visitors visible below.\n[270-300s] - Yellow character stands on green grassy platform, facing upward toward a glowing purple object above.\n- Platform is part of a larger inflatable structure with brown earth and stone textures, resembling a game level.\n- Camera pans right, revealing a blue stone-walled corridor with two doors and a floating yellow question mark block.\n[300-330s] - Camera moves through a stone-walled corridor with wooden doors and ceiling lights, approaching a staircase.  \n- Staircase descends into a dimly lit area with warm lighting, leading toward a brightly lit exit.  \n- At 308, camera enters a room with wooden walls and a glowing orange door, then proceeds down a stone staircase.\n[330-360s] - A large, mushroom-shaped structure dominates the left side of the scene, with people walking beneath its wide cap.  \n- A red-and-white striped tent with \"POKE\" signage is positioned near the right edge, adjacent to a green, brick-style building.  \n- A blue, ornate lamppost stands prominently in the foreground, partially obscuring the view of the crowd as they move through the area.\n[360-390s] - Large mushroom structures with red caps and white spots dominate the foreground, supporting themed walkways.  \n- A crowd of visitors moves through the area, some queuing near a building with a cartoonish, layered facade.  \n- A character resembling Toad peeks out from a window on the building, positioned above the crowd.\n[390-420s] - A large, cartoonish castle with red-roofed towers and stone walls is central, surrounded by crowds and red ropes.  \n- A green, grassy hill with a tree and a small figure (possibly Mario) is visible in the background.  \n- People are walking toward the castle entrance, some carrying umbrellas, under a clear blue sky.\n[420-450s] - A yellow question mark block is mounted on a brick wall, glowing with a white question mark symbol.  \n- A vertical stack of three glowing question mark blocks is visible on the left wall, with the top block labeled \"DOW\" in red text.  \n- The camera pans slightly to the right, revealing a doorway leading to an outdoor area with greenery visible beyond.\n[450-480s] - A child in a red shirt walks toward a wooden doorway with a yellow question mark sign above it.  \n- A group of people, including adults and children, are seen walking through a themed entrance area with stone walls and rope barriers.  \n- The scene transitions to an outdoor area with colorful, cartoonish buildings under a clear blue sky, featuring a large green hill and whimsical architecture.\n[480-510s] - A large, mushroom-shaped structure with green cap and white spots is visible on the left side of the scene.  \n- A group of people, including adults and children, are walking through the area, some heading toward the entrance of a building with a clock tower.  \n- A blue \"EXIT\" sign with white text is mounted on a decorative lamppost near the center-right of the frame.\n[510-540s] - Camera exits a green tunnel into a sunlit arcade with arched brick walkways and handrails.  \n- People walk along a paved path under arches, transitioning from shaded to open areas with palm trees and outdoor seating.  \n- A \"SANDY'S\" food stand is visible on the right, with pedestrians passing by under clear blue skies.\n[540-570s] - A large \"Jurassic World\" building with a dinosaur-themed entrance arch is visible, surrounded by crowds and palm trees under bright sunlight.\n- People are walking along paved pathways, some near a red umbrella café and others approaching the building's entrance.\n- A sign reading \"ATTENTION: NO PETS ALLOWED\" is visible above escalators leading into the building, indicating access restrictions.", "history_tokens": 1004, "history_utf8_bytes": 4371, "recent_frame_times_s": [553.0287666666667, 554.0297666666667, 555.0307666666666, 556.0317666666666, 557.0327666666667, 558.0004, 559.0014, 560.0024, 561.0034, 562.0044, 563.0054, 564.0064, 565.0074, 566.0084, 567.0094, 568.0104, 569.0114, 570.0124, 571.0134, 572.0144, 573.0154, 574.0164, 575.0174, 576.0184, 577.0194, 578.0204, 579.0214, 580.0224, 581.0234, 582.0244], "recent_frames_sha256": "ed0d5da9f3f3762fd89fd9a536c86ea2a53e3282af693b5dc08d79c7463607bc", "num_recent_frames": 30, "tq": 719755.710237798, "t1": 719756.206094149, "ta": 719756.206094149, "te": 719756.243901965, "first_response_s": 0.495856350986287, "answer_total_s": 0.5336641669273376, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 322, "content_group": "98275f6f0de7924f2f92db84d58fcf80e35db8f3a2235bd6deae6c33b5d3b32b", "question": {"question_id": "sample_322_a2192_q0", "video_id": 322, "video_path": "./videos/sample_322_real.mp4", "annotation_index": 2192, "question_index": 0, "question": "What is prominently featured on the massive concrete building?", "options": ["A. A giant robot.", "B. A T-Rex mural.", "C. A cityscape painting.", "D. A famous portrait."], "answer": "B", "time_stamp_s": 5, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_322_a2192_q0", "video_id": 322, "time_stamp_s": 5, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b568c9044640d00a8d0eb66814d634d5afc43ead6263cac71b871e162129be91", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.042, 1.0096333333333334, 2.0106333333333333, 3.011633333333333, 4.0126333333333335], "recent_frames_sha256": "b094ed1454f814e2a2aafe6f98a7579470d0a5c8a785da6aa72387b75cca9266", "num_recent_frames": 5, "tq": 717712.571172917, "t1": 717719.036990323, "ta": 717719.036990323, "te": 717719.074837464, "first_response_s": 6.46581740595866, "answer_total_s": 6.503664546995424, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_322_a2192_q0", "video_id": 322, "time_stamp_s": 5, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "62cb28661f405a8670745b42bf4005daa036fc9c8d568763986703c7d1ece0cc", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.042, 1.0096333333333334, 2.0106333333333333, 3.011633333333333, 4.0126333333333335], "recent_frames_sha256": "b094ed1454f814e2a2aafe6f98a7579470d0a5c8a785da6aa72387b75cca9266", "num_recent_frames": 5, "tq": 717765.484114947, "t1": 717778.814259359, "ta": 717778.814259359, "te": 717779.043319657, "first_response_s": 13.330144412000664, "answer_total_s": 13.559204709948972, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 322, "content_group": "98275f6f0de7924f2f92db84d58fcf80e35db8f3a2235bd6deae6c33b5d3b32b", "question": {"question_id": "sample_322_a2193_q0", "video_id": 322, "video_path": "./videos/sample_322_real.mp4", "annotation_index": 2193, "question_index": 0, "question": "What was located on the right side of the scene just now?", "options": ["A. A dark gray railing.", "B. A postbox.", "C. A small vehicle.", "D. A tree."], "answer": "B", "time_stamp_s": 202, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_322_a2193_q0", "video_id": 322, "time_stamp_s": 202, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a9591274fee6436d39b62da54f2479e24aa951984b672828c4a5594efe2c45ec", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [172.0138, 173.0148, 174.0158, 175.0168, 176.0178, 177.0188, 178.0198, 179.0208, 180.0218, 181.0228, 182.0238, 183.0248, 184.0258, 185.0268, 186.0278, 187.0288, 188.0298, 189.0308, 190.0318, 191.0328, 192.00043333333332, 193.00143333333332, 194.00243333333333, 195.00343333333333, 196.00443333333334, 197.00543333333334, 198.00643333333332, 199.00743333333332, 200.00843333333333, 201.00943333333333], "recent_frames_sha256": "a115d51f0323072f2d39471b0b9b66ef3110cafa55493dda8fb136544545bcd6", "num_recent_frames": 30, "tq": 717719.088851711, "t1": 717732.693218926, "ta": 717732.693218926, "te": 717732.730468339, "first_response_s": 13.604367214953527, "answer_total_s": 13.641616628039628, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_322_a2193_q0", "video_id": 322, "time_stamp_s": 202, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "75d6845b67e729070cc9157afb4670028dc927e4a9b5017eb8c19fb56f5c5432", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Camera moves upward on escalators toward a glass-domed entrance with a large T-Rex mural on the adjacent building.  \n- People walk along a covered walkway under a transparent arched roof, approaching the entrance.  \n- A \"RECEPTION DESK\" sign is visible on an escalator, indicating direction to visitor services.\n[30-60s] - A person in a red jacket walks forward on the escalator, moving away from the camera.  \n- Other passengers are visible on adjacent escalators, some standing, others walking.  \n- The escalator is enclosed under a glass roof with palm trees visible along the sides.\n[60-90s] - Two individuals in red and black jackets ascend an escalator, moving upward toward the exit.  \n- The escalator is flanked by glass panels and palm trees, with a curved architectural design overhead.  \n- A \"Lift\" sign is visible on the right wall, indicating nearby elevator access.\n[90-120s] - A person in a red jacket walks down a long, covered escalator, moving away from the camera.  \n- The escalator is flanked by glass panels and metal railings, with multiple people ascending and descending.  \n- A sign above the escalator reads \"SOUTH BOUND\" and \"UP\" with an arrow pointing upward.\n[120-150s] - People ascend on escalators under a glass-domed structure, with some looking toward the camera.  \n- A red circular sign with a white \"no smoking\" symbol is visible on the escalator’s side panel.  \n- The background reveals construction cranes and buildings under a clear blue sky.\n[150-180s] - People ascend and descend escalators under a glass-domed structure, with some pausing to look around.  \n- The scene transitions to an open plaza with pedestrians walking, framed by distant mountains and urban buildings.  \n- A large billboard is visible on the right, displaying colorful imagery against a clear blue sky.", "history_tokens": 430, "history_utf8_bytes": 1825, "recent_frame_times_s": [172.0138, 173.0148, 174.0158, 175.0168, 176.0178, 177.0188, 178.0198, 179.0208, 180.0218, 181.0228, 182.0238, 183.0248, 184.0258, 185.0268, 186.0278, 187.0288, 188.0298, 189.0308, 190.0318, 191.0328, 192.00043333333332, 193.00143333333332, 194.00243333333333, 195.00343333333333, 196.00443333333334, 197.00543333333334, 198.00643333333332, 199.00743333333332, 200.00843333333333, 201.00943333333333], "recent_frames_sha256": "a115d51f0323072f2d39471b0b9b66ef3110cafa55493dda8fb136544545bcd6", "num_recent_frames": 30, "tq": 717822.716197068, "t1": 717825.630089623, "ta": 717825.630089623, "te": 717826.067311884, "first_response_s": 2.913892555050552, "answer_total_s": 3.35111481603235, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 322, "content_group": "98275f6f0de7924f2f92db84d58fcf80e35db8f3a2235bd6deae6c33b5d3b32b", "question": {"question_id": "sample_322_a2194_q0", "video_id": 322, "video_path": "./videos/sample_322_real.mp4", "annotation_index": 2194, "question_index": 0, "question": "What material are the picnic tables and benches made of?", "options": ["A. Wood.", "B. Plastic.", "C. Metal mesh.", "D. Concrete."], "answer": "C", "time_stamp_s": 420, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_322_a2194_q0", "video_id": 322, "time_stamp_s": 420, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2dff5486633b2873f2ee5befa8e4fed17bc0cdc8a47b8e378c4c0ce18bb513e9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [390.0316, 391.0326, 392.0002333333333, 393.00123333333335, 394.0022333333333, 395.00323333333336, 396.00423333333333, 397.0052333333333, 398.00623333333334, 399.0072333333333, 400.00823333333335, 401.0092333333333, 402.01023333333336, 403.01123333333334, 404.0122333333333, 405.01323333333335, 406.0142333333333, 407.01523333333336, 408.01623333333333, 409.0172333333333, 410.01823333333334, 411.0192333333333, 412.02023333333335, 413.0212333333333, 414.02223333333336, 415.02323333333334, 416.0242333333333, 417.02523333333335, 418.0262333333333, 419.02723333333336], "recent_frames_sha256": "287257c09655736ef7d101c8315cc026ae10a5583d49caf843baa47db9b1bb05", "num_recent_frames": 30, "tq": 717732.742760595, "t1": 717744.43421427, "ta": 717744.43421427, "te": 717744.478128269, "first_response_s": 11.69145367492456, "answer_total_s": 11.73536767391488, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_322_a2194_q0", "video_id": 322, "time_stamp_s": 420, "ground_truth": "C", "raw_output": "C. Metal mesh.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "d6ff0d89651a2d8581d17e982157a87cf0a817072aee2b3a0964d4db295a1999", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Two individuals in red and black jackets ascend an escalator, moving upward toward the exit.  \n- The escalator is flanked by glass panels and palm trees, with a curved architectural design overhead.  \n- A \"Lift\" sign is visible on the right wall, indicating nearby elevator access.\n[90-120s] - A person in a red jacket walks down a long, covered escalator, moving away from the camera.  \n- The escalator is flanked by glass panels and metal railings, with multiple people ascending and descending.  \n- A sign above the escalator reads \"SOUTH BOUND\" and \"UP\" with an arrow pointing upward.\n[120-150s] - People ascend on escalators under a glass-domed structure, with some looking toward the camera.  \n- A red circular sign with a white \"no smoking\" symbol is visible on the escalator’s side panel.  \n- The background reveals construction cranes and buildings under a clear blue sky.\n[150-180s] - People ascend and descend escalators under a glass-domed structure, with some pausing to look around.  \n- The scene transitions to an open plaza with pedestrians walking, framed by distant mountains and urban buildings.  \n- A large billboard is visible on the right, displaying colorful imagery against a clear blue sky.\n[180-210s] - Pedestrians walk along a paved pathway near a railing, with construction sites and cranes visible in the background.  \n- A tree stands near the railing, partially obscuring the view of the construction area.  \n- The camera pans to reveal a wide urban landscape with buildings, green fields, and distant mountains under a clear blue sky.\n[210-240s] - A red car drives along a paved road, passing through a landscaped area with trees and shrubs.  \n- A modern glass building with a curved facade is visible on the left, adjacent to a construction site with cranes and exposed earth.  \n- A pedestrian pathway with benches and potted plants runs parallel to the road, with people walking along it.\n[240-270s] - A person in a red jacket ascends a central escalator, flanked by two parallel escalators.  \n- The escalators are enclosed under a curved glass and metal roof, with sunlight streaming through.  \n- People are visible on both sides of the central escalator, some standing still, others moving.\n[270-300s] - Two individuals in red and dark clothing ascend a central escalator, moving away from the camera.  \n- The escalator is flanked by mirrored side panels and enclosed under a curved glass roof, with sunlight streaming through.  \n- At the top, the escalator leads to an open-air walkway with visible outdoor seating and a red umbrella.\n[300-330s] - A person in a red jacket walks forward, slightly ahead of another person in dark clothing, both moving along a paved pathway.  \n- A large \"TOY STORY\" archway spans the walkway, with visible signage and decorative elements, indicating an amusement park entrance.  \n- The scene includes various storefronts, palm trees, and a yellow food truck on the right, with people casually strolling or standing nearby.\n[330-360s] - A \"Moe's Tavern\" building with a pink facade and red signage is visible, with people walking past it.  \n- A row of green, bush-like structures with yellow faces and red \"Duff\" signs is positioned along a brick wall on the right.  \n- The camera pans right, revealing more of the themed street, including construction cranes and buildings in the background.\n[360-390s] - A large, cartoonish insect head (likely a bee) is mounted above a yellow building labeled \"MARTIN TACOS,\" with green umbrellas and tables in front.\n- A brick building with a sign reading \"DUFFY'S\" and a \"Duff\" logo on the ground is visible, with a red \"Duff\" sign hanging from the archway.\n- The scene includes string lights overhead and a clear blue sky, suggesting a sunny day.\n[390-420s] - Green metal tables and chairs are arranged in rows under a covered patio with exposed ceiling beams and hanging fans.  \n- A brick wall with mounted TV screens and colorful posters (including one for \"The Mummy\" movie) lines the patio area.  \n- The camera pans right, revealing more green tables and chairs, with a hedge and a \"Are You Ready to Be Invited?\" poster visible near the entrance.", "history_tokens": 990, "history_utf8_bytes": 4169, "recent_frame_times_s": [390.0316, 391.0326, 392.0002333333333, 393.00123333333335, 394.0022333333333, 395.00323333333336, 396.00423333333333, 397.0052333333333, 398.00623333333334, 399.0072333333333, 400.00823333333335, 401.0092333333333, 402.01023333333336, 403.01123333333334, 404.0122333333333, 405.01323333333335, 406.0142333333333, 407.01523333333336, 408.01623333333333, 409.0172333333333, 410.01823333333334, 411.0192333333333, 412.02023333333335, 413.0212333333333, 414.02223333333336, 415.02323333333334, 416.0242333333333, 417.02523333333335, 418.0262333333333, 419.02723333333336], "recent_frames_sha256": "287257c09655736ef7d101c8315cc026ae10a5583d49caf843baa47db9b1bb05", "num_recent_frames": 30, "tq": 717907.906876687, "t1": 717909.387145085, "ta": 717909.387145085, "te": 717909.579642956, "first_response_s": 1.4802683980669826, "answer_total_s": 1.6727662690682337, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 322, "content_group": "98275f6f0de7924f2f92db84d58fcf80e35db8f3a2235bd6deae6c33b5d3b32b", "question": {"question_id": "sample_322_a2195_q1", "video_id": 322, "video_path": "./videos/sample_322_real.mp4", "annotation_index": 2195, "question_index": 1, "question": "What is located in front of the building directly ahead in the middle of the street?", "options": ["A. A café.", "B. A box office.", "C. A small stand with an umbrella.", "D. A mural."], "answer": "C", "time_stamp_s": 600, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [600, 660], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_322_a2195_q1", "video_id": 322, "time_stamp_s": 600, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4b1f1fc8a4bf1ef911e1381d9214cc297292e27acd1a7a02192f75b56286b434", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [570.0114, 571.0124, 572.0134, 573.0144, 574.0154, 575.0164, 576.0174, 577.0184, 578.0194, 579.0204, 580.0214, 581.0224, 582.0234, 583.0244, 584.0254, 585.0264, 586.0274, 587.0284, 588.0294, 589.0304, 590.0314, 591.0324, 592.0000333333334, 593.0010333333333, 594.0020333333333, 595.0030333333333, 596.0040333333334, 597.0050333333334, 598.0060333333333, 599.0070333333333], "recent_frames_sha256": "330ec499b541ccc9fca4968a1350c8377e8ca47b4646485568153127989038c3", "num_recent_frames": 30, "tq": 717744.490345876, "t1": 717756.942654172, "ta": 717756.942654172, "te": 717756.980657234, "first_response_s": 12.452308295993134, "answer_total_s": 12.490311358007602, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_322_a2195_q1", "video_id": 322, "time_stamp_s": 600, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9a59edc9b52f0c03853466c7641fe86469414c349912c2feec1d15a80ef8cb7c", "condition_order": ["recent", "notes"], "memory": "[270-300s] - Two individuals in red and dark clothing ascend a central escalator, moving away from the camera.  \n- The escalator is flanked by mirrored side panels and enclosed under a curved glass roof, with sunlight streaming through.  \n- At the top, the escalator leads to an open-air walkway with visible outdoor seating and a red umbrella.\n[300-330s] - A person in a red jacket walks forward, slightly ahead of another person in dark clothing, both moving along a paved pathway.  \n- A large \"TOY STORY\" archway spans the walkway, with visible signage and decorative elements, indicating an amusement park entrance.  \n- The scene includes various storefronts, palm trees, and a yellow food truck on the right, with people casually strolling or standing nearby.\n[330-360s] - A \"Moe's Tavern\" building with a pink facade and red signage is visible, with people walking past it.  \n- A row of green, bush-like structures with yellow faces and red \"Duff\" signs is positioned along a brick wall on the right.  \n- The camera pans right, revealing more of the themed street, including construction cranes and buildings in the background.\n[360-390s] - A large, cartoonish insect head (likely a bee) is mounted above a yellow building labeled \"MARTIN TACOS,\" with green umbrellas and tables in front.\n- A brick building with a sign reading \"DUFFY'S\" and a \"Duff\" logo on the ground is visible, with a red \"Duff\" sign hanging from the archway.\n- The scene includes string lights overhead and a clear blue sky, suggesting a sunny day.\n[390-420s] - Green metal tables and chairs are arranged in rows under a covered patio with exposed ceiling beams and hanging fans.  \n- A brick wall with mounted TV screens and colorful posters (including one for \"The Mummy\" movie) lines the patio area.  \n- The camera pans right, revealing more green tables and chairs, with a hedge and a \"Are You Ready to Be Invited?\" poster visible near the entrance.\n[420-450s] - A large crane is visible in the background, positioned near a construction site.  \n- People are walking along a paved pathway, passing by colorful storefronts and outdoor seating areas.  \n- A red umbrella and a green umbrella are visible in the foreground, with a few individuals seated or standing nearby.\n[450-480s] - A black construction wall with \"Fast & Furious\" branding and a car image is visible, positioned to the right of the path.  \n- People walk along the sidewalk, some carrying bags or pushing strollers, moving toward the background.  \n- A tall crane structure is visible in the distance, above the construction area.\n[480-510s] - A large \"Fast & Furious\" mural with a black muscle car and smoke effect is visible on a black wall, partially obscured by a construction crane.  \n- The camera pans right, revealing a bustling pedestrian area with people walking under a bright blue sky, passing by a \"Cocina\" restaurant and a decorative archway.  \n- The scene transitions to show a street lined with palm trees and buildings, with the \"Fast & Furious\" mural still visible on the left side of the frame.\n[510-540s] - A large mural of a vintage car with purple smoke effects is painted on a dark gray wall on the right side of the street.  \n- A red and white food cart with a sign reading \"Burger\" is parked on the left side of the street, near a tree.  \n- A yellow building with a red awning and greenery on its facade is visible at the corner of the street, with a crane in the background.\n[540-570s] - A wide, open plaza with palm trees and a large building with a spire in the background under a clear blue sky.\n- A bench with a \"UNIVERSAL\" logo is visible in the foreground, positioned near a pergola structure.\n- The plaza is mostly empty, with only a few tables and umbrellas set up, suggesting a quiet or off-peak time.\n[570-600s] - A man in a dark jacket and beige pants walks away from the camera under a covered walkway.  \n- Outdoor seating areas with beige and red umbrellas are visible, mostly empty, under bright sunlight.  \n- A teal building with \"FOUNTAIN\" signage and a checkered pattern is prominent on the right side of the street.", "history_tokens": 985, "history_utf8_bytes": 4104, "recent_frame_times_s": [570.0114, 571.0124, 572.0134, 573.0144, 574.0154, 575.0164, 576.0174, 577.0184, 578.0194, 579.0204, 580.0214, 581.0224, 582.0234, 583.0244, 584.0254, 585.0264, 586.0274, 587.0284, 588.0294, 589.0304, 590.0314, 591.0324, 592.0000333333334, 593.0010333333333, 594.0020333333333, 595.0030333333333, 596.0040333333334, 597.0050333333334, 598.0060333333333, 599.0070333333333], "recent_frames_sha256": "330ec499b541ccc9fca4968a1350c8377e8ca47b4646485568153127989038c3", "num_recent_frames": 30, "tq": 717964.583271861, "t1": 717965.571328207, "ta": 717965.571328207, "te": 717965.611126124, "first_response_s": 0.9880563460756093, "answer_total_s": 1.0278542630840093, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 322, "content_group": "98275f6f0de7924f2f92db84d58fcf80e35db8f3a2235bd6deae6c33b5d3b32b", "question": {"question_id": "sample_322_a2195_q0", "video_id": 322, "video_path": "./videos/sample_322_real.mp4", "annotation_index": 2195, "question_index": 0, "question": "What is prominently displayed on the marquee of the tall building to the left?", "options": ["A. Café Entrance.", "B. Box Office.", "C. Storefronts.", "D. Green Awning."], "answer": "B", "time_stamp_s": 605, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [600, 660], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_322_a2195_q0", "video_id": 322, "time_stamp_s": 605, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "edba0477a53d3fbed1c2168286d1ffe8a139961c9169161ca61502cb0b6c2dec", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [575.0164, 576.0174, 577.0184, 578.0194, 579.0204, 580.0214, 581.0224, 582.0234, 583.0244, 584.0254, 585.0264, 586.0274, 587.0284, 588.0294, 589.0304, 590.0314, 591.0324, 592.0000333333334, 593.0010333333333, 594.0020333333333, 595.0030333333333, 596.0040333333334, 597.0050333333334, 598.0060333333333, 599.0070333333333, 600.0080333333333, 601.0090333333334, 602.0100333333334, 603.0110333333333, 604.0120333333333], "recent_frames_sha256": "32953faafb518d49d784a1e24feda7a94662f23daf3f80010e6803646bc9174a", "num_recent_frames": 30, "tq": 717756.990327386, "t1": 717765.438216335, "ta": 717765.438216335, "te": 717765.476503743, "first_response_s": 8.447888949071057, "answer_total_s": 8.486176357022487, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_322_a2195_q0", "video_id": 322, "time_stamp_s": 605, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "07e05d13b3582dd08284c013f0aa736cc95d851d16a192e9a1fc30d2f0547429", "condition_order": ["recent", "notes"], "memory": "[270-300s] - Two individuals in red and dark clothing ascend a central escalator, moving away from the camera.  \n- The escalator is flanked by mirrored side panels and enclosed under a curved glass roof, with sunlight streaming through.  \n- At the top, the escalator leads to an open-air walkway with visible outdoor seating and a red umbrella.\n[300-330s] - A person in a red jacket walks forward, slightly ahead of another person in dark clothing, both moving along a paved pathway.  \n- A large \"TOY STORY\" archway spans the walkway, with visible signage and decorative elements, indicating an amusement park entrance.  \n- The scene includes various storefronts, palm trees, and a yellow food truck on the right, with people casually strolling or standing nearby.\n[330-360s] - A \"Moe's Tavern\" building with a pink facade and red signage is visible, with people walking past it.  \n- A row of green, bush-like structures with yellow faces and red \"Duff\" signs is positioned along a brick wall on the right.  \n- The camera pans right, revealing more of the themed street, including construction cranes and buildings in the background.\n[360-390s] - A large, cartoonish insect head (likely a bee) is mounted above a yellow building labeled \"MARTIN TACOS,\" with green umbrellas and tables in front.\n- A brick building with a sign reading \"DUFFY'S\" and a \"Duff\" logo on the ground is visible, with a red \"Duff\" sign hanging from the archway.\n- The scene includes string lights overhead and a clear blue sky, suggesting a sunny day.\n[390-420s] - Green metal tables and chairs are arranged in rows under a covered patio with exposed ceiling beams and hanging fans.  \n- A brick wall with mounted TV screens and colorful posters (including one for \"The Mummy\" movie) lines the patio area.  \n- The camera pans right, revealing more green tables and chairs, with a hedge and a \"Are You Ready to Be Invited?\" poster visible near the entrance.\n[420-450s] - A large crane is visible in the background, positioned near a construction site.  \n- People are walking along a paved pathway, passing by colorful storefronts and outdoor seating areas.  \n- A red umbrella and a green umbrella are visible in the foreground, with a few individuals seated or standing nearby.\n[450-480s] - A black construction wall with \"Fast & Furious\" branding and a car image is visible, positioned to the right of the path.  \n- People walk along the sidewalk, some carrying bags or pushing strollers, moving toward the background.  \n- A tall crane structure is visible in the distance, above the construction area.\n[480-510s] - A large \"Fast & Furious\" mural with a black muscle car and smoke effect is visible on a black wall, partially obscured by a construction crane.  \n- The camera pans right, revealing a bustling pedestrian area with people walking under a bright blue sky, passing by a \"Cocina\" restaurant and a decorative archway.  \n- The scene transitions to show a street lined with palm trees and buildings, with the \"Fast & Furious\" mural still visible on the left side of the frame.\n[510-540s] - A large mural of a vintage car with purple smoke effects is painted on a dark gray wall on the right side of the street.  \n- A red and white food cart with a sign reading \"Burger\" is parked on the left side of the street, near a tree.  \n- A yellow building with a red awning and greenery on its facade is visible at the corner of the street, with a crane in the background.\n[540-570s] - A wide, open plaza with palm trees and a large building with a spire in the background under a clear blue sky.\n- A bench with a \"UNIVERSAL\" logo is visible in the foreground, positioned near a pergola structure.\n- The plaza is mostly empty, with only a few tables and umbrellas set up, suggesting a quiet or off-peak time.\n[570-600s] - A man in a dark jacket and beige pants walks away from the camera under a covered walkway.  \n- Outdoor seating areas with beige and red umbrellas are visible, mostly empty, under bright sunlight.  \n- A teal building with \"FOUNTAIN\" signage and a checkered pattern is prominent on the right side of the street.", "history_tokens": 985, "history_utf8_bytes": 4104, "recent_frame_times_s": [575.0164, 576.0174, 577.0184, 578.0194, 579.0204, 580.0214, 581.0224, 582.0234, 583.0244, 584.0254, 585.0264, 586.0274, 587.0284, 588.0294, 589.0304, 590.0314, 591.0324, 592.0000333333334, 593.0010333333333, 594.0020333333333, 595.0030333333333, 596.0040333333334, 597.0050333333334, 598.0060333333333, 599.0070333333333, 600.0080333333333, 601.0090333333334, 602.0100333333334, 603.0110333333333, 604.0120333333333], "recent_frames_sha256": "32953faafb518d49d784a1e24feda7a94662f23daf3f80010e6803646bc9174a", "num_recent_frames": 30, "tq": 717965.62939096, "t1": 717979.032945268, "ta": 717979.032945268, "te": 717979.436060009, "first_response_s": 13.403554307995364, "answer_total_s": 13.806669048964977, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 323, "content_group": "d3662a55e74999901e37699c3a017687edc58ecabd8b87c9ed4800e94186bdd0", "question": {"question_id": "sample_323_a1443_q0", "video_id": 323, "video_path": "./videos/sample_323_real.mp4", "annotation_index": 1443, "question_index": 0, "question": "What is the temperature displayed on the scene right now?", "options": ["A. 10 degrees Celsius.", "B. 12 degrees Celsius.", "C. 14 degrees Celsius.", "D. 16 degrees Celsius."], "answer": "C", "time_stamp_s": 11, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_323_a1443_q0", "video_id": 323, "time_stamp_s": 11, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7061fdd4ea664bf671130280fbb82fa502801df0b0e85f3966e2ed50f635e57e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0], "recent_frames_sha256": "5e33c150b8735e3ec20cdb60039ba3ddf1abb42e1dab0262abad5e87de585477", "num_recent_frames": 12, "tq": 716906.328393259, "t1": 716912.761676153, "ta": 716912.761676153, "te": 716912.990924321, "first_response_s": 6.433282894082367, "answer_total_s": 6.662531062029302, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_323_a1443_q0", "video_id": 323, "time_stamp_s": 11, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d299cbff0b9d2e17002d62dd53de16dceebc9779d13d0cdfc14db7e71af8ec46", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0], "recent_frames_sha256": "5e33c150b8735e3ec20cdb60039ba3ddf1abb42e1dab0262abad5e87de585477", "num_recent_frames": 12, "tq": 716728.854689496, "t1": 716730.096313892, "ta": 716730.096313892, "te": 716730.143182197, "first_response_s": 1.2416243960615247, "answer_total_s": 1.2884927010163665, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 323, "content_group": "d3662a55e74999901e37699c3a017687edc58ecabd8b87c9ed4800e94186bdd0", "question": {"question_id": "sample_323_a1444_q0", "video_id": 323, "video_path": "./videos/sample_323_real.mp4", "annotation_index": 1444, "question_index": 0, "question": "What occupies the right side of the frame right now?", "options": ["A. A tree.", "B. A telephone booth.", "C. A black car.", "D. A bench."], "answer": "B", "time_stamp_s": 182, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_323_a1444_q0", "video_id": 323, "time_stamp_s": 182, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b7fa0ff5efd944fc670bc7438cb2b01e697539095a3aa1590f64d76b06e8d8c5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0], "recent_frames_sha256": "02cbb866e3d82598d0c6c1b516929fdeb4d34e568d165751f9e25ec6c765286c", "num_recent_frames": 30, "tq": 716913.010863058, "t1": 716921.157571683, "ta": 716921.157571683, "te": 716921.197597676, "first_response_s": 8.146708625019528, "answer_total_s": 8.186734617920592, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_323_a1444_q0", "video_id": 323, "time_stamp_s": 182, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f2585cd82e744dd9e8b23dda85bc51b45ecc9e839bd2d5417da2fa48dcf801df", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pedestrians with umbrellas cross a wet street at a crosswalk in Akhabara, Taito City, under rainy conditions.  \n- A white van and a brown minivan are parked along the roadside, with one van partially visible on the left and the other on the right.  \n- The camera pans right, revealing a sidewalk with orange and yellow tiles, a metal railing, and a storefront with a yellow sign displaying Japanese characters.\n[30-60s] - Pedestrians with umbrellas walk along a wet sidewalk, moving away from the camera.  \n- A silver van passes on the road to the left, while a black car and white van follow.  \n- The sidewalk is bordered by metal railings and trees, with a parked van visible on the right.\n[60-90s] - A white van passes by on the road, moving from left to right, near a crosswalk.  \n- A pedestrian walks along the sidewalk, moving away from the camera’s perspective.  \n- A stone wall with a playground and orange torii gate is visible on the right side of the sidewalk.\n[90-120s] - A silver van passes by on the left, followed by a white SUV, both moving along the wet street.  \n- A pedestrian in a green jacket walks away from the camera on the sidewalk, heading toward the street’s far end.  \n- The sidewalk is lined with parked cars and bordered by a metal railing, with trees and a fence visible on the right.\n[120-150s] - A white van with a yellow license plate is parked on the left side of the wet street, partially obstructing the sidewalk.  \n- Several pedestrians, some holding transparent umbrellas, walk along the orange-tiled sidewalk, moving away from the camera.  \n- A white truck with a red logo drives past the van, heading down the street, while a few people with umbrellas walk toward the camera on the sidewalk.\n[150-180s] - A person in a beige coat walks away from the camera, holding a white umbrella, along a wet brick sidewalk.  \n- A white car and a blue truck pass on the adjacent road, with a yellow bus visible further down the street.  \n- Orange traffic cones line the sidewalk near a modern building, indicating construction or roadwork.", "history_tokens": 494, "history_utf8_bytes": 2081, "recent_frame_times_s": [153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0], "recent_frames_sha256": "02cbb866e3d82598d0c6c1b516929fdeb4d34e568d165751f9e25ec6c765286c", "num_recent_frames": 30, "tq": 716786.817384242, "t1": 716787.648257342, "ta": 716787.648257342, "te": 716787.844569263, "first_response_s": 0.8308731000870466, "answer_total_s": 1.0271850210847333, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 323, "content_group": "d3662a55e74999901e37699c3a017687edc58ecabd8b87c9ed4800e94186bdd0", "question": {"question_id": "sample_323_a1445_q0", "video_id": 323, "video_path": "./videos/sample_323_real.mp4", "annotation_index": 1445, "question_index": 0, "question": "What happens to the man in the black hoodie as the video progresses?", "options": ["A. He runs towards the camera.", "B. He stops walking.", "C. He moves out of frame.", "D. He drops his umbrella."], "answer": "C", "time_stamp_s": 366, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_323_a1445_q0", "video_id": 323, "time_stamp_s": 366, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c4d2a2cdfafe72439d304680f101e4b6131d0ccd8119ed4d969d4389a2abd9d6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0], "recent_frames_sha256": "b4c9821f29db5acf7267ebfc2cc8baf9708145b2be6824e377d6733f9bad544a", "num_recent_frames": 30, "tq": 716921.214240733, "t1": 716935.17222729, "ta": 716935.17222729, "te": 716935.209594958, "first_response_s": 13.957986557041295, "answer_total_s": 13.995354225044139, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_323_a1445_q0", "video_id": 323, "time_stamp_s": 366, "ground_truth": "C", "raw_output": "C. He moves out of frame.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "36edfb39990eaa3c7ab3699e9306920a727d35a98d96f3409844ce040e486493", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pedestrians with umbrellas cross a wet street at a crosswalk in Akhabara, Taito City, under rainy conditions.  \n- A white van and a brown minivan are parked along the roadside, with one van partially visible on the left and the other on the right.  \n- The camera pans right, revealing a sidewalk with orange and yellow tiles, a metal railing, and a storefront with a yellow sign displaying Japanese characters.\n[30-60s] - Pedestrians with umbrellas walk along a wet sidewalk, moving away from the camera.  \n- A silver van passes on the road to the left, while a black car and white van follow.  \n- The sidewalk is bordered by metal railings and trees, with a parked van visible on the right.\n[60-90s] - A white van passes by on the road, moving from left to right, near a crosswalk.  \n- A pedestrian walks along the sidewalk, moving away from the camera’s perspective.  \n- A stone wall with a playground and orange torii gate is visible on the right side of the sidewalk.\n[90-120s] - A silver van passes by on the left, followed by a white SUV, both moving along the wet street.  \n- A pedestrian in a green jacket walks away from the camera on the sidewalk, heading toward the street’s far end.  \n- The sidewalk is lined with parked cars and bordered by a metal railing, with trees and a fence visible on the right.\n[120-150s] - A white van with a yellow license plate is parked on the left side of the wet street, partially obstructing the sidewalk.  \n- Several pedestrians, some holding transparent umbrellas, walk along the orange-tiled sidewalk, moving away from the camera.  \n- A white truck with a red logo drives past the van, heading down the street, while a few people with umbrellas walk toward the camera on the sidewalk.\n[150-180s] - A person in a beige coat walks away from the camera, holding a white umbrella, along a wet brick sidewalk.  \n- A white car and a blue truck pass on the adjacent road, with a yellow bus visible further down the street.  \n- Orange traffic cones line the sidewalk near a modern building, indicating construction or roadwork.\n[180-210s] - A person in a white coat walks away from the camera, holding a white umbrella, along a wet sidewalk.  \n- A cyclist with a black umbrella crosses the street, moving from right to left, then proceeds to cross a marked pedestrian crosswalk.  \n- A child in a pink outfit walks with an adult, both holding umbrellas, approaching the crosswalk from the right side of the frame.\n[210-240s] - A man in a dark coat walks away from the camera, holding a black umbrella, along a wet sidewalk.  \n- A white van passes on the street, moving in the opposite direction of the man.  \n- A blue umbrella is visible on the right side of the sidewalk, held by a person walking away from the camera.\n[240-270s] - A person in dark clothing walks away from the camera, holding a black umbrella, along a wet sidewalk.  \n- Another individual with a blue umbrella walks toward the camera, passing a building entrance.  \n- The sidewalk features yellow tactile paving and a crosswalk, with a parked van visible on the street.\n[270-300s] - A white van with a visible license plate drives slowly down the wet street, passing pedestrians on the sidewalk.  \n- A man in a dark coat and beige pants walks away from the camera, holding a transparent umbrella, crossing the street.  \n- Several pedestrians, some with umbrellas, are seen crossing the street at a marked crosswalk, including a man in a light blue shirt adjusting his umbrella.\n[300-330s] - A man in a dark coat walks away from the camera, holding a white umbrella, along a wet sidewalk.  \n- A white minivan passes on the street, moving in the opposite direction of the pedestrian.  \n- A pink bus is visible in the distance, approaching the intersection as the camera pans forward.\n[330-360s] - A man in a dark suit walks away from the camera, holding an umbrella, along a wet sidewalk near a \"Black Biz\" store.  \n- A white car is parked on the left side of the street, near a \"CAFE YARE YARE\" sign.  \n- The camera pans left, revealing a wider street with pedestrians and a bridge in the distance, under overcast skies.", "history_tokens": 989, "history_utf8_bytes": 4141, "recent_frame_times_s": [337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0], "recent_frames_sha256": "b4c9821f29db5acf7267ebfc2cc8baf9708145b2be6824e377d6733f9bad544a", "num_recent_frames": 30, "tq": 716836.982293375, "t1": 716844.711355589, "ta": 716844.711355589, "te": 716845.030996997, "first_response_s": 7.72906221402809, "answer_total_s": 8.048703622072935, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 323, "content_group": "d3662a55e74999901e37699c3a017687edc58ecabd8b87c9ed4800e94186bdd0", "question": {"question_id": "sample_323_a1445_q1", "video_id": 323, "video_path": "./videos/sample_323_real.mp4", "annotation_index": 1445, "question_index": 1, "question": "Where is the lone pedestrian with an umbrella located relative to the camera?", "options": ["A. To the left of the street.", "B. Directly behind the camera.", "C. On the right side of the street, walking towards the camera.", "D. In the middle of the street."], "answer": "C", "time_stamp_s": 372, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_323_a1445_q1", "video_id": 323, "time_stamp_s": 372, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6efe9162ec0ee95895e3338695f425f0fcdd55f8c609bdc6b4dd097f1629ae7c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0], "recent_frames_sha256": "bc30d151d97b15c2ba483e2f5963da7376a0c3deb4c8d0b0aa1509e2af04d1e7", "num_recent_frames": 30, "tq": 716935.237736725, "t1": 716947.504275046, "ta": 716947.504275046, "te": 716947.540657955, "first_response_s": 12.26653832104057, "answer_total_s": 12.302921229973435, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_323_a1445_q1", "video_id": 323, "time_stamp_s": 372, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "342bf329f445b44f0ed5ad0ff65900434b38ff177aceb44d482acf6b4f58e659", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pedestrians with umbrellas cross a wet street at a crosswalk in Akhabara, Taito City, under rainy conditions.  \n- A white van and a brown minivan are parked along the roadside, with one van partially visible on the left and the other on the right.  \n- The camera pans right, revealing a sidewalk with orange and yellow tiles, a metal railing, and a storefront with a yellow sign displaying Japanese characters.\n[30-60s] - Pedestrians with umbrellas walk along a wet sidewalk, moving away from the camera.  \n- A silver van passes on the road to the left, while a black car and white van follow.  \n- The sidewalk is bordered by metal railings and trees, with a parked van visible on the right.\n[60-90s] - A white van passes by on the road, moving from left to right, near a crosswalk.  \n- A pedestrian walks along the sidewalk, moving away from the camera’s perspective.  \n- A stone wall with a playground and orange torii gate is visible on the right side of the sidewalk.\n[90-120s] - A silver van passes by on the left, followed by a white SUV, both moving along the wet street.  \n- A pedestrian in a green jacket walks away from the camera on the sidewalk, heading toward the street’s far end.  \n- The sidewalk is lined with parked cars and bordered by a metal railing, with trees and a fence visible on the right.\n[120-150s] - A white van with a yellow license plate is parked on the left side of the wet street, partially obstructing the sidewalk.  \n- Several pedestrians, some holding transparent umbrellas, walk along the orange-tiled sidewalk, moving away from the camera.  \n- A white truck with a red logo drives past the van, heading down the street, while a few people with umbrellas walk toward the camera on the sidewalk.\n[150-180s] - A person in a beige coat walks away from the camera, holding a white umbrella, along a wet brick sidewalk.  \n- A white car and a blue truck pass on the adjacent road, with a yellow bus visible further down the street.  \n- Orange traffic cones line the sidewalk near a modern building, indicating construction or roadwork.\n[180-210s] - A person in a white coat walks away from the camera, holding a white umbrella, along a wet sidewalk.  \n- A cyclist with a black umbrella crosses the street, moving from right to left, then proceeds to cross a marked pedestrian crosswalk.  \n- A child in a pink outfit walks with an adult, both holding umbrellas, approaching the crosswalk from the right side of the frame.\n[210-240s] - A man in a dark coat walks away from the camera, holding a black umbrella, along a wet sidewalk.  \n- A white van passes on the street, moving in the opposite direction of the man.  \n- A blue umbrella is visible on the right side of the sidewalk, held by a person walking away from the camera.\n[240-270s] - A person in dark clothing walks away from the camera, holding a black umbrella, along a wet sidewalk.  \n- Another individual with a blue umbrella walks toward the camera, passing a building entrance.  \n- The sidewalk features yellow tactile paving and a crosswalk, with a parked van visible on the street.\n[270-300s] - A white van with a visible license plate drives slowly down the wet street, passing pedestrians on the sidewalk.  \n- A man in a dark coat and beige pants walks away from the camera, holding a transparent umbrella, crossing the street.  \n- Several pedestrians, some with umbrellas, are seen crossing the street at a marked crosswalk, including a man in a light blue shirt adjusting his umbrella.\n[300-330s] - A man in a dark coat walks away from the camera, holding a white umbrella, along a wet sidewalk.  \n- A white minivan passes on the street, moving in the opposite direction of the pedestrian.  \n- A pink bus is visible in the distance, approaching the intersection as the camera pans forward.\n[330-360s] - A man in a dark suit walks away from the camera, holding an umbrella, along a wet sidewalk near a \"Black Biz\" store.  \n- A white car is parked on the left side of the street, near a \"CAFE YARE YARE\" sign.  \n- The camera pans left, revealing a wider street with pedestrians and a bridge in the distance, under overcast skies.", "history_tokens": 989, "history_utf8_bytes": 4141, "recent_frame_times_s": [343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0], "recent_frames_sha256": "bc30d151d97b15c2ba483e2f5963da7376a0c3deb4c8d0b0aa1509e2af04d1e7", "num_recent_frames": 30, "tq": 716845.043586391, "t1": 716855.926807387, "ta": 716855.926807387, "te": 716855.963984123, "first_response_s": 10.883220996009186, "answer_total_s": 10.920397731941193, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 323, "content_group": "d3662a55e74999901e37699c3a017687edc58ecabd8b87c9ed4800e94186bdd0", "question": {"question_id": "sample_323_a1446_q0", "video_id": 323, "video_path": "./videos/sample_323_real.mp4", "annotation_index": 1446, "question_index": 0, "question": "What was the main activity happening just now?", "options": ["A. People shopping in a market.", "B. People crossing a street on a rainy day.", "C. Cars driving through a busy intersection.", "D. Pedestrians waiting at a bus stop."], "answer": "B", "time_stamp_s": 560, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_323_a1446_q0", "video_id": 323, "time_stamp_s": 560, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b96b326eec5b743c8c9712b04afca2ac68e3758c156aaa856a9be1eabd8b8a7a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0], "recent_frames_sha256": "77c153be289114847a8dedca385d87ff5519354a2e6e1b649d2bc11a5ff24e2c", "num_recent_frames": 30, "tq": 716947.555317643, "t1": 716954.598322122, "ta": 716954.598322122, "te": 716954.635669278, "first_response_s": 7.043004479026422, "answer_total_s": 7.080351634998806, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_323_a1446_q0", "video_id": 323, "time_stamp_s": 560, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "52d48f019eaa047fa01078888fff8ca0771cf68e729dbd020cdaf6fabbaab103", "condition_order": ["notes", "recent"], "memory": "[180-210s] - A person in a white coat walks away from the camera, holding a white umbrella, along a wet sidewalk.  \n- A cyclist with a black umbrella crosses the street, moving from right to left, then proceeds to cross a marked pedestrian crosswalk.  \n- A child in a pink outfit walks with an adult, both holding umbrellas, approaching the crosswalk from the right side of the frame.\n[210-240s] - A man in a dark coat walks away from the camera, holding a black umbrella, along a wet sidewalk.  \n- A white van passes on the street, moving in the opposite direction of the man.  \n- A blue umbrella is visible on the right side of the sidewalk, held by a person walking away from the camera.\n[240-270s] - A person in dark clothing walks away from the camera, holding a black umbrella, along a wet sidewalk.  \n- Another individual with a blue umbrella walks toward the camera, passing a building entrance.  \n- The sidewalk features yellow tactile paving and a crosswalk, with a parked van visible on the street.\n[270-300s] - A white van with a visible license plate drives slowly down the wet street, passing pedestrians on the sidewalk.  \n- A man in a dark coat and beige pants walks away from the camera, holding a transparent umbrella, crossing the street.  \n- Several pedestrians, some with umbrellas, are seen crossing the street at a marked crosswalk, including a man in a light blue shirt adjusting his umbrella.\n[300-330s] - A man in a dark coat walks away from the camera, holding a white umbrella, along a wet sidewalk.  \n- A white minivan passes on the street, moving in the opposite direction of the pedestrian.  \n- A pink bus is visible in the distance, approaching the intersection as the camera pans forward.\n[330-360s] - A man in a dark suit walks away from the camera, holding an umbrella, along a wet sidewalk near a \"Black Biz\" store.  \n- A white car is parked on the left side of the street, near a \"CAFE YARE YARE\" sign.  \n- The camera pans left, revealing a wider street with pedestrians and a bridge in the distance, under overcast skies.\n[360-390s] - Pedestrians cross a wet street with umbrellas, moving from right to left across the frame.  \n- A white van is parked on the left side of the road, stationary near the curb.  \n- The sidewalk has orange and gray tiles, with a metal railing separating it from the road.\n[390-420s] - Pedestrians with umbrellas walk along a wet sidewalk, moving away from the camera toward a modern building with a textured facade.  \n- A large overpass with visible structural supports spans above the sidewalk, with vehicles passing underneath.  \n- Greenery, including bushes and trees, lines the sidewalk, with some flowering plants visible near the building’s entrance.\n[420-450s] - A woman in a white top and black pants walks forward holding a blue umbrella, pulling a black suitcase.  \n- A group of people, including a man in a black suit and another in a beige coat, walk ahead, some with umbrellas, crossing a zebra crossing under an overpass.  \n- The sidewalk is lined with greenery and flower beds, with parked bicycles visible on the left side near a building entrance.\n[450-480s] - A person in a white coat holds a black umbrella while walking across a wet crosswalk.  \n- Another individual in dark clothing walks beside them, also carrying an umbrella.  \n- A transparent umbrella is visible ahead, held by someone walking away from the camera.\n[480-510s] - A person in a black coat holds a transparent umbrella while walking on a wet sidewalk.  \n- A woman in a white top and blue jeans walks with a light blue umbrella, carrying a backpack.  \n- A man in a dark suit walks ahead, holding a dark umbrella, near a storefront with a green neon sign.\n[510-540s] - Pedestrians with umbrellas cross a wet street at a crosswalk under traffic signals.  \n- A yellow and green bus passes on the road, with tall buildings lining the street.  \n- A café with a red awning and signage is visible on the sidewalk, with people walking past.", "history_tokens": 953, "history_utf8_bytes": 3991, "recent_frame_times_s": [531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0], "recent_frames_sha256": "77c153be289114847a8dedca385d87ff5519354a2e6e1b649d2bc11a5ff24e2c", "num_recent_frames": 30, "tq": 716896.925097499, "t1": 716906.157686315, "ta": 716906.157686315, "te": 716906.31602228, "first_response_s": 9.232588815968484, "answer_total_s": 9.390924780978821, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 324, "content_group": "c80394a6a3015d496d942baf31622fa5ac3af98fc89f0cb129654f4fb3c4bdf2", "question": {"question_id": "sample_324_a430_q0", "video_id": 324, "video_path": "./videos/sample_324_real.mp4", "annotation_index": 430, "question_index": 0, "question": "What object is the person holding in the hand?", "options": ["A. A folded umbrella.", "B. A map.", "C. A shopping bag.", "D. A book."], "answer": "A", "time_stamp_s": 3, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_324_a430_q0", "video_id": 324, "time_stamp_s": 3, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5ae45dc907e1afafca3ef945dd706e3d65e34ba4bc89d7d0aabba5107d76b81a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "dbc7ee64b2575daccc889ffb7fa6e132d9e4e8ea83657ec3733b531f623843cd", "num_recent_frames": 4, "tq": 717078.88947878, "t1": 717089.674977891, "ta": 717089.674977891, "te": 717089.712239627, "first_response_s": 10.78549911105074, "answer_total_s": 10.822760847047903, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_324_a430_q0", "video_id": 324, "time_stamp_s": 3, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ff660984363f22e7e31c8c6d07302768bcc9c1f3c2027534a952a5b7931bd0ab", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "dbc7ee64b2575daccc889ffb7fa6e132d9e4e8ea83657ec3733b531f623843cd", "num_recent_frames": 4, "tq": 716856.003882023, "t1": 716868.384287447, "ta": 716868.384287447, "te": 716868.543085274, "first_response_s": 12.380405423929915, "answer_total_s": 12.539203251013532, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 324, "content_group": "c80394a6a3015d496d942baf31622fa5ac3af98fc89f0cb129654f4fb3c4bdf2", "question": {"question_id": "sample_324_a431_q0", "video_id": 324, "video_path": "./videos/sample_324_real.mp4", "annotation_index": 431, "question_index": 0, "question": "What is the distinctive feature of the crosswalk?", "options": ["A. It has red and white stripes.", "B. It is marked with white stripes.", "C. It is marked with yellow stripes.", "D. It has green and white stripes."], "answer": "B", "time_stamp_s": 200, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_324_a431_q0", "video_id": 324, "time_stamp_s": 200, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "22d84d63c8c5697475ded82c257c31201eb320ce68a0962e43ad2b5667b4d484", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0], "recent_frames_sha256": "c83b4b13b0e128ef5dfaa0b017d3708d3b156092c68b4eaef4034a1a013919fa", "num_recent_frames": 30, "tq": 717089.722993654, "t1": 717102.537675502, "ta": 717102.537675502, "te": 717102.579919137, "first_response_s": 12.814681848045439, "answer_total_s": 12.856925482978113, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_324_a431_q0", "video_id": 324, "time_stamp_s": 200, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "20323493567b5ef49ea544059b8bac92bdb67968e11fc5b7c248c429167c2d0b", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A person in a white shirt walks with a transparent umbrella across a wet crosswalk in Akishbara, Japan, under heavy rain.  \n- Another individual in a black jacket walks alongside, holding a black umbrella, while a third person in a beige coat walks ahead.  \n- The street is lined with shops, some with closed shutters, and an elevated train track runs parallel to the sidewalk.\n[30-60s] - Pedestrians with umbrellas cross a wet street at a crosswalk under an overpass.  \n- A cyclist with a pink umbrella rides across the street, moving from left to right.  \n- Blue directional arrows painted on the road surface guide traffic flow.\n[60-90s] - A person in a beige coat walks forward with a black umbrella, moving away from the camera.  \n- A woman in a dark coat walks ahead, holding a blue patterned umbrella, positioned to the left of the camera’s view.  \n- A person with a large, colorful umbrella (orange with cartoon designs) walks on the right, partially obscuring the view as they move forward.\n[90-120s] - A person in a beige coat holds a colorful umbrella while walking on a wet sidewalk, passing parked cars and modern buildings.  \n- Another individual with an orange umbrella walks alongside, moving away from the camera toward a street corner.  \n- A third person with a purple umbrella is seen further ahead, walking in the same direction, near a storefront with visible signage.\n[120-150s] - Three pedestrians cross a wet street under umbrellas, with one holding a blue polka-dot umbrella and another a green umbrella.  \n- A white van and a white truck are visible on the road, with the van parked near a bicycle rack.  \n- A red Coca-Cola vending machine and a blue bank branch sign are visible on the sidewalk.\n[150-180s] - A black Uber taxi is parked on the right side of the street, with its rear door open and a person stepping out.  \n- Pedestrians with umbrellas cross the wet street at a marked crosswalk, moving from left to right.  \n- A white van and other vehicles are visible on the road, with some parked or moving slowly near the crosswalk.", "history_tokens": 483, "history_utf8_bytes": 2075, "recent_frame_times_s": [171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0], "recent_frames_sha256": "c83b4b13b0e128ef5dfaa0b017d3708d3b156092c68b4eaef4034a1a013919fa", "num_recent_frames": 30, "tq": 716911.790302997, "t1": 716919.982454833, "ta": 716919.982454833, "te": 716920.135742446, "first_response_s": 8.192151836003177, "answer_total_s": 8.345439448952675, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 324, "content_group": "c80394a6a3015d496d942baf31622fa5ac3af98fc89f0cb129654f4fb3c4bdf2", "question": {"question_id": "sample_324_a432_q0", "video_id": 324, "video_path": "./videos/sample_324_real.mp4", "annotation_index": 432, "question_index": 0, "question": "What is the overall weather condition depicted in the video?", "options": ["A. Sunny.", "B. Snowy.", "C. Rainy.", "D. Foggy."], "answer": "C", "time_stamp_s": 379, "task_type": "Causal Reasoning", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_324_a432_q0", "video_id": 324, "time_stamp_s": 379, "ground_truth": "C", "raw_output": "C. Rainy.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "2fee95a56a334e8a9533a4392e121c6f57fa12ec9cea751de8d61714ca581fc7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0], "recent_frames_sha256": "59f5f5ccbf2de47aa0d1a10c5e075e30ff5b04a155b8e2de16868cac39d49606", "num_recent_frames": 30, "tq": 717102.593346156, "t1": 717114.694029945, "ta": 717114.694029945, "te": 717114.883211557, "first_response_s": 12.100683789001778, "answer_total_s": 12.289865401107818, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_324_a432_q0", "video_id": 324, "time_stamp_s": 379, "ground_truth": "C", "raw_output": "C. Rainy.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "be0c49258d2639fbb5a582fd3585c8d8e50bac7d6efce4425ee41f72df69a240", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A person in a white shirt walks with a transparent umbrella across a wet crosswalk in Akishbara, Japan, under heavy rain.  \n- Another individual in a black jacket walks alongside, holding a black umbrella, while a third person in a beige coat walks ahead.  \n- The street is lined with shops, some with closed shutters, and an elevated train track runs parallel to the sidewalk.\n[30-60s] - Pedestrians with umbrellas cross a wet street at a crosswalk under an overpass.  \n- A cyclist with a pink umbrella rides across the street, moving from left to right.  \n- Blue directional arrows painted on the road surface guide traffic flow.\n[60-90s] - A person in a beige coat walks forward with a black umbrella, moving away from the camera.  \n- A woman in a dark coat walks ahead, holding a blue patterned umbrella, positioned to the left of the camera’s view.  \n- A person with a large, colorful umbrella (orange with cartoon designs) walks on the right, partially obscuring the view as they move forward.\n[90-120s] - A person in a beige coat holds a colorful umbrella while walking on a wet sidewalk, passing parked cars and modern buildings.  \n- Another individual with an orange umbrella walks alongside, moving away from the camera toward a street corner.  \n- A third person with a purple umbrella is seen further ahead, walking in the same direction, near a storefront with visible signage.\n[120-150s] - Three pedestrians cross a wet street under umbrellas, with one holding a blue polka-dot umbrella and another a green umbrella.  \n- A white van and a white truck are visible on the road, with the van parked near a bicycle rack.  \n- A red Coca-Cola vending machine and a blue bank branch sign are visible on the sidewalk.\n[150-180s] - A black Uber taxi is parked on the right side of the street, with its rear door open and a person stepping out.  \n- Pedestrians with umbrellas cross the wet street at a marked crosswalk, moving from left to right.  \n- A white van and other vehicles are visible on the road, with some parked or moving slowly near the crosswalk.\n[180-210s] - Pedestrians with umbrellas cross a wet street at a crosswalk, moving from right to left in the frame.\n- A cyclist in a yellow jacket rides across the street, passing near the crosswalk.\n- A black car is parked on the right side of the road, partially obscured by a building.\n[210-240s] - A yellow umbrella is carried by a person walking on a wet sidewalk, moving away from the camera.  \n- A white car passes on the road, with pedestrians crossing the street at a crosswalk.  \n- A red \"SUBSCRIBE\" button with a bell icon appears in the bottom right corner of the screen.\n[240-270s] - Pedestrians with umbrellas walk along a wet sidewalk, some carrying bags or wearing jackets.  \n- A red SUV is parked on the street, partially obscured by rain and pedestrians.  \n- A bus stop with orange cones and a bench is visible on the left, near a tree-lined sidewalk.\n[270-300s] - Pedestrians with umbrellas walk along a wet sidewalk, some carrying bags or wearing jackets.  \n- A red car drives past on the street, passing by buildings with visible signage.  \n- The sidewalk is lined with orange traffic cones and metal railings, with a crosswalk visible ahead.\n[300-330s] - A man in dark clothing walks away from the camera, holding a black umbrella, along a wet sidewalk beside a park.  \n- Raindrops streak across the camera lens, obscuring the view of tall glass buildings and green trees in the background.  \n- The sidewalk is lined with yellow tactile paving, and a bicycle rack is visible near a small signpost.\n[330-360s] - A white van drives along the wet road, passing by buildings and pedestrians.  \n- A person walks on the sidewalk holding an umbrella, moving away from the camera.  \n- A blue bus appears on the right side of the road, partially visible as it moves forward.", "history_tokens": 919, "history_utf8_bytes": 3862, "recent_frame_times_s": [350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0], "recent_frames_sha256": "59f5f5ccbf2de47aa0d1a10c5e075e30ff5b04a155b8e2de16868cac39d49606", "num_recent_frames": 30, "tq": 716960.682197071, "t1": 716967.030433825, "ta": 716967.030433825, "te": 716967.265067114, "first_response_s": 6.348236753954552, "answer_total_s": 6.582870042999275, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 324, "content_group": "c80394a6a3015d496d942baf31622fa5ac3af98fc89f0cb129654f4fb3c4bdf2", "question": {"question_id": "sample_324_a433_q0", "video_id": 324, "video_path": "./videos/sample_324_real.mp4", "annotation_index": 433, "question_index": 0, "question": "What was a noticeable feature of the street just now?", "options": ["A. It is lined with colorful flowers.", "B. The road is empty.", "C. It has a lot of parked bicycles and is wet due to rain.", "D. It is empty and dry with clear skies."], "answer": "C", "time_stamp_s": 560, "task_type": "Attribute Recognition", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_324_a433_q0", "video_id": 324, "time_stamp_s": 560, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cea47c53b54027ebc27cb62aae93bab47d45b6fc5380110d03b37f805f5ca898", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0], "recent_frames_sha256": "9e8cfadd4b36a2cc1a1b6d9c10e3fee130b40df3ecd2c9fc38ef0dba46528365", "num_recent_frames": 30, "tq": 717114.893826408, "t1": 717126.548854189, "ta": 717126.548854189, "te": 717126.587578068, "first_response_s": 11.655027781031094, "answer_total_s": 11.693751660059206, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_324_a433_q0", "video_id": 324, "time_stamp_s": 560, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "eba6b1506e8b7395e6cc33c41b20c0c783a221e79fb6dd6fdb84fc3bfff66669", "condition_order": ["notes", "recent"], "memory": "[180-210s] - Pedestrians with umbrellas cross a wet street at a crosswalk, moving from right to left in the frame.\n- A cyclist in a yellow jacket rides across the street, passing near the crosswalk.\n- A black car is parked on the right side of the road, partially obscured by a building.\n[210-240s] - A yellow umbrella is carried by a person walking on a wet sidewalk, moving away from the camera.  \n- A white car passes on the road, with pedestrians crossing the street at a crosswalk.  \n- A red \"SUBSCRIBE\" button with a bell icon appears in the bottom right corner of the screen.\n[240-270s] - Pedestrians with umbrellas walk along a wet sidewalk, some carrying bags or wearing jackets.  \n- A red SUV is parked on the street, partially obscured by rain and pedestrians.  \n- A bus stop with orange cones and a bench is visible on the left, near a tree-lined sidewalk.\n[270-300s] - Pedestrians with umbrellas walk along a wet sidewalk, some carrying bags or wearing jackets.  \n- A red car drives past on the street, passing by buildings with visible signage.  \n- The sidewalk is lined with orange traffic cones and metal railings, with a crosswalk visible ahead.\n[300-330s] - A man in dark clothing walks away from the camera, holding a black umbrella, along a wet sidewalk beside a park.  \n- Raindrops streak across the camera lens, obscuring the view of tall glass buildings and green trees in the background.  \n- The sidewalk is lined with yellow tactile paving, and a bicycle rack is visible near a small signpost.\n[330-360s] - A white van drives along the wet road, passing by buildings and pedestrians.  \n- A person walks on the sidewalk holding an umbrella, moving away from the camera.  \n- A blue bus appears on the right side of the road, partially visible as it moves forward.\n[360-390s] - A black taxi with \"TAXI\" branding and license plate \"15-11\" is parked on the street, facing away from the camera.  \n- A blue garbage truck with \"東京市\" (Tokyo City) text is driving slowly on the road, positioned behind the taxi.  \n- Pedestrians with umbrellas walk along a wet brick sidewalk, moving away from the camera toward the buildings.\n[390-420s] - Blue garbage truck with \"東京\" text parked on wet street, partially blocking sidewalk.  \n- Pedestrians with umbrellas cross street at crosswalk, some walking along wet sidewalk near shops.  \n- Black taxi with \"taxi\" sign and green license plate passes crosswalk, followed by white van.\n[420-450s] - A black SUV with orange accents and Japanese license plate is stationary at a wet crosswalk, facing away from the camera.  \n- Pedestrians with umbrellas cross the street in the background, moving from left to right.  \n- A yellow crane is visible on the right side of the street, positioned near a building.\n[450-480s] - A black taxi with \"KATO\" branding is stationary at a wet crosswalk, facing away from the camera.\n- Pedestrians with umbrellas cross the street, moving from right to left, as the traffic light turns green.\n- The camera pans right, revealing a narrow alleyway with closed shop shutters and a bus parked further down the street.\n[480-510s] - A person in a red jacket and blue jeans walks with a transparent umbrella, moving from right to left across a wet crosswalk.  \n- Another individual, wearing a grey shirt and carrying a backpack, walks with a black umbrella, crossing the same crosswalk in the opposite direction.  \n- A blue bus is visible in the background, parked or moving slowly along the street, with raindrops visible on the camera lens.\n[510-540s] - Two pedestrians walk away from the camera under umbrellas along a wet sidewalk, passing parked vehicles and storefronts.  \n- A tree with green leaves stands beside the sidewalk, its branches swaying slightly in the rain.  \n- A white van and a black SUV are parked parallel to the curb, with a bicycle leaning against a railing nearby.", "history_tokens": 940, "history_utf8_bytes": 3876, "recent_frame_times_s": [531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0], "recent_frames_sha256": "9e8cfadd4b36a2cc1a1b6d9c10e3fee130b40df3ecd2c9fc38ef0dba46528365", "num_recent_frames": 30, "tq": 717013.955729342, "t1": 717019.949628685, "ta": 717019.949628685, "te": 717019.987328497, "first_response_s": 5.993899343069643, "answer_total_s": 6.0315991550451145, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 324, "content_group": "c80394a6a3015d496d942baf31622fa5ac3af98fc89f0cb129654f4fb3c4bdf2", "question": {"question_id": "sample_324_a434_q0", "video_id": 324, "video_path": "./videos/sample_324_real.mp4", "annotation_index": 434, "question_index": 0, "question": "Where is the small white building located in the courtyard?", "options": ["A. To the left of the pathway.", "B. At the far end of the courtyard.", "C. Next to the playground.", "D. In the center of the courtyard."], "answer": "B", "time_stamp_s": 719, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [660, 719], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_324_a434_q0", "video_id": 324, "time_stamp_s": 719, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a48032c58b98c5772cd78a084abe0f5bf4f83a62a870b8f7f0981477e80b6b79", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [690.0, 691.0, 692.0, 693.0, 694.0, 695.0, 696.0, 697.0, 698.0, 699.0, 700.0, 701.0, 702.0, 703.0, 704.0, 705.0, 706.0, 707.0, 708.0, 709.0, 710.0, 711.0, 712.0, 713.0, 714.0, 715.0, 716.0, 717.0, 718.0, 719.0], "recent_frames_sha256": "f3d477ee7b8b1f6f5459bf2e08d7d0238d2cd87b2851f85be70560f762671a31", "num_recent_frames": 30, "tq": 717126.595163232, "t1": 717166.230581846, "ta": 717166.230581846, "te": 717166.268046735, "first_response_s": 39.635418614023365, "answer_total_s": 39.672883503022604, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_324_a434_q0", "video_id": 324, "time_stamp_s": 719, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1ed464e10fc1576b8441ed057db3bd60874460623f487bcf8340b67325c3e41a", "condition_order": ["notes", "recent"], "memory": "[300-330s] - A man in dark clothing walks away from the camera, holding a black umbrella, along a wet sidewalk beside a park.  \n- Raindrops streak across the camera lens, obscuring the view of tall glass buildings and green trees in the background.  \n- The sidewalk is lined with yellow tactile paving, and a bicycle rack is visible near a small signpost.\n[330-360s] - A white van drives along the wet road, passing by buildings and pedestrians.  \n- A person walks on the sidewalk holding an umbrella, moving away from the camera.  \n- A blue bus appears on the right side of the road, partially visible as it moves forward.\n[360-390s] - A black taxi with \"TAXI\" branding and license plate \"15-11\" is parked on the street, facing away from the camera.  \n- A blue garbage truck with \"東京市\" (Tokyo City) text is driving slowly on the road, positioned behind the taxi.  \n- Pedestrians with umbrellas walk along a wet brick sidewalk, moving away from the camera toward the buildings.\n[390-420s] - Blue garbage truck with \"東京\" text parked on wet street, partially blocking sidewalk.  \n- Pedestrians with umbrellas cross street at crosswalk, some walking along wet sidewalk near shops.  \n- Black taxi with \"taxi\" sign and green license plate passes crosswalk, followed by white van.\n[420-450s] - A black SUV with orange accents and Japanese license plate is stationary at a wet crosswalk, facing away from the camera.  \n- Pedestrians with umbrellas cross the street in the background, moving from left to right.  \n- A yellow crane is visible on the right side of the street, positioned near a building.\n[450-480s] - A black taxi with \"KATO\" branding is stationary at a wet crosswalk, facing away from the camera.\n- Pedestrians with umbrellas cross the street, moving from right to left, as the traffic light turns green.\n- The camera pans right, revealing a narrow alleyway with closed shop shutters and a bus parked further down the street.\n[480-510s] - A person in a red jacket and blue jeans walks with a transparent umbrella, moving from right to left across a wet crosswalk.  \n- Another individual, wearing a grey shirt and carrying a backpack, walks with a black umbrella, crossing the same crosswalk in the opposite direction.  \n- A blue bus is visible in the background, parked or moving slowly along the street, with raindrops visible on the camera lens.\n[510-540s] - Two pedestrians walk away from the camera under umbrellas along a wet sidewalk, passing parked vehicles and storefronts.  \n- A tree with green leaves stands beside the sidewalk, its branches swaying slightly in the rain.  \n- A white van and a black SUV are parked parallel to the curb, with a bicycle leaning against a railing nearby.\n[540-570s] - A white van is parked at a curb with a \"KIRIN\" sign visible nearby, while pedestrians with umbrellas walk along the wet sidewalk.  \n- A man in a blue shirt and dark pants walks away from the camera, holding a large blue umbrella, passing a closed storefront.  \n- A bicycle with a blue frame is parked near a tree on the sidewalk, with a yellow tactile paving strip visible nearby.\n[570-600s] - A white van drives slowly along the wet street, passing by buildings and trees.  \n- A person walks away from the camera on the sidewalk, holding an umbrella.  \n- A bicycle is parked near a tree, with another bicycle nearby, both on the wet pavement.\n[600-630s] - A white van drives along the wet street, passing a green-painted bike lane.  \n- A person walks on the sidewalk holding an umbrella, moving away from the camera.  \n- A cyclist rides along the green bike lane, passing the van and the pedestrian.\n[630-660s] - A white van drives past the camera on a wet road, moving away from the viewer.  \n- Green-painted bike lanes with metal railings line the street, separating traffic from a sidewalk.  \n- Raindrops are visible on the camera lens, indicating ongoing precipitation.\n[660-690s] - Raindrops visibly fall on wet pavement, reflecting light and creating puddles.  \n- A person walks away from the camera, holding a blue umbrella, moving along the right sidewalk.  \n- The camera pans right, revealing a playground with colorful equipment and trees lining a paved area.", "history_tokens": 1008, "history_utf8_bytes": 4197, "recent_frame_times_s": [690.0, 691.0, 692.0, 693.0, 694.0, 695.0, 696.0, 697.0, 698.0, 699.0, 700.0, 701.0, 702.0, 703.0, 704.0, 705.0, 706.0, 707.0, 708.0, 709.0, 710.0, 711.0, 712.0, 713.0, 714.0, 715.0, 716.0, 717.0, 718.0, 719.0], "recent_frames_sha256": "f3d477ee7b8b1f6f5459bf2e08d7d0238d2cd87b2851f85be70560f762671a31", "num_recent_frames": 30, "tq": 717071.672266883, "t1": 717078.828524628, "ta": 717078.828524628, "te": 717078.867377077, "first_response_s": 7.156257744994946, "answer_total_s": 7.195110194035806, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 325, "content_group": "1ec4b3734a130f8a79fedd92668d2bbc89fa1b849745f9d002328de3812382f2", "question": {"question_id": "sample_325_a234_q1", "video_id": 325, "video_path": "./videos/sample_325_real.mp4", "annotation_index": 234, "question_index": 1, "question": "What did the red motorbike do just now?", "options": ["A. Stops at the intersection.", "B. Turns left at the traffic light.", "C. Proceeds through the intersection and moves along the road.", "D. Parks on the sidewalk."], "answer": "C", "time_stamp_s": 9, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_325_a234_q1", "video_id": 325, "time_stamp_s": 9, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b4fecdf905e909cd1beef2d40c027601d33b1f8986bffa40f1864af61e04be00", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008], "recent_frames_sha256": "ca5a7e88a2fe2cb14678d580ba33e6dfb35f013d26e3ef1118fd08cf93aed60f", "num_recent_frames": 9, "tq": 718956.422097057, "t1": 718957.394729589, "ta": 718957.394729589, "te": 718957.433479589, "first_response_s": 0.9726325320079923, "answer_total_s": 1.0113825319567695, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_325_a234_q1", "video_id": 325, "time_stamp_s": 9, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "78ee0f4a5afb6be95e6ae7d676d85fba800d76cd0157d9b9909f638022e488d2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008], "recent_frames_sha256": "ca5a7e88a2fe2cb14678d580ba33e6dfb35f013d26e3ef1118fd08cf93aed60f", "num_recent_frames": 9, "tq": 718753.62625372, "t1": 718767.124132666, "ta": 718767.124132666, "te": 718767.165838117, "first_response_s": 13.49787894601468, "answer_total_s": 13.539584396989085, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 325, "content_group": "1ec4b3734a130f8a79fedd92668d2bbc89fa1b849745f9d002328de3812382f2", "question": {"question_id": "sample_325_a234_q0", "video_id": 325, "video_path": "./videos/sample_325_real.mp4", "annotation_index": 234, "question_index": 0, "question": "What type of sidewalk is depicted in the video right now?", "options": ["A. Metal sidewalk.", "B. Wooden sidewalk.", "C. Stone sidewalk.", "D. Concrete sidewalk."], "answer": "C", "time_stamp_s": 20, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_325_a234_q0", "video_id": 325, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "27aad619512abdf2f4de74a0837a0ab2dbc4e518bb26ffe709e5cc076461bd87", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665], "recent_frames_sha256": "ef43e1bee948ac468eb571acbbe765329f42a9f57e1f7950f89ddc59afa004bc", "num_recent_frames": 20, "tq": 718957.460624084, "t1": 718969.152901651, "ta": 718969.152901651, "te": 718969.19263267, "first_response_s": 11.692277566995472, "answer_total_s": 11.7320085860556, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_325_a234_q0", "video_id": 325, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f51af3482587186ed74d18302508c550c86ee1ef669a27db0ac4fd893e0d1613", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665], "recent_frames_sha256": "ef43e1bee948ac468eb571acbbe765329f42a9f57e1f7950f89ddc59afa004bc", "num_recent_frames": 20, "tq": 718767.191617872, "t1": 718773.462231759, "ta": 718773.462231759, "te": 718773.503243432, "first_response_s": 6.270613886998035, "answer_total_s": 6.311625560047105, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 325, "content_group": "1ec4b3734a130f8a79fedd92668d2bbc89fa1b849745f9d002328de3812382f2", "question": {"question_id": "sample_325_a235_q0", "video_id": 325, "video_path": "./videos/sample_325_real.mp4", "annotation_index": 235, "question_index": 0, "question": "What type of vehicle is parked in the middle of the frame right now?", "options": ["A. A red car.", "B. A white car.", "C. A black motorcycle.", "D. A yellow truck."], "answer": "B", "time_stamp_s": 180, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_325_a235_q0", "video_id": 325, "time_stamp_s": 180, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b1ecd00a5826a37af149b65deaaed894128a46113324044c0c093dd10ce46c38", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667], "recent_frames_sha256": "56a07cbd65982a39903991a04051d512be659a86ee3e92756cb61896f18d67e0", "num_recent_frames": 30, "tq": 718969.219750816, "t1": 718977.639666417, "ta": 718977.639666417, "te": 718977.841230657, "first_response_s": 8.41991560102906, "answer_total_s": 8.621479840949178, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_325_a235_q0", "video_id": 325, "time_stamp_s": 180, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d432aa7f69409b8afd666a107c015fbeffa8a764ee705e3f24a268964b0abfd3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A red traffic light at a street corner in Porto, Portugal, is illuminated as a scooter and car pass by.  \n- A pedestrian walks along a cobblestone sidewalk past outdoor café tables under orange umbrellas, with a blue \"No Parking\" sign visible.  \n- Graffiti-covered walls and storefronts line the street, with cyclists and cars moving along the road under a clear blue sky.\n[30-60s] - Red umbrella awning of \"SUPER ROCK\" café extends over outdoor seating on right sidewalk.  \n- Pedestrian crosswalk with white stripes is visible at street intersection, with traffic light changing to green.  \n- \"Bistro\" café with red chairs and tables is seen on left side of narrow street, with people walking past.\n[60-90s] - Red umbrellas shade outdoor tables where patrons sit and converse.  \n- A blue sign reading \"PISO DE RESIDENCIA\" is visible on a building facade.  \n- Cobblestone street stretches into the distance, flanked by shops and trees.\n[90-120s] - A man in a grey shirt walks toward the camera, passing a potted plant on the sidewalk.  \n- A woman in a black top and shorts walks past a parked white van, carrying a green bag.  \n- A black car is parked on the right side of the cobblestone street, partially obscuring a storefront entrance.\n[120-150s] - A white van is parked on the left side of the cobblestone street, partially obstructing the view of the storefronts.  \n- A black sedan drives past the van, moving toward the camera, with its license plate visible.  \n- A man in a dark suit walks away from the camera, heading down the street, while a woman in a patterned dress walks toward the camera on the right sidewalk.\n[150-180s] - A white truck is parked on the right side of the street, partially obscured by a bus stop shelter.  \n- A black car drives past the camera from left to right, passing a red-painted building with blue shutters.  \n- A metal fence with ornate posts lines the sidewalk, separating it from a tree and a set of stairs leading to a building.", "history_tokens": 481, "history_utf8_bytes": 1986, "recent_frame_times_s": [150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667], "recent_frames_sha256": "56a07cbd65982a39903991a04051d512be659a86ee3e92756cb61896f18d67e0", "num_recent_frames": 30, "tq": 718827.660367341, "t1": 718829.679906025, "ta": 718829.679906025, "te": 718829.722059826, "first_response_s": 2.019538683933206, "answer_total_s": 2.061692485003732, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 325, "content_group": "1ec4b3734a130f8a79fedd92668d2bbc89fa1b849745f9d002328de3812382f2", "question": {"question_id": "sample_325_a236_q0", "video_id": 325, "video_path": "./videos/sample_325_real.mp4", "annotation_index": 236, "question_index": 0, "question": "Where is the white van parked in relation to the rest of the cars on the street?", "options": ["A. Near the center of the left lane.", "B. Near the center of the right lane.", "C. Along the left side of the street.", "D. Along the right side of the street."], "answer": "D", "time_stamp_s": 330, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_325_a236_q0", "video_id": 325, "time_stamp_s": 330, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b4d9e488bc6e3e55c613d0ec65ab0435bace646f7d418fcc06c712dd4bc0c127", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [300.01638333333335, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0000166666667, 318.00101666666666, 319.0020166666667, 320.00301666666667, 321.00401666666664, 322.0050166666667, 323.00601666666665, 324.0070166666667, 325.00801666666666, 326.00901666666664, 327.0100166666667, 328.01101666666665, 329.0120166666667], "recent_frames_sha256": "44acd00db5a9fb5a23c6a6cb92355c2acce63a36660d106561c44e0a7608a676", "num_recent_frames": 30, "tq": 718977.864977123, "t1": 718985.259925696, "ta": 718985.259925696, "te": 718985.298165679, "first_response_s": 7.394948572968133, "answer_total_s": 7.433188555995002, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_325_a236_q0", "video_id": 325, "time_stamp_s": 330, "ground_truth": "D", "raw_output": "C. Along the left side of the street.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "1b90deb7383edb9327d9424213e6b5cc5a41b9cf0a4c91504cfaaf572df6f014", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A red traffic light at a street corner in Porto, Portugal, is illuminated as a scooter and car pass by.  \n- A pedestrian walks along a cobblestone sidewalk past outdoor café tables under orange umbrellas, with a blue \"No Parking\" sign visible.  \n- Graffiti-covered walls and storefronts line the street, with cyclists and cars moving along the road under a clear blue sky.\n[30-60s] - Red umbrella awning of \"SUPER ROCK\" café extends over outdoor seating on right sidewalk.  \n- Pedestrian crosswalk with white stripes is visible at street intersection, with traffic light changing to green.  \n- \"Bistro\" café with red chairs and tables is seen on left side of narrow street, with people walking past.\n[60-90s] - Red umbrellas shade outdoor tables where patrons sit and converse.  \n- A blue sign reading \"PISO DE RESIDENCIA\" is visible on a building facade.  \n- Cobblestone street stretches into the distance, flanked by shops and trees.\n[90-120s] - A man in a grey shirt walks toward the camera, passing a potted plant on the sidewalk.  \n- A woman in a black top and shorts walks past a parked white van, carrying a green bag.  \n- A black car is parked on the right side of the cobblestone street, partially obscuring a storefront entrance.\n[120-150s] - A white van is parked on the left side of the cobblestone street, partially obstructing the view of the storefronts.  \n- A black sedan drives past the van, moving toward the camera, with its license plate visible.  \n- A man in a dark suit walks away from the camera, heading down the street, while a woman in a patterned dress walks toward the camera on the right sidewalk.\n[150-180s] - A white truck is parked on the right side of the street, partially obscured by a bus stop shelter.  \n- A black car drives past the camera from left to right, passing a red-painted building with blue shutters.  \n- A metal fence with ornate posts lines the sidewalk, separating it from a tree and a set of stairs leading to a building.\n[180-210s] - A white car drives forward, passing through a cobblestone street toward a plaza with market stalls.  \n- Market stalls with yellow umbrellas are arranged on a paved plaza, with people seated or walking nearby.  \n- A tree with green leaves stands on the right side of the plaza, casting shadows on the ground.\n[210-240s] - A woman in a red dress walks past a storefront with \"Dil Martín\" signage, carrying a black bag.  \n- A white pickup truck passes through a bustling street intersection with pedestrians and tram tracks.  \n- A yellow and white bus moves along the cobblestone street, passing by ornate buildings with awnings and shopfronts.\n[240-270s] - A man in an orange shirt walks away from the camera down a cobblestone street with tram tracks.  \n- A storefront with \"MOKO\" signage is visible on the left, adjacent to a shop with graffiti-covered windows.  \n- Several parked cars line the right side of the street, with a white van and a red car prominently visible.\n[270-300s] - A black car with license plate \"CF-244-FO\" drives away from the camera down the cobblestone street.  \n- A silver car is parked on the right side of the street, near a storefront with a green awning.  \n- Pedestrians walk along the sidewalk on the left, passing by shops including one labeled \"RESTAURANTE.\"\n[300-330s] - A man in a yellow shirt walks leftward along the sidewalk, passing a closed shop with a \"CLOSED\" sign.  \n- A white car drives rightward down the street, passing parked vehicles and a \"P\" parking sign.  \n- A woman in a black top and shorts walks rightward, crossing the street near a \"Banco de Portugal\" sign.", "history_tokens": 892, "history_utf8_bytes": 3614, "recent_frame_times_s": [300.01638333333335, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0000166666667, 318.00101666666666, 319.0020166666667, 320.00301666666667, 321.00401666666664, 322.0050166666667, 323.00601666666665, 324.0070166666667, 325.00801666666666, 326.00901666666664, 327.0100166666667, 328.01101666666665, 329.0120166666667], "recent_frames_sha256": "44acd00db5a9fb5a23c6a6cb92355c2acce63a36660d106561c44e0a7608a676", "num_recent_frames": 30, "tq": 718872.551418112, "t1": 718873.935366946, "ta": 718873.935366946, "te": 718874.333357172, "first_response_s": 1.383948834030889, "answer_total_s": 1.7819390599615872, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 325, "content_group": "1ec4b3734a130f8a79fedd92668d2bbc89fa1b849745f9d002328de3812382f2", "question": {"question_id": "sample_325_a237_q0", "video_id": 325, "video_path": "./videos/sample_325_real.mp4", "annotation_index": 237, "question_index": 0, "question": "What is prominently displayed on the wall above the entrance inside the building?", "options": ["A. A painting.", "B. A clock.", "C. A sculpture.", "D. A mirror."], "answer": "B", "time_stamp_s": 489, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_325_a237_q0", "video_id": 325, "time_stamp_s": 489, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dc44475c29b18ed3cb17c2cc5b4a712a73f80df3d2e0505479a5b1ba131de884", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [459.00855, 460.00955, 461.01055, 462.01155, 463.01255, 464.01355, 465.01455, 466.01555, 467.01655, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334], "recent_frames_sha256": "0c274c93d49fc2062531c5f34692e4cd386e89a42adf5ebdc7379d665fe21deb", "num_recent_frames": 30, "tq": 718985.308599512, "t1": 718998.327208059, "ta": 718998.327208059, "te": 718998.365394765, "first_response_s": 13.018608547048643, "answer_total_s": 13.05679525306914, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_325_a237_q0", "video_id": 325, "time_stamp_s": 489, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "aec8a0f567490593edb7951690af75a6f1b14fafd034f7425f1a7fe8b8c57257", "condition_order": ["notes", "recent"], "memory": "[120-150s] - A white van is parked on the left side of the cobblestone street, partially obstructing the view of the storefronts.  \n- A black sedan drives past the van, moving toward the camera, with its license plate visible.  \n- A man in a dark suit walks away from the camera, heading down the street, while a woman in a patterned dress walks toward the camera on the right sidewalk.\n[150-180s] - A white truck is parked on the right side of the street, partially obscured by a bus stop shelter.  \n- A black car drives past the camera from left to right, passing a red-painted building with blue shutters.  \n- A metal fence with ornate posts lines the sidewalk, separating it from a tree and a set of stairs leading to a building.\n[180-210s] - A white car drives forward, passing through a cobblestone street toward a plaza with market stalls.  \n- Market stalls with yellow umbrellas are arranged on a paved plaza, with people seated or walking nearby.  \n- A tree with green leaves stands on the right side of the plaza, casting shadows on the ground.\n[210-240s] - A woman in a red dress walks past a storefront with \"Dil Martín\" signage, carrying a black bag.  \n- A white pickup truck passes through a bustling street intersection with pedestrians and tram tracks.  \n- A yellow and white bus moves along the cobblestone street, passing by ornate buildings with awnings and shopfronts.\n[240-270s] - A man in an orange shirt walks away from the camera down a cobblestone street with tram tracks.  \n- A storefront with \"MOKO\" signage is visible on the left, adjacent to a shop with graffiti-covered windows.  \n- Several parked cars line the right side of the street, with a white van and a red car prominently visible.\n[270-300s] - A black car with license plate \"CF-244-FO\" drives away from the camera down the cobblestone street.  \n- A silver car is parked on the right side of the street, near a storefront with a green awning.  \n- Pedestrians walk along the sidewalk on the left, passing by shops including one labeled \"RESTAURANTE.\"\n[300-330s] - A man in a yellow shirt walks leftward along the sidewalk, passing a closed shop with a \"CLOSED\" sign.  \n- A white car drives rightward down the street, passing parked vehicles and a \"P\" parking sign.  \n- A woman in a black top and shorts walks rightward, crossing the street near a \"Banco de Portugal\" sign.\n[330-360s] - A white van drives past on the right, partially obscuring a storefront with a \"20% OFF\" sign.  \n- Pedestrians walk along the left sidewalk, some carrying bags, as the camera moves forward.  \n- The cobblestone street features tram tracks running down its center, flanked by historic buildings with balconies.\n[360-390s] - A man in a purple shirt walks away from the camera, pushing a bicycle down the cobblestone street.  \n- A woman in a yellow top walks alongside him, also moving away from the camera.  \n- The street features tram tracks running down the center, flanked by multi-story buildings with storefronts and awnings.\n[390-420s] - A green awning extends over a storefront on the right side of the street, partially shading outdoor seating.  \n- A blue directional sign with a white arrow is mounted on a pole near the sidewalk, indicating a turn or route.  \n- A tram track runs down the center of the cobblestone street, flanked by buildings with ornate facades and shopfronts.\n[420-450s] - A man in a white shirt and dark pants walks toward the camera, holding a phone.  \n- A red car passes on the street, followed by a white van and a motorcycle.  \n- A small kiosk with a blue sign is visible on the sidewalk, near a group of pedestrians.\n[450-480s] - A silver sedan drives across a paved square, passing pedestrians and parked cars.  \n- A line of taxis, including blue and black models, is parked along a cobblestone street beside a large stone building with arched windows.  \n- A woman in a pink dress walks along the sidewalk near the building’s entrance, while a man in a yellow vest pushes a cart with a trash bag.", "history_tokens": 994, "history_utf8_bytes": 4006, "recent_frame_times_s": [459.00855, 460.00955, 461.01055, 462.01155, 463.01255, 464.01355, 465.01455, 466.01555, 467.01655, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334], "recent_frames_sha256": "0c274c93d49fc2062531c5f34692e4cd386e89a42adf5ebdc7379d665fe21deb", "num_recent_frames": 30, "tq": 718947.435651995, "t1": 718956.230546355, "ta": 718956.230546355, "te": 718956.389687987, "first_response_s": 8.794894360005856, "answer_total_s": 8.954035992035642, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 326, "content_group": "2dd5d44a44dc0bb87707be274f8000459e0dc6c0026c156df99c433fe24f35a2", "question": {"question_id": "sample_326_a1777_q0", "video_id": 326, "video_path": "./videos/sample_326_real.mp4", "annotation_index": 1777, "question_index": 0, "question": "Where were the tables and chairs located in the scene just now?", "options": ["A. On the right side of the street.", "B. Inside a building.", "C. In front of the building with white umbrellas.", "D. Near the zebra crossing."], "answer": "C", "time_stamp_s": 5, "task_type": "Spatial Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_326_a1777_q0", "video_id": 326, "time_stamp_s": 5, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "26ad315abb7bda6e1e2ad27675e0bf76289587388f22a9576d78776bf5946d70", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.019, 1.0033166666666666, 2.0043166666666665, 3.005316666666667, 4.006316666666667], "recent_frames_sha256": "2749a63df84bd6395c810e936e2ab4f05c4e0a38938292787a4726d5de66f2ef", "num_recent_frames": 5, "tq": 717474.171962119, "t1": 717474.923337678, "ta": 717474.923337678, "te": 717474.962876122, "first_response_s": 0.7513755589025095, "answer_total_s": 0.7909140029223636, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_326_a1777_q0", "video_id": 326, "time_stamp_s": 5, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "613ed6021934843cf99e0b21a8fd713fa9e040757e1aecbbef537e3c80d774f3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.019, 1.0033166666666666, 2.0043166666666665, 3.005316666666667, 4.006316666666667], "recent_frames_sha256": "2749a63df84bd6395c810e936e2ab4f05c4e0a38938292787a4726d5de66f2ef", "num_recent_frames": 5, "tq": 717517.450130046, "t1": 717523.48189285, "ta": 717523.48189285, "te": 717523.776577046, "first_response_s": 6.0317628040211275, "answer_total_s": 6.3264470000285655, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 326, "content_group": "2dd5d44a44dc0bb87707be274f8000459e0dc6c0026c156df99c433fe24f35a2", "question": {"question_id": "sample_326_a1778_q0", "video_id": 326, "video_path": "./videos/sample_326_real.mp4", "annotation_index": 1778, "question_index": 0, "question": "Where is the small three-wheeled vehicle parked?", "options": ["A. On the cobblestone pavement near the cathedral.", "B. In front of the cathedral.", "C. Near the modern buildings.", "D. At the bottom right corner of the street."], "answer": "B", "time_stamp_s": 175, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_326_a1778_q0", "video_id": 326, "time_stamp_s": 175, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4b69d9590958f385ee5cd2fe3dcf957d9a3f062a32ac71461d2f5fdaf852b83c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [145.01385, 146.01485, 147.01585, 148.00016666666667, 149.00116666666668, 150.00216666666665, 151.00316666666666, 152.00416666666666, 153.00516666666667, 154.00616666666667, 155.00716666666668, 156.00816666666665, 157.00916666666666, 158.01016666666666, 159.01116666666667, 160.01216666666667, 161.01316666666668, 162.01416666666665, 163.01516666666666, 164.01616666666666, 165.00048333333334, 166.00148333333334, 167.00248333333334, 168.00348333333332, 169.00448333333333, 170.00548333333333, 171.00648333333334, 172.00748333333334, 173.00848333333334, 174.00948333333332], "recent_frames_sha256": "b3fb1a9cf3b65333ff7a055f2b23ace6d0d303e9b85f34b539f8394a89c1fd70", "num_recent_frames": 30, "tq": 717474.980972981, "t1": 717485.605814998, "ta": 717485.605814998, "te": 717485.644934075, "first_response_s": 10.624842017074116, "answer_total_s": 10.663961093989201, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_326_a1778_q0", "video_id": 326, "time_stamp_s": 175, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "848983f7740bbb13af42ccfb9b84d6243c8d7f79701be7de8f0ad4745799e7c9", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pedestrians cross a zebra crossing as cars pass by on a sunny day.  \n- A group of three people walks along a paved sidewalk, moving away from the camera.  \n- A silver van is parked on the street near a building with a red sign, while other vehicles are visible in motion or parked nearby.\n[30-60s] - A white car drives past on the left side of the paved walkway.  \n- A person in dark clothing walks toward the camera from the distance.  \n- Trees with autumn-colored leaves line the right side of the walkway, casting shadows.\n[60-90s] - A man in a blue shirt walks toward the camera, passing a tree on the right.  \n- A group of three people walks away from the camera, heading toward a building entrance.  \n- A blue sign with white text is visible on the left, indicating a direction to \"Santander\" and \"Casa de la Cultura.\"\n[90-120s] - A woman in a patterned dress walks across a cobblestone area, passing parked cars and heading toward a grassy slope.  \n- A black SUV is parked near the curb, with its rear facing the camera, while a silver sedan enters the frame from the right.  \n- In the background, a large stone building with a prominent tower and red-tiled roofs stands under a clear blue sky.\n[120-150s] - Woman in patterned dress walks along stone bridge, carrying orange bag, moving away from camera.  \n- Cobblestone road curves left, bordered by low stone wall and greenery, leading toward historic cathedral.  \n- Cathedral’s Gothic architecture, with tall spires and arched windows, dominates the skyline under clear blue sky.", "history_tokens": 377, "history_utf8_bytes": 1551, "recent_frame_times_s": [145.01385, 146.01485, 147.01585, 148.00016666666667, 149.00116666666668, 150.00216666666665, 151.00316666666666, 152.00416666666666, 153.00516666666667, 154.00616666666667, 155.00716666666668, 156.00816666666665, 157.00916666666666, 158.01016666666666, 159.01116666666667, 160.01216666666667, 161.01316666666668, 162.01416666666665, 163.01516666666666, 164.01616666666666, 165.00048333333334, 166.00148333333334, 167.00248333333334, 168.00348333333332, 169.00448333333333, 170.00548333333333, 171.00648333333334, 172.00748333333334, 173.00848333333334, 174.00948333333332], "recent_frames_sha256": "b3fb1a9cf3b65333ff7a055f2b23ace6d0d303e9b85f34b539f8394a89c1fd70", "num_recent_frames": 30, "tq": 717562.613828864, "t1": 717569.784123111, "ta": 717569.784123111, "te": 717570.087898941, "first_response_s": 7.170294247101992, "answer_total_s": 7.474070077063516, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 326, "content_group": "2dd5d44a44dc0bb87707be274f8000459e0dc6c0026c156df99c433fe24f35a2", "question": {"question_id": "sample_326_a1779_q0", "video_id": 326, "video_path": "./videos/sample_326_real.mp4", "annotation_index": 1779, "question_index": 0, "question": "What is visible to the right of the stone street in the video right now?", "options": ["A. A historic stone building.", "B. A large modern skyscraper.", "C. A park with trees.", "D. A river with boats."], "answer": "A", "time_stamp_s": 326, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_326_a1779_q0", "video_id": 326, "time_stamp_s": 326, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f8aca25f313f8f29c25444cf1656df0530386f8dc8ad55e054e38fb0e4f9fbd9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [296.0147, 297.0157, 298.0000166666667, 299.00101666666666, 300.0020166666667, 301.00301666666667, 302.00401666666664, 303.0050166666667, 304.00601666666665, 305.0070166666667, 306.00801666666666, 307.00901666666664, 308.0100166666667, 309.01101666666665, 310.0120166666667, 311.01301666666666, 312.0140166666667, 313.01501666666667, 314.01601666666664, 315.00033333333334, 316.0013333333333, 317.00233333333335, 318.00333333333333, 319.0043333333333, 320.00533333333334, 321.0063333333333, 322.00733333333335, 323.0083333333333, 324.00933333333336, 325.01033333333334], "recent_frames_sha256": "732f6f21c81e712fcc1e7d61b5dacfa35ddb0a7edbf53379cc61e50e2c714553", "num_recent_frames": 30, "tq": 717485.660707463, "t1": 717497.701208367, "ta": 717497.701208367, "te": 717498.087500015, "first_response_s": 12.040500903967768, "answer_total_s": 12.426792551996186, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_326_a1779_q0", "video_id": 326, "time_stamp_s": 326, "ground_truth": "A", "raw_output": "A. A historic stone building.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "ed116c5faf0dcba204ce41f52126e0187261713fe9fc7eeb416a0e662ce9cb43", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pedestrians cross a zebra crossing as cars pass by on a sunny day.  \n- A group of three people walks along a paved sidewalk, moving away from the camera.  \n- A silver van is parked on the street near a building with a red sign, while other vehicles are visible in motion or parked nearby.\n[30-60s] - A white car drives past on the left side of the paved walkway.  \n- A person in dark clothing walks toward the camera from the distance.  \n- Trees with autumn-colored leaves line the right side of the walkway, casting shadows.\n[60-90s] - A man in a blue shirt walks toward the camera, passing a tree on the right.  \n- A group of three people walks away from the camera, heading toward a building entrance.  \n- A blue sign with white text is visible on the left, indicating a direction to \"Santander\" and \"Casa de la Cultura.\"\n[90-120s] - A woman in a patterned dress walks across a cobblestone area, passing parked cars and heading toward a grassy slope.  \n- A black SUV is parked near the curb, with its rear facing the camera, while a silver sedan enters the frame from the right.  \n- In the background, a large stone building with a prominent tower and red-tiled roofs stands under a clear blue sky.\n[120-150s] - Woman in patterned dress walks along stone bridge, carrying orange bag, moving away from camera.  \n- Cobblestone road curves left, bordered by low stone wall and greenery, leading toward historic cathedral.  \n- Cathedral’s Gothic architecture, with tall spires and arched windows, dominates the skyline under clear blue sky.\n[150-180s] - A cobblestone street leads toward a large, ornate stone cathedral with arched entrances and towers under a clear blue sky.\n- A vintage-style white van is parked on the right side of the street, near a modern-looking brown building with glass windows.\n- Several pedestrians are walking along the sidewalk and street, with some stopping near the cathedral’s entrance.\n[180-210s] - A group of three pedestrians walks leftward across a cobblestone plaza, passing between two large stone buildings.  \n- A man in a white shirt and dark pants walks toward the camera, then turns right, moving away from the group.  \n- A blue directional sign with an arrow points left, mounted on a stone pillar near the right edge of the frame.\n[210-240s] - A tall, ornate stone column stands centrally in the plaza, flanked by lampposts and a stone bridge.  \n- A historic stone building with crenellated towers and red-tiled roofs is visible on the right, adjacent to a low stone wall.  \n- A large white building with classical columns and arched windows is seen on the left, with people walking across the cobblestone plaza.\n[240-270s] - A large stone cathedral with ornate Gothic architecture dominates the foreground, featuring a prominent rose window and twin towers.  \n- A wide cobblestone plaza stretches before the cathedral, with a tall, plain stone wall to the left and a blue \"Porto\" sign mounted on it.  \n- People are seen walking across the plaza, some approaching the cathedral’s entrance, while others move toward the stone wall, under a bright blue sky.\n[270-300s] - A blue banner with \"Porto\" and a logo is affixed to a stone wall, visible on the left side of the frame.  \n- The camera pans right, revealing a wide cobblestone street flanked by massive stone buildings, including a prominent church facade.  \n- A few pedestrians are seen walking along the street, with a crane visible in the distant background.", "history_tokens": 825, "history_utf8_bytes": 3474, "recent_frame_times_s": [296.0147, 297.0157, 298.0000166666667, 299.00101666666666, 300.0020166666667, 301.00301666666667, 302.00401666666664, 303.0050166666667, 304.00601666666665, 305.0070166666667, 306.00801666666666, 307.00901666666664, 308.0100166666667, 309.01101666666665, 310.0120166666667, 311.01301666666666, 312.0140166666667, 313.01501666666667, 314.01601666666664, 315.00033333333334, 316.0013333333333, 317.00233333333335, 318.00333333333333, 319.0043333333333, 320.00533333333334, 321.0063333333333, 322.00733333333335, 323.0083333333333, 324.00933333333336, 325.01033333333334], "recent_frames_sha256": "732f6f21c81e712fcc1e7d61b5dacfa35ddb0a7edbf53379cc61e50e2c714553", "num_recent_frames": 30, "tq": 717617.640442102, "t1": 717624.641626341, "ta": 717624.641626341, "te": 717624.946489342, "first_response_s": 7.001184239052236, "answer_total_s": 7.306047240039334, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 326, "content_group": "2dd5d44a44dc0bb87707be274f8000459e0dc6c0026c156df99c433fe24f35a2", "question": {"question_id": "sample_326_a1779_q1", "video_id": 326, "video_path": "./videos/sample_326_real.mp4", "annotation_index": 1779, "question_index": 1, "question": "What color is the promotional sign on the back of the tour vehicle?", "options": ["A. Blue and Green.", "B. Green and Yellow.", "C. Yellow amd Red.", "D. Red and Blue."], "answer": "D", "time_stamp_s": 333, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_326_a1779_q1", "video_id": 326, "time_stamp_s": 333, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "19c6c1f056030f1ee5f6a926227ef8ed735ad72190bda4490da28371e21dc169", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [303.0050166666667, 304.00601666666665, 305.0070166666667, 306.00801666666666, 307.00901666666664, 308.0100166666667, 309.01101666666665, 310.0120166666667, 311.01301666666666, 312.0140166666667, 313.01501666666667, 314.01601666666664, 315.00033333333334, 316.0013333333333, 317.00233333333335, 318.00333333333333, 319.0043333333333, 320.00533333333334, 321.0063333333333, 322.00733333333335, 323.0083333333333, 324.00933333333336, 325.01033333333334, 326.0113333333333, 327.01233333333334, 328.0133333333333, 329.01433333333335, 330.01533333333333, 331.0163333333333, 332.00065], "recent_frames_sha256": "07176969c5a82458a9d914e58c129ea52718a127a97d098bf10b510d62c97435", "num_recent_frames": 30, "tq": 717498.101841249, "t1": 717510.121384572, "ta": 717510.121384572, "te": 717510.159766039, "first_response_s": 12.019543322967365, "answer_total_s": 12.057924789958633, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_326_a1779_q1", "video_id": 326, "time_stamp_s": 333, "ground_truth": "D", "raw_output": "D. Red and Blue.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "efe5daba24c4b43a4f5756df439b7c1b2e42b7f40b264702f7813f32a8c17111", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pedestrians cross a zebra crossing as cars pass by on a sunny day.  \n- A group of three people walks along a paved sidewalk, moving away from the camera.  \n- A silver van is parked on the street near a building with a red sign, while other vehicles are visible in motion or parked nearby.\n[30-60s] - A white car drives past on the left side of the paved walkway.  \n- A person in dark clothing walks toward the camera from the distance.  \n- Trees with autumn-colored leaves line the right side of the walkway, casting shadows.\n[60-90s] - A man in a blue shirt walks toward the camera, passing a tree on the right.  \n- A group of three people walks away from the camera, heading toward a building entrance.  \n- A blue sign with white text is visible on the left, indicating a direction to \"Santander\" and \"Casa de la Cultura.\"\n[90-120s] - A woman in a patterned dress walks across a cobblestone area, passing parked cars and heading toward a grassy slope.  \n- A black SUV is parked near the curb, with its rear facing the camera, while a silver sedan enters the frame from the right.  \n- In the background, a large stone building with a prominent tower and red-tiled roofs stands under a clear blue sky.\n[120-150s] - Woman in patterned dress walks along stone bridge, carrying orange bag, moving away from camera.  \n- Cobblestone road curves left, bordered by low stone wall and greenery, leading toward historic cathedral.  \n- Cathedral’s Gothic architecture, with tall spires and arched windows, dominates the skyline under clear blue sky.\n[150-180s] - A cobblestone street leads toward a large, ornate stone cathedral with arched entrances and towers under a clear blue sky.\n- A vintage-style white van is parked on the right side of the street, near a modern-looking brown building with glass windows.\n- Several pedestrians are walking along the sidewalk and street, with some stopping near the cathedral’s entrance.\n[180-210s] - A group of three pedestrians walks leftward across a cobblestone plaza, passing between two large stone buildings.  \n- A man in a white shirt and dark pants walks toward the camera, then turns right, moving away from the group.  \n- A blue directional sign with an arrow points left, mounted on a stone pillar near the right edge of the frame.\n[210-240s] - A tall, ornate stone column stands centrally in the plaza, flanked by lampposts and a stone bridge.  \n- A historic stone building with crenellated towers and red-tiled roofs is visible on the right, adjacent to a low stone wall.  \n- A large white building with classical columns and arched windows is seen on the left, with people walking across the cobblestone plaza.\n[240-270s] - A large stone cathedral with ornate Gothic architecture dominates the foreground, featuring a prominent rose window and twin towers.  \n- A wide cobblestone plaza stretches before the cathedral, with a tall, plain stone wall to the left and a blue \"Porto\" sign mounted on it.  \n- People are seen walking across the plaza, some approaching the cathedral’s entrance, while others move toward the stone wall, under a bright blue sky.\n[270-300s] - A blue banner with \"Porto\" and a logo is affixed to a stone wall, visible on the left side of the frame.  \n- The camera pans right, revealing a wide cobblestone street flanked by massive stone buildings, including a prominent church facade.  \n- A few pedestrians are seen walking along the street, with a crane visible in the distant background.\n[300-330s] - A white car drives past the cobblestone square, moving from right to left.  \n- A group of people stands near the stone building’s base, some facing away from the camera.  \n- A construction crane is visible in the background, positioned behind modern glass buildings.", "history_tokens": 891, "history_utf8_bytes": 3756, "recent_frame_times_s": [303.0050166666667, 304.00601666666665, 305.0070166666667, 306.00801666666666, 307.00901666666664, 308.0100166666667, 309.01101666666665, 310.0120166666667, 311.01301666666666, 312.0140166666667, 313.01501666666667, 314.01601666666664, 315.00033333333334, 316.0013333333333, 317.00233333333335, 318.00333333333333, 319.0043333333333, 320.00533333333334, 321.0063333333333, 322.00733333333335, 323.0083333333333, 324.00933333333336, 325.01033333333334, 326.0113333333333, 327.01233333333334, 328.0133333333333, 329.01433333333335, 330.01533333333333, 331.0163333333333, 332.00065], "recent_frames_sha256": "07176969c5a82458a9d914e58c129ea52718a127a97d098bf10b510d62c97435", "num_recent_frames": 30, "tq": 717631.537939304, "t1": 717637.572581435, "ta": 717637.572581435, "te": 717637.83475515, "first_response_s": 6.034642130951397, "answer_total_s": 6.296815845998935, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 326, "content_group": "2dd5d44a44dc0bb87707be274f8000459e0dc6c0026c156df99c433fe24f35a2", "question": {"question_id": "sample_326_a1780_q0", "video_id": 326, "video_path": "./videos/sample_326_real.mp4", "annotation_index": 1780, "question_index": 0, "question": "What types of paths does the bridge have?", "options": ["A. Two vehicle lanes and a bike lane.", "B. two pedestrian walkways and two tram tracks.", "C. A bike lane and a tram track.", "D. Two pedestrian walkways and a vehicle lane."], "answer": "B", "time_stamp_s": 589, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [540, 590], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_326_a1780_q0", "video_id": 326, "time_stamp_s": 589, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2a968ece44ff3a919f591c54ff840b03fbd6fc09fd16c6a3ea11d597a2e86fd7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [559.0107666666667, 560.0117666666666, 561.0127666666667, 562.0137666666667, 563.0147666666667, 564.0157666666667, 565.0000833333334, 566.0010833333333, 567.0020833333333, 568.0030833333333, 569.0040833333334, 570.0050833333333, 571.0060833333333, 572.0070833333333, 573.0080833333334, 574.0090833333334, 575.0100833333333, 576.0110833333333, 577.0120833333333, 578.0130833333334, 579.0140833333334, 580.0150833333333, 581.0160833333333, 582.0004, 583.0014, 584.0024, 585.0034, 586.0044, 587.0054, 588.0064], "recent_frames_sha256": "8d1fea8eda72a33997a0310031a16bd9183b3fc6d0d5e28a24060bab8209bb98", "num_recent_frames": 30, "tq": 717510.175154251, "t1": 717517.395550555, "ta": 717517.395550555, "te": 717517.432739802, "first_response_s": 7.220396303921007, "answer_total_s": 7.257585551007651, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_326_a1780_q0", "video_id": 326, "time_stamp_s": 589, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0dbecb0adcfcb6db3c9d3098bc9b6b12b3e9b4fba4dc197cfe2807f17689a33d", "condition_order": ["recent", "notes"], "memory": "[210-240s] - A tall, ornate stone column stands centrally in the plaza, flanked by lampposts and a stone bridge.  \n- A historic stone building with crenellated towers and red-tiled roofs is visible on the right, adjacent to a low stone wall.  \n- A large white building with classical columns and arched windows is seen on the left, with people walking across the cobblestone plaza.\n[240-270s] - A large stone cathedral with ornate Gothic architecture dominates the foreground, featuring a prominent rose window and twin towers.  \n- A wide cobblestone plaza stretches before the cathedral, with a tall, plain stone wall to the left and a blue \"Porto\" sign mounted on it.  \n- People are seen walking across the plaza, some approaching the cathedral’s entrance, while others move toward the stone wall, under a bright blue sky.\n[270-300s] - A blue banner with \"Porto\" and a logo is affixed to a stone wall, visible on the left side of the frame.  \n- The camera pans right, revealing a wide cobblestone street flanked by massive stone buildings, including a prominent church facade.  \n- A few pedestrians are seen walking along the street, with a crane visible in the distant background.\n[300-330s] - A white car drives past the cobblestone square, moving from right to left.  \n- A group of people stands near the stone building’s base, some facing away from the camera.  \n- A construction crane is visible in the background, positioned behind modern glass buildings.\n[330-360s] - A black car drives past a stone wall, stopping near a blue parking sign.  \n- Two men sit on a stone ledge; one in a blue shirt holds a white paper, while the other in a striped shirt looks down.  \n- A red cart with a canopy is parked beside the wall, near a construction site with a crane.\n[360-390s] - Red train with \"MUNICIPAL\" text on front, stationary on cobblestone street, pulling white carriages with blue sketches.  \n- Green trash bin on sidewalk, positioned near grassy area, with a traffic light pole nearby.  \n- Pedestrians walking across street, some near red train, others near buildings with colorful facades.\n[390-420s] - A silver SUV is parked on the right side of the cobblestone street, partially obstructing the view of the sidewalk.  \n- A group of pedestrians, including a woman in a striped shirt and denim shorts, walks toward the camera from the center of the street.  \n- Graffiti-covered walls are visible on the right, with a small shopfront and outdoor seating area under a white umbrella further down the street.\n[420-450s] - A man in a red shirt and white shorts stands near a shop, holding a phone to his ear while looking at a map or brochure.  \n- Two men sit on a bench beside a parked silver car, appearing to converse or rest.  \n- A sign for \"CERES PARK\" is visible, indicating a nearby public park or recreational area.\n[450-480s] - A woman in a white top walks along a paved path, carrying a brown shoulder bag, moving away from the camera.  \n- To her left, a railway track with overhead wires and a fence runs parallel to the path.  \n- The background features a panoramic view of a city with terracotta-roofed buildings, a river, and a distant castle-like structure under a partly cloudy sky.\n[480-510s] - A woman in a white dress walks away from the camera along a bridge's pedestrian path, carrying a bag.  \n- The bridge features overhead tram lines and ornate metal railings, with a \"No Entry\" sign visible.  \n- A cityscape with red-tiled roofs and a castle-like structure is visible across the water to the right.\n[510-540s] - A woman in a white top and dark shorts walks toward the camera on the bridge, holding a phone.  \n- A man in a black shirt stands near the railing, looking at the river.  \n- The camera pans right, revealing colorful buildings on a hillside overlooking the river.\n[540-570s] - A woman with curly hair stands on the bridge’s right side, holding a phone to her ear.  \n- A man in a white shirt walks leftward along the bridge’s left side, passing a stone wall.  \n- The bridge’s metal railings and overhead wires are visible, with a distant building and river in the background.", "history_tokens": 1004, "history_utf8_bytes": 4126, "recent_frame_times_s": [559.0107666666667, 560.0117666666666, 561.0127666666667, 562.0137666666667, 563.0147666666667, 564.0157666666667, 565.0000833333334, 566.0010833333333, 567.0020833333333, 568.0030833333333, 569.0040833333334, 570.0050833333333, 571.0060833333333, 572.0070833333333, 573.0080833333334, 574.0090833333334, 575.0100833333333, 576.0110833333333, 577.0120833333333, 578.0130833333334, 579.0140833333334, 580.0150833333333, 581.0160833333333, 582.0004, 583.0014, 584.0024, 585.0034, 586.0044, 587.0054, 588.0064], "recent_frames_sha256": "8d1fea8eda72a33997a0310031a16bd9183b3fc6d0d5e28a24060bab8209bb98", "num_recent_frames": 30, "tq": 717705.34628298, "t1": 717706.905780366, "ta": 717706.905780366, "te": 717706.947604609, "first_response_s": 1.5594973859842867, "answer_total_s": 1.6013216288993135, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 327, "content_group": "89342ec921c69cfdfa67dea93d44434ea5bd4a1ea9a91551c6d6c1fec1eb9e30", "question": {"question_id": "sample_327_a1471_q0", "video_id": 327, "video_path": "./videos/sample_327_real.mp4", "annotation_index": 1471, "question_index": 0, "question": "What are the man doing as he walk on the bridge?", "options": ["A. Looking at something in his hands.", "B. Holding hands.", "C. Talking to each other.", "D. Taking pictures."], "answer": "A", "time_stamp_s": 15, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_327_a1471_q0", "video_id": 327, "time_stamp_s": 15, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a54561b50ffa75dd0cf21c6e1a5c265edac05fc2cfca5eee750f7532c18a9186", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.026, 1.0103166666666668, 2.0113166666666666, 3.0123166666666665, 4.013316666666666, 5.014316666666667, 6.015316666666667, 7.0163166666666665, 8.000633333333333, 9.001633333333332, 10.002633333333334, 11.003633333333333, 12.004633333333333, 13.005633333333334, 14.006633333333333], "recent_frames_sha256": "f2e71ad3303a16a73850208bcb5e08b631910e0db69aa41e19a8e62f2e3586d7", "num_recent_frames": 15, "tq": 715274.676412497, "t1": 715280.812721673, "ta": 715280.812721673, "te": 715280.976882349, "first_response_s": 6.136309176101349, "answer_total_s": 6.300469852052629, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_327_a1471_q0", "video_id": 327, "time_stamp_s": 15, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "01181d81e527b01e072cdd2371d73114daffdbb000daa9b6f0c74e6531ce889c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.026, 1.0103166666666668, 2.0113166666666666, 3.0123166666666665, 4.013316666666666, 5.014316666666667, 6.015316666666667, 7.0163166666666665, 8.000633333333333, 9.001633333333332, 10.002633333333334, 11.003633333333333, 12.004633333333333, 13.005633333333334, 14.006633333333333], "recent_frames_sha256": "f2e71ad3303a16a73850208bcb5e08b631910e0db69aa41e19a8e62f2e3586d7", "num_recent_frames": 15, "tq": 710709.649352783, "t1": 710719.699960262, "ta": 710719.699960262, "te": 710720.071405716, "first_response_s": 10.050607479061, "answer_total_s": 10.422052933019586, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 327, "content_group": "89342ec921c69cfdfa67dea93d44434ea5bd4a1ea9a91551c6d6c1fec1eb9e30", "question": {"question_id": "sample_327_a1472_q0", "video_id": 327, "video_path": "./videos/sample_327_real.mp4", "annotation_index": 1472, "question_index": 0, "question": "What color is the tram?", "options": ["A. Red and white.", "B. Blue and white.", "C. Green and yellow.", "D. Yellow and gray."], "answer": "D", "time_stamp_s": 196, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_327_a1472_q0", "video_id": 327, "time_stamp_s": 196, "ground_truth": "D", "raw_output": "D. Yellow and gray.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "a227c4616e130eb8ef5f6383eeaa50a278fb88dc1ce9d62fa90405ff7def779f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [166.00848333333334, 167.00948333333332, 168.01048333333333, 169.01148333333333, 170.01248333333334, 171.01348333333334, 172.01448333333335, 173.01548333333332, 174.01648333333333, 175.0008, 176.0018, 177.0028, 178.0038, 179.0048, 180.0058, 181.0068, 182.0078, 183.0088, 184.0098, 185.0108, 186.0118, 187.0128, 188.0138, 189.0148, 190.0158, 191.00011666666666, 192.00111666666666, 193.00211666666667, 194.00311666666667, 195.00411666666668], "recent_frames_sha256": "b814659b8f9237723379a7f5d61e0ba492fbc9ff018b6fd44e8f48bb558530f2", "num_recent_frames": 30, "tq": 715280.999546748, "t1": 715288.58785044, "ta": 715288.58785044, "te": 715288.829652904, "first_response_s": 7.588303691940382, "answer_total_s": 7.830106155946851, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_327_a1472_q0", "video_id": 327, "time_stamp_s": 196, "ground_truth": "D", "raw_output": "D. Yellow and gray.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "1ddb580d9d41778945fa34a93977dea100ff037486fa8b7812aff9c6db0a322f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pedestrians walk across a metal bridge with yellow lane markings, moving away from the camera toward a distant building.  \n- The bridge spans a river, with urban structures and greenery visible on both banks under a partly cloudy sky.  \n- Overhead wires and ornate metal railings frame the bridge, suggesting it may be a tram or cable car route.\n[30-60s] - A man in a light-colored shirt and dark pants walks along a bridge's pedestrian path, holding a phone to his ear.  \n- The bridge features metal railings, overhead electrical wires, and tracks, with a distant building visible on the far side.  \n- A small boat moves along the river below, passing under the bridge as the camera pans slightly to the right.\n[60-90s] - Pedestrians walk along the bridge’s pathway, moving toward the camera.  \n- A tram track runs parallel to the pedestrian path, with overhead wires above.  \n- The bridge’s ornate metal railings and arches frame the view of the cityscape below.\n[90-120s] - Pedestrians walk along the bridge’s sidewalk, moving away from the camera’s perspective.  \n- The bridge’s metal railings and overhead tram wires remain static, framing the scene.  \n- A large building with a dome is visible in the background, positioned on the left side of the bridge.\n[120-150s] - A yellow and silver train enters from the right, moving toward the camera along the tracks.  \n- A man in a grey shirt and cap walks on the pedestrian path, moving toward the camera.  \n- The train passes the man, and the camera follows the train’s movement as it proceeds across the bridge.\n[150-180s] - Yellow and gray tram moves rightward across bridge, passing pedestrians on sidewalk.  \n- Pedestrians walk along bridge’s left sidewalk, some facing camera, others away.  \n- Tram’s front end becomes visible as it approaches camera, then recedes into distance.", "history_tokens": 436, "history_utf8_bytes": 1862, "recent_frame_times_s": [166.00848333333334, 167.00948333333332, 168.01048333333333, 169.01148333333333, 170.01248333333334, 171.01348333333334, 172.01448333333335, 173.01548333333332, 174.01648333333333, 175.0008, 176.0018, 177.0028, 178.0038, 179.0048, 180.0058, 181.0068, 182.0078, 183.0088, 184.0098, 185.0108, 186.0118, 187.0128, 188.0138, 189.0148, 190.0158, 191.00011666666666, 192.00111666666666, 193.00211666666667, 194.00311666666667, 195.00411666666668], "recent_frames_sha256": "b814659b8f9237723379a7f5d61e0ba492fbc9ff018b6fd44e8f48bb558530f2", "num_recent_frames": 30, "tq": 710764.630941107, "t1": 710765.663323004, "ta": 710765.663323004, "te": 710765.882755424, "first_response_s": 1.0323818969773129, "answer_total_s": 1.251814316958189, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 327, "content_group": "89342ec921c69cfdfa67dea93d44434ea5bd4a1ea9a91551c6d6c1fec1eb9e30", "question": {"question_id": "sample_327_a1473_q0", "video_id": 327, "video_path": "./videos/sample_327_real.mp4", "annotation_index": 1473, "question_index": 0, "question": "What sign is prominently visible right now?", "options": ["A. No Parking sign.", "B. Yield sign.", "C. Speed limit sign.", "D. Stop sign."], "answer": "D", "time_stamp_s": 481, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_327_a1473_q0", "video_id": 327, "time_stamp_s": 481, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b8e332eeb097bcfc2cd491135173687c9a616ff263f87d3f91143cdf4df8d1f3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [451.00986666666665, 452.0108666666667, 453.01186666666666, 454.01286666666664, 455.0138666666667, 456.01486666666665, 457.0158666666667, 458.0001833333333, 459.00118333333336, 460.00218333333333, 461.0031833333333, 462.00418333333334, 463.0051833333333, 464.00618333333335, 465.00718333333333, 466.0081833333333, 467.00918333333334, 468.0101833333333, 469.01118333333335, 470.0121833333333, 471.01318333333336, 472.01418333333334, 473.0151833333333, 474.01618333333334, 475.0005, 476.0015, 477.0025, 478.0035, 479.0045, 480.0055], "recent_frames_sha256": "38bfbb33233687dc7db81db8eae9c52b3a7a4caa570cd4d76b5ecb0dcb3479f8", "num_recent_frames": 30, "tq": 715288.858178889, "t1": 715296.575352987, "ta": 715296.575352987, "te": 715296.618730826, "first_response_s": 7.717174098012038, "answer_total_s": 7.7605519369244576, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_327_a1473_q0", "video_id": 327, "time_stamp_s": 481, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5fd73cd32f9807adc73ceb83fe4629cf8ef5759119b88789b158bd14e18e3c63", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Pedestrians walk along the bridge’s pathway, moving toward the camera.  \n- A tram track runs parallel to the pedestrian path, with overhead wires above.  \n- The bridge’s ornate metal railings and arches frame the view of the cityscape below.\n[90-120s] - Pedestrians walk along the bridge’s sidewalk, moving away from the camera’s perspective.  \n- The bridge’s metal railings and overhead tram wires remain static, framing the scene.  \n- A large building with a dome is visible in the background, positioned on the left side of the bridge.\n[120-150s] - A yellow and silver train enters from the right, moving toward the camera along the tracks.  \n- A man in a grey shirt and cap walks on the pedestrian path, moving toward the camera.  \n- The train passes the man, and the camera follows the train’s movement as it proceeds across the bridge.\n[150-180s] - Yellow and gray tram moves rightward across bridge, passing pedestrians on sidewalk.  \n- Pedestrians walk along bridge’s left sidewalk, some facing camera, others away.  \n- Tram’s front end becomes visible as it approaches camera, then recedes into distance.\n[180-210s] - A tram moves slowly toward the camera along the tracks on the bridge.  \n- Pedestrians walk on the bridge’s sidewalks, with one person crossing the path.  \n- The bridge’s metal framework and overhead wires remain static against a clear sky.\n[210-240s] - A yellow construction crane stands stationary beside a multi-story building under development.  \n- A tram track runs centrally across the bridge, flanked by pedestrian walkways with metal railings.  \n- A few pedestrians walk along the bridge, moving toward the camera’s perspective.\n[240-270s] - A tram passes left to right on the tracks, moving away from the camera.  \n- A person in a white shirt walks along the right sidewalk, moving away from the camera.  \n- A large yellow construction crane is visible on the left, partially obscuring a building under construction.\n[270-300s] - Construction site with scaffolding and blue netting on left, adjacent to tram tracks.  \n- Blue truck parked near tracks, with orange traffic cones nearby.  \n- Pedestrians walking along the right sidewalk, near tram tracks and utility poles.\n[300-330s] - A blue truck is parked on the left side of the cobblestone street, stationary.  \n- A red and white food cart is parked on the right side of the street, with people walking nearby.  \n- A purple car drives past the camera, moving along the street toward the right.\n[330-360s] - Two individuals sit on a low concrete wall along a paved walkway, facing away from the camera.  \n- A red car drives down the road ahead, moving away from the camera’s position.  \n- A blue directional sign with a white arrow and a speed limit sign (20) are visible on the right side of the path.\n[360-390s] - A red car is parked on the right side of a paved walkway, facing away from the camera.  \n- A black SUV pulls up beside it, stopping parallel to the red car.  \n- A woman in a yellow top and black pants runs past the parked cars, moving toward the left side of the frame.\n[390-420s] - A woman in a blue top and shorts walks toward the camera, carrying a bag, on the paved path.  \n- Trees with green leaves line both sides of the path, casting shadows under a clear blue sky.  \n- A yellow vehicle is parked on the left side of the road, near a building with a yellow facade.\n[420-450s] - A blue bus is stationary or moving slowly down the center of the paved walkway.  \n- A person in dark clothing walks away from the camera toward the bus.  \n- Trees and shrubs line both sides of the walkway, casting shadows on the pavement.\n[450-480s] - A red bus is parked on the street, partially obscured by trees and buildings.  \n- A silver car drives past the bus, moving from left to right across the frame.  \n- A row of cylindrical trash bins with metallic lids is visible on the right side of the paved area.", "history_tokens": 957, "history_utf8_bytes": 3937, "recent_frame_times_s": [451.00986666666665, 452.0108666666667, 453.01186666666666, 454.01286666666664, 455.0138666666667, 456.01486666666665, 457.0158666666667, 458.0001833333333, 459.00118333333336, 460.00218333333333, 461.0031833333333, 462.00418333333334, 463.0051833333333, 464.00618333333335, 465.00718333333333, 466.0081833333333, 467.00918333333334, 468.0101833333333, 469.01118333333335, 470.0121833333333, 471.01318333333336, 472.01418333333334, 473.0151833333333, 474.01618333333334, 475.0005, 476.0015, 477.0025, 478.0035, 479.0045, 480.0055], "recent_frames_sha256": "38bfbb33233687dc7db81db8eae9c52b3a7a4caa570cd4d76b5ecb0dcb3479f8", "num_recent_frames": 30, "tq": 715229.674866968, "t1": 715235.475585196, "ta": 715235.475585196, "te": 715235.714677287, "first_response_s": 5.800718228099868, "answer_total_s": 6.03981031908188, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 327, "content_group": "89342ec921c69cfdfa67dea93d44434ea5bd4a1ea9a91551c6d6c1fec1eb9e30", "question": {"question_id": "sample_327_a1474_q0", "video_id": 327, "video_path": "./videos/sample_327_real.mp4", "annotation_index": 1474, "question_index": 0, "question": "What does the person near the right side of the street appear to be doing?", "options": ["A. Sitting on a bench.", "B. Walking along the sidewalk.", "C. Standing still.", "D. Entering a building."], "answer": "B", "time_stamp_s": 586, "task_type": "Causal Reasoning", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [540, 597], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_327_a1474_q0", "video_id": 327, "time_stamp_s": 586, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b964b4458559bf87c36a2bef66ee047dfe800c569fc56b4194026fb74a7dbfdd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [556.0147666666667, 557.0157666666667, 558.0000833333334, 559.0010833333333, 560.0020833333333, 561.0030833333333, 562.0040833333334, 563.0050833333333, 564.0060833333333, 565.0070833333333, 566.0080833333334, 567.0090833333334, 568.0100833333333, 569.0110833333333, 570.0120833333333, 571.0130833333334, 572.0140833333334, 573.0150833333333, 574.0160833333333, 575.0004, 576.0014, 577.0024, 578.0034, 579.0044, 580.0054, 581.0064, 582.0074, 583.0084, 584.0094, 585.0104], "recent_frames_sha256": "de9317f68c6899d90820be8b63098bf3654a3f4d3c7b3abbd37b974d7b5f9f30", "num_recent_frames": 30, "tq": 715296.636250443, "t1": 715309.348509805, "ta": 715309.348509805, "te": 715309.388117003, "first_response_s": 12.71225936198607, "answer_total_s": 12.751866559963673, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_327_a1474_q0", "video_id": 327, "time_stamp_s": 586, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7ff420fe8ff8b47468e9e3f23a06576da1b843e6a57d33ee4e942d06b5f1b514", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Yellow and gray tram moves rightward across bridge, passing pedestrians on sidewalk.  \n- Pedestrians walk along bridge’s left sidewalk, some facing camera, others away.  \n- Tram’s front end becomes visible as it approaches camera, then recedes into distance.\n[180-210s] - A tram moves slowly toward the camera along the tracks on the bridge.  \n- Pedestrians walk on the bridge’s sidewalks, with one person crossing the path.  \n- The bridge’s metal framework and overhead wires remain static against a clear sky.\n[210-240s] - A yellow construction crane stands stationary beside a multi-story building under development.  \n- A tram track runs centrally across the bridge, flanked by pedestrian walkways with metal railings.  \n- A few pedestrians walk along the bridge, moving toward the camera’s perspective.\n[240-270s] - A tram passes left to right on the tracks, moving away from the camera.  \n- A person in a white shirt walks along the right sidewalk, moving away from the camera.  \n- A large yellow construction crane is visible on the left, partially obscuring a building under construction.\n[270-300s] - Construction site with scaffolding and blue netting on left, adjacent to tram tracks.  \n- Blue truck parked near tracks, with orange traffic cones nearby.  \n- Pedestrians walking along the right sidewalk, near tram tracks and utility poles.\n[300-330s] - A blue truck is parked on the left side of the cobblestone street, stationary.  \n- A red and white food cart is parked on the right side of the street, with people walking nearby.  \n- A purple car drives past the camera, moving along the street toward the right.\n[330-360s] - Two individuals sit on a low concrete wall along a paved walkway, facing away from the camera.  \n- A red car drives down the road ahead, moving away from the camera’s position.  \n- A blue directional sign with a white arrow and a speed limit sign (20) are visible on the right side of the path.\n[360-390s] - A red car is parked on the right side of a paved walkway, facing away from the camera.  \n- A black SUV pulls up beside it, stopping parallel to the red car.  \n- A woman in a yellow top and black pants runs past the parked cars, moving toward the left side of the frame.\n[390-420s] - A woman in a blue top and shorts walks toward the camera, carrying a bag, on the paved path.  \n- Trees with green leaves line both sides of the path, casting shadows under a clear blue sky.  \n- A yellow vehicle is parked on the left side of the road, near a building with a yellow facade.\n[420-450s] - A blue bus is stationary or moving slowly down the center of the paved walkway.  \n- A person in dark clothing walks away from the camera toward the bus.  \n- Trees and shrubs line both sides of the walkway, casting shadows on the pavement.\n[450-480s] - A red bus is parked on the street, partially obscured by trees and buildings.  \n- A silver car drives past the bus, moving from left to right across the frame.  \n- A row of cylindrical trash bins with metallic lids is visible on the right side of the paved area.\n[480-510s] - A silver car is parked on the right side of the cobblestone street, partially visible near the curb.  \n- A pedestrian in a gray shirt walks along the sidewalk, moving away from the camera toward the street’s end.  \n- The street features orange buildings with arched windows and a stone base, bordered by a low fence and greenery.\n[510-540s] - A silver car drives past parked vehicles on a cobblestone street, moving from right to left.  \n- A dark-colored sedan passes the camera, following the silver car, with its license plate visible.  \n- The street is lined with colorful buildings and trees, with a grassy hill visible on the right side.\n[540-570s] - A white Renault car drives up the cobblestone street, passing parked vehicles.  \n- A woman in a red dress walks along the sidewalk, carrying a shopping bag.  \n- A brown car is parked on the right side of the street, partially visible.", "history_tokens": 971, "history_utf8_bytes": 3978, "recent_frame_times_s": [556.0147666666667, 557.0157666666667, 558.0000833333334, 559.0010833333333, 560.0020833333333, 561.0030833333333, 562.0040833333334, 563.0050833333333, 564.0060833333333, 565.0070833333333, 566.0080833333334, 567.0090833333334, 568.0100833333333, 569.0110833333333, 570.0120833333333, 571.0130833333334, 572.0140833333334, 573.0150833333333, 574.0160833333333, 575.0004, 576.0014, 577.0024, 578.0034, 579.0044, 580.0054, 581.0064, 582.0074, 583.0084, 584.0094, 585.0104], "recent_frames_sha256": "de9317f68c6899d90820be8b63098bf3654a3f4d3c7b3abbd37b974d7b5f9f30", "num_recent_frames": 30, "tq": 715260.140907116, "t1": 715266.898204004, "ta": 715266.898204004, "te": 715267.177435023, "first_response_s": 6.75729688804131, "answer_total_s": 7.036527907010168, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 327, "content_group": "89342ec921c69cfdfa67dea93d44434ea5bd4a1ea9a91551c6d6c1fec1eb9e30", "question": {"question_id": "sample_327_a1474_q1", "video_id": 327, "video_path": "./videos/sample_327_real.mp4", "annotation_index": 1474, "question_index": 1, "question": "Where are the trash bins located in the scene?", "options": ["A. Along the sidewalk on the left side.", "B. Along the left side of the street.", "C. In the green space with trees.", "D. Next to the multi-story red and white building."], "answer": "A", "time_stamp_s": 592, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [540, 597], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_327_a1474_q1", "video_id": 327, "time_stamp_s": 592, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "76a5942a2b9c162f6e86feb35d901b7a07dd167d15bf504550e3fe67beeea2d2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [562.0040833333334, 563.0050833333333, 564.0060833333333, 565.0070833333333, 566.0080833333334, 567.0090833333334, 568.0100833333333, 569.0110833333333, 570.0120833333333, 571.0130833333334, 572.0140833333334, 573.0150833333333, 574.0160833333333, 575.0004, 576.0014, 577.0024, 578.0034, 579.0044, 580.0054, 581.0064, 582.0074, 583.0084, 584.0094, 585.0104, 586.0114, 587.0124, 588.0134, 589.0144, 590.0154, 591.0164], "recent_frames_sha256": "eb3b483d787b9d96b9b2bf9cf4eeb32afe0bab9238fa004f36c041ae35b9d43d", "num_recent_frames": 30, "tq": 715309.399288002, "t1": 715321.312372297, "ta": 715321.312372297, "te": 715321.353495506, "first_response_s": 11.913084294996224, "answer_total_s": 11.954207503935322, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_327_a1474_q1", "video_id": 327, "time_stamp_s": 592, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a47836ffe50d3da2d3daf18f5a8f14cc406c7ee6b8ad4d8febe6d9868e42ef24", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Yellow and gray tram moves rightward across bridge, passing pedestrians on sidewalk.  \n- Pedestrians walk along bridge’s left sidewalk, some facing camera, others away.  \n- Tram’s front end becomes visible as it approaches camera, then recedes into distance.\n[180-210s] - A tram moves slowly toward the camera along the tracks on the bridge.  \n- Pedestrians walk on the bridge’s sidewalks, with one person crossing the path.  \n- The bridge’s metal framework and overhead wires remain static against a clear sky.\n[210-240s] - A yellow construction crane stands stationary beside a multi-story building under development.  \n- A tram track runs centrally across the bridge, flanked by pedestrian walkways with metal railings.  \n- A few pedestrians walk along the bridge, moving toward the camera’s perspective.\n[240-270s] - A tram passes left to right on the tracks, moving away from the camera.  \n- A person in a white shirt walks along the right sidewalk, moving away from the camera.  \n- A large yellow construction crane is visible on the left, partially obscuring a building under construction.\n[270-300s] - Construction site with scaffolding and blue netting on left, adjacent to tram tracks.  \n- Blue truck parked near tracks, with orange traffic cones nearby.  \n- Pedestrians walking along the right sidewalk, near tram tracks and utility poles.\n[300-330s] - A blue truck is parked on the left side of the cobblestone street, stationary.  \n- A red and white food cart is parked on the right side of the street, with people walking nearby.  \n- A purple car drives past the camera, moving along the street toward the right.\n[330-360s] - Two individuals sit on a low concrete wall along a paved walkway, facing away from the camera.  \n- A red car drives down the road ahead, moving away from the camera’s position.  \n- A blue directional sign with a white arrow and a speed limit sign (20) are visible on the right side of the path.\n[360-390s] - A red car is parked on the right side of a paved walkway, facing away from the camera.  \n- A black SUV pulls up beside it, stopping parallel to the red car.  \n- A woman in a yellow top and black pants runs past the parked cars, moving toward the left side of the frame.\n[390-420s] - A woman in a blue top and shorts walks toward the camera, carrying a bag, on the paved path.  \n- Trees with green leaves line both sides of the path, casting shadows under a clear blue sky.  \n- A yellow vehicle is parked on the left side of the road, near a building with a yellow facade.\n[420-450s] - A blue bus is stationary or moving slowly down the center of the paved walkway.  \n- A person in dark clothing walks away from the camera toward the bus.  \n- Trees and shrubs line both sides of the walkway, casting shadows on the pavement.\n[450-480s] - A red bus is parked on the street, partially obscured by trees and buildings.  \n- A silver car drives past the bus, moving from left to right across the frame.  \n- A row of cylindrical trash bins with metallic lids is visible on the right side of the paved area.\n[480-510s] - A silver car is parked on the right side of the cobblestone street, partially visible near the curb.  \n- A pedestrian in a gray shirt walks along the sidewalk, moving away from the camera toward the street’s end.  \n- The street features orange buildings with arched windows and a stone base, bordered by a low fence and greenery.\n[510-540s] - A silver car drives past parked vehicles on a cobblestone street, moving from right to left.  \n- A dark-colored sedan passes the camera, following the silver car, with its license plate visible.  \n- The street is lined with colorful buildings and trees, with a grassy hill visible on the right side.\n[540-570s] - A white Renault car drives up the cobblestone street, passing parked vehicles.  \n- A woman in a red dress walks along the sidewalk, carrying a shopping bag.  \n- A brown car is parked on the right side of the street, partially visible.", "history_tokens": 971, "history_utf8_bytes": 3978, "recent_frame_times_s": [562.0040833333334, 563.0050833333333, 564.0060833333333, 565.0070833333333, 566.0080833333334, 567.0090833333334, 568.0100833333333, 569.0110833333333, 570.0120833333333, 571.0130833333334, 572.0140833333334, 573.0150833333333, 574.0160833333333, 575.0004, 576.0014, 577.0024, 578.0034, 579.0044, 580.0054, 581.0064, 582.0074, 583.0084, 584.0094, 585.0104, 586.0114, 587.0124, 588.0134, 589.0144, 590.0154, 591.0164], "recent_frames_sha256": "eb3b483d787b9d96b9b2bf9cf4eeb32afe0bab9238fa004f36c041ae35b9d43d", "num_recent_frames": 30, "tq": 715267.197212532, "t1": 715274.45918541, "ta": 715274.45918541, "te": 715274.662686484, "first_response_s": 7.261972878011875, "answer_total_s": 7.465473952004686, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 328, "content_group": "8671c11e7481248298167c7fba8d5e1d2395f81f380ad6d430f5ab2e53095ca8", "question": {"question_id": "sample_328_a1594_q0", "video_id": 328, "video_path": "./videos/sample_328_real.mp4", "annotation_index": 1594, "question_index": 0, "question": "Where are the green trash bins located?", "options": ["A. On the right side of the street.", "B. In the background near the cityscape.", "C. On the left side of the street.", "D. Next to the olive-green garage door."], "answer": "C", "time_stamp_s": 3, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_328_a1594_q0", "video_id": 328, "time_stamp_s": 3, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bf295fca7a161ec736d96a236942e98fb85e579b154bf36e31614e463f279d28", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.019, 1.0033166666666666, 2.0043166666666665], "recent_frames_sha256": "a456b99ace120d01d28446bb636945a26f4a9d2e9de14b0d77992d6e3c40cd34", "num_recent_frames": 3, "tq": 719473.377525435, "t1": 719484.200269945, "ta": 719484.200269945, "te": 719484.238100616, "first_response_s": 10.82274451002013, "answer_total_s": 10.860575181082822, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_328_a1594_q0", "video_id": 328, "time_stamp_s": 3, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1400a7da5489b587c71883694d330938c587c35ad1be04da9951d850a904f782", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.019, 1.0033166666666666, 2.0043166666666665], "recent_frames_sha256": "a456b99ace120d01d28446bb636945a26f4a9d2e9de14b0d77992d6e3c40cd34", "num_recent_frames": 3, "tq": 719528.96822245, "t1": 719535.07743277, "ta": 719535.07743277, "te": 719535.226230772, "first_response_s": 6.109210320049897, "answer_total_s": 6.258008321980014, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 328, "content_group": "8671c11e7481248298167c7fba8d5e1d2395f81f380ad6d430f5ab2e53095ca8", "question": {"question_id": "sample_328_a1595_q0", "video_id": 328, "video_path": "./videos/sample_328_real.mp4", "annotation_index": 1595, "question_index": 0, "question": "What vehicle is parked on the left side of the narrow street right now", "options": ["A. A blue bicycle.", "B. A white van.", "C. A yellow motorcycle.", "D. A red scooter."], "answer": "D", "time_stamp_s": 162, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_328_a1595_q0", "video_id": 328, "time_stamp_s": 162, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4743eade220e4be6efbdfc7ef5ea9b3ad713e294e25f37414cbdd9a287327d8a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [132.00085, 133.00185, 134.00285, 135.00385, 136.00485, 137.00585, 138.00685, 139.00785, 140.00885, 141.00985, 142.01085, 143.01185, 144.01285, 145.01385, 146.01485, 147.01585, 148.00016666666667, 149.00116666666668, 150.00216666666665, 151.00316666666666, 152.00416666666666, 153.00516666666667, 154.00616666666667, 155.00716666666668, 156.00816666666665, 157.00916666666666, 158.01016666666666, 159.01116666666667, 160.01216666666667, 161.01316666666668], "recent_frames_sha256": "4aa8854d07344feedadc4bbab94bd522e46dde3ab097acaaba3dd122d2ddb8e5", "num_recent_frames": 30, "tq": 719484.252572584, "t1": 719492.803552596, "ta": 719492.803552596, "te": 719492.840979724, "first_response_s": 8.550980012048967, "answer_total_s": 8.588407139992341, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_328_a1595_q0", "video_id": 328, "time_stamp_s": 162, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d9ed669838194109c3dac25b1d314b29f8783d757140ebfa234ce4c23aa8fbd7", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cobblestone street ascends steeply, flanked by parked cars and low buildings with terracotta roofs.  \n- A stone wall runs along the right side, while a green door and utility structures appear on the left.  \n- Distant cityscape with red-tiled roofs and a prominent tower visible under a partly cloudy sky.\n[30-60s] - A white van is parked on the left side of the narrow cobblestone street, with its rear facing the camera.  \n- A white car is parked on the right side of the street, near a stone wall with a blue circular sign.  \n- The camera moves forward along the street, revealing more buildings and a red door on the right as it progresses.\n[60-90s] - Two individuals walk away from the camera down a narrow alley, moving toward the end of the street.  \n- Graffiti art, including a cartoonish face and colorful lettering, is visible on the right wall.  \n- The alley is flanked by white and beige buildings with shuttered windows and a metal awning overhead.\n[90-120s] - Two individuals walk hand-in-hand down a narrow cobblestone alley, moving away from the camera.  \n- The alley is flanked by buildings with varied facades, including graffiti-covered walls and traditional shutters.  \n- A yellow triangular warning sign is visible on the right wall, indicating a potential hazard ahead.\n[120-150s] - A woman in a striped top walks away from the camera down a narrow cobblestone alley.  \n- The camera moves forward, revealing a large metal bridge spanning above the alley.  \n- Buildings on either side show varied facades, including graffiti on one wall and a red door on another.", "history_tokens": 376, "history_utf8_bytes": 1594, "recent_frame_times_s": [132.00085, 133.00185, 134.00285, 135.00385, 136.00485, 137.00585, 138.00685, 139.00785, 140.00885, 141.00985, 142.01085, 143.01185, 144.01285, 145.01385, 146.01485, 147.01585, 148.00016666666667, 149.00116666666668, 150.00216666666665, 151.00316666666666, 152.00416666666666, 153.00516666666667, 154.00616666666667, 155.00716666666668, 156.00816666666665, 157.00916666666666, 158.01016666666666, 159.01116666666667, 160.01216666666667, 161.01316666666668], "recent_frames_sha256": "4aa8854d07344feedadc4bbab94bd522e46dde3ab097acaaba3dd122d2ddb8e5", "num_recent_frames": 30, "tq": 719581.800215569, "t1": 719589.67579146, "ta": 719589.67579146, "te": 719589.718751425, "first_response_s": 7.875575890997425, "answer_total_s": 7.918535856064409, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 328, "content_group": "8671c11e7481248298167c7fba8d5e1d2395f81f380ad6d430f5ab2e53095ca8", "question": {"question_id": "sample_328_a1596_q0", "video_id": 328, "video_path": "./videos/sample_328_real.mp4", "annotation_index": 1596, "question_index": 0, "question": "What are the colors of the antique vehicle parked by the curb right now?", "options": ["A. Red and white.", "B. Blue ,Green and silver.", "C. Black and yellow.", "D. Green ,Brown and gold."], "answer": "D", "time_stamp_s": 339, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_328_a1596_q0", "video_id": 328, "time_stamp_s": 339, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f0ed799e1e7af483aee90f454890ec25a8f9f0dc66f991445206d3adc85f2828", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [309.01101666666665, 310.0120166666667, 311.01301666666666, 312.0140166666667, 313.01501666666667, 314.01601666666664, 315.00033333333334, 316.0013333333333, 317.00233333333335, 318.00333333333333, 319.0043333333333, 320.00533333333334, 321.0063333333333, 322.00733333333335, 323.0083333333333, 324.00933333333336, 325.01033333333334, 326.0113333333333, 327.01233333333334, 328.0133333333333, 329.01433333333335, 330.01533333333333, 331.0163333333333, 332.00065, 333.00165, 334.00265, 335.00365, 336.00465, 337.00565, 338.00665], "recent_frames_sha256": "f4ca1e3ee4439e9c0002d6d32b71801d926df93d5c9a4b508b133ce696922da8", "num_recent_frames": 30, "tq": 719492.853373525, "t1": 719505.494806388, "ta": 719505.494806388, "te": 719505.532388857, "first_response_s": 12.64143286307808, "answer_total_s": 12.679015332018025, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_328_a1596_q0", "video_id": 328, "time_stamp_s": 339, "ground_truth": "D", "raw_output": "D. Green ,Brown and gold.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "04c1200b3a2887b797fd4d06dc7e0907358cbdb7a41405542e325cb2e4a18b7f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Cobblestone street ascends steeply, flanked by parked cars and low buildings with terracotta roofs.  \n- A stone wall runs along the right side, while a green door and utility structures appear on the left.  \n- Distant cityscape with red-tiled roofs and a prominent tower visible under a partly cloudy sky.\n[30-60s] - A white van is parked on the left side of the narrow cobblestone street, with its rear facing the camera.  \n- A white car is parked on the right side of the street, near a stone wall with a blue circular sign.  \n- The camera moves forward along the street, revealing more buildings and a red door on the right as it progresses.\n[60-90s] - Two individuals walk away from the camera down a narrow alley, moving toward the end of the street.  \n- Graffiti art, including a cartoonish face and colorful lettering, is visible on the right wall.  \n- The alley is flanked by white and beige buildings with shuttered windows and a metal awning overhead.\n[90-120s] - Two individuals walk hand-in-hand down a narrow cobblestone alley, moving away from the camera.  \n- The alley is flanked by buildings with varied facades, including graffiti-covered walls and traditional shutters.  \n- A yellow triangular warning sign is visible on the right wall, indicating a potential hazard ahead.\n[120-150s] - A woman in a striped top walks away from the camera down a narrow cobblestone alley.  \n- The camera moves forward, revealing a large metal bridge spanning above the alley.  \n- Buildings on either side show varied facades, including graffiti on one wall and a red door on another.\n[150-180s] - A white van with \"CASA VERTICAL\" text is parked on the right side of the narrow cobblestone street.  \n- A red car is parked on the left side, near a concrete wall with graffiti.  \n- The camera moves forward along the street, revealing more parked vehicles and a large metal bridge structure overhead.\n[180-210s] - A silver van is parked near a large metal bridge structure, with its rear facing the camera.  \n- The camera pans right, revealing a narrow cobblestone street lined with colorful buildings (orange, yellow, and white) and parked cars.  \n- A yellow car is parked at the bottom of the street, with a black car behind it, both positioned along the sloped road.\n[210-240s] - A yellow car is parked on the right side of a cobblestone street, near a white building with multiple windows.  \n- A construction zone with orange barriers and a worker in a yellow vest is visible further down the street.  \n- A large metal tower structure is seen in the background, partially obscured by a stone wall and chain-link fence.\n[240-270s] - Stone archway labeled \"PONTE DE SÃO JORGE\" frames a view of the river and bridge structure.  \n- A metal lattice tower stands behind the archway, partially obscured by a stone wall.  \n- Vehicles and pedestrians move along the road beneath the archway, with a triangular traffic sign visible on the right.\n[270-300s] - A white van is parked on the curved road, partially obstructing the view of the sidewalk.  \n- A group of pedestrians walks along the sidewalk, moving away from the camera toward the river.  \n- A graffiti-covered wall is visible on the left, with a metal staircase leading up to a building.\n[300-330s] - A child in a brown shirt walks past a yellow \"BANHOS\" sign near a cobblestone street.  \n- Two green vintage-style carts are parked under a large tree, with people walking nearby.  \n- A black car drives along the waterfront road, passing by a metal railing and a distant bridge.", "history_tokens": 849, "history_utf8_bytes": 3542, "recent_frame_times_s": [309.01101666666665, 310.0120166666667, 311.01301666666666, 312.0140166666667, 313.01501666666667, 314.01601666666664, 315.00033333333334, 316.0013333333333, 317.00233333333335, 318.00333333333333, 319.0043333333333, 320.00533333333334, 321.0063333333333, 322.00733333333335, 323.0083333333333, 324.00933333333336, 325.01033333333334, 326.0113333333333, 327.01233333333334, 328.0133333333333, 329.01433333333335, 330.01533333333333, 331.0163333333333, 332.00065, 333.00165, 334.00265, 335.00365, 336.00465, 337.00565, 338.00665], "recent_frames_sha256": "f4ca1e3ee4439e9c0002d6d32b71801d926df93d5c9a4b508b133ce696922da8", "num_recent_frames": 30, "tq": 719632.541522968, "t1": 719633.776295806, "ta": 719633.776295806, "te": 719634.076603349, "first_response_s": 1.2347728380700573, "answer_total_s": 1.5350803809706122, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 328, "content_group": "8671c11e7481248298167c7fba8d5e1d2395f81f380ad6d430f5ab2e53095ca8", "question": {"question_id": "sample_328_a1597_q0", "video_id": 328, "video_path": "./videos/sample_328_real.mp4", "annotation_index": 1597, "question_index": 0, "question": "What is visible in the foreground on the pedestrian pathway?", "options": ["A. A cyclist and a runner.", "B. A person with a red backpack.", "C. A group of people standing still.", "D. Two people walking side by side."], "answer": "D", "time_stamp_s": 482, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_328_a1597_q0", "video_id": 328, "time_stamp_s": 482, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "68dca1323b9c557d6cee17bcb509a7496ab9b841b5c6428293efd3f35486a336", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [452.0038666666667, 453.00486666666666, 454.0058666666667, 455.00686666666667, 456.00786666666664, 457.0088666666667, 458.00986666666665, 459.0108666666667, 460.01186666666666, 461.01286666666664, 462.0138666666667, 463.01486666666665, 464.0158666666667, 465.0001833333333, 466.00118333333336, 467.00218333333333, 468.0031833333333, 469.00418333333334, 470.0051833333333, 471.00618333333335, 472.00718333333333, 473.0081833333333, 474.00918333333334, 475.0101833333333, 476.01118333333335, 477.0121833333333, 478.01318333333336, 479.01418333333334, 480.0151833333333, 481.01618333333334], "recent_frames_sha256": "813452e854938d022dd423300dcfda22193ce49388ade12caf8a6dc7394ca66d", "num_recent_frames": 30, "tq": 719505.544342996, "t1": 719517.636954471, "ta": 719517.636954471, "te": 719517.674716429, "first_response_s": 12.092611475032754, "answer_total_s": 12.130373432999477, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_328_a1597_q0", "video_id": 328, "time_stamp_s": 482, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4ddc64001c2d1615e89efd627347a5aa354bb0f2d7b3581a23c82119471dd0e9", "condition_order": ["recent", "notes"], "memory": "[120-150s] - A woman in a striped top walks away from the camera down a narrow cobblestone alley.  \n- The camera moves forward, revealing a large metal bridge spanning above the alley.  \n- Buildings on either side show varied facades, including graffiti on one wall and a red door on another.\n[150-180s] - A white van with \"CASA VERTICAL\" text is parked on the right side of the narrow cobblestone street.  \n- A red car is parked on the left side, near a concrete wall with graffiti.  \n- The camera moves forward along the street, revealing more parked vehicles and a large metal bridge structure overhead.\n[180-210s] - A silver van is parked near a large metal bridge structure, with its rear facing the camera.  \n- The camera pans right, revealing a narrow cobblestone street lined with colorful buildings (orange, yellow, and white) and parked cars.  \n- A yellow car is parked at the bottom of the street, with a black car behind it, both positioned along the sloped road.\n[210-240s] - A yellow car is parked on the right side of a cobblestone street, near a white building with multiple windows.  \n- A construction zone with orange barriers and a worker in a yellow vest is visible further down the street.  \n- A large metal tower structure is seen in the background, partially obscured by a stone wall and chain-link fence.\n[240-270s] - Stone archway labeled \"PONTE DE SÃO JORGE\" frames a view of the river and bridge structure.  \n- A metal lattice tower stands behind the archway, partially obscured by a stone wall.  \n- Vehicles and pedestrians move along the road beneath the archway, with a triangular traffic sign visible on the right.\n[270-300s] - A white van is parked on the curved road, partially obstructing the view of the sidewalk.  \n- A group of pedestrians walks along the sidewalk, moving away from the camera toward the river.  \n- A graffiti-covered wall is visible on the left, with a metal staircase leading up to a building.\n[300-330s] - A child in a brown shirt walks past a yellow \"BANHOS\" sign near a cobblestone street.  \n- Two green vintage-style carts are parked under a large tree, with people walking nearby.  \n- A black car drives along the waterfront road, passing by a metal railing and a distant bridge.\n[330-360s] - A vintage green and yellow tuk-tuk is parked on a cobblestone street, facing the camera, with its canopy open.  \n- A black Renault car (license plate visible) drives past on the street, moving from right to left.  \n- A group of pedestrians walks along a stone-paved sidewalk adjacent to a large stone building, heading away from the camera.\n[360-390s] - A red car drives across the bridge, passing the pedestrians.  \n- The bridge’s metal trusses and ornate railings are visible, with a cityscape in the background.  \n- Pedestrians walk along the bridge’s sidewalk, some looking at the scenery.\n[390-420s] - A couple walks side-by-side on a metal truss bridge, with the woman in a green top and blue jeans, and the man in a black shirt and white shorts, both carrying backpacks.  \n- A red double-decker tour bus passes them on the bridge, followed by a motorcycle and a silver sedan.  \n- The bridge spans a river, with a hillside town visible in the background under a partly cloudy sky.\n[420-450s] - Three pedestrians walk side-by-side on a metal truss bridge, with the central figure gesturing toward the river.  \n- A silver sedan passes behind them, followed by a black SUV, both moving in the same direction as the pedestrians.  \n- The bridge’s ornate metalwork and distant hillside buildings are visible under a partly cloudy sky.\n[450-480s] - Two pedestrians walk side-by-side on a metal truss bridge, facing away from the camera, with one carrying a backpack.  \n- A white car passes behind them, followed by a dark sedan, both moving along the bridge’s roadway.  \n- The bridge’s metal structure features graffiti, including yellow and black markings, visible on its side panels.", "history_tokens": 955, "history_utf8_bytes": 3948, "recent_frame_times_s": [452.0038666666667, 453.00486666666666, 454.0058666666667, 455.00686666666667, 456.00786666666664, 457.0088666666667, 458.00986666666665, 459.0108666666667, 460.01186666666666, 461.01286666666664, 462.0138666666667, 463.01486666666665, 464.0158666666667, 465.0001833333333, 466.00118333333336, 467.00218333333333, 468.0031833333333, 469.00418333333334, 470.0051833333333, 471.00618333333335, 472.00718333333333, 473.0081833333333, 474.00918333333334, 475.0101833333333, 476.01118333333335, 477.0121833333333, 478.01318333333336, 479.01418333333334, 480.0151833333333, 481.01618333333334], "recent_frames_sha256": "813452e854938d022dd423300dcfda22193ce49388ade12caf8a6dc7394ca66d", "num_recent_frames": 30, "tq": 719680.643661135, "t1": 719682.533197729, "ta": 719682.533197729, "te": 719682.774054086, "first_response_s": 1.8895365940406919, "answer_total_s": 2.1303929509595037, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 328, "content_group": "8671c11e7481248298167c7fba8d5e1d2395f81f380ad6d430f5ab2e53095ca8", "question": {"question_id": "sample_328_a1598_q0", "video_id": 328, "video_path": "./videos/sample_328_real.mp4", "annotation_index": 1598, "question_index": 0, "question": "What action does the viewer take in the video?", "options": ["A. Walking down a stone-paved street.", "B. Sitting at a cafe.", "C. Riding a bicycle.", "D. Boarding a boat."], "answer": "A", "time_stamp_s": 598, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [540, 598], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_328_a1598_q0", "video_id": 328, "time_stamp_s": 598, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f487ce01ba13c54506efdcfea50f22a35316ac27cd7395c0f483f7e11dd66acb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [568.0030833333333, 569.0040833333334, 570.0050833333333, 571.0060833333333, 572.0070833333333, 573.0080833333334, 574.0090833333334, 575.0100833333333, 576.0110833333333, 577.0120833333333, 578.0130833333334, 579.0140833333334, 580.0150833333333, 581.0160833333333, 582.0004, 583.0014, 584.0024, 585.0034, 586.0044, 587.0054, 588.0064, 589.0074, 590.0084, 591.0094, 592.0104, 593.0114, 594.0124, 595.0134, 596.0144, 597.0154], "recent_frames_sha256": "7f61cdf5c5a462c94af9e7e00b65cfccc6997b24fcb3b141d988eb6fef7943d4", "num_recent_frames": 30, "tq": 719517.689128891, "t1": 719528.923797589, "ta": 719528.923797589, "te": 719528.961321644, "first_response_s": 11.234668698045425, "answer_total_s": 11.272192753036506, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_328_a1598_q0", "video_id": 328, "time_stamp_s": 598, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dfac3ca87c558d9ef4b033400c69f9fa745ff78b52fe7d94bb9c642b0ad1e469", "condition_order": ["recent", "notes"], "memory": "[210-240s] - A yellow car is parked on the right side of a cobblestone street, near a white building with multiple windows.  \n- A construction zone with orange barriers and a worker in a yellow vest is visible further down the street.  \n- A large metal tower structure is seen in the background, partially obscured by a stone wall and chain-link fence.\n[240-270s] - Stone archway labeled \"PONTE DE SÃO JORGE\" frames a view of the river and bridge structure.  \n- A metal lattice tower stands behind the archway, partially obscured by a stone wall.  \n- Vehicles and pedestrians move along the road beneath the archway, with a triangular traffic sign visible on the right.\n[270-300s] - A white van is parked on the curved road, partially obstructing the view of the sidewalk.  \n- A group of pedestrians walks along the sidewalk, moving away from the camera toward the river.  \n- A graffiti-covered wall is visible on the left, with a metal staircase leading up to a building.\n[300-330s] - A child in a brown shirt walks past a yellow \"BANHOS\" sign near a cobblestone street.  \n- Two green vintage-style carts are parked under a large tree, with people walking nearby.  \n- A black car drives along the waterfront road, passing by a metal railing and a distant bridge.\n[330-360s] - A vintage green and yellow tuk-tuk is parked on a cobblestone street, facing the camera, with its canopy open.  \n- A black Renault car (license plate visible) drives past on the street, moving from right to left.  \n- A group of pedestrians walks along a stone-paved sidewalk adjacent to a large stone building, heading away from the camera.\n[360-390s] - A red car drives across the bridge, passing the pedestrians.  \n- The bridge’s metal trusses and ornate railings are visible, with a cityscape in the background.  \n- Pedestrians walk along the bridge’s sidewalk, some looking at the scenery.\n[390-420s] - A couple walks side-by-side on a metal truss bridge, with the woman in a green top and blue jeans, and the man in a black shirt and white shorts, both carrying backpacks.  \n- A red double-decker tour bus passes them on the bridge, followed by a motorcycle and a silver sedan.  \n- The bridge spans a river, with a hillside town visible in the background under a partly cloudy sky.\n[420-450s] - Three pedestrians walk side-by-side on a metal truss bridge, with the central figure gesturing toward the river.  \n- A silver sedan passes behind them, followed by a black SUV, both moving in the same direction as the pedestrians.  \n- The bridge’s ornate metalwork and distant hillside buildings are visible under a partly cloudy sky.\n[450-480s] - Two pedestrians walk side-by-side on a metal truss bridge, facing away from the camera, with one carrying a backpack.  \n- A white car passes behind them, followed by a dark sedan, both moving along the bridge’s roadway.  \n- The bridge’s metal structure features graffiti, including yellow and black markings, visible on its side panels.\n[480-510s] - Two pedestrians walk away from the camera on a metal truss bridge, one with a green backpack and the other with a brown backpack.  \n- A white car passes on the bridge’s left side, followed by a cyclist.  \n- The bridge’s intricate steel structure and the river below are visible, with buildings lining the riverbank.\n[510-540s] - A couple walks away from the camera on a metal bridge, the woman carrying a light green backpack and the man with a dark backpack.  \n- The bridge's steel trusses and graffiti are visible, with a stone tunnel entrance ahead.  \n- As they proceed, pedestrians cross a street below, and a white car passes on the road.\n[540-570s] - A man in a red shirt walks briskly along the sidewalk, moving away from the camera.  \n- A woman in a purple top walks toward the camera, passing a street vendor with a cart.  \n- A silver car drives past on the road, following a curve near a stone wall.", "history_tokens": 946, "history_utf8_bytes": 3899, "recent_frame_times_s": [568.0030833333333, 569.0040833333334, 570.0050833333333, 571.0060833333333, 572.0070833333333, 573.0080833333334, 574.0090833333334, 575.0100833333333, 576.0110833333333, 577.0120833333333, 578.0130833333334, 579.0140833333334, 580.0150833333333, 581.0160833333333, 582.0004, 583.0014, 584.0024, 585.0034, 586.0044, 587.0054, 588.0064, 589.0074, 590.0084, 591.0094, 592.0104, 593.0114, 594.0124, 595.0134, 596.0144, 597.0154], "recent_frames_sha256": "7f61cdf5c5a462c94af9e7e00b65cfccc6997b24fcb3b141d988eb6fef7943d4", "num_recent_frames": 30, "tq": 719699.629048639, "t1": 719700.689246896, "ta": 719700.689246896, "te": 719700.726929026, "first_response_s": 1.0601982569787651, "answer_total_s": 1.0978803869802505, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 329, "content_group": "ff61ebae21984999f7dcf6d3c53dcfa2a9768728977e56ac241d7c20166084ad", "question": {"question_id": "sample_329_a917_q0", "video_id": 329, "video_path": "./videos/sample_329_real.mp4", "annotation_index": 917, "question_index": 0, "question": "What is the weather like in the video?", "options": ["A. Completely cloudy.", "B. Rainy.", "C. Overcast.", "D. Partly cloudy."], "answer": "D", "time_stamp_s": 7, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_329_a917_q0", "video_id": 329, "time_stamp_s": 7, "ground_truth": "D", "raw_output": "D. Partly cloudy.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "74e11a133a92cd71d7be9b3c005233332b5f6f8d4a1d465b2a67276ba88715dc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.022, 1.0063166666666667, 2.0073166666666666, 3.0083166666666665, 4.009316666666667, 5.010316666666666, 6.011316666666667], "recent_frames_sha256": "1abf7b6146e20e66054519dc5b6a955eb45a37f8f93e016e073e16d4cf74afbb", "num_recent_frames": 7, "tq": 716637.623492181, "t1": 716644.22991376, "ta": 716644.22991376, "te": 716644.451078873, "first_response_s": 6.6064215790247545, "answer_total_s": 6.827586692059413, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_329_a917_q0", "video_id": 329, "time_stamp_s": 7, "ground_truth": "D", "raw_output": "D. Partly cloudy.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "c77aaf722d93ecc413f2fc919abc1609e634a4733a99a537f72f24cdab99faa5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.022, 1.0063166666666667, 2.0073166666666666, 3.0083166666666665, 4.009316666666667, 5.010316666666666, 6.011316666666667], "recent_frames_sha256": "1abf7b6146e20e66054519dc5b6a955eb45a37f8f93e016e073e16d4cf74afbb", "num_recent_frames": 7, "tq": 716449.044179943, "t1": 716463.120744707, "ta": 716463.120744707, "te": 716463.341943747, "first_response_s": 14.07656476390548, "answer_total_s": 14.297763803973794, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 329, "content_group": "ff61ebae21984999f7dcf6d3c53dcfa2a9768728977e56ac241d7c20166084ad", "question": {"question_id": "sample_329_a918_q0", "video_id": 329, "video_path": "./videos/sample_329_real.mp4", "annotation_index": 918, "question_index": 0, "question": "What is visible near the right side of the buildings right now?", "options": ["A. A blue mailbox.", "B. A green bench.", "C. A yellow taxi.", "D. A red phone booth."], "answer": "D", "time_stamp_s": 177, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_329_a918_q0", "video_id": 329, "time_stamp_s": 177, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5f0269718d840cb55ec8d8d481ed502d727fd8033eb591b7be17aa9e5977f933", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [147.00216666666665, 148.00316666666666, 149.00416666666666, 150.00516666666667, 151.00616666666667, 152.00716666666668, 153.00816666666665, 154.00916666666666, 155.01016666666666, 156.01116666666667, 157.01216666666667, 158.01316666666668, 159.01416666666665, 160.01516666666666, 161.01616666666666, 162.00048333333334, 163.00148333333334, 164.00248333333334, 165.00348333333332, 166.00448333333333, 167.00548333333333, 168.00648333333334, 169.00748333333334, 170.00848333333334, 171.00948333333332, 172.01048333333333, 173.01148333333333, 174.01248333333334, 175.01348333333334, 176.01448333333335], "recent_frames_sha256": "4924977927bf443530e6b014ff280a94d5af42a91a7f17c1319b021e3f50e2ff", "num_recent_frames": 30, "tq": 716644.478829778, "t1": 716650.681614875, "ta": 716650.681614875, "te": 716650.718986415, "first_response_s": 6.202785096946172, "answer_total_s": 6.24015663692262, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_329_a918_q0", "video_id": 329, "time_stamp_s": 177, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f95f08a35bd313a3d7899f7ba2d75380f23ce8b2f056b4f5482180139288bf0c", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A woman in a green dress walks along a seaside promenade, passing by outdoor café tables under white umbrellas.  \n- A man in a brown shirt and jeans walks beside her, occasionally glancing at his phone.  \n- Several cars, including a silver sedan and a dark SUV, pass by on the street adjacent to the promenade.\n[30-60s] - A white van drives along the left side of the promenade, moving away from the camera.  \n- A group of pedestrians walks toward the camera, passing by outdoor café tables under green umbrellas.  \n- A motorcycle is parked near the center-right, with a person standing beside it.\n[60-90s] - People stroll along the waterfront promenade, some near the water’s edge and others near café tables under umbrellas.  \n- A group of individuals in swimwear gathers near the water’s edge, possibly preparing to swim or relax.  \n- A bicycle and a motorbike are parked along the promenade, with a few people walking past them.\n[90-120s] - People swim and wade in the water near the dock, with some jumping in from the pier.\n- A large tree stands prominently on the promenade, surrounded by outdoor seating areas under white umbrellas.\n- A wooden boat with a red sail is moored near the shore, while another small boat moves along the water.\n[120-150s] - A large tree casts shade over a group of people seated on benches along the waterfront promenade.  \n- People walk past or sit at outdoor cafes with white umbrellas lining the right side of the path.  \n- A street vendor cart with a blue flag is visible near the left edge of the frame, with pedestrians passing by.", "history_tokens": 374, "history_utf8_bytes": 1590, "recent_frame_times_s": [147.00216666666665, 148.00316666666666, 149.00416666666666, 150.00516666666667, 151.00616666666667, 152.00716666666668, 153.00816666666665, 154.00916666666666, 155.01016666666666, 156.01116666666667, 157.01216666666667, 158.01316666666668, 159.01416666666665, 160.01516666666666, 161.01616666666666, 162.00048333333334, 163.00148333333334, 164.00248333333334, 165.00348333333332, 166.00448333333333, 167.00548333333333, 168.00648333333334, 169.00748333333334, 170.00848333333334, 171.00948333333332, 172.01048333333333, 173.01148333333333, 174.01248333333334, 175.01348333333334, 176.01448333333335], "recent_frames_sha256": "4924977927bf443530e6b014ff280a94d5af42a91a7f17c1319b021e3f50e2ff", "num_recent_frames": 30, "tq": 716498.960677161, "t1": 716500.375996317, "ta": 716500.375996317, "te": 716500.413976226, "first_response_s": 1.4153191560180858, "answer_total_s": 1.4532990650041029, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 329, "content_group": "ff61ebae21984999f7dcf6d3c53dcfa2a9768728977e56ac241d7c20166084ad", "question": {"question_id": "sample_329_a919_q0", "video_id": 329, "video_path": "./videos/sample_329_real.mp4", "annotation_index": 919, "question_index": 0, "question": "What is the person in the blue outfit carrying?", "options": ["A. A briefcase.", "B. A backpack.", "C. A suitcase.", "D. A shopping bag."], "answer": "D", "time_stamp_s": 321, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_329_a919_q0", "video_id": 329, "time_stamp_s": 321, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e9d4f704c0cacfc6558fceec09a6ee3cf076660d452fda63caae84e714960385", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [291.0127, 292.0137, 293.0147, 294.0157, 295.0000166666667, 296.00101666666666, 297.0020166666667, 298.00301666666667, 299.00401666666664, 300.0050166666667, 301.00601666666665, 302.0070166666667, 303.00801666666666, 304.00901666666664, 305.0100166666667, 306.01101666666665, 307.0120166666667, 308.01301666666666, 309.0140166666667, 310.01501666666667, 311.01601666666664, 312.00033333333334, 313.0013333333333, 314.00233333333335, 315.00333333333333, 316.0043333333333, 317.00533333333334, 318.0063333333333, 319.00733333333335, 320.0083333333333], "recent_frames_sha256": "53d8ace6975aa442f676eb4c0b73da14ddc5f21b2cd5ce8ed2cf7ef478cc9083", "num_recent_frames": 30, "tq": 716650.746181483, "t1": 716657.489963305, "ta": 716657.489963305, "te": 716657.527375213, "first_response_s": 6.743781821918674, "answer_total_s": 6.781193729955703, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_329_a919_q0", "video_id": 329, "time_stamp_s": 321, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f27efe8dcc1888b08aea091d10d6f9a9272e59bb39bcf062b82912016c423e46", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A woman in a green dress walks along a seaside promenade, passing by outdoor café tables under white umbrellas.  \n- A man in a brown shirt and jeans walks beside her, occasionally glancing at his phone.  \n- Several cars, including a silver sedan and a dark SUV, pass by on the street adjacent to the promenade.\n[30-60s] - A white van drives along the left side of the promenade, moving away from the camera.  \n- A group of pedestrians walks toward the camera, passing by outdoor café tables under green umbrellas.  \n- A motorcycle is parked near the center-right, with a person standing beside it.\n[60-90s] - People stroll along the waterfront promenade, some near the water’s edge and others near café tables under umbrellas.  \n- A group of individuals in swimwear gathers near the water’s edge, possibly preparing to swim or relax.  \n- A bicycle and a motorbike are parked along the promenade, with a few people walking past them.\n[90-120s] - People swim and wade in the water near the dock, with some jumping in from the pier.\n- A large tree stands prominently on the promenade, surrounded by outdoor seating areas under white umbrellas.\n- A wooden boat with a red sail is moored near the shore, while another small boat moves along the water.\n[120-150s] - A large tree casts shade over a group of people seated on benches along the waterfront promenade.  \n- People walk past or sit at outdoor cafes with white umbrellas lining the right side of the path.  \n- A street vendor cart with a blue flag is visible near the left edge of the frame, with pedestrians passing by.\n[150-180s] - A couple walks hand-in-hand along the paved promenade, moving away from the camera toward the waterfront.  \n- A white car drives past on the left, followed by a red motorcycle.  \n- A red telephone booth stands near the stone staircase on the right, adjacent to a row of yellow buildings.\n[180-210s] - A group of pedestrians walks along a paved promenade beside a river, moving away from the camera.  \n- A stone archway with mossy patches and a small plant near its base is visible on the right, leading into a narrow passage.  \n- The promenade is lined with multi-story buildings featuring balconies and awnings, with a few outdoor seating areas visible.\n[210-240s] - A woman in a blue top and white shorts walks away from the camera along a paved sidewalk.  \n- A tall stone wall with arched windows and balconies lines the right side of the path, with closed umbrellas and planters.  \n- A utility pole with multiple arms stands near the center of the sidewalk, casting a shadow as the camera moves forward.\n[240-270s] - A man in a white shirt and beige shorts walks toward the camera, passing a parked silver car.  \n- A white van is parked near a stone wall, with a white truck visible behind it.  \n- A group of people gather under a yellow umbrella near the waterfront, with a building featuring blue balconies in the background.\n[270-300s] - A white building with a green door and arched windows stands at the corner of a cobblestone square, adjacent to a café with outdoor seating.  \n- A dark gray pickup truck is parked on the right side of the square, facing away from the camera.  \n- A white van and a silver car are parked along the narrow street that slopes upward, with pedestrians walking toward the top.", "history_tokens": 783, "history_utf8_bytes": 3320, "recent_frame_times_s": [291.0127, 292.0137, 293.0147, 294.0157, 295.0000166666667, 296.00101666666666, 297.0020166666667, 298.00301666666667, 299.00401666666664, 300.0050166666667, 301.00601666666665, 302.0070166666667, 303.00801666666666, 304.00901666666664, 305.0100166666667, 306.01101666666665, 307.0120166666667, 308.01301666666666, 309.0140166666667, 310.01501666666667, 311.01601666666664, 312.00033333333334, 313.0013333333333, 314.00233333333335, 315.00333333333333, 316.0043333333333, 317.00533333333334, 318.0063333333333, 319.00733333333335, 320.0083333333333], "recent_frames_sha256": "53d8ace6975aa442f676eb4c0b73da14ddc5f21b2cd5ce8ed2cf7ef478cc9083", "num_recent_frames": 30, "tq": 716550.761794244, "t1": 716552.095795839, "ta": 716552.095795839, "te": 716552.244182087, "first_response_s": 1.334001594921574, "answer_total_s": 1.4823878429597244, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 329, "content_group": "ff61ebae21984999f7dcf6d3c53dcfa2a9768728977e56ac241d7c20166084ad", "question": {"question_id": "sample_329_a920_q0", "video_id": 329, "video_path": "./videos/sample_329_real.mp4", "annotation_index": 920, "question_index": 0, "question": "Where was the historical stone building located in the frame right now?", "options": ["A. On the left side.", "B. On the right side.", "C. In the center.", "D. In the background."], "answer": "A", "time_stamp_s": 489, "task_type": "Spatial Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_329_a920_q0", "video_id": 329, "time_stamp_s": 489, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "adec1ec89c0150bffae362f4daf006de0400b97d7832dce7cc281903101f83e1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [459.0138666666667, 460.01486666666665, 461.0158666666667, 462.0001833333333, 463.00118333333336, 464.00218333333333, 465.0031833333333, 466.00418333333334, 467.0051833333333, 468.00618333333335, 469.00718333333333, 470.0081833333333, 471.00918333333334, 472.0101833333333, 473.01118333333335, 474.0121833333333, 475.01318333333336, 476.01418333333334, 477.0151833333333, 478.01618333333334, 479.0005, 480.0015, 481.0025, 482.0035, 483.0045, 484.0055, 485.0065, 486.0075, 487.0085, 488.0095], "recent_frames_sha256": "6cdb7d2239c044f1d54d588459cf0c75582f501882c34a0636d8f22162891162", "num_recent_frames": 30, "tq": 716657.557189576, "t1": 716664.873498208, "ta": 716664.873498208, "te": 716664.91250181, "first_response_s": 7.316308632027358, "answer_total_s": 7.355312234023586, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_329_a920_q0", "video_id": 329, "time_stamp_s": 489, "ground_truth": "A", "raw_output": "B. On the right side.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "7e11cead223ce7644633b5eab3b60e9d5b7a432741a9d158d203f689d0b0c187", "condition_order": ["notes", "recent"], "memory": "[120-150s] - A large tree casts shade over a group of people seated on benches along the waterfront promenade.  \n- People walk past or sit at outdoor cafes with white umbrellas lining the right side of the path.  \n- A street vendor cart with a blue flag is visible near the left edge of the frame, with pedestrians passing by.\n[150-180s] - A couple walks hand-in-hand along the paved promenade, moving away from the camera toward the waterfront.  \n- A white car drives past on the left, followed by a red motorcycle.  \n- A red telephone booth stands near the stone staircase on the right, adjacent to a row of yellow buildings.\n[180-210s] - A group of pedestrians walks along a paved promenade beside a river, moving away from the camera.  \n- A stone archway with mossy patches and a small plant near its base is visible on the right, leading into a narrow passage.  \n- The promenade is lined with multi-story buildings featuring balconies and awnings, with a few outdoor seating areas visible.\n[210-240s] - A woman in a blue top and white shorts walks away from the camera along a paved sidewalk.  \n- A tall stone wall with arched windows and balconies lines the right side of the path, with closed umbrellas and planters.  \n- A utility pole with multiple arms stands near the center of the sidewalk, casting a shadow as the camera moves forward.\n[240-270s] - A man in a white shirt and beige shorts walks toward the camera, passing a parked silver car.  \n- A white van is parked near a stone wall, with a white truck visible behind it.  \n- A group of people gather under a yellow umbrella near the waterfront, with a building featuring blue balconies in the background.\n[270-300s] - A white building with a green door and arched windows stands at the corner of a cobblestone square, adjacent to a café with outdoor seating.  \n- A dark gray pickup truck is parked on the right side of the square, facing away from the camera.  \n- A white van and a silver car are parked along the narrow street that slopes upward, with pedestrians walking toward the top.\n[300-330s] - A woman in a white shirt and blue jeans walks toward the camera, carrying a black bag.  \n- A man in a white t-shirt and dark shorts walks beside her, holding a phone.  \n- A group of people, including a woman in a red top and a man in a blue shirt, are seen walking away from the camera up the street.\n[330-360s] - Pedestrians walk across a cobblestone square under a bright blue sky, with a prominent statue and a large crane visible in the background.\n- A group of tourists, some carrying bags, moves along the sidewalk near a building with ornate balconies and a \"Banco\" sign.\n- A parked silver car and a line of scooters are visible on the street, with a large stone building featuring classical architecture in the distance.\n[360-390s] - A white van with \"BICAFE HOME & OFFICE\" branding is parked on the cobblestone street, partially obscuring the view of a black car behind it.  \n- A man in a yellow shirt walks along the sidewalk, moving away from the camera toward the street’s far end.  \n- The street scene includes a mix of parked cars, a traffic light, and a large stone building in the background, under a partly cloudy sky.\n[390-420s] - A large stone cathedral with Gothic architecture dominates the right side of the street, its facade visible against a partly cloudy sky.  \n- Cobblestone streets with parked cars and a blue-and-white bus pass by, while pedestrians walk along the sidewalk.  \n- A yellow building with balconies stands on the left, and a stone wall runs along the right, separating the street from the cathedral.\n[420-450s] - A large stone church with a prominent arched entrance and tall windows dominates the right side of the street.  \n- Pedestrians, including a woman in a white top and a man in a red shirt, walk along the sidewalk near the church’s entrance.  \n- A yellow taxi and a white van pass by on the cobblestone road, with a red traffic light visible at the intersection.\n[450-480s] - Two individuals in red shirts stand near a stone building's entrance, observing the street.  \n- A black SUV passes by, followed by a silver sedan, both moving along the cobblestone road.  \n- A pedestrian in a patterned top walks across the street, crossing from right to left.", "history_tokens": 1021, "history_utf8_bytes": 4278, "recent_frame_times_s": [459.0138666666667, 460.01486666666665, 461.0158666666667, 462.0001833333333, 463.00118333333336, 464.00218333333333, 465.0031833333333, 466.00418333333334, 467.0051833333333, 468.00618333333335, 469.00718333333333, 470.0081833333333, 471.00918333333334, 472.0101833333333, 473.01118333333335, 474.0121833333333, 475.01318333333336, 476.01418333333334, 477.0151833333333, 478.01618333333334, 479.0005, 480.0015, 481.0025, 482.0035, 483.0045, 484.0055, 485.0065, 486.0075, 487.0085, 488.0095], "recent_frames_sha256": "6cdb7d2239c044f1d54d588459cf0c75582f501882c34a0636d8f22162891162", "num_recent_frames": 30, "tq": 716608.484765994, "t1": 716610.687784095, "ta": 716610.687784095, "te": 716610.969059585, "first_response_s": 2.2030181009322405, "answer_total_s": 2.484293590998277, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 329, "content_group": "ff61ebae21984999f7dcf6d3c53dcfa2a9768728977e56ac241d7c20166084ad", "question": {"question_id": "sample_329_a921_q0", "video_id": 329, "video_path": "./videos/sample_329_real.mp4", "annotation_index": 921, "question_index": 0, "question": "What is the name of the left side establishment indicated by the signs on the building?", "options": ["A. HARD CLUB.", "B. HARD ROCK.", "C. CLUB HARD.", "D. ROCK CLUB."], "answer": "A", "time_stamp_s": 589, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [540, 589], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_329_a921_q0", "video_id": 329, "time_stamp_s": 589, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f50178369fea3e5261dbf7c033daf555edffa899742be6ae4f89cedbffc27ce0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [559.0137666666667, 560.0147666666667, 561.0157666666667, 562.0000833333334, 563.0010833333333, 564.0020833333333, 565.0030833333333, 566.0040833333334, 567.0050833333333, 568.0060833333333, 569.0070833333333, 570.0080833333334, 571.0090833333334, 572.0100833333333, 573.0110833333333, 574.0120833333333, 575.0130833333334, 576.0140833333334, 577.0150833333333, 578.0160833333333, 579.0004, 580.0014, 581.0024, 582.0034, 583.0044, 584.0054, 585.0064, 586.0074, 587.0084, 588.0094], "recent_frames_sha256": "9e396b07e6f2216f530450d32de0b2d3d0a6aeb32fa036e868bc321f01d8aa16", "num_recent_frames": 30, "tq": 716664.929699209, "t1": 716671.373061508, "ta": 716671.373061508, "te": 716671.523736242, "first_response_s": 6.443362299003638, "answer_total_s": 6.594037032919005, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_329_a921_q0", "video_id": 329, "time_stamp_s": 589, "ground_truth": "A", "raw_output": "C. CLUB HARD.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "b4873f4a24d1d539ee287bc5f12912a8a48d779c43b7f9081f0581249e8a40af", "condition_order": ["notes", "recent"], "memory": "[210-240s] - A woman in a blue top and white shorts walks away from the camera along a paved sidewalk.  \n- A tall stone wall with arched windows and balconies lines the right side of the path, with closed umbrellas and planters.  \n- A utility pole with multiple arms stands near the center of the sidewalk, casting a shadow as the camera moves forward.\n[240-270s] - A man in a white shirt and beige shorts walks toward the camera, passing a parked silver car.  \n- A white van is parked near a stone wall, with a white truck visible behind it.  \n- A group of people gather under a yellow umbrella near the waterfront, with a building featuring blue balconies in the background.\n[270-300s] - A white building with a green door and arched windows stands at the corner of a cobblestone square, adjacent to a café with outdoor seating.  \n- A dark gray pickup truck is parked on the right side of the square, facing away from the camera.  \n- A white van and a silver car are parked along the narrow street that slopes upward, with pedestrians walking toward the top.\n[300-330s] - A woman in a white shirt and blue jeans walks toward the camera, carrying a black bag.  \n- A man in a white t-shirt and dark shorts walks beside her, holding a phone.  \n- A group of people, including a woman in a red top and a man in a blue shirt, are seen walking away from the camera up the street.\n[330-360s] - Pedestrians walk across a cobblestone square under a bright blue sky, with a prominent statue and a large crane visible in the background.\n- A group of tourists, some carrying bags, moves along the sidewalk near a building with ornate balconies and a \"Banco\" sign.\n- A parked silver car and a line of scooters are visible on the street, with a large stone building featuring classical architecture in the distance.\n[360-390s] - A white van with \"BICAFE HOME & OFFICE\" branding is parked on the cobblestone street, partially obscuring the view of a black car behind it.  \n- A man in a yellow shirt walks along the sidewalk, moving away from the camera toward the street’s far end.  \n- The street scene includes a mix of parked cars, a traffic light, and a large stone building in the background, under a partly cloudy sky.\n[390-420s] - A large stone cathedral with Gothic architecture dominates the right side of the street, its facade visible against a partly cloudy sky.  \n- Cobblestone streets with parked cars and a blue-and-white bus pass by, while pedestrians walk along the sidewalk.  \n- A yellow building with balconies stands on the left, and a stone wall runs along the right, separating the street from the cathedral.\n[420-450s] - A large stone church with a prominent arched entrance and tall windows dominates the right side of the street.  \n- Pedestrians, including a woman in a white top and a man in a red shirt, walk along the sidewalk near the church’s entrance.  \n- A yellow taxi and a white van pass by on the cobblestone road, with a red traffic light visible at the intersection.\n[450-480s] - Two individuals in red shirts stand near a stone building's entrance, observing the street.  \n- A black SUV passes by, followed by a silver sedan, both moving along the cobblestone road.  \n- A pedestrian in a patterned top walks across the street, crossing from right to left.\n[480-510s] - A gray SUV with license plate \"24-700-AR\" parks along the cobblestone road, its rear door open.  \n- Two individuals sit on a bench near the stone wall, appearing relaxed.  \n- A red traffic light is visible at the intersection, indicating stop for vehicles.\n[510-540s] - A man in a blue shirt climbs a stone staircase attached to a historic building.  \n- A red and white delivery van with \"Casa de Laranja\" branding is parked on the street.  \n- A black SUV drives past, then stops with its driver opening the door.\n[540-570s] - A silver car is parked on the right side of the cobblestone street, partially visible near the foreground.  \n- Two individuals are seated on a stone bench along the left sidewalk, facing away from the camera.  \n- A blue pedestrian crossing sign is mounted on a pole near the center-right of the frame, positioned above the street.", "history_tokens": 1006, "history_utf8_bytes": 4154, "recent_frame_times_s": [559.0137666666667, 560.0147666666667, 561.0157666666667, 562.0000833333334, 563.0010833333333, 564.0020833333333, 565.0030833333333, 566.0040833333334, 567.0050833333333, 568.0060833333333, 569.0070833333333, 570.0080833333334, 571.0090833333334, 572.0100833333333, 573.0110833333333, 574.0120833333333, 575.0130833333334, 576.0140833333334, 577.0150833333333, 578.0160833333333, 579.0004, 580.0014, 581.0024, 582.0034, 583.0044, 584.0054, 585.0064, 586.0074, 587.0084, 588.0094], "recent_frames_sha256": "9e396b07e6f2216f530450d32de0b2d3d0a6aeb32fa036e868bc321f01d8aa16", "num_recent_frames": 30, "tq": 716634.640246001, "t1": 716637.165747716, "ta": 716637.165747716, "te": 716637.577046879, "first_response_s": 2.5255017150193453, "answer_total_s": 2.9368008780293167, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 330, "content_group": "c7d8e0131d90d72403255922db63591a68aae6bf0d713d753ea6258c59e09e03", "question": {"question_id": "sample_330_a29_q0", "video_id": 330, "video_path": "./videos/sample_330_real.mp4", "annotation_index": 29, "question_index": 0, "question": "What object is visible on the left side of the frame next to the parked cars?", "options": ["A. A red mailbox.", "B. A blue parking meter.", "C. A green trash can.", "D. A yellow bike rack."], "answer": "B", "time_stamp_s": 15, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_330_a29_q0", "video_id": 330, "time_stamp_s": 15, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "48d09f58549ad2714583921d404dcf106bb3dd0c0e68af70ee8da76483082ec5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.029, 1.0133166666666666, 2.0143166666666668, 3.0153166666666666, 4.0163166666666665, 5.000633333333333, 6.001633333333333, 7.002633333333334, 8.003633333333333, 9.004633333333333, 10.005633333333334, 11.006633333333333, 12.007633333333333, 13.008633333333334, 14.009633333333333], "recent_frames_sha256": "4c7a85600beba2717e5f34d3eb400e585d512903a8366c3ce8b1769af046dc92", "num_recent_frames": 15, "tq": 715604.519308512, "t1": 715618.009564272, "ta": 715618.009564272, "te": 715618.048549116, "first_response_s": 13.490255760028958, "answer_total_s": 13.52924060402438, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_330_a29_q0", "video_id": 330, "time_stamp_s": 15, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f19b9bae93fd8f99dbcc2b62d46a4d509fcd7bc66e44166b7acd59d59f2cc3e4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.029, 1.0133166666666666, 2.0143166666666668, 3.0153166666666666, 4.0163166666666665, 5.000633333333333, 6.001633333333333, 7.002633333333334, 8.003633333333333, 9.004633333333333, 10.005633333333334, 11.006633333333333, 12.007633333333333, 13.008633333333334, 14.009633333333333], "recent_frames_sha256": "4c7a85600beba2717e5f34d3eb400e585d512903a8366c3ce8b1769af046dc92", "num_recent_frames": 15, "tq": 715697.986194724, "t1": 715699.318214045, "ta": 715699.318214045, "te": 715699.356721955, "first_response_s": 1.3320193210383877, "answer_total_s": 1.370527231018059, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 330, "content_group": "c7d8e0131d90d72403255922db63591a68aae6bf0d713d753ea6258c59e09e03", "question": {"question_id": "sample_330_a30_q0", "video_id": 330, "video_path": "./videos/sample_330_real.mp4", "annotation_index": 30, "question_index": 0, "question": "What distinct feature is highlighted on the ornate stone building right now?", "options": ["A. Blue doors.", "B. Stone carvings.", "C. Red-framed windows.", "D. Iron railings."], "answer": "B", "time_stamp_s": 180, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_330_a30_q0", "video_id": 330, "time_stamp_s": 180, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bf7648a8087523029a1b187c9408853b803706704fc67dfb398a71eaf4574b7b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.01216666666667, 151.01316666666668, 152.01416666666665, 153.01516666666666, 154.01616666666666, 155.00048333333334, 156.00148333333334, 157.00248333333334, 158.00348333333332, 159.00448333333333, 160.00548333333333, 161.00648333333334, 162.00748333333334, 163.00848333333334, 164.00948333333332, 165.01048333333333, 166.01148333333333, 167.01248333333334, 168.01348333333334, 169.01448333333335, 170.01548333333332, 171.01648333333333, 172.0008, 173.0018, 174.0028, 175.0038, 176.0048, 177.0058, 178.0068, 179.0078], "recent_frames_sha256": "e86810d1a6d75b2b9aa53f7babe1c3d780bd7c1ba6707f06c160e4aad39b979a", "num_recent_frames": 30, "tq": 715618.055941303, "t1": 715660.762966203, "ta": 715660.762966203, "te": 715660.800471808, "first_response_s": 42.707024900009856, "answer_total_s": 42.74453050491866, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_330_a30_q0", "video_id": 330, "time_stamp_s": 180, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "74c4e78dc0c4448cc8bb66432e4c692bfc51683457b083a5f8c27d7a8faaab5d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A blue parking sign with \"P\" and \"Zona de Estacionamento\" is visible on a pole near parked cars.  \n- A man in a blue shirt and white shorts walks past parked vehicles, moving toward the camera.  \n- A red metal fence lines the sidewalk, adjacent to a building with a large abstract mural.\n[30-60s] - A woman in a white dress walks past parked vans and a café with outdoor seating, then bends down near a blue chair.  \n- A white van with \"tealt\" branding is parked on the left, while a silver sedan and a white hatchback are parked further down the street.  \n- A blue parking sign and a \"No Parking\" sign are visible on a pole, with a crane in the background near a building under construction.\n[60-90s] - A man in a white shirt walks past a stone building with large windows on the right side of the street.  \n- A blue car is parked on the left side of the street, near a building with green shutters.  \n- A street signpost with directional arrows is visible in the center of the frame, indicating nearby streets.\n[90-120s] - A black car drives leftward along a cobblestone street, passing a red building with outdoor seating.  \n- A horse-drawn carriage is parked near a \"No Entry\" sign, with pedestrians walking past.  \n- A tall, modern sculpture stands on the sidewalk, contrasting with the historic architecture.\n[120-150s] - A street performer plays guitar under a white umbrella near a café with red accents.  \n- A woman in a white top and red shorts walks past, heading toward the right side of the frame.  \n- A man in a blue shirt sits on a bench on the right, facing away from the camera.\n[150-180s] - A person in a yellow shirt walks briskly past a building with red shutters and ornate balconies.  \n- A man sits on the ground near a building with arched stone entrances, appearing to rest or work.  \n- A blue-tiled building with decorative ironwork and a closed gate stands on the right, contrasting with adjacent structures.", "history_tokens": 473, "history_utf8_bytes": 1946, "recent_frame_times_s": [150.01216666666667, 151.01316666666668, 152.01416666666665, 153.01516666666666, 154.01616666666666, 155.00048333333334, 156.00148333333334, 157.00248333333334, 158.00348333333332, 159.00448333333333, 160.00548333333333, 161.00648333333334, 162.00748333333334, 163.00848333333334, 164.00948333333332, 165.01048333333333, 166.01148333333333, 167.01248333333334, 168.01348333333334, 169.01448333333335, 170.01548333333332, 171.01648333333333, 172.0008, 173.0018, 174.0028, 175.0038, 176.0048, 177.0058, 178.0068, 179.0078], "recent_frames_sha256": "e86810d1a6d75b2b9aa53f7babe1c3d780bd7c1ba6707f06c160e4aad39b979a", "num_recent_frames": 30, "tq": 715744.423519044, "t1": 715752.019430933, "ta": 715752.019430933, "te": 715752.255979725, "first_response_s": 7.595911889104173, "answer_total_s": 7.832460681092925, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 330, "content_group": "c7d8e0131d90d72403255922db63591a68aae6bf0d713d753ea6258c59e09e03", "question": {"question_id": "sample_330_a31_q0", "video_id": 330, "video_path": "./videos/sample_330_real.mp4", "annotation_index": 31, "question_index": 0, "question": "What color is the shirt of the man who is slightly ahead in the group of four people?", "options": ["A. Green.", "B. Blue.", "C. White.", "D. Red."], "answer": "C", "time_stamp_s": 332, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_330_a31_q0", "video_id": 330, "time_stamp_s": 332, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f4bdbd3dfbea795b57613dd65fc9f5ee23f84f0e82f010248a8a1448c9d5d196", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [302.0140166666667, 303.01501666666667, 304.01601666666664, 305.00033333333334, 306.0013333333333, 307.00233333333335, 308.00333333333333, 309.0043333333333, 310.00533333333334, 311.0063333333333, 312.00733333333335, 313.0083333333333, 314.00933333333336, 315.01033333333334, 316.0113333333333, 317.01233333333334, 318.0133333333333, 319.01433333333335, 320.01533333333333, 321.0163333333333, 322.00065, 323.00165, 324.00265, 325.00365, 326.00465, 327.00565, 328.00665, 329.00765, 330.00865, 331.00965], "recent_frames_sha256": "3a2a491d8071df29ed11791e39f4f80097f698a42af3e3593e0aa1b425ae41d5", "num_recent_frames": 30, "tq": 715660.807937757, "t1": 715672.498010905, "ta": 715672.498010905, "te": 715672.536636053, "first_response_s": 11.690073147998191, "answer_total_s": 11.728698296006769, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_330_a31_q0", "video_id": 330, "time_stamp_s": 332, "ground_truth": "C", "raw_output": "B. Blue.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "78edeaca5e84afe1d84d23c903a01b08301b3b5f3b6c94f36fe6800aa3cfb524", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A blue parking sign with \"P\" and \"Zona de Estacionamento\" is visible on a pole near parked cars.  \n- A man in a blue shirt and white shorts walks past parked vehicles, moving toward the camera.  \n- A red metal fence lines the sidewalk, adjacent to a building with a large abstract mural.\n[30-60s] - A woman in a white dress walks past parked vans and a café with outdoor seating, then bends down near a blue chair.  \n- A white van with \"tealt\" branding is parked on the left, while a silver sedan and a white hatchback are parked further down the street.  \n- A blue parking sign and a \"No Parking\" sign are visible on a pole, with a crane in the background near a building under construction.\n[60-90s] - A man in a white shirt walks past a stone building with large windows on the right side of the street.  \n- A blue car is parked on the left side of the street, near a building with green shutters.  \n- A street signpost with directional arrows is visible in the center of the frame, indicating nearby streets.\n[90-120s] - A black car drives leftward along a cobblestone street, passing a red building with outdoor seating.  \n- A horse-drawn carriage is parked near a \"No Entry\" sign, with pedestrians walking past.  \n- A tall, modern sculpture stands on the sidewalk, contrasting with the historic architecture.\n[120-150s] - A street performer plays guitar under a white umbrella near a café with red accents.  \n- A woman in a white top and red shorts walks past, heading toward the right side of the frame.  \n- A man in a blue shirt sits on a bench on the right, facing away from the camera.\n[150-180s] - A person in a yellow shirt walks briskly past a building with red shutters and ornate balconies.  \n- A man sits on the ground near a building with arched stone entrances, appearing to rest or work.  \n- A blue-tiled building with decorative ironwork and a closed gate stands on the right, contrasting with adjacent structures.\n[180-210s] - A woman in a yellow top walks away from the camera down a sunlit street, carrying a brown bag.  \n- A man in a white shirt and shorts walks toward the camera, passing a café with outdoor seating.  \n- A child in a red shirt runs alongside a woman in a blue dress on the left side of the street.\n[210-240s] - A woman in a yellow top and brown shorts walks away from the camera down the center of a sunlit street.  \n- Pedestrians, including a man in a green shirt and a woman in a white top, move in various directions along the street.  \n- Outdoor café tables with white umbrellas are visible on the right, with patrons seated and enjoying the day.\n[240-270s] - A woman in an orange top walks away from the camera down a sunlit street lined with colorful buildings.  \n- Graffiti-covered metal barriers line both sides of the street, with some sections displaying vibrant spray-painted tags.  \n- A motorcyclist passes by on the right, moving toward the camera, while pedestrians continue walking in both directions.\n[270-300s] - A woman in a yellow top walks briskly down the street, moving away from the camera.  \n- A man in a blue shirt and beige pants walks alongside her, also moving away.  \n- A street vendor with a cart is visible on the right, displaying goods under a green awning.\n[300-330s] - A group of pedestrians, including a man in a pink shirt and blue jeans, walks down a sunlit street lined with historic buildings.  \n- A woman in a floral dress walks toward the camera on the right side of the street.  \n- A shop with a red metal gate and signage for \"SCHWARZ\" is visible on the right, with a few people seated outside nearby.", "history_tokens": 880, "history_utf8_bytes": 3602, "recent_frame_times_s": [302.0140166666667, 303.01501666666667, 304.01601666666664, 305.00033333333334, 306.0013333333333, 307.00233333333335, 308.00333333333333, 309.0043333333333, 310.00533333333334, 311.0063333333333, 312.00733333333335, 313.0083333333333, 314.00933333333336, 315.01033333333334, 316.0113333333333, 317.01233333333334, 318.0133333333333, 319.01433333333335, 320.01533333333333, 321.0163333333333, 322.00065, 323.00165, 324.00265, 325.00365, 326.00465, 327.00565, 328.00665, 329.00765, 330.00865, 331.00965], "recent_frames_sha256": "3a2a491d8071df29ed11791e39f4f80097f698a42af3e3593e0aa1b425ae41d5", "num_recent_frames": 30, "tq": 715785.643153442, "t1": 715792.08974052, "ta": 715792.08974052, "te": 715792.237834963, "first_response_s": 6.446587078040466, "answer_total_s": 6.594681521062739, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 330, "content_group": "c7d8e0131d90d72403255922db63591a68aae6bf0d713d753ea6258c59e09e03", "question": {"question_id": "sample_330_a32_q0", "video_id": 330, "video_path": "./videos/sample_330_real.mp4", "annotation_index": 32, "question_index": 0, "question": "What type of umbrellas are seen at the outdoor cafés right now?", "options": ["A. Blue and white.", "B. Red and brown.", "C. Green and yellow.", "D. Black and white."], "answer": "B", "time_stamp_s": 485, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_330_a32_q0", "video_id": 330, "time_stamp_s": 485, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b2983328d27525853616cd8194b5077e9450d8cbb7e3f105b4bfc03624bc8621", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [455.0001833333333, 456.00118333333336, 457.00218333333333, 458.0031833333333, 459.00418333333334, 460.0051833333333, 461.00618333333335, 462.00718333333333, 463.0081833333333, 464.00918333333334, 465.0101833333333, 466.01118333333335, 467.0121833333333, 468.01318333333336, 469.01418333333334, 470.0151833333333, 471.01618333333334, 472.0005, 473.0015, 474.0025, 475.0035, 476.0045, 477.0055, 478.0065, 479.0075, 480.0085, 481.0095, 482.0105, 483.0115, 484.0125], "recent_frames_sha256": "5f704fd859b5a2ce729ebe158aef5b288a64ccac3b89a27e6c50f1946335eb39", "num_recent_frames": 30, "tq": 715672.545126613, "t1": 715683.778555871, "ta": 715683.778555871, "te": 715683.816753163, "first_response_s": 11.233429257990792, "answer_total_s": 11.271626550005749, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_330_a32_q0", "video_id": 330, "time_stamp_s": 485, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "861b2b78d22bd7ec3bb03725414fb4ba0e0b697929beb7aa67d43787b52f6e6e", "condition_order": ["recent", "notes"], "memory": "[120-150s] - A street performer plays guitar under a white umbrella near a café with red accents.  \n- A woman in a white top and red shorts walks past, heading toward the right side of the frame.  \n- A man in a blue shirt sits on a bench on the right, facing away from the camera.\n[150-180s] - A person in a yellow shirt walks briskly past a building with red shutters and ornate balconies.  \n- A man sits on the ground near a building with arched stone entrances, appearing to rest or work.  \n- A blue-tiled building with decorative ironwork and a closed gate stands on the right, contrasting with adjacent structures.\n[180-210s] - A woman in a yellow top walks away from the camera down a sunlit street, carrying a brown bag.  \n- A man in a white shirt and shorts walks toward the camera, passing a café with outdoor seating.  \n- A child in a red shirt runs alongside a woman in a blue dress on the left side of the street.\n[210-240s] - A woman in a yellow top and brown shorts walks away from the camera down the center of a sunlit street.  \n- Pedestrians, including a man in a green shirt and a woman in a white top, move in various directions along the street.  \n- Outdoor café tables with white umbrellas are visible on the right, with patrons seated and enjoying the day.\n[240-270s] - A woman in an orange top walks away from the camera down a sunlit street lined with colorful buildings.  \n- Graffiti-covered metal barriers line both sides of the street, with some sections displaying vibrant spray-painted tags.  \n- A motorcyclist passes by on the right, moving toward the camera, while pedestrians continue walking in both directions.\n[270-300s] - A woman in a yellow top walks briskly down the street, moving away from the camera.  \n- A man in a blue shirt and beige pants walks alongside her, also moving away.  \n- A street vendor with a cart is visible on the right, displaying goods under a green awning.\n[300-330s] - A group of pedestrians, including a man in a pink shirt and blue jeans, walks down a sunlit street lined with historic buildings.  \n- A woman in a floral dress walks toward the camera on the right side of the street.  \n- A shop with a red metal gate and signage for \"SCHWARZ\" is visible on the right, with a few people seated outside nearby.\n[330-360s] - A man in a pink shirt walks forward, carrying a blue backpack, alongside others on a sunlit street.  \n- A woman in a white top and black pants walks ahead, her back to the camera, moving toward the street’s end.  \n- A red storefront with a metal shutter is visible on the right, partially open, as pedestrians pass by.\n[360-390s] - A man in a white shirt and dark pants walks toward the camera, gesturing with his right hand as he passes a red storefront.  \n- A woman in a light-colored top and jeans runs across the street from left to right, moving away from the camera.  \n- The camera pans right, revealing a green-painted building with a sign reading \"Café\" and a fire hydrant on the sidewalk.\n[390-420s] - A woman in a blue dress walks away from the camera, followed by a man in a dark shirt and cap.  \n- A white van is parked on the left side of the street, partially obstructing the view.  \n- A storefront with a green awning and \"TRADICION\" sign is visible on the right, with people passing by.\n[420-450s] - A couple walks away from the camera down a cobblestone street, flanked by colorful buildings and outdoor café tables.  \n- A silver car drives past on the right, followed by a black SUV, while pedestrians continue moving along the street.  \n- A white van is parked on the right side of the street, near a green-painted building with a \"Café\" sign.\n[450-480s] - A green, ornate kiosk with posters stands centrally in the plaza, surrounded by cobblestone pavement.  \n- People walk past outdoor café tables under umbrellas, with some carrying bags or wearing casual attire.  \n- A large, historic building with classical architecture and a dome dominates the background, partially obscured by construction fencing.", "history_tokens": 988, "history_utf8_bytes": 4021, "recent_frame_times_s": [455.0001833333333, 456.00118333333336, 457.00218333333333, 458.0031833333333, 459.00418333333334, 460.0051833333333, 461.00618333333335, 462.00718333333333, 463.0081833333333, 464.00918333333334, 465.0101833333333, 466.01118333333335, 467.0121833333333, 468.01318333333336, 469.01418333333334, 470.0151833333333, 471.01618333333334, 472.0005, 473.0015, 474.0025, 475.0035, 476.0045, 477.0055, 478.0065, 479.0075, 480.0085, 481.0095, 482.0105, 483.0115, 484.0125], "recent_frames_sha256": "5f704fd859b5a2ce729ebe158aef5b288a64ccac3b89a27e6c50f1946335eb39", "num_recent_frames": 30, "tq": 715836.169681283, "t1": 715849.805868445, "ta": 715849.805868445, "te": 715850.006745586, "first_response_s": 13.63618716201745, "answer_total_s": 13.837064303108491, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 330, "content_group": "c7d8e0131d90d72403255922db63591a68aae6bf0d713d753ea6258c59e09e03", "question": {"question_id": "sample_330_a32_q1", "video_id": 330, "video_path": "./videos/sample_330_real.mp4", "annotation_index": 32, "question_index": 1, "question": "What does the the glass structure likely depict right now?", "options": ["A. A historic monument.", "B. A modern bus stop.", "C. A construction site.", "D. A marketplace."], "answer": "B", "time_stamp_s": 499, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_330_a32_q1", "video_id": 330, "time_stamp_s": 499, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "330fabe5ba62cbd2e036239f3ec46ec4a66f4148466f1bf88b3579c7d51e3f08", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [469.01418333333334, 470.0151833333333, 471.01618333333334, 472.0005, 473.0015, 474.0025, 475.0035, 476.0045, 477.0055, 478.0065, 479.0075, 480.0085, 481.0095, 482.0105, 483.0115, 484.0125, 485.0135, 486.0145, 487.0155, 488.0165, 489.00081666666665, 490.0018166666667, 491.00281666666666, 492.0038166666667, 493.00481666666667, 494.00581666666665, 495.0068166666667, 496.00781666666666, 497.0088166666667, 498.00981666666667], "recent_frames_sha256": "9faac8b6bd9fc8c70f77739ca6376f42df4558881e98cb09144f232c5553a869", "num_recent_frames": 30, "tq": 715683.825963558, "t1": 715697.784182685, "ta": 715697.784182685, "te": 715697.968296485, "first_response_s": 13.958219126914628, "answer_total_s": 14.142332926974632, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_330_a32_q1", "video_id": 330, "time_stamp_s": 499, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "72e350c8b089fe47fee70b81a616cf2af7f6d4f2a0a5ce0c0454c200da2288ec", "condition_order": ["recent", "notes"], "memory": "[120-150s] - A street performer plays guitar under a white umbrella near a café with red accents.  \n- A woman in a white top and red shorts walks past, heading toward the right side of the frame.  \n- A man in a blue shirt sits on a bench on the right, facing away from the camera.\n[150-180s] - A person in a yellow shirt walks briskly past a building with red shutters and ornate balconies.  \n- A man sits on the ground near a building with arched stone entrances, appearing to rest or work.  \n- A blue-tiled building with decorative ironwork and a closed gate stands on the right, contrasting with adjacent structures.\n[180-210s] - A woman in a yellow top walks away from the camera down a sunlit street, carrying a brown bag.  \n- A man in a white shirt and shorts walks toward the camera, passing a café with outdoor seating.  \n- A child in a red shirt runs alongside a woman in a blue dress on the left side of the street.\n[210-240s] - A woman in a yellow top and brown shorts walks away from the camera down the center of a sunlit street.  \n- Pedestrians, including a man in a green shirt and a woman in a white top, move in various directions along the street.  \n- Outdoor café tables with white umbrellas are visible on the right, with patrons seated and enjoying the day.\n[240-270s] - A woman in an orange top walks away from the camera down a sunlit street lined with colorful buildings.  \n- Graffiti-covered metal barriers line both sides of the street, with some sections displaying vibrant spray-painted tags.  \n- A motorcyclist passes by on the right, moving toward the camera, while pedestrians continue walking in both directions.\n[270-300s] - A woman in a yellow top walks briskly down the street, moving away from the camera.  \n- A man in a blue shirt and beige pants walks alongside her, also moving away.  \n- A street vendor with a cart is visible on the right, displaying goods under a green awning.\n[300-330s] - A group of pedestrians, including a man in a pink shirt and blue jeans, walks down a sunlit street lined with historic buildings.  \n- A woman in a floral dress walks toward the camera on the right side of the street.  \n- A shop with a red metal gate and signage for \"SCHWARZ\" is visible on the right, with a few people seated outside nearby.\n[330-360s] - A man in a pink shirt walks forward, carrying a blue backpack, alongside others on a sunlit street.  \n- A woman in a white top and black pants walks ahead, her back to the camera, moving toward the street’s end.  \n- A red storefront with a metal shutter is visible on the right, partially open, as pedestrians pass by.\n[360-390s] - A man in a white shirt and dark pants walks toward the camera, gesturing with his right hand as he passes a red storefront.  \n- A woman in a light-colored top and jeans runs across the street from left to right, moving away from the camera.  \n- The camera pans right, revealing a green-painted building with a sign reading \"Café\" and a fire hydrant on the sidewalk.\n[390-420s] - A woman in a blue dress walks away from the camera, followed by a man in a dark shirt and cap.  \n- A white van is parked on the left side of the street, partially obstructing the view.  \n- A storefront with a green awning and \"TRADICION\" sign is visible on the right, with people passing by.\n[420-450s] - A couple walks away from the camera down a cobblestone street, flanked by colorful buildings and outdoor café tables.  \n- A silver car drives past on the right, followed by a black SUV, while pedestrians continue moving along the street.  \n- A white van is parked on the right side of the street, near a green-painted building with a \"Café\" sign.\n[450-480s] - A green, ornate kiosk with posters stands centrally in the plaza, surrounded by cobblestone pavement.  \n- People walk past outdoor café tables under umbrellas, with some carrying bags or wearing casual attire.  \n- A large, historic building with classical architecture and a dome dominates the background, partially obscured by construction fencing.", "history_tokens": 988, "history_utf8_bytes": 4021, "recent_frame_times_s": [469.01418333333334, 470.0151833333333, 471.01618333333334, 472.0005, 473.0015, 474.0025, 475.0035, 476.0045, 477.0055, 478.0065, 479.0075, 480.0085, 481.0095, 482.0105, 483.0115, 484.0125, 485.0135, 486.0145, 487.0155, 488.0165, 489.00081666666665, 490.0018166666667, 491.00281666666666, 492.0038166666667, 493.00481666666667, 494.00581666666665, 495.0068166666667, 496.00781666666666, 497.0088166666667, 498.00981666666667], "recent_frames_sha256": "9faac8b6bd9fc8c70f77739ca6376f42df4558881e98cb09144f232c5553a869", "num_recent_frames": 30, "tq": 715850.034998242, "t1": 715856.085932479, "ta": 715856.085932479, "te": 715856.123458362, "first_response_s": 6.050934236962348, "answer_total_s": 6.088460119906813, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 331, "content_group": "81eeb28488f39e887192f8965a2301b187e073f48f2891cb2c6c2cefda38d7e8", "question": {"question_id": "sample_331_a520_q0", "video_id": 331, "video_path": "./videos/sample_331_real.mp4", "annotation_index": 520, "question_index": 0, "question": "What color shorts is the person wearing who is walking with someone in a blue shirt?", "options": ["A. Black.", "B. Yellow.", "C. Red.", "D. Green."], "answer": "B", "time_stamp_s": 7, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_331_a520_q0", "video_id": 331, "time_stamp_s": 7, "ground_truth": "B", "raw_output": "B. Yellow.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "6720f0d5348f1248298b7f011e5085088f5eb9d0141fdb35fb66be1bf2210fd9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.019, 1.0033166666666666, 2.0043166666666665, 3.005316666666667, 4.006316666666667, 5.007316666666667, 6.0083166666666665], "recent_frames_sha256": "7f7070dcbc3b05ba10ac5b5e20706cd071c0c92f9a9a161f097e6a1689726125", "num_recent_frames": 7, "tq": 716044.287114041, "t1": 716050.393615352, "ta": 716050.393615352, "te": 716050.547244757, "first_response_s": 6.106501310947351, "answer_total_s": 6.260130715905689, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_331_a520_q0", "video_id": 331, "time_stamp_s": 7, "ground_truth": "B", "raw_output": "B. Yellow.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "2f33493d89896fdb6277dd4067059c12b9100ed55c083276a27b42314ed09748", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.019, 1.0033166666666666, 2.0043166666666665, 3.005316666666667, 4.006316666666667, 5.007316666666667, 6.0083166666666665], "recent_frames_sha256": "7f7070dcbc3b05ba10ac5b5e20706cd071c0c92f9a9a161f097e6a1689726125", "num_recent_frames": 7, "tq": 715930.703365174, "t1": 715941.364100068, "ta": 715941.364100068, "te": 715941.623529864, "first_response_s": 10.660734893986955, "answer_total_s": 10.92016469000373, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 331, "content_group": "81eeb28488f39e887192f8965a2301b187e073f48f2891cb2c6c2cefda38d7e8", "question": {"question_id": "sample_331_a521_q0", "video_id": 331, "video_path": "./videos/sample_331_real.mp4", "annotation_index": 521, "question_index": 0, "question": "Where is the cyclist heading as they ride through the square?", "options": ["A. Towards the pedestrian crossing.", "B. Away from the central area.", "C. Towards the central area.", "D. Along the street to the left."], "answer": "C", "time_stamp_s": 138, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_331_a521_q0", "video_id": 331, "time_stamp_s": 138, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2879c10f1ea9333295dce8ed52f0ede2f221190d8e839985f411c26d07a79f47", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [108.01021666666666, 109.01121666666667, 110.01221666666666, 111.01321666666666, 112.01421666666667, 113.01521666666666, 114.01621666666666, 115.00053333333334, 116.00153333333333, 117.00253333333333, 118.00353333333334, 119.00453333333333, 120.00553333333333, 121.00653333333334, 122.00753333333333, 123.00853333333333, 124.00953333333334, 125.01053333333333, 126.01153333333333, 127.01253333333334, 128.01353333333333, 129.01453333333333, 130.01553333333334, 131.01653333333334, 132.00085, 133.00185, 134.00285, 135.00385, 136.00485, 137.00585], "recent_frames_sha256": "db2a6220c9209ab656f0b0c839a408affefcbe1d25ed2737c3515ca9761134de", "num_recent_frames": 30, "tq": 716050.56281752, "t1": 716064.530466097, "ta": 716064.530466097, "te": 716064.569349087, "first_response_s": 13.967648577061482, "answer_total_s": 14.006531566963531, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_331_a521_q0", "video_id": 331, "time_stamp_s": 138, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7618c631081832f786d485f5d42992a17dc114c0ce89f3d2d3bf3f213ceb6862", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pedestrians walk along cobblestone streets with tram tracks, passing under a green awning and near a traffic light.  \n- A red-brick church with a prominent tower is visible across a plaza, surrounded by trees and outdoor seating areas.  \n- A silver car and a red bus pass through the intersection as people cross the street, with a \"No Entry\" sign visible.\n[30-60s] - A man in a blue shirt walks across a crosswalk, moving away from the camera toward a large plaza.  \n- A bronze equestrian statue stands prominently in the plaza, with a crane visible behind it.  \n- The plaza is surrounded by historic buildings with ornate facades and trees lining the sidewalks.\n[60-90s] - A red double-decker bus with \"Tours\" branding moves across the street, passing a large white building with spires.  \n- A crane is visible in the background, positioned near a brick building with a pointed roof.  \n- Pedestrians and vehicles, including a blue car and a white van, are seen on the street, with trees lining the sidewalk.\n[90-120s] - A woman in a dark dress walks across the plaza, moving from right to left.  \n- A fountain with a central statue is visible in the center of the plaza.  \n- A red double-decker bus partially exits the frame on the right, while a blue bus remains stationary on the left.", "history_tokens": 312, "history_utf8_bytes": 1299, "recent_frame_times_s": [108.01021666666666, 109.01121666666667, 110.01221666666666, 111.01321666666666, 112.01421666666667, 113.01521666666666, 114.01621666666666, 115.00053333333334, 116.00153333333333, 117.00253333333333, 118.00353333333334, 119.00453333333333, 120.00553333333333, 121.00653333333334, 122.00753333333333, 123.00853333333333, 124.00953333333334, 125.01053333333333, 126.01153333333333, 127.01253333333334, 128.01353333333333, 129.01453333333333, 130.01553333333334, 131.01653333333334, 132.00085, 133.00185, 134.00285, 135.00385, 136.00485, 137.00585], "recent_frames_sha256": "db2a6220c9209ab656f0b0c839a408affefcbe1d25ed2737c3515ca9761134de", "num_recent_frames": 30, "tq": 715964.911584222, "t1": 715966.124508745, "ta": 715966.124508745, "te": 715966.312316307, "first_response_s": 1.2129245230462402, "answer_total_s": 1.4007320849923417, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 331, "content_group": "81eeb28488f39e887192f8965a2301b187e073f48f2891cb2c6c2cefda38d7e8", "question": {"question_id": "sample_331_a522_q0", "video_id": 331, "video_path": "./videos/sample_331_real.mp4", "annotation_index": 522, "question_index": 0, "question": "What is parked on the right side of the plaza?", "options": ["A. A red bicycle.", "B. A blue car.", "C. A white van.", "D. A black motorcycle."], "answer": "C", "time_stamp_s": 245, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_331_a522_q0", "video_id": 331, "time_stamp_s": 245, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e77b48b8d2f3e10cf45061884124d1ca8a6b72f6368b53f7bce3d310412c98ce", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [215.00043333333332, 216.00143333333332, 217.00243333333333, 218.00343333333333, 219.00443333333334, 220.00543333333334, 221.00643333333332, 222.00743333333332, 223.00843333333333, 224.00943333333333, 225.01043333333334, 226.01143333333334, 227.01243333333332, 228.01343333333332, 229.01443333333333, 230.01543333333333, 231.01643333333334, 232.00075, 233.00175, 234.00275, 235.00375, 236.00475, 237.00575, 238.00675, 239.00775, 240.00875, 241.00975, 242.01075, 243.01175, 244.01275], "recent_frames_sha256": "808edd085217e274186f34b0bdfda360b9582618a4c5f635ccaa78c15d536a84", "num_recent_frames": 30, "tq": 716064.580233045, "t1": 716076.961999569, "ta": 716076.961999569, "te": 716077.004620918, "first_response_s": 12.381766523933038, "answer_total_s": 12.424387872917578, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_331_a522_q0", "video_id": 331, "time_stamp_s": 245, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e8f813ff587f8d6c7376bd4b3e3cda5b0b30ff0638f3255ee3095a301d94c996", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pedestrians walk along cobblestone streets with tram tracks, passing under a green awning and near a traffic light.  \n- A red-brick church with a prominent tower is visible across a plaza, surrounded by trees and outdoor seating areas.  \n- A silver car and a red bus pass through the intersection as people cross the street, with a \"No Entry\" sign visible.\n[30-60s] - A man in a blue shirt walks across a crosswalk, moving away from the camera toward a large plaza.  \n- A bronze equestrian statue stands prominently in the plaza, with a crane visible behind it.  \n- The plaza is surrounded by historic buildings with ornate facades and trees lining the sidewalks.\n[60-90s] - A red double-decker bus with \"Tours\" branding moves across the street, passing a large white building with spires.  \n- A crane is visible in the background, positioned near a brick building with a pointed roof.  \n- Pedestrians and vehicles, including a blue car and a white van, are seen on the street, with trees lining the sidewalk.\n[90-120s] - A woman in a dark dress walks across the plaza, moving from right to left.  \n- A fountain with a central statue is visible in the center of the plaza.  \n- A red double-decker bus partially exits the frame on the right, while a blue bus remains stationary on the left.\n[120-150s] - Two women walk toward the camera, one in a brown top and blue skirt, the other in a white top and dark pants, passing a green bench.  \n- A man in a red shirt and blue jeans walks away from the camera, heading toward the center of the square.  \n- A bicycle with a green basket passes by on the right, moving away from the camera’s viewpoint.\n[150-180s] - A pedestrian walks across a crosswalk from left to right, moving away from the camera.  \n- A yellow construction crane remains stationary in the background, positioned between two buildings.  \n- A white vehicle passes on the right side of the frame, moving away from the camera.\n[180-210s] - A man in a blue shirt and beige pants walks toward the camera, then exits the frame.  \n- A large circular metal grate is visible in the foreground, centered in the plaza.  \n- A yellow crane stands tall on the right side of the frame, adjacent to a multi-story building under construction.\n[210-240s] - A group of pedestrians walks across the plaza, moving from right to left, with one person carrying a bag.  \n- A white van is parked near the center-right of the frame, stationary.  \n- A large yellow construction crane is visible on the right side, towering over the buildings under construction.", "history_tokens": 610, "history_utf8_bytes": 2558, "recent_frame_times_s": [215.00043333333332, 216.00143333333332, 217.00243333333333, 218.00343333333333, 219.00443333333334, 220.00543333333334, 221.00643333333332, 222.00743333333332, 223.00843333333333, 224.00943333333333, 225.01043333333334, 226.01143333333334, 227.01243333333332, 228.01343333333332, 229.01443333333333, 230.01543333333333, 231.01643333333334, 232.00075, 233.00175, 234.00275, 235.00375, 236.00475, 237.00575, 238.00675, 239.00775, 240.00875, 241.00975, 242.01075, 243.01175, 244.01275], "recent_frames_sha256": "808edd085217e274186f34b0bdfda360b9582618a4c5f635ccaa78c15d536a84", "num_recent_frames": 30, "tq": 715999.74213665, "t1": 716001.858740793, "ta": 716001.858740793, "te": 716001.898709892, "first_response_s": 2.1166041429387406, "answer_total_s": 2.1565732419257984, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 331, "content_group": "81eeb28488f39e887192f8965a2301b187e073f48f2891cb2c6c2cefda38d7e8", "question": {"question_id": "sample_331_a522_q1", "video_id": 331, "video_path": "./videos/sample_331_real.mp4", "annotation_index": 522, "question_index": 1, "question": "Where is the scaffolding located in the plaza?", "options": ["A. On the right side.", "B. Near the center.", "C. On the left side.", "D. In front of the clock tower."], "answer": "C", "time_stamp_s": 250, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_331_a522_q1", "video_id": 331, "time_stamp_s": 250, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6899f124c411c46c7cc3af7c6b821b2d60a3477673dc783485f2666fdc30ef97", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [220.00543333333334, 221.00643333333332, 222.00743333333332, 223.00843333333333, 224.00943333333333, 225.01043333333334, 226.01143333333334, 227.01243333333332, 228.01343333333332, 229.01443333333333, 230.01543333333333, 231.01643333333334, 232.00075, 233.00175, 234.00275, 235.00375, 236.00475, 237.00575, 238.00675, 239.00775, 240.00875, 241.00975, 242.01075, 243.01175, 244.01275, 245.01375, 246.01475, 247.01575, 248.00006666666667, 249.00106666666667], "recent_frames_sha256": "c21bbc0410dae5f8d182da891a3bf5f94a472b350877b74378bf8fa7a3658d7f", "num_recent_frames": 30, "tq": 716077.016039082, "t1": 716088.804874834, "ta": 716088.804874834, "te": 716088.841786809, "first_response_s": 11.788835752056912, "answer_total_s": 11.82574772706721, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_331_a522_q1", "video_id": 331, "time_stamp_s": 250, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2937872005fb5bf5e64b96175e3617066a1e712e609aa3cd5690641da2686b7a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pedestrians walk along cobblestone streets with tram tracks, passing under a green awning and near a traffic light.  \n- A red-brick church with a prominent tower is visible across a plaza, surrounded by trees and outdoor seating areas.  \n- A silver car and a red bus pass through the intersection as people cross the street, with a \"No Entry\" sign visible.\n[30-60s] - A man in a blue shirt walks across a crosswalk, moving away from the camera toward a large plaza.  \n- A bronze equestrian statue stands prominently in the plaza, with a crane visible behind it.  \n- The plaza is surrounded by historic buildings with ornate facades and trees lining the sidewalks.\n[60-90s] - A red double-decker bus with \"Tours\" branding moves across the street, passing a large white building with spires.  \n- A crane is visible in the background, positioned near a brick building with a pointed roof.  \n- Pedestrians and vehicles, including a blue car and a white van, are seen on the street, with trees lining the sidewalk.\n[90-120s] - A woman in a dark dress walks across the plaza, moving from right to left.  \n- A fountain with a central statue is visible in the center of the plaza.  \n- A red double-decker bus partially exits the frame on the right, while a blue bus remains stationary on the left.\n[120-150s] - Two women walk toward the camera, one in a brown top and blue skirt, the other in a white top and dark pants, passing a green bench.  \n- A man in a red shirt and blue jeans walks away from the camera, heading toward the center of the square.  \n- A bicycle with a green basket passes by on the right, moving away from the camera’s viewpoint.\n[150-180s] - A pedestrian walks across a crosswalk from left to right, moving away from the camera.  \n- A yellow construction crane remains stationary in the background, positioned between two buildings.  \n- A white vehicle passes on the right side of the frame, moving away from the camera.\n[180-210s] - A man in a blue shirt and beige pants walks toward the camera, then exits the frame.  \n- A large circular metal grate is visible in the foreground, centered in the plaza.  \n- A yellow crane stands tall on the right side of the frame, adjacent to a multi-story building under construction.\n[210-240s] - A group of pedestrians walks across the plaza, moving from right to left, with one person carrying a bag.  \n- A white van is parked near the center-right of the frame, stationary.  \n- A large yellow construction crane is visible on the right side, towering over the buildings under construction.", "history_tokens": 610, "history_utf8_bytes": 2558, "recent_frame_times_s": [220.00543333333334, 221.00643333333332, 222.00743333333332, 223.00843333333333, 224.00943333333333, 225.01043333333334, 226.01143333333334, 227.01243333333332, 228.01343333333332, 229.01443333333333, 230.01543333333333, 231.01643333333334, 232.00075, 233.00175, 234.00275, 235.00375, 236.00475, 237.00575, 238.00675, 239.00775, 240.00875, 241.00975, 242.01075, 243.01175, 244.01275, 245.01375, 246.01475, 247.01575, 248.00006666666667, 249.00106666666667], "recent_frames_sha256": "c21bbc0410dae5f8d182da891a3bf5f94a472b350877b74378bf8fa7a3658d7f", "num_recent_frames": 30, "tq": 716001.937237367, "t1": 716007.781769109, "ta": 716007.781769109, "te": 716007.819714131, "first_response_s": 5.844531741924584, "answer_total_s": 5.882476763916202, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 331, "content_group": "81eeb28488f39e887192f8965a2301b187e073f48f2891cb2c6c2cefda38d7e8", "question": {"question_id": "sample_331_a523_q0", "video_id": 331, "video_path": "./videos/sample_331_real.mp4", "annotation_index": 523, "question_index": 0, "question": "What is the color of the vehicle that follows the white van?", "options": ["A. Red.", "B. Black.", "C. Green.", "D. Blue."], "answer": "C", "time_stamp_s": 370, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_331_a523_q0", "video_id": 331, "time_stamp_s": 370, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "13b8bd99bc1d737594b9efd257156f3d2d0998e76725f8b6965eec2b4dc1f7a5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [340.00865, 341.00965, 342.01065, 343.01165, 344.01265, 345.01365, 346.01465, 347.01565, 348.01665, 349.00096666666667, 350.00196666666665, 351.0029666666667, 352.00396666666666, 353.0049666666667, 354.00596666666667, 355.00696666666664, 356.0079666666667, 357.00896666666665, 358.0099666666667, 359.01096666666666, 360.0119666666667, 361.01296666666667, 362.01396666666665, 363.0149666666667, 364.01596666666666, 365.00028333333336, 366.00128333333333, 367.0022833333333, 368.00328333333334, 369.0042833333333], "recent_frames_sha256": "91bc758e7d58fb953194dc1ec64ed650908e8415ad06b3499da419cfad3ebbbc", "num_recent_frames": 30, "tq": 716088.850524651, "t1": 716100.73227416, "ta": 716100.73227416, "te": 716100.769505034, "first_response_s": 11.881749509018846, "answer_total_s": 11.918980382964946, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_331_a523_q0", "video_id": 331, "time_stamp_s": 370, "ground_truth": "C", "raw_output": "D. Blue.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "dbdbde789af819234fdd075af7e55acff0696b54163a8bdcc4288bee8ce03843", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pedestrians walk along cobblestone streets with tram tracks, passing under a green awning and near a traffic light.  \n- A red-brick church with a prominent tower is visible across a plaza, surrounded by trees and outdoor seating areas.  \n- A silver car and a red bus pass through the intersection as people cross the street, with a \"No Entry\" sign visible.\n[30-60s] - A man in a blue shirt walks across a crosswalk, moving away from the camera toward a large plaza.  \n- A bronze equestrian statue stands prominently in the plaza, with a crane visible behind it.  \n- The plaza is surrounded by historic buildings with ornate facades and trees lining the sidewalks.\n[60-90s] - A red double-decker bus with \"Tours\" branding moves across the street, passing a large white building with spires.  \n- A crane is visible in the background, positioned near a brick building with a pointed roof.  \n- Pedestrians and vehicles, including a blue car and a white van, are seen on the street, with trees lining the sidewalk.\n[90-120s] - A woman in a dark dress walks across the plaza, moving from right to left.  \n- A fountain with a central statue is visible in the center of the plaza.  \n- A red double-decker bus partially exits the frame on the right, while a blue bus remains stationary on the left.\n[120-150s] - Two women walk toward the camera, one in a brown top and blue skirt, the other in a white top and dark pants, passing a green bench.  \n- A man in a red shirt and blue jeans walks away from the camera, heading toward the center of the square.  \n- A bicycle with a green basket passes by on the right, moving away from the camera’s viewpoint.\n[150-180s] - A pedestrian walks across a crosswalk from left to right, moving away from the camera.  \n- A yellow construction crane remains stationary in the background, positioned between two buildings.  \n- A white vehicle passes on the right side of the frame, moving away from the camera.\n[180-210s] - A man in a blue shirt and beige pants walks toward the camera, then exits the frame.  \n- A large circular metal grate is visible in the foreground, centered in the plaza.  \n- A yellow crane stands tall on the right side of the frame, adjacent to a multi-story building under construction.\n[210-240s] - A group of pedestrians walks across the plaza, moving from right to left, with one person carrying a bag.  \n- A white van is parked near the center-right of the frame, stationary.  \n- A large yellow construction crane is visible on the right side, towering over the buildings under construction.\n[240-270s] - A white van is parked on the right side of the square, stationary.  \n- A row of trees with green leaves lines the left side, casting shadows on the pavement.  \n- A tall clock tower building stands prominently in the center background, with construction cranes visible nearby.\n[270-300s] - A man in a blue shirt walks toward the water's edge, then sits on a low concrete ledge.  \n- A silver Smart car drives across the street, passing behind the trees.  \n- A large white building with a clock tower is visible in the background, partially obscured by trees.\n[300-330s] - A white police car with \"Policia\" text drives across a zebra crossing, moving from right to left.  \n- A blue car passes the police car, also moving from right to left, while a white van approaches from the left.  \n- A large, ornate building with a clock tower and scaffolding is visible in the background, with trees lining the street.\n[330-360s] - A white van is stationary at the crosswalk, facing the camera.  \n- A white police car with \"Policia\" written on its side is parked on the right side of the frame.  \n- A large tree with dense green foliage is positioned centrally, partially obscuring the view of the background building.", "history_tokens": 908, "history_utf8_bytes": 3777, "recent_frame_times_s": [340.00865, 341.00965, 342.01065, 343.01165, 344.01265, 345.01365, 346.01465, 347.01565, 348.01665, 349.00096666666667, 350.00196666666665, 351.0029666666667, 352.00396666666666, 353.0049666666667, 354.00596666666667, 355.00696666666664, 356.0079666666667, 357.00896666666665, 358.0099666666667, 359.01096666666666, 360.0119666666667, 361.01296666666667, 362.01396666666665, 363.0149666666667, 364.01596666666666, 365.00028333333336, 366.00128333333333, 367.0022833333333, 368.00328333333334, 369.0042833333333], "recent_frames_sha256": "91bc758e7d58fb953194dc1ec64ed650908e8415ad06b3499da419cfad3ebbbc", "num_recent_frames": 30, "tq": 716041.659633908, "t1": 716043.961974015, "ta": 716043.961974015, "te": 716044.241724866, "first_response_s": 2.302340107038617, "answer_total_s": 2.582090958021581, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 333, "content_group": "d277300dfb64a8ca91c6b1bd1100a94ee661920d510efc65c0e824240a59da48", "question": {"question_id": "sample_333_a1899_q0", "video_id": 333, "video_path": "./videos/sample_333_real.mp4", "annotation_index": 1899, "question_index": 0, "question": "What colour of bus was visible driving on the street just now?", "options": ["A. Green bus.", "B. Blue bus.", "C. Red bus.", "D. Yellow bus."], "answer": "A", "time_stamp_s": 12, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_333_a1899_q0", "video_id": 333, "time_stamp_s": 12, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7472e854a885a85d50bffff1603e95e03d195c63a411357fee76b730bde470a9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.046, 1.0136333333333334, 2.0146333333333333, 3.015633333333333, 4.016633333333333, 5.017633333333333, 6.018633333333334, 7.019633333333333, 8.020633333333333, 9.021633333333334, 10.022633333333333, 11.023633333333333], "recent_frames_sha256": "13423b1c8fd791fe2ab5c283b8e1d3fb37f4b06b1388ce53d4a30d0ee8ce33ae", "num_recent_frames": 12, "tq": 715296.64122232, "t1": 715309.348509805, "ta": 715309.348509805, "te": 715309.388117003, "first_response_s": 12.707287485012785, "answer_total_s": 12.746894682990387, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_333_a1899_q0", "video_id": 333, "time_stamp_s": 12, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "106cdfa52e162ecdc19ed58031851a1ab5bde713717e3b76c8caae0fa6feb46f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.046, 1.0136333333333334, 2.0146333333333333, 3.015633333333333, 4.016633333333333, 5.017633333333333, 6.018633333333334, 7.019633333333333, 8.020633333333333, 9.021633333333334, 10.022633333333333, 11.023633333333333], "recent_frames_sha256": "13423b1c8fd791fe2ab5c283b8e1d3fb37f4b06b1388ce53d4a30d0ee8ce33ae", "num_recent_frames": 12, "tq": 715347.39010328, "t1": 715353.374962573, "ta": 715353.374962573, "te": 715353.695504222, "first_response_s": 5.984859293093905, "answer_total_s": 6.305400941986591, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 333, "content_group": "d277300dfb64a8ca91c6b1bd1100a94ee661920d510efc65c0e824240a59da48", "question": {"question_id": "sample_333_a1899_q1", "video_id": 333, "video_path": "./videos/sample_333_real.mp4", "annotation_index": 1899, "question_index": 1, "question": "How many buses have been shown in the video so far?", "options": ["A. One.", "B. Two.", "C. Three.", "D. Four."], "answer": "C", "time_stamp_s": 35, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_333_a1899_q1", "video_id": 333, "time_stamp_s": 35, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a96cb58433877e0a05c2dc369aa44349b897fff49bd5bb24bfc1c4091e437853", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [5.017633333333333, 6.018633333333334, 7.019633333333333, 8.020633333333333, 9.021633333333334, 10.022633333333333, 11.023633333333333, 12.024633333333334, 13.025633333333333, 14.026633333333333, 15.027633333333334, 16.02863333333333, 17.029633333333333, 18.030633333333334, 19.031633333333332, 20.032633333333333, 21.00026666666667, 22.001266666666666, 23.002266666666667, 24.003266666666665, 25.004266666666666, 26.005266666666667, 27.006266666666665, 28.007266666666666, 29.008266666666668, 30.009266666666665, 31.010266666666666, 32.011266666666664, 33.01226666666667, 34.01326666666667], "recent_frames_sha256": "2f7fdd4f1b136b6b40a566f3f396ba858bc0af19b32480196a18ef8defa2d73f", "num_recent_frames": 30, "tq": 715309.404995247, "t1": 715321.312372297, "ta": 715321.312372297, "te": 715321.353495506, "first_response_s": 11.907377050025389, "answer_total_s": 11.948500258964486, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_333_a1899_q1", "video_id": 333, "time_stamp_s": 35, "ground_truth": "C", "raw_output": "C. Three.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "9e380f2d48cfd5e8701f089e598a15172d051a567e9203a2c01e050ad1a67a68", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Group of pedestrians, including a man in blue shirt and another with a backpack, walk along a sidewalk past a building entrance with orange safety barriers.  \n- A red double-decker bus passes by on the street, followed by a yellow bus, while other vehicles like taxis and cars move in the traffic lane.  \n- A woman in a white top and black shorts walks ahead, carrying a shoulder bag, as the camera follows from behind, capturing the urban street scene.", "history_tokens": 102, "history_utf8_bytes": 463, "recent_frame_times_s": [5.017633333333333, 6.018633333333334, 7.019633333333333, 8.020633333333333, 9.021633333333334, 10.022633333333333, 11.023633333333333, 12.024633333333334, 13.025633333333333, 14.026633333333333, 15.027633333333334, 16.02863333333333, 17.029633333333333, 18.030633333333334, 19.031633333333332, 20.032633333333333, 21.00026666666667, 22.001266666666666, 23.002266666666667, 24.003266666666665, 25.004266666666666, 26.005266666666667, 27.006266666666665, 28.007266666666666, 29.008266666666668, 30.009266666666665, 31.010266666666666, 32.011266666666664, 33.01226666666667, 34.01326666666667], "recent_frames_sha256": "2f7fdd4f1b136b6b40a566f3f396ba858bc0af19b32480196a18ef8defa2d73f", "num_recent_frames": 30, "tq": 715358.758394313, "t1": 715370.45506939, "ta": 715370.45506939, "te": 715370.643393659, "first_response_s": 11.696675076964311, "answer_total_s": 11.884999345988035, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 333, "content_group": "d277300dfb64a8ca91c6b1bd1100a94ee661920d510efc65c0e824240a59da48", "question": {"question_id": "sample_333_a1900_q0", "video_id": 333, "video_path": "./videos/sample_333_real.mp4", "annotation_index": 1900, "question_index": 0, "question": "What are people doing while standing on the sidewalk right now?", "options": ["A. Playing musical instruments.", "B. Reading newspapers.", "C. Using their phones and conversing.", "D. Painting murals."], "answer": "C", "time_stamp_s": 170, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_333_a1900_q0", "video_id": 333, "time_stamp_s": 170, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "98a80b80556d37def9fd9cfbf1e8c5373958317fcf9ecb4bc722fed0c68c9d1c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [140.01916666666668, 141.02016666666665, 142.02116666666666, 143.02216666666666, 144.02316666666667, 145.02416666666667, 146.02516666666668, 147.02616666666665, 148.02716666666666, 149.02816666666666, 150.02916666666667, 151.03016666666667, 152.03116666666668, 153.03216666666665, 154.03316666666666, 155.0008, 156.0018, 157.0028, 158.0038, 159.0048, 160.0058, 161.0068, 162.0078, 163.0088, 164.0098, 165.0108, 166.0118, 167.0128, 168.0138, 169.0148], "recent_frames_sha256": "cd12eb564cb6b31406971d7a67a346098cad5fb5314b9225ccc174b1c071109f", "num_recent_frames": 30, "tq": 715321.369165464, "t1": 715331.897843944, "ta": 715331.897843944, "te": 715331.938781857, "first_response_s": 10.528678480070084, "answer_total_s": 10.569616393069737, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_333_a1900_q0", "video_id": 333, "time_stamp_s": 170, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d14ca53d209867df00b05018cea35997eb228bfc7c18f02f1b87a902164c2937", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Group of pedestrians, including a man in blue shirt and another with a backpack, walk along a sidewalk past a building entrance with orange safety barriers.  \n- A red double-decker bus passes by on the street, followed by a yellow bus, while other vehicles like taxis and cars move in the traffic lane.  \n- A woman in a white top and black shorts walks ahead, carrying a shoulder bag, as the camera follows from behind, capturing the urban street scene.\n[30-60s] - A man in a white shirt and black shorts walks away from the camera, carrying a blue bag, alongside another person in a white shirt and black shorts.  \n- A woman in a pink shirt and blue jeans enters a building through a glass door, carrying a black backpack.  \n- The building entrance features a prominent sign with a circular logo and decorative lighting, flanked by potted plants and a staircase with red lights.\n[60-90s] - A red double-decker bus (route 234) is stationary at a bus stop, with its destination sign clearly visible.  \n- Pedestrians, including a woman in a white top and black skirt, cross a zebra crossing near the bus stop.  \n- A large, dome-shaped building is visible in the background, suggesting an urban or tourist area.\n[90-120s] - A group of pedestrians, including a woman in a white top and black shorts, walks along a brick sidewalk near a modern building entrance.  \n- A red double-decker bus passes on the street, with traffic lights and other vehicles visible in the background.  \n- A blue street sign reading \"KIM JONG IL ST\" is prominently displayed near the sidewalk, indicating the location.\n[120-150s] - A yellow double-decker bus with \"K11\" branding passes by, moving from left to right across the frame.  \n- A red taxi and other vehicles are visible on the road, with traffic flowing in the background.  \n- Pedestrians, including a man in a blue shirt and another in a red shirt, are standing on the sidewalk, observing the street activity.", "history_tokens": 455, "history_utf8_bytes": 1952, "recent_frame_times_s": [140.01916666666668, 141.02016666666665, 142.02116666666666, 143.02216666666666, 144.02316666666667, 145.02416666666667, 146.02516666666668, 147.02616666666665, 148.02716666666666, 149.02816666666666, 150.02916666666667, 151.03016666666667, 152.03116666666668, 153.03216666666665, 154.03316666666666, 155.0008, 156.0018, 157.0028, 158.0038, 159.0048, 160.0058, 161.0068, 162.0078, 163.0088, 164.0098, 165.0108, 166.0118, 167.0128, 168.0138, 169.0148], "recent_frames_sha256": "cd12eb564cb6b31406971d7a67a346098cad5fb5314b9225ccc174b1c071109f", "num_recent_frames": 30, "tq": 715397.53958134, "t1": 715404.907398866, "ta": 715404.907398866, "te": 715405.185817151, "first_response_s": 7.367817525984719, "answer_total_s": 7.6462358109420165, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 333, "content_group": "d277300dfb64a8ca91c6b1bd1100a94ee661920d510efc65c0e824240a59da48", "question": {"question_id": "sample_333_a1901_q0", "video_id": 333, "video_path": "./videos/sample_333_real.mp4", "annotation_index": 1901, "question_index": 0, "question": "What is the color scheme of the map labeled \"Salisbury Garden\" shown on the signboard?", "options": ["A. Black on white.", "B. Blue on white.", "C. Green on black.", "D. White on black."], "answer": "D", "time_stamp_s": 326, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_333_a1901_q0", "video_id": 333, "time_stamp_s": 326, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1bc5538530227591ee96c91d0107ddea9d8b56cb37f84115637da4ec40e0a6eb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [296.0083333333333, 297.00933333333336, 298.01033333333334, 299.0113333333333, 300.01233333333334, 301.0133333333333, 302.01433333333335, 303.01533333333333, 304.0163333333333, 305.01733333333334, 306.0183333333333, 307.01933333333335, 308.0203333333333, 309.02133333333336, 310.02233333333334, 311.0233333333333, 312.02433333333335, 313.0253333333333, 314.02633333333335, 315.02733333333333, 316.0283333333333, 317.02933333333334, 318.0303333333333, 319.03133333333335, 320.0323333333333, 321.03333333333336, 322.00096666666667, 323.00196666666665, 324.0029666666667, 325.00396666666666], "recent_frames_sha256": "44b4940f5579f4ac597ef85395ab94b00f67f019f2af47fb930adf0d107c4826", "num_recent_frames": 30, "tq": 715331.951227992, "t1": 715340.573009883, "ta": 715340.573009883, "te": 715340.614191602, "first_response_s": 8.621781891095452, "answer_total_s": 8.662963610026054, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_333_a1901_q0", "video_id": 333, "time_stamp_s": 326, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9cf7f0a7ddb4315529d5a579bebbba61094f5989c80ed0159e21ddc41d00311e", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Group of pedestrians, including a man in blue shirt and another with a backpack, walk along a sidewalk past a building entrance with orange safety barriers.  \n- A red double-decker bus passes by on the street, followed by a yellow bus, while other vehicles like taxis and cars move in the traffic lane.  \n- A woman in a white top and black shorts walks ahead, carrying a shoulder bag, as the camera follows from behind, capturing the urban street scene.\n[30-60s] - A man in a white shirt and black shorts walks away from the camera, carrying a blue bag, alongside another person in a white shirt and black shorts.  \n- A woman in a pink shirt and blue jeans enters a building through a glass door, carrying a black backpack.  \n- The building entrance features a prominent sign with a circular logo and decorative lighting, flanked by potted plants and a staircase with red lights.\n[60-90s] - A red double-decker bus (route 234) is stationary at a bus stop, with its destination sign clearly visible.  \n- Pedestrians, including a woman in a white top and black skirt, cross a zebra crossing near the bus stop.  \n- A large, dome-shaped building is visible in the background, suggesting an urban or tourist area.\n[90-120s] - A group of pedestrians, including a woman in a white top and black shorts, walks along a brick sidewalk near a modern building entrance.  \n- A red double-decker bus passes on the street, with traffic lights and other vehicles visible in the background.  \n- A blue street sign reading \"KIM JONG IL ST\" is prominently displayed near the sidewalk, indicating the location.\n[120-150s] - A yellow double-decker bus with \"K11\" branding passes by, moving from left to right across the frame.  \n- A red taxi and other vehicles are visible on the road, with traffic flowing in the background.  \n- Pedestrians, including a man in a blue shirt and another in a red shirt, are standing on the sidewalk, observing the street activity.\n[150-180s] - A group of pedestrians, including a man in a blue shirt and a woman in a black top, stand near a metal railing, observing traffic on the street.  \n- A woman in a beige jacket walks past the group, carrying a yellow bag, while others move in various directions along the sidewalk.  \n- The background features modern buildings, including one with a prominent \"K11\" sign, under a partly cloudy sky.\n[180-210s] - Pedestrians cross a wide street with yellow zebra crossings, moving from right to left in the frame.\n- A red taxi and a double-decker bus (with \"KITCHEN\" visible on its side) are stopped at the intersection, waiting for the crosswalk signal.\n- A large building with \"K11\" signage is visible in the background, with people walking along its sidewalk.\n[210-240s] - A tall building with \"青光\" signage and illuminated vertical lights dominates the street view, with vehicles passing by its base.  \n- Pedestrians, including a man in black and a woman in a black dress, cross the street at a marked crosswalk, moving from right to left.  \n- Traffic lights and street signs are visible, with a red light indicating stop for vehicles, while cars and buses move along the road.\n[240-270s] - Pedestrians cross a zebra-striped street under a green traffic light, moving toward a modern building with a golden, geometric facade.  \n- A tall, glass-clad skyscraper with illuminated windows stands prominently in the background, flanked by other commercial buildings.  \n- The sky shows transitioning daylight with scattered clouds, casting soft light over the urban scene.\n[270-300s] - A modern fountain with tiered steps and illuminated water jets is centered in a plaza, surrounded by pedestrians.  \n- Behind the fountain, a curved wall features a honeycomb-like pattern with embedded greenery, lit from within.  \n- A large, illuminated \"K11\" sign is visible on a building to the right, indicating a commercial or cultural landmark.", "history_tokens": 909, "history_utf8_bytes": 3897, "recent_frame_times_s": [296.0083333333333, 297.00933333333336, 298.01033333333334, 299.0113333333333, 300.01233333333334, 301.0133333333333, 302.01433333333335, 303.01533333333333, 304.0163333333333, 305.01733333333334, 306.0183333333333, 307.01933333333335, 308.0203333333333, 309.02133333333336, 310.02233333333334, 311.0233333333333, 312.02433333333335, 313.0253333333333, 314.02633333333335, 315.02733333333333, 316.0283333333333, 317.02933333333334, 318.0303333333333, 319.03133333333335, 320.0323333333333, 321.03333333333336, 322.00096666666667, 323.00196666666665, 324.0029666666667, 325.00396666666666], "recent_frames_sha256": "44b4940f5579f4ac597ef85395ab94b00f67f019f2af47fb930adf0d107c4826", "num_recent_frames": 30, "tq": 715438.61928235, "t1": 715445.414676736, "ta": 715445.414676736, "te": 715445.45268442, "first_response_s": 6.795394386048429, "answer_total_s": 6.833402070100419, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 333, "content_group": "d277300dfb64a8ca91c6b1bd1100a94ee661920d510efc65c0e824240a59da48", "question": {"question_id": "sample_333_a1902_q0", "video_id": 333, "video_path": "./videos/sample_333_real.mp4", "annotation_index": 1902, "question_index": 0, "question": "What was labeled on the modern building visible in the scene just now?", "options": ["A. RESORT.", "B. REGENT.", "C. REFLECT.", "D. RETREAT."], "answer": "B", "time_stamp_s": 485, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_333_a1902_q0", "video_id": 333, "time_stamp_s": 485, "ground_truth": "B", "raw_output": "B. REGENT.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "6de9c28cd91452c457160d0a32869062525682bc09fbbea2f08e77458cd053c6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [455.0005, 456.0015, 457.0025, 458.0035, 459.0045, 460.0055, 461.0065, 462.0075, 463.0085, 464.0095, 465.0105, 466.0115, 467.0125, 468.0135, 469.0145, 470.0155, 471.0165, 472.0175, 473.0185, 474.0195, 475.0205, 476.0215, 477.0225, 478.0235, 479.0245, 480.0255, 481.0265, 482.0275, 483.0285, 484.0295], "recent_frames_sha256": "406c46b0628c1473bab8a3d3ea8169096ce122f7bab12c7654a631e75ddc1146", "num_recent_frames": 30, "tq": 715340.624793485, "t1": 715347.197305383, "ta": 715347.197305383, "te": 715347.381142609, "first_response_s": 6.57251189800445, "answer_total_s": 6.756349124014378, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_333_a1902_q0", "video_id": 333, "time_stamp_s": 485, "ground_truth": "B", "raw_output": "B. REGENT.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "d1014e9c3381dc10d3b7bfe4e07aea8f3e51d8daa24e7562d7afba9666e3aa08", "condition_order": ["recent", "notes"], "memory": "[120-150s] - A yellow double-decker bus with \"K11\" branding passes by, moving from left to right across the frame.  \n- A red taxi and other vehicles are visible on the road, with traffic flowing in the background.  \n- Pedestrians, including a man in a blue shirt and another in a red shirt, are standing on the sidewalk, observing the street activity.\n[150-180s] - A group of pedestrians, including a man in a blue shirt and a woman in a black top, stand near a metal railing, observing traffic on the street.  \n- A woman in a beige jacket walks past the group, carrying a yellow bag, while others move in various directions along the sidewalk.  \n- The background features modern buildings, including one with a prominent \"K11\" sign, under a partly cloudy sky.\n[180-210s] - Pedestrians cross a wide street with yellow zebra crossings, moving from right to left in the frame.\n- A red taxi and a double-decker bus (with \"KITCHEN\" visible on its side) are stopped at the intersection, waiting for the crosswalk signal.\n- A large building with \"K11\" signage is visible in the background, with people walking along its sidewalk.\n[210-240s] - A tall building with \"青光\" signage and illuminated vertical lights dominates the street view, with vehicles passing by its base.  \n- Pedestrians, including a man in black and a woman in a black dress, cross the street at a marked crosswalk, moving from right to left.  \n- Traffic lights and street signs are visible, with a red light indicating stop for vehicles, while cars and buses move along the road.\n[240-270s] - Pedestrians cross a zebra-striped street under a green traffic light, moving toward a modern building with a golden, geometric facade.  \n- A tall, glass-clad skyscraper with illuminated windows stands prominently in the background, flanked by other commercial buildings.  \n- The sky shows transitioning daylight with scattered clouds, casting soft light over the urban scene.\n[270-300s] - A modern fountain with tiered steps and illuminated water jets is centered in a plaza, surrounded by pedestrians.  \n- Behind the fountain, a curved wall features a honeycomb-like pattern with embedded greenery, lit from within.  \n- A large, illuminated \"K11\" sign is visible on a building to the right, indicating a commercial or cultural landmark.\n[300-330s] - A multi-tiered fountain with illuminated water jets and decorative spherical elements is centrally positioned in a plaza.  \n- People are seen walking around the plaza, including a family with a child in a green outfit.  \n- A directional signpost with a map of the plaza’s layout is visible near the fountain’s edge.\n[330-360s] - Pedestrians walk across a patterned pavement with circular designs, some near a glass-fronted building.  \n- Yellow-and-black traffic cones are placed along the edge of the walkway.  \n- A woman in a yellow top and white pants walks toward the camera, while others move in various directions.\n[360-390s] - A colorful, lion-shaped sculpture sits atop a large drum, positioned on a paved plaza.  \n- A person in a white shirt walks past the sculpture, moving from left to right.  \n- The plaza features embedded circular lights and tree trunks with surrounding planters, with a city skyline visible in the background.\n[390-420s] - A colorful, abstractly painted bear sculpture sits atop a large drum, stationary on a paved plaza.  \n- The camera pans left, revealing a metal barrier separating the plaza from a grassy park area with trees and distant city buildings.  \n- The path along the park curves gently, bordered by low hedges and illuminated by embedded lights in the pavement.\n[420-450s] - Palm trees stand in a grassy park, with a modern building visible in the background.  \n- A paved walkway with decorative patterns runs alongside a metal barrier, leading toward the building.  \n- The sky shows twilight hues, with distant city lights and mountains faintly visible.\n[450-480s] - A woman in a yellow top sits on a low wall, facing away from the camera, near the Regent hotel entrance.  \n- The camera pans left, revealing the Regent hotel's illuminated sign and modern architecture against a twilight sky.  \n- People are scattered across the paved plaza, some seated on benches, others walking, with distant city lights beginning to glow.", "history_tokens": 996, "history_utf8_bytes": 4284, "recent_frame_times_s": [455.0005, 456.0015, 457.0025, 458.0035, 459.0045, 460.0055, 461.0065, 462.0075, 463.0085, 464.0095, 465.0105, 466.0115, 467.0125, 468.0135, 469.0145, 470.0155, 471.0165, 472.0175, 473.0185, 474.0195, 475.0205, 476.0215, 477.0225, 478.0235, 479.0245, 480.0255, 481.0265, 482.0275, 483.0285, 484.0295], "recent_frames_sha256": "406c46b0628c1473bab8a3d3ea8169096ce122f7bab12c7654a631e75ddc1146", "num_recent_frames": 30, "tq": 715490.448846997, "t1": 715491.733990585, "ta": 715491.733990585, "te": 715491.922206508, "first_response_s": 1.2851435879711062, "answer_total_s": 1.4733595110010356, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 334, "content_group": "9bf70a7d7a4b148a53ed4ea18a40e4e71789a4099b9fca2dbdd374ba7ecb0fbe", "question": {"question_id": "sample_334_a1069_q1", "video_id": 334, "video_path": "./videos/sample_334_real.mp4", "annotation_index": 1069, "question_index": 1, "question": "What are many people in the crowd doing around the statue?", "options": ["A. Dancing.", "B. Eating.", "C. Singing.", "D. Taking photos."], "answer": "D", "time_stamp_s": 12, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_334_a1069_q1", "video_id": 334, "time_stamp_s": 12, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "112a79aea02e4085f6091dbf82b2761e5e655074cc796ebc91c5fc5720276057", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.053, 1.0206333333333333, 2.0216333333333334, 3.0226333333333333, 4.023633333333334, 5.024633333333333, 6.025633333333333, 7.026633333333334, 8.027633333333334, 9.028633333333334, 10.029633333333333, 11.030633333333334], "recent_frames_sha256": "e10f458f536f5bb2a8812274bd0222d359382709404243f654462f6eaa107674", "num_recent_frames": 12, "tq": 717402.803221238, "t1": 717414.411897219, "ta": 717414.411897219, "te": 717414.44854407, "first_response_s": 11.608675981056876, "answer_total_s": 11.645322832046077, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_334_a1069_q1", "video_id": 334, "time_stamp_s": 12, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8046790d7b65f1e330a3ea397c86de9afd2606f32d92d97add36f129341b590b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.053, 1.0206333333333333, 2.0216333333333334, 3.0226333333333333, 4.023633333333334, 5.024633333333333, 6.025633333333333, 7.026633333333334, 8.027633333333334, 9.028633333333334, 10.029633333333333, 11.030633333333334], "recent_frames_sha256": "e10f458f536f5bb2a8812274bd0222d359382709404243f654462f6eaa107674", "num_recent_frames": 12, "tq": 717232.448094937, "t1": 717238.104210869, "ta": 717238.104210869, "te": 717238.142661636, "first_response_s": 5.6561159319244325, "answer_total_s": 5.694566698977724, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 334, "content_group": "9bf70a7d7a4b148a53ed4ea18a40e4e71789a4099b9fca2dbdd374ba7ecb0fbe", "question": {"question_id": "sample_334_a1069_q0", "video_id": 334, "video_path": "./videos/sample_334_real.mp4", "annotation_index": 1069, "question_index": 0, "question": "What is the woman in the statue holding in her left hand?", "options": ["A. A book.", "B. A sword.", "C. A shield.", "D. A lit globe."], "answer": "D", "time_stamp_s": 19, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_334_a1069_q0", "video_id": 334, "time_stamp_s": 19, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "109fb39e0088872173d48b006bb73b3f7c871954cadcb2e15d0fb2a4413607e2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.053, 1.0206333333333333, 2.0216333333333334, 3.0226333333333333, 4.023633333333334, 5.024633333333333, 6.025633333333333, 7.026633333333334, 8.027633333333334, 9.028633333333334, 10.029633333333333, 11.030633333333334, 12.031633333333334, 13.032633333333333, 14.000266666666667, 15.001266666666666, 16.002266666666667, 17.003266666666665, 18.004266666666666], "recent_frames_sha256": "fbb7d4c1f9b79564731ada97bf19368055019cea94f86e4c918051012366eaa2", "num_recent_frames": 19, "tq": 717414.465908812, "t1": 717421.883193716, "ta": 717421.883193716, "te": 717421.919907649, "first_response_s": 7.417284904047847, "answer_total_s": 7.453998837037943, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_334_a1069_q0", "video_id": 334, "time_stamp_s": 19, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6e448d8d52b0123032de30581864f5ef8cdbfad3342bb4fcc306fb26b2a922e6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.053, 1.0206333333333333, 2.0216333333333334, 3.0226333333333333, 4.023633333333334, 5.024633333333333, 6.025633333333333, 7.026633333333334, 8.027633333333334, 9.028633333333334, 10.029633333333333, 11.030633333333334, 12.031633333333334, 13.032633333333333, 14.000266666666667, 15.001266666666666, 16.002266666666667, 17.003266666666665, 18.004266666666666], "recent_frames_sha256": "fbb7d4c1f9b79564731ada97bf19368055019cea94f86e4c918051012366eaa2", "num_recent_frames": 19, "tq": 717238.158560971, "t1": 717250.193414806, "ta": 717250.193414806, "te": 717250.23148005, "first_response_s": 12.034853835008107, "answer_total_s": 12.07291907898616, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 334, "content_group": "9bf70a7d7a4b148a53ed4ea18a40e4e71789a4099b9fca2dbdd374ba7ecb0fbe", "question": {"question_id": "sample_334_a1070_q0", "video_id": 334, "video_path": "./videos/sample_334_real.mp4", "annotation_index": 1070, "question_index": 0, "question": "What kind of light enhances the visibility of the dome?", "options": ["A. A bright white light.", "B. A cooler blue light.", "C. A flashing red light.", "D. A soft yellowish light."], "answer": "D", "time_stamp_s": 180, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_334_a1070_q0", "video_id": 334, "time_stamp_s": 180, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9876c47034b8d1ab4f62034a691fa4a86d3dd87eae93bd2a4e2bb3d897c4f678", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.0028, 151.0038, 152.0048, 153.0058, 154.0068, 155.0078, 156.0088, 157.0098, 158.0108, 159.0118, 160.0128, 161.0138, 162.0148, 163.0158, 164.0168, 165.0178, 166.0188, 167.0198, 168.0208, 169.0218, 170.0228, 171.0238, 172.0248, 173.0258, 174.0268, 175.0278, 176.0288, 177.0298, 178.0308, 179.0318], "recent_frames_sha256": "28bcac5456d589a57d58d49617a52b4a531b5d5366f77db6dfbf55f83acf9d38", "num_recent_frames": 30, "tq": 717421.932220159, "t1": 717433.808883915, "ta": 717433.808883915, "te": 717433.84659619, "first_response_s": 11.876663755974732, "answer_total_s": 11.914376031025313, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_334_a1070_q0", "video_id": 334, "time_stamp_s": 180, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "db73881f92063025826e6d7def06e6503ee25e64903c7f5639b219047a49d133", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Bronze statue of a woman holding a lantern, standing on a tiered black pedestal with illuminated edges, positioned near a crowd.  \n- Large, glowing orange lanterns are being released or displayed in the background, with people gathered around them.  \n- City skyline with tall buildings and mountains visible in the distance under a cloudy sky, suggesting late afternoon or early evening.\n[30-60s] - Statue with torch-like elements stands atop a multi-tiered, illuminated base, surrounded by crowds.  \n- People gather around the statue, some observing, others walking past, on a paved plaza.  \n- City skyline with illuminated buildings visible in the background under a cloudy sky.\n[60-90s] - A group of people walks across a paved plaza, some carrying bags or strollers, while others are seated on benches nearby.  \n- A large, curved, metallic structure with a grid-like design stands prominently in the center of the plaza, surrounded by people.  \n- In the background, a tall building under construction with a green crane is visible, alongside a modern building with a \"REGEN\" sign.\n[90-120s] - A group of people walks along a paved path, with some individuals seated on the ground near the edge of the walkway.  \n- A modern, curved building with illuminated windows is visible on the right side of the frame, adjacent to the path.  \n- The camera pans slightly to the left, revealing a large, spherical structure and a crowd seated in front of it, suggesting an event or performance area.\n[120-150s] - A white truck is parked under a modern building's overhang, with a dark sedan nearby.  \n- A group of pedestrians walks across a paved plaza, moving toward a large white dome-shaped structure.  \n- In the background, a tall building with illuminated windows and a prominent \"GEORGE\" sign is visible against a twilight sky.\n[150-180s] - A large white dome structure is centrally positioned, illuminated from below, with people walking near its base.  \n- Modern high-rise buildings with lit windows form the background, including one with a prominent blue and white sign.  \n- The camera pans slightly to the right, revealing more of the urban skyline and a wooden structure to the right of the dome.", "history_tokens": 488, "history_utf8_bytes": 2209, "recent_frame_times_s": [150.0028, 151.0038, 152.0048, 153.0058, 154.0068, 155.0078, 156.0088, 157.0098, 158.0108, 159.0118, 160.0128, 161.0138, 162.0148, 163.0158, 164.0168, 165.0178, 166.0188, 167.0198, 168.0208, 169.0218, 170.0228, 171.0238, 172.0248, 173.0258, 174.0268, 175.0278, 176.0288, 177.0298, 178.0308, 179.0318], "recent_frames_sha256": "28bcac5456d589a57d58d49617a52b4a531b5d5366f77db6dfbf55f83acf9d38", "num_recent_frames": 30, "tq": 717297.636940707, "t1": 717298.437176907, "ta": 717298.437176907, "te": 717298.474953951, "first_response_s": 0.8002361999824643, "answer_total_s": 0.8380132439779118, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 334, "content_group": "9bf70a7d7a4b148a53ed4ea18a40e4e71789a4099b9fca2dbdd374ba7ecb0fbe", "question": {"question_id": "sample_334_a1071_q0", "video_id": 334, "video_path": "./videos/sample_334_real.mp4", "annotation_index": 1071, "question_index": 0, "question": "What largest text is visible on the left side of the walkway right now?", "options": ["A. HKMOA.", "B. City Park.", "C. Art Museum.", "D. Train Station."], "answer": "A", "time_stamp_s": 327, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_334_a1071_q0", "video_id": 334, "time_stamp_s": 327, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "047af4f310b9192d6f14c6dfee12b7a9cead52209642d964eb953525bf2eba3f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [297.0163333333333, 298.01733333333334, 299.0183333333333, 300.01933333333335, 301.0203333333333, 302.02133333333336, 303.02233333333334, 304.0233333333333, 305.02433333333335, 306.0253333333333, 307.02633333333335, 308.02733333333333, 309.0283333333333, 310.02933333333334, 311.0303333333333, 312.03133333333335, 313.0323333333333, 314.03333333333336, 315.00096666666667, 316.00196666666665, 317.0029666666667, 318.00396666666666, 319.0049666666667, 320.00596666666667, 321.00696666666664, 322.0079666666667, 323.00896666666665, 324.0099666666667, 325.01096666666666, 326.0119666666667], "recent_frames_sha256": "4f4ba7dbda01287eb09babd1e8c70c73a2ddb7df020537dac3af2ec585506ef9", "num_recent_frames": 30, "tq": 717433.856906787, "t1": 717442.054920873, "ta": 717442.054920873, "te": 717442.092392212, "first_response_s": 8.198014085995965, "answer_total_s": 8.23548542498611, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_334_a1071_q0", "video_id": 334, "time_stamp_s": 327, "ground_truth": "A", "raw_output": "A. HKMOA.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "dee81b7375b80b166b39bcce0f479ab16697f449efdaaf7a09997b05c44342d1", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Bronze statue of a woman holding a lantern, standing on a tiered black pedestal with illuminated edges, positioned near a crowd.  \n- Large, glowing orange lanterns are being released or displayed in the background, with people gathered around them.  \n- City skyline with tall buildings and mountains visible in the distance under a cloudy sky, suggesting late afternoon or early evening.\n[30-60s] - Statue with torch-like elements stands atop a multi-tiered, illuminated base, surrounded by crowds.  \n- People gather around the statue, some observing, others walking past, on a paved plaza.  \n- City skyline with illuminated buildings visible in the background under a cloudy sky.\n[60-90s] - A group of people walks across a paved plaza, some carrying bags or strollers, while others are seated on benches nearby.  \n- A large, curved, metallic structure with a grid-like design stands prominently in the center of the plaza, surrounded by people.  \n- In the background, a tall building under construction with a green crane is visible, alongside a modern building with a \"REGEN\" sign.\n[90-120s] - A group of people walks along a paved path, with some individuals seated on the ground near the edge of the walkway.  \n- A modern, curved building with illuminated windows is visible on the right side of the frame, adjacent to the path.  \n- The camera pans slightly to the left, revealing a large, spherical structure and a crowd seated in front of it, suggesting an event or performance area.\n[120-150s] - A white truck is parked under a modern building's overhang, with a dark sedan nearby.  \n- A group of pedestrians walks across a paved plaza, moving toward a large white dome-shaped structure.  \n- In the background, a tall building with illuminated windows and a prominent \"GEORGE\" sign is visible against a twilight sky.\n[150-180s] - A large white dome structure is centrally positioned, illuminated from below, with people walking near its base.  \n- Modern high-rise buildings with lit windows form the background, including one with a prominent blue and white sign.  \n- The camera pans slightly to the right, revealing more of the urban skyline and a wooden structure to the right of the dome.\n[180-210s] - A large white dome structure is illuminated from within, positioned centrally in the plaza.  \n- A modern building with a prominent \"KIO\" sign and a large circular window is visible to the left.  \n- People are walking across the paved plaza, with some moving toward the dome and others away from it.\n[210-240s] - A large, illuminated dome structure dominates the right side of the frame, casting a warm glow on the surrounding plaza.  \n- People are seen walking across the paved area, some moving toward the dome while others pass by in the background.  \n- The sky transitions from blue to soft orange hues, indicating late afternoon or early evening light.\n[240-270s] - A large, illuminated dome structure dominates the right side of the frame, casting a warm glow on the water below.  \n- The camera pans right, revealing a modern building with lit windows in the background, suggesting an urban setting.  \n- A narrow water channel runs between the dome and the building, with wooden posts visible in the water.\n[270-300s] - A large, illuminated white dome dominates the foreground, reflecting ambient light.  \n- Behind it, a modern building with \"HOTEL\" signage is lit up against a twilight sky.  \n- Palm trees and a covered walkway with warm lighting are visible to the left, with pedestrians moving along the path.", "history_tokens": 791, "history_utf8_bytes": 3540, "recent_frame_times_s": [297.0163333333333, 298.01733333333334, 299.0183333333333, 300.01933333333335, 301.0203333333333, 302.02133333333336, 303.02233333333334, 304.0233333333333, 305.02433333333335, 306.0253333333333, 307.02633333333335, 308.02733333333333, 309.0283333333333, 310.02933333333334, 311.0303333333333, 312.03133333333335, 313.0323333333333, 314.03333333333336, 315.00096666666667, 316.00196666666665, 317.0029666666667, 318.00396666666666, 319.0049666666667, 320.00596666666667, 321.00696666666664, 322.0079666666667, 323.00896666666665, 324.0099666666667, 325.01096666666666, 326.0119666666667], "recent_frames_sha256": "4f4ba7dbda01287eb09babd1e8c70c73a2ddb7df020537dac3af2ec585506ef9", "num_recent_frames": 30, "tq": 717335.487649968, "t1": 717342.904094589, "ta": 717342.904094589, "te": 717343.350649344, "first_response_s": 7.416444620932452, "answer_total_s": 7.862999376025982, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 334, "content_group": "9bf70a7d7a4b148a53ed4ea18a40e4e71789a4099b9fca2dbdd374ba7ecb0fbe", "question": {"question_id": "sample_334_a1072_q0", "video_id": 334, "video_path": "./videos/sample_334_real.mp4", "annotation_index": 1072, "question_index": 0, "question": "What is the color of the tallest tower's illumination?", "options": ["A. Blue.", "B. Green.", "C. Red.", "D. Yellow."], "answer": "D", "time_stamp_s": 599, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [540, 599], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_334_a1072_q0", "video_id": 334, "time_stamp_s": 599, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "df1a1f05c15fea7e29cdad25cad9ed24d9739da112bde5fd0294b9f0c4a10cc3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [569.0214, 570.0224, 571.0234, 572.0244, 573.0254, 574.0264, 575.0274, 576.0284, 577.0294, 578.0304, 579.0314, 580.0324, 581.0000333333334, 582.0010333333333, 583.0020333333333, 584.0030333333333, 585.0040333333334, 586.0050333333334, 587.0060333333333, 588.0070333333333, 589.0080333333333, 590.0090333333334, 591.0100333333334, 592.0110333333333, 593.0120333333333, 594.0130333333333, 595.0140333333334, 596.0150333333333, 597.0160333333333, 598.0170333333333], "recent_frames_sha256": "77283ed95e4e92003f69936485b39cb6182596ae942515c068fdfe2f374a0920", "num_recent_frames": 30, "tq": 717442.117217937, "t1": 717448.88053435, "ta": 717448.88053435, "te": 717448.917252279, "first_response_s": 6.76331641303841, "answer_total_s": 6.8000343419844285, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_334_a1072_q0", "video_id": 334, "time_stamp_s": 599, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "54c7f6e8feea2fb83de066e0dd6199a85ff8b63b85fb32fb617cc9e3b0dee216", "condition_order": ["notes", "recent"], "memory": "[180-210s] - A large white dome structure is illuminated from within, positioned centrally in the plaza.  \n- A modern building with a prominent \"KIO\" sign and a large circular window is visible to the left.  \n- People are walking across the paved plaza, with some moving toward the dome and others away from it.\n[210-240s] - A large, illuminated dome structure dominates the right side of the frame, casting a warm glow on the surrounding plaza.  \n- People are seen walking across the paved area, some moving toward the dome while others pass by in the background.  \n- The sky transitions from blue to soft orange hues, indicating late afternoon or early evening light.\n[240-270s] - A large, illuminated dome structure dominates the right side of the frame, casting a warm glow on the water below.  \n- The camera pans right, revealing a modern building with lit windows in the background, suggesting an urban setting.  \n- A narrow water channel runs between the dome and the building, with wooden posts visible in the water.\n[270-300s] - A large, illuminated white dome dominates the foreground, reflecting ambient light.  \n- Behind it, a modern building with \"HOTEL\" signage is lit up against a twilight sky.  \n- Palm trees and a covered walkway with warm lighting are visible to the left, with pedestrians moving along the path.\n[300-330s] - A woman in a dark dress walks toward the camera, passing under a lit canopy.  \n- A man in a white shirt and dark pants walks in the opposite direction, moving away from the camera.  \n- A blue sign with text is visible on the left, near a tree, as the camera moves forward.\n[330-360s] - A person walks away from the camera down the covered walkway, moving toward the distant end.  \n- The walkway is lined with evenly spaced white pillars and illuminated by overhead lights.  \n- A blue sign with pink text and a logo is visible on the left, partially obscured by the camera’s angle.\n[360-390s] - A person in a light blue top walks across the paved area near a palm tree, moving from right to left.  \n- The camera pans left, revealing a modern building with illuminated signage and a red fire hydrant nearby.  \n- A covered walkway with overhead lighting extends into the distance, flanked by white pillars and greenery.\n[390-420s] - A person in a light-colored outfit walks toward the camera from the left side of the frame.  \n- A woman in a pink dress walks past the camera on the left, moving away from the viewer.  \n- The camera pans right, revealing more pedestrians and a tree with a leaning trunk on the right side of the paved area.\n[420-450s] - A person in a light-colored outfit walks away from the camera toward the center of the plaza.  \n- Palm trees with illuminated street lamps stand along the paved walkway, casting soft shadows.  \n- The distant skyline features brightly lit skyscrapers, including a prominent orange-lit building, under a twilight sky.\n[450-480s] - Palm trees with illuminated streetlights stand on a paved promenade, casting warm light on the ground.  \n- A crowd of people walks or stands in the area, some near a large, brightly lit structure resembling a tower or sculpture.  \n- In the background, a city skyline with numerous lit buildings and distant mountains is visible under a twilight sky.\n[480-510s] - A group of pedestrians walks along a paved promenade near a waterfront, with some individuals carrying bags or wearing casual attire.  \n- A modern building with a lit \"SUSHI\" sign and outdoor seating area is visible on the left, with patrons seated at tables.  \n- The sky transitions from dusk to night, with city lights and distant mountains visible in the background.\n[510-540s] - A brightly lit city skyline reflects on the water, with buildings displaying colorful lights against a twilight sky.  \n- A traditional-style boat with illuminated orange sails glides along the waterfront, near a crowd of people on the promenade.  \n- The camera pans right, revealing palm trees and a modern building with vertical lighting, as the crowd moves along the paved walkway.\n[540-570s] - Two women stand near a waterfront railing, one holding a phone and a white bag, the other looking at her phone.  \n- The camera pans right to reveal a vibrant city skyline across the water, with colorful lights reflecting on the dark surface.  \n- A traditional-style boat with illuminated decorations sails slowly from left to right in the foreground.", "history_tokens": 1012, "history_utf8_bytes": 4418, "recent_frame_times_s": [569.0214, 570.0224, 571.0234, 572.0244, 573.0254, 574.0264, 575.0274, 576.0284, 577.0294, 578.0304, 579.0314, 580.0324, 581.0000333333334, 582.0010333333333, 583.0020333333333, 584.0030333333333, 585.0040333333334, 586.0050333333334, 587.0060333333333, 588.0070333333333, 589.0080333333333, 590.0090333333334, 591.0100333333334, 592.0110333333333, 593.0120333333333, 594.0130333333333, 595.0140333333334, 596.0150333333333, 597.0160333333333, 598.0170333333333], "recent_frames_sha256": "77283ed95e4e92003f69936485b39cb6182596ae942515c068fdfe2f374a0920", "num_recent_frames": 30, "tq": 717401.213519371, "t1": 717402.743923882, "ta": 717402.743923882, "te": 717402.781608952, "first_response_s": 1.5304045110242441, "answer_total_s": 1.568089580978267, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 335, "content_group": "f757888052bdf29e2a977fcaf7523c961a7d2f0808540f86cbb7c5df468dab42", "question": {"question_id": "sample_335_a1661_q0", "video_id": 335, "video_path": "./videos/sample_335_real.mp4", "annotation_index": 1661, "question_index": 0, "question": "Based on the crowd's interaction and engagement, what might be inferred to be present but out of view?", "options": ["A. A quiet library.", "B. Street performers and entertainment elements.", "C. A calm and deserted area.", "D. An indoor concert."], "answer": "B", "time_stamp_s": 20, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_335_a1661_q0", "video_id": 335, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "19e3d0fb60e0b78b382ba4c0a6f0e40a1939127d18fc7565d5386735168f0edb", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.036, 1.0036333333333334, 2.0046333333333335, 3.0056333333333334, 4.006633333333333, 5.007633333333334, 6.008633333333333, 7.009633333333333, 8.010633333333333, 9.011633333333334, 10.012633333333333, 11.013633333333333, 12.014633333333334, 13.015633333333334, 14.016633333333333, 15.017633333333333, 16.018633333333334, 17.019633333333335, 18.020633333333333, 19.021633333333334], "recent_frames_sha256": "0bd8801e891f76acdc5ef00274275fa3bf93c973c904bf944102bd3cffe6bc38", "num_recent_frames": 20, "tq": 716899.396139993, "t1": 716899.924462559, "ta": 716899.924462559, "te": 716899.961414107, "first_response_s": 0.5283225660677999, "answer_total_s": 0.5652741140220314, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_335_a1661_q0", "video_id": 335, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d0509341695e1ecc7d60a539d4e67493e7664a792d5c16821edc6d142bfecfce", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.036, 1.0036333333333334, 2.0046333333333335, 3.0056333333333334, 4.006633333333333, 5.007633333333334, 6.008633333333333, 7.009633333333333, 8.010633333333333, 9.011633333333334, 10.012633333333333, 11.013633333333333, 12.014633333333334, 13.015633333333334, 14.016633333333333, 15.017633333333333, 16.018633333333334, 17.019633333333335, 18.020633333333333, 19.021633333333334], "recent_frames_sha256": "0bd8801e891f76acdc5ef00274275fa3bf93c973c904bf944102bd3cffe6bc38", "num_recent_frames": 20, "tq": 716703.787310751, "t1": 716716.238943092, "ta": 716716.238943092, "te": 716716.467240168, "first_response_s": 12.451632340904325, "answer_total_s": 12.679929416975938, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 335, "content_group": "f757888052bdf29e2a977fcaf7523c961a7d2f0808540f86cbb7c5df468dab42", "question": {"question_id": "sample_335_a1662_q0", "video_id": 335, "video_path": "./videos/sample_335_real.mp4", "annotation_index": 1662, "question_index": 0, "question": "What is the camera doing right now?", "options": ["A. Moving forward slowly.", "B. Staying still.", "C. Moving backward.", "D. Panning left and right."], "answer": "A", "time_stamp_s": 194, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_335_a1662_q0", "video_id": 335, "time_stamp_s": 194, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b6ace48c00bef752489da87bdb93cf38599e3f2d2aae61067bc75d1efa006985", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [164.03316666666666, 165.0008, 166.0018, 167.0028, 168.0038, 169.0048, 170.0058, 171.0068, 172.0078, 173.0088, 174.0098, 175.0108, 176.0118, 177.0128, 178.0138, 179.0148, 180.0158, 181.0168, 182.0178, 183.0188, 184.0198, 185.0208, 186.0218, 187.0228, 188.0238, 189.0248, 190.0258, 191.0268, 192.0278, 193.0288], "recent_frames_sha256": "6d51d111c7469075ef255571daf2fa72a7f70f15726f1a331e16c9abf0f895b9", "num_recent_frames": 30, "tq": 716899.975705694, "t1": 716912.761676153, "ta": 716912.761676153, "te": 716912.990924321, "first_response_s": 12.785970458993688, "answer_total_s": 13.015218626940623, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_335_a1662_q0", "video_id": 335, "time_stamp_s": 194, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "edbeec01c76572954a97a1f408ad96b54f95c066b8963c8aa16cd8409e6b878d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Crowds stroll along a cobblestone promenade beside a waterfront, with illuminated buildings and palm trees lining the path.  \n- A modern building with a prominent \"MUSEUM\" sign and outdoor seating area is visible, with people dining and walking nearby.  \n- The camera pans left, revealing a panoramic view of a city skyline at dusk, with tall skyscrapers lit up against a darkening sky.\n[30-60s] - People walk across a paved plaza under twilight sky, passing palm trees and modern buildings with illuminated facades.\n- A group of individuals in white attire walks together, moving away from the camera toward a building entrance.\n- Decorative light structures with triangular tops are visible, casting warm glow on the plaza as people gather nearby.\n[60-90s] - A group of people stands near a tree, facing away from the camera, under ambient lighting.  \n- A couple walks past, moving toward the left, with the woman in a light top and jeans, and the man in a dark shirt and pants.  \n- People are seated on wide stone steps to the left, with some appearing to be engaged in conversation or resting.\n[90-120s] - Camera pans right, revealing a wide plaza with people sitting and walking, illuminated by ambient city lights.  \n- A tree with green foliage stands near a metal railing on the right side of the plaza.  \n- In the background, a distant city skyline with lit buildings and a prominent orange-lit structure is visible.\n[120-150s] - People are seated on a wooden deck, some facing the cityscape, others engaged in casual activities.  \n- A large, illuminated orange balloon floats near the center-right of the frame, contrasting with the darkening sky.  \n- The city skyline glows with numerous lights, including prominent skyscrapers, visible across the water in the background.\n[150-180s] - Camera pans left, revealing a wide, tiled plaza under a modern building with recessed lighting and large pillars.  \n- A tree with green leaves is visible on the right, partially obscuring the view of the building’s upper levels.  \n- The plaza appears empty, with no visible people or moving objects, and the lighting suggests it is nighttime.", "history_tokens": 482, "history_utf8_bytes": 2150, "recent_frame_times_s": [164.03316666666666, 165.0008, 166.0018, 167.0028, 168.0038, 169.0048, 170.0058, 171.0068, 172.0078, 173.0088, 174.0098, 175.0108, 176.0118, 177.0128, 178.0138, 179.0148, 180.0158, 181.0168, 182.0178, 183.0188, 184.0198, 185.0208, 186.0218, 187.0228, 188.0238, 189.0248, 190.0258, 191.0268, 192.0278, 193.0288], "recent_frames_sha256": "6d51d111c7469075ef255571daf2fa72a7f70f15726f1a331e16c9abf0f895b9", "num_recent_frames": 30, "tq": 716770.510895964, "t1": 716776.195015014, "ta": 716776.195015014, "te": 716776.234452752, "first_response_s": 5.684119050041772, "answer_total_s": 5.7235567880561575, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 335, "content_group": "f757888052bdf29e2a977fcaf7523c961a7d2f0808540f86cbb7c5df468dab42", "question": {"question_id": "sample_335_a1663_q0", "video_id": 335, "video_path": "./videos/sample_335_real.mp4", "annotation_index": 1663, "question_index": 0, "question": "Where are the trees located in relation to the buildings in the cityscape?", "options": ["A. Behind the buildings.", "B. To the right of the buildings.", "C. In the foreground, framing the scene.", "D. On the rooftops of the buildings."], "answer": "C", "time_stamp_s": 330, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_335_a1663_q0", "video_id": 335, "time_stamp_s": 330, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "28a9113ea5433f930de51af43b46dd60ac0d0e9877497cfac32ed427e890983e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [300.00233333333335, 301.00333333333333, 302.0043333333333, 303.00533333333334, 304.0063333333333, 305.00733333333335, 306.0083333333333, 307.00933333333336, 308.01033333333334, 309.0113333333333, 310.01233333333334, 311.0133333333333, 312.01433333333335, 313.01533333333333, 314.0163333333333, 315.01733333333334, 316.0183333333333, 317.01933333333335, 318.0203333333333, 319.02133333333336, 320.02233333333334, 321.0233333333333, 322.02433333333335, 323.0253333333333, 324.02633333333335, 325.02733333333333, 326.0283333333333, 327.02933333333334, 328.0303333333333, 329.03133333333335], "recent_frames_sha256": "8cc693e23e92c4aad38d257efce42552ec0ff9e74ed8084dcb894897b89e42fd", "num_recent_frames": 30, "tq": 716913.009124752, "t1": 716921.157571683, "ta": 716921.157571683, "te": 716921.197597676, "first_response_s": 8.148446931038052, "answer_total_s": 8.188472923939116, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_335_a1663_q0", "video_id": 335, "time_stamp_s": 330, "ground_truth": "C", "raw_output": "C. In the foreground, framing the scene.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "0f463676e9f0fa2780e220fef5b06bbaa0ba512bdff3e53d0a5265deb04507b3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Crowds stroll along a cobblestone promenade beside a waterfront, with illuminated buildings and palm trees lining the path.  \n- A modern building with a prominent \"MUSEUM\" sign and outdoor seating area is visible, with people dining and walking nearby.  \n- The camera pans left, revealing a panoramic view of a city skyline at dusk, with tall skyscrapers lit up against a darkening sky.\n[30-60s] - People walk across a paved plaza under twilight sky, passing palm trees and modern buildings with illuminated facades.\n- A group of individuals in white attire walks together, moving away from the camera toward a building entrance.\n- Decorative light structures with triangular tops are visible, casting warm glow on the plaza as people gather nearby.\n[60-90s] - A group of people stands near a tree, facing away from the camera, under ambient lighting.  \n- A couple walks past, moving toward the left, with the woman in a light top and jeans, and the man in a dark shirt and pants.  \n- People are seated on wide stone steps to the left, with some appearing to be engaged in conversation or resting.\n[90-120s] - Camera pans right, revealing a wide plaza with people sitting and walking, illuminated by ambient city lights.  \n- A tree with green foliage stands near a metal railing on the right side of the plaza.  \n- In the background, a distant city skyline with lit buildings and a prominent orange-lit structure is visible.\n[120-150s] - People are seated on a wooden deck, some facing the cityscape, others engaged in casual activities.  \n- A large, illuminated orange balloon floats near the center-right of the frame, contrasting with the darkening sky.  \n- The city skyline glows with numerous lights, including prominent skyscrapers, visible across the water in the background.\n[150-180s] - Camera pans left, revealing a wide, tiled plaza under a modern building with recessed lighting and large pillars.  \n- A tree with green leaves is visible on the right, partially obscuring the view of the building’s upper levels.  \n- The plaza appears empty, with no visible people or moving objects, and the lighting suggests it is nighttime.\n[180-210s] - A modern building with a pinkish facade and illuminated \"M+M\" sign is visible, positioned to the right of a paved walkway.  \n- A tall, lit skyscraper stands in the background, contrasting with the darker blue sky.  \n- Palm trees line the walkway, with a few pedestrians walking along it, near a glass railing.\n[210-240s] - Camera pans left across a modern plaza with illuminated walkways and low-profile buildings under a darkening sky.  \n- A large, curved architectural structure with embedded lights dominates the foreground, casting a warm glow on the patterned pavement.  \n- In the background, tall skyscrapers with glowing windows and digital billboards stand out against the twilight sky.\n[240-270s] - A group of people walks across a lower level beneath an elevated walkway, moving from left to right.  \n- The camera tilts upward, revealing a circular chandelier with multiple lights suspended from the ceiling.  \n- The scene is illuminated by artificial lighting, with city lights visible in the background through open spaces.\n[270-300s] - A group of people in colorful costumes (yellow, pink, blue) walk across a paved area, followed by others in dark attire.  \n- A man in a yellow raincoat and another in a blue outfit walk side by side, then turn to face a group of people.  \n- The group gathers near a building entrance with illuminated signage, standing in a line as if waiting or preparing for an event.\n[300-330s] - A group of people, some in colorful costumes, stand near the entrance of the Hong Kong Cultural Centre at night.\n- The building's sign is illuminated, displaying \"HONG KONG CULTURAL CENTRE\" in both English and Chinese characters.\n- A red vehicle is parked nearby, and the scene transitions to show surrounding urban architecture with lit windows.", "history_tokens": 894, "history_utf8_bytes": 3942, "recent_frame_times_s": [300.00233333333335, 301.00333333333333, 302.0043333333333, 303.00533333333334, 304.0063333333333, 305.00733333333335, 306.0083333333333, 307.00933333333336, 308.01033333333334, 309.0113333333333, 310.01233333333334, 311.0133333333333, 312.01433333333335, 313.01533333333333, 314.0163333333333, 315.01733333333334, 316.0183333333333, 317.01933333333335, 318.0203333333333, 319.02133333333336, 320.02233333333334, 321.0233333333333, 322.02433333333335, 323.0253333333333, 324.02633333333335, 325.02733333333333, 326.0283333333333, 327.02933333333334, 328.0303333333333, 329.03133333333335], "recent_frames_sha256": "8cc693e23e92c4aad38d257efce42552ec0ff9e74ed8084dcb894897b89e42fd", "num_recent_frames": 30, "tq": 716821.032795372, "t1": 716821.465340301, "ta": 716821.465340301, "te": 716821.835302396, "first_response_s": 0.43254492909181863, "answer_total_s": 0.8025070240255445, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 335, "content_group": "f757888052bdf29e2a977fcaf7523c961a7d2f0808540f86cbb7c5df468dab42", "question": {"question_id": "sample_335_a1664_q0", "video_id": 335, "video_path": "./videos/sample_335_real.mp4", "annotation_index": 1664, "question_index": 0, "question": "Which type of bus entered the scene just now?", "options": ["A. Single-decker bus.", "B. Mini-bus.", "C. Coach bus.", "D. Double-decker bus."], "answer": "D", "time_stamp_s": 494, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_335_a1664_q0", "video_id": 335, "time_stamp_s": 494, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bf6cb1b585fcdabb6e58927ff0846a8816bae351cbc3bc5d59d984e726311ff9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [464.0328666666667, 465.0005, 466.0015, 467.0025, 468.0035, 469.0045, 470.0055, 471.0065, 472.0075, 473.0085, 474.0095, 475.0105, 476.0115, 477.0125, 478.0135, 479.0145, 480.0155, 481.0165, 482.0175, 483.0185, 484.0195, 485.0205, 486.0215, 487.0225, 488.0235, 489.0245, 490.0255, 491.0265, 492.0275, 493.0285], "recent_frames_sha256": "32f1237c4f3de77829a2ee352d69f01604d801128d48e0dd16518104768353f0", "num_recent_frames": 30, "tq": 716921.212620959, "t1": 716935.17222729, "ta": 716935.17222729, "te": 716935.209594958, "first_response_s": 13.959606330958195, "answer_total_s": 13.996973998961039, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_335_a1664_q0", "video_id": 335, "time_stamp_s": 494, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "559f19015c2ca7d2919279a6f8ba6134ff69cf4d2c69e06f0479ed7b0b6e7a9b", "condition_order": ["notes", "recent"], "memory": "[90-120s] - Camera pans right, revealing a wide plaza with people sitting and walking, illuminated by ambient city lights.  \n- A tree with green foliage stands near a metal railing on the right side of the plaza.  \n- In the background, a distant city skyline with lit buildings and a prominent orange-lit structure is visible.\n[120-150s] - People are seated on a wooden deck, some facing the cityscape, others engaged in casual activities.  \n- A large, illuminated orange balloon floats near the center-right of the frame, contrasting with the darkening sky.  \n- The city skyline glows with numerous lights, including prominent skyscrapers, visible across the water in the background.\n[150-180s] - Camera pans left, revealing a wide, tiled plaza under a modern building with recessed lighting and large pillars.  \n- A tree with green leaves is visible on the right, partially obscuring the view of the building’s upper levels.  \n- The plaza appears empty, with no visible people or moving objects, and the lighting suggests it is nighttime.\n[180-210s] - A modern building with a pinkish facade and illuminated \"M+M\" sign is visible, positioned to the right of a paved walkway.  \n- A tall, lit skyscraper stands in the background, contrasting with the darker blue sky.  \n- Palm trees line the walkway, with a few pedestrians walking along it, near a glass railing.\n[210-240s] - Camera pans left across a modern plaza with illuminated walkways and low-profile buildings under a darkening sky.  \n- A large, curved architectural structure with embedded lights dominates the foreground, casting a warm glow on the patterned pavement.  \n- In the background, tall skyscrapers with glowing windows and digital billboards stand out against the twilight sky.\n[240-270s] - A group of people walks across a lower level beneath an elevated walkway, moving from left to right.  \n- The camera tilts upward, revealing a circular chandelier with multiple lights suspended from the ceiling.  \n- The scene is illuminated by artificial lighting, with city lights visible in the background through open spaces.\n[270-300s] - A group of people in colorful costumes (yellow, pink, blue) walk across a paved area, followed by others in dark attire.  \n- A man in a yellow raincoat and another in a blue outfit walk side by side, then turn to face a group of people.  \n- The group gathers near a building entrance with illuminated signage, standing in a line as if waiting or preparing for an event.\n[300-330s] - A group of people, some in colorful costumes, stand near the entrance of the Hong Kong Cultural Centre at night.\n- The building's sign is illuminated, displaying \"HONG KONG CULTURAL CENTRE\" in both English and Chinese characters.\n- A red vehicle is parked nearby, and the scene transitions to show surrounding urban architecture with lit windows.\n[330-360s] - Yellow double-decker bus moves leftward across the frame, passing under streetlights.  \n- Pedestrians cross the paved area near trees, some walking toward the bus.  \n- A street sign with Chinese characters and directional arrows is visible near the bus’s path.\n[360-390s] - Pedestrians walk along a tree-lined sidewalk under streetlights, moving toward a crosswalk.  \n- A red car and a green bus are visible on the road, with traffic lights and directional signs indicating a busy intersection.  \n- A tall, illuminated skyscraper dominates the skyline, with other buildings and streetlights creating a vibrant urban night scene.\n[390-420s] - A tall, illuminated skyscraper with a bright rectangular light at its top dominates the skyline.  \n- A building with \"VICTORIA\" signage and glowing window frames is visible on the right side of the street.  \n- Traffic, including buses and cars, flows continuously along the road, with a tram passing by in the foreground.\n[420-450s] - A red double-decker bus moves leftward across the frame, passing a yellow bus at a crosswalk.  \n- Pedestrians walk along the sidewalk, some near trees, others near a building with illuminated windows.  \n- A white bus enters the frame from the right, moving toward the crosswalk as traffic flows.\n[450-480s] - A red double-decker bus passes by, its rear lights glowing as it moves along the road.  \n- Pedestrians walk on the sidewalk, some carrying bags, near a metal railing separating the sidewalk from the street.  \n- A blue street sign with Chinese characters is visible above the sidewalk, indicating a direction.", "history_tokens": 1021, "history_utf8_bytes": 4444, "recent_frame_times_s": [464.0328666666667, 465.0005, 466.0015, 467.0025, 468.0035, 469.0045, 470.0055, 471.0065, 472.0075, 473.0085, 474.0095, 475.0105, 476.0115, 477.0125, 478.0135, 479.0145, 480.0155, 481.0165, 482.0175, 483.0185, 484.0195, 485.0205, 486.0215, 487.0225, 488.0235, 489.0245, 490.0255, 491.0265, 492.0275, 493.0285], "recent_frames_sha256": "32f1237c4f3de77829a2ee352d69f01604d801128d48e0dd16518104768353f0", "num_recent_frames": 30, "tq": 716862.408419535, "t1": 716868.384287447, "ta": 716868.384287447, "te": 716868.543085274, "first_response_s": 5.9758679119404405, "answer_total_s": 6.134665739024058, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 335, "content_group": "f757888052bdf29e2a977fcaf7523c961a7d2f0808540f86cbb7c5df468dab42", "question": {"question_id": "sample_335_a1665_q0", "video_id": 335, "video_path": "./videos/sample_335_real.mp4", "annotation_index": 1665, "question_index": 0, "question": "What indicates that the area is lively and urban?", "options": ["A. Presence of street performers.", "B. Numerous pedestrians and vehicles and tall buildings.", "C. Absence of advertisements.", "D. Quiet surroundings."], "answer": "B", "time_stamp_s": 595, "task_type": "Causal Reasoning", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [540, 597], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_335_a1665_q0", "video_id": 335, "time_stamp_s": 595, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dc41354906c7cb64dcd28a4da1a494ad44a599b19c140bdc2feccc3b27006503", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [565.0004, 566.0014, 567.0024, 568.0034, 569.0044, 570.0054, 571.0064, 572.0074, 573.0084, 574.0094, 575.0104, 576.0114, 577.0124, 578.0134, 579.0144, 580.0154, 581.0164, 582.0174, 583.0184, 584.0194, 585.0204, 586.0214, 587.0224, 588.0234, 589.0244, 590.0254, 591.0264, 592.0274, 593.0284, 594.0294], "recent_frames_sha256": "9d1a68a25bf734d3325095e73dd78c641b8f6f8bffd7212c65198ae5e640f1d6", "num_recent_frames": 30, "tq": 716935.23592908, "t1": 716947.504275046, "ta": 716947.504275046, "te": 716947.540657955, "first_response_s": 12.268345966003835, "answer_total_s": 12.3047288749367, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_335_a1665_q0", "video_id": 335, "time_stamp_s": 595, "ground_truth": "B", "raw_output": "B. Numerous pedestrians and vehicles and tall buildings.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "ac799deabbad4677d95e85fe639ff53663ab0db4f18b956c5805d96a03866fe3", "condition_order": ["notes", "recent"], "memory": "[180-210s] - A modern building with a pinkish facade and illuminated \"M+M\" sign is visible, positioned to the right of a paved walkway.  \n- A tall, lit skyscraper stands in the background, contrasting with the darker blue sky.  \n- Palm trees line the walkway, with a few pedestrians walking along it, near a glass railing.\n[210-240s] - Camera pans left across a modern plaza with illuminated walkways and low-profile buildings under a darkening sky.  \n- A large, curved architectural structure with embedded lights dominates the foreground, casting a warm glow on the patterned pavement.  \n- In the background, tall skyscrapers with glowing windows and digital billboards stand out against the twilight sky.\n[240-270s] - A group of people walks across a lower level beneath an elevated walkway, moving from left to right.  \n- The camera tilts upward, revealing a circular chandelier with multiple lights suspended from the ceiling.  \n- The scene is illuminated by artificial lighting, with city lights visible in the background through open spaces.\n[270-300s] - A group of people in colorful costumes (yellow, pink, blue) walk across a paved area, followed by others in dark attire.  \n- A man in a yellow raincoat and another in a blue outfit walk side by side, then turn to face a group of people.  \n- The group gathers near a building entrance with illuminated signage, standing in a line as if waiting or preparing for an event.\n[300-330s] - A group of people, some in colorful costumes, stand near the entrance of the Hong Kong Cultural Centre at night.\n- The building's sign is illuminated, displaying \"HONG KONG CULTURAL CENTRE\" in both English and Chinese characters.\n- A red vehicle is parked nearby, and the scene transitions to show surrounding urban architecture with lit windows.\n[330-360s] - Yellow double-decker bus moves leftward across the frame, passing under streetlights.  \n- Pedestrians cross the paved area near trees, some walking toward the bus.  \n- A street sign with Chinese characters and directional arrows is visible near the bus’s path.\n[360-390s] - Pedestrians walk along a tree-lined sidewalk under streetlights, moving toward a crosswalk.  \n- A red car and a green bus are visible on the road, with traffic lights and directional signs indicating a busy intersection.  \n- A tall, illuminated skyscraper dominates the skyline, with other buildings and streetlights creating a vibrant urban night scene.\n[390-420s] - A tall, illuminated skyscraper with a bright rectangular light at its top dominates the skyline.  \n- A building with \"VICTORIA\" signage and glowing window frames is visible on the right side of the street.  \n- Traffic, including buses and cars, flows continuously along the road, with a tram passing by in the foreground.\n[420-450s] - A red double-decker bus moves leftward across the frame, passing a yellow bus at a crosswalk.  \n- Pedestrians walk along the sidewalk, some near trees, others near a building with illuminated windows.  \n- A white bus enters the frame from the right, moving toward the crosswalk as traffic flows.\n[450-480s] - A red double-decker bus passes by, its rear lights glowing as it moves along the road.  \n- Pedestrians walk on the sidewalk, some carrying bags, near a metal railing separating the sidewalk from the street.  \n- A blue street sign with Chinese characters is visible above the sidewalk, indicating a direction.\n[480-510s] - Pedestrians walk along a sidewalk bordered by a metal railing, moving away from the camera.  \n- A large, brightly lit building with a prominent vertical sign dominates the background, situated across the street.  \n- Vehicles, including buses and cars, move along the road, with their headlights and taillights visible against the night sky.\n[510-540s] - A red double-decker bus passes by on the road, moving from right to left.  \n- Pedestrians walk along the sidewalk, some carrying bags, near trees and a fence.  \n- A historic-looking building with a wooden facade and a fenced perimeter is visible on the corner.\n[540-570s] - A double-decker bus with route number \"20\" passes by, moving from right to left along the street.  \n- Pedestrians walk along a paved sidewalk adjacent to the road, near a modern building with large posters.  \n- The scene is illuminated by streetlights and building lights under a dark night sky.", "history_tokens": 1011, "history_utf8_bytes": 4338, "recent_frame_times_s": [565.0004, 566.0014, 567.0024, 568.0034, 569.0044, 570.0054, 571.0064, 572.0074, 573.0084, 574.0094, 575.0104, 576.0114, 577.0124, 578.0134, 579.0144, 580.0154, 581.0164, 582.0174, 583.0184, 584.0194, 585.0204, 586.0214, 587.0224, 588.0234, 589.0244, 590.0254, 591.0264, 592.0274, 593.0284, 594.0294], "recent_frames_sha256": "9d1a68a25bf734d3325095e73dd78c641b8f6f8bffd7212c65198ae5e640f1d6", "num_recent_frames": 30, "tq": 716892.249809901, "t1": 716898.911517205, "ta": 716898.911517205, "te": 716899.348247637, "first_response_s": 6.661707303952426, "answer_total_s": 7.0984377360437065, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 336, "content_group": "957f9889bf89d5fb99b58981eca69e3145d155200e43b8636d4d6e5b2865f7df", "question": {"question_id": "sample_336_a465_q0", "video_id": 336, "video_path": "./videos/sample_336_real.mp4", "annotation_index": 465, "question_index": 0, "question": "What type of bus is visible right now?", "options": ["A. Single-decker bus.", "B. Minibus.", "C. Double-decker bus.", "D. School bus."], "answer": "C", "time_stamp_s": 16, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_336_a465_q0", "video_id": 336, "time_stamp_s": 16, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e5df5a476382085373e93af1877b7d2edf453e87472fdb28c50c44a0994245e9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.036, 1.0036333333333334, 2.0046333333333335, 3.0056333333333334, 4.006633333333333, 5.007633333333334, 6.008633333333333, 7.009633333333333, 8.010633333333333, 9.011633333333334, 10.012633333333333, 11.013633333333333, 12.014633333333334, 13.015633333333334, 14.016633333333333, 15.017633333333333], "recent_frames_sha256": "c5da8314b18078f1d731cb14ae74a71717d4484504f919e91c1f85e44a1285e6", "num_recent_frames": 16, "tq": 717166.28265324, "t1": 717180.495933239, "ta": 717180.495933239, "te": 717180.533791891, "first_response_s": 14.213279998977669, "answer_total_s": 14.251138650928624, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_336_a465_q0", "video_id": 336, "time_stamp_s": 16, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "99af5588a675da8cc55a379b271a0da947e7a31dd9dc78676f316322fe606cd1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.036, 1.0036333333333334, 2.0046333333333335, 3.0056333333333334, 4.006633333333333, 5.007633333333334, 6.008633333333333, 7.009633333333333, 8.010633333333333, 9.011633333333334, 10.012633333333333, 11.013633333333333, 12.014633333333334, 13.015633333333334, 14.016633333333333, 15.017633333333333], "recent_frames_sha256": "c5da8314b18078f1d731cb14ae74a71717d4484504f919e91c1f85e44a1285e6", "num_recent_frames": 16, "tq": 717232.437452435, "t1": 717238.104210869, "ta": 717238.104210869, "te": 717238.142661636, "first_response_s": 5.666758433915675, "answer_total_s": 5.705209200968966, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 336, "content_group": "957f9889bf89d5fb99b58981eca69e3145d155200e43b8636d4d6e5b2865f7df", "question": {"question_id": "sample_336_a466_q0", "video_id": 336, "video_path": "./videos/sample_336_real.mp4", "annotation_index": 466, "question_index": 0, "question": "What is the primary activity of the pedestrians seen in the walkway?", "options": ["A. Running.", "B. Walking.", "C. Cycling.", "D. Skating."], "answer": "B", "time_stamp_s": 146, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_336_a466_q0", "video_id": 336, "time_stamp_s": 146, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9a8bc9743ce0be531d1e7351dd29a60be02394b5597e0d775508de42dbc99de1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [116.01853333333334, 117.01953333333333, 118.02053333333333, 119.02153333333334, 120.02253333333333, 121.02353333333333, 122.02453333333334, 123.02553333333333, 124.02653333333333, 125.02753333333334, 126.02853333333333, 127.02953333333333, 128.03053333333332, 129.03153333333333, 130.03253333333333, 131.00016666666667, 132.00116666666668, 133.00216666666665, 134.00316666666666, 135.00416666666666, 136.00516666666667, 137.00616666666667, 138.00716666666668, 139.00816666666665, 140.00916666666666, 141.01016666666666, 142.01116666666667, 143.01216666666667, 144.01316666666668, 145.01416666666665], "recent_frames_sha256": "46d318b9db8ad14f9ee79d30e757f0f37e0262bdee16225b5f9060cd792da796", "num_recent_frames": 30, "tq": 717180.548879535, "t1": 717191.958927242, "ta": 717191.958927242, "te": 717191.996488366, "first_response_s": 11.410047706915066, "answer_total_s": 11.447608830989338, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_336_a466_q0", "video_id": 336, "time_stamp_s": 146, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0fc45d3971979d929db372e125047ae03829b5dbcee463c1fc704535a4e19aca", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A double-decker bus with Chinese characters on its side moves along a city street at night, passing pedestrians and palm trees.  \n- A tall, illuminated clock tower stands prominently in the background, with its lights casting a warm glow on the surrounding area.  \n- Pedestrians walk along a paved sidewalk beside a modern building with angled walls and posters, some looking toward the clock tower.\n[30-60s] - A tall clock tower with illuminated faces stands centrally, surrounded by palm trees and pedestrians.  \n- Digital billboards display dynamic, colorful graphics, including a prominent \"HONG KONG\" sign.  \n- People walk along a cobblestone path, with some pausing near the tower or billboards, under a partly cloudy night sky.\n[60-90s] - A tall brick tower with illuminated clock faces stands prominently on the right, casting warm light on the cobblestone plaza.  \n- Palm trees line the plaza, their fronds swaying gently under night sky lighting.  \n- People stroll and gather across the plaza, some walking toward the tower while others move toward the left side of the frame.\n[90-120s] - Crowd gathers in an open plaza at night, with some individuals walking toward or away from the camera.  \n- A tall, illuminated tower stands on the left, while a brightly lit building with a curved roof is visible on the right.  \n- City skyline with skyscrapers and lights forms the background, with palm trees and a flagpole visible in the foreground.", "history_tokens": 324, "history_utf8_bytes": 1460, "recent_frame_times_s": [116.01853333333334, 117.01953333333333, 118.02053333333333, 119.02153333333334, 120.02253333333333, 121.02353333333333, 122.02453333333334, 123.02553333333333, 124.02653333333333, 125.02753333333334, 126.02853333333333, 127.02953333333333, 128.03053333333332, 129.03153333333333, 130.03253333333333, 131.00016666666667, 132.00116666666668, 133.00216666666665, 134.00316666666666, 135.00416666666666, 136.00516666666667, 137.00616666666667, 138.00716666666668, 139.00816666666665, 140.00916666666666, 141.01016666666666, 142.01116666666667, 143.01216666666667, 144.01316666666668, 145.01416666666665], "recent_frames_sha256": "46d318b9db8ad14f9ee79d30e757f0f37e0262bdee16225b5f9060cd792da796", "num_recent_frames": 30, "tq": 717268.026107782, "t1": 717269.319723183, "ta": 717269.319723183, "te": 717269.550075583, "first_response_s": 1.2936154010239989, "answer_total_s": 1.5239678010111675, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 336, "content_group": "957f9889bf89d5fb99b58981eca69e3145d155200e43b8636d4d6e5b2865f7df", "question": {"question_id": "sample_336_a467_q0", "video_id": 336, "video_path": "./videos/sample_336_real.mp4", "annotation_index": 467, "question_index": 0, "question": "What is the setting of the video scene?", "options": ["A. A busy market street during the day.", "B. A quiet village at sunset.", "C. A vibrant cityscape at night.", "D. A beach during the evening."], "answer": "C", "time_stamp_s": 300, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_336_a467_q0", "video_id": 336, "time_stamp_s": 300, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0200320341d48c4502c69b889ba4a41660141d26aaa7c8482d2ca29a5d81bf07", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [270.0057, 271.0067, 272.0077, 273.0087, 274.0097, 275.0107, 276.0117, 277.0127, 278.0137, 279.0147, 280.0157, 281.0167, 282.0177, 283.0187, 284.0197, 285.0207, 286.0217, 287.0227, 288.0237, 289.0247, 290.0257, 291.0267, 292.0277, 293.0287, 294.0297, 295.0307, 296.0317, 297.0327, 298.00033333333334, 299.0013333333333], "recent_frames_sha256": "ab2d9fd0bc157126359c37f883db4df0590648c3acc9da3b7d88134e558b74be", "num_recent_frames": 30, "tq": 717192.011253565, "t1": 717205.586594219, "ta": 717205.586594219, "te": 717205.622802265, "first_response_s": 13.575340654002503, "answer_total_s": 13.611548700020649, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_336_a467_q0", "video_id": 336, "time_stamp_s": 300, "ground_truth": "C", "raw_output": "C. A vibrant cityscape at night.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "423489e486de7847e60722b4afdd1ee825fcdf1a94a40573a3c9bc4373d83288", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A double-decker bus with Chinese characters on its side moves along a city street at night, passing pedestrians and palm trees.  \n- A tall, illuminated clock tower stands prominently in the background, with its lights casting a warm glow on the surrounding area.  \n- Pedestrians walk along a paved sidewalk beside a modern building with angled walls and posters, some looking toward the clock tower.\n[30-60s] - A tall clock tower with illuminated faces stands centrally, surrounded by palm trees and pedestrians.  \n- Digital billboards display dynamic, colorful graphics, including a prominent \"HONG KONG\" sign.  \n- People walk along a cobblestone path, with some pausing near the tower or billboards, under a partly cloudy night sky.\n[60-90s] - A tall brick tower with illuminated clock faces stands prominently on the right, casting warm light on the cobblestone plaza.  \n- Palm trees line the plaza, their fronds swaying gently under night sky lighting.  \n- People stroll and gather across the plaza, some walking toward the tower while others move toward the left side of the frame.\n[90-120s] - Crowd gathers in an open plaza at night, with some individuals walking toward or away from the camera.  \n- A tall, illuminated tower stands on the left, while a brightly lit building with a curved roof is visible on the right.  \n- City skyline with skyscrapers and lights forms the background, with palm trees and a flagpole visible in the foreground.\n[120-150s] - A group of people walks along a covered walkway beside a waterfront, with city lights reflecting on the water.  \n- A woman in a floral dress walks toward the camera, holding a phone, while others move in various directions.  \n- The walkway has white pillars and a sign with Chinese characters, indicating a public or tourist area.\n[150-180s] - A man in a blue shirt walks past the camera, moving from left to right under a covered walkway.  \n- People are seated on benches along the walkway, some engaged in conversation or looking at their phones.  \n- The scene is illuminated by overhead lights and ambient street lighting, with a darkening sky visible beyond the covered area.\n[180-210s] - A tall, illuminated clock tower stands prominently against the night sky, with its face clearly visible.  \n- People are seen walking and sitting on benches along a paved pathway, with some groups gathered near the tower.  \n- The camera pans to reveal a modern building with a curved roof and columns, lit by warm lights, positioned adjacent to the clock tower.\n[210-240s] - People are gathered near the waterfront, some standing and others seated, observing the city skyline at night.\n- A large, illuminated mural depicting a ship is visible on the escalator’s side wall, adding a decorative element to the space.\n- The area is supported by white pillars and has a patterned ceiling with embedded lighting, creating a modern, open-air ambiance.\n[240-270s] - Group of people standing in line under a covered area, facing a brightly lit city skyline at night.  \n- White cylindrical pillars support the ceiling, with overhead lights illuminating the space.  \n- Cityscape features numerous illuminated buildings, including a prominent skyscraper with a red light on top.\n[270-300s] - City skyline illuminated with vibrant lights reflecting on water surface.  \n- Buildings display varied colors, including blue, red, and green, with prominent towers.  \n- Water ripples gently, mirroring the lights, under a dark sky with scattered clouds.", "history_tokens": 779, "history_utf8_bytes": 3502, "recent_frame_times_s": [270.0057, 271.0067, 272.0077, 273.0087, 274.0097, 275.0107, 276.0117, 277.0127, 278.0137, 279.0147, 280.0157, 281.0167, 282.0177, 283.0187, 284.0197, 285.0207, 286.0217, 287.0227, 288.0237, 289.0247, 290.0257, 291.0267, 292.0277, 293.0287, 294.0297, 295.0307, 296.0317, 297.0327, 298.00033333333334, 299.0013333333333], "recent_frames_sha256": "ab2d9fd0bc157126359c37f883db4df0590648c3acc9da3b7d88134e558b74be", "num_recent_frames": 30, "tq": 717316.034457909, "t1": 717317.077599627, "ta": 717317.077599627, "te": 717317.435409453, "first_response_s": 1.0431417180225253, "answer_total_s": 1.4009515440557152, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 336, "content_group": "957f9889bf89d5fb99b58981eca69e3145d155200e43b8636d4d6e5b2865f7df", "question": {"question_id": "sample_336_a468_q0", "video_id": 336, "video_path": "./videos/sample_336_real.mp4", "annotation_index": 468, "question_index": 0, "question": "What is the overall setting depicted in the video?", "options": ["A. A city skyline at night.", "B. A rural landscape at sunset.", "C. A beach during daytime.", "D. A forest in the morning."], "answer": "A", "time_stamp_s": 440, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_336_a468_q0", "video_id": 336, "time_stamp_s": 440, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c04b39a08d4e62030b924dd95e517330e819e6709952eb4a17431c6823cdbf4f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [410.0122333333333, 411.01323333333335, 412.0142333333333, 413.01523333333336, 414.01623333333333, 415.0172333333333, 416.01823333333334, 417.0192333333333, 418.02023333333335, 419.0212333333333, 420.02223333333336, 421.02323333333334, 422.0242333333333, 423.02523333333335, 424.0262333333333, 425.02723333333336, 426.02823333333333, 427.0292333333333, 428.03023333333334, 429.0312333333333, 430.03223333333335, 431.0332333333333, 432.00086666666664, 433.0018666666667, 434.00286666666665, 435.0038666666667, 436.00486666666666, 437.0058666666667, 438.00686666666667, 439.00786666666664], "recent_frames_sha256": "ec501031a4cfc28390b1e40a488a24410d6c074309a0f1f775d6d51c43a2288a", "num_recent_frames": 30, "tq": 717205.635686414, "t1": 717219.193325713, "ta": 717219.193325713, "te": 717219.380760166, "first_response_s": 13.557639299076982, "answer_total_s": 13.745073752012104, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_336_a468_q0", "video_id": 336, "time_stamp_s": 440, "ground_truth": "A", "raw_output": "A. A city skyline at night.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "0da27cc9641a439790e6ecb4e8837a5b1370876713f21787aee7b2d78b2beed2", "condition_order": ["recent", "notes"], "memory": "[30-60s] - A tall clock tower with illuminated faces stands centrally, surrounded by palm trees and pedestrians.  \n- Digital billboards display dynamic, colorful graphics, including a prominent \"HONG KONG\" sign.  \n- People walk along a cobblestone path, with some pausing near the tower or billboards, under a partly cloudy night sky.\n[60-90s] - A tall brick tower with illuminated clock faces stands prominently on the right, casting warm light on the cobblestone plaza.  \n- Palm trees line the plaza, their fronds swaying gently under night sky lighting.  \n- People stroll and gather across the plaza, some walking toward the tower while others move toward the left side of the frame.\n[90-120s] - Crowd gathers in an open plaza at night, with some individuals walking toward or away from the camera.  \n- A tall, illuminated tower stands on the left, while a brightly lit building with a curved roof is visible on the right.  \n- City skyline with skyscrapers and lights forms the background, with palm trees and a flagpole visible in the foreground.\n[120-150s] - A group of people walks along a covered walkway beside a waterfront, with city lights reflecting on the water.  \n- A woman in a floral dress walks toward the camera, holding a phone, while others move in various directions.  \n- The walkway has white pillars and a sign with Chinese characters, indicating a public or tourist area.\n[150-180s] - A man in a blue shirt walks past the camera, moving from left to right under a covered walkway.  \n- People are seated on benches along the walkway, some engaged in conversation or looking at their phones.  \n- The scene is illuminated by overhead lights and ambient street lighting, with a darkening sky visible beyond the covered area.\n[180-210s] - A tall, illuminated clock tower stands prominently against the night sky, with its face clearly visible.  \n- People are seen walking and sitting on benches along a paved pathway, with some groups gathered near the tower.  \n- The camera pans to reveal a modern building with a curved roof and columns, lit by warm lights, positioned adjacent to the clock tower.\n[210-240s] - People are gathered near the waterfront, some standing and others seated, observing the city skyline at night.\n- A large, illuminated mural depicting a ship is visible on the escalator’s side wall, adding a decorative element to the space.\n- The area is supported by white pillars and has a patterned ceiling with embedded lighting, creating a modern, open-air ambiance.\n[240-270s] - Group of people standing in line under a covered area, facing a brightly lit city skyline at night.  \n- White cylindrical pillars support the ceiling, with overhead lights illuminating the space.  \n- Cityscape features numerous illuminated buildings, including a prominent skyscraper with a red light on top.\n[270-300s] - City skyline illuminated with vibrant lights reflecting on water surface.  \n- Buildings display varied colors, including blue, red, and green, with prominent towers.  \n- Water ripples gently, mirroring the lights, under a dark sky with scattered clouds.\n[300-330s] - City skyline illuminated with vibrant, multicolored lights reflecting on rippling water surface.  \n- Clouds drift slowly across dark night sky above the urban landscape.  \n- Camera pans right, revealing more skyscrapers and their glowing facades.\n[330-360s] - City skyline with vibrant lights reflected on water, featuring a prominent tower with a spire.  \n- Camera pans right, revealing a covered plaza with white pillars and people walking or sitting.  \n- Background shows palm trees and purple ambient lighting, with a transition to a more open, pedestrian area.\n[360-390s] - People walk along a covered walkway with white pillars and overhead lights, some seated on benches.\n- The camera pans right to reveal a vibrant city skyline across a body of water, reflecting colorful lights.\n- The skyline features numerous tall buildings with illuminated windows, including a prominent tower with a spire.\n[390-420s] - City skyline illuminated with vibrant, multicolored lights reflecting on the water surface.  \n- Clouds drift slowly across the dark night sky above the buildings.  \n- Water ripples gently, distorting and shifting the reflections of the city lights.", "history_tokens": 954, "history_utf8_bytes": 4270, "recent_frame_times_s": [410.0122333333333, 411.01323333333335, 412.0142333333333, 413.01523333333336, 414.01623333333333, 415.0172333333333, 416.01823333333334, 417.0192333333333, 418.02023333333335, 419.0212333333333, 420.02223333333336, 421.02323333333334, 422.0242333333333, 423.02523333333335, 424.0262333333333, 425.02723333333336, 426.02823333333333, 427.0292333333333, 428.03023333333334, 429.0312333333333, 430.03223333333335, 431.0332333333333, 432.00086666666664, 433.0018666666667, 434.00286666666665, 435.0038666666667, 436.00486666666666, 437.0058666666667, 438.00686666666667, 439.00786666666664], "recent_frames_sha256": "ec501031a4cfc28390b1e40a488a24410d6c074309a0f1f775d6d51c43a2288a", "num_recent_frames": 30, "tq": 717353.578266515, "t1": 717354.611577407, "ta": 717354.611577407, "te": 717354.907406571, "first_response_s": 1.0333108919439837, "answer_total_s": 1.329140055924654, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 336, "content_group": "957f9889bf89d5fb99b58981eca69e3145d155200e43b8636d4d6e5b2865f7df", "question": {"question_id": "sample_336_a468_q1", "video_id": 336, "video_path": "./videos/sample_336_real.mp4", "annotation_index": 468, "question_index": 1, "question": "Where are the colorful lights primarily reflected?", "options": ["A. In the sky.", "B. On the buildings.", "C. In the water in the foreground.", "D. On the streets."], "answer": "C", "time_stamp_s": 440, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_336_a468_q1", "video_id": 336, "time_stamp_s": 440, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a0e053370719ae63dc878f6c05f4e1348a949f433e3ad59625c3c28c547b78a8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [410.0122333333333, 411.01323333333335, 412.0142333333333, 413.01523333333336, 414.01623333333333, 415.0172333333333, 416.01823333333334, 417.0192333333333, 418.02023333333335, 419.0212333333333, 420.02223333333336, 421.02323333333334, 422.0242333333333, 423.02523333333335, 424.0262333333333, 425.02723333333336, 426.02823333333333, 427.0292333333333, 428.03023333333334, 429.0312333333333, 430.03223333333335, 431.0332333333333, 432.00086666666664, 433.0018666666667, 434.00286666666665, 435.0038666666667, 436.00486666666666, 437.0058666666667, 438.00686666666667, 439.00786666666664], "recent_frames_sha256": "ec501031a4cfc28390b1e40a488a24410d6c074309a0f1f775d6d51c43a2288a", "num_recent_frames": 30, "tq": 717219.40134672, "t1": 717232.381694242, "ta": 717232.381694242, "te": 717232.423085841, "first_response_s": 12.980347521952353, "answer_total_s": 13.021739120944403, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_336_a468_q1", "video_id": 336, "time_stamp_s": 440, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b8d948e07070021674b15b284c8ef44e80f6df9fc253dc4a9138eae427860d36", "condition_order": ["recent", "notes"], "memory": "[30-60s] - A tall clock tower with illuminated faces stands centrally, surrounded by palm trees and pedestrians.  \n- Digital billboards display dynamic, colorful graphics, including a prominent \"HONG KONG\" sign.  \n- People walk along a cobblestone path, with some pausing near the tower or billboards, under a partly cloudy night sky.\n[60-90s] - A tall brick tower with illuminated clock faces stands prominently on the right, casting warm light on the cobblestone plaza.  \n- Palm trees line the plaza, their fronds swaying gently under night sky lighting.  \n- People stroll and gather across the plaza, some walking toward the tower while others move toward the left side of the frame.\n[90-120s] - Crowd gathers in an open plaza at night, with some individuals walking toward or away from the camera.  \n- A tall, illuminated tower stands on the left, while a brightly lit building with a curved roof is visible on the right.  \n- City skyline with skyscrapers and lights forms the background, with palm trees and a flagpole visible in the foreground.\n[120-150s] - A group of people walks along a covered walkway beside a waterfront, with city lights reflecting on the water.  \n- A woman in a floral dress walks toward the camera, holding a phone, while others move in various directions.  \n- The walkway has white pillars and a sign with Chinese characters, indicating a public or tourist area.\n[150-180s] - A man in a blue shirt walks past the camera, moving from left to right under a covered walkway.  \n- People are seated on benches along the walkway, some engaged in conversation or looking at their phones.  \n- The scene is illuminated by overhead lights and ambient street lighting, with a darkening sky visible beyond the covered area.\n[180-210s] - A tall, illuminated clock tower stands prominently against the night sky, with its face clearly visible.  \n- People are seen walking and sitting on benches along a paved pathway, with some groups gathered near the tower.  \n- The camera pans to reveal a modern building with a curved roof and columns, lit by warm lights, positioned adjacent to the clock tower.\n[210-240s] - People are gathered near the waterfront, some standing and others seated, observing the city skyline at night.\n- A large, illuminated mural depicting a ship is visible on the escalator’s side wall, adding a decorative element to the space.\n- The area is supported by white pillars and has a patterned ceiling with embedded lighting, creating a modern, open-air ambiance.\n[240-270s] - Group of people standing in line under a covered area, facing a brightly lit city skyline at night.  \n- White cylindrical pillars support the ceiling, with overhead lights illuminating the space.  \n- Cityscape features numerous illuminated buildings, including a prominent skyscraper with a red light on top.\n[270-300s] - City skyline illuminated with vibrant lights reflecting on water surface.  \n- Buildings display varied colors, including blue, red, and green, with prominent towers.  \n- Water ripples gently, mirroring the lights, under a dark sky with scattered clouds.\n[300-330s] - City skyline illuminated with vibrant, multicolored lights reflecting on rippling water surface.  \n- Clouds drift slowly across dark night sky above the urban landscape.  \n- Camera pans right, revealing more skyscrapers and their glowing facades.\n[330-360s] - City skyline with vibrant lights reflected on water, featuring a prominent tower with a spire.  \n- Camera pans right, revealing a covered plaza with white pillars and people walking or sitting.  \n- Background shows palm trees and purple ambient lighting, with a transition to a more open, pedestrian area.\n[360-390s] - People walk along a covered walkway with white pillars and overhead lights, some seated on benches.\n- The camera pans right to reveal a vibrant city skyline across a body of water, reflecting colorful lights.\n- The skyline features numerous tall buildings with illuminated windows, including a prominent tower with a spire.\n[390-420s] - City skyline illuminated with vibrant, multicolored lights reflecting on the water surface.  \n- Clouds drift slowly across the dark night sky above the buildings.  \n- Water ripples gently, distorting and shifting the reflections of the city lights.", "history_tokens": 954, "history_utf8_bytes": 4270, "recent_frame_times_s": [410.0122333333333, 411.01323333333335, 412.0142333333333, 413.01523333333336, 414.01623333333333, 415.0172333333333, 416.01823333333334, 417.0192333333333, 418.02023333333335, 419.0212333333333, 420.02223333333336, 421.02323333333334, 422.0242333333333, 423.02523333333335, 424.0262333333333, 425.02723333333336, 426.02823333333333, 427.0292333333333, 428.03023333333334, 429.0312333333333, 430.03223333333335, 431.0332333333333, 432.00086666666664, 433.0018666666667, 434.00286666666665, 435.0038666666667, 436.00486666666666, 437.0058666666667, 438.00686666666667, 439.00786666666664], "recent_frames_sha256": "ec501031a4cfc28390b1e40a488a24410d6c074309a0f1f775d6d51c43a2288a", "num_recent_frames": 30, "tq": 717354.936509483, "t1": 717366.951180644, "ta": 717366.951180644, "te": 717366.98971785, "first_response_s": 12.014671160955913, "answer_total_s": 12.053208366967738, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 337, "content_group": "de014850b5e8740dfb9170cc7aa3d87ce878f7454447d61796b406fc0650b861", "question": {"question_id": "sample_337_a1626_q0", "video_id": 337, "video_path": "./videos/sample_337_real.mp4", "annotation_index": 1626, "question_index": 0, "question": "Where is the crowd of people located in relation to the city skyline?", "options": ["A. On the left side of the frame.", "B. In the center of the frame.", "C. On the right side of the frame.", "D. At the top of the frame."], "answer": "C", "time_stamp_s": 2, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_337_a1626_q0", "video_id": 337, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fca232d3a78255a851e8bbd60aca3da13aa5b4b16d5b93e3b2610aac9f1a63a0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.037, 1.0046333333333333], "recent_frames_sha256": "12a4f49e8441599fa2912e68dd438a58cfc5de5e33e11a9952b866a1fa5c1267", "num_recent_frames": 2, "tq": 710574.01080219, "t1": 710575.093356641, "ta": 710575.093356641, "te": 710575.130322098, "first_response_s": 1.0825544509571046, "answer_total_s": 1.1195199079811573, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_337_a1626_q0", "video_id": 337, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6b837c79368e85b74a9c5d9e64bff682401be837d478d134947a44a38b326ddc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.037, 1.0046333333333333], "recent_frames_sha256": "12a4f49e8441599fa2912e68dd438a58cfc5de5e33e11a9952b866a1fa5c1267", "num_recent_frames": 2, "tq": 710398.073254199, "t1": 710409.513236994, "ta": 710409.513236994, "te": 710409.759063549, "first_response_s": 11.439982795040123, "answer_total_s": 11.68580934999045, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 337, "content_group": "de014850b5e8740dfb9170cc7aa3d87ce878f7454447d61796b406fc0650b861", "question": {"question_id": "sample_337_a1627_q0", "video_id": 337, "video_path": "./videos/sample_337_real.mp4", "annotation_index": 1627, "question_index": 0, "question": "What is the main focus of the video?", "options": ["A. A parade in the city.", "B. A busy street market.", "C. A breathtaking nighttime cityscape.", "D. A sports event."], "answer": "C", "time_stamp_s": 200, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_337_a1627_q0", "video_id": 337, "time_stamp_s": 200, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ea65d7a4c37ba71164408317c50a15a0c142e49eb52936a1b95f1333f3bffd83", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [170.0068, 171.0078, 172.0088, 173.0098, 174.0108, 175.0118, 176.0128, 177.0138, 178.0148, 179.0158, 180.0168, 181.0178, 182.0188, 183.0198, 184.0208, 185.0218, 186.0228, 187.0238, 188.0248, 189.0258, 190.0268, 191.0278, 192.0288, 193.0298, 194.0308, 195.0318, 196.0328, 197.00043333333332, 198.00143333333332, 199.00243333333333], "recent_frames_sha256": "fba635127dabd9552985b94f0b931df4454568d852e04adf40f57e6991e5adab", "num_recent_frames": 30, "tq": 710575.148902835, "t1": 710586.318911469, "ta": 710586.318911469, "te": 710586.504523099, "first_response_s": 11.170008633984253, "answer_total_s": 11.355620264075696, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_337_a1627_q0", "video_id": 337, "time_stamp_s": 200, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dbc8a7ce62b68c7ff52cc8143613bc5bcb7f899dee56236f9c0e6762e9e8ad4f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - City skyline illuminated with colorful lights reflecting on water, with clouds moving slowly across dark sky.  \n- Camera pans left, revealing more buildings and their lights, including a prominent tower with a spire.  \n- Right edge of frame shows part of a structure, possibly a bridge or pier, with warm lighting.\n[30-60s] - City skyline illuminated with vibrant, multicolored lights reflecting on water surface.  \n- Clouds drift slowly across dark sky above the urban landscape.  \n- A prominent tower with a golden spire stands centrally, flanked by other high-rises.\n[60-90s] - City skyline illuminated with vibrant, shifting lights reflecting on water surface.  \n- Clouds drift slowly across dark sky, partially obscuring city lights.  \n- Bright beams of light project from buildings, creating dynamic visual patterns.\n[90-120s] - City skyline illuminated with vibrant lights reflecting on water surface.  \n- Clouds drift slowly across dark sky, partially obscuring city lights.  \n- Bright beams of light project from buildings, creating dynamic visual effects.\n[120-150s] - City skyline illuminated with vibrant, multicolored lights reflecting on the water surface.  \n- A large, fluffy cloud drifts slowly across the dark sky above the city.  \n- Water ripples gently, distorting and shifting the reflections of the city lights.\n[150-180s] - City skyline illuminated with vibrant, shifting lights reflecting on water surface.  \n- Clouds drift slowly across dark sky above the urban landscape.  \n- Reflections of lights on water show dynamic color changes as buildings' lights pulse.", "history_tokens": 353, "history_utf8_bytes": 1596, "recent_frame_times_s": [170.0068, 171.0078, 172.0088, 173.0098, 174.0108, 175.0118, 176.0128, 177.0138, 178.0148, 179.0158, 180.0168, 181.0178, 182.0188, 183.0198, 184.0208, 185.0218, 186.0228, 187.0238, 188.0248, 189.0258, 190.0268, 191.0278, 192.0288, 193.0298, 194.0308, 195.0318, 196.0328, 197.00043333333332, 198.00143333333332, 199.00243333333333], "recent_frames_sha256": "fba635127dabd9552985b94f0b931df4454568d852e04adf40f57e6991e5adab", "num_recent_frames": 30, "tq": 710448.456061873, "t1": 710449.07437879, "ta": 710449.07437879, "te": 710449.112230432, "first_response_s": 0.618316916981712, "answer_total_s": 0.6561685589840636, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 337, "content_group": "de014850b5e8740dfb9170cc7aa3d87ce878f7454447d61796b406fc0650b861", "question": {"question_id": "sample_337_a1628_q0", "video_id": 337, "video_path": "./videos/sample_337_real.mp4", "annotation_index": 1628, "question_index": 0, "question": "What is the color of the backpack worn by the person in the red shirt?", "options": ["A. Green.", "B. Black.", "C. Purple.", "D. Blue."], "answer": "C", "time_stamp_s": 366, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_337_a1628_q0", "video_id": 337, "time_stamp_s": 366, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8b9d1d569459121ac15726427f34b5ab6eb6448cc3c0e53c7278b7ce2b17374c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [336.00596666666667, 337.00696666666664, 338.0079666666667, 339.00896666666665, 340.0099666666667, 341.01096666666666, 342.0119666666667, 343.01296666666667, 344.01396666666665, 345.0149666666667, 346.01596666666666, 347.0169666666667, 348.01796666666667, 349.01896666666664, 350.0199666666667, 351.02096666666665, 352.0219666666667, 353.02296666666666, 354.0239666666667, 355.02496666666667, 356.02596666666665, 357.0269666666667, 358.02796666666666, 359.0289666666667, 360.02996666666667, 361.03096666666664, 362.0319666666667, 363.03296666666665, 364.0006, 365.0016], "recent_frames_sha256": "810e48534613a3af394e5f313b29f46246e26052d2dbbd28086c6ae6fb995fb8", "num_recent_frames": 30, "tq": 710586.525146189, "t1": 710594.013953991, "ta": 710594.013953991, "te": 710594.051128997, "first_response_s": 7.488807801972143, "answer_total_s": 7.525982807972468, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_337_a1628_q0", "video_id": 337, "time_stamp_s": 366, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "213eb3eaa0975e493ff3a0488d0f0591d8c90989ecc4a301317b0e4a50802473", "condition_order": ["notes", "recent"], "memory": "[0-30s] - City skyline illuminated with colorful lights reflecting on water, with clouds moving slowly across dark sky.  \n- Camera pans left, revealing more buildings and their lights, including a prominent tower with a spire.  \n- Right edge of frame shows part of a structure, possibly a bridge or pier, with warm lighting.\n[30-60s] - City skyline illuminated with vibrant, multicolored lights reflecting on water surface.  \n- Clouds drift slowly across dark sky above the urban landscape.  \n- A prominent tower with a golden spire stands centrally, flanked by other high-rises.\n[60-90s] - City skyline illuminated with vibrant, shifting lights reflecting on water surface.  \n- Clouds drift slowly across dark sky, partially obscuring city lights.  \n- Bright beams of light project from buildings, creating dynamic visual patterns.\n[90-120s] - City skyline illuminated with vibrant lights reflecting on water surface.  \n- Clouds drift slowly across dark sky, partially obscuring city lights.  \n- Bright beams of light project from buildings, creating dynamic visual effects.\n[120-150s] - City skyline illuminated with vibrant, multicolored lights reflecting on the water surface.  \n- A large, fluffy cloud drifts slowly across the dark sky above the city.  \n- Water ripples gently, distorting and shifting the reflections of the city lights.\n[150-180s] - City skyline illuminated with vibrant, shifting lights reflecting on water surface.  \n- Clouds drift slowly across dark sky above the urban landscape.  \n- Reflections of lights on water show dynamic color changes as buildings' lights pulse.\n[180-210s] - City skyline illuminated with vibrant, multicolored lights reflecting on water surface.  \n- Clouds drift slowly across dark sky, partially obscuring city lights.  \n- Camera pans right, revealing more skyscrapers and their glowing facades.\n[210-240s] - City skyline illuminated with vibrant, shifting lights reflecting on water surface.  \n- Clouds drift slowly across dark sky above the urban landscape.  \n- Water ripples gently, distorting and mirroring the colorful lights from buildings.\n[240-270s] - City skyline illuminated with vibrant lights reflecting on water surface.  \n- Clouds drift slowly across dark sky above the urban landscape.  \n- Water ripples subtly, mirroring the dynamic glow of buildings.\n[270-300s] - City skyline illuminated with vibrant lights reflecting on water surface.  \n- Clouds drift slowly across dark sky, casting subtle shadows over buildings.  \n- Bright beams of light project from buildings toward the sky, creating dynamic visual effects.\n[300-330s] - A bright green laser beam sweeps across the skyline from left to right, illuminating the night sky.  \n- The camera pans slightly to the right, revealing more of the illuminated cityscape and the water’s reflective surface.  \n- A portion of a boat’s interior, with warm lighting and passengers, is visible on the right side of the frame.\n[330-360s] - A tall, illuminated clock tower stands prominently in a crowded outdoor area at night, with people walking around it.  \n- The camera pans to show a bustling pedestrian area under an overhead structure, with individuals moving in various directions.  \n- A group of people, including a man in a white t-shirt and a woman in a striped top, are seen walking together, with some holding phones or bags.", "history_tokens": 747, "history_utf8_bytes": 3350, "recent_frame_times_s": [336.00596666666667, 337.00696666666664, 338.0079666666667, 339.00896666666665, 340.0099666666667, 341.01096666666666, 342.0119666666667, 343.01296666666667, 344.01396666666665, 345.0149666666667, 346.01596666666666, 347.0169666666667, 348.01796666666667, 349.01896666666664, 350.0199666666667, 351.02096666666665, 352.0219666666667, 353.02296666666666, 354.0239666666667, 355.02496666666667, 356.02596666666665, 357.0269666666667, 358.02796666666666, 359.0289666666667, 360.02996666666667, 361.03096666666664, 362.0319666666667, 363.03296666666665, 364.0006, 365.0016], "recent_frames_sha256": "810e48534613a3af394e5f313b29f46246e26052d2dbbd28086c6ae6fb995fb8", "num_recent_frames": 30, "tq": 710496.991810169, "t1": 710506.31989259, "ta": 710506.31989259, "te": 710506.357246991, "first_response_s": 9.328082421096042, "answer_total_s": 9.365436822059564, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 337, "content_group": "de014850b5e8740dfb9170cc7aa3d87ce878f7454447d61796b406fc0650b861", "question": {"question_id": "sample_337_a1629_q0", "video_id": 337, "video_path": "./videos/sample_337_real.mp4", "annotation_index": 1629, "question_index": 0, "question": "What kind of atmosphere is depicted in the video?", "options": ["A. Calm and quiet.", "B. Lively and bustling.", "C. Tense and stressful.", "D. Serene and peaceful."], "answer": "B", "time_stamp_s": 559, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "city_walk", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_337_a1629_q0", "video_id": 337, "time_stamp_s": 559, "ground_truth": "B", "raw_output": "B. Lively and bustling.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "0c36ed6223ee11304a9ac666b4765f069e16979e8eb74cd15bd98c2850249150", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [529.0321333333334, 530.0331333333334, 531.0007666666667, 532.0017666666666, 533.0027666666666, 534.0037666666667, 535.0047666666667, 536.0057666666667, 537.0067666666666, 538.0077666666666, 539.0087666666667, 540.0097666666667, 541.0107666666667, 542.0117666666666, 543.0127666666667, 544.0137666666667, 545.0147666666667, 546.0157666666667, 547.0167666666666, 548.0177666666667, 549.0187666666667, 550.0197666666667, 551.0207666666666, 552.0217666666666, 553.0227666666667, 554.0237666666667, 555.0247666666667, 556.0257666666666, 557.0267666666666, 558.0277666666667], "recent_frames_sha256": "7da45a9cefdb9c986479ef05d08cf9812671353ddb92f0cd0837c54ac3847bb6", "num_recent_frames": 30, "tq": 710594.065824786, "t1": 710602.675086981, "ta": 710602.675086981, "te": 710602.932788287, "first_response_s": 8.609262195066549, "answer_total_s": 8.866963501088321, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_337_a1629_q0", "video_id": 337, "time_stamp_s": 559, "ground_truth": "B", "raw_output": "B. Lively and bustling.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "e3b3d08332040cb6c33825003922d1f7a4716607f700b4c916496e25a4fb9302", "condition_order": ["notes", "recent"], "memory": "[120-150s] - City skyline illuminated with vibrant, multicolored lights reflecting on the water surface.  \n- A large, fluffy cloud drifts slowly across the dark sky above the city.  \n- Water ripples gently, distorting and shifting the reflections of the city lights.\n[150-180s] - City skyline illuminated with vibrant, shifting lights reflecting on water surface.  \n- Clouds drift slowly across dark sky above the urban landscape.  \n- Reflections of lights on water show dynamic color changes as buildings' lights pulse.\n[180-210s] - City skyline illuminated with vibrant, multicolored lights reflecting on water surface.  \n- Clouds drift slowly across dark sky, partially obscuring city lights.  \n- Camera pans right, revealing more skyscrapers and their glowing facades.\n[210-240s] - City skyline illuminated with vibrant, shifting lights reflecting on water surface.  \n- Clouds drift slowly across dark sky above the urban landscape.  \n- Water ripples gently, distorting and mirroring the colorful lights from buildings.\n[240-270s] - City skyline illuminated with vibrant lights reflecting on water surface.  \n- Clouds drift slowly across dark sky above the urban landscape.  \n- Water ripples subtly, mirroring the dynamic glow of buildings.\n[270-300s] - City skyline illuminated with vibrant lights reflecting on water surface.  \n- Clouds drift slowly across dark sky, casting subtle shadows over buildings.  \n- Bright beams of light project from buildings toward the sky, creating dynamic visual effects.\n[300-330s] - A bright green laser beam sweeps across the skyline from left to right, illuminating the night sky.  \n- The camera pans slightly to the right, revealing more of the illuminated cityscape and the water’s reflective surface.  \n- A portion of a boat’s interior, with warm lighting and passengers, is visible on the right side of the frame.\n[330-360s] - A tall, illuminated clock tower stands prominently in a crowded outdoor area at night, with people walking around it.  \n- The camera pans to show a bustling pedestrian area under an overhead structure, with individuals moving in various directions.  \n- A group of people, including a man in a white t-shirt and a woman in a striped top, are seen walking together, with some holding phones or bags.\n[360-390s] - A man in a red shirt and black shorts walks away from the camera, carrying a purple backpack.  \n- A group of people, including a woman in a pink dress and a man in a plaid shirt, walk toward a green and white entrance marked \"MTR\".  \n- The area is covered by a metal roof with fluorescent lights, and various signs and kiosks are visible along the walkway.\n[390-420s] - A woman in a pink patterned top walks toward the camera, carrying a white bag.  \n- People are seen walking in both directions along a covered walkway with shops and stalls.  \n- A bus is visible in the distance, parked or moving along the street beyond the walkway.\n[420-450s] - A blue overhead sign displays \"To Wan Chai\" and \"To Central\" with directional arrows, indicating train station platforms.  \n- People walk along a covered walkway with yellow safety lines, some carrying bags or wearing casual attire.  \n- Shops and kiosks line the left side, with some closed shutters visible, while others remain open with illuminated displays.\n[450-480s] - People walk through a brightly lit indoor market with stalls displaying colorful goods and a McDonald's sign visible.  \n- A man in a blue shirt pushes a shopping cart past a stall with stacked red boxes.  \n- The camera pans right, revealing more shoppers and a large open area with blue support pillars and distant storefronts.\n[480-510s] - A man in a blue shirt and face mask holds a phone and a yellow bag while walking along the sidewalk.  \n- A group of people, including some in pink shirts, are gathered near a McDonald's restaurant, with some standing in line.  \n- The scene is set at night, with bright neon signs from shops and buildings illuminating the street and a river visible in the background.\n[510-540s] - A large illuminated screen displays bright white light, attracting a crowd of people gathered around it.  \n- A McDonald's sign is visible on a building to the left, with pedestrians walking past it.  \n- People are seen moving in various directions, some carrying bags or looking at their phones, near a tree and streetlights.", "history_tokens": 1001, "history_utf8_bytes": 4357, "recent_frame_times_s": [529.0321333333334, 530.0331333333334, 531.0007666666667, 532.0017666666666, 533.0027666666666, 534.0037666666667, 535.0047666666667, 536.0057666666667, 537.0067666666666, 538.0077666666666, 539.0087666666667, 540.0097666666667, 541.0107666666667, 542.0117666666666, 543.0127666666667, 544.0137666666667, 545.0147666666667, 546.0157666666667, 547.0167666666666, 548.0177666666667, 549.0187666666667, 550.0197666666667, 551.0207666666666, 552.0217666666666, 553.0227666666667, 554.0237666666667, 555.0247666666667, 556.0257666666666, 557.0267666666666, 558.0277666666667], "recent_frames_sha256": "7da45a9cefdb9c986479ef05d08cf9812671353ddb92f0cd0837c54ac3847bb6", "num_recent_frames": 30, "tq": 710557.038484733, "t1": 710562.234069753, "ta": 710562.234069753, "te": 710562.49249655, "first_response_s": 5.195585020002909, "answer_total_s": 5.454011816997081, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 337, "content_group": "de014850b5e8740dfb9170cc7aa3d87ce878f7454447d61796b406fc0650b861", "question": {"question_id": "sample_337_a1629_q1", "video_id": 337, "video_path": "./videos/sample_337_real.mp4", "annotation_index": 1629, "question_index": 1, "question": "What is located to the left of the pedestrian pathway?", "options": ["A. A large digital billboard.", "B. Bright advertisements for brands.", "C. A row of slender vertical poles supporting an overhead structure.", "D. A water fountain."], "answer": "C", "time_stamp_s": 559, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "city_walk", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_337_a1629_q1", "video_id": 337, "time_stamp_s": 559, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "50207026d8c1093c3d27db2d8ff7b0138a2c076fc4f75fc276f6ec38be86cb60", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [529.0321333333334, 530.0331333333334, 531.0007666666667, 532.0017666666666, 533.0027666666666, 534.0037666666667, 535.0047666666667, 536.0057666666667, 537.0067666666666, 538.0077666666666, 539.0087666666667, 540.0097666666667, 541.0107666666667, 542.0117666666666, 543.0127666666667, 544.0137666666667, 545.0147666666667, 546.0157666666667, 547.0167666666666, 548.0177666666667, 549.0187666666667, 550.0197666666667, 551.0207666666666, 552.0217666666666, 553.0227666666667, 554.0237666666667, 555.0247666666667, 556.0257666666666, 557.0267666666666, 558.0277666666667], "recent_frames_sha256": "7da45a9cefdb9c986479ef05d08cf9812671353ddb92f0cd0837c54ac3847bb6", "num_recent_frames": 30, "tq": 710602.947286171, "t1": 710617.062615597, "ta": 710617.062615597, "te": 710617.100178418, "first_response_s": 14.115329426014796, "answer_total_s": 14.1528922469588, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_337_a1629_q1", "video_id": 337, "time_stamp_s": 559, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "18b8eef0d7881967a5d34a8d51c81b727e8c63e4fcc8d0c6a3ebd9b83f85557d", "condition_order": ["notes", "recent"], "memory": "[120-150s] - City skyline illuminated with vibrant, multicolored lights reflecting on the water surface.  \n- A large, fluffy cloud drifts slowly across the dark sky above the city.  \n- Water ripples gently, distorting and shifting the reflections of the city lights.\n[150-180s] - City skyline illuminated with vibrant, shifting lights reflecting on water surface.  \n- Clouds drift slowly across dark sky above the urban landscape.  \n- Reflections of lights on water show dynamic color changes as buildings' lights pulse.\n[180-210s] - City skyline illuminated with vibrant, multicolored lights reflecting on water surface.  \n- Clouds drift slowly across dark sky, partially obscuring city lights.  \n- Camera pans right, revealing more skyscrapers and their glowing facades.\n[210-240s] - City skyline illuminated with vibrant, shifting lights reflecting on water surface.  \n- Clouds drift slowly across dark sky above the urban landscape.  \n- Water ripples gently, distorting and mirroring the colorful lights from buildings.\n[240-270s] - City skyline illuminated with vibrant lights reflecting on water surface.  \n- Clouds drift slowly across dark sky above the urban landscape.  \n- Water ripples subtly, mirroring the dynamic glow of buildings.\n[270-300s] - City skyline illuminated with vibrant lights reflecting on water surface.  \n- Clouds drift slowly across dark sky, casting subtle shadows over buildings.  \n- Bright beams of light project from buildings toward the sky, creating dynamic visual effects.\n[300-330s] - A bright green laser beam sweeps across the skyline from left to right, illuminating the night sky.  \n- The camera pans slightly to the right, revealing more of the illuminated cityscape and the water’s reflective surface.  \n- A portion of a boat’s interior, with warm lighting and passengers, is visible on the right side of the frame.\n[330-360s] - A tall, illuminated clock tower stands prominently in a crowded outdoor area at night, with people walking around it.  \n- The camera pans to show a bustling pedestrian area under an overhead structure, with individuals moving in various directions.  \n- A group of people, including a man in a white t-shirt and a woman in a striped top, are seen walking together, with some holding phones or bags.\n[360-390s] - A man in a red shirt and black shorts walks away from the camera, carrying a purple backpack.  \n- A group of people, including a woman in a pink dress and a man in a plaid shirt, walk toward a green and white entrance marked \"MTR\".  \n- The area is covered by a metal roof with fluorescent lights, and various signs and kiosks are visible along the walkway.\n[390-420s] - A woman in a pink patterned top walks toward the camera, carrying a white bag.  \n- People are seen walking in both directions along a covered walkway with shops and stalls.  \n- A bus is visible in the distance, parked or moving along the street beyond the walkway.\n[420-450s] - A blue overhead sign displays \"To Wan Chai\" and \"To Central\" with directional arrows, indicating train station platforms.  \n- People walk along a covered walkway with yellow safety lines, some carrying bags or wearing casual attire.  \n- Shops and kiosks line the left side, with some closed shutters visible, while others remain open with illuminated displays.\n[450-480s] - People walk through a brightly lit indoor market with stalls displaying colorful goods and a McDonald's sign visible.  \n- A man in a blue shirt pushes a shopping cart past a stall with stacked red boxes.  \n- The camera pans right, revealing more shoppers and a large open area with blue support pillars and distant storefronts.\n[480-510s] - A man in a blue shirt and face mask holds a phone and a yellow bag while walking along the sidewalk.  \n- A group of people, including some in pink shirts, are gathered near a McDonald's restaurant, with some standing in line.  \n- The scene is set at night, with bright neon signs from shops and buildings illuminating the street and a river visible in the background.\n[510-540s] - A large illuminated screen displays bright white light, attracting a crowd of people gathered around it.  \n- A McDonald's sign is visible on a building to the left, with pedestrians walking past it.  \n- People are seen moving in various directions, some carrying bags or looking at their phones, near a tree and streetlights.", "history_tokens": 1001, "history_utf8_bytes": 4357, "recent_frame_times_s": [529.0321333333334, 530.0331333333334, 531.0007666666667, 532.0017666666666, 533.0027666666666, 534.0037666666667, 535.0047666666667, 536.0057666666667, 537.0067666666666, 538.0077666666666, 539.0087666666667, 540.0097666666667, 541.0107666666667, 542.0117666666666, 543.0127666666667, 544.0137666666667, 545.0147666666667, 546.0157666666667, 547.0167666666666, 548.0177666666667, 549.0187666666667, 550.0197666666667, 551.0207666666666, 552.0217666666666, 553.0227666666667, 554.0237666666667, 555.0247666666667, 556.0257666666666, 557.0267666666666, 558.0277666666667], "recent_frames_sha256": "7da45a9cefdb9c986479ef05d08cf9812671353ddb92f0cd0837c54ac3847bb6", "num_recent_frames": 30, "tq": 710562.515766679, "t1": 710573.673709786, "ta": 710573.673709786, "te": 710573.973406701, "first_response_s": 11.157943107071333, "answer_total_s": 11.457640022039413, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 339, "content_group": "a10449004e5387cf3aadc6334dac247dcae51517cbaebddee595b9b5e1c75fca", "question": {"question_id": "sample_339_a1416_q0", "video_id": 339, "video_path": "./videos/sample_339_real.mp4", "annotation_index": 1416, "question_index": 0, "question": "What did the individual do just now?", "options": ["A. The individual washed their hands, applied hand sanitizer, and dried their hands with a towel.", "B. The individual washed their hands, used a dryer, and sanitized the sink.", "C. The individual washed their hands, dried them with paper towels, and disposed of the towels.", "D. The individual prepared food, cleaned the sink, and disposed of trash."], "answer": "C", "time_stamp_s": 14, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_339_a1416_q0", "video_id": 339, "time_stamp_s": 14, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8b51977cc8eb5307fab074b4c18ad23811d37b6f1c264f2b32cd72539f996b55", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013], "recent_frames_sha256": "929372a9b46ec9401bbe732011f89f93e1b936995b8c6237353517e379a01351", "num_recent_frames": 14, "tq": 710246.556397248, "t1": 710253.673043745, "ta": 710253.673043745, "te": 710253.711404037, "first_response_s": 7.116646497044712, "answer_total_s": 7.155006789020263, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_339_a1416_q0", "video_id": 339, "time_stamp_s": 14, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c4abe8b2ac7fd709ecf03af1c7b077e335f8d4f0b2806a0bbff03b94307c18e8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013], "recent_frames_sha256": "929372a9b46ec9401bbe732011f89f93e1b936995b8c6237353517e379a01351", "num_recent_frames": 14, "tq": 710297.043950209, "t1": 710298.094722147, "ta": 710298.094722147, "te": 710298.131793145, "first_response_s": 1.050771937938407, "answer_total_s": 1.0878429359290749, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 339, "content_group": "a10449004e5387cf3aadc6334dac247dcae51517cbaebddee595b9b5e1c75fca", "question": {"question_id": "sample_339_a1417_q0", "video_id": 339, "video_path": "./videos/sample_339_real.mp4", "annotation_index": 1417, "question_index": 0, "question": "Which of the following options best summarizes the content of the video just now?", "options": ["A. The individual pressed and stretched pizza dough into a baking pan, ensuring it was evenly spread.", "B. The individual prepared a salad, adding various toppings and dressing.", "C. The individual assembled a sandwich, layering different meats and cheeses.", "D. The individual applied sauce and added cheese to a cooked pizza crust."], "answer": "A", "time_stamp_s": 88, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [78, 88], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_339_a1417_q0", "video_id": 339, "time_stamp_s": 88, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9f0d5dbf6ba8d2cb82d37acf289f08d3837561a84518f8c049dfe3703e900377", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [58.00795, 59.00895, 60.00995, 61.01095, 62.01195, 63.01295, 64.01395, 65.01495, 66.01595, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334], "recent_frames_sha256": "44985b9f6812161f2bde4e6ce1af65de24ac7c5de911d3124876ab585fb55178", "num_recent_frames": 30, "tq": 710253.727503285, "t1": 710260.612368492, "ta": 710260.612368492, "te": 710260.649826804, "first_response_s": 6.884865206899121, "answer_total_s": 6.922323518898338, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_339_a1417_q0", "video_id": 339, "time_stamp_s": 88, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "641aa71e46364e95bec7650760513ce0558c85874c7ef33a9a1c117210fb1423", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person washes hands under a sink faucet, then dries them with a paper towel.  \n- Person picks up a blue tray holding five round dough balls from a stack of similar trays.  \n- Person places the tray into a stainless steel appliance, likely a dough mixer or proofing unit.\n[30-60s] - Hands flatten dough in a metal pan, then transfer it to a blue tray.  \n- A person places a round dough piece into a metal pan, pressing it down.  \n- Two empty metal pans are placed on the counter, one with a small red object nearby.", "history_tokens": 130, "history_utf8_bytes": 524, "recent_frame_times_s": [58.00795, 59.00895, 60.00995, 61.01095, 62.01195, 63.01295, 64.01395, 65.01495, 66.01595, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334], "recent_frames_sha256": "44985b9f6812161f2bde4e6ce1af65de24ac7c5de911d3124876ab585fb55178", "num_recent_frames": 30, "tq": 710320.613719047, "t1": 710326.749073575, "ta": 710326.749073575, "te": 710326.787285377, "first_response_s": 6.135354527970776, "answer_total_s": 6.173566329991445, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 339, "content_group": "a10449004e5387cf3aadc6334dac247dcae51517cbaebddee595b9b5e1c75fca", "question": {"question_id": "sample_339_a1418_q0", "video_id": 339, "video_path": "./videos/sample_339_real.mp4", "annotation_index": 1418, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual washed and stored kitchen utensils in a cabinet.", "B. The individual opened a tray to reveal dough balls, adjusted them, and he took one out and put flour on it.", "C. The individual prepared a pizza by adding toppings and placing it in the oven.", "D. The individual chopped vegetables and placed them in a container."], "answer": "B", "time_stamp_s": 166, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [156, 166], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_339_a1418_q0", "video_id": 339, "time_stamp_s": 166, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0a7dcb6428b73d5ef3aac8feba9215f66a6984abe3140f8a94fec479bba9e0e4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485], "recent_frames_sha256": "ae67e9923063f1b13bafac946874fb563f1e1520126a13a70700330eb5daa06a", "num_recent_frames": 30, "tq": 710260.661755076, "t1": 710272.898016295, "ta": 710272.898016295, "te": 710272.935181946, "first_response_s": 12.23626121901907, "answer_total_s": 12.273426870000549, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_339_a1418_q0", "video_id": 339, "time_stamp_s": 166, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6108c04040f3e604a80041c5e344689e3da40a72ae1ee599021695c7420e881d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person washes hands under a sink faucet, then dries them with a paper towel.  \n- Person picks up a blue tray holding five round dough balls from a stack of similar trays.  \n- Person places the tray into a stainless steel appliance, likely a dough mixer or proofing unit.\n[30-60s] - Hands flatten dough in a metal pan, then transfer it to a blue tray.  \n- A person places a round dough piece into a metal pan, pressing it down.  \n- Two empty metal pans are placed on the counter, one with a small red object nearby.\n[60-90s] - Hands press and stretch dough in a round metal pan, ensuring even thickness.  \n- A bottle of yellow sauce is held nearby, suggesting imminent application.  \n- Stainless steel counter holds multiple pans, some with prepped ingredients like cheese and sauce.\n[90-120s] - Person's hands press and adjust dough in a round metal pan, ensuring even distribution.  \n- Another identical pan with dough is visible nearby, suggesting preparation for multiple pizzas.  \n- The person moves the pan toward an oven or baking rack, indicating next step in baking process.\n[120-150s] - Hands place a round pizza dough into a metal pan on a stainless steel counter.  \n- Another hand adds shredded cheese over the dough in a separate pan.  \n- A stack of blue plastic trays is lifted and moved to a different area of the kitchen.", "history_tokens": 315, "history_utf8_bytes": 1346, "recent_frame_times_s": [136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485], "recent_frames_sha256": "ae67e9923063f1b13bafac946874fb563f1e1520126a13a70700330eb5daa06a", "num_recent_frames": 30, "tq": 710347.334852678, "t1": 710354.510104545, "ta": 710354.510104545, "te": 710354.771616787, "first_response_s": 7.1752518670400605, "answer_total_s": 7.43676410894841, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 339, "content_group": "a10449004e5387cf3aadc6334dac247dcae51517cbaebddee595b9b5e1c75fca", "question": {"question_id": "sample_339_a1419_q0", "video_id": 339, "video_path": "./videos/sample_339_real.mp4", "annotation_index": 1419, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual was preparing a sandwich, adding vegetables and condiments.", "B. The individual was slicing vegetables and arranging them on a platter.", "C. The individual was chopping toppings and placing them in separate containers.", "D. The individual was placing pepperoni slices on a pizza and then moving it aside."], "answer": "D", "time_stamp_s": 244, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [234, 244], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_339_a1419_q0", "video_id": 339, "time_stamp_s": 244, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7fb9d9bd21805bfa71563ee3a1471854dc66253c464bd9ec7c57401d19ac8750", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [214.0138, 215.0148, 216.0158, 217.00011666666666, 218.00111666666666, 219.00211666666667, 220.00311666666667, 221.00411666666668, 222.00511666666668, 223.00611666666666, 224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333], "recent_frames_sha256": "351b02e40c50d47946fb1b96e96eaeb0b17018c82888fda57403cab7985fe0b6", "num_recent_frames": 30, "tq": 710272.943252445, "t1": 710284.484144745, "ta": 710284.484144745, "te": 710284.521536484, "first_response_s": 11.540892300079577, "answer_total_s": 11.578284039045684, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_339_a1419_q0", "video_id": 339, "time_stamp_s": 244, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6e8180baedd1e99e05efd16b30cb55adf595198f846e226a7b330269ea676748", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person washes hands under a sink faucet, then dries them with a paper towel.  \n- Person picks up a blue tray holding five round dough balls from a stack of similar trays.  \n- Person places the tray into a stainless steel appliance, likely a dough mixer or proofing unit.\n[30-60s] - Hands flatten dough in a metal pan, then transfer it to a blue tray.  \n- A person places a round dough piece into a metal pan, pressing it down.  \n- Two empty metal pans are placed on the counter, one with a small red object nearby.\n[60-90s] - Hands press and stretch dough in a round metal pan, ensuring even thickness.  \n- A bottle of yellow sauce is held nearby, suggesting imminent application.  \n- Stainless steel counter holds multiple pans, some with prepped ingredients like cheese and sauce.\n[90-120s] - Person's hands press and adjust dough in a round metal pan, ensuring even distribution.  \n- Another identical pan with dough is visible nearby, suggesting preparation for multiple pizzas.  \n- The person moves the pan toward an oven or baking rack, indicating next step in baking process.\n[120-150s] - Hands place a round pizza dough into a metal pan on a stainless steel counter.  \n- Another hand adds shredded cheese over the dough in a separate pan.  \n- A stack of blue plastic trays is lifted and moved to a different area of the kitchen.\n[150-180s] - Hands lift a blue tray with dough pieces and a white spatula, revealing stacked trays beneath.  \n- A hand removes a tray lid, exposing multiple dough pieces inside.  \n- Dough is flattened on a floured metal surface, with hands pressing and spreading it.\n[180-210s] - Hands stretch and flip dough on a floured metal surface, then place it onto a perforated pizza pan.  \n- A second hand, with a tattoo, assists in positioning the dough, while a container of red sauce is nearby.  \n- The dough is then spread with sauce using a spoon, preparing it for toppings.\n[210-240s] - Hands spread tomato sauce evenly over a round pizza dough on a metal tray.  \n- Pizza is then placed on a wire rack above a baking surface, with toppings like pepperoni and cheese added.  \n- Toppings are distributed across the pizza surface, covering the sauce layer.", "history_tokens": 522, "history_utf8_bytes": 2198, "recent_frame_times_s": [214.0138, 215.0148, 216.0158, 217.00011666666666, 218.00111666666666, 219.00211666666667, 220.00311666666667, 221.00411666666668, 222.00511666666668, 223.00611666666666, 224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333], "recent_frames_sha256": "351b02e40c50d47946fb1b96e96eaeb0b17018c82888fda57403cab7985fe0b6", "num_recent_frames": 30, "tq": 710377.141285908, "t1": 710384.968350946, "ta": 710384.968350946, "te": 710385.330086008, "first_response_s": 7.8270650380291045, "answer_total_s": 8.1888001000043, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 339, "content_group": "a10449004e5387cf3aadc6334dac247dcae51517cbaebddee595b9b5e1c75fca", "question": {"question_id": "sample_339_a1420_q0", "video_id": 339, "video_path": "./videos/sample_339_real.mp4", "annotation_index": 1420, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual prepared a pizza by adding toppings and placing it in the oven.", "B. The individual was pressing and stretching pizza dough inside a baking pan.", "C. The individual was washing kitchen utensils and placing them in a drying rack.", "D. The individual was organizing ingredients in the refrigerator for future use."], "answer": "B", "time_stamp_s": 320, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [312, 322], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_339_a1420_q0", "video_id": 339, "time_stamp_s": 320, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bbaf78570a278fe2ce8c4a6256f88b878715400a3b1c9e80c54914f1122df02b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [290.00638333333336, 291.00738333333334, 292.0083833333333, 293.00938333333335, 294.0103833333333, 295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333, 300.01638333333335, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0000166666667, 318.00101666666666, 319.0020166666667], "recent_frames_sha256": "5179bc2ae0e141e1830c85790ccf4138926458c0467b02101dbae059cbe3c89e", "num_recent_frames": 30, "tq": 710284.529675172, "t1": 710297.006107267, "ta": 710297.006107267, "te": 710297.038687433, "first_response_s": 12.47643209504895, "answer_total_s": 12.509012261056341, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_339_a1420_q0", "video_id": 339, "time_stamp_s": 320, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5e44410aab5d90c42277a3cf6358a680968733e22d54361e42b868df9f3cb7b4", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person washes hands under a sink faucet, then dries them with a paper towel.  \n- Person picks up a blue tray holding five round dough balls from a stack of similar trays.  \n- Person places the tray into a stainless steel appliance, likely a dough mixer or proofing unit.\n[30-60s] - Hands flatten dough in a metal pan, then transfer it to a blue tray.  \n- A person places a round dough piece into a metal pan, pressing it down.  \n- Two empty metal pans are placed on the counter, one with a small red object nearby.\n[60-90s] - Hands press and stretch dough in a round metal pan, ensuring even thickness.  \n- A bottle of yellow sauce is held nearby, suggesting imminent application.  \n- Stainless steel counter holds multiple pans, some with prepped ingredients like cheese and sauce.\n[90-120s] - Person's hands press and adjust dough in a round metal pan, ensuring even distribution.  \n- Another identical pan with dough is visible nearby, suggesting preparation for multiple pizzas.  \n- The person moves the pan toward an oven or baking rack, indicating next step in baking process.\n[120-150s] - Hands place a round pizza dough into a metal pan on a stainless steel counter.  \n- Another hand adds shredded cheese over the dough in a separate pan.  \n- A stack of blue plastic trays is lifted and moved to a different area of the kitchen.\n[150-180s] - Hands lift a blue tray with dough pieces and a white spatula, revealing stacked trays beneath.  \n- A hand removes a tray lid, exposing multiple dough pieces inside.  \n- Dough is flattened on a floured metal surface, with hands pressing and spreading it.\n[180-210s] - Hands stretch and flip dough on a floured metal surface, then place it onto a perforated pizza pan.  \n- A second hand, with a tattoo, assists in positioning the dough, while a container of red sauce is nearby.  \n- The dough is then spread with sauce using a spoon, preparing it for toppings.\n[210-240s] - Hands spread tomato sauce evenly over a round pizza dough on a metal tray.  \n- Pizza is then placed on a wire rack above a baking surface, with toppings like pepperoni and cheese added.  \n- Toppings are distributed across the pizza surface, covering the sauce layer.\n[240-270s] - Hands sprinkle shredded cheese over a pizza base covered in sauce and pepperoni.  \n- A second pizza is prepared simultaneously, with sauce spread and cheese added.  \n- Both pizzas are placed on a metal rack in a commercial kitchen setting.\n[270-300s] - Pizza with tomato sauce and toppings is placed on a metal rack in a commercial kitchen.  \n- A hand uses a spatula to spread sauce on a pizza dough in a round metal pan.  \n- A metal pan is being greased with oil, preparing for another pizza.", "history_tokens": 646, "history_utf8_bytes": 2705, "recent_frame_times_s": [290.00638333333336, 291.00738333333334, 292.0083833333333, 293.00938333333335, 294.0103833333333, 295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333, 300.01638333333335, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0000166666667, 318.00101666666666, 319.0020166666667], "recent_frames_sha256": "5179bc2ae0e141e1830c85790ccf4138926458c0467b02101dbae059cbe3c89e", "num_recent_frames": 30, "tq": 710403.09249447, "t1": 710409.513236994, "ta": 710409.513236994, "te": 710409.759063549, "first_response_s": 6.420742524089292, "answer_total_s": 6.666569079039618, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 340, "content_group": "4ad4f99fd8d0d1c201175b5c12ee7faa5ea2a365ed79436fc06fae1171291f70", "question": {"question_id": "sample_340_a2177_q0", "video_id": 340, "video_path": "./videos/sample_340_real.mp4", "annotation_index": 2177, "question_index": 0, "question": "What is the best summary of the actions taken by the individual just now?", "options": ["A. The individual sliced fresh vegetables, seasoned them, and placed them on a grill.", "B. The individual carefully unwrapped a pair of gloves, stretched them open, and began putting them on.", "C. The individual assembled the necessary ingredients for a sandwich and started layering them.", "D. The individual cleaned a work surface, arranged cooking utensils, and prepared a workstation."], "answer": "B", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_340_a2177_q0", "video_id": 340, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0d5954099ac1502fc9f734f5b7977422adcb2283a50d06f713dff0d5fb238813", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "7bcccae54ff701f449bfd6ef216287fef870d416cd4b8d450a8636a2fc99c0ce", "num_recent_frames": 10, "tq": 719325.370734961, "t1": 719331.602815231, "ta": 719331.602815231, "te": 719331.640132362, "first_response_s": 6.232080269954167, "answer_total_s": 6.269397401018068, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_340_a2177_q0", "video_id": 340, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e2b17b67f4d44fe0708d7b680591df2d2ed3e9828b025ab28186de0279cfde12", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "7bcccae54ff701f449bfd6ef216287fef870d416cd4b8d450a8636a2fc99c0ce", "num_recent_frames": 10, "tq": 719155.53550231, "t1": 719166.121901921, "ta": 719166.121901921, "te": 719166.159366913, "first_response_s": 10.586399610969238, "answer_total_s": 10.623864602996036, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 340, "content_group": "4ad4f99fd8d0d1c201175b5c12ee7faa5ea2a365ed79436fc06fae1171291f70", "question": {"question_id": "sample_340_a2178_q0", "video_id": 340, "video_path": "./videos/sample_340_real.mp4", "annotation_index": 2178, "question_index": 0, "question": "What best summarizes the actions taken by the individual just now?", "options": ["A. The individual gathered various vegetables, chopped them, and prepared a salad.", "B. The individual picked up a hamburger patty, grilled it, and assembled a cheeseburger.", "C. The individual took a hot dog from the water, placed it in a bun, and added sauerkraut.", "D. The individual prepared a pasta dish by boiling noodles, adding sauce, and serving it in a bowl."], "answer": "C", "time_stamp_s": 133, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [123, 133], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_340_a2178_q0", "video_id": 340, "time_stamp_s": 133, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "75499e7cb76ab95fa25902454824c025190801ea828b7be6fb6e9bb9613cef6c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319], "recent_frames_sha256": "83c5a5bac9f88a89661d7c470e1baac3904d907faa27c74e59630f6c3ca191d7", "num_recent_frames": 30, "tq": 719331.654222992, "t1": 719342.628996058, "ta": 719342.628996058, "te": 719342.851203288, "first_response_s": 10.974773066001944, "answer_total_s": 11.196980295935646, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_340_a2178_q0", "video_id": 340, "time_stamp_s": 133, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "249bee99e63d95e098407de02553f7a490e7ae6af950538262cd6863ac2646c2", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person dons black gloves while handling a white cloth near a stainless steel food prep station.  \n- They wipe down the station’s surface, then move to a nearby counter with various food items and utensils.  \n- The person’s feet are visible on a red-and-white checkered floor, and they are wearing white sneakers and blue jeans.\n[30-60s] - Person wearing gloves places carrots into a metal tray on a stainless steel counter.  \n- A hot dog bun is picked up and held near a tray containing carrots.  \n- The person moves a metal lid to reveal a tray with carrots, then places the lid back.\n[60-90s] - Hand holds hot dog bun with visible toppings, while other hand uses black glove to scoop condiments from metal trays.  \n- Condiment trays are arranged in a row, with one tray containing a light-colored grainy substance and another holding a dark, chunky sauce.  \n- The worker’s gloved hand moves between trays, suggesting preparation for assembling the hot dog.\n[90-120s] - A gloved hand places a hot dog with toppings onto a paper wrapper, then wraps it in foil.  \n- The hand moves to a nearby station, picking up a brown paper bag and placing the wrapped hot dog inside.  \n- The scene shifts to a stainless steel counter with various food containers, and the hand reaches for a foil-wrapped item near a yellow container.", "history_tokens": 307, "history_utf8_bytes": 1335, "recent_frame_times_s": [103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319], "recent_frames_sha256": "83c5a5bac9f88a89661d7c470e1baac3904d907faa27c74e59630f6c3ca191d7", "num_recent_frames": 30, "tq": 719201.935677433, "t1": 719208.500523847, "ta": 719208.500523847, "te": 719208.542483767, "first_response_s": 6.564846413908526, "answer_total_s": 6.606806333991699, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 340, "content_group": "4ad4f99fd8d0d1c201175b5c12ee7faa5ea2a365ed79436fc06fae1171291f70", "question": {"question_id": "sample_340_a2179_q0", "video_id": 340, "video_path": "./videos/sample_340_real.mp4", "annotation_index": 2179, "question_index": 0, "question": "What best summarizes the actions taken by the individual just now?", "options": ["A. The individual placed a hot dog in a bun, added onions and peppers, wrapped it in paper, and placed it aside.", "B. The individual assembled a hamburger with cheese, lettuce, and tomatoes, wrapped it, and handed it to a customer.", "C. The individual prepared a burrito with beans and rice, wrapped it, and placed it in a serving tray.", "D. The individual made a salad by chopping vegetables, adding dressing, and setting it on a counter."], "answer": "A", "time_stamp_s": 256, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [246, 256], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_340_a2179_q0", "video_id": 340, "time_stamp_s": 256, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4fb2824f3abb2ae3df6933ca479785cef76ef6241d388d1f8715e6e5d66797fc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333], "recent_frames_sha256": "4c7ecd3b82b8c3a152042246cf9a853a02b543207fa0587fc3a04342582019c4", "num_recent_frames": 30, "tq": 719342.873790291, "t1": 719351.05579519, "ta": 719351.05579519, "te": 719351.095675084, "first_response_s": 8.182004899019375, "answer_total_s": 8.221884793019854, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_340_a2179_q0", "video_id": 340, "time_stamp_s": 256, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "66540f88b64d97ba68e480728c5a16385f11731a79f5840ed8493e808a464e72", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person dons black gloves while handling a white cloth near a stainless steel food prep station.  \n- They wipe down the station’s surface, then move to a nearby counter with various food items and utensils.  \n- The person’s feet are visible on a red-and-white checkered floor, and they are wearing white sneakers and blue jeans.\n[30-60s] - Person wearing gloves places carrots into a metal tray on a stainless steel counter.  \n- A hot dog bun is picked up and held near a tray containing carrots.  \n- The person moves a metal lid to reveal a tray with carrots, then places the lid back.\n[60-90s] - Hand holds hot dog bun with visible toppings, while other hand uses black glove to scoop condiments from metal trays.  \n- Condiment trays are arranged in a row, with one tray containing a light-colored grainy substance and another holding a dark, chunky sauce.  \n- The worker’s gloved hand moves between trays, suggesting preparation for assembling the hot dog.\n[90-120s] - A gloved hand places a hot dog with toppings onto a paper wrapper, then wraps it in foil.  \n- The hand moves to a nearby station, picking up a brown paper bag and placing the wrapped hot dog inside.  \n- The scene shifts to a stainless steel counter with various food containers, and the hand reaches for a foil-wrapped item near a yellow container.\n[120-150s] - A gloved hand uses a spatula to scoop sauerkraut into a hot dog bun.  \n- Another gloved hand holds a bun while the other hand scoops chili from a container.  \n- The hot dog bun is then placed on a metal tray after being filled with chili.\n[150-180s] - Hand in glove scoops chili from metal tray and places it onto a hot dog bun held by another hand.  \n- The hot dog is then placed on a paper towel on a stainless steel counter.  \n- A brown paper bag is opened and placed on the counter, ready to receive the prepared hot dog.\n[180-210s] - Worker uses tongs to lift a hot dog from a steaming pan, then places it into a bun.  \n- Worker places a paper towel on the counter, then picks up a plastic-wrapped package of condiments.  \n- Worker dips the hot dog into a container of mustard, then places it back into the bun.\n[210-240s] - Hand in black glove uses tongs to lift a cooked sausage from a hot oil pan.  \n- Hand in clear glove holds a hot dog bun, positioning it near the sausage for assembly.  \n- A plastic bag is placed on the counter, likely to wrap the assembled hot dog.", "history_tokens": 596, "history_utf8_bytes": 2427, "recent_frame_times_s": [226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333], "recent_frames_sha256": "4c7ecd3b82b8c3a152042246cf9a853a02b543207fa0587fc3a04342582019c4", "num_recent_frames": 30, "tq": 719237.697126802, "t1": 719244.442685422, "ta": 719244.442685422, "te": 719244.664715695, "first_response_s": 6.745558619964868, "answer_total_s": 6.967588892905042, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 340, "content_group": "4ad4f99fd8d0d1c201175b5c12ee7faa5ea2a365ed79436fc06fae1171291f70", "question": {"question_id": "sample_340_a2180_q0", "video_id": 340, "video_path": "./videos/sample_340_real.mp4", "annotation_index": 2180, "question_index": 0, "question": "What is the best summary of the actions taken by the individual just now?", "options": ["A. The individual sliced onions and tomatoes, placed them carefully in a hot dog bun, and wrapped it.", "B. The individual grabbed a hamburger bun, cooked a patty, and assembled a cheeseburger.", "C. The individual picked up a hot dog bun, retrieved a hot dog from water, placed it in the bun, added ketchup.", "D. The individual prepared a sandwich by layering several ingredients between two slices of bread and served it."], "answer": "C", "time_stamp_s": 379, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [369, 379], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_340_a2180_q0", "video_id": 340, "time_stamp_s": 379, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8c103f9ba2fd69ab2beb172abc1572b960a02856c3230e2fe16d28f7e495ae44", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666], "recent_frames_sha256": "9cb5b2371b5b898fe4716e1a272e350bdbee692e60599a51a8c2c93f3bd58a5c", "num_recent_frames": 30, "tq": 719351.106191774, "t1": 719362.6792113, "ta": 719362.6792113, "te": 719362.717847318, "first_response_s": 11.573019525967538, "answer_total_s": 11.61165554402396, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_340_a2180_q0", "video_id": 340, "time_stamp_s": 379, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "daba36cab21cfd6aa32eb63006d0cce8c823a4e0b672672a227b139a5977de38", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person dons black gloves while handling a white cloth near a stainless steel food prep station.  \n- They wipe down the station’s surface, then move to a nearby counter with various food items and utensils.  \n- The person’s feet are visible on a red-and-white checkered floor, and they are wearing white sneakers and blue jeans.\n[30-60s] - Person wearing gloves places carrots into a metal tray on a stainless steel counter.  \n- A hot dog bun is picked up and held near a tray containing carrots.  \n- The person moves a metal lid to reveal a tray with carrots, then places the lid back.\n[60-90s] - Hand holds hot dog bun with visible toppings, while other hand uses black glove to scoop condiments from metal trays.  \n- Condiment trays are arranged in a row, with one tray containing a light-colored grainy substance and another holding a dark, chunky sauce.  \n- The worker’s gloved hand moves between trays, suggesting preparation for assembling the hot dog.\n[90-120s] - A gloved hand places a hot dog with toppings onto a paper wrapper, then wraps it in foil.  \n- The hand moves to a nearby station, picking up a brown paper bag and placing the wrapped hot dog inside.  \n- The scene shifts to a stainless steel counter with various food containers, and the hand reaches for a foil-wrapped item near a yellow container.\n[120-150s] - A gloved hand uses a spatula to scoop sauerkraut into a hot dog bun.  \n- Another gloved hand holds a bun while the other hand scoops chili from a container.  \n- The hot dog bun is then placed on a metal tray after being filled with chili.\n[150-180s] - Hand in glove scoops chili from metal tray and places it onto a hot dog bun held by another hand.  \n- The hot dog is then placed on a paper towel on a stainless steel counter.  \n- A brown paper bag is opened and placed on the counter, ready to receive the prepared hot dog.\n[180-210s] - Worker uses tongs to lift a hot dog from a steaming pan, then places it into a bun.  \n- Worker places a paper towel on the counter, then picks up a plastic-wrapped package of condiments.  \n- Worker dips the hot dog into a container of mustard, then places it back into the bun.\n[210-240s] - Hand in black glove uses tongs to lift a cooked sausage from a hot oil pan.  \n- Hand in clear glove holds a hot dog bun, positioning it near the sausage for assembly.  \n- A plastic bag is placed on the counter, likely to wrap the assembled hot dog.\n[240-270s] - Left hand holds a hot dog bun while right hand uses a spoon to scoop chili from a metal tray.  \n- Hot dog bun is positioned over a metal tray containing chili, with a spoon actively transferring chili into it.  \n- Right hand wears black gloves, and the left hand wears a transparent glove, both handling the food preparation.\n[270-300s] - Person wearing gloves uses paper towels to wipe a stainless steel food prep surface.  \n- A brown paper bag is opened to reveal white paper items inside, likely food packaging.  \n- The scene transitions to a cash register area with a red-and-white checkered floor, indicating a food service setting.\n[300-330s] - Cash register screen displays \"$22.50\" as a transaction is being processed.  \n- A person in a white shirt with an orange logo stands near the register, holding a white cup.  \n- The floor features a red and white checkered tile pattern, and a stainless steel counter is visible nearby.\n[330-360s] - Worker adds mustard from a metal container to a hot dog using a spoon.  \n- Worker then adds chili from another container to the same hot dog.  \n- Worker wraps the assembled hot dog in paper after adding toppings.", "history_tokens": 873, "history_utf8_bytes": 3602, "recent_frame_times_s": [349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666], "recent_frames_sha256": "9cb5b2371b5b898fe4716e1a272e350bdbee692e60599a51a8c2c93f3bd58a5c", "num_recent_frames": 30, "tq": 719278.783454148, "t1": 719286.018335262, "ta": 719286.018335262, "te": 719286.327300633, "first_response_s": 7.234881113981828, "answer_total_s": 7.543846484972164, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 340, "content_group": "4ad4f99fd8d0d1c201175b5c12ee7faa5ea2a365ed79436fc06fae1171291f70", "question": {"question_id": "sample_340_a2181_q0", "video_id": 340, "video_path": "./videos/sample_340_real.mp4", "annotation_index": 2181, "question_index": 0, "question": "Which of the following options best summarizes the actions taken by the individual just now?", "options": ["A. The individual cooked a pasta dish by boiling noodles, adding sauce, and plating it.", "B. The individual prepared a burrito, added beans and rice, and wrapped it in foil.", "C. The individual assembled a hot dog by placing it into a bun, adding toppings, and wrapping it.", "D. The individual chopped vegetables, added them to a salad bowl, and tossed them with dressing."], "answer": "C", "time_stamp_s": 501, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [492, 502], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_340_a2181_q0", "video_id": 340, "time_stamp_s": 501, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ed838df3e7b5ef417e8c58bf564ba20d9ef8b0ea4250db0ef355a6941b5812af", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667, 487.01986666666664, 488.0208666666667, 489.02186666666665, 490.0228666666667, 491.02386666666666, 492.02486666666664, 493.0258666666667, 494.02686666666665, 495.0278666666667, 496.02886666666666, 497.0298666666667, 498.03086666666667, 499.03186666666664, 500.0328666666667], "recent_frames_sha256": "2e5ece8931ea5038bc4546e12b3c8c2352ca01ae69a38be6951becc27bf40805", "num_recent_frames": 30, "tq": 719362.729842305, "t1": 719376.118879941, "ta": 719376.118879941, "te": 719376.158104043, "first_response_s": 13.389037635992281, "answer_total_s": 13.42826173803769, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_340_a2181_q0", "video_id": 340, "time_stamp_s": 501, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ca75900adb542537bf6f12c85bd00d50e207ab294407ecabf5537a6034d233ca", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A gloved hand places a hot dog with toppings onto a paper wrapper, then wraps it in foil.  \n- The hand moves to a nearby station, picking up a brown paper bag and placing the wrapped hot dog inside.  \n- The scene shifts to a stainless steel counter with various food containers, and the hand reaches for a foil-wrapped item near a yellow container.\n[120-150s] - A gloved hand uses a spatula to scoop sauerkraut into a hot dog bun.  \n- Another gloved hand holds a bun while the other hand scoops chili from a container.  \n- The hot dog bun is then placed on a metal tray after being filled with chili.\n[150-180s] - Hand in glove scoops chili from metal tray and places it onto a hot dog bun held by another hand.  \n- The hot dog is then placed on a paper towel on a stainless steel counter.  \n- A brown paper bag is opened and placed on the counter, ready to receive the prepared hot dog.\n[180-210s] - Worker uses tongs to lift a hot dog from a steaming pan, then places it into a bun.  \n- Worker places a paper towel on the counter, then picks up a plastic-wrapped package of condiments.  \n- Worker dips the hot dog into a container of mustard, then places it back into the bun.\n[210-240s] - Hand in black glove uses tongs to lift a cooked sausage from a hot oil pan.  \n- Hand in clear glove holds a hot dog bun, positioning it near the sausage for assembly.  \n- A plastic bag is placed on the counter, likely to wrap the assembled hot dog.\n[240-270s] - Left hand holds a hot dog bun while right hand uses a spoon to scoop chili from a metal tray.  \n- Hot dog bun is positioned over a metal tray containing chili, with a spoon actively transferring chili into it.  \n- Right hand wears black gloves, and the left hand wears a transparent glove, both handling the food preparation.\n[270-300s] - Person wearing gloves uses paper towels to wipe a stainless steel food prep surface.  \n- A brown paper bag is opened to reveal white paper items inside, likely food packaging.  \n- The scene transitions to a cash register area with a red-and-white checkered floor, indicating a food service setting.\n[300-330s] - Cash register screen displays \"$22.50\" as a transaction is being processed.  \n- A person in a white shirt with an orange logo stands near the register, holding a white cup.  \n- The floor features a red and white checkered tile pattern, and a stainless steel counter is visible nearby.\n[330-360s] - Worker adds mustard from a metal container to a hot dog using a spoon.  \n- Worker then adds chili from another container to the same hot dog.  \n- Worker wraps the assembled hot dog in paper after adding toppings.\n[360-390s] - Worker holds a hot dog bun in left hand while right hand uses black spatula to scoop chili from metal tray.  \n- Worker places the chili-filled hot dog onto a paper towel on the stainless steel counter.  \n- Worker then picks up a hot dog bun and dips it into a tray of carrots in a liquid, then places it back on the counter.\n[390-420s] - Worker holds a hot dog bun with a sausage, adding chili from a metal container.  \n- Worker uses a black glove to scoop chili, then places it back into the container.  \n- Worker then adds ketchup to the hot dog using a red squeeze bottle.\n[420-450s] - A hand in a clear glove holds a brown paper bag, opening it to reveal a wrapped item inside.  \n- Another hand, wearing a black glove, reaches into the bag, pulling out a wrapped food item.  \n- The food item is placed onto a metal tray, which is part of a larger stainless steel food preparation station.\n[450-480s] - Hand wearing glove places a paper bag on a counter near a cash register.  \n- Cash register screen displays a blue interface with text, likely indicating a transaction or payment status.  \n- Floor tiles show a red and white checkered pattern, with a brown mat near a large metal appliance.", "history_tokens": 945, "history_utf8_bytes": 3835, "recent_frame_times_s": [471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667, 487.01986666666664, 488.0208666666667, 489.02186666666665, 490.0228666666667, 491.02386666666666, 492.02486666666664, 493.0258666666667, 494.02686666666665, 495.0278666666667, 496.02886666666666, 497.0298666666667, 498.03086666666667, 499.03186666666664, 500.0328666666667], "recent_frames_sha256": "2e5ece8931ea5038bc4546e12b3c8c2352ca01ae69a38be6951becc27bf40805", "num_recent_frames": 30, "tq": 719315.858832103, "t1": 719325.299633655, "ta": 719325.299633655, "te": 719325.33779213, "first_response_s": 9.44080155203119, "answer_total_s": 9.478960026986897, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 341, "content_group": "a4c84190bfad89ec37239179b9a4852caeef5ce0c9dd91920165b9be1c2c1a7e", "question": {"question_id": "sample_341_a590_q0", "video_id": 341, "video_path": "./videos/sample_341_real.mp4", "annotation_index": 590, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual boiled pasta, mixed it with cheese sauce, and served it in a bowl.", "B. The individual selected package items, assembled a burger with cheese, and added a meat patty.", "C. The individual prepared a salad by washing vegetables, chopping them, and arranging them on a plate.", "D. The individual set the table with cutlery, placed a glass of water, and served a main course."], "answer": "B", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_341_a590_q0", "video_id": 341, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e4560d16c5f5e3019683c9d6be7c239a91476327d09db747325bb1c625c7432f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "f9c1e961974337aa74a1bc966a5951c0dfbdb5947546efca048fc9921eabef23", "num_recent_frames": 10, "tq": 710617.114912408, "t1": 710628.667230143, "ta": 710628.667230143, "te": 710628.705328576, "first_response_s": 11.552317734924145, "answer_total_s": 11.590416167979129, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_341_a590_q0", "video_id": 341, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a731e3a45a9b534eb2a27c07e8c72c2e41a894a5e7f521fe85678e45809c623e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "f9c1e961974337aa74a1bc966a5951c0dfbdb5947546efca048fc9921eabef23", "num_recent_frames": 10, "tq": 710673.976831281, "t1": 710686.01249829, "ta": 710686.01249829, "te": 710686.363187837, "first_response_s": 12.035667009069584, "answer_total_s": 12.38635655597318, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 341, "content_group": "a4c84190bfad89ec37239179b9a4852caeef5ce0c9dd91920165b9be1c2c1a7e", "question": {"question_id": "sample_341_a591_q0", "video_id": 341, "video_path": "./videos/sample_341_real.mp4", "annotation_index": 591, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual boiled pasta, mixed it with cheese sauce, and served it in a bowl.", "B. The individual baked a cake, decorated it with icing, and placed it on display.", "C. The individual selected packaged items, assembled a breakfast burger with a meat patty, cheese, and a fried egg.", "D. The individual prepared a salad by washing vegetables, chopping them, and arranging them on a plate."], "answer": "C", "time_stamp_s": 79, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [69, 79], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_341_a591_q0", "video_id": 341, "time_stamp_s": 79, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7c3aec7341d5b56417b0bcd680bd127e10a8b1e9ba831dbeb8d2822a9fd41638", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [49.015633333333334, 50.01663333333333, 51.00095, 52.00195, 53.00295, 54.00395, 55.00495, 56.00595, 57.00695, 58.00795, 59.00895, 60.00995, 61.01095, 62.01195, 63.01295, 64.01395, 65.01495, 66.01595, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667], "recent_frames_sha256": "62ffacc223646df6fff71eb35c83a2ca97d5870858e0c124887ebb863289ecae", "num_recent_frames": 30, "tq": 710628.727289604, "t1": 710639.937519071, "ta": 710639.937519071, "te": 710639.976036738, "first_response_s": 11.210229467018507, "answer_total_s": 11.248747133999132, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_341_a591_q0", "video_id": 341, "time_stamp_s": 79, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "40033c41a6a5e545a0c4a46a97ffaa10ae4029e842792ca28e2a88fdd448e315", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands in gloves remove a yellow tray from a stacked oven unit, then place it on a counter.  \n- A black container is lifted from a drawer beneath the oven, revealing a yellow lid inside.  \n- Blue plastic containers are handled and moved around the counter area, likely for food prep or storage.\n[30-60s] - Hands place a yellow cutting board on a stainless steel counter, then open a drawer to retrieve a green-handled tool.  \n- The person uses the tool to press down on a stack of round, yellowish items (possibly buns or patties) on the cutting board.  \n- After pressing, the person removes the items from the board and places them into a metal tray, then closes the drawer.", "history_tokens": 160, "history_utf8_bytes": 684, "recent_frame_times_s": [49.015633333333334, 50.01663333333333, 51.00095, 52.00195, 53.00295, 54.00395, 55.00495, 56.00595, 57.00695, 58.00795, 59.00895, 60.00995, 61.01095, 62.01195, 63.01295, 64.01395, 65.01495, 66.01595, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667], "recent_frames_sha256": "62ffacc223646df6fff71eb35c83a2ca97d5870858e0c124887ebb863289ecae", "num_recent_frames": 30, "tq": 710702.957309767, "t1": 710704.543464276, "ta": 710704.543464276, "te": 710704.583454713, "first_response_s": 1.5861545089865103, "answer_total_s": 1.6261449459707364, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 341, "content_group": "a4c84190bfad89ec37239179b9a4852caeef5ce0c9dd91920165b9be1c2c1a7e", "question": {"question_id": "sample_341_a592_q0", "video_id": 341, "video_path": "./videos/sample_341_real.mp4", "annotation_index": 592, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual prepared a pizza by spreading sauce, adding toppings, and placing it in the oven.", "B. The individual assembled a burger by retrieving sliced onions from refrigeration, adding them to the buns.", "C. The individual baked biscuits, buttered them, and served them with jam.", "D. The individual grilled chicken, seasoned it with herbs, and plated it with a side of vegetables."], "answer": "B", "time_stamp_s": 147, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [138, 148], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_341_a592_q0", "video_id": 341, "time_stamp_s": 147, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "adf97986aee0760b23c798f2a6a63abc551782336bcdff390dc1699c8dd00d6f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332], "recent_frames_sha256": "db6f9d6762e5157e4dde291789c3b6a343f0ae2dee8ec924babd39d5941f91ff", "num_recent_frames": 30, "tq": 710639.987822653, "t1": 710646.914085858, "ta": 710646.914085858, "te": 710646.952427899, "first_response_s": 6.926263205008581, "answer_total_s": 6.964605245972052, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_341_a592_q0", "video_id": 341, "time_stamp_s": 147, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "589216fdbc2fddc5e1d0bd0ab2fcd1949700487a16a04a117ac9e881254f5e30", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands in gloves remove a yellow tray from a stacked oven unit, then place it on a counter.  \n- A black container is lifted from a drawer beneath the oven, revealing a yellow lid inside.  \n- Blue plastic containers are handled and moved around the counter area, likely for food prep or storage.\n[30-60s] - Hands place a yellow cutting board on a stainless steel counter, then open a drawer to retrieve a green-handled tool.  \n- The person uses the tool to press down on a stack of round, yellowish items (possibly buns or patties) on the cutting board.  \n- After pressing, the person removes the items from the board and places them into a metal tray, then closes the drawer.\n[60-90s] - Hands use tongs to transfer a yellow cheese slice from a tray to a plate.  \n- A second plate with a round food item and a small yellow cheese slice is visible nearby.  \n- The person moves the plate toward a stainless steel oven unit with multiple compartments.\n[90-120s] - A gloved hand holds a receipt showing \"1308\" and \"Sriracha Gravy Biscuit\" with a \"Special Request\" note.  \n- The hand places the receipt into a drawer beneath a stainless steel oven unit.  \n- The hand then pulls out a yellow tray and a green tray from a lower shelf, revealing food items on the trays.", "history_tokens": 309, "history_utf8_bytes": 1270, "recent_frame_times_s": [117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332], "recent_frames_sha256": "db6f9d6762e5157e4dde291789c3b6a343f0ae2dee8ec924babd39d5941f91ff", "num_recent_frames": 30, "tq": 710725.363909481, "t1": 710731.673352597, "ta": 710731.673352597, "te": 710731.858731501, "first_response_s": 6.309443116071634, "answer_total_s": 6.494822020060383, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 341, "content_group": "a4c84190bfad89ec37239179b9a4852caeef5ce0c9dd91920165b9be1c2c1a7e", "question": {"question_id": "sample_341_a593_q0", "video_id": 341, "video_path": "./videos/sample_341_real.mp4", "annotation_index": 593, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual grilled chicken breasts, added seasoning, and placed them on a platter.", "B. The individual prepared a burger by retrieving a patty, adding cheese, and assembling it with a bun.", "C. The individual baked cookies, sprinkled them with sugar, and placed them on a rack to cool.", "D. The individual deep-fried french fries, salted them, and served them in a container."], "answer": "B", "time_stamp_s": 217, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [207, 217], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_341_a593_q0", "video_id": 341, "time_stamp_s": 217, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6b811f9d5f974117884cc01033634fd09636b99f6fbb0cff68ac2a24b130e695", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158], "recent_frames_sha256": "bf7b8ce0d6c5df059fe19d6b5ca255708b4f289c29840c767068f07eac4fcb94", "num_recent_frames": 30, "tq": 710646.963504507, "t1": 710660.045304271, "ta": 710660.045304271, "te": 710660.083690782, "first_response_s": 13.081799764069729, "answer_total_s": 13.120186274987645, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_341_a593_q0", "video_id": 341, "time_stamp_s": 217, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ec02d3c5fdc3d1ac733d3f40d606469e5f492ab79ea6a4fd750b62a95d386998", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands in gloves remove a yellow tray from a stacked oven unit, then place it on a counter.  \n- A black container is lifted from a drawer beneath the oven, revealing a yellow lid inside.  \n- Blue plastic containers are handled and moved around the counter area, likely for food prep or storage.\n[30-60s] - Hands place a yellow cutting board on a stainless steel counter, then open a drawer to retrieve a green-handled tool.  \n- The person uses the tool to press down on a stack of round, yellowish items (possibly buns or patties) on the cutting board.  \n- After pressing, the person removes the items from the board and places them into a metal tray, then closes the drawer.\n[60-90s] - Hands use tongs to transfer a yellow cheese slice from a tray to a plate.  \n- A second plate with a round food item and a small yellow cheese slice is visible nearby.  \n- The person moves the plate toward a stainless steel oven unit with multiple compartments.\n[90-120s] - A gloved hand holds a receipt showing \"1308\" and \"Sriracha Gravy Biscuit\" with a \"Special Request\" note.  \n- The hand places the receipt into a drawer beneath a stainless steel oven unit.  \n- The hand then pulls out a yellow tray and a green tray from a lower shelf, revealing food items on the trays.\n[120-150s] - Hands place burger buns on yellow paper trays near a commercial oven.  \n- Person opens a plastic container holding white cheese slices, preparing to add them to the buns.  \n- The container is held steady while the buns remain on the yellow trays, positioned near the oven.\n[150-180s] - Hands place yellow paper towels on a stainless steel counter near a commercial oven.  \n- A blue tray is pulled out from under the counter, revealing stacked food trays inside.  \n- A person in the background is seen working near a white container, partially visible.\n[180-210s] - Hands place sliced bread rounds onto a yellow cutting board near a commercial oven.  \n- A gloved hand removes a tray of cooked food from a multi-tiered oven unit.  \n- The person then transfers the bread rounds from the cutting board into a container beneath the oven.", "history_tokens": 506, "history_utf8_bytes": 2116, "recent_frame_times_s": [187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158], "recent_frames_sha256": "bf7b8ce0d6c5df059fe19d6b5ca255708b4f289c29840c767068f07eac4fcb94", "num_recent_frames": 30, "tq": 710760.294825678, "t1": 710765.663323004, "ta": 710765.663323004, "te": 710765.882755424, "first_response_s": 5.368497326038778, "answer_total_s": 5.587929746019654, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 341, "content_group": "a4c84190bfad89ec37239179b9a4852caeef5ce0c9dd91920165b9be1c2c1a7e", "question": {"question_id": "sample_341_a594_q0", "video_id": 341, "video_path": "./videos/sample_341_real.mp4", "annotation_index": 594, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual baked cookies, cooled them on a rack, and packaged them in boxes.", "B. The individual selected hash browns, packaged them in package.", "C. The individual grilled sandwiches, wrapped them, and packed them into boxes.", "D. The individual deep-fried chicken wings, added sauce, and arranged them on a plate."], "answer": "B", "time_stamp_s": 286, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [276, 286], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_341_a594_q0", "video_id": 341, "time_stamp_s": 286, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "524ee26610c912c2fe7e927776593a3efb7c5fe33e66cf2a2241ef1a1411c5f7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.00038333333333, 285.0013833333333], "recent_frames_sha256": "f4ba2a2527e8d9992c76f51093997ca14d5bfdca702ae1a10da17e7bbb819204", "num_recent_frames": 30, "tq": 710660.098956995, "t1": 710673.915928837, "ta": 710673.915928837, "te": 710673.955144285, "first_response_s": 13.816971842083149, "answer_total_s": 13.856187290046364, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_341_a594_q0", "video_id": 341, "time_stamp_s": 286, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f98d8f7c695aa1ddf73d4fb9c61713ef7609a424be5c89f81e379ce9f6c44de7", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands in gloves remove a yellow tray from a stacked oven unit, then place it on a counter.  \n- A black container is lifted from a drawer beneath the oven, revealing a yellow lid inside.  \n- Blue plastic containers are handled and moved around the counter area, likely for food prep or storage.\n[30-60s] - Hands place a yellow cutting board on a stainless steel counter, then open a drawer to retrieve a green-handled tool.  \n- The person uses the tool to press down on a stack of round, yellowish items (possibly buns or patties) on the cutting board.  \n- After pressing, the person removes the items from the board and places them into a metal tray, then closes the drawer.\n[60-90s] - Hands use tongs to transfer a yellow cheese slice from a tray to a plate.  \n- A second plate with a round food item and a small yellow cheese slice is visible nearby.  \n- The person moves the plate toward a stainless steel oven unit with multiple compartments.\n[90-120s] - A gloved hand holds a receipt showing \"1308\" and \"Sriracha Gravy Biscuit\" with a \"Special Request\" note.  \n- The hand places the receipt into a drawer beneath a stainless steel oven unit.  \n- The hand then pulls out a yellow tray and a green tray from a lower shelf, revealing food items on the trays.\n[120-150s] - Hands place burger buns on yellow paper trays near a commercial oven.  \n- Person opens a plastic container holding white cheese slices, preparing to add them to the buns.  \n- The container is held steady while the buns remain on the yellow trays, positioned near the oven.\n[150-180s] - Hands place yellow paper towels on a stainless steel counter near a commercial oven.  \n- A blue tray is pulled out from under the counter, revealing stacked food trays inside.  \n- A person in the background is seen working near a white container, partially visible.\n[180-210s] - Hands place sliced bread rounds onto a yellow cutting board near a commercial oven.  \n- A gloved hand removes a tray of cooked food from a multi-tiered oven unit.  \n- The person then transfers the bread rounds from the cutting board into a container beneath the oven.\n[210-240s] - Gloved hands use a brush to apply a yellow substance onto a small, round food item placed on a white paper towel.  \n- The food item is then transferred to a yellow tray, which is subsequently placed into a stainless steel oven unit.  \n- The oven's interior is visible, showing multiple racks with other food items already inside, and the oven's digital display shows operational status.\n[240-270s] - Person removes a black tray from a stainless steel unit, then places it into a yellow plastic container.  \n- Yellow container is positioned on a metal counter near a trash bin and a stack of trays.  \n- Person walks away from the counter, moving toward a large stainless steel appliance with multiple compartments.", "history_tokens": 666, "history_utf8_bytes": 2843, "recent_frame_times_s": [256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.00038333333333, 285.0013833333333], "recent_frames_sha256": "f4ba2a2527e8d9992c76f51093997ca14d5bfdca702ae1a10da17e7bbb819204", "num_recent_frames": 30, "tq": 710782.093203633, "t1": 710787.482996463, "ta": 710787.482996463, "te": 710787.520451054, "first_response_s": 5.389792829984799, "answer_total_s": 5.427247421001084, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 342, "content_group": "663b40ecf3e7594fed44ef65d1075d88af8c1911148d85fc901ec8bafdc3a8f8", "question": {"question_id": "sample_342_a735_q0", "video_id": 342, "video_path": "./videos/sample_342_real.mp4", "annotation_index": 735, "question_index": 0, "question": "What is the best summary of the actions performed just now?", "options": ["A. The individual cleaned the counter, set up station supplies, and took a coffee break.", "B. The individual collected wrapping papers, retrieved buns, and placed them on the counter.", "C. The individual took wrapping papers, handled buns by hands, and placed the buns on the counter.", "D. The individual stocked the shelves, wiped down surfaces, and organized condiments."], "answer": "C", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_342_a735_q0", "video_id": 342, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fdc0ae89f425c094eedc63acd610b82c06bfb5608bf8b3588c813799ff2fb76b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "58a9c18825c8df73e6dedb6bfda8facb8f4bb2eaa6ffd005fdcd46c4449f25aa", "num_recent_frames": 10, "tq": 718285.390035632, "t1": 718286.255827821, "ta": 718286.255827821, "te": 718286.293261964, "first_response_s": 0.8657921890262514, "answer_total_s": 0.9032263320405036, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_342_a735_q0", "video_id": 342, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c68aad986dc43bfad5be53d3c5555299eb461666dd87414ba8295ebf9cba1ea4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "58a9c18825c8df73e6dedb6bfda8facb8f4bb2eaa6ffd005fdcd46c4449f25aa", "num_recent_frames": 10, "tq": 718210.375202739, "t1": 718218.78657583, "ta": 718218.78657583, "te": 718218.826176454, "first_response_s": 8.411373090930283, "answer_total_s": 8.450973714934662, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 342, "content_group": "663b40ecf3e7594fed44ef65d1075d88af8c1911148d85fc901ec8bafdc3a8f8", "question": {"question_id": "sample_342_a736_q0", "video_id": 342, "video_path": "./videos/sample_342_real.mp4", "annotation_index": 736, "question_index": 0, "question": "What summarizes the actions performed just now?", "options": ["A. The individual cleaned the station, organized utensils, and disposed of waste materials.", "B. The individual picked and packed food items, marked them for delivery, and cleaned the station afterward.", "C. The individual selected a yellow wrapping paper, placed an order ticket on it.", "D. The individual placed food items in a container, labeled it, and set it aside for pickup."], "answer": "C", "time_stamp_s": 47, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [43, 53], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_342_a736_q0", "video_id": 342, "time_stamp_s": 47, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "24afe5b82889961d8c882f22f13fd7a3095fcdc10bb9e6321c143b19efe10255", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [17.000316666666667, 18.001316666666668, 19.002316666666665, 20.003316666666667, 21.004316666666668, 22.005316666666666, 23.006316666666667, 24.007316666666668, 25.008316666666666, 26.009316666666667, 27.010316666666668, 28.011316666666666, 29.012316666666667, 30.013316666666668, 31.014316666666666, 32.01531666666666, 33.01631666666667, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333], "recent_frames_sha256": "fd92a32a94dfa4101d6c760331955b5730a13de26bd65f7f61a6d0a5585967a1", "num_recent_frames": 30, "tq": 718286.316419797, "t1": 718300.097115546, "ta": 718300.097115546, "te": 718300.137629983, "first_response_s": 13.780695748981088, "answer_total_s": 13.821210185997188, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_342_a736_q0", "video_id": 342, "time_stamp_s": 47, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e83c4a6e46a52410b723fc484a71430b248f477f8648aa4fb8ddcd13196d6ddb", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands place yellow paper with circular cutouts on a metal counter, then position a green oven mitt on it.  \n- A person uses a spray bottle to mist the paper, then places a tray of round, golden-brown items (likely pastries) onto the paper.  \n- The person then picks up a white tray with a grid of similar items and places it beside the yellow paper, preparing for further processing.", "history_tokens": 92, "history_utf8_bytes": 393, "recent_frame_times_s": [17.000316666666667, 18.001316666666668, 19.002316666666665, 20.003316666666667, 21.004316666666668, 22.005316666666666, 23.006316666666667, 24.007316666666668, 25.008316666666666, 26.009316666666667, 27.010316666666668, 28.011316666666666, 29.012316666666667, 30.013316666666668, 31.014316666666666, 32.01531666666666, 33.01631666666667, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333], "recent_frames_sha256": "fd92a32a94dfa4101d6c760331955b5730a13de26bd65f7f61a6d0a5585967a1", "num_recent_frames": 30, "tq": 718223.517699881, "t1": 718225.69619201, "ta": 718225.69619201, "te": 718226.039639936, "first_response_s": 2.178492128965445, "answer_total_s": 2.5219400549540296, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 342, "content_group": "663b40ecf3e7594fed44ef65d1075d88af8c1911148d85fc901ec8bafdc3a8f8", "question": {"question_id": "sample_342_a737_q0", "video_id": 342, "video_path": "./videos/sample_342_real.mp4", "annotation_index": 737, "question_index": 0, "question": "What is the best summary of the actions performed just now?", "options": ["A. The individual cleaned the counter, organized ingredients, and prepared a salad.", "B. The individual prepared a sandwich, added condiments, and wrapped it for delivery.", "C. The individual cooked bacon, meat pie, and scrambled eggs, then placed them in a container.", "D. The individual prepared a fruit platter, arranged it neatly, and handed it to a customer."], "answer": "C", "time_stamp_s": 96, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [86, 96], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_342_a737_q0", "video_id": 342, "time_stamp_s": 96, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7afa8f55c56b82705af00bda7702abc1e18bd718e97fc96bdf572a9d859296c2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [66.01595, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333], "recent_frames_sha256": "ff8efe58c2f67535c82339499ae2acea69df447b9abf44dd692d463d6239cadb", "num_recent_frames": 30, "tq": 718300.164184921, "t1": 718314.777912527, "ta": 718314.777912527, "te": 718314.817485175, "first_response_s": 14.613727606018074, "answer_total_s": 14.653300254023634, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_342_a737_q0", "video_id": 342, "time_stamp_s": 96, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "12c64b04559cee90e7fa4fa22c71aa80522c47270ddbfd48b31cdc3e3df743e0", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands place yellow paper with circular cutouts on a metal counter, then position a green oven mitt on it.  \n- A person uses a spray bottle to mist the paper, then places a tray of round, golden-brown items (likely pastries) onto the paper.  \n- The person then picks up a white tray with a grid of similar items and places it beside the yellow paper, preparing for further processing.\n[30-60s] - Hands place a yellow paper with circular cutouts onto a metal counter near a commercial oven.  \n- A receipt is held in one hand while the other hand manipulates the yellow paper, possibly preparing or organizing items.  \n- The counter area includes a trash bin, a blue container, and a stack of paper towels, indicating a food service or kitchen environment.\n[60-90s] - Hands remove a tray of cooked bacon from a commercial oven, placing it on a metal rack.  \n- A yellow sponge is used to wipe the oven’s interior surface after removing the bacon tray.  \n- The oven’s digital display shows \"SUGGESTED 5\" as the current setting or timer.", "history_tokens": 244, "history_utf8_bytes": 1045, "recent_frame_times_s": [66.01595, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333], "recent_frames_sha256": "ff8efe58c2f67535c82339499ae2acea69df447b9abf44dd692d463d6239cadb", "num_recent_frames": 30, "tq": 718244.229453035, "t1": 718251.46676454, "ta": 718251.46676454, "te": 718251.504527381, "first_response_s": 7.2373115048976615, "answer_total_s": 7.275074345991015, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 342, "content_group": "663b40ecf3e7594fed44ef65d1075d88af8c1911148d85fc901ec8bafdc3a8f8", "question": {"question_id": "sample_342_a738_q0", "video_id": 342, "video_path": "./videos/sample_342_real.mp4", "annotation_index": 738, "question_index": 0, "question": "What is the best summary of the actions performed just now?", "options": ["A. The individual prepared a batch of fries, added salt, and placed them in a serving container.", "B. The individual organized several orders, packed different items, and completed the preparation station setup.", "C. The individual took pancakes, added meat pie from the warmer, and placed scrambled eggs on the same tray.", "D. The individual assembled a salad with fresh ingredients, topped it with dressing, and delivered it to the counter."], "answer": "C", "time_stamp_s": 141, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [129, 139], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_342_a738_q0", "video_id": 342, "time_stamp_s": 141, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1cc65c1bd50a19f417db9ca4b3b8e33dd84fce4a37bf8ff07a33f99bb94d0e58", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332], "recent_frames_sha256": "ac4ec53e6c5e47ff357f1b4f1966a319ae6968b3a0911e8e4f077c88bf713926", "num_recent_frames": 30, "tq": 718314.83719378, "t1": 718326.750269897, "ta": 718326.750269897, "te": 718326.791026949, "first_response_s": 11.913076117052697, "answer_total_s": 11.953833168954588, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_342_a738_q0", "video_id": 342, "time_stamp_s": 141, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d2e28afdf45088bb4469f3c7b80d542c0fdb18fec99b4c54f8fd05bd4dd1d6cf", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands place yellow paper with circular cutouts on a metal counter, then position a green oven mitt on it.  \n- A person uses a spray bottle to mist the paper, then places a tray of round, golden-brown items (likely pastries) onto the paper.  \n- The person then picks up a white tray with a grid of similar items and places it beside the yellow paper, preparing for further processing.\n[30-60s] - Hands place a yellow paper with circular cutouts onto a metal counter near a commercial oven.  \n- A receipt is held in one hand while the other hand manipulates the yellow paper, possibly preparing or organizing items.  \n- The counter area includes a trash bin, a blue container, and a stack of paper towels, indicating a food service or kitchen environment.\n[60-90s] - Hands remove a tray of cooked bacon from a commercial oven, placing it on a metal rack.  \n- A yellow sponge is used to wipe the oven’s interior surface after removing the bacon tray.  \n- The oven’s digital display shows \"SUGGESTED 5\" as the current setting or timer.\n[90-120s] - A gloved hand holds a printed receipt showing \"220\" as the total, with \"SRY SUGS\" and \"BACON\" listed as items.  \n- The hand moves the receipt toward a display case filled with food items, likely for customer viewing.  \n- A tray with yellow food (possibly scrambled eggs) is being carried away from a food preparation station.", "history_tokens": 333, "history_utf8_bytes": 1383, "recent_frame_times_s": [111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332], "recent_frames_sha256": "ac4ec53e6c5e47ff357f1b4f1966a319ae6968b3a0911e8e4f077c88bf713926", "num_recent_frames": 30, "tq": 718262.338051168, "t1": 718264.409278805, "ta": 718264.409278805, "te": 718264.675837087, "first_response_s": 2.071227637003176, "answer_total_s": 2.337785918964073, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 342, "content_group": "663b40ecf3e7594fed44ef65d1075d88af8c1911148d85fc901ec8bafdc3a8f8", "question": {"question_id": "sample_342_a739_q0", "video_id": 342, "video_path": "./videos/sample_342_real.mp4", "annotation_index": 739, "question_index": 0, "question": "What is the best summary of the actions performed just now?", "options": ["A. The individual toasted buns, added condiments, and wrapped sandwiches for delivery.", "B. The individual organized cooking utensils, took inventory, and sanitized the station.", "C. The individual prepared a breakfast burger, added egg and cheese, and neatly wrapped it.", "D. The individual made a cup of coffee, added cream, and handed it to a customer."], "answer": "C", "time_stamp_s": 182, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [172, 182], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_342_a739_q0", "video_id": 342, "time_stamp_s": 182, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3f07a1feb85c633996dc8e4a530a5e3e0da4644e406c6794e655b8c549aa4ae9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665], "recent_frames_sha256": "e5864f79742ea8663f2c3ef201201629db477a4115fb85984e4f712c07e95f71", "num_recent_frames": 30, "tq": 718326.80669861, "t1": 718334.707208479, "ta": 718334.707208479, "te": 718334.746334539, "first_response_s": 7.900509869097732, "answer_total_s": 7.939635929069482, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_342_a739_q0", "video_id": 342, "time_stamp_s": 182, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "39e169c01aed148e3701904e6f981104e331242b63a744c511ef178332ae1815", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands place yellow paper with circular cutouts on a metal counter, then position a green oven mitt on it.  \n- A person uses a spray bottle to mist the paper, then places a tray of round, golden-brown items (likely pastries) onto the paper.  \n- The person then picks up a white tray with a grid of similar items and places it beside the yellow paper, preparing for further processing.\n[30-60s] - Hands place a yellow paper with circular cutouts onto a metal counter near a commercial oven.  \n- A receipt is held in one hand while the other hand manipulates the yellow paper, possibly preparing or organizing items.  \n- The counter area includes a trash bin, a blue container, and a stack of paper towels, indicating a food service or kitchen environment.\n[60-90s] - Hands remove a tray of cooked bacon from a commercial oven, placing it on a metal rack.  \n- A yellow sponge is used to wipe the oven’s interior surface after removing the bacon tray.  \n- The oven’s digital display shows \"SUGGESTED 5\" as the current setting or timer.\n[90-120s] - A gloved hand holds a printed receipt showing \"220\" as the total, with \"SRY SUGS\" and \"BACON\" listed as items.  \n- The hand moves the receipt toward a display case filled with food items, likely for customer viewing.  \n- A tray with yellow food (possibly scrambled eggs) is being carried away from a food preparation station.\n[120-150s] - Hand removes a black container with yellow food items from a stainless steel appliance.  \n- Container is placed on a metal counter next to a tray with white paper towels.  \n- Another hand reaches for a yellow tray holding stacked food items, positioning it near the container.\n[150-180s] - Hands place golden-brown biscuits onto paper-lined trays near a stainless steel oven unit.  \n- A worker in a dark shirt moves behind the counter, handling food items near a large appliance.  \n- The camera wearer’s hands transfer cooked items from a tray into a container, with a yellow bucket visible nearby.", "history_tokens": 470, "history_utf8_bytes": 1997, "recent_frame_times_s": [152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665], "recent_frames_sha256": "e5864f79742ea8663f2c3ef201201629db477a4115fb85984e4f712c07e95f71", "num_recent_frames": 30, "tq": 718283.754437328, "t1": 718285.059532794, "ta": 718285.059532794, "te": 718285.359480755, "first_response_s": 1.305095466086641, "answer_total_s": 1.6050434270873666, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 343, "content_group": "ab2d054a811c55ef8182ff0361769dc603eab5bd4cf80cf11211f92e1c12201b", "question": {"question_id": "sample_343_a451_q0", "video_id": 343, "video_path": "./videos/sample_343_real.mp4", "annotation_index": 451, "question_index": 0, "question": "Which of the following options best summarizes the activity that transpired just now?", "options": ["A. The person cooked fish filets, garnished them with vegetables, and presented them for serving.", "B. The person assembled burgers by adding patties, placing condiments, and wrapping them.", "C. The person restocked sandwich ingredients, such as lettuce and tomatoes, in preparation areas.", "D. The person cleaned a used tray by discarding waste, and preparing it for reuse."], "answer": "D", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_343_a451_q0", "video_id": 343, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "55d8d704c8358d6fceaa7ffac36610ac836d4b928bc6330fab1ed8dae2e1c358", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "171d70d8424f16fbccbd8115796e6762c6cbeeb54804b8ec9c0bed0cf4f7a295", "num_recent_frames": 10, "tq": 715445.468050281, "t1": 715450.551922149, "ta": 715450.551922149, "te": 715450.589660193, "first_response_s": 5.083871867973357, "answer_total_s": 5.12160991190467, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_343_a451_q0", "video_id": 343, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7f7d62ad19ae4f0f2f644c0e951aa4889faea3967760e6fb46c6d3361efe676c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "171d70d8424f16fbccbd8115796e6762c6cbeeb54804b8ec9c0bed0cf4f7a295", "num_recent_frames": 10, "tq": 715492.594289792, "t1": 715503.109437605, "ta": 715503.109437605, "te": 715503.521781827, "first_response_s": 10.515147813013755, "answer_total_s": 10.927492034970783, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 343, "content_group": "ab2d054a811c55ef8182ff0361769dc603eab5bd4cf80cf11211f92e1c12201b", "question": {"question_id": "sample_343_a452_q0", "video_id": 343, "video_path": "./videos/sample_343_real.mp4", "annotation_index": 452, "question_index": 0, "question": "Which of the following options best summarizes the activity that transpired just now?", "options": ["A. The worker inspected the kitchen utensils, adjusted the oven temperature, and cleaned the grill.", "B. The worker arranged cooked patties on a slide, cleaned the grill surface, and prepared for the next batch.", "C. The worker deep-fried chicken, assembled it on a plate, and garnished it with herbs.", "D. The worker flipped burger patties, placed them on a tray,."], "answer": "D", "time_stamp_s": 85, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [75, 85], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_343_a452_q0", "video_id": 343, "time_stamp_s": 85, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "756c138eda682d9d8b622071e43d3e8193a431d955ad4d667257340d5e75ca5c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [55.00495, 56.00595, 57.00695, 58.00795, 59.00895, 60.00995, 61.01095, 62.01195, 63.01295, 64.01395, 65.01495, 66.01595, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334], "recent_frames_sha256": "c96ef527c01a17e7abc3ca6ee826fad9a94000bd0827437c046e50811f26d733", "num_recent_frames": 30, "tq": 715450.61581293, "t1": 715461.951691365, "ta": 715461.951691365, "te": 715461.989042004, "first_response_s": 11.335878434940241, "answer_total_s": 11.373229073942639, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_343_a452_q0", "video_id": 343, "time_stamp_s": 85, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3afba2a96db44a6d25a9dfe57c9cb99c6f867083b01f228901a5962d6d83834a", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person in blue shirt removes a tray of cooked food from a large oven, then places it on a metal surface.  \n- Another person in blue shirt uses a spatula to handle food items on a tray near the oven.  \n- A person wearing blue gloves places a wrapped item into a container, then uses a spoon to scoop something from a plastic container.\n[30-60s] - Person in blue shirt and gloves cracks eggs into a metal tray, placing them in individual cups.  \n- Eggs are arranged in a grid pattern on a tray, with yolks visible in each cup.  \n- Person moves the tray to a different station, likely for further processing or cooking.", "history_tokens": 147, "history_utf8_bytes": 626, "recent_frame_times_s": [55.00495, 56.00595, 57.00695, 58.00795, 59.00895, 60.00995, 61.01095, 62.01195, 63.01295, 64.01395, 65.01495, 66.01595, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334], "recent_frames_sha256": "c96ef527c01a17e7abc3ca6ee826fad9a94000bd0827437c046e50811f26d733", "num_recent_frames": 30, "tq": 715520.662623647, "t1": 715527.217257422, "ta": 715527.217257422, "te": 715527.434934947, "first_response_s": 6.554633775027469, "answer_total_s": 6.772311300039291, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 343, "content_group": "ab2d054a811c55ef8182ff0361769dc603eab5bd4cf80cf11211f92e1c12201b", "question": {"question_id": "sample_343_a453_q0", "video_id": 343, "video_path": "./videos/sample_343_real.mp4", "annotation_index": 453, "question_index": 0, "question": "Which of the following options best summarizes the activity that transpired just now?", "options": ["A. The worker arranged hotdogs on a grill, added condiments, and wrapped them for serving.", "B. The worker cooked and seasoned bacon strips and placed them into the fryer for crispiness.", "C. The worker assembled fish fillets, sprinkled them with seasoning, and placed them in the oven for baking.", "D. The worker transferred cooked onion onto a tray, cleaned the surface of the grill, and prepared for the next cooking batch."], "answer": "D", "time_stamp_s": 160, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [150, 160], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_343_a453_q0", "video_id": 343, "time_stamp_s": 160, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6d9af0ccd645078c82e880bbb112d2fddaf987cffd2bc45e4064ad78b9dfdb13", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885], "recent_frames_sha256": "4122495daab55390584317147c28adf8b1fc49052181da39390e97d3b81d0c0e", "num_recent_frames": 30, "tq": 715461.999684133, "t1": 715468.998129943, "ta": 715468.998129943, "te": 715469.035426417, "first_response_s": 6.998445810051635, "answer_total_s": 7.035742284031585, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_343_a453_q0", "video_id": 343, "time_stamp_s": 160, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "749332718ce4e8612ae360a0181e26daf241220bc9a1185027773556fe63d903", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person in blue shirt removes a tray of cooked food from a large oven, then places it on a metal surface.  \n- Another person in blue shirt uses a spatula to handle food items on a tray near the oven.  \n- A person wearing blue gloves places a wrapped item into a container, then uses a spoon to scoop something from a plastic container.\n[30-60s] - Person in blue shirt and gloves cracks eggs into a metal tray, placing them in individual cups.  \n- Eggs are arranged in a grid pattern on a tray, with yolks visible in each cup.  \n- Person moves the tray to a different station, likely for further processing or cooking.\n[60-90s] - Person uses spatula to flip pancakes on griddle, moving them to a tray.  \n- Griddle surface shows grease residue and scattered cooked pancakes.  \n- Person’s hands and blue shirt are visible as they work with the griddle and tray.\n[90-120s] - Person in blue shirt uses tongs to remove cooked food from a large industrial oven.  \n- Another worker in blue shirt is seen moving around the kitchen, handling trays and equipment.  \n- The kitchen floor is tiled with orange and white squares, and various cooking tools and trays are visible.\n[120-150s] - Person uses spatula to flip burger patties on a large griddle, revealing seared surfaces.  \n- Griddle shows signs of use with visible grease and residue, indicating frequent cooking.  \n- Person’s hands and tools (spatula, tongs) are actively engaged in flipping and managing food.", "history_tokens": 347, "history_utf8_bytes": 1470, "recent_frame_times_s": [130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885], "recent_frames_sha256": "4122495daab55390584317147c28adf8b1fc49052181da39390e97d3b81d0c0e", "num_recent_frames": 30, "tq": 715545.634707099, "t1": 715558.737168978, "ta": 715558.737168978, "te": 715559.004500252, "first_response_s": 13.102461879025213, "answer_total_s": 13.36979315301869, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 343, "content_group": "ab2d054a811c55ef8182ff0361769dc603eab5bd4cf80cf11211f92e1c12201b", "question": {"question_id": "sample_343_a454_q0", "video_id": 343, "video_path": "./videos/sample_343_real.mp4", "annotation_index": 454, "question_index": 0, "question": "Which of the following options best summarizes the activity that transpired just now?", "options": ["A. The individual prepared a batch of scrambled eggs, added herbs, and placed them on a hot plate.", "B. The individual restocked a freezer with packages of frozen vegetables, organized them by color, and labeled each bin.", "C. The individual cleaned and sanitized a workstation, organized cooking utensils, and prepared for the next task.", "D. The individual prepared strips of bacon by separating them from frozen packaging."], "answer": "D", "time_stamp_s": 235, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [225, 235], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_343_a454_q0", "video_id": 343, "time_stamp_s": 235, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6446e47935c6092b358f2a502582d39c33154838ccee3820700b2fe35846bc1b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666, 218.00111666666666, 219.00211666666667, 220.00311666666667, 221.00411666666668, 222.00511666666668, 223.00611666666666, 224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332], "recent_frames_sha256": "2776690a765fe396eb766cb69ade58ba02790d39ad6ca47f7d12de7b0f5a4542", "num_recent_frames": 30, "tq": 715469.047641075, "t1": 715479.661393034, "ta": 715479.661393034, "te": 715479.95818103, "first_response_s": 10.613751959055662, "answer_total_s": 10.910539955017157, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_343_a454_q0", "video_id": 343, "time_stamp_s": 235, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4463221b46a02541ef2a10172c1a4775fe0a8b205f452b213f2cdd2aebb31331", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person in blue shirt removes a tray of cooked food from a large oven, then places it on a metal surface.  \n- Another person in blue shirt uses a spatula to handle food items on a tray near the oven.  \n- A person wearing blue gloves places a wrapped item into a container, then uses a spoon to scoop something from a plastic container.\n[30-60s] - Person in blue shirt and gloves cracks eggs into a metal tray, placing them in individual cups.  \n- Eggs are arranged in a grid pattern on a tray, with yolks visible in each cup.  \n- Person moves the tray to a different station, likely for further processing or cooking.\n[60-90s] - Person uses spatula to flip pancakes on griddle, moving them to a tray.  \n- Griddle surface shows grease residue and scattered cooked pancakes.  \n- Person’s hands and blue shirt are visible as they work with the griddle and tray.\n[90-120s] - Person in blue shirt uses tongs to remove cooked food from a large industrial oven.  \n- Another worker in blue shirt is seen moving around the kitchen, handling trays and equipment.  \n- The kitchen floor is tiled with orange and white squares, and various cooking tools and trays are visible.\n[120-150s] - Person uses spatula to flip burger patties on a large griddle, revealing seared surfaces.  \n- Griddle shows signs of use with visible grease and residue, indicating frequent cooking.  \n- Person’s hands and tools (spatula, tongs) are actively engaged in flipping and managing food.\n[150-180s] - Person in blue shirt uses tongs to remove cooked items from a large griddle, placing them onto a metal tray.  \n- The tray, now filled with food, is carried away from the griddle toward a different station.  \n- Another worker in blue shirt is visible in the background, moving near a sink and other kitchen equipment.\n[180-210s] - Person in blue shirt carries tray with white circular items toward griddle area.  \n- Griddle surface has multiple circular molds with partially cooked items.  \n- Person places tray with circular items onto griddle, then moves to adjacent station.", "history_tokens": 484, "history_utf8_bytes": 2060, "recent_frame_times_s": [205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666, 218.00111666666666, 219.00211666666667, 220.00311666666667, 221.00411666666668, 222.00511666666668, 223.00611666666666, 224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332], "recent_frames_sha256": "2776690a765fe396eb766cb69ade58ba02790d39ad6ca47f7d12de7b0f5a4542", "num_recent_frames": 30, "tq": 715575.018755106, "t1": 715581.921869431, "ta": 715581.921869431, "te": 715582.117701872, "first_response_s": 6.903114325017668, "answer_total_s": 7.098946765996516, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 343, "content_group": "ab2d054a811c55ef8182ff0361769dc603eab5bd4cf80cf11211f92e1c12201b", "question": {"question_id": "sample_343_a455_q0", "video_id": 343, "video_path": "./videos/sample_343_real.mp4", "annotation_index": 455, "question_index": 0, "question": "Which of the following options best summarizes the activity that transpired just now?", "options": ["A. The worker cleaned the grill, prepared eggs by cracking and whisking them, and started cooking pancakes.", "B. The worker poured liquid eggs into a container, organized kitchen supplies, and cleaned the preparation area.", "C. The worker cracked eggs into a bowl, mixed them with spices, and set them aside for cooking later.", "D. The worker filled a container with liquid eggs."], "answer": "D", "time_stamp_s": 310, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [300, 310], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_343_a455_q0", "video_id": 343, "time_stamp_s": 310, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "129988e370bfabb73ba341b3a87423bb4282aa47296d030f4d89443163735e65", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.00038333333333, 285.0013833333333, 286.00238333333334, 287.0033833333333, 288.00438333333335, 289.0053833333333, 290.00638333333336, 291.00738333333334, 292.0083833333333, 293.00938333333335, 294.0103833333333, 295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333, 300.01638333333335, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087], "recent_frames_sha256": "e74b87fd8192c230a7a7c5d81a55491f99ef689890f44daf4723d6341afd6540", "num_recent_frames": 30, "tq": 715479.968596102, "t1": 715492.549179781, "ta": 715492.549179781, "te": 715492.586781921, "first_response_s": 12.58058367902413, "answer_total_s": 12.61818581901025, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_343_a455_q0", "video_id": 343, "time_stamp_s": 310, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "098470701e8f3a2e72a0887699030963a079208018d9f77575f3430399175886", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person in blue shirt removes a tray of cooked food from a large oven, then places it on a metal surface.  \n- Another person in blue shirt uses a spatula to handle food items on a tray near the oven.  \n- A person wearing blue gloves places a wrapped item into a container, then uses a spoon to scoop something from a plastic container.\n[30-60s] - Person in blue shirt and gloves cracks eggs into a metal tray, placing them in individual cups.  \n- Eggs are arranged in a grid pattern on a tray, with yolks visible in each cup.  \n- Person moves the tray to a different station, likely for further processing or cooking.\n[60-90s] - Person uses spatula to flip pancakes on griddle, moving them to a tray.  \n- Griddle surface shows grease residue and scattered cooked pancakes.  \n- Person’s hands and blue shirt are visible as they work with the griddle and tray.\n[90-120s] - Person in blue shirt uses tongs to remove cooked food from a large industrial oven.  \n- Another worker in blue shirt is seen moving around the kitchen, handling trays and equipment.  \n- The kitchen floor is tiled with orange and white squares, and various cooking tools and trays are visible.\n[120-150s] - Person uses spatula to flip burger patties on a large griddle, revealing seared surfaces.  \n- Griddle shows signs of use with visible grease and residue, indicating frequent cooking.  \n- Person’s hands and tools (spatula, tongs) are actively engaged in flipping and managing food.\n[150-180s] - Person in blue shirt uses tongs to remove cooked items from a large griddle, placing them onto a metal tray.  \n- The tray, now filled with food, is carried away from the griddle toward a different station.  \n- Another worker in blue shirt is visible in the background, moving near a sink and other kitchen equipment.\n[180-210s] - Person in blue shirt carries tray with white circular items toward griddle area.  \n- Griddle surface has multiple circular molds with partially cooked items.  \n- Person places tray with circular items onto griddle, then moves to adjacent station.\n[210-240s] - Person in blue shirt uses yellow tray to transport sliced cheese, moving it across a stainless steel counter.  \n- Another person in blue shirt handles a large plastic bag of bacon strips, placing it on a metal tray.  \n- Yellow trays are moved from a griddle area to a storage unit, with bacon being prepared nearby.\n[240-270s] - Person wearing blue gloves handles a clear plastic bag containing sliced meat, placing it on a metal tray.  \n- Another person in blue gloves is seen handling a black tray, possibly preparing or organizing food items.  \n- The setting appears to be a commercial kitchen with tiled floors and stainless steel equipment.\n[270-300s] - Person transfers cooked bacon strips from a griddle to a wire rack using tongs.  \n- Another person holds a black bag, possibly for packaging, near the griddle.  \n- The wire rack is placed on a metal tray, and bacon is arranged in rows on it.", "history_tokens": 697, "history_utf8_bytes": 2974, "recent_frame_times_s": [280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.00038333333333, 285.0013833333333, 286.00238333333334, 287.0033833333333, 288.00438333333335, 289.0053833333333, 290.00638333333336, 291.00738333333334, 292.0083833333333, 293.00938333333335, 294.0103833333333, 295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333, 300.01638333333335, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087], "recent_frames_sha256": "e74b87fd8192c230a7a7c5d81a55491f99ef689890f44daf4723d6341afd6540", "num_recent_frames": 30, "tq": 715610.204647747, "t1": 715612.399032491, "ta": 715612.399032491, "te": 715612.712896724, "first_response_s": 2.1943847440415993, "answer_total_s": 2.5082489770138636, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 344, "content_group": "246122bbe85f45e47c665cbca1e6ae91ed95f4fd6d4e8e826e458697c08df373", "question": {"question_id": "sample_344_a1934_q0", "video_id": 344, "video_path": "./videos/sample_344_real.mp4", "annotation_index": 1934, "question_index": 0, "question": "Which of the following options best summarizes the actions just taken?", "options": ["A. The individual opened a refrigerator, took out frozen food, placed it in a fryer basket, and prepared to deep-fry it.", "B. The individual put on gloves, searched for cleaning supplies, and began to clean the station.", "C. The individual filled a basket with fresh vegetables, washed them, and prepared to cook them.", "D. The individual arranged various condiments on the counter and started preparing a sandwich."], "answer": "A", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_344_a1934_q0", "video_id": 344, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "859040c92a4851c57095ffdcccfc643cf2b1454daa6fe122686137c24ea2cff1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "4d1ca21a67d7436c5f4b5880f60d1890d5ec6fda76a015bfca322b8545cb2277", "num_recent_frames": 11, "tq": 716382.284276686, "t1": 716382.887202718, "ta": 716382.887202718, "te": 716382.924879417, "first_response_s": 0.6029260319191962, "answer_total_s": 0.640602731029503, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_344_a1934_q0", "video_id": 344, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "63fdb25152f80697ea06403e0a747d886842c33c783c512a2023c3c106a81a63", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "4d1ca21a67d7436c5f4b5880f60d1890d5ec6fda76a015bfca322b8545cb2277", "num_recent_frames": 11, "tq": 716274.430686141, "t1": 716281.00709964, "ta": 716281.00709964, "te": 716281.20983267, "first_response_s": 6.576413498958573, "answer_total_s": 6.779146529035643, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 344, "content_group": "246122bbe85f45e47c665cbca1e6ae91ed95f4fd6d4e8e826e458697c08df373", "question": {"question_id": "sample_344_a1935_q0", "video_id": 344, "video_path": "./videos/sample_344_real.mp4", "annotation_index": 1935, "question_index": 0, "question": "What actions were taken just now by the individual?", "options": ["A. The individual opened a refrigerator, retrieved ingredients, and prepared to cook them.", "B. The individual opened a pantry, selected a pan, and started cooking the food.", "C. The individual arranged utensils on the counter and began preparing a salad.", "D. The individual checked the deep fryer, removed fried food, and placed it on a rack."], "answer": "A", "time_stamp_s": 87, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [77, 87], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_344_a1935_q0", "video_id": 344, "time_stamp_s": 87, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "682a8143a7a05e923da0aa2b37f0043b449e68f12b1de2971d8af5c947bef51d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0], "recent_frames_sha256": "aa2ff743ce59a32232cf8dc11f96947e2a71e26df907f4973b7ce01acfbfaf3d", "num_recent_frames": 30, "tq": 716382.938539227, "t1": 716395.110657866, "ta": 716395.110657866, "te": 716395.14907566, "first_response_s": 12.172118638991378, "answer_total_s": 12.210536433034576, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_344_a1935_q0", "video_id": 344, "time_stamp_s": 87, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6529f9edffc5b727be3f9a7363419211c4d42879ff1263400dc4c9409ff8fef7", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person wearing blue gloves removes a bag of frozen food from a refrigerator and places it into a deep fryer basket.  \n- The person then opens another refrigerator, retrieves a different bag of food, and places it into a separate fryer basket.  \n- The person closes the refrigerator doors after placing the food items into the fryers.\n[30-60s] - Person wearing blue gloves removes a blue-wrapped food item from a fryer basket and places it into a metal tray.  \n- The fryer basket is then lifted out of the fryer unit, revealing other baskets containing cooked food items.  \n- The person uses a cloth to wipe the fryer basket after removing the food, indicating cleaning or preparation for reuse.", "history_tokens": 157, "history_utf8_bytes": 704, "recent_frame_times_s": [58.0, 59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0], "recent_frames_sha256": "aa2ff743ce59a32232cf8dc11f96947e2a71e26df907f4973b7ce01acfbfaf3d", "num_recent_frames": 30, "tq": 716295.218307039, "t1": 716296.249202568, "ta": 716296.249202568, "te": 716296.432933078, "first_response_s": 1.0308955289656296, "answer_total_s": 1.214626039029099, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 344, "content_group": "246122bbe85f45e47c665cbca1e6ae91ed95f4fd6d4e8e826e458697c08df373", "question": {"question_id": "sample_344_a1936_q0", "video_id": 344, "video_path": "./videos/sample_344_real.mp4", "annotation_index": 1936, "question_index": 0, "question": "Which of the following options best summarizes the actions just taken?", "options": ["A. The individual opened a storage unit, retrieved packaged food, and began putting it into fryer baskets.", "B. The individual organized utensils on the counter, chopped vegetables, and prepared to sauté them.", "C. The individual opened a pantry, gathered baking ingredients, and prepared to start baking.", "D. The individual cleaned the working station, disposed of garbage, and reorganized supplies."], "answer": "A", "time_stamp_s": 164, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [154, 164], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_344_a1936_q0", "video_id": 344, "time_stamp_s": 164, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4f0c0e6153c38b22d20aec58b3b7a53fc5fb57a94437ab4d9a7bfd9037d6d027", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0], "recent_frames_sha256": "7af450836282d9dc18ad4527eb332aecbd41a7b4adf47b7f766cc1932f860555", "num_recent_frames": 30, "tq": 716395.161060378, "t1": 716408.557300988, "ta": 716408.557300988, "te": 716408.594661826, "first_response_s": 13.396240610047244, "answer_total_s": 13.433601448079571, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_344_a1936_q0", "video_id": 344, "time_stamp_s": 164, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "96f6ff5a86b8525ff08199fa7edde2cde8126104fdb94f61a92f1ed818f4fb2a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person wearing blue gloves removes a bag of frozen food from a refrigerator and places it into a deep fryer basket.  \n- The person then opens another refrigerator, retrieves a different bag of food, and places it into a separate fryer basket.  \n- The person closes the refrigerator doors after placing the food items into the fryers.\n[30-60s] - Person wearing blue gloves removes a blue-wrapped food item from a fryer basket and places it into a metal tray.  \n- The fryer basket is then lifted out of the fryer unit, revealing other baskets containing cooked food items.  \n- The person uses a cloth to wipe the fryer basket after removing the food, indicating cleaning or preparation for reuse.\n[60-90s] - Hands in blue gloves place a plastic bag of food items into a stainless steel fryer basket.  \n- The fryer basket is then moved toward a large industrial fryer unit with multiple compartments.  \n- The worker adjusts the fryer's control panel, likely setting temperature or timer for cooking.\n[90-120s] - Hands in blue gloves transfer a bag of potato slices from a sink to a fryer rack, then place the rack into a deep fryer unit.  \n- The fryer unit has multiple compartments, with one compartment visibly containing oil and a rack already in place.  \n- The person moves the fryer rack into the fryer, then removes the bag of potato slices from the sink and places them into the fryer.\n[120-150s] - Hands in blue gloves transfer potato wedges from a plastic bag into a metal fryer basket.  \n- The fryer basket is then lowered into a deep fryer unit with hot oil, positioned near a stainless steel appliance.  \n- The fryer basket is submerged, and the oil begins to bubble as the potatoes are fried.", "history_tokens": 397, "history_utf8_bytes": 1712, "recent_frame_times_s": [135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0], "recent_frames_sha256": "7af450836282d9dc18ad4527eb332aecbd41a7b4adf47b7f766cc1932f860555", "num_recent_frames": 30, "tq": 716318.954727916, "t1": 716320.193731459, "ta": 716320.193731459, "te": 716320.416698296, "first_response_s": 1.2390035429270938, "answer_total_s": 1.461970379925333, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 344, "content_group": "246122bbe85f45e47c665cbca1e6ae91ed95f4fd6d4e8e826e458697c08df373", "question": {"question_id": "sample_344_a1937_q0", "video_id": 344, "video_path": "./videos/sample_344_real.mp4", "annotation_index": 1937, "question_index": 0, "question": "What actions were taken just now by the individual?", "options": ["A. The individual removed the fried food from the fryer, placed it on a tray, and organized the tray in a storage unit.", "B. The individual placed the food in a frying pan, sautéed it, and plated it.", "C. The individual chopped vegetables, placed them in a bowl, and started making a salad.", "D. The individual cleaned the working station, wiped the counters, and organized the utensils."], "answer": "A", "time_stamp_s": 240, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [231, 241], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_344_a1937_q0", "video_id": 344, "time_stamp_s": 240, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9dfc1c010f3102082c05ade7f08745703e264d96592f5237a2f86528eb8c7a6f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0], "recent_frames_sha256": "fbc1173972cd5b6a5bf0f6e5d546d0c7ec2d7de859973c3175c849ee5844de8c", "num_recent_frames": 30, "tq": 716408.600892697, "t1": 716423.390978758, "ta": 716423.390978758, "te": 716423.428799937, "first_response_s": 14.790086060995236, "answer_total_s": 14.827907240018249, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_344_a1937_q0", "video_id": 344, "time_stamp_s": 240, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b9b672516ac88525b4e812769f8cd41ecba37ecfbccb28940f79e6263d7caa7d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person wearing blue gloves removes a bag of frozen food from a refrigerator and places it into a deep fryer basket.  \n- The person then opens another refrigerator, retrieves a different bag of food, and places it into a separate fryer basket.  \n- The person closes the refrigerator doors after placing the food items into the fryers.\n[30-60s] - Person wearing blue gloves removes a blue-wrapped food item from a fryer basket and places it into a metal tray.  \n- The fryer basket is then lifted out of the fryer unit, revealing other baskets containing cooked food items.  \n- The person uses a cloth to wipe the fryer basket after removing the food, indicating cleaning or preparation for reuse.\n[60-90s] - Hands in blue gloves place a plastic bag of food items into a stainless steel fryer basket.  \n- The fryer basket is then moved toward a large industrial fryer unit with multiple compartments.  \n- The worker adjusts the fryer's control panel, likely setting temperature or timer for cooking.\n[90-120s] - Hands in blue gloves transfer a bag of potato slices from a sink to a fryer rack, then place the rack into a deep fryer unit.  \n- The fryer unit has multiple compartments, with one compartment visibly containing oil and a rack already in place.  \n- The person moves the fryer rack into the fryer, then removes the bag of potato slices from the sink and places them into the fryer.\n[120-150s] - Hands in blue gloves transfer potato wedges from a plastic bag into a metal fryer basket.  \n- The fryer basket is then lowered into a deep fryer unit with hot oil, positioned near a stainless steel appliance.  \n- The fryer basket is submerged, and the oil begins to bubble as the potatoes are fried.\n[150-180s] - Gloved hands remove a blue-wrapped item from a refrigerator, then place it on a metal rack.  \n- Hands then take a plastic-wrapped food item from the same rack and place it into a fryer basket.  \n- The fryer basket is subsequently lowered into a deep fryer, with the fryer's oil visibly heating up.\n[180-210s] - Hands in blue gloves place a blue plastic bag into a stainless steel refrigerator, then retrieve another bag from the same unit.  \n- A black-handled tool rests on a metal rack beside the refrigerator, with a yellow object nearby.  \n- The person moves toward a large fryer unit with multiple oil-filled compartments, each equipped with a black handle.\n[210-240s] - Person wearing blue gloves removes a blue wire rack from a deep fryer, revealing golden-brown fried items inside.  \n- The rack is then transferred to a nearby stainless steel surface, likely for draining or further processing.  \n- A second fryer unit is visible in the background, with similar fried items being processed simultaneously.", "history_tokens": 635, "history_utf8_bytes": 2738, "recent_frame_times_s": [211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0], "recent_frames_sha256": "fbc1173972cd5b6a5bf0f6e5d546d0c7ec2d7de859973c3175c849ee5844de8c", "num_recent_frames": 30, "tq": 716350.302686017, "t1": 716357.431066829, "ta": 716357.431066829, "te": 716357.623203632, "first_response_s": 7.128380812006071, "answer_total_s": 7.320517614949495, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 344, "content_group": "246122bbe85f45e47c665cbca1e6ae91ed95f4fd6d4e8e826e458697c08df373", "question": {"question_id": "sample_344_a1938_q0", "video_id": 344, "video_path": "./videos/sample_344_real.mp4", "annotation_index": 1938, "question_index": 0, "question": "Which of the following options best summarizes the actions just taken?", "options": ["A. The individual removed fried food from the fryer, transferred it to a tray, and organized the tray in a storage unit.", "B. The individual picked up a pan, sautéed vegetables, and plated them.", "C. The individual opened a can of vegetables, placed them in a pot, and started boiling them.", "D. The individual cleaned the deep fryer, disposed of oil, and prepped it for the next batch."], "answer": "A", "time_stamp_s": 318, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [308, 318], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_344_a1938_q0", "video_id": 344, "time_stamp_s": 318, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c6a639e5df8e7e1139b646842f676fc0a568ef0fad5600e1056052b383ed51bf", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0], "recent_frames_sha256": "df613361d8efe04d56424ad9c0cc6555de061009a8c2c7a33c32fb4137a9e245", "num_recent_frames": 30, "tq": 716423.435859597, "t1": 716435.657773209, "ta": 716435.657773209, "te": 716435.989621567, "first_response_s": 12.221913611982018, "answer_total_s": 12.553761969902553, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_344_a1938_q0", "video_id": 344, "time_stamp_s": 318, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4a5a38bd3a244c4c20545ef3346aa5f711bcb4715f42865b7d60e52c3c81483d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person wearing blue gloves removes a bag of frozen food from a refrigerator and places it into a deep fryer basket.  \n- The person then opens another refrigerator, retrieves a different bag of food, and places it into a separate fryer basket.  \n- The person closes the refrigerator doors after placing the food items into the fryers.\n[30-60s] - Person wearing blue gloves removes a blue-wrapped food item from a fryer basket and places it into a metal tray.  \n- The fryer basket is then lifted out of the fryer unit, revealing other baskets containing cooked food items.  \n- The person uses a cloth to wipe the fryer basket after removing the food, indicating cleaning or preparation for reuse.\n[60-90s] - Hands in blue gloves place a plastic bag of food items into a stainless steel fryer basket.  \n- The fryer basket is then moved toward a large industrial fryer unit with multiple compartments.  \n- The worker adjusts the fryer's control panel, likely setting temperature or timer for cooking.\n[90-120s] - Hands in blue gloves transfer a bag of potato slices from a sink to a fryer rack, then place the rack into a deep fryer unit.  \n- The fryer unit has multiple compartments, with one compartment visibly containing oil and a rack already in place.  \n- The person moves the fryer rack into the fryer, then removes the bag of potato slices from the sink and places them into the fryer.\n[120-150s] - Hands in blue gloves transfer potato wedges from a plastic bag into a metal fryer basket.  \n- The fryer basket is then lowered into a deep fryer unit with hot oil, positioned near a stainless steel appliance.  \n- The fryer basket is submerged, and the oil begins to bubble as the potatoes are fried.\n[150-180s] - Gloved hands remove a blue-wrapped item from a refrigerator, then place it on a metal rack.  \n- Hands then take a plastic-wrapped food item from the same rack and place it into a fryer basket.  \n- The fryer basket is subsequently lowered into a deep fryer, with the fryer's oil visibly heating up.\n[180-210s] - Hands in blue gloves place a blue plastic bag into a stainless steel refrigerator, then retrieve another bag from the same unit.  \n- A black-handled tool rests on a metal rack beside the refrigerator, with a yellow object nearby.  \n- The person moves toward a large fryer unit with multiple oil-filled compartments, each equipped with a black handle.\n[210-240s] - Person wearing blue gloves removes a blue wire rack from a deep fryer, revealing golden-brown fried items inside.  \n- The rack is then transferred to a nearby stainless steel surface, likely for draining or further processing.  \n- A second fryer unit is visible in the background, with similar fried items being processed simultaneously.\n[240-270s] - Hands in blue gloves remove a metal rack from a deep fryer, revealing golden-brown fried items inside.  \n- The rack is then placed onto a stainless steel countertop next to a large industrial fryer unit.  \n- A blue plastic bag containing white powder is picked up and moved toward the fryer area, suggesting preparation for seasoning or coating.\n[270-300s] - Gloved hands remove a tray of golden-brown fried items from a deep fryer, then place it on a metal cart.  \n- The fryer unit has multiple oil-filled compartments, each with a handle, and the oil level appears consistent across compartments.  \n- A green plastic tray is used to hold the fried items, and the hands are seen manipulating it while moving it between the fryer and cart.", "history_tokens": 811, "history_utf8_bytes": 3491, "recent_frame_times_s": [289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0], "recent_frames_sha256": "df613361d8efe04d56424ad9c0cc6555de061009a8c2c7a33c32fb4137a9e245", "num_recent_frames": 30, "tq": 716376.104118112, "t1": 716382.222837489, "ta": 716382.222837489, "te": 716382.260556569, "first_response_s": 6.1187193769728765, "answer_total_s": 6.156438456964679, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 345, "content_group": "ef2eb63e5cccb42ca7408f337130a5a6e0e46b152f0cc2f34b55cbb6e615f57a", "question": {"question_id": "sample_345_a1081_q0", "video_id": 345, "video_path": "./videos/sample_345_real.mp4", "annotation_index": 1081, "question_index": 0, "question": "What is the best summary of the actions taken just now?", "options": ["A. A worker picked up a bag, added condiments, and handed it to another worker.", "B. A worker grabbed a bag, placed a cheeseburger inside, and passed it to a colleague.", "C. A worker retrieved a bag, added fries and a cheeseburger, checked the order slip, and moved to the fryer area.", "D. A worker took a bag, filled it with a drink, and proceeded to the front counter."], "answer": "C", "time_stamp_s": 12, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_345_a1081_q0", "video_id": 345, "time_stamp_s": 12, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a35bdf34199491cb4e7ddd754f7918b211bb2083eb52c07a3b7955397ca0e751", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011], "recent_frames_sha256": "93ca2e59464212451f354ee4101142bb8cc9e45e78fef3c3846529d50b207ac2", "num_recent_frames": 12, "tq": 715781.235875763, "t1": 715786.569495165, "ta": 715786.569495165, "te": 715786.792541095, "first_response_s": 5.333619402023032, "answer_total_s": 5.556665332056582, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_345_a1081_q0", "video_id": 345, "time_stamp_s": 12, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "23004ec62fe45e73bd9005d7512eb8d92b62072837ac99d53f6eb02ed10ec0c0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011], "recent_frames_sha256": "93ca2e59464212451f354ee4101142bb8cc9e45e78fef3c3846529d50b207ac2", "num_recent_frames": 12, "tq": 715612.782913292, "t1": 715624.806312965, "ta": 715624.806312965, "te": 715624.969616134, "first_response_s": 12.023399673053063, "answer_total_s": 12.186702842009254, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 345, "content_group": "ef2eb63e5cccb42ca7408f337130a5a6e0e46b152f0cc2f34b55cbb6e615f57a", "question": {"question_id": "sample_345_a1082_q0", "video_id": 345, "video_path": "./videos/sample_345_real.mp4", "annotation_index": 1082, "question_index": 0, "question": "What is the best summary of the actions taken just now?", "options": ["A. A worker placed fries into a fryer, prepared drinks, and gave them to a colleague.", "B. A worker assembled a hamburger, wrapped it, and handed it to a customer.", "C. A worker collected fries in a bag, placed an order slip on it, and moved it to the counter.", "D. A worker took a customer's order, processed the payment, and handed over a receipt."], "answer": "C", "time_stamp_s": 108, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [98, 108], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_345_a1082_q0", "video_id": 345, "time_stamp_s": 108, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5824fea14814b2b29687c46e457bf3d5ef348a2dbb85096ac77952fb21ddc949", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069], "recent_frames_sha256": "3a184e331f1105fa96a5498619d5fbcb8c02a33350ee74c50c5ebef75fd3b268", "num_recent_frames": 30, "tq": 715786.810319553, "t1": 715797.541124161, "ta": 715797.541124161, "te": 715797.761999278, "first_response_s": 10.73080460797064, "answer_total_s": 10.951679724967107, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_345_a1082_q0", "video_id": 345, "time_stamp_s": 108, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "86e0c147e52e9d065ca385418c9c222ecf3be23767b523facb890c437440f3a9", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person holds a paper bag and places it on a counter near a food preparation station.  \n- Another person in a blue shirt is seen working at a counter with a computer screen displaying McDonald's branding.  \n- A hand places a plastic cup on a white tray, which is positioned in front of a screen showing beverage options.\n[30-60s] - Person holds a brown paper bag with \"Burger King\" logo, then opens it to reveal a receipt and two white paper bags inside.  \n- The person places the receipt on a counter, then picks up a white paper bag and moves it toward a display case with food items.  \n- A second person in a red shirt is seen in the background near a counter with a coffee machine, while another person in a purple shirt stands nearby.\n[60-90s] - Hand inserts a metal cup into a coffee machine's dispensing port, then removes it after filling.  \n- The machine's digital display shows operational indicators, including a green light and icons for various coffee types.  \n- A person in a red shirt is visible in the background, moving near the counter.", "history_tokens": 241, "history_utf8_bytes": 1063, "recent_frame_times_s": [78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069], "recent_frames_sha256": "3a184e331f1105fa96a5498619d5fbcb8c02a33350ee74c50c5ebef75fd3b268", "num_recent_frames": 30, "tq": 715677.194990614, "t1": 715678.176670063, "ta": 715678.176670063, "te": 715678.400133369, "first_response_s": 0.9816794490907341, "answer_total_s": 1.205142755061388, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 345, "content_group": "ef2eb63e5cccb42ca7408f337130a5a6e0e46b152f0cc2f34b55cbb6e615f57a", "question": {"question_id": "sample_345_a1083_q0", "video_id": 345, "video_path": "./videos/sample_345_real.mp4", "annotation_index": 1083, "question_index": 0, "question": "What is the best summary of the actions taken just now?", "options": ["A. A worker filled a bag with fries, attached an order slip, delivered the bag to the customer, and returned to their station.", "B. A worker packed a bag with a cheeseburger, sealed it, printed an order slip, and handed it to another worker.", "C. A worker grabbed a bag, placed the order receipt with it, and headed to the pick-up counter to deliver the order.", "D. A worker assembled a sandwich, confirmed the customer's name, and moved to the serving counter."], "answer": "C", "time_stamp_s": 206, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [196, 206], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_345_a1083_q0", "video_id": 345, "time_stamp_s": 206, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f29814279c8a9cfec1ba0f32340de8f311828ae8af8174b4f177ef63dc515dc8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "97ceff1ce4e94a0478a8934bf15c28987151cf5236d1c2e856c5dc737a4d1932", "num_recent_frames": 30, "tq": 715797.780953316, "t1": 715805.054736573, "ta": 715805.054736573, "te": 715805.092282044, "first_response_s": 7.273783256998286, "answer_total_s": 7.311328727984801, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_345_a1083_q0", "video_id": 345, "time_stamp_s": 206, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "16e3e82b7e8a6bfdc94944a8e4ede35fd23d362629e29acbabe55cdfd55634cc", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person holds a paper bag and places it on a counter near a food preparation station.  \n- Another person in a blue shirt is seen working at a counter with a computer screen displaying McDonald's branding.  \n- A hand places a plastic cup on a white tray, which is positioned in front of a screen showing beverage options.\n[30-60s] - Person holds a brown paper bag with \"Burger King\" logo, then opens it to reveal a receipt and two white paper bags inside.  \n- The person places the receipt on a counter, then picks up a white paper bag and moves it toward a display case with food items.  \n- A second person in a red shirt is seen in the background near a counter with a coffee machine, while another person in a purple shirt stands nearby.\n[60-90s] - Hand inserts a metal cup into a coffee machine's dispensing port, then removes it after filling.  \n- The machine's digital display shows operational indicators, including a green light and icons for various coffee types.  \n- A person in a red shirt is visible in the background, moving near the counter.\n[90-120s] - Person holds a paper box with a yellow item and a small container of ice cream, moving toward a counter.  \n- Another person in a red shirt is visible in the background, near a food preparation area.  \n- A white bottle labeled \"0.0\" is picked up and held, then placed on a counter near a coffee machine.\n[120-150s] - Hand holds a brown paper bag with McDonald's logo, moving it toward a counter area.  \n- Another hand places a white paper bag on a metal counter, near a coffee machine.  \n- A person in a blue shirt stands near the counter, observing the actions.\n[150-180s] - A person in a black shirt is seen handling brown paper bags, placing them on a metal counter.  \n- Another individual in a red shirt is visible in the background, seated near a coffee machine.  \n- A hand holds a small paper bag with a logo, moving it toward a counter area with various kitchen equipment.", "history_tokens": 460, "history_utf8_bytes": 1954, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "97ceff1ce4e94a0478a8934bf15c28987151cf5236d1c2e856c5dc737a4d1932", "num_recent_frames": 30, "tq": 715703.575810121, "t1": 715711.654130862, "ta": 715711.654130862, "te": 715711.690749343, "first_response_s": 8.07832074095495, "answer_total_s": 8.114939221995883, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 345, "content_group": "ef2eb63e5cccb42ca7408f337130a5a6e0e46b152f0cc2f34b55cbb6e615f57a", "question": {"question_id": "sample_345_a1084_q0", "video_id": 345, "video_path": "./videos/sample_345_real.mp4", "annotation_index": 1084, "question_index": 0, "question": "What is the best summary of the actions taken just now?", "options": ["A. A worker reviewed a customer's order, cleaned the workstation, and prepared it for the next task.", "B. A worker assembled a new order from scratch, wrapped each item, and handed it to the kitchen staff.", "C. A worker retrieved a filled order bag, attached the order slip to the bag, and delivered it to the front counter.", "D. A worker took a customer's order, processed the payment, and handed the receipt to a colleague."], "answer": "C", "time_stamp_s": 304, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [294, 304], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_345_a1084_q0", "video_id": 345, "time_stamp_s": 304, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a92dad51b666f126c92b45c688abc92e4931246a2fe93f6dd68ca2fb37145d80", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.00038333333333, 285.0013833333333, 286.00238333333334, 287.0033833333333, 288.00438333333335, 289.0053833333333, 290.00638333333336, 291.00738333333334, 292.0083833333333, 293.00938333333335, 294.0103833333333, 295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333, 300.01638333333335, 301.0007, 302.0017, 303.0027], "recent_frames_sha256": "c3b81e11a4657a67e5e0935bcfbe025ca172f17ac9ca7dc1958afcb1e973c382", "num_recent_frames": 30, "tq": 715805.099849471, "t1": 715816.807319697, "ta": 715816.807319697, "te": 715816.844820886, "first_response_s": 11.707470225985162, "answer_total_s": 11.744971415027976, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_345_a1084_q0", "video_id": 345, "time_stamp_s": 304, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ad186a01b5891a6a7b22c8376750cbde354a70799c4b69d524fe3181d3086284", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person holds a paper bag and places it on a counter near a food preparation station.  \n- Another person in a blue shirt is seen working at a counter with a computer screen displaying McDonald's branding.  \n- A hand places a plastic cup on a white tray, which is positioned in front of a screen showing beverage options.\n[30-60s] - Person holds a brown paper bag with \"Burger King\" logo, then opens it to reveal a receipt and two white paper bags inside.  \n- The person places the receipt on a counter, then picks up a white paper bag and moves it toward a display case with food items.  \n- A second person in a red shirt is seen in the background near a counter with a coffee machine, while another person in a purple shirt stands nearby.\n[60-90s] - Hand inserts a metal cup into a coffee machine's dispensing port, then removes it after filling.  \n- The machine's digital display shows operational indicators, including a green light and icons for various coffee types.  \n- A person in a red shirt is visible in the background, moving near the counter.\n[90-120s] - Person holds a paper box with a yellow item and a small container of ice cream, moving toward a counter.  \n- Another person in a red shirt is visible in the background, near a food preparation area.  \n- A white bottle labeled \"0.0\" is picked up and held, then placed on a counter near a coffee machine.\n[120-150s] - Hand holds a brown paper bag with McDonald's logo, moving it toward a counter area.  \n- Another hand places a white paper bag on a metal counter, near a coffee machine.  \n- A person in a blue shirt stands near the counter, observing the actions.\n[150-180s] - A person in a black shirt is seen handling brown paper bags, placing them on a metal counter.  \n- Another individual in a red shirt is visible in the background, seated near a coffee machine.  \n- A hand holds a small paper bag with a logo, moving it toward a counter area with various kitchen equipment.\n[180-210s] - Hands open a brown paper bag, revealing a box of fries inside, while another person in a blue hoodie stands nearby.  \n- A person in a red shirt is seen in the background, moving near a coffee machine.  \n- The camera pans to show a customer seated at a table, holding a paper bag, with a staff member in a blue uniform standing beside them.\n[210-240s] - A person in a blue shirt is seen handling a brown paper bag near a coffee machine labeled \"ICE COFFEE\".  \n- Another individual in a red shirt is standing near a counter with a tray, possibly preparing food or drink.  \n- The camera pans to show a kitchen area with stainless steel appliances, including a large oven and a sink, with a person in a black shirt working nearby.\n[240-270s] - A hand opens a brown paper bag, revealing a white paper insert with printed text, likely a receipt or order confirmation.  \n- The bag is then placed on a stainless steel counter, near a cash register and a coffee machine, indicating a fast-food or café setting.  \n- Another person in a black shirt is seen handling a similar bag, suggesting a collaborative or sequential process in the service area.\n[270-300s] - Person in black shirt places brown paper bag on metal counter while another person in orange shirt stands nearby.  \n- Hands hold and open a brown paper bag with McDonald's logo, revealing a yellow plastic container inside.  \n- A yellow plastic container with a lid is placed into a brown paper bag, which is then set on a metal counter.", "history_tokens": 807, "history_utf8_bytes": 3458, "recent_frame_times_s": [274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.00038333333333, 285.0013833333333, 286.00238333333334, 287.0033833333333, 288.00438333333335, 289.0053833333333, 290.00638333333336, 291.00738333333334, 292.0083833333333, 293.00938333333335, 294.0103833333333, 295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333, 300.01638333333335, 301.0007, 302.0017, 303.0027], "recent_frames_sha256": "c3b81e11a4657a67e5e0935bcfbe025ca172f17ac9ca7dc1958afcb1e973c382", "num_recent_frames": 30, "tq": 715744.419516264, "t1": 715752.019430933, "ta": 715752.019430933, "te": 715752.255979725, "first_response_s": 7.599914669059217, "answer_total_s": 7.83646346104797, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 345, "content_group": "ef2eb63e5cccb42ca7408f337130a5a6e0e46b152f0cc2f34b55cbb6e615f57a", "question": {"question_id": "sample_345_a1085_q0", "video_id": 345, "video_path": "./videos/sample_345_real.mp4", "annotation_index": 1085, "question_index": 0, "question": "What is the best summary of the actions taken just now?", "options": ["A. A worker checked an order ticket, filled a bag with food items, and placed the bag on the counter.", "B. A worker retrieved a receipt, confirmed the order with the customer, and then handed the order to another worker.", "C. A worker attached a ticket to a bag, moved to the front counter, and handed the bag to a customer.", "D. A worker processed a payment, handed the change to a customer, and returned to the kitchen."], "answer": "C", "time_stamp_s": 402, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [392, 402], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_345_a1085_q0", "video_id": 345, "time_stamp_s": 402, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bccb295cb1c5e3a4456858b4c4de5a8224203724ea8fd8d078731dca57e3449a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.00028333333336, 385.00128333333333, 386.0022833333333, 387.00328333333334, 388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006], "recent_frames_sha256": "7054f477ee59cb15e9ceff91c820a9936229eecc3be14eca9f24bfb2655d1361", "num_recent_frames": 30, "tq": 715816.852566664, "t1": 715829.153205709, "ta": 715829.153205709, "te": 715829.19140249, "first_response_s": 12.300639044959098, "answer_total_s": 12.338835826027207, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_345_a1085_q0", "video_id": 345, "time_stamp_s": 402, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2a4d9997bcbfed9830067c1d9799627a3dc953a22751447a43e4309311c4277f", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Person holds a brown paper bag with \"Burger King\" logo, then opens it to reveal a receipt and two white paper bags inside.  \n- The person places the receipt on a counter, then picks up a white paper bag and moves it toward a display case with food items.  \n- A second person in a red shirt is seen in the background near a counter with a coffee machine, while another person in a purple shirt stands nearby.\n[60-90s] - Hand inserts a metal cup into a coffee machine's dispensing port, then removes it after filling.  \n- The machine's digital display shows operational indicators, including a green light and icons for various coffee types.  \n- A person in a red shirt is visible in the background, moving near the counter.\n[90-120s] - Person holds a paper box with a yellow item and a small container of ice cream, moving toward a counter.  \n- Another person in a red shirt is visible in the background, near a food preparation area.  \n- A white bottle labeled \"0.0\" is picked up and held, then placed on a counter near a coffee machine.\n[120-150s] - Hand holds a brown paper bag with McDonald's logo, moving it toward a counter area.  \n- Another hand places a white paper bag on a metal counter, near a coffee machine.  \n- A person in a blue shirt stands near the counter, observing the actions.\n[150-180s] - A person in a black shirt is seen handling brown paper bags, placing them on a metal counter.  \n- Another individual in a red shirt is visible in the background, seated near a coffee machine.  \n- A hand holds a small paper bag with a logo, moving it toward a counter area with various kitchen equipment.\n[180-210s] - Hands open a brown paper bag, revealing a box of fries inside, while another person in a blue hoodie stands nearby.  \n- A person in a red shirt is seen in the background, moving near a coffee machine.  \n- The camera pans to show a customer seated at a table, holding a paper bag, with a staff member in a blue uniform standing beside them.\n[210-240s] - A person in a blue shirt is seen handling a brown paper bag near a coffee machine labeled \"ICE COFFEE\".  \n- Another individual in a red shirt is standing near a counter with a tray, possibly preparing food or drink.  \n- The camera pans to show a kitchen area with stainless steel appliances, including a large oven and a sink, with a person in a black shirt working nearby.\n[240-270s] - A hand opens a brown paper bag, revealing a white paper insert with printed text, likely a receipt or order confirmation.  \n- The bag is then placed on a stainless steel counter, near a cash register and a coffee machine, indicating a fast-food or café setting.  \n- Another person in a black shirt is seen handling a similar bag, suggesting a collaborative or sequential process in the service area.\n[270-300s] - Person in black shirt places brown paper bag on metal counter while another person in orange shirt stands nearby.  \n- Hands hold and open a brown paper bag with McDonald's logo, revealing a yellow plastic container inside.  \n- A yellow plastic container with a lid is placed into a brown paper bag, which is then set on a metal counter.\n[300-330s] - Hands open a small white packet labeled \"Caffeine Free\" and place it on a counter.  \n- A brown paper bag is picked up and held, with a visible \"Caffeine Free\" label on its side.  \n- The bag is then opened to reveal a dark, possibly coffee-like substance inside.\n[330-360s] - A person holds a brown paper bag with yellow text, moving it toward a counter area.  \n- Another person in a black shirt is seen handling a large cardboard box near the kitchen equipment.  \n- A woman with long dark hair carries a large paper bag, walking past stainless steel appliances and toward the kitchen workspace.\n[360-390s] - A person in a black shirt hands a brown paper bag to another individual near a counter.  \n- A man in a red shirt stands beside a heated food display, observing the transaction.  \n- The camera holder holds a receipt labeled \"20¢\" while standing near a counter with a visible \"Ebay\" sign in the background.", "history_tokens": 962, "history_utf8_bytes": 4055, "recent_frame_times_s": [372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.00028333333336, 385.00128333333333, 386.0022833333333, 387.00328333333334, 388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006], "recent_frames_sha256": "7054f477ee59cb15e9ceff91c820a9936229eecc3be14eca9f24bfb2655d1361", "num_recent_frames": 30, "tq": 715772.385151977, "t1": 715780.969493707, "ta": 715780.969493707, "te": 715781.196293474, "first_response_s": 8.584341729991138, "answer_total_s": 8.811141496989876, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 346, "content_group": "c055220b51d52ea8931cdd07c7dab10f152cdb6fddd81fa476d2c53a04da21d3", "question": {"question_id": "sample_346_a1250_q0", "video_id": 346, "video_path": "./videos/sample_346_real.mp4", "annotation_index": 1250, "question_index": 0, "question": "What is the best summary of the actions performed just now?", "options": ["A. The individual retrieved a bun, added ketchup, and served it to the customer.", "B. The individual prepared a sandwich, added lettuce and turkey, and placed it on a tray.", "C. The individual assembled a cheeseburger by retrieving cheese slices and placing them on buns.", "D. The individual took a hot dog, added condiments, and wrapped it before serving."], "answer": "C", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_346_a1250_q0", "video_id": 346, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0e69d6d9f670015215feddabdea083f9f4423fd24928e2737031740afb5689dc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "487cd38a534515fb82ec203c55f29c5809af501a36634590bf82bd79af5a2116", "num_recent_frames": 10, "tq": 718661.601660758, "t1": 718667.157100005, "ta": 718667.157100005, "te": 718667.194920795, "first_response_s": 5.555439246934839, "answer_total_s": 5.593260037014261, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_346_a1250_q0", "video_id": 346, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b13b6678f5872a36a4ad0e9089fb6d53e6c63b2df624d60f7b134508ff866653", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "487cd38a534515fb82ec203c55f29c5809af501a36634590bf82bd79af5a2116", "num_recent_frames": 10, "tq": 718574.732043592, "t1": 718581.573959082, "ta": 718581.573959082, "te": 718581.611786722, "first_response_s": 6.841915489989333, "answer_total_s": 6.8797431299462914, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 346, "content_group": "c055220b51d52ea8931cdd07c7dab10f152cdb6fddd81fa476d2c53a04da21d3", "question": {"question_id": "sample_346_a1251_q0", "video_id": 346, "video_path": "./videos/sample_346_real.mp4", "annotation_index": 1251, "question_index": 0, "question": "Which of the following options best summarizes the actions performed just now?", "options": ["A. The individual retrieved a food tray, added vegetables, and handed it to a colleague.", "B. The individual assembled a cheeseburger, prepared the packaging, and wrapped it.", "C. The individual prepared a salad, selected dressing, and presented it for immediate delivery.", "D. The individual checked order tickets, selected package."], "answer": "D", "time_stamp_s": 67, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [57, 67], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_346_a1251_q0", "video_id": 346, "time_stamp_s": 67, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0dfc9db935201cc585c210905fccaab443a1ca10a99690937d5ce84001a6d55f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.00095, 52.00195, 53.00295, 54.00395, 55.00495, 56.00595, 57.00695, 58.00795, 59.00895, 60.00995, 61.01095, 62.01195, 63.01295, 64.01395, 65.01495, 66.01595], "recent_frames_sha256": "7236e1782f59673bbce65eb93d01ba1a0e7532e1db583d5b94d0fb1986cc23d4", "num_recent_frames": 30, "tq": 718667.213019524, "t1": 718674.983656724, "ta": 718674.983656724, "te": 718675.021226911, "first_response_s": 7.770637199981138, "answer_total_s": 7.808207386988215, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_346_a1251_q0", "video_id": 346, "time_stamp_s": 67, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b5d56583c7e71bf610e7a382d6c725838c4ea7d9c58de9e02d9acdc8aaaf9abb", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands wearing gloves pick up burger patties from a tray and place them on paper liners.  \n- The person arranges the patties on paper liners while moving them across a stainless steel counter.  \n- Various food items, including cheese and greens, are visible in containers on shelves behind the counter.\n[30-60s] - Hand selects and places yellow cheese slices onto a tray near a display of green relish and sliced onions.  \n- Hand picks up a toasted bun from a stacked tray, then moves toward a stainless steel counter with a coffee machine.  \n- Hand places the bun on a counter next to a container of yellow cheese slices and a stack of paper napkins.", "history_tokens": 148, "history_utf8_bytes": 660, "recent_frame_times_s": [37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.00095, 52.00195, 53.00295, 54.00395, 55.00495, 56.00595, 57.00695, 58.00795, 59.00895, 60.00995, 61.01095, 62.01195, 63.01295, 64.01395, 65.01495, 66.01595], "recent_frames_sha256": "7236e1782f59673bbce65eb93d01ba1a0e7532e1db583d5b94d0fb1986cc23d4", "num_recent_frames": 30, "tq": 718601.878557111, "t1": 718608.374465802, "ta": 718608.374465802, "te": 718608.524943876, "first_response_s": 6.495908690965734, "answer_total_s": 6.6463867649436, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 346, "content_group": "c055220b51d52ea8931cdd07c7dab10f152cdb6fddd81fa476d2c53a04da21d3", "question": {"question_id": "sample_346_a1252_q0", "video_id": 346, "video_path": "./videos/sample_346_real.mp4", "annotation_index": 1252, "question_index": 0, "question": "Which of the following options best summarizes the actions performed just now?", "options": ["A. The individual prepared a sandwich by taking out bread, adding cheese, and toasting it.", "B. The individual organized order tickets, prepared packaging materials, and assembled them for food items.", "C. The individual operated the deep fryer to cook fries and then placed them into containers.", "D. The individual checked order tickets, prepared the packaging, and organized prepared items."], "answer": "D", "time_stamp_s": 124, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [114, 124], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_346_a1252_q0", "video_id": 346, "time_stamp_s": 124, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c1cd7cafc7f4da98b876839ef18c3d2e8954db3421d367c994d83b8334b2c734", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666], "recent_frames_sha256": "e102753379f45e16d040231febbdaa88fa435e17bfb3e1062a64076d54c0059b", "num_recent_frames": 30, "tq": 718675.039703085, "t1": 718686.31317712, "ta": 718686.31317712, "te": 718686.350857059, "first_response_s": 11.27347403508611, "answer_total_s": 11.311153974034823, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_346_a1252_q0", "video_id": 346, "time_stamp_s": 124, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b6860fa73413a43449959461c20726dbc9c8cd9be4a838f5d4768eb6eede52a7", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands wearing gloves pick up burger patties from a tray and place them on paper liners.  \n- The person arranges the patties on paper liners while moving them across a stainless steel counter.  \n- Various food items, including cheese and greens, are visible in containers on shelves behind the counter.\n[30-60s] - Hand selects and places yellow cheese slices onto a tray near a display of green relish and sliced onions.  \n- Hand picks up a toasted bun from a stacked tray, then moves toward a stainless steel counter with a coffee machine.  \n- Hand places the bun on a counter next to a container of yellow cheese slices and a stack of paper napkins.\n[60-90s] - Hands place a yellow paper towel on a stainless steel counter near stacked buns and cheese containers.  \n- A person’s hands pick up a bun and apply a yellow condiment from a squeeze bottle onto it.  \n- Another hand reaches for a container of green relish, positioning it near the bun being prepared.\n[90-120s] - Hands place two burger patties onto a yellow paper tray, then add cheese slices from a container.  \n- A hand picks up a burger bun from a stack, then places it into a burger press machine.  \n- The burger press is operated, and the cooked burger is removed, followed by placing it on a yellow paper tray.", "history_tokens": 297, "history_utf8_bytes": 1289, "recent_frame_times_s": [94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666], "recent_frames_sha256": "e102753379f45e16d040231febbdaa88fa435e17bfb3e1062a64076d54c0059b", "num_recent_frames": 30, "tq": 718624.112807655, "t1": 718625.976922331, "ta": 718625.976922331, "te": 718626.34994934, "first_response_s": 1.8641146760201082, "answer_total_s": 2.237141684978269, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 346, "content_group": "c055220b51d52ea8931cdd07c7dab10f152cdb6fddd81fa476d2c53a04da21d3", "question": {"question_id": "sample_346_a1253_q0", "video_id": 346, "video_path": "./videos/sample_346_real.mp4", "annotation_index": 1253, "question_index": 0, "question": "Which of the following options best summarizes the actions performed just now?", "options": ["A. The individual retrieved a bun, added condiments, and wrapped it for serving.", "B. The individual assembled a cheeseburger, placing cheese slices.", "C. The individual cooked burger patties, added toppings, and handed them to a colleague.", "D. The individual prepared the packaging boxes, placed burger patties in them, and added condiments."], "answer": "B", "time_stamp_s": 181, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [171, 181], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_346_a1253_q0", "video_id": 346, "time_stamp_s": 181, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "01d20924506914bb77de464335476f37cc6eea5eb4ffd971a74420a882370556", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668], "recent_frames_sha256": "2be1a5905ab1cc88d4410c9f367c60c56f964e28b550c052801cd20ce3f73edc", "num_recent_frames": 30, "tq": 718686.362729679, "t1": 718693.264936742, "ta": 718693.264936742, "te": 718693.302788221, "first_response_s": 6.902207063045353, "answer_total_s": 6.940058542066254, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_346_a1253_q0", "video_id": 346, "time_stamp_s": 181, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "62ed45f707d2f470c7be6e0db2f3040462cfb56ef6701df416b505dd7226488f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands wearing gloves pick up burger patties from a tray and place them on paper liners.  \n- The person arranges the patties on paper liners while moving them across a stainless steel counter.  \n- Various food items, including cheese and greens, are visible in containers on shelves behind the counter.\n[30-60s] - Hand selects and places yellow cheese slices onto a tray near a display of green relish and sliced onions.  \n- Hand picks up a toasted bun from a stacked tray, then moves toward a stainless steel counter with a coffee machine.  \n- Hand places the bun on a counter next to a container of yellow cheese slices and a stack of paper napkins.\n[60-90s] - Hands place a yellow paper towel on a stainless steel counter near stacked buns and cheese containers.  \n- A person’s hands pick up a bun and apply a yellow condiment from a squeeze bottle onto it.  \n- Another hand reaches for a container of green relish, positioning it near the bun being prepared.\n[90-120s] - Hands place two burger patties onto a yellow paper tray, then add cheese slices from a container.  \n- A hand picks up a burger bun from a stack, then places it into a burger press machine.  \n- The burger press is operated, and the cooked burger is removed, followed by placing it on a yellow paper tray.\n[120-150s] - Hands place burger patties onto yellow paper liners on a stainless steel counter.  \n- A white paper with \"142\" printed on it is held and then placed near the burger patties.  \n- A hand reaches for a container of cheese slices, positioning it near the burger assembly area.\n[150-180s] - Hands place a paper bag on the counter, then pick up a burger bun from a tray.  \n- The person selects cheese slices from a container and places them on the bun.  \n- A container of pickles is visible nearby, but no action is taken with it.", "history_tokens": 434, "history_utf8_bytes": 1827, "recent_frame_times_s": [151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668], "recent_frames_sha256": "2be1a5905ab1cc88d4410c9f367c60c56f964e28b550c052801cd20ce3f73edc", "num_recent_frames": 30, "tq": 718643.473413858, "t1": 718649.696954374, "ta": 718649.696954374, "te": 718649.734962236, "first_response_s": 6.223540515988134, "answer_total_s": 6.261548378039151, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 346, "content_group": "c055220b51d52ea8931cdd07c7dab10f152cdb6fddd81fa476d2c53a04da21d3", "question": {"question_id": "sample_346_a1254_q0", "video_id": 346, "video_path": "./videos/sample_346_real.mp4", "annotation_index": 1254, "question_index": 0, "question": "Which of the following options best summarizes the actions performed just now?", "options": ["A. The individual took a food tray, assembled a hot dog, and handed it to a customer.", "B. The individual retrieved burger buns, assembled cheeseburgers, and moved them to the packaging area.", "C. The individual collected order tickets, retrieved package, and organized them for next turn.", "D. The individual took the order tickets, prepared beverage cups, and filled them with various drinks."], "answer": "C", "time_stamp_s": 238, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [228, 238], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_346_a1254_q0", "video_id": 346, "time_stamp_s": 238, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b8404b9ed1211c7c4c9011d13b1b448904c58289a1e0b83cf5c608c1ae94a6a1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666, 218.00111666666666, 219.00211666666667, 220.00311666666667, 221.00411666666668, 222.00511666666668, 223.00611666666666, 224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333], "recent_frames_sha256": "60c2256c8bf8a774ca3ccc37856375fc2683c788ac1212d1b63e4f49f32968eb", "num_recent_frames": 30, "tq": 718693.313170326, "t1": 718703.834480928, "ta": 718703.834480928, "te": 718703.871940505, "first_response_s": 10.52131060208194, "answer_total_s": 10.558770179050043, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_346_a1254_q0", "video_id": 346, "time_stamp_s": 238, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d48c833732ef75a1abbdb65c2aae60fc15ff37389ea9c41ab26ce2a95f7f0a97", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands wearing gloves pick up burger patties from a tray and place them on paper liners.  \n- The person arranges the patties on paper liners while moving them across a stainless steel counter.  \n- Various food items, including cheese and greens, are visible in containers on shelves behind the counter.\n[30-60s] - Hand selects and places yellow cheese slices onto a tray near a display of green relish and sliced onions.  \n- Hand picks up a toasted bun from a stacked tray, then moves toward a stainless steel counter with a coffee machine.  \n- Hand places the bun on a counter next to a container of yellow cheese slices and a stack of paper napkins.\n[60-90s] - Hands place a yellow paper towel on a stainless steel counter near stacked buns and cheese containers.  \n- A person’s hands pick up a bun and apply a yellow condiment from a squeeze bottle onto it.  \n- Another hand reaches for a container of green relish, positioning it near the bun being prepared.\n[90-120s] - Hands place two burger patties onto a yellow paper tray, then add cheese slices from a container.  \n- A hand picks up a burger bun from a stack, then places it into a burger press machine.  \n- The burger press is operated, and the cooked burger is removed, followed by placing it on a yellow paper tray.\n[120-150s] - Hands place burger patties onto yellow paper liners on a stainless steel counter.  \n- A white paper with \"142\" printed on it is held and then placed near the burger patties.  \n- A hand reaches for a container of cheese slices, positioning it near the burger assembly area.\n[150-180s] - Hands place a paper bag on the counter, then pick up a burger bun from a tray.  \n- The person selects cheese slices from a container and places them on the bun.  \n- A container of pickles is visible nearby, but no action is taken with it.\n[180-210s] - Hands place a round, golden-brown bread slice onto a white paper tray.  \n- A gloved hand reaches for a yellow cheese block from a container, then places it onto the bread.  \n- The tray is moved toward a stainless steel counter where a digital scale is visible.", "history_tokens": 502, "history_utf8_bytes": 2101, "recent_frame_times_s": [208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666, 218.00111666666666, 219.00211666666667, 220.00311666666667, 221.00411666666668, 222.00511666666668, 223.00611666666666, 224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333], "recent_frames_sha256": "60c2256c8bf8a774ca3ccc37856375fc2683c788ac1212d1b63e4f49f32968eb", "num_recent_frames": 30, "tq": 718660.158475814, "t1": 718661.421396851, "ta": 718661.421396851, "te": 718661.570166757, "first_response_s": 1.262921036919579, "answer_total_s": 1.4116909429430962, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 348, "content_group": "e4dd7b7019acbed168de85ec02af94a749ac17f121f19f7985d2dc67f99bc7a8", "question": {"question_id": "sample_348_a0_q0", "video_id": 348, "video_path": "./videos/sample_348_real.mp4", "annotation_index": 0, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual organized serving trays and sanitized the preparation area.", "B. The individual retrieved produce from the refrigerator and began chopping vegetables.", "C. The individual replenished bread inventory by placing new buns onto the shelves.", "D. The individual checked inventory levels and noted items lacking in stock."], "answer": "C", "time_stamp_s": 31, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_348_a0_q0", "video_id": 348, "time_stamp_s": 31, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2f600282d326f4ccd6602d26c28ca147f1ccb15f073de5d20cd5cdcf40bb4d0b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665, 20.003316666666667, 21.004316666666668, 22.005316666666666, 23.006316666666667, 24.007316666666668, 25.008316666666666, 26.009316666666667, 27.010316666666668, 28.011316666666666, 29.012316666666667, 30.013316666666668], "recent_frames_sha256": "799f6a44709a81f69d8a9c47f6182e80d014804137278a8979e94314010da958", "num_recent_frames": 30, "tq": 716449.027393265, "t1": 716449.690308575, "ta": 716449.690308575, "te": 716449.727912863, "first_response_s": 0.66291531000752, "answer_total_s": 0.7005195979727432, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_348_a0_q0", "video_id": 348, "time_stamp_s": 31, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f7cf8ad68c985ef54d26c3a6a4041e7ff7470eeb061f9423e60d80d674af18b8", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person opens a commercial dishwasher, removes a metal rack, and places it on a counter.  \n- They handle a blue plastic bag, then transfer a tray of packaged buns from a display case to the rack.  \n- The person wears blue gloves and stands on a tiled floor in a kitchen setting with various food items and equipment visible.", "history_tokens": 76, "history_utf8_bytes": 333, "recent_frame_times_s": [1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665, 20.003316666666667, 21.004316666666668, 22.005316666666666, 23.006316666666667, 24.007316666666668, 25.008316666666666, 26.009316666666667, 27.010316666666668, 28.011316666666666, 29.012316666666667, 30.013316666666668], "recent_frames_sha256": "799f6a44709a81f69d8a9c47f6182e80d014804137278a8979e94314010da958", "num_recent_frames": 30, "tq": 716206.533826861, "t1": 716213.446515203, "ta": 716213.446515203, "te": 716213.63702759, "first_response_s": 6.912688342039473, "answer_total_s": 7.103200729005039, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 348, "content_group": "e4dd7b7019acbed168de85ec02af94a749ac17f121f19f7985d2dc67f99bc7a8", "question": {"question_id": "sample_348_a1_q0", "video_id": 348, "video_path": "./videos/sample_348_real.mp4", "annotation_index": 1, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual prepared a burger by retrieving buns, and placing them on the package.", "B. The individual organized utensils by sanitizing them and placing them back in their designated areas.", "C. The individual cleaned the preparation area and refilled condiment dispensers.", "D. The individual baked a batch of fresh buns and arranged them in an orderly manner."], "answer": "A", "time_stamp_s": 206, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [197, 207], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_348_a1_q0", "video_id": 348, "time_stamp_s": 206, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a3ff8a912e8867909ae29ec182c414d6be8f2ff16dbbf398b227608f7b9ae0ca", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "a331cd4cb0234290f891ba6c818219890f78423282cf41522fdb806c5275e20d", "num_recent_frames": 30, "tq": 716449.743293934, "t1": 716464.137611179, "ta": 716464.137611179, "te": 716464.174809379, "first_response_s": 14.394317244994454, "answer_total_s": 14.431515445001423, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_348_a1_q0", "video_id": 348, "time_stamp_s": 206, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e163fff2614f90f796be0b126078e78e02e1c22d2e7482ac5f7e3b8b1d6cf103", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person opens a commercial dishwasher, removes a metal rack, and places it on a counter.  \n- They handle a blue plastic bag, then transfer a tray of packaged buns from a display case to the rack.  \n- The person wears blue gloves and stands on a tiled floor in a kitchen setting with various food items and equipment visible.\n[30-60s] - Hands place a burger patty on a bun, then add cheese and lettuce from adjacent containers.  \n- Worker picks up a container of shredded cheese, opens it, and prepares to add it to the burger.  \n- The worker’s gloved hands handle food items, with a focus on assembling the burger on a stainless steel counter.\n[60-90s] - Hands in gloves place a small white packet into a tray near cheese and condiment containers.  \n- Person pulls out a metal cart holding trays of packaged buns, then moves to another cart with more buns.  \n- Buns are arranged on a stainless steel counter, with some trays already containing buns and others empty.\n[90-120s] - Worker places burger buns on a tray, then adds cheese slices from a container.  \n- Another worker hands over a container of green relish to the first worker.  \n- Worker uses a yellow paper wrapper to cover the assembled burger.\n[120-150s] - Hands place burger buns on yellow trays, then add toppings like lettuce and cheese.  \n- A tray of buns is moved to a metal counter, where a person picks up a bun.  \n- The person places a bun on a tray, then moves to a different station, possibly for further assembly.\n[150-180s] - Hands place burger patties onto yellow paper liners on a stainless steel counter.  \n- Worker retrieves a blue-wrapped item from a refrigerated cart, then places it on a tray.  \n- A stainless steel oven is visible in the background, with trays of food items stacked nearby.", "history_tokens": 426, "history_utf8_bytes": 1784, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "a331cd4cb0234290f891ba6c818219890f78423282cf41522fdb806c5275e20d", "num_recent_frames": 30, "tq": 716279.190430349, "t1": 716281.00709964, "ta": 716281.00709964, "te": 716281.20983267, "first_response_s": 1.8166692910017446, "answer_total_s": 2.0194023210788146, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 348, "content_group": "e4dd7b7019acbed168de85ec02af94a749ac17f121f19f7985d2dc67f99bc7a8", "question": {"question_id": "sample_348_a2_q0", "video_id": 348, "video_path": "./videos/sample_348_real.mp4", "annotation_index": 2, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual arranged fresh vegetables on plates and prepared salads.", "B. The individual topped burger buns with ketchup, onions.", "C. The individual arranged freshly cut fruits into serving containers.", "D. The individual prepared sandwiches by arranging cheese and lettuce on bread slices."], "answer": "B", "time_stamp_s": 403, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [394, 404], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_348_a2_q0", "video_id": 348, "time_stamp_s": 403, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a238a34e7f09bc9abb163414c33fa870ae16dca0ebd92fd184bb378dc58a794d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.00028333333336, 385.00128333333333, 386.0022833333333, 387.00328333333334, 388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016], "recent_frames_sha256": "5242737f4fb6e4ab0af9eba76806861054b469115017623fd8415a93ca77933e", "num_recent_frames": 30, "tq": 716464.190554823, "t1": 716475.857660989, "ta": 716475.857660989, "te": 716475.895084649, "first_response_s": 11.66710616601631, "answer_total_s": 11.704529825947247, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_348_a2_q0", "video_id": 348, "time_stamp_s": 403, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "655703b96bb62bc30627f6b1e258626a7db9fdd071f4e643447f31848ab1c856", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person opens a commercial dishwasher, removes a metal rack, and places it on a counter.  \n- They handle a blue plastic bag, then transfer a tray of packaged buns from a display case to the rack.  \n- The person wears blue gloves and stands on a tiled floor in a kitchen setting with various food items and equipment visible.\n[30-60s] - Hands place a burger patty on a bun, then add cheese and lettuce from adjacent containers.  \n- Worker picks up a container of shredded cheese, opens it, and prepares to add it to the burger.  \n- The worker’s gloved hands handle food items, with a focus on assembling the burger on a stainless steel counter.\n[60-90s] - Hands in gloves place a small white packet into a tray near cheese and condiment containers.  \n- Person pulls out a metal cart holding trays of packaged buns, then moves to another cart with more buns.  \n- Buns are arranged on a stainless steel counter, with some trays already containing buns and others empty.\n[90-120s] - Worker places burger buns on a tray, then adds cheese slices from a container.  \n- Another worker hands over a container of green relish to the first worker.  \n- Worker uses a yellow paper wrapper to cover the assembled burger.\n[120-150s] - Hands place burger buns on yellow trays, then add toppings like lettuce and cheese.  \n- A tray of buns is moved to a metal counter, where a person picks up a bun.  \n- The person places a bun on a tray, then moves to a different station, possibly for further assembly.\n[150-180s] - Hands place burger patties onto yellow paper liners on a stainless steel counter.  \n- Worker retrieves a blue-wrapped item from a refrigerated cart, then places it on a tray.  \n- A stainless steel oven is visible in the background, with trays of food items stacked nearby.\n[180-210s] - Person in blue pants and white shoes walks across tiled floor toward food prep station.  \n- Hands in gloves handle burger buns and condiments on stainless steel counter.  \n- Another worker in dark uniform stands nearby, holding a tray with food items.\n[210-240s] - Hands in gloves place a yellow tray with eggs into a metal station, then retrieve a white paper towel.  \n- A worker in the background handles a tray of buns while another worker moves a tray of cheese slices.  \n- A metal rack with wrapped buns is pulled out, revealing a blue plastic container underneath.\n[240-270s] - Hands place burger buns onto a metal tray near a fryer, then transfer them to a baking rack.  \n- A large metal tray with a grid pattern is lifted and moved, revealing a baking rack underneath.  \n- A digital display on a machine shows \"10:00\" as the worker handles buns near a conveyor belt.\n[270-300s] - Person wearing gloves places a burger patty on a white tray near a cheese dispenser.  \n- Hands then pick up a slice of yellow cheese and position it over the patty.  \n- The cheese is held in place as the person prepares to add it to the burger.\n[300-330s] - Hands wearing gloves pick up burger buns from a plastic-wrapped tray, then place them on a white paper tray.  \n- A second worker in the background handles a tray of yellow items, likely condiments or toppings, near a stainless steel counter.  \n- The counter holds multiple containers with various ingredients, including mustard, ketchup, and cheese, arranged in a row.\n[330-360s] - Hands place buns into a metal tray under a heated surface, likely for toasting or warming.  \n- A yellow paper towel is used to wipe or clean the counter area near the buns.  \n- A digital display screen is visible, showing a transaction or order interface, suggesting a fast-food or automated ordering system.\n[360-390s] - Hands in gloves place burger buns onto a conveyor belt near a meat slicer.  \n- A tray of buns is moved from a storage area to the preparation station.  \n- A burger patty is placed on a bun, followed by a slice of cheese.", "history_tokens": 937, "history_utf8_bytes": 3868, "recent_frame_times_s": [373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.00028333333336, 385.00128333333333, 386.0022833333333, 387.00328333333334, 388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016], "recent_frames_sha256": "5242737f4fb6e4ab0af9eba76806861054b469115017623fd8415a93ca77933e", "num_recent_frames": 30, "tq": 716325.852535351, "t1": 716327.050103108, "ta": 716327.050103108, "te": 716327.087847047, "first_response_s": 1.1975677571026608, "answer_total_s": 1.2353116960730404, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 348, "content_group": "e4dd7b7019acbed168de85ec02af94a749ac17f121f19f7985d2dc67f99bc7a8", "question": {"question_id": "sample_348_a3_q0", "video_id": 348, "video_path": "./videos/sample_348_real.mp4", "annotation_index": 3, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual toasted the buns and added ketchup and mustard.", "B. The individual placed two buns in boxes, added cheese slices, and added condiments.", "C. The individual grilled burger patties and placed them on the buns with lettuce and pickles.", "D. The individual wrapped sandwiches with paper and handed them to the customer."], "answer": "B", "time_stamp_s": 607, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [591, 601], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_348_a3_q0", "video_id": 348, "time_stamp_s": 607, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "86a158b622be6a79243701e42ac58451ab2e6612ae0d95b999ad20ee8e1e1d88", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0000833333334, 585.0010833333333, 586.0020833333333, 587.0030833333333, 588.0040833333334, 589.0050833333333, 590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054], "recent_frames_sha256": "38a1d59a65c7d1ffac99d2aee34f4e0e28afedea15fbbac1e0df68cced344e2d", "num_recent_frames": 30, "tq": 716475.90709982, "t1": 716488.263467247, "ta": 716488.263467247, "te": 716488.299883432, "first_response_s": 12.356367427040823, "answer_total_s": 12.392783612012863, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_348_a3_q0", "video_id": 348, "time_stamp_s": 607, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8c1dda09049f547e449414b8ccc771f9a7230233807bca517af00bd6320c1a16", "condition_order": ["notes", "recent"], "memory": "[210-240s] - Hands in gloves place a yellow tray with eggs into a metal station, then retrieve a white paper towel.  \n- A worker in the background handles a tray of buns while another worker moves a tray of cheese slices.  \n- A metal rack with wrapped buns is pulled out, revealing a blue plastic container underneath.\n[240-270s] - Hands place burger buns onto a metal tray near a fryer, then transfer them to a baking rack.  \n- A large metal tray with a grid pattern is lifted and moved, revealing a baking rack underneath.  \n- A digital display on a machine shows \"10:00\" as the worker handles buns near a conveyor belt.\n[270-300s] - Person wearing gloves places a burger patty on a white tray near a cheese dispenser.  \n- Hands then pick up a slice of yellow cheese and position it over the patty.  \n- The cheese is held in place as the person prepares to add it to the burger.\n[300-330s] - Hands wearing gloves pick up burger buns from a plastic-wrapped tray, then place them on a white paper tray.  \n- A second worker in the background handles a tray of yellow items, likely condiments or toppings, near a stainless steel counter.  \n- The counter holds multiple containers with various ingredients, including mustard, ketchup, and cheese, arranged in a row.\n[330-360s] - Hands place buns into a metal tray under a heated surface, likely for toasting or warming.  \n- A yellow paper towel is used to wipe or clean the counter area near the buns.  \n- A digital display screen is visible, showing a transaction or order interface, suggesting a fast-food or automated ordering system.\n[360-390s] - Hands in gloves place burger buns onto a conveyor belt near a meat slicer.  \n- A tray of buns is moved from a storage area to the preparation station.  \n- A burger patty is placed on a bun, followed by a slice of cheese.\n[390-420s] - Hands in gloves place burger buns into a tray, then pick up a container of cheese slices.  \n- A metal counter holds various condiment containers, including ketchup and mustard, with a spatula nearby.  \n- A green plastic container with a lid is visible on the counter, possibly holding lettuce or another topping.\n[420-450s] - Hands in gloves place buns onto a tray, then move to a container of cheese slices.  \n- A white paper bag is opened and placed on the counter, with a yellow-labeled container nearby.  \n- The worker picks up a bun and places it into the paper bag, then reaches for a container of sliced cheese.\n[450-480s] - Hands place a yellow paper towel on the counter near a tray of buns.  \n- A hand picks up a white paper container from a stack on the counter.  \n- The hand then moves to grab a yellow paper towel from a nearby dispenser.\n[480-510s] - Hands place burger buns on yellow paper trays, positioning them side by side.  \n- A white paper towel is used to wipe the counter surface near the buns.  \n- The worker’s hands move toward a tray holding sliced cheese and other condiments.\n[510-540s] - Hands place a round, toasted bread item onto a paper tray, then pick up a second similar item from a nearby tray.  \n- The worker moves toward a metal cart holding various food items, including a yellow container and a tray with orange-colored food.  \n- A receipt is pulled from a machine, then used to open a brown paper bag, which is subsequently placed on the counter.\n[540-570s] - Person places a paper container on a stainless steel counter near a food preparation station.  \n- They then pick up a round, flat food item (likely a tortilla or bun) from a tray and place it into the container.  \n- A green spray bottle is used to apply a liquid (possibly seasoning or oil) onto the food item before it is placed into the container.\n[570-600s] - Person places a white tray with two yellow eggs into a stainless steel appliance, likely a griddle or fryer, positioned near a counter with condiment containers.  \n- The person then moves to a different section of the counter, where they pick up a container of sliced cheese, indicating preparation for assembling a dish.  \n- The workspace includes a variety of food items and equipment, such as a toaster, a cutting board, and a cart with bread rolls, suggesting a busy kitchen environment.", "history_tokens": 1012, "history_utf8_bytes": 4189, "recent_frame_times_s": [577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0000833333334, 585.0010833333333, 586.0020833333333, 587.0030833333333, 588.0040833333334, 589.0050833333333, 590.0060833333333, 591.0070833333333, 592.0080833333334, 593.0090833333334, 594.0100833333333, 595.0110833333333, 596.0120833333333, 597.0130833333334, 598.0140833333334, 599.0150833333333, 600.0160833333333, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044, 606.0054], "recent_frames_sha256": "38a1d59a65c7d1ffac99d2aee34f4e0e28afedea15fbbac1e0df68cced344e2d", "num_recent_frames": 30, "tq": 716380.959779033, "t1": 716382.222837489, "ta": 716382.222837489, "te": 716382.260556569, "first_response_s": 1.2630584560101852, "answer_total_s": 1.3007775360019878, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 348, "content_group": "e4dd7b7019acbed168de85ec02af94a749ac17f121f19f7985d2dc67f99bc7a8", "question": {"question_id": "sample_348_a4_q0", "video_id": 348, "video_path": "./videos/sample_348_real.mp4", "annotation_index": 4, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual selected burger buns, added patties, and placed them on a griddle.", "B. The individual retrieved burger buns, added lettuce and sauces, and placed them on a tray.", "C. The individual took burger buns, added lettuce and condiments, and arranged them on a preparation area.", "D. The individual cleaned the preparation area, organized serving trays, and put away ingredients."], "answer": "C", "time_stamp_s": 802, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [788, 798], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_348_a4_q0", "video_id": 348, "time_stamp_s": 802, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cab38fb499d124528378448b873a788ea81c1e8292a26574b5220d6c32c63e2c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [772.0045666666666, 773.0055666666667, 774.0065666666667, 775.0075666666667, 776.0085666666666, 777.0095666666666, 778.0105666666667, 779.0115666666667, 780.0125666666667, 781.0135666666666, 782.0145666666666, 783.0155666666667, 784.0165666666667, 785.0008833333334, 786.0018833333334, 787.0028833333333, 788.0038833333333, 789.0048833333333, 790.0058833333334, 791.0068833333333, 792.0078833333333, 793.0088833333333, 794.0098833333333, 795.0108833333334, 796.0118833333333, 797.0128833333333, 798.0138833333333, 799.0148833333334, 800.0158833333334, 801.0002], "recent_frames_sha256": "b356b3f27f715c6a0cb171a908f52d9f5b74fb3771c3b96b6d08e5cd746fd48a", "num_recent_frames": 30, "tq": 716488.309822419, "t1": 716500.770367662, "ta": 716500.770367662, "te": 716500.807983687, "first_response_s": 12.460545242996886, "answer_total_s": 12.498161268071271, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_348_a4_q0", "video_id": 348, "time_stamp_s": 802, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "819a149fed2d0bd0f0942ee063af4412948d1e80411e66bba16b05c05e237442", "condition_order": ["notes", "recent"], "memory": "[420-450s] - Hands in gloves place buns onto a tray, then move to a container of cheese slices.  \n- A white paper bag is opened and placed on the counter, with a yellow-labeled container nearby.  \n- The worker picks up a bun and places it into the paper bag, then reaches for a container of sliced cheese.\n[450-480s] - Hands place a yellow paper towel on the counter near a tray of buns.  \n- A hand picks up a white paper container from a stack on the counter.  \n- The hand then moves to grab a yellow paper towel from a nearby dispenser.\n[480-510s] - Hands place burger buns on yellow paper trays, positioning them side by side.  \n- A white paper towel is used to wipe the counter surface near the buns.  \n- The worker’s hands move toward a tray holding sliced cheese and other condiments.\n[510-540s] - Hands place a round, toasted bread item onto a paper tray, then pick up a second similar item from a nearby tray.  \n- The worker moves toward a metal cart holding various food items, including a yellow container and a tray with orange-colored food.  \n- A receipt is pulled from a machine, then used to open a brown paper bag, which is subsequently placed on the counter.\n[540-570s] - Person places a paper container on a stainless steel counter near a food preparation station.  \n- They then pick up a round, flat food item (likely a tortilla or bun) from a tray and place it into the container.  \n- A green spray bottle is used to apply a liquid (possibly seasoning or oil) onto the food item before it is placed into the container.\n[570-600s] - Person places a white tray with two yellow eggs into a stainless steel appliance, likely a griddle or fryer, positioned near a counter with condiment containers.  \n- The person then moves to a different section of the counter, where they pick up a container of sliced cheese, indicating preparation for assembling a dish.  \n- The workspace includes a variety of food items and equipment, such as a toaster, a cutting board, and a cart with bread rolls, suggesting a busy kitchen environment.\n[600-630s] - Hands place a yellow condiment container onto a stainless steel counter near a tray of sliced cheese.  \n- A white paper cup is picked up and held, likely for serving or holding condiments.  \n- The person moves toward a section with burger buns and other ingredients, indicating preparation for assembling a burger.\n[630-660s] - Hands in gloves place a paper towel over a burger patty in a fryer basket, then remove the basket from the fryer.  \n- Burger patty is transferred to a paper-lined tray, then a paper towel is placed over it.  \n- Hands pick up a burger bun and place it on the tray, then reach for cheese slices from a container.\n[660-690s] - A person in a dark shirt places burger buns on a tray while another person in a blue shirt handles a tray of cooked patties.  \n- A third person, wearing gloves, adds condiments to the buns using a squeeze bottle.  \n- The buns are arranged on a metal tray near a display case filled with various food items.\n[690-720s] - Worker places yellow-brown buns onto a metal tray, then transfers them to a conveyor belt.  \n- Hands wearing transparent gloves handle buns and move them across a stainless steel surface.  \n- A yellow cutting board is positioned on a tiled floor, with a knife and other kitchen tools nearby.\n[720-750s] - Hands place a yellow bun on a white tray, then pick up a second bun from a nearby tray.  \n- A person to the left places a slice of cheese onto a bun on the tray.  \n- The tray with buns and cheese is positioned under a metal counter with various condiment containers.\n[750-780s] - Hands place a burger assembly on a yellow paper, then pick up a receipt and a yellow paper with a green circular logo.  \n- A burger with a patty and cheese is placed on a yellow paper, then another burger is added to the same paper.  \n- The worker picks up a burger from a tray and places it on a yellow paper, then moves to another yellow paper to place a second burger.", "history_tokens": 961, "history_utf8_bytes": 3986, "recent_frame_times_s": [772.0045666666666, 773.0055666666667, 774.0065666666667, 775.0075666666667, 776.0085666666666, 777.0095666666666, 778.0105666666667, 779.0115666666667, 780.0125666666667, 781.0135666666666, 782.0145666666666, 783.0155666666667, 784.0165666666667, 785.0008833333334, 786.0018833333334, 787.0028833333333, 788.0038833333333, 789.0048833333333, 790.0058833333334, 791.0068833333333, 792.0078833333333, 793.0088833333333, 794.0098833333333, 795.0108833333334, 796.0118833333333, 797.0128833333333, 798.0138833333333, 799.0148833333334, 800.0158833333334, 801.0002], "recent_frames_sha256": "b356b3f27f715c6a0cb171a908f52d9f5b74fb3771c3b96b6d08e5cd746fd48a", "num_recent_frames": 30, "tq": 716441.833428497, "t1": 716448.797322794, "ta": 716448.797322794, "te": 716448.998387333, "first_response_s": 6.9638942970195785, "answer_total_s": 7.164958836045116, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 350, "content_group": "b207f8bc6e73ddfd1cb5c724c4633c173e2bf6a9b68e520020f769b6436d008c", "question": {"question_id": "sample_350_a1064_q0", "video_id": 350, "video_path": "./videos/sample_350_real.mp4", "annotation_index": 1064, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual just now?", "options": ["A. The individual is cleaning trays, organizing workspaces, and baking bread in the oven.", "B. The individual is taking an order, chopping vegetables, and making a quick salad.", "C. The individual is preparing a dessert by mixing ingredients and placing them in the refrigerator.", "D. The individual is putting on gloves, picking up a hot dog bun, and assembling a hot dog."], "answer": "D", "time_stamp_s": 12, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_350_a1064_q0", "video_id": 350, "time_stamp_s": 12, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3ed1568f60cfb55eb0243dfc6ee28d62a746baa9605a283ded89f0e787d47286", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011], "recent_frames_sha256": "b980b5bf77a9e9a91a62636c195a0c1d6ddceed7d0e268605d1e761eaf5d27bc", "num_recent_frames": 12, "tq": 716512.77657735, "t1": 716527.08748197, "ta": 716527.08748197, "te": 716527.124827255, "first_response_s": 14.310904619982466, "answer_total_s": 14.348249905044213, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_350_a1064_q0", "video_id": 350, "time_stamp_s": 12, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d60631b590d3f2445c6050d29185b68145e37c308da6d4d857a18bcc9f229449", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011], "recent_frames_sha256": "b980b5bf77a9e9a91a62636c195a0c1d6ddceed7d0e268605d1e761eaf5d27bc", "num_recent_frames": 12, "tq": 716574.673071426, "t1": 716575.902052358, "ta": 716575.902052358, "te": 716576.27635105, "first_response_s": 1.2289809320354834, "answer_total_s": 1.6032796240178868, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 350, "content_group": "b207f8bc6e73ddfd1cb5c724c4633c173e2bf6a9b68e520020f769b6436d008c", "question": {"question_id": "sample_350_a1065_q0", "video_id": 350, "video_path": "./videos/sample_350_real.mp4", "annotation_index": 1065, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual just now?", "options": ["A. The individual is taking an order, grilling a hamburger patty, and placing it in a bun.", "B. The individual is preparing a sandwich by slicing bread, adding fillings, and wrapping it up.", "C. The individual is filling a tray with fries, adding salt, and serving it to a customer.", "D. The individual is putting on gloves, picking up a hot dog bun, adding the wiener, and preparing toppings."], "answer": "D", "time_stamp_s": 151, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [140, 150], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_350_a1065_q0", "video_id": 350, "time_stamp_s": 151, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4aa499615c592343dd2737a1fcda60aa7838e7f5e6bfe91876c4541629709abf", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334], "recent_frames_sha256": "f9a4f586be4f4b3b9a67f98c88533c0725f4cca248a9acea0d4b791b410f7970", "num_recent_frames": 30, "tq": 716527.133677879, "t1": 716538.993803454, "ta": 716538.993803454, "te": 716539.030965534, "first_response_s": 11.860125574981794, "answer_total_s": 11.89728765503969, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_350_a1065_q0", "video_id": 350, "time_stamp_s": 151, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6ced2445a260c4f910d64f3bd6204d6dd441e74a4eece1e180edd83ae03f12ae", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A worker in a blue shirt and white apron places a burger patty into a metal tray on a long stainless steel counter.  \n- Another worker in a red shirt is seated at a counter to the left, interacting with a yellow squeeze bottle.  \n- The worker in blue uses a yellow squeeze bottle to apply sauce onto the burger patty before placing it into a tray.\n[30-60s] - Employee in blue shirt and gloves uses yellow squeeze bottle to add condiment to a sandwich.  \n- Sandwich is placed on a metal tray, then moved toward a counter with a red-and-white checkered floor.  \n- Another employee in red shirt is visible in the background, seated at a counter with a laptop.\n[60-90s] - Employee in blue shirt and gloves places a burger patty into a bun, then adds a yellow condiment from a dispenser.  \n- The employee uses a paper towel to wipe the counter after handling the burger components.  \n- A customer in a red shirt is visible in the background, seated at a table with a laptop.\n[90-120s] - Employee in blue shirt and white apron uses a wooden tool to scoop dark sauce from a metal container.  \n- Employee places the sauce onto a hot dog bun, then transfers the bun to a plastic container.  \n- Another employee in a red shirt is visible in the background, standing near a counter with yellow cylindrical objects.\n[120-150s] - Employee in blue shirt and gloves places a burger patty into a metal tray.  \n- Another employee in red shirt is visible at the counter, handling items.  \n- Yellow cylindrical objects are positioned on the left side of the counter.", "history_tokens": 363, "history_utf8_bytes": 1557, "recent_frame_times_s": [121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334], "recent_frames_sha256": "f9a4f586be4f4b3b9a67f98c88533c0725f4cca248a9acea0d4b791b410f7970", "num_recent_frames": 30, "tq": 716620.401881359, "t1": 716625.504516169, "ta": 716625.504516169, "te": 716625.66037371, "first_response_s": 5.102634809911251, "answer_total_s": 5.258492350927554, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 350, "content_group": "b207f8bc6e73ddfd1cb5c724c4633c173e2bf6a9b68e520020f769b6436d008c", "question": {"question_id": "sample_350_a1066_q0", "video_id": 350, "video_path": "./videos/sample_350_real.mp4", "annotation_index": 1066, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual just now?", "options": ["A. The individual is assembling pastries, adding icing, and placing them on a cooling rack.", "B. The individual is grilling a hot dog, applying condiments, and wrapping it in foil.", "C. The individual is chopping vegetables, tossing them into a bowl, and serving a salad.", "D. The individual is assembling an order by packaging items into a paper bag and preparing it for delivery."], "answer": "D", "time_stamp_s": 290, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [280, 290], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_350_a1066_q0", "video_id": 350, "time_stamp_s": 290, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "847ae6fe9381c0ba811d89e6302654386fc0c92b4c80845abb6cb4d77934cb5d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666], "recent_frames_sha256": "3bc9bc51eb620a725fc209267a3637162995914a202ade32d716d10c4611ec7f", "num_recent_frames": 30, "tq": 716539.038887248, "t1": 716551.127111209, "ta": 716551.127111209, "te": 716551.164045235, "first_response_s": 12.088223960949108, "answer_total_s": 12.12515798700042, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_350_a1066_q0", "video_id": 350, "time_stamp_s": 290, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ee9ae93e98d1351537cefa2dad29008caea1004290d0e4c254cd4f2b0a81fd46", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A worker in a blue shirt and white apron places a burger patty into a metal tray on a long stainless steel counter.  \n- Another worker in a red shirt is seated at a counter to the left, interacting with a yellow squeeze bottle.  \n- The worker in blue uses a yellow squeeze bottle to apply sauce onto the burger patty before placing it into a tray.\n[30-60s] - Employee in blue shirt and gloves uses yellow squeeze bottle to add condiment to a sandwich.  \n- Sandwich is placed on a metal tray, then moved toward a counter with a red-and-white checkered floor.  \n- Another employee in red shirt is visible in the background, seated at a counter with a laptop.\n[60-90s] - Employee in blue shirt and gloves places a burger patty into a bun, then adds a yellow condiment from a dispenser.  \n- The employee uses a paper towel to wipe the counter after handling the burger components.  \n- A customer in a red shirt is visible in the background, seated at a table with a laptop.\n[90-120s] - Employee in blue shirt and white apron uses a wooden tool to scoop dark sauce from a metal container.  \n- Employee places the sauce onto a hot dog bun, then transfers the bun to a plastic container.  \n- Another employee in a red shirt is visible in the background, standing near a counter with yellow cylindrical objects.\n[120-150s] - Employee in blue shirt and gloves places a burger patty into a metal tray.  \n- Another employee in red shirt is visible at the counter, handling items.  \n- Yellow cylindrical objects are positioned on the left side of the counter.\n[150-180s] - Employee in blue shirt and gloves uses spatula to scoop chocolate from a metal tray.  \n- Another employee in red shirt stands nearby, handling items on the counter.  \n- Yellow cylindrical containers are visible on the left side of the metal food prep station.\n[180-210s] - Employee in blue shirt and white apron uses spatula to scoop food from a metal tray.  \n- Another employee in red shirt and white gloves stands at the counter, handling items.  \n- Yellow cylindrical objects are positioned on the counter near the food trays.\n[210-240s] - Worker in blue shirt and white apron uses a tool to handle items on a metal counter.  \n- Yellow cylindrical objects are positioned on the left side of the counter.  \n- Another worker in a red shirt is visible in the background, standing near a glass partition.\n[240-270s] - Worker in blue shirt and gloves places wrapped items onto a metal counter.  \n- Another worker in red shirt is visible in the background, handling items near a window.  \n- Brown paper bags are being prepared for packaging on the counter.", "history_tokens": 611, "history_utf8_bytes": 2624, "recent_frame_times_s": [260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666], "recent_frames_sha256": "3bc9bc51eb620a725fc209267a3637162995914a202ade32d716d10c4611ec7f", "num_recent_frames": 30, "tq": 716656.347893162, "t1": 716658.141491031, "ta": 716658.141491031, "te": 716658.180025861, "first_response_s": 1.793597868992947, "answer_total_s": 1.8321326989680529, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 350, "content_group": "b207f8bc6e73ddfd1cb5c724c4633c173e2bf6a9b68e520020f769b6436d008c", "question": {"question_id": "sample_350_a1067_q0", "video_id": 350, "video_path": "./videos/sample_350_real.mp4", "annotation_index": 1067, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual just now?", "options": ["A. The individual is arranging condiments on a counter and placing food items in the refrigerator.", "B. The individual is taking orders from customers and showing them to their seats.", "C. The individual is pouring beverages into cups and setting them on a tray for delivery.", "D. The individual is putting on gloves, picking up a hot dog bun, adding the wiener, and preparing toppings."], "answer": "D", "time_stamp_s": 459, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [420, 430], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_350_a1067_q0", "video_id": 350, "time_stamp_s": 459, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "80945321af8adfd0ac269b282c0d8f9b5f189e2b0808320f9a4a1040b11d3615", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [429.0286, 430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333, 439.0052333333333, 440.00623333333334, 441.0072333333333, 442.00823333333335, 443.0092333333333, 444.01023333333336, 445.01123333333334, 446.0122333333333, 447.01323333333335, 448.0142333333333, 449.01523333333336, 450.01623333333333, 451.0172333333333, 452.01823333333334, 453.0192333333333, 454.02023333333335, 455.0212333333333, 456.02223333333336, 457.02323333333334, 458.0242333333333], "recent_frames_sha256": "0aaa22c2431e574afbd3074ea7eddd8f37790cf77dd59bf5ec62b53f49a05748", "num_recent_frames": 30, "tq": 716551.172660114, "t1": 716562.142226214, "ta": 716562.142226214, "te": 716562.17951603, "first_response_s": 10.969566100044176, "answer_total_s": 11.00685591599904, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_350_a1067_q0", "video_id": 350, "time_stamp_s": 459, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ae35960eaf428d91ebb2e88069050648b0e934404a98ecc541a02367b4ee6655", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A worker in a blue shirt and white apron places a burger patty into a metal tray on a long stainless steel counter.  \n- Another worker in a red shirt is seated at a counter to the left, interacting with a yellow squeeze bottle.  \n- The worker in blue uses a yellow squeeze bottle to apply sauce onto the burger patty before placing it into a tray.\n[30-60s] - Employee in blue shirt and gloves uses yellow squeeze bottle to add condiment to a sandwich.  \n- Sandwich is placed on a metal tray, then moved toward a counter with a red-and-white checkered floor.  \n- Another employee in red shirt is visible in the background, seated at a counter with a laptop.\n[60-90s] - Employee in blue shirt and gloves places a burger patty into a bun, then adds a yellow condiment from a dispenser.  \n- The employee uses a paper towel to wipe the counter after handling the burger components.  \n- A customer in a red shirt is visible in the background, seated at a table with a laptop.\n[90-120s] - Employee in blue shirt and white apron uses a wooden tool to scoop dark sauce from a metal container.  \n- Employee places the sauce onto a hot dog bun, then transfers the bun to a plastic container.  \n- Another employee in a red shirt is visible in the background, standing near a counter with yellow cylindrical objects.\n[120-150s] - Employee in blue shirt and gloves places a burger patty into a metal tray.  \n- Another employee in red shirt is visible at the counter, handling items.  \n- Yellow cylindrical objects are positioned on the left side of the counter.\n[150-180s] - Employee in blue shirt and gloves uses spatula to scoop chocolate from a metal tray.  \n- Another employee in red shirt stands nearby, handling items on the counter.  \n- Yellow cylindrical containers are visible on the left side of the metal food prep station.\n[180-210s] - Employee in blue shirt and white apron uses spatula to scoop food from a metal tray.  \n- Another employee in red shirt and white gloves stands at the counter, handling items.  \n- Yellow cylindrical objects are positioned on the counter near the food trays.\n[210-240s] - Worker in blue shirt and white apron uses a tool to handle items on a metal counter.  \n- Yellow cylindrical objects are positioned on the left side of the counter.  \n- Another worker in a red shirt is visible in the background, standing near a glass partition.\n[240-270s] - Worker in blue shirt and gloves places wrapped items onto a metal counter.  \n- Another worker in red shirt is visible in the background, handling items near a window.  \n- Brown paper bags are being prepared for packaging on the counter.\n[270-300s] - Employee in blue shirt and white apron places a brown paper bag on the metal counter, then adjusts its position.  \n- Another employee in a red shirt is visible in the background, handling items near a counter with yellow cylindrical objects.  \n- The counter surface is lined with metallic trays, and a red-and-white checkered floor mat is visible to the right.\n[300-330s] - Worker in blue shirt places a brown paper bag onto a metal conveyor belt.  \n- Another worker in red shirt stands near a yellow roller, observing the process.  \n- The conveyor belt holds multiple metal trays, some partially covered by the paper bag.\n[330-360s] - A person in a red shirt stands near a glass partition, holding a phone.  \n- A man in a blue shirt and beige apron walks past a long metal counter, carrying a brown paper bag.  \n- Yellow cylindrical objects are positioned on the left side of the counter.\n[360-390s] - Worker in blue shirt and gloves places a brown paper bag on the metal counter.  \n- Worker uses a yellow roller to press down on a metal tray.  \n- Another worker in red shirt stands near the counter, observing the process.\n[390-420s] - A person in a blue shirt and white apron stands near a metal counter, holding a small object in their hands.  \n- A red-shirted individual is visible in the background, standing near a window and holding a phone.  \n- The counter surface has several metal trays, a brown mat, and a cardboard piece placed on it.\n[420-450s] - A man in a blue shirt and white apron walks toward the counter, carrying a tray.  \n- He places the tray on the counter and begins to open its lid.  \n- A person in a red jacket is visible in the background near the window.", "history_tokens": 1023, "history_utf8_bytes": 4320, "recent_frame_times_s": [429.0286, 430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333, 439.0052333333333, 440.00623333333334, 441.0072333333333, 442.00823333333335, 443.0092333333333, 444.01023333333336, 445.01123333333334, 446.0122333333333, 447.01323333333335, 448.0142333333333, 449.01523333333336, 450.01623333333333, 451.0172333333333, 452.01823333333334, 453.0192333333333, 454.02023333333335, 455.0212333333333, 456.02223333333336, 457.02323333333334, 458.0242333333333], "recent_frames_sha256": "0aaa22c2431e574afbd3074ea7eddd8f37790cf77dd59bf5ec62b53f49a05748", "num_recent_frames": 30, "tq": 716696.156102344, "t1": 716703.57536613, "ta": 716703.57536613, "te": 716703.764062667, "first_response_s": 7.419263785937801, "answer_total_s": 7.60796032298822, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 350, "content_group": "b207f8bc6e73ddfd1cb5c724c4633c173e2bf6a9b68e520020f769b6436d008c", "question": {"question_id": "sample_350_a1068_q0", "video_id": 350, "video_path": "./videos/sample_350_real.mp4", "annotation_index": 1068, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual just now?", "options": ["A. The individual is grilling a hamburger patty, adding cheese and condiments, and wrapping it up in paper.", "B. The individual is filling a drink cup with a beverage, adding ice, and sealing it with a lid.", "C. The individual is assembling a vegetarian wrap with fresh vegetables, dressing, and a tortilla.", "D. The individual is preparing a hot dog, topping it with grilled onions and meat sauce, and wrapping it in wrapping paper."], "answer": "D", "time_stamp_s": 571, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [560, 570], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_350_a1068_q0", "video_id": 350, "time_stamp_s": 571, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a1e6d9925b6a5bc779a21aaa27198d183b8dc545d8e3edc59d91252e1fc8a73b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333, 554.0201333333333, 555.0211333333333, 556.0221333333334, 557.0231333333334, 558.0241333333333, 559.0251333333333, 560.0261333333333, 561.0271333333334, 562.0281333333334, 563.0291333333333, 564.0301333333333, 565.0311333333333, 566.0321333333334, 567.0331333333334, 568.0007666666667, 569.0017666666666, 570.0027666666666], "recent_frames_sha256": "9389e41f6a19d547f330718080a17e4bd33d723af6f4dee35e41f442b109e478", "num_recent_frames": 30, "tq": 716562.187398862, "t1": 716574.63371552, "ta": 716574.63371552, "te": 716574.667549498, "first_response_s": 12.446316658053547, "answer_total_s": 12.480150636052713, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_350_a1068_q0", "video_id": 350, "time_stamp_s": 571, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ed424c1001881a9d2471930b7a2c941888fc67d369c68c9abddc05034d6fafc3", "condition_order": ["recent", "notes"], "memory": "[120-150s] - Employee in blue shirt and gloves places a burger patty into a metal tray.  \n- Another employee in red shirt is visible at the counter, handling items.  \n- Yellow cylindrical objects are positioned on the left side of the counter.\n[150-180s] - Employee in blue shirt and gloves uses spatula to scoop chocolate from a metal tray.  \n- Another employee in red shirt stands nearby, handling items on the counter.  \n- Yellow cylindrical containers are visible on the left side of the metal food prep station.\n[180-210s] - Employee in blue shirt and white apron uses spatula to scoop food from a metal tray.  \n- Another employee in red shirt and white gloves stands at the counter, handling items.  \n- Yellow cylindrical objects are positioned on the counter near the food trays.\n[210-240s] - Worker in blue shirt and white apron uses a tool to handle items on a metal counter.  \n- Yellow cylindrical objects are positioned on the left side of the counter.  \n- Another worker in a red shirt is visible in the background, standing near a glass partition.\n[240-270s] - Worker in blue shirt and gloves places wrapped items onto a metal counter.  \n- Another worker in red shirt is visible in the background, handling items near a window.  \n- Brown paper bags are being prepared for packaging on the counter.\n[270-300s] - Employee in blue shirt and white apron places a brown paper bag on the metal counter, then adjusts its position.  \n- Another employee in a red shirt is visible in the background, handling items near a counter with yellow cylindrical objects.  \n- The counter surface is lined with metallic trays, and a red-and-white checkered floor mat is visible to the right.\n[300-330s] - Worker in blue shirt places a brown paper bag onto a metal conveyor belt.  \n- Another worker in red shirt stands near a yellow roller, observing the process.  \n- The conveyor belt holds multiple metal trays, some partially covered by the paper bag.\n[330-360s] - A person in a red shirt stands near a glass partition, holding a phone.  \n- A man in a blue shirt and beige apron walks past a long metal counter, carrying a brown paper bag.  \n- Yellow cylindrical objects are positioned on the left side of the counter.\n[360-390s] - Worker in blue shirt and gloves places a brown paper bag on the metal counter.  \n- Worker uses a yellow roller to press down on a metal tray.  \n- Another worker in red shirt stands near the counter, observing the process.\n[390-420s] - A person in a blue shirt and white apron stands near a metal counter, holding a small object in their hands.  \n- A red-shirted individual is visible in the background, standing near a window and holding a phone.  \n- The counter surface has several metal trays, a brown mat, and a cardboard piece placed on it.\n[420-450s] - A man in a blue shirt and white apron walks toward the counter, carrying a tray.  \n- He places the tray on the counter and begins to open its lid.  \n- A person in a red jacket is visible in the background near the window.\n[450-480s] - Staff member in blue shirt and gloves uses black spatula to scoop brown sauce from a metal tray.  \n- The sauce is being transferred into a small, round, golden-brown bread roll held in the other hand.  \n- The bread roll is positioned over a metal tray with multiple compartments, some covered and others open.\n[480-510s] - Employee in blue shirt and gloves uses tongs to place a burger patty into a bun.  \n- Metal food prep station with multiple covered trays and yellow cylindrical containers is visible.  \n- Employee moves toward the end of the station after placing the patty, with a red-and-white checkered floor mat nearby.\n[510-540s] - Employee in blue shirt and gloves places a brown paper bag on the metal counter.  \n- Another employee in black shirt and mask is visible behind the counter, handling items.  \n- A blue plastic bag is placed on the counter near the employee’s feet.\n[540-570s] - Employee in blue shirt and gloves adds toppings to a hot dog from metal trays.  \n- Customer sits on a bench to the left, observing the process.  \n- Yellow protective posts are visible on the left side of the counter.", "history_tokens": 987, "history_utf8_bytes": 4140, "recent_frame_times_s": [541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333, 554.0201333333333, 555.0211333333333, 556.0221333333334, 557.0231333333334, 558.0241333333333, 559.0251333333333, 560.0261333333333, 561.0271333333334, 562.0281333333334, 563.0291333333333, 564.0301333333333, 565.0311333333333, 566.0321333333334, 567.0331333333334, 568.0007666666667, 569.0017666666666, 570.0027666666666], "recent_frames_sha256": "9389e41f6a19d547f330718080a17e4bd33d723af6f4dee35e41f442b109e478", "num_recent_frames": 30, "tq": 716728.107533543, "t1": 716730.096313892, "ta": 716730.096313892, "te": 716730.143182197, "first_response_s": 1.9887803490273654, "answer_total_s": 2.035648653982207, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 351, "content_group": "161523bb8887fc7f690f10c85804f86e5c136931d3fac4ed7f1dc12ce1477432", "question": {"question_id": "sample_351_a827_q0", "video_id": 351, "video_path": "./videos/sample_351_real.mp4", "annotation_index": 827, "question_index": 0, "question": "Which of the following options best summarizes the vendor's actions just now?", "options": ["A. The vendor picked up multiple croissants, placed them into a box, and handed it to a customer.", "B. The vendor rearranged pastries on the tray, cleaned the display glass, and took an order from a customer.", "C. The vendor picked up a muffin, added nuts, and placed it onto a display dish.", "D. The vendor selected a pastry using tongs, placed it into a paper bag."], "answer": "D", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_351_a827_q0", "video_id": 351, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5028da9b86492b0f68267ef912e569abe05326859e9d18a4a823313e723a24aa", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "6ba8a4242281bb966bec1d70022198e871b06707eff57c2286569f984bf85f3c", "num_recent_frames": 11, "tq": 717367.029015344, "t1": 717367.931180482, "ta": 717367.931180482, "te": 717367.971063581, "first_response_s": 0.9021651380462572, "answer_total_s": 0.9420482369605452, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_351_a827_q0", "video_id": 351, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b2079f13f98a4e083ec2f4a0c033c12ce2255eb2327ca6388af47ed02937962d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "6ba8a4242281bb966bec1d70022198e871b06707eff57c2286569f984bf85f3c", "num_recent_frames": 11, "tq": 717205.639439329, "t1": 717213.01731775, "ta": 717213.01731775, "te": 717213.40812459, "first_response_s": 7.377878420986235, "answer_total_s": 7.768685260904022, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 351, "content_group": "161523bb8887fc7f690f10c85804f86e5c136931d3fac4ed7f1dc12ce1477432", "question": {"question_id": "sample_351_a828_q0", "video_id": 351, "video_path": "./videos/sample_351_real.mp4", "annotation_index": 828, "question_index": 0, "question": "Which of the following options best summarizes the barista's actions just now?", "options": ["A. The barista prepared a small cappuccino, added honey, and gave it to the customer.", "B. The barista brewed a large black coffee, added sugar, and placed it on the counter for pickup.", "C. The barista made an espresso shot, added milk, and served it with a croissant.", "D. The barista poured a large latte, sealed the cup with a lid, and handed it over to the customer."], "answer": "D", "time_stamp_s": 130, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [121, 131], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_351_a828_q0", "video_id": 351, "time_stamp_s": 130, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8b2d5ea608041afa35ce06ca7a7d774156e187f11f86bf565c2676000fe522f3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0], "recent_frames_sha256": "b617c62c97c6a6e5fe3dac165aebbba8da99feae834f3d397e24a2559d8a9546", "num_recent_frames": 30, "tq": 717367.992697304, "t1": 717379.704790005, "ta": 717379.704790005, "te": 717379.74745209, "first_response_s": 11.712092700996436, "answer_total_s": 11.75475478603039, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_351_a828_q0", "video_id": 351, "time_stamp_s": 130, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "361bdbb07d0b2f50da94f543b44b23bfe30e074a78d519bca144088fbba1e02b", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hand uses tongs to select pastries from a glass display case, then places them on brown paper bags.  \n- Hand picks up a black coffee cup from a stack, then places it on an espresso machine's portafilter.  \n- Espresso machine is operated with a hand adjusting the lever, while text overlay indicates \"Order (Takeaway) 1x Latte - Large Whole\".\n[30-60s] - Barista selects a large latte and whole espresso from the espresso machine's portafilter group.  \n- Customer pays using a card at a touchscreen POS terminal, with the order details displayed on screen.  \n- The barista places the coffee cup on a counter near a stack of disposable cups and a coffee grinder.\n[60-90s] - Barista selects \"Latte - Large\" and \"Espresso\" from touchscreen order system.  \n- Barista retrieves a white paper cup from under the counter, preparing for drink assembly.  \n- Espresso machine is visible with steam wand and portafilter, ready for brewing.\n[90-120s] - Barista holds a metal pitcher filled with steamed milk, positioning it near the espresso machine's steam wand.  \n- The barista pours the milk into a pre-filled coffee cup, creating a latte with a visible layer of foam.  \n- The cup is placed on a wooden counter beside other coffee-making tools and ingredients.", "history_tokens": 301, "history_utf8_bytes": 1259, "recent_frame_times_s": [101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0], "recent_frames_sha256": "b617c62c97c6a6e5fe3dac165aebbba8da99feae834f3d397e24a2559d8a9546", "num_recent_frames": 30, "tq": 717242.855621441, "t1": 717250.193414806, "ta": 717250.193414806, "te": 717250.23148005, "first_response_s": 7.337793365004472, "answer_total_s": 7.375858608982526, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 351, "content_group": "161523bb8887fc7f690f10c85804f86e5c136931d3fac4ed7f1dc12ce1477432", "question": {"question_id": "sample_351_a829_q0", "video_id": 351, "video_path": "./videos/sample_351_real.mp4", "annotation_index": 829, "question_index": 0, "question": "Which of the following options best summarizes the barista's actions just now?", "options": ["A. The barista picked up fruits to prepare a smoothie, blended them, and served it to a customer.", "B. The barista prepared a double espresso, added cream, and served it with a cookie.", "C. The barista brewed a pot of tea, added honey, and served it in a teapot to a customer.", "D. The barista steamed milk, prepared orders of oat latte and soy flat white."], "answer": "D", "time_stamp_s": 252, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [242, 252], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_351_a829_q0", "video_id": 351, "time_stamp_s": 252, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "77255ec3b5f117d74c621904b159f47d66a2bc37b3a62300df7d73282fa34275", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0], "recent_frames_sha256": "c618664a13ce63ad83f9fb3831044b289e4d397e2ecf90e0fa6df702cb0e7403", "num_recent_frames": 30, "tq": 717379.766184157, "t1": 717391.143639569, "ta": 717391.143639569, "te": 717391.181074947, "first_response_s": 11.377455412060954, "answer_total_s": 11.41489079000894, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_351_a829_q0", "video_id": 351, "time_stamp_s": 252, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "98806bd3dc8970f3d4f68e9b7300147688c5e43260fa3bc4007464bb01674b8d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hand uses tongs to select pastries from a glass display case, then places them on brown paper bags.  \n- Hand picks up a black coffee cup from a stack, then places it on an espresso machine's portafilter.  \n- Espresso machine is operated with a hand adjusting the lever, while text overlay indicates \"Order (Takeaway) 1x Latte - Large Whole\".\n[30-60s] - Barista selects a large latte and whole espresso from the espresso machine's portafilter group.  \n- Customer pays using a card at a touchscreen POS terminal, with the order details displayed on screen.  \n- The barista places the coffee cup on a counter near a stack of disposable cups and a coffee grinder.\n[60-90s] - Barista selects \"Latte - Large\" and \"Espresso\" from touchscreen order system.  \n- Barista retrieves a white paper cup from under the counter, preparing for drink assembly.  \n- Espresso machine is visible with steam wand and portafilter, ready for brewing.\n[90-120s] - Barista holds a metal pitcher filled with steamed milk, positioning it near the espresso machine's steam wand.  \n- The barista pours the milk into a pre-filled coffee cup, creating a latte with a visible layer of foam.  \n- The cup is placed on a wooden counter beside other coffee-making tools and ingredients.\n[120-150s] - Barista pours steamed milk into a latte cup, then places a lid on the cup.  \n- Barista picks up a coffee pot and prepares to brew a Decaf coffee.  \n- Barista places a soy milk packet on the counter near the coffee machine.\n[150-180s] - Barista places a pre-measured coffee dose into the portafilter, preparing for extraction.  \n- Espresso machine's digital display shows \"30\" seconds, indicating a timed brewing process.  \n- A stack of paper cups and a tray with a small container of soy milk are visible on the counter.\n[180-210s] - Barista's hand adjusts a coffee grinder's hopper, preparing grounds for brewing.  \n- A stack of black paper cups is positioned to the right of the grinder, ready for use.  \n- The barista places a small metal cup on the counter, likely for measuring coffee or milk.\n[210-240s] - Barista pours espresso into a cup using a portafilter, with a digital display showing \"96°\" on the machine.  \n- The barista places the cup on the espresso machine's drip tray, then moves to the milk frothing station.  \n- A text overlay lists the order: \"1x Latte, 1x Out, 1x Decaf, 1x Flatwhite, 1x Soy,\" indicating the items to be prepared.", "history_tokens": 617, "history_utf8_bytes": 2427, "recent_frame_times_s": [223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0], "recent_frames_sha256": "c618664a13ce63ad83f9fb3831044b289e4d397e2ecf90e0fa6df702cb0e7403", "num_recent_frames": 30, "tq": 717285.415423465, "t1": 717286.529109804, "ta": 717286.529109804, "te": 717286.5667604, "first_response_s": 1.1136863389983773, "answer_total_s": 1.1513369349995628, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 351, "content_group": "161523bb8887fc7f690f10c85804f86e5c136931d3fac4ed7f1dc12ce1477432", "question": {"question_id": "sample_351_a830_q0", "video_id": 351, "video_path": "./videos/sample_351_real.mp4", "annotation_index": 830, "question_index": 0, "question": "Which of the following options best summarizes the barista's actions just now?", "options": ["A. The barista arranged mugs on the counter, brought milk from the fridge, and cleaned the workspace.", "B. The barista refilled the milk container, steamed milk, and cleaned the counter.", "C. The barista cleaned the espresso machine, brewed espresso, and arranged cups for serving.", "D. The barista grabbed milk cartons into the fridge, organized them, and prepared the workspace for further tasks."], "answer": "D", "time_stamp_s": 373, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [363, 373], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_351_a830_q0", "video_id": 351, "time_stamp_s": 373, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a643a79bd760eacaf2729a61f99fd909c3f302d588576554328bde99979c1e30", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0], "recent_frames_sha256": "3650bbc9e38be675cf62e773e19e238549602f6fa6bebc1181c91e386b28db90", "num_recent_frames": 30, "tq": 717391.191723867, "t1": 717401.721144777, "ta": 717401.721144777, "te": 717401.760680533, "first_response_s": 10.529420910053886, "answer_total_s": 10.56895666604396, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_351_a830_q0", "video_id": 351, "time_stamp_s": 373, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "69f8557c8c3036e4074ac7d7f2d64fee84867e195351200126387215eb0ba586", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hand uses tongs to select pastries from a glass display case, then places them on brown paper bags.  \n- Hand picks up a black coffee cup from a stack, then places it on an espresso machine's portafilter.  \n- Espresso machine is operated with a hand adjusting the lever, while text overlay indicates \"Order (Takeaway) 1x Latte - Large Whole\".\n[30-60s] - Barista selects a large latte and whole espresso from the espresso machine's portafilter group.  \n- Customer pays using a card at a touchscreen POS terminal, with the order details displayed on screen.  \n- The barista places the coffee cup on a counter near a stack of disposable cups and a coffee grinder.\n[60-90s] - Barista selects \"Latte - Large\" and \"Espresso\" from touchscreen order system.  \n- Barista retrieves a white paper cup from under the counter, preparing for drink assembly.  \n- Espresso machine is visible with steam wand and portafilter, ready for brewing.\n[90-120s] - Barista holds a metal pitcher filled with steamed milk, positioning it near the espresso machine's steam wand.  \n- The barista pours the milk into a pre-filled coffee cup, creating a latte with a visible layer of foam.  \n- The cup is placed on a wooden counter beside other coffee-making tools and ingredients.\n[120-150s] - Barista pours steamed milk into a latte cup, then places a lid on the cup.  \n- Barista picks up a coffee pot and prepares to brew a Decaf coffee.  \n- Barista places a soy milk packet on the counter near the coffee machine.\n[150-180s] - Barista places a pre-measured coffee dose into the portafilter, preparing for extraction.  \n- Espresso machine's digital display shows \"30\" seconds, indicating a timed brewing process.  \n- A stack of paper cups and a tray with a small container of soy milk are visible on the counter.\n[180-210s] - Barista's hand adjusts a coffee grinder's hopper, preparing grounds for brewing.  \n- A stack of black paper cups is positioned to the right of the grinder, ready for use.  \n- The barista places a small metal cup on the counter, likely for measuring coffee or milk.\n[210-240s] - Barista pours espresso into a cup using a portafilter, with a digital display showing \"96°\" on the machine.  \n- The barista places the cup on the espresso machine's drip tray, then moves to the milk frothing station.  \n- A text overlay lists the order: \"1x Latte, 1x Out, 1x Decaf, 1x Flatwhite, 1x Soy,\" indicating the items to be prepared.\n[240-270s] - Barista holds a white cup under the espresso machine's steam wand, frothing milk.  \n- Text overlay lists order: \"1x Latte, 1x Flatwhite, 1x Decaf, 1x Soy.\"  \n- Steam wand is actively frothing milk, with visible steam and milk swirling.\n[270-300s] - Barista pours steamed milk into a coffee cup, creating a latte art pattern.  \n- A blue carton of milk and a small container of syrup are visible on the counter.  \n- The barista holds the cup steady while pouring, with the milk forming a swirl in the coffee.\n[300-330s] - Barista pours steamed milk into a coffee cup, creating latte art.\n- A blue carton of milk and a packet of soy are visible on the counter.\n- The barista’s hand holds a yellow-handled pitcher while pouring milk.\n[330-360s] - Person holds two coffee cups with latte art, placing them on a black mat at a counter.  \n- The cups are then carried to a wooden table where two people are seated.  \n- One person places a cup on the table, while another person is seen using a mouse on a laptop.", "history_tokens": 896, "history_utf8_bytes": 3447, "recent_frame_times_s": [344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0], "recent_frames_sha256": "3650bbc9e38be675cf62e773e19e238549602f6fa6bebc1181c91e386b28db90", "num_recent_frames": 30, "tq": 717323.719483243, "t1": 717329.194681794, "ta": 717329.194681794, "te": 717329.232645204, "first_response_s": 5.475198551081121, "answer_total_s": 5.513161961105652, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 351, "content_group": "161523bb8887fc7f690f10c85804f86e5c136931d3fac4ed7f1dc12ce1477432", "question": {"question_id": "sample_351_a831_q0", "video_id": 351, "video_path": "./videos/sample_351_real.mp4", "annotation_index": 831, "question_index": 0, "question": "Which of the following options best summarizes the actions just now?", "options": ["A. The cashier counted money in the register, sorted coins and bills, and printed the receipt.", "B. The cashier scanned a barcode, weighed the item, and asked the customer for payment.", "C. The cashier arranged items on the counter, packed them into a bag, and handed the bag to the customer.", "D. The cashier picked items on the touchscreen, confirmed the order, and selected a payment option."], "answer": "D", "time_stamp_s": 499, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [484, 494], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_351_a831_q0", "video_id": 351, "time_stamp_s": 499, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ea48975279921c4bf8c998b1b52dd82527374897a601820af3d9d946688746ac", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0], "recent_frames_sha256": "29f3c2ab02418f939d8ff796649ae21df70ccd79f11ee3dd25702b0e6632d8bc", "num_recent_frames": 30, "tq": 717401.770273363, "t1": 717414.411897219, "ta": 717414.411897219, "te": 717414.44854407, "first_response_s": 12.64162385603413, "answer_total_s": 12.67827070702333, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_351_a831_q0", "video_id": 351, "time_stamp_s": 499, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bdc5d23a5b6832a9fe09abd426c3ba170eea4957c5f266ae1c0c2b1fd82077af", "condition_order": ["notes", "recent"], "memory": "[90-120s] - Barista holds a metal pitcher filled with steamed milk, positioning it near the espresso machine's steam wand.  \n- The barista pours the milk into a pre-filled coffee cup, creating a latte with a visible layer of foam.  \n- The cup is placed on a wooden counter beside other coffee-making tools and ingredients.\n[120-150s] - Barista pours steamed milk into a latte cup, then places a lid on the cup.  \n- Barista picks up a coffee pot and prepares to brew a Decaf coffee.  \n- Barista places a soy milk packet on the counter near the coffee machine.\n[150-180s] - Barista places a pre-measured coffee dose into the portafilter, preparing for extraction.  \n- Espresso machine's digital display shows \"30\" seconds, indicating a timed brewing process.  \n- A stack of paper cups and a tray with a small container of soy milk are visible on the counter.\n[180-210s] - Barista's hand adjusts a coffee grinder's hopper, preparing grounds for brewing.  \n- A stack of black paper cups is positioned to the right of the grinder, ready for use.  \n- The barista places a small metal cup on the counter, likely for measuring coffee or milk.\n[210-240s] - Barista pours espresso into a cup using a portafilter, with a digital display showing \"96°\" on the machine.  \n- The barista places the cup on the espresso machine's drip tray, then moves to the milk frothing station.  \n- A text overlay lists the order: \"1x Latte, 1x Out, 1x Decaf, 1x Flatwhite, 1x Soy,\" indicating the items to be prepared.\n[240-270s] - Barista holds a white cup under the espresso machine's steam wand, frothing milk.  \n- Text overlay lists order: \"1x Latte, 1x Flatwhite, 1x Decaf, 1x Soy.\"  \n- Steam wand is actively frothing milk, with visible steam and milk swirling.\n[270-300s] - Barista pours steamed milk into a coffee cup, creating a latte art pattern.  \n- A blue carton of milk and a small container of syrup are visible on the counter.  \n- The barista holds the cup steady while pouring, with the milk forming a swirl in the coffee.\n[300-330s] - Barista pours steamed milk into a coffee cup, creating latte art.\n- A blue carton of milk and a packet of soy are visible on the counter.\n- The barista’s hand holds a yellow-handled pitcher while pouring milk.\n[330-360s] - Person holds two coffee cups with latte art, placing them on a black mat at a counter.  \n- The cups are then carried to a wooden table where two people are seated.  \n- One person places a cup on the table, while another person is seen using a mouse on a laptop.\n[360-390s] - Hand places a blue-lidded container onto a counter near a coffee machine.  \n- Hand retrieves a pink-lidded container from a refrigerator, then places it on the counter.  \n- Coffee machine is positioned centrally with two portafilters being prepared for use.\n[390-420s] - Hand places a metal portafilter onto the espresso machine's group head, preparing for brewing.  \n- Espresso machine's steam wand and group head are visible, with a blue container of milk powder nearby.  \n- Counter holds stacked mugs, a yellow lemon, and a metal tongs resting beside a glass jar.\n[420-450s] - Barista removes a portafilter from the espresso machine, revealing a used filter basket with coffee grounds.  \n- The barista places the portafilter on the counter, then picks up a black cloth to wipe the machine's surface.  \n- A display case with pastries and bread is visible in the background, suggesting a café setting.\n[450-480s] - A child in a blue patterned shirt reaches toward a tablet screen displaying payment options.  \n- A woman in a beige jacket stands behind the counter, holding a phone and observing the interaction.  \n- The tablet screen shows a digital interface with multiple payment method icons, including credit cards and digital wallets.", "history_tokens": 962, "history_utf8_bytes": 3765, "recent_frame_times_s": [470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0], "recent_frames_sha256": "29f3c2ab02418f939d8ff796649ae21df70ccd79f11ee3dd25702b0e6632d8bc", "num_recent_frames": 30, "tq": 717365.351229599, "t1": 717366.951180644, "ta": 717366.951180644, "te": 717366.98971785, "first_response_s": 1.5999510450055823, "answer_total_s": 1.6384882510174066, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 352, "content_group": "53e12fba1333fa4952579f88a60bd002e2446d9f2f0a0b2ada71ddc7ba7d6b50", "question": {"question_id": "sample_352_a370_q0", "video_id": 352, "video_path": "./videos/sample_352_real.mp4", "annotation_index": 370, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. An individual browsed through items in a refrigerator section of a store with a cloth in hand.", "B. An individual walked through an establishment, apparently a café, holding a cloth and prepared to clean a table.", "C. An individual picked up a jacket from a chair and folded it neatly to place it back.", "D. An individual took a tray of food to serve a seated customer at a table."], "answer": "B", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_352_a370_q0", "video_id": 352, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bd2bdfca334126fadb2c09c0d3a67367f7c75987c2dca7a910a8480fd36fe7de", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.02796875, 1.00796875, 2.00796875, 3.00796875, 4.00796875, 5.00796875, 6.00796875, 7.00796875, 8.00796875, 9.00796875], "recent_frames_sha256": "eea51516bb4e7aa919817e92167a0d146e16329dbda5f977dcd1c3ab7ce606c3", "num_recent_frames": 10, "tq": 716837.654985483, "t1": 716849.770599123, "ta": 716849.770599123, "te": 716849.808522727, "first_response_s": 12.115613639936782, "answer_total_s": 12.153537243953906, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_352_a370_q0", "video_id": 352, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b2162c177983a652d92c8bdb745c9d5e0a650da0e02359c5f874a8214764ce4d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.02796875, 1.00796875, 2.00796875, 3.00796875, 4.00796875, 5.00796875, 6.00796875, 7.00796875, 8.00796875, 9.00796875], "recent_frames_sha256": "eea51516bb4e7aa919817e92167a0d146e16329dbda5f977dcd1c3ab7ce606c3", "num_recent_frames": 10, "tq": 716892.908381228, "t1": 716898.911517205, "ta": 716898.911517205, "te": 716899.348247637, "first_response_s": 6.0031359769636765, "answer_total_s": 6.439866409054957, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 352, "content_group": "53e12fba1333fa4952579f88a60bd002e2446d9f2f0a0b2ada71ddc7ba7d6b50", "question": {"question_id": "sample_352_a371_q0", "video_id": 352, "video_path": "./videos/sample_352_real.mp4", "annotation_index": 371, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. An individual was washing their hands and drying them with a towel.", "B. An individual was organizing various kitchen utensils and cutlery in a drawer.", "C. An individual was washing and rinsing a batch of dishes and cups in a sink.", "D. An individual was preparing ingredients for a meal by chopping vegetables."], "answer": "C", "time_stamp_s": 135, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [125, 135], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_352_a371_q0", "video_id": 352, "time_stamp_s": 135, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b1af99b76b01549aaee146de43cbdf7caf616ca2b32f3a103d38e076083caa19", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [105.00796875, 106.00796875, 107.00796875, 108.00796875, 109.00796875, 110.00796875, 111.00796875, 112.00796875, 113.00796875, 114.00796875, 115.00796875, 116.00796875, 117.00796875, 118.00796875, 119.00796875, 120.00796875, 121.00796875, 122.00796875, 123.00796875, 124.00796875, 125.00796875, 126.00796875, 127.00796875, 128.00796875, 129.00796875, 130.00796875, 131.00796875, 132.00796875, 133.00796875, 134.00796875], "recent_frames_sha256": "66b71fcfa5961a379dfba1ab8df65aae246fea35c564a4e9f7251c6b66b1826a", "num_recent_frames": 30, "tq": 716849.820116501, "t1": 716856.673103556, "ta": 716856.673103556, "te": 716856.711143109, "first_response_s": 6.852987055084668, "answer_total_s": 6.891026608063839, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_352_a371_q0", "video_id": 352, "time_stamp_s": 135, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a073f0da3e9e1dfa5e29e6fc2a43ec6a31e31fef1c740836e6ddec7d1eb016f7", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person places a black cloth on a wooden table, then uses it to wipe a metal cup and a black coffee cup.  \n- A small potted plant sits on the table near the cups, and a cylindrical container with a lid is also present.  \n- The person moves the cloth to wipe the table surface, then lifts the cloth to reveal a black coffee cup and a metal cup on the table.\n[30-60s] - Hand holds a metallic bowl, moving it toward a sink area with various utensils and containers.  \n- Plates are arranged on a towel on the countertop, with some being picked up and inspected.  \n- A stainless steel sink contains multiple bowls and small containers, suggesting preparation or cleaning activity.\n[60-90s] - Person wipes a plate with a cloth while standing near a sink.  \n- Plates are stacked and moved toward a dishwasher, which is open and ready for loading.  \n- A stack of clean plates is placed into the dishwasher's rack.\n[90-120s] - Hands remove a blue-lidded container from a dish rack and place it on the counter.  \n- A clear glass is picked up and used to rinse small metal cups under running water in the sink.  \n- The sink area contains various dirty dishes, including cups, bowls, and utensils, alongside a dish rack and cleaning supplies.", "history_tokens": 291, "history_utf8_bytes": 1239, "recent_frame_times_s": [105.00796875, 106.00796875, 107.00796875, 108.00796875, 109.00796875, 110.00796875, 111.00796875, 112.00796875, 113.00796875, 114.00796875, 115.00796875, 116.00796875, 117.00796875, 118.00796875, 119.00796875, 120.00796875, 121.00796875, 122.00796875, 123.00796875, 124.00796875, 125.00796875, 126.00796875, 127.00796875, 128.00796875, 129.00796875, 130.00796875, 131.00796875, 132.00796875, 133.00796875, 134.00796875], "recent_frames_sha256": "66b71fcfa5961a379dfba1ab8df65aae246fea35c564a4e9f7251c6b66b1826a", "num_recent_frames": 30, "tq": 716927.154103935, "t1": 716927.73396992, "ta": 716927.73396992, "te": 716927.919647285, "first_response_s": 0.5798659849679098, "answer_total_s": 0.7655433500185609, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 352, "content_group": "53e12fba1333fa4952579f88a60bd002e2446d9f2f0a0b2ada71ddc7ba7d6b50", "question": {"question_id": "sample_352_a372_q0", "video_id": 352, "video_path": "./videos/sample_352_real.mp4", "annotation_index": 372, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. An individual rearranged items in a refrigerator and then wiped the floors.", "B. An individual disposed of trash, retrieved cleaning supplies, and started mopping the floor.", "C. An individual washed dishes, emptied the trash, and cleaned the sink.", "D. An individual served food to a customer and then started cleaning the countertops."], "answer": "B", "time_stamp_s": 260, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [250, 260], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_352_a372_q0", "video_id": 352, "time_stamp_s": 260, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5e88cbdd2455cb67dea8f5a5663a427c6dbdd48e66557e7e00783140c5ef45ea", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [230.00796875, 231.00796875, 232.00796875, 233.00796875, 234.00796875, 235.00796875, 236.00796875, 237.00796875, 238.00796875, 239.00796875, 240.00796875, 241.00796875, 242.00796875, 243.00796875, 244.00796875, 245.00796875, 246.00796875, 247.00796875, 248.00796875, 249.00796875, 250.00796875, 251.00796875, 252.00796875, 253.00796875, 254.00796875, 255.00796875, 256.00796875, 257.00796875, 258.00796875, 259.00796875], "recent_frames_sha256": "2e56a3200a22ab4855fff0975d724830cb01f023bc7635d11811b006f16c49b1", "num_recent_frames": 30, "tq": 716856.723690562, "t1": 716869.198862648, "ta": 716869.198862648, "te": 716869.238896237, "first_response_s": 12.475172086036764, "answer_total_s": 12.515205675037578, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_352_a372_q0", "video_id": 352, "time_stamp_s": 260, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d811d09b0daeb3ea14abcbfbb4df756b0da90f1c40a86f1bc39b936eb22c438d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person places a black cloth on a wooden table, then uses it to wipe a metal cup and a black coffee cup.  \n- A small potted plant sits on the table near the cups, and a cylindrical container with a lid is also present.  \n- The person moves the cloth to wipe the table surface, then lifts the cloth to reveal a black coffee cup and a metal cup on the table.\n[30-60s] - Hand holds a metallic bowl, moving it toward a sink area with various utensils and containers.  \n- Plates are arranged on a towel on the countertop, with some being picked up and inspected.  \n- A stainless steel sink contains multiple bowls and small containers, suggesting preparation or cleaning activity.\n[60-90s] - Person wipes a plate with a cloth while standing near a sink.  \n- Plates are stacked and moved toward a dishwasher, which is open and ready for loading.  \n- A stack of clean plates is placed into the dishwasher's rack.\n[90-120s] - Hands remove a blue-lidded container from a dish rack and place it on the counter.  \n- A clear glass is picked up and used to rinse small metal cups under running water in the sink.  \n- The sink area contains various dirty dishes, including cups, bowls, and utensils, alongside a dish rack and cleaning supplies.\n[120-150s] - Person uses blue sponge to scrub a metal cup under running water.  \n- Hands move cups and lids around in sink, rinsing them with water.  \n- Sink contains multiple metal cups, lids, and a blue sponge.\n[150-180s] - Hands rinse multiple small bowls under running water in a stainless steel sink.  \n- A blue sponge and dish rack are visible to the left of the sink.  \n- Dish soap bottles and a green bottle are positioned on the countertop to the right.\n[180-210s] - Hands remove a glass from a dishwasher rack, placing it on a countertop near a sink.  \n- A white towel is positioned on the countertop beside the sink, near a cutting board and knife.  \n- The dishwasher rack is partially filled with various cups and small containers, some of which are being handled by the person.\n[210-240s] - Hand places a beige ceramic cup into the dishwasher rack, adjusting its position among other cups.  \n- Dishwasher rack contains multiple cups and lids, some with visible residue or stains.  \n- Hand repeatedly repositions cups within the rack, ensuring proper placement for cleaning.", "history_tokens": 549, "history_utf8_bytes": 2326, "recent_frame_times_s": [230.00796875, 231.00796875, 232.00796875, 233.00796875, 234.00796875, 235.00796875, 236.00796875, 237.00796875, 238.00796875, 239.00796875, 240.00796875, 241.00796875, 242.00796875, 243.00796875, 244.00796875, 245.00796875, 246.00796875, 247.00796875, 248.00796875, 249.00796875, 250.00796875, 251.00796875, 252.00796875, 253.00796875, 254.00796875, 255.00796875, 256.00796875, 257.00796875, 258.00796875, 259.00796875], "recent_frames_sha256": "2e56a3200a22ab4855fff0975d724830cb01f023bc7635d11811b006f16c49b1", "num_recent_frames": 30, "tq": 716960.66607508, "t1": 716967.030433825, "ta": 716967.030433825, "te": 716967.265067114, "first_response_s": 6.36435874493327, "answer_total_s": 6.598992033977993, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 352, "content_group": "53e12fba1333fa4952579f88a60bd002e2446d9f2f0a0b2ada71ddc7ba7d6b50", "question": {"question_id": "sample_352_a373_q0", "video_id": 352, "video_path": "./videos/sample_352_real.mp4", "annotation_index": 373, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. An individual adjusted various settings on an electronic device, selected payment options.", "B. An individual searched through web pages on a tablet, bookmarked a few articles, and saved them for later reading.", "C. An individual played a game on a tablet, paused to check messages, and then defeated the final boss in the game.", "D. An individual followed a recipe on a tablet screen, added ingredients to a bowl, and began the baking process."], "answer": "A", "time_stamp_s": 385, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [375, 385], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_352_a373_q0", "video_id": 352, "time_stamp_s": 385, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7b8f066fdee62d313c806c94e51ee62032aa239c53856b20e36ff48b91f756d3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [355.00796875, 356.00796875, 357.00796875, 358.00796875, 359.00796875, 360.00796875, 361.00796875, 362.00796875, 363.00796875, 364.00796875, 365.00796875, 366.00796875, 367.00796875, 368.00796875, 369.00796875, 370.00796875, 371.00796875, 372.00796875, 373.00796875, 374.00796875, 375.00796875, 376.00796875, 377.00796875, 378.00796875, 379.00796875, 380.00796875, 381.00796875, 382.00796875, 383.00796875, 384.00796875], "recent_frames_sha256": "1e0874f63fa4c3d99751de9cf59e3ae42fc4b7e3ac0f82c3c82b80bcaab3892f", "num_recent_frames": 30, "tq": 716869.249079449, "t1": 716882.66372491, "ta": 716882.66372491, "te": 716882.886682224, "first_response_s": 13.414645461016335, "answer_total_s": 13.637602775008418, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_352_a373_q0", "video_id": 352, "time_stamp_s": 385, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "85bf4e1c159ee505c4b092debfc331d7340931ea7acadbf4e2cd1f6e8ab4427f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person places a black cloth on a wooden table, then uses it to wipe a metal cup and a black coffee cup.  \n- A small potted plant sits on the table near the cups, and a cylindrical container with a lid is also present.  \n- The person moves the cloth to wipe the table surface, then lifts the cloth to reveal a black coffee cup and a metal cup on the table.\n[30-60s] - Hand holds a metallic bowl, moving it toward a sink area with various utensils and containers.  \n- Plates are arranged on a towel on the countertop, with some being picked up and inspected.  \n- A stainless steel sink contains multiple bowls and small containers, suggesting preparation or cleaning activity.\n[60-90s] - Person wipes a plate with a cloth while standing near a sink.  \n- Plates are stacked and moved toward a dishwasher, which is open and ready for loading.  \n- A stack of clean plates is placed into the dishwasher's rack.\n[90-120s] - Hands remove a blue-lidded container from a dish rack and place it on the counter.  \n- A clear glass is picked up and used to rinse small metal cups under running water in the sink.  \n- The sink area contains various dirty dishes, including cups, bowls, and utensils, alongside a dish rack and cleaning supplies.\n[120-150s] - Person uses blue sponge to scrub a metal cup under running water.  \n- Hands move cups and lids around in sink, rinsing them with water.  \n- Sink contains multiple metal cups, lids, and a blue sponge.\n[150-180s] - Hands rinse multiple small bowls under running water in a stainless steel sink.  \n- A blue sponge and dish rack are visible to the left of the sink.  \n- Dish soap bottles and a green bottle are positioned on the countertop to the right.\n[180-210s] - Hands remove a glass from a dishwasher rack, placing it on a countertop near a sink.  \n- A white towel is positioned on the countertop beside the sink, near a cutting board and knife.  \n- The dishwasher rack is partially filled with various cups and small containers, some of which are being handled by the person.\n[210-240s] - Hand places a beige ceramic cup into the dishwasher rack, adjusting its position among other cups.  \n- Dishwasher rack contains multiple cups and lids, some with visible residue or stains.  \n- Hand repeatedly repositions cups within the rack, ensuring proper placement for cleaning.\n[240-270s] - Person opens a refrigerator door, revealing a trash bin inside with crumpled paper and food waste.\n- They use a red-handled broom to sweep debris from the floor into the trash bin.\n- The broom is moved across the shiny white floor, collecting scattered items near the sink and cabinets.\n[270-300s] - Hand removes a metal strainer from a sink, then rinses it under running water.  \n- Hand places a metal strainer into a coffee machine's compartment, preparing for use.  \n- Coffee machine displays a digital readout showing \"3.0\" and \"1.0\" as operational parameters.\n[300-330s] - Person opens a cabinet, revealing stacked disposable cups and a container of coffee grounds.  \n- They retrieve a stack of white disposable cups and place them on the counter near the espresso machine.  \n- A second person is seen handling a plastic-wrapped item, possibly a coffee filter or accessory, while standing near the counter.\n[330-360s] - Hands unwrap a plastic-wrapped metal container near espresso machine.  \n- Cashier interacts with tablet POS system, selecting items from menu.  \n- Customer in white apron approaches counter, holding paper bag.", "history_tokens": 821, "history_utf8_bytes": 3474, "recent_frame_times_s": [355.00796875, 356.00796875, 357.00796875, 358.00796875, 359.00796875, 360.00796875, 361.00796875, 362.00796875, 363.00796875, 364.00796875, 365.00796875, 366.00796875, 367.00796875, 368.00796875, 369.00796875, 370.00796875, 371.00796875, 372.00796875, 373.00796875, 374.00796875, 375.00796875, 376.00796875, 377.00796875, 378.00796875, 379.00796875, 380.00796875, 381.00796875, 382.00796875, 383.00796875, 384.00796875], "recent_frames_sha256": "1e0874f63fa4c3d99751de9cf59e3ae42fc4b7e3ac0f82c3c82b80bcaab3892f", "num_recent_frames": 30, "tq": 716995.224874269, "t1": 716996.712720697, "ta": 716996.712720697, "te": 716996.902057228, "first_response_s": 1.4878464280627668, "answer_total_s": 1.6771829590434209, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 352, "content_group": "53e12fba1333fa4952579f88a60bd002e2446d9f2f0a0b2ada71ddc7ba7d6b50", "question": {"question_id": "sample_352_a374_q0", "video_id": 352, "video_path": "./videos/sample_352_real.mp4", "annotation_index": 374, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. An individual made a cappuccino and a flat white with oat milk, and served them in takeaway cups.", "B. An individual made an espresso and a latte, serving them in ceramic mugs for dine-in.", "C. An individual prepared tea and hot chocolate for takeaway, using regular milk for both.", "D. An individual brewed a strong filter coffee and an americano, serving them in large takeaway containers."], "answer": "A", "time_stamp_s": 573, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [500, 510], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_352_a374_q0", "video_id": 352, "time_stamp_s": 573, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9fc6928c86b11afc55a6343c872240ddeeee5395296dee194d5e90b595d9324c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [543.00796875, 544.00796875, 545.00796875, 546.00796875, 547.00796875, 548.00796875, 549.00796875, 550.00796875, 551.00796875, 552.00796875, 553.00796875, 554.00796875, 555.00796875, 556.00796875, 557.00796875, 558.00796875, 559.00796875, 560.00796875, 561.00796875, 562.00796875, 563.00796875, 564.00796875, 565.00796875, 566.00796875, 567.00796875, 568.00796875, 569.00796875, 570.00796875, 571.00796875, 572.00796875], "recent_frames_sha256": "3f4ecefe2995a69bea4b7182f5aa0df2ddd0419180c569bdb28273df79b70135", "num_recent_frames": 30, "tq": 716882.89856116, "t1": 716892.861659332, "ta": 716892.861659332, "te": 716892.900131825, "first_response_s": 9.963098171981983, "answer_total_s": 10.00157066504471, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_352_a374_q0", "video_id": 352, "time_stamp_s": 573, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a662b5f2848e14e298d653f83a0ef23de0e317d1294c430f5cf4e27d05ac5758", "condition_order": ["recent", "notes"], "memory": "[180-210s] - Hands remove a glass from a dishwasher rack, placing it on a countertop near a sink.  \n- A white towel is positioned on the countertop beside the sink, near a cutting board and knife.  \n- The dishwasher rack is partially filled with various cups and small containers, some of which are being handled by the person.\n[210-240s] - Hand places a beige ceramic cup into the dishwasher rack, adjusting its position among other cups.  \n- Dishwasher rack contains multiple cups and lids, some with visible residue or stains.  \n- Hand repeatedly repositions cups within the rack, ensuring proper placement for cleaning.\n[240-270s] - Person opens a refrigerator door, revealing a trash bin inside with crumpled paper and food waste.\n- They use a red-handled broom to sweep debris from the floor into the trash bin.\n- The broom is moved across the shiny white floor, collecting scattered items near the sink and cabinets.\n[270-300s] - Hand removes a metal strainer from a sink, then rinses it under running water.  \n- Hand places a metal strainer into a coffee machine's compartment, preparing for use.  \n- Coffee machine displays a digital readout showing \"3.0\" and \"1.0\" as operational parameters.\n[300-330s] - Person opens a cabinet, revealing stacked disposable cups and a container of coffee grounds.  \n- They retrieve a stack of white disposable cups and place them on the counter near the espresso machine.  \n- A second person is seen handling a plastic-wrapped item, possibly a coffee filter or accessory, while standing near the counter.\n[330-360s] - Hands unwrap a plastic-wrapped metal container near espresso machine.  \n- Cashier interacts with tablet POS system, selecting items from menu.  \n- Customer in white apron approaches counter, holding paper bag.\n[360-390s] - A hand taps a touchscreen POS system, navigating through product categories and selecting items.  \n- The screen displays a list of items with prices, and the user selects a product, triggering a payment interface.  \n- A red can of Coca-Cola sits on the counter next to the POS terminal, with a wooden sculpture visible in the background.\n[390-420s] - A hand places a red plastic cup on a counter near a cash register displaying a digital screen with payment options.  \n- The hand then moves to a cutting board where a loaf of whole grain bread is positioned, with a knife and tongs nearby.  \n- The bread is sliced with a knife, and the slices are transferred to a black tray, indicating preparation for takeaway.\n[420-450s] - Hands use tongs to lift a loaf of bread from a wooden cutting board.  \n- A text overlay reads \"Order (Takeaway) 1x Cappuccino - Whole.\"  \n- The bread is placed into a brown paper bag, with the bag being held open by the hands.\n[450-480s] - Barista picks up a white paper order slip from a drawer, showing \"Order (Takeaway) 1x Cappuccino - Whole 1x Flatwhite - Oat\".\n- Barista places the order slip on the counter and then picks up a portafilter, preparing to grind coffee beans.\n- Barista positions the portafilter under the coffee grinder, ready to grind coffee for the cappuccino.\n[480-510s] - Barista places a freshly brewed espresso shot into a white cup.  \n- A stack of disposable paper cups is positioned to the right of the espresso machine.  \n- The barista’s hand moves toward a container of oat milk, preparing to froth it.\n[510-540s] - Barista pours milk from a carton into a metal pitcher, preparing for a cappuccino.  \n- Barista places a white cup on the espresso machine's drip tray, positioning it under the steam wand.  \n- Barista presses a button on a digital device, likely to start the espresso extraction.\n[540-570s] - Barista pours steamed oat milk into a paper cup containing espresso, creating a latte art pattern.  \n- The cup is positioned on a wooden counter near a stack of paper cups and a brown paper bag.  \n- A text overlay displays the order: “1x Cappuccino, Whole, 1x Favorite, Oat.”", "history_tokens": 964, "history_utf8_bytes": 3930, "recent_frame_times_s": [543.00796875, 544.00796875, 545.00796875, 546.00796875, 547.00796875, 548.00796875, 549.00796875, 550.00796875, 551.00796875, 552.00796875, 553.00796875, 554.00796875, 555.00796875, 556.00796875, 557.00796875, 558.00796875, 559.00796875, 560.00796875, 561.00796875, 562.00796875, 563.00796875, 564.00796875, 565.00796875, 566.00796875, 567.00796875, 568.00796875, 569.00796875, 570.00796875, 571.00796875, 572.00796875], "recent_frames_sha256": "3f4ecefe2995a69bea4b7182f5aa0df2ddd0419180c569bdb28273df79b70135", "num_recent_frames": 30, "tq": 717060.011844539, "t1": 717066.009951477, "ta": 717066.009951477, "te": 717066.048267121, "first_response_s": 5.998106938088313, "answer_total_s": 6.036422581993975, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 354, "content_group": "3825a5aace07b82f1f7b64ee70ed08d6f4fb3a309c1e1bd467c974cf8020d78b", "question": {"question_id": "sample_354_a675_q0", "video_id": 354, "video_path": "./videos/sample_354_real.mp4", "annotation_index": 675, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual arranged dishes and served them to a customer in a kitchen setting.", "B. The individual wiped down the countertops and sanitized the kitchen utensils.", "C. The individual selected a glass, added ice from the ice maker.", "D. The individual took various tools from a drawer and began assembling a device."], "answer": "C", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_354_a675_q0", "video_id": 354, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7db65f2de4dfa9cca13c141357dfc30b00046965169acdc8afb97773c40229ad", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "401fb04b8b86c5b9993c6e8012d802b1b7c4a8b6cc741f9da4abff618e651246", "num_recent_frames": 10, "tq": 716689.761834112, "t1": 716690.841588157, "ta": 716690.841588157, "te": 716690.881257151, "first_response_s": 1.0797540450002998, "answer_total_s": 1.1194230390246958, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_354_a675_q0", "video_id": 354, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "97db975cca2e913485f9e6aba53dd1ad789d5c1a78b5741c9de4780dd612228b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "401fb04b8b86c5b9993c6e8012d802b1b7c4a8b6cc741f9da4abff618e651246", "num_recent_frames": 10, "tq": 716512.473283259, "t1": 716526.492888081, "ta": 716526.492888081, "te": 716526.768867365, "first_response_s": 14.019604822038673, "answer_total_s": 14.295584106002934, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 354, "content_group": "3825a5aace07b82f1f7b64ee70ed08d6f4fb3a309c1e1bd467c974cf8020d78b", "question": {"question_id": "sample_354_a676_q0", "video_id": 354, "video_path": "./videos/sample_354_real.mp4", "annotation_index": 676, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual made a sandwich using fresh ingredients and served it on a plate.", "B. The individual filled a pitcher with milk and steamed it.", "C. The individual organized cutlery in a drawer and cleaned the kitchen area.", "D. The individual cleaned the steaming wand and organized cups on a shelf."], "answer": "B", "time_stamp_s": 144, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [134, 144], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_354_a676_q0", "video_id": 354, "time_stamp_s": 144, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1fe4b42de1f714a19ddcdf7e2d07bdc0628c4a086100a4fc10d0d35cd7ef0e48", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334], "recent_frames_sha256": "622d4954c8f4995ee8e8123115825bc7df80efd400461cae9dee564424ceb6f2", "num_recent_frames": 30, "tq": 716690.903056223, "t1": 716702.503403554, "ta": 716702.503403554, "te": 716702.544085926, "first_response_s": 11.600347331026569, "answer_total_s": 11.641029703081585, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_354_a676_q0", "video_id": 354, "time_stamp_s": 144, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0930fdd3aac3db8bb1724349988216e879533f0385188779b22aaf3edaddf1ed", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person picks up a clear glass and places it under a faucet to fill with water.  \n- They then use tongs to transfer ice cubes from a container into the glass.  \n- After filling the glass, they place a metal scoop on the counter and pick up a box labeled \"Café\" near a coffee machine.\n[30-60s] - Person holds a potato and green container, then places potato on scale showing 0.00g, while green container is held in other hand.\n- Person picks up a small cup and places it on the scale, which then displays 0.00g.\n- Person moves a small cup from scale to countertop, then picks up a green container and places it on scale, which now shows 0.00g.\n[60-90s] - Hand pours green powder from a glass bowl into a small metal cup on a digital scale.  \n- Scale displays weight increasing as powder is added, then the hand lifts the cup off the scale.  \n- Hand places the cup into a brown paper cup, which is then set on a metal tray with other cups nearby.\n[90-120s] - Person uses a spoon to scoop coffee grounds into a portafilter, then places it on a digital scale.  \n- The scale displays a weight of 16.5 grams, indicating the measured amount of coffee.  \n- The person adjusts the portafilter’s position on the scale, ensuring proper alignment for tamping.", "history_tokens": 320, "history_utf8_bytes": 1259, "recent_frame_times_s": [114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334], "recent_frames_sha256": "622d4954c8f4995ee8e8123115825bc7df80efd400461cae9dee564424ceb6f2", "num_recent_frames": 30, "tq": 716561.802121775, "t1": 716563.388972381, "ta": 716563.388972381, "te": 716563.538593962, "first_response_s": 1.5868506060214713, "answer_total_s": 1.7364721869817004, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 354, "content_group": "3825a5aace07b82f1f7b64ee70ed08d6f4fb3a309c1e1bd467c974cf8020d78b", "question": {"question_id": "sample_354_a677_q0", "video_id": 354, "video_path": "./videos/sample_354_real.mp4", "annotation_index": 677, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual cleaned the countertop and put away kitchen utensils.", "B. This person cleaned the kitchen utensils used for making coffee.", "C. The individual prepared a sandwich, wrapped it up, and served it to a customer.", "D. The individual restocked supplies in a pantry and washed dishes."], "answer": "B", "time_stamp_s": 279, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [268, 278], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_354_a677_q0", "video_id": 354, "time_stamp_s": 279, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c871664772e90e732461c25b3fc3a5d07d6b7a015ed10a768cce7d480dbbbe0d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667], "recent_frames_sha256": "bdf932861f7d4e165d2227cc333ba6dc5e208e18edb4995b8bb2a1f55b25ad4e", "num_recent_frames": 30, "tq": 716702.567835655, "t1": 716709.823734225, "ta": 716709.823734225, "te": 716709.862098664, "first_response_s": 7.255898570059799, "answer_total_s": 7.2942630090983585, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_354_a677_q0", "video_id": 354, "time_stamp_s": 279, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6a94b9491c970ed15b64265d2d0066db12edadaa0f3df96a2a6d8960e28f5153", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person picks up a clear glass and places it under a faucet to fill with water.  \n- They then use tongs to transfer ice cubes from a container into the glass.  \n- After filling the glass, they place a metal scoop on the counter and pick up a box labeled \"Café\" near a coffee machine.\n[30-60s] - Person holds a potato and green container, then places potato on scale showing 0.00g, while green container is held in other hand.\n- Person picks up a small cup and places it on the scale, which then displays 0.00g.\n- Person moves a small cup from scale to countertop, then picks up a green container and places it on scale, which now shows 0.00g.\n[60-90s] - Hand pours green powder from a glass bowl into a small metal cup on a digital scale.  \n- Scale displays weight increasing as powder is added, then the hand lifts the cup off the scale.  \n- Hand places the cup into a brown paper cup, which is then set on a metal tray with other cups nearby.\n[90-120s] - Person uses a spoon to scoop coffee grounds into a portafilter, then places it on a digital scale.  \n- The scale displays a weight of 16.5 grams, indicating the measured amount of coffee.  \n- The person adjusts the portafilter’s position on the scale, ensuring proper alignment for tamping.\n[120-150s] - Hand places a metal portafilter with coffee grounds onto a digital scale, which reads 18.5g.  \n- Hand then moves the portafilter to a coffee machine's group head, preparing for extraction.  \n- A metal milk frothing pitcher is positioned under a tap, ready to be filled with water.\n[150-180s] - Hands hold a metal pitcher under a chrome faucet, then move it away as water flows.  \n- A clear glass with a straw is picked up and placed on the counter, then moved toward a drawer.  \n- A drawer is opened, revealing various items, including a blue container and a white object, before being closed.\n[180-210s] - A hand pours a dark liquid from a bottle into a glass containing ice and mint leaves.  \n- The glass is placed on a metal drip tray next to another similar glass.  \n- A white pitcher is positioned near the sink, with a hand reaching toward it.\n[210-240s] - Person places a small metal cup on a digital scale, which reads \"0.00 g\" as they prepare to measure coffee grounds.\n- They then position the cup under the espresso machine's portafilter, ready to extract coffee.\n- The espresso machine's portafilter is inserted into the machine, and the brewing process begins, with steam rising from the machine.\n[240-270s] - Barista pours steamed milk into a cup with espresso, creating latte art.  \n- A green beverage in a glass is placed beside the latte on the counter.  \n- Barista picks up a metal pitcher from a shelf, likely for another drink preparation.", "history_tokens": 688, "history_utf8_bytes": 2732, "recent_frame_times_s": [249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667], "recent_frames_sha256": "bdf932861f7d4e165d2227cc333ba6dc5e208e18edb4995b8bb2a1f55b25ad4e", "num_recent_frames": 30, "tq": 716608.526628597, "t1": 716610.687784095, "ta": 716610.687784095, "te": 716610.969059585, "first_response_s": 2.161155497888103, "answer_total_s": 2.4424309879541397, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 354, "content_group": "3825a5aace07b82f1f7b64ee70ed08d6f4fb3a309c1e1bd467c974cf8020d78b", "question": {"question_id": "sample_354_a678_q0", "video_id": 354, "video_path": "./videos/sample_354_real.mp4", "annotation_index": 678, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual arranged dishes on a table and served a customer.", "B. The individual measured and cleaned the portafilter, weighed handle filter, and prepared it for brewing.", "C. The individual wiped down the counters and organized kitchen utensils.", "D. The individual prepared a sandwich, wrapped it, and handed it to a customer."], "answer": "B", "time_stamp_s": 412, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [402, 412], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_354_a678_q0", "video_id": 354, "time_stamp_s": 412, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "384ac975f57e789059a0792142e8d0144d006287f589c4090b7b012dc9671a8c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [382.0149666666667, 383.01596666666666, 384.0169666666667, 385.01796666666667, 386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665, 394.0269666666667, 395.02796666666666, 396.0289666666667, 397.02996666666667, 398.03096666666664, 399.0319666666667, 400.03296666666665, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106], "recent_frames_sha256": "80f741c5e5e5c9865bcac201f0eeb66bc8632368e5b5e86dd3656613982564ce", "num_recent_frames": 30, "tq": 716709.876074978, "t1": 716717.158709966, "ta": 716717.158709966, "te": 716717.197284865, "first_response_s": 7.282634987961501, "answer_total_s": 7.321209886926226, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_354_a678_q0", "video_id": 354, "time_stamp_s": 412, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fa4112a1f7a8904aabfaf989ba406146b6be122424bdb0e77115b0854550033e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person picks up a clear glass and places it under a faucet to fill with water.  \n- They then use tongs to transfer ice cubes from a container into the glass.  \n- After filling the glass, they place a metal scoop on the counter and pick up a box labeled \"Café\" near a coffee machine.\n[30-60s] - Person holds a potato and green container, then places potato on scale showing 0.00g, while green container is held in other hand.\n- Person picks up a small cup and places it on the scale, which then displays 0.00g.\n- Person moves a small cup from scale to countertop, then picks up a green container and places it on scale, which now shows 0.00g.\n[60-90s] - Hand pours green powder from a glass bowl into a small metal cup on a digital scale.  \n- Scale displays weight increasing as powder is added, then the hand lifts the cup off the scale.  \n- Hand places the cup into a brown paper cup, which is then set on a metal tray with other cups nearby.\n[90-120s] - Person uses a spoon to scoop coffee grounds into a portafilter, then places it on a digital scale.  \n- The scale displays a weight of 16.5 grams, indicating the measured amount of coffee.  \n- The person adjusts the portafilter’s position on the scale, ensuring proper alignment for tamping.\n[120-150s] - Hand places a metal portafilter with coffee grounds onto a digital scale, which reads 18.5g.  \n- Hand then moves the portafilter to a coffee machine's group head, preparing for extraction.  \n- A metal milk frothing pitcher is positioned under a tap, ready to be filled with water.\n[150-180s] - Hands hold a metal pitcher under a chrome faucet, then move it away as water flows.  \n- A clear glass with a straw is picked up and placed on the counter, then moved toward a drawer.  \n- A drawer is opened, revealing various items, including a blue container and a white object, before being closed.\n[180-210s] - A hand pours a dark liquid from a bottle into a glass containing ice and mint leaves.  \n- The glass is placed on a metal drip tray next to another similar glass.  \n- A white pitcher is positioned near the sink, with a hand reaching toward it.\n[210-240s] - Person places a small metal cup on a digital scale, which reads \"0.00 g\" as they prepare to measure coffee grounds.\n- They then position the cup under the espresso machine's portafilter, ready to extract coffee.\n- The espresso machine's portafilter is inserted into the machine, and the brewing process begins, with steam rising from the machine.\n[240-270s] - Barista pours steamed milk into a cup with espresso, creating latte art.  \n- A green beverage in a glass is placed beside the latte on the counter.  \n- Barista picks up a metal pitcher from a shelf, likely for another drink preparation.\n[270-300s] - Hand places a small container into a sink, then picks up a green straw from the counter.  \n- Hand reaches for a digital scale, then moves to a cabinet, pulling out a cylindrical metal object.  \n- Hand retrieves a blue bowl from the floor near a stainless steel appliance, then places it on the counter.\n[300-330s] - Person holds a clear plastic container with ice cubes, moving it toward a sink area.  \n- Another hand reaches for a blue sippy cup with a straw, positioned near the sink.  \n- A white plastic jug is picked up and moved toward the sink, suggesting preparation for a drink or cleaning task.\n[330-360s] - Hands wipe a small glass cup with a white cloth, then rinse it under running water.  \n- A small glass cup filled with espresso is held and tilted, then poured into a larger measuring cup.  \n- The person moves toward a sink area, where a blue bucket and a white cloth are visible on the floor.\n[360-390s] - Hand reaches into a cabinet to retrieve a small white object, likely a utensil or tool.  \n- The object is then used to interact with a coffee machine's drip tray or spout area.  \n- A digital scale is visible on the counter, showing a reading of 0.00 grams, indicating it's ready for use.", "history_tokens": 990, "history_utf8_bytes": 3956, "recent_frame_times_s": [382.0149666666667, 383.01596666666666, 384.0169666666667, 385.01796666666667, 386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665, 394.0269666666667, 395.02796666666666, 396.0289666666667, 397.02996666666667, 398.03096666666664, 399.0319666666667, 400.03296666666665, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106], "recent_frames_sha256": "80f741c5e5e5c9865bcac201f0eeb66bc8632368e5b5e86dd3656613982564ce", "num_recent_frames": 30, "tq": 716643.162687893, "t1": 716649.193790664, "ta": 716649.193790664, "te": 716649.342148431, "first_response_s": 6.031102770939469, "answer_total_s": 6.179460537969135, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 354, "content_group": "3825a5aace07b82f1f7b64ee70ed08d6f4fb3a309c1e1bd467c974cf8020d78b", "question": {"question_id": "sample_354_a679_q0", "video_id": 354, "video_path": "./videos/sample_354_real.mp4", "annotation_index": 679, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual poured a latte into a to-go cup and handed it to a customer.", "B. The individual set up the handle filter,and prepared an espresso shot.", "C. The individual measured coffee grounds and cleaned the grinder.", "D. The individual operated the espresso machine, steamed milk, and cleaned the milk frother."], "answer": "B", "time_stamp_s": 546, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [536, 546], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_354_a679_q0", "video_id": 354, "time_stamp_s": 546, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ebff8307eddf1c347c0c2bb8ef11cc484be51a74b827e8422a343b0a47e79007", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [516.0155, 517.0165, 518.0175, 519.0185, 520.0195, 521.0205, 522.0215, 523.0225, 524.0235, 525.0245, 526.0255, 527.0265, 528.0275, 529.0285, 530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333], "recent_frames_sha256": "d5298511543912b698d96a9f49056c5f67613408ace7718a04fe4a836bd9c543", "num_recent_frames": 30, "tq": 716717.207703005, "t1": 716728.794286291, "ta": 716728.794286291, "te": 716728.833828607, "first_response_s": 11.586583285941742, "answer_total_s": 11.6261256019352, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_354_a679_q0", "video_id": 354, "time_stamp_s": 546, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a0293c31fb885c82a24ad7785bbf3777880cc37b273134edc133b61599910068", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Hands hold a metal pitcher under a chrome faucet, then move it away as water flows.  \n- A clear glass with a straw is picked up and placed on the counter, then moved toward a drawer.  \n- A drawer is opened, revealing various items, including a blue container and a white object, before being closed.\n[180-210s] - A hand pours a dark liquid from a bottle into a glass containing ice and mint leaves.  \n- The glass is placed on a metal drip tray next to another similar glass.  \n- A white pitcher is positioned near the sink, with a hand reaching toward it.\n[210-240s] - Person places a small metal cup on a digital scale, which reads \"0.00 g\" as they prepare to measure coffee grounds.\n- They then position the cup under the espresso machine's portafilter, ready to extract coffee.\n- The espresso machine's portafilter is inserted into the machine, and the brewing process begins, with steam rising from the machine.\n[240-270s] - Barista pours steamed milk into a cup with espresso, creating latte art.  \n- A green beverage in a glass is placed beside the latte on the counter.  \n- Barista picks up a metal pitcher from a shelf, likely for another drink preparation.\n[270-300s] - Hand places a small container into a sink, then picks up a green straw from the counter.  \n- Hand reaches for a digital scale, then moves to a cabinet, pulling out a cylindrical metal object.  \n- Hand retrieves a blue bowl from the floor near a stainless steel appliance, then places it on the counter.\n[300-330s] - Person holds a clear plastic container with ice cubes, moving it toward a sink area.  \n- Another hand reaches for a blue sippy cup with a straw, positioned near the sink.  \n- A white plastic jug is picked up and moved toward the sink, suggesting preparation for a drink or cleaning task.\n[330-360s] - Hands wipe a small glass cup with a white cloth, then rinse it under running water.  \n- A small glass cup filled with espresso is held and tilted, then poured into a larger measuring cup.  \n- The person moves toward a sink area, where a blue bucket and a white cloth are visible on the floor.\n[360-390s] - Hand reaches into a cabinet to retrieve a small white object, likely a utensil or tool.  \n- The object is then used to interact with a coffee machine's drip tray or spout area.  \n- A digital scale is visible on the counter, showing a reading of 0.00 grams, indicating it's ready for use.\n[390-420s] - Hand holds portafilter under black coffee machine spout, positioned to receive liquid.  \n- Digital scale displays \"0.00\" as hand prepares to measure coffee grounds.  \n- Portafilter is moved toward scale, indicating next step in coffee preparation.\n[420-450s] - A hand reaches for a jar of coffee beans on a shelf, then moves to pour beans into a paper cup.  \n- Another hand holds a small container, possibly containing sugar or creamer, while a third hand pours liquid from a bottle into the cup.  \n- The counter is cluttered with various coffee-making tools, cups, and jars, indicating a busy preparation area.\n[450-480s] - Hands are washing a ceramic mug under running water in a kitchen sink.  \n- A red sponge is used to scrub the mug’s exterior while water flows.  \n- The sink contains other mugs, a yellow sponge, and a metal strainer nearby.\n[480-510s] - Person's hands are visibly wet and rubbing together under running water in a sink.  \n- A blue sippy cup with a straw is held in one hand, positioned near the sink area.  \n- The person moves away from the sink, transitioning to a countertop where a laptop and other items are visible.\n[510-540s] - Hand places a small cup on a digital scale, which reads \"000.00\" before being filled with coffee grounds.  \n- Coffee grounds are measured and transferred into a portafilter, then placed into an espresso machine's group head.  \n- Espresso machine's digital display shows \"00:00\" as the brewing process begins, with steam and water flow visible.", "history_tokens": 969, "history_utf8_bytes": 3919, "recent_frame_times_s": [516.0155, 517.0165, 518.0175, 519.0185, 520.0195, 521.0205, 522.0215, 523.0225, 524.0235, 525.0245, 526.0255, 527.0265, 528.0275, 529.0285, 530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333], "recent_frames_sha256": "d5298511543912b698d96a9f49056c5f67613408ace7718a04fe4a836bd9c543", "num_recent_frames": 30, "tq": 716681.917342772, "t1": 716689.559747183, "ta": 716689.559747183, "te": 716689.749085339, "first_response_s": 7.642404410988092, "answer_total_s": 7.831742567010224, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 356, "content_group": "355509579eb4b2c15245628d91d43bfdae2dcb0dc3943256130814fa4eab9102", "question": {"question_id": "sample_356_a1183_q0", "video_id": 356, "video_path": "./videos/sample_356_real.mp4", "annotation_index": 1183, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The person picked up a metal pitcher, cleaned it, and placed it back on the shelf.", "B. The person heated a metal pitcher, added ingredients, and served them in a cup.", "C. The person cleaned a metal pitcher, filled it with water, and placed it next to other pitchers.", "D. The person retrieved one metal pitcher, steamed it, and returned the milk carton to the fridge."], "answer": "D", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_356_a1183_q0", "video_id": 356, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2e73ecdde15829c1be7d903c52f6ebede446360b63f067678eefbe81767e828e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.038, 1.0056333333333334, 2.0066333333333333, 3.007633333333333, 4.008633333333333, 5.009633333333333, 6.010633333333334, 7.011633333333333, 8.012633333333333, 9.013633333333333], "recent_frames_sha256": "e45e8de826721ace8a31bd6ad5ccaec79de953747c76beb3f59a84bcc094ce9e", "num_recent_frames": 10, "tq": 710755.475987962, "t1": 710756.038871027, "ta": 710756.038871027, "te": 710756.078085563, "first_response_s": 0.5628830649657175, "answer_total_s": 0.602097601047717, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_356_a1183_q0", "video_id": 356, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "63f2d2dff88544291248069c6d9848b6d046dd706a4a3e408aada8db0745701d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.038, 1.0056333333333334, 2.0066333333333333, 3.007633333333333, 4.008633333333333, 5.009633333333333, 6.010633333333334, 7.011633333333333, 8.012633333333333, 9.013633333333333], "recent_frames_sha256": "e45e8de826721ace8a31bd6ad5ccaec79de953747c76beb3f59a84bcc094ce9e", "num_recent_frames": 10, "tq": 710586.527683742, "t1": 710587.548266091, "ta": 710587.548266091, "te": 710587.695626216, "first_response_s": 1.0205823490396142, "answer_total_s": 1.1679424740141258, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 356, "content_group": "355509579eb4b2c15245628d91d43bfdae2dcb0dc3943256130814fa4eab9102", "question": {"question_id": "sample_356_a1184_q0", "video_id": 356, "video_path": "./videos/sample_356_real.mp4", "annotation_index": 1184, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The person prepared a coffee mug, poured milk into it, and placed it under a coffee machine.", "B. The person cleaned a coffee grinder, filled it with new beans, and started grinding the coffee.", "C. The person filled a coffee pot with water, placed it in the machine, and added coffee grounds to the filter.", "D. The person ground coffee beans, measured the coffee grounds on a scale, and adjusted the amount until it reached the desired weight."], "answer": "D", "time_stamp_s": 145, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [136, 146], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_356_a1184_q0", "video_id": 356, "time_stamp_s": 145, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a7a3a68f13b2b5f0298a9a67662bb594dad30ef1da633c712163b056fec348dd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [115.01953333333333, 116.02053333333333, 117.02153333333334, 118.02253333333333, 119.02353333333333, 120.02453333333334, 121.02553333333333, 122.02653333333333, 123.02753333333334, 124.02853333333333, 125.02953333333333, 126.03053333333334, 127.03153333333333, 128.03253333333333, 129.00016666666667, 130.00116666666668, 131.00216666666665, 132.00316666666666, 133.00416666666666, 134.00516666666667, 135.00616666666667, 136.00716666666668, 137.00816666666665, 138.00916666666666, 139.01016666666666, 140.01116666666667, 141.01216666666667, 142.01316666666668, 143.01416666666665, 144.01516666666666], "recent_frames_sha256": "8e481a763388c54a011ee514d44755f10223918a2a606aa88f9bc6b8c1acbb7b", "num_recent_frames": 30, "tq": 710756.101743789, "t1": 710766.50828864, "ta": 710766.50828864, "te": 710766.549566461, "first_response_s": 10.406544850906357, "answer_total_s": 10.447822671965696, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_356_a1184_q0", "video_id": 356, "time_stamp_s": 145, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2153e16b553394da477d3454668567703ca76769488d17760cb5a00fdda53a1e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hand places a green-capped container into a coffee machine's hopper, then removes it after a brief interaction.  \n- A person picks up a black cylindrical object (possibly a portafilter) and moves it toward the coffee machine's group head.  \n- A digital scale displays \"0.00-863\" as a hand adjusts or positions a small metal cup near it, suggesting preparation for coffee measurement.\n[30-60s] - Hand holds a small metal cup under a faucet, filling it with water.  \n- A digital scale displays \"0.00\" as the hand places a metal cup on it.  \n- Background shows a coffee machine, mugs, and a \"LAVAZZA\" bag on the counter.\n[60-90s] - Person holds a metal pitcher under a faucet, filling it with water.  \n- Person then places the pitcher on a metal grate, wiping it with a cloth.  \n- Person picks up a small cup and pours a dark liquid from the pitcher into it.\n[90-120s] - Hand pours steamed milk into a cup containing espresso, creating a layered drink.  \n- The cup is moved away from the espresso machine's spout after milk is poured.  \n- A stainless steel pitcher is held in the hand, likely containing the steamed milk.", "history_tokens": 288, "history_utf8_bytes": 1128, "recent_frame_times_s": [115.01953333333333, 116.02053333333333, 117.02153333333334, 118.02253333333333, 119.02353333333333, 120.02453333333334, 121.02553333333333, 122.02653333333333, 123.02753333333334, 124.02853333333333, 125.02953333333333, 126.03053333333334, 127.03153333333333, 128.03253333333333, 129.00016666666667, 130.00116666666668, 131.00216666666665, 132.00316666666666, 133.00416666666666, 134.00516666666667, 135.00616666666667, 136.00716666666668, 137.00816666666665, 138.00916666666666, 139.01016666666666, 140.01116666666667, 141.01216666666667, 142.01316666666668, 143.01416666666665, 144.01516666666666], "recent_frames_sha256": "8e481a763388c54a011ee514d44755f10223918a2a606aa88f9bc6b8c1acbb7b", "num_recent_frames": 30, "tq": 710621.887339408, "t1": 710622.876575159, "ta": 710622.876575159, "te": 710622.913991854, "first_response_s": 0.9892357509816065, "answer_total_s": 1.026652445900254, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 356, "content_group": "355509579eb4b2c15245628d91d43bfdae2dcb0dc3943256130814fa4eab9102", "question": {"question_id": "sample_356_a1185_q0", "video_id": 356, "video_path": "./videos/sample_356_real.mp4", "annotation_index": 1185, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The person prepared a coffee, added sugar, and stirred it with a spoon.", "B. The person brewed tea, added honey, and placed it on the counter to be served.", "C. The person filled a cup with water, added ice, and handed it to a customer.", "D. The person steamed milk, poured it into a cup with some green liquid, and created a latte art."], "answer": "D", "time_stamp_s": 281, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [272, 282], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_356_a1185_q0", "video_id": 356, "time_stamp_s": 281, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3bacc402fe326c81091f91e27c27ccd23465b8b1b86ec13cee030f64cc8dd814", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [251.02206666666666, 252.02306666666667, 253.02406666666667, 254.02506666666667, 255.02606666666668, 256.02706666666666, 257.0280666666667, 258.02906666666667, 259.03006666666664, 260.0310666666667, 261.03206666666665, 262.0330666666667, 263.0007, 264.0017, 265.0027, 266.0037, 267.0047, 268.0057, 269.0067, 270.0077, 271.0087, 272.0097, 273.0107, 274.0117, 275.0127, 276.0137, 277.0147, 278.0157, 279.0167, 280.0177], "recent_frames_sha256": "687018724905945f9626aca0856cc3d950e03f8409b723f1831fb3b1eaca58e5", "num_recent_frames": 30, "tq": 710766.560951206, "t1": 710777.331248291, "ta": 710777.331248291, "te": 710777.369820701, "first_response_s": 10.77029708493501, "answer_total_s": 10.808869494940154, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_356_a1185_q0", "video_id": 356, "time_stamp_s": 281, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1b828319a271d24283c4c82ce1c47b5d30720ad985efe0f3944f4c651740c88e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hand places a green-capped container into a coffee machine's hopper, then removes it after a brief interaction.  \n- A person picks up a black cylindrical object (possibly a portafilter) and moves it toward the coffee machine's group head.  \n- A digital scale displays \"0.00-863\" as a hand adjusts or positions a small metal cup near it, suggesting preparation for coffee measurement.\n[30-60s] - Hand holds a small metal cup under a faucet, filling it with water.  \n- A digital scale displays \"0.00\" as the hand places a metal cup on it.  \n- Background shows a coffee machine, mugs, and a \"LAVAZZA\" bag on the counter.\n[60-90s] - Person holds a metal pitcher under a faucet, filling it with water.  \n- Person then places the pitcher on a metal grate, wiping it with a cloth.  \n- Person picks up a small cup and pours a dark liquid from the pitcher into it.\n[90-120s] - Hand pours steamed milk into a cup containing espresso, creating a layered drink.  \n- The cup is moved away from the espresso machine's spout after milk is poured.  \n- A stainless steel pitcher is held in the hand, likely containing the steamed milk.\n[120-150s] - Hand places a metal portafilter onto a digital scale, which displays \"0.00\" as it begins to weigh coffee grounds.\n- Coffee grounds are measured and transferred into the portafilter, with the scale showing increasing weight up to \"18.00\" grams.\n- The portafilter is then positioned under the espresso machine's group head, preparing for extraction.\n[150-180s] - Hand holds a glass jar with green paste, scooping it into a small metal cup placed on a digital scale.  \n- Scale displays weight readings (e.g., 0:00:30, 0:00:31) as the paste is measured.  \n- Background shows coffee equipment, including a grinder and espresso machine, with a sink and shelf holding various mugs.\n[180-210s] - A hand holds a dark, cylindrical container, tilting it to pour a dark liquid into a brown paper cup positioned under a metal drip tray.  \n- The cup is placed on a metal grate, with a stack of similar cups nearby, suggesting a coffee preparation station.  \n- The hand then moves the container away, revealing a digital scale showing \"0.00\" and a coffee machine in the background.\n[210-240s] - Person holds a metal portafilter with coffee grounds, preparing to tamp it.  \n- They pour water from a jug into a metal pitcher, likely for steaming or dilution.  \n- The espresso machine's steam wand is visible, positioned near the pitcher, ready for use.\n[240-270s] - Person holds a stainless steel milk frothing pitcher, positioning it under a faucet to fill with water.  \n- A brown paper cup is visible on the counter to the left, and a second person is seated in the background.  \n- The pitcher is tilted slightly as water flows into it, indicating the action of filling.", "history_tokens": 706, "history_utf8_bytes": 2797, "recent_frame_times_s": [251.02206666666666, 252.02306666666667, 253.02406666666667, 254.02506666666667, 255.02606666666668, 256.02706666666666, 257.0280666666667, 258.02906666666667, 259.03006666666664, 260.0310666666667, 261.03206666666665, 262.0330666666667, 263.0007, 264.0017, 265.0027, 266.0037, 267.0047, 268.0057, 269.0067, 270.0077, 271.0087, 272.0097, 273.0107, 274.0117, 275.0127, 276.0137, 277.0147, 278.0157, 279.0167, 280.0177], "recent_frames_sha256": "687018724905945f9626aca0856cc3d950e03f8409b723f1831fb3b1eaca58e5", "num_recent_frames": 30, "tq": 710665.503353772, "t1": 710667.356426825, "ta": 710667.356426825, "te": 710667.63792948, "first_response_s": 1.8530730530619621, "answer_total_s": 2.13457570807077, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 356, "content_group": "355509579eb4b2c15245628d91d43bfdae2dcb0dc3943256130814fa4eab9102", "question": {"question_id": "sample_356_a1186_q0", "video_id": 356, "video_path": "./videos/sample_356_real.mp4", "annotation_index": 1186, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The person rinsed the pitcher with cold water and placed it on a shelf.", "B. The person brewed coffee and added milk to it before serving.", "C. The person cleaned a coffee machine and replaced the portafilter.", "D. The person steamed milk in a metal pitcher while setting a cup under an espresso machine."], "answer": "D", "time_stamp_s": 417, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [408, 418], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_356_a1186_q0", "video_id": 356, "time_stamp_s": 417, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "439b6301dcdb0322ad555038d97a5732edac60d7dc665ce8863a4aa79e437d2d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [387.0246, 388.0256, 389.0266, 390.0276, 391.0286, 392.0296, 393.0306, 394.0316, 395.0326, 396.0002333333333, 397.00123333333335, 398.0022333333333, 399.00323333333336, 400.00423333333333, 401.0052333333333, 402.00623333333334, 403.0072333333333, 404.00823333333335, 405.0092333333333, 406.01023333333336, 407.01123333333334, 408.0122333333333, 409.01323333333335, 410.0142333333333, 411.01523333333336, 412.01623333333333, 413.0172333333333, 414.01823333333334, 415.0192333333333, 416.02023333333335], "recent_frames_sha256": "80ff31c057a7cb73c3b69465f1a90b2ff71c1bc9082b529d9ff151e3ae176095", "num_recent_frames": 30, "tq": 710777.3849763, "t1": 710788.341240065, "ta": 710788.341240065, "te": 710788.63829983, "first_response_s": 10.956263765110634, "answer_total_s": 11.253323530079797, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_356_a1186_q0", "video_id": 356, "time_stamp_s": 417, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "147522353c60fbf32525be3c42d2f12a1de465ecb6044c9b7f864a224a35a688", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hand places a green-capped container into a coffee machine's hopper, then removes it after a brief interaction.  \n- A person picks up a black cylindrical object (possibly a portafilter) and moves it toward the coffee machine's group head.  \n- A digital scale displays \"0.00-863\" as a hand adjusts or positions a small metal cup near it, suggesting preparation for coffee measurement.\n[30-60s] - Hand holds a small metal cup under a faucet, filling it with water.  \n- A digital scale displays \"0.00\" as the hand places a metal cup on it.  \n- Background shows a coffee machine, mugs, and a \"LAVAZZA\" bag on the counter.\n[60-90s] - Person holds a metal pitcher under a faucet, filling it with water.  \n- Person then places the pitcher on a metal grate, wiping it with a cloth.  \n- Person picks up a small cup and pours a dark liquid from the pitcher into it.\n[90-120s] - Hand pours steamed milk into a cup containing espresso, creating a layered drink.  \n- The cup is moved away from the espresso machine's spout after milk is poured.  \n- A stainless steel pitcher is held in the hand, likely containing the steamed milk.\n[120-150s] - Hand places a metal portafilter onto a digital scale, which displays \"0.00\" as it begins to weigh coffee grounds.\n- Coffee grounds are measured and transferred into the portafilter, with the scale showing increasing weight up to \"18.00\" grams.\n- The portafilter is then positioned under the espresso machine's group head, preparing for extraction.\n[150-180s] - Hand holds a glass jar with green paste, scooping it into a small metal cup placed on a digital scale.  \n- Scale displays weight readings (e.g., 0:00:30, 0:00:31) as the paste is measured.  \n- Background shows coffee equipment, including a grinder and espresso machine, with a sink and shelf holding various mugs.\n[180-210s] - A hand holds a dark, cylindrical container, tilting it to pour a dark liquid into a brown paper cup positioned under a metal drip tray.  \n- The cup is placed on a metal grate, with a stack of similar cups nearby, suggesting a coffee preparation station.  \n- The hand then moves the container away, revealing a digital scale showing \"0.00\" and a coffee machine in the background.\n[210-240s] - Person holds a metal portafilter with coffee grounds, preparing to tamp it.  \n- They pour water from a jug into a metal pitcher, likely for steaming or dilution.  \n- The espresso machine's steam wand is visible, positioned near the pitcher, ready for use.\n[240-270s] - Person holds a stainless steel milk frothing pitcher, positioning it under a faucet to fill with water.  \n- A brown paper cup is visible on the counter to the left, and a second person is seated in the background.  \n- The pitcher is tilted slightly as water flows into it, indicating the action of filling.\n[270-300s] - A hand pours steamed milk into a green beverage in a paper cup, creating a latte art design.  \n- The cup is placed on a metal drip tray near coffee taps, with stacked paper cups nearby.  \n- A person in the background is partially visible, seated at a table with a coffee machine and other equipment.\n[300-330s] - Hands are seen holding a coffee grinder, actively grinding coffee beans into a metal container.  \n- The grinder is positioned on a kitchen counter, with a sink and various kitchen items visible nearby.  \n- A person in dark clothing is partially visible in the background, standing near the counter.\n[330-360s] - Hand places a portafilter into an espresso machine's group head, with a digital display showing \"03\" seconds.\n- A hand holds a small cup while another hand adjusts a digital scale, which reads \"0.00\" grams.\n- The scale is positioned on a countertop next to a coffee grinder and a container of coffee beans.\n[360-390s] - Person holds a portafilter with coffee grounds, positioning it under the espresso machine's group head.  \n- Espresso machine's lever is pulled back, indicating the start of the extraction process.  \n- A black container with a red liquid is visible to the left, near a wall-mounted sign.", "history_tokens": 1003, "history_utf8_bytes": 4042, "recent_frame_times_s": [387.0246, 388.0256, 389.0266, 390.0276, 391.0286, 392.0296, 393.0306, 394.0316, 395.0326, 396.0002333333333, 397.00123333333335, 398.0022333333333, 399.00323333333336, 400.00423333333333, 401.0052333333333, 402.00623333333334, 403.0072333333333, 404.00823333333335, 405.0092333333333, 406.01023333333336, 407.01123333333334, 408.0122333333333, 409.01323333333335, 410.0142333333333, 411.01523333333336, 412.01623333333333, 413.0172333333333, 414.01823333333334, 415.0192333333333, 416.02023333333335], "recent_frames_sha256": "80ff31c057a7cb73c3b69465f1a90b2ff71c1bc9082b529d9ff151e3ae176095", "num_recent_frames": 30, "tq": 710697.808688524, "t1": 710704.543464276, "ta": 710704.543464276, "te": 710704.583454713, "first_response_s": 6.734775752061978, "answer_total_s": 6.774766189046204, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 356, "content_group": "355509579eb4b2c15245628d91d43bfdae2dcb0dc3943256130814fa4eab9102", "question": {"question_id": "sample_356_a1187_q0", "video_id": 356, "video_path": "./videos/sample_356_real.mp4", "annotation_index": 1187, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The person filled a coffee cup, placed it in the sink, and cleaned it with water.", "B. The person ground coffee beans, measured the coffee grounds, and prepared a coffee pot.", "C. The person retrieved a milk carton from the fridge, measured the milk, and placed it on the counter.", "D. The person steamed the milk in one metal pitcher while shaking another metal pitcher simultaneously."], "answer": "D", "time_stamp_s": 554, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [544, 554], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_356_a1187_q0", "video_id": 356, "time_stamp_s": 554, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c0fc95a8fb021493ffa5edf8ed399336e840f55567cabe82220d42f0e4348552", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [524.0281333333334, 525.0291333333333, 526.0301333333333, 527.0311333333333, 528.0321333333334, 529.0331333333334, 530.0007666666667, 531.0017666666666, 532.0027666666666, 533.0037666666667, 534.0047666666667, 535.0057666666667, 536.0067666666666, 537.0077666666666, 538.0087666666667, 539.0097666666667, 540.0107666666667, 541.0117666666666, 542.0127666666667, 543.0137666666667, 544.0147666666667, 545.0157666666667, 546.0167666666666, 547.0177666666667, 548.0187666666667, 549.0197666666667, 550.0207666666666, 551.0217666666666, 552.0227666666667, 553.0237666666667], "recent_frames_sha256": "74118cc58807c52ac4c5da7fb0ec3f620a55c5472c71dc33717c65c1db0fee83", "num_recent_frames": 30, "tq": 710788.647491056, "t1": 710799.689047812, "ta": 710799.689047812, "te": 710799.72729261, "first_response_s": 11.041556756012142, "answer_total_s": 11.079801553976722, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_356_a1187_q0", "video_id": 356, "time_stamp_s": 554, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f0c133d051dcab33ca1bab7db513bf388a314495c2212399bde5caf58099882d", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Hand holds a glass jar with green paste, scooping it into a small metal cup placed on a digital scale.  \n- Scale displays weight readings (e.g., 0:00:30, 0:00:31) as the paste is measured.  \n- Background shows coffee equipment, including a grinder and espresso machine, with a sink and shelf holding various mugs.\n[180-210s] - A hand holds a dark, cylindrical container, tilting it to pour a dark liquid into a brown paper cup positioned under a metal drip tray.  \n- The cup is placed on a metal grate, with a stack of similar cups nearby, suggesting a coffee preparation station.  \n- The hand then moves the container away, revealing a digital scale showing \"0.00\" and a coffee machine in the background.\n[210-240s] - Person holds a metal portafilter with coffee grounds, preparing to tamp it.  \n- They pour water from a jug into a metal pitcher, likely for steaming or dilution.  \n- The espresso machine's steam wand is visible, positioned near the pitcher, ready for use.\n[240-270s] - Person holds a stainless steel milk frothing pitcher, positioning it under a faucet to fill with water.  \n- A brown paper cup is visible on the counter to the left, and a second person is seated in the background.  \n- The pitcher is tilted slightly as water flows into it, indicating the action of filling.\n[270-300s] - A hand pours steamed milk into a green beverage in a paper cup, creating a latte art design.  \n- The cup is placed on a metal drip tray near coffee taps, with stacked paper cups nearby.  \n- A person in the background is partially visible, seated at a table with a coffee machine and other equipment.\n[300-330s] - Hands are seen holding a coffee grinder, actively grinding coffee beans into a metal container.  \n- The grinder is positioned on a kitchen counter, with a sink and various kitchen items visible nearby.  \n- A person in dark clothing is partially visible in the background, standing near the counter.\n[330-360s] - Hand places a portafilter into an espresso machine's group head, with a digital display showing \"03\" seconds.\n- A hand holds a small cup while another hand adjusts a digital scale, which reads \"0.00\" grams.\n- The scale is positioned on a countertop next to a coffee grinder and a container of coffee beans.\n[360-390s] - Person holds a portafilter with coffee grounds, positioning it under the espresso machine's group head.  \n- Espresso machine's lever is pulled back, indicating the start of the extraction process.  \n- A black container with a red liquid is visible to the left, near a wall-mounted sign.\n[390-420s] - Hands hold a metal pitcher filled with milk, positioned near a coffee machine's steam wand.  \n- The pitcher is tilted slightly, suggesting preparation for steaming or frothing.  \n- A small cup is placed nearby, ready to receive the frothed milk.\n[420-450s] - Hands pour steamed milk from a metal pitcher into a small cup, using a steam wand for frothing.  \n- A digital scale is placed on a counter, with a metal cup resting on it, indicating preparation for weighing.  \n- A coffee machine with a blue light is visible in the background, suggesting it is active or ready for use.\n[450-480s] - Hand places a small metal portafilter with ground coffee into a coffee machine's brewing group, as the machine's digital display shows \"0.00\" and \"0.00\" for weight and time.  \n- Coffee machine's digital display updates to \"0.00\" and \"0.00\" as the hand adjusts the portafilter's position.  \n- A small amount of coffee grounds spills onto the white countertop near the machine's base.\n[480-510s] - Hand holds a metal pitcher under a faucet, filling it with water.  \n- Another hand holds a small metal cup, pouring milk from the pitcher into it.  \n- A green cup is positioned nearby, ready to receive the milk.\n[510-540s] - Hand pours steamed milk into espresso cup, creating latte art with swirling pattern.  \n- Milk pitcher is set down after pouring, then moved to a metal tray.  \n- Espresso cup with latte art is placed on a metal drip tray, next to a coffee machine.", "history_tokens": 1003, "history_utf8_bytes": 4025, "recent_frame_times_s": [524.0281333333334, 525.0291333333333, 526.0301333333333, 527.0311333333333, 528.0321333333334, 529.0331333333334, 530.0007666666667, 531.0017666666666, 532.0027666666666, 533.0037666666667, 534.0047666666667, 535.0057666666667, 536.0067666666666, 537.0077666666666, 538.0087666666667, 539.0097666666667, 540.0107666666667, 541.0117666666666, 542.0127666666667, 543.0137666666667, 544.0147666666667, 545.0157666666667, 546.0167666666666, 547.0177666666667, 548.0187666666667, 549.0197666666667, 550.0207666666666, 551.0217666666666, 552.0227666666667, 553.0237666666667], "recent_frames_sha256": "74118cc58807c52ac4c5da7fb0ec3f620a55c5472c71dc33717c65c1db0fee83", "num_recent_frames": 30, "tq": 710748.569580807, "t1": 710755.225679432, "ta": 710755.225679432, "te": 710755.430330491, "first_response_s": 6.656098625040613, "answer_total_s": 6.860749684041366, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 357, "content_group": "5d135731a88213c00619c56946bee313a0be041a5d4f02dc01476e2b0bc00f8b", "question": {"question_id": "sample_357_a2013_q0", "video_id": 357, "video_path": "./videos/sample_357_real.mp4", "annotation_index": 2013, "question_index": 0, "question": "Which of the following options best summarizes the actions that were just taken?", "options": ["A. The individual brewed tea, poured it into a teacup, and added milk.", "B. The individual steamed milk, poured it into a jug, and checked its temperature.", "C. The individual made coffee, poured it into a cup, and added sugar.", "D. The individual steamed milk, transferred it between jugs."], "answer": "D", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_357_a2013_q0", "video_id": 357, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f723644c6b4627e2a07cb261d3eeda834278fba10caa6731df4540b43978fb52", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.043, 1.0106333333333333, 2.011633333333333, 3.0126333333333335, 4.013633333333333, 5.014633333333333, 6.015633333333334, 7.016633333333333, 8.017633333333333, 9.018633333333334], "recent_frames_sha256": "cc3e4a49621835025a01699f223a20d091c105902b82902921ee8b071d206aba", "num_recent_frames": 10, "tq": 719176.637673586, "t1": 719184.200236427, "ta": 719184.200236427, "te": 719184.2374507, "first_response_s": 7.562562840990722, "answer_total_s": 7.599777113995515, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_357_a2013_q0", "video_id": 357, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8082c7b0c88c0c413f536a8becce584931c8e343eed56721d01518dd130d88fd", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.043, 1.0106333333333333, 2.011633333333333, 3.0126333333333335, 4.013633333333333, 5.014633333333333, 6.015633333333334, 7.016633333333333, 8.017633333333333, 9.018633333333334], "recent_frames_sha256": "cc3e4a49621835025a01699f223a20d091c105902b82902921ee8b071d206aba", "num_recent_frames": 10, "tq": 719231.15525255, "t1": 719232.678683315, "ta": 719232.678683315, "te": 719232.716851359, "first_response_s": 1.5234307650243863, "answer_total_s": 1.5615988089703023, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 357, "content_group": "5d135731a88213c00619c56946bee313a0be041a5d4f02dc01476e2b0bc00f8b", "question": {"question_id": "sample_357_a2014_q0", "video_id": 357, "video_path": "./videos/sample_357_real.mp4", "annotation_index": 2014, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual prepared a sandwich, added condiments, and served it on a plate.", "B. The individual washed plates, dried them, and placed them in a cupboard.", "C. The individual cooked pasta, drained it, and added sauce.", "D. The individual cleaned a coffee station, wiped the counter, and organized items."], "answer": "D", "time_stamp_s": 136, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [126, 136], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_357_a2014_q0", "video_id": 357, "time_stamp_s": 136, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0b96b71dda124694ac7a75ce5a140780261b8301bd39646b9e8188af0e23fd05", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [106.01553333333334, 107.01653333333333, 108.01753333333333, 109.01853333333334, 110.01953333333333, 111.02053333333333, 112.02153333333334, 113.02253333333333, 114.02353333333333, 115.02453333333334, 116.02553333333333, 117.02653333333333, 118.02753333333334, 119.02853333333333, 120.02953333333333, 121.03053333333334, 122.03153333333333, 123.03253333333333, 124.00016666666667, 125.00116666666666, 126.00216666666667, 127.00316666666667, 128.00416666666666, 129.00516666666667, 130.00616666666667, 131.00716666666668, 132.00816666666665, 133.00916666666666, 134.01016666666666, 135.01116666666667], "recent_frames_sha256": "56a9bd47d4812514940bf0a62a1f247f8aab253ac6989f3ded0c0a8226501958", "num_recent_frames": 30, "tq": 719184.246922113, "t1": 719195.947467359, "ta": 719195.947467359, "te": 719195.989470942, "first_response_s": 11.700545246014372, "answer_total_s": 11.742548828944564, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_357_a2014_q0", "video_id": 357, "time_stamp_s": 136, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "299b9997878c00f54effb1e3975876786ff7612c0db23261b65566c567c3bfb6", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold a metal pitcher under a coffee machine's spout, filling it with steamed milk.  \n- The pitcher is then moved to a drip tray, and the person places it down near a stack of paper cups.  \n- A hand reaches for a blue lid, likely to cover a container, while the coffee machine remains active in the background.\n[30-60s] - Barista uses a metal pitcher to pour steamed milk into a small cup containing espresso, creating a layered drink.  \n- The barista places the cup on a metal tray with a logo, then moves to a different station with a pitcher and a glass.  \n- A person in a black outfit is visible in the background, standing near a sink area.\n[60-90s] - Hand holds a metal portafilter with ground coffee, placing it on a digital scale that reads \"0.00\" and then adjusts to \"18.3\" grams.  \n- The portafilter is then moved toward a coffee machine's group head, preparing for extraction.  \n- A white paper bag labeled \"YI\" is visible on the counter, suggesting coffee bean packaging nearby.\n[90-120s] - Hand places a metal portafilter into a coffee machine's group head, then removes it after a brief interaction.  \n- A digital scale displays \"0.00 g\" as the person prepares to measure coffee grounds, with a milk jug nearby.  \n- The coffee machine's control panel is visible, showing a blue screen with a \"START\" button, indicating readiness for brewing.", "history_tokens": 338, "history_utf8_bytes": 1370, "recent_frame_times_s": [106.01553333333334, 107.01653333333333, 108.01753333333333, 109.01853333333334, 110.01953333333333, 111.02053333333333, 112.02153333333334, 113.02253333333333, 114.02353333333333, 115.02453333333334, 116.02553333333333, 117.02653333333333, 118.02753333333334, 119.02853333333333, 120.02953333333333, 121.03053333333334, 122.03153333333333, 123.03253333333333, 124.00016666666667, 125.00116666666666, 126.00216666666667, 127.00316666666667, 128.00416666666666, 129.00516666666667, 130.00616666666667, 131.00716666666668, 132.00816666666665, 133.00916666666666, 134.01016666666666, 135.01116666666667], "recent_frames_sha256": "56a9bd47d4812514940bf0a62a1f247f8aab253ac6989f3ded0c0a8226501958", "num_recent_frames": 30, "tq": 719267.054742463, "t1": 719272.744403054, "ta": 719272.744403054, "te": 719272.782827818, "first_response_s": 5.689660590956919, "answer_total_s": 5.72808535490185, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 357, "content_group": "5d135731a88213c00619c56946bee313a0be041a5d4f02dc01476e2b0bc00f8b", "question": {"question_id": "sample_357_a2015_q0", "video_id": 357, "video_path": "./videos/sample_357_real.mp4", "annotation_index": 2015, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual made a cup of tea, added honey, and stirred it.", "B. The individual brewed a pot of coffee, poured it into a thermos, and placed it on the counter.", "C. The individual cleaned a coffee cup, poured milk, and organized the counter.", "D. This person cleaned the handle filter and placed it on the coffee machine."], "answer": "D", "time_stamp_s": 260, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [252, 262], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_357_a2015_q0", "video_id": 357, "time_stamp_s": 260, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "02e6ea5a7a6eb69432eeb4cd798e3ca1c62b201eb54598eedcbdd5a349a25dc5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [230.00606666666667, 231.00706666666667, 232.00806666666668, 233.00906666666666, 234.01006666666666, 235.01106666666666, 236.01206666666667, 237.01306666666667, 238.01406666666668, 239.01506666666666, 240.01606666666666, 241.01706666666666, 242.01806666666667, 243.01906666666667, 244.02006666666668, 245.02106666666666, 246.02206666666666, 247.02306666666667, 248.02406666666667, 249.02506666666667, 250.02606666666668, 251.02706666666666, 252.02806666666666, 253.02906666666667, 254.03006666666667, 255.03106666666667, 256.03206666666665, 257.0330666666667, 258.0007, 259.0017], "recent_frames_sha256": "71574192538f06e7cd6131021f60ce2917fcc9e2afd45b12c7a88cc2f5dc5061", "num_recent_frames": 30, "tq": 719195.997368294, "t1": 719209.032103149, "ta": 719209.032103149, "te": 719209.068993317, "first_response_s": 13.034734854940325, "answer_total_s": 13.071625022916123, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_357_a2015_q0", "video_id": 357, "time_stamp_s": 260, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8b65a64ad4aa3712f69760a09712de433c86874c1c60bb7f3ab9733a5e2af73e", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold a metal pitcher under a coffee machine's spout, filling it with steamed milk.  \n- The pitcher is then moved to a drip tray, and the person places it down near a stack of paper cups.  \n- A hand reaches for a blue lid, likely to cover a container, while the coffee machine remains active in the background.\n[30-60s] - Barista uses a metal pitcher to pour steamed milk into a small cup containing espresso, creating a layered drink.  \n- The barista places the cup on a metal tray with a logo, then moves to a different station with a pitcher and a glass.  \n- A person in a black outfit is visible in the background, standing near a sink area.\n[60-90s] - Hand holds a metal portafilter with ground coffee, placing it on a digital scale that reads \"0.00\" and then adjusts to \"18.3\" grams.  \n- The portafilter is then moved toward a coffee machine's group head, preparing for extraction.  \n- A white paper bag labeled \"YI\" is visible on the counter, suggesting coffee bean packaging nearby.\n[90-120s] - Hand places a metal portafilter into a coffee machine's group head, then removes it after a brief interaction.  \n- A digital scale displays \"0.00 g\" as the person prepares to measure coffee grounds, with a milk jug nearby.  \n- The coffee machine's control panel is visible, showing a blue screen with a \"START\" button, indicating readiness for brewing.\n[120-150s] - Hand wipes down a stainless steel countertop near a coffee machine and sink area.  \n- A digital scale displays \"002.41\" as a hand places a small cup on it.  \n- A person holds a metal pitcher under a gooseneck faucet, filling it with steamed milk.\n[150-180s] - Person holds a metal pitcher under a faucet, filling it with milk.  \n- Person then pours the milk into a cup containing coffee grounds.  \n- The cup is held steady while milk is poured, creating a layered effect.\n[180-210s] - A hand holds a cup with latte art while pouring steamed milk from a metal pitcher.  \n- The espresso machine's digital display shows \"00:28\" as the hand prepares to pour.  \n- A person in a white shirt and black apron is visible in the background, standing near the counter.\n[210-240s] - Hand holds a spoon with ground coffee over a digital scale showing 18.0g, then moves to place the coffee into a portafilter.  \n- Portafilter is placed on a black mat, then tamped with a tamper, and the tamper is lifted away.  \n- Coffee grounds are visible in the portafilter, and the scale is no longer in use.", "history_tokens": 635, "history_utf8_bytes": 2465, "recent_frame_times_s": [230.00606666666667, 231.00706666666667, 232.00806666666668, 233.00906666666666, 234.01006666666666, 235.01106666666666, 236.01206666666667, 237.01306666666667, 238.01406666666668, 239.01506666666666, 240.01606666666666, 241.01706666666666, 242.01806666666667, 243.01906666666667, 244.02006666666668, 245.02106666666666, 246.02206666666666, 247.02306666666667, 248.02406666666667, 249.02506666666667, 250.02606666666668, 251.02706666666666, 252.02806666666666, 253.02906666666667, 254.03006666666667, 255.03106666666667, 256.03206666666665, 257.0330666666667, 258.0007, 259.0017], "recent_frames_sha256": "71574192538f06e7cd6131021f60ce2917fcc9e2afd45b12c7a88cc2f5dc5061", "num_recent_frames": 30, "tq": 719305.496126027, "t1": 719317.803401794, "ta": 719317.803401794, "te": 719318.019391793, "first_response_s": 12.307275767088868, "answer_total_s": 12.523265765979886, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 357, "content_group": "5d135731a88213c00619c56946bee313a0be041a5d4f02dc01476e2b0bc00f8b", "question": {"question_id": "sample_357_a2016_q0", "video_id": 357, "video_path": "./videos/sample_357_real.mp4", "annotation_index": 2016, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual made coffee, served it to a customer, and cleaned the table.", "B. The individual prepared tea, added sugar, and arranged cups on a tray.", "C. The individual cooked food, plated it, and cleaned the kitchen.", "D. The individual cleaned a weighing scale, organized the countertop."], "answer": "D", "time_stamp_s": 388, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [378, 388], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_357_a2016_q0", "video_id": 357, "time_stamp_s": 388, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3f52575d9a485dc501938825eb1a7b8d49d350b14c4ba67aa968edce2e71461d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [358.0006, 359.0016, 360.0026, 361.0036, 362.0046, 363.0056, 364.0066, 365.0076, 366.0086, 367.0096, 368.0106, 369.0116, 370.0126, 371.0136, 372.0146, 373.0156, 374.0166, 375.0176, 376.0186, 377.0196, 378.0206, 379.0216, 380.0226, 381.0236, 382.0246, 383.0256, 384.0266, 385.0276, 386.0286, 387.0296], "recent_frames_sha256": "64e6d08690969d5542b04a67e630ebb04f11530ccd30ec13ae8e0eeb9bde12d0", "num_recent_frames": 30, "tq": 719209.076761152, "t1": 719219.582636201, "ta": 719219.582636201, "te": 719219.619556043, "first_response_s": 10.505875049042515, "answer_total_s": 10.542794890934601, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_357_a2016_q0", "video_id": 357, "time_stamp_s": 388, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "58b06106dd2896a0924efc0bf543ffe6b160da2f522dce227711635085585f2d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands hold a metal pitcher under a coffee machine's spout, filling it with steamed milk.  \n- The pitcher is then moved to a drip tray, and the person places it down near a stack of paper cups.  \n- A hand reaches for a blue lid, likely to cover a container, while the coffee machine remains active in the background.\n[30-60s] - Barista uses a metal pitcher to pour steamed milk into a small cup containing espresso, creating a layered drink.  \n- The barista places the cup on a metal tray with a logo, then moves to a different station with a pitcher and a glass.  \n- A person in a black outfit is visible in the background, standing near a sink area.\n[60-90s] - Hand holds a metal portafilter with ground coffee, placing it on a digital scale that reads \"0.00\" and then adjusts to \"18.3\" grams.  \n- The portafilter is then moved toward a coffee machine's group head, preparing for extraction.  \n- A white paper bag labeled \"YI\" is visible on the counter, suggesting coffee bean packaging nearby.\n[90-120s] - Hand places a metal portafilter into a coffee machine's group head, then removes it after a brief interaction.  \n- A digital scale displays \"0.00 g\" as the person prepares to measure coffee grounds, with a milk jug nearby.  \n- The coffee machine's control panel is visible, showing a blue screen with a \"START\" button, indicating readiness for brewing.\n[120-150s] - Hand wipes down a stainless steel countertop near a coffee machine and sink area.  \n- A digital scale displays \"002.41\" as a hand places a small cup on it.  \n- A person holds a metal pitcher under a gooseneck faucet, filling it with steamed milk.\n[150-180s] - Person holds a metal pitcher under a faucet, filling it with milk.  \n- Person then pours the milk into a cup containing coffee grounds.  \n- The cup is held steady while milk is poured, creating a layered effect.\n[180-210s] - A hand holds a cup with latte art while pouring steamed milk from a metal pitcher.  \n- The espresso machine's digital display shows \"00:28\" as the hand prepares to pour.  \n- A person in a white shirt and black apron is visible in the background, standing near the counter.\n[210-240s] - Hand holds a spoon with ground coffee over a digital scale showing 18.0g, then moves to place the coffee into a portafilter.  \n- Portafilter is placed on a black mat, then tamped with a tamper, and the tamper is lifted away.  \n- Coffee grounds are visible in the portafilter, and the scale is no longer in use.\n[240-270s] - Hand places a black portafilter into a coffee machine's group head, with digital display showing \"2.2\" and \"2.2\" on adjacent machines.  \n- Hand adjusts a black coffee grinder, then moves to a digital scale to weigh coffee grounds into a portafilter.  \n- Coffee machine's steam wand is visible, with a white milk jug nearby, suggesting preparation for a latte or cappuccino.\n[270-300s] - Person holds a portafilter with coffee grounds, preparing to tamping it.  \n- Coffee machine is visible in the background, with a digital display showing \"000-4183\".  \n- Sink area with a faucet and a black mug is visible, suggesting preparation for cleaning or rinsing.\n[300-330s] - Hand wipes sink area with red cloth while holding a coffee cup.  \n- Coffee machine and milk jug are visible on countertop near sink.  \n- Person moves toward coffee station, hand reaching for a container.\n[330-360s] - Hand wipes down metal drip tray under coffee taps with cloth.  \n- Stacks of paper cups (black and brown) sit on circular trays beside taps.  \n- Barista in white shirt handles a paper cup near the taps, partially visible.", "history_tokens": 921, "history_utf8_bytes": 3585, "recent_frame_times_s": [358.0006, 359.0016, 360.0026, 361.0036, 362.0046, 363.0056, 364.0066, 365.0076, 366.0086, 367.0096, 368.0106, 369.0116, 370.0126, 371.0136, 372.0146, 373.0156, 374.0166, 375.0176, 376.0186, 377.0196, 378.0206, 379.0216, 380.0226, 381.0236, 382.0246, 383.0256, 384.0266, 385.0276, 386.0286, 387.0296], "recent_frames_sha256": "64e6d08690969d5542b04a67e630ebb04f11530ccd30ec13ae8e0eeb9bde12d0", "num_recent_frames": 30, "tq": 719341.857636092, "t1": 719344.300385304, "ta": 719344.300385304, "te": 719344.526554723, "first_response_s": 2.4427492120303214, "answer_total_s": 2.66891863103956, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 357, "content_group": "5d135731a88213c00619c56946bee313a0be041a5d4f02dc01476e2b0bc00f8b", "question": {"question_id": "sample_357_a2017_q0", "video_id": 357, "video_path": "./videos/sample_357_real.mp4", "annotation_index": 2017, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual brewed coffee, added milk, and stirred it.", "B. The individual steamed milk, poured it into a jug, and served it.", "C. The individual prepared tea, added sugar, and served it in a teapot.", "D. The individual cleaned a portafilter, filled another portafilter with coffee grounds and weighted it."], "answer": "D", "time_stamp_s": 514, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [504, 514], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_357_a2017_q0", "video_id": 357, "time_stamp_s": 514, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f476a191985f85a66dee8aa9a302e0bfee0cb338f642150602f243ad589099ba", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [484.0265, 485.0275, 486.0285, 487.0295, 488.0305, 489.0315, 490.0325, 491.00013333333334, 492.0011333333333, 493.00213333333335, 494.0031333333333, 495.00413333333336, 496.00513333333333, 497.0061333333333, 498.00713333333334, 499.0081333333333, 500.00913333333335, 501.01013333333333, 502.0111333333333, 503.01213333333334, 504.0131333333333, 505.01413333333335, 506.0151333333333, 507.01613333333336, 508.01713333333333, 509.0181333333333, 510.01913333333334, 511.0201333333333, 512.0211333333333, 513.0221333333334], "recent_frames_sha256": "f6a7ef00cc92378021f2f513edd136fb67f7e239de6ae5e1e6d5ae889816af61", "num_recent_frames": 30, "tq": 719219.628467989, "t1": 719231.105444316, "ta": 719231.105444316, "te": 719231.145711964, "first_response_s": 11.476976327016018, "answer_total_s": 11.517243974958546, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_357_a2017_q0", "video_id": 357, "time_stamp_s": 514, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e18ad41947f8c42db53870f738d363b3a165c8e5b4d68af5b80208d87c7418e2", "condition_order": ["recent", "notes"], "memory": "[120-150s] - Hand wipes down a stainless steel countertop near a coffee machine and sink area.  \n- A digital scale displays \"002.41\" as a hand places a small cup on it.  \n- A person holds a metal pitcher under a gooseneck faucet, filling it with steamed milk.\n[150-180s] - Person holds a metal pitcher under a faucet, filling it with milk.  \n- Person then pours the milk into a cup containing coffee grounds.  \n- The cup is held steady while milk is poured, creating a layered effect.\n[180-210s] - A hand holds a cup with latte art while pouring steamed milk from a metal pitcher.  \n- The espresso machine's digital display shows \"00:28\" as the hand prepares to pour.  \n- A person in a white shirt and black apron is visible in the background, standing near the counter.\n[210-240s] - Hand holds a spoon with ground coffee over a digital scale showing 18.0g, then moves to place the coffee into a portafilter.  \n- Portafilter is placed on a black mat, then tamped with a tamper, and the tamper is lifted away.  \n- Coffee grounds are visible in the portafilter, and the scale is no longer in use.\n[240-270s] - Hand places a black portafilter into a coffee machine's group head, with digital display showing \"2.2\" and \"2.2\" on adjacent machines.  \n- Hand adjusts a black coffee grinder, then moves to a digital scale to weigh coffee grounds into a portafilter.  \n- Coffee machine's steam wand is visible, with a white milk jug nearby, suggesting preparation for a latte or cappuccino.\n[270-300s] - Person holds a portafilter with coffee grounds, preparing to tamping it.  \n- Coffee machine is visible in the background, with a digital display showing \"000-4183\".  \n- Sink area with a faucet and a black mug is visible, suggesting preparation for cleaning or rinsing.\n[300-330s] - Hand wipes sink area with red cloth while holding a coffee cup.  \n- Coffee machine and milk jug are visible on countertop near sink.  \n- Person moves toward coffee station, hand reaching for a container.\n[330-360s] - Hand wipes down metal drip tray under coffee taps with cloth.  \n- Stacks of paper cups (black and brown) sit on circular trays beside taps.  \n- Barista in white shirt handles a paper cup near the taps, partially visible.\n[360-390s] - Hand places a dark paper cup with white stripes under a chrome espresso machine spout, then removes it after liquid dispenses.  \n- A digital scale displays \"0.00\" as a hand adjusts its position on the counter.  \n- A brown paper cup is visible upside down on a metal tray to the left of the espresso machine.\n[390-420s] - Hand holds a portafilter with ground coffee, positioned under a steam wand for frothing.  \n- Steam wand is actively steaming the coffee grounds, with visible steam rising.  \n- Coffee machine's control panel displays illuminated buttons, indicating operational status.\n[420-450s] - Hand holds a metal portafilter with ground coffee, positioning it under a coffee machine's spout for tamping.  \n- A person in a black shirt stands nearby, observing the coffee preparation process.  \n- The countertop displays various coffee-making tools, including a milk jug and a container of sugar.\n[450-480s] - A person holds a metal pitcher and a metal scoop, moving them toward an espresso machine.  \n- The espresso machine's portafilter is inserted into the machine, with a person adjusting its position.  \n- A digital scale displays \"000.00\" as a person prepares to measure coffee grounds.\n[480-510s] - Hand reaches for and picks up a small glass container holding ice cubes from a countertop.  \n- Hand then moves toward a coffee machine, positioning the container near its portafilter area.  \n- Coffee machine’s digital display shows a red \"00\" indicating it is powered on or ready for use.", "history_tokens": 945, "history_utf8_bytes": 3730, "recent_frame_times_s": [484.0265, 485.0275, 486.0285, 487.0295, 488.0305, 489.0315, 490.0325, 491.00013333333334, 492.0011333333333, 493.00213333333335, 494.0031333333333, 495.00413333333336, 496.00513333333333, 497.0061333333333, 498.00713333333334, 499.0081333333333, 500.00913333333335, 501.01013333333333, 502.0111333333333, 503.01213333333334, 504.0131333333333, 505.01413333333335, 506.0151333333333, 507.01613333333336, 508.01713333333333, 509.0181333333333, 510.01913333333334, 511.0201333333333, 512.0211333333333, 513.0221333333334], "recent_frames_sha256": "f6a7ef00cc92378021f2f513edd136fb67f7e239de6ae5e1e6d5ae889816af61", "num_recent_frames": 30, "tq": 719381.212480762, "t1": 719382.525390135, "ta": 719382.525390135, "te": 719382.563013385, "first_response_s": 1.3129093729658052, "answer_total_s": 1.3505326230078936, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 358, "content_group": "c6f6296e562c9c10a4d18042e8433010ed5f1c0e6709a9265b6eaf2226663bee", "question": {"question_id": "sample_358_a1011_q0", "video_id": 358, "video_path": "./videos/sample_358_real.mp4", "annotation_index": 1011, "question_index": 0, "question": "Which of the following options best summarizes the barista's actions just now?", "options": ["A. The barista cleaned the counter, sanitized cups, and organized coffee beans on the shelves.", "B. The barista wiped down the espresso machine, added a new milk container, and prepared a cappuccino.", "C. The barista organized the espresso machine, ground fresh coffee beans, and created a detailed latte art design.", "D. The barista cleaned the milk frothing equipment, and brought the two cups of prepared espresso to the customers.."], "answer": "D", "time_stamp_s": 14, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_358_a1011_q0", "video_id": 358, "time_stamp_s": 14, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "91e2594418606ee544672e73fb4aca1654b43b1f0711a30bc283a137b44aab1a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.039, 1.0066333333333333, 2.007633333333333, 3.0086333333333335, 4.009633333333333, 5.010633333333334, 6.011633333333333, 7.0126333333333335, 8.013633333333333, 9.014633333333334, 10.015633333333334, 11.016633333333333, 12.017633333333333, 13.018633333333334], "recent_frames_sha256": "40fd3c69b7974511addd68ddcfa9448469cb1948ce2da0a34570cbfed828f000", "num_recent_frames": 14, "tq": 719431.382631776, "t1": 719442.104264881, "ta": 719442.104264881, "te": 719442.142619544, "first_response_s": 10.721633104956709, "answer_total_s": 10.759987768018618, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_358_a1011_q0", "video_id": 358, "time_stamp_s": 14, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "871f6ed8f33056094e82321281f7431d2cb673fdedcadbea35aefcdd2178e56a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.039, 1.0066333333333333, 2.007633333333333, 3.0086333333333335, 4.009633333333333, 5.010633333333334, 6.011633333333333, 7.0126333333333335, 8.013633333333333, 9.014633333333334, 10.015633333333334, 11.016633333333333, 12.017633333333333, 13.018633333333334], "recent_frames_sha256": "40fd3c69b7974511addd68ddcfa9448469cb1948ce2da0a34570cbfed828f000", "num_recent_frames": 14, "tq": 719484.246761573, "t1": 719486.032992815, "ta": 719486.032992815, "te": 719486.3979139, "first_response_s": 1.7862312420038506, "answer_total_s": 2.151152326958254, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 358, "content_group": "c6f6296e562c9c10a4d18042e8433010ed5f1c0e6709a9265b6eaf2226663bee", "question": {"question_id": "sample_358_a1012_q0", "video_id": 358, "video_path": "./videos/sample_358_real.mp4", "annotation_index": 1012, "question_index": 0, "question": "Which of the following options best summarizes the bartender's actions just now?", "options": ["A. The bartender filled a pitcher with beer and served it to customers at the bar.", "B. The bartender cleaned the taps, filled a pitcher with hot water, and steeped tea bags in it.", "C. The bartender prepared a fruit smoothie by blending fresh fruits and ice, then pouring it into a glass to serve.", "D. The bartender steamed milk using a frothing wand, cleaned the wand, and combined the steamed milk with an espresso shot."], "answer": "D", "time_stamp_s": 115, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [102, 112], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_358_a1012_q0", "video_id": 358, "time_stamp_s": 115, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "96ea935ac77cbaee8a1bc21ba329bf1e9fda647d1939323dc538f2e23c6147db", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [85.0239, 86.0249, 87.0259, 88.0269, 89.0279, 90.0289, 91.0299, 92.0309, 93.0319, 94.0329, 95.00053333333334, 96.00153333333333, 97.00253333333333, 98.00353333333334, 99.00453333333333, 100.00553333333333, 101.00653333333334, 102.00753333333333, 103.00853333333333, 104.00953333333334, 105.01053333333333, 106.01153333333333, 107.01253333333334, 108.01353333333333, 109.01453333333333, 110.01553333333334, 111.01653333333333, 112.01753333333333, 113.01853333333334, 114.01953333333333], "recent_frames_sha256": "c0f1c73acc0dd6cb3727c73a2409d27068fdbd9e567380dc29e35318cf63a484", "num_recent_frames": 30, "tq": 719442.158417358, "t1": 719449.594874622, "ta": 719449.594874622, "te": 719449.633309596, "first_response_s": 7.436457264004275, "answer_total_s": 7.474892238038592, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_358_a1012_q0", "video_id": 358, "time_stamp_s": 115, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cbc1e81ee3cbfc5758235b22f132bb6748f36ec4d5abc698df06d2ceceb469d5", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Barista places a paper cup under espresso machine's spout, then moves to a second cup, preparing for extraction.  \n- A black pot with a red lid is lifted from under the counter, revealing a digital scale and coffee beans nearby.  \n- Barista handles a white bag labeled \"EVY\" while standing beside the espresso machine and scale, suggesting preparation for brewing.\n[30-60s] - Person holds a white bottle labeled \"Caffeine\" while another hand holds a metal scoop near a digital scale.  \n- Coffee grounds are measured into a portafilter using a scoop, then placed on a scale showing 18.1g.  \n- Portafilter is inserted into an espresso machine, with the machine's group head and steam wand visible nearby.\n[60-90s] - Hand holds a clear plastic cup with a straw, containing a layered beverage, positioned near an espresso machine.  \n- The cup is moved slightly, revealing a metal drip tray beneath it, with another espresso machine visible to the left.  \n- A hand reaches into a lower shelf area, possibly retrieving or adjusting equipment, while the cup remains in focus.", "history_tokens": 247, "history_utf8_bytes": 1078, "recent_frame_times_s": [85.0239, 86.0249, 87.0259, 88.0269, 89.0279, 90.0289, 91.0299, 92.0309, 93.0319, 94.0329, 95.00053333333334, 96.00153333333333, 97.00253333333333, 98.00353333333334, 99.00453333333333, 100.00553333333333, 101.00653333333334, 102.00753333333333, 103.00853333333333, 104.00953333333334, 105.01053333333333, 106.01153333333333, 107.01253333333334, 108.01353333333333, 109.01453333333333, 110.01553333333334, 111.01653333333333, 112.01753333333333, 113.01853333333334, 114.01953333333333], "recent_frames_sha256": "c0f1c73acc0dd6cb3727c73a2409d27068fdbd9e567380dc29e35318cf63a484", "num_recent_frames": 30, "tq": 719516.941904169, "t1": 719523.521520899, "ta": 719523.521520899, "te": 719523.890479568, "first_response_s": 6.579616729984991, "answer_total_s": 6.948575399001129, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 358, "content_group": "c6f6296e562c9c10a4d18042e8433010ed5f1c0e6709a9265b6eaf2226663bee", "question": {"question_id": "sample_358_a1013_q0", "video_id": 358, "video_path": "./videos/sample_358_real.mp4", "annotation_index": 1013, "question_index": 0, "question": "Which of the following options best summarizes the actions taken by the individual just now?", "options": ["A. The individual prepared coffee beans by weighing them, grinding them, and adjusting the grind size.", "B. The individual brewed a coffee by immersing the beans in boiling water and stirring frequently.", "C. The individual cleaned the coffee machine, steamed milk, and poured it into a cup to serve a cappuccino.", "D. The individual prepared a portafilter with ground coffee, weighed it, and used a spoon to adjust the coffee amount."], "answer": "D", "time_stamp_s": 213, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [204, 214], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_358_a1013_q0", "video_id": 358, "time_stamp_s": 213, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0155c928e0fd00a1cb81adebb0c94973ea3e25bd04a0edfb49e56063c714af93", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [183.0218, 184.0228, 185.0238, 186.0248, 187.0258, 188.0268, 189.0278, 190.0288, 191.0298, 192.0308, 193.0318, 194.0328, 195.00043333333332, 196.00143333333332, 197.00243333333333, 198.00343333333333, 199.00443333333334, 200.00543333333334, 201.00643333333332, 202.00743333333332, 203.00843333333333, 204.00943333333333, 205.01043333333334, 206.01143333333334, 207.01243333333332, 208.01343333333332, 209.01443333333333, 210.01543333333333, 211.01643333333334, 212.01743333333334], "recent_frames_sha256": "76ee42a0f5fa51cb673d70328761339fdcf2aa3b7d203039b1fdc98eeb450119", "num_recent_frames": 30, "tq": 719449.652487348, "t1": 719461.549372456, "ta": 719461.549372456, "te": 719461.586816198, "first_response_s": 11.89688510808628, "answer_total_s": 11.934328850009479, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_358_a1013_q0", "video_id": 358, "time_stamp_s": 213, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ab679c16f8bbd3f274d33cbbb73314311ce913026cad4f8883075a755a1139db", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Barista places a paper cup under espresso machine's spout, then moves to a second cup, preparing for extraction.  \n- A black pot with a red lid is lifted from under the counter, revealing a digital scale and coffee beans nearby.  \n- Barista handles a white bag labeled \"EVY\" while standing beside the espresso machine and scale, suggesting preparation for brewing.\n[30-60s] - Person holds a white bottle labeled \"Caffeine\" while another hand holds a metal scoop near a digital scale.  \n- Coffee grounds are measured into a portafilter using a scoop, then placed on a scale showing 18.1g.  \n- Portafilter is inserted into an espresso machine, with the machine's group head and steam wand visible nearby.\n[60-90s] - Hand holds a clear plastic cup with a straw, containing a layered beverage, positioned near an espresso machine.  \n- The cup is moved slightly, revealing a metal drip tray beneath it, with another espresso machine visible to the left.  \n- A hand reaches into a lower shelf area, possibly retrieving or adjusting equipment, while the cup remains in focus.\n[90-120s] - Barista holds a metal pitcher under a steam wand, preparing to froth milk.  \n- A small cup with coffee grounds is positioned nearby, ready for use.  \n- The barista pours the frothed milk into a dark coffee cup, creating a latte art design.\n[120-150s] - Hand pours steamed milk into a coffee cup, creating latte art.  \n- Coffee machine and steam wand are visible in the background.  \n- A digital scale displays weight readings as a hand interacts with it.\n[150-180s] - Hand places a metal tap head onto a countertop grating, then removes it.  \n- Another hand reaches into a cabinet below the counter, pulling out a black object.  \n- A digital display on a nearby device shows \"00:00\" as the hand moves away from the counter.\n[180-210s] - Hands measure coffee grounds on a digital scale, then transfer them into a portafilter.  \n- Portafilter is placed into an espresso machine, with a visible digital display showing \"000.00\" on the scale.  \n- Coffee grinder and espresso machine are positioned on a white countertop, with a red container nearby.", "history_tokens": 519, "history_utf8_bytes": 2136, "recent_frame_times_s": [183.0218, 184.0228, 185.0238, 186.0248, 187.0258, 188.0268, 189.0278, 190.0288, 191.0298, 192.0308, 193.0318, 194.0328, 195.00043333333332, 196.00143333333332, 197.00243333333333, 198.00343333333333, 199.00443333333334, 200.00543333333334, 201.00643333333332, 202.00743333333332, 203.00843333333333, 204.00943333333333, 205.01043333333334, 206.01143333333334, 207.01243333333332, 208.01343333333332, 209.01443333333333, 210.01543333333333, 211.01643333333334, 212.01743333333334], "recent_frames_sha256": "76ee42a0f5fa51cb673d70328761339fdcf2aa3b7d203039b1fdc98eeb450119", "num_recent_frames": 30, "tq": 719560.570529221, "t1": 719562.50592482, "ta": 719562.50592482, "te": 719562.879214567, "first_response_s": 1.9353955989936367, "answer_total_s": 2.3086853460408747, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 358, "content_group": "c6f6296e562c9c10a4d18042e8433010ed5f1c0e6709a9265b6eaf2226663bee", "question": {"question_id": "sample_358_a1014_q0", "video_id": 358, "video_path": "./videos/sample_358_real.mp4", "annotation_index": 1014, "question_index": 0, "question": "Which of the following options best summarizes the actions taken by the barista just now?", "options": ["A. The barista steamed milk, weighed it, and poured it into a coffee cup.", "B. The barista cleaned the coffee machine, weighed coffee grounds, and placed them into the portafilter.", "C. The barista poured milk into a glass, placed it on a scale, and then threw the milk container away.", "D. The barista poured milk into a measuring cup, weighed it, and then returned the container to the fridge."], "answer": "D", "time_stamp_s": 316, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [306, 316], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_358_a1014_q0", "video_id": 358, "time_stamp_s": 316, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ee8c89d37d4c3800029a21386bf0bbed9c14d47121ee7b42a9a550b4f16402e2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [286.0247, 287.0257, 288.0267, 289.0277, 290.0287, 291.0297, 292.0307, 293.0317, 294.0327, 295.00033333333334, 296.0013333333333, 297.00233333333335, 298.00333333333333, 299.0043333333333, 300.00533333333334, 301.0063333333333, 302.00733333333335, 303.0083333333333, 304.00933333333336, 305.01033333333334, 306.0113333333333, 307.01233333333334, 308.0133333333333, 309.01433333333335, 310.01533333333333, 311.0163333333333, 312.01733333333334, 313.0183333333333, 314.01933333333335, 315.0203333333333], "recent_frames_sha256": "e78c1298cfabf9ce121a88b7fbd21b04472eb4c0a139c106acaeee22a33d903e", "num_recent_frames": 30, "tq": 719461.602032453, "t1": 719473.324782666, "ta": 719473.324782666, "te": 719473.362736733, "first_response_s": 11.722750212997198, "answer_total_s": 11.76070427999366, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_358_a1014_q0", "video_id": 358, "time_stamp_s": 316, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "50de4067dc8f7db863990f91718821106df17dcf31290863db9e870048d4c55e", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Barista places a paper cup under espresso machine's spout, then moves to a second cup, preparing for extraction.  \n- A black pot with a red lid is lifted from under the counter, revealing a digital scale and coffee beans nearby.  \n- Barista handles a white bag labeled \"EVY\" while standing beside the espresso machine and scale, suggesting preparation for brewing.\n[30-60s] - Person holds a white bottle labeled \"Caffeine\" while another hand holds a metal scoop near a digital scale.  \n- Coffee grounds are measured into a portafilter using a scoop, then placed on a scale showing 18.1g.  \n- Portafilter is inserted into an espresso machine, with the machine's group head and steam wand visible nearby.\n[60-90s] - Hand holds a clear plastic cup with a straw, containing a layered beverage, positioned near an espresso machine.  \n- The cup is moved slightly, revealing a metal drip tray beneath it, with another espresso machine visible to the left.  \n- A hand reaches into a lower shelf area, possibly retrieving or adjusting equipment, while the cup remains in focus.\n[90-120s] - Barista holds a metal pitcher under a steam wand, preparing to froth milk.  \n- A small cup with coffee grounds is positioned nearby, ready for use.  \n- The barista pours the frothed milk into a dark coffee cup, creating a latte art design.\n[120-150s] - Hand pours steamed milk into a coffee cup, creating latte art.  \n- Coffee machine and steam wand are visible in the background.  \n- A digital scale displays weight readings as a hand interacts with it.\n[150-180s] - Hand places a metal tap head onto a countertop grating, then removes it.  \n- Another hand reaches into a cabinet below the counter, pulling out a black object.  \n- A digital display on a nearby device shows \"00:00\" as the hand moves away from the counter.\n[180-210s] - Hands measure coffee grounds on a digital scale, then transfer them into a portafilter.  \n- Portafilter is placed into an espresso machine, with a visible digital display showing \"000.00\" on the scale.  \n- Coffee grinder and espresso machine are positioned on a white countertop, with a red container nearby.\n[210-240s] - A hand uses a spoon to transfer coffee grounds from a container into a portafilter, which is placed on a digital scale showing 17.9 grams.  \n- The scale is positioned on a white countertop, with a coffee machine and a mug nearby.  \n- The person then moves the portafilter to a coffee machine, preparing to tamp the grounds.\n[240-270s] - Hand holds a clear plastic cup with a straw, containing a light brown beverage, near a coffee machine and sink.  \n- A tablet is placed on the counter, displaying a screen with a blue button, which is being touched by the hand.  \n- The counter holds various items including a milk jug, a coffee grinder, and a red cloth, with a sink and faucet visible to the right.\n[270-300s] - Hand holds a yellow squeeze bottle labeled \"Milk Foam\" over a small glass cup resting on a digital scale.  \n- Scale displays \"0.00 g\" as the hand begins to dispense liquid into the cup.  \n- Background shows a coffee machine and various kitchen items on a white countertop.", "history_tokens": 770, "history_utf8_bytes": 3137, "recent_frame_times_s": [286.0247, 287.0257, 288.0267, 289.0277, 290.0287, 291.0297, 292.0307, 293.0317, 294.0327, 295.00033333333334, 296.0013333333333, 297.00233333333335, 298.00333333333333, 299.0043333333333, 300.00533333333334, 301.0063333333333, 302.00733333333335, 303.0083333333333, 304.00933333333336, 305.01033333333334, 306.0113333333333, 307.01233333333334, 308.0133333333333, 309.01433333333335, 310.01533333333333, 311.0163333333333, 312.01733333333334, 313.0183333333333, 314.01933333333335, 315.0203333333333], "recent_frames_sha256": "e78c1298cfabf9ce121a88b7fbd21b04472eb4c0a139c106acaeee22a33d903e", "num_recent_frames": 30, "tq": 719587.84997711, "t1": 719589.67579146, "ta": 719589.67579146, "te": 719589.718751425, "first_response_s": 1.8258143499260768, "answer_total_s": 1.8687743149930611, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 358, "content_group": "c6f6296e562c9c10a4d18042e8433010ed5f1c0e6709a9265b6eaf2226663bee", "question": {"question_id": "sample_358_a1015_q0", "video_id": 358, "video_path": "./videos/sample_358_real.mp4", "annotation_index": 1015, "question_index": 0, "question": "Which of the following options best summarizes the barista's actions just now?", "options": ["A. The barista poured milk into a pitcher, steamed it, and then mixed it into a hot cup of coffee.", "B. The barista filled a pitcher with milk, adjusted the coffee machine, rinsed the pitcher, and cleaned the counter area.", "C. The barista filled a pitcher with milk, cleaned the pitcher, and prepared an iced coffee.", "D. The barista poured milk into a glass, and steamed the milk in a pitcher."], "answer": "D", "time_stamp_s": 415, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [408, 418], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_358_a1015_q0", "video_id": 358, "time_stamp_s": 415, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5744ec857ce52c4673e2600c1514af1da8b504d25449fb7fb08b620ec1053063", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [385.0236, 386.0246, 387.0256, 388.0266, 389.0276, 390.0286, 391.0296, 392.0306, 393.0316, 394.0326, 395.0002333333333, 396.00123333333335, 397.0022333333333, 398.00323333333336, 399.00423333333333, 400.0052333333333, 401.00623333333334, 402.0072333333333, 403.00823333333335, 404.0092333333333, 405.01023333333336, 406.01123333333334, 407.0122333333333, 408.01323333333335, 409.0142333333333, 410.01523333333336, 411.01623333333333, 412.0172333333333, 413.01823333333334, 414.0192333333333], "recent_frames_sha256": "ec1be38432dc1b6f8d98ff87c8df7d532a76ef3d9bf13623b82044211d88be03", "num_recent_frames": 30, "tq": 719473.373637905, "t1": 719484.200269945, "ta": 719484.200269945, "te": 719484.238100616, "first_response_s": 10.826632039970718, "answer_total_s": 10.864462711033411, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_358_a1015_q0", "video_id": 358, "time_stamp_s": 415, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a58c5c91971f2bbf7b757faf12e02271fc753f70e4658b4c7f51efe629054b58", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Barista places a paper cup under espresso machine's spout, then moves to a second cup, preparing for extraction.  \n- A black pot with a red lid is lifted from under the counter, revealing a digital scale and coffee beans nearby.  \n- Barista handles a white bag labeled \"EVY\" while standing beside the espresso machine and scale, suggesting preparation for brewing.\n[30-60s] - Person holds a white bottle labeled \"Caffeine\" while another hand holds a metal scoop near a digital scale.  \n- Coffee grounds are measured into a portafilter using a scoop, then placed on a scale showing 18.1g.  \n- Portafilter is inserted into an espresso machine, with the machine's group head and steam wand visible nearby.\n[60-90s] - Hand holds a clear plastic cup with a straw, containing a layered beverage, positioned near an espresso machine.  \n- The cup is moved slightly, revealing a metal drip tray beneath it, with another espresso machine visible to the left.  \n- A hand reaches into a lower shelf area, possibly retrieving or adjusting equipment, while the cup remains in focus.\n[90-120s] - Barista holds a metal pitcher under a steam wand, preparing to froth milk.  \n- A small cup with coffee grounds is positioned nearby, ready for use.  \n- The barista pours the frothed milk into a dark coffee cup, creating a latte art design.\n[120-150s] - Hand pours steamed milk into a coffee cup, creating latte art.  \n- Coffee machine and steam wand are visible in the background.  \n- A digital scale displays weight readings as a hand interacts with it.\n[150-180s] - Hand places a metal tap head onto a countertop grating, then removes it.  \n- Another hand reaches into a cabinet below the counter, pulling out a black object.  \n- A digital display on a nearby device shows \"00:00\" as the hand moves away from the counter.\n[180-210s] - Hands measure coffee grounds on a digital scale, then transfer them into a portafilter.  \n- Portafilter is placed into an espresso machine, with a visible digital display showing \"000.00\" on the scale.  \n- Coffee grinder and espresso machine are positioned on a white countertop, with a red container nearby.\n[210-240s] - A hand uses a spoon to transfer coffee grounds from a container into a portafilter, which is placed on a digital scale showing 17.9 grams.  \n- The scale is positioned on a white countertop, with a coffee machine and a mug nearby.  \n- The person then moves the portafilter to a coffee machine, preparing to tamp the grounds.\n[240-270s] - Hand holds a clear plastic cup with a straw, containing a light brown beverage, near a coffee machine and sink.  \n- A tablet is placed on the counter, displaying a screen with a blue button, which is being touched by the hand.  \n- The counter holds various items including a milk jug, a coffee grinder, and a red cloth, with a sink and faucet visible to the right.\n[270-300s] - Hand holds a yellow squeeze bottle labeled \"Milk Foam\" over a small glass cup resting on a digital scale.  \n- Scale displays \"0.00 g\" as the hand begins to dispense liquid into the cup.  \n- Background shows a coffee machine and various kitchen items on a white countertop.\n[300-330s] - Hand pours liquid from a yellow squeeze bottle into a small glass on a digital scale, which reads 0.08 oz.  \n- Scale is positioned on a white countertop next to a coffee machine and two metal tampers.  \n- The scale’s display updates as liquid is dispensed, indicating weight measurement in progress.\n[330-360s] - Hand holds a metal pitcher, pouring milk into a smaller metal cup.  \n- Milk container is positioned to the left of the pitcher, with a white label visible.  \n- A black coffee machine is on the left, and a metal grid with a circular pattern is beneath the pitcher.\n[360-390s] - Hand holds metal pitcher under espresso machine spout, filling with steamed milk.  \n- Another hand places a white bottle (likely milk or creamer) on counter beside pitcher.  \n- Person reaches into cabinet, pulling out a glass and placing it on counter.", "history_tokens": 979, "history_utf8_bytes": 3995, "recent_frame_times_s": [385.0236, 386.0246, 387.0256, 388.0266, 389.0276, 390.0286, 391.0296, 392.0306, 393.0316, 394.0326, 395.0002333333333, 396.00123333333335, 397.0022333333333, 398.00323333333336, 399.00423333333333, 400.0052333333333, 401.00623333333334, 402.0072333333333, 403.00823333333335, 404.0092333333333, 405.01023333333336, 406.01123333333334, 407.0122333333333, 408.01323333333335, 409.0142333333333, 410.01523333333336, 411.01623333333333, 412.0172333333333, 413.01823333333334, 414.0192333333333], "recent_frames_sha256": "ec1be38432dc1b6f8d98ff87c8df7d532a76ef3d9bf13623b82044211d88be03", "num_recent_frames": 30, "tq": 719613.893632464, "t1": 719621.555676194, "ta": 719621.555676194, "te": 719621.898151704, "first_response_s": 7.662043730029836, "answer_total_s": 8.004519239999354, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 359, "content_group": "23a703ca099693d1ec0775b98309b403ec8b3af975bbf5b46c027f53c19705de", "question": {"question_id": "sample_359_a1561_q0", "video_id": 359, "video_path": "./videos/sample_359_real.mp4", "annotation_index": 1561, "question_index": 0, "question": "Which of the following options best summarizes the sequence of actions that just happened?", "options": ["A. The person cleaned a cup, filled it with water, and placed it on a tray.", "B. The person prepared utensils, boiled water, and served a customer.", "C. The person washed a cup, brewed espresso, and poured it into a mug.", "D. The person cleaned a pitcher, filled a glass with iced coffee."], "answer": "D", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_359_a1561_q0", "video_id": 359, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e05f23081e1361c60492d16808fad063526fabb6957863898d46af16dcac347c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.035, 1.0026333333333333, 2.003633333333333, 3.0046333333333335, 4.005633333333333, 5.006633333333333, 6.007633333333334, 7.008633333333333, 8.009633333333333, 9.010633333333333], "recent_frames_sha256": "33d354e680bc607ff6862f2a1f3a98b213cb08cab6bf65bf0f7ca51f916f0517", "num_recent_frames": 10, "tq": 715418.069168239, "t1": 715428.653179004, "ta": 715428.653179004, "te": 715428.691020017, "first_response_s": 10.584010764956474, "answer_total_s": 10.621851778007112, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_359_a1561_q0", "video_id": 359, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6b7fa94546a06f9dd52bfc8a2f6b3deab18b9458e4b0ca855c12c2166c5e43f6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.035, 1.0026333333333333, 2.003633333333333, 3.0046333333333335, 4.005633333333333, 5.006633333333333, 6.007633333333334, 7.008633333333333, 8.009633333333333, 9.010633333333333], "recent_frames_sha256": "33d354e680bc607ff6862f2a1f3a98b213cb08cab6bf65bf0f7ca51f916f0517", "num_recent_frames": 10, "tq": 715469.043882799, "t1": 715478.653455999, "ta": 715478.653455999, "te": 715478.986568223, "first_response_s": 9.609573199995793, "answer_total_s": 9.942685424000956, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 359, "content_group": "23a703ca099693d1ec0775b98309b403ec8b3af975bbf5b46c027f53c19705de", "question": {"question_id": "sample_359_a1562_q0", "video_id": 359, "video_path": "./videos/sample_359_real.mp4", "annotation_index": 1562, "question_index": 0, "question": "Which of the following options best summarizes the actions performed just now?", "options": ["A. The person grabbed almond milk, prepared a latte, and handed it to a customer.", "B. The person cleaned cups, filled a jug with almond milk, and adjusted the espresso machine settings.", "C. The person made a cappuccino, added whipped cream, and served it on a tray.", "D. The person picked up a box of almond milk, and poured milk into a pitche."], "answer": "D", "time_stamp_s": 156, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [146, 156], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_359_a1562_q0", "video_id": 359, "time_stamp_s": 156, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f0c395fcf5816650f8e9f9a77ac66e309eee8b754f9e406a5b5ba08061da5fe5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [126.02753333333334, 127.02853333333333, 128.02953333333335, 129.03053333333332, 130.03153333333333, 131.03253333333333, 132.00016666666667, 133.00116666666668, 134.00216666666665, 135.00316666666666, 136.00416666666666, 137.00516666666667, 138.00616666666667, 139.00716666666668, 140.00816666666665, 141.00916666666666, 142.01016666666666, 143.01116666666667, 144.01216666666667, 145.01316666666668, 146.01416666666665, 147.01516666666666, 148.01616666666666, 149.01716666666667, 150.01816666666667, 151.01916666666668, 152.02016666666665, 153.02116666666666, 154.02216666666666, 155.02316666666667], "recent_frames_sha256": "ecfe1e6d5d00cd495a9ff6d35d6ca22c22b84fc9a2a357a8da19fbb90e5ebadf", "num_recent_frames": 30, "tq": 715428.704860108, "t1": 715439.237563698, "ta": 715439.237563698, "te": 715439.275540683, "first_response_s": 10.532703589997254, "answer_total_s": 10.570680574979633, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_359_a1562_q0", "video_id": 359, "time_stamp_s": 156, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2b4f890f281698ff2282c9619797829ffb161999f7f72fdb76b94fbd663e309b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands pour steamed milk from a metal pitcher into a glass containing coffee and foam.  \n- A digital scale displays \"0.00\" on the counter near the espresso machine.  \n- Multiple mugs and a milk jug are arranged on the counter, with a person’s hand reaching for a tool near the espresso machine.\n[30-60s] - Hand holds a black portafilter, placing it under a coffee grinder's spout to dispense ground coffee into the portafilter's basket.\n- Coffee grounds are measured on a digital scale, which shows a weight of 18.5 grams before being transferred into the portafilter.\n- The portafilter is then positioned under a coffee machine's group head, ready for brewing, with the machine's digital display showing operational status.\n[60-90s] - Hand places a small cup on a digital scale, which reads \"000 183\" (likely grams), indicating precise measurement.  \n- The hand then moves the cup to a coffee machine's portafilter area, preparing for brewing.  \n- A metal portafilter is positioned under the machine's spout, ready to receive the ground coffee.\n[90-120s] - Hand holds a small metal cup near a sink, then moves to a digital scale on the counter.  \n- A red box labeled \"FRUITY FOAM STEAM\" is picked up and opened, revealing a product inside.  \n- The hand places the box on the counter next to a coffee machine and other kitchen items.\n[120-150s] - Hands manipulate a red \"Rude Health\" carton, tilting it to pour contents into a metal cup.  \n- The carton's label, featuring \"Fruit, Steam, Repeat\" and \"Baked Almond,\" is clearly visible as it's handled.  \n- The pouring action is performed over a stainless steel countertop with espresso equipment nearby.", "history_tokens": 416, "history_utf8_bytes": 1663, "recent_frame_times_s": [126.02753333333334, 127.02853333333333, 128.02953333333335, 129.03053333333332, 130.03153333333333, 131.03253333333333, 132.00016666666667, 133.00116666666668, 134.00216666666665, 135.00316666666666, 136.00416666666666, 137.00516666666667, 138.00616666666667, 139.00716666666668, 140.00816666666665, 141.00916666666666, 142.01016666666666, 143.01116666666667, 144.01216666666667, 145.01316666666668, 146.01416666666665, 147.01516666666666, 148.01616666666666, 149.01716666666667, 150.01816666666667, 151.01916666666668, 152.02016666666665, 153.02116666666666, 154.02216666666666, 155.02316666666667], "recent_frames_sha256": "ecfe1e6d5d00cd495a9ff6d35d6ca22c22b84fc9a2a357a8da19fbb90e5ebadf", "num_recent_frames": 30, "tq": 715520.651488883, "t1": 715527.217257422, "ta": 715527.217257422, "te": 715527.434934947, "first_response_s": 6.565768539090641, "answer_total_s": 6.783446064102463, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 359, "content_group": "23a703ca099693d1ec0775b98309b403ec8b3af975bbf5b46c027f53c19705de", "question": {"question_id": "sample_359_a1563_q0", "video_id": 359, "video_path": "./videos/sample_359_real.mp4", "annotation_index": 1563, "question_index": 0, "question": "Which of the following options best summarizes the sequence of actions that just happened?", "options": ["A. The person poured coffee into a to-go cup, cleaned the counter, and organized utensils.", "B. The person poured milk into a cup, placed it in the sink, and threw away a lid.", "C. The person grabbed a to-go cup, dumped its content into the trash, and cleaned the brewer.", "D. The person picked up an iced coffee and drank it, disposed of a cup into the trash,."], "answer": "D", "time_stamp_s": 302, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [292, 302], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_359_a1563_q0", "video_id": 359, "time_stamp_s": 302, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "529957c67060355793b15dc0f4ec44a2c5634ebcadfe4a5869ba52e9734d9fd6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [272.0067, 273.0077, 274.0087, 275.0097, 276.0107, 277.0117, 278.0127, 279.0137, 280.0147, 281.0157, 282.0167, 283.0177, 284.0187, 285.0197, 286.0207, 287.0217, 288.0227, 289.0237, 290.0247, 291.0257, 292.0267, 293.0277, 294.0287, 295.0297, 296.0307, 297.0317, 298.0327, 299.00033333333334, 300.0013333333333, 301.00233333333335], "recent_frames_sha256": "4ce54c7d3e2b21b6a105147760299446c23e8087aab2edf1d47ad314ca232030", "num_recent_frames": 30, "tq": 715439.287302904, "t1": 715450.551922149, "ta": 715450.551922149, "te": 715450.589660193, "first_response_s": 11.264619245077483, "answer_total_s": 11.302357289008796, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_359_a1563_q0", "video_id": 359, "time_stamp_s": 302, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fa4db1866fd519cf87b71edb0e3960c0f85f4121bce21de57687af25cc90753f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands pour steamed milk from a metal pitcher into a glass containing coffee and foam.  \n- A digital scale displays \"0.00\" on the counter near the espresso machine.  \n- Multiple mugs and a milk jug are arranged on the counter, with a person’s hand reaching for a tool near the espresso machine.\n[30-60s] - Hand holds a black portafilter, placing it under a coffee grinder's spout to dispense ground coffee into the portafilter's basket.\n- Coffee grounds are measured on a digital scale, which shows a weight of 18.5 grams before being transferred into the portafilter.\n- The portafilter is then positioned under a coffee machine's group head, ready for brewing, with the machine's digital display showing operational status.\n[60-90s] - Hand places a small cup on a digital scale, which reads \"000 183\" (likely grams), indicating precise measurement.  \n- The hand then moves the cup to a coffee machine's portafilter area, preparing for brewing.  \n- A metal portafilter is positioned under the machine's spout, ready to receive the ground coffee.\n[90-120s] - Hand holds a small metal cup near a sink, then moves to a digital scale on the counter.  \n- A red box labeled \"FRUITY FOAM STEAM\" is picked up and opened, revealing a product inside.  \n- The hand places the box on the counter next to a coffee machine and other kitchen items.\n[120-150s] - Hands manipulate a red \"Rude Health\" carton, tilting it to pour contents into a metal cup.  \n- The carton's label, featuring \"Fruit, Steam, Repeat\" and \"Baked Almond,\" is clearly visible as it's handled.  \n- The pouring action is performed over a stainless steel countertop with espresso equipment nearby.\n[150-180s] - Hand holds a metal pitcher under a faucet, filling it with water.  \n- Another metal pitcher with green tape is visible on the counter nearby.  \n- A white cup and a black coffee machine are positioned to the right of the faucet.\n[180-210s] - Hand holds a stainless steel milk frothing pitcher with a green handle, positioning it under a chrome faucet to fill with water.  \n- The pitcher is then moved to a metal drip tray, where the hand adjusts its position to prepare for frothing.  \n- A second hand reaches for a metal container, likely to hold or retrieve a tool or accessory from beneath the counter.\n[210-240s] - Barista pours steamed milk from a metal pitcher into a small paper cup containing espresso, creating a latte art design.  \n- The cup is held steady over a metal drip tray, with a green-labeled coffee machine visible in the background.  \n- The barista’s hands are visible, manipulating the cup and pitcher, with a second cup resting nearby on a saucer.\n[240-270s] - Hand holds a small metal pitcher with green lid, positioned near a stainless steel espresso machine's steam wand.  \n- A red carton labeled \"MILK\" is visible on the counter, alongside a white milk jug and various mugs.  \n- The hand moves the pitcher toward a sink area, suggesting preparation for cleaning or refilling.\n[270-300s] - Person in apron holds a glass jar while standing near kitchen counter.  \n- Refrigerator door is opened, revealing shelves with various food items.  \n- Hand reaches into fridge, selecting a red-packaged item.", "history_tokens": 783, "history_utf8_bytes": 3201, "recent_frame_times_s": [272.0067, 273.0077, 274.0087, 275.0097, 276.0107, 277.0117, 278.0127, 279.0137, 280.0147, 281.0157, 282.0167, 283.0177, 284.0187, 285.0197, 286.0207, 287.0217, 288.0227, 289.0237, 290.0247, 291.0257, 292.0267, 293.0277, 294.0287, 295.0297, 296.0307, 297.0317, 298.0327, 299.00033333333334, 300.0013333333333, 301.00233333333335], "recent_frames_sha256": "4ce54c7d3e2b21b6a105147760299446c23e8087aab2edf1d47ad314ca232030", "num_recent_frames": 30, "tq": 715563.396946197, "t1": 715570.027434431, "ta": 715570.027434431, "te": 715570.329131914, "first_response_s": 6.630488233990036, "answer_total_s": 6.9321857169270515, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 359, "content_group": "23a703ca099693d1ec0775b98309b403ec8b3af975bbf5b46c027f53c19705de", "question": {"question_id": "sample_359_a1564_q0", "video_id": 359, "video_path": "./videos/sample_359_real.mp4", "annotation_index": 1564, "question_index": 0, "question": "Which of the following options best summarizes the sequence of actions that just happened?", "options": ["A. The person cleaned a coffee machine, prepared a cup, and served an espresso.", "B. The person prepared a coffee pot, filled it with water, and brewed a pot of coffee.", "C. The person picked up a milk pitcher, steamed milk, and poured it into a cup.", "D. The person grabbed a portafilter, filled it with coffee grounds, weighed it, and adjusted the amount with a spoon."], "answer": "D", "time_stamp_s": 448, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [438, 448], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_359_a1564_q0", "video_id": 359, "time_stamp_s": 448, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c5a16131e9806437b681a237fe7eb02e8f9da5a24e6321ca6e9e5c505c8eae02", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [418.0192333333333, 419.02023333333335, 420.0212333333333, 421.02223333333336, 422.02323333333334, 423.0242333333333, 424.02523333333335, 425.0262333333333, 426.02723333333336, 427.02823333333333, 428.0292333333333, 429.03023333333334, 430.0312333333333, 431.03223333333335, 432.0332333333333, 433.00086666666664, 434.0018666666667, 435.00286666666665, 436.0038666666667, 437.00486666666666, 438.0058666666667, 439.00686666666667, 440.00786666666664, 441.0088666666667, 442.00986666666665, 443.0108666666667, 444.01186666666666, 445.01286666666664, 446.0138666666667, 447.01486666666665], "recent_frames_sha256": "f02084188ce3b0fd5e82a1f02b030725901585d5f87864b46cc2eaf6de5df5a3", "num_recent_frames": 30, "tq": 715450.612469655, "t1": 715461.951691365, "ta": 715461.951691365, "te": 715461.989042004, "first_response_s": 11.339221709989943, "answer_total_s": 11.37657234899234, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_359_a1564_q0", "video_id": 359, "time_stamp_s": 448, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b325071c5bd307c588a331737b258f70125f2cd77546d6242699e4ed84d40fe2", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Hand holds a black portafilter, placing it under a coffee grinder's spout to dispense ground coffee into the portafilter's basket.\n- Coffee grounds are measured on a digital scale, which shows a weight of 18.5 grams before being transferred into the portafilter.\n- The portafilter is then positioned under a coffee machine's group head, ready for brewing, with the machine's digital display showing operational status.\n[60-90s] - Hand places a small cup on a digital scale, which reads \"000 183\" (likely grams), indicating precise measurement.  \n- The hand then moves the cup to a coffee machine's portafilter area, preparing for brewing.  \n- A metal portafilter is positioned under the machine's spout, ready to receive the ground coffee.\n[90-120s] - Hand holds a small metal cup near a sink, then moves to a digital scale on the counter.  \n- A red box labeled \"FRUITY FOAM STEAM\" is picked up and opened, revealing a product inside.  \n- The hand places the box on the counter next to a coffee machine and other kitchen items.\n[120-150s] - Hands manipulate a red \"Rude Health\" carton, tilting it to pour contents into a metal cup.  \n- The carton's label, featuring \"Fruit, Steam, Repeat\" and \"Baked Almond,\" is clearly visible as it's handled.  \n- The pouring action is performed over a stainless steel countertop with espresso equipment nearby.\n[150-180s] - Hand holds a metal pitcher under a faucet, filling it with water.  \n- Another metal pitcher with green tape is visible on the counter nearby.  \n- A white cup and a black coffee machine are positioned to the right of the faucet.\n[180-210s] - Hand holds a stainless steel milk frothing pitcher with a green handle, positioning it under a chrome faucet to fill with water.  \n- The pitcher is then moved to a metal drip tray, where the hand adjusts its position to prepare for frothing.  \n- A second hand reaches for a metal container, likely to hold or retrieve a tool or accessory from beneath the counter.\n[210-240s] - Barista pours steamed milk from a metal pitcher into a small paper cup containing espresso, creating a latte art design.  \n- The cup is held steady over a metal drip tray, with a green-labeled coffee machine visible in the background.  \n- The barista’s hands are visible, manipulating the cup and pitcher, with a second cup resting nearby on a saucer.\n[240-270s] - Hand holds a small metal pitcher with green lid, positioned near a stainless steel espresso machine's steam wand.  \n- A red carton labeled \"MILK\" is visible on the counter, alongside a white milk jug and various mugs.  \n- The hand moves the pitcher toward a sink area, suggesting preparation for cleaning or refilling.\n[270-300s] - Person in apron holds a glass jar while standing near kitchen counter.  \n- Refrigerator door is opened, revealing shelves with various food items.  \n- Hand reaches into fridge, selecting a red-packaged item.\n[300-330s] - Hand reaches into a drawer to retrieve a small container, likely for coffee grounds or beans.  \n- A coffee machine with a digital display is visible on the counter, positioned near the drawer.  \n- The hand moves the container toward the coffee machine, suggesting preparation for brewing.\n[330-360s] - Hand moves a black digital scale, then places a small white cup on it.  \n- Hand picks up a black coffee grinder, then places it on the counter next to the scale.  \n- Hand reaches into a cabinet under the counter, pulling out a small container with a yellow lid.\n[360-390s] - Person holds a coffee grinder with a digital display showing \"0:00\" while placing a portafilter into the machine.  \n- They then pick up a metal tamper and position it over the portafilter, preparing to tamp coffee grounds.  \n- The person moves toward a storage area, reaching for a container or tool, likely to retrieve coffee grounds or another accessory.\n[390-420s] - Hand places a metal portafilter onto a digital scale showing \"0.00\" as it's prepared for coffee grounds.\n- A hand holds a small metal scoop, poised to measure coffee grounds, near a container of ground coffee.\n- The scale's display changes to \"18.1\" grams as coffee grounds are added to the portafilter, indicating a measured quantity.", "history_tokens": 1021, "history_utf8_bytes": 4191, "recent_frame_times_s": [418.0192333333333, 419.02023333333335, 420.0212333333333, 421.02223333333336, 422.02323333333334, 423.0242333333333, 424.02523333333335, 425.0262333333333, 426.02723333333336, 427.02823333333333, 428.0292333333333, 429.03023333333334, 430.0312333333333, 431.03223333333335, 432.0332333333333, 433.00086666666664, 434.0018666666667, 435.00286666666665, 436.0038666666667, 437.00486666666666, 438.0058666666667, 439.00686666666667, 440.00786666666664, 441.0088666666667, 442.00986666666665, 443.0108666666667, 444.01186666666666, 445.01286666666664, 446.0138666666667, 447.01486666666665], "recent_frames_sha256": "f02084188ce3b0fd5e82a1f02b030725901585d5f87864b46cc2eaf6de5df5a3", "num_recent_frames": 30, "tq": 715604.300977208, "t1": 715612.399032491, "ta": 715612.399032491, "te": 715612.712896724, "first_response_s": 8.098055283073336, "answer_total_s": 8.4119195160456, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 359, "content_group": "23a703ca099693d1ec0775b98309b403ec8b3af975bbf5b46c027f53c19705de", "question": {"question_id": "sample_359_a1565_q0", "video_id": 359, "video_path": "./videos/sample_359_real.mp4", "annotation_index": 1565, "question_index": 0, "question": "Which of the following options best summarizes the sequence of actions that just happened?", "options": ["A. The person grabbed a glass, picked a lid, and filled the glass with water.", "B. The person picked up a glass, inspected it, and placed it on the counter.", "C. The person picked up glasses, stacked them, and put them aside.", "D. The person grabbed a glass, examined it, and walked towards another area."], "answer": "D", "time_stamp_s": 594, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [584, 594], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_359_a1565_q0", "video_id": 359, "time_stamp_s": 594, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5418800551357e632fc035b1569fac71a921ef92ca162e8332a200741f8971ca", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [564.0317666666666, 565.0327666666667, 566.0004, 567.0014, 568.0024, 569.0034, 570.0044, 571.0054, 572.0064, 573.0074, 574.0084, 575.0094, 576.0104, 577.0114, 578.0124, 579.0134, 580.0144, 581.0154, 582.0164, 583.0174, 584.0184, 585.0194, 586.0204, 587.0214, 588.0224, 589.0234, 590.0244, 591.0254, 592.0264, 593.0274], "recent_frames_sha256": "db912948d09500327fcfed4399aaf1181117043548feb008fd1a91f29e0cbea8", "num_recent_frames": 30, "tq": 715461.996173745, "t1": 715468.998129943, "ta": 715468.998129943, "te": 715469.035426417, "first_response_s": 7.00195619801525, "answer_total_s": 7.0392526719952, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_359_a1565_q0", "video_id": 359, "time_stamp_s": 594, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ea07b1a7ff54d7d77390758c76f2b1d532747c3e403ca8c29c6caf8fa3cd8247", "condition_order": ["recent", "notes"], "memory": "[210-240s] - Barista pours steamed milk from a metal pitcher into a small paper cup containing espresso, creating a latte art design.  \n- The cup is held steady over a metal drip tray, with a green-labeled coffee machine visible in the background.  \n- The barista’s hands are visible, manipulating the cup and pitcher, with a second cup resting nearby on a saucer.\n[240-270s] - Hand holds a small metal pitcher with green lid, positioned near a stainless steel espresso machine's steam wand.  \n- A red carton labeled \"MILK\" is visible on the counter, alongside a white milk jug and various mugs.  \n- The hand moves the pitcher toward a sink area, suggesting preparation for cleaning or refilling.\n[270-300s] - Person in apron holds a glass jar while standing near kitchen counter.  \n- Refrigerator door is opened, revealing shelves with various food items.  \n- Hand reaches into fridge, selecting a red-packaged item.\n[300-330s] - Hand reaches into a drawer to retrieve a small container, likely for coffee grounds or beans.  \n- A coffee machine with a digital display is visible on the counter, positioned near the drawer.  \n- The hand moves the container toward the coffee machine, suggesting preparation for brewing.\n[330-360s] - Hand moves a black digital scale, then places a small white cup on it.  \n- Hand picks up a black coffee grinder, then places it on the counter next to the scale.  \n- Hand reaches into a cabinet under the counter, pulling out a small container with a yellow lid.\n[360-390s] - Person holds a coffee grinder with a digital display showing \"0:00\" while placing a portafilter into the machine.  \n- They then pick up a metal tamper and position it over the portafilter, preparing to tamp coffee grounds.  \n- The person moves toward a storage area, reaching for a container or tool, likely to retrieve coffee grounds or another accessory.\n[390-420s] - Hand places a metal portafilter onto a digital scale showing \"0.00\" as it's prepared for coffee grounds.\n- A hand holds a small metal scoop, poised to measure coffee grounds, near a container of ground coffee.\n- The scale's display changes to \"18.1\" grams as coffee grounds are added to the portafilter, indicating a measured quantity.\n[420-450s] - Hand holds portafilter with ground coffee, positioning it under espresso machine's group head.  \n- Digital scale displays \"000:50.0\" as coffee is measured and transferred into the portafilter.  \n- Espresso machine's group head is visible with blue lighting, indicating readiness for brewing.\n[450-480s] - Hand uses spoon to transfer coffee grounds from container into portafilter, then places portafilter on scale.  \n- Scale displays \"0.00\" as portafilter is positioned on it, indicating weight measurement.  \n- Coffee machine's digital display shows \"0.00\" and \"0.00\" as the person prepares to start brewing.\n[480-510s] - Hand picks up a clear plastic cup with a spoon inside, containing a light-colored, creamy substance.  \n- The cup is held near a digital scale displaying \"000.00 g\" and a coffee machine with a blue-lit interface.  \n- The hand moves the cup toward the espresso machine's portafilter area, suggesting preparation for a drink.\n[510-540s] - Hands remove a black cloth from under the espresso machine's base, revealing a metal portafilter and group head.  \n- The person picks up a metal portafilter and places it on the machine's drip tray, then moves to the side to retrieve a blue bowl.  \n- A white jug and various coffee-making tools are visible on the countertop, with the person stepping away from the machine toward the sink area.\n[540-570s] - A stainless steel milk frothing pitcher sits on a digital scale, displaying a weight that increases from 0.00 to 0.02 kg as milk is poured into it.\n- A white plastic bottle, likely containing milk or cream, is held above the pitcher, with milk being poured into it.\n- The scale's display updates in real-time, showing the accumulating weight of the milk being added to the pitcher.", "history_tokens": 971, "history_utf8_bytes": 3977, "recent_frame_times_s": [564.0317666666666, 565.0327666666667, 566.0004, 567.0014, 568.0024, 569.0034, 570.0044, 571.0054, 572.0064, 573.0074, 574.0084, 575.0094, 576.0104, 577.0114, 578.0124, 579.0134, 580.0144, 581.0154, 582.0164, 583.0174, 584.0184, 585.0194, 586.0204, 587.0214, 588.0224, 589.0234, 590.0244, 591.0254, 592.0264, 593.0274], "recent_frames_sha256": "db912948d09500327fcfed4399aaf1181117043548feb008fd1a91f29e0cbea8", "num_recent_frames": 30, "tq": 715683.092674809, "t1": 715691.669053876, "ta": 715691.669053876, "te": 715691.863138813, "first_response_s": 8.576379066915251, "answer_total_s": 8.770464003900997, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 361, "content_group": "b180b038ed75cc990a53740d9122a23215e04be83cbd3fb113de239deb2f5495", "question": {"question_id": "sample_361_a352_q0", "video_id": 361, "video_path": "./videos/sample_361_real.mp4", "annotation_index": 352, "question_index": 0, "question": "Which of the following options best summarizes the content of the video just shown?", "options": ["A. An individual adjusts the settings on a coffee grinder, preparing it for use.", "B. An individual sets the timer on a toaster oven, ready to bake.", "C. An individual calibrates an oven's temperature for baking pastries.", "D. An individual measures the exact amount of coffee grounds for a recipe."], "answer": "A", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_361_a352_q0", "video_id": 361, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bef5b3441945c155227b9d515bd81e509894e1b0c332c95652911937a011f7d3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.019010416666666665, 1.00234375, 2.00234375, 3.00234375, 4.00234375, 5.00234375, 6.00234375, 7.00234375, 8.00234375, 9.00234375], "recent_frames_sha256": "dabae167cf4c9d1854ba4927be174db14610f7ca0b268a1eaf91113d6ffc030b", "num_recent_frames": 10, "tq": 716500.81751651, "t1": 716512.729243264, "ta": 716512.729243264, "te": 716512.766690474, "first_response_s": 11.911726753925905, "answer_total_s": 11.949173963977955, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_361_a352_q0", "video_id": 361, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "91b32910fac895ac310e91ccc3d29351ec1f8310b01805a3e3441d312ab62e4e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.019010416666666665, 1.00234375, 2.00234375, 3.00234375, 4.00234375, 5.00234375, 6.00234375, 7.00234375, 8.00234375, 9.00234375], "recent_frames_sha256": "dabae167cf4c9d1854ba4927be174db14610f7ca0b268a1eaf91113d6ffc030b", "num_recent_frames": 10, "tq": 716562.185710815, "t1": 716563.388972381, "ta": 716563.388972381, "te": 716563.538593962, "first_response_s": 1.203261565999128, "answer_total_s": 1.352883146959357, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 361, "content_group": "b180b038ed75cc990a53740d9122a23215e04be83cbd3fb113de239deb2f5495", "question": {"question_id": "sample_361_a353_q0", "video_id": 361, "video_path": "./videos/sample_361_real.mp4", "annotation_index": 353, "question_index": 0, "question": "What is the best summary of the actions performed just now?", "options": ["A. The individual prepared a coffee by grinding the beans and operating an espresso machine.", "B. The individual assembled a sandwich with various ingredients and served it to a customer.", "C. The individual organized a stationary set, placing pens and pencils in a container.", "D. The individual arranged some tools on a workbench, preparing for a repair task."], "answer": "A", "time_stamp_s": 125, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [115, 125], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_361_a353_q0", "video_id": 361, "time_stamp_s": 125, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "39702468ba7129cb591674b4c5f2f87d30967797e6e9bdfb2972472c38d9e378", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [95.00234375, 96.00234375, 97.00234375, 98.00234375, 99.00234375, 100.00234375, 101.00234375, 102.00234375, 103.00234375, 104.00234375, 105.00234375, 106.00234375, 107.00234375, 108.00234375, 109.00234375, 110.00234375, 111.00234375, 112.00234375, 113.00234375, 114.00234375, 115.00234375, 116.00234375, 117.00234375, 118.00234375, 119.00234375, 120.00234375, 121.00234375, 122.00234375, 123.00234375, 124.00234375], "recent_frames_sha256": "29a8c9a291acf23717f7e7da7885e0402c73d2a8089ee810aed6df53311256a7", "num_recent_frames": 30, "tq": 716512.776252746, "t1": 716527.08748197, "ta": 716527.08748197, "te": 716527.124827255, "first_response_s": 14.31122922396753, "answer_total_s": 14.348574509029277, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_361_a353_q0", "video_id": 361, "time_stamp_s": 125, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "875eced9bd68b3aa2d1f734f76d06f49ac01001d1c23dfff5de47445214df077", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hand removes portafilter from espresso machine, then places it on a metal tray.  \n- Hand picks up a metal milk frothing pitcher and moves it toward a stainless steel milk frother.  \n- Hand places a small metal cup on the counter, then picks up a metal container with a lid.\n[30-60s] - Hand holds a clear glass pitcher filled with ice cubes, positioned near a coffee machine.  \n- A digital scale is placed on the counter, with a small metal container nearby, suggesting preparation for measuring ingredients.  \n- The person’s hand reaches for a metal portafilter, indicating readiness to brew coffee.\n[60-90s] - Person places a portafilter into the espresso machine's group head, preparing for extraction.  \n- Digital scale shows coffee weight increasing as grounds are added to the portafilter.  \n- Espresso machine's steam wand is visible, indicating readiness for milk frothing or steam cleaning.\n[90-120s] - Person holds a portafilter with a coffee puck, preparing to tamping it.  \n- Coffee machine's digital display shows \"00:00\" as the person positions the portafilter under the group head.  \n- A small container with a red cloth is visible near the machine's base, likely for cleaning or storage.", "history_tokens": 282, "history_utf8_bytes": 1214, "recent_frame_times_s": [95.00234375, 96.00234375, 97.00234375, 98.00234375, 99.00234375, 100.00234375, 101.00234375, 102.00234375, 103.00234375, 104.00234375, 105.00234375, 106.00234375, 107.00234375, 108.00234375, 109.00234375, 110.00234375, 111.00234375, 112.00234375, 113.00234375, 114.00234375, 115.00234375, 116.00234375, 117.00234375, 118.00234375, 119.00234375, 120.00234375, 121.00234375, 122.00234375, 123.00234375, 124.00234375], "recent_frames_sha256": "29a8c9a291acf23717f7e7da7885e0402c73d2a8089ee810aed6df53311256a7", "num_recent_frames": 30, "tq": 716603.374363883, "t1": 716610.687784095, "ta": 716610.687784095, "te": 716610.969059585, "first_response_s": 7.3134202118963, "answer_total_s": 7.594695701962337, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 361, "content_group": "b180b038ed75cc990a53740d9122a23215e04be83cbd3fb113de239deb2f5495", "question": {"question_id": "sample_361_a354_q0", "video_id": 361, "video_path": "./videos/sample_361_real.mp4", "annotation_index": 354, "question_index": 0, "question": "Which of the following options best summarizes the content of the video just shown?", "options": ["A. A person is preparing for steaming the milk.", "B. A barista prepares and serves a complex coffee drink, adjusting various machines and ingredients to ensure perfection.", "C. An individual prepares various ingredients for a large meal, organizing and setting them on a counter.", "D. A chef expertly places different kitchen tools in an organized manner to prepare for a cooking session."], "answer": "A", "time_stamp_s": 240, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [230, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_361_a354_q0", "video_id": 361, "time_stamp_s": 240, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "131cdebc0b2bbafc348dee6178f2526a5779f3cab274cada241105496083ea4b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [210.00234375, 211.00234375, 212.00234375, 213.00234375, 214.00234375, 215.00234375, 216.00234375, 217.00234375, 218.00234375, 219.00234375, 220.00234375, 221.00234375, 222.00234375, 223.00234375, 224.00234375, 225.00234375, 226.00234375, 227.00234375, 228.00234375, 229.00234375, 230.00234375, 231.00234375, 232.00234375, 233.00234375, 234.00234375, 235.00234375, 236.00234375, 237.00234375, 238.00234375, 239.00234375], "recent_frames_sha256": "e5ab4beb35a44dd4f97e54a9d4a85306dc0e2549b38855f4ac9f605689349876", "num_recent_frames": 30, "tq": 716527.131308714, "t1": 716538.993803454, "ta": 716538.993803454, "te": 716539.030965534, "first_response_s": 11.862494739936665, "answer_total_s": 11.899656819994561, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_361_a354_q0", "video_id": 361, "time_stamp_s": 240, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "16c8053f767e4bde3d55a9985c89791c684138bfa7c90b8b789c6a0255040136", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hand removes portafilter from espresso machine, then places it on a metal tray.  \n- Hand picks up a metal milk frothing pitcher and moves it toward a stainless steel milk frother.  \n- Hand places a small metal cup on the counter, then picks up a metal container with a lid.\n[30-60s] - Hand holds a clear glass pitcher filled with ice cubes, positioned near a coffee machine.  \n- A digital scale is placed on the counter, with a small metal container nearby, suggesting preparation for measuring ingredients.  \n- The person’s hand reaches for a metal portafilter, indicating readiness to brew coffee.\n[60-90s] - Person places a portafilter into the espresso machine's group head, preparing for extraction.  \n- Digital scale shows coffee weight increasing as grounds are added to the portafilter.  \n- Espresso machine's steam wand is visible, indicating readiness for milk frothing or steam cleaning.\n[90-120s] - Person holds a portafilter with a coffee puck, preparing to tamping it.  \n- Coffee machine's digital display shows \"00:00\" as the person positions the portafilter under the group head.  \n- A small container with a red cloth is visible near the machine's base, likely for cleaning or storage.\n[120-150s] - A hand holds a portafilter with ground coffee, positioned near a digital scale showing 18g, while another hand adjusts the scale's position on the counter.  \n- The portafilter is then placed into a coffee machine's group head, with the machine's digital display visible in the background.  \n- A small container with a white lid is placed on the counter next to the scale, suggesting preparation for brewing.\n[150-180s] - Person holds a metal portafilter with coffee grounds, positioning it under the espresso machine's spout.  \n- They then place the portafilter into the machine's group head, preparing to extract espresso.  \n- A second person is seen nearby, holding a smartphone, possibly recording or checking something.\n[180-210s] - Hand holds clear plastic cup, then places it under ice machine to collect ice cubes.  \n- Ice cubes are transferred from machine into cup using blue tool.  \n- Cup is moved to countertop near coffee machine, where liquid is poured into it.\n[210-240s] - Hands hold a metal pitcher and pour milk from a carton into it.  \n- A person in a gray apron stands nearby, observing the action.  \n- The pitcher is then positioned under a tap to fill with water.", "history_tokens": 569, "history_utf8_bytes": 2412, "recent_frame_times_s": [210.00234375, 211.00234375, 212.00234375, 213.00234375, 214.00234375, 215.00234375, 216.00234375, 217.00234375, 218.00234375, 219.00234375, 220.00234375, 221.00234375, 222.00234375, 223.00234375, 224.00234375, 225.00234375, 226.00234375, 227.00234375, 228.00234375, 229.00234375, 230.00234375, 231.00234375, 232.00234375, 233.00234375, 234.00234375, 235.00234375, 236.00234375, 237.00234375, 238.00234375, 239.00234375], "recent_frames_sha256": "e5ab4beb35a44dd4f97e54a9d4a85306dc0e2549b38855f4ac9f605689349876", "num_recent_frames": 30, "tq": 716634.674799806, "t1": 716637.165747716, "ta": 716637.165747716, "te": 716637.577046879, "first_response_s": 2.4909479100024328, "answer_total_s": 2.902247073012404, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 361, "content_group": "b180b038ed75cc990a53740d9122a23215e04be83cbd3fb113de239deb2f5495", "question": {"question_id": "sample_361_a355_q0", "video_id": 361, "video_path": "./videos/sample_361_real.mp4", "annotation_index": 355, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual just now?", "options": ["A. The individual ground coffee beans, tamped the coffee grounds, and prepared an espresso shot.", "B. The individual operated a juicer, filled a glass with orange juice, and served it to a customer.", "C. The individual brewed a pot of tea, poured it into cups, and arranged cookies on a plate.", "D. The individual prepared a milkshake, added toppings, and served it with a straw."], "answer": "A", "time_stamp_s": 355, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [345, 355], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_361_a355_q0", "video_id": 361, "time_stamp_s": 355, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3eac606c77ad6263ecf1a8c855cba201d84e610851278c13f7315dbf96a9d903", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [325.00234375, 326.00234375, 327.00234375, 328.00234375, 329.00234375, 330.00234375, 331.00234375, 332.00234375, 333.00234375, 334.00234375, 335.00234375, 336.00234375, 337.00234375, 338.00234375, 339.00234375, 340.00234375, 341.00234375, 342.00234375, 343.00234375, 344.00234375, 345.00234375, 346.00234375, 347.00234375, 348.00234375, 349.00234375, 350.00234375, 351.00234375, 352.00234375, 353.00234375, 354.00234375], "recent_frames_sha256": "2c230f74bd9d78621ccfeabc61e3e41df1a72b89dcde42a5abc0aa48888aef00", "num_recent_frames": 30, "tq": 716539.037054048, "t1": 716551.127111209, "ta": 716551.127111209, "te": 716551.164045235, "first_response_s": 12.090057160938159, "answer_total_s": 12.126991186989471, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_361_a355_q0", "video_id": 361, "time_stamp_s": 355, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "190a3bf76bfdfc0f979ba460d7a5407bfb4f79e40adc729ec41410c6111dfdde", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hand removes portafilter from espresso machine, then places it on a metal tray.  \n- Hand picks up a metal milk frothing pitcher and moves it toward a stainless steel milk frother.  \n- Hand places a small metal cup on the counter, then picks up a metal container with a lid.\n[30-60s] - Hand holds a clear glass pitcher filled with ice cubes, positioned near a coffee machine.  \n- A digital scale is placed on the counter, with a small metal container nearby, suggesting preparation for measuring ingredients.  \n- The person’s hand reaches for a metal portafilter, indicating readiness to brew coffee.\n[60-90s] - Person places a portafilter into the espresso machine's group head, preparing for extraction.  \n- Digital scale shows coffee weight increasing as grounds are added to the portafilter.  \n- Espresso machine's steam wand is visible, indicating readiness for milk frothing or steam cleaning.\n[90-120s] - Person holds a portafilter with a coffee puck, preparing to tamping it.  \n- Coffee machine's digital display shows \"00:00\" as the person positions the portafilter under the group head.  \n- A small container with a red cloth is visible near the machine's base, likely for cleaning or storage.\n[120-150s] - A hand holds a portafilter with ground coffee, positioned near a digital scale showing 18g, while another hand adjusts the scale's position on the counter.  \n- The portafilter is then placed into a coffee machine's group head, with the machine's digital display visible in the background.  \n- A small container with a white lid is placed on the counter next to the scale, suggesting preparation for brewing.\n[150-180s] - Person holds a metal portafilter with coffee grounds, positioning it under the espresso machine's spout.  \n- They then place the portafilter into the machine's group head, preparing to extract espresso.  \n- A second person is seen nearby, holding a smartphone, possibly recording or checking something.\n[180-210s] - Hand holds clear plastic cup, then places it under ice machine to collect ice cubes.  \n- Ice cubes are transferred from machine into cup using blue tool.  \n- Cup is moved to countertop near coffee machine, where liquid is poured into it.\n[210-240s] - Hands hold a metal pitcher and pour milk from a carton into it.  \n- A person in a gray apron stands nearby, observing the action.  \n- The pitcher is then positioned under a tap to fill with water.\n[240-270s] - Hand holds a stainless steel milk frothing pitcher with a yellow handle, positioning it under the espresso machine's steam wand.  \n- The pitcher is then wiped with a yellow cloth, likely for cleaning or preparation before use.  \n- A stack of brown paper cups is visible to the left, indicating a coffee shop or barista station setup.\n[270-300s] - Hand holds a small metal pitcher filled with steamed milk, positioned near a coffee machine's steam wand.  \n- Coffee machine's steam wand is actively steaming milk, with the pitcher tilted to receive the frothed milk.  \n- A small paper cup is held under the machine's spout, ready to receive espresso, while the pitcher is being used for steaming.\n[300-330s] - Hand places a metal cup under a dual spout espresso machine, then moves to adjust a portafilter.  \n- A digital scale displays \"0.00 g\" as a portafilter is positioned on it, indicating preparation for weighing coffee grounds.  \n- The person picks up a metal cup with a yellow handle, likely for espresso extraction, and positions it under the machine.", "history_tokens": 823, "history_utf8_bytes": 3484, "recent_frame_times_s": [325.00234375, 326.00234375, 327.00234375, 328.00234375, 329.00234375, 330.00234375, 331.00234375, 332.00234375, 333.00234375, 334.00234375, 335.00234375, 336.00234375, 337.00234375, 338.00234375, 339.00234375, 340.00234375, 341.00234375, 342.00234375, 343.00234375, 344.00234375, 345.00234375, 346.00234375, 347.00234375, 348.00234375, 349.00234375, 350.00234375, 351.00234375, 352.00234375, 353.00234375, 354.00234375], "recent_frames_sha256": "2c230f74bd9d78621ccfeabc61e3e41df1a72b89dcde42a5abc0aa48888aef00", "num_recent_frames": 30, "tq": 716663.601780944, "t1": 716669.816051772, "ta": 716669.816051772, "te": 716670.19485043, "first_response_s": 6.214270827942528, "answer_total_s": 6.593069485970773, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 361, "content_group": "b180b038ed75cc990a53740d9122a23215e04be83cbd3fb113de239deb2f5495", "question": {"question_id": "sample_361_a356_q0", "video_id": 361, "video_path": "./videos/sample_361_real.mp4", "annotation_index": 356, "question_index": 0, "question": "Which of the following options best summarizes the action just taken by the individual?", "options": ["A. The individual is steaming the milk.", "B. The individual is arranging paper cups for use.", "C. The individual is preparing a drink by adding a mixer.", "D. The individual is cleaning a stainless steel jug."], "answer": "A", "time_stamp_s": 470, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [460, 470], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_361_a356_q0", "video_id": 361, "time_stamp_s": 470, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d0b5a8d6865885798a480f28090fa9fcf7df80cd9ee3a87867f9c89a942a46d9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [440.00234375, 441.00234375, 442.00234375, 443.00234375, 444.00234375, 445.00234375, 446.00234375, 447.00234375, 448.00234375, 449.00234375, 450.00234375, 451.00234375, 452.00234375, 453.00234375, 454.00234375, 455.00234375, 456.00234375, 457.00234375, 458.00234375, 459.00234375, 460.00234375, 461.00234375, 462.00234375, 463.00234375, 464.00234375, 465.00234375, 466.00234375, 467.00234375, 468.00234375, 469.00234375], "recent_frames_sha256": "158b3789b35444efbdafeb77894e3971f85e2a4f96a7f9679b7c0fc044ca7f2f", "num_recent_frames": 30, "tq": 716551.170728824, "t1": 716562.142226214, "ta": 716562.142226214, "te": 716562.17951603, "first_response_s": 10.971497390069999, "answer_total_s": 11.008787206024863, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_361_a356_q0", "video_id": 361, "time_stamp_s": 470, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2cfc8ff98d4f2cf23a669131bfb17405856bfe9b0fd209afdda69b4b13b09c61", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Person places a portafilter into the espresso machine's group head, preparing for extraction.  \n- Digital scale shows coffee weight increasing as grounds are added to the portafilter.  \n- Espresso machine's steam wand is visible, indicating readiness for milk frothing or steam cleaning.\n[90-120s] - Person holds a portafilter with a coffee puck, preparing to tamping it.  \n- Coffee machine's digital display shows \"00:00\" as the person positions the portafilter under the group head.  \n- A small container with a red cloth is visible near the machine's base, likely for cleaning or storage.\n[120-150s] - A hand holds a portafilter with ground coffee, positioned near a digital scale showing 18g, while another hand adjusts the scale's position on the counter.  \n- The portafilter is then placed into a coffee machine's group head, with the machine's digital display visible in the background.  \n- A small container with a white lid is placed on the counter next to the scale, suggesting preparation for brewing.\n[150-180s] - Person holds a metal portafilter with coffee grounds, positioning it under the espresso machine's spout.  \n- They then place the portafilter into the machine's group head, preparing to extract espresso.  \n- A second person is seen nearby, holding a smartphone, possibly recording or checking something.\n[180-210s] - Hand holds clear plastic cup, then places it under ice machine to collect ice cubes.  \n- Ice cubes are transferred from machine into cup using blue tool.  \n- Cup is moved to countertop near coffee machine, where liquid is poured into it.\n[210-240s] - Hands hold a metal pitcher and pour milk from a carton into it.  \n- A person in a gray apron stands nearby, observing the action.  \n- The pitcher is then positioned under a tap to fill with water.\n[240-270s] - Hand holds a stainless steel milk frothing pitcher with a yellow handle, positioning it under the espresso machine's steam wand.  \n- The pitcher is then wiped with a yellow cloth, likely for cleaning or preparation before use.  \n- A stack of brown paper cups is visible to the left, indicating a coffee shop or barista station setup.\n[270-300s] - Hand holds a small metal pitcher filled with steamed milk, positioned near a coffee machine's steam wand.  \n- Coffee machine's steam wand is actively steaming milk, with the pitcher tilted to receive the frothed milk.  \n- A small paper cup is held under the machine's spout, ready to receive espresso, while the pitcher is being used for steaming.\n[300-330s] - Hand places a metal cup under a dual spout espresso machine, then moves to adjust a portafilter.  \n- A digital scale displays \"0.00 g\" as a portafilter is positioned on it, indicating preparation for weighing coffee grounds.  \n- The person picks up a metal cup with a yellow handle, likely for espresso extraction, and positions it under the machine.\n[330-360s] - Hands measure coffee grounds on a digital scale, showing 19.2g, then transfer to a portafilter.  \n- Portafilter is placed under the espresso machine's group head, ready for tamping.  \n- Coffee grounds are visibly compacted in the portafilter, with a metal tamper nearby.\n[360-390s] - Hand pours coffee grounds from a black pot into a portafilter, then places it into a coffee machine's brewing group.  \n- Digital scale shows 13g of coffee grounds being measured before being transferred to the portafilter.  \n- Coffee machine's brewing group is positioned under the portafilter, ready for tamping or extraction.\n[390-420s] - Hands insert a portafilter with ground coffee into a coffee machine's group head.  \n- A metal milk pitcher is picked up and held near the machine's steam wand.  \n- The pitcher is then moved toward a sink area, suggesting preparation for steaming milk.\n[420-450s] - Hand pours dark liquid from a bag into a metal container near a coffee machine.  \n- Hand holds a white bottle and pours a white liquid into the same metal container.  \n- Coffee machine and stacked paper cups are visible in the background.", "history_tokens": 966, "history_utf8_bytes": 4014, "recent_frame_times_s": [440.00234375, 441.00234375, 442.00234375, 443.00234375, 444.00234375, 445.00234375, 446.00234375, 447.00234375, 448.00234375, 449.00234375, 450.00234375, 451.00234375, 452.00234375, 453.00234375, 454.00234375, 455.00234375, 456.00234375, 457.00234375, 458.00234375, 459.00234375, 460.00234375, 461.00234375, 462.00234375, 463.00234375, 464.00234375, 465.00234375, 466.00234375, 467.00234375, 468.00234375, 469.00234375], "recent_frames_sha256": "158b3789b35444efbdafeb77894e3971f85e2a4f96a7f9679b7c0fc044ca7f2f", "num_recent_frames": 30, "tq": 716696.164280263, "t1": 716703.57536613, "ta": 716703.57536613, "te": 716703.764062667, "first_response_s": 7.411085866973735, "answer_total_s": 7.599782404024154, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 362, "content_group": "e83390a61171ea4e57614c93ba1dd25adac135e96666609952e8e58c4f140c3c", "question": {"question_id": "sample_362_a42_q0", "video_id": 362, "video_path": "./videos/sample_362_real.mp4", "annotation_index": 42, "question_index": 0, "question": "Which of the following options best summarizes the actions of the barista taken just now?", "options": ["A. The barista prepared a cappuccino, stirred it, and served it to a customer.", "B. The barista steamed milk, prepared two lattes, and began making a new latte.", "C. The barista brewed coffee, added sugar and cream, and handed it to a customer.", "D. The barista made a latte, added cocoa powder, and served it to a customer."], "answer": "B", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_362_a42_q0", "video_id": 362, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "cb33754a2f7d16a591b0976a1880ff5f6b96a998f2e01cbe7c72258dddd30450", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.030989583333333334, 1.0143229166666667, 2.0143229166666665, 3.0143229166666665, 4.014322916666667, 5.014322916666667, 6.014322916666667, 7.014322916666667, 8.014322916666666, 9.014322916666666], "recent_frames_sha256": "db24e888e14ad38cb4fffb0b4a95e29644f9475f532ee06dc4bc545cab763d66", "num_recent_frames": 10, "tq": 710194.079190914, "t1": 710201.343784034, "ta": 710201.343784034, "te": 710201.379930188, "first_response_s": 7.264593119965866, "answer_total_s": 7.300739273894578, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_362_a42_q0", "video_id": 362, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a2280f608a2edbdcb01cd1088d6bea22f310b2cd076d6b9d7dbe0c9d7398bf39", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.030989583333333334, 1.0143229166666667, 2.0143229166666665, 3.0143229166666665, 4.014322916666667, 5.014322916666667, 6.014322916666667, 7.014322916666667, 8.014322916666666, 9.014322916666666], "recent_frames_sha256": "db24e888e14ad38cb4fffb0b4a95e29644f9475f532ee06dc4bc545cab763d66", "num_recent_frames": 10, "tq": 710221.442096189, "t1": 710227.782350978, "ta": 710227.782350978, "te": 710227.828134234, "first_response_s": 6.340254788985476, "answer_total_s": 6.38603804493323, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 362, "content_group": "e83390a61171ea4e57614c93ba1dd25adac135e96666609952e8e58c4f140c3c", "question": {"question_id": "sample_362_a43_q0", "video_id": 362, "video_path": "./videos/sample_362_real.mp4", "annotation_index": 43, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The worker prepared an espresso by measuring coffee grounds, tamping them, and placing them in the machine.", "B. The worker prepared a cup of tea by measuring loose leaves, placing them in a pot, and adding hot water.", "C. The worker cleaned the coffee machine and sorted cups for the next order.", "D. The worker brewed a fresh pot of coffee by measuring water and coffee grounds, then starting the machine."], "answer": "A", "time_stamp_s": 138, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [116, 126], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_362_a43_q0", "video_id": 362, "time_stamp_s": 138, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e6f86dc09ac8ac8b58c9a84d5cc1160eb38dcf5e14016d57ef82db28fb9dffde", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [108.01432291666667, 109.01432291666667, 110.01432291666667, 111.01432291666667, 112.01432291666667, 113.01432291666667, 114.01432291666667, 115.01432291666667, 116.01432291666667, 117.01432291666667, 118.01432291666667, 119.01432291666667, 120.01432291666667, 121.01432291666667, 122.01432291666667, 123.01432291666667, 124.01432291666667, 125.01432291666667, 126.01432291666667, 127.01432291666667, 128.01432291666666, 129.01432291666666, 130.01432291666666, 131.01432291666666, 132.01432291666666, 133.01432291666666, 134.01432291666666, 135.01432291666666, 136.01432291666666, 137.01432291666666], "recent_frames_sha256": "ffa7661f1150f526f1afcc9868906bceea7c163d33ec19adaa285d5f14e0f50d", "num_recent_frames": 30, "tq": 710201.409264491, "t1": 710207.467369414, "ta": 710207.467369414, "te": 710207.505265254, "first_response_s": 6.058104922994971, "answer_total_s": 6.096000762889162, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_362_a43_q0", "video_id": 362, "time_stamp_s": 138, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "faeb0bf0fad4e057cceb53165269482f677417205d814b04e51fd9ab6bd1f3a2", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Barista pours steamed milk into a cup of espresso to create latte art, then places the finished drink on the counter.  \n- The barista picks up a small, brown paper cup and places it next to the latte, possibly for a second drink or to hold a different beverage.  \n- The barista’s hands are visible throughout, manipulating the coffee machine and cups, with the espresso machine and milk pitcher in use.\n[30-60s] - Hand places a metal portafilter into a coffee machine's group head, preparing for extraction.  \n- Digital scale displays \"0.00 g\" as a hand positions a small cup beneath the portafilter's spout.  \n- Tablet screen shows a coffee machine interface with a \"Start\" button, indicating readiness for brewing.\n[60-90s] - Hand places coffee grounds into a portafilter, then tamps it down with a tamper.  \n- Portafilter is positioned under the espresso machine's group head, ready for extraction.  \n- Digital scale shows weight of coffee grounds (18.7g) before tamping.\n[90-120s] - Hand places a white bottle into a drawer under the counter.  \n- Coffee grounds are measured on a digital scale, showing 18g.  \n- A person’s hand holds a coffee tamper, preparing to tamp the grounds.", "history_tokens": 298, "history_utf8_bytes": 1199, "recent_frame_times_s": [108.01432291666667, 109.01432291666667, 110.01432291666667, 111.01432291666667, 112.01432291666667, 113.01432291666667, 114.01432291666667, 115.01432291666667, 116.01432291666667, 117.01432291666667, 118.01432291666667, 119.01432291666667, 120.01432291666667, 121.01432291666667, 122.01432291666667, 123.01432291666667, 124.01432291666667, 125.01432291666667, 126.01432291666667, 127.01432291666667, 128.01432291666666, 129.01432291666666, 130.01432291666666, 131.01432291666666, 132.01432291666666, 133.01432291666666, 134.01432291666666, 135.01432291666666, 136.01432291666666, 137.01432291666666], "recent_frames_sha256": "ffa7661f1150f526f1afcc9868906bceea7c163d33ec19adaa285d5f14e0f50d", "num_recent_frames": 30, "tq": 710252.875400151, "t1": 710260.01909596, "ta": 710260.01909596, "te": 710260.057784677, "first_response_s": 7.143695808947086, "answer_total_s": 7.182384526007809, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 362, "content_group": "e83390a61171ea4e57614c93ba1dd25adac135e96666609952e8e58c4f140c3c", "question": {"question_id": "sample_362_a44_q0", "video_id": 362, "video_path": "./videos/sample_362_real.mp4", "annotation_index": 44, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual cleaned the coffee machine and placed a cup on the scale.", "B. The individual measured cocoa powder into a pitcher.", "C. The individual selected a cup, poured coffee grounds into it, and added hot water.", "D. The individual brewed fresh coffee by placing a new filter and coffee grounds into the machine."], "answer": "B", "time_stamp_s": 238, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [232, 242], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_362_a44_q0", "video_id": 362, "time_stamp_s": 238, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a607addf1fbbe7a2a2d928d7de8b4473172cebc0ee5247b623ba546dddf38038", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [208.01432291666666, 209.01432291666666, 210.01432291666666, 211.01432291666666, 212.01432291666666, 213.01432291666666, 214.01432291666666, 215.01432291666666, 216.01432291666666, 217.01432291666666, 218.01432291666666, 219.01432291666666, 220.01432291666666, 221.01432291666666, 222.01432291666666, 223.01432291666666, 224.01432291666666, 225.01432291666666, 226.01432291666666, 227.01432291666666, 228.01432291666666, 229.01432291666666, 230.01432291666666, 231.01432291666666, 232.01432291666666, 233.01432291666666, 234.01432291666666, 235.01432291666666, 236.01432291666666, 237.01432291666666], "recent_frames_sha256": "d1f199688d0f1db13473c5f93c0866c931cf11acaa8d1176e00c9563f69af0fc", "num_recent_frames": 30, "tq": 710207.528638489, "t1": 710212.568594372, "ta": 710212.568594372, "te": 710212.606082771, "first_response_s": 5.039955883054063, "answer_total_s": 5.077444282011129, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_362_a44_q0", "video_id": 362, "time_stamp_s": 238, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b5bf4539a54414e536b0cab1bf84a3043749d4e1e52981e7dc5dea6cedfbeaea", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Barista pours steamed milk into a cup of espresso to create latte art, then places the finished drink on the counter.  \n- The barista picks up a small, brown paper cup and places it next to the latte, possibly for a second drink or to hold a different beverage.  \n- The barista’s hands are visible throughout, manipulating the coffee machine and cups, with the espresso machine and milk pitcher in use.\n[30-60s] - Hand places a metal portafilter into a coffee machine's group head, preparing for extraction.  \n- Digital scale displays \"0.00 g\" as a hand positions a small cup beneath the portafilter's spout.  \n- Tablet screen shows a coffee machine interface with a \"Start\" button, indicating readiness for brewing.\n[60-90s] - Hand places coffee grounds into a portafilter, then tamps it down with a tamper.  \n- Portafilter is positioned under the espresso machine's group head, ready for extraction.  \n- Digital scale shows weight of coffee grounds (18.7g) before tamping.\n[90-120s] - Hand places a white bottle into a drawer under the counter.  \n- Coffee grounds are measured on a digital scale, showing 18g.  \n- A person’s hand holds a coffee tamper, preparing to tamp the grounds.\n[120-150s] - Hands place a portafilter with ground coffee into an espresso machine's group head, preparing for extraction.  \n- A digital scale displays \"0.00\" as the person adjusts the portafilter's position on the machine's drip tray.  \n- The espresso machine's steam wand is visible, positioned near the portafilter, ready for use.\n[150-180s] - Hand removes portafilter from machine, revealing coffee grounds in the filter basket.  \n- Digital scale displays weight of coffee grounds as they are measured and placed into the portafilter.  \n- Coffee machine's portafilter is inserted into the machine's brewing group, preparing for extraction.\n[180-210s] - Hand inserts portafilter into espresso machine, then removes it after brewing.  \n- Coffee grounds are scooped from a container into the portafilter.  \n- A tablet displays a digital interface, likely for coffee machine settings or order tracking.", "history_tokens": 510, "history_utf8_bytes": 2102, "recent_frame_times_s": [208.01432291666666, 209.01432291666666, 210.01432291666666, 211.01432291666666, 212.01432291666666, 213.01432291666666, 214.01432291666666, 215.01432291666666, 216.01432291666666, 217.01432291666666, 218.01432291666666, 219.01432291666666, 220.01432291666666, 221.01432291666666, 222.01432291666666, 223.01432291666666, 224.01432291666666, 225.01432291666666, 226.01432291666666, 227.01432291666666, 228.01432291666666, 229.01432291666666, 230.01432291666666, 231.01432291666666, 232.01432291666666, 233.01432291666666, 234.01432291666666, 235.01432291666666, 236.01432291666666, 237.01432291666666], "recent_frames_sha256": "d1f199688d0f1db13473c5f93c0866c931cf11acaa8d1176e00c9563f69af0fc", "num_recent_frames": 30, "tq": 710289.471065644, "t1": 710291.251893003, "ta": 710291.251893003, "te": 710291.451039305, "first_response_s": 1.7808273590635508, "answer_total_s": 1.9799736610148102, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 362, "content_group": "e83390a61171ea4e57614c93ba1dd25adac135e96666609952e8e58c4f140c3c", "question": {"question_id": "sample_362_a45_q0", "video_id": 362, "video_path": "./videos/sample_362_real.mp4", "annotation_index": 45, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual placed the milk jug under the steamer, wiped the machine, and steamed the milk.", "B. The individual brewed a fresh cup of coffee, cleaned the counter, and served the drink.", "C. The individual cleaned the work area, steamed milk, and prepared a milk-based beverage.", "D. The individual restocked supplies, brewed coffee, and served it to a customer."], "answer": "C", "time_stamp_s": 362, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [348, 358], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_362_a45_q0", "video_id": 362, "time_stamp_s": 362, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fac8c5f6c580f3aea08df614dd514f2c6ebee0385f9a1fa045b5b06a0198bb38", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [332.0143229166667, 333.0143229166667, 334.0143229166667, 335.0143229166667, 336.0143229166667, 337.0143229166667, 338.0143229166667, 339.0143229166667, 340.0143229166667, 341.0143229166667, 342.0143229166667, 343.0143229166667, 344.0143229166667, 345.0143229166667, 346.0143229166667, 347.0143229166667, 348.0143229166667, 349.0143229166667, 350.0143229166667, 351.0143229166667, 352.0143229166667, 353.0143229166667, 354.0143229166667, 355.0143229166667, 356.0143229166667, 357.0143229166667, 358.0143229166667, 359.0143229166667, 360.0143229166667, 361.0143229166667], "recent_frames_sha256": "5c3876a540cdfe24b8568ce5aa864cdb11fed94447be31cb24151044f43b1966", "num_recent_frames": 30, "tq": 710212.648269775, "t1": 710220.021302199, "ta": 710220.021302199, "te": 710220.058793669, "first_response_s": 7.373032424016856, "answer_total_s": 7.410523894010112, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_362_a45_q0", "video_id": 362, "time_stamp_s": 362, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c6e2886aee5b7c5d59e465885d791aea7ef01fcfeba10aa4ee58f1cf6d690f6d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Barista pours steamed milk into a cup of espresso to create latte art, then places the finished drink on the counter.  \n- The barista picks up a small, brown paper cup and places it next to the latte, possibly for a second drink or to hold a different beverage.  \n- The barista’s hands are visible throughout, manipulating the coffee machine and cups, with the espresso machine and milk pitcher in use.\n[30-60s] - Hand places a metal portafilter into a coffee machine's group head, preparing for extraction.  \n- Digital scale displays \"0.00 g\" as a hand positions a small cup beneath the portafilter's spout.  \n- Tablet screen shows a coffee machine interface with a \"Start\" button, indicating readiness for brewing.\n[60-90s] - Hand places coffee grounds into a portafilter, then tamps it down with a tamper.  \n- Portafilter is positioned under the espresso machine's group head, ready for extraction.  \n- Digital scale shows weight of coffee grounds (18.7g) before tamping.\n[90-120s] - Hand places a white bottle into a drawer under the counter.  \n- Coffee grounds are measured on a digital scale, showing 18g.  \n- A person’s hand holds a coffee tamper, preparing to tamp the grounds.\n[120-150s] - Hands place a portafilter with ground coffee into an espresso machine's group head, preparing for extraction.  \n- A digital scale displays \"0.00\" as the person adjusts the portafilter's position on the machine's drip tray.  \n- The espresso machine's steam wand is visible, positioned near the portafilter, ready for use.\n[150-180s] - Hand removes portafilter from machine, revealing coffee grounds in the filter basket.  \n- Digital scale displays weight of coffee grounds as they are measured and placed into the portafilter.  \n- Coffee machine's portafilter is inserted into the machine's brewing group, preparing for extraction.\n[180-210s] - Hand inserts portafilter into espresso machine, then removes it after brewing.  \n- Coffee grounds are scooped from a container into the portafilter.  \n- A tablet displays a digital interface, likely for coffee machine settings or order tracking.\n[210-240s] - Hand holds a clear container with brown granular substance and a wooden spoon, positioned over a metal measuring cup.  \n- Left hand places a metal measuring cup onto a digital scale, which displays \"0.00 g\" as the weight resets.  \n- Right hand scoops the granular substance from the container into the measuring cup, preparing for measurement.\n[240-270s] - Hand holds a small metal cup, pouring dark liquid into a paper cup on the espresso machine's drip tray.  \n- Paper cup with coffee grounds is placed on the machine's drip tray, positioned near a stack of paper cups.  \n- Hand moves a metal cup toward the espresso machine's portafilter, preparing for brewing.\n[270-300s] - Hand pours water from a white jug into a metal portafilter, likely for espresso machine preparation.  \n- Hand holds a red \"Budweiser\" packet, preparing to add its contents to a cup.  \n- Two brown paper cups sit on the counter, one already containing a small amount of liquid.\n[300-330s] - Barista holds a metal pitcher under a steam wand, preparing to froth milk.  \n- A blue and white striped cloth is used to wipe the steam wand after use.  \n- Two brown paper cups are positioned on the counter, ready to receive coffee.\n[330-360s] - Barista places a paper cup under a coffee tap, filling it with espresso.  \n- Barista holds a metal pitcher, pouring steamed milk into the espresso cup.  \n- Barista uses a yellow sponge to wipe the espresso machine's surface.", "history_tokens": 868, "history_utf8_bytes": 3553, "recent_frame_times_s": [332.0143229166667, 333.0143229166667, 334.0143229166667, 335.0143229166667, 336.0143229166667, 337.0143229166667, 338.0143229166667, 339.0143229166667, 340.0143229166667, 341.0143229166667, 342.0143229166667, 343.0143229166667, 344.0143229166667, 345.0143229166667, 346.0143229166667, 347.0143229166667, 348.0143229166667, 349.0143229166667, 350.0143229166667, 351.0143229166667, 352.0143229166667, 353.0143229166667, 354.0143229166667, 355.0143229166667, 356.0143229166667, 357.0143229166667, 358.0143229166667, 359.0143229166667, 360.0143229166667, 361.0143229166667], "recent_frames_sha256": "5c3876a540cdfe24b8568ce5aa864cdb11fed94447be31cb24151044f43b1966", "num_recent_frames": 30, "tq": 710340.566131754, "t1": 710342.448997139, "ta": 710342.448997139, "te": 710342.852057736, "first_response_s": 1.8828653850359842, "answer_total_s": 2.285925982054323, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 362, "content_group": "e83390a61171ea4e57614c93ba1dd25adac135e96666609952e8e58c4f140c3c", "question": {"question_id": "sample_362_a46_q0", "video_id": 362, "video_path": "./videos/sample_362_real.mp4", "annotation_index": 46, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual brewed a fresh cup of tea, added sugar, and served it to a customer.", "B. The individual steamed milk, prepared a latte, and added a lid to the cup.", "C. The individual prepared an espresso shot, cleaned the coffee machine, and discarded used grounds.", "D. The individual restocked the cups, cleaned the counter, and replaced the lids."], "answer": "B", "time_stamp_s": 467, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [464, 474], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_362_a46_q0", "video_id": 362, "time_stamp_s": 467, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d4747648c4a86cffa2510be6216899616a4a26e80482b4cfaa2953e71f8b0b9e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [437.0143229166667, 438.0143229166667, 439.0143229166667, 440.0143229166667, 441.0143229166667, 442.0143229166667, 443.0143229166667, 444.0143229166667, 445.0143229166667, 446.0143229166667, 447.0143229166667, 448.0143229166667, 449.0143229166667, 450.0143229166667, 451.0143229166667, 452.0143229166667, 453.0143229166667, 454.0143229166667, 455.0143229166667, 456.0143229166667, 457.0143229166667, 458.0143229166667, 459.0143229166667, 460.0143229166667, 461.0143229166667, 462.0143229166667, 463.0143229166667, 464.0143229166667, 465.0143229166667, 466.0143229166667], "recent_frames_sha256": "c847853d653b3549d7f2e07a49147c19af3cec2c85f158568a42e74138432ba2", "num_recent_frames": 30, "tq": 710220.077491281, "t1": 710221.362050748, "ta": 710221.362050748, "te": 710221.402792724, "first_response_s": 1.284559466992505, "answer_total_s": 1.3253014429938048, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_362_a46_q0", "video_id": 362, "time_stamp_s": 467, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "38059b794f264cc16d410c157e206dddf9d15682197617181d9a941dd330859a", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Hand places a metal portafilter into a coffee machine's group head, preparing for extraction.  \n- Digital scale displays \"0.00 g\" as a hand positions a small cup beneath the portafilter's spout.  \n- Tablet screen shows a coffee machine interface with a \"Start\" button, indicating readiness for brewing.\n[60-90s] - Hand places coffee grounds into a portafilter, then tamps it down with a tamper.  \n- Portafilter is positioned under the espresso machine's group head, ready for extraction.  \n- Digital scale shows weight of coffee grounds (18.7g) before tamping.\n[90-120s] - Hand places a white bottle into a drawer under the counter.  \n- Coffee grounds are measured on a digital scale, showing 18g.  \n- A person’s hand holds a coffee tamper, preparing to tamp the grounds.\n[120-150s] - Hands place a portafilter with ground coffee into an espresso machine's group head, preparing for extraction.  \n- A digital scale displays \"0.00\" as the person adjusts the portafilter's position on the machine's drip tray.  \n- The espresso machine's steam wand is visible, positioned near the portafilter, ready for use.\n[150-180s] - Hand removes portafilter from machine, revealing coffee grounds in the filter basket.  \n- Digital scale displays weight of coffee grounds as they are measured and placed into the portafilter.  \n- Coffee machine's portafilter is inserted into the machine's brewing group, preparing for extraction.\n[180-210s] - Hand inserts portafilter into espresso machine, then removes it after brewing.  \n- Coffee grounds are scooped from a container into the portafilter.  \n- A tablet displays a digital interface, likely for coffee machine settings or order tracking.\n[210-240s] - Hand holds a clear container with brown granular substance and a wooden spoon, positioned over a metal measuring cup.  \n- Left hand places a metal measuring cup onto a digital scale, which displays \"0.00 g\" as the weight resets.  \n- Right hand scoops the granular substance from the container into the measuring cup, preparing for measurement.\n[240-270s] - Hand holds a small metal cup, pouring dark liquid into a paper cup on the espresso machine's drip tray.  \n- Paper cup with coffee grounds is placed on the machine's drip tray, positioned near a stack of paper cups.  \n- Hand moves a metal cup toward the espresso machine's portafilter, preparing for brewing.\n[270-300s] - Hand pours water from a white jug into a metal portafilter, likely for espresso machine preparation.  \n- Hand holds a red \"Budweiser\" packet, preparing to add its contents to a cup.  \n- Two brown paper cups sit on the counter, one already containing a small amount of liquid.\n[300-330s] - Barista holds a metal pitcher under a steam wand, preparing to froth milk.  \n- A blue and white striped cloth is used to wipe the steam wand after use.  \n- Two brown paper cups are positioned on the counter, ready to receive coffee.\n[330-360s] - Barista places a paper cup under a coffee tap, filling it with espresso.  \n- Barista holds a metal pitcher, pouring steamed milk into the espresso cup.  \n- Barista uses a yellow sponge to wipe the espresso machine's surface.\n[360-390s] - Hand pours steamed milk into a paper cup, creating foam.  \n- A carton of oat milk and a box of cocoa powder are visible on the counter.  \n- A second cup is prepared with chocolate sprinkles added from a small wooden spoon.\n[390-420s] - A hand holds a metal cup while another hand pours coffee grounds into it from a container.  \n- A red box labeled \"Caffeine\" is visible on the counter, alongside a blue box of milk powder.  \n- The counter holds various coffee-making tools, including a milk frother and a coffee grinder.\n[420-450s] - Hand holds a yellow sponge, wiping the metal portafilter after use.  \n- Portafilter is positioned under a coffee machine's spout, likely for rinsing or cleaning.  \n- Background shows stacked paper cups and a customer seated nearby, indicating a café setting.", "history_tokens": 974, "history_utf8_bytes": 3946, "recent_frame_times_s": [437.0143229166667, 438.0143229166667, 439.0143229166667, 440.0143229166667, 441.0143229166667, 442.0143229166667, 443.0143229166667, 444.0143229166667, 445.0143229166667, 446.0143229166667, 447.0143229166667, 448.0143229166667, 449.0143229166667, 450.0143229166667, 451.0143229166667, 452.0143229166667, 453.0143229166667, 454.0143229166667, 455.0143229166667, 456.0143229166667, 457.0143229166667, 458.0143229166667, 459.0143229166667, 460.0143229166667, 461.0143229166667, 462.0143229166667, 463.0143229166667, 464.0143229166667, 465.0143229166667, 466.0143229166667], "recent_frames_sha256": "c847853d653b3549d7f2e07a49147c19af3cec2c85f158568a42e74138432ba2", "num_recent_frames": 30, "tq": 710365.666488491, "t1": 710372.735037934, "ta": 710372.735037934, "te": 710372.88997889, "first_response_s": 7.068549443036318, "answer_total_s": 7.223490398959257, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 363, "content_group": "3769e95476be930ddf3d21c8f3858342470ec038dee832b3042ffb0e905e8b4c", "question": {"question_id": "sample_363_a1944_q0", "video_id": 363, "video_path": "./videos/sample_363_real.mp4", "annotation_index": 1944, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. An individual ground coffee beans, weighed the coffee, and started brewing the coffee.", "B. An individual added condiments to a ready-made espresso shot and served it to a customer.", "C. An individual prepared a cup of coffee by grinding beans and tamping it.", "D. An individual poured milk and water into a cup and served a latte."], "answer": "C", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_363_a1944_q0", "video_id": 363, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "938ba1902e6413e1878ee810a0d8e5432fc12ea014212cbae98ebdad669cf9ca", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.027018229166666668, 1.0103515625, 2.0103515625, 3.0103515625, 4.0103515625, 5.0103515625, 6.0103515625, 7.0103515625, 8.0103515625, 9.0103515625], "recent_frames_sha256": "9321464da262b67ffdab283cd72e1fc37346992c1ba96cbfd5e2f3404c3e3b3f", "num_recent_frames": 10, "tq": 718567.556662403, "t1": 718574.673086064, "ta": 718574.673086064, "te": 718574.710602686, "first_response_s": 7.116423661005683, "answer_total_s": 7.153940282994881, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_363_a1944_q0", "video_id": 363, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "651a8fd052638278146ada4f9641c52fad68b395ba8709c536b6190ecf3ccdbe", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.027018229166666668, 1.0103515625, 2.0103515625, 3.0103515625, 4.0103515625, 5.0103515625, 6.0103515625, 7.0103515625, 8.0103515625, 9.0103515625], "recent_frames_sha256": "9321464da262b67ffdab283cd72e1fc37346992c1ba96cbfd5e2f3404c3e3b3f", "num_recent_frames": 10, "tq": 718421.686599597, "t1": 718427.49835742, "ta": 718427.49835742, "te": 718427.53673018, "first_response_s": 5.811757822986692, "answer_total_s": 5.85013058304321, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 363, "content_group": "3769e95476be930ddf3d21c8f3858342470ec038dee832b3042ffb0e905e8b4c", "question": {"question_id": "sample_363_a1945_q0", "video_id": 363, "video_path": "./videos/sample_363_real.mp4", "annotation_index": 1945, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. An individual prepared two cups of iced coffee, sealed the lids, and placed them on the counter.", "B. An individual brewed two cups of hot coffee, added sugar, and handed them to customers.", "C. An individual cleaned the coffee machine and stored the coffee cups.", "D. An individual took out coffee supplies from storage and organized them on the shelf."], "answer": "A", "time_stamp_s": 129, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [119, 129], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_363_a1945_q0", "video_id": 363, "time_stamp_s": 129, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "163d8536a0e50f88c73547e78cc661f92b918fcb21c0053e13733962f438fc01", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [99.0103515625, 100.0103515625, 101.0103515625, 102.0103515625, 103.0103515625, 104.0103515625, 105.0103515625, 106.0103515625, 107.0103515625, 108.0103515625, 109.0103515625, 110.0103515625, 111.0103515625, 112.0103515625, 113.0103515625, 114.0103515625, 115.0103515625, 116.0103515625, 117.0103515625, 118.0103515625, 119.0103515625, 120.0103515625, 121.0103515625, 122.0103515625, 123.0103515625, 124.0103515625, 125.0103515625, 126.0103515625, 127.0103515625, 128.0103515625], "recent_frames_sha256": "5c9601ba2bb132b27089f2e45a85924906e674b9728ad1089e3793530a690f56", "num_recent_frames": 30, "tq": 718574.729735481, "t1": 718582.325185908, "ta": 718582.325185908, "te": 718582.36348895, "first_response_s": 7.5954504270339385, "answer_total_s": 7.633753468981013, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_363_a1945_q0", "video_id": 363, "time_stamp_s": 129, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "737f60742d172fa1f215fd25d1ed5bb7ad60da35b3f115a579fd6466bd668aeb", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person holds a portafilter with coffee grounds, positioning it under an espresso machine's group head.  \n- They insert the portafilter into the machine, then remove it after extraction, revealing a used filter basket.  \n- The person then places the used filter basket into a sink or waste container, with various coffee-making tools visible nearby.\n[30-60s] - Person pours coffee grounds into a portafilter using a scoop, then places it on the espresso machine's group head.  \n- The espresso machine's digital display shows \"0.00\" as the person prepares to tare the scale.  \n- A digital scale is positioned on the counter, displaying \"0.00 g\" before the person begins weighing coffee.\n[60-90s] - Person holds a small cup with coffee grounds on a digital scale, adjusting the cup's position slightly.  \n- The scale displays a weight reading of approximately 18.2 grams, indicating precise measurement.  \n- The person’s hands are positioned near a coffee machine, suggesting preparation for brewing.\n[90-120s] - Barista hands pour espresso into a glass cup while holding a metal portafilter.  \n- Two glasses with creamy liquid and a small cup of espresso are placed on the counter.  \n- A person in a white shirt is visible in the background, observing the coffee preparation.", "history_tokens": 294, "history_utf8_bytes": 1285, "recent_frame_times_s": [99.0103515625, 100.0103515625, 101.0103515625, 102.0103515625, 103.0103515625, 104.0103515625, 105.0103515625, 106.0103515625, 107.0103515625, 108.0103515625, 109.0103515625, 110.0103515625, 111.0103515625, 112.0103515625, 113.0103515625, 114.0103515625, 115.0103515625, 116.0103515625, 117.0103515625, 118.0103515625, 119.0103515625, 120.0103515625, 121.0103515625, 122.0103515625, 123.0103515625, 124.0103515625, 125.0103515625, 126.0103515625, 127.0103515625, 128.0103515625], "recent_frames_sha256": "5c9601ba2bb132b27089f2e45a85924906e674b9728ad1089e3793530a690f56", "num_recent_frames": 30, "tq": 718457.724940838, "t1": 718459.196678682, "ta": 718459.196678682, "te": 718459.423117397, "first_response_s": 1.4717378440545872, "answer_total_s": 1.698176559060812, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 363, "content_group": "3769e95476be930ddf3d21c8f3858342470ec038dee832b3042ffb0e905e8b4c", "question": {"question_id": "sample_363_a1946_q0", "video_id": 363, "video_path": "./videos/sample_363_real.mp4", "annotation_index": 1946, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual brewed a fresh pot of coffee, added sugar, and handed it to the customer.", "B. The individual added a straw to an iced coffee, stirred it, and handed it to the customer.", "C. The individual took a hot coffee, added a lid, and placed it in a tray.", "D. The individual steamed milk, poured it into a cup, and added cinnamon topping."], "answer": "B", "time_stamp_s": 251, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [238, 248], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_363_a1946_q0", "video_id": 363, "time_stamp_s": 251, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9577512d21e7e090d2a954d69e135af7c1c17c9b8ac1f7498e0f5ae46c8a5935", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [221.0103515625, 222.0103515625, 223.0103515625, 224.0103515625, 225.0103515625, 226.0103515625, 227.0103515625, 228.0103515625, 229.0103515625, 230.0103515625, 231.0103515625, 232.0103515625, 233.0103515625, 234.0103515625, 235.0103515625, 236.0103515625, 237.0103515625, 238.0103515625, 239.0103515625, 240.0103515625, 241.0103515625, 242.0103515625, 243.0103515625, 244.0103515625, 245.0103515625, 246.0103515625, 247.0103515625, 248.0103515625, 249.0103515625, 250.0103515625], "recent_frames_sha256": "5e3300203fc2afea49e4bb6b992a659a146953e6e4a8f25435db021c11ac94a4", "num_recent_frames": 30, "tq": 718582.376774155, "t1": 718596.342345142, "ta": 718596.342345142, "te": 718596.379954141, "first_response_s": 13.965570987085812, "answer_total_s": 14.003179986029863, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_363_a1946_q0", "video_id": 363, "time_stamp_s": 251, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4b991c05f30d85b37600630f74c1c97a5814ae671954521a9b3ddf251f03c374", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person holds a portafilter with coffee grounds, positioning it under an espresso machine's group head.  \n- They insert the portafilter into the machine, then remove it after extraction, revealing a used filter basket.  \n- The person then places the used filter basket into a sink or waste container, with various coffee-making tools visible nearby.\n[30-60s] - Person pours coffee grounds into a portafilter using a scoop, then places it on the espresso machine's group head.  \n- The espresso machine's digital display shows \"0.00\" as the person prepares to tare the scale.  \n- A digital scale is positioned on the counter, displaying \"0.00 g\" before the person begins weighing coffee.\n[60-90s] - Person holds a small cup with coffee grounds on a digital scale, adjusting the cup's position slightly.  \n- The scale displays a weight reading of approximately 18.2 grams, indicating precise measurement.  \n- The person’s hands are positioned near a coffee machine, suggesting preparation for brewing.\n[90-120s] - Barista hands pour espresso into a glass cup while holding a metal portafilter.  \n- Two glasses with creamy liquid and a small cup of espresso are placed on the counter.  \n- A person in a white shirt is visible in the background, observing the coffee preparation.\n[120-150s] - Hand inserts a white plastic straw into a clear plastic cup containing a dark liquid.  \n- Another hand holds a small metal portafilter with coffee grounds, positioned near the espresso machine's spout.  \n- A second clear cup with a similar dark liquid is visible on the counter, slightly to the right of the first cup.\n[150-180s] - Hand holds a clear glass with yellow liquid, positioned near espresso machine's drip tray.  \n- Another hand places a metal portafilter into the machine's group head, preparing for extraction.  \n- A second glass with yellow liquid is visible on the counter, suggesting multiple drinks are being prepared.\n[180-210s] - A hand holds a glass with a yellow liquid, then pours orange liquid from a pitcher into it.  \n- Another hand reaches for a carton of milk, then pours it into the glass.  \n- The glass is placed on a metal tray near a coffee machine.\n[210-240s] - A hand stirs a glass of amber liquid with a spoon, then pours it into a clear plastic cup.  \n- The pouring action is performed over a metal drip tray, with another glass of similar liquid already on the tray.  \n- A ring is visible on the finger holding the glass, and a second hand reaches toward the cup after pouring.", "history_tokens": 587, "history_utf8_bytes": 2512, "recent_frame_times_s": [221.0103515625, 222.0103515625, 223.0103515625, 224.0103515625, 225.0103515625, 226.0103515625, 227.0103515625, 228.0103515625, 229.0103515625, 230.0103515625, 231.0103515625, 232.0103515625, 233.0103515625, 234.0103515625, 235.0103515625, 236.0103515625, 237.0103515625, 238.0103515625, 239.0103515625, 240.0103515625, 241.0103515625, 242.0103515625, 243.0103515625, 244.0103515625, 245.0103515625, 246.0103515625, 247.0103515625, 248.0103515625, 249.0103515625, 250.0103515625], "recent_frames_sha256": "5e3300203fc2afea49e4bb6b992a659a146953e6e4a8f25435db021c11ac94a4", "num_recent_frames": 30, "tq": 718499.231039577, "t1": 718507.189762327, "ta": 718507.189762327, "te": 718507.229946303, "first_response_s": 7.958722749957815, "answer_total_s": 7.998906725901179, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 363, "content_group": "3769e95476be930ddf3d21c8f3858342470ec038dee832b3042ffb0e905e8b4c", "question": {"question_id": "sample_363_a1947_q0", "video_id": 363, "video_path": "./videos/sample_363_real.mp4", "annotation_index": 1947, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual cleaned tables and collected used cups from the customers in a cafe.", "B. The individual took packaged suger and served them to customers at a table.", "C. The individual cleaned the espresso machine and arranged the utensils on the counter.", "D. The individual arranged pastries on a display counter for customers."], "answer": "B", "time_stamp_s": 360, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [357, 367], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_363_a1947_q0", "video_id": 363, "time_stamp_s": 360, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9c11da1754d3ee1f5049add54e50e54d71813fb933627bb7e1144a02076fa559", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [330.0103515625, 331.0103515625, 332.0103515625, 333.0103515625, 334.0103515625, 335.0103515625, 336.0103515625, 337.0103515625, 338.0103515625, 339.0103515625, 340.0103515625, 341.0103515625, 342.0103515625, 343.0103515625, 344.0103515625, 345.0103515625, 346.0103515625, 347.0103515625, 348.0103515625, 349.0103515625, 350.0103515625, 351.0103515625, 352.0103515625, 353.0103515625, 354.0103515625, 355.0103515625, 356.0103515625, 357.0103515625, 358.0103515625, 359.0103515625], "recent_frames_sha256": "6af7d34091a4d3e99e9244f9f85a71df657e902d87c7054a663e1140c1ecf9c4", "num_recent_frames": 30, "tq": 718596.387381736, "t1": 718609.141671204, "ta": 718609.141671204, "te": 718609.182247998, "first_response_s": 12.754289468051866, "answer_total_s": 12.79486626200378, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_363_a1947_q0", "video_id": 363, "time_stamp_s": 360, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0f2dc81ca2a97a346cdf57c26f4ee5db2d794c48264547496756292ce6b84a32", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person holds a portafilter with coffee grounds, positioning it under an espresso machine's group head.  \n- They insert the portafilter into the machine, then remove it after extraction, revealing a used filter basket.  \n- The person then places the used filter basket into a sink or waste container, with various coffee-making tools visible nearby.\n[30-60s] - Person pours coffee grounds into a portafilter using a scoop, then places it on the espresso machine's group head.  \n- The espresso machine's digital display shows \"0.00\" as the person prepares to tare the scale.  \n- A digital scale is positioned on the counter, displaying \"0.00 g\" before the person begins weighing coffee.\n[60-90s] - Person holds a small cup with coffee grounds on a digital scale, adjusting the cup's position slightly.  \n- The scale displays a weight reading of approximately 18.2 grams, indicating precise measurement.  \n- The person’s hands are positioned near a coffee machine, suggesting preparation for brewing.\n[90-120s] - Barista hands pour espresso into a glass cup while holding a metal portafilter.  \n- Two glasses with creamy liquid and a small cup of espresso are placed on the counter.  \n- A person in a white shirt is visible in the background, observing the coffee preparation.\n[120-150s] - Hand inserts a white plastic straw into a clear plastic cup containing a dark liquid.  \n- Another hand holds a small metal portafilter with coffee grounds, positioned near the espresso machine's spout.  \n- A second clear cup with a similar dark liquid is visible on the counter, slightly to the right of the first cup.\n[150-180s] - Hand holds a clear glass with yellow liquid, positioned near espresso machine's drip tray.  \n- Another hand places a metal portafilter into the machine's group head, preparing for extraction.  \n- A second glass with yellow liquid is visible on the counter, suggesting multiple drinks are being prepared.\n[180-210s] - A hand holds a glass with a yellow liquid, then pours orange liquid from a pitcher into it.  \n- Another hand reaches for a carton of milk, then pours it into the glass.  \n- The glass is placed on a metal tray near a coffee machine.\n[210-240s] - A hand stirs a glass of amber liquid with a spoon, then pours it into a clear plastic cup.  \n- The pouring action is performed over a metal drip tray, with another glass of similar liquid already on the tray.  \n- A ring is visible on the finger holding the glass, and a second hand reaches toward the cup after pouring.\n[240-270s] - Hand holds a clear plastic straw, inserting it into a glass containing a light brown liquid.  \n- The glass is placed on a metal gridded surface, likely a coffee machine's drip tray.  \n- A digital scale is visible nearby, showing a reading of \"0.00\", suggesting preparation for weighing ingredients.\n[270-300s] - Person pours water from a clear pitcher into a metal milk frothing pitcher.  \n- They then place the pitcher under a coffee machine's steam wand, preparing to froth milk.  \n- A digital scale and various coffee-related items are visible on the counter nearby.\n[300-330s] - A hand opens a drawer to retrieve a small container, then places it on a counter next to a digital scale.  \n- The scale displays a weight reading of 2.08 grams as a spoon is used to measure coffee grounds.  \n- A wooden tray is presented with a glass teapot, a small ceramic cup, and a glass of water, being carried toward an outdoor seating area.\n[330-360s] - A person in a dark shirt holds a phone while seated at a table with food items nearby.  \n- Another person in a white shirt hands a small object (possibly a utensil or tool) to the first person.  \n- The first person then reaches for a coffee machine, indicating interaction with kitchen equipment.", "history_tokens": 891, "history_utf8_bytes": 3765, "recent_frame_times_s": [330.0103515625, 331.0103515625, 332.0103515625, 333.0103515625, 334.0103515625, 335.0103515625, 336.0103515625, 337.0103515625, 338.0103515625, 339.0103515625, 340.0103515625, 341.0103515625, 342.0103515625, 343.0103515625, 344.0103515625, 345.0103515625, 346.0103515625, 347.0103515625, 348.0103515625, 349.0103515625, 350.0103515625, 351.0103515625, 352.0103515625, 353.0103515625, 354.0103515625, 355.0103515625, 356.0103515625, 357.0103515625, 358.0103515625, 359.0103515625], "recent_frames_sha256": "6af7d34091a4d3e99e9244f9f85a71df657e902d87c7054a663e1140c1ecf9c4", "num_recent_frames": 30, "tq": 718534.598364715, "t1": 718536.296207599, "ta": 718536.296207599, "te": 718536.337138616, "first_response_s": 1.6978428839938715, "answer_total_s": 1.73877390101552, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 363, "content_group": "3769e95476be930ddf3d21c8f3858342470ec038dee832b3042ffb0e905e8b4c", "question": {"question_id": "sample_363_a1948_q0", "video_id": 363, "video_path": "./videos/sample_363_real.mp4", "annotation_index": 1948, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual cleaned up spilled milk and put milk containers back in the refrigerator.", "B. The individual brewed three cups of coffee, and disposed of used coffee grounds.", "C. The individual cleaned the coffee machine and arranged the cups neatly on the counter.", "D. The individual brewed a fresh pot of coffee and added sugar and milk before serving it."], "answer": "B", "time_stamp_s": 486, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [476, 486], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_363_a1948_q0", "video_id": 363, "time_stamp_s": 486, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "897c93697449fc6782fbe7ec9474a759b3a3bbbe2e1a3322fc92b279011beb83", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [456.0103515625, 457.0103515625, 458.0103515625, 459.0103515625, 460.0103515625, 461.0103515625, 462.0103515625, 463.0103515625, 464.0103515625, 465.0103515625, 466.0103515625, 467.0103515625, 468.0103515625, 469.0103515625, 470.0103515625, 471.0103515625, 472.0103515625, 473.0103515625, 474.0103515625, 475.0103515625, 476.0103515625, 477.0103515625, 478.0103515625, 479.0103515625, 480.0103515625, 481.0103515625, 482.0103515625, 483.0103515625, 484.0103515625, 485.0103515625], "recent_frames_sha256": "cf5bb05132c19d56fee9472f620842b74a2d1bdb8a808297dc77111d1db759df", "num_recent_frames": 30, "tq": 718609.191451155, "t1": 718619.020521106, "ta": 718619.020521106, "te": 718619.060111751, "first_response_s": 9.829069950967096, "answer_total_s": 9.868660595966503, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_363_a1948_q0", "video_id": 363, "time_stamp_s": 486, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c0c0e9f0ee1f5e8bb5f6318a7a3dbffc34e5128fdb030927f078bf3346b2f354", "condition_order": ["notes", "recent"], "memory": "[90-120s] - Barista hands pour espresso into a glass cup while holding a metal portafilter.  \n- Two glasses with creamy liquid and a small cup of espresso are placed on the counter.  \n- A person in a white shirt is visible in the background, observing the coffee preparation.\n[120-150s] - Hand inserts a white plastic straw into a clear plastic cup containing a dark liquid.  \n- Another hand holds a small metal portafilter with coffee grounds, positioned near the espresso machine's spout.  \n- A second clear cup with a similar dark liquid is visible on the counter, slightly to the right of the first cup.\n[150-180s] - Hand holds a clear glass with yellow liquid, positioned near espresso machine's drip tray.  \n- Another hand places a metal portafilter into the machine's group head, preparing for extraction.  \n- A second glass with yellow liquid is visible on the counter, suggesting multiple drinks are being prepared.\n[180-210s] - A hand holds a glass with a yellow liquid, then pours orange liquid from a pitcher into it.  \n- Another hand reaches for a carton of milk, then pours it into the glass.  \n- The glass is placed on a metal tray near a coffee machine.\n[210-240s] - A hand stirs a glass of amber liquid with a spoon, then pours it into a clear plastic cup.  \n- The pouring action is performed over a metal drip tray, with another glass of similar liquid already on the tray.  \n- A ring is visible on the finger holding the glass, and a second hand reaches toward the cup after pouring.\n[240-270s] - Hand holds a clear plastic straw, inserting it into a glass containing a light brown liquid.  \n- The glass is placed on a metal gridded surface, likely a coffee machine's drip tray.  \n- A digital scale is visible nearby, showing a reading of \"0.00\", suggesting preparation for weighing ingredients.\n[270-300s] - Person pours water from a clear pitcher into a metal milk frothing pitcher.  \n- They then place the pitcher under a coffee machine's steam wand, preparing to froth milk.  \n- A digital scale and various coffee-related items are visible on the counter nearby.\n[300-330s] - A hand opens a drawer to retrieve a small container, then places it on a counter next to a digital scale.  \n- The scale displays a weight reading of 2.08 grams as a spoon is used to measure coffee grounds.  \n- A wooden tray is presented with a glass teapot, a small ceramic cup, and a glass of water, being carried toward an outdoor seating area.\n[330-360s] - A person in a dark shirt holds a phone while seated at a table with food items nearby.  \n- Another person in a white shirt hands a small object (possibly a utensil or tool) to the first person.  \n- The first person then reaches for a coffee machine, indicating interaction with kitchen equipment.\n[360-390s] - Person places a coffee portafilter on a scale, adjusting its position to ensure proper alignment.  \n- Coffee grounds are measured and placed into the portafilter, with the scale indicating weight.  \n- The portafilter is then secured onto the espresso machine's group head, preparing for extraction.\n[390-420s] - Person holds a portafilter with ground coffee, preparing to tare the scale.  \n- Scale displays \"502g\" as coffee is measured, then the person removes the portafilter.  \n- Coffee grounds are transferred to a metal tray, and the person adjusts the scale to zero.\n[420-450s] - Hand holds portafilter with coffee grounds, placing it on a digital scale showing 502.1g.  \n- Another hand reaches for a container of coffee beans, preparing to add more to the portafilter.  \n- A small container of coffee grounds is visible on the counter, near a coffee machine and utensils.\n[450-480s] - Hand places a ceramic cup on the espresso machine's portafilter holder, preparing for extraction.  \n- Digital scale displays \"0.00\" as the person adjusts the cup position, indicating readiness for weighing or measurement.  \n- Espresso machine's portafilter is positioned on the gridded metal tray, with a hand nearby holding a small container, likely for coffee grounds or water.", "history_tokens": 974, "history_utf8_bytes": 4039, "recent_frame_times_s": [456.0103515625, 457.0103515625, 458.0103515625, 459.0103515625, 460.0103515625, 461.0103515625, 462.0103515625, 463.0103515625, 464.0103515625, 465.0103515625, 466.0103515625, 467.0103515625, 468.0103515625, 469.0103515625, 470.0103515625, 471.0103515625, 472.0103515625, 473.0103515625, 474.0103515625, 475.0103515625, 476.0103515625, 477.0103515625, 478.0103515625, 479.0103515625, 480.0103515625, 481.0103515625, 482.0103515625, 483.0103515625, 484.0103515625, 485.0103515625], "recent_frames_sha256": "cf5bb05132c19d56fee9472f620842b74a2d1bdb8a808297dc77111d1db759df", "num_recent_frames": 30, "tq": 718565.356764689, "t1": 718567.490237637, "ta": 718567.490237637, "te": 718567.527613279, "first_response_s": 2.133472947985865, "answer_total_s": 2.170848589972593, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 364, "content_group": "691579ebaf1b0bc9bddeefbf45433072b902fbd13bfd52b49833455eaf1ae152", "question": {"question_id": "sample_364_a1041_q0", "video_id": 364, "video_path": "./videos/sample_364_real.mp4", "annotation_index": 1041, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual poured milk into a cup, stirred it, and then took it to the customer.", "B. The individual brewed a pot of tea, poured it into a thermal flask, and brought it to a table.", "C. The individual finished preparing a latte, placed it alongside a black coffee.", "D. The individual selected pastries from a display case, packed them in a box, and handed them to a customer."], "answer": "C", "time_stamp_s": 8, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_364_a1041_q0", "video_id": 364, "time_stamp_s": 8, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "02d26ff98fe13681271604f109637c0dbd1cfbc623824d3338d0bedbfcd0b471", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.030989583333333334, 1.0143229166666667, 2.0143229166666665, 3.0143229166666665, 4.014322916666667, 5.014322916666667, 6.014322916666667, 7.014322916666667], "recent_frames_sha256": "0098b3a632fa40df4f9ee030867deb0b2faa4d5a4451d35ae54b1999a84de29a", "num_recent_frames": 8, "tq": 718997.257438467, "t1": 718998.327208059, "ta": 718998.327208059, "te": 718998.365394765, "first_response_s": 1.069769592024386, "answer_total_s": 1.1079562980448827, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_364_a1041_q0", "video_id": 364, "time_stamp_s": 8, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a11538d330fead1b990b750d891951399fcc5ade00e669d807c2f746b64e8f5d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.030989583333333334, 1.0143229166666667, 2.0143229166666665, 3.0143229166666665, 4.014322916666667, 5.014322916666667, 6.014322916666667, 7.014322916666667], "recent_frames_sha256": "0098b3a632fa40df4f9ee030867deb0b2faa4d5a4451d35ae54b1999a84de29a", "num_recent_frames": 8, "tq": 719046.383694434, "t1": 719088.45020565, "ta": 719088.45020565, "te": 719088.675114509, "first_response_s": 42.06651121599134, "answer_total_s": 42.291420074994676, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 364, "content_group": "691579ebaf1b0bc9bddeefbf45433072b902fbd13bfd52b49833455eaf1ae152", "question": {"question_id": "sample_364_a1042_q0", "video_id": 364, "video_path": "./videos/sample_364_real.mp4", "annotation_index": 1042, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual checked order status on a tablet, cleaned a countertop area, and served a sandwich.", "B. The individual prepare matcha, carried the matcha to a sink, and then checked order details on a tablet.", "C. The individual brewed coffee, poured it into a cup, and then prepared a latte with milk.", "D. The individual selected utensils, eco-certified cleaning solutions, and organized a storage area."], "answer": "B", "time_stamp_s": 184, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [174, 184], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_364_a1042_q0", "video_id": 364, "time_stamp_s": 184, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "689a7b54abfbf1ac1f6669e71f76f2e77d9703abac49bbd7c420f15c6e4333b2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [154.01432291666666, 155.01432291666666, 156.01432291666666, 157.01432291666666, 158.01432291666666, 159.01432291666666, 160.01432291666666, 161.01432291666666, 162.01432291666666, 163.01432291666666, 164.01432291666666, 165.01432291666666, 166.01432291666666, 167.01432291666666, 168.01432291666666, 169.01432291666666, 170.01432291666666, 171.01432291666666, 172.01432291666666, 173.01432291666666, 174.01432291666666, 175.01432291666666, 176.01432291666666, 177.01432291666666, 178.01432291666666, 179.01432291666666, 180.01432291666666, 181.01432291666666, 182.01432291666666, 183.01432291666666], "recent_frames_sha256": "ceb1878384b6b1ee10f89830c96b8c6708c2ed3cee8c834d3a9f8664ba8b3790", "num_recent_frames": 30, "tq": 718998.395590593, "t1": 719006.390497056, "ta": 719006.390497056, "te": 719006.428503736, "first_response_s": 7.994906462961808, "answer_total_s": 8.032913143048063, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_364_a1042_q0", "video_id": 364, "time_stamp_s": 184, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "446e3fef402e03cc2a408be207131a0d7b9871bb50e4f1f8cd7d128c9c8a6105", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hand holds a small cup with latte art, moving it toward a coffee machine's steam wand.  \n- Hand pours coffee from a white bottle into a portafilter, which is placed on a digital scale showing 60g.  \n- Coffee machine and various tools (e.g., milk frother, tongs) are visible on the counter, with a stack of paper cups nearby.\n[30-60s] - Hands use a spoon to stir a brown substance in a small glass container, with a digital scale showing 98.5g nearby.  \n- A clear glass is picked up and held, then placed on a counter next to a coffee machine and other kitchen tools.  \n- A hand interacts with a digital display on a coffee machine, likely adjusting settings, while holding the glass container.\n[60-90s] - Person holds a clear glass and pours a white liquid (likely milk) into it from a container.  \n- A blue plastic scoop is used to transfer a white powdery substance (possibly sugar or creamer) into the glass.  \n- The glass is placed on a countertop next to a digital scale displaying \"385\" and a small cup with a spoon.\n[90-120s] - Hands hold a glass with a creamy beverage, then place it on a counter near coffee-making equipment.  \n- A small, round, dark-colored cup is picked up and held, showing a latte art design.  \n- The counter area includes various coffee tools, a digital scale, and a white jug, with a person seated in the background.\n[120-150s] - Hand holds a small clear glass, moving it toward a yellow cart with a metal rack.  \n- A black coffee machine is visible to the left, with a white container and various cups nearby.  \n- The hand places the glass on a metal rack, then picks up a small metal cup from the same rack.\n[150-180s] - A hand holds a small metal cup over a digital scale, which displays \"0.0\" as the weight resets.  \n- The hand then scoops green powder from a jar using a spoon and transfers it into the cup.  \n- The cup is lifted off the scale after being filled, showing the green powder inside.", "history_tokens": 490, "history_utf8_bytes": 1943, "recent_frame_times_s": [154.01432291666666, 155.01432291666666, 156.01432291666666, 157.01432291666666, 158.01432291666666, 159.01432291666666, 160.01432291666666, 161.01432291666666, 162.01432291666666, 163.01432291666666, 164.01432291666666, 165.01432291666666, 166.01432291666666, 167.01432291666666, 168.01432291666666, 169.01432291666666, 170.01432291666666, 171.01432291666666, 172.01432291666666, 173.01432291666666, 174.01432291666666, 175.01432291666666, 176.01432291666666, 177.01432291666666, 178.01432291666666, 179.01432291666666, 180.01432291666666, 181.01432291666666, 182.01432291666666, 183.01432291666666], "recent_frames_sha256": "ceb1878384b6b1ee10f89830c96b8c6708c2ed3cee8c834d3a9f8664ba8b3790", "num_recent_frames": 30, "tq": 719129.881335977, "t1": 719131.334933819, "ta": 719131.334933819, "te": 719131.372820489, "first_response_s": 1.4535978420171887, "answer_total_s": 1.4914845119928941, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 364, "content_group": "691579ebaf1b0bc9bddeefbf45433072b902fbd13bfd52b49833455eaf1ae152", "question": {"question_id": "sample_364_a1043_q0", "video_id": 364, "video_path": "./videos/sample_364_real.mp4", "annotation_index": 1043, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual selected tea leaves, boiled water, and brewed a fresh pot of tea.", "B. The individual poured milk into a metal jug, steamed the milk, and prepared it for use.", "C. The individual prepared an espresso shot, added steamed milk, and created latte art.", "D. The individual grabbed utensils, washed them, and organized them on a drying rack."], "answer": "B", "time_stamp_s": 358, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [348, 358], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_364_a1043_q0", "video_id": 364, "time_stamp_s": 358, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c462ce3cf7de232b4508d8c0871c00d0d81375303bbaecd04ba501efffdadc02", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [328.0143229166667, 329.0143229166667, 330.0143229166667, 331.0143229166667, 332.0143229166667, 333.0143229166667, 334.0143229166667, 335.0143229166667, 336.0143229166667, 337.0143229166667, 338.0143229166667, 339.0143229166667, 340.0143229166667, 341.0143229166667, 342.0143229166667, 343.0143229166667, 344.0143229166667, 345.0143229166667, 346.0143229166667, 347.0143229166667, 348.0143229166667, 349.0143229166667, 350.0143229166667, 351.0143229166667, 352.0143229166667, 353.0143229166667, 354.0143229166667, 355.0143229166667, 356.0143229166667, 357.0143229166667], "recent_frames_sha256": "664d35b62c239cb48a92c216c53dc689bbae3f24dc5cb4cbb06e2d3a0c1d4491", "num_recent_frames": 30, "tq": 719006.447600049, "t1": 719019.316975786, "ta": 719019.316975786, "te": 719019.355246354, "first_response_s": 12.869375737034716, "answer_total_s": 12.907646305044182, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_364_a1043_q0", "video_id": 364, "time_stamp_s": 358, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "92b657bb3f63149d4bdefc78caf8bb5e0610f8bef3f18d18740a891e72256b28", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hand holds a small cup with latte art, moving it toward a coffee machine's steam wand.  \n- Hand pours coffee from a white bottle into a portafilter, which is placed on a digital scale showing 60g.  \n- Coffee machine and various tools (e.g., milk frother, tongs) are visible on the counter, with a stack of paper cups nearby.\n[30-60s] - Hands use a spoon to stir a brown substance in a small glass container, with a digital scale showing 98.5g nearby.  \n- A clear glass is picked up and held, then placed on a counter next to a coffee machine and other kitchen tools.  \n- A hand interacts with a digital display on a coffee machine, likely adjusting settings, while holding the glass container.\n[60-90s] - Person holds a clear glass and pours a white liquid (likely milk) into it from a container.  \n- A blue plastic scoop is used to transfer a white powdery substance (possibly sugar or creamer) into the glass.  \n- The glass is placed on a countertop next to a digital scale displaying \"385\" and a small cup with a spoon.\n[90-120s] - Hands hold a glass with a creamy beverage, then place it on a counter near coffee-making equipment.  \n- A small, round, dark-colored cup is picked up and held, showing a latte art design.  \n- The counter area includes various coffee tools, a digital scale, and a white jug, with a person seated in the background.\n[120-150s] - Hand holds a small clear glass, moving it toward a yellow cart with a metal rack.  \n- A black coffee machine is visible to the left, with a white container and various cups nearby.  \n- The hand places the glass on a metal rack, then picks up a small metal cup from the same rack.\n[150-180s] - A hand holds a small metal cup over a digital scale, which displays \"0.0\" as the weight resets.  \n- The hand then scoops green powder from a jar using a spoon and transfers it into the cup.  \n- The cup is lifted off the scale after being filled, showing the green powder inside.\n[180-210s] - Hand interacts with tablet screen displaying coffee machine interface, likely adjusting settings.  \n- Coffee grounds are measured and placed into a portafilter, then tamped.  \n- Portafilter is positioned under the espresso machine's group head, ready for extraction.\n[210-240s] - Hand pours coffee grounds into a portafilter on a digital scale, which displays \"13\" grams.  \n- Another hand holds a metal scoop, transferring grounds from a container into the portafilter.  \n- The portafilter is then attached to an espresso machine's group head, with a steam wand visible nearby.\n[240-270s] - Person holds a metal portafilter with a brown cloth, preparing to use it with a coffee machine.  \n- Coffee machine is visible with a digital display and various tools on the counter nearby.  \n- Another person in white attire is seen in the background, holding a blue object, possibly a container or tool.\n[270-300s] - Hands adjust a portafilter on a coffee machine, with the machine's digital display showing operational status.  \n- A digital scale holds a small cup of ground coffee, indicating precise measurement.  \n- The coffee machine's portafilter is inserted into the machine, preparing for brewing.\n[300-330s] - Barista holds a portafilter with ground coffee, preparing to tamping it.  \n- Coffee machine's group head is visible, with a digital display showing \"0:00\" as the timer resets.  \n- Barista moves the portafilter toward the espresso machine's group head, positioning it for extraction.", "history_tokens": 847, "history_utf8_bytes": 3450, "recent_frame_times_s": [328.0143229166667, 329.0143229166667, 330.0143229166667, 331.0143229166667, 332.0143229166667, 333.0143229166667, 334.0143229166667, 335.0143229166667, 336.0143229166667, 337.0143229166667, 338.0143229166667, 339.0143229166667, 340.0143229166667, 341.0143229166667, 342.0143229166667, 343.0143229166667, 344.0143229166667, 345.0143229166667, 346.0143229166667, 347.0143229166667, 348.0143229166667, 349.0143229166667, 350.0143229166667, 351.0143229166667, 352.0143229166667, 353.0143229166667, 354.0143229166667, 355.0143229166667, 356.0143229166667, 357.0143229166667], "recent_frames_sha256": "664d35b62c239cb48a92c216c53dc689bbae3f24dc5cb4cbb06e2d3a0c1d4491", "num_recent_frames": 30, "tq": 719176.228141823, "t1": 719178.228163334, "ta": 719178.228163334, "te": 719178.267583976, "first_response_s": 2.0000215109903365, "answer_total_s": 2.0394421530654654, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 364, "content_group": "691579ebaf1b0bc9bddeefbf45433072b902fbd13bfd52b49833455eaf1ae152", "question": {"question_id": "sample_364_a1044_q0", "video_id": 364, "video_path": "./videos/sample_364_real.mp4", "annotation_index": 1044, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual filled a cup with hot water, steeped a tea bag, and served the tea to a customer.", "B. The individual poured milk into a container, steamed it, and cleaned the workstation with a cloth.", "C. The individual brewed a pot of coffee, poured it into multiple cups, and served it to customers.", "D. The individual mixed various ingredients into a jug, prepared a smoothie, and cleaned the blender."], "answer": "B", "time_stamp_s": 531, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [522, 532], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_364_a1044_q0", "video_id": 364, "time_stamp_s": 531, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2b76c42e0db8b38f43cedbaa5fbe592b1f77b8f58cab33d9d73859926838460b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [501.0143229166667, 502.0143229166667, 503.0143229166667, 504.0143229166667, 505.0143229166667, 506.0143229166667, 507.0143229166667, 508.0143229166667, 509.0143229166667, 510.0143229166667, 511.0143229166667, 512.0143229166666, 513.0143229166666, 514.0143229166666, 515.0143229166666, 516.0143229166666, 517.0143229166666, 518.0143229166666, 519.0143229166666, 520.0143229166666, 521.0143229166666, 522.0143229166666, 523.0143229166666, 524.0143229166666, 525.0143229166666, 526.0143229166666, 527.0143229166666, 528.0143229166666, 529.0143229166666, 530.0143229166666], "recent_frames_sha256": "5ab77b6794ec8d2ae3ac00bfaeea14fad7b76933e26ed3d07ae36c2e6006b1ad", "num_recent_frames": 30, "tq": 719019.372174999, "t1": 719034.532677797, "ta": 719034.532677797, "te": 719034.569701575, "first_response_s": 15.160502798040397, "answer_total_s": 15.197526575997472, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_364_a1044_q0", "video_id": 364, "time_stamp_s": 531, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a8efbaf4e575cae6dd702918a2cdbbc5ee572217410e1d36f0e4b733789b783a", "condition_order": ["recent", "notes"], "memory": "[120-150s] - Hand holds a small clear glass, moving it toward a yellow cart with a metal rack.  \n- A black coffee machine is visible to the left, with a white container and various cups nearby.  \n- The hand places the glass on a metal rack, then picks up a small metal cup from the same rack.\n[150-180s] - A hand holds a small metal cup over a digital scale, which displays \"0.0\" as the weight resets.  \n- The hand then scoops green powder from a jar using a spoon and transfers it into the cup.  \n- The cup is lifted off the scale after being filled, showing the green powder inside.\n[180-210s] - Hand interacts with tablet screen displaying coffee machine interface, likely adjusting settings.  \n- Coffee grounds are measured and placed into a portafilter, then tamped.  \n- Portafilter is positioned under the espresso machine's group head, ready for extraction.\n[210-240s] - Hand pours coffee grounds into a portafilter on a digital scale, which displays \"13\" grams.  \n- Another hand holds a metal scoop, transferring grounds from a container into the portafilter.  \n- The portafilter is then attached to an espresso machine's group head, with a steam wand visible nearby.\n[240-270s] - Person holds a metal portafilter with a brown cloth, preparing to use it with a coffee machine.  \n- Coffee machine is visible with a digital display and various tools on the counter nearby.  \n- Another person in white attire is seen in the background, holding a blue object, possibly a container or tool.\n[270-300s] - Hands adjust a portafilter on a coffee machine, with the machine's digital display showing operational status.  \n- A digital scale holds a small cup of ground coffee, indicating precise measurement.  \n- The coffee machine's portafilter is inserted into the machine, preparing for brewing.\n[300-330s] - Barista holds a portafilter with ground coffee, preparing to tamping it.  \n- Coffee machine's group head is visible, with a digital display showing \"0:00\" as the timer resets.  \n- Barista moves the portafilter toward the espresso machine's group head, positioning it for extraction.\n[330-360s] - A hand holds a yellow-handled milk frother near a coffee machine's steam wand, preparing to froth milk.  \n- Another person in a white shirt stands nearby, holding a coffee cup and a spoon, seemingly waiting for the milk frothing.  \n- The frother is positioned under the steam wand, indicating the start of the frothing process.\n[360-390s] - Hands hold a stainless steel pitcher under a faucet, filling it with water while a yellow cloth is used to wipe the spout.  \n- A stack of brown paper cups sits on a tray to the left, and a digital scale is visible on the counter.  \n- The pitcher is then moved away from the faucet and placed on the counter, with the yellow cloth still in hand.\n[390-420s] - Hand pours steamed milk into a paper cup, creating latte art.  \n- A small white container is picked up and placed on a counter.  \n- A black coffee machine is visible with a digital display showing \"55\".\n[420-450s] - Person holds a portafilter with coffee grounds, placing it on a digital scale showing 19.0g.\n- They use a spoon to adjust the coffee level in the portafilter, ensuring proper fill.\n- The scale's display updates to 19.0g as the person prepares the coffee for brewing.\n[450-480s] - Hand places a portafilter with coffee grounds into an espresso machine's group head.  \n- A digital scale is used to measure coffee grounds, then the portafilter is removed from the scale.  \n- The hand moves the portafilter to a metal drip tray, preparing for espresso extraction.\n[480-510s] - Hand holds a metal portafilter with a coffee puck, positioned near a digital scale showing \"0.00\".  \n- Another hand places a white paper cup on the counter, then picks up a yellow-handled tool (possibly a tamper or scoop).  \n- The portafilter is moved toward a coffee machine's group head, suggesting preparation for brewing.", "history_tokens": 969, "history_utf8_bytes": 3918, "recent_frame_times_s": [501.0143229166667, 502.0143229166667, 503.0143229166667, 504.0143229166667, 505.0143229166667, 506.0143229166667, 507.0143229166667, 508.0143229166667, 509.0143229166667, 510.0143229166667, 511.0143229166667, 512.0143229166666, 513.0143229166666, 514.0143229166666, 515.0143229166666, 516.0143229166666, 517.0143229166666, 518.0143229166666, 519.0143229166666, 520.0143229166666, 521.0143229166666, 522.0143229166666, 523.0143229166666, 524.0143229166666, 525.0143229166666, 526.0143229166666, 527.0143229166666, 528.0143229166666, 529.0143229166666, 530.0143229166666], "recent_frames_sha256": "5ab77b6794ec8d2ae3ac00bfaeea14fad7b76933e26ed3d07ae36c2e6006b1ad", "num_recent_frames": 30, "tq": 719230.388742963, "t1": 719232.678683315, "ta": 719232.678683315, "te": 719232.716851359, "first_response_s": 2.289940352085978, "answer_total_s": 2.328108396031894, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 364, "content_group": "691579ebaf1b0bc9bddeefbf45433072b902fbd13bfd52b49833455eaf1ae152", "question": {"question_id": "sample_364_a1045_q0", "video_id": 364, "video_path": "./videos/sample_364_real.mp4", "annotation_index": 1045, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual poured hot water into a cup, steeped the tea, and served it.", "B. The individual weighed matcha powder.", "C. The individual mixed chocolate powder into a glass and added hot milk.", "D. The individual cleaned the workspace with a cloth and disposed of the trash."], "answer": "B", "time_stamp_s": 706, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [696, 706], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_364_a1045_q0", "video_id": 364, "time_stamp_s": 706, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e37a5f3be370155a456f81f1050441cbaac5bc07434f031447b54fd1fa40e0fe", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [676.0143229166666, 677.0143229166666, 678.0143229166666, 679.0143229166666, 680.0143229166666, 681.0143229166666, 682.0143229166666, 683.0143229166666, 684.0143229166666, 685.0143229166666, 686.0143229166666, 687.0143229166666, 688.0143229166666, 689.0143229166666, 690.0143229166666, 691.0143229166666, 692.0143229166666, 693.0143229166666, 694.0143229166666, 695.0143229166666, 696.0143229166666, 697.0143229166666, 698.0143229166666, 699.0143229166666, 700.0143229166666, 701.0143229166666, 702.0143229166666, 703.0143229166666, 704.0143229166666, 705.0143229166666], "recent_frames_sha256": "930bbd2d9db4906134ed78d6dd1c7da2f1bef3fc57b14b234103d4222e9f057e", "num_recent_frames": 30, "tq": 719034.589964725, "t1": 719046.337429882, "ta": 719046.337429882, "te": 719046.374654269, "first_response_s": 11.747465157066472, "answer_total_s": 11.784689544001594, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_364_a1045_q0", "video_id": 364, "time_stamp_s": 706, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ef6c84b5ac937c035b87ca28e2b2bcb38e7b31eb4ab43a21b255dada374945fb", "condition_order": ["recent", "notes"], "memory": "[300-330s] - Barista holds a portafilter with ground coffee, preparing to tamping it.  \n- Coffee machine's group head is visible, with a digital display showing \"0:00\" as the timer resets.  \n- Barista moves the portafilter toward the espresso machine's group head, positioning it for extraction.\n[330-360s] - A hand holds a yellow-handled milk frother near a coffee machine's steam wand, preparing to froth milk.  \n- Another person in a white shirt stands nearby, holding a coffee cup and a spoon, seemingly waiting for the milk frothing.  \n- The frother is positioned under the steam wand, indicating the start of the frothing process.\n[360-390s] - Hands hold a stainless steel pitcher under a faucet, filling it with water while a yellow cloth is used to wipe the spout.  \n- A stack of brown paper cups sits on a tray to the left, and a digital scale is visible on the counter.  \n- The pitcher is then moved away from the faucet and placed on the counter, with the yellow cloth still in hand.\n[390-420s] - Hand pours steamed milk into a paper cup, creating latte art.  \n- A small white container is picked up and placed on a counter.  \n- A black coffee machine is visible with a digital display showing \"55\".\n[420-450s] - Person holds a portafilter with coffee grounds, placing it on a digital scale showing 19.0g.\n- They use a spoon to adjust the coffee level in the portafilter, ensuring proper fill.\n- The scale's display updates to 19.0g as the person prepares the coffee for brewing.\n[450-480s] - Hand places a portafilter with coffee grounds into an espresso machine's group head.  \n- A digital scale is used to measure coffee grounds, then the portafilter is removed from the scale.  \n- The hand moves the portafilter to a metal drip tray, preparing for espresso extraction.\n[480-510s] - Hand holds a metal portafilter with a coffee puck, positioned near a digital scale showing \"0.00\".  \n- Another hand places a white paper cup on the counter, then picks up a yellow-handled tool (possibly a tamper or scoop).  \n- The portafilter is moved toward a coffee machine's group head, suggesting preparation for brewing.\n[510-540s] - Hands hold a metal pitcher under a chrome tap, filling it with steamed milk.  \n- A small ceramic cup is held in the other hand, positioned to receive the milk.  \n- A blue cloth is used to wipe the tap area after the milk is poured.\n[540-570s] - Hand pours steamed milk into espresso, creating latte art in a dark cup.  \n- Coffee machine's portafilter is inserted into the group head, preparing for extraction.  \n- Two finished lattes are held side by side, showcasing the latte art before being placed on the counter.\n[570-600s] - Hands hold two espresso cups, one with latte art, near a coffee machine and a tray of cups.  \n- A digital scale displays \"5021\" as a hand places a small container on it.  \n- A box labeled \"LVP!\" is visible on the counter, with a hand reaching toward it.\n[600-630s] - A hand places a metal portafilter onto a digital scale, which displays \"502.3\" grams, indicating coffee weight measurement.  \n- The same hand then removes the portafilter from the scale and positions it under the espresso machine's group head.  \n- A small container of ground coffee is visible on the counter, with a spoon resting inside, suggesting preparation for grinding or tamping.\n[630-660s] - A person holds a portafilter with coffee grounds, positioning it under the espresso machine's group head.  \n- Another person stands nearby, observing the coffee preparation process.  \n- The espresso machine's digital display shows \"0.00\" as the brew time or weight, indicating readiness for extraction.\n[660-690s] - A person in a white uniform is seen standing near a coffee machine, holding a small container.  \n- The person places a metal cup on a scale, then adds a green substance from a container into the cup.  \n- The scale displays a weight reading of 60 grams as the green substance is measured.", "history_tokens": 991, "history_utf8_bytes": 3937, "recent_frame_times_s": [676.0143229166666, 677.0143229166666, 678.0143229166666, 679.0143229166666, 680.0143229166666, 681.0143229166666, 682.0143229166666, 683.0143229166666, 684.0143229166666, 685.0143229166666, 686.0143229166666, 687.0143229166666, 688.0143229166666, 689.0143229166666, 690.0143229166666, 691.0143229166666, 692.0143229166666, 693.0143229166666, 694.0143229166666, 695.0143229166666, 696.0143229166666, 697.0143229166666, 698.0143229166666, 699.0143229166666, 700.0143229166666, 701.0143229166666, 702.0143229166666, 703.0143229166666, 704.0143229166666, 705.0143229166666], "recent_frames_sha256": "930bbd2d9db4906134ed78d6dd1c7da2f1bef3fc57b14b234103d4222e9f057e", "num_recent_frames": 30, "tq": 719278.83169114, "t1": 719286.018335262, "ta": 719286.018335262, "te": 719286.327300633, "first_response_s": 7.186644122004509, "answer_total_s": 7.495609492994845, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 365, "content_group": "86b430751ac308a37785423587a038b3db5e251896f815a1c9020ff3c67d744e", "question": {"question_id": "sample_365_a1769_q0", "video_id": 365, "video_path": "./videos/sample_365_real.mp4", "annotation_index": 1769, "question_index": 0, "question": "What action sequence was taken just now by the individual working with the coffee machine?", "options": ["A. The individual brewed tea, added sugar and milk, and served it with biscuits.", "B. The individual prepared an espresso, added whipped cream, and served it in a glass.", "C. The individual brewed coffee, added cream, and stirred it before serving.", "D. The individual operated an espresso machine, brewed a shot of espresso, and pour the milk into a cup."], "answer": "D", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_365_a1769_q0", "video_id": 365, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "29849ba3c816a1acd8eb6f89fb04b1199041735cb018aaff928464a929d32557", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "7f4d0bbc47d44cb933d4d3cd2a0c31a55e81f19181d77c0b2628e4436c23c0fe", "num_recent_frames": 11, "tq": 715929.726088148, "t1": 715930.639161457, "ta": 715930.639161457, "te": 715930.676759459, "first_response_s": 0.9130733089987189, "answer_total_s": 0.9506713110022247, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_365_a1769_q0", "video_id": 365, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8151df40c005e773ec99a91ff4ad30076e024e75bdef6539ed66559fedc1dfb6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "7f4d0bbc47d44cb933d4d3cd2a0c31a55e81f19181d77c0b2628e4436c23c0fe", "num_recent_frames": 11, "tq": 715753.098422265, "t1": 715765.932281693, "ta": 715765.932281693, "te": 715766.303399792, "first_response_s": 12.833859427948482, "answer_total_s": 13.20497752702795, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 365, "content_group": "86b430751ac308a37785423587a038b3db5e251896f815a1c9020ff3c67d744e", "question": {"question_id": "sample_365_a1770_q0", "video_id": 365, "video_path": "./videos/sample_365_real.mp4", "annotation_index": 1770, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now by the barista?", "options": ["A. The barista measured cportafilter, locked the portafilter into the espresso machine, and add coffee grounds into it.", "B. The barista cleaned the espresso machine, prepared the milk pitcher, and steamed milk.", "C. The barista brewed a cup of tea, added lemon, and served it to a customer.", "D. The barista ground coffee beans, prepared a French press, and set it aside to steep."], "answer": "A", "time_stamp_s": 147, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [137, 147], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_365_a1770_q0", "video_id": 365, "time_stamp_s": 147, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6802d8f2abcb030b8ad2c9c33631a52f4ff48716b220b9dea5715cb47517662f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0], "recent_frames_sha256": "fbe43e8e0506c5b9a5bc48569ef583fd40d125c70349e189522f49e596ce8d23", "num_recent_frames": 30, "tq": 715930.703102899, "t1": 715942.759714661, "ta": 715942.759714661, "te": 715942.797306233, "first_response_s": 12.056611762032844, "answer_total_s": 12.094203333952464, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_365_a1770_q0", "video_id": 365, "time_stamp_s": 147, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3b13dfa88e3a3474095582341a10d4c97c3e163da87197973a7b64aecc6a023f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A person in a black shirt opens a drawer and retrieves a metal portafilter, then places it into an espresso machine's group head.  \n- Another person, wearing a suit, pours hot water from a kettle into a white ceramic cup, then places a saucer over the cup.  \n- The espresso machine's steam wand is used to froth milk, and the person then places a lid on a cup containing a dark liquid, likely espresso.\n[30-60s] - Barista places a white cup with espresso on a rotating metal tray, then positions it under the espresso machine's group head.  \n- Barista uses a metal tool to adjust the espresso machine's lever, preparing for extraction.  \n- Espresso machine's digital display shows a green indicator, suggesting readiness for brewing.\n[60-90s] - Hand holds a small white paper with text, positioned near a large espresso machine with red buttons and a green display.  \n- Hand uses a metal tool to scoop dark brown coffee grounds from a container into a portafilter, then places the portafilter into the espresso machine.  \n- A pink cloth is visible on the counter, and a small white cup with a dark liquid is placed nearby.\n[90-120s] - Hands use a metal tamper to press coffee grounds in a portafilter, then place it on a digital scale for weighing.  \n- The portafilter is inserted into an espresso machine's group head, with a red cloth nearby on the machine's drip tray.  \n- A metal scoop is used to transfer coffee grounds into the portafilter, followed by securing the portafilter onto the machine.", "history_tokens": 351, "history_utf8_bytes": 1511, "recent_frame_times_s": [118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0], "recent_frames_sha256": "fbe43e8e0506c5b9a5bc48569ef583fd40d125c70349e189522f49e596ce8d23", "num_recent_frames": 30, "tq": 715796.743123662, "t1": 715804.318693306, "ta": 715804.318693306, "te": 715804.508195709, "first_response_s": 7.575569643988274, "answer_total_s": 7.765072047011927, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 365, "content_group": "86b430751ac308a37785423587a038b3db5e251896f815a1c9020ff3c67d744e", "question": {"question_id": "sample_365_a1771_q0", "video_id": 365, "video_path": "./videos/sample_365_real.mp4", "annotation_index": 1771, "question_index": 0, "question": "What sequence of actions did the barista perform just now with the steamed milk?", "options": ["A. The barista poured milk into a cup, cleaned the espresso machine, and prepared a new cup.", "B. The barista steamed the milk, wiped the steam wand, and placed the milk pitcher down.", "C. The barista brewed coffee, steamed milk, and added sugar to the cup.", "D. The barista measured milk, adjusted the machine settings, and poured the milk into a new pot."], "answer": "B", "time_stamp_s": 283, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [274, 284], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_365_a1771_q0", "video_id": 365, "time_stamp_s": 283, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "04ffad07730fe8da048eea0b04566f4dc977c6ce9a9f9ddf88d371dab887a6d3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0], "recent_frames_sha256": "fc8b28a501249f44d9af36f72e167e193e190c9930a65aea6a9b2dca3eb13851", "num_recent_frames": 30, "tq": 715942.813939806, "t1": 715953.1303115, "ta": 715953.1303115, "te": 715953.16821528, "first_response_s": 10.316371694090776, "answer_total_s": 10.354275474091992, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_365_a1771_q0", "video_id": 365, "time_stamp_s": 283, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "65a81f7b737c30dc3f6c9b79aa4a900c24118b7544779061c612af8ea92ff6ba", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A person in a black shirt opens a drawer and retrieves a metal portafilter, then places it into an espresso machine's group head.  \n- Another person, wearing a suit, pours hot water from a kettle into a white ceramic cup, then places a saucer over the cup.  \n- The espresso machine's steam wand is used to froth milk, and the person then places a lid on a cup containing a dark liquid, likely espresso.\n[30-60s] - Barista places a white cup with espresso on a rotating metal tray, then positions it under the espresso machine's group head.  \n- Barista uses a metal tool to adjust the espresso machine's lever, preparing for extraction.  \n- Espresso machine's digital display shows a green indicator, suggesting readiness for brewing.\n[60-90s] - Hand holds a small white paper with text, positioned near a large espresso machine with red buttons and a green display.  \n- Hand uses a metal tool to scoop dark brown coffee grounds from a container into a portafilter, then places the portafilter into the espresso machine.  \n- A pink cloth is visible on the counter, and a small white cup with a dark liquid is placed nearby.\n[90-120s] - Hands use a metal tamper to press coffee grounds in a portafilter, then place it on a digital scale for weighing.  \n- The portafilter is inserted into an espresso machine's group head, with a red cloth nearby on the machine's drip tray.  \n- A metal scoop is used to transfer coffee grounds into the portafilter, followed by securing the portafilter onto the machine.\n[120-150s] - Hand places a white cup on the espresso machine's portafilter handle, then removes it.  \n- A digital scale is positioned on the counter, with a metal portafilter resting on it.  \n- The espresso machine's steam wand and group head are visible, with a pink cloth nearby.\n[150-180s] - Hand holds a jar of honey, then moves to a scale to measure coffee grounds.  \n- Coffee grounds are poured into a portafilter, which is then placed under the espresso machine's group head.  \n- Scale shows weight of coffee grounds as they are measured and transferred into the portafilter.\n[180-210s] - Person holds a white cup, pouring honey from a bottle labeled \"Raw\" into it.  \n- Another hand places a glass measuring cup near a sink, while a carton of \"Lactaid\" milk is visible nearby.  \n- A metal bowl containing a white powdery substance is being held over the sink, suggesting preparation for mixing.\n[210-240s] - Hand pours water from a measuring cup into a sink, then transfers a small glass container with coffee grounds to a scale.  \n- A hand holds a small glass container with a dark liquid (likely coffee) near a sink, then moves it toward a coffee machine.  \n- A hand places a metal portafilter on a scale, preparing to measure coffee grounds, while another hand holds a small glass container with coffee grounds.\n[240-270s] - Hand holds a portafilter with dark coffee grounds, positioned under the espresso machine's group head.  \n- Another hand uses a metal tamper to press down the coffee grounds in the portafilter.  \n- The portafilter is then inserted into the espresso machine's brewing group head, ready for extraction.", "history_tokens": 745, "history_utf8_bytes": 3146, "recent_frame_times_s": [254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0, 268.0, 269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0], "recent_frames_sha256": "fc8b28a501249f44d9af36f72e167e193e190c9930a65aea6a9b2dca3eb13851", "num_recent_frames": 30, "tq": 715848.027599726, "t1": 715849.805868445, "ta": 715849.805868445, "te": 715850.006745586, "first_response_s": 1.7782687189755961, "answer_total_s": 1.9791458600666374, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 365, "content_group": "86b430751ac308a37785423587a038b3db5e251896f815a1c9020ff3c67d744e", "question": {"question_id": "sample_365_a1772_q0", "video_id": 365, "video_path": "./videos/sample_365_real.mp4", "annotation_index": 1772, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now by the individual with the coffee grinder?", "options": ["A. The individual operated the coffee grinder, collected ground coffee in a metal pitcher, and mixed it with water.", "B. The individual adjusted the coffee grinder settings, and transferred the grounds to a portafilter.", "C. The individual poured whole coffee beans into the grinder, ground them into a container, and stored the container for later use.", "D. The individual set the coffee grinder, filled it with milk, and brewed a latte."], "answer": "B", "time_stamp_s": 420, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [411, 421], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_365_a1772_q0", "video_id": 365, "time_stamp_s": 420, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cc30c776e02afb0f8db8f423a84d4babff19532e19b27498491082e6be274edf", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0], "recent_frames_sha256": "adb60b83a981eb58352b5c1f6ca666c6786963b5dd04c6efc1f3d0a120ae5cf6", "num_recent_frames": 30, "tq": 715953.184265169, "t1": 715959.902661174, "ta": 715959.902661174, "te": 715959.940713461, "first_response_s": 6.718396004987881, "answer_total_s": 6.75644829205703, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_365_a1772_q0", "video_id": 365, "time_stamp_s": 420, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "45994e14954300ec7f5f8f71bbf4fa7f1d40e5083fb784f3e0a21d6ad0d926e5", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Barista places a white cup with espresso on a rotating metal tray, then positions it under the espresso machine's group head.  \n- Barista uses a metal tool to adjust the espresso machine's lever, preparing for extraction.  \n- Espresso machine's digital display shows a green indicator, suggesting readiness for brewing.\n[60-90s] - Hand holds a small white paper with text, positioned near a large espresso machine with red buttons and a green display.  \n- Hand uses a metal tool to scoop dark brown coffee grounds from a container into a portafilter, then places the portafilter into the espresso machine.  \n- A pink cloth is visible on the counter, and a small white cup with a dark liquid is placed nearby.\n[90-120s] - Hands use a metal tamper to press coffee grounds in a portafilter, then place it on a digital scale for weighing.  \n- The portafilter is inserted into an espresso machine's group head, with a red cloth nearby on the machine's drip tray.  \n- A metal scoop is used to transfer coffee grounds into the portafilter, followed by securing the portafilter onto the machine.\n[120-150s] - Hand places a white cup on the espresso machine's portafilter handle, then removes it.  \n- A digital scale is positioned on the counter, with a metal portafilter resting on it.  \n- The espresso machine's steam wand and group head are visible, with a pink cloth nearby.\n[150-180s] - Hand holds a jar of honey, then moves to a scale to measure coffee grounds.  \n- Coffee grounds are poured into a portafilter, which is then placed under the espresso machine's group head.  \n- Scale shows weight of coffee grounds as they are measured and transferred into the portafilter.\n[180-210s] - Person holds a white cup, pouring honey from a bottle labeled \"Raw\" into it.  \n- Another hand places a glass measuring cup near a sink, while a carton of \"Lactaid\" milk is visible nearby.  \n- A metal bowl containing a white powdery substance is being held over the sink, suggesting preparation for mixing.\n[210-240s] - Hand pours water from a measuring cup into a sink, then transfers a small glass container with coffee grounds to a scale.  \n- A hand holds a small glass container with a dark liquid (likely coffee) near a sink, then moves it toward a coffee machine.  \n- A hand places a metal portafilter on a scale, preparing to measure coffee grounds, while another hand holds a small glass container with coffee grounds.\n[240-270s] - Hand holds a portafilter with dark coffee grounds, positioned under the espresso machine's group head.  \n- Another hand uses a metal tamper to press down the coffee grounds in the portafilter.  \n- The portafilter is then inserted into the espresso machine's brewing group head, ready for extraction.\n[270-300s] - Barista pours steamed milk into a coffee cup, creating a latte art design.  \n- The cup is placed on a counter near a digital scale and a circular tray.  \n- A person in the background is partially visible, standing near the counter.\n[300-330s] - Hands rinse a metal cup under running water in a sink.  \n- A white box labeled \"Ly\" is opened and its contents poured into the cup.  \n- The cup is then moved toward an espresso machine, suggesting preparation for brewing.\n[330-360s] - Barista pours steamed milk into a paper cup containing espresso, creating a latte art design.  \n- The barista holds the cup with one hand while pouring with the other, maintaining a steady stream.  \n- The cup is then moved toward a sink area, suggesting preparation for serving or cleaning.\n[360-390s] - Hands place a metal portafilter into an espresso machine's group head, preparing for extraction.  \n- A person holds a white paper cup near the machine, likely to receive the espresso.  \n- The espresso machine's control panel shows red indicator lights, suggesting it is powered on and ready.\n[390-420s] - Person holds a black coffee grinder with a hopper, adjusting its position above a metal cup.  \n- Hands rotate the grinder’s dial to control grind size while keeping the cup below.  \n- Grinder’s hopper is lifted and placed back on the machine, indicating preparation for grinding.", "history_tokens": 978, "history_utf8_bytes": 4119, "recent_frame_times_s": [391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0, 420.0], "recent_frames_sha256": "adb60b83a981eb58352b5c1f6ca666c6786963b5dd04c6efc1f3d0a120ae5cf6", "num_recent_frames": 30, "tq": 715890.060715635, "t1": 715891.64618968, "ta": 715891.64618968, "te": 715892.024500763, "first_response_s": 1.5854740450158715, "answer_total_s": 1.963785128085874, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 365, "content_group": "86b430751ac308a37785423587a038b3db5e251896f815a1c9020ff3c67d744e", "question": {"question_id": "sample_365_a1773_q0", "video_id": 365, "video_path": "./videos/sample_365_real.mp4", "annotation_index": 1773, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now by the individual with the coffee grounds?", "options": ["A. The individual measured coffee grounds, tamped them into a portafilter, and locked it into an espresso machine.", "B. The individual adjusted the grinder settings, measured coffee grounds, and transferred them to a filter.", "C. The individual weighed portafilter, added coffee grounds into a glass container from a portafilter with a spoon.", "D. The individual prepared a batch of coffee grounds, cleaned the countertop, and disposed of extra grounds."], "answer": "C", "time_stamp_s": 558, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [548, 558], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_365_a1773_q0", "video_id": 365, "time_stamp_s": 558, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "430aeeeed342b37c0505c2ef32c63374f720543884b7d148018ad3867c6d72c9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0], "recent_frames_sha256": "c3c30a18cbdf84c391e51411ba13b9ab1db8aad6df02466244d1afe6bd5375d4", "num_recent_frames": 30, "tq": 715959.951719871, "t1": 715971.471530428, "ta": 715971.471530428, "te": 715971.509086628, "first_response_s": 11.519810557016172, "answer_total_s": 11.557366756955162, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_365_a1773_q0", "video_id": 365, "time_stamp_s": 558, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "635c864f907c491561f852e5a505305ec9b825e0abb3470622f5bd52a64f5ba9", "condition_order": ["notes", "recent"], "memory": "[120-150s] - Hand places a white cup on the espresso machine's portafilter handle, then removes it.  \n- A digital scale is positioned on the counter, with a metal portafilter resting on it.  \n- The espresso machine's steam wand and group head are visible, with a pink cloth nearby.\n[150-180s] - Hand holds a jar of honey, then moves to a scale to measure coffee grounds.  \n- Coffee grounds are poured into a portafilter, which is then placed under the espresso machine's group head.  \n- Scale shows weight of coffee grounds as they are measured and transferred into the portafilter.\n[180-210s] - Person holds a white cup, pouring honey from a bottle labeled \"Raw\" into it.  \n- Another hand places a glass measuring cup near a sink, while a carton of \"Lactaid\" milk is visible nearby.  \n- A metal bowl containing a white powdery substance is being held over the sink, suggesting preparation for mixing.\n[210-240s] - Hand pours water from a measuring cup into a sink, then transfers a small glass container with coffee grounds to a scale.  \n- A hand holds a small glass container with a dark liquid (likely coffee) near a sink, then moves it toward a coffee machine.  \n- A hand places a metal portafilter on a scale, preparing to measure coffee grounds, while another hand holds a small glass container with coffee grounds.\n[240-270s] - Hand holds a portafilter with dark coffee grounds, positioned under the espresso machine's group head.  \n- Another hand uses a metal tamper to press down the coffee grounds in the portafilter.  \n- The portafilter is then inserted into the espresso machine's brewing group head, ready for extraction.\n[270-300s] - Barista pours steamed milk into a coffee cup, creating a latte art design.  \n- The cup is placed on a counter near a digital scale and a circular tray.  \n- A person in the background is partially visible, standing near the counter.\n[300-330s] - Hands rinse a metal cup under running water in a sink.  \n- A white box labeled \"Ly\" is opened and its contents poured into the cup.  \n- The cup is then moved toward an espresso machine, suggesting preparation for brewing.\n[330-360s] - Barista pours steamed milk into a paper cup containing espresso, creating a latte art design.  \n- The barista holds the cup with one hand while pouring with the other, maintaining a steady stream.  \n- The cup is then moved toward a sink area, suggesting preparation for serving or cleaning.\n[360-390s] - Hands place a metal portafilter into an espresso machine's group head, preparing for extraction.  \n- A person holds a white paper cup near the machine, likely to receive the espresso.  \n- The espresso machine's control panel shows red indicator lights, suggesting it is powered on and ready.\n[390-420s] - Person holds a black coffee grinder with a hopper, adjusting its position above a metal cup.  \n- Hands rotate the grinder’s dial to control grind size while keeping the cup below.  \n- Grinder’s hopper is lifted and placed back on the machine, indicating preparation for grinding.\n[420-450s] - Hands hold a metal portafilter with ground coffee, positioning it under an espresso machine's group head.  \n- A metal tamper is used to press down the coffee grounds in the portafilter.  \n- The portafilter is inserted into the espresso machine's group head, with the machine's red lights illuminated.\n[450-480s] - Hands hold a pink cloth, wiping a metal espresso machine group head.  \n- A small metal portafilter is picked up and placed into the machine's group head.  \n- The portafilter is secured with a lever, preparing for coffee extraction.\n[480-510s] - Hands hold a metal cup filled with milk, positioned near an espresso machine's steam wand.  \n- A metal spoon is inserted into the milk, stirring it while the cup is held steady.  \n- The espresso machine's steam wand is visible in the background, with a digital scale and pink cloth nearby.\n[510-540s] - Barista pours steamed milk from a metal pitcher into a paper cup containing espresso, creating a latte art design.  \n- The cup is held steady by the barista’s left hand while the right hand controls the milk pour.  \n- The espresso base is visible in the cup, with the milk forming a swirling pattern on top.", "history_tokens": 1015, "history_utf8_bytes": 4205, "recent_frame_times_s": [529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0], "recent_frames_sha256": "c3c30a18cbdf84c391e51411ba13b9ab1db8aad6df02466244d1afe6bd5375d4", "num_recent_frames": 30, "tq": 715922.562858054, "t1": 715929.505013855, "ta": 715929.505013855, "te": 715929.696439998, "first_response_s": 6.942155801109038, "answer_total_s": 7.133581944042817, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 366, "content_group": "7047c02a11e8114c760c870edee8a2290e0f6a7f2cea00181bca80001e5abd84", "question": {"question_id": "sample_366_a1447_q0", "video_id": 366, "video_path": "./videos/sample_366_real.mp4", "annotation_index": 1447, "question_index": 0, "question": "What activity is being performed just now?", "options": ["A. Grinding coffee beans and weighing the ground coffee.", "B. Brewing a pot of tea using loose leaves and boiling water.", "C. Preparing a smoothie with various fruits and a blender.", "D. Making a sandwich with multiple layers of ingredients."], "answer": "A", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_366_a1447_q0", "video_id": 366, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "33e2e00e8ebf8931a74a557f3221155a4df0d207c23e99181e8a6ad290ec93f4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.019010416666666665, 1.00234375, 2.00234375, 3.00234375, 4.00234375, 5.00234375, 6.00234375, 7.00234375, 8.00234375, 9.00234375], "recent_frames_sha256": "d09e4af40848da7de4778404ca4ed2fa0ed03e28a24359c2c2e4adb079266321", "num_recent_frames": 10, "tq": 717676.940553512, "t1": 717688.774204858, "ta": 717688.774204858, "te": 717688.814964952, "first_response_s": 11.833651346038096, "answer_total_s": 11.874411439988762, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_366_a1447_q0", "video_id": 366, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fdf1db19a7df521cf8cbd6f7a96648718b5d71960c28fc109907b13700b24bbd", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.019010416666666665, 1.00234375, 2.00234375, 3.00234375, 4.00234375, 5.00234375, 6.00234375, 7.00234375, 8.00234375, 9.00234375], "recent_frames_sha256": "d09e4af40848da7de4778404ca4ed2fa0ed03e28a24359c2c2e4adb079266321", "num_recent_frames": 10, "tq": 717732.738729614, "t1": 717739.323958688, "ta": 717739.323958688, "te": 717739.361801263, "first_response_s": 6.585229074000381, "answer_total_s": 6.623071648995392, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 366, "content_group": "7047c02a11e8114c760c870edee8a2290e0f6a7f2cea00181bca80001e5abd84", "question": {"question_id": "sample_366_a1448_q0", "video_id": 366, "video_path": "./videos/sample_366_real.mp4", "annotation_index": 1448, "question_index": 0, "question": "Which of the following options best summarizes the activity performed just now?", "options": ["A. A person is cleaning a metal surface with a cloth and checking its condition.", "B. A person is painting a metal surface with a brush.", "C. A person is repairing an electronic device using tools.", "D. A person is assembling parts of a mechanical device."], "answer": "A", "time_stamp_s": 153, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [143, 153], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_366_a1448_q0", "video_id": 366, "time_stamp_s": 153, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "476a0e29d778e31a548bb597c868dc71975775cba14ab97815eecbe0c83cbe52", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [123.00234375, 124.00234375, 125.00234375, 126.00234375, 127.00234375, 128.00234375, 129.00234375, 130.00234375, 131.00234375, 132.00234375, 133.00234375, 134.00234375, 135.00234375, 136.00234375, 137.00234375, 138.00234375, 139.00234375, 140.00234375, 141.00234375, 142.00234375, 143.00234375, 144.00234375, 145.00234375, 146.00234375, 147.00234375, 148.00234375, 149.00234375, 150.00234375, 151.00234375, 152.00234375], "recent_frames_sha256": "1282e22816ce382a7ed301440b081c4497de8bbcd8a02ad318975637e09abd14", "num_recent_frames": 30, "tq": 717688.834553352, "t1": 717699.718197822, "ta": 717699.718197822, "te": 717699.77501536, "first_response_s": 10.883644470013678, "answer_total_s": 10.940462008002214, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_366_a1448_q0", "video_id": 366, "time_stamp_s": 153, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1290be30ecd59ed9198e852008dbea75e0c95e17f77aea4c74fd6f1d0dbc6cd9", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A person uses a digital scale to measure coffee grounds into a portafilter, adjusting the amount with their hands.  \n- The portafilter is placed on a coffee machine, with a grinder and other equipment visible nearby.  \n- The person’s hands are actively engaged in the process, with the scale and portafilter in focus, while background items like pastries and containers remain static.\n[30-60s] - Hand inserts portafilter into espresso machine's group head, initiating extraction.  \n- Machine's control panel displays operational status with illuminated buttons and gauges.  \n- Portafilter is positioned under a white ceramic cup on the machine's drip tray.\n[60-90s] - Hand holds a metal cup under the espresso machine's steam wand, positioning it to froth milk.  \n- The machine's steam wand is actively steaming milk, creating foam in the cup.  \n- A pink cloth is visible on the machine's drip tray, likely for cleaning or drying.\n[90-120s] - A hand holds a small white cup containing espresso, positioned near a sink with a visible coffee machine in the background.  \n- The hand pours steamed milk from a metal pitcher into the espresso cup, creating a latte art design.  \n- The cup is then moved toward a dining area with red booth seating, indicating the drink is being prepared for service.\n[120-150s] - Hands rinse a small metal cup under running water in a sink, then place it into a white bowl.  \n- A stainless steel coffee machine is picked up and wiped with a cloth, revealing a logo on its surface.  \n- The machine is moved toward a cabinet area, with a coffee cup and carton of milk visible on the countertop nearby.", "history_tokens": 378, "history_utf8_bytes": 1639, "recent_frame_times_s": [123.00234375, 124.00234375, 125.00234375, 126.00234375, 127.00234375, 128.00234375, 129.00234375, 130.00234375, 131.00234375, 132.00234375, 133.00234375, 134.00234375, 135.00234375, 136.00234375, 137.00234375, 138.00234375, 139.00234375, 140.00234375, 141.00234375, 142.00234375, 143.00234375, 144.00234375, 145.00234375, 146.00234375, 147.00234375, 148.00234375, 149.00234375, 150.00234375, 151.00234375, 152.00234375], "recent_frames_sha256": "1282e22816ce382a7ed301440b081c4497de8bbcd8a02ad318975637e09abd14", "num_recent_frames": 30, "tq": 717784.929336001, "t1": 717791.795795649, "ta": 717791.795795649, "te": 717792.00041583, "first_response_s": 6.866459648008458, "answer_total_s": 7.07107982900925, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 366, "content_group": "7047c02a11e8114c760c870edee8a2290e0f6a7f2cea00181bca80001e5abd84", "question": {"question_id": "sample_366_a1449_q0", "video_id": 366, "video_path": "./videos/sample_366_real.mp4", "annotation_index": 1449, "question_index": 0, "question": "Which of the following options best summarizes the activity performed just now?", "options": ["A. Preparing an espresso by grinding coffee beans, measuring the coffee, and extracting the shot.", "B. Cleaning and sanitizing a workspace in preparation for a new task.", "C. Operating kitchen equipment to bake a batch of cookies.", "D. Conducting a detailed inspection and maintenance of a coffee machine."], "answer": "A", "time_stamp_s": 296, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [286, 296], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_366_a1449_q0", "video_id": 366, "time_stamp_s": 296, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "12426c5d9d79556c74c6229096e32ae27c4d0def963d36aa6726e7833573b0b7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [266.00234375, 267.00234375, 268.00234375, 269.00234375, 270.00234375, 271.00234375, 272.00234375, 273.00234375, 274.00234375, 275.00234375, 276.00234375, 277.00234375, 278.00234375, 279.00234375, 280.00234375, 281.00234375, 282.00234375, 283.00234375, 284.00234375, 285.00234375, 286.00234375, 287.00234375, 288.00234375, 289.00234375, 290.00234375, 291.00234375, 292.00234375, 293.00234375, 294.00234375, 295.00234375], "recent_frames_sha256": "1debff545647eac40a6179e36b7fc23a06fdc3d74008701eb2eb338f13639414", "num_recent_frames": 30, "tq": 717699.812390289, "t1": 717712.512564579, "ta": 717712.512564579, "te": 717712.550471905, "first_response_s": 12.700174289988354, "answer_total_s": 12.738081616000272, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_366_a1449_q0", "video_id": 366, "time_stamp_s": 296, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "58fd83571ee4891c6285027253c5faa3899ad5ac33f0a5af06cd53e30cb95f33", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A person uses a digital scale to measure coffee grounds into a portafilter, adjusting the amount with their hands.  \n- The portafilter is placed on a coffee machine, with a grinder and other equipment visible nearby.  \n- The person’s hands are actively engaged in the process, with the scale and portafilter in focus, while background items like pastries and containers remain static.\n[30-60s] - Hand inserts portafilter into espresso machine's group head, initiating extraction.  \n- Machine's control panel displays operational status with illuminated buttons and gauges.  \n- Portafilter is positioned under a white ceramic cup on the machine's drip tray.\n[60-90s] - Hand holds a metal cup under the espresso machine's steam wand, positioning it to froth milk.  \n- The machine's steam wand is actively steaming milk, creating foam in the cup.  \n- A pink cloth is visible on the machine's drip tray, likely for cleaning or drying.\n[90-120s] - A hand holds a small white cup containing espresso, positioned near a sink with a visible coffee machine in the background.  \n- The hand pours steamed milk from a metal pitcher into the espresso cup, creating a latte art design.  \n- The cup is then moved toward a dining area with red booth seating, indicating the drink is being prepared for service.\n[120-150s] - Hands rinse a small metal cup under running water in a sink, then place it into a white bowl.  \n- A stainless steel coffee machine is picked up and wiped with a cloth, revealing a logo on its surface.  \n- The machine is moved toward a cabinet area, with a coffee cup and carton of milk visible on the countertop nearby.\n[150-180s] - Hand holds a metallic appliance with a digital display showing \"0.00\" while positioning it near a countertop.  \n- The appliance is moved toward a circular cooking surface, which is part of a larger kitchen unit.  \n- A small glass container with a dark substance and a spoon is visible on the countertop nearby.\n[180-210s] - Hands use a metal tamper to press coffee grounds in a portafilter, which is placed on a scale.  \n- The portafilter is then inserted into the espresso machine's group head.  \n- A pink cloth is visible nearby, likely for cleaning or wiping.\n[210-240s] - Hands hold a printed list of coffee orders, showing \"Cappuccino\" and \"Latte\" as visible text.  \n- A hand reaches toward an espresso machine, then moves to open a drawer containing coffee grounds and a scoop.  \n- The camera pans to a sink area with a carton of milk and a coffee grinder visible nearby.\n[240-270s] - A person uses a digital scale to measure coffee grounds into a portafilter, then places the portafilter into an espresso machine.  \n- The espresso machine's group head is visible, with a red cloth nearby, and the person adjusts the portafilter's position.  \n- The scale's digital display shows the weight of the coffee grounds as they are being measured.", "history_tokens": 688, "history_utf8_bytes": 2898, "recent_frame_times_s": [266.00234375, 267.00234375, 268.00234375, 269.00234375, 270.00234375, 271.00234375, 272.00234375, 273.00234375, 274.00234375, 275.00234375, 276.00234375, 277.00234375, 278.00234375, 279.00234375, 280.00234375, 281.00234375, 282.00234375, 283.00234375, 284.00234375, 285.00234375, 286.00234375, 287.00234375, 288.00234375, 289.00234375, 290.00234375, 291.00234375, 292.00234375, 293.00234375, 294.00234375, 295.00234375], "recent_frames_sha256": "1debff545647eac40a6179e36b7fc23a06fdc3d74008701eb2eb338f13639414", "num_recent_frames": 30, "tq": 717822.705729783, "t1": 717825.630089623, "ta": 717825.630089623, "te": 717826.067311884, "first_response_s": 2.9243598399916664, "answer_total_s": 3.3615821009734645, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 366, "content_group": "7047c02a11e8114c760c870edee8a2290e0f6a7f2cea00181bca80001e5abd84", "question": {"question_id": "sample_366_a1450_q0", "video_id": 366, "video_path": "./videos/sample_366_real.mp4", "annotation_index": 1450, "question_index": 0, "question": "Which of the following options best summarizes the activity performed just now?", "options": ["A. Preparing an espresso and stirring it.", "B. Brewing a pot of tea and adding sugar.", "C. Mixing ingredients for a cake batter.", "D. Cleaning and sanitizing a kitchen workspace."], "answer": "A", "time_stamp_s": 439, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [429, 439], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_366_a1450_q0", "video_id": 366, "time_stamp_s": 439, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "832754cd354646790aff22f122fa4c5892f6bd05b63c6a714648118eb0265e43", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [409.00234375, 410.00234375, 411.00234375, 412.00234375, 413.00234375, 414.00234375, 415.00234375, 416.00234375, 417.00234375, 418.00234375, 419.00234375, 420.00234375, 421.00234375, 422.00234375, 423.00234375, 424.00234375, 425.00234375, 426.00234375, 427.00234375, 428.00234375, 429.00234375, 430.00234375, 431.00234375, 432.00234375, 433.00234375, 434.00234375, 435.00234375, 436.00234375, 437.00234375, 438.00234375], "recent_frames_sha256": "4b4f192edffe8c6b320e4b506ea98117f089cd7ac19cf4b341ad11484895e6d5", "num_recent_frames": 30, "tq": 717712.568907269, "t1": 717719.036990323, "ta": 717719.036990323, "te": 717719.074837464, "first_response_s": 6.468083053943701, "answer_total_s": 6.505930194980465, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_366_a1450_q0", "video_id": 366, "time_stamp_s": 439, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3231c4f4d0865044a44e2591d0f73136a7179ce1ff1740af73fb679662fe35e8", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Hand inserts portafilter into espresso machine's group head, initiating extraction.  \n- Machine's control panel displays operational status with illuminated buttons and gauges.  \n- Portafilter is positioned under a white ceramic cup on the machine's drip tray.\n[60-90s] - Hand holds a metal cup under the espresso machine's steam wand, positioning it to froth milk.  \n- The machine's steam wand is actively steaming milk, creating foam in the cup.  \n- A pink cloth is visible on the machine's drip tray, likely for cleaning or drying.\n[90-120s] - A hand holds a small white cup containing espresso, positioned near a sink with a visible coffee machine in the background.  \n- The hand pours steamed milk from a metal pitcher into the espresso cup, creating a latte art design.  \n- The cup is then moved toward a dining area with red booth seating, indicating the drink is being prepared for service.\n[120-150s] - Hands rinse a small metal cup under running water in a sink, then place it into a white bowl.  \n- A stainless steel coffee machine is picked up and wiped with a cloth, revealing a logo on its surface.  \n- The machine is moved toward a cabinet area, with a coffee cup and carton of milk visible on the countertop nearby.\n[150-180s] - Hand holds a metallic appliance with a digital display showing \"0.00\" while positioning it near a countertop.  \n- The appliance is moved toward a circular cooking surface, which is part of a larger kitchen unit.  \n- A small glass container with a dark substance and a spoon is visible on the countertop nearby.\n[180-210s] - Hands use a metal tamper to press coffee grounds in a portafilter, which is placed on a scale.  \n- The portafilter is then inserted into the espresso machine's group head.  \n- A pink cloth is visible nearby, likely for cleaning or wiping.\n[210-240s] - Hands hold a printed list of coffee orders, showing \"Cappuccino\" and \"Latte\" as visible text.  \n- A hand reaches toward an espresso machine, then moves to open a drawer containing coffee grounds and a scoop.  \n- The camera pans to a sink area with a carton of milk and a coffee grinder visible nearby.\n[240-270s] - A person uses a digital scale to measure coffee grounds into a portafilter, then places the portafilter into an espresso machine.  \n- The espresso machine's group head is visible, with a red cloth nearby, and the person adjusts the portafilter's position.  \n- The scale's digital display shows the weight of the coffee grounds as they are being measured.\n[270-300s] - Hand removes portafilter from espresso machine group head, revealing steam wand and pressure gauges.  \n- Portafilter is placed on a digital scale, which displays weight as the person prepares to tamp coffee grounds.  \n- Coffee grounds are visible in the portafilter, and a cup with latte art is nearby on the counter.\n[300-330s] - Hand pours milk from a white jug into a metal cup, positioned near a kitchen sink.  \n- The cup is then moved toward an espresso machine, where steam is applied to froth the milk.  \n- The frothed milk is held steady under the machine’s steam wand, with the machine’s control panel visible in the background.\n[330-360s] - Hands hold a small cup with espresso and a metal pitcher of milk, preparing for latte art.  \n- Milk is poured into the espresso cup, creating a swirling pattern.  \n- A circular metal tray is positioned nearby, likely for holding the finished drink.\n[360-390s] - Hand holds a metal cup under running water in a sink, rinsing it.  \n- Another hand places a small white cup on the counter near the sink.  \n- Espresso machine is visible in the background, with a hand reaching toward its controls.\n[390-420s] - A hand uses a wooden spoon to scoop dark powder from a glass jar into a small white cup.  \n- The jar is placed back on a shelf above a coffee machine, while the cup is held in the other hand.  \n- The coffee machine's portafilter is positioned under the spout, ready for use.", "history_tokens": 958, "history_utf8_bytes": 3950, "recent_frame_times_s": [409.00234375, 410.00234375, 411.00234375, 412.00234375, 413.00234375, 414.00234375, 415.00234375, 416.00234375, 417.00234375, 418.00234375, 419.00234375, 420.00234375, 421.00234375, 422.00234375, 423.00234375, 424.00234375, 425.00234375, 426.00234375, 427.00234375, 428.00234375, 429.00234375, 430.00234375, 431.00234375, 432.00234375, 433.00234375, 434.00234375, 435.00234375, 436.00234375, 437.00234375, 438.00234375], "recent_frames_sha256": "4b4f192edffe8c6b320e4b506ea98117f089cd7ac19cf4b341ad11484895e6d5", "num_recent_frames": 30, "tq": 717889.131610118, "t1": 717892.003292199, "ta": 717892.003292199, "te": 717892.20161401, "first_response_s": 2.8716820810223, "answer_total_s": 3.070003892062232, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 366, "content_group": "7047c02a11e8114c760c870edee8a2290e0f6a7f2cea00181bca80001e5abd84", "question": {"question_id": "sample_366_a1451_q0", "video_id": 366, "video_path": "./videos/sample_366_real.mp4", "annotation_index": 1451, "question_index": 0, "question": "Which of the following options best summarizes the activity performed just now?", "options": ["A. Weighing coffee grounds and tamping them into a portafilter.", "B. Cleaning the coffee machine and setting it up for a new brew.", "C. Preparing a tray of cookies for baking in the oven.", "D. Cleaning and arranging the kitchen workspace."], "answer": "A", "time_stamp_s": 582, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [572, 582], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_366_a1451_q0", "video_id": 366, "time_stamp_s": 582, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6c9505282708443d6d7c2697f3c29c340bd5f02bd3a28380ccdfcbef398baba8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [552.00234375, 553.00234375, 554.00234375, 555.00234375, 556.00234375, 557.00234375, 558.00234375, 559.00234375, 560.00234375, 561.00234375, 562.00234375, 563.00234375, 564.00234375, 565.00234375, 566.00234375, 567.00234375, 568.00234375, 569.00234375, 570.00234375, 571.00234375, 572.00234375, 573.00234375, 574.00234375, 575.00234375, 576.00234375, 577.00234375, 578.00234375, 579.00234375, 580.00234375, 581.00234375], "recent_frames_sha256": "a29e6c73be3a76798a1aab7628fe01fec500059505a7fabed6345dbd9de7ae9c", "num_recent_frames": 30, "tq": 717719.085197288, "t1": 717732.693218926, "ta": 717732.693218926, "te": 717732.730468339, "first_response_s": 13.608021638006903, "answer_total_s": 13.645271051093005, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_366_a1451_q0", "video_id": 366, "time_stamp_s": 582, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f57b6af195c83bb47a05330a70094411efd4118b25d35d472d908cba6b8e9227", "condition_order": ["recent", "notes"], "memory": "[150-180s] - Hand holds a metallic appliance with a digital display showing \"0.00\" while positioning it near a countertop.  \n- The appliance is moved toward a circular cooking surface, which is part of a larger kitchen unit.  \n- A small glass container with a dark substance and a spoon is visible on the countertop nearby.\n[180-210s] - Hands use a metal tamper to press coffee grounds in a portafilter, which is placed on a scale.  \n- The portafilter is then inserted into the espresso machine's group head.  \n- A pink cloth is visible nearby, likely for cleaning or wiping.\n[210-240s] - Hands hold a printed list of coffee orders, showing \"Cappuccino\" and \"Latte\" as visible text.  \n- A hand reaches toward an espresso machine, then moves to open a drawer containing coffee grounds and a scoop.  \n- The camera pans to a sink area with a carton of milk and a coffee grinder visible nearby.\n[240-270s] - A person uses a digital scale to measure coffee grounds into a portafilter, then places the portafilter into an espresso machine.  \n- The espresso machine's group head is visible, with a red cloth nearby, and the person adjusts the portafilter's position.  \n- The scale's digital display shows the weight of the coffee grounds as they are being measured.\n[270-300s] - Hand removes portafilter from espresso machine group head, revealing steam wand and pressure gauges.  \n- Portafilter is placed on a digital scale, which displays weight as the person prepares to tamp coffee grounds.  \n- Coffee grounds are visible in the portafilter, and a cup with latte art is nearby on the counter.\n[300-330s] - Hand pours milk from a white jug into a metal cup, positioned near a kitchen sink.  \n- The cup is then moved toward an espresso machine, where steam is applied to froth the milk.  \n- The frothed milk is held steady under the machine’s steam wand, with the machine’s control panel visible in the background.\n[330-360s] - Hands hold a small cup with espresso and a metal pitcher of milk, preparing for latte art.  \n- Milk is poured into the espresso cup, creating a swirling pattern.  \n- A circular metal tray is positioned nearby, likely for holding the finished drink.\n[360-390s] - Hand holds a metal cup under running water in a sink, rinsing it.  \n- Another hand places a small white cup on the counter near the sink.  \n- Espresso machine is visible in the background, with a hand reaching toward its controls.\n[390-420s] - A hand uses a wooden spoon to scoop dark powder from a glass jar into a small white cup.  \n- The jar is placed back on a shelf above a coffee machine, while the cup is held in the other hand.  \n- The coffee machine's portafilter is positioned under the spout, ready for use.\n[420-450s] - Hand stirs dark liquid in a small white cup using a spoon.  \n- Cup is held near a commercial espresso machine with visible grates and digital display.  \n- Background shows a sink, a metal bowl, and a container of sugar.\n[450-480s] - Hand holds a small metal cup under espresso machine's steam wand, filling it with steamed milk.  \n- Espresso machine's steam wand is actively steaming milk, with visible frothing action.  \n- Hand adjusts position of metal cup to ensure even steaming and frothing of milk.\n[480-510s] - A hand pours steamed milk into a small espresso cup, creating a latte art design.  \n- The cup is held steady while milk is poured, with the latte art forming a swirl pattern.  \n- A tray with other coffee drinks is visible in the background, slightly out of focus.\n[510-540s] - Hand pours steamed milk into a cup, creating latte art on a coffee surface.  \n- Two finished lattes are placed on a metal tray, one with a heart design, the other with a swirl.  \n- Barista removes a used portafilter from the espresso machine, preparing for the next brew.\n[540-570s] - Hands place a white paper cup with \"ANYA CAFE\" branding onto the espresso machine's drip tray.  \n- A pink cloth is used to wipe the machine's surface near the portafilter.  \n- The espresso machine's digital display shows operational status as the portafilter is inserted.", "history_tokens": 1014, "history_utf8_bytes": 4072, "recent_frame_times_s": [552.00234375, 553.00234375, 554.00234375, 555.00234375, 556.00234375, 557.00234375, 558.00234375, 559.00234375, 560.00234375, 561.00234375, 562.00234375, 563.00234375, 564.00234375, 565.00234375, 566.00234375, 567.00234375, 568.00234375, 569.00234375, 570.00234375, 571.00234375, 572.00234375, 573.00234375, 574.00234375, 575.00234375, 576.00234375, 577.00234375, 578.00234375, 579.00234375, 580.00234375, 581.00234375], "recent_frames_sha256": "a29e6c73be3a76798a1aab7628fe01fec500059505a7fabed6345dbd9de7ae9c", "num_recent_frames": 30, "tq": 717931.928496958, "t1": 717940.798892206, "ta": 717940.798892206, "te": 717941.044356915, "first_response_s": 8.87039524805732, "answer_total_s": 9.11585995706264, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 367, "content_group": "e8c5bfdab8fec50053f3be6a19a707190683f27060895ff061cd6d95d3544cc3", "question": {"question_id": "sample_367_a2145_q0", "video_id": 367, "video_path": "./videos/sample_367_real.mp4", "annotation_index": 2145, "question_index": 0, "question": "Which of the following options best summarizes the recent actions taken just now?", "options": ["A. The individual cleaned a machine, selected a sandwich, and prepared it for a customer.", "B. The individual set a table with utensils, organized a menu, and greeted a guest.", "C. The individual washed dishes, stacked them, and prepared a meal.", "D. The individual positioned the portafilter, and ground coffee into it, and cleaned the portafilter,."], "answer": "D", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_367_a2145_q0", "video_id": 367, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "41eda8a96ac8ecce8e2d32039ee86d5002c70bc7a675ddd9efeb371a1b779221", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03697916666666667, 1.0036458333333333, 2.003645833333333, 3.003645833333333, 4.003645833333334, 5.003645833333334, 6.003645833333334, 7.003645833333334, 8.003645833333334, 9.003645833333334], "recent_frames_sha256": "c82e4c530acf7de22e85c5884e0f591c2ce77df14555b4bc7d0ec0839dd049f9", "num_recent_frames": 10, "tq": 717662.763810323, "t1": 717663.635675557, "ta": 717663.635675557, "te": 717663.674468765, "first_response_s": 0.8718652339885011, "answer_total_s": 0.9106584420660511, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_367_a2145_q0", "video_id": 367, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f923bd1dc0bdd648d1f3476ceea6adea81865cd230a079d8e7678a98b6d35db1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03697916666666667, 1.0036458333333333, 2.003645833333333, 3.003645833333333, 4.003645833333334, 5.003645833333334, 6.003645833333334, 7.003645833333334, 8.003645833333334, 9.003645833333334], "recent_frames_sha256": "c82e4c530acf7de22e85c5884e0f591c2ce77df14555b4bc7d0ec0839dd049f9", "num_recent_frames": 10, "tq": 717510.179727011, "t1": 717511.460194982, "ta": 717511.460194982, "te": 717512.027282361, "first_response_s": 1.2804679709952325, "answer_total_s": 1.8475553500466049, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 367, "content_group": "e8c5bfdab8fec50053f3be6a19a707190683f27060895ff061cd6d95d3544cc3", "question": {"question_id": "sample_367_a2146_q0", "video_id": 367, "video_path": "./videos/sample_367_real.mp4", "annotation_index": 2146, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual brewed a pot of tea, added honey, and served it to a customer.", "B. The individual prepared a bowl of soup, garnished it with herbs, and handed it over.", "C. The individual mixed a smoothie, poured it into a glass, and placed it on the counter.", "D. The individual poured frothed milk into a cup of coffee, creating latte art."], "answer": "D", "time_stamp_s": 128, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [118, 128], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_367_a2146_q0", "video_id": 367, "time_stamp_s": 128, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9c60f7c8fb37a57921509753379f555381452ac62abdfa3ef6e7e0588577882e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [98.00364583333334, 99.00364583333334, 100.00364583333334, 101.00364583333334, 102.00364583333334, 103.00364583333334, 104.00364583333334, 105.00364583333334, 106.00364583333334, 107.00364583333334, 108.00364583333334, 109.00364583333334, 110.00364583333334, 111.00364583333334, 112.00364583333334, 113.00364583333334, 114.00364583333334, 115.00364583333334, 116.00364583333334, 117.00364583333334, 118.00364583333334, 119.00364583333334, 120.00364583333334, 121.00364583333334, 122.00364583333334, 123.00364583333334, 124.00364583333334, 125.00364583333334, 126.00364583333334, 127.00364583333334], "recent_frames_sha256": "2552d1dd60082e09c146dbd433f6f987ecb63f565417176aec8b1ba77ce0889c", "num_recent_frames": 30, "tq": 717663.69440125, "t1": 717676.876432572, "ta": 717676.876432572, "te": 717676.915686001, "first_response_s": 13.182031322037801, "answer_total_s": 13.221284750965424, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_367_a2146_q0", "video_id": 367, "time_stamp_s": 128, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "963d9f9fc9581473600e33e4bd369ac02e5257a974044ecfe53f716f8d70aac1", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands use a pink cloth to wipe a metal portafilter, then place it on an espresso machine's group head.  \n- A digital scale is used to measure coffee grounds into a portafilter, which is then placed into the machine.  \n- The espresso machine's group head is visible with steam and water flow, indicating brewing in progress.\n[30-60s] - Hand places a green-topped portafilter into the espresso machine's group head, then removes it after a brief pause.  \n- A hand holds a metal tamper and presses down on coffee grounds in a portafilter, then sets the portafilter aside.  \n- A hand picks up a small metal scoop and transfers coffee grounds into a portafilter, then places the portafilter on a scale.\n[60-90s] - Hand holds a metal pitcher under espresso machine's steam wand, filling it with milk.  \n- Milk pitcher is positioned near the machine's steam wand, with steam being introduced into the milk.  \n- The pitcher is held steady as steam is applied, indicating the process of frothing milk.\n[90-120s] - Hand holds a metal pitcher with steamed milk, positioned under espresso machine's steam wand.  \n- Hand pours milk into a small white cup containing espresso, creating a swirling pattern.  \n- Background shows a kitchen sink, a large water jug, and a person seated at a table.", "history_tokens": 305, "history_utf8_bytes": 1289, "recent_frame_times_s": [98.00364583333334, 99.00364583333334, 100.00364583333334, 101.00364583333334, 102.00364583333334, 103.00364583333334, 104.00364583333334, 105.00364583333334, 106.00364583333334, 107.00364583333334, 108.00364583333334, 109.00364583333334, 110.00364583333334, 111.00364583333334, 112.00364583333334, 113.00364583333334, 114.00364583333334, 115.00364583333334, 116.00364583333334, 117.00364583333334, 118.00364583333334, 119.00364583333334, 120.00364583333334, 121.00364583333334, 122.00364583333334, 123.00364583333334, 124.00364583333334, 125.00364583333334, 126.00364583333334, 127.00364583333334], "recent_frames_sha256": "2552d1dd60082e09c146dbd433f6f987ecb63f565417176aec8b1ba77ce0889c", "num_recent_frames": 30, "tq": 717541.229530522, "t1": 717547.343145664, "ta": 717547.343145664, "te": 717547.379850106, "first_response_s": 6.113615141948685, "answer_total_s": 6.150319583946839, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 367, "content_group": "e8c5bfdab8fec50053f3be6a19a707190683f27060895ff061cd6d95d3544cc3", "question": {"question_id": "sample_367_a2147_q0", "video_id": 367, "video_path": "./videos/sample_367_real.mp4", "annotation_index": 2147, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual removed a foil cover from a container, stirred a hot soup, and served it to a customer.", "B. The individual picked up a plastic container, opened the lid, and prepared the contents for blending.", "C. The individual placed a small container back on the shelf after stirring its contents and wiped the counter.", "D. This individual put a plastic lid on a prepared iced latte."], "answer": "D", "time_stamp_s": 246, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [236, 246], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_367_a2147_q0", "video_id": 367, "time_stamp_s": 246, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fd08aa97c3eaa205e310b73eb9b35cd80b1e96cb123965fc481288ffcc4c21e1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [216.00364583333334, 217.00364583333334, 218.00364583333334, 219.00364583333334, 220.00364583333334, 221.00364583333334, 222.00364583333334, 223.00364583333334, 224.00364583333334, 225.00364583333334, 226.00364583333334, 227.00364583333334, 228.00364583333334, 229.00364583333334, 230.00364583333334, 231.00364583333334, 232.00364583333334, 233.00364583333334, 234.00364583333334, 235.00364583333334, 236.00364583333334, 237.00364583333334, 238.00364583333334, 239.00364583333334, 240.00364583333334, 241.00364583333334, 242.00364583333334, 243.00364583333334, 244.00364583333334, 245.00364583333334], "recent_frames_sha256": "1dc5ebef5466ee80a421793e674320755f6ed772f92eee145532726320d6248d", "num_recent_frames": 30, "tq": 717676.935663161, "t1": 717688.774204858, "ta": 717688.774204858, "te": 717688.814964952, "first_response_s": 11.83854169701226, "answer_total_s": 11.879301790962927, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_367_a2147_q0", "video_id": 367, "time_stamp_s": 246, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2d30b34727d638bb9cf70f128c80ab6e6c7ec5e8409c468eb4338d70f8c603c9", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands use a pink cloth to wipe a metal portafilter, then place it on an espresso machine's group head.  \n- A digital scale is used to measure coffee grounds into a portafilter, which is then placed into the machine.  \n- The espresso machine's group head is visible with steam and water flow, indicating brewing in progress.\n[30-60s] - Hand places a green-topped portafilter into the espresso machine's group head, then removes it after a brief pause.  \n- A hand holds a metal tamper and presses down on coffee grounds in a portafilter, then sets the portafilter aside.  \n- A hand picks up a small metal scoop and transfers coffee grounds into a portafilter, then places the portafilter on a scale.\n[60-90s] - Hand holds a metal pitcher under espresso machine's steam wand, filling it with milk.  \n- Milk pitcher is positioned near the machine's steam wand, with steam being introduced into the milk.  \n- The pitcher is held steady as steam is applied, indicating the process of frothing milk.\n[90-120s] - Hand holds a metal pitcher with steamed milk, positioned under espresso machine's steam wand.  \n- Hand pours milk into a small white cup containing espresso, creating a swirling pattern.  \n- Background shows a kitchen sink, a large water jug, and a person seated at a table.\n[120-150s] - Barista pours steamed milk into a cup, creating latte art.  \n- Barista places the cup into a sink, then rinses a metal pitcher under running water.  \n- Barista moves toward an espresso machine, preparing to use it.\n[150-180s] - Hands pour water from a faucet into a metal pitcher containing ice cubes.  \n- A yellow carton labeled \"Rude Health\" and a white carton are visible on the counter beside the pitcher.  \n- The pitcher is held steady by one hand while the other directs the water flow.\n[180-210s] - Person holds a yellow carton labeled \"Rude Health Almond Milk\" and opens its top seal.  \n- They pour the almond milk into a metal mixing bowl containing ice cubes.  \n- The carton is then placed into a drawer under the sink, suggesting storage after use.\n[210-240s] - Hand holds a yellow \"Rude Health\" carton, preparing to open it near a coffee machine.  \n- Coffee machine with a portafilter and steam wand is visible in the background, with a pink cloth draped over it.  \n- A small white bowl containing chopped nuts is placed on the counter, near a sink and a metal griddle.", "history_tokens": 586, "history_utf8_bytes": 2384, "recent_frame_times_s": [216.00364583333334, 217.00364583333334, 218.00364583333334, 219.00364583333334, 220.00364583333334, 221.00364583333334, 222.00364583333334, 223.00364583333334, 224.00364583333334, 225.00364583333334, 226.00364583333334, 227.00364583333334, 228.00364583333334, 229.00364583333334, 230.00364583333334, 231.00364583333334, 232.00364583333334, 233.00364583333334, 234.00364583333334, 235.00364583333334, 236.00364583333334, 237.00364583333334, 238.00364583333334, 239.00364583333334, 240.00364583333334, 241.00364583333334, 242.00364583333334, 243.00364583333334, 244.00364583333334, 245.00364583333334], "recent_frames_sha256": "1dc5ebef5466ee80a421793e674320755f6ed772f92eee145532726320d6248d", "num_recent_frames": 30, "tq": 717580.018897437, "t1": 717581.526853067, "ta": 717581.526853067, "te": 717581.750640136, "first_response_s": 1.5079556299606338, "answer_total_s": 1.7317426989320666, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 367, "content_group": "e8c5bfdab8fec50053f3be6a19a707190683f27060895ff061cd6d95d3544cc3", "question": {"question_id": "sample_367_a2148_q0", "video_id": 367, "video_path": "./videos/sample_367_real.mp4", "annotation_index": 2148, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual selected a teapot, steeped tea leaves, and poured the tea into a cup.", "B. The individual prepared a smoothie by blending ingredients, pouring it into a glass, and garnishing it.", "C. The individual washed a tea strainer, added herbs into it, and boiled water.", "D. The individual tamped coffee grounds, and prepared to extract an espresso shot."], "answer": "D", "time_stamp_s": 364, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [354, 364], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_367_a2148_q0", "video_id": 367, "time_stamp_s": 364, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "680ccb2c856400888f222dcc7f3d31834d9862a584fac65749054da1a16cbd10", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [334.00364583333334, 335.00364583333334, 336.00364583333334, 337.00364583333334, 338.00364583333334, 339.00364583333334, 340.00364583333334, 341.00364583333334, 342.00364583333334, 343.00364583333334, 344.00364583333334, 345.00364583333334, 346.00364583333334, 347.00364583333334, 348.00364583333334, 349.00364583333334, 350.00364583333334, 351.00364583333334, 352.00364583333334, 353.00364583333334, 354.00364583333334, 355.00364583333334, 356.00364583333334, 357.00364583333334, 358.00364583333334, 359.00364583333334, 360.00364583333334, 361.00364583333334, 362.00364583333334, 363.00364583333334], "recent_frames_sha256": "8d5e03e03ffe486d77f30edcfa87ea81e70320db07f349c896352586a524e2da", "num_recent_frames": 30, "tq": 717688.828023355, "t1": 717699.718197822, "ta": 717699.718197822, "te": 717699.77501536, "first_response_s": 10.890174467000179, "answer_total_s": 10.946992004988715, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_367_a2148_q0", "video_id": 367, "time_stamp_s": 364, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "efe74b4d6b89b2366c8a1ab35d4a58f80024389c2d7ebd3d0c37cfc6d4c83fcc", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands use a pink cloth to wipe a metal portafilter, then place it on an espresso machine's group head.  \n- A digital scale is used to measure coffee grounds into a portafilter, which is then placed into the machine.  \n- The espresso machine's group head is visible with steam and water flow, indicating brewing in progress.\n[30-60s] - Hand places a green-topped portafilter into the espresso machine's group head, then removes it after a brief pause.  \n- A hand holds a metal tamper and presses down on coffee grounds in a portafilter, then sets the portafilter aside.  \n- A hand picks up a small metal scoop and transfers coffee grounds into a portafilter, then places the portafilter on a scale.\n[60-90s] - Hand holds a metal pitcher under espresso machine's steam wand, filling it with milk.  \n- Milk pitcher is positioned near the machine's steam wand, with steam being introduced into the milk.  \n- The pitcher is held steady as steam is applied, indicating the process of frothing milk.\n[90-120s] - Hand holds a metal pitcher with steamed milk, positioned under espresso machine's steam wand.  \n- Hand pours milk into a small white cup containing espresso, creating a swirling pattern.  \n- Background shows a kitchen sink, a large water jug, and a person seated at a table.\n[120-150s] - Barista pours steamed milk into a cup, creating latte art.  \n- Barista places the cup into a sink, then rinses a metal pitcher under running water.  \n- Barista moves toward an espresso machine, preparing to use it.\n[150-180s] - Hands pour water from a faucet into a metal pitcher containing ice cubes.  \n- A yellow carton labeled \"Rude Health\" and a white carton are visible on the counter beside the pitcher.  \n- The pitcher is held steady by one hand while the other directs the water flow.\n[180-210s] - Person holds a yellow carton labeled \"Rude Health Almond Milk\" and opens its top seal.  \n- They pour the almond milk into a metal mixing bowl containing ice cubes.  \n- The carton is then placed into a drawer under the sink, suggesting storage after use.\n[210-240s] - Hand holds a yellow \"Rude Health\" carton, preparing to open it near a coffee machine.  \n- Coffee machine with a portafilter and steam wand is visible in the background, with a pink cloth draped over it.  \n- A small white bowl containing chopped nuts is placed on the counter, near a sink and a metal griddle.\n[240-270s] - Hands are seen manipulating a small, round, brownish object (possibly a cookie or pastry) over a circular metal surface.  \n- A clear plastic cup with a black straw is held and stirred with a spoon, containing a light-colored liquid and some solid ingredients.  \n- A glass pitcher filled with water is lifted and positioned near the cup, suggesting preparation for adding water to the drink.\n[270-300s] - A hand holds a clear glass bottle with a green cap, pouring liquid into a cup containing iced coffee and a straw.\n- The cup is placed on a circular metal tray, with a person’s arm visible holding the cup steady.\n- A box labeled \"HONEY\" and a small bowl are visible on the counter, suggesting ingredients or tools for preparation.\n[300-330s] - Hands place a portafilter onto a digital scale, which displays a weight reading of 18.5 grams.\n- The scale is then moved to the side of a commercial espresso machine, positioned near a tray of cookies.\n- The person removes the portafilter from the scale and places it into a compartment under the espresso machine, likely for tamping or cleaning.\n[330-360s] - Barista holds portafilter with ground coffee, positioning it under espresso machine's group head.  \n- Digital scale displays weight of coffee grounds as barista adjusts portafilter for tamping.  \n- Coffee grounds are visibly compacted in the portafilter, ready for extraction.", "history_tokens": 912, "history_utf8_bytes": 3783, "recent_frame_times_s": [334.00364583333334, 335.00364583333334, 336.00364583333334, 337.00364583333334, 338.00364583333334, 339.00364583333334, 340.00364583333334, 341.00364583333334, 342.00364583333334, 343.00364583333334, 344.00364583333334, 345.00364583333334, 346.00364583333334, 347.00364583333334, 348.00364583333334, 349.00364583333334, 350.00364583333334, 351.00364583333334, 352.00364583333334, 353.00364583333334, 354.00364583333334, 355.00364583333334, 356.00364583333334, 357.00364583333334, 358.00364583333334, 359.00364583333334, 360.00364583333334, 361.00364583333334, 362.00364583333334, 363.00364583333334], "recent_frames_sha256": "8d5e03e03ffe486d77f30edcfa87ea81e70320db07f349c896352586a524e2da", "num_recent_frames": 30, "tq": 717617.668258882, "t1": 717624.641626341, "ta": 717624.641626341, "te": 717624.946489342, "first_response_s": 6.973367459024303, "answer_total_s": 7.2782304600114, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 367, "content_group": "e8c5bfdab8fec50053f3be6a19a707190683f27060895ff061cd6d95d3544cc3", "question": {"question_id": "sample_367_a2149_q0", "video_id": 367, "video_path": "./videos/sample_367_real.mp4", "annotation_index": 2149, "question_index": 0, "question": "Which of the following options best summarizes the recent actions taken just now?", "options": ["A. The individual washed a coffee cup, set it down, and filled it with milk.", "B. The individual cleaned a teapot, boiled water, and steeped tea leaves.", "C. The individual prepared a paper cup, filled it with brewed tea, and added a slice of lemon.", "D. The individual wiped and cleaned the portafilter, weighted the portafilter, and adjusted the grinder settings."], "answer": "D", "time_stamp_s": 482, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [472, 482], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_367_a2149_q0", "video_id": 367, "time_stamp_s": 482, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e6457f8af9e82708906e7ad9b15d44a9fdd8382ff84847c3078a4110fa0c5e46", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [452.00364583333334, 453.00364583333334, 454.00364583333334, 455.00364583333334, 456.00364583333334, 457.00364583333334, 458.00364583333334, 459.00364583333334, 460.00364583333334, 461.00364583333334, 462.00364583333334, 463.00364583333334, 464.00364583333334, 465.00364583333334, 466.00364583333334, 467.00364583333334, 468.00364583333334, 469.00364583333334, 470.00364583333334, 471.00364583333334, 472.00364583333334, 473.00364583333334, 474.00364583333334, 475.00364583333334, 476.00364583333334, 477.00364583333334, 478.00364583333334, 479.00364583333334, 480.00364583333334, 481.00364583333334], "recent_frames_sha256": "614d67fbd57b8a8c451df251cf1d867643b4d2fb98e27c96fd6df293987cb6aa", "num_recent_frames": 30, "tq": 717699.801657732, "t1": 717712.512564579, "ta": 717712.512564579, "te": 717712.550471905, "first_response_s": 12.710906847030856, "answer_total_s": 12.748814173042774, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_367_a2149_q0", "video_id": 367, "time_stamp_s": 482, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9a9228a48ca112f1d60eaf227a45b8e9dc01828de290d05b62ce9180730fc67c", "condition_order": ["notes", "recent"], "memory": "[90-120s] - Hand holds a metal pitcher with steamed milk, positioned under espresso machine's steam wand.  \n- Hand pours milk into a small white cup containing espresso, creating a swirling pattern.  \n- Background shows a kitchen sink, a large water jug, and a person seated at a table.\n[120-150s] - Barista pours steamed milk into a cup, creating latte art.  \n- Barista places the cup into a sink, then rinses a metal pitcher under running water.  \n- Barista moves toward an espresso machine, preparing to use it.\n[150-180s] - Hands pour water from a faucet into a metal pitcher containing ice cubes.  \n- A yellow carton labeled \"Rude Health\" and a white carton are visible on the counter beside the pitcher.  \n- The pitcher is held steady by one hand while the other directs the water flow.\n[180-210s] - Person holds a yellow carton labeled \"Rude Health Almond Milk\" and opens its top seal.  \n- They pour the almond milk into a metal mixing bowl containing ice cubes.  \n- The carton is then placed into a drawer under the sink, suggesting storage after use.\n[210-240s] - Hand holds a yellow \"Rude Health\" carton, preparing to open it near a coffee machine.  \n- Coffee machine with a portafilter and steam wand is visible in the background, with a pink cloth draped over it.  \n- A small white bowl containing chopped nuts is placed on the counter, near a sink and a metal griddle.\n[240-270s] - Hands are seen manipulating a small, round, brownish object (possibly a cookie or pastry) over a circular metal surface.  \n- A clear plastic cup with a black straw is held and stirred with a spoon, containing a light-colored liquid and some solid ingredients.  \n- A glass pitcher filled with water is lifted and positioned near the cup, suggesting preparation for adding water to the drink.\n[270-300s] - A hand holds a clear glass bottle with a green cap, pouring liquid into a cup containing iced coffee and a straw.\n- The cup is placed on a circular metal tray, with a person’s arm visible holding the cup steady.\n- A box labeled \"HONEY\" and a small bowl are visible on the counter, suggesting ingredients or tools for preparation.\n[300-330s] - Hands place a portafilter onto a digital scale, which displays a weight reading of 18.5 grams.\n- The scale is then moved to the side of a commercial espresso machine, positioned near a tray of cookies.\n- The person removes the portafilter from the scale and places it into a compartment under the espresso machine, likely for tamping or cleaning.\n[330-360s] - Barista holds portafilter with ground coffee, positioning it under espresso machine's group head.  \n- Digital scale displays weight of coffee grounds as barista adjusts portafilter for tamping.  \n- Coffee grounds are visibly compacted in the portafilter, ready for extraction.\n[360-390s] - Person holds a portafilter with ground coffee, preparing to tamping it.  \n- Coffee grounds are visibly packed into the portafilter, with a tamper in hand.  \n- Portafilter is positioned near an espresso machine, ready for insertion into the group head.\n[390-420s] - Hands pour milk into a small metal cup near a sink, with a carton of \"PURE\" milk and a large jug visible nearby.  \n- The person then positions the cup under the espresso machine's steam wand, preparing to froth the milk.  \n- The espresso machine's steam wand is activated, with steam visibly rising from the cup as milk is being frothed.\n[420-450s] - Hand holds a small metal pitcher of steamed milk, poised to pour into a coffee cup.  \n- Coffee cup contains espresso, positioned under the steam wand of an espresso machine.  \n- A pink cloth is visible on the machine’s drip tray, suggesting recent cleaning or drying.\n[450-480s] - Barista hands a small container of cinnamon to the viewer while holding a plate with a croissant.  \n- Viewer holds a small cup with a latte art design, then moves it toward the sink.  \n- Coffee machine is visible in the background, with a portafilter being prepared for use.", "history_tokens": 967, "history_utf8_bytes": 3967, "recent_frame_times_s": [452.00364583333334, 453.00364583333334, 454.00364583333334, 455.00364583333334, 456.00364583333334, 457.00364583333334, 458.00364583333334, 459.00364583333334, 460.00364583333334, 461.00364583333334, 462.00364583333334, 463.00364583333334, 464.00364583333334, 465.00364583333334, 466.00364583333334, 467.00364583333334, 468.00364583333334, 469.00364583333334, 470.00364583333334, 471.00364583333334, 472.00364583333334, 473.00364583333334, 474.00364583333334, 475.00364583333334, 476.00364583333334, 477.00364583333334, 478.00364583333334, 479.00364583333334, 480.00364583333334, 481.00364583333334], "recent_frames_sha256": "614d67fbd57b8a8c451df251cf1d867643b4d2fb98e27c96fd6df293987cb6aa", "num_recent_frames": 30, "tq": 717656.071713139, "t1": 717662.562054957, "ta": 717662.562054957, "te": 717662.718191985, "first_response_s": 6.490341818076558, "answer_total_s": 6.6464788460871205, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 368, "content_group": "d5278cf1a76ffb5fe1dd126f74f63c6c0d4cc0720474859177bda52ab9b02410", "question": {"question_id": "sample_368_a800_q0", "video_id": 368, "video_path": "./videos/sample_368_real.mp4", "annotation_index": 800, "question_index": 0, "question": "Which of the following options best summarizes the actions occurring just now?", "options": ["A. A barista prepares a hot beverage, adds sugar, stirs, and serves it with a lid.", "B. A barista retrieves an ingredient from a drawer, prepares a cold drink, adds a straw, and serves it.", "C. A barista prepares a cold drink, adds whipped cream, and hands it to a customer without a lid.", "D. A barista prepares a hot beverage, retrieves an lid, adds it, and passed it to a customer."], "answer": "D", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_368_a800_q0", "video_id": 368, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7ee6165282a397e769318e4afd3c25aafe6f9a5ad0548f568445a9212081fb7c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0259765625, 1.0093098958333333, 2.0093098958333333, 3.0093098958333333, 4.009309895833334, 5.009309895833334, 6.009309895833334, 7.009309895833334, 8.009309895833333, 9.009309895833333], "recent_frames_sha256": "e811b70f0d534ed0df0a64b0cf045135b28cb5a774f30880f1c8e459f342cc43", "num_recent_frames": 10, "tq": 718900.546258567, "t1": 718906.048738458, "ta": 718906.048738458, "te": 718906.086142028, "first_response_s": 5.502479890943505, "answer_total_s": 5.539883460965939, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_368_a800_q0", "video_id": 368, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "01fc88438a9205504cc8999862a7112907f5c867078ae470aff26ec3709b3ab0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0259765625, 1.0093098958333333, 2.0093098958333333, 3.0093098958333333, 4.009309895833334, 5.009309895833334, 6.009309895833334, 7.009309895833334, 8.009309895833333, 9.009309895833333], "recent_frames_sha256": "e811b70f0d534ed0df0a64b0cf045135b28cb5a774f30880f1c8e459f342cc43", "num_recent_frames": 10, "tq": 718753.625975715, "t1": 718767.124132666, "ta": 718767.124132666, "te": 718767.165838117, "first_response_s": 13.498156951041892, "answer_total_s": 13.539862402016297, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 368, "content_group": "d5278cf1a76ffb5fe1dd126f74f63c6c0d4cc0720474859177bda52ab9b02410", "question": {"question_id": "sample_368_a801_q0", "video_id": 368, "video_path": "./videos/sample_368_real.mp4", "annotation_index": 801, "question_index": 0, "question": "Which of the following options best summarizes the actions occurring just now?", "options": ["A. An individual fills a cup with water, places it in a microwave, and heats it.", "B. An individual measures out flour, sifts it into a bowl, and prepares to bake bread.", "C. An individual cuts vegetables, arranges them on a plate, and garnishes with herbs.", "D. An individual prepares a cup of coffee by gathering supplies and opening a coffee bag with scissors."], "answer": "D", "time_stamp_s": 117, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [107, 117], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_368_a801_q0", "video_id": 368, "time_stamp_s": 117, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8de0b0d33056a45cd3b7f4fc67f57e0f2314b98829fb79ec1de2260349073ff8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [87.00930989583334, 88.00930989583334, 89.00930989583334, 90.00930989583334, 91.00930989583334, 92.00930989583334, 93.00930989583334, 94.00930989583334, 95.00930989583334, 96.00930989583334, 97.00930989583334, 98.00930989583334, 99.00930989583334, 100.00930989583334, 101.00930989583334, 102.00930989583334, 103.00930989583334, 104.00930989583334, 105.00930989583334, 106.00930989583334, 107.00930989583334, 108.00930989583334, 109.00930989583334, 110.00930989583334, 111.00930989583334, 112.00930989583334, 113.00930989583334, 114.00930989583334, 115.00930989583334, 116.00930989583334], "recent_frames_sha256": "68446ed1c456689aa2c328dc517bbcfee0750d48a20e82bbdd162e04c51a2892", "num_recent_frames": 30, "tq": 718906.104583181, "t1": 718948.266261113, "ta": 718948.266261113, "te": 718948.46118, "first_response_s": 42.16167793201748, "answer_total_s": 42.3565968190087, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_368_a801_q0", "video_id": 368, "time_stamp_s": 117, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6e195e675b8b362233a4fef46d616b757601328ddacdebeefee1e7467b7e439a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand places a white cup under an espresso machine's spout, then removes it after extraction.  \n- The same hand uses a red cloth to wipe the machine's portafilter area after use.  \n- A second cup is positioned nearby, filled with a light brown liquid, likely coffee, while the first cup is being handled.\n[30-60s] - Barista pours steamed milk into espresso, creating a latte art design in a white cup.  \n- The barista hands the finished drink to a customer in a suit, who receives it with a white napkin.  \n- A sink is visible with a faucet, and a small glass container with a dark liquid is being rinsed under running water.\n[60-90s] - Person removes a metal portafilter from a coffee machine, then places it on a scale.  \n- Coffee machine's control panel is visible with illuminated buttons and a digital display.  \n- A tray of pastries sits on the counter to the left of the coffee machine.", "history_tokens": 221, "history_utf8_bytes": 904, "recent_frame_times_s": [87.00930989583334, 88.00930989583334, 89.00930989583334, 90.00930989583334, 91.00930989583334, 92.00930989583334, 93.00930989583334, 94.00930989583334, 95.00930989583334, 96.00930989583334, 97.00930989583334, 98.00930989583334, 99.00930989583334, 100.00930989583334, 101.00930989583334, 102.00930989583334, 103.00930989583334, 104.00930989583334, 105.00930989583334, 106.00930989583334, 107.00930989583334, 108.00930989583334, 109.00930989583334, 110.00930989583334, 111.00930989583334, 112.00930989583334, 113.00930989583334, 114.00930989583334, 115.00930989583334, 116.00930989583334], "recent_frames_sha256": "68446ed1c456689aa2c328dc517bbcfee0750d48a20e82bbdd162e04c51a2892", "num_recent_frames": 30, "tq": 718785.406746119, "t1": 718787.111146201, "ta": 718787.111146201, "te": 718787.151749914, "first_response_s": 1.704400082002394, "answer_total_s": 1.7450037950184196, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 368, "content_group": "d5278cf1a76ffb5fe1dd126f74f63c6c0d4cc0720474859177bda52ab9b02410", "question": {"question_id": "sample_368_a802_q0", "video_id": 368, "video_path": "./videos/sample_368_real.mp4", "annotation_index": 802, "question_index": 0, "question": "Which of the following options best summarizes the actions taking place just now?", "options": ["A. An individual measures coffee beans, grinds them, and prepares the ground coffee in a portafilter.", "B. An individual weighs ground coffee, adjusts the grinder settings, and grinds more beans.", "C. An individual selects coffee beans, roasts them, and prepares them for grinding.", "D. An individual adds coffee grounds to a portafilter, weighted it, and used spoon to adjust it."], "answer": "D", "time_stamp_s": 224, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [214, 224], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_368_a802_q0", "video_id": 368, "time_stamp_s": 224, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "637937e8f37920e75e8bd28be9a1c1a7c53d9ba8fb77408be367dbac62d3be14", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [194.00930989583333, 195.00930989583333, 196.00930989583333, 197.00930989583333, 198.00930989583333, 199.00930989583333, 200.00930989583333, 201.00930989583333, 202.00930989583333, 203.00930989583333, 204.00930989583333, 205.00930989583333, 206.00930989583333, 207.00930989583333, 208.00930989583333, 209.00930989583333, 210.00930989583333, 211.00930989583333, 212.00930989583333, 213.00930989583333, 214.00930989583333, 215.00930989583333, 216.00930989583333, 217.00930989583333, 218.00930989583333, 219.00930989583333, 220.00930989583333, 221.00930989583333, 222.00930989583333, 223.00930989583333], "recent_frames_sha256": "340f7d5c4edb0859b69d8a0af50c875b7c0c70f39312f7d6db2918407c6a4702", "num_recent_frames": 30, "tq": 718948.478453295, "t1": 718957.394729589, "ta": 718957.394729589, "te": 718957.433479589, "first_response_s": 8.916276294039562, "answer_total_s": 8.95502629398834, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_368_a802_q0", "video_id": 368, "time_stamp_s": 224, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6dfe30d3f82a977968665da1c821f62ba125b99c4fce8d5aa52eef9dcfba3477", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand places a white cup under an espresso machine's spout, then removes it after extraction.  \n- The same hand uses a red cloth to wipe the machine's portafilter area after use.  \n- A second cup is positioned nearby, filled with a light brown liquid, likely coffee, while the first cup is being handled.\n[30-60s] - Barista pours steamed milk into espresso, creating a latte art design in a white cup.  \n- The barista hands the finished drink to a customer in a suit, who receives it with a white napkin.  \n- A sink is visible with a faucet, and a small glass container with a dark liquid is being rinsed under running water.\n[60-90s] - Person removes a metal portafilter from a coffee machine, then places it on a scale.  \n- Coffee machine's control panel is visible with illuminated buttons and a digital display.  \n- A tray of pastries sits on the counter to the left of the coffee machine.\n[90-120s] - A hand opens a coffee bag labeled \"Jamaica Estate\" and uses scissors to cut the top.  \n- The bag is then held open, revealing coffee grounds inside, with a sink and various kitchen items visible in the background.  \n- The person’s hands are actively manipulating the bag, preparing to pour or measure the coffee.\n[120-150s] - Hand places a white paper bag onto a red espresso machine's surface, then removes it.  \n- Hand opens a drawer beneath the machine, revealing tools and containers.  \n- Hand reaches for a small, dark object (possibly a tamper or grinder) from the drawer.\n[150-180s] - Hand holds a metal portafilter, positioning it under the espresso machine's group head.  \n- Portafilter is filled with ground coffee, then placed on a digital scale for weight measurement.  \n- Scale displays a reading of approximately 18 grams of coffee grounds.\n[180-210s] - Hand holds a portafilter with ground coffee, positioning it under the espresso machine's group head.  \n- Espresso machine's control panel is visible, with a green display and multiple buttons, indicating readiness for brewing.  \n- The machine's steam wand and water reservoir are visible, with a cup placed nearby for extraction.", "history_tokens": 505, "history_utf8_bytes": 2116, "recent_frame_times_s": [194.00930989583333, 195.00930989583333, 196.00930989583333, 197.00930989583333, 198.00930989583333, 199.00930989583333, 200.00930989583333, 201.00930989583333, 202.00930989583333, 203.00930989583333, 204.00930989583333, 205.00930989583333, 206.00930989583333, 207.00930989583333, 208.00930989583333, 209.00930989583333, 210.00930989583333, 211.00930989583333, 212.00930989583333, 213.00930989583333, 214.00930989583333, 215.00930989583333, 216.00930989583333, 217.00930989583333, 218.00930989583333, 219.00930989583333, 220.00930989583333, 221.00930989583333, 222.00930989583333, 223.00930989583333], "recent_frames_sha256": "340f7d5c4edb0859b69d8a0af50c875b7c0c70f39312f7d6db2918407c6a4702", "num_recent_frames": 30, "tq": 718827.65573067, "t1": 718829.679906025, "ta": 718829.679906025, "te": 718829.722059826, "first_response_s": 2.0241753549780697, "answer_total_s": 2.066329156048596, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 368, "content_group": "d5278cf1a76ffb5fe1dd126f74f63c6c0d4cc0720474859177bda52ab9b02410", "question": {"question_id": "sample_368_a803_q0", "video_id": 368, "video_path": "./videos/sample_368_real.mp4", "annotation_index": 803, "question_index": 0, "question": "Which of the following options best summarizes the actions occurring just now?", "options": ["A. An individual grinds coffee beans, pours them into a filter, and makes a pour-over coffee.", "B. An individual selects a coffee pod, inserts it into a machine, and prepares a cup of coffee.", "C. An individual brews a pot of coffee, pours it into a carafe, and serves it to customers.", "D. An individual measures coffee grounds, tamps them, and prepares an espresso."], "answer": "D", "time_stamp_s": 330, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [321, 331], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_368_a803_q0", "video_id": 368, "time_stamp_s": 330, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3f4dd7d5dbde26abe61b99166fe0ffeeb489417d824bee1f742c52c2b8f21b3f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [300.0093098958333, 301.0093098958333, 302.0093098958333, 303.0093098958333, 304.0093098958333, 305.0093098958333, 306.0093098958333, 307.0093098958333, 308.0093098958333, 309.0093098958333, 310.0093098958333, 311.0093098958333, 312.0093098958333, 313.0093098958333, 314.0093098958333, 315.0093098958333, 316.0093098958333, 317.0093098958333, 318.0093098958333, 319.0093098958333, 320.0093098958333, 321.0093098958333, 322.0093098958333, 323.0093098958333, 324.0093098958333, 325.0093098958333, 326.0093098958333, 327.0093098958333, 328.0093098958333, 329.0093098958333], "recent_frames_sha256": "db63539da6b003e6be675129c85884cea8a048b015c3f4d3bf63061e3c3acd09", "num_recent_frames": 30, "tq": 718957.458861789, "t1": 718969.152901651, "ta": 718969.152901651, "te": 718969.19263267, "first_response_s": 11.694039862020873, "answer_total_s": 11.733770881081, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_368_a803_q0", "video_id": 368, "time_stamp_s": 330, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8d57c923f32925e1ed257a85f7489d70913b56fbf3ad400cc7d3dd6de9607ae6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A hand places a white cup under an espresso machine's spout, then removes it after extraction.  \n- The same hand uses a red cloth to wipe the machine's portafilter area after use.  \n- A second cup is positioned nearby, filled with a light brown liquid, likely coffee, while the first cup is being handled.\n[30-60s] - Barista pours steamed milk into espresso, creating a latte art design in a white cup.  \n- The barista hands the finished drink to a customer in a suit, who receives it with a white napkin.  \n- A sink is visible with a faucet, and a small glass container with a dark liquid is being rinsed under running water.\n[60-90s] - Person removes a metal portafilter from a coffee machine, then places it on a scale.  \n- Coffee machine's control panel is visible with illuminated buttons and a digital display.  \n- A tray of pastries sits on the counter to the left of the coffee machine.\n[90-120s] - A hand opens a coffee bag labeled \"Jamaica Estate\" and uses scissors to cut the top.  \n- The bag is then held open, revealing coffee grounds inside, with a sink and various kitchen items visible in the background.  \n- The person’s hands are actively manipulating the bag, preparing to pour or measure the coffee.\n[120-150s] - Hand places a white paper bag onto a red espresso machine's surface, then removes it.  \n- Hand opens a drawer beneath the machine, revealing tools and containers.  \n- Hand reaches for a small, dark object (possibly a tamper or grinder) from the drawer.\n[150-180s] - Hand holds a metal portafilter, positioning it under the espresso machine's group head.  \n- Portafilter is filled with ground coffee, then placed on a digital scale for weight measurement.  \n- Scale displays a reading of approximately 18 grams of coffee grounds.\n[180-210s] - Hand holds a portafilter with ground coffee, positioning it under the espresso machine's group head.  \n- Espresso machine's control panel is visible, with a green display and multiple buttons, indicating readiness for brewing.  \n- The machine's steam wand and water reservoir are visible, with a cup placed nearby for extraction.\n[210-240s] - Hand holds a metal portafilter with ground coffee, positioned near a digital scale showing weight measurement.  \n- Another hand uses tongs to transfer coffee grounds from a container into the portafilter.  \n- The portafilter is placed on a scale, and the person adjusts its position to ensure proper alignment for grinding.\n[240-270s] - Hand holds a small white cup with a brown liquid, positioned near an espresso machine's portafilter.\n- Two white saucers are placed on a circular metal tray, one being set down by the hand while the other is already on the tray.\n- The hand moves the cup toward the espresso machine, suggesting preparation for serving or brewing.\n[270-300s] - Barista's hand adjusts a knob on the espresso machine's control panel while holding a cup.  \n- The machine's digital display shows \"0.0\" as the brew time or pressure.  \n- A second hand places a cup on the machine's tray, preparing for extraction.\n[300-330s] - Hand holds a black coffee grinder, positioned near a red espresso machine with visible steam wand and control knobs.  \n- A small glass bowl containing ground coffee is placed on a digital scale, while a metal portafilter is held nearby.  \n- The person’s hand moves the portafilter toward the grinder, suggesting preparation for tamping or brewing.", "history_tokens": 810, "history_utf8_bytes": 3419, "recent_frame_times_s": [300.0093098958333, 301.0093098958333, 302.0093098958333, 303.0093098958333, 304.0093098958333, 305.0093098958333, 306.0093098958333, 307.0093098958333, 308.0093098958333, 309.0093098958333, 310.0093098958333, 311.0093098958333, 312.0093098958333, 313.0093098958333, 314.0093098958333, 315.0093098958333, 316.0093098958333, 317.0093098958333, 318.0093098958333, 319.0093098958333, 320.0093098958333, 321.0093098958333, 322.0093098958333, 323.0093098958333, 324.0093098958333, 325.0093098958333, 326.0093098958333, 327.0093098958333, 328.0093098958333, 329.0093098958333], "recent_frames_sha256": "db63539da6b003e6be675129c85884cea8a048b015c3f4d3bf63061e3c3acd09", "num_recent_frames": 30, "tq": 718866.605584214, "t1": 718873.935366946, "ta": 718873.935366946, "te": 718874.333357172, "first_response_s": 7.329782732063904, "answer_total_s": 7.727772957994603, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 368, "content_group": "d5278cf1a76ffb5fe1dd126f74f63c6c0d4cc0720474859177bda52ab9b02410", "question": {"question_id": "sample_368_a804_q0", "video_id": 368, "video_path": "./videos/sample_368_real.mp4", "annotation_index": 804, "question_index": 0, "question": "Which of the following options best summarizes the actions occurring just now?", "options": ["A. An individual measured coffee beans, ground them, and filled a cup with the ground coffee.", "B. An individual steamed milk, brewed an espresso, and combined them to make a latte.", "C. An individual brewed coffee, added sugar, and served it with a stir stick.", "D. An individual brewed an espresso, poured milk into it, and adorned it with a latte art heart."], "answer": "D", "time_stamp_s": 438, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [428, 438], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_368_a804_q0", "video_id": 368, "time_stamp_s": 438, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9b169d07b1510a7bc22115eb09492b07016e3318fa09c0ac0c1c669c9c6d62ee", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [408.0093098958333, 409.0093098958333, 410.0093098958333, 411.0093098958333, 412.0093098958333, 413.0093098958333, 414.0093098958333, 415.0093098958333, 416.0093098958333, 417.0093098958333, 418.0093098958333, 419.0093098958333, 420.0093098958333, 421.0093098958333, 422.0093098958333, 423.0093098958333, 424.0093098958333, 425.0093098958333, 426.0093098958333, 427.0093098958333, 428.0093098958333, 429.0093098958333, 430.0093098958333, 431.0093098958333, 432.0093098958333, 433.0093098958333, 434.0093098958333, 435.0093098958333, 436.0093098958333, 437.0093098958333], "recent_frames_sha256": "f1efc5431adfee0acbba088f992ff968a8ff62035a270b4183d62d0b612ba49a", "num_recent_frames": 30, "tq": 718969.218030341, "t1": 718977.639666417, "ta": 718977.639666417, "te": 718977.841230657, "first_response_s": 8.421636076061986, "answer_total_s": 8.623200315982103, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_368_a804_q0", "video_id": 368, "time_stamp_s": 438, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1f50389dd6d4f80927739334b626c42dc5d7c34f4f0797e38c8f8a9dcd6446f9", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Barista pours steamed milk into espresso, creating a latte art design in a white cup.  \n- The barista hands the finished drink to a customer in a suit, who receives it with a white napkin.  \n- A sink is visible with a faucet, and a small glass container with a dark liquid is being rinsed under running water.\n[60-90s] - Person removes a metal portafilter from a coffee machine, then places it on a scale.  \n- Coffee machine's control panel is visible with illuminated buttons and a digital display.  \n- A tray of pastries sits on the counter to the left of the coffee machine.\n[90-120s] - A hand opens a coffee bag labeled \"Jamaica Estate\" and uses scissors to cut the top.  \n- The bag is then held open, revealing coffee grounds inside, with a sink and various kitchen items visible in the background.  \n- The person’s hands are actively manipulating the bag, preparing to pour or measure the coffee.\n[120-150s] - Hand places a white paper bag onto a red espresso machine's surface, then removes it.  \n- Hand opens a drawer beneath the machine, revealing tools and containers.  \n- Hand reaches for a small, dark object (possibly a tamper or grinder) from the drawer.\n[150-180s] - Hand holds a metal portafilter, positioning it under the espresso machine's group head.  \n- Portafilter is filled with ground coffee, then placed on a digital scale for weight measurement.  \n- Scale displays a reading of approximately 18 grams of coffee grounds.\n[180-210s] - Hand holds a portafilter with ground coffee, positioning it under the espresso machine's group head.  \n- Espresso machine's control panel is visible, with a green display and multiple buttons, indicating readiness for brewing.  \n- The machine's steam wand and water reservoir are visible, with a cup placed nearby for extraction.\n[210-240s] - Hand holds a metal portafilter with ground coffee, positioned near a digital scale showing weight measurement.  \n- Another hand uses tongs to transfer coffee grounds from a container into the portafilter.  \n- The portafilter is placed on a scale, and the person adjusts its position to ensure proper alignment for grinding.\n[240-270s] - Hand holds a small white cup with a brown liquid, positioned near an espresso machine's portafilter.\n- Two white saucers are placed on a circular metal tray, one being set down by the hand while the other is already on the tray.\n- The hand moves the cup toward the espresso machine, suggesting preparation for serving or brewing.\n[270-300s] - Barista's hand adjusts a knob on the espresso machine's control panel while holding a cup.  \n- The machine's digital display shows \"0.0\" as the brew time or pressure.  \n- A second hand places a cup on the machine's tray, preparing for extraction.\n[300-330s] - Hand holds a black coffee grinder, positioned near a red espresso machine with visible steam wand and control knobs.  \n- A small glass bowl containing ground coffee is placed on a digital scale, while a metal portafilter is held nearby.  \n- The person’s hand moves the portafilter toward the grinder, suggesting preparation for tamping or brewing.\n[330-360s] - Hand inserts portafilter into espresso machine group head, preparing for brewing.  \n- Coffee grounds are scooped from a metal container using a spoon, then placed into the portafilter.  \n- Portafilter is secured into the machine, and the machine’s digital display shows brewing parameters.\n[360-390s] - Hand pours milk from a pitcher into a metal cup, then positions the cup under an espresso machine's steam wand.  \n- The espresso machine's steam wand is activated, frothing the milk as the cup is held steady.  \n- After frothing, the hand removes the cup from the steam wand and places it on a tray with other prepared drinks.\n[390-420s] - Hand holds a metal pitcher under espresso machine's steam wand, filling it with steamed milk.  \n- The pitcher is positioned over a pink cloth on the machine's drip tray.  \n- The machine's steam wand is actively steaming milk, creating foam.", "history_tokens": 949, "history_utf8_bytes": 4001, "recent_frame_times_s": [408.0093098958333, 409.0093098958333, 410.0093098958333, 411.0093098958333, 412.0093098958333, 413.0093098958333, 414.0093098958333, 415.0093098958333, 416.0093098958333, 417.0093098958333, 418.0093098958333, 419.0093098958333, 420.0093098958333, 421.0093098958333, 422.0093098958333, 423.0093098958333, 424.0093098958333, 425.0093098958333, 426.0093098958333, 427.0093098958333, 428.0093098958333, 429.0093098958333, 430.0093098958333, 431.0093098958333, 432.0093098958333, 433.0093098958333, 434.0093098958333, 435.0093098958333, 436.0093098958333, 437.0093098958333], "recent_frames_sha256": "f1efc5431adfee0acbba088f992ff968a8ff62035a270b4183d62d0b612ba49a", "num_recent_frames": 30, "tq": 718898.503664018, "t1": 718900.297333752, "ta": 718900.297333752, "te": 718900.498340101, "first_response_s": 1.793669734033756, "answer_total_s": 1.9946760829770938, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 369, "content_group": "e241a085f73c5ef76444982f503c1c7671860c187f1adb8c798a4e9b95b326b4", "question": {"question_id": "sample_369_a33_q0", "video_id": 369, "video_path": "./videos/sample_369_real.mp4", "annotation_index": 33, "question_index": 0, "question": "Which of the following options best summarizes the actions just now?", "options": ["A. The individual cleans the espresso machine and places the portafilter in position.", "B. The individual grinds coffee beans, tamps the ground coffee, and brews an espresso shot.", "C. The individual serves a coffee beverage, cleans up the work area, and restocks coffee supplies.", "D. The individual steams the milk using the steam wand, and prepares it for a coffee beverage."], "answer": "D", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_369_a33_q0", "video_id": 369, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5bf4e415fa6cb4f620ac1e396404b7b084301d9d9031a452de967233bec28fde", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.022981770833333335, 1.0063151041666667, 2.0063151041666667, 3.0063151041666667, 4.006315104166666, 5.006315104166666, 6.006315104166666, 7.006315104166666, 8.006315104166667, 9.006315104166667], "recent_frames_sha256": "323f3b7c71f6d310ba16e7976905fd3748d3aca1b3db0677d2036d4c45db3a7c", "num_recent_frames": 10, "tq": 718422.429045846, "t1": 718432.835648519, "ta": 718432.835648519, "te": 718432.872409701, "first_response_s": 10.406602672999725, "answer_total_s": 10.44336385501083, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_369_a33_q0", "video_id": 369, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e42f9c3e8a1fde650033dad2f68f5a5f41a2709ac71918a3a9b8db0c835a1b71", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.022981770833333335, 1.0063151041666667, 2.0063151041666667, 3.0063151041666667, 4.006315104166666, 5.006315104166666, 6.006315104166666, 7.006315104166666, 8.006315104166667, 9.006315104166667], "recent_frames_sha256": "323f3b7c71f6d310ba16e7976905fd3748d3aca1b3db0677d2036d4c45db3a7c", "num_recent_frames": 10, "tq": 718475.139259789, "t1": 718481.104342625, "ta": 718481.104342625, "te": 718481.441540692, "first_response_s": 5.965082835988142, "answer_total_s": 6.302280902978964, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 369, "content_group": "e241a085f73c5ef76444982f503c1c7671860c187f1adb8c798a4e9b95b326b4", "question": {"question_id": "sample_369_a34_q0", "video_id": 369, "video_path": "./videos/sample_369_real.mp4", "annotation_index": 34, "question_index": 0, "question": "Which of the following options best summarizes the actions just now?", "options": ["A. The individual prepares a hot beverage by steaming milk and selecting a paper cup.", "B. The individual clears the espresso machine area by wiping it clean, rearranging cups, and replacing a filter.", "C. The individual operates the deep fryer to prepare a food item, setting the timer and monitoring the cooking process.", "D. The individual brews an espresso shot by grinding beans, tamping them, and inserting the portafilter into the machine."], "answer": "D", "time_stamp_s": 120, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [110, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_369_a34_q0", "video_id": 369, "time_stamp_s": 120, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "09abcda22ec328344046a2799aba643f16c9331e29f5d7194f464b083f6eaa8a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [90.00631510416666, 91.00631510416666, 92.00631510416666, 93.00631510416666, 94.00631510416666, 95.00631510416666, 96.00631510416666, 97.00631510416666, 98.00631510416666, 99.00631510416666, 100.00631510416666, 101.00631510416666, 102.00631510416666, 103.00631510416666, 104.00631510416666, 105.00631510416666, 106.00631510416666, 107.00631510416666, 108.00631510416666, 109.00631510416666, 110.00631510416666, 111.00631510416666, 112.00631510416666, 113.00631510416666, 114.00631510416666, 115.00631510416666, 116.00631510416666, 117.00631510416666, 118.00631510416666, 119.00631510416666], "recent_frames_sha256": "98be38d3a11ec41806c2800a6e1b617b9ec27968624e0fbf8c4284dd5b7115ac", "num_recent_frames": 30, "tq": 718432.886096395, "t1": 718444.788244509, "ta": 718444.788244509, "te": 718444.826382072, "first_response_s": 11.90214811405167, "answer_total_s": 11.940285676973872, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_369_a34_q0", "video_id": 369, "time_stamp_s": 120, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3e71cd6cfeef9612cb0eedaef23ea977f3049e89b6c54b5d7997f32a2529d563", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands stir milk in a metal pitcher near an espresso machine, then wipe the pitcher with a pink cloth.  \n- A small white cup containing orange liquid is held in one hand while the milk pitcher is held in the other, positioned near a sink.  \n- The espresso machine's portafilter is removed and placed on a metal tray, with a digital scale visible nearby.\n[30-60s] - Barista pours steamed milk into espresso, creating latte art in a white cup.  \n- Cup is placed on a rotating tray, then moved to a digital scale for weighing.  \n- A spoon is used to adjust the latte art, and the cup is set on a saucer before being presented.\n[60-90s] - Hands place a white cup with latte art on a rotating tray, then remove it from the tray.  \n- A hand holds a metal portafilter while another hand uses a tamper to press coffee grounds.  \n- A hand fills a small glass with water from a faucet, then places it on a counter near coffee equipment.\n[90-120s] - Hand holds a portafilter with ground coffee, placing it on a digital scale that reads \"0.00\" grams.  \n- Scale is positioned on a counter next to a coffee machine with multiple knobs and a green circular button.  \n- Background shows stacked white cups and a glass jar with a lid, indicating a coffee shop setting.", "history_tokens": 310, "history_utf8_bytes": 1260, "recent_frame_times_s": [90.00631510416666, 91.00631510416666, 92.00631510416666, 93.00631510416666, 94.00631510416666, 95.00631510416666, 96.00631510416666, 97.00631510416666, 98.00631510416666, 99.00631510416666, 100.00631510416666, 101.00631510416666, 102.00631510416666, 103.00631510416666, 104.00631510416666, 105.00631510416666, 106.00631510416666, 107.00631510416666, 108.00631510416666, 109.00631510416666, 110.00631510416666, 111.00631510416666, 112.00631510416666, 113.00631510416666, 114.00631510416666, 115.00631510416666, 116.00631510416666, 117.00631510416666, 118.00631510416666, 119.00631510416666], "recent_frames_sha256": "98be38d3a11ec41806c2800a6e1b617b9ec27968624e0fbf8c4284dd5b7115ac", "num_recent_frames": 30, "tq": 718513.55086409, "t1": 718520.291125685, "ta": 718520.291125685, "te": 718520.6034884, "first_response_s": 6.740261594997719, "answer_total_s": 7.052624310017563, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 369, "content_group": "e241a085f73c5ef76444982f503c1c7671860c187f1adb8c798a4e9b95b326b4", "question": {"question_id": "sample_369_a35_q0", "video_id": 369, "video_path": "./videos/sample_369_real.mp4", "annotation_index": 35, "question_index": 0, "question": "Which of the following options best summarizes the actions just now?", "options": ["A. The individual brews an espresso shot, mixes it with hot water to create an Americano, and places it on the counter.", "B. The individual dismantles the espresso machine, cleans each part thoroughly, and reassembles it.", "C. The individual heats milk on the stovetop, pours it into a blender, and prepares a smoothie.", "D. The individual operates the espresso machine, froths milk using the steam wand."], "answer": "D", "time_stamp_s": 230, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [220, 230], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_369_a35_q0", "video_id": 369, "time_stamp_s": 230, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "798130cc26712ef867708f3c81a368244db16b48885494a77f5fd3d858f18624", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [200.00631510416667, 201.00631510416667, 202.00631510416667, 203.00631510416667, 204.00631510416667, 205.00631510416667, 206.00631510416667, 207.00631510416667, 208.00631510416667, 209.00631510416667, 210.00631510416667, 211.00631510416667, 212.00631510416667, 213.00631510416667, 214.00631510416667, 215.00631510416667, 216.00631510416667, 217.00631510416667, 218.00631510416667, 219.00631510416667, 220.00631510416667, 221.00631510416667, 222.00631510416667, 223.00631510416667, 224.00631510416667, 225.00631510416667, 226.00631510416667, 227.00631510416667, 228.00631510416667, 229.00631510416667], "recent_frames_sha256": "e46b786f27ad66a6750f5bceb61e7c401453273edaae441e946acab7f10f6329", "num_recent_frames": 30, "tq": 718444.838184793, "t1": 718452.534318177, "ta": 718452.534318177, "te": 718452.57106667, "first_response_s": 7.696133384015411, "answer_total_s": 7.732881876989268, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_369_a35_q0", "video_id": 369, "time_stamp_s": 230, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fbda5d788482e704d9fa38166723e0223bf1f73096195d55f5e69a06a7d15f1b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands stir milk in a metal pitcher near an espresso machine, then wipe the pitcher with a pink cloth.  \n- A small white cup containing orange liquid is held in one hand while the milk pitcher is held in the other, positioned near a sink.  \n- The espresso machine's portafilter is removed and placed on a metal tray, with a digital scale visible nearby.\n[30-60s] - Barista pours steamed milk into espresso, creating latte art in a white cup.  \n- Cup is placed on a rotating tray, then moved to a digital scale for weighing.  \n- A spoon is used to adjust the latte art, and the cup is set on a saucer before being presented.\n[60-90s] - Hands place a white cup with latte art on a rotating tray, then remove it from the tray.  \n- A hand holds a metal portafilter while another hand uses a tamper to press coffee grounds.  \n- A hand fills a small glass with water from a faucet, then places it on a counter near coffee equipment.\n[90-120s] - Hand holds a portafilter with ground coffee, placing it on a digital scale that reads \"0.00\" grams.  \n- Scale is positioned on a counter next to a coffee machine with multiple knobs and a green circular button.  \n- Background shows stacked white cups and a glass jar with a lid, indicating a coffee shop setting.\n[120-150s] - Hand places a metal portafilter onto a digital scale, preparing to weigh coffee grounds.\n- Hand picks up a small container of milk powder and a measuring cup near a sink, suggesting preparation for a milk-based beverage.\n- Coffee machine's control panel is visible with buttons and dials, indicating readiness for brewing.\n[150-180s] - Hand holds a metal cup filled with milk, positioning it under an espresso machine's steam wand.  \n- The machine's steam wand is inserted into the milk, actively frothing it.  \n- A pink cloth is placed under the machine's steam wand to catch drips.\n[180-210s] - Barista pours steamed milk into espresso, creating latte art in a white cup.  \n- Milk pitcher is held steadily while pouring, with a pink cloth nearby on the counter.  \n- Barista moves cup toward a stainless steel machine, likely for final placement or warming.", "history_tokens": 517, "history_utf8_bytes": 2132, "recent_frame_times_s": [200.00631510416667, 201.00631510416667, 202.00631510416667, 203.00631510416667, 204.00631510416667, 205.00631510416667, 206.00631510416667, 207.00631510416667, 208.00631510416667, 209.00631510416667, 210.00631510416667, 211.00631510416667, 212.00631510416667, 213.00631510416667, 214.00631510416667, 215.00631510416667, 216.00631510416667, 217.00631510416667, 218.00631510416667, 219.00631510416667, 220.00631510416667, 221.00631510416667, 222.00631510416667, 223.00631510416667, 224.00631510416667, 225.00631510416667, 226.00631510416667, 227.00631510416667, 228.00631510416667, 229.00631510416667], "recent_frames_sha256": "e46b786f27ad66a6750f5bceb61e7c401453273edaae441e946acab7f10f6329", "num_recent_frames": 30, "tq": 718552.358161179, "t1": 718552.9302246, "ta": 718552.9302246, "te": 718552.967871321, "first_response_s": 0.5720634210156277, "answer_total_s": 0.6097101420164108, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 369, "content_group": "e241a085f73c5ef76444982f503c1c7671860c187f1adb8c798a4e9b95b326b4", "question": {"question_id": "sample_369_a36_q0", "video_id": 369, "video_path": "./videos/sample_369_real.mp4", "annotation_index": 36, "question_index": 0, "question": "Which of the following options best summarizes the actions just now?", "options": ["A. The individual inserts the portafilter into the espresso machine and begins making an espresso shot.", "B. The individual cleans the coffee grinder and refills it with new coffee beans.", "C. The individual inspects the coffee machine, runs a cleaning cycle, and restocks the supply tray.", "D. The individual measures ground coffee, fills the portafilter, and use spoon to adjust it."], "answer": "D", "time_stamp_s": 340, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [330, 340], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_369_a36_q0", "video_id": 369, "time_stamp_s": 340, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ce2a70e968a5666105b0c2d5bb3c79e793927049d83b978c09f7e172be23e26f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [310.0063151041667, 311.0063151041667, 312.0063151041667, 313.0063151041667, 314.0063151041667, 315.0063151041667, 316.0063151041667, 317.0063151041667, 318.0063151041667, 319.0063151041667, 320.0063151041667, 321.0063151041667, 322.0063151041667, 323.0063151041667, 324.0063151041667, 325.0063151041667, 326.0063151041667, 327.0063151041667, 328.0063151041667, 329.0063151041667, 330.0063151041667, 331.0063151041667, 332.0063151041667, 333.0063151041667, 334.0063151041667, 335.0063151041667, 336.0063151041667, 337.0063151041667, 338.0063151041667, 339.0063151041667], "recent_frames_sha256": "0cd946ae6f5081ce4421b99de385f8d9f85c6008e11a5eae742c89277260cb6e", "num_recent_frames": 30, "tq": 718452.579254549, "t1": 718464.715394438, "ta": 718464.715394438, "te": 718464.752725876, "first_response_s": 12.136139889014885, "answer_total_s": 12.173471327056177, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_369_a36_q0", "video_id": 369, "time_stamp_s": 340, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "82c8ea0a08239ec78b85cee1b1ef31a085470fe20cc6d7959434cf953a709704", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands stir milk in a metal pitcher near an espresso machine, then wipe the pitcher with a pink cloth.  \n- A small white cup containing orange liquid is held in one hand while the milk pitcher is held in the other, positioned near a sink.  \n- The espresso machine's portafilter is removed and placed on a metal tray, with a digital scale visible nearby.\n[30-60s] - Barista pours steamed milk into espresso, creating latte art in a white cup.  \n- Cup is placed on a rotating tray, then moved to a digital scale for weighing.  \n- A spoon is used to adjust the latte art, and the cup is set on a saucer before being presented.\n[60-90s] - Hands place a white cup with latte art on a rotating tray, then remove it from the tray.  \n- A hand holds a metal portafilter while another hand uses a tamper to press coffee grounds.  \n- A hand fills a small glass with water from a faucet, then places it on a counter near coffee equipment.\n[90-120s] - Hand holds a portafilter with ground coffee, placing it on a digital scale that reads \"0.00\" grams.  \n- Scale is positioned on a counter next to a coffee machine with multiple knobs and a green circular button.  \n- Background shows stacked white cups and a glass jar with a lid, indicating a coffee shop setting.\n[120-150s] - Hand places a metal portafilter onto a digital scale, preparing to weigh coffee grounds.\n- Hand picks up a small container of milk powder and a measuring cup near a sink, suggesting preparation for a milk-based beverage.\n- Coffee machine's control panel is visible with buttons and dials, indicating readiness for brewing.\n[150-180s] - Hand holds a metal cup filled with milk, positioning it under an espresso machine's steam wand.  \n- The machine's steam wand is inserted into the milk, actively frothing it.  \n- A pink cloth is placed under the machine's steam wand to catch drips.\n[180-210s] - Barista pours steamed milk into espresso, creating latte art in a white cup.  \n- Milk pitcher is held steadily while pouring, with a pink cloth nearby on the counter.  \n- Barista moves cup toward a stainless steel machine, likely for final placement or warming.\n[210-240s] - Hand places a blue cup under espresso machine's spout, then adjusts lever to dispense coffee.  \n- Coffee flows into cup, then hand lifts cup to show frothed milk being poured from a small white bowl.  \n- Espresso machine's steam wand is visible, with a pink cloth underneath the spout.\n[240-270s] - Barista pours steamed milk into a small cup, creating latte art.  \n- A customer in a striped shirt holds a cup while another person places a lid on it.  \n- Barista uses a spoon to stir the coffee in the cup.\n[270-300s] - Hands hold a portafilter with a metal handle, positioning it over a digital scale for weighing coffee grounds.  \n- The scale is placed on a stainless steel countertop near an espresso machine, with a pink cloth nearby.  \n- A person’s hand reaches toward the espresso machine’s group head, preparing to tamping or brewing.\n[300-330s] - Person uses a spoon to scoop coffee grounds into a portafilter, placing it on a digital scale.  \n- The scale displays a weight reading as the person adjusts the portafilter's position.  \n- A sink with a faucet is visible nearby, suggesting preparation for cleaning or rinsing.", "history_tokens": 801, "history_utf8_bytes": 3281, "recent_frame_times_s": [310.0063151041667, 311.0063151041667, 312.0063151041667, 313.0063151041667, 314.0063151041667, 315.0063151041667, 316.0063151041667, 317.0063151041667, 318.0063151041667, 319.0063151041667, 320.0063151041667, 321.0063151041667, 322.0063151041667, 323.0063151041667, 324.0063151041667, 325.0063151041667, 326.0063151041667, 327.0063151041667, 328.0063151041667, 329.0063151041667, 330.0063151041667, 331.0063151041667, 332.0063151041667, 333.0063151041667, 334.0063151041667, 335.0063151041667, 336.0063151041667, 337.0063151041667, 338.0063151041667, 339.0063151041667], "recent_frames_sha256": "0cd946ae6f5081ce4421b99de385f8d9f85c6008e11a5eae742c89277260cb6e", "num_recent_frames": 30, "tq": 718588.504397413, "t1": 718595.773688455, "ta": 718595.773688455, "te": 718595.814742536, "first_response_s": 7.269291042000987, "answer_total_s": 7.310345123056322, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 369, "content_group": "e241a085f73c5ef76444982f503c1c7671860c187f1adb8c798a4e9b95b326b4", "question": {"question_id": "sample_369_a37_q0", "video_id": 369, "video_path": "./videos/sample_369_real.mp4", "annotation_index": 37, "question_index": 0, "question": "Which of the following options best summarizes the actions just now?", "options": ["A. The individual rinses out a used cup and places it in the dishwasher.", "B. The individual refills the coffee machine with water and prepares it for brewing.", "C. The individual measures out coffee grounds and places them into the portafilter.", "D. The individual fills a glass with ice cubes from a container."], "answer": "D", "time_stamp_s": 450, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [440, 450], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_369_a37_q0", "video_id": 369, "time_stamp_s": 450, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2d07136d8e2168eb38bc934139ef94aac5c4fae7182e522c0fcd9be494263cce", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [420.0063151041667, 421.0063151041667, 422.0063151041667, 423.0063151041667, 424.0063151041667, 425.0063151041667, 426.0063151041667, 427.0063151041667, 428.0063151041667, 429.0063151041667, 430.0063151041667, 431.0063151041667, 432.0063151041667, 433.0063151041667, 434.0063151041667, 435.0063151041667, 436.0063151041667, 437.0063151041667, 438.0063151041667, 439.0063151041667, 440.0063151041667, 441.0063151041667, 442.0063151041667, 443.0063151041667, 444.0063151041667, 445.0063151041667, 446.0063151041667, 447.0063151041667, 448.0063151041667, 449.0063151041667], "recent_frames_sha256": "71f162c0cfd33e4a0ff75b56d720f85256b451c2776c589df3da164ccffb8f63", "num_recent_frames": 30, "tq": 718464.761056044, "t1": 718475.095356776, "ta": 718475.095356776, "te": 718475.133064171, "first_response_s": 10.33430073200725, "answer_total_s": 10.37200812692754, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_369_a37_q0", "video_id": 369, "time_stamp_s": 450, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8cc3babb25bd2f4f7516c0cb780b59468158a360a63b43b4550855cde3bbee08", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Barista pours steamed milk into espresso, creating latte art in a white cup.  \n- Cup is placed on a rotating tray, then moved to a digital scale for weighing.  \n- A spoon is used to adjust the latte art, and the cup is set on a saucer before being presented.\n[60-90s] - Hands place a white cup with latte art on a rotating tray, then remove it from the tray.  \n- A hand holds a metal portafilter while another hand uses a tamper to press coffee grounds.  \n- A hand fills a small glass with water from a faucet, then places it on a counter near coffee equipment.\n[90-120s] - Hand holds a portafilter with ground coffee, placing it on a digital scale that reads \"0.00\" grams.  \n- Scale is positioned on a counter next to a coffee machine with multiple knobs and a green circular button.  \n- Background shows stacked white cups and a glass jar with a lid, indicating a coffee shop setting.\n[120-150s] - Hand places a metal portafilter onto a digital scale, preparing to weigh coffee grounds.\n- Hand picks up a small container of milk powder and a measuring cup near a sink, suggesting preparation for a milk-based beverage.\n- Coffee machine's control panel is visible with buttons and dials, indicating readiness for brewing.\n[150-180s] - Hand holds a metal cup filled with milk, positioning it under an espresso machine's steam wand.  \n- The machine's steam wand is inserted into the milk, actively frothing it.  \n- A pink cloth is placed under the machine's steam wand to catch drips.\n[180-210s] - Barista pours steamed milk into espresso, creating latte art in a white cup.  \n- Milk pitcher is held steadily while pouring, with a pink cloth nearby on the counter.  \n- Barista moves cup toward a stainless steel machine, likely for final placement or warming.\n[210-240s] - Hand places a blue cup under espresso machine's spout, then adjusts lever to dispense coffee.  \n- Coffee flows into cup, then hand lifts cup to show frothed milk being poured from a small white bowl.  \n- Espresso machine's steam wand is visible, with a pink cloth underneath the spout.\n[240-270s] - Barista pours steamed milk into a small cup, creating latte art.  \n- A customer in a striped shirt holds a cup while another person places a lid on it.  \n- Barista uses a spoon to stir the coffee in the cup.\n[270-300s] - Hands hold a portafilter with a metal handle, positioning it over a digital scale for weighing coffee grounds.  \n- The scale is placed on a stainless steel countertop near an espresso machine, with a pink cloth nearby.  \n- A person’s hand reaches toward the espresso machine’s group head, preparing to tamping or brewing.\n[300-330s] - Person uses a spoon to scoop coffee grounds into a portafilter, placing it on a digital scale.  \n- The scale displays a weight reading as the person adjusts the portafilter's position.  \n- A sink with a faucet is visible nearby, suggesting preparation for cleaning or rinsing.\n[330-360s] - Hand holds portafilter with ground coffee, placing it on a digital scale for precise measurement.  \n- Scale displays weight as coffee is added, then the portafilter is lifted and moved toward the espresso machine's group head.  \n- Espresso machine's group head is visible with a tamper nearby, indicating preparation for brewing.\n[360-390s] - Hand holds a metal pitcher under espresso machine's steam wand, frothing milk.  \n- Milk pitcher is positioned near a digital scale and pink towel on the counter.  \n- Person moves pitcher away from machine after frothing, then hands it to another person.\n[390-420s] - A hand pours steamed milk into a cup of espresso, creating a latte art design.  \n- The cup is then moved toward a stainless steel sink area where a person in a striped shirt is present.  \n- A hand places a white lid on the cup, followed by a small white container being handed to another person.\n[420-450s] - Hands use a metal tamping tool to press ground coffee into a portafilter, securing it in place.  \n- The portafilter is then inserted into an espresso machine's group head, preparing for brewing.  \n- A hand reaches for a yellow container near a sink, likely to clean or refill equipment.", "history_tokens": 1009, "history_utf8_bytes": 4137, "recent_frame_times_s": [420.0063151041667, 421.0063151041667, 422.0063151041667, 423.0063151041667, 424.0063151041667, 425.0063151041667, 426.0063151041667, 427.0063151041667, 428.0063151041667, 429.0063151041667, 430.0063151041667, 431.0063151041667, 432.0063151041667, 433.0063151041667, 434.0063151041667, 435.0063151041667, 436.0063151041667, 437.0063151041667, 438.0063151041667, 439.0063151041667, 440.0063151041667, 441.0063151041667, 442.0063151041667, 443.0063151041667, 444.0063151041667, 445.0063151041667, 446.0063151041667, 447.0063151041667, 448.0063151041667, 449.0063151041667], "recent_frames_sha256": "71f162c0cfd33e4a0ff75b56d720f85256b451c2776c589df3da164ccffb8f63", "num_recent_frames": 30, "tq": 718630.809366668, "t1": 718638.135959571, "ta": 718638.135959571, "te": 718638.501530116, "first_response_s": 7.326592903002165, "answer_total_s": 7.692163447965868, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 370, "content_group": "859427829de7bd48f78b3a7c2460e1e4e32bf285ed96d95622893cd339aeecc0", "question": {"question_id": "sample_370_a1430_q0", "video_id": 370, "video_path": "./videos/sample_370_real.mp4", "annotation_index": 1430, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. Prepared a cup of coffee, added milk, and served it with biscuits on the side.", "B. cleaned the coffee machine, and wiped down the counter.", "C. Cleaned a cup of coffee, added sugar and cream, and handed it to a customer.", "D. Assembled a coffee machine, ground coffee beans, and served coffee to a customer."], "answer": "B", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_370_a1430_q0", "video_id": 370, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "326af778128cd1ab21c86f2ee1ba3ea2a87ea5c3f29ec88ea69334b4378c0d66", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.019010416666666665, 1.00234375, 2.00234375, 3.00234375, 4.00234375, 5.00234375, 6.00234375, 7.00234375, 8.00234375, 9.00234375], "recent_frames_sha256": "1d0ed544597ab400ca3d7e79ea814a10101c4de5778542c9de07ad71fed86882", "num_recent_frames": 10, "tq": 718567.558641979, "t1": 718574.673086064, "ta": 718574.673086064, "te": 718574.710602686, "first_response_s": 7.11444408504758, "answer_total_s": 7.151960707036778, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_370_a1430_q0", "video_id": 370, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e853d48d0e32efaabacde5d02de35e89b9fdae67ef00401184a59628609f3461", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.019010416666666665, 1.00234375, 2.00234375, 3.00234375, 4.00234375, 5.00234375, 6.00234375, 7.00234375, 8.00234375, 9.00234375], "recent_frames_sha256": "1d0ed544597ab400ca3d7e79ea814a10101c4de5778542c9de07ad71fed86882", "num_recent_frames": 10, "tq": 718619.071190437, "t1": 718625.976922331, "ta": 718625.976922331, "te": 718626.34994934, "first_response_s": 6.9057318940758705, "answer_total_s": 7.278758903034031, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 370, "content_group": "859427829de7bd48f78b3a7c2460e1e4e32bf285ed96d95622893cd339aeecc0", "question": {"question_id": "sample_370_a1431_q0", "video_id": 370, "video_path": "./videos/sample_370_real.mp4", "annotation_index": 1431, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. Filled a pitcher with almond milk, prepared a blender, and blended a smoothie.", "B. Poured milk into a jug, steamed it, and prepared a latte for a customer.", "C. Poured milk into a pitcher, cleaned the workspace, and dumped the used coffee grounds.", "D. Selected multiple milk alternatives, tasted each, and served samples to customers."], "answer": "C", "time_stamp_s": 112, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [102, 112], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_370_a1431_q0", "video_id": 370, "time_stamp_s": 112, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "68cfb9e5087a5a96cfd84179cab036cabdc06482f3e6a35466ce9e5c2daf3fb9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [82.00234375, 83.00234375, 84.00234375, 85.00234375, 86.00234375, 87.00234375, 88.00234375, 89.00234375, 90.00234375, 91.00234375, 92.00234375, 93.00234375, 94.00234375, 95.00234375, 96.00234375, 97.00234375, 98.00234375, 99.00234375, 100.00234375, 101.00234375, 102.00234375, 103.00234375, 104.00234375, 105.00234375, 106.00234375, 107.00234375, 108.00234375, 109.00234375, 110.00234375, 111.00234375], "recent_frames_sha256": "59be8a6300ba744ddb86ce894b78653f8f378fa4a950458e9db835d9071b30d9", "num_recent_frames": 30, "tq": 718574.731529751, "t1": 718582.325185908, "ta": 718582.325185908, "te": 718582.36348895, "first_response_s": 7.593656157026999, "answer_total_s": 7.631959198974073, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_370_a1431_q0", "video_id": 370, "time_stamp_s": 112, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4180e31e117f0a3201132a62305b20e03c74eefae910a0edb0c2131fcbf45c33", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person holds a clear glass, moving it toward a sink while another hand wipes a surface nearby.  \n- A stainless steel sink with a faucet is visible, and the person pours water from the glass into the sink.  \n- Various kitchen items, including a carton of milk, a bottle, and a red cloth, are arranged on the countertop.\n[30-60s] - Person holds a glass measuring cup with water, moving it toward a coffee machine's portafilter area.  \n- They place the cup on a digital scale, then remove it, suggesting a weighing or measurement step.  \n- The coffee machine's portafilter is visible nearby, with a pink cloth resting on its surface.\n[60-90s] - Hand holds portafilter with ground coffee, positioning it under espresso machine's group head.  \n- Espresso machine's group head is visible with red indicator lights and a green steam wand.  \n- Portafilter is inserted into the machine's group head, preparing for extraction.", "history_tokens": 217, "history_utf8_bytes": 926, "recent_frame_times_s": [82.00234375, 83.00234375, 84.00234375, 85.00234375, 86.00234375, 87.00234375, 88.00234375, 89.00234375, 90.00234375, 91.00234375, 92.00234375, 93.00234375, 94.00234375, 95.00234375, 96.00234375, 97.00234375, 98.00234375, 99.00234375, 100.00234375, 101.00234375, 102.00234375, 103.00234375, 104.00234375, 105.00234375, 106.00234375, 107.00234375, 108.00234375, 109.00234375, 110.00234375, 111.00234375], "recent_frames_sha256": "59be8a6300ba744ddb86ce894b78653f8f378fa4a950458e9db835d9071b30d9", "num_recent_frames": 30, "tq": 718649.070489529, "t1": 718649.696954374, "ta": 718649.696954374, "te": 718649.734962236, "first_response_s": 0.6264648449141532, "answer_total_s": 0.6644727069651708, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 370, "content_group": "859427829de7bd48f78b3a7c2460e1e4e32bf285ed96d95622893cd339aeecc0", "question": {"question_id": "sample_370_a1432_q0", "video_id": 370, "video_path": "./videos/sample_370_real.mp4", "annotation_index": 1432, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. Poured water into a cup, added instant coffee, and stirred it.", "B. Poured espresso into a cup, added steamed milk, and created a latte art.", "C. Brewed tea, added sugar, and placed the cup on a tray.", "D. Poured espresso into a cup, cleaned the area, and served the drink without milk."], "answer": "B", "time_stamp_s": 214, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [204, 214], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_370_a1432_q0", "video_id": 370, "time_stamp_s": 214, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2fe50394ebf79af7d433550932f174e22581cbf11302656654587d550ad94adc", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [184.00234375, 185.00234375, 186.00234375, 187.00234375, 188.00234375, 189.00234375, 190.00234375, 191.00234375, 192.00234375, 193.00234375, 194.00234375, 195.00234375, 196.00234375, 197.00234375, 198.00234375, 199.00234375, 200.00234375, 201.00234375, 202.00234375, 203.00234375, 204.00234375, 205.00234375, 206.00234375, 207.00234375, 208.00234375, 209.00234375, 210.00234375, 211.00234375, 212.00234375, 213.00234375], "recent_frames_sha256": "3cfbb387f637ad89a66fced1d066d74d1d25fab00b0deb4d3404dafd53accebf", "num_recent_frames": 30, "tq": 718582.378749612, "t1": 718596.342345142, "ta": 718596.342345142, "te": 718596.379954141, "first_response_s": 13.96359553001821, "answer_total_s": 14.001204528962262, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_370_a1432_q0", "video_id": 370, "time_stamp_s": 214, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "08faa319abe59ec6436511831e0432b90265545e67be8ff571e73c83552264cd", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person holds a clear glass, moving it toward a sink while another hand wipes a surface nearby.  \n- A stainless steel sink with a faucet is visible, and the person pours water from the glass into the sink.  \n- Various kitchen items, including a carton of milk, a bottle, and a red cloth, are arranged on the countertop.\n[30-60s] - Person holds a glass measuring cup with water, moving it toward a coffee machine's portafilter area.  \n- They place the cup on a digital scale, then remove it, suggesting a weighing or measurement step.  \n- The coffee machine's portafilter is visible nearby, with a pink cloth resting on its surface.\n[60-90s] - Hand holds portafilter with ground coffee, positioning it under espresso machine's group head.  \n- Espresso machine's group head is visible with red indicator lights and a green steam wand.  \n- Portafilter is inserted into the machine's group head, preparing for extraction.\n[90-120s] - Hand pours milk from a large white container into a metal measuring cup near a sink.  \n- Hand places the measuring cup on a countertop beside a carton labeled \"RUBBER\" and a metal bowl.  \n- Hand uses a black-handled tool to adjust or operate a machine component near an espresso machine.\n[120-150s] - Hand adjusts a digital scale, then removes a portafilter with ground coffee from it.  \n- The scale is placed on a counter next to a red espresso machine with a visible green button.  \n- A hand presses a button on the espresso machine, which has multiple knobs and a digital display.\n[150-180s] - Hand holds a metal portafilter with ground coffee, positioning it under an espresso machine's group head.  \n- A small metal pitcher is filled with milk, then poured into a larger container, likely for steaming.  \n- A person in dark clothing walks past, carrying a tray, while the coffee machine's digital display shows operational status.\n[180-210s] - Hand holds a stainless steel milk frothing pitcher under espresso machine's steam wand, actively frothing milk.  \n- Milk pitcher is moved away from steam wand after frothing, then placed on countertop.  \n- Espresso machine's portafilter is removed and set aside, revealing a cup of espresso on the machine's drip tray.", "history_tokens": 520, "history_utf8_bytes": 2206, "recent_frame_times_s": [184.00234375, 185.00234375, 186.00234375, 187.00234375, 188.00234375, 189.00234375, 190.00234375, 191.00234375, 192.00234375, 193.00234375, 194.00234375, 195.00234375, 196.00234375, 197.00234375, 198.00234375, 199.00234375, 200.00234375, 201.00234375, 202.00234375, 203.00234375, 204.00234375, 205.00234375, 206.00234375, 207.00234375, 208.00234375, 209.00234375, 210.00234375, 211.00234375, 212.00234375, 213.00234375], "recent_frames_sha256": "3cfbb387f637ad89a66fced1d066d74d1d25fab00b0deb4d3404dafd53accebf", "num_recent_frames": 30, "tq": 718680.730317676, "t1": 718687.565771037, "ta": 718687.565771037, "te": 718687.975526645, "first_response_s": 6.835453361039981, "answer_total_s": 7.245208968990482, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 370, "content_group": "859427829de7bd48f78b3a7c2460e1e4e32bf285ed96d95622893cd339aeecc0", "question": {"question_id": "sample_370_a1433_q0", "video_id": 370, "video_path": "./videos/sample_370_real.mp4", "annotation_index": 1433, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual poured milk into a cup, added sugar, and mixed it, then served the drink to a customer.", "B. The individual poured milk into an espresso shot, added syrup, and served a flavored coffee drink to a customer.", "C. The individual steamed milk, poured it into an espresso shot, and created a latte art before serving it.", "D. The individual brewed coffee, added cream and sugar, then served it to a customer."], "answer": "C", "time_stamp_s": 316, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [306, 316], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_370_a1433_q0", "video_id": 370, "time_stamp_s": 316, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6d3328d617b77bbe1eac413422c178061f351340772a4eabbc611887c160b9f3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [286.00234375, 287.00234375, 288.00234375, 289.00234375, 290.00234375, 291.00234375, 292.00234375, 293.00234375, 294.00234375, 295.00234375, 296.00234375, 297.00234375, 298.00234375, 299.00234375, 300.00234375, 301.00234375, 302.00234375, 303.00234375, 304.00234375, 305.00234375, 306.00234375, 307.00234375, 308.00234375, 309.00234375, 310.00234375, 311.00234375, 312.00234375, 313.00234375, 314.00234375, 315.00234375], "recent_frames_sha256": "62da6440132ca14f304db88f1f86b0ffbb2a7df0aaa3d46bd01cfb1813b6e4c7", "num_recent_frames": 30, "tq": 718596.389112297, "t1": 718609.141671204, "ta": 718609.141671204, "te": 718609.182247998, "first_response_s": 12.752558907028288, "answer_total_s": 12.793135700980201, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_370_a1433_q0", "video_id": 370, "time_stamp_s": 316, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "eecf12a2384827be55f74d806a8e553dddccf7f18e33a41b02786a484f4e9599", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person holds a clear glass, moving it toward a sink while another hand wipes a surface nearby.  \n- A stainless steel sink with a faucet is visible, and the person pours water from the glass into the sink.  \n- Various kitchen items, including a carton of milk, a bottle, and a red cloth, are arranged on the countertop.\n[30-60s] - Person holds a glass measuring cup with water, moving it toward a coffee machine's portafilter area.  \n- They place the cup on a digital scale, then remove it, suggesting a weighing or measurement step.  \n- The coffee machine's portafilter is visible nearby, with a pink cloth resting on its surface.\n[60-90s] - Hand holds portafilter with ground coffee, positioning it under espresso machine's group head.  \n- Espresso machine's group head is visible with red indicator lights and a green steam wand.  \n- Portafilter is inserted into the machine's group head, preparing for extraction.\n[90-120s] - Hand pours milk from a large white container into a metal measuring cup near a sink.  \n- Hand places the measuring cup on a countertop beside a carton labeled \"RUBBER\" and a metal bowl.  \n- Hand uses a black-handled tool to adjust or operate a machine component near an espresso machine.\n[120-150s] - Hand adjusts a digital scale, then removes a portafilter with ground coffee from it.  \n- The scale is placed on a counter next to a red espresso machine with a visible green button.  \n- A hand presses a button on the espresso machine, which has multiple knobs and a digital display.\n[150-180s] - Hand holds a metal portafilter with ground coffee, positioning it under an espresso machine's group head.  \n- A small metal pitcher is filled with milk, then poured into a larger container, likely for steaming.  \n- A person in dark clothing walks past, carrying a tray, while the coffee machine's digital display shows operational status.\n[180-210s] - Hand holds a stainless steel milk frothing pitcher under espresso machine's steam wand, actively frothing milk.  \n- Milk pitcher is moved away from steam wand after frothing, then placed on countertop.  \n- Espresso machine's portafilter is removed and set aside, revealing a cup of espresso on the machine's drip tray.\n[210-240s] - Hand pours steamed milk into espresso cup, creating latte art.  \n- Cup is placed on a rotating metal tray with a saucer underneath.  \n- Background shows a café interior with red booths and tiled floor.\n[240-270s] - A barista hands a latte with latte art to a customer using a metal tray.  \n- The customer’s hands are visible, receiving the cup while another hand holds a spoon.  \n- The espresso machine and sink area are in the background, with a measuring cup being rinsed under running water.\n[270-300s] - Hands hold a metal milk frothing pitcher under espresso machine's steam wand, frothing milk.  \n- After frothing, hands lift pitcher away from steam wand, then move it toward a sink.  \n- A white espresso cup with dark coffee is held in one hand, positioned near the pitcher, ready for milk addition.", "history_tokens": 724, "history_utf8_bytes": 3029, "recent_frame_times_s": [286.00234375, 287.00234375, 288.00234375, 289.00234375, 290.00234375, 291.00234375, 292.00234375, 293.00234375, 294.00234375, 295.00234375, 296.00234375, 297.00234375, 298.00234375, 299.00234375, 300.00234375, 301.00234375, 302.00234375, 303.00234375, 304.00234375, 305.00234375, 306.00234375, 307.00234375, 308.00234375, 309.00234375, 310.00234375, 311.00234375, 312.00234375, 313.00234375, 314.00234375, 315.00234375], "recent_frames_sha256": "62da6440132ca14f304db88f1f86b0ffbb2a7df0aaa3d46bd01cfb1813b6e4c7", "num_recent_frames": 30, "tq": 718714.434411911, "t1": 718716.392139028, "ta": 718716.392139028, "te": 718716.436551591, "first_response_s": 1.957727116998285, "answer_total_s": 2.0021396800875664, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 370, "content_group": "859427829de7bd48f78b3a7c2460e1e4e32bf285ed96d95622893cd339aeecc0", "question": {"question_id": "sample_370_a1434_q0", "video_id": 370, "video_path": "./videos/sample_370_real.mp4", "annotation_index": 1434, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual cleaned the coffee machine, refilled the water tank, and wiped the counter.", "B. The individual ground the coffee, tamped it, locked the portafilter, and started brewing a shot of espresso.", "C. The individual steamed milk, poured it into a pitcher, and created latte art.", "D. The individual packaged pastries, displayed them, and organized the counter."], "answer": "B", "time_stamp_s": 418, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [408, 418], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_370_a1434_q0", "video_id": 370, "time_stamp_s": 418, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b29f5feb786533a7f99c11996d6b5c125479c7ac7eda4da19a6f9a6016e4caa9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [388.00234375, 389.00234375, 390.00234375, 391.00234375, 392.00234375, 393.00234375, 394.00234375, 395.00234375, 396.00234375, 397.00234375, 398.00234375, 399.00234375, 400.00234375, 401.00234375, 402.00234375, 403.00234375, 404.00234375, 405.00234375, 406.00234375, 407.00234375, 408.00234375, 409.00234375, 410.00234375, 411.00234375, 412.00234375, 413.00234375, 414.00234375, 415.00234375, 416.00234375, 417.00234375], "recent_frames_sha256": "168300ada1cf0a86da4f794eff68dd44c1f2206c756f34daa988efae2776c4bc", "num_recent_frames": 30, "tq": 718609.193469791, "t1": 718619.020521106, "ta": 718619.020521106, "te": 718619.060111751, "first_response_s": 9.827051314990968, "answer_total_s": 9.866641959990375, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_370_a1434_q0", "video_id": 370, "time_stamp_s": 418, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5db34a7b262c58356533350ad20bcdee5a62fb0fa14c9917a6c1e1caa10a1b10", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person holds a clear glass, moving it toward a sink while another hand wipes a surface nearby.  \n- A stainless steel sink with a faucet is visible, and the person pours water from the glass into the sink.  \n- Various kitchen items, including a carton of milk, a bottle, and a red cloth, are arranged on the countertop.\n[30-60s] - Person holds a glass measuring cup with water, moving it toward a coffee machine's portafilter area.  \n- They place the cup on a digital scale, then remove it, suggesting a weighing or measurement step.  \n- The coffee machine's portafilter is visible nearby, with a pink cloth resting on its surface.\n[60-90s] - Hand holds portafilter with ground coffee, positioning it under espresso machine's group head.  \n- Espresso machine's group head is visible with red indicator lights and a green steam wand.  \n- Portafilter is inserted into the machine's group head, preparing for extraction.\n[90-120s] - Hand pours milk from a large white container into a metal measuring cup near a sink.  \n- Hand places the measuring cup on a countertop beside a carton labeled \"RUBBER\" and a metal bowl.  \n- Hand uses a black-handled tool to adjust or operate a machine component near an espresso machine.\n[120-150s] - Hand adjusts a digital scale, then removes a portafilter with ground coffee from it.  \n- The scale is placed on a counter next to a red espresso machine with a visible green button.  \n- A hand presses a button on the espresso machine, which has multiple knobs and a digital display.\n[150-180s] - Hand holds a metal portafilter with ground coffee, positioning it under an espresso machine's group head.  \n- A small metal pitcher is filled with milk, then poured into a larger container, likely for steaming.  \n- A person in dark clothing walks past, carrying a tray, while the coffee machine's digital display shows operational status.\n[180-210s] - Hand holds a stainless steel milk frothing pitcher under espresso machine's steam wand, actively frothing milk.  \n- Milk pitcher is moved away from steam wand after frothing, then placed on countertop.  \n- Espresso machine's portafilter is removed and set aside, revealing a cup of espresso on the machine's drip tray.\n[210-240s] - Hand pours steamed milk into espresso cup, creating latte art.  \n- Cup is placed on a rotating metal tray with a saucer underneath.  \n- Background shows a café interior with red booths and tiled floor.\n[240-270s] - A barista hands a latte with latte art to a customer using a metal tray.  \n- The customer’s hands are visible, receiving the cup while another hand holds a spoon.  \n- The espresso machine and sink area are in the background, with a measuring cup being rinsed under running water.\n[270-300s] - Hands hold a metal milk frothing pitcher under espresso machine's steam wand, frothing milk.  \n- After frothing, hands lift pitcher away from steam wand, then move it toward a sink.  \n- A white espresso cup with dark coffee is held in one hand, positioned near the pitcher, ready for milk addition.\n[300-330s] - Hands pour steamed milk into espresso, creating latte art with swirling patterns.  \n- A second identical latte is prepared and held alongside the first.  \n- Both lattes are presented to a customer or colleague, with the barista’s hands visible in the frame.\n[330-360s] - Barista hands hold a latte art cup on a warming tray, then transfer it to a saucer.  \n- Another person’s hands are visible near the counter, holding a spoon and interacting with a container.  \n- The camera pans slightly to show a sink, milk jug, and coffee equipment in the background.\n[360-390s] - Hands pour coffee grounds from a small container into a coffee grinder's hopper.  \n- Grinder's hopper is then secured with a lid, and the machine is adjusted for grinding.  \n- A metal cup is positioned under the grinder's output chute, ready to receive ground coffee.", "history_tokens": 934, "history_utf8_bytes": 3884, "recent_frame_times_s": [388.00234375, 389.00234375, 390.00234375, 391.00234375, 392.00234375, 393.00234375, 394.00234375, 395.00234375, 396.00234375, 397.00234375, 398.00234375, 399.00234375, 400.00234375, 401.00234375, 402.00234375, 403.00234375, 404.00234375, 405.00234375, 406.00234375, 407.00234375, 408.00234375, 409.00234375, 410.00234375, 411.00234375, 412.00234375, 413.00234375, 414.00234375, 415.00234375, 416.00234375, 417.00234375], "recent_frames_sha256": "168300ada1cf0a86da4f794eff68dd44c1f2206c756f34daa988efae2776c4bc", "num_recent_frames": 30, "tq": 718741.629525262, "t1": 718753.440869499, "ta": 718753.440869499, "te": 718753.592399622, "first_response_s": 11.81134423695039, "answer_total_s": 11.962874359916896, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 372, "content_group": "3945bbac28ea7986b0fd4b81d841bc1c65f8e1095c42a51f68537b8bbf24c4ce", "question": {"question_id": "sample_372_a511_q0", "video_id": 372, "video_path": "./videos/sample_372_real.mp4", "annotation_index": 511, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual makes an espresso shot, adds water to it, and prepares it for serving.", "B. The individual heats water, measures coffee grounds, and prepares coffee in a French press.", "C. The individual collects various ingredients, chops them, and prepares a fresh smoothie.", "D. The individual picks up a milk jug, pours milk into a metal pitcher."], "answer": "D", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_372_a511_q0", "video_id": 372, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "55ef49da97d8252705099931fbbe55291c801a2eeeca0b07bf06a17925ab4b95", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.027994791666666668, 1.011328125, 2.011328125, 3.011328125, 4.011328125, 5.011328125, 6.011328125, 7.011328125, 8.011328125, 9.011328125], "recent_frames_sha256": "8f9ea314504b3788268a44f52caabad8204b7fa72ad44983241b757214f06c3e", "num_recent_frames": 10, "tq": 719394.632887185, "t1": 719395.929816793, "ta": 719395.929816793, "te": 719396.15752306, "first_response_s": 1.2969296079827473, "answer_total_s": 1.5246358750155196, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_372_a511_q0", "video_id": 372, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "630428d456473a507e92727e196cac9276a4fd13c2d814e00c099f61463265cf", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.027994791666666668, 1.011328125, 2.011328125, 3.011328125, 4.011328125, 5.011328125, 6.011328125, 7.011328125, 8.011328125, 9.011328125], "recent_frames_sha256": "8f9ea314504b3788268a44f52caabad8204b7fa72ad44983241b757214f06c3e", "num_recent_frames": 10, "tq": 719286.389559234, "t1": 719293.427592353, "ta": 719293.427592353, "te": 719293.46563426, "first_response_s": 7.0380331189371645, "answer_total_s": 7.0760750259505585, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 372, "content_group": "3945bbac28ea7986b0fd4b81d841bc1c65f8e1095c42a51f68537b8bbf24c4ce", "question": {"question_id": "sample_372_a512_q0", "video_id": 372, "video_path": "./videos/sample_372_real.mp4", "annotation_index": 512, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual washed the espresso machine parts and prepared fresh coffee grounds.", "B. The individual brewed tea leaves and poured tea into a cup.", "C. The individual mixed ingredients in a blender to prepare a smoothie.", "D. The individual steamed milk using an espresso machine's steam wand and wiped the steam wand clean."], "answer": "D", "time_stamp_s": 89, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [79, 89], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_372_a512_q0", "video_id": 372, "time_stamp_s": 89, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4d0549e94ddd9b5097885262ecd291d499b3a66d4fd1e7df439e253df836c161", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [59.011328125, 60.011328125, 61.011328125, 62.011328125, 63.011328125, 64.011328125, 65.011328125, 66.011328125, 67.011328125, 68.011328125, 69.011328125, 70.011328125, 71.011328125, 72.011328125, 73.011328125, 74.011328125, 75.011328125, 76.011328125, 77.011328125, 78.011328125, 79.011328125, 80.011328125, 81.011328125, 82.011328125, 83.011328125, 84.011328125, 85.011328125, 86.011328125, 87.011328125, 88.011328125], "recent_frames_sha256": "f00365fc35a89acc5ac918e8de7b5b27d4da894ea9d56df7728a99bab13b0113", "num_recent_frames": 30, "tq": 719396.184389044, "t1": 719402.983737386, "ta": 719402.983737386, "te": 719403.020583063, "first_response_s": 6.7993483419995755, "answer_total_s": 6.83619401906617, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_372_a512_q0", "video_id": 372, "time_stamp_s": 89, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a0bb5c6f3ccefc7c51c5f993905ea5bbff3b82c156c9460d35c00bbe55ac4755", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person pours milk into a metal cup from a white bottle, then places the cup under an espresso machine's portafilter.  \n- Person uses a metal scoop to transfer ground coffee into the portafilter, then positions it under the espresso machine's group head.  \n- Espresso machine is active with a digital display showing brewing parameters, and a cup is placed on the machine's drip tray.\n[30-60s] - Hands use a spoon to transfer ground coffee from a small container into a portafilter, then insert it into the espresso machine's group head.  \n- The portafilter is locked into place, and the machine's lever is pulled down to begin the extraction process.  \n- A small amount of coffee grounds spills onto the counter during the transfer, indicating a minor mess.", "history_tokens": 171, "history_utf8_bytes": 767, "recent_frame_times_s": [59.011328125, 60.011328125, 61.011328125, 62.011328125, 63.011328125, 64.011328125, 65.011328125, 66.011328125, 67.011328125, 68.011328125, 69.011328125, 70.011328125, 71.011328125, 72.011328125, 73.011328125, 74.011328125, 75.011328125, 76.011328125, 77.011328125, 78.011328125, 79.011328125, 80.011328125, 81.011328125, 82.011328125, 83.011328125, 84.011328125, 85.011328125, 86.011328125, 87.011328125, 88.011328125], "recent_frames_sha256": "f00365fc35a89acc5ac918e8de7b5b27d4da894ea9d56df7728a99bab13b0113", "num_recent_frames": 30, "tq": 719310.239475242, "t1": 719317.803401794, "ta": 719317.803401794, "te": 719318.019391793, "first_response_s": 7.563926552073099, "answer_total_s": 7.779916550964117, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 372, "content_group": "3945bbac28ea7986b0fd4b81d841bc1c65f8e1095c42a51f68537b8bbf24c4ce", "question": {"question_id": "sample_372_a513_q0", "video_id": 372, "video_path": "./videos/sample_372_real.mp4", "annotation_index": 513, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual prepares espresso shots while organizing coffee cups and saucers.", "B. The individual brews tea, rinses teapots, and places them on a drying rack.", "C. The individual purchases new coffee supplies and stores them in the kitchen cabinets.", "D. The individual cleans several milk frothing pitchers, rinsing them under running water."], "answer": "D", "time_stamp_s": 165, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [158, 168], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_372_a513_q0", "video_id": 372, "time_stamp_s": 165, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bb6466cfe3d0de0b74304e2a7b268524cc02b8db1f91230be5ffd5ce803e312f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [135.011328125, 136.011328125, 137.011328125, 138.011328125, 139.011328125, 140.011328125, 141.011328125, 142.011328125, 143.011328125, 144.011328125, 145.011328125, 146.011328125, 147.011328125, 148.011328125, 149.011328125, 150.011328125, 151.011328125, 152.011328125, 153.011328125, 154.011328125, 155.011328125, 156.011328125, 157.011328125, 158.011328125, 159.011328125, 160.011328125, 161.011328125, 162.011328125, 163.011328125, 164.011328125], "recent_frames_sha256": "9b1052a11e6b16064288b173ea39a041b17f3bf1a01457bc0f4f3e5f8a399673", "num_recent_frames": 30, "tq": 719403.042238161, "t1": 719410.20769029, "ta": 719410.20769029, "te": 719410.245209479, "first_response_s": 7.165452128974721, "answer_total_s": 7.2029713180381805, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_372_a513_q0", "video_id": 372, "time_stamp_s": 165, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ce5137131f31932c8f2fae7f4d44409d56ed81b3affb18e15d43f361fe633bd4", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person pours milk into a metal cup from a white bottle, then places the cup under an espresso machine's portafilter.  \n- Person uses a metal scoop to transfer ground coffee into the portafilter, then positions it under the espresso machine's group head.  \n- Espresso machine is active with a digital display showing brewing parameters, and a cup is placed on the machine's drip tray.\n[30-60s] - Hands use a spoon to transfer ground coffee from a small container into a portafilter, then insert it into the espresso machine's group head.  \n- The portafilter is locked into place, and the machine's lever is pulled down to begin the extraction process.  \n- A small amount of coffee grounds spills onto the counter during the transfer, indicating a minor mess.\n[60-90s] - Hand holds a metal pitcher filled with steamed milk, positioning it under the espresso machine's steam wand.  \n- The espresso machine's steam wand is actively steaming the milk, causing visible frothing.  \n- A white cup is placed on the machine's drip tray, ready to receive the espresso.\n[90-120s] - Hand holds a small white cup with espresso and adds milk using a spoon, creating a layered drink.  \n- A second hand holds a metal pitcher, likely containing milk or cream, positioned near the cup.  \n- The cup is moved toward a rotating tray with a white plate and a small bowl, suggesting preparation for serving.\n[120-150s] - A person holds a white cup with a spoon, stirring its contents while standing near a rotating tray.  \n- Another person enters the frame, carrying a plate with food, approaching the tray.  \n- The rotating tray displays a small plate with a red and white design, positioned centrally.", "history_tokens": 384, "history_utf8_bytes": 1689, "recent_frame_times_s": [135.011328125, 136.011328125, 137.011328125, 138.011328125, 139.011328125, 140.011328125, 141.011328125, 142.011328125, 143.011328125, 144.011328125, 145.011328125, 146.011328125, 147.011328125, 148.011328125, 149.011328125, 150.011328125, 151.011328125, 152.011328125, 153.011328125, 154.011328125, 155.011328125, 156.011328125, 157.011328125, 158.011328125, 159.011328125, 160.011328125, 161.011328125, 162.011328125, 163.011328125, 164.011328125], "recent_frames_sha256": "9b1052a11e6b16064288b173ea39a041b17f3bf1a01457bc0f4f3e5f8a399673", "num_recent_frames": 30, "tq": 719335.591871851, "t1": 719336.634913304, "ta": 719336.634913304, "te": 719336.675912446, "first_response_s": 1.0430414529982954, "answer_total_s": 1.0840405949857086, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 372, "content_group": "3945bbac28ea7986b0fd4b81d841bc1c65f8e1095c42a51f68537b8bbf24c4ce", "question": {"question_id": "sample_372_a514_q0", "video_id": 372, "video_path": "./videos/sample_372_real.mp4", "annotation_index": 514, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual arranges milk jugs and rinses them under running water, then cleans the countertop.", "B. The individual organizes kitchen utensils, prepares ingredients, and washes dishes in the sink.", "C. The individual identifies dirty items in the workspace, organizes them, and prepares for the next task by collecting utensils.", "D. The individual adjusted coffee machine settings, added coffee to cups while checking printed receipts."], "answer": "D", "time_stamp_s": 290, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [237, 247], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_372_a514_q0", "video_id": 372, "time_stamp_s": 290, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "77221b35e56a4b6d29328c90f7f258913952653d9e9ff71ec7173a6fe1ff8457", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [260.011328125, 261.011328125, 262.011328125, 263.011328125, 264.011328125, 265.011328125, 266.011328125, 267.011328125, 268.011328125, 269.011328125, 270.011328125, 271.011328125, 272.011328125, 273.011328125, 274.011328125, 275.011328125, 276.011328125, 277.011328125, 278.011328125, 279.011328125, 280.011328125, 281.011328125, 282.011328125, 283.011328125, 284.011328125, 285.011328125, 286.011328125, 287.011328125, 288.011328125, 289.011328125], "recent_frames_sha256": "c8f69e869be1a4ad9c87f4d3748c196daf7a67a3ce9a477da77c86d66bd4f639", "num_recent_frames": 30, "tq": 719410.266470543, "t1": 719418.155260233, "ta": 719418.155260233, "te": 719418.193786197, "first_response_s": 7.888789689983241, "answer_total_s": 7.927315654000267, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_372_a514_q0", "video_id": 372, "time_stamp_s": 290, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3bd6b724e67b3165b8a988b12ba8cf82b415f1f50c62bdbb3290f2b50cd7aebe", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person pours milk into a metal cup from a white bottle, then places the cup under an espresso machine's portafilter.  \n- Person uses a metal scoop to transfer ground coffee into the portafilter, then positions it under the espresso machine's group head.  \n- Espresso machine is active with a digital display showing brewing parameters, and a cup is placed on the machine's drip tray.\n[30-60s] - Hands use a spoon to transfer ground coffee from a small container into a portafilter, then insert it into the espresso machine's group head.  \n- The portafilter is locked into place, and the machine's lever is pulled down to begin the extraction process.  \n- A small amount of coffee grounds spills onto the counter during the transfer, indicating a minor mess.\n[60-90s] - Hand holds a metal pitcher filled with steamed milk, positioning it under the espresso machine's steam wand.  \n- The espresso machine's steam wand is actively steaming the milk, causing visible frothing.  \n- A white cup is placed on the machine's drip tray, ready to receive the espresso.\n[90-120s] - Hand holds a small white cup with espresso and adds milk using a spoon, creating a layered drink.  \n- A second hand holds a metal pitcher, likely containing milk or cream, positioned near the cup.  \n- The cup is moved toward a rotating tray with a white plate and a small bowl, suggesting preparation for serving.\n[120-150s] - A person holds a white cup with a spoon, stirring its contents while standing near a rotating tray.  \n- Another person enters the frame, carrying a plate with food, approaching the tray.  \n- The rotating tray displays a small plate with a red and white design, positioned centrally.\n[150-180s] - A person holds a metal portafilter with a white ceramic cup placed on a rotating platform, preparing for coffee extraction.  \n- The person then moves the portafilter to a sink, where they rinse it under running water, likely to clean it after use.  \n- The scene transitions to a coffee machine, where the person places the portafilter into the machine’s group head, indicating readiness for brewing.\n[180-210s] - Hand reaches into a cluttered cabinet to retrieve a pink and white patterned cloth.  \n- Cloth is unwrapped and used to wipe a metal portafilter handle.  \n- Portafilter is placed back on the espresso machine's platform after cleaning.\n[210-240s] - Person holds a portafilter with coffee grounds, then places it on a scale to measure weight.  \n- Another person’s hand reaches for a container of coffee grounds near the scale.  \n- A pink cloth is used to wipe the portafilter after handling.\n[240-270s] - Hand places a small cup into a sink, then picks up a metal container from the counter.  \n- Espresso machine is visible with a green indicator light, and a cup is positioned under the portafilter.  \n- A pink towel is draped over the espresso machine’s handle, and a white cup sits on a tray nearby.", "history_tokens": 681, "history_utf8_bytes": 2921, "recent_frame_times_s": [260.011328125, 261.011328125, 262.011328125, 263.011328125, 264.011328125, 265.011328125, 266.011328125, 267.011328125, 268.011328125, 269.011328125, 270.011328125, 271.011328125, 272.011328125, 273.011328125, 274.011328125, 275.011328125, 276.011328125, 277.011328125, 278.011328125, 279.011328125, 280.011328125, 281.011328125, 282.011328125, 283.011328125, 284.011328125, 285.011328125, 286.011328125, 287.011328125, 288.011328125, 289.011328125], "recent_frames_sha256": "c8f69e869be1a4ad9c87f4d3748c196daf7a67a3ce9a477da77c86d66bd4f639", "num_recent_frames": 30, "tq": 719375.13369068, "t1": 719382.525390135, "ta": 719382.525390135, "te": 719382.563013385, "first_response_s": 7.391699454979971, "answer_total_s": 7.429322705022059, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 372, "content_group": "3945bbac28ea7986b0fd4b81d841bc1c65f8e1095c42a51f68537b8bbf24c4ce", "question": {"question_id": "sample_372_a515_q0", "video_id": 372, "video_path": "./videos/sample_372_real.mp4", "annotation_index": 515, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. The individual collects various bakery items, assembles them on a tray, and prepares to serve them to customers.", "B. The individual picks up a milk jug, prepares milk for steaming, and pours it into a cup for serving.", "C. The individual clears dirty dishes, washes them, and arranges them on a drying rack.", "D. The individual operates the espresso machine, prepares coffee, and serves the freshly brewed coffee to a customer."], "answer": "D", "time_stamp_s": 326, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [316, 326], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_372_a515_q0", "video_id": 372, "time_stamp_s": 326, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "949c49c83dc3fdcaad3be9c09edd8bd9afb5134617c934a962cff905d7e5f420", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [296.011328125, 297.011328125, 298.011328125, 299.011328125, 300.011328125, 301.011328125, 302.011328125, 303.011328125, 304.011328125, 305.011328125, 306.011328125, 307.011328125, 308.011328125, 309.011328125, 310.011328125, 311.011328125, 312.011328125, 313.011328125, 314.011328125, 315.011328125, 316.011328125, 317.011328125, 318.011328125, 319.011328125, 320.011328125, 321.011328125, 322.011328125, 323.011328125, 324.011328125, 325.011328125], "recent_frames_sha256": "394dc0e7f437bbd8af99b91f7046199d73a6cb55d274b4058ef0830fdecb4896", "num_recent_frames": 30, "tq": 719418.214340104, "t1": 719431.320251391, "ta": 719431.320251391, "te": 719431.358589141, "first_response_s": 13.105911287013441, "answer_total_s": 13.144249037024565, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_372_a515_q0", "video_id": 372, "time_stamp_s": 326, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b1d0d6dcad0efcf12f8db1eb4c5d9c6eadbb1250dfe003f777e36282cb99a843", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person pours milk into a metal cup from a white bottle, then places the cup under an espresso machine's portafilter.  \n- Person uses a metal scoop to transfer ground coffee into the portafilter, then positions it under the espresso machine's group head.  \n- Espresso machine is active with a digital display showing brewing parameters, and a cup is placed on the machine's drip tray.\n[30-60s] - Hands use a spoon to transfer ground coffee from a small container into a portafilter, then insert it into the espresso machine's group head.  \n- The portafilter is locked into place, and the machine's lever is pulled down to begin the extraction process.  \n- A small amount of coffee grounds spills onto the counter during the transfer, indicating a minor mess.\n[60-90s] - Hand holds a metal pitcher filled with steamed milk, positioning it under the espresso machine's steam wand.  \n- The espresso machine's steam wand is actively steaming the milk, causing visible frothing.  \n- A white cup is placed on the machine's drip tray, ready to receive the espresso.\n[90-120s] - Hand holds a small white cup with espresso and adds milk using a spoon, creating a layered drink.  \n- A second hand holds a metal pitcher, likely containing milk or cream, positioned near the cup.  \n- The cup is moved toward a rotating tray with a white plate and a small bowl, suggesting preparation for serving.\n[120-150s] - A person holds a white cup with a spoon, stirring its contents while standing near a rotating tray.  \n- Another person enters the frame, carrying a plate with food, approaching the tray.  \n- The rotating tray displays a small plate with a red and white design, positioned centrally.\n[150-180s] - A person holds a metal portafilter with a white ceramic cup placed on a rotating platform, preparing for coffee extraction.  \n- The person then moves the portafilter to a sink, where they rinse it under running water, likely to clean it after use.  \n- The scene transitions to a coffee machine, where the person places the portafilter into the machine’s group head, indicating readiness for brewing.\n[180-210s] - Hand reaches into a cluttered cabinet to retrieve a pink and white patterned cloth.  \n- Cloth is unwrapped and used to wipe a metal portafilter handle.  \n- Portafilter is placed back on the espresso machine's platform after cleaning.\n[210-240s] - Person holds a portafilter with coffee grounds, then places it on a scale to measure weight.  \n- Another person’s hand reaches for a container of coffee grounds near the scale.  \n- A pink cloth is used to wipe the portafilter after handling.\n[240-270s] - Hand places a small cup into a sink, then picks up a metal container from the counter.  \n- Espresso machine is visible with a green indicator light, and a cup is positioned under the portafilter.  \n- A pink towel is draped over the espresso machine’s handle, and a white cup sits on a tray nearby.\n[270-300s] - Hand removes portafilter from espresso machine group head, revealing a small cup of espresso below.  \n- Hand places a white paper napkin on the machine's drip tray.  \n- Hand reaches for a white ceramic cup from a stack on a tray, positioning it near the espresso machine.", "history_tokens": 750, "history_utf8_bytes": 3206, "recent_frame_times_s": [296.011328125, 297.011328125, 298.011328125, 299.011328125, 300.011328125, 301.011328125, 302.011328125, 303.011328125, 304.011328125, 305.011328125, 306.011328125, 307.011328125, 308.011328125, 309.011328125, 310.011328125, 311.011328125, 312.011328125, 313.011328125, 314.011328125, 315.011328125, 316.011328125, 317.011328125, 318.011328125, 319.011328125, 320.011328125, 321.011328125, 322.011328125, 323.011328125, 324.011328125, 325.011328125], "recent_frames_sha256": "394dc0e7f437bbd8af99b91f7046199d73a6cb55d274b4058ef0830fdecb4896", "num_recent_frames": 30, "tq": 719388.086462321, "t1": 719394.370705077, "ta": 719394.370705077, "te": 719394.601553242, "first_response_s": 6.284242755966261, "answer_total_s": 6.515090920962393, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 373, "content_group": "eb536fcd1b13a7967b9d1e3cc620f82094834b51e8428ab61199068d31655afc", "question": {"question_id": "sample_373_a1302_q0", "video_id": 373, "video_path": "./videos/sample_373_real.mp4", "annotation_index": 1302, "question_index": 0, "question": "What best summarizes the process just shown?", "options": ["A. The vendor prepared a burger, toasted the bun, added condiments, and served it to the customer.", "B. The vendor selected hot dogs, prepared a bun, added relish and mustard, and served it to the customer.", "C. The vendor selected several hot dogs, placed them in a container, heated them, and arranged other ingredients.", "D. The vendor cooked hot dogs, placed them in buns, added ketchup and mustard, and served them to the customer."], "answer": "C", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_373_a1302_q0", "video_id": 373, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d103087847324f3bbe3f5543ef1f1ab5cadc3c3e94210c45c3ae6ff3d9b8c292", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "d72484eed30e1e74d105231759d08febeae8f80fa5108eac48337279a1415e63", "num_recent_frames": 10, "tq": 716222.052495672, "t1": 716230.151177161, "ta": 716230.151177161, "te": 716230.188444333, "first_response_s": 8.098681489005685, "answer_total_s": 8.1359486610163, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_373_a1302_q0", "video_id": 373, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f9eed79f06836dd9379024eeef036eac174852c1b6ab973e0b5510e9cb50e8f0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "d72484eed30e1e74d105231759d08febeae8f80fa5108eac48337279a1415e63", "num_recent_frames": 10, "tq": 716289.587041777, "t1": 716296.249202568, "ta": 716296.249202568, "te": 716296.432933078, "first_response_s": 6.662160790991038, "answer_total_s": 6.8458913010545075, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 373, "content_group": "eb536fcd1b13a7967b9d1e3cc620f82094834b51e8428ab61199068d31655afc", "question": {"question_id": "sample_373_a1303_q0", "video_id": 373, "video_path": "./videos/sample_373_real.mp4", "annotation_index": 1303, "question_index": 0, "question": "Which of the following options best summarizes the actions just now?", "options": ["A. The vendor selected condiments, placed them on a tray, and began packaging hot dogs.", "B. The vendor heated hot dogs, added toppings, and handed them to the customer.", "C. The vendor picked up a hot dog bun, retrieved hot dogs from the warmer.", "D. The vendor prepared a salad, added dressings, and served it to the customer."], "answer": "C", "time_stamp_s": 147, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [137, 147], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_373_a1303_q0", "video_id": 373, "time_stamp_s": 147, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a7b0c02612719555429df46e59c1cd9535c2e07ce44fc5d10ed430213934b9cf", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332], "recent_frames_sha256": "be25587161a2546e5b22e2c3e8e08840e1641645e00838726fe3a8225ff503c0", "num_recent_frames": 30, "tq": 716230.21782742, "t1": 716237.689663401, "ta": 716237.689663401, "te": 716237.727166292, "first_response_s": 7.471835981006734, "answer_total_s": 7.509338872041553, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_373_a1303_q0", "video_id": 373, "time_stamp_s": 147, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3c728f5e2efe18402c43cc3f7a8e5b93de23661d147bab999ecd19193c5ce2f3", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A person wearing gloves uses a spatula to scoop food from a metal container into a hot dog bun.  \n- The hot dog stand features multiple metal compartments, a sink, and a checkered floor.  \n- A second person in a blue shirt is visible in the background, standing near the counter.\n[30-60s] - Hand adds mustard to hot dog, then adds chopped onions, followed by a pinkish topping (likely tuna or salmon salad) from a container.  \n- The hot dog is held in a gloved hand while the toppings are applied sequentially.  \n- The hot dog is then placed on a paper towel to absorb excess condiments before being set aside.\n[60-90s] - Hand holds hot dog with chili, then adds yellow mustard from bottle.  \n- Hot dog is topped with corn kernels from a container.  \n- Hand moves to add relish from a separate container.\n[90-120s] - Person holds a hot dog topped with jalapeños and mustard, then adds a topping from a container.  \n- The hot dog is placed on a paper towel on a metal counter, with a tray of toppings visible nearby.  \n- A second hand, wearing a black glove, reaches for a container of toppings while the first hand holds the hot dog.", "history_tokens": 278, "history_utf8_bytes": 1144, "recent_frame_times_s": [117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332], "recent_frames_sha256": "be25587161a2546e5b22e2c3e8e08840e1641645e00838726fe3a8225ff503c0", "num_recent_frames": 30, "tq": 716325.838218757, "t1": 716327.050103108, "ta": 716327.050103108, "te": 716327.087847047, "first_response_s": 1.2118843510979787, "answer_total_s": 1.2496282900683582, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 373, "content_group": "eb536fcd1b13a7967b9d1e3cc620f82094834b51e8428ab61199068d31655afc", "question": {"question_id": "sample_373_a1304_q0", "video_id": 373, "video_path": "./videos/sample_373_real.mp4", "annotation_index": 1304, "question_index": 0, "question": "Which of the following options best summarizes the actions just now?", "options": ["A. The vendor cleaned the workstation, organized utensils, and added new items to the menu.", "B. The vendor adjusted equipment, reviewed the counter area, and greeted a customer.", "C. The vendor retrieved a hot dog bun, used tongs to grab a hot dog, and prepared the bun for assembly.", "D. The vendor heated up condiments, chopped vegetables, and arranged them for a salad."], "answer": "C", "time_stamp_s": 284, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [274, 284], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_373_a1304_q0", "video_id": 373, "time_stamp_s": 284, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "880388f20b6c5c1dc04ccbf5155a2e43ad5b1505f90bbaa0bb614934886ff25f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667], "recent_frames_sha256": "c4d4f0ac4fd910ecb150b439e6e207b05c73b7b958a0bf6f54125d3d2c9ef304", "num_recent_frames": 30, "tq": 716237.751161466, "t1": 716274.369340982, "ta": 716274.369340982, "te": 716274.40698839, "first_response_s": 36.618179516051896, "answer_total_s": 36.65582692401949, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_373_a1304_q0", "video_id": 373, "time_stamp_s": 284, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3ba31e4a5c8a8ba5b7cfa2d6fab323461fa4cc16c548e0fe2d5c42ccef1a826d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A person wearing gloves uses a spatula to scoop food from a metal container into a hot dog bun.  \n- The hot dog stand features multiple metal compartments, a sink, and a checkered floor.  \n- A second person in a blue shirt is visible in the background, standing near the counter.\n[30-60s] - Hand adds mustard to hot dog, then adds chopped onions, followed by a pinkish topping (likely tuna or salmon salad) from a container.  \n- The hot dog is held in a gloved hand while the toppings are applied sequentially.  \n- The hot dog is then placed on a paper towel to absorb excess condiments before being set aside.\n[60-90s] - Hand holds hot dog with chili, then adds yellow mustard from bottle.  \n- Hot dog is topped with corn kernels from a container.  \n- Hand moves to add relish from a separate container.\n[90-120s] - Person holds a hot dog topped with jalapeños and mustard, then adds a topping from a container.  \n- The hot dog is placed on a paper towel on a metal counter, with a tray of toppings visible nearby.  \n- A second hand, wearing a black glove, reaches for a container of toppings while the first hand holds the hot dog.\n[120-150s] - Hand in glove places a paper bag on a counter near a tablet display.  \n- Another hand reaches for a hot dog from a metal tray while a person stands nearby.  \n- A stainless steel food prep station with multiple compartments is visible, with one compartment containing carrots.\n[150-180s] - A person in a white shirt is seen behind a counter, handling items near a glass partition.  \n- The person preparing the hot dog adds ketchup and relish to the bun, then places a pickle on top.  \n- The hot dog is then topped with a creamy substance, likely mayonnaise or a similar condiment.\n[180-210s] - A gloved hand holds a hot dog bun with toppings, positioned over a metal counter.  \n- The other gloved hand reaches for a condiment container, likely to add sauce or relish.  \n- The hot dog is then lifted and moved toward a condiment station with yellow and red dispensers visible.\n[210-240s] - Person holds a hot dog with mustard and adds a topping from a green container.  \n- They place the hot dog on a paper wrapper and then onto a metal counter.  \n- A second person in black gloves is seen nearby, handling a brown paper bag.\n[240-270s] - A gloved hand holds a hot dog bun near a stainless steel counter with multiple compartments.  \n- A person in a dark shirt with \"SYRACUSE\" text stands behind the counter, handling items.  \n- A tablet on a cart displays a screen with text, positioned near a white container and condiment bottles.", "history_tokens": 634, "history_utf8_bytes": 2589, "recent_frame_times_s": [254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667], "recent_frames_sha256": "c4d4f0ac4fd910ecb150b439e6e207b05c73b7b958a0bf6f54125d3d2c9ef304", "num_recent_frames": 30, "tq": 716367.41943065, "t1": 716369.226643196, "ta": 716369.226643196, "te": 716369.268492929, "first_response_s": 1.8072125460021198, "answer_total_s": 1.8490622790995985, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 373, "content_group": "eb536fcd1b13a7967b9d1e3cc620f82094834b51e8428ab61199068d31655afc", "question": {"question_id": "sample_373_a1305_q0", "video_id": 373, "video_path": "./videos/sample_373_real.mp4", "annotation_index": 1305, "question_index": 0, "question": "Which of the following options best summarizes the actions just now?", "options": ["A. The vendor cooked a hot dog, added mustard and ketchup, wrapped it, and served it to the customer.", "B. The vendor grilled a hot dog, added ketchup, placed it on a bun, and served it to the customer without wrapping.", "C. The vendor retrieved a cooked hot dog, added toppings, wrapped it in paper, put it in a bag, and handed it to the customer.", "D. The vendor made a sandwich, added vegetables, wrapped it, and handed it to the customer."], "answer": "C", "time_stamp_s": 420, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [411, 421], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_373_a1305_q0", "video_id": 373, "time_stamp_s": 420, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ab865ec888bf6697dcd851cf3bc83768e7cb0d152a14d6046aa266f0b7ff88c9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665, 394.0269666666667, 395.02796666666666, 396.0289666666667, 397.02996666666667, 398.03096666666664, 399.0319666666667, 400.03296666666665, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186], "recent_frames_sha256": "114ecbb27d0d6c965c097ff2f16a0077415d2b6cfe1439f1491b86025cb3f757", "num_recent_frames": 30, "tq": 716274.426262525, "t1": 716282.480212286, "ta": 716282.480212286, "te": 716282.518962215, "first_response_s": 8.05394976097159, "answer_total_s": 8.092699690023437, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_373_a1305_q0", "video_id": 373, "time_stamp_s": 420, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4594c7af7b103763087b400c76bac347ecefad101e327da824651a29663c267a", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A person wearing gloves uses a spatula to scoop food from a metal container into a hot dog bun.  \n- The hot dog stand features multiple metal compartments, a sink, and a checkered floor.  \n- A second person in a blue shirt is visible in the background, standing near the counter.\n[30-60s] - Hand adds mustard to hot dog, then adds chopped onions, followed by a pinkish topping (likely tuna or salmon salad) from a container.  \n- The hot dog is held in a gloved hand while the toppings are applied sequentially.  \n- The hot dog is then placed on a paper towel to absorb excess condiments before being set aside.\n[60-90s] - Hand holds hot dog with chili, then adds yellow mustard from bottle.  \n- Hot dog is topped with corn kernels from a container.  \n- Hand moves to add relish from a separate container.\n[90-120s] - Person holds a hot dog topped with jalapeños and mustard, then adds a topping from a container.  \n- The hot dog is placed on a paper towel on a metal counter, with a tray of toppings visible nearby.  \n- A second hand, wearing a black glove, reaches for a container of toppings while the first hand holds the hot dog.\n[120-150s] - Hand in glove places a paper bag on a counter near a tablet display.  \n- Another hand reaches for a hot dog from a metal tray while a person stands nearby.  \n- A stainless steel food prep station with multiple compartments is visible, with one compartment containing carrots.\n[150-180s] - A person in a white shirt is seen behind a counter, handling items near a glass partition.  \n- The person preparing the hot dog adds ketchup and relish to the bun, then places a pickle on top.  \n- The hot dog is then topped with a creamy substance, likely mayonnaise or a similar condiment.\n[180-210s] - A gloved hand holds a hot dog bun with toppings, positioned over a metal counter.  \n- The other gloved hand reaches for a condiment container, likely to add sauce or relish.  \n- The hot dog is then lifted and moved toward a condiment station with yellow and red dispensers visible.\n[210-240s] - Person holds a hot dog with mustard and adds a topping from a green container.  \n- They place the hot dog on a paper wrapper and then onto a metal counter.  \n- A second person in black gloves is seen nearby, handling a brown paper bag.\n[240-270s] - A gloved hand holds a hot dog bun near a stainless steel counter with multiple compartments.  \n- A person in a dark shirt with \"SYRACUSE\" text stands behind the counter, handling items.  \n- A tablet on a cart displays a screen with text, positioned near a white container and condiment bottles.\n[270-300s] - A person in a dark shirt with \"BROOKLYN\" text stands behind a stainless steel counter, observing the food preparation.  \n- The camera wearer holds a hot dog bun in one hand and uses tongs to place a sausage into a grease-filled pan.  \n- The counter features multiple stainless steel trays, condiment bottles, and a trash bin, with a red-and-white checkered floor visible beneath.\n[300-330s] - Person holds hot dog with chili and onions, then adds mustard from a yellow squeeze bottle.  \n- Hot dog is topped with shredded cheese, then moved toward a customer.  \n- Counter features metal trays with condiments, and a red-and-white checkered floor is visible.\n[330-360s] - Hand in black glove dips hot dog into a container of green relish.  \n- Hand in clear glove holds the hot dog while the other hand adds relish.  \n- Hot dog is placed on paper towel after being dipped.\n[360-390s] - Person wearing black gloves wipes stainless steel surfaces with a cloth.  \n- Another person in blue shirt and black boots stands near the counter.  \n- A hot dog bun is held in gloved hand, positioned above a simmering liquid in a sink.\n[390-420s] - Hand holds a hot dog with ketchup, then adds relish from a metal container.  \n- Gloved hand uses a utensil to scoop and apply relish onto the hot dog.  \n- Hot dog is placed on a metal counter with other food containers nearby.", "history_tokens": 978, "history_utf8_bytes": 3961, "recent_frame_times_s": [390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665, 394.0269666666667, 395.02796666666666, 396.0289666666667, 397.02996666666667, 398.03096666666664, 399.0319666666667, 400.03296666666665, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186], "recent_frames_sha256": "114ecbb27d0d6c965c097ff2f16a0077415d2b6cfe1439f1491b86025cb3f757", "num_recent_frames": 30, "tq": 716421.091151569, "t1": 716422.717396094, "ta": 716422.717396094, "te": 716422.918758096, "first_response_s": 1.6262445249594748, "answer_total_s": 1.8276065270183608, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 373, "content_group": "eb536fcd1b13a7967b9d1e3cc620f82094834b51e8428ab61199068d31655afc", "question": {"question_id": "sample_373_a1306_q0", "video_id": 373, "video_path": "./videos/sample_373_real.mp4", "annotation_index": 1306, "question_index": 0, "question": "Which of the following options best summarizes the process just shown?", "options": ["A. The vendor grilled a hot dog, placed it in a bun, and added vegetables before serving it to the customer.", "B. The vendor cooked a hot dog, added ketchup and mustard, and wrapped it for the customer.", "C. The vendor prepared a hot dog, added ketchup and onion topping, and handed it to the customer.", "D. The vendor prepared a hot dog, added mayonnaise and mustard, and served it to the customer."], "answer": "C", "time_stamp_s": 562, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [548, 558], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_373_a1306_q0", "video_id": 373, "time_stamp_s": 562, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f93de30103e7f9d227368738ef55b8071aeb0419566574e903fb258d745ca9d4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333, 554.0201333333333, 555.0211333333333, 556.0221333333334, 557.0231333333334, 558.0241333333333, 559.0251333333333, 560.0261333333333, 561.0271333333334], "recent_frames_sha256": "9b5ca569dfd8b5231a51035c90ecda62056bc9da2ac6611bbd0131bf9736fddd", "num_recent_frames": 30, "tq": 716282.538907576, "t1": 716289.539297829, "ta": 716289.539297829, "te": 716289.576695907, "first_response_s": 7.000390253029764, "answer_total_s": 7.037788331042975, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_373_a1306_q0", "video_id": 373, "time_stamp_s": 562, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8456f449da74136ddf3435ea719a2c7ee536f799e39381802ea1885fac3d9c6f", "condition_order": ["recent", "notes"], "memory": "[150-180s] - A person in a white shirt is seen behind a counter, handling items near a glass partition.  \n- The person preparing the hot dog adds ketchup and relish to the bun, then places a pickle on top.  \n- The hot dog is then topped with a creamy substance, likely mayonnaise or a similar condiment.\n[180-210s] - A gloved hand holds a hot dog bun with toppings, positioned over a metal counter.  \n- The other gloved hand reaches for a condiment container, likely to add sauce or relish.  \n- The hot dog is then lifted and moved toward a condiment station with yellow and red dispensers visible.\n[210-240s] - Person holds a hot dog with mustard and adds a topping from a green container.  \n- They place the hot dog on a paper wrapper and then onto a metal counter.  \n- A second person in black gloves is seen nearby, handling a brown paper bag.\n[240-270s] - A gloved hand holds a hot dog bun near a stainless steel counter with multiple compartments.  \n- A person in a dark shirt with \"SYRACUSE\" text stands behind the counter, handling items.  \n- A tablet on a cart displays a screen with text, positioned near a white container and condiment bottles.\n[270-300s] - A person in a dark shirt with \"BROOKLYN\" text stands behind a stainless steel counter, observing the food preparation.  \n- The camera wearer holds a hot dog bun in one hand and uses tongs to place a sausage into a grease-filled pan.  \n- The counter features multiple stainless steel trays, condiment bottles, and a trash bin, with a red-and-white checkered floor visible beneath.\n[300-330s] - Person holds hot dog with chili and onions, then adds mustard from a yellow squeeze bottle.  \n- Hot dog is topped with shredded cheese, then moved toward a customer.  \n- Counter features metal trays with condiments, and a red-and-white checkered floor is visible.\n[330-360s] - Hand in black glove dips hot dog into a container of green relish.  \n- Hand in clear glove holds the hot dog while the other hand adds relish.  \n- Hot dog is placed on paper towel after being dipped.\n[360-390s] - Person wearing black gloves wipes stainless steel surfaces with a cloth.  \n- Another person in blue shirt and black boots stands near the counter.  \n- A hot dog bun is held in gloved hand, positioned above a simmering liquid in a sink.\n[390-420s] - Hand holds a hot dog with ketchup, then adds relish from a metal container.  \n- Gloved hand uses a utensil to scoop and apply relish onto the hot dog.  \n- Hot dog is placed on a metal counter with other food containers nearby.\n[420-450s] - A gloved hand places a brown paper bag onto a metal counter, then moves to another bag, suggesting packaging or preparation for service.  \n- A person in a dark shirt stands near the counter, holding a phone, possibly waiting or observing.  \n- A tablet with a blue screen is visible on a stand, likely used for ordering or transaction processing, positioned near the counter.\n[450-480s] - A gloved hand lifts a metal lid to reveal a container with a yellowish liquid and carrots submerged in it.  \n- The hand then uses a black spatula to scoop the liquid and carrots into a hot dog bun held by another gloved hand.  \n- The hot dog bun, now containing the liquid and carrots, is lifted and moved toward the right side of the frame.\n[480-510s] - Left hand holds a hot dog bun with chili, right hand uses black glove to place it on paper towel.  \n- Right hand then uses black glove to pick up a hot dog from a metal tray.  \n- Hot dog is placed into a bun, then the bun is wrapped in paper towel.\n[510-540s] - A gloved hand places a brown paper bag onto a stainless steel counter, then lifts it to reveal a black object inside.  \n- The hand moves the bag toward a cash register with a touchscreen display, which shows a blue screen with text.  \n- A foil-covered tray is positioned on the counter, with a blue tape edge visible, suggesting it's part of a food preparation or storage setup.", "history_tokens": 972, "history_utf8_bytes": 3924, "recent_frame_times_s": [532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333, 554.0201333333333, 555.0211333333333, 556.0221333333334, 557.0231333333334, 558.0241333333333, 559.0251333333333, 560.0261333333333, 561.0271333333334], "recent_frames_sha256": "9b5ca569dfd8b5231a51035c90ecda62056bc9da2ac6611bbd0131bf9736fddd", "num_recent_frames": 30, "tq": 716456.031491754, "t1": 716463.120744707, "ta": 716463.120744707, "te": 716463.341943747, "first_response_s": 7.089252952951938, "answer_total_s": 7.310451993020251, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 374, "content_group": "04a8d255948fb3e0f8c774f508525d6e7fa144b239bab632798605c72c2391cc", "question": {"question_id": "sample_374_a2201_q0", "video_id": 374, "video_path": "./videos/sample_374_real.mp4", "annotation_index": 2201, "question_index": 0, "question": "Which of the following options best summarizes the actions performed just now?", "options": ["A. The individual grabbed a bottle of condiments, applied them to a hamburger, and closed the sandwich.", "B. The individual washed hands at the sink, selected a large bowl, and began mixing ingredients.", "C. The individual arranged vegetables and meats on a tray and placed it into the oven, setting the timer.", "D. The individual fetched a pack of hot dogs from the refrigerator, closed the refrigerator door, and proceeded with the preparation."], "answer": "D", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_374_a2201_q0", "video_id": 374, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f3bc582ec06cb31efaa035acb7e3c02f163c378df3fbc67b9aa3f11deea10400", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "3e1b7d77821dc6ddc2721452f8304ab18e8398aacf49634edb565d4c0130e312", "num_recent_frames": 10, "tq": 717250.268858912, "t1": 717255.358890924, "ta": 717255.358890924, "te": 717255.39610456, "first_response_s": 5.090032011969015, "answer_total_s": 5.127245647949167, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_374_a2201_q0", "video_id": 374, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6451c4ed328f670cc4951fe1a558e88f1ab05cc23b721016534ba4da958cc3e6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "3e1b7d77821dc6ddc2721452f8304ab18e8398aacf49634edb565d4c0130e312", "num_recent_frames": 10, "tq": 717305.02837723, "t1": 717317.077599627, "ta": 717317.077599627, "te": 717317.435409453, "first_response_s": 12.049222396919504, "answer_total_s": 12.407032222952694, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 374, "content_group": "04a8d255948fb3e0f8c774f508525d6e7fa144b239bab632798605c72c2391cc", "question": {"question_id": "sample_374_a2202_q0", "video_id": 374, "video_path": "./videos/sample_374_real.mp4", "annotation_index": 2202, "question_index": 0, "question": "What activities were performed just now to prepare the hot dog?", "options": ["A. The individual added ketchup to the hot dog, chopped onions, and added them as a topping.", "B. The individual toasted the bun, grilled the hot dog, and served it with French fries.", "C. The individual microwaved the hot dog, added relish, and served it with a cold drink.", "D. The individual added mustard to the hot dog, followed by meat sauce, and topped it with a scoop of mashed potatoes."], "answer": "D", "time_stamp_s": 169, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [159, 169], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_374_a2202_q0", "video_id": 374, "time_stamp_s": 169, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a15212503ae1e1034969a769d2341698216d5fc7131f5b7b48362dd0fb03d854", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668], "recent_frames_sha256": "fd18ea84fd96f2c18cf13ab3a328b21c938cf9c91765c6f88f7325311eabe6d1", "num_recent_frames": 30, "tq": 717255.416153824, "t1": 717270.477955794, "ta": 717270.477955794, "te": 717270.515374649, "first_response_s": 15.061801970005035, "answer_total_s": 15.09922082500998, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_374_a2202_q0", "video_id": 374, "time_stamp_s": 169, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e4ad2f1ee240fa6fcbc3571d0d1bf49858ea5fc3580b31ec5798869d5ce23795", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person wearing gloves opens sausage packages and places sausages into a metal tray.  \n- Kitchen environment features red-and-white checkered flooring, stainless steel counters, and various cooking equipment.  \n- Person holds two packages of sausages, one in each hand, before placing them on the counter.\n[30-60s] - Hands in gloves handle a package of hot dogs, removing it from a plastic bag and placing it on a metal counter.  \n- A second package of hot dogs is opened and its contents are transferred into a metal tray.  \n- The person then places the now-empty plastic bag into a trash bin located under a counter.\n[60-90s] - Hands in gloves handle a hot dog bun, then pick up a sausage from a grease tray.  \n- A red sauce bottle is used to apply ketchup onto the sausage in the bun.  \n- The hot dog is held with the bun facing the camera, showing the sausage and sauce.\n[90-120s] - Hand wearing transparent glove holds a hot dog with mustard, then adds ketchup from a red squeeze bottle.  \n- Gloved hand uses a spatula to scoop sausages from a metal tray, then places them into the hot dog bun.  \n- Background shows a red-and-white checkered floor, yellow condiment dispensers, and a person in a cap standing near the counter.\n[120-150s] - A hand holds a hot dog with mustard being added from a yellow dispenser.  \n- The hot dog is then placed on a paper wrapper on a metal counter.  \n- A gloved hand uses a tool to spread a topping over the hot dog.", "history_tokens": 357, "history_utf8_bytes": 1464, "recent_frame_times_s": [139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668], "recent_frames_sha256": "fd18ea84fd96f2c18cf13ab3a328b21c938cf9c91765c6f88f7325311eabe6d1", "num_recent_frames": 30, "tq": 717359.308897627, "t1": 717366.951180644, "ta": 717366.951180644, "te": 717366.98971785, "first_response_s": 7.642283016932197, "answer_total_s": 7.680820222944021, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 374, "content_group": "04a8d255948fb3e0f8c774f508525d6e7fa144b239bab632798605c72c2391cc", "question": {"question_id": "sample_374_a2203_q0", "video_id": 374, "video_path": "./videos/sample_374_real.mp4", "annotation_index": 2203, "question_index": 0, "question": "Which of the following options best summarizes the actions performed just now?", "options": ["A. The individual seasoned food in a bowl, then proceeded to bake it in the oven.", "B. The individual prepared a beverage, poured it into a cup, and handed it to a customer.", "C. The individual prepared a sandwich, wrapped it in paper, and served it at the counter.", "D. The individual packaged food into a bag, placed it on the counter, and then gave the package to the customer."], "answer": "D", "time_stamp_s": 331, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [318, 328], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_374_a2203_q0", "video_id": 374, "time_stamp_s": 331, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "65e3996a982ab787c5aae7a680a023bab3c842fb15a6c99c3aa5692883506836", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297], "recent_frames_sha256": "382753ea2e0b0a9f01d6f1c9358b0da7b13b100626ecaef3ac4c9b5c3f12e504", "num_recent_frames": 30, "tq": 717270.532817703, "t1": 717279.333213535, "ta": 717279.333213535, "te": 717279.375132819, "first_response_s": 8.800395832047798, "answer_total_s": 8.842315116082318, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_374_a2203_q0", "video_id": 374, "time_stamp_s": 331, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "078a01bb716086c53809e6ff792e78d2ede8940ae2c3e6d59164db281c8b803c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person wearing gloves opens sausage packages and places sausages into a metal tray.  \n- Kitchen environment features red-and-white checkered flooring, stainless steel counters, and various cooking equipment.  \n- Person holds two packages of sausages, one in each hand, before placing them on the counter.\n[30-60s] - Hands in gloves handle a package of hot dogs, removing it from a plastic bag and placing it on a metal counter.  \n- A second package of hot dogs is opened and its contents are transferred into a metal tray.  \n- The person then places the now-empty plastic bag into a trash bin located under a counter.\n[60-90s] - Hands in gloves handle a hot dog bun, then pick up a sausage from a grease tray.  \n- A red sauce bottle is used to apply ketchup onto the sausage in the bun.  \n- The hot dog is held with the bun facing the camera, showing the sausage and sauce.\n[90-120s] - Hand wearing transparent glove holds a hot dog with mustard, then adds ketchup from a red squeeze bottle.  \n- Gloved hand uses a spatula to scoop sausages from a metal tray, then places them into the hot dog bun.  \n- Background shows a red-and-white checkered floor, yellow condiment dispensers, and a person in a cap standing near the counter.\n[120-150s] - A hand holds a hot dog with mustard being added from a yellow dispenser.  \n- The hot dog is then placed on a paper wrapper on a metal counter.  \n- A gloved hand uses a tool to spread a topping over the hot dog.\n[150-180s] - A gloved hand places a hot dog on paper, then uses a spatula to scoop a brown sauce from a metal tray.  \n- Another gloved hand holds a yellow squeeze bottle, likely for condiments, while a third hand prepares a bun.  \n- The hot dog is then topped with a yellow sauce, and the assembly continues on a stainless steel counter with red-and-white tiled flooring.\n[180-210s] - A gloved hand lifts a metal lid to reveal a container of brown seasoning, then moves to another container with yellowish contents.  \n- A hot dog bun is held in the left hand while the right hand uses a tool to scoop yellowish condiment from a container.  \n- The hot dog bun is placed on a metal tray, and a yellow squeeze bottle is used to add condiment to the bun.\n[210-240s] - Hand wearing glove holds a hot dog with mustard, then adds chili sauce from a metal tray.  \n- Another hand in black glove places a paper napkin on the counter near the food trays.  \n- The counter displays multiple metal trays with various condiments and food items, including corn and beans.\n[240-270s] - Hand holds a hot dog bun, then adds chili from a metal tray.  \n- Gloved hand uses a utensil to scoop chili into the bun.  \n- Hot dog is placed on a metal counter with other food trays nearby.\n[270-300s] - Hands in gloves place wrapped food items onto a metal counter surface.  \n- A stainless steel food display unit with multiple compartments is visible, some containing wrapped items.  \n- Yellow cylindrical containers are positioned on the counter near the display unit.\n[300-330s] - A gloved hand picks up a wrapped item from a metal tray, then places it into a brown paper bag.  \n- The paper bag is positioned on the counter, near yellow condiment dispensers and a glass display case.  \n- A customer in a white shirt is visible outside, standing near the counter, while another person in a white shirt is partially visible behind the counter.", "history_tokens": 817, "history_utf8_bytes": 3380, "recent_frame_times_s": [301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297], "recent_frames_sha256": "382753ea2e0b0a9f01d6f1c9358b0da7b13b100626ecaef3ac4c9b5c3f12e504", "num_recent_frames": 30, "tq": 717408.894906161, "t1": 717415.225259062, "ta": 717415.225259062, "te": 717415.5209789, "first_response_s": 6.330352901015431, "answer_total_s": 6.626072739018127, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 374, "content_group": "04a8d255948fb3e0f8c774f508525d6e7fa144b239bab632798605c72c2391cc", "question": {"question_id": "sample_374_a2204_q0", "video_id": 374, "video_path": "./videos/sample_374_real.mp4", "annotation_index": 2204, "question_index": 0, "question": "Which of the following options best summarizes the activities performed just now?", "options": ["A. The individual selected a hot dog bun, retrieved a cooked hot dog from the water, and added ketchup and mustard as condiments.", "B. The individual toasted a hot dog bun, placed a raw hot dog on the grill, and then garnished it with relish and onions.", "C. The individual boiled multiple hot dogs, toasted multiple buns, and served the hot dogs directly to customers without any condiments.", "D. The individual selected a hot dog bun, retrieved a cooked hot dog from the water with tongs, and prepared to finalize the hot dog."], "answer": "D", "time_stamp_s": 487, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [477, 487], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_374_a2204_q0", "video_id": 374, "time_stamp_s": 487, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cac690040b7c3ce732bfdd817932be18ef0e1510cf54093f6647ec3aa63f35d6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [457.02323333333334, 458.0242333333333, 459.02523333333335, 460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667], "recent_frames_sha256": "008b95a42e4b47c9a738620b9d19de2060560f73a2c6ab284390dee6e4408567", "num_recent_frames": 30, "tq": 717279.38818735, "t1": 717291.871459546, "ta": 717291.871459546, "te": 717291.910299144, "first_response_s": 12.483272196026519, "answer_total_s": 12.522111793980002, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_374_a2204_q0", "video_id": 374, "time_stamp_s": 487, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6156a8fd5137e54f8ecc6fc99f1b2f2a0e1150c302b15ba1cafe16e86dc2f9aa", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Hands in gloves handle a hot dog bun, then pick up a sausage from a grease tray.  \n- A red sauce bottle is used to apply ketchup onto the sausage in the bun.  \n- The hot dog is held with the bun facing the camera, showing the sausage and sauce.\n[90-120s] - Hand wearing transparent glove holds a hot dog with mustard, then adds ketchup from a red squeeze bottle.  \n- Gloved hand uses a spatula to scoop sausages from a metal tray, then places them into the hot dog bun.  \n- Background shows a red-and-white checkered floor, yellow condiment dispensers, and a person in a cap standing near the counter.\n[120-150s] - A hand holds a hot dog with mustard being added from a yellow dispenser.  \n- The hot dog is then placed on a paper wrapper on a metal counter.  \n- A gloved hand uses a tool to spread a topping over the hot dog.\n[150-180s] - A gloved hand places a hot dog on paper, then uses a spatula to scoop a brown sauce from a metal tray.  \n- Another gloved hand holds a yellow squeeze bottle, likely for condiments, while a third hand prepares a bun.  \n- The hot dog is then topped with a yellow sauce, and the assembly continues on a stainless steel counter with red-and-white tiled flooring.\n[180-210s] - A gloved hand lifts a metal lid to reveal a container of brown seasoning, then moves to another container with yellowish contents.  \n- A hot dog bun is held in the left hand while the right hand uses a tool to scoop yellowish condiment from a container.  \n- The hot dog bun is placed on a metal tray, and a yellow squeeze bottle is used to add condiment to the bun.\n[210-240s] - Hand wearing glove holds a hot dog with mustard, then adds chili sauce from a metal tray.  \n- Another hand in black glove places a paper napkin on the counter near the food trays.  \n- The counter displays multiple metal trays with various condiments and food items, including corn and beans.\n[240-270s] - Hand holds a hot dog bun, then adds chili from a metal tray.  \n- Gloved hand uses a utensil to scoop chili into the bun.  \n- Hot dog is placed on a metal counter with other food trays nearby.\n[270-300s] - Hands in gloves place wrapped food items onto a metal counter surface.  \n- A stainless steel food display unit with multiple compartments is visible, some containing wrapped items.  \n- Yellow cylindrical containers are positioned on the counter near the display unit.\n[300-330s] - A gloved hand picks up a wrapped item from a metal tray, then places it into a brown paper bag.  \n- The paper bag is positioned on the counter, near yellow condiment dispensers and a glass display case.  \n- A customer in a white shirt is visible outside, standing near the counter, while another person in a white shirt is partially visible behind the counter.\n[330-360s] - Person holds cash and a pen, counting bills near a cash drawer with a purple handle.  \n- Cash drawer is open, revealing stacks of bills and a black pen inside.  \n- Person places cash into the drawer while another person stands nearby, holding a phone.\n[360-390s] - A person's hand lifts a metal tray containing sausages from a food service counter.  \n- The person then uses a cloth to wipe down the stainless steel surface of the counter.  \n- A fork is visible in the person's other hand, resting near the counter's edge.\n[390-420s] - Hand selects a hot dog bun from a plastic-wrapped package on a counter.  \n- Uses a gloved hand to pick up a hot dog from a metal tray filled with sausages.  \n- Adds chili and shredded cheese to the hot dog, holding it in the left hand while assembling.\n[420-450s] - Hand holds a hot dog with fried chicken pieces, moving toward a counter with metal trays.  \n- Gloved hand lifts a metal tray lid to reveal orange-colored food items (possibly carrots or sticks) beneath.  \n- Counter area features yellow condiment bottles and a visible window with outdoor vehicles.\n[450-480s] - A person holds a hot dog bun near a metal tray containing sausages.  \n- Another person is seen rolling a yellow object (possibly a condiment bottle) on the counter.  \n- A child in a green shirt stands behind a glass partition, observing the scene.", "history_tokens": 1015, "history_utf8_bytes": 4125, "recent_frame_times_s": [457.02323333333334, 458.0242333333333, 459.02523333333335, 460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667], "recent_frames_sha256": "008b95a42e4b47c9a738620b9d19de2060560f73a2c6ab284390dee6e4408567", "num_recent_frames": 30, "tq": 717454.054950352, "t1": 717460.440360337, "ta": 717460.440360337, "te": 717460.853091907, "first_response_s": 6.385409985086881, "answer_total_s": 6.798141555045731, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 374, "content_group": "04a8d255948fb3e0f8c774f508525d6e7fa144b239bab632798605c72c2391cc", "question": {"question_id": "sample_374_a2205_q0", "video_id": 374, "video_path": "./videos/sample_374_real.mp4", "annotation_index": 2205, "question_index": 0, "question": "Which of the following options best summarizes the activities performed just now?", "options": ["A. The individual toasted a bun, grilled a hot dog, added ketchup and mustard, and served it to the customer.", "B. The individual selected a hamburger bun, grilled a patty, added cheese, lettuce, and tomato, and served it to the customer.", "C. The individual microwaved a hot dog, placed it in a bun, and added pickles and onions as toppings.", "D. The individual selected a hot dog bun, retrieved a cooked hot dog from the water, placed it in the bun, and added meat sauce as a topping."], "answer": "D", "time_stamp_s": 646, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [636, 646], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_374_a2205_q0", "video_id": 374, "time_stamp_s": 646, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e63bb86799fee54dee60ee9fe5c7daff406a3f5d5447b0bc81cda34e6f56ef68", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [616.0154, 617.0164, 618.0174, 619.0184, 620.0194, 621.0204, 622.0214, 623.0224, 624.0234, 625.0244, 626.0254, 627.0264, 628.0274, 629.0284, 630.0294, 631.0304, 632.0314, 633.0324, 634.0000333333334, 635.0010333333333, 636.0020333333333, 637.0030333333333, 638.0040333333334, 639.0050333333334, 640.0060333333333, 641.0070333333333, 642.0080333333333, 643.0090333333334, 644.0100333333334, 645.0110333333333], "recent_frames_sha256": "5a4d0166d03ffa8f5d8eb169be902e30d2c94a0ba8da7a61562531c286e7f5df", "num_recent_frames": 30, "tq": 717291.921816634, "t1": 717304.977129097, "ta": 717304.977129097, "te": 717305.016537565, "first_response_s": 13.055312462965958, "answer_total_s": 13.094720931025222, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_374_a2205_q0", "video_id": 374, "time_stamp_s": 646, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2c9081fefa6c60f4f719a68c5a682d7325845fae18042848f92d67ba2832f40f", "condition_order": ["recent", "notes"], "memory": "[210-240s] - Hand wearing glove holds a hot dog with mustard, then adds chili sauce from a metal tray.  \n- Another hand in black glove places a paper napkin on the counter near the food trays.  \n- The counter displays multiple metal trays with various condiments and food items, including corn and beans.\n[240-270s] - Hand holds a hot dog bun, then adds chili from a metal tray.  \n- Gloved hand uses a utensil to scoop chili into the bun.  \n- Hot dog is placed on a metal counter with other food trays nearby.\n[270-300s] - Hands in gloves place wrapped food items onto a metal counter surface.  \n- A stainless steel food display unit with multiple compartments is visible, some containing wrapped items.  \n- Yellow cylindrical containers are positioned on the counter near the display unit.\n[300-330s] - A gloved hand picks up a wrapped item from a metal tray, then places it into a brown paper bag.  \n- The paper bag is positioned on the counter, near yellow condiment dispensers and a glass display case.  \n- A customer in a white shirt is visible outside, standing near the counter, while another person in a white shirt is partially visible behind the counter.\n[330-360s] - Person holds cash and a pen, counting bills near a cash drawer with a purple handle.  \n- Cash drawer is open, revealing stacks of bills and a black pen inside.  \n- Person places cash into the drawer while another person stands nearby, holding a phone.\n[360-390s] - A person's hand lifts a metal tray containing sausages from a food service counter.  \n- The person then uses a cloth to wipe down the stainless steel surface of the counter.  \n- A fork is visible in the person's other hand, resting near the counter's edge.\n[390-420s] - Hand selects a hot dog bun from a plastic-wrapped package on a counter.  \n- Uses a gloved hand to pick up a hot dog from a metal tray filled with sausages.  \n- Adds chili and shredded cheese to the hot dog, holding it in the left hand while assembling.\n[420-450s] - Hand holds a hot dog with fried chicken pieces, moving toward a counter with metal trays.  \n- Gloved hand lifts a metal tray lid to reveal orange-colored food items (possibly carrots or sticks) beneath.  \n- Counter area features yellow condiment bottles and a visible window with outdoor vehicles.\n[450-480s] - A person holds a hot dog bun near a metal tray containing sausages.  \n- Another person is seen rolling a yellow object (possibly a condiment bottle) on the counter.  \n- A child in a green shirt stands behind a glass partition, observing the scene.\n[480-510s] - A hand holds a hot dog bun over a metal tray containing sausages.  \n- A person in a red shirt and gloves places the hot dog onto a paper towel.  \n- A customer in a green shirt is visible in the background, standing near the counter.\n[510-540s] - A person in a black glove uses tongs to pick up a sausage from a metal tray.  \n- The sausage is placed onto a hot dog bun held by a gloved hand.  \n- In the background, a child with curly hair sits at a counter, observing the food preparation.\n[540-570s] - Hand holds a hot dog with a sausage, positioned near a metal counter with condiment trays.  \n- Black-gloved hand reaches toward a tray containing chopped onions or similar topping.  \n- Reflection in the counter shows two people standing behind, one holding a phone, near a yellow condiment dispenser.\n[570-600s] - A gloved hand places a paper bag on the counter near the condiment station.  \n- A person in a red shirt stands behind the counter, handling a white bowl.  \n- The camera pans to show a tablet displaying a menu or order screen, positioned on a stand near the counter.\n[600-630s] - A person in black gloves holds an orange tray, positioning it over a metal food prep station.  \n- A man sits on a stool near a stainless steel counter, holding a drink and a plate, appearing relaxed.  \n- The kitchen area features red-and-white checkered flooring, a trash bin, and various food prep equipment.", "history_tokens": 967, "history_utf8_bytes": 3955, "recent_frame_times_s": [616.0154, 617.0164, 618.0174, 619.0184, 620.0194, 621.0204, 622.0214, 623.0224, 624.0234, 625.0244, 626.0254, 627.0264, 628.0274, 629.0284, 630.0294, 631.0304, 632.0314, 633.0324, 634.0000333333334, 635.0010333333333, 636.0020333333333, 637.0030333333333, 638.0040333333334, 639.0050333333334, 640.0060333333333, 641.0070333333333, 642.0080333333333, 643.0090333333334, 644.0100333333334, 645.0110333333333], "recent_frames_sha256": "5a4d0166d03ffa8f5d8eb169be902e30d2c94a0ba8da7a61562531c286e7f5df", "num_recent_frames": 30, "tq": 717503.460931842, "t1": 717511.460194982, "ta": 717511.460194982, "te": 717512.027282361, "first_response_s": 7.999263140023686, "answer_total_s": 8.566350519075058, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 375, "content_group": "5d8eaf01a5f557583f4b5a73a79b6ebbb1945867217710439b52cd954486309b", "question": {"question_id": "sample_375_a902_q0", "video_id": 375, "video_path": "./videos/sample_375_real.mp4", "annotation_index": 902, "question_index": 0, "question": "Which of the following best summarizes the actions taken just now?", "options": ["A. The individual cleaned the kitchen floor using a mop and then organized the countertop.", "B. The individual prepared ingredients, chopped vegetables, and placed them into a frying pan.", "C. The individual unpacked a delivery box, organized the contents, and disposed of the packaging.", "D. The individual washed their hands, applied soap, and rinsed thoroughly under running water."], "answer": "D", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_375_a902_q0", "video_id": 375, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b821f587f1e244243bf6a9b8808791c393ae4efe9d66401a18a1970b45bdc424", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "afa14d68d4cdd7a38c9fd4ee0b863b7517992c827b4b792d2d7f5fc7353843a1", "num_recent_frames": 10, "tq": 718029.751129039, "t1": 718035.784141565, "ta": 718035.784141565, "te": 718035.822568828, "first_response_s": 6.033012525993399, "answer_total_s": 6.071439789026044, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_375_a902_q0", "video_id": 375, "time_stamp_s": 10, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "12e838820b8250ea2fa630eb42ee5228c78ef900a4f9620f6edd8156cfad1cd2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "afa14d68d4cdd7a38c9fd4ee0b863b7517992c827b4b792d2d7f5fc7353843a1", "num_recent_frames": 10, "tq": 718085.181897247, "t1": 718090.696380945, "ta": 718090.696380945, "te": 718090.736624382, "first_response_s": 5.514483698061667, "answer_total_s": 5.5547271349933, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 375, "content_group": "5d8eaf01a5f557583f4b5a73a79b6ebbb1945867217710439b52cd954486309b", "question": {"question_id": "sample_375_a903_q0", "video_id": 375, "video_path": "./videos/sample_375_real.mp4", "annotation_index": 903, "question_index": 0, "question": "Which of the following best summarizes the actions taken just now?", "options": ["A. The individual washed potatoes, chopped them, and started cooking.", "B. The individual peeled potatoes, rinsed them, and placed them in a container.", "C. The individual sorted potatoes, discarded the bad ones, and organized the rest in a basket.", "D. The individual emptied a sack of potatoes into a sink, discarded the sack, and prepared the workstation."], "answer": "D", "time_stamp_s": 59, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [49, 59], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_375_a903_q0", "video_id": 375, "time_stamp_s": 59, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6bbc00e61fd399663106d6025c8db790abfbfacc9f1e366db9aa0af19b7e769d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [29.012316666666667, 30.013316666666668, 31.014316666666666, 32.01531666666666, 33.01631666666667, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.00095, 52.00195, 53.00295, 54.00395, 55.00495, 56.00595, 57.00695, 58.00795], "recent_frames_sha256": "8a79a1398b6de2d6ab37073470ecff346086e374ac6e67c001d7104f4d476e05", "num_recent_frames": 30, "tq": 718035.842694335, "t1": 718047.457601427, "ta": 718047.457601427, "te": 718047.499837693, "first_response_s": 11.614907091949135, "answer_total_s": 11.657143357908353, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_375_a903_q0", "video_id": 375, "time_stamp_s": 59, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "732bc53627f7283e703f757713b33dab04cbce4a99ea2368aabe8d7746539188", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person washes hands under running water in a stainless steel sink, then dries them with a beige cloth.  \n- A stack of pizza boxes labeled \"Pizzeria\" is visible on the right side of the sink.  \n- The person’s hands are visibly wet and soapy during washing, and the cloth is used to dry them thoroughly.", "history_tokens": 78, "history_utf8_bytes": 313, "recent_frame_times_s": [29.012316666666667, 30.013316666666668, 31.014316666666666, 32.01531666666666, 33.01631666666667, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.00095, 52.00195, 53.00295, 54.00395, 55.00495, 56.00595, 57.00695, 58.00795], "recent_frames_sha256": "8a79a1398b6de2d6ab37073470ecff346086e374ac6e67c001d7104f4d476e05", "num_recent_frames": 30, "tq": 718101.493179507, "t1": 718107.821308526, "ta": 718107.821308526, "te": 718107.866676963, "first_response_s": 6.328129019006155, "answer_total_s": 6.373497456079349, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 375, "content_group": "5d8eaf01a5f557583f4b5a73a79b6ebbb1945867217710439b52cd954486309b", "question": {"question_id": "sample_375_a904_q0", "video_id": 375, "video_path": "./videos/sample_375_real.mp4", "annotation_index": 904, "question_index": 0, "question": "Which of the following best summarizes the actions taken just now?", "options": ["A. The individual emptied a bag of potatoes into the sink, washed them under running water, and dried them with a towel.", "B. The individual peeled the potatoes, rinsed them under running water, and placed them in a storage container.", "C. The individual sorted the potatoes, removed any that were spoiled, and organized the rest into neat stacks.", "D. The individual placed potatoes into the sink, washed them under running water, and sliced them using a potato slicer."], "answer": "D", "time_stamp_s": 108, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [98, 108], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_375_a904_q0", "video_id": 375, "time_stamp_s": 108, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "61004f8d552c8825708cd1ed6cf7b3ad3f7a4a57d6190058053692d4bfcedc46", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069], "recent_frames_sha256": "d4756b5b315ccbb0a800fda9f151924d055298181be00fd8addbcd9f3dee3e5c", "num_recent_frames": 30, "tq": 718047.516705193, "t1": 718059.695162074, "ta": 718059.695162074, "te": 718059.732866143, "first_response_s": 12.178456880967133, "answer_total_s": 12.216160950018093, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_375_a904_q0", "video_id": 375, "time_stamp_s": 108, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8804264601329141fd17660557a3a2dae837e2f8f7231cf003cf3d033d9fffb0", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person washes hands under running water in a stainless steel sink, then dries them with a beige cloth.  \n- A stack of pizza boxes labeled \"Pizzeria\" is visible on the right side of the sink.  \n- The person’s hands are visibly wet and soapy during washing, and the cloth is used to dry them thoroughly.\n[30-60s] - Person holds a bag of potatoes labeled \"FRESH POTATOES\" and \"FIVE GUYS\" while standing near a stainless steel sink.  \n- The bag is opened, and potatoes are poured into a green plastic container within the sink.  \n- A second bag of potatoes is visible nearby, with a red trash can positioned to the right of the sink area.\n[60-90s] - Two high-pressure water jets spray potatoes in a stainless steel sink basin, with one jet from the left and one from the right.  \n- A green plastic crate is positioned to the right of the sink basin, likely for collecting washed potatoes.  \n- A hand briefly enters the frame to adjust or interact with the potatoes during the rinsing process.", "history_tokens": 239, "history_utf8_bytes": 1000, "recent_frame_times_s": [78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069], "recent_frames_sha256": "d4756b5b315ccbb0a800fda9f151924d055298181be00fd8addbcd9f3dee3e5c", "num_recent_frames": 30, "tq": 718125.337521751, "t1": 718132.502641781, "ta": 718132.502641781, "te": 718132.652739478, "first_response_s": 7.165120030054823, "answer_total_s": 7.315217727096751, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 375, "content_group": "5d8eaf01a5f557583f4b5a73a79b6ebbb1945867217710439b52cd954486309b", "question": {"question_id": "sample_375_a905_q0", "video_id": 375, "video_path": "./videos/sample_375_real.mp4", "annotation_index": 905, "question_index": 0, "question": "Which of the following best summarizes the actions taken just now?", "options": ["A. The individual boiled potatoes, mashed them, and added seasoning.", "B. The individual peeled potatoes, chopped them, and placed them into a baking dish.", "C. The individual washed potato slices, rinsed them, and placed them into a pot of water.", "D. The individual sliced potatoes, washed the slices in water, and prepared them for cooking."], "answer": "D", "time_stamp_s": 157, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [147, 157], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_375_a905_q0", "video_id": 375, "time_stamp_s": 157, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4ac549edda643d0d8e8d65a35d3b9df4db06c3a5146771830df535beba7f1870", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585], "recent_frames_sha256": "02bfa536cebfc57c19a05cf4534eac85c4673ccf6182cc1d13e5d925be71c025", "num_recent_frames": 30, "tq": 718059.744072449, "t1": 718072.847290004, "ta": 718072.847290004, "te": 718072.884448501, "first_response_s": 13.103217554977164, "answer_total_s": 13.140376052004285, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_375_a905_q0", "video_id": 375, "time_stamp_s": 157, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6c001d6383a7a3c34a11452e20a87ef2bd329ba54803702acb5dcff8a85ddc2f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person washes hands under running water in a stainless steel sink, then dries them with a beige cloth.  \n- A stack of pizza boxes labeled \"Pizzeria\" is visible on the right side of the sink.  \n- The person’s hands are visibly wet and soapy during washing, and the cloth is used to dry them thoroughly.\n[30-60s] - Person holds a bag of potatoes labeled \"FRESH POTATOES\" and \"FIVE GUYS\" while standing near a stainless steel sink.  \n- The bag is opened, and potatoes are poured into a green plastic container within the sink.  \n- A second bag of potatoes is visible nearby, with a red trash can positioned to the right of the sink area.\n[60-90s] - Two high-pressure water jets spray potatoes in a stainless steel sink basin, with one jet from the left and one from the right.  \n- A green plastic crate is positioned to the right of the sink basin, likely for collecting washed potatoes.  \n- A hand briefly enters the frame to adjust or interact with the potatoes during the rinsing process.\n[90-120s] - Hand moves potatoes from steaming sink to green tray in a divided stainless steel sink.  \n- Fries are being transferred from a potato chipper into the green tray, which is positioned next to the steaming potatoes.  \n- The chipper is actively processing potatoes, with cut fries accumulating in the tray.\n[120-150s] - Hand repeatedly places whole potatoes into a grater, producing thin, uniform strips that fall into a metal tray.  \n- Grated potato strips accumulate in a green-lidded tray, while unprocessed potatoes remain in a separate compartment.  \n- A metal basket with a grid pattern is positioned to the right, likely for collecting or transporting the prepared potato strips.", "history_tokens": 394, "history_utf8_bytes": 1696, "recent_frame_times_s": [127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585], "recent_frames_sha256": "02bfa536cebfc57c19a05cf4534eac85c4673ccf6182cc1d13e5d925be71c025", "num_recent_frames": 30, "tq": 718151.189441819, "t1": 718158.690648971, "ta": 718158.690648971, "te": 718158.892708691, "first_response_s": 7.501207152032293, "answer_total_s": 7.703266871976666, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 375, "content_group": "5d8eaf01a5f557583f4b5a73a79b6ebbb1945867217710439b52cd954486309b", "question": {"question_id": "sample_375_a906_q0", "video_id": 375, "video_path": "./videos/sample_375_real.mp4", "annotation_index": 906, "question_index": 0, "question": "Which of the following best summarizes the actions taken just now?", "options": ["A. The individual sliced potatoes thinly, washed them gently under running water, and arranged them on a tray for drying.", "B. The individual poured sliced potatoes into a water bath, agitated them using a strainer, and transferred them to a drying area.", "C. The individual submerged the sliced potatoes in warm water, rinsed them with a colander, and then patted them dry with a cloth.", "D. The individual placed potato slices into a container of water, mixed them vigorously for cleaning, and separated them using a divided compartment."], "answer": "D", "time_stamp_s": 206, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [196, 206], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_375_a906_q0", "video_id": 375, "time_stamp_s": 206, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "28af4949b2f40c364846403ecf0b4c19f032cd6db76da4965ae7c3a399733652", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "61e9bc1c1caa24bf4dfe9ba6a7e2e7ac3c523c8b766627f76b4ad0797a4b668b", "num_recent_frames": 30, "tq": 718072.895940683, "t1": 718085.140098746, "ta": 718085.140098746, "te": 718085.175716415, "first_response_s": 12.244158063083887, "answer_total_s": 12.279775732080452, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_375_a906_q0", "video_id": 375, "time_stamp_s": 206, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3b93d19e29c42719b160bcb75b5e62a4e028f9cd9def01638e45256de3cf9ec0", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person washes hands under running water in a stainless steel sink, then dries them with a beige cloth.  \n- A stack of pizza boxes labeled \"Pizzeria\" is visible on the right side of the sink.  \n- The person’s hands are visibly wet and soapy during washing, and the cloth is used to dry them thoroughly.\n[30-60s] - Person holds a bag of potatoes labeled \"FRESH POTATOES\" and \"FIVE GUYS\" while standing near a stainless steel sink.  \n- The bag is opened, and potatoes are poured into a green plastic container within the sink.  \n- A second bag of potatoes is visible nearby, with a red trash can positioned to the right of the sink area.\n[60-90s] - Two high-pressure water jets spray potatoes in a stainless steel sink basin, with one jet from the left and one from the right.  \n- A green plastic crate is positioned to the right of the sink basin, likely for collecting washed potatoes.  \n- A hand briefly enters the frame to adjust or interact with the potatoes during the rinsing process.\n[90-120s] - Hand moves potatoes from steaming sink to green tray in a divided stainless steel sink.  \n- Fries are being transferred from a potato chipper into the green tray, which is positioned next to the steaming potatoes.  \n- The chipper is actively processing potatoes, with cut fries accumulating in the tray.\n[120-150s] - Hand repeatedly places whole potatoes into a grater, producing thin, uniform strips that fall into a metal tray.  \n- Grated potato strips accumulate in a green-lidded tray, while unprocessed potatoes remain in a separate compartment.  \n- A metal basket with a grid pattern is positioned to the right, likely for collecting or transporting the prepared potato strips.\n[150-180s] - A person uses a green spatula to stir and separate potato strips in a large, bubbling oil fryer.  \n- The fryer has multiple compartments; one holds the potato strips while another contains a grater with partially processed potatoes.  \n- The person’s hands are actively manipulating the food, ensuring even frying, with some strips visibly turning golden.", "history_tokens": 476, "history_utf8_bytes": 2066, "recent_frame_times_s": [176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.00048333333334, 185.00148333333334, 186.00248333333334, 187.00348333333332, 188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048], "recent_frames_sha256": "61e9bc1c1caa24bf4dfe9ba6a7e2e7ac3c523c8b766627f76b4ad0797a4b668b", "num_recent_frames": 30, "tq": 718165.417993863, "t1": 718171.725021004, "ta": 718171.725021004, "te": 718171.951945163, "first_response_s": 6.307027140981518, "answer_total_s": 6.533951299963519, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 376, "content_group": "7822200a03ac3b992dffcc6b8f547df1397f4fb0fe62492a0fe5e36658c824a8", "question": {"question_id": "sample_376_a1475_q0", "video_id": 376, "video_path": "./videos/sample_376_real.mp4", "annotation_index": 1475, "question_index": 0, "question": "Which of the following best summarizes the actions performed just now?", "options": ["A. The individual took vegetables out of the refrigerator, cleaned them, and arranged them on a plate.", "B. The individual retrieved a container with liquid, uncovered it, and began stirring its contents.", "C. The individual operated a deep fryer, cooked food, and placed it into a serving dish.", "D. The individual brewed coffee, poured it into cups, and served them."], "answer": "B", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_376_a1475_q0", "video_id": 376, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "714c9234abe39017d8e6ff628c64fdcda240006254c5b722d854566a50bce611", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "5291d9ca1552c127fae64a7dbd66694eea464c0b865307f6d5c3f4db1cf1d7d8", "num_recent_frames": 10, "tq": 717440.941697357, "t1": 717442.054920873, "ta": 717442.054920873, "te": 717442.092392212, "first_response_s": 1.113223516033031, "answer_total_s": 1.1506948550231755, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_376_a1475_q0", "video_id": 376, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e0e9400baf1e659096ae1cf84ab66a51611d3be794aa0a13f38312e3432b5d01", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "5291d9ca1552c127fae64a7dbd66694eea464c0b865307f6d5c3f4db1cf1d7d8", "num_recent_frames": 10, "tq": 717367.032156399, "t1": 717378.745998193, "ta": 717378.745998193, "te": 717378.783352599, "first_response_s": 11.71384179405868, "answer_total_s": 11.751196200028062, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 376, "content_group": "7822200a03ac3b992dffcc6b8f547df1397f4fb0fe62492a0fe5e36658c824a8", "question": {"question_id": "sample_376_a1476_q0", "video_id": 376, "video_path": "./videos/sample_376_real.mp4", "annotation_index": 1476, "question_index": 0, "question": "Which of the following best summarizes the actions performed just now?", "options": ["A. The individual placed food on a grill, removed gloves, and discarded them in the trash.", "B. The individual cleaned the grill, prepared a sandwich, and discarded waste.", "C. The individual assembled a cooking station, put on gloves, and set up kitchen tools.", "D. The individual operated a fryer, removed food, and placed it into a serving dish."], "answer": "A", "time_stamp_s": 46, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [38, 48], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_376_a1476_q0", "video_id": 376, "time_stamp_s": 46, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5fff6fdc34eff84bc5d78acbc9f20b1671f96f37f6b88c8ba00574e29a1c8030", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665, 20.003316666666667, 21.004316666666668, 22.005316666666666, 23.006316666666667, 24.007316666666668, 25.008316666666666, 26.009316666666667, 27.010316666666668, 28.011316666666666, 29.012316666666667, 30.013316666666668, 31.014316666666666, 32.01531666666666, 33.01631666666667, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336], "recent_frames_sha256": "cdb24663b1fa1011b65e493187132923309686bc3c257c19717431ca8cccef60", "num_recent_frames": 30, "tq": 717442.128939276, "t1": 717448.88053435, "ta": 717448.88053435, "te": 717448.917252279, "first_response_s": 6.751595074078068, "answer_total_s": 6.788313003024086, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_376_a1476_q0", "video_id": 376, "time_stamp_s": 46, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7e1d7009ebf7be9a3fd9aff6ff2de31984f137aee46054d6b248abbb20f473a4", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person wearing gloves lifts a rectangular container filled with brown liquid, tilting it to pour its contents into another container.  \n- The container is moved across a stainless steel counter, with other containers and kitchen equipment visible in the background.  \n- Another person in a blue shirt is seen in the background, standing near racks of trays or equipment.", "history_tokens": 76, "history_utf8_bytes": 380, "recent_frame_times_s": [16.016, 17.000316666666667, 18.001316666666668, 19.002316666666665, 20.003316666666667, 21.004316666666668, 22.005316666666666, 23.006316666666667, 24.007316666666668, 25.008316666666666, 26.009316666666667, 27.010316666666668, 28.011316666666666, 29.012316666666667, 30.013316666666668, 31.014316666666666, 32.01531666666666, 33.01631666666667, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336], "recent_frames_sha256": "cdb24663b1fa1011b65e493187132923309686bc3c257c19717431ca8cccef60", "num_recent_frames": 30, "tq": 717388.638309567, "t1": 717390.137101016, "ta": 717390.137101016, "te": 717390.439507261, "first_response_s": 1.4987914490047842, "answer_total_s": 1.801197694032453, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 376, "content_group": "7822200a03ac3b992dffcc6b8f547df1397f4fb0fe62492a0fe5e36658c824a8", "question": {"question_id": "sample_376_a1477_q0", "video_id": 376, "video_path": "./videos/sample_376_real.mp4", "annotation_index": 1477, "question_index": 0, "question": "Which of the following best summarizes the actions performed just now?", "options": ["A. The individual placed raw meat on a grill and monitored the cooking process.", "B. The individual retrieved cooked meat from a tray and placed it into a serving container.", "C. The individual prepared a sandwich by slicing bread and adding condiments.", "D. The individual operated a coffee machine and served fresh coffee to customers."], "answer": "B", "time_stamp_s": 99, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [76, 86], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_376_a1477_q0", "video_id": 376, "time_stamp_s": 99, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d0559d72c3b2d393ac3975a535ac1fb1f2923631ea3919389cd5595643fe9ba6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333], "recent_frames_sha256": "c1327c21d940a88a95ad4ede01e5d613064a268a50c0ec1f0f00d113efe6fb0b", "num_recent_frames": 30, "tq": 717448.939681904, "t1": 717461.669681549, "ta": 717461.669681549, "te": 717461.856559573, "first_response_s": 12.729999644914642, "answer_total_s": 12.916877668933012, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_376_a1477_q0", "video_id": 376, "time_stamp_s": 99, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "05ee02b57c3bd1f2cc22d18f23a783a3f06aed27350dc68d786b9d81093d2ce6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person wearing gloves lifts a rectangular container filled with brown liquid, tilting it to pour its contents into another container.  \n- The container is moved across a stainless steel counter, with other containers and kitchen equipment visible in the background.  \n- Another person in a blue shirt is seen in the background, standing near racks of trays or equipment.\n[30-60s] - Gloved hands place raw bacon strips onto a hot griddle surface, with a yellow tray holding additional bacon visible nearby.  \n- The griddle is part of a larger commercial kitchen setup, including stacked ovens and a tiled floor.  \n- Bacon is arranged in rows on the griddle, with one hand holding a tray and the other placing bacon, indicating preparation for cooking.\n[60-90s] - A person in a blue shirt stands near a griddle, observing food being cooked.  \n- Another person uses a spatula to flip or move toasted bread slices on the griddle.  \n- A yellow tray is positioned under the griddle, receiving cooked items as they are transferred.", "history_tokens": 227, "history_utf8_bytes": 1034, "recent_frame_times_s": [69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333], "recent_frames_sha256": "c1327c21d940a88a95ad4ede01e5d613064a268a50c0ec1f0f00d113efe6fb0b", "num_recent_frames": 30, "tq": 717408.916188932, "t1": 717415.225259062, "ta": 717415.225259062, "te": 717415.5209789, "first_response_s": 6.309070129995234, "answer_total_s": 6.604789967997931, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 376, "content_group": "7822200a03ac3b992dffcc6b8f547df1397f4fb0fe62492a0fe5e36658c824a8", "question": {"question_id": "sample_376_a1478_q0", "video_id": 376, "video_path": "./videos/sample_376_real.mp4", "annotation_index": 1478, "question_index": 0, "question": "Which of the following best summarizes the actions performed just now?", "options": ["A. The individual deep-fried some meat, drained the excess oil, then garnished it with seasoning.", "B. The individual prepared a pot of stew, added various ingredients, and simmered it.", "C. The individual placed meat in a container, put cooked chicken in the oven, and then prepared buns.", "D. The individual made a salad by adding lettuce, tomatoes, and dressing into a bowl."], "answer": "C", "time_stamp_s": 126, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [114, 124], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_376_a1478_q0", "video_id": 376, "time_stamp_s": 126, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "66fe88799f2965d84a38466c57db40ceaaaf960d6d8d7a754697edcbb69fc2ef", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667], "recent_frames_sha256": "6dd947c8d64b37f3bf5a21b99ee079ecfaafd1e9ba405b5da9e92c2a9aba1895", "num_recent_frames": 30, "tq": 717461.879138946, "t1": 717474.923337678, "ta": 717474.923337678, "te": 717474.962876122, "first_response_s": 13.044198732008226, "answer_total_s": 13.08373717602808, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_376_a1478_q0", "video_id": 376, "time_stamp_s": 126, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e4566601f9753511370f0761aff41f01efcdd7f3f2cf2ecd70f9d1815295c3cf", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person wearing gloves lifts a rectangular container filled with brown liquid, tilting it to pour its contents into another container.  \n- The container is moved across a stainless steel counter, with other containers and kitchen equipment visible in the background.  \n- Another person in a blue shirt is seen in the background, standing near racks of trays or equipment.\n[30-60s] - Gloved hands place raw bacon strips onto a hot griddle surface, with a yellow tray holding additional bacon visible nearby.  \n- The griddle is part of a larger commercial kitchen setup, including stacked ovens and a tiled floor.  \n- Bacon is arranged in rows on the griddle, with one hand holding a tray and the other placing bacon, indicating preparation for cooking.\n[60-90s] - A person in a blue shirt stands near a griddle, observing food being cooked.  \n- Another person uses a spatula to flip or move toasted bread slices on the griddle.  \n- A yellow tray is positioned under the griddle, receiving cooked items as they are transferred.\n[90-120s] - Hand uses fork to spread sauce from a yellow tray onto a sandwich on a griddle.  \n- Sauce tray is positioned under a heated griddle unit with digital display showing \"12:00\".  \n- Griddle surface has multiple sandwiches cooking, with one being flipped or moved by hand.", "history_tokens": 297, "history_utf8_bytes": 1315, "recent_frame_times_s": [96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667], "recent_frames_sha256": "6dd947c8d64b37f3bf5a21b99ee079ecfaafd1e9ba405b5da9e92c2a9aba1895", "num_recent_frames": 30, "tq": 717426.4108232, "t1": 717427.905929856, "ta": 717427.905929856, "te": 717428.206310451, "first_response_s": 1.495106655987911, "answer_total_s": 1.7954872510163113, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 376, "content_group": "7822200a03ac3b992dffcc6b8f547df1397f4fb0fe62492a0fe5e36658c824a8", "question": {"question_id": "sample_376_a1479_q0", "video_id": 376, "video_path": "./videos/sample_376_real.mp4", "annotation_index": 1479, "question_index": 0, "question": "Which of the following best summarizes the actions performed just now?", "options": ["A. The individual grilled a burger patty, added cheese, and placed it on a bun with pickles and onions.", "B. The individual breaded chicken, fried it, and served it with a side of vegetables.", "C. The individual prepared a chicken sandwich by adding BBQ sauce and placing it on a bun with pickled cucumber and onions.", "D. The individual made a dessert by assembling ingredients and placing them into a dessert cup."], "answer": "C", "time_stamp_s": 162, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [152, 162], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_376_a1479_q0", "video_id": 376, "time_stamp_s": 162, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "241e4530fa650a70c7fa3d5327735fad0caa89ceec1d22dad442c9ac0cef775f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085], "recent_frames_sha256": "1e302cad0f153cae762ed422bc4942283d238b9e3a141cfa15bed452fabd4c5e", "num_recent_frames": 30, "tq": 717474.975383982, "t1": 717485.605814998, "ta": 717485.605814998, "te": 717485.644934075, "first_response_s": 10.630431016092189, "answer_total_s": 10.669550093007274, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_376_a1479_q0", "video_id": 376, "time_stamp_s": 162, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "85254cf4a8ec49bdf880d009fbffce5132c660631d8312720f668ebe43a7e699", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person wearing gloves lifts a rectangular container filled with brown liquid, tilting it to pour its contents into another container.  \n- The container is moved across a stainless steel counter, with other containers and kitchen equipment visible in the background.  \n- Another person in a blue shirt is seen in the background, standing near racks of trays or equipment.\n[30-60s] - Gloved hands place raw bacon strips onto a hot griddle surface, with a yellow tray holding additional bacon visible nearby.  \n- The griddle is part of a larger commercial kitchen setup, including stacked ovens and a tiled floor.  \n- Bacon is arranged in rows on the griddle, with one hand holding a tray and the other placing bacon, indicating preparation for cooking.\n[60-90s] - A person in a blue shirt stands near a griddle, observing food being cooked.  \n- Another person uses a spatula to flip or move toasted bread slices on the griddle.  \n- A yellow tray is positioned under the griddle, receiving cooked items as they are transferred.\n[90-120s] - Hand uses fork to spread sauce from a yellow tray onto a sandwich on a griddle.  \n- Sauce tray is positioned under a heated griddle unit with digital display showing \"12:00\".  \n- Griddle surface has multiple sandwiches cooking, with one being flipped or moved by hand.\n[120-150s] - Hands in gloves place buns into a slicing machine, then remove sliced buns.  \n- Buns are moved to a tray and placed into a refrigerated compartment with other food items.  \n- The tray is positioned under a display case with various condiments and toppings.", "history_tokens": 363, "history_utf8_bytes": 1585, "recent_frame_times_s": [132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085], "recent_frames_sha256": "1e302cad0f153cae762ed422bc4942283d238b9e3a141cfa15bed452fabd4c5e", "num_recent_frames": 30, "tq": 717432.799682947, "t1": 717440.880113476, "ta": 717440.880113476, "te": 717440.918230511, "first_response_s": 8.080430528963916, "answer_total_s": 8.118547564023174, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 378, "content_group": "f8c17f0e69eec734f988bd70251551aab389bb91e1b08883f02c64fd95d1a3c2", "question": {"question_id": "sample_378_a1132_q0", "video_id": 378, "video_path": "./videos/sample_378_real.mp4", "annotation_index": 1132, "question_index": 0, "question": "Which of the following options best summarizes the actions performed just now?", "options": ["A. The worker searched for ingredients by opening cans and containers, selecting items to prepare a salad.", "B. The worker prepared a sandwich by taking bread, adding condiments, and wrapping it.", "C. The worker wore gloves and prepared to assemble a sandwich, with loaves of bread and various fillings visible.", "D. The worker cleaned the workstation and disposed of the packaging of sandwich ingredients."], "answer": "C", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_378_a1132_q0", "video_id": 378, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "74381d3c50b643108eab8ab1eb3e0390e58b8b307862960b011860c23c8825a0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "6d52f87fd784bc3dece54c837a9736399519b86c6fb822bff6d1793b05d13831", "num_recent_frames": 10, "tq": 715989.268500207, "t1": 716000.058235674, "ta": 716000.058235674, "te": 716000.096266263, "first_response_s": 10.789735467056744, "answer_total_s": 10.827766056056134, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_378_a1132_q0", "video_id": 378, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9931c93ea2569a932a7b88c6dacccf39dbd20a2cd40a96c20c9a874a8dc5af45", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "6d52f87fd784bc3dece54c837a9736399519b86c6fb822bff6d1793b05d13831", "num_recent_frames": 10, "tq": 715917.884237612, "t1": 715929.505013855, "ta": 715929.505013855, "te": 715929.696439998, "first_response_s": 11.6207762430422, "answer_total_s": 11.81220238597598, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 378, "content_group": "f8c17f0e69eec734f988bd70251551aab389bb91e1b08883f02c64fd95d1a3c2", "question": {"question_id": "sample_378_a1133_q0", "video_id": 378, "video_path": "./videos/sample_378_real.mp4", "annotation_index": 1133, "question_index": 0, "question": "Which of the following options best summarizes the actions performed just now?", "options": ["A. The worker prepared a dessert by gathering ingredients, measuring them, and combining them, ready for baking.", "B. The worker washed their hands, prepped vegetables, and started slicing them for a stir-fry dish.", "C. The worker sliced various meats, arranged them on a piece of bread, and added slices of cheese to construct a sandwich.", "D. The worker cleaned the countertop, sanitized the utensils, and organized the kitchen workspace."], "answer": "C", "time_stamp_s": 63, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [55, 65], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_378_a1133_q0", "video_id": 378, "time_stamp_s": 63, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "eb0fd77cc0b076e60b57d7ec5352713cbd471ed4285dc1b88cdc98f8259202ea", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333], "recent_frames_sha256": "435567dc8fe6ed4627b5986a5f6a961b07beb7021a5fcea4d2acd5efa0934364", "num_recent_frames": 30, "tq": 716000.104928776, "t1": 716007.113236163, "ta": 716007.113236163, "te": 716007.151143875, "first_response_s": 7.008307387004606, "answer_total_s": 7.046215098933317, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_378_a1133_q0", "video_id": 378, "time_stamp_s": 63, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "59521af12ef5c32cc3b714227c0ddafff4413f80591ef76048b1aa653d65ec73", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands wearing gloves open a plastic bag, then place a long bread roll on a paper towel.  \n- A green-handled knife is used to slice the bread roll in half.  \n- Sliced pepperoni is added to the bread roll, followed by a hand placing a slice of salami on top.\n[30-60s] - Hands in gloves layer sliced deli meats (salami, ham) onto a sandwich base.  \n- A long baguette is positioned to the left, with various condiment containers visible in the background.  \n- The sandwich is being assembled on a white cutting board, with the hands actively adding ingredients.", "history_tokens": 141, "history_utf8_bytes": 567, "recent_frame_times_s": [33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333], "recent_frames_sha256": "435567dc8fe6ed4627b5986a5f6a961b07beb7021a5fcea4d2acd5efa0934364", "num_recent_frames": 30, "tq": 715939.466525871, "t1": 715941.364100068, "ta": 715941.364100068, "te": 715941.623529864, "first_response_s": 1.8975741970352829, "answer_total_s": 2.157003993052058, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 378, "content_group": "f8c17f0e69eec734f988bd70251551aab389bb91e1b08883f02c64fd95d1a3c2", "question": {"question_id": "sample_378_a1134_q0", "video_id": 378, "video_path": "./videos/sample_378_real.mp4", "annotation_index": 1134, "question_index": 0, "question": "Which of the following options best summarizes the actions performed just now?", "options": ["A. The worker took out the toasted sandwich.", "B. The worker removed a loaf of bread from storage, sliced it, and placed it on a tray for toasting.", "C. The worker washed vegetables and prepped them for a salad, placing them in the designated containers.", "D. The worker inspected the quality of the baked goods and discarded those that were not up to standards."], "answer": "A", "time_stamp_s": 115, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [110, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_378_a1134_q0", "video_id": 378, "time_stamp_s": 115, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4908fd24c607fe2546e7211c2391bd81574a550ee0734f0da5b6c1321817091b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [85.01826666666666, 86.01926666666667, 87.02026666666667, 88.02126666666666, 89.02226666666667, 90.02326666666667, 91.02426666666666, 92.02526666666667, 93.02626666666667, 94.02726666666666, 95.02826666666667, 96.02926666666667, 97.03026666666666, 98.03126666666667, 99.03226666666667, 100.03326666666666, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139], "recent_frames_sha256": "922a7af53053697b3ce007ada383dbe11400e9e0dd85751c531fd835b617e709", "num_recent_frames": 30, "tq": 716007.160316145, "t1": 716018.927287673, "ta": 716018.927287673, "te": 716018.964814241, "first_response_s": 11.766971527948044, "answer_total_s": 11.804498095996678, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_378_a1134_q0", "video_id": 378, "time_stamp_s": 115, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0197b692923458f95c8350a459156096f5fbdc30d77ae1fcbecd5e8eb464f7b4", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands wearing gloves open a plastic bag, then place a long bread roll on a paper towel.  \n- A green-handled knife is used to slice the bread roll in half.  \n- Sliced pepperoni is added to the bread roll, followed by a hand placing a slice of salami on top.\n[30-60s] - Hands in gloves layer sliced deli meats (salami, ham) onto a sandwich base.  \n- A long baguette is positioned to the left, with various condiment containers visible in the background.  \n- The sandwich is being assembled on a white cutting board, with the hands actively adding ingredients.\n[60-90s] - Hands in gloves place a long sandwich on a tray, then slide it into a stainless steel oven labeled \"SALVATORE\".  \n- A cracker is picked up and placed on a paper towel, then positioned next to the sandwich.  \n- The sandwich is moved toward a counter with multiple food containers, suggesting preparation for serving or further assembly.", "history_tokens": 221, "history_utf8_bytes": 914, "recent_frame_times_s": [85.01826666666666, 86.01926666666667, 87.02026666666667, 88.02126666666666, 89.02226666666667, 90.02326666666667, 91.02426666666666, 92.02526666666667, 93.02626666666667, 94.02726666666666, 95.02826666666667, 96.02926666666667, 97.03026666666666, 98.03126666666667, 99.03226666666667, 100.03326666666666, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139], "recent_frames_sha256": "922a7af53053697b3ce007ada383dbe11400e9e0dd85751c531fd835b617e709", "num_recent_frames": 30, "tq": 715951.921398798, "t1": 715954.376440917, "ta": 715954.376440917, "te": 715954.413194926, "first_response_s": 2.4550421190215275, "answer_total_s": 2.491796127986163, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 378, "content_group": "f8c17f0e69eec734f988bd70251551aab389bb91e1b08883f02c64fd95d1a3c2", "question": {"question_id": "sample_378_a1135_q0", "video_id": 378, "video_path": "./videos/sample_378_real.mp4", "annotation_index": 1135, "question_index": 0, "question": "Which of the following options best summarizes the actions performed just now?", "options": ["A. The worker prepared a sandwich by adding jalapenos, retrieving ketchup, and then applying ketchup and another condiment before wrapping it up.", "B. The worker assembled a salad by chopping vegetables, seasoning the mixture, and serving it to a customer.", "C. The worker toasted a sandwich, cut it, added the final toppings, and packaged it for delivery.", "D. The worker retrieved various vegetables from storage, cleaned them, and placed them in a food container."], "answer": "A", "time_stamp_s": 194, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [165, 175], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_378_a1135_q0", "video_id": 378, "time_stamp_s": 194, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "26f5a24ec8821618c54af219ee078b8cbc333030fcd9bbef3cb9b1c1de13df07", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665], "recent_frames_sha256": "8d46f4f422832f32ce4d5827345644118e187dfdfde6f9c4c6b2857b2ed83f3e", "num_recent_frames": 30, "tq": 716018.974717541, "t1": 716030.723513455, "ta": 716030.723513455, "te": 716030.759994868, "first_response_s": 11.748795913998038, "answer_total_s": 11.785277326940559, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_378_a1135_q0", "video_id": 378, "time_stamp_s": 194, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ca356b305098907d49b4058d327af7f833187a0bc04a9dc09174d8517d1c5b9b", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands wearing gloves open a plastic bag, then place a long bread roll on a paper towel.  \n- A green-handled knife is used to slice the bread roll in half.  \n- Sliced pepperoni is added to the bread roll, followed by a hand placing a slice of salami on top.\n[30-60s] - Hands in gloves layer sliced deli meats (salami, ham) onto a sandwich base.  \n- A long baguette is positioned to the left, with various condiment containers visible in the background.  \n- The sandwich is being assembled on a white cutting board, with the hands actively adding ingredients.\n[60-90s] - Hands in gloves place a long sandwich on a tray, then slide it into a stainless steel oven labeled \"SALVATORE\".  \n- A cracker is picked up and placed on a paper towel, then positioned next to the sandwich.  \n- The sandwich is moved toward a counter with multiple food containers, suggesting preparation for serving or further assembly.\n[90-120s] - Gloved hands spread a creamy substance over a large flatbread on a white paper surface.  \n- A tray of grilled chicken pieces is moved into view, suggesting preparation for assembly.  \n- A hot dog in a bun is placed on a metal rack, indicating it's part of a sandwich or wrap being assembled.\n[120-150s] - Hands in gloves fold a sandwich with cheese and bread, then place it on parchment paper.  \n- A long sandwich with ham, cheese, and tomato slices is assembled on a counter with condiment containers nearby.  \n- The sandwich is placed on a tray, then moved toward a stainless steel appliance, likely for heating or toasting.\n[150-180s] - Hands add sliced red onions to a long sandwich on a paper wrapper.  \n- A green plastic bag is opened, revealing a container of sliced green peppers.  \n- A red bottle is used to drizzle a sauce over the sandwich.", "history_tokens": 430, "history_utf8_bytes": 1778, "recent_frame_times_s": [164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665], "recent_frames_sha256": "8d46f4f422832f32ce4d5827345644118e187dfdfde6f9c4c6b2857b2ed83f3e", "num_recent_frames": 30, "tq": 715975.875444361, "t1": 715977.097102697, "ta": 715977.097102697, "te": 715977.136505326, "first_response_s": 1.2216583359986544, "answer_total_s": 1.2610609650146216, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 378, "content_group": "f8c17f0e69eec734f988bd70251551aab389bb91e1b08883f02c64fd95d1a3c2", "question": {"question_id": "sample_378_a1136_q0", "video_id": 378, "video_path": "./videos/sample_378_real.mp4", "annotation_index": 1136, "question_index": 0, "question": "Which of the following options best summarizes the actions performed just now?", "options": ["A. The worker topped a sandwich with tomatoes, cucumbers, and onions, then wrapped it for delivery.", "B. The worker added fresh ingredients such as tomatoes and cucumbers to a sandwich, aligning them carefully on lettuce and other toppings.", "C. The worker prepared a salad by chopping onions, cucumbers, and other vegetables, and then mixed them in a bowl.", "D. The worker grilled a sandwich with various ingredients and sliced it before packaging it for a customer."], "answer": "B", "time_stamp_s": 230, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [220, 230], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_378_a1136_q0", "video_id": 378, "time_stamp_s": 230, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "28f7b9cc048ddc14a49a408ba08246c3948cd49fea2ca1c9eb7fc2fcd378052f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288], "recent_frames_sha256": "7d529844cac4c18d8bd4401a06dee905c5510989fb81d7bd2552094db77e2f1c", "num_recent_frames": 30, "tq": 716030.767971715, "t1": 716042.170694132, "ta": 716042.170694132, "te": 716042.207633216, "first_response_s": 11.40272241702769, "answer_total_s": 11.439661501091905, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_378_a1136_q0", "video_id": 378, "time_stamp_s": 230, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3366d25e50b565b483d96a7ddc1904469ee791e2e4e037bb2cfa3206d864b2f5", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands wearing gloves open a plastic bag, then place a long bread roll on a paper towel.  \n- A green-handled knife is used to slice the bread roll in half.  \n- Sliced pepperoni is added to the bread roll, followed by a hand placing a slice of salami on top.\n[30-60s] - Hands in gloves layer sliced deli meats (salami, ham) onto a sandwich base.  \n- A long baguette is positioned to the left, with various condiment containers visible in the background.  \n- The sandwich is being assembled on a white cutting board, with the hands actively adding ingredients.\n[60-90s] - Hands in gloves place a long sandwich on a tray, then slide it into a stainless steel oven labeled \"SALVATORE\".  \n- A cracker is picked up and placed on a paper towel, then positioned next to the sandwich.  \n- The sandwich is moved toward a counter with multiple food containers, suggesting preparation for serving or further assembly.\n[90-120s] - Gloved hands spread a creamy substance over a large flatbread on a white paper surface.  \n- A tray of grilled chicken pieces is moved into view, suggesting preparation for assembly.  \n- A hot dog in a bun is placed on a metal rack, indicating it's part of a sandwich or wrap being assembled.\n[120-150s] - Hands in gloves fold a sandwich with cheese and bread, then place it on parchment paper.  \n- A long sandwich with ham, cheese, and tomato slices is assembled on a counter with condiment containers nearby.  \n- The sandwich is placed on a tray, then moved toward a stainless steel appliance, likely for heating or toasting.\n[150-180s] - Hands add sliced red onions to a long sandwich on a paper wrapper.  \n- A green plastic bag is opened, revealing a container of sliced green peppers.  \n- A red bottle is used to drizzle a sauce over the sandwich.\n[180-210s] - Hands in gloves roll a sandwich with visible fillings, then cut it in half.  \n- The sandwich is placed on a paper-lined tray, then wrapped in branded paper.  \n- A separate roll is shown with cheese spread on it, positioned on a cutting board.", "history_tokens": 495, "history_utf8_bytes": 2034, "recent_frame_times_s": [200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288], "recent_frames_sha256": "7d529844cac4c18d8bd4401a06dee905c5510989fb81d7bd2552094db77e2f1c", "num_recent_frames": 30, "tq": 715987.948124094, "t1": 715989.214514814, "ta": 715989.214514814, "te": 715989.252077882, "first_response_s": 1.2663907199166715, "answer_total_s": 1.3039537878939882, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 380, "content_group": "f30332c156fdbd4b5da178a137eec5440de87f2f40dbd11c8ca4ecbd4fc2b016", "question": {"question_id": "sample_380_a86_q0", "video_id": 380, "video_path": "./videos/sample_380_real.mp4", "annotation_index": 86, "question_index": 0, "question": "What is mounted on the lamp post right now?", "options": ["A. A camera.", "B. A streetlight.", "C. An American flag.", "D. A traffic sign."], "answer": "C", "time_stamp_s": 5, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_380_a86_q0", "video_id": 380, "time_stamp_s": 5, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "837cc1598b5d0b6f9ddb0a2af098cebd40110ddb7bf2153bde18e43064bc5f6f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004], "recent_frames_sha256": "fa59262b624bcf7a22e131ce41053085143d51be5bea2bd6dac02adfd9fe85f7", "num_recent_frames": 5, "tq": 717402.803514389, "t1": 717414.411897219, "ta": 717414.411897219, "te": 717414.44854407, "first_response_s": 11.608382830047049, "answer_total_s": 11.645029681036249, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_380_a86_q0", "video_id": 380, "time_stamp_s": 5, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "431fe1a50d9a9704f52a65b398344e95a9d440f2f154754dfb30bf40bb51f3e4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004], "recent_frames_sha256": "fa59262b624bcf7a22e131ce41053085143d51be5bea2bd6dac02adfd9fe85f7", "num_recent_frames": 5, "tq": 717448.930197563, "t1": 717460.440360337, "ta": 717460.440360337, "te": 717460.853091907, "first_response_s": 11.510162774007767, "answer_total_s": 11.922894343966618, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 380, "content_group": "f30332c156fdbd4b5da178a137eec5440de87f2f40dbd11c8ca4ecbd4fc2b016", "question": {"question_id": "sample_380_a87_q0", "video_id": 380, "video_path": "./videos/sample_380_real.mp4", "annotation_index": 87, "question_index": 0, "question": "What is the predominant color of the banners on the street right now?", "options": ["A. Purple.", "B. Red.", "C. Blue.", "D. Green."], "answer": "A", "time_stamp_s": 128, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [127, 132], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_380_a87_q0", "video_id": 380, "time_stamp_s": 128, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "51f98a5c0d4b0b78ff56e210032d60fe0d63b6256eddbaf91a98abb5c99ad14b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [98.03126666666667, 99.03226666666667, 100.03326666666666, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269], "recent_frames_sha256": "feea05569bd3d777a3e4661aa459d57d694e8d5e92a2f2b0677a5284102ae52b", "num_recent_frames": 30, "tq": 717414.467753485, "t1": 717421.883193716, "ta": 717421.883193716, "te": 717421.919907649, "first_response_s": 7.4154402310959995, "answer_total_s": 7.452154164086096, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_380_a87_q0", "video_id": 380, "time_stamp_s": 128, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7acf0d683659487cf4f5d652bc2901d6e7681e7113bf9cd46eb00669c9e230a8", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxis and black SUVs navigate a busy urban intersection with traffic lights and street signs (e.g., \"BROADWAY\" and \"W 42 ST\").  \n- A FedEx truck and other delivery vehicles are parked or moving along the street, with pedestrians crossing at crosswalks.  \n- The camera pans forward, revealing tall buildings lining the street, including a \"PARK\" sign and storefronts with visible signage like \"EPOC\".\n[30-60s] - A black SUV with a visible license plate drives forward, positioned centrally in the lane, moving away from the camera.\n- Yellow taxis and other vehicles are parked or moving along the street, with some taxis visible on the left side of the road.\n- A pedestrian crossing is visible with a crosswalk signal, and a street sign indicating \"W 34th St\" is displayed above the intersection.\n[60-90s] - A black SUV with license plate \"987654\" is stationary at a crosswalk, facing the camera.  \n- A yellow taxi cab moves from left to right across the street, passing behind the SUV.  \n- A white van is visible on the left side of the road, parked or moving slowly near a sidewalk.\n[90-120s] - A black SUV drives forward through a city street, passing construction zones marked by orange cones and signs.  \n- Yellow taxis and other vehicles are visible in traffic, with some stopped or moving slowly near the construction area.  \n- Pedestrians cross the street at marked crosswalks, and buildings line both sides of the road, including a bridge on the left.", "history_tokens": 349, "history_utf8_bytes": 1476, "recent_frame_times_s": [98.03126666666667, 99.03226666666667, 100.03326666666666, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269], "recent_frames_sha256": "feea05569bd3d777a3e4661aa459d57d694e8d5e92a2f2b0677a5284102ae52b", "num_recent_frames": 30, "tq": 717490.20096707, "t1": 717496.845049438, "ta": 717496.845049438, "te": 717496.883920626, "first_response_s": 6.644082368002273, "answer_total_s": 6.682953556068242, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 380, "content_group": "f30332c156fdbd4b5da178a137eec5440de87f2f40dbd11c8ca4ecbd4fc2b016", "question": {"question_id": "sample_380_a88_q0", "video_id": 380, "video_path": "./videos/sample_380_real.mp4", "annotation_index": 88, "question_index": 0, "question": "Which street is indicated on the green sign right now?", "options": ["A. E 40 St.", "B. E 34 St.", "C. W 42 St.", "D. Broadway."], "answer": "A", "time_stamp_s": 256, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [254, 259], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_380_a88_q0", "video_id": 380, "time_stamp_s": 256, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "be19ce4e850fc15009a19d470be7ed1abc0087bcd9a2ef038ec992ca1619336d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333], "recent_frames_sha256": "5bca59e090aeda95bc3dfd8b94e0868f1ede8fc39b1df9b3967e4f8ce66d52ee", "num_recent_frames": 30, "tq": 717421.93460974, "t1": 717433.808883915, "ta": 717433.808883915, "te": 717433.84659619, "first_response_s": 11.874274174915627, "answer_total_s": 11.911986449966207, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_380_a88_q0", "video_id": 380, "time_stamp_s": 256, "ground_truth": "A", "raw_output": "C. W 42 St.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "8de8b3d77568c45af8a1c5a4ae022240f93709a048922086df1386a4d7b5712d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxis and black SUVs navigate a busy urban intersection with traffic lights and street signs (e.g., \"BROADWAY\" and \"W 42 ST\").  \n- A FedEx truck and other delivery vehicles are parked or moving along the street, with pedestrians crossing at crosswalks.  \n- The camera pans forward, revealing tall buildings lining the street, including a \"PARK\" sign and storefronts with visible signage like \"EPOC\".\n[30-60s] - A black SUV with a visible license plate drives forward, positioned centrally in the lane, moving away from the camera.\n- Yellow taxis and other vehicles are parked or moving along the street, with some taxis visible on the left side of the road.\n- A pedestrian crossing is visible with a crosswalk signal, and a street sign indicating \"W 34th St\" is displayed above the intersection.\n[60-90s] - A black SUV with license plate \"987654\" is stationary at a crosswalk, facing the camera.  \n- A yellow taxi cab moves from left to right across the street, passing behind the SUV.  \n- A white van is visible on the left side of the road, parked or moving slowly near a sidewalk.\n[90-120s] - A black SUV drives forward through a city street, passing construction zones marked by orange cones and signs.  \n- Yellow taxis and other vehicles are visible in traffic, with some stopped or moving slowly near the construction area.  \n- Pedestrians cross the street at marked crosswalks, and buildings line both sides of the road, including a bridge on the left.\n[120-150s] - A pedestrian crosses the street at a marked crosswalk, moving from left to right, while a white sedan and a yellow taxi pass by.\n- A FedEx delivery truck is parked on the right side of the street, stationary near the curb.\n- A cyclist rides across the street from right to left, passing in front of a red sedan that is also moving across the intersection.\n[150-180s] - A red sedan crosses the street from left to right, briefly obscuring the view of the intersection.\n- A FedEx truck is parked on the right side of the road, stationary near the curb.\n- A pedestrian with a suitcase walks across the crosswalk from right to left, moving away from the camera.\n[180-210s] - A black SUV drives forward, following other vehicles on a city street lined with tall buildings.  \n- A yellow taxi and a white van cross the street at a crosswalk, with traffic lights showing green.  \n- A FedEx delivery truck is visible on the right side of the road, parked or moving slowly.\n[210-240s] - Yellow taxis and black cars move along the street, with a black sedan prominently driving forward.\n- Pedestrians cross the wide crosswalk at the intersection, some walking briskly while others pause.\n- A red traffic light is active at the intersection, controlling vehicle movement and signaling pedestrians to cross.", "history_tokens": 650, "history_utf8_bytes": 2784, "recent_frame_times_s": [226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333], "recent_frames_sha256": "5bca59e090aeda95bc3dfd8b94e0868f1ede8fc39b1df9b3967e4f8ce66d52ee", "num_recent_frames": 30, "tq": 717522.477141706, "t1": 717523.48189285, "ta": 717523.48189285, "te": 717523.776577046, "first_response_s": 1.004751143977046, "answer_total_s": 1.299435339984484, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 380, "content_group": "f30332c156fdbd4b5da178a137eec5440de87f2f40dbd11c8ca4ecbd4fc2b016", "question": {"question_id": "sample_380_a89_q0", "video_id": 380, "video_path": "./videos/sample_380_real.mp4", "annotation_index": 89, "question_index": 0, "question": "What is positioned next to the road right now?", "options": ["A. Parking meters.", "B. Trash bins.", "C. Orange traffic barrels.", "D. Benches."], "answer": "C", "time_stamp_s": 384, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [381, 386], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_380_a89_q0", "video_id": 380, "time_stamp_s": 384, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "33e111b0e3319f66c24a9ca4e0959eb5d8d7486f3eb51754c860bab3234bcfcf", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666], "recent_frames_sha256": "bce936ddcc80fe67f2910f6b68c4615b981c8f7ae981ec59d6cbc77068990e5b", "num_recent_frames": 30, "tq": 717433.858845948, "t1": 717442.054920873, "ta": 717442.054920873, "te": 717442.092392212, "first_response_s": 8.196074925013818, "answer_total_s": 8.233546264003962, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_380_a89_q0", "video_id": 380, "time_stamp_s": 384, "ground_truth": "C", "raw_output": "C. Orange traffic barrels.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "9cf6ee1d016f7c0fd68b12d6dc264033b613b2b1f4f46a6eb481fd5eef2404fb", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxis and black SUVs navigate a busy urban intersection with traffic lights and street signs (e.g., \"BROADWAY\" and \"W 42 ST\").  \n- A FedEx truck and other delivery vehicles are parked or moving along the street, with pedestrians crossing at crosswalks.  \n- The camera pans forward, revealing tall buildings lining the street, including a \"PARK\" sign and storefronts with visible signage like \"EPOC\".\n[30-60s] - A black SUV with a visible license plate drives forward, positioned centrally in the lane, moving away from the camera.\n- Yellow taxis and other vehicles are parked or moving along the street, with some taxis visible on the left side of the road.\n- A pedestrian crossing is visible with a crosswalk signal, and a street sign indicating \"W 34th St\" is displayed above the intersection.\n[60-90s] - A black SUV with license plate \"987654\" is stationary at a crosswalk, facing the camera.  \n- A yellow taxi cab moves from left to right across the street, passing behind the SUV.  \n- A white van is visible on the left side of the road, parked or moving slowly near a sidewalk.\n[90-120s] - A black SUV drives forward through a city street, passing construction zones marked by orange cones and signs.  \n- Yellow taxis and other vehicles are visible in traffic, with some stopped or moving slowly near the construction area.  \n- Pedestrians cross the street at marked crosswalks, and buildings line both sides of the road, including a bridge on the left.\n[120-150s] - A pedestrian crosses the street at a marked crosswalk, moving from left to right, while a white sedan and a yellow taxi pass by.\n- A FedEx delivery truck is parked on the right side of the street, stationary near the curb.\n- A cyclist rides across the street from right to left, passing in front of a red sedan that is also moving across the intersection.\n[150-180s] - A red sedan crosses the street from left to right, briefly obscuring the view of the intersection.\n- A FedEx truck is parked on the right side of the road, stationary near the curb.\n- A pedestrian with a suitcase walks across the crosswalk from right to left, moving away from the camera.\n[180-210s] - A black SUV drives forward, following other vehicles on a city street lined with tall buildings.  \n- A yellow taxi and a white van cross the street at a crosswalk, with traffic lights showing green.  \n- A FedEx delivery truck is visible on the right side of the road, parked or moving slowly.\n[210-240s] - Yellow taxis and black cars move along the street, with a black sedan prominently driving forward.\n- Pedestrians cross the wide crosswalk at the intersection, some walking briskly while others pause.\n- A red traffic light is active at the intersection, controlling vehicle movement and signaling pedestrians to cross.\n[240-270s] - Yellow taxis move across the intersection, with one turning right at 248 seconds.\n- A cyclist crosses the street from left to right, passing a pedestrian crossing at 243 seconds.\n- A white van and a black SUV pass through the intersection, with the van turning left at 250 seconds.\n[270-300s] - A black Cadillac is driving forward, positioned centrally in the lane, with its brake lights illuminated.  \n- Yellow taxis and other vehicles are visible in adjacent lanes, moving in traffic.  \n- The camera's perspective is from a vehicle approaching Grand Central Terminal, with the building's facade and ornate clock prominently displayed.\n[300-330s] - A black SUV is stationary in traffic, positioned directly in front of a large stone building with arched windows and a central statue.  \n- Yellow taxis pass by on the left, moving in the same direction as the SUV.  \n- A yellow diamond-shaped road sign indicating a “15” speed limit is visible on the right side of the road.\n[330-360s] - A black van drives past the Grand Hyatt hotel entrance, passing between parked cars and a yellow taxi.  \n- The camera pans left, revealing a narrow street flanked by tall buildings, with a black SUV ahead.  \n- A red \"GRAND HYATT\" sign is prominently displayed on a glass building facade above the hotel entrance.", "history_tokens": 961, "history_utf8_bytes": 4101, "recent_frame_times_s": [354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666], "recent_frames_sha256": "bce936ddcc80fe67f2910f6b68c4615b981c8f7ae981ec59d6cbc77068990e5b", "num_recent_frames": 30, "tq": 717557.436344089, "t1": 717569.784123111, "ta": 717569.784123111, "te": 717570.087898941, "first_response_s": 12.34777902206406, "answer_total_s": 12.651554852025583, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 380, "content_group": "f30332c156fdbd4b5da178a137eec5440de87f2f40dbd11c8ca4ecbd4fc2b016", "question": {"question_id": "sample_380_a90_q0", "video_id": 380, "video_path": "./videos/sample_380_real.mp4", "annotation_index": 90, "question_index": 0, "question": "What sign is visible on the left side of the street right now?", "options": ["A. One Way.", "B. Speed Limit.", "C. No Parking.", "D. Yield."], "answer": "A", "time_stamp_s": 508, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [508, 513], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_380_a90_q0", "video_id": 380, "time_stamp_s": 508, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5aa36dd0d895c9517f54a650860ea610bba41b9ca28dcd9df8c413c10d01226b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667, 487.01986666666664, 488.0208666666667, 489.02186666666665, 490.0228666666667, 491.02386666666666, 492.02486666666664, 493.0258666666667, 494.02686666666665, 495.0278666666667, 496.02886666666666, 497.0298666666667, 498.03086666666667, 499.03186666666664, 500.0328666666667, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065], "recent_frames_sha256": "da8e7271e68f21e196cbc01f4d5a65cb907b4a3132c98a0c4573c1a98385f4c8", "num_recent_frames": 30, "tq": 717442.119281772, "t1": 717448.88053435, "ta": 717448.88053435, "te": 717448.917252279, "first_response_s": 6.761252578115091, "answer_total_s": 6.797970507061109, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_380_a90_q0", "video_id": 380, "time_stamp_s": 508, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c7da17638d658e5db0f167f8a36a711fffb2c0009383f62201dc3bf229ff56b6", "condition_order": ["recent", "notes"], "memory": "[90-120s] - A black SUV drives forward through a city street, passing construction zones marked by orange cones and signs.  \n- Yellow taxis and other vehicles are visible in traffic, with some stopped or moving slowly near the construction area.  \n- Pedestrians cross the street at marked crosswalks, and buildings line both sides of the road, including a bridge on the left.\n[120-150s] - A pedestrian crosses the street at a marked crosswalk, moving from left to right, while a white sedan and a yellow taxi pass by.\n- A FedEx delivery truck is parked on the right side of the street, stationary near the curb.\n- A cyclist rides across the street from right to left, passing in front of a red sedan that is also moving across the intersection.\n[150-180s] - A red sedan crosses the street from left to right, briefly obscuring the view of the intersection.\n- A FedEx truck is parked on the right side of the road, stationary near the curb.\n- A pedestrian with a suitcase walks across the crosswalk from right to left, moving away from the camera.\n[180-210s] - A black SUV drives forward, following other vehicles on a city street lined with tall buildings.  \n- A yellow taxi and a white van cross the street at a crosswalk, with traffic lights showing green.  \n- A FedEx delivery truck is visible on the right side of the road, parked or moving slowly.\n[210-240s] - Yellow taxis and black cars move along the street, with a black sedan prominently driving forward.\n- Pedestrians cross the wide crosswalk at the intersection, some walking briskly while others pause.\n- A red traffic light is active at the intersection, controlling vehicle movement and signaling pedestrians to cross.\n[240-270s] - Yellow taxis move across the intersection, with one turning right at 248 seconds.\n- A cyclist crosses the street from left to right, passing a pedestrian crossing at 243 seconds.\n- A white van and a black SUV pass through the intersection, with the van turning left at 250 seconds.\n[270-300s] - A black Cadillac is driving forward, positioned centrally in the lane, with its brake lights illuminated.  \n- Yellow taxis and other vehicles are visible in adjacent lanes, moving in traffic.  \n- The camera's perspective is from a vehicle approaching Grand Central Terminal, with the building's facade and ornate clock prominently displayed.\n[300-330s] - A black SUV is stationary in traffic, positioned directly in front of a large stone building with arched windows and a central statue.  \n- Yellow taxis pass by on the left, moving in the same direction as the SUV.  \n- A yellow diamond-shaped road sign indicating a “15” speed limit is visible on the right side of the road.\n[330-360s] - A black van drives past the Grand Hyatt hotel entrance, passing between parked cars and a yellow taxi.  \n- The camera pans left, revealing a narrow street flanked by tall buildings, with a black SUV ahead.  \n- A red \"GRAND HYATT\" sign is prominently displayed on a glass building facade above the hotel entrance.\n[360-390s] - Black sedan drives forward, approaching a tunnel entrance flanked by orange traffic cones and barriers.  \n- Construction zone with orange barriers and workers visible on the left side of the road.  \n- A yellow taxi and other vehicles are seen ahead, entering the tunnel.\n[390-420s] - Black sedan drives forward, passing orange traffic cones and entering a dark tunnel under a building.\n- Tunnel interior features concrete walls, yellow-and-black chevron markings, and a directional arrow sign indicating a right turn.\n- Vehicle's brake lights remain illuminated as it proceeds into the tunnel, with other cars visible ahead.\n[420-450s] - A \"NO TURNS\" sign is visible on the left side of the frame, indicating traffic restrictions.  \n- Yellow taxis and a yellow van are actively moving through the intersection, with one van turning right.  \n- Pedestrians are crossing the street, some walking in groups, while others are alone, all moving across the crosswalk.\n[450-480s] - A white \"Boulder\" delivery truck passes left to right, partially obscured by a black SUV.  \n- Yellow taxis and other vehicles move steadily along the street, with one taxi turning right at the intersection.  \n- Pedestrians cross the street at the crosswalk, some walking toward the camera, others away.", "history_tokens": 986, "history_utf8_bytes": 4290, "recent_frame_times_s": [478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667, 487.01986666666664, 488.0208666666667, 489.02186666666665, 490.0228666666667, 491.02386666666666, 492.02486666666664, 493.0258666666667, 494.02686666666665, 495.0278666666667, 496.02886666666666, 497.0298666666667, 498.03086666666667, 499.03186666666664, 500.0328666666667, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065], "recent_frames_sha256": "da8e7271e68f21e196cbc01f4d5a65cb907b4a3132c98a0c4573c1a98385f4c8", "num_recent_frames": 30, "tq": 717605.039760945, "t1": 717612.286946841, "ta": 717612.286946841, "te": 717612.444976621, "first_response_s": 7.2471858960343525, "answer_total_s": 7.4052156759426, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 381, "content_group": "2e9addaa2623ae56906a9373968863ad94e90b296bab78704d3992ff671cf902", "question": {"question_id": "sample_381_a1882_q0", "video_id": 381, "video_path": "./videos/sample_381_real.mp4", "annotation_index": 1882, "question_index": 0, "question": "What is the vehicle immediately in front of the taxi right now?", "options": ["A. A bus.", "B. A bicycle.", "C. A yellow car.", "D. A motorcycle."], "answer": "C", "time_stamp_s": 2, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_381_a1882_q0", "video_id": 381, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f1bf8948d8ba5f548ba66772839bf804f8f632477b6a1b1fb4c159d10a3e96d2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.041, 1.0086333333333333], "recent_frames_sha256": "d6a11454ad0180c5094cb69150a93aa9f31440dda977de4f309ac979aa31d4ac", "num_recent_frames": 2, "tq": 717042.632042483, "t1": 717055.469058804, "ta": 717055.469058804, "te": 717055.502286965, "first_response_s": 12.8370163210202, "answer_total_s": 12.870244482066482, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_381_a1882_q0", "video_id": 381, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "90068dc5644715e2c9489ca543a699eb6332e58740e2c36168c3ee3f475f225b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.041, 1.0086333333333333], "recent_frames_sha256": "d6a11454ad0180c5094cb69150a93aa9f31440dda977de4f309ac979aa31d4ac", "num_recent_frames": 2, "tq": 717102.589014817, "t1": 717103.568390434, "ta": 717103.568390434, "te": 717103.720781551, "first_response_s": 0.9793756169965491, "answer_total_s": 1.1317667339462787, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 381, "content_group": "2e9addaa2623ae56906a9373968863ad94e90b296bab78704d3992ff671cf902", "question": {"question_id": "sample_381_a1883_q0", "video_id": 381, "video_path": "./videos/sample_381_real.mp4", "annotation_index": 1883, "question_index": 0, "question": "What colors are the advertisements on the left buildings right now?", "options": ["A. Red and White.", "B. Black and Yellow.", "C. Green and White.", "D. Blue and Red."], "answer": "A", "time_stamp_s": 125, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [122, 127], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_381_a1883_q0", "video_id": 381, "time_stamp_s": 125, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "eae0edf1f5b9a93b466775b1bfbd239b9efa7186d35e31b5b4b2422252a7d26e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [95.00253333333333, 96.00353333333334, 97.00453333333333, 98.00553333333333, 99.00653333333334, 100.00753333333333, 101.00853333333333, 102.00953333333334, 103.01053333333333, 104.01153333333333, 105.01253333333334, 106.01353333333333, 107.01453333333333, 108.01553333333334, 109.01653333333333, 110.01753333333333, 111.01853333333334, 112.01953333333333, 113.02053333333333, 114.02153333333334, 115.02253333333333, 116.02353333333333, 117.02453333333334, 118.02553333333333, 119.02653333333333, 120.02753333333334, 121.02853333333333, 122.02953333333333, 123.03053333333334, 124.03153333333333], "recent_frames_sha256": "793cd270f7f469b58f29fdb7de1fa8ab02913f6c5b7ba5a9a2c55db6e6462e0d", "num_recent_frames": 30, "tq": 717055.507739311, "t1": 717066.371896605, "ta": 717066.371896605, "te": 717066.409797955, "first_response_s": 10.864157294039614, "answer_total_s": 10.902058643987402, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_381_a1883_q0", "video_id": 381, "time_stamp_s": 125, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1c547f1058cb190ac4b5a0d126631bce76c689b94394239e97e3521e1b8b236c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxi cab remains stationary at intersection, facing camera, with license plate visible.  \n- Traffic lights change from red to green, allowing vehicles to proceed through the intersection.  \n- Pedestrians cross the street at crosswalk, moving from left to right relative to camera.\n[30-60s] - Yellow taxis and black SUVs navigate a busy urban street with traffic lights and crosswalks.  \n- Pedestrians walk along sidewalks flanked by tall buildings, some carrying bags or umbrellas.  \n- A white truck and a black sedan are visible among the traffic, with a red light momentarily stopping vehicles.\n[60-90s] - A green taxi is prominently visible, moving forward in traffic, with its brake lights illuminated.  \n- A white bus is positioned to the right of the green taxi, partially obstructing its lane.  \n- The street is lined with tall buildings, and construction scaffolding is visible on the right side of the road.\n[90-120s] - A green taxi is stationary on the right side of the road, with its brake lights illuminated.  \n- A white bus is positioned to the right of the taxi, partially visible and stationary.  \n- Traffic lights and street signs are visible, indicating a busy urban intersection.", "history_tokens": 271, "history_utf8_bytes": 1215, "recent_frame_times_s": [95.00253333333333, 96.00353333333334, 97.00453333333333, 98.00553333333333, 99.00653333333334, 100.00753333333333, 101.00853333333333, 102.00953333333334, 103.01053333333333, 104.01153333333333, 105.01253333333334, 106.01353333333333, 107.01453333333333, 108.01553333333334, 109.01653333333333, 110.01753333333333, 111.01853333333334, 112.01953333333333, 113.02053333333333, 114.02153333333334, 115.02253333333333, 116.02353333333333, 117.02453333333334, 118.02553333333333, 119.02653333333333, 120.02753333333334, 121.02853333333333, 122.02953333333333, 123.03053333333334, 124.03153333333333], "recent_frames_sha256": "793cd270f7f469b58f29fdb7de1fa8ab02913f6c5b7ba5a9a2c55db6e6462e0d", "num_recent_frames": 30, "tq": 717172.535800593, "t1": 717173.33826478, "ta": 717173.33826478, "te": 717173.377816879, "first_response_s": 0.8024641870288178, "answer_total_s": 0.8420162859838456, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 381, "content_group": "2e9addaa2623ae56906a9373968863ad94e90b296bab78704d3992ff671cf902", "question": {"question_id": "sample_381_a1884_q0", "video_id": 381, "video_path": "./videos/sample_381_real.mp4", "annotation_index": 1884, "question_index": 0, "question": "What type of vehicle is in front of the yellow taxi right now?", "options": ["A. A black car.", "B. A white van.", "C. A gray SUV.", "D. A red truck."], "answer": "A", "time_stamp_s": 247, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [244, 249], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_381_a1884_q0", "video_id": 381, "time_stamp_s": 247, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3595c2ca1a16c0022e76d2349be25bc5d0cae5ac05a290809ca8d6b21214f370", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [217.02443333333332, 218.02543333333332, 219.02643333333333, 220.02743333333333, 221.02843333333334, 222.02943333333334, 223.03043333333332, 224.03143333333333, 225.03243333333333, 226.00006666666667, 227.00106666666667, 228.00206666666668, 229.00306666666665, 230.00406666666666, 231.00506666666666, 232.00606666666667, 233.00706666666667, 234.00806666666668, 235.00906666666666, 236.01006666666666, 237.01106666666666, 238.01206666666667, 239.01306666666667, 240.01406666666668, 241.01506666666666, 242.01606666666666, 243.01706666666666, 244.01806666666667, 245.01906666666667, 246.02006666666668], "recent_frames_sha256": "95daafd065c4ac703e09c5605273622509ddbeeeaf66140f86529c31a9be6c87", "num_recent_frames": 30, "tq": 717066.415875276, "t1": 717077.748678961, "ta": 717077.748678961, "te": 717077.785745252, "first_response_s": 11.332803684985265, "answer_total_s": 11.36986997607164, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_381_a1884_q0", "video_id": 381, "time_stamp_s": 247, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7903e4c9311972f581be4f4929c8c4a3ce2d2a9d35cfbbf3bac99e51c5853fdd", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxi cab remains stationary at intersection, facing camera, with license plate visible.  \n- Traffic lights change from red to green, allowing vehicles to proceed through the intersection.  \n- Pedestrians cross the street at crosswalk, moving from left to right relative to camera.\n[30-60s] - Yellow taxis and black SUVs navigate a busy urban street with traffic lights and crosswalks.  \n- Pedestrians walk along sidewalks flanked by tall buildings, some carrying bags or umbrellas.  \n- A white truck and a black sedan are visible among the traffic, with a red light momentarily stopping vehicles.\n[60-90s] - A green taxi is prominently visible, moving forward in traffic, with its brake lights illuminated.  \n- A white bus is positioned to the right of the green taxi, partially obstructing its lane.  \n- The street is lined with tall buildings, and construction scaffolding is visible on the right side of the road.\n[90-120s] - A green taxi is stationary on the right side of the road, with its brake lights illuminated.  \n- A white bus is positioned to the right of the taxi, partially visible and stationary.  \n- Traffic lights and street signs are visible, indicating a busy urban intersection.\n[120-150s] - A green taxi moves forward on the road, passing a white bus parked on the right side.  \n- A red truck crosses the street at an intersection, navigating through traffic.  \n- Yellow taxis and other vehicles are visible in motion, indicating active street traffic.\n[150-180s] - Yellow taxi van drives forward, maintaining lane position between other vehicles.  \n- Pedestrians cross street at crosswalk, moving from left to right relative to camera.  \n- Traffic lights change from yellow to red, halting vehicle movement at intersection.\n[180-210s] - A yellow taxi passes left to right across the foreground, followed by a white FedEx truck.\n- A silver pickup truck and a black SUV cross the intersection sequentially.\n- Pedestrians are seen crossing the street at the crosswalk, with one person walking away from the camera.\n[210-240s] - A green FedEx truck drives rightward, passing a crosswalk marked \"SCHOOL\" on the road.  \n- A yellow school bus emits white smoke as it moves forward, positioned ahead of the FedEx truck.  \n- A green taxi turns left at the intersection, navigating around the school bus and other vehicles.", "history_tokens": 534, "history_utf8_bytes": 2352, "recent_frame_times_s": [217.02443333333332, 218.02543333333332, 219.02643333333333, 220.02743333333333, 221.02843333333334, 222.02943333333334, 223.03043333333332, 224.03143333333333, 225.03243333333333, 226.00006666666667, 227.00106666666667, 228.00206666666668, 229.00306666666665, 230.00406666666666, 231.00506666666666, 232.00606666666667, 233.00706666666667, 234.00806666666668, 235.00906666666666, 236.01006666666666, 237.01106666666666, 238.01206666666667, 239.01306666666667, 240.01406666666668, 241.01506666666666, 242.01606666666666, 243.01706666666666, 244.01806666666667, 245.01906666666667, 246.02006666666668], "recent_frames_sha256": "95daafd065c4ac703e09c5605273622509ddbeeeaf66140f86529c31a9be6c87", "num_recent_frames": 30, "tq": 717203.024125469, "t1": 717204.492895719, "ta": 717204.492895719, "te": 717204.755299172, "first_response_s": 1.4687702499795705, "answer_total_s": 1.731173702981323, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 381, "content_group": "2e9addaa2623ae56906a9373968863ad94e90b296bab78704d3992ff671cf902", "question": {"question_id": "sample_381_a1885_q0", "video_id": 381, "video_path": "./videos/sample_381_real.mp4", "annotation_index": 1885, "question_index": 0, "question": "What is the person in the crosswalk holding in her hand right now?", "options": ["A. A handbag.", "B. A phone.", "C. A shopping bag and a handbag.", "D. An umbrella."], "answer": "C", "time_stamp_s": 368, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [366, 371], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_381_a1885_q0", "video_id": 381, "time_stamp_s": 368, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ec7b49cdc19ba1d1563b2194cc2fbbf5b37efeb3c7289110844b100e781a83f9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [338.0119666666667, 339.01296666666667, 340.01396666666665, 341.0149666666667, 342.01596666666666, 343.0169666666667, 344.01796666666667, 345.01896666666664, 346.0199666666667, 347.02096666666665, 348.0219666666667, 349.02296666666666, 350.0239666666667, 351.02496666666667, 352.02596666666665, 353.0269666666667, 354.02796666666666, 355.0289666666667, 356.02996666666667, 357.03096666666664, 358.0319666666667, 359.03296666666665, 360.0006, 361.0016, 362.0026, 363.0036, 364.0046, 365.0056, 366.0066, 367.0076], "recent_frames_sha256": "6fa8c304dd22b458ceb01eb28fc3b7af8140b92f917568b8e51149070dc0c6e3", "num_recent_frames": 30, "tq": 717077.791924943, "t1": 717089.674977891, "ta": 717089.674977891, "te": 717089.712239627, "first_response_s": 11.883052948047407, "answer_total_s": 11.92031468404457, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_381_a1885_q0", "video_id": 381, "time_stamp_s": 368, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "faabbd5d723119f18e0b65e57e2600e6c7d4b5ff5b92348eae42973b868cb253", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxi cab remains stationary at intersection, facing camera, with license plate visible.  \n- Traffic lights change from red to green, allowing vehicles to proceed through the intersection.  \n- Pedestrians cross the street at crosswalk, moving from left to right relative to camera.\n[30-60s] - Yellow taxis and black SUVs navigate a busy urban street with traffic lights and crosswalks.  \n- Pedestrians walk along sidewalks flanked by tall buildings, some carrying bags or umbrellas.  \n- A white truck and a black sedan are visible among the traffic, with a red light momentarily stopping vehicles.\n[60-90s] - A green taxi is prominently visible, moving forward in traffic, with its brake lights illuminated.  \n- A white bus is positioned to the right of the green taxi, partially obstructing its lane.  \n- The street is lined with tall buildings, and construction scaffolding is visible on the right side of the road.\n[90-120s] - A green taxi is stationary on the right side of the road, with its brake lights illuminated.  \n- A white bus is positioned to the right of the taxi, partially visible and stationary.  \n- Traffic lights and street signs are visible, indicating a busy urban intersection.\n[120-150s] - A green taxi moves forward on the road, passing a white bus parked on the right side.  \n- A red truck crosses the street at an intersection, navigating through traffic.  \n- Yellow taxis and other vehicles are visible in motion, indicating active street traffic.\n[150-180s] - Yellow taxi van drives forward, maintaining lane position between other vehicles.  \n- Pedestrians cross street at crosswalk, moving from left to right relative to camera.  \n- Traffic lights change from yellow to red, halting vehicle movement at intersection.\n[180-210s] - A yellow taxi passes left to right across the foreground, followed by a white FedEx truck.\n- A silver pickup truck and a black SUV cross the intersection sequentially.\n- Pedestrians are seen crossing the street at the crosswalk, with one person walking away from the camera.\n[210-240s] - A green FedEx truck drives rightward, passing a crosswalk marked \"SCHOOL\" on the road.  \n- A yellow school bus emits white smoke as it moves forward, positioned ahead of the FedEx truck.  \n- A green taxi turns left at the intersection, navigating around the school bus and other vehicles.\n[240-270s] - Yellow taxi cab moves forward on right lane, passing parked cars.  \n- Pedestrian crosses street at crosswalk, moving from left to right.  \n- Traffic light at intersection shows green for vehicles, allowing flow.\n[270-300s] - Yellow taxi cab moves rightward across the street, passing a crosswalk.\n- A black SUV turns left at the intersection, navigating through traffic.\n- Traffic lights at the intersection change from red to green, allowing vehicles to proceed.\n[300-330s] - A black Porsche SUV drives forward on the right lane, passing yellow taxis and other vehicles.  \n- A white delivery truck with \"DHL\" branding is visible on the left side of the road, moving in the same direction.  \n- Traffic lights at the intersection show green, allowing vehicles to proceed through the crosswalk.\n[330-360s] - A black SUV is parked on the right side of the road, facing away from the camera.  \n- Two pedestrians cross the street from left to right at a marked crosswalk.  \n- A yellow taxi and a white van are visible in the distance, moving along the road.", "history_tokens": 789, "history_utf8_bytes": 3418, "recent_frame_times_s": [338.0119666666667, 339.01296666666667, 340.01396666666665, 341.0149666666667, 342.01596666666666, 343.0169666666667, 344.01796666666667, 345.01896666666664, 346.0199666666667, 347.02096666666665, 348.0219666666667, 349.02296666666666, 350.0239666666667, 351.02496666666667, 352.02596666666665, 353.0269666666667, 354.02796666666666, 355.0289666666667, 356.02996666666667, 357.03096666666664, 358.0319666666667, 359.03296666666665, 360.0006, 361.0016, 362.0026, 363.0036, 364.0046, 365.0056, 366.0066, 367.0076], "recent_frames_sha256": "6fa8c304dd22b458ceb01eb28fc3b7af8140b92f917568b8e51149070dc0c6e3", "num_recent_frames": 30, "tq": 717237.223492447, "t1": 717238.104210869, "ta": 717238.104210869, "te": 717238.142661636, "first_response_s": 0.880718421889469, "answer_total_s": 0.9191691889427602, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 381, "content_group": "2e9addaa2623ae56906a9373968863ad94e90b296bab78704d3992ff671cf902", "question": {"question_id": "sample_381_a1886_q0", "video_id": 381, "video_path": "./videos/sample_381_real.mp4", "annotation_index": 1886, "question_index": 0, "question": "What colors are the cones lining the street?", "options": ["A. Orange and white.", "B. Yellow and black.", "C. Green and white.", "D. Blue and white."], "answer": "A", "time_stamp_s": 488, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [488, 493], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_381_a1886_q0", "video_id": 381, "time_stamp_s": 488, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bd2cd2cae4b5d76b75e24ca2653881772d84f186f9420524575781f94f75a54d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [458.03186666666664, 459.0328666666667, 460.0005, 461.0015, 462.0025, 463.0035, 464.0045, 465.0055, 466.0065, 467.0075, 468.0085, 469.0095, 470.0105, 471.0115, 472.0125, 473.0135, 474.0145, 475.0155, 476.0165, 477.0175, 478.0185, 479.0195, 480.0205, 481.0215, 482.0225, 483.0235, 484.0245, 485.0255, 486.0265, 487.0275], "recent_frames_sha256": "c3ad0b47d1855e380c27d2733009f62c123d9f6165ebfef0a5b0331a9dc5f61b", "num_recent_frames": 30, "tq": 717089.719318144, "t1": 717102.537675502, "ta": 717102.537675502, "te": 717102.579919137, "first_response_s": 12.818357357988134, "answer_total_s": 12.860600992920808, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_381_a1886_q0", "video_id": 381, "time_stamp_s": 488, "ground_truth": "A", "raw_output": "A. Orange and white.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "c4ebc2500c669556cc2a2c2ccf80aebfba7f8a6d10eb04f1ef20db98df918204", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Yellow taxis and black SUVs navigate a busy urban street with traffic lights and crosswalks.  \n- Pedestrians walk along sidewalks flanked by tall buildings, some carrying bags or umbrellas.  \n- A white truck and a black sedan are visible among the traffic, with a red light momentarily stopping vehicles.\n[60-90s] - A green taxi is prominently visible, moving forward in traffic, with its brake lights illuminated.  \n- A white bus is positioned to the right of the green taxi, partially obstructing its lane.  \n- The street is lined with tall buildings, and construction scaffolding is visible on the right side of the road.\n[90-120s] - A green taxi is stationary on the right side of the road, with its brake lights illuminated.  \n- A white bus is positioned to the right of the taxi, partially visible and stationary.  \n- Traffic lights and street signs are visible, indicating a busy urban intersection.\n[120-150s] - A green taxi moves forward on the road, passing a white bus parked on the right side.  \n- A red truck crosses the street at an intersection, navigating through traffic.  \n- Yellow taxis and other vehicles are visible in motion, indicating active street traffic.\n[150-180s] - Yellow taxi van drives forward, maintaining lane position between other vehicles.  \n- Pedestrians cross street at crosswalk, moving from left to right relative to camera.  \n- Traffic lights change from yellow to red, halting vehicle movement at intersection.\n[180-210s] - A yellow taxi passes left to right across the foreground, followed by a white FedEx truck.\n- A silver pickup truck and a black SUV cross the intersection sequentially.\n- Pedestrians are seen crossing the street at the crosswalk, with one person walking away from the camera.\n[210-240s] - A green FedEx truck drives rightward, passing a crosswalk marked \"SCHOOL\" on the road.  \n- A yellow school bus emits white smoke as it moves forward, positioned ahead of the FedEx truck.  \n- A green taxi turns left at the intersection, navigating around the school bus and other vehicles.\n[240-270s] - Yellow taxi cab moves forward on right lane, passing parked cars.  \n- Pedestrian crosses street at crosswalk, moving from left to right.  \n- Traffic light at intersection shows green for vehicles, allowing flow.\n[270-300s] - Yellow taxi cab moves rightward across the street, passing a crosswalk.\n- A black SUV turns left at the intersection, navigating through traffic.\n- Traffic lights at the intersection change from red to green, allowing vehicles to proceed.\n[300-330s] - A black Porsche SUV drives forward on the right lane, passing yellow taxis and other vehicles.  \n- A white delivery truck with \"DHL\" branding is visible on the left side of the road, moving in the same direction.  \n- Traffic lights at the intersection show green, allowing vehicles to proceed through the crosswalk.\n[330-360s] - A black SUV is parked on the right side of the road, facing away from the camera.  \n- Two pedestrians cross the street from left to right at a marked crosswalk.  \n- A yellow taxi and a white van are visible in the distance, moving along the road.\n[360-390s] - A black SUV crosses the intersection from left to right, followed by a yellow taxi.\n- A pedestrian walks across the crosswalk from right to left, then exits the frame.\n- A silver SUV enters the frame from the left, moving rightward across the intersection.\n[390-420s] - Yellow taxis move steadily along the street, some turning or waiting at intersections.  \n- A black SUV is visible on the right side of the road, driving in the same direction as the taxis.  \n- A pedestrian crosses the street at a crosswalk, moving from left to right.\n[420-450s] - Yellow taxi cab crosses intersection from left to right, passing a brick building with \"E\" sign.  \n- Pedestrian crossing signal shows \"walk\" symbol, with a person waiting at crosswalk.  \n- Traffic light for vehicles turns red, halting traffic including a white SUV and black sedan.\n[450-480s] - A red SUV drives forward, its brake lights illuminated, as it approaches a crosswalk.  \n- A pedestrian crosses the street at the crosswalk, moving from left to right.  \n- A yellow taxi passes on the left side of the road, moving in the same direction as the SUV.", "history_tokens": 1000, "history_utf8_bytes": 4242, "recent_frame_times_s": [458.03186666666664, 459.0328666666667, 460.0005, 461.0015, 462.0025, 463.0035, 464.0045, 465.0055, 466.0065, 467.0075, 468.0085, 469.0095, 470.0105, 471.0115, 472.0125, 473.0135, 474.0145, 475.0155, 476.0165, 477.0175, 478.0185, 479.0195, 480.0205, 481.0215, 482.0225, 483.0235, 484.0245, 485.0255, 486.0265, 487.0275], "recent_frames_sha256": "c3ad0b47d1855e380c27d2733009f62c123d9f6165ebfef0a5b0331a9dc5f61b", "num_recent_frames": 30, "tq": 717268.034533735, "t1": 717269.319723183, "ta": 717269.319723183, "te": 717269.550075583, "first_response_s": 1.28518944804091, "answer_total_s": 1.5155418480280787, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 382, "content_group": "e6984fa0095ca3d21355f1f134d737bad26dcc003ad33166d493b749240f8bf1", "question": {"question_id": "sample_382_a538_q0", "video_id": 382, "video_path": "./videos/sample_382_real.mp4", "annotation_index": 538, "question_index": 0, "question": "What color is the taxi visible right now?", "options": ["A. Blue.", "B. Green.", "C. Yellow.", "D. Red."], "answer": "C", "time_stamp_s": 38, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_382_a538_q0", "video_id": 382, "time_stamp_s": 38, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "db7c03a8f4db9e38d6e19fc337b969a6e942287992c7b8558cd2c24f84612060", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [8.027633333333334, 9.028633333333334, 10.029633333333333, 11.030633333333334, 12.031633333333334, 13.032633333333333, 14.000266666666667, 15.001266666666666, 16.002266666666667, 17.003266666666665, 18.004266666666666, 19.005266666666667, 20.006266666666665, 21.007266666666666, 22.008266666666668, 23.009266666666665, 24.010266666666666, 25.011266666666668, 26.012266666666665, 27.013266666666667, 28.014266666666668, 29.015266666666665, 30.016266666666667, 31.017266666666668, 32.01826666666667, 33.01926666666667, 34.020266666666664, 35.02126666666667, 36.02226666666667, 37.023266666666665], "recent_frames_sha256": "2ee46c7f9e74d7ba143d4ccd8a9c46b03aba8c01b75e7ef8b7ef05e4696613cf", "num_recent_frames": 30, "tq": 718358.110122744, "t1": 718370.156606245, "ta": 718370.156606245, "te": 718370.194819445, "first_response_s": 12.046483500977047, "answer_total_s": 12.084696701029316, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_382_a538_q0", "video_id": 382, "time_stamp_s": 38, "ground_truth": "C", "raw_output": "C. Yellow.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "c95d7873809beb89e0efedd748e05773cdad1a1e7e506157b52ae5e49d7a1d38", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxis and other vehicles move along a city street with traffic lights and bare trees lining the road.  \n- A white van and a red pickup truck are parked or slow-moving near a building under construction with scaffolding.  \n- Pedestrians, including one walking a dog, cross the street at a crosswalk as traffic signals change.", "history_tokens": 76, "history_utf8_bytes": 341, "recent_frame_times_s": [8.027633333333334, 9.028633333333334, 10.029633333333333, 11.030633333333334, 12.031633333333334, 13.032633333333333, 14.000266666666667, 15.001266666666666, 16.002266666666667, 17.003266666666665, 18.004266666666666, 19.005266666666667, 20.006266666666665, 21.007266666666666, 22.008266666666668, 23.009266666666665, 24.010266666666666, 25.011266666666668, 26.012266666666665, 27.013266666666667, 28.014266666666668, 29.015266666666665, 30.016266666666667, 31.017266666666668, 32.01826666666667, 33.01926666666667, 34.020266666666664, 35.02126666666667, 36.02226666666667, 37.023266666666665], "recent_frames_sha256": "2ee46c7f9e74d7ba143d4ccd8a9c46b03aba8c01b75e7ef8b7ef05e4696613cf", "num_recent_frames": 30, "tq": 718419.597261287, "t1": 718421.400263057, "ta": 718421.400263057, "te": 718421.641468298, "first_response_s": 1.803001769934781, "answer_total_s": 2.0442070110002533, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 382, "content_group": "e6984fa0095ca3d21355f1f134d737bad26dcc003ad33166d493b749240f8bf1", "question": {"question_id": "sample_382_a539_q0", "video_id": 382, "video_path": "./videos/sample_382_real.mp4", "annotation_index": 539, "question_index": 0, "question": "What type of vehicle is shown in the foreground right now?", "options": ["A. A truck.", "B. A taxi.", "C. A motorcycle.", "D. A bicycle."], "answer": "B", "time_stamp_s": 126, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [125, 130], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_382_a539_q0", "video_id": 382, "time_stamp_s": 126, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d31d90fc739d63af26dbc87c22130a3246b10387e13a32af654eeea49a3aa55f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [96.01553333333334, 97.01653333333333, 98.01753333333333, 99.01853333333334, 100.01953333333333, 101.02053333333333, 102.02153333333334, 103.02253333333333, 104.02353333333333, 105.02453333333334, 106.02553333333333, 107.02653333333333, 108.02753333333334, 109.02853333333333, 110.02953333333333, 111.03053333333334, 112.03153333333333, 113.03253333333333, 114.00016666666667, 115.00116666666666, 116.00216666666667, 117.00316666666667, 118.00416666666666, 119.00516666666667, 120.00616666666667, 121.00716666666666, 122.00816666666667, 123.00916666666667, 124.01016666666666, 125.01116666666667], "recent_frames_sha256": "677b946af59a0963dda26e57dbee6ad0c6f0fbe11bda29b6a0042219ba8e3b09", "num_recent_frames": 30, "tq": 718370.214812583, "t1": 718382.792363958, "ta": 718382.792363958, "te": 718382.841169749, "first_response_s": 12.5775513749104, "answer_total_s": 12.626357165980153, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_382_a539_q0", "video_id": 382, "time_stamp_s": 126, "ground_truth": "B", "raw_output": "B. A taxi.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "75794a3de9da868f5036e6bca7121f44a613a41ccb184f6e2ebcc2517d70e822", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxis and other vehicles move along a city street with traffic lights and bare trees lining the road.  \n- A white van and a red pickup truck are parked or slow-moving near a building under construction with scaffolding.  \n- Pedestrians, including one walking a dog, cross the street at a crosswalk as traffic signals change.\n[30-60s] - Yellow taxi cab moves forward, following traffic on a multi-lane city street.  \n- A white bus is visible to the right, parallel to the taxi, with its rear facing the camera.  \n- Traffic lights change from red to green, allowing vehicles to proceed through the intersection.\n[60-90s] - Yellow taxi with license plate \"NY 12345\" remains stationary in traffic, positioned behind a silver sedan.  \n- White delivery truck labeled \"STANLEY RUTH\" is parked on the left side of the road, partially obstructing the lane.  \n- A large white bus is visible on the right, stationary or moving slowly, with its side facing the camera.\n[90-120s] - A yellow taxi cab is stationary at a crosswalk, facing away from the camera, with its brake lights illuminated.  \n- A white delivery truck with \"STANLEY RUTH\" branding is parked on the left side of the road, partially obstructing the crosswalk.  \n- A white bus is visible on the right side of the road, moving slowly or stopped, with its front facing the camera.", "history_tokens": 321, "history_utf8_bytes": 1348, "recent_frame_times_s": [96.01553333333334, 97.01653333333333, 98.01753333333333, 99.01853333333334, 100.01953333333333, 101.02053333333333, 102.02153333333334, 103.02253333333333, 104.02353333333333, 105.02453333333334, 106.02553333333333, 107.02653333333333, 108.02753333333334, 109.02853333333333, 110.02953333333333, 111.03053333333334, 112.03153333333333, 113.03253333333333, 114.00016666666667, 115.00116666666666, 116.00216666666667, 117.00316666666667, 118.00416666666666, 119.00516666666667, 120.00616666666667, 121.00716666666666, 122.00816666666667, 123.00916666666667, 124.01016666666666, 125.01116666666667], "recent_frames_sha256": "677b946af59a0963dda26e57dbee6ad0c6f0fbe11bda29b6a0042219ba8e3b09", "num_recent_frames": 30, "tq": 718444.289397, "t1": 718451.814707941, "ta": 718451.814707941, "te": 718452.163372718, "first_response_s": 7.525310941040516, "answer_total_s": 7.873975718044676, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 382, "content_group": "e6984fa0095ca3d21355f1f134d737bad26dcc003ad33166d493b749240f8bf1", "question": {"question_id": "sample_382_a540_q0", "video_id": 382, "video_path": "./videos/sample_382_real.mp4", "annotation_index": 540, "question_index": 0, "question": "What type of lanes is indicated by the road markings right now?", "options": ["A. Carpool lanes.", "B. HOV lanes.", "C. Bus lanes.", "D. Bike lanes."], "answer": "C", "time_stamp_s": 254, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [250, 255], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_382_a540_q0", "video_id": 382, "time_stamp_s": 254, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d4f368921403e5f5fb66c639aa5c31602733fa9519fa0c6da5c0917df7eab7f6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [224.01006666666666, 225.01106666666666, 226.01206666666667, 227.01306666666667, 228.01406666666668, 229.01506666666666, 230.01606666666666, 231.01706666666666, 232.01806666666667, 233.01906666666667, 234.02006666666668, 235.02106666666666, 236.02206666666666, 237.02306666666667, 238.02406666666667, 239.02506666666667, 240.02606666666668, 241.02706666666666, 242.02806666666666, 243.02906666666667, 244.03006666666667, 245.03106666666667, 246.03206666666668, 247.03306666666666, 248.0007, 249.0017, 250.0027, 251.0037, 252.0047, 253.0057], "recent_frames_sha256": "8428f734031fc83851a0af863e8f2b068582a695a878842423c9eab7f91396e9", "num_recent_frames": 30, "tq": 718382.857218847, "t1": 718390.500461205, "ta": 718390.500461205, "te": 718390.538110778, "first_response_s": 7.643242357997224, "answer_total_s": 7.680891930940561, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_382_a540_q0", "video_id": 382, "time_stamp_s": 254, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "13d616e6b52b9e66dc2a28e0b7f1da3126a499c784fde87af5550fcaea1830cb", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxis and other vehicles move along a city street with traffic lights and bare trees lining the road.  \n- A white van and a red pickup truck are parked or slow-moving near a building under construction with scaffolding.  \n- Pedestrians, including one walking a dog, cross the street at a crosswalk as traffic signals change.\n[30-60s] - Yellow taxi cab moves forward, following traffic on a multi-lane city street.  \n- A white bus is visible to the right, parallel to the taxi, with its rear facing the camera.  \n- Traffic lights change from red to green, allowing vehicles to proceed through the intersection.\n[60-90s] - Yellow taxi with license plate \"NY 12345\" remains stationary in traffic, positioned behind a silver sedan.  \n- White delivery truck labeled \"STANLEY RUTH\" is parked on the left side of the road, partially obstructing the lane.  \n- A large white bus is visible on the right, stationary or moving slowly, with its side facing the camera.\n[90-120s] - A yellow taxi cab is stationary at a crosswalk, facing away from the camera, with its brake lights illuminated.  \n- A white delivery truck with \"STANLEY RUTH\" branding is parked on the left side of the road, partially obstructing the crosswalk.  \n- A white bus is visible on the right side of the road, moving slowly or stopped, with its front facing the camera.\n[120-150s] - Yellow taxi moves forward on the road, maintaining center lane position.  \n- White bus travels in the right lane, overtaking the taxi as it approaches the intersection.  \n- Traffic lights at the intersection show green, allowing vehicles to proceed.\n[150-180s] - A yellow taxi is stationary at the intersection, waiting for traffic to clear.\n- A large beige truck is parked on the left side of the road, near a bus stop.\n- Pedestrians are crossing the street at the crosswalk, moving from left to right.\n[180-210s] - Yellow taxi turns right at intersection, merging into traffic flow.\n- Large beige truck remains stationary at curb, partially blocking crosswalk.\n- Pedestrians cross street at crosswalk, moving from left to right.\n[210-240s] - Yellow taxis move forward in a line, passing through intersections with traffic lights and crosswalks.  \n- A black SUV overtakes a taxi on the left side of the road.  \n- Pedestrians walk along sidewalks flanked by tall buildings and bare trees.", "history_tokens": 562, "history_utf8_bytes": 2350, "recent_frame_times_s": [224.01006666666666, 225.01106666666666, 226.01206666666667, 227.01306666666667, 228.01406666666668, 229.01506666666666, 230.01606666666666, 231.01706666666666, 232.01806666666667, 233.01906666666667, 234.02006666666668, 235.02106666666666, 236.02206666666666, 237.02306666666667, 238.02406666666667, 239.02506666666667, 240.02606666666668, 241.02706666666666, 242.02806666666666, 243.02906666666667, 244.03006666666667, 245.03106666666667, 246.03206666666668, 247.03306666666666, 248.0007, 249.0017, 250.0027, 251.0037, 252.0047, 253.0057], "recent_frames_sha256": "8428f734031fc83851a0af863e8f2b068582a695a878842423c9eab7f91396e9", "num_recent_frames": 30, "tq": 718487.022993663, "t1": 718494.325067827, "ta": 718494.325067827, "te": 718494.565280037, "first_response_s": 7.30207416403573, "answer_total_s": 7.5422863740241155, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 382, "content_group": "e6984fa0095ca3d21355f1f134d737bad26dcc003ad33166d493b749240f8bf1", "question": {"question_id": "sample_382_a541_q0", "video_id": 382, "video_path": "./videos/sample_382_real.mp4", "annotation_index": 541, "question_index": 0, "question": "What time is displayed on the clock visible right now?", "options": ["A. 12:50.", "B. 13:10.", "C. 12:00.", "D. 12:25."], "answer": "D", "time_stamp_s": 377, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [375, 380], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_382_a541_q0", "video_id": 382, "time_stamp_s": 377, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c326a75468f0deff011c91a1d23d735ecf00c1fb2838ee774971d073ef217d7e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [347.03296666666665, 348.0006, 349.0016, 350.0026, 351.0036, 352.0046, 353.0056, 354.0066, 355.0076, 356.0086, 357.0096, 358.0106, 359.0116, 360.0126, 361.0136, 362.0146, 363.0156, 364.0166, 365.0176, 366.0186, 367.0196, 368.0206, 369.0216, 370.0226, 371.0236, 372.0246, 373.0256, 374.0266, 375.0276, 376.0286], "recent_frames_sha256": "7c4bef7b8402c67ba5f69154e43a8bbd71a1fbaaa14214475f8cd7e028022af1", "num_recent_frames": 30, "tq": 718390.550999358, "t1": 718402.269641055, "ta": 718402.269641055, "te": 718402.590154953, "first_response_s": 11.718641697079875, "answer_total_s": 12.039155595004559, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_382_a541_q0", "video_id": 382, "time_stamp_s": 377, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "aaa590da561fc1ef17d59cde338536a6eb80b73679dcb3bfcb2f119e0daebbd6", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxis and other vehicles move along a city street with traffic lights and bare trees lining the road.  \n- A white van and a red pickup truck are parked or slow-moving near a building under construction with scaffolding.  \n- Pedestrians, including one walking a dog, cross the street at a crosswalk as traffic signals change.\n[30-60s] - Yellow taxi cab moves forward, following traffic on a multi-lane city street.  \n- A white bus is visible to the right, parallel to the taxi, with its rear facing the camera.  \n- Traffic lights change from red to green, allowing vehicles to proceed through the intersection.\n[60-90s] - Yellow taxi with license plate \"NY 12345\" remains stationary in traffic, positioned behind a silver sedan.  \n- White delivery truck labeled \"STANLEY RUTH\" is parked on the left side of the road, partially obstructing the lane.  \n- A large white bus is visible on the right, stationary or moving slowly, with its side facing the camera.\n[90-120s] - A yellow taxi cab is stationary at a crosswalk, facing away from the camera, with its brake lights illuminated.  \n- A white delivery truck with \"STANLEY RUTH\" branding is parked on the left side of the road, partially obstructing the crosswalk.  \n- A white bus is visible on the right side of the road, moving slowly or stopped, with its front facing the camera.\n[120-150s] - Yellow taxi moves forward on the road, maintaining center lane position.  \n- White bus travels in the right lane, overtaking the taxi as it approaches the intersection.  \n- Traffic lights at the intersection show green, allowing vehicles to proceed.\n[150-180s] - A yellow taxi is stationary at the intersection, waiting for traffic to clear.\n- A large beige truck is parked on the left side of the road, near a bus stop.\n- Pedestrians are crossing the street at the crosswalk, moving from left to right.\n[180-210s] - Yellow taxi turns right at intersection, merging into traffic flow.\n- Large beige truck remains stationary at curb, partially blocking crosswalk.\n- Pedestrians cross street at crosswalk, moving from left to right.\n[210-240s] - Yellow taxis move forward in a line, passing through intersections with traffic lights and crosswalks.  \n- A black SUV overtakes a taxi on the left side of the road.  \n- Pedestrians walk along sidewalks flanked by tall buildings and bare trees.\n[240-270s] - Yellow taxis move forward in a line, with one turning right at a crosswalk.  \n- Pedestrians cross the street at a marked crosswalk, some walking briskly.  \n- A white van passes on the right side of the road, moving in the same direction as the taxis.\n[270-300s] - A white delivery van with \"UPS\" branding is stationary at the intersection, partially obscured by a yellow taxi cab.\n- A large white semi-truck is positioned behind the van, with its trailer facing the camera, and appears to be waiting at the traffic light.\n- Pedestrians are crossing the street, with some walking towards the camera and others moving away, indicating active crosswalk usage.\n[300-330s] - A cyclist in a blue jacket crosses the street from left to right, passing a white truck and a black SUV.  \n- Yellow taxis are stopped at the intersection, with one taxi turning right into a side street.  \n- Pedestrians, including a man in a blue coat, cross the street at the crosswalk as the traffic light turns green.\n[330-360s] - Yellow taxis dominate the street, moving in lanes with some stopping at a crosswalk.  \n- A cyclist in a white shirt rides ahead of the taxis, navigating the traffic.  \n- Pedestrians cross the street at a marked crosswalk, with some waiting at the curb.", "history_tokens": 871, "history_utf8_bytes": 3619, "recent_frame_times_s": [347.03296666666665, 348.0006, 349.0016, 350.0026, 351.0036, 352.0046, 353.0056, 354.0066, 355.0076, 356.0086, 357.0096, 358.0106, 359.0116, 360.0126, 361.0136, 362.0146, 363.0156, 364.0166, 365.0176, 366.0186, 367.0196, 368.0206, 369.0216, 370.0226, 371.0236, 372.0246, 373.0256, 374.0266, 375.0276, 376.0286], "recent_frames_sha256": "7c4bef7b8402c67ba5f69154e43a8bbd71a1fbaaa14214475f8cd7e028022af1", "num_recent_frames": 30, "tq": 718528.225734649, "t1": 718536.296207599, "ta": 718536.296207599, "te": 718536.337138616, "first_response_s": 8.070472949999385, "answer_total_s": 8.111403967021033, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 382, "content_group": "e6984fa0095ca3d21355f1f134d737bad26dcc003ad33166d493b749240f8bf1", "question": {"question_id": "sample_382_a542_q0", "video_id": 382, "video_path": "./videos/sample_382_real.mp4", "annotation_index": 542, "question_index": 0, "question": "Which brand's store is visible on the right side of the street right now?", "options": ["A. Nike.", "B. GAP.", "C. Adidas.", "D. H&M."], "answer": "B", "time_stamp_s": 502, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [500, 505], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_382_a542_q0", "video_id": 382, "time_stamp_s": 502, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b8f9f531d47c0e726fc6a43c8665178c4736d3c31e10ae1b8efd57125740a596", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [472.0245, 473.0255, 474.0265, 475.0275, 476.0285, 477.0295, 478.0305, 479.0315, 480.0325, 481.00013333333334, 482.0011333333333, 483.00213333333335, 484.0031333333333, 485.00413333333336, 486.00513333333333, 487.0061333333333, 488.00713333333334, 489.0081333333333, 490.00913333333335, 491.01013333333333, 492.0111333333333, 493.01213333333334, 494.0131333333333, 495.01413333333335, 496.0151333333333, 497.01613333333336, 498.01713333333333, 499.0181333333333, 500.01913333333334, 501.0201333333333], "recent_frames_sha256": "38033630661d073f358d3c688d707af9c23bea373fe239c404a2ba999d741184", "num_recent_frames": 30, "tq": 718402.600879408, "t1": 718414.465833676, "ta": 718414.465833676, "te": 718414.505505494, "first_response_s": 11.864954268094152, "answer_total_s": 11.90462608600501, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_382_a542_q0", "video_id": 382, "time_stamp_s": 502, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "93bdcecb5bc9e928f8e433492df493c13bae0cee5d9338383678475a57079e4e", "condition_order": ["recent", "notes"], "memory": "[90-120s] - A yellow taxi cab is stationary at a crosswalk, facing away from the camera, with its brake lights illuminated.  \n- A white delivery truck with \"STANLEY RUTH\" branding is parked on the left side of the road, partially obstructing the crosswalk.  \n- A white bus is visible on the right side of the road, moving slowly or stopped, with its front facing the camera.\n[120-150s] - Yellow taxi moves forward on the road, maintaining center lane position.  \n- White bus travels in the right lane, overtaking the taxi as it approaches the intersection.  \n- Traffic lights at the intersection show green, allowing vehicles to proceed.\n[150-180s] - A yellow taxi is stationary at the intersection, waiting for traffic to clear.\n- A large beige truck is parked on the left side of the road, near a bus stop.\n- Pedestrians are crossing the street at the crosswalk, moving from left to right.\n[180-210s] - Yellow taxi turns right at intersection, merging into traffic flow.\n- Large beige truck remains stationary at curb, partially blocking crosswalk.\n- Pedestrians cross street at crosswalk, moving from left to right.\n[210-240s] - Yellow taxis move forward in a line, passing through intersections with traffic lights and crosswalks.  \n- A black SUV overtakes a taxi on the left side of the road.  \n- Pedestrians walk along sidewalks flanked by tall buildings and bare trees.\n[240-270s] - Yellow taxis move forward in a line, with one turning right at a crosswalk.  \n- Pedestrians cross the street at a marked crosswalk, some walking briskly.  \n- A white van passes on the right side of the road, moving in the same direction as the taxis.\n[270-300s] - A white delivery van with \"UPS\" branding is stationary at the intersection, partially obscured by a yellow taxi cab.\n- A large white semi-truck is positioned behind the van, with its trailer facing the camera, and appears to be waiting at the traffic light.\n- Pedestrians are crossing the street, with some walking towards the camera and others moving away, indicating active crosswalk usage.\n[300-330s] - A cyclist in a blue jacket crosses the street from left to right, passing a white truck and a black SUV.  \n- Yellow taxis are stopped at the intersection, with one taxi turning right into a side street.  \n- Pedestrians, including a man in a blue coat, cross the street at the crosswalk as the traffic light turns green.\n[330-360s] - Yellow taxis dominate the street, moving in lanes with some stopping at a crosswalk.  \n- A cyclist in a white shirt rides ahead of the taxis, navigating the traffic.  \n- Pedestrians cross the street at a marked crosswalk, with some waiting at the curb.\n[360-390s] - Yellow taxis line the street, some stationary, others moving slowly in traffic.  \n- A clock on a building’s facade shows time, but its reading is not discernible.  \n- A yellow van is visible on the right side of the road, positioned behind a taxi.\n[390-420s] - A white bus with red and blue stripes enters from the right, stopping at a crosswalk.  \n- Yellow taxis are stationary or moving slowly in traffic, with one taxi turning left at the intersection.  \n- A yellow van with \"NYC\" branding is visible on the left, partially obscured by a barrier.\n[420-450s] - A white MTA bus (number 7417) is stationary on the right, displaying route \"42\" on its digital sign.  \n- Yellow taxis are moving forward in traffic, with one taxi turning left at the intersection.  \n- A white delivery truck with \"DHL\" branding is visible on the left side of the road, partially obscured by a taxi.\n[450-480s] - A white bus with \"BUSES\" text on its side is stationary on the right lane, partially obscured by yellow taxis.\n- A blue and white delivery truck appears behind the bus, moving slowly through traffic.\n- A yellow taxi with a visible license plate \"3233\" is in the center of the frame, surrounded by other taxis.", "history_tokens": 951, "history_utf8_bytes": 3861, "recent_frame_times_s": [472.0245, 473.0255, 474.0265, 475.0275, 476.0285, 477.0295, 478.0305, 479.0315, 480.0325, 481.00013333333334, 482.0011333333333, 483.00213333333335, 484.0031333333333, 485.00413333333336, 486.00513333333333, 487.0061333333333, 488.00713333333334, 489.0081333333333, 490.00913333333335, 491.01013333333333, 492.0111333333333, 493.01213333333334, 494.0131333333333, 495.01413333333335, 496.0151333333333, 497.01613333333336, 498.01713333333333, 499.0181333333333, 500.01913333333334, 501.0201333333333], "recent_frames_sha256": "38033630661d073f358d3c688d707af9c23bea373fe239c404a2ba999d741184", "num_recent_frames": 30, "tq": 718565.34095719, "t1": 718567.490237637, "ta": 718567.490237637, "te": 718567.527613279, "first_response_s": 2.1492804469307885, "answer_total_s": 2.186656088917516, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 383, "content_group": "c85dc8f436ac5d7621e54ebebcb43935dc16cd422449c5df4fbb25c59ec93577", "question": {"question_id": "sample_383_a168_q0", "video_id": 383, "video_path": "./videos/sample_383_real.mp4", "annotation_index": 168, "question_index": 0, "question": "Which country's flag is hanging on the right side of the road now?", "options": ["A. Australia.", "B. Italy.", "C. United States.", "D. UK."], "answer": "C", "time_stamp_s": 3, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_383_a168_q0", "video_id": 383, "time_stamp_s": 3, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a354317483d50c6a004d6544e17321b09e5b5bff8b9945f5d9345e85e30040ba", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.034, 1.0016333333333334, 2.0026333333333333], "recent_frames_sha256": "1759452b5f9d87ec279406b3f05bbad39a42aa021d0b6e270667fae5229562ee", "num_recent_frames": 3, "tq": 717116.069466784, "t1": 717126.548854189, "ta": 717126.548854189, "te": 717126.587578068, "first_response_s": 10.479387404979207, "answer_total_s": 10.518111284007318, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_383_a168_q0", "video_id": 383, "time_stamp_s": 3, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ccc2cb9c88312fcfa1346954b487cdf0bf30316f828a7d4a887f87a3d7c02cd6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.034, 1.0016333333333334, 2.0026333333333333], "recent_frames_sha256": "1759452b5f9d87ec279406b3f05bbad39a42aa021d0b6e270667fae5229562ee", "num_recent_frames": 3, "tq": 716954.662686974, "t1": 716967.030433825, "ta": 716967.030433825, "te": 716967.265067114, "first_response_s": 12.36774685094133, "answer_total_s": 12.602380139986053, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 383, "content_group": "c85dc8f436ac5d7621e54ebebcb43935dc16cd422449c5df4fbb25c59ec93577", "question": {"question_id": "sample_383_a169_q0", "video_id": 383, "video_path": "./videos/sample_383_real.mp4", "annotation_index": 169, "question_index": 0, "question": "Which store sign is currently visible on the right side of the road right now?", "options": ["A. Victoria's Secret.", "B. Lululemon.", "C. Ann Taylor.", "D. Forever 21."], "answer": "C", "time_stamp_s": 128, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [124, 129], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_383_a169_q0", "video_id": 383, "time_stamp_s": 128, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "04435acead2446188a5538b79f02d17d987a684274d5f31223b031cfa3d6ac03", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [98.0319, 99.0329, 100.00053333333334, 101.00153333333333, 102.00253333333333, 103.00353333333334, 104.00453333333333, 105.00553333333333, 106.00653333333334, 107.00753333333333, 108.00853333333333, 109.00953333333334, 110.01053333333333, 111.01153333333333, 112.01253333333334, 113.01353333333333, 114.01453333333333, 115.01553333333334, 116.01653333333333, 117.01753333333333, 118.01853333333334, 119.01953333333333, 120.02053333333333, 121.02153333333334, 122.02253333333333, 123.02353333333333, 124.02453333333334, 125.02553333333333, 126.02653333333333, 127.02753333333334], "recent_frames_sha256": "2f0104df28eac834ec9d7691537ad0ba8fa6e174096e616b87fe3ade33c0f8a7", "num_recent_frames": 30, "tq": 717126.599118287, "t1": 717166.230581846, "ta": 717166.230581846, "te": 717166.268046735, "first_response_s": 39.631463558995165, "answer_total_s": 39.6689284479944, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_383_a169_q0", "video_id": 383, "time_stamp_s": 128, "ground_truth": "C", "raw_output": "C. Ann Taylor.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "289ce71cd09cf45e08b2f8e23426a2aca8443bc305fe5bb8c8d2e0e18c21e349", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A maroon SUV drives forward, followed by yellow taxis and a white postal truck, navigating a busy city street lined with tall buildings and American flags.  \n- Pedestrians cross the street at marked crosswalks, while cyclists ride along the sidewalks.  \n- A large billboard on the left side of the street displays colorful abstract art, and another billboard on the right features a portrait of a man.\n[30-60s] - Yellow taxis are stationary in traffic, aligned in lanes with some turning or moving slowly.\n- American flags hang prominently from buildings on both sides of the street, swaying slightly.\n- Pedestrians cross the street at a crosswalk, with some walking toward or away from the camera.\n[60-90s] - A large white bus enters the frame from the right, moving slowly through traffic.  \n- Yellow taxis remain stationary in the foreground, with one taxi's rear lights illuminated.  \n- American flags hang prominently along the buildings on both sides of the street.\n[90-120s] - A white bus with blue trim moves forward, passing yellow taxis at a crosswalk, with American flags lining the street.  \n- Yellow taxis and other vehicles, including a white van, are visible on the road, with pedestrians crossing at the intersection.  \n- The bus continues down the street, flanked by tall buildings and more American flags, as the camera follows its movement.", "history_tokens": 300, "history_utf8_bytes": 1369, "recent_frame_times_s": [98.0319, 99.0329, 100.00053333333334, 101.00153333333333, 102.00253333333333, 103.00353333333334, 104.00453333333333, 105.00553333333333, 106.00653333333334, 107.00753333333333, 108.00853333333333, 109.00953333333334, 110.01053333333333, 111.01153333333333, 112.01253333333334, 113.01353333333333, 114.01453333333333, 115.01553333333334, 116.01653333333333, 117.01753333333333, 118.01853333333334, 119.01953333333333, 120.02053333333333, 121.02153333333334, 122.02253333333333, 123.02353333333333, 124.02453333333334, 125.02553333333333, 126.02653333333333, 127.02753333333334], "recent_frames_sha256": "2f0104df28eac834ec9d7691537ad0ba8fa6e174096e616b87fe3ade33c0f8a7", "num_recent_frames": 30, "tq": 716995.219126869, "t1": 716996.712720697, "ta": 716996.712720697, "te": 716996.902057228, "first_response_s": 1.493593828054145, "answer_total_s": 1.682930359034799, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 383, "content_group": "c85dc8f436ac5d7621e54ebebcb43935dc16cd422449c5df4fbb25c59ec93577", "question": {"question_id": "sample_383_a170_q0", "video_id": 383, "video_path": "./videos/sample_383_real.mp4", "annotation_index": 170, "question_index": 0, "question": "Which basketball-related sign is currently visible in the video right now?", "options": ["A. NBA Store.", "B. Nike Store.", "C. Adidas Shop.", "D. Reebok Shop."], "answer": "A", "time_stamp_s": 251, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [248, 253], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_383_a170_q0", "video_id": 383, "time_stamp_s": 251, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a6d3da018a7abe83405f19f615d44d4e7b058927c15101ec54507260a3bce555", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [221.02143333333333, 222.02243333333334, 223.02343333333334, 224.02443333333332, 225.02543333333332, 226.02643333333333, 227.02743333333333, 228.02843333333334, 229.02943333333334, 230.03043333333332, 231.03143333333333, 232.03243333333333, 233.00006666666667, 234.00106666666667, 235.00206666666668, 236.00306666666665, 237.00406666666666, 238.00506666666666, 239.00606666666667, 240.00706666666667, 241.00806666666668, 242.00906666666666, 243.01006666666666, 244.01106666666666, 245.01206666666667, 246.01306666666667, 247.01406666666668, 248.01506666666666, 249.01606666666666, 250.01706666666666], "recent_frames_sha256": "b5715b29ee412558051883e2501fdc1c7d8ec9392333abc52f5423dd5c95c70f", "num_recent_frames": 30, "tq": 717166.28024938, "t1": 717180.495933239, "ta": 717180.495933239, "te": 717180.533791891, "first_response_s": 14.215683858958073, "answer_total_s": 14.253542510909028, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_383_a170_q0", "video_id": 383, "time_stamp_s": 251, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "19e7388d27120e6deac4a44340410a8716214a4f5ce486769e76d71872a8ddfd", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A maroon SUV drives forward, followed by yellow taxis and a white postal truck, navigating a busy city street lined with tall buildings and American flags.  \n- Pedestrians cross the street at marked crosswalks, while cyclists ride along the sidewalks.  \n- A large billboard on the left side of the street displays colorful abstract art, and another billboard on the right features a portrait of a man.\n[30-60s] - Yellow taxis are stationary in traffic, aligned in lanes with some turning or moving slowly.\n- American flags hang prominently from buildings on both sides of the street, swaying slightly.\n- Pedestrians cross the street at a crosswalk, with some walking toward or away from the camera.\n[60-90s] - A large white bus enters the frame from the right, moving slowly through traffic.  \n- Yellow taxis remain stationary in the foreground, with one taxi's rear lights illuminated.  \n- American flags hang prominently along the buildings on both sides of the street.\n[90-120s] - A white bus with blue trim moves forward, passing yellow taxis at a crosswalk, with American flags lining the street.  \n- Yellow taxis and other vehicles, including a white van, are visible on the road, with pedestrians crossing at the intersection.  \n- The bus continues down the street, flanked by tall buildings and more American flags, as the camera follows its movement.\n[120-150s] - A white van with \"NYC\" on its rear is stopped at a crosswalk, surrounded by yellow taxis and pedestrians.  \n- Pedestrians cross the street in front of the van, some carrying bags or walking in groups.  \n- A cyclist rides across the crosswalk, passing the van and other vehicles, while a red SUV waits on the right.\n[150-180s] - Yellow taxi cab moves slowly across the intersection, positioned between pedestrians crossing the street.  \n- A large white bus appears from the right, approaching the intersection, with its front facing the camera.  \n- A blue and white tour bus enters the frame from the right, partially obscuring the view of the white bus as it passes.\n[180-210s] - Red van and yellow taxis stop at intersection, with bus partially visible on right.  \n- Pedestrians cross street at crosswalk, some walking toward camera.  \n- Traffic lights change to green, allowing vehicles to proceed forward.\n[210-240s] - A red van and a white van are driving in the same lane, with the white van slightly ahead.  \n- Yellow taxis are visible on both sides of the road, including one turning left at the intersection.  \n- A large bus with \"MIDTOWN\" branding enters the frame from the right, moving in the same direction as the vans.", "history_tokens": 600, "history_utf8_bytes": 2614, "recent_frame_times_s": [221.02143333333333, 222.02243333333334, 223.02343333333334, 224.02443333333332, 225.02543333333332, 226.02643333333333, 227.02743333333333, 228.02843333333334, 229.02943333333334, 230.03043333333332, 231.03143333333333, 232.03243333333333, 233.00006666666667, 234.00106666666667, 235.00206666666668, 236.00306666666665, 237.00406666666666, 238.00506666666666, 239.00606666666667, 240.00706666666667, 241.00806666666668, 242.00906666666666, 243.01006666666666, 244.01106666666666, 245.01206666666667, 246.01306666666667, 247.01406666666668, 248.01506666666666, 249.01606666666666, 250.01706666666666], "recent_frames_sha256": "b5715b29ee412558051883e2501fdc1c7d8ec9392333abc52f5423dd5c95c70f", "num_recent_frames": 30, "tq": 717030.861133439, "t1": 717042.557186747, "ta": 717042.557186747, "te": 717042.59870754, "first_response_s": 11.696053307969123, "answer_total_s": 11.737574100960046, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 383, "content_group": "c85dc8f436ac5d7621e54ebebcb43935dc16cd422449c5df4fbb25c59ec93577", "question": {"question_id": "sample_383_a171_q0", "video_id": 383, "video_path": "./videos/sample_383_real.mp4", "annotation_index": 171, "question_index": 0, "question": "Which store sign is visible on the right side of the road right now?", "options": ["A. Starbucks.", "B. Pret A Manger.", "C. Chipotle.", "D. McDonald's."], "answer": "B", "time_stamp_s": 374, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [372, 377], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_383_a171_q0", "video_id": 383, "time_stamp_s": 374, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "14581ec81d5abdf5228a44b8e348faf2b27721bfd59d26e1067ec75c2dffb0c4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [344.01096666666666, 345.0119666666667, 346.01296666666667, 347.01396666666665, 348.0149666666667, 349.01596666666666, 350.0169666666667, 351.01796666666667, 352.01896666666664, 353.0199666666667, 354.02096666666665, 355.0219666666667, 356.02296666666666, 357.0239666666667, 358.02496666666667, 359.02596666666665, 360.0269666666667, 361.02796666666666, 362.0289666666667, 363.02996666666667, 364.03096666666664, 365.0319666666667, 366.03296666666665, 367.0006, 368.0016, 369.0026, 370.0036, 371.0046, 372.0056, 373.0066], "recent_frames_sha256": "509acf16ed5eca77977175caa7e1589c64f8edafff08a0b9b5ef0f71a410e7e6", "num_recent_frames": 30, "tq": 717180.545141203, "t1": 717191.958927242, "ta": 717191.958927242, "te": 717191.996488366, "first_response_s": 11.413786038989201, "answer_total_s": 11.451347163063474, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_383_a171_q0", "video_id": 383, "time_stamp_s": 374, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d9f251b4e3f229e23ecc154c17249b8503da5a17d5af60287ada58b81cdb65ca", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A maroon SUV drives forward, followed by yellow taxis and a white postal truck, navigating a busy city street lined with tall buildings and American flags.  \n- Pedestrians cross the street at marked crosswalks, while cyclists ride along the sidewalks.  \n- A large billboard on the left side of the street displays colorful abstract art, and another billboard on the right features a portrait of a man.\n[30-60s] - Yellow taxis are stationary in traffic, aligned in lanes with some turning or moving slowly.\n- American flags hang prominently from buildings on both sides of the street, swaying slightly.\n- Pedestrians cross the street at a crosswalk, with some walking toward or away from the camera.\n[60-90s] - A large white bus enters the frame from the right, moving slowly through traffic.  \n- Yellow taxis remain stationary in the foreground, with one taxi's rear lights illuminated.  \n- American flags hang prominently along the buildings on both sides of the street.\n[90-120s] - A white bus with blue trim moves forward, passing yellow taxis at a crosswalk, with American flags lining the street.  \n- Yellow taxis and other vehicles, including a white van, are visible on the road, with pedestrians crossing at the intersection.  \n- The bus continues down the street, flanked by tall buildings and more American flags, as the camera follows its movement.\n[120-150s] - A white van with \"NYC\" on its rear is stopped at a crosswalk, surrounded by yellow taxis and pedestrians.  \n- Pedestrians cross the street in front of the van, some carrying bags or walking in groups.  \n- A cyclist rides across the crosswalk, passing the van and other vehicles, while a red SUV waits on the right.\n[150-180s] - Yellow taxi cab moves slowly across the intersection, positioned between pedestrians crossing the street.  \n- A large white bus appears from the right, approaching the intersection, with its front facing the camera.  \n- A blue and white tour bus enters the frame from the right, partially obscuring the view of the white bus as it passes.\n[180-210s] - Red van and yellow taxis stop at intersection, with bus partially visible on right.  \n- Pedestrians cross street at crosswalk, some walking toward camera.  \n- Traffic lights change to green, allowing vehicles to proceed forward.\n[210-240s] - A red van and a white van are driving in the same lane, with the white van slightly ahead.  \n- Yellow taxis are visible on both sides of the road, including one turning left at the intersection.  \n- A large bus with \"MIDTOWN\" branding enters the frame from the right, moving in the same direction as the vans.\n[240-270s] - A white bus with \"CITY BUS\" branding moves forward, partially obscured by traffic.  \n- Yellow taxis and a black sedan are visible in adjacent lanes, with the black sedan turning right at the intersection.  \n- Pedestrians cross the street at a crosswalk, with some walking toward the camera and others away.\n[270-300s] - A red delivery truck moves forward through the intersection, passing between two cars.\n- A black Honda and a black Toyota are stopped at the crosswalk, facing the camera.\n- Pedestrians cross the street at the crosswalk, with some walking towards the camera and others away.\n[300-330s] - A red tour bus with \"THE CIRCLE\" logo is parked on the right side of the street, partially blocking traffic.  \n- A large white delivery truck is moving slowly down the street, positioned ahead of the bus.  \n- Yellow taxis are visible in the traffic flow, crossing the street at a crosswalk as the camera pans forward.\n[330-360s] - Yellow taxis move forward in a line, passing a red van on the left and a large bus on the right.  \n- Pedestrians cross the street at a marked crosswalk, with some walking along sidewalks flanked by tall buildings.  \n- A \"47th St\" sign is visible on a building facade, indicating the street name.", "history_tokens": 904, "history_utf8_bytes": 3861, "recent_frame_times_s": [344.01096666666666, 345.0119666666667, 346.01296666666667, 347.01396666666665, 348.0149666666667, 349.01596666666666, 350.0169666666667, 351.01796666666667, 352.01896666666664, 353.0199666666667, 354.02096666666665, 355.0219666666667, 356.02296666666666, 357.0239666666667, 358.02496666666667, 359.02596666666665, 360.0269666666667, 361.02796666666666, 362.0289666666667, 363.02996666666667, 364.03096666666664, 365.0319666666667, 366.03296666666665, 367.0006, 368.0016, 369.0026, 370.0036, 371.0046, 372.0056, 373.0066], "recent_frames_sha256": "509acf16ed5eca77977175caa7e1589c64f8edafff08a0b9b5ef0f71a410e7e6", "num_recent_frames": 30, "tq": 717077.433834914, "t1": 717078.828524628, "ta": 717078.828524628, "te": 717078.867377077, "first_response_s": 1.3946897139539942, "answer_total_s": 1.4335421629948542, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 383, "content_group": "c85dc8f436ac5d7621e54ebebcb43935dc16cd422449c5df4fbb25c59ec93577", "question": {"question_id": "sample_383_a172_q0", "video_id": 383, "video_path": "./videos/sample_383_real.mp4", "annotation_index": 172, "question_index": 0, "question": "Which roads are currently visible in the video right now?", "options": ["A. East 40th St and 3rd Ave.", "B. East 36th St and 5th Ave.", "C. East 42nd St and Madison Ave.", "D. East 30th St and Park Ave."], "answer": "B", "time_stamp_s": 498, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [496, 501], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_383_a172_q0", "video_id": 383, "time_stamp_s": 498, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e949f47187527d307b8d158333aaf8c7934b728adae1842ec66a01cdef0e2afc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [468.0015, 469.0025, 470.0035, 471.0045, 472.0055, 473.0065, 474.0075, 475.0085, 476.0095, 477.0105, 478.0115, 479.0125, 480.0135, 481.0145, 482.0155, 483.0165, 484.0175, 485.0185, 486.0195, 487.0205, 488.0215, 489.0225, 490.0235, 491.0245, 492.0255, 493.0265, 494.0275, 495.0285, 496.0295, 497.0305], "recent_frames_sha256": "e361130d92280587861433f428e958325aba665f7afa106ad75664effa48166f", "num_recent_frames": 30, "tq": 717192.007611209, "t1": 717205.586594219, "ta": 717205.586594219, "te": 717205.622802265, "first_response_s": 13.578983010025695, "answer_total_s": 13.615191056043841, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_383_a172_q0", "video_id": 383, "time_stamp_s": 498, "ground_truth": "B", "raw_output": "C. East 42nd St and Madison Ave.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "40a83450e861bd5a3bf0d3cfe683b3e56f0e595868adf50b68974dfc95725f6a", "condition_order": ["notes", "recent"], "memory": "[60-90s] - A large white bus enters the frame from the right, moving slowly through traffic.  \n- Yellow taxis remain stationary in the foreground, with one taxi's rear lights illuminated.  \n- American flags hang prominently along the buildings on both sides of the street.\n[90-120s] - A white bus with blue trim moves forward, passing yellow taxis at a crosswalk, with American flags lining the street.  \n- Yellow taxis and other vehicles, including a white van, are visible on the road, with pedestrians crossing at the intersection.  \n- The bus continues down the street, flanked by tall buildings and more American flags, as the camera follows its movement.\n[120-150s] - A white van with \"NYC\" on its rear is stopped at a crosswalk, surrounded by yellow taxis and pedestrians.  \n- Pedestrians cross the street in front of the van, some carrying bags or walking in groups.  \n- A cyclist rides across the crosswalk, passing the van and other vehicles, while a red SUV waits on the right.\n[150-180s] - Yellow taxi cab moves slowly across the intersection, positioned between pedestrians crossing the street.  \n- A large white bus appears from the right, approaching the intersection, with its front facing the camera.  \n- A blue and white tour bus enters the frame from the right, partially obscuring the view of the white bus as it passes.\n[180-210s] - Red van and yellow taxis stop at intersection, with bus partially visible on right.  \n- Pedestrians cross street at crosswalk, some walking toward camera.  \n- Traffic lights change to green, allowing vehicles to proceed forward.\n[210-240s] - A red van and a white van are driving in the same lane, with the white van slightly ahead.  \n- Yellow taxis are visible on both sides of the road, including one turning left at the intersection.  \n- A large bus with \"MIDTOWN\" branding enters the frame from the right, moving in the same direction as the vans.\n[240-270s] - A white bus with \"CITY BUS\" branding moves forward, partially obscured by traffic.  \n- Yellow taxis and a black sedan are visible in adjacent lanes, with the black sedan turning right at the intersection.  \n- Pedestrians cross the street at a crosswalk, with some walking toward the camera and others away.\n[270-300s] - A red delivery truck moves forward through the intersection, passing between two cars.\n- A black Honda and a black Toyota are stopped at the crosswalk, facing the camera.\n- Pedestrians cross the street at the crosswalk, with some walking towards the camera and others away.\n[300-330s] - A red tour bus with \"THE CIRCLE\" logo is parked on the right side of the street, partially blocking traffic.  \n- A large white delivery truck is moving slowly down the street, positioned ahead of the bus.  \n- Yellow taxis are visible in the traffic flow, crossing the street at a crosswalk as the camera pans forward.\n[330-360s] - Yellow taxis move forward in a line, passing a red van on the left and a large bus on the right.  \n- Pedestrians cross the street at a marked crosswalk, with some walking along sidewalks flanked by tall buildings.  \n- A \"47th St\" sign is visible on a building facade, indicating the street name.\n[360-390s] - Yellow taxis form a dense line, moving slowly or stationary in traffic.  \n- A cyclist in a blue jacket rides past the taxis, moving from left to right.  \n- American flags hang from buildings on the right side of the street.\n[390-420s] - Yellow taxis move slowly in traffic, with one turning right at a crosswalk.  \n- A white van is parked on the right side of the street, partially obscured by a taxi.  \n- American flags hang from buildings on the right, swaying slightly in the wind.\n[420-450s] - Yellow taxis move forward in traffic, with one turning left at a crosswalk.  \n- A black SUV is positioned to the right of the taxis, following closely.  \n- American flags hang from buildings on the right side of the street.\n[450-480s] - Yellow taxis in convoy move forward, with one SUV directly ahead in center lane.\n- Pedestrians cross street at crosswalk, some near traffic signal on right.\n- Buildings line both sides of street, with \"COSTA\" and \"Macy's\" signage visible on left.", "history_tokens": 1002, "history_utf8_bytes": 4147, "recent_frame_times_s": [468.0015, 469.0025, 470.0035, 471.0045, 472.0055, 473.0065, 474.0075, 475.0085, 476.0095, 477.0105, 478.0115, 479.0125, 480.0135, 481.0145, 482.0155, 483.0165, 484.0175, 485.0185, 486.0195, 487.0205, 488.0215, 489.0225, 490.0235, 491.0245, 492.0255, 493.0265, 494.0275, 495.0285, 496.0295, 497.0305], "recent_frames_sha256": "e361130d92280587861433f428e958325aba665f7afa106ad75664effa48166f", "num_recent_frames": 30, "tq": 717114.260602881, "t1": 717115.584135863, "ta": 717115.584135863, "te": 717116.057062247, "first_response_s": 1.3235329820308834, "answer_total_s": 1.7964593659853563, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 384, "content_group": "accb084c99c8f76959e93633dfcd25b809ffb14680f8d964e255737f0e8e7236", "question": {"question_id": "sample_384_a1990_q0", "video_id": 384, "video_path": "./videos/sample_384_real.mp4", "annotation_index": 1990, "question_index": 0, "question": "What type of vehicles are prominently visible in this clip?", "options": ["A. Buses.", "B. Yellow taxis.", "C. Motorcycles.", "D. Police cars."], "answer": "B", "time_stamp_s": 4, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_384_a1990_q0", "video_id": 384, "time_stamp_s": 4, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7efcea60d8ea8deaf506f62affdc5654527b6d43ee3f88f54a564e05df136982", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.047, 1.0146333333333333, 2.015633333333333, 3.0166333333333335], "recent_frames_sha256": "d1ad1d25f4fb25dbb05fe8c9c8b8609fac84ed22eba1569d0dbc9b24bcacf2cf", "num_recent_frames": 4, "tq": 718278.515026017, "t1": 718286.255827821, "ta": 718286.255827821, "te": 718286.293261964, "first_response_s": 7.740801804000512, "answer_total_s": 7.778235947014764, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_384_a1990_q0", "video_id": 384, "time_stamp_s": 4, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "08c69fd3b844660b309805927fdecf2c386fd9fe70a31306d634381237a01672", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.047, 1.0146333333333333, 2.015633333333333, 3.0166333333333335], "recent_frames_sha256": "d1ad1d25f4fb25dbb05fe8c9c8b8609fac84ed22eba1569d0dbc9b24bcacf2cf", "num_recent_frames": 4, "tq": 718334.761994542, "t1": 718342.227724995, "ta": 718342.227724995, "te": 718342.419156274, "first_response_s": 7.465730453026481, "answer_total_s": 7.657161731971428, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 384, "content_group": "accb084c99c8f76959e93633dfcd25b809ffb14680f8d964e255737f0e8e7236", "question": {"question_id": "sample_384_a1991_q0", "video_id": 384, "video_path": "./videos/sample_384_real.mp4", "annotation_index": 1991, "question_index": 0, "question": "What color are most of the taxis visible right now?", "options": ["A. Green.", "B. White.", "C. Yellow.", "D. Black."], "answer": "C", "time_stamp_s": 129, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [126, 131], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_384_a1991_q0", "video_id": 384, "time_stamp_s": 129, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "51e9814751600697a584db3f756a9ee2a9363e8f122ef82ed06e526b55f731ff", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [99.01253333333334, 100.01353333333333, 101.01453333333333, 102.01553333333334, 103.01653333333333, 104.01753333333333, 105.01853333333334, 106.01953333333333, 107.02053333333333, 108.02153333333334, 109.02253333333333, 110.02353333333333, 111.02453333333334, 112.02553333333333, 113.02653333333333, 114.02753333333334, 115.02853333333333, 116.02953333333333, 117.03053333333334, 118.03153333333333, 119.03253333333333, 120.00016666666667, 121.00116666666666, 122.00216666666667, 123.00316666666667, 124.00416666666666, 125.00516666666667, 126.00616666666667, 127.00716666666666, 128.00816666666665], "recent_frames_sha256": "657c6675cee746d5723bd9730b1acbb052cb0dae75092078579171f8df967a6c", "num_recent_frames": 30, "tq": 718286.314798031, "t1": 718300.097115546, "ta": 718300.097115546, "te": 718300.137629983, "first_response_s": 13.782317514996976, "answer_total_s": 13.822831952013075, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_384_a1991_q0", "video_id": 384, "time_stamp_s": 129, "ground_truth": "C", "raw_output": "C. Yellow.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "d0c0b1278ccf3f6eec80d6b9e5de8573211d207084e2e49c5f0295ab19a5f97f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxis and a blue delivery truck navigate a busy city street with traffic lights and crosswalks.  \n- A large blue bus with \"MIDTOWN\" branding enters from the right, passing through the intersection.  \n- Pedestrians are visible on sidewalks, and flags (including American and blue banners) hang from buildings lining the street.\n[30-60s] - A blue delivery truck with \"CREATE JOBS\" branding moves forward, partially obstructing the view of yellow taxis ahead.\n- Pedestrians cross a wide street at a marked crosswalk, with some carrying bags or backpacks.\n- A large white bus with \"MUNICIPAL\" text on its side passes on the right, navigating through traffic alongside other vehicles.\n[60-90s] - A white van with \"SCHNEIDER\" branding passes left to right across the crosswalk.  \n- A cyclist in an orange vest rides through the crosswalk, moving from right to left.  \n- A yellow taxi and a black sedan are visible in traffic, with the taxi turning right at the intersection.\n[90-120s] - Yellow taxis move forward through the street, with one turning right at the intersection.  \n- Pedestrians cross the street at a crosswalk, some waiting at the curb.  \n- Construction scaffolding and smoke are visible on the right side of the road.", "history_tokens": 296, "history_utf8_bytes": 1244, "recent_frame_times_s": [99.01253333333334, 100.01353333333333, 101.01453333333333, 102.01553333333334, 103.01653333333333, 104.01753333333333, 105.01853333333334, 106.01953333333333, 107.02053333333333, 108.02153333333334, 109.02253333333333, 110.02353333333333, 111.02453333333334, 112.02553333333333, 113.02653333333333, 114.02753333333334, 115.02853333333333, 116.02953333333333, 117.03053333333334, 118.03153333333333, 119.03253333333333, 120.00016666666667, 121.00116666666666, 122.00216666666667, 123.00316666666667, 124.00416666666666, 125.00516666666667, 126.00616666666667, 127.00716666666666, 128.00816666666665], "recent_frames_sha256": "657c6675cee746d5723bd9730b1acbb052cb0dae75092078579171f8df967a6c", "num_recent_frames": 30, "tq": 718381.967348164, "t1": 718384.484848761, "ta": 718384.484848761, "te": 718384.860995503, "first_response_s": 2.517500597052276, "answer_total_s": 2.8936473390785977, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 384, "content_group": "accb084c99c8f76959e93633dfcd25b809ffb14680f8d964e255737f0e8e7236", "question": {"question_id": "sample_384_a1992_q0", "video_id": 384, "video_path": "./videos/sample_384_real.mp4", "annotation_index": 1992, "question_index": 0, "question": "What are the visible sign colors mounted on the buildings right now?", "options": ["A. Green and blue.", "B. Red and black.", "C. Yellow and white.", "D. Green and white."], "answer": "D", "time_stamp_s": 254, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [252, 257], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_384_a1992_q0", "video_id": 384, "time_stamp_s": 254, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b52254fc72f9326756ea23fcc70bf6cdec79ec77ff401568ca7e26d5b25abd10", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [224.00406666666666, 225.00506666666666, 226.00606666666667, 227.00706666666667, 228.00806666666668, 229.00906666666666, 230.01006666666666, 231.01106666666666, 232.01206666666667, 233.01306666666667, 234.01406666666668, 235.01506666666666, 236.01606666666666, 237.01706666666666, 238.01806666666667, 239.01906666666667, 240.02006666666668, 241.02106666666666, 242.02206666666666, 243.02306666666667, 244.02406666666667, 245.02506666666667, 246.02606666666668, 247.02706666666666, 248.02806666666666, 249.02906666666667, 250.03006666666667, 251.03106666666667, 252.03206666666668, 253.03306666666666], "recent_frames_sha256": "f92b20877f54c5df7ab82716b764a209829f7a2d07f0cdc1f36430dca102208b", "num_recent_frames": 30, "tq": 718300.162190013, "t1": 718314.777912527, "ta": 718314.777912527, "te": 718314.817485175, "first_response_s": 14.615722513990477, "answer_total_s": 14.655295161996037, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_384_a1992_q0", "video_id": 384, "time_stamp_s": 254, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b49006f257d1185ebf2c02e80c4e0b0af32a57befaf88ca751aec2be0b98f76f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxis and a blue delivery truck navigate a busy city street with traffic lights and crosswalks.  \n- A large blue bus with \"MIDTOWN\" branding enters from the right, passing through the intersection.  \n- Pedestrians are visible on sidewalks, and flags (including American and blue banners) hang from buildings lining the street.\n[30-60s] - A blue delivery truck with \"CREATE JOBS\" branding moves forward, partially obstructing the view of yellow taxis ahead.\n- Pedestrians cross a wide street at a marked crosswalk, with some carrying bags or backpacks.\n- A large white bus with \"MUNICIPAL\" text on its side passes on the right, navigating through traffic alongside other vehicles.\n[60-90s] - A white van with \"SCHNEIDER\" branding passes left to right across the crosswalk.  \n- A cyclist in an orange vest rides through the crosswalk, moving from right to left.  \n- A yellow taxi and a black sedan are visible in traffic, with the taxi turning right at the intersection.\n[90-120s] - Yellow taxis move forward through the street, with one turning right at the intersection.  \n- Pedestrians cross the street at a crosswalk, some waiting at the curb.  \n- Construction scaffolding and smoke are visible on the right side of the road.\n[120-150s] - A white USPS truck with blue lettering and logo moves forward, passing a yellow taxi on the left side of the road.  \n- A yellow taxi with a visible license plate (NYC 12345) is positioned ahead of the USPS truck, moving slowly in traffic.  \n- A white SUV is visible to the left of the yellow taxi, partially obscured by the USPS truck as it passes.\n[150-180s] - A yellow taxi drives forward, passing a white FedEx truck on the left and a large white delivery truck ahead.  \n- Construction scaffolding lines the left sidewalk, with workers and orange traffic barriers visible.  \n- A cyclist rides across the street from right to left, passing near the curb where pedestrians are walking.\n[180-210s] - A man in a dark coat walks across the street from right to left, carrying a bag.  \n- A black car drives slowly down the right side of the road, passing a storefront with an American flag.  \n- Construction workers in orange vests stand near scaffolding on the left, with orange traffic cones and barriers in place.\n[210-240s] - A large bus with \"MUNICIPAL TRANSPORT\" text on its rear is stationary at a crosswalk, positioned behind two yellow taxis.  \n- Orange traffic barriers line the left side of the street, adjacent to a building under construction with visible scaffolding.  \n- Pedestrians cross the street at the crosswalk as the traffic light turns green, allowing vehicles to proceed.", "history_tokens": 629, "history_utf8_bytes": 2650, "recent_frame_times_s": [224.00406666666666, 225.00506666666666, 226.00606666666667, 227.00706666666667, 228.00806666666668, 229.00906666666666, 230.01006666666666, 231.01106666666666, 232.01206666666667, 233.01306666666667, 234.01406666666668, 235.01506666666666, 236.01606666666666, 237.01706666666666, 238.01806666666667, 239.01906666666667, 240.02006666666668, 241.02106666666666, 242.02206666666666, 243.02306666666667, 244.02406666666667, 245.02506666666667, 246.02606666666668, 247.02706666666666, 248.02806666666666, 249.02906666666667, 250.03006666666667, 251.03106666666667, 252.03206666666668, 253.03306666666666], "recent_frames_sha256": "f92b20877f54c5df7ab82716b764a209829f7a2d07f0cdc1f36430dca102208b", "num_recent_frames": 30, "tq": 718413.799524826, "t1": 718421.400263057, "ta": 718421.400263057, "te": 718421.641468298, "first_response_s": 7.600738230976276, "answer_total_s": 7.8419434720417485, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 384, "content_group": "accb084c99c8f76959e93633dfcd25b809ffb14680f8d964e255737f0e8e7236", "question": {"question_id": "sample_384_a1993_q0", "video_id": 384, "video_path": "./videos/sample_384_real.mp4", "annotation_index": 1993, "question_index": 0, "question": "What is predominantly seen on the poles lining the street right now?", "options": ["A. Traffic lights.", "B. Banners.", "C. Flower pots.", "D. Bike racks."], "answer": "B", "time_stamp_s": 380, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [378, 383], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_384_a1993_q0", "video_id": 384, "time_stamp_s": 380, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bb3cacc75d21dfd95207002eb820879c199abb58b33032c042ac554abda2f8af", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [350.02996666666667, 351.03096666666664, 352.0319666666667, 353.03296666666665, 354.0006, 355.0016, 356.0026, 357.0036, 358.0046, 359.0056, 360.0066, 361.0076, 362.0086, 363.0096, 364.0106, 365.0116, 366.0126, 367.0136, 368.0146, 369.0156, 370.0166, 371.0176, 372.0186, 373.0196, 374.0206, 375.0216, 376.0226, 377.0236, 378.0246, 379.0256], "recent_frames_sha256": "998ac12e824bc592fce1c86ac6c22633305d47756234245b039ccb2e83eaead6", "num_recent_frames": 30, "tq": 718314.835102053, "t1": 718326.750269897, "ta": 718326.750269897, "te": 718326.791026949, "first_response_s": 11.915167844039388, "answer_total_s": 11.95592489594128, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_384_a1993_q0", "video_id": 384, "time_stamp_s": 380, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a0add5071c8ce9698344e17ad097de39e39afdda07b7cf83a6f46c0b83cf51be", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxis and a blue delivery truck navigate a busy city street with traffic lights and crosswalks.  \n- A large blue bus with \"MIDTOWN\" branding enters from the right, passing through the intersection.  \n- Pedestrians are visible on sidewalks, and flags (including American and blue banners) hang from buildings lining the street.\n[30-60s] - A blue delivery truck with \"CREATE JOBS\" branding moves forward, partially obstructing the view of yellow taxis ahead.\n- Pedestrians cross a wide street at a marked crosswalk, with some carrying bags or backpacks.\n- A large white bus with \"MUNICIPAL\" text on its side passes on the right, navigating through traffic alongside other vehicles.\n[60-90s] - A white van with \"SCHNEIDER\" branding passes left to right across the crosswalk.  \n- A cyclist in an orange vest rides through the crosswalk, moving from right to left.  \n- A yellow taxi and a black sedan are visible in traffic, with the taxi turning right at the intersection.\n[90-120s] - Yellow taxis move forward through the street, with one turning right at the intersection.  \n- Pedestrians cross the street at a crosswalk, some waiting at the curb.  \n- Construction scaffolding and smoke are visible on the right side of the road.\n[120-150s] - A white USPS truck with blue lettering and logo moves forward, passing a yellow taxi on the left side of the road.  \n- A yellow taxi with a visible license plate (NYC 12345) is positioned ahead of the USPS truck, moving slowly in traffic.  \n- A white SUV is visible to the left of the yellow taxi, partially obscured by the USPS truck as it passes.\n[150-180s] - A yellow taxi drives forward, passing a white FedEx truck on the left and a large white delivery truck ahead.  \n- Construction scaffolding lines the left sidewalk, with workers and orange traffic barriers visible.  \n- A cyclist rides across the street from right to left, passing near the curb where pedestrians are walking.\n[180-210s] - A man in a dark coat walks across the street from right to left, carrying a bag.  \n- A black car drives slowly down the right side of the road, passing a storefront with an American flag.  \n- Construction workers in orange vests stand near scaffolding on the left, with orange traffic cones and barriers in place.\n[210-240s] - A large bus with \"MUNICIPAL TRANSPORT\" text on its rear is stationary at a crosswalk, positioned behind two yellow taxis.  \n- Orange traffic barriers line the left side of the street, adjacent to a building under construction with visible scaffolding.  \n- Pedestrians cross the street at the crosswalk as the traffic light turns green, allowing vehicles to proceed.\n[240-270s] - Yellow taxi with license plate \"987654\" moves forward in traffic, positioned between a black SUV and a large bus.  \n- A \"MONEY\" sign is visible on the side of the bus, which is parked or moving slowly on the right.  \n- A green street sign reading \"Columbus Circle\" is visible on the left, indicating the location near a major intersection.\n[270-300s] - Yellow taxi in foreground, stationary at intersection, license plate visible.  \n- Bus on right side of road, partially obscured by other vehicles.  \n- Flatiron Building visible in distance, framed between tall buildings.\n[300-330s] - Yellow taxi with license plate \"K6666\" is stationary in traffic, facing away from camera.  \n- Black SUV with \"NYC\" license plate is to its left, also stationary.  \n- Flatiron Building is visible in the distance, framed between tall buildings on either side.\n[330-360s] - A yellow school bus with its brake lights on is positioned ahead in traffic, moving slowly through a crosswalk.  \n- A large blue and white bus labeled \"WYNDHAM\" is on the right side of the road, partially obstructing the view of the street.  \n- The iconic Flatiron Building stands prominently in the background, framed by tall city buildings on either side.", "history_tokens": 934, "history_utf8_bytes": 3879, "recent_frame_times_s": [350.02996666666667, 351.03096666666664, 352.0319666666667, 353.03296666666665, 354.0006, 355.0016, 356.0026, 357.0036, 358.0046, 359.0056, 360.0066, 361.0076, 362.0086, 363.0096, 364.0106, 365.0116, 366.0126, 367.0136, 368.0146, 369.0156, 370.0166, 371.0176, 372.0186, 373.0196, 374.0206, 375.0216, 376.0226, 377.0236, 378.0246, 379.0256], "recent_frames_sha256": "998ac12e824bc592fce1c86ac6c22633305d47756234245b039ccb2e83eaead6", "num_recent_frames": 30, "tq": 718449.904699315, "t1": 718459.196678682, "ta": 718459.196678682, "te": 718459.423117397, "first_response_s": 9.291979367029853, "answer_total_s": 9.518418082036078, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 384, "content_group": "accb084c99c8f76959e93633dfcd25b809ffb14680f8d964e255737f0e8e7236", "question": {"question_id": "sample_384_a1994_q0", "video_id": 384, "video_path": "./videos/sample_384_real.mp4", "annotation_index": 1994, "question_index": 0, "question": "What is the mode of transportation that several individuals are using right now?", "options": ["A. Roller skates.", "B. Skateboards.", "C. Bicycles.", "D. Scooters."], "answer": "C", "time_stamp_s": 506, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [504, 509], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_384_a1994_q0", "video_id": 384, "time_stamp_s": 506, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b397625de7ad5931895ad212d90afbf4b6ef7fc25e12524b330229a16d6e7cd9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [476.0225, 477.0235, 478.0245, 479.0255, 480.0265, 481.0275, 482.0285, 483.0295, 484.0305, 485.0315, 486.0325, 487.00013333333334, 488.0011333333333, 489.00213333333335, 490.0031333333333, 491.00413333333336, 492.00513333333333, 493.0061333333333, 494.00713333333334, 495.0081333333333, 496.00913333333335, 497.01013333333333, 498.0111333333333, 499.01213333333334, 500.0131333333333, 501.01413333333335, 502.0151333333333, 503.01613333333336, 504.01713333333333, 505.0181333333333], "recent_frames_sha256": "900a0de12a98ea437168f4a4468a74780c04b811ed2b72030b179a36510b8100", "num_recent_frames": 30, "tq": 718326.804086803, "t1": 718334.707208479, "ta": 718334.707208479, "te": 718334.746334539, "first_response_s": 7.903121676063165, "answer_total_s": 7.942247736034915, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_384_a1994_q0", "video_id": 384, "time_stamp_s": 506, "ground_truth": "C", "raw_output": "C. Bicycles.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "8645f05e89d45442c83160d28c0097b163c9f6735dd9e2ba89e7f493578652d7", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Yellow taxis move forward through the street, with one turning right at the intersection.  \n- Pedestrians cross the street at a crosswalk, some waiting at the curb.  \n- Construction scaffolding and smoke are visible on the right side of the road.\n[120-150s] - A white USPS truck with blue lettering and logo moves forward, passing a yellow taxi on the left side of the road.  \n- A yellow taxi with a visible license plate (NYC 12345) is positioned ahead of the USPS truck, moving slowly in traffic.  \n- A white SUV is visible to the left of the yellow taxi, partially obscured by the USPS truck as it passes.\n[150-180s] - A yellow taxi drives forward, passing a white FedEx truck on the left and a large white delivery truck ahead.  \n- Construction scaffolding lines the left sidewalk, with workers and orange traffic barriers visible.  \n- A cyclist rides across the street from right to left, passing near the curb where pedestrians are walking.\n[180-210s] - A man in a dark coat walks across the street from right to left, carrying a bag.  \n- A black car drives slowly down the right side of the road, passing a storefront with an American flag.  \n- Construction workers in orange vests stand near scaffolding on the left, with orange traffic cones and barriers in place.\n[210-240s] - A large bus with \"MUNICIPAL TRANSPORT\" text on its rear is stationary at a crosswalk, positioned behind two yellow taxis.  \n- Orange traffic barriers line the left side of the street, adjacent to a building under construction with visible scaffolding.  \n- Pedestrians cross the street at the crosswalk as the traffic light turns green, allowing vehicles to proceed.\n[240-270s] - Yellow taxi with license plate \"987654\" moves forward in traffic, positioned between a black SUV and a large bus.  \n- A \"MONEY\" sign is visible on the side of the bus, which is parked or moving slowly on the right.  \n- A green street sign reading \"Columbus Circle\" is visible on the left, indicating the location near a major intersection.\n[270-300s] - Yellow taxi in foreground, stationary at intersection, license plate visible.  \n- Bus on right side of road, partially obscured by other vehicles.  \n- Flatiron Building visible in distance, framed between tall buildings.\n[300-330s] - Yellow taxi with license plate \"K6666\" is stationary in traffic, facing away from camera.  \n- Black SUV with \"NYC\" license plate is to its left, also stationary.  \n- Flatiron Building is visible in the distance, framed between tall buildings on either side.\n[330-360s] - A yellow school bus with its brake lights on is positioned ahead in traffic, moving slowly through a crosswalk.  \n- A large blue and white bus labeled \"WYNDHAM\" is on the right side of the road, partially obstructing the view of the street.  \n- The iconic Flatiron Building stands prominently in the background, framed by tall city buildings on either side.\n[360-390s] - Yellow school bus overtakes camera vehicle, moving leftward on street.  \n- Black sedan ahead maintains position in center lane, following traffic flow.  \n- Pedestrians cross street at crosswalk, visible on sidewalk to left.\n[390-420s] - A cyclist in a blue jacket rides along the green bike lane, moving from left to right.\n- A black SUV is parked on the left side of the road, stationary near the curb.\n- A yellow taxi is visible on the right side of the road, positioned behind a black sedan.\n[420-450s] - A black sedan with a visible license plate drives forward in the center lane, following traffic flow.\n- Yellow taxis are present on the right side of the road, moving in the same direction as the sedan.\n- The road features a green bike lane on the left, separated by concrete barriers, with pedestrians visible on sidewalks.\n[450-480s] - Yellow taxi cab moves forward through intersection, passing pedestrians and other vehicles.  \n- White van with \"Prestige\" branding is visible on left side of road, driving in same direction.  \n- Traffic lights change from red to green, allowing vehicles to proceed through crosswalk.", "history_tokens": 968, "history_utf8_bytes": 4036, "recent_frame_times_s": [476.0225, 477.0235, 478.0245, 479.0255, 480.0265, 481.0275, 482.0285, 483.0295, 484.0305, 485.0315, 486.0325, 487.00013333333334, 488.0011333333333, 489.00213333333335, 490.0031333333333, 491.00413333333336, 492.00513333333333, 493.0061333333333, 494.00713333333334, 495.0081333333333, 496.00913333333335, 497.01013333333333, 498.0111333333333, 499.01213333333334, 500.0131333333333, 501.01413333333335, 502.0151333333333, 503.01613333333336, 504.01713333333333, 505.0181333333333], "recent_frames_sha256": "900a0de12a98ea437168f4a4468a74780c04b811ed2b72030b179a36510b8100", "num_recent_frames": 30, "tq": 718492.52240995, "t1": 718494.325067827, "ta": 718494.325067827, "te": 718494.565280037, "first_response_s": 1.8026578769786283, "answer_total_s": 2.0428700869670138, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 386, "content_group": "d59da2356b6af0e9d7a1a6fba5bcef4ecb1cb3b989fa752f33ef4c0293596de5", "question": {"question_id": "sample_386_a614_q0", "video_id": 386, "video_path": "./videos/sample_386_real.mp4", "annotation_index": 614, "question_index": 0, "question": "Right now, which brand's logo is prominently displayed on the building?", "options": ["A. Starbucks.", "B. Burger King.", "C. KFC.", "D. McDonald's."], "answer": "D", "time_stamp_s": 4, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_386_a614_q0", "video_id": 386, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d9eef4b085f196b3a8ea2674e0630ae5a1d138b4d350db3cb062a7096dddd838", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.048, 1.0156333333333334, 2.0166333333333335, 3.0176333333333334], "recent_frames_sha256": "b2ccd7c22cb601e49fa39599163e75419201a4b78be1fe38093088794b5f3ab0", "num_recent_frames": 4, "tq": 719576.414818333, "t1": 719582.873890291, "ta": 719582.873890291, "te": 719582.913615423, "first_response_s": 6.459071957971901, "answer_total_s": 6.498797090025619, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_386_a614_q0", "video_id": 386, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bfd6ac10d2cc7b8f758c2fd9bac0aacdce4498e0f05849cf13ec22d090080eb9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.048, 1.0156333333333334, 2.0166333333333335, 3.0176333333333334], "recent_frames_sha256": "b2ccd7c22cb601e49fa39599163e75419201a4b78be1fe38093088794b5f3ab0", "num_recent_frames": 4, "tq": 719431.382386919, "t1": 719443.630645948, "ta": 719443.630645948, "te": 719443.821258813, "first_response_s": 12.248259029001929, "answer_total_s": 12.438871894031763, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 386, "content_group": "d59da2356b6af0e9d7a1a6fba5bcef4ecb1cb3b989fa752f33ef4c0293596de5", "question": {"question_id": "sample_386_a615_q0", "video_id": 386, "video_path": "./videos/sample_386_real.mp4", "annotation_index": 615, "question_index": 0, "question": "Right now, which type of vehicle is marked with the logo \"VIA Touch\"?", "options": ["A. A taxi.", "B. A truck.", "C. A police car.", "D. A van."], "answer": "D", "time_stamp_s": 120, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [117, 122], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_386_a615_q0", "video_id": 386, "time_stamp_s": 120, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fc9a10a0caac486e40d7c7e535ab2d761aa306edc22b2a46c821ae8a31659980", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [90.00453333333333, 91.00553333333333, 92.00653333333334, 93.00753333333333, 94.00853333333333, 95.00953333333334, 96.01053333333333, 97.01153333333333, 98.01253333333334, 99.01353333333333, 100.01453333333333, 101.01553333333334, 102.01653333333333, 103.01753333333333, 104.01853333333334, 105.01953333333333, 106.02053333333333, 107.02153333333334, 108.02253333333333, 109.02353333333333, 110.02453333333334, 111.02553333333333, 112.02653333333333, 113.02753333333334, 114.02853333333333, 115.02953333333333, 116.03053333333334, 117.03153333333333, 118.03253333333333, 119.00016666666667], "recent_frames_sha256": "f9532592eb0504d7d7c7f0ac2994a38b1a1151546faab82d4d8d15ce93e64a82", "num_recent_frames": 30, "tq": 719582.941449721, "t1": 719590.722813605, "ta": 719590.722813605, "te": 719590.761159099, "first_response_s": 7.781363883987069, "answer_total_s": 7.819709378061816, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_386_a615_q0", "video_id": 386, "time_stamp_s": 120, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "83927b98506ff5fa0e810b438c674c352f2cbf51c1b85eea74634afbb2dccc42", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A large green construction vehicle with wide, heavy-duty front-mounted attachments moves slowly down a busy city street, surrounded by cars and pedestrians.  \n- Yellow taxis and white vans are visible in traffic, with a police car briefly appearing on the left side of the frame.  \n- Pedestrians cross the street at a marked crosswalk as the construction vehicle proceeds forward, with buildings and billboards (including a McDonald’s sign) lining the street.\n[30-60s] - A large white truck with a flatbed is stationary in traffic, its rear lights illuminated.  \n- A black SUV is directly in front of the truck, and another black SUV is to its right.  \n- A red delivery truck is visible behind the white truck, also stopped in traffic.\n[60-90s] - A large pink delivery truck with \"Cafe de la Paix\" branding is stationary, its rear doors open, revealing stacked cardboard boxes inside.  \n- A black tow truck with its rear lights illuminated is positioned behind the pink truck, seemingly waiting or preparing to assist.  \n- Yellow taxis and other vehicles are visible in traffic around the trucks, indicating a busy urban street environment.\n[90-120s] - A white NYPD van is parked on the left side of the street, stationary near a crosswalk.  \n- A white FedEx truck is driving slowly in the right lane, passing a yellow taxi.  \n- Pedestrians cross the street at a marked crosswalk, with some individuals walking in groups and others alone.", "history_tokens": 322, "history_utf8_bytes": 1450, "recent_frame_times_s": [90.00453333333333, 91.00553333333333, 92.00653333333334, 93.00753333333333, 94.00853333333333, 95.00953333333334, 96.01053333333333, 97.01153333333333, 98.01253333333334, 99.01353333333333, 100.01453333333333, 101.01553333333334, 102.01653333333333, 103.01753333333333, 104.01853333333334, 105.01953333333333, 106.02053333333333, 107.02153333333334, 108.02253333333333, 109.02353333333333, 110.02453333333334, 111.02553333333333, 112.02653333333333, 113.02753333333334, 114.02853333333333, 115.02953333333333, 116.03053333333334, 117.03153333333333, 118.03253333333333, 119.00016666666667], "recent_frames_sha256": "f9532592eb0504d7d7c7f0ac2994a38b1a1151546faab82d4d8d15ce93e64a82", "num_recent_frames": 30, "tq": 719470.847861697, "t1": 719472.419808576, "ta": 719472.419808576, "te": 719472.658774651, "first_response_s": 1.5719468790339306, "answer_total_s": 1.8109129540389404, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 386, "content_group": "d59da2356b6af0e9d7a1a6fba5bcef4ecb1cb3b989fa752f33ef4c0293596de5", "question": {"question_id": "sample_386_a616_q0", "video_id": 386, "video_path": "./videos/sample_386_real.mp4", "annotation_index": 616, "question_index": 0, "question": "What is the color of the awning next to the Duane Reade sign right now??", "options": ["A. There's no awning.", "B. Red.", "C. White.", "D. Green."], "answer": "A", "time_stamp_s": 235, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [234, 239], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_386_a616_q0", "video_id": 386, "time_stamp_s": 235, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "20b52f635d03cc94857d813bd166a7d6b97534b8512147292ed56c46307f3b95", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [205.01943333333332, 206.02043333333333, 207.02143333333333, 208.02243333333334, 209.02343333333334, 210.02443333333332, 211.02543333333332, 212.02643333333333, 213.02743333333333, 214.02843333333334, 215.02943333333334, 216.03043333333332, 217.03143333333333, 218.03243333333333, 219.00006666666667, 220.00106666666667, 221.00206666666668, 222.00306666666665, 223.00406666666666, 224.00506666666666, 225.00606666666667, 226.00706666666667, 227.00806666666668, 228.00906666666666, 229.01006666666666, 230.01106666666666, 231.01206666666667, 232.01306666666667, 233.01406666666668, 234.01506666666666], "recent_frames_sha256": "61b8d56580bb9978ae5208b3d9ff5957391010aa68ebd0e21d3f55440932796c", "num_recent_frames": 30, "tq": 719590.780645421, "t1": 719604.407840375, "ta": 719604.407840375, "te": 719604.449116388, "first_response_s": 13.627194953965954, "answer_total_s": 13.66847096697893, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_386_a616_q0", "video_id": 386, "time_stamp_s": 235, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e62dcb44145ba97e011e98bb15915165b480bb82ad5d151be25b00a5262779c0", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A large green construction vehicle with wide, heavy-duty front-mounted attachments moves slowly down a busy city street, surrounded by cars and pedestrians.  \n- Yellow taxis and white vans are visible in traffic, with a police car briefly appearing on the left side of the frame.  \n- Pedestrians cross the street at a marked crosswalk as the construction vehicle proceeds forward, with buildings and billboards (including a McDonald’s sign) lining the street.\n[30-60s] - A large white truck with a flatbed is stationary in traffic, its rear lights illuminated.  \n- A black SUV is directly in front of the truck, and another black SUV is to its right.  \n- A red delivery truck is visible behind the white truck, also stopped in traffic.\n[60-90s] - A large pink delivery truck with \"Cafe de la Paix\" branding is stationary, its rear doors open, revealing stacked cardboard boxes inside.  \n- A black tow truck with its rear lights illuminated is positioned behind the pink truck, seemingly waiting or preparing to assist.  \n- Yellow taxis and other vehicles are visible in traffic around the trucks, indicating a busy urban street environment.\n[90-120s] - A white NYPD van is parked on the left side of the street, stationary near a crosswalk.  \n- A white FedEx truck is driving slowly in the right lane, passing a yellow taxi.  \n- Pedestrians cross the street at a marked crosswalk, with some individuals walking in groups and others alone.\n[120-150s] - A cyclist in dark clothing rides left to right across the crosswalk, positioned near the center of the frame.\n- A yellow taxi cab moves from right to left, passing the cyclist and crossing the intersection.\n- A white van is parked on the left side of the street, stationary near the curb.\n[150-180s] - A yellow taxi cab moves forward in the right lane, passing other vehicles including a black SUV and a white van.  \n- A large black UPS truck is parked on the left side of the street, partially blocking the lane.  \n- Pedestrians and cyclists are visible crossing the street at the crosswalk, with some waiting at the curb.\n[180-210s] - A yellow delivery truck with a political campaign ad passes leftward, then exits the frame.  \n- A black sedan drives straight through the intersection, following traffic flow.  \n- Pedestrians cross the street at a marked crosswalk, with some waiting at the curb.", "history_tokens": 538, "history_utf8_bytes": 2363, "recent_frame_times_s": [205.01943333333332, 206.02043333333333, 207.02143333333333, 208.02243333333334, 209.02343333333334, 210.02443333333332, 211.02543333333332, 212.02643333333333, 213.02743333333333, 214.02843333333334, 215.02943333333334, 216.03043333333332, 217.03143333333333, 218.03243333333333, 219.00006666666667, 220.00106666666667, 221.00206666666668, 222.00306666666665, 223.00406666666666, 224.00506666666666, 225.00606666666667, 226.00706666666667, 227.00806666666668, 228.00906666666666, 229.01006666666666, 230.01106666666666, 231.01206666666667, 232.01306666666667, 233.01406666666668, 234.01506666666666], "recent_frames_sha256": "61b8d56580bb9978ae5208b3d9ff5957391010aa68ebd0e21d3f55440932796c", "num_recent_frames": 30, "tq": 719498.489671502, "t1": 719498.969543892, "ta": 719498.969543892, "te": 719499.191269804, "first_response_s": 0.4798723899293691, "answer_total_s": 0.7015983019955456, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 386, "content_group": "d59da2356b6af0e9d7a1a6fba5bcef4ecb1cb3b989fa752f33ef4c0293596de5", "question": {"question_id": "sample_386_a617_q0", "video_id": 386, "video_path": "./videos/sample_386_real.mp4", "annotation_index": 617, "question_index": 0, "question": "What is indicated by the green sign to the left of the street corner currently?", "options": ["A. Bicycle route.", "B. Parking is prohibited.", "C. Pedestrian zone.", "D. One-way street."], "answer": "A", "time_stamp_s": 353, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [351, 356], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_386_a617_q0", "video_id": 386, "time_stamp_s": 353, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "947a062fa1c2a4f19591ca4d110a7d2257e8b67c59653efee1eff453c40cb8b6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [323.00396666666666, 324.0049666666667, 325.00596666666667, 326.00696666666664, 327.0079666666667, 328.00896666666665, 329.0099666666667, 330.01096666666666, 331.0119666666667, 332.01296666666667, 333.01396666666665, 334.0149666666667, 335.01596666666666, 336.0169666666667, 337.01796666666667, 338.01896666666664, 339.0199666666667, 340.02096666666665, 341.0219666666667, 342.02296666666666, 343.0239666666667, 344.02496666666667, 345.02596666666665, 346.0269666666667, 347.02796666666666, 348.0289666666667, 349.02996666666667, 350.03096666666664, 351.0319666666667, 352.03296666666665], "recent_frames_sha256": "73c7e8cb422a70f7276a1e9fb456ebeb1e9512fb7eab7fd4de52f0b71c8c99e0", "num_recent_frames": 30, "tq": 719604.469533208, "t1": 719614.802910633, "ta": 719614.802910633, "te": 719614.843034675, "first_response_s": 10.333377425093204, "answer_total_s": 10.373501467052847, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_386_a617_q0", "video_id": 386, "time_stamp_s": 353, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "aaf48134df413ebbc60783852ca790b073cd782a196137cd4917d65940a32be9", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A large green construction vehicle with wide, heavy-duty front-mounted attachments moves slowly down a busy city street, surrounded by cars and pedestrians.  \n- Yellow taxis and white vans are visible in traffic, with a police car briefly appearing on the left side of the frame.  \n- Pedestrians cross the street at a marked crosswalk as the construction vehicle proceeds forward, with buildings and billboards (including a McDonald’s sign) lining the street.\n[30-60s] - A large white truck with a flatbed is stationary in traffic, its rear lights illuminated.  \n- A black SUV is directly in front of the truck, and another black SUV is to its right.  \n- A red delivery truck is visible behind the white truck, also stopped in traffic.\n[60-90s] - A large pink delivery truck with \"Cafe de la Paix\" branding is stationary, its rear doors open, revealing stacked cardboard boxes inside.  \n- A black tow truck with its rear lights illuminated is positioned behind the pink truck, seemingly waiting or preparing to assist.  \n- Yellow taxis and other vehicles are visible in traffic around the trucks, indicating a busy urban street environment.\n[90-120s] - A white NYPD van is parked on the left side of the street, stationary near a crosswalk.  \n- A white FedEx truck is driving slowly in the right lane, passing a yellow taxi.  \n- Pedestrians cross the street at a marked crosswalk, with some individuals walking in groups and others alone.\n[120-150s] - A cyclist in dark clothing rides left to right across the crosswalk, positioned near the center of the frame.\n- A yellow taxi cab moves from right to left, passing the cyclist and crossing the intersection.\n- A white van is parked on the left side of the street, stationary near the curb.\n[150-180s] - A yellow taxi cab moves forward in the right lane, passing other vehicles including a black SUV and a white van.  \n- A large black UPS truck is parked on the left side of the street, partially blocking the lane.  \n- Pedestrians and cyclists are visible crossing the street at the crosswalk, with some waiting at the curb.\n[180-210s] - A yellow delivery truck with a political campaign ad passes leftward, then exits the frame.  \n- A black sedan drives straight through the intersection, following traffic flow.  \n- Pedestrians cross the street at a marked crosswalk, with some waiting at the curb.\n[210-240s] - A black sedan with New York license plate drives forward through a city intersection, passing pedestrians and traffic lights.  \n- A white van with \"FLEX\" branding is parked on the right side of the road, adjacent to a yellow taxi.  \n- A red and white \"Santander\" bank sign is visible on a building to the left, with people walking near the sidewalk.\n[240-270s] - A black taxi with license plate \"987654\" is stationary in the foreground, facing away from the camera.  \n- A person in a red coat walks across the street from left to right, carrying a white bag.  \n- A large truck is parked on the left side of the street, with workers near its rear, possibly loading or unloading.\n[270-300s] - A black taxi with license plate \"10555\" is stationary in the foreground, facing away from the camera.  \n- A white delivery truck with \"Duluth Trading\" branding is parked on the left side of the street, with workers near its rear.  \n- A cyclist rides past the truck, moving toward the center of the street, while pedestrians walk along the sidewalks.\n[300-330s] - A black sedan drives forward, following a line of yellow taxis and other vehicles on a busy city street.  \n- Pedestrians cross the street at a marked crosswalk, with some walking toward or away from the camera.  \n- A white van with \"SPECIAL\" text on its side is parked on the left side of the road, near a building with a \"Sears\" sign.", "history_tokens": 893, "history_utf8_bytes": 3766, "recent_frame_times_s": [323.00396666666666, 324.0049666666667, 325.00596666666667, 326.00696666666664, 327.0079666666667, 328.00896666666665, 329.0099666666667, 330.01096666666666, 331.0119666666667, 332.01296666666667, 333.01396666666665, 334.0149666666667, 335.01596666666666, 336.0169666666667, 337.01796666666667, 338.01896666666664, 339.0199666666667, 340.02096666666665, 341.0219666666667, 342.02296666666666, 343.0239666666667, 344.02496666666667, 345.02596666666665, 346.0269666666667, 347.02796666666666, 348.0289666666667, 349.02996666666667, 350.03096666666664, 351.0319666666667, 352.03296666666665], "recent_frames_sha256": "73c7e8cb422a70f7276a1e9fb456ebeb1e9512fb7eab7fd4de52f0b71c8c99e0", "num_recent_frames": 30, "tq": 719528.453780124, "t1": 719535.07743277, "ta": 719535.07743277, "te": 719535.226230772, "first_response_s": 6.623652646085247, "answer_total_s": 6.772450648015365, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 386, "content_group": "d59da2356b6af0e9d7a1a6fba5bcef4ecb1cb3b989fa752f33ef4c0293596de5", "question": {"question_id": "sample_386_a618_q0", "video_id": 386, "video_path": "./videos/sample_386_real.mp4", "annotation_index": 618, "question_index": 0, "question": "What type of sign is installed at the street corner right now?", "options": ["A. One-Way Street.", "B. No Parking.", "C. Pedestrian Crossing.", "D. Speed Limit."], "answer": "A", "time_stamp_s": 468, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [468, 473], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_386_a618_q0", "video_id": 386, "time_stamp_s": 468, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bdd642b40ca9b57b6255b296fffc29486be6be623201d48ee0d382aedcbdf188", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [438.01886666666667, 439.01986666666664, 440.0208666666667, 441.02186666666665, 442.0228666666667, 443.02386666666666, 444.02486666666664, 445.0258666666667, 446.02686666666665, 447.0278666666667, 448.02886666666666, 449.0298666666667, 450.03086666666667, 451.03186666666664, 452.0328666666667, 453.0005, 454.0015, 455.0025, 456.0035, 457.0045, 458.0055, 459.0065, 460.0075, 461.0085, 462.0095, 463.0105, 464.0115, 465.0125, 466.0135, 467.0145], "recent_frames_sha256": "b9bf26df44e9b1df12e37f63cd37c3251318f3b3ee1109ee90bbd7632fef9c34", "num_recent_frames": 30, "tq": 719614.859953217, "t1": 719627.508900658, "ta": 719627.508900658, "te": 719627.546160285, "first_response_s": 12.648947441019118, "answer_total_s": 12.68620706803631, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_386_a618_q0", "video_id": 386, "time_stamp_s": 468, "ground_truth": "A", "raw_output": "C. Pedestrian Crossing.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "88d0ab728c857a3a8e60f953c20f43208fe860b7ee297ef75d83600da1df7a76", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A white NYPD van is parked on the left side of the street, stationary near a crosswalk.  \n- A white FedEx truck is driving slowly in the right lane, passing a yellow taxi.  \n- Pedestrians cross the street at a marked crosswalk, with some individuals walking in groups and others alone.\n[120-150s] - A cyclist in dark clothing rides left to right across the crosswalk, positioned near the center of the frame.\n- A yellow taxi cab moves from right to left, passing the cyclist and crossing the intersection.\n- A white van is parked on the left side of the street, stationary near the curb.\n[150-180s] - A yellow taxi cab moves forward in the right lane, passing other vehicles including a black SUV and a white van.  \n- A large black UPS truck is parked on the left side of the street, partially blocking the lane.  \n- Pedestrians and cyclists are visible crossing the street at the crosswalk, with some waiting at the curb.\n[180-210s] - A yellow delivery truck with a political campaign ad passes leftward, then exits the frame.  \n- A black sedan drives straight through the intersection, following traffic flow.  \n- Pedestrians cross the street at a marked crosswalk, with some waiting at the curb.\n[210-240s] - A black sedan with New York license plate drives forward through a city intersection, passing pedestrians and traffic lights.  \n- A white van with \"FLEX\" branding is parked on the right side of the road, adjacent to a yellow taxi.  \n- A red and white \"Santander\" bank sign is visible on a building to the left, with people walking near the sidewalk.\n[240-270s] - A black taxi with license plate \"987654\" is stationary in the foreground, facing away from the camera.  \n- A person in a red coat walks across the street from left to right, carrying a white bag.  \n- A large truck is parked on the left side of the street, with workers near its rear, possibly loading or unloading.\n[270-300s] - A black taxi with license plate \"10555\" is stationary in the foreground, facing away from the camera.  \n- A white delivery truck with \"Duluth Trading\" branding is parked on the left side of the street, with workers near its rear.  \n- A cyclist rides past the truck, moving toward the center of the street, while pedestrians walk along the sidewalks.\n[300-330s] - A black sedan drives forward, following a line of yellow taxis and other vehicles on a busy city street.  \n- Pedestrians cross the street at a marked crosswalk, with some walking toward or away from the camera.  \n- A white van with \"SPECIAL\" text on its side is parked on the left side of the road, near a building with a \"Sears\" sign.\n[330-360s] - A black sedan with a yellow license plate drives forward, flanked by yellow taxis on both sides.  \n- Pedestrians cross the street at a crosswalk, with some walking toward the camera and others away.  \n- A large American flag hangs prominently above a building on the left, with a \"Macy's\" sign visible below it.\n[360-390s] - A black sedan with a visible license plate is stationary in the center of the frame, positioned between two yellow taxis.\n- Pedestrians cross the street at the crosswalk, some carrying umbrellas, while others walk in groups or alone.\n- A white delivery truck passes on the right side of the road, moving away from the camera's perspective.\n[390-420s] - A black sedan with a visible New York license plate is positioned in the center of the lane, moving slowly forward.\n- Yellow taxis are lined up to the right, waiting at the intersection, with one taxi turning right into a side street.\n- A large white and blue bus labeled \"PANAM\" enters the frame from the right, moving slowly past the sedan and taxis.\n[420-450s] - Pedestrians cross the street at a marked crosswalk, some carrying bags or bikes.  \n- A white van and yellow taxis are visible on the road, with the van turning right.  \n- A silver sedan enters the frame from the left, moving across the intersection.", "history_tokens": 959, "history_utf8_bytes": 3920, "recent_frame_times_s": [438.01886666666667, 439.01986666666664, 440.0208666666667, 441.02186666666665, 442.0228666666667, 443.02386666666666, 444.02486666666664, 445.0258666666667, 446.02686666666665, 447.0278666666667, 448.02886666666666, 449.0298666666667, 450.03086666666667, 451.03186666666664, 452.0328666666667, 453.0005, 454.0015, 455.0025, 456.0035, 457.0045, 458.0055, 459.0065, 460.0075, 461.0085, 462.0095, 463.0105, 464.0115, 465.0125, 466.0135, 467.0145], "recent_frames_sha256": "b9bf26df44e9b1df12e37f63cd37c3251318f3b3ee1109ee90bbd7632fef9c34", "num_recent_frames": 30, "tq": 719574.995698821, "t1": 719576.105948635, "ta": 719576.105948635, "te": 719576.381635485, "first_response_s": 1.110249813995324, "answer_total_s": 1.3859366639517248, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 387, "content_group": "c4dff17a92bde2895b3b546568791d0f8e7f0eb3f5512ee70302af5eca4b118c", "question": {"question_id": "sample_387_a2082_q0", "video_id": 387, "video_path": "./videos/sample_387_real.mp4", "annotation_index": 2082, "question_index": 0, "question": "What mode of transportation are the two people on the left side of the road using now?", "options": ["A. Car.", "B. Bus.", "C. Airplane.", "D. Bike."], "answer": "D", "time_stamp_s": 4, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_387_a2082_q0", "video_id": 387, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "deaa152cea2c186d966689d2fd3df3eb065eb5b2fdd5303dcca4bdd3c6e8b182", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.054, 1.0216333333333334, 2.0226333333333333, 3.023633333333333], "recent_frames_sha256": "e52203fca635acc36d964d2008187b7099d3884f9104eaabd861c34e9f8e5796", "num_recent_frames": 4, "tq": 717402.803772283, "t1": 717414.411897219, "ta": 717414.411897219, "te": 717414.44854407, "first_response_s": 11.608124935999513, "answer_total_s": 11.644771786988713, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_387_a2082_q0", "video_id": 387, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "51ee0e0f6660d368c2ced058d4b0d6c46ff44b8405b9081ad1e125138a558a92", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.054, 1.0216333333333334, 2.0226333333333333, 3.023633333333333], "recent_frames_sha256": "e52203fca635acc36d964d2008187b7099d3884f9104eaabd861c34e9f8e5796", "num_recent_frames": 4, "tq": 717448.93207693, "t1": 717460.440360337, "ta": 717460.440360337, "te": 717460.853091907, "first_response_s": 11.508283407078125, "answer_total_s": 11.921014977036975, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 387, "content_group": "c4dff17a92bde2895b3b546568791d0f8e7f0eb3f5512ee70302af5eca4b118c", "question": {"question_id": "sample_387_a2083_q0", "video_id": 387, "video_path": "./videos/sample_387_real.mp4", "annotation_index": 2083, "question_index": 0, "question": "What is the brand name visible on the building to the left right now?", "options": ["A. Greenbox.", "B. Green&Go.", "C. FreshStop.", "D. Fresh&CO."], "answer": "D", "time_stamp_s": 126, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [126, 131], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_387_a2083_q0", "video_id": 387, "time_stamp_s": 126, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3a6679d2cc237e075556e1bd5b1a654db72bce61bf2e2d84cb33577374a27efb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [96.01653333333333, 97.01753333333333, 98.01853333333334, 99.01953333333333, 100.02053333333333, 101.02153333333334, 102.02253333333333, 103.02353333333333, 104.02453333333334, 105.02553333333333, 106.02653333333333, 107.02753333333334, 108.02853333333333, 109.02953333333333, 110.03053333333334, 111.03153333333333, 112.03253333333333, 113.00016666666667, 114.00116666666666, 115.00216666666667, 116.00316666666667, 117.00416666666666, 118.00516666666667, 119.00616666666667, 120.00716666666666, 121.00816666666667, 122.00916666666667, 123.01016666666666, 124.01116666666667, 125.01216666666667], "recent_frames_sha256": "842301683c1468e337e351d70d4c9f9b1eccccb269b0711f9d400e7959157574", "num_recent_frames": 30, "tq": 717414.469551512, "t1": 717421.883193716, "ta": 717421.883193716, "te": 717421.919907649, "first_response_s": 7.413642204017378, "answer_total_s": 7.450356137007475, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_387_a2083_q0", "video_id": 387, "time_stamp_s": 126, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bb981a96b5b38b8000f37d00abf361a541f4e8cbe6595970ee06d3b026471489", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A red double-decker bus labeled \"TOP VIEW\" moves forward, passing pedestrians and vehicles on a busy city street.  \n- Yellow taxis and other cars navigate the street, with pedestrians crossing at a marked crosswalk as traffic signals change.  \n- Tall buildings line both sides of the street, with construction scaffolding visible on one side and storefronts on the other.\n[30-60s] - Yellow taxis and black sedans move through the intersection, with a black SUV turning right at 0:36.\n- Pedestrians cross the street in multiple groups, some holding umbrellas, while others wait at crosswalks.\n- A blue NYPD vehicle is parked on the right side of the road, with a white delivery truck behind it.\n[60-90s] - Yellow taxi with \"NYC\" license plate (123456) is stationary at intersection, facing camera.  \n- Pedestrian crosses street at crosswalk, moving from left to right.  \n- \"Sears\" sign visible on building to left, with \"Sears\" text clearly legible.\n[90-120s] - A green and yellow \"AMAZON\" bus is parked on the right side of the street, partially obstructing traffic.  \n- Yellow taxis and other vehicles, including a black SUV, are moving slowly or stopped in traffic.  \n- A white delivery truck with a large advertisement for \"Coca-Cola\" is visible ahead, approaching the intersection.", "history_tokens": 316, "history_utf8_bytes": 1295, "recent_frame_times_s": [96.01653333333333, 97.01753333333333, 98.01853333333334, 99.01953333333333, 100.02053333333333, 101.02153333333334, 102.02253333333333, 103.02353333333333, 104.02453333333334, 105.02553333333333, 106.02653333333333, 107.02753333333334, 108.02853333333333, 109.02953333333333, 110.03053333333334, 111.03153333333333, 112.03253333333333, 113.00016666666667, 114.00116666666666, 115.00216666666667, 116.00316666666667, 117.00416666666666, 118.00516666666667, 119.00616666666667, 120.00716666666666, 121.00816666666667, 122.00916666666667, 123.01016666666666, 124.01116666666667, 125.01216666666667], "recent_frames_sha256": "842301683c1468e337e351d70d4c9f9b1eccccb269b0711f9d400e7959157574", "num_recent_frames": 30, "tq": 717490.204817223, "t1": 717496.845049438, "ta": 717496.845049438, "te": 717496.883920626, "first_response_s": 6.640232214936987, "answer_total_s": 6.679103403002955, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 387, "content_group": "c4dff17a92bde2895b3b546568791d0f8e7f0eb3f5512ee70302af5eca4b118c", "question": {"question_id": "sample_387_a2084_q0", "video_id": 387, "video_path": "./videos/sample_387_real.mp4", "annotation_index": 2084, "question_index": 0, "question": "How many flags are on the buildings to the left right now?", "options": ["A. Five.", "B. Six.", "C. Three.", "D. Four."], "answer": "B", "time_stamp_s": 230, "task_type": "Counting", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [252, 257], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_387_a2084_q0", "video_id": 387, "time_stamp_s": 230, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e485c4a2d805d9be4d6d28e3d57c706735fcee1ba4ea939b4cc1c6d623567199", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [200.02043333333333, 201.02143333333333, 202.02243333333334, 203.02343333333334, 204.02443333333332, 205.02543333333332, 206.02643333333333, 207.02743333333333, 208.02843333333334, 209.02943333333334, 210.03043333333332, 211.03143333333333, 212.03243333333333, 213.00006666666667, 214.00106666666667, 215.00206666666668, 216.00306666666665, 217.00406666666666, 218.00506666666666, 219.00606666666667, 220.00706666666667, 221.00806666666668, 222.00906666666666, 223.01006666666666, 224.01106666666666, 225.01206666666667, 226.01306666666667, 227.01406666666668, 228.01506666666666, 229.01606666666666], "recent_frames_sha256": "8408bd5b68aba2fd070b9bf7e08da5f038728145dcbdd2b1b27fdc59264c08da", "num_recent_frames": 30, "tq": 717421.936284015, "t1": 717433.808883915, "ta": 717433.808883915, "te": 717433.84659619, "first_response_s": 11.87259990000166, "answer_total_s": 11.91031217505224, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_387_a2084_q0", "video_id": 387, "time_stamp_s": 230, "ground_truth": "B", "raw_output": "A. Five.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "b761e17454ad8aee1243ff6b2b05f7653938f58a272fe7540a34afc20bb119a5", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A red double-decker bus labeled \"TOP VIEW\" moves forward, passing pedestrians and vehicles on a busy city street.  \n- Yellow taxis and other cars navigate the street, with pedestrians crossing at a marked crosswalk as traffic signals change.  \n- Tall buildings line both sides of the street, with construction scaffolding visible on one side and storefronts on the other.\n[30-60s] - Yellow taxis and black sedans move through the intersection, with a black SUV turning right at 0:36.\n- Pedestrians cross the street in multiple groups, some holding umbrellas, while others wait at crosswalks.\n- A blue NYPD vehicle is parked on the right side of the road, with a white delivery truck behind it.\n[60-90s] - Yellow taxi with \"NYC\" license plate (123456) is stationary at intersection, facing camera.  \n- Pedestrian crosses street at crosswalk, moving from left to right.  \n- \"Sears\" sign visible on building to left, with \"Sears\" text clearly legible.\n[90-120s] - A green and yellow \"AMAZON\" bus is parked on the right side of the street, partially obstructing traffic.  \n- Yellow taxis and other vehicles, including a black SUV, are moving slowly or stopped in traffic.  \n- A white delivery truck with a large advertisement for \"Coca-Cola\" is visible ahead, approaching the intersection.\n[120-150s] - A black SUV with license plate \"M4666\" is stationary at a crosswalk, facing the camera.\n- Yellow taxis and other vehicles are visible in traffic ahead, moving along the street.\n- Pedestrians cross the street at the crosswalk, some walking in groups, others individually.\n[150-180s] - A black SUV with a visible license plate is stationary at a crosswalk, positioned between a white van and a yellow taxi.  \n- A large white truck carrying a wrapped object moves slowly through traffic, positioned ahead of the SUV.  \n- A green bus with \"MOTORCYCLE\" text on its side is visible on the right side of the road, moving in the same direction as the SUV.\n[180-210s] - A black van with \"S\" logo on side moves leftward, passing a traffic light.  \n- Yellow taxis and a white van with \"ONLY\" painted on road surface are visible in traffic.  \n- A statue stands at a crosswalk, with vehicles and pedestrians around it.", "history_tokens": 548, "history_utf8_bytes": 2214, "recent_frame_times_s": [200.02043333333333, 201.02143333333333, 202.02243333333334, 203.02343333333334, 204.02443333333332, 205.02543333333332, 206.02643333333333, 207.02743333333333, 208.02843333333334, 209.02943333333334, 210.03043333333332, 211.03143333333333, 212.03243333333333, 213.00006666666667, 214.00106666666667, 215.00206666666668, 216.00306666666665, 217.00406666666666, 218.00506666666666, 219.00606666666667, 220.00706666666667, 221.00806666666668, 222.00906666666666, 223.01006666666666, 224.01106666666666, 225.01206666666667, 226.01306666666667, 227.01406666666668, 228.01506666666666, 229.01606666666666], "recent_frames_sha256": "8408bd5b68aba2fd070b9bf7e08da5f038728145dcbdd2b1b27fdc59264c08da", "num_recent_frames": 30, "tq": 717516.499276373, "t1": 717523.48189285, "ta": 717523.48189285, "te": 717523.776577046, "first_response_s": 6.982616477063857, "answer_total_s": 7.277300673071295, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 387, "content_group": "c4dff17a92bde2895b3b546568791d0f8e7f0eb3f5512ee70302af5eca4b118c", "question": {"question_id": "sample_387_a2085_q0", "video_id": 387, "video_path": "./videos/sample_387_real.mp4", "annotation_index": 2085, "question_index": 0, "question": "What is the name of the store visible on the awning to the right right now?", "options": ["A. Adventure Baggage.", "B. Party Supplies.", "C. Green & Go.", "D. Gifts & Luggage."], "answer": "D", "time_stamp_s": 383, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [378, 383], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_387_a2085_q0", "video_id": 387, "time_stamp_s": 383, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8a09c5d4cada3fd661c8cae27d8ed8d1748c668e87ed5e0b1489bf07a46959d4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [353.0066, 354.0076, 355.0086, 356.0096, 357.0106, 358.0116, 359.0126, 360.0136, 361.0146, 362.0156, 363.0166, 364.0176, 365.0186, 366.0196, 367.0206, 368.0216, 369.0226, 370.0236, 371.0246, 372.0256, 373.0266, 374.0276, 375.0286, 376.0296, 377.0306, 378.0316, 379.0326, 380.0002333333333, 381.00123333333335, 382.0022333333333], "recent_frames_sha256": "8c0ada63c1e50e6ea125a3bd1d37e76a5ae6d1f6a03a361b0c75566f317e7e7a", "num_recent_frames": 30, "tq": 717433.860852135, "t1": 717442.054920873, "ta": 717442.054920873, "te": 717442.092392212, "first_response_s": 8.194068738026544, "answer_total_s": 8.231540077016689, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_387_a2085_q0", "video_id": 387, "time_stamp_s": 383, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "34950622e6c4e74aafb0b72af2adae9c90f7fb99efd9669b39d7cef9aad776a4", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A red double-decker bus labeled \"TOP VIEW\" moves forward, passing pedestrians and vehicles on a busy city street.  \n- Yellow taxis and other cars navigate the street, with pedestrians crossing at a marked crosswalk as traffic signals change.  \n- Tall buildings line both sides of the street, with construction scaffolding visible on one side and storefronts on the other.\n[30-60s] - Yellow taxis and black sedans move through the intersection, with a black SUV turning right at 0:36.\n- Pedestrians cross the street in multiple groups, some holding umbrellas, while others wait at crosswalks.\n- A blue NYPD vehicle is parked on the right side of the road, with a white delivery truck behind it.\n[60-90s] - Yellow taxi with \"NYC\" license plate (123456) is stationary at intersection, facing camera.  \n- Pedestrian crosses street at crosswalk, moving from left to right.  \n- \"Sears\" sign visible on building to left, with \"Sears\" text clearly legible.\n[90-120s] - A green and yellow \"AMAZON\" bus is parked on the right side of the street, partially obstructing traffic.  \n- Yellow taxis and other vehicles, including a black SUV, are moving slowly or stopped in traffic.  \n- A white delivery truck with a large advertisement for \"Coca-Cola\" is visible ahead, approaching the intersection.\n[120-150s] - A black SUV with license plate \"M4666\" is stationary at a crosswalk, facing the camera.\n- Yellow taxis and other vehicles are visible in traffic ahead, moving along the street.\n- Pedestrians cross the street at the crosswalk, some walking in groups, others individually.\n[150-180s] - A black SUV with a visible license plate is stationary at a crosswalk, positioned between a white van and a yellow taxi.  \n- A large white truck carrying a wrapped object moves slowly through traffic, positioned ahead of the SUV.  \n- A green bus with \"MOTORCYCLE\" text on its side is visible on the right side of the road, moving in the same direction as the SUV.\n[180-210s] - A black van with \"S\" logo on side moves leftward, passing a traffic light.  \n- Yellow taxis and a white van with \"ONLY\" painted on road surface are visible in traffic.  \n- A statue stands at a crosswalk, with vehicles and pedestrians around it.\n[210-240s] - A black sedan drives forward, following traffic on a multi-lane city street with \"ONLY\" lane markings.\n- Yellow taxis and a white bus are visible in adjacent lanes, with a white delivery truck parked on the left.\n- A horse-drawn carriage passes on the left, moving alongside buildings with scaffolding and American flags.\n[240-270s] - A black sedan with a yellow license plate is driving forward, positioned in the center lane.\n- Yellow taxis are moving in both directions, with one turning right at the intersection.\n- A white van is visible on the left side of the road, parked near a building with scaffolding.\n[270-300s] - A black sedan with a \"NYC\" license plate is stationary in the center lane, facing forward.\n- Yellow taxis and white vans are moving in adjacent lanes, with one taxi passing on the left.\n- A large bus passes on the right, followed by a white van, while construction scaffolding and American flags are visible on the left side of the road.\n[300-330s] - A black sedan drives forward, passing a white bus and yellow taxis on a multi-lane city street.  \n- A cyclist with a cargo trailer crosses the intersection, moving from right to left.  \n- Pedestrians cross the street at a marked crosswalk, with some walking briskly and others pausing.\n[330-360s] - A yellow taxi cab moves rightward across the intersection, passing a white van and a black SUV.\n- A pedestrian crosses the street from left to right at the crosswalk, near a traffic light that turns green.\n- A white delivery truck is visible in the center of the intersection, moving forward with other vehicles.", "history_tokens": 925, "history_utf8_bytes": 3817, "recent_frame_times_s": [353.0066, 354.0076, 355.0086, 356.0096, 357.0106, 358.0116, 359.0126, 360.0136, 361.0146, 362.0156, 363.0166, 364.0176, 365.0186, 366.0196, 367.0206, 368.0216, 369.0226, 370.0236, 371.0246, 372.0256, 373.0266, 374.0276, 375.0286, 376.0296, 377.0306, 378.0316, 379.0326, 380.0002333333333, 381.00123333333335, 382.0022333333333], "recent_frames_sha256": "8c0ada63c1e50e6ea125a3bd1d37e76a5ae6d1f6a03a361b0c75566f317e7e7a", "num_recent_frames": 30, "tq": 717562.604583709, "t1": 717569.784123111, "ta": 717569.784123111, "te": 717570.087898941, "first_response_s": 7.179539402015507, "answer_total_s": 7.483315231977031, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 387, "content_group": "c4dff17a92bde2895b3b546568791d0f8e7f0eb3f5512ee70302af5eca4b118c", "question": {"question_id": "sample_387_a2086_q0", "video_id": 387, "video_path": "./videos/sample_387_real.mp4", "annotation_index": 2086, "question_index": 0, "question": "What is the company name visible on the red billboard to the right right now?", "options": ["A. Barclays.", "B. Reuters.", "C. Tommy Hilfiger.", "D. Applebees."], "answer": "D", "time_stamp_s": 506, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [504, 509], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_387_a2086_q0", "video_id": 387, "time_stamp_s": 506, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "897bf1ac58339f2891513cdd04709fb76dd186b01619c0da77b62da3325bc203", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [476.0295, 477.0305, 478.0315, 479.0325, 480.00013333333334, 481.0011333333333, 482.00213333333335, 483.0031333333333, 484.00413333333336, 485.00513333333333, 486.0061333333333, 487.00713333333334, 488.0081333333333, 489.00913333333335, 490.01013333333333, 491.0111333333333, 492.01213333333334, 493.0131333333333, 494.01413333333335, 495.0151333333333, 496.01613333333336, 497.01713333333333, 498.0181333333333, 499.01913333333334, 500.0201333333333, 501.02113333333335, 502.02213333333333, 503.0231333333333, 504.02413333333334, 505.0251333333333], "recent_frames_sha256": "24a8f3991e6ad5d6afe5ad767502a828f1f6b4081b3acd1d1e43744bb576eefe", "num_recent_frames": 30, "tq": 717442.1211239, "t1": 717448.88053435, "ta": 717448.88053435, "te": 717448.917252279, "first_response_s": 6.7594104500021785, "answer_total_s": 6.796128378948197, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_387_a2086_q0", "video_id": 387, "time_stamp_s": 506, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "80dba0ee062bf5e8a370b483bfc407a9b852f3fd5e4551efdc64698e502f2360", "condition_order": ["recent", "notes"], "memory": "[90-120s] - A green and yellow \"AMAZON\" bus is parked on the right side of the street, partially obstructing traffic.  \n- Yellow taxis and other vehicles, including a black SUV, are moving slowly or stopped in traffic.  \n- A white delivery truck with a large advertisement for \"Coca-Cola\" is visible ahead, approaching the intersection.\n[120-150s] - A black SUV with license plate \"M4666\" is stationary at a crosswalk, facing the camera.\n- Yellow taxis and other vehicles are visible in traffic ahead, moving along the street.\n- Pedestrians cross the street at the crosswalk, some walking in groups, others individually.\n[150-180s] - A black SUV with a visible license plate is stationary at a crosswalk, positioned between a white van and a yellow taxi.  \n- A large white truck carrying a wrapped object moves slowly through traffic, positioned ahead of the SUV.  \n- A green bus with \"MOTORCYCLE\" text on its side is visible on the right side of the road, moving in the same direction as the SUV.\n[180-210s] - A black van with \"S\" logo on side moves leftward, passing a traffic light.  \n- Yellow taxis and a white van with \"ONLY\" painted on road surface are visible in traffic.  \n- A statue stands at a crosswalk, with vehicles and pedestrians around it.\n[210-240s] - A black sedan drives forward, following traffic on a multi-lane city street with \"ONLY\" lane markings.\n- Yellow taxis and a white bus are visible in adjacent lanes, with a white delivery truck parked on the left.\n- A horse-drawn carriage passes on the left, moving alongside buildings with scaffolding and American flags.\n[240-270s] - A black sedan with a yellow license plate is driving forward, positioned in the center lane.\n- Yellow taxis are moving in both directions, with one turning right at the intersection.\n- A white van is visible on the left side of the road, parked near a building with scaffolding.\n[270-300s] - A black sedan with a \"NYC\" license plate is stationary in the center lane, facing forward.\n- Yellow taxis and white vans are moving in adjacent lanes, with one taxi passing on the left.\n- A large bus passes on the right, followed by a white van, while construction scaffolding and American flags are visible on the left side of the road.\n[300-330s] - A black sedan drives forward, passing a white bus and yellow taxis on a multi-lane city street.  \n- A cyclist with a cargo trailer crosses the intersection, moving from right to left.  \n- Pedestrians cross the street at a marked crosswalk, with some walking briskly and others pausing.\n[330-360s] - A yellow taxi cab moves rightward across the intersection, passing a white van and a black SUV.\n- A pedestrian crosses the street from left to right at the crosswalk, near a traffic light that turns green.\n- A white delivery truck is visible in the center of the intersection, moving forward with other vehicles.\n[360-390s] - Yellow taxis navigate a busy intersection with traffic lights and pedestrians crossing.\n- A white pickup truck and other vehicles move through the intersection, indicating active traffic flow.\n- A large building with scaffolding and construction signs is visible on the left side of the street.\n[390-420s] - A red SUV drives forward, following a black sedan through a city intersection with crosswalks and traffic lights.  \n- Yellow taxis and other vehicles are visible on both sides of the street, with pedestrians crossing at the crosswalk.  \n- Buildings line the street, including one with a prominent \"BROADWAY\" sign and another with scaffolding, indicating construction or renovation.\n[420-450s] - Pedestrians cross a wide street at a marked crosswalk, some in groups, others individually, moving from left to right across the frame.\n- A black SUV is visible in the foreground, driving away from the camera, while a yellow taxi passes on the right side of the road.\n- Orange construction barriers and a white van are positioned near the crosswalk, indicating ongoing roadwork or traffic control.\n[450-480s] - A white van with \"BROOKLYN\" branding drives across the intersection, followed by a black SUV.  \n- Pedestrians cross the street at the crosswalk, with one person in a dark jacket and another in a light-colored top.  \n- Traffic lights change from red to green, allowing vehicles to proceed through the intersection.", "history_tokens": 1009, "history_utf8_bytes": 4299, "recent_frame_times_s": [476.0295, 477.0305, 478.0315, 479.0325, 480.00013333333334, 481.0011333333333, 482.00213333333335, 483.0031333333333, 484.00413333333336, 485.00513333333333, 486.0061333333333, 487.00713333333334, 488.0081333333333, 489.00913333333335, 490.01013333333333, 491.0111333333333, 492.01213333333334, 493.0131333333333, 494.01413333333335, 495.0151333333333, 496.01613333333336, 497.01713333333333, 498.0181333333333, 499.01913333333334, 500.0201333333333, 501.02113333333335, 502.02213333333333, 503.0231333333333, 504.02413333333334, 505.0251333333333], "recent_frames_sha256": "24a8f3991e6ad5d6afe5ad767502a828f1f6b4081b3acd1d1e43744bb576eefe", "num_recent_frames": 30, "tq": 717605.069774227, "t1": 717612.286946841, "ta": 717612.286946841, "te": 717612.444976621, "first_response_s": 7.21717261406593, "answer_total_s": 7.3752023939741775, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 388, "content_group": "e0b7aa29c173815a3329c3f5e4f43cf79eb331526862e40b1a48013e5f80c18f", "question": {"question_id": "sample_388_a795_q0", "video_id": 388, "video_path": "./videos/sample_388_real.mp4", "annotation_index": 795, "question_index": 0, "question": "Which brand's advertisement is visible right now on the digital billboard at the forefront?", "options": ["A. Toshiba.", "B. Coca-Cola.", "C. Samsung.", "D. Apple."], "answer": "A", "time_stamp_s": 10, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_388_a795_q0", "video_id": 388, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "84591321d4207e002f51cf80682914bf14505624cd3037527c40120727f3a330", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.048, 1.0156333333333334, 2.0166333333333335, 3.0176333333333334, 4.018633333333334, 5.019633333333333, 6.0206333333333335, 7.021633333333333, 8.022633333333333, 9.023633333333333], "recent_frames_sha256": "9f397abe5fcfeae573e21ab861da51ef598433eaa9e858d74a01728d0a1cdddc", "num_recent_frames": 10, "tq": 719535.260033583, "t1": 719541.600147707, "ta": 719541.600147707, "te": 719541.638816267, "first_response_s": 6.3401141240028664, "answer_total_s": 6.378782683983445, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_388_a795_q0", "video_id": 388, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "444ee6fb49375443f3dd7b80d9f2504ec54b8fb926ee1aebda8ff01cdedd6a0d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.048, 1.0156333333333334, 2.0166333333333335, 3.0176333333333334, 4.018633333333334, 5.019633333333333, 6.0206333333333335, 7.021633333333333, 8.022633333333333, 9.023633333333333], "recent_frames_sha256": "9f397abe5fcfeae573e21ab861da51ef598433eaa9e858d74a01728d0a1cdddc", "num_recent_frames": 10, "tq": 719418.220862382, "t1": 719430.293615734, "ta": 719430.293615734, "te": 719430.494599411, "first_response_s": 12.072753351996653, "answer_total_s": 12.273737029056065, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 388, "content_group": "e0b7aa29c173815a3329c3f5e4f43cf79eb331526862e40b1a48013e5f80c18f", "question": {"question_id": "sample_388_a796_q0", "video_id": 388, "video_path": "./videos/sample_388_real.mp4", "annotation_index": 796, "question_index": 0, "question": "Which apparel brand's sign is visible on the right side of the street?", "options": ["A. Levi's.", "B. Gap.", "C. Puma.", "D. H&M."], "answer": "A", "time_stamp_s": 84, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [82, 87], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_388_a796_q0", "video_id": 388, "time_stamp_s": 84, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1279dcc75d13034b22eaf3b93cc8fbc287cec0276c490b2850ef3f60437e618b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [54.0019, 55.0029, 56.0039, 57.0049, 58.0059, 59.0069, 60.0079, 61.0089, 62.0099, 63.0109, 64.0119, 65.0129, 66.0139, 67.0149, 68.0159, 69.0169, 70.0179, 71.0189, 72.0199, 73.0209, 74.0219, 75.0229, 76.0239, 77.0249, 78.0259, 79.0269, 80.0279, 81.0289, 82.0299, 83.0309], "recent_frames_sha256": "0b9319b676c6bcd009490e6bc342a7277cab86a36bbffe574cb0a9343b04471e", "num_recent_frames": 30, "tq": 719541.650241365, "t1": 719555.070478871, "ta": 719555.070478871, "te": 719555.108183947, "first_response_s": 13.420237506041303, "answer_total_s": 13.457942582084797, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_388_a796_q0", "video_id": 388, "time_stamp_s": 84, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b5df55478279cee2956eb2222a0ffd368aab9c9e90a82024c659c74836ee3ffa", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Yellow taxis and other vehicles navigate a busy street in Times Square, with traffic lights and crosswalks visible.  \n- Large digital billboards display advertisements, including a prominent yellow duck character and various brand logos.  \n- Pedestrians are seen walking along sidewalks, and vehicles stop at intersections, indicating active traffic flow.\n[30-60s] - Yellow taxis and other vehicles are stationary or moving slowly in traffic on a busy street.  \n- Large digital billboards display various advertisements, including brands like \"Skechers\" and \"Kraft.\"  \n- Pedestrians are visible crossing the street at crosswalks, with some walking near storefronts.", "history_tokens": 143, "history_utf8_bytes": 675, "recent_frame_times_s": [54.0019, 55.0029, 56.0039, 57.0049, 58.0059, 59.0069, 60.0079, 61.0089, 62.0099, 63.0109, 64.0119, 65.0129, 66.0139, 67.0149, 68.0159, 69.0169, 70.0179, 71.0189, 72.0199, 73.0209, 74.0219, 75.0229, 76.0239, 77.0249, 78.0259, 79.0269, 80.0279, 81.0289, 82.0299, 83.0309], "recent_frames_sha256": "0b9319b676c6bcd009490e6bc342a7277cab86a36bbffe574cb0a9343b04471e", "num_recent_frames": 30, "tq": 719448.874661752, "t1": 719455.918028346, "ta": 719455.918028346, "te": 719456.102941373, "first_response_s": 7.043366594007239, "answer_total_s": 7.2282796209910884, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 388, "content_group": "e0b7aa29c173815a3329c3f5e4f43cf79eb331526862e40b1a48013e5f80c18f", "question": {"question_id": "sample_388_a797_q0", "video_id": 388, "video_path": "./videos/sample_388_real.mp4", "annotation_index": 797, "question_index": 0, "question": "What are the primary colors visible on the tall vertical screen to the left?", "options": ["A. Blue and white stripes.", "B. Red and yellow stripes.", "C. Blue and yellow stripes.", "D. Red and white stripes."], "answer": "D", "time_stamp_s": 165, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [164, 169], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_388_a797_q0", "video_id": 388, "time_stamp_s": 165, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b6af8d9bc198b8691a00f489bce17f00418ac9285261d62fe50d2d7e0ae86f77", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [135.01616666666666, 136.01716666666667, 137.01816666666667, 138.01916666666668, 139.02016666666665, 140.02116666666666, 141.02216666666666, 142.02316666666667, 143.02416666666667, 144.02516666666668, 145.02616666666665, 146.02716666666666, 147.02816666666666, 148.02916666666667, 149.03016666666667, 150.03116666666668, 151.03216666666665, 152.03316666666666, 153.0008, 154.0018, 155.0028, 156.0038, 157.0048, 158.0058, 159.0068, 160.0078, 161.0088, 162.0098, 163.0108, 164.0118], "recent_frames_sha256": "9fefc25c7e3e4709bdbd95715c9f9239c683b9de42d9c9301bddc0292f001cf8", "num_recent_frames": 30, "tq": 719555.118147858, "t1": 719568.800065138, "ta": 719568.800065138, "te": 719568.838118592, "first_response_s": 13.68191728007514, "answer_total_s": 13.719970734091476, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_388_a797_q0", "video_id": 388, "time_stamp_s": 165, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "26f9c4223cce1f40f08f0c547da3b24d093ed559822d074ae63a9a2ea0a9280e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Yellow taxis and other vehicles navigate a busy street in Times Square, with traffic lights and crosswalks visible.  \n- Large digital billboards display advertisements, including a prominent yellow duck character and various brand logos.  \n- Pedestrians are seen walking along sidewalks, and vehicles stop at intersections, indicating active traffic flow.\n[30-60s] - Yellow taxis and other vehicles are stationary or moving slowly in traffic on a busy street.  \n- Large digital billboards display various advertisements, including brands like \"Skechers\" and \"Kraft.\"  \n- Pedestrians are visible crossing the street at crosswalks, with some walking near storefronts.\n[60-90s] - A large digital billboard on the left displays a dynamic, colorful abstract pattern that shifts rapidly.  \n- A yellow taxi in the foreground has its brake lights illuminated, indicating it is stationary or slowing down.  \n- A white van is positioned ahead of the taxi, also appearing to be stopped or moving slowly in traffic.\n[90-120s] - Yellow taxis and other vehicles navigate a busy street in Times Square, with traffic moving forward and stopping at crosswalks.\n- Large digital billboards display changing advertisements, including Bud Light and NFL content, positioned above and beside the street.\n- Pedestrians are visible crossing the street at marked crosswalks, with some vehicles stopping to allow them to pass.\n[120-150s] - A yellow taxi with license plate \"9222\" is stationary in traffic, positioned centrally in the frame.  \n- Large digital billboards display changing advertisements, including one for \"4 lines $40\" and another featuring a woman with text \"The New Yorker\".  \n- The scene is set in a busy urban street with multiple lanes of traffic, including other yellow taxis and cars, under an overcast sky.", "history_tokens": 393, "history_utf8_bytes": 1813, "recent_frame_times_s": [135.01616666666666, 136.01716666666667, 137.01816666666667, 138.01916666666668, 139.02016666666665, 140.02116666666666, 141.02216666666666, 142.02316666666667, 143.02416666666667, 144.02516666666668, 145.02616666666665, 146.02716666666666, 147.02816666666666, 148.02916666666667, 149.03016666666667, 150.03116666666668, 151.03216666666665, 152.03316666666666, 153.0008, 154.0018, 155.0028, 156.0038, 157.0048, 158.0058, 159.0068, 160.0078, 161.0088, 162.0098, 163.0108, 164.0118], "recent_frames_sha256": "9fefc25c7e3e4709bdbd95715c9f9239c683b9de42d9c9301bddc0292f001cf8", "num_recent_frames": 30, "tq": 719478.397267282, "t1": 719486.032992815, "ta": 719486.032992815, "te": 719486.3979139, "first_response_s": 7.635725533007644, "answer_total_s": 8.000646617962047, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 388, "content_group": "e0b7aa29c173815a3329c3f5e4f43cf79eb331526862e40b1a48013e5f80c18f", "question": {"question_id": "sample_388_a798_q0", "video_id": 388, "video_path": "./videos/sample_388_real.mp4", "annotation_index": 798, "question_index": 0, "question": "What is the current color of the taxi right now that is at the forefront?", "options": ["A. Black.", "B. White.", "C. Red.", "D. Yellow."], "answer": "D", "time_stamp_s": 248, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [246, 251], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_388_a798_q0", "video_id": 388, "time_stamp_s": 248, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bb7d929a7974027b220a2f65d524283ce612fa6fdd202cefee6a3087de6d067a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [218.03243333333333, 219.00006666666667, 220.00106666666667, 221.00206666666668, 222.00306666666665, 223.00406666666666, 224.00506666666666, 225.00606666666667, 226.00706666666667, 227.00806666666668, 228.00906666666666, 229.01006666666666, 230.01106666666666, 231.01206666666667, 232.01306666666667, 233.01406666666668, 234.01506666666666, 235.01606666666666, 236.01706666666666, 237.01806666666667, 238.01906666666667, 239.02006666666668, 240.02106666666666, 241.02206666666666, 242.02306666666667, 243.02406666666667, 244.02506666666667, 245.02606666666668, 246.02706666666666, 247.02806666666666], "recent_frames_sha256": "f0f7b537015d4196571a41981f7b6fa4b2fce15a4fdcac3585ddae546071b9ed", "num_recent_frames": 30, "tq": 719568.849103519, "t1": 719582.873890291, "ta": 719582.873890291, "te": 719582.913615423, "first_response_s": 14.024786771973595, "answer_total_s": 14.064511904027313, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_388_a798_q0", "video_id": 388, "time_stamp_s": 248, "ground_truth": "D", "raw_output": "D. Yellow.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "f6bac9a879821899e3b7d097f59664c84c749069978164a965831fc43c82751e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Yellow taxis and other vehicles navigate a busy street in Times Square, with traffic lights and crosswalks visible.  \n- Large digital billboards display advertisements, including a prominent yellow duck character and various brand logos.  \n- Pedestrians are seen walking along sidewalks, and vehicles stop at intersections, indicating active traffic flow.\n[30-60s] - Yellow taxis and other vehicles are stationary or moving slowly in traffic on a busy street.  \n- Large digital billboards display various advertisements, including brands like \"Skechers\" and \"Kraft.\"  \n- Pedestrians are visible crossing the street at crosswalks, with some walking near storefronts.\n[60-90s] - A large digital billboard on the left displays a dynamic, colorful abstract pattern that shifts rapidly.  \n- A yellow taxi in the foreground has its brake lights illuminated, indicating it is stationary or slowing down.  \n- A white van is positioned ahead of the taxi, also appearing to be stopped or moving slowly in traffic.\n[90-120s] - Yellow taxis and other vehicles navigate a busy street in Times Square, with traffic moving forward and stopping at crosswalks.\n- Large digital billboards display changing advertisements, including Bud Light and NFL content, positioned above and beside the street.\n- Pedestrians are visible crossing the street at marked crosswalks, with some vehicles stopping to allow them to pass.\n[120-150s] - A yellow taxi with license plate \"9222\" is stationary in traffic, positioned centrally in the frame.  \n- Large digital billboards display changing advertisements, including one for \"4 lines $40\" and another featuring a woman with text \"The New Yorker\".  \n- The scene is set in a busy urban street with multiple lanes of traffic, including other yellow taxis and cars, under an overcast sky.\n[150-180s] - A large blue billboard displays a rotating advertisement featuring a cartoon character and text like \"sweet\" and \"good choice, kid.\"  \n- Yellow taxis and other vehicles are stationary or moving slowly in traffic, with one yellow SUV prominently in the foreground.  \n- The billboard on the right side shows a red bottle with a label and text, likely for a beverage brand, alongside other commercial signage.\n[180-210s] - A yellow taxi is directly ahead, moving slowly through traffic.  \n- A cyclist in dark clothing rides alongside the taxi, navigating the lane.  \n- Large digital billboards display changing advertisements, including one with \"Your DNA\" text.\n[210-240s] - Yellow taxis and black SUVs navigate congested traffic in Times Square, with vehicles moving slowly or stopped.  \n- Large digital billboards display advertisements for brands like \"Subway\" and \"H&M,\" with changing visuals and text.  \n- A white van with \"CONTRACTOR\" text is visible among the traffic, positioned between taxis and other vehicles.", "history_tokens": 623, "history_utf8_bytes": 2845, "recent_frame_times_s": [218.03243333333333, 219.00006666666667, 220.00106666666667, 221.00206666666668, 222.00306666666665, 223.00406666666666, 224.00506666666666, 225.00606666666667, 226.00706666666667, 227.00806666666668, 228.00906666666666, 229.01006666666666, 230.01106666666666, 231.01206666666667, 232.01306666666667, 233.01406666666668, 234.01506666666666, 235.01606666666666, 236.01706666666666, 237.01806666666667, 238.01906666666667, 239.02006666666668, 240.02106666666666, 241.02206666666666, 242.02306666666667, 243.02406666666667, 244.02506666666667, 245.02606666666668, 246.02706666666666, 247.02806666666666], "recent_frames_sha256": "f0f7b537015d4196571a41981f7b6fa4b2fce15a4fdcac3585ddae546071b9ed", "num_recent_frames": 30, "tq": 719510.745104913, "t1": 719511.508337768, "ta": 719511.508337768, "te": 719511.659584174, "first_response_s": 0.7632328550098464, "answer_total_s": 0.9144792610313743, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 388, "content_group": "e0b7aa29c173815a3329c3f5e4f43cf79eb331526862e40b1a48013e5f80c18f", "question": {"question_id": "sample_388_a799_q0", "video_id": 388, "video_path": "./videos/sample_388_real.mp4", "annotation_index": 799, "question_index": 0, "question": "Which bank's logo is visible on the red and white storefront on the left right now?", "options": ["A. Bank of America.", "B. Chase.", "C. Wells Fargo.", "D. Citibank."], "answer": "A", "time_stamp_s": 331, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [328, 333], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_388_a799_q0", "video_id": 388, "time_stamp_s": 331, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3283d9b026f0da8a8e847bcb08a4e20d252718114843aa323add646222fdb546", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [301.01533333333333, 302.0163333333333, 303.01733333333334, 304.0183333333333, 305.01933333333335, 306.0203333333333, 307.02133333333336, 308.02233333333334, 309.0233333333333, 310.02433333333335, 311.0253333333333, 312.02633333333335, 313.02733333333333, 314.0283333333333, 315.02933333333334, 316.0303333333333, 317.03133333333335, 318.0323333333333, 319.03333333333336, 320.00096666666667, 321.00196666666665, 322.0029666666667, 323.00396666666666, 324.0049666666667, 325.00596666666667, 326.00696666666664, 327.0079666666667, 328.00896666666665, 329.0099666666667, 330.01096666666666], "recent_frames_sha256": "aa8963de532215b669cca9f0f399e241a6b230034c417c30ec08c4f2e458a185", "num_recent_frames": 30, "tq": 719582.933165044, "t1": 719590.722813605, "ta": 719590.722813605, "te": 719590.761159099, "first_response_s": 7.789648560923524, "answer_total_s": 7.827994054998271, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_388_a799_q0", "video_id": 388, "time_stamp_s": 331, "ground_truth": "A", "raw_output": "B. Chase.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "1dbb1ca912da7d51ead9f1484ba5cee477c150b9a03db99d89e7f0e5a388f8ef", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Yellow taxis and other vehicles navigate a busy street in Times Square, with traffic lights and crosswalks visible.  \n- Large digital billboards display advertisements, including a prominent yellow duck character and various brand logos.  \n- Pedestrians are seen walking along sidewalks, and vehicles stop at intersections, indicating active traffic flow.\n[30-60s] - Yellow taxis and other vehicles are stationary or moving slowly in traffic on a busy street.  \n- Large digital billboards display various advertisements, including brands like \"Skechers\" and \"Kraft.\"  \n- Pedestrians are visible crossing the street at crosswalks, with some walking near storefronts.\n[60-90s] - A large digital billboard on the left displays a dynamic, colorful abstract pattern that shifts rapidly.  \n- A yellow taxi in the foreground has its brake lights illuminated, indicating it is stationary or slowing down.  \n- A white van is positioned ahead of the taxi, also appearing to be stopped or moving slowly in traffic.\n[90-120s] - Yellow taxis and other vehicles navigate a busy street in Times Square, with traffic moving forward and stopping at crosswalks.\n- Large digital billboards display changing advertisements, including Bud Light and NFL content, positioned above and beside the street.\n- Pedestrians are visible crossing the street at marked crosswalks, with some vehicles stopping to allow them to pass.\n[120-150s] - A yellow taxi with license plate \"9222\" is stationary in traffic, positioned centrally in the frame.  \n- Large digital billboards display changing advertisements, including one for \"4 lines $40\" and another featuring a woman with text \"The New Yorker\".  \n- The scene is set in a busy urban street with multiple lanes of traffic, including other yellow taxis and cars, under an overcast sky.\n[150-180s] - A large blue billboard displays a rotating advertisement featuring a cartoon character and text like \"sweet\" and \"good choice, kid.\"  \n- Yellow taxis and other vehicles are stationary or moving slowly in traffic, with one yellow SUV prominently in the foreground.  \n- The billboard on the right side shows a red bottle with a label and text, likely for a beverage brand, alongside other commercial signage.\n[180-210s] - A yellow taxi is directly ahead, moving slowly through traffic.  \n- A cyclist in dark clothing rides alongside the taxi, navigating the lane.  \n- Large digital billboards display changing advertisements, including one with \"Your DNA\" text.\n[210-240s] - Yellow taxis and black SUVs navigate congested traffic in Times Square, with vehicles moving slowly or stopped.  \n- Large digital billboards display advertisements for brands like \"Subway\" and \"H&M,\" with changing visuals and text.  \n- A white van with \"CONTRACTOR\" text is visible among the traffic, positioned between taxis and other vehicles.\n[240-270s] - Yellow taxi with license plate \"123456\" remains stationary at intersection, facing camera.  \n- Pedestrians cross street at crosswalk; some wear bright yellow vests.  \n- Traffic lights change to green, allowing vehicles to proceed.\n[270-300s] - Yellow taxi cab in foreground, moving forward on street, license plate visible.\n- Pedestrians cross street at crosswalk, some with umbrellas, near traffic lights.\n- Large digital billboard on right displays \"NEW YORK #1 HIT MUSIC STATION\" with pink neon text.\n[300-330s] - A black van with \"KASTE\" branding drives forward, following a yellow taxi in a busy city street.  \n- Yellow taxis and other vehicles navigate the street, with traffic lights and crosswalks visible.  \n- Pedestrians and construction scaffolding line the sidewalks, indicating urban activity.", "history_tokens": 822, "history_utf8_bytes": 3665, "recent_frame_times_s": [301.01533333333333, 302.0163333333333, 303.01733333333334, 304.0183333333333, 305.01933333333335, 306.0203333333333, 307.02133333333336, 308.02233333333334, 309.0233333333333, 310.02433333333335, 311.0253333333333, 312.02633333333335, 313.02733333333333, 314.0283333333333, 315.02933333333334, 316.0303333333333, 317.03133333333335, 318.0323333333333, 319.03333333333336, 320.00096666666667, 321.00196666666665, 322.0029666666667, 323.00396666666666, 324.0049666666667, 325.00596666666667, 326.00696666666664, 327.0079666666667, 328.00896666666665, 329.0099666666667, 330.01096666666666], "recent_frames_sha256": "aa8963de532215b669cca9f0f399e241a6b230034c417c30ec08c4f2e458a185", "num_recent_frames": 30, "tq": 719533.871270724, "t1": 719535.07743277, "ta": 719535.07743277, "te": 719535.226230772, "first_response_s": 1.2061620460590348, "answer_total_s": 1.3549600479891524, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 389, "content_group": "4f90e7c3fe64cd278d5edb4f22ac2d9688f4e1435c37077becb49e8ffb4650e9", "question": {"question_id": "sample_389_a1959_q0", "video_id": 389, "video_path": "./videos/sample_389_real.mp4", "annotation_index": 1959, "question_index": 0, "question": "What is the color of the banner with the word \"UNO\" on it?", "options": ["A. Red.", "B. Blue.", "C. Green.", "D. Yellow."], "answer": "A", "time_stamp_s": 16, "task_type": "Attribute Recognition", "required_ability": "episodic memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_389_a1959_q0", "video_id": 389, "time_stamp_s": 16, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d91f86c62add64bacec941aff292ba92f05318855046c5d7949a0ade6c382bdb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "376255738733a22bbd71782e8ba33fbbebb6894ab5fffbb8bf6eda34371376be", "num_recent_frames": 16, "tq": 719627.558292047, "t1": 719638.865615535, "ta": 719638.865615535, "te": 719638.903108899, "first_response_s": 11.307323487941176, "answer_total_s": 11.344816852011718, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_389_a1959_q0", "video_id": 389, "time_stamp_s": 16, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b4803f38fb7ed092a20e287f29853b9a56851a22fcfe25d02d48b114ee14b213", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015], "recent_frames_sha256": "376255738733a22bbd71782e8ba33fbbebb6894ab5fffbb8bf6eda34371376be", "num_recent_frames": 16, "tq": 719683.555318424, "t1": 719689.991702901, "ta": 719689.991702901, "te": 719690.029187283, "first_response_s": 6.436384476954117, "answer_total_s": 6.473868859000504, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 389, "content_group": "4f90e7c3fe64cd278d5edb4f22ac2d9688f4e1435c37077becb49e8ffb4650e9", "question": {"question_id": "sample_389_a1960_q0", "video_id": 389, "video_path": "./videos/sample_389_real.mp4", "annotation_index": 1960, "question_index": 0, "question": "What type of vehicle is visible in front of the teal food truck right now?", "options": ["A. Taxi cab.", "B. Truck.", "C. Bus.", "D. Black car."], "answer": "D", "time_stamp_s": 130, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [126, 131], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_389_a1960_q0", "video_id": 389, "time_stamp_s": 130, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d4c9b746ecdbecac9d8aa961e4292d5f7e280df38f2ba59337a0612375f92fb4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666], "recent_frames_sha256": "380fd0f41ffc4b94f8e2fb0adf105e68d6673ce80c9b25ac64a49cf267c3df34", "num_recent_frames": 30, "tq": 719638.911933471, "t1": 719650.831446749, "ta": 719650.831446749, "te": 719650.868811747, "first_response_s": 11.91951327805873, "answer_total_s": 11.956878275959753, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_389_a1960_q0", "video_id": 389, "time_stamp_s": 130, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "46ec1bdcfb31e9d4db0d4ff8c65d78a120ceb805dc6e778b56d4ac1d941998d4", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxis and other vehicles navigate busy streets lined with tall buildings and storefronts, including a visible \"Citi\" bank sign.  \n- Pedestrians and cyclists cross wide sidewalks and crosswalks, with some individuals walking in groups or alone.  \n- A large, ornate building with arched windows and a clock tower is prominently featured, suggesting a central urban landmark.\n[30-60s] - A black sedan drives forward, passing a yellow taxi and a white van on the left side of the road.  \n- A red-painted bike lane runs along the right side of the street, with a few pedestrians and cyclists nearby.  \n- A white delivery truck with \"BOSTON\" written on its side is visible ahead, moving slowly in the traffic.\n[60-90s] - Pedestrians cross a wide crosswalk at a traffic signal intersection.  \n- A blue bus is parked on the left side of the street, near a \"P\" sign.  \n- A \"CHASE\" bank building with scaffolding is visible on the right side of the road.\n[90-120s] - Pedestrians cross the street at a marked crosswalk, with some walking in groups and others alone.  \n- A red double-decker bus is visible in the distance, moving along the road.  \n- Cars are parked along both sides of the street, with a few vehicles in motion.", "history_tokens": 301, "history_utf8_bytes": 1233, "recent_frame_times_s": [100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666], "recent_frames_sha256": "380fd0f41ffc4b94f8e2fb0adf105e68d6673ce80c9b25ac64a49cf267c3df34", "num_recent_frames": 30, "tq": 719711.873458823, "t1": 719712.908195081, "ta": 719712.908195081, "te": 719713.135636506, "first_response_s": 1.034736258094199, "answer_total_s": 1.2621776830637828, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 389, "content_group": "4f90e7c3fe64cd278d5edb4f22ac2d9688f4e1435c37077becb49e8ffb4650e9", "question": {"question_id": "sample_389_a1961_q0", "video_id": 389, "video_path": "./videos/sample_389_real.mp4", "annotation_index": 1961, "question_index": 0, "question": "What is the speed limit indicated on the \"Share the Road\" sign right now?", "options": ["A. 10 MPH.", "B. 15 MPH.", "C. 20 MPH.", "D. 5 MPH."], "answer": "D", "time_stamp_s": 254, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [252, 257], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_389_a1961_q0", "video_id": 389, "time_stamp_s": 254, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3ad19fe51f7925bf0b281c8b80c498af212bcd84c97c1a5bde98ffdeb71e410d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275], "recent_frames_sha256": "e8e23dfa8dcf4db8a83f0521c95fff654e910f04d635568b6a1ab8c11c8b68ae", "num_recent_frames": 30, "tq": 719650.877983564, "t1": 719662.50073323, "ta": 719662.50073323, "te": 719662.538149719, "first_response_s": 11.622749665984884, "answer_total_s": 11.660166154964827, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_389_a1961_q0", "video_id": 389, "time_stamp_s": 254, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "48e403faa95ac6115a3a0ca9c6bb131299ce002d176e5a751f7e1c8be764157c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxis and other vehicles navigate busy streets lined with tall buildings and storefronts, including a visible \"Citi\" bank sign.  \n- Pedestrians and cyclists cross wide sidewalks and crosswalks, with some individuals walking in groups or alone.  \n- A large, ornate building with arched windows and a clock tower is prominently featured, suggesting a central urban landmark.\n[30-60s] - A black sedan drives forward, passing a yellow taxi and a white van on the left side of the road.  \n- A red-painted bike lane runs along the right side of the street, with a few pedestrians and cyclists nearby.  \n- A white delivery truck with \"BOSTON\" written on its side is visible ahead, moving slowly in the traffic.\n[60-90s] - Pedestrians cross a wide crosswalk at a traffic signal intersection.  \n- A blue bus is parked on the left side of the street, near a \"P\" sign.  \n- A \"CHASE\" bank building with scaffolding is visible on the right side of the road.\n[90-120s] - Pedestrians cross the street at a marked crosswalk, with some walking in groups and others alone.  \n- A red double-decker bus is visible in the distance, moving along the road.  \n- Cars are parked along both sides of the street, with a few vehicles in motion.\n[120-150s] - Red double-decker bus with \"Celebrating Concerts of Pride\" ad moves forward, passing a yellow taxi.  \n- Yellow taxi turns left at intersection, navigating through traffic.  \n- Blue bicycles are parked along sidewalk on left, near a \"BROADWAY\" sign.\n[150-180s] - A black sedan drives straight ahead, maintaining center lane position.  \n- Orange construction barriers line the left side of the road, with workers visible near them.  \n- A \"MAY 5\" directional arrow is painted on the road surface, indicating a lane change or route guidance.\n[180-210s] - Pedestrians cross the street at a marked crosswalk as traffic, including yellow taxis, moves around them.  \n- A large billboard featuring a portrait is visible on a building to the right, while another billboard with a different image is on the left.  \n- The road has clear lane markings, including a \"ONE WAY\" sign and directional arrows, with construction barriers lining the sides.\n[210-240s] - Pedestrians cross the street at a marked crosswalk, some carrying umbrellas or bags.  \n- A black sedan is stationary on the left side of the frame, waiting at the intersection.  \n- Yellow taxis and other vehicles move through the intersection, with traffic lights changing to green.", "history_tokens": 594, "history_utf8_bytes": 2478, "recent_frame_times_s": [224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275], "recent_frames_sha256": "e8e23dfa8dcf4db8a83f0521c95fff654e910f04d635568b6a1ab8c11c8b68ae", "num_recent_frames": 30, "tq": 719730.882427775, "t1": 719735.305994652, "ta": 719735.305994652, "te": 719735.455146637, "first_response_s": 4.423566877027042, "answer_total_s": 4.572718862094916, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 389, "content_group": "4f90e7c3fe64cd278d5edb4f22ac2d9688f4e1435c37077becb49e8ffb4650e9", "question": {"question_id": "sample_389_a1962_q0", "video_id": 389, "video_path": "./videos/sample_389_real.mp4", "annotation_index": 1962, "question_index": 0, "question": "What type of store has signs visible right now?", "options": ["A. Bookstore.", "B. Coffee shop.", "C. Clothing store.", "D. Pet store."], "answer": "D", "time_stamp_s": 379, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [378, 383], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_389_a1962_q0", "video_id": 389, "time_stamp_s": 379, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "65dc964e71f3ff0db2d7603626ba896fbd8c463d1ab5f908b100eec5f0536c79", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666], "recent_frames_sha256": "1587d69bb059973de8ba14954c297beda55386d2f045ce4aaec22ec3dbdc83fb", "num_recent_frames": 30, "tq": 719662.544710914, "t1": 719675.895893172, "ta": 719675.895893172, "te": 719675.934426056, "first_response_s": 13.351182257989421, "answer_total_s": 13.389715141966008, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_389_a1962_q0", "video_id": 389, "time_stamp_s": 379, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a388e13ee5b73541a18d77e46448db2cf6b721990f50f86928d9eda88cb4e397", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxis and other vehicles navigate busy streets lined with tall buildings and storefronts, including a visible \"Citi\" bank sign.  \n- Pedestrians and cyclists cross wide sidewalks and crosswalks, with some individuals walking in groups or alone.  \n- A large, ornate building with arched windows and a clock tower is prominently featured, suggesting a central urban landmark.\n[30-60s] - A black sedan drives forward, passing a yellow taxi and a white van on the left side of the road.  \n- A red-painted bike lane runs along the right side of the street, with a few pedestrians and cyclists nearby.  \n- A white delivery truck with \"BOSTON\" written on its side is visible ahead, moving slowly in the traffic.\n[60-90s] - Pedestrians cross a wide crosswalk at a traffic signal intersection.  \n- A blue bus is parked on the left side of the street, near a \"P\" sign.  \n- A \"CHASE\" bank building with scaffolding is visible on the right side of the road.\n[90-120s] - Pedestrians cross the street at a marked crosswalk, with some walking in groups and others alone.  \n- A red double-decker bus is visible in the distance, moving along the road.  \n- Cars are parked along both sides of the street, with a few vehicles in motion.\n[120-150s] - Red double-decker bus with \"Celebrating Concerts of Pride\" ad moves forward, passing a yellow taxi.  \n- Yellow taxi turns left at intersection, navigating through traffic.  \n- Blue bicycles are parked along sidewalk on left, near a \"BROADWAY\" sign.\n[150-180s] - A black sedan drives straight ahead, maintaining center lane position.  \n- Orange construction barriers line the left side of the road, with workers visible near them.  \n- A \"MAY 5\" directional arrow is painted on the road surface, indicating a lane change or route guidance.\n[180-210s] - Pedestrians cross the street at a marked crosswalk as traffic, including yellow taxis, moves around them.  \n- A large billboard featuring a portrait is visible on a building to the right, while another billboard with a different image is on the left.  \n- The road has clear lane markings, including a \"ONE WAY\" sign and directional arrows, with construction barriers lining the sides.\n[210-240s] - Pedestrians cross the street at a marked crosswalk, some carrying umbrellas or bags.  \n- A black sedan is stationary on the left side of the frame, waiting at the intersection.  \n- Yellow taxis and other vehicles move through the intersection, with traffic lights changing to green.\n[240-270s] - A red and white trolley moves slowly down the street, passing pedestrians and storefronts.  \n- Cyclists ride along a designated bike lane, separated from the main traffic flow.  \n- Yellow umbrellas shade outdoor seating areas at cafes lining the sidewalk.\n[270-300s] - A silver sedan drives past a \"CINNAMON\" storefront on the left side of the street.  \n- A white SUV is parked on the right side of the road, near a \"PARKING\" sign.  \n- Pedestrians cross the street at a marked crosswalk, with traffic lights visible overhead.\n[300-330s] - A gray SUV is directly ahead, driving slowly down the street, with its brake lights illuminated.  \n- Scaffolding structures are visible on both sides of the road, covering storefronts and indicating construction or renovation.  \n- A pedestrian in a white shirt is seen crossing the street to the right, moving away from the camera’s perspective.\n[330-360s] - Gray SUV drives forward, passing through an intersection with traffic lights and pedestrians crossing.\n- Scaffolding covers both sides of the street, with buildings visible behind it.\n- A \"ONE WAY\" sign is visible on the right side of the road, indicating traffic direction.", "history_tokens": 877, "history_utf8_bytes": 3666, "recent_frame_times_s": [349.01533333333333, 350.0163333333333, 351.00065, 352.00165, 353.00265, 354.00365, 355.00465, 356.00565, 357.00665, 358.00765, 359.00865, 360.00965, 361.01065, 362.01165, 363.01265, 364.01365, 365.01465, 366.01565, 367.01665, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666], "recent_frames_sha256": "1587d69bb059973de8ba14954c297beda55386d2f045ce4aaec22ec3dbdc83fb", "num_recent_frames": 30, "tq": 719752.16286251, "t1": 719756.206094149, "ta": 719756.206094149, "te": 719756.243901965, "first_response_s": 4.04323163907975, "answer_total_s": 4.0810394550208, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 389, "content_group": "4f90e7c3fe64cd278d5edb4f22ac2d9688f4e1435c37077becb49e8ffb4650e9", "question": {"question_id": "sample_389_a1963_q0", "video_id": 389, "video_path": "./videos/sample_389_real.mp4", "annotation_index": 1963, "question_index": 0, "question": "What type of store is visible with the sign \"METROPOLIS\"?", "options": ["A. Bookstore.", "B. Pet store.", "C. Coffee shop.", "D. Clothing store."], "answer": "D", "time_stamp_s": 507, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [504, 509], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_389_a1963_q0", "video_id": 389, "time_stamp_s": 507, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e73245126b27462c0ae029ae8ae397636d9ed3963446e89f03045ac0e3c0d594", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336, 498.01418333333334, 499.0151833333333, 500.01618333333334, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055], "recent_frames_sha256": "132c177f7745edb4046778945bd8c27d43e2ef0eca74518fdcfc23e312b43d9c", "num_recent_frames": 30, "tq": 719675.942275393, "t1": 719683.506727062, "ta": 719683.506727062, "te": 719683.546203185, "first_response_s": 7.56445166899357, "answer_total_s": 7.603927791933529, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_389_a1963_q0", "video_id": 389, "time_stamp_s": 507, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d99f4a50acdaad77bc4392d562541ea0d56f56d4523fd028035becafcf6474ba", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Pedestrians cross a wide crosswalk at a traffic signal intersection.  \n- A blue bus is parked on the left side of the street, near a \"P\" sign.  \n- A \"CHASE\" bank building with scaffolding is visible on the right side of the road.\n[90-120s] - Pedestrians cross the street at a marked crosswalk, with some walking in groups and others alone.  \n- A red double-decker bus is visible in the distance, moving along the road.  \n- Cars are parked along both sides of the street, with a few vehicles in motion.\n[120-150s] - Red double-decker bus with \"Celebrating Concerts of Pride\" ad moves forward, passing a yellow taxi.  \n- Yellow taxi turns left at intersection, navigating through traffic.  \n- Blue bicycles are parked along sidewalk on left, near a \"BROADWAY\" sign.\n[150-180s] - A black sedan drives straight ahead, maintaining center lane position.  \n- Orange construction barriers line the left side of the road, with workers visible near them.  \n- A \"MAY 5\" directional arrow is painted on the road surface, indicating a lane change or route guidance.\n[180-210s] - Pedestrians cross the street at a marked crosswalk as traffic, including yellow taxis, moves around them.  \n- A large billboard featuring a portrait is visible on a building to the right, while another billboard with a different image is on the left.  \n- The road has clear lane markings, including a \"ONE WAY\" sign and directional arrows, with construction barriers lining the sides.\n[210-240s] - Pedestrians cross the street at a marked crosswalk, some carrying umbrellas or bags.  \n- A black sedan is stationary on the left side of the frame, waiting at the intersection.  \n- Yellow taxis and other vehicles move through the intersection, with traffic lights changing to green.\n[240-270s] - A red and white trolley moves slowly down the street, passing pedestrians and storefronts.  \n- Cyclists ride along a designated bike lane, separated from the main traffic flow.  \n- Yellow umbrellas shade outdoor seating areas at cafes lining the sidewalk.\n[270-300s] - A silver sedan drives past a \"CINNAMON\" storefront on the left side of the street.  \n- A white SUV is parked on the right side of the road, near a \"PARKING\" sign.  \n- Pedestrians cross the street at a marked crosswalk, with traffic lights visible overhead.\n[300-330s] - A gray SUV is directly ahead, driving slowly down the street, with its brake lights illuminated.  \n- Scaffolding structures are visible on both sides of the road, covering storefronts and indicating construction or renovation.  \n- A pedestrian in a white shirt is seen crossing the street to the right, moving away from the camera’s perspective.\n[330-360s] - Gray SUV drives forward, passing through an intersection with traffic lights and pedestrians crossing.\n- Scaffolding covers both sides of the street, with buildings visible behind it.\n- A \"ONE WAY\" sign is visible on the right side of the road, indicating traffic direction.\n[360-390s] - A black Tesla drives forward, following a motorcycle at a crosswalk intersection.  \n- Yellow taxis and a large yellow delivery truck are visible on the road, with the truck moving ahead.  \n- A pedestrian crossing with white stripes is visible ahead, with people walking across.\n[390-420s] - A black Tesla drives straight ahead, approaching a crosswalk with cyclists and pedestrians.\n- A large building with a circular, sun-like design on its facade is visible across the street.\n- A \"LOCAL\" directional sign appears on the left, indicating a turn or lane change ahead.\n[420-450s] - A black Tesla drives forward in the center lane, following traffic.\n- Blue bicycles are parked in a designated bike lane on the left side of the road.\n- A white sedan is visible on the right side, moving in the same direction as the Tesla.\n[450-480s] - A black Tesla drives forward in the center lane, following traffic.\n- Blue bicycles are parked in a row along the left curb, under a \"Citi Bike\" sign.\n- A white SUV overtakes the Tesla from the right, moving into the lane ahead.", "history_tokens": 969, "history_utf8_bytes": 4022, "recent_frame_times_s": [477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.0001833333333, 485.00118333333336, 486.00218333333333, 487.0031833333333, 488.00418333333334, 489.0051833333333, 490.00618333333335, 491.00718333333333, 492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336, 498.01418333333334, 499.0151833333333, 500.01618333333334, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055], "recent_frames_sha256": "132c177f7745edb4046778945bd8c27d43e2ef0eca74518fdcfc23e312b43d9c", "num_recent_frames": 30, "tq": 719772.620271326, "t1": 719775.910201049, "ta": 719775.910201049, "te": 719775.943052398, "first_response_s": 3.2899297229014337, "answer_total_s": 3.322781071998179, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 391, "content_group": "ea87f1a450c5b2b4e87a8959ca2e514bd2da33027fead5402d298eb6d95df721", "question": {"question_id": "sample_391_a1750_q0", "video_id": 391, "video_path": "./videos/sample_391_real.mp4", "annotation_index": 1750, "question_index": 0, "question": "What is the large vehicle to the right displaying on the side?", "options": ["A. A city map.", "B. An advertisement for The Lion King musical.", "C. A tourist guide logo.", "D. A food delivery service logo."], "answer": "B", "time_stamp_s": 11, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_391_a1750_q0", "video_id": 391, "time_stamp_s": 11, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0a7ab99e3191368e681d58ef46c633ac048faa5e6dbde052e6527140d9c3eaec", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.017, 1.0013166666666666, 2.0023166666666667, 3.0033166666666666, 4.004316666666667, 5.005316666666666, 6.006316666666667, 7.007316666666667, 8.008316666666667, 9.009316666666667, 10.010316666666666], "recent_frames_sha256": "e809a1fee17c4498c2a710736ce882a114e24129e6c06ec67bbcd53e4d17e48a", "num_recent_frames": 11, "tq": 716947.562065962, "t1": 716954.598322122, "ta": 716954.598322122, "te": 716954.635669278, "first_response_s": 7.036256160004996, "answer_total_s": 7.07360331597738, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_391_a1750_q0", "video_id": 391, "time_stamp_s": 11, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a6bf588ffc807e9b0e97a770e2a011909459ece7e1c4b94701fb15e4efc7d611", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.017, 1.0013166666666666, 2.0023166666666667, 3.0033166666666666, 4.004316666666667, 5.005316666666666, 6.006316666666667, 7.007316666666667, 8.008316666666667, 9.009316666666667, 10.010316666666666], "recent_frames_sha256": "e809a1fee17c4498c2a710736ce882a114e24129e6c06ec67bbcd53e4d17e48a", "num_recent_frames": 11, "tq": 716997.619236394, "t1": 717008.796485214, "ta": 717008.796485214, "te": 717008.836404277, "first_response_s": 11.177248820080422, "answer_total_s": 11.217167883063667, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 391, "content_group": "ea87f1a450c5b2b4e87a8959ca2e514bd2da33027fead5402d298eb6d95df721", "question": {"question_id": "sample_391_a1751_q0", "video_id": 391, "video_path": "./videos/sample_391_real.mp4", "annotation_index": 1751, "question_index": 0, "question": "What is written on the blue bus's side near the top?", "options": ["A. Starr.", "B. City Lights Entertainment.", "C. Broadway Tours.", "D. Manhattan Transit."], "answer": "A", "time_stamp_s": 124, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [122, 127], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_391_a1751_q0", "video_id": 391, "time_stamp_s": 124, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "48839e885a4775766940d7fb7874b81b92c69bd17125f02c8d0ff7f2cb5c7d50", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [94.0109, 95.0119, 96.0129, 97.0139, 98.0149, 99.0159, 100.00021666666666, 101.00121666666666, 102.00221666666667, 103.00321666666666, 104.00421666666666, 105.00521666666667, 106.00621666666666, 107.00721666666666, 108.00821666666667, 109.00921666666666, 110.01021666666666, 111.01121666666667, 112.01221666666666, 113.01321666666666, 114.01421666666667, 115.01521666666666, 116.01621666666666, 117.00053333333334, 118.00153333333333, 119.00253333333333, 120.00353333333334, 121.00453333333333, 122.00553333333333, 123.00653333333334], "recent_frames_sha256": "1f1fa4c3d5a24eb023d2802abe21f3836f684be739b90308893b94238b228cb4", "num_recent_frames": 30, "tq": 716954.660107681, "t1": 716968.00109506, "ta": 716968.00109506, "te": 716968.040279441, "first_response_s": 13.340987379080616, "answer_total_s": 13.380171760101803, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_391_a1751_q0", "video_id": 391, "time_stamp_s": 124, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ae4f7c9380c036f6ac69f7bd7af9dcfcae7a8e615f500dac2a9b84f52ba0b928", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A black sedan drives forward, following traffic on a multi-lane city street with tall buildings and trees lining the road.  \n- A large tour bus with \"The Lion King\" branding and a lion graphic is visible on the right, moving slowly or stopped.  \n- Pedestrians cross the street at a crosswalk, and traffic lights change from red to green, allowing vehicles to proceed.\n[30-60s] - A black tour bus with a yellow lion graphic and \"THE STORY OF A LIFETIME\" text drives on the right lane, passing parked cars and tall buildings.  \n- A red bus appears ahead, moving in the same direction, with traffic lights and street signs visible at intersections.  \n- Pedestrians cross at a crosswalk as the camera vehicle approaches, with construction scaffolding visible on the right side of the street.\n[60-90s] - Red bus travels forward on a dedicated bus lane, passing other vehicles and pedestrians.  \n- Yellow taxi appears on the left, moving in the same direction as the bus.  \n- Pedestrians cross the street at a marked crosswalk, with some waiting at the curb.\n[90-120s] - Red bus travels down the center of a multi-lane street, flanked by parked cars and tall buildings.  \n- A white food truck with pink branding is parked on the right side of the road, near a crosswalk.  \n- Pedestrians cross the street at marked crosswalks, with traffic lights changing from red to green.", "history_tokens": 325, "history_utf8_bytes": 1377, "recent_frame_times_s": [94.0109, 95.0119, 96.0129, 97.0139, 98.0149, 99.0159, 100.00021666666666, 101.00121666666666, 102.00221666666667, 103.00321666666666, 104.00421666666666, 105.00521666666667, 106.00621666666666, 107.00721666666666, 108.00821666666667, 109.00921666666666, 110.01021666666666, 111.01121666666667, 112.01221666666666, 113.01321666666666, 114.01421666666667, 115.01521666666666, 116.01621666666666, 117.00053333333334, 118.00153333333333, 119.00253333333333, 120.00353333333334, 121.00453333333333, 122.00553333333333, 123.00653333333334], "recent_frames_sha256": "1f1fa4c3d5a24eb023d2802abe21f3836f684be739b90308893b94238b228cb4", "num_recent_frames": 30, "tq": 717048.752296086, "t1": 717055.237077749, "ta": 717055.237077749, "te": 717055.38598549, "first_response_s": 6.484781662933528, "answer_total_s": 6.633689403999597, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 391, "content_group": "ea87f1a450c5b2b4e87a8959ca2e514bd2da33027fead5402d298eb6d95df721", "question": {"question_id": "sample_391_a1752_q0", "video_id": 391, "video_path": "./videos/sample_391_real.mp4", "annotation_index": 1752, "question_index": 0, "question": "What is the predominant color of the vintage car on the right?", "options": ["A. Blue.", "B. Red.", "C. White.", "D. Black."], "answer": "C", "time_stamp_s": 242, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [244, 249], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_391_a1752_q0", "video_id": 391, "time_stamp_s": 242, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b7df9842ebfb1fad426bb77db44c95e0ff066b9d17ed3b31d687d0b50e9004e0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [212.01211666666666, 213.01311666666666, 214.01411666666667, 215.01511666666667, 216.01611666666668, 217.00043333333332, 218.00143333333332, 219.00243333333333, 220.00343333333333, 221.00443333333334, 222.00543333333334, 223.00643333333332, 224.00743333333332, 225.00843333333333, 226.00943333333333, 227.01043333333334, 228.01143333333334, 229.01243333333332, 230.01343333333332, 231.01443333333333, 232.01543333333333, 233.01643333333334, 234.00075, 235.00175, 236.00275, 237.00375, 238.00475, 239.00575, 240.00675, 241.00775], "recent_frames_sha256": "a93ceae7bd8848634cea6c7bc5b2b9729343c202f5cae75d9f6f0e984ea43e69", "num_recent_frames": 30, "tq": 716968.050663551, "t1": 716978.416750449, "ta": 716978.416750449, "te": 716978.455023361, "first_response_s": 10.366086898022331, "answer_total_s": 10.404359810054302, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_391_a1752_q0", "video_id": 391, "time_stamp_s": 242, "ground_truth": "C", "raw_output": "C. White.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "d9f879791a1d3e4853b818f290ffe5e57817f9ae27c756685c93913b9e9dd66b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A black sedan drives forward, following traffic on a multi-lane city street with tall buildings and trees lining the road.  \n- A large tour bus with \"The Lion King\" branding and a lion graphic is visible on the right, moving slowly or stopped.  \n- Pedestrians cross the street at a crosswalk, and traffic lights change from red to green, allowing vehicles to proceed.\n[30-60s] - A black tour bus with a yellow lion graphic and \"THE STORY OF A LIFETIME\" text drives on the right lane, passing parked cars and tall buildings.  \n- A red bus appears ahead, moving in the same direction, with traffic lights and street signs visible at intersections.  \n- Pedestrians cross at a crosswalk as the camera vehicle approaches, with construction scaffolding visible on the right side of the street.\n[60-90s] - Red bus travels forward on a dedicated bus lane, passing other vehicles and pedestrians.  \n- Yellow taxi appears on the left, moving in the same direction as the bus.  \n- Pedestrians cross the street at a marked crosswalk, with some waiting at the curb.\n[90-120s] - Red bus travels down the center of a multi-lane street, flanked by parked cars and tall buildings.  \n- A white food truck with pink branding is parked on the right side of the road, near a crosswalk.  \n- Pedestrians cross the street at marked crosswalks, with traffic lights changing from red to green.\n[120-150s] - Red bus continues straight ahead, maintaining central position in traffic lane.  \n- Blue \"Stori\" bus overtakes from right, then a white bus follows, both moving in same direction.  \n- Pedestrians cross at crosswalks; street signs and traffic lights are visible at intersections.\n[150-180s] - A silver SUV drives across the crosswalk, moving from left to right, while pedestrians cross the street in front of it.\n- A blue sedan enters the frame from the right, following the SUV, and continues straight through the intersection.\n- A large bus with \"BIG\" visible on its side is parked on the right, partially obstructing the view of the street.\n[180-210s] - A silver SUV drives forward, passing a crosswalk with pedestrians on both sides.  \n- A red-painted bike lane runs along the right side of the road, with cyclists and pedestrians nearby.  \n- A green construction barrier lines the left side of the street, with a \"NO ENTRY\" sign visible.\n[210-240s] - A black SUV drives forward, following a red-painted bike lane, as pedestrians cross the street at a crosswalk.  \n- A white ambulance is parked on the right side of the road, with its lights flashing, near a group of people gathered on the sidewalk.  \n- A tall building with scaffolding on its facade is visible on the right, with American and other flags flying above.", "history_tokens": 643, "history_utf8_bytes": 2714, "recent_frame_times_s": [212.01211666666666, 213.01311666666666, 214.01411666666667, 215.01511666666667, 216.01611666666668, 217.00043333333332, 218.00143333333332, 219.00243333333333, 220.00343333333333, 221.00443333333334, 222.00543333333334, 223.00643333333332, 224.00743333333332, 225.00843333333333, 226.00943333333333, 227.01043333333334, 228.01143333333334, 229.01243333333332, 230.01343333333332, 231.01443333333333, 232.01543333333333, 233.01643333333334, 234.00075, 235.00175, 236.00275, 237.00375, 238.00475, 239.00575, 240.00675, 241.00775], "recent_frames_sha256": "a93ceae7bd8848634cea6c7bc5b2b9729343c202f5cae75d9f6f0e984ea43e69", "num_recent_frames": 30, "tq": 717089.2695356, "t1": 717090.490916818, "ta": 717090.490916818, "te": 717090.644596633, "first_response_s": 1.2213812180561945, "answer_total_s": 1.3750610330607742, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 391, "content_group": "ea87f1a450c5b2b4e87a8959ca2e514bd2da33027fead5402d298eb6d95df721", "question": {"question_id": "sample_391_a1753_q0", "video_id": 391, "video_path": "./videos/sample_391_real.mp4", "annotation_index": 1753, "question_index": 0, "question": "What does the van on the right promote?", "options": ["A. A moving company.", "B. A food delivery service.", "C. Sightseeing tours.", "D. Outdoor adventures."], "answer": "C", "time_stamp_s": 369, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [366, 371], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_391_a1753_q0", "video_id": 391, "time_stamp_s": 369, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6e34d38c2b82e42e8843051b4962ca31997fc6db662a035d2f5947b7846a5ce6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [339.00565, 340.00665, 341.00765, 342.00865, 343.00965, 344.01065, 345.01165, 346.01265, 347.01365, 348.01465, 349.01565, 350.01665, 351.00096666666667, 352.00196666666665, 353.0029666666667, 354.00396666666666, 355.0049666666667, 356.00596666666667, 357.00696666666664, 358.0079666666667, 359.00896666666665, 360.0099666666667, 361.01096666666666, 362.0119666666667, 363.01296666666667, 364.01396666666665, 365.0149666666667, 366.01596666666666, 367.00028333333336, 368.00128333333333], "recent_frames_sha256": "a5de4c23d36902b8aa3ac249925ab3e6fb2c7f4e4bc102795915fa4316680be8", "num_recent_frames": 30, "tq": 716978.466921064, "t1": 716989.87273167, "ta": 716989.87273167, "te": 716989.90974066, "first_response_s": 11.405810606083833, "answer_total_s": 11.442819596035406, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_391_a1753_q0", "video_id": 391, "time_stamp_s": 369, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0d951d9223a873d1b07a4a1e8a979a005531062699903c23525e12346fdefeb0", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A black sedan drives forward, following traffic on a multi-lane city street with tall buildings and trees lining the road.  \n- A large tour bus with \"The Lion King\" branding and a lion graphic is visible on the right, moving slowly or stopped.  \n- Pedestrians cross the street at a crosswalk, and traffic lights change from red to green, allowing vehicles to proceed.\n[30-60s] - A black tour bus with a yellow lion graphic and \"THE STORY OF A LIFETIME\" text drives on the right lane, passing parked cars and tall buildings.  \n- A red bus appears ahead, moving in the same direction, with traffic lights and street signs visible at intersections.  \n- Pedestrians cross at a crosswalk as the camera vehicle approaches, with construction scaffolding visible on the right side of the street.\n[60-90s] - Red bus travels forward on a dedicated bus lane, passing other vehicles and pedestrians.  \n- Yellow taxi appears on the left, moving in the same direction as the bus.  \n- Pedestrians cross the street at a marked crosswalk, with some waiting at the curb.\n[90-120s] - Red bus travels down the center of a multi-lane street, flanked by parked cars and tall buildings.  \n- A white food truck with pink branding is parked on the right side of the road, near a crosswalk.  \n- Pedestrians cross the street at marked crosswalks, with traffic lights changing from red to green.\n[120-150s] - Red bus continues straight ahead, maintaining central position in traffic lane.  \n- Blue \"Stori\" bus overtakes from right, then a white bus follows, both moving in same direction.  \n- Pedestrians cross at crosswalks; street signs and traffic lights are visible at intersections.\n[150-180s] - A silver SUV drives across the crosswalk, moving from left to right, while pedestrians cross the street in front of it.\n- A blue sedan enters the frame from the right, following the SUV, and continues straight through the intersection.\n- A large bus with \"BIG\" visible on its side is parked on the right, partially obstructing the view of the street.\n[180-210s] - A silver SUV drives forward, passing a crosswalk with pedestrians on both sides.  \n- A red-painted bike lane runs along the right side of the road, with cyclists and pedestrians nearby.  \n- A green construction barrier lines the left side of the street, with a \"NO ENTRY\" sign visible.\n[210-240s] - A black SUV drives forward, following a red-painted bike lane, as pedestrians cross the street at a crosswalk.  \n- A white ambulance is parked on the right side of the road, with its lights flashing, near a group of people gathered on the sidewalk.  \n- A tall building with scaffolding on its facade is visible on the right, with American and other flags flying above.\n[240-270s] - A black SUV drives forward, passing a white vintage car parked on the right side of the road.  \n- Pedestrians are seated on stone benches along the left sidewalk, observing the street activity.  \n- A red-painted bike lane runs parallel to the road, with several vehicles parked along the right curb.\n[270-300s] - Pedestrians cross the street at a marked crosswalk as traffic lights turn red.  \n- A silver car is parked on the left side of the road, near a sidewalk with orange construction barriers.  \n- A yellow traffic signal hangs above the intersection, with a red light illuminated.\n[300-330s] - Red traffic lights govern vehicle movement at the intersection, with cars and buses waiting to proceed.\n- A pedestrian crossing is active, with individuals walking across the street, including a person with a backpack and another with a cane.\n- A red double-decker bus enters the frame from the right, stopping near the crosswalk as traffic signals change to green.\n[330-360s] - A black SUV drives forward, positioned between a red truck and a white van, on a road with yellow lane markings.  \n- A blue bus overtakes the SUV from the left, passing a large classical-style building with green construction barriers.  \n- Orange traffic cones and construction barriers line the road, with pedestrians visible near a food truck on the right.", "history_tokens": 948, "history_utf8_bytes": 4066, "recent_frame_times_s": [339.00565, 340.00665, 341.00765, 342.00865, 343.00965, 344.01065, 345.01165, 346.01265, 347.01365, 348.01465, 349.01565, 350.01665, 351.00096666666667, 352.00196666666665, 353.0029666666667, 354.00396666666666, 355.0049666666667, 356.00596666666667, 357.00696666666664, 358.0079666666667, 359.00896666666665, 360.0099666666667, 361.01096666666666, 362.0119666666667, 363.01296666666667, 364.01396666666665, 365.0149666666667, 366.01596666666666, 367.00028333333336, 368.00128333333333], "recent_frames_sha256": "a5de4c23d36902b8aa3ac249925ab3e6fb2c7f4e4bc102795915fa4316680be8", "num_recent_frames": 30, "tq": 717126.125816653, "t1": 717134.685649512, "ta": 717134.685649512, "te": 717134.996370567, "first_response_s": 8.559832858969457, "answer_total_s": 8.870553913991898, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 391, "content_group": "ea87f1a450c5b2b4e87a8959ca2e514bd2da33027fead5402d298eb6d95df721", "question": {"question_id": "sample_391_a1754_q0", "video_id": 391, "video_path": "./videos/sample_391_real.mp4", "annotation_index": 1754, "question_index": 0, "question": "What is the building on the left with a sign?", "options": ["A. Bank of America.", "B. Hilton Garden Inn.", "C. Holiday Inn Express.", "D. Wells Fargo."], "answer": "B", "time_stamp_s": 488, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [488, 493], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_391_a1754_q0", "video_id": 391, "time_stamp_s": 488, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b181880ee4c1bc5d9b0ed299eb21097709ddb5ece468cd2aab9577360401c61d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [458.00786666666664, 459.0088666666667, 460.00986666666665, 461.0108666666667, 462.01186666666666, 463.01286666666664, 464.0138666666667, 465.01486666666665, 466.0158666666667, 467.0001833333333, 468.00118333333336, 469.00218333333333, 470.0031833333333, 471.00418333333334, 472.0051833333333, 473.00618333333335, 474.00718333333333, 475.0081833333333, 476.00918333333334, 477.0101833333333, 478.01118333333335, 479.0121833333333, 480.01318333333336, 481.01418333333334, 482.0151833333333, 483.01618333333334, 484.0005, 485.0015, 486.0025, 487.0035], "recent_frames_sha256": "b7625d3f3052bdd288bafe3a4c226ee7ea1410a9edc79ec985bfdf9aff4ff02f", "num_recent_frames": 30, "tq": 716989.917806369, "t1": 716997.57231295, "ta": 716997.57231295, "te": 716997.61068827, "first_response_s": 7.6545065810205415, "answer_total_s": 7.692881900933571, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_391_a1754_q0", "video_id": 391, "time_stamp_s": 488, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6733284f8e9632ed3ec8080c44d41d5a6512d338888636d6c15aeacff645f4be", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Red bus travels down the center of a multi-lane street, flanked by parked cars and tall buildings.  \n- A white food truck with pink branding is parked on the right side of the road, near a crosswalk.  \n- Pedestrians cross the street at marked crosswalks, with traffic lights changing from red to green.\n[120-150s] - Red bus continues straight ahead, maintaining central position in traffic lane.  \n- Blue \"Stori\" bus overtakes from right, then a white bus follows, both moving in same direction.  \n- Pedestrians cross at crosswalks; street signs and traffic lights are visible at intersections.\n[150-180s] - A silver SUV drives across the crosswalk, moving from left to right, while pedestrians cross the street in front of it.\n- A blue sedan enters the frame from the right, following the SUV, and continues straight through the intersection.\n- A large bus with \"BIG\" visible on its side is parked on the right, partially obstructing the view of the street.\n[180-210s] - A silver SUV drives forward, passing a crosswalk with pedestrians on both sides.  \n- A red-painted bike lane runs along the right side of the road, with cyclists and pedestrians nearby.  \n- A green construction barrier lines the left side of the street, with a \"NO ENTRY\" sign visible.\n[210-240s] - A black SUV drives forward, following a red-painted bike lane, as pedestrians cross the street at a crosswalk.  \n- A white ambulance is parked on the right side of the road, with its lights flashing, near a group of people gathered on the sidewalk.  \n- A tall building with scaffolding on its facade is visible on the right, with American and other flags flying above.\n[240-270s] - A black SUV drives forward, passing a white vintage car parked on the right side of the road.  \n- Pedestrians are seated on stone benches along the left sidewalk, observing the street activity.  \n- A red-painted bike lane runs parallel to the road, with several vehicles parked along the right curb.\n[270-300s] - Pedestrians cross the street at a marked crosswalk as traffic lights turn red.  \n- A silver car is parked on the left side of the road, near a sidewalk with orange construction barriers.  \n- A yellow traffic signal hangs above the intersection, with a red light illuminated.\n[300-330s] - Red traffic lights govern vehicle movement at the intersection, with cars and buses waiting to proceed.\n- A pedestrian crossing is active, with individuals walking across the street, including a person with a backpack and another with a cane.\n- A red double-decker bus enters the frame from the right, stopping near the crosswalk as traffic signals change to green.\n[330-360s] - A black SUV drives forward, positioned between a red truck and a white van, on a road with yellow lane markings.  \n- A blue bus overtakes the SUV from the left, passing a large classical-style building with green construction barriers.  \n- Orange traffic cones and construction barriers line the road, with pedestrians visible near a food truck on the right.\n[360-390s] - A black SUV drives forward, following a red truck and a white emergency vehicle with \"FROSTEE\" branding.  \n- Traffic lights change from red to green, allowing vehicles to proceed through the intersection.  \n- Pedestrians cross the street at a marked crosswalk as the camera vehicle moves forward.\n[390-420s] - A red fire truck is stationary on the left side of the road, positioned near a crosswalk.  \n- A black SUV is directly ahead, stopped at the intersection, with its brake lights illuminated.  \n- Yellow taxis are parked along the right side of the road, forming a line near the curb.\n[420-450s] - A black SUV is stationary at a crosswalk, facing the camera, with its brake lights illuminated.  \n- Two yellow taxis are parked on the right side of the road, with one driver visible standing beside it.  \n- A group of pedestrians is gathered on the sidewalk near the crosswalk, waiting to cross.\n[450-480s] - Black SUV proceeds through intersection, turning right after green light.\n- Yellow taxis and pedestrians cross street at crosswalk; one taxi is stationary near curb.\n- Traffic cones and construction barriers line road, indicating ongoing work.", "history_tokens": 975, "history_utf8_bytes": 4173, "recent_frame_times_s": [458.00786666666664, 459.0088666666667, 460.00986666666665, 461.0108666666667, 462.01186666666666, 463.01286666666664, 464.0138666666667, 465.01486666666665, 466.0158666666667, 467.0001833333333, 468.00118333333336, 469.00218333333333, 470.0031833333333, 471.00418333333334, 472.0051833333333, 473.00618333333335, 474.00718333333333, 475.0081833333333, 476.00918333333334, 477.0101833333333, 478.01118333333335, 479.0121833333333, 480.01318333333336, 481.01418333333334, 482.0151833333333, 483.01618333333334, 484.0005, 485.0015, 486.0025, 487.0035], "recent_frames_sha256": "b7625d3f3052bdd288bafe3a4c226ee7ea1410a9edc79ec985bfdf9aff4ff02f", "num_recent_frames": 30, "tq": 717198.275125989, "t1": 717204.492895719, "ta": 717204.492895719, "te": 717204.755299172, "first_response_s": 6.217769730021246, "answer_total_s": 6.480173183022998, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 392, "content_group": "80b489d70e47927d1ac1fc04491e890987e7823748ec0ea7bf74582b30b28479", "question": {"question_id": "sample_392_a1272_q0", "video_id": 392, "video_path": "./videos/sample_392_real.mp4", "annotation_index": 1272, "question_index": 0, "question": "Which coffee shop logo is visible in the background right now?", "options": ["A. Dunkin'.", "B. Costa Coffee.", "C. Tim Hortons.", "D. Starbucks."], "answer": "D", "time_stamp_s": 3, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_392_a1272_q0", "video_id": 392, "time_stamp_s": 3, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e102d35903d8f6c576200e190008758358b53f7accc3c6765b8283ca079de7d0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.019, 1.0033166666666666, 2.0043166666666665], "recent_frames_sha256": "71e01ee392a835ef00e558f3d1b3e87b8edcb7fbb3cc5c1b54a2332f2ea741ef", "num_recent_frames": 3, "tq": 716811.68268982, "t1": 716816.834975072, "ta": 716816.834975072, "te": 716816.872888889, "first_response_s": 5.152285251999274, "answer_total_s": 5.190199069096707, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_392_a1272_q0", "video_id": 392, "time_stamp_s": 3, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "83149bbf03dabf223d9a08e13c598e395ba61272ee64e6ff958b9d7c8e89bf7e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.019, 1.0033166666666666, 2.0043166666666665], "recent_frames_sha256": "71e01ee392a835ef00e558f3d1b3e87b8edcb7fbb3cc5c1b54a2332f2ea741ef", "num_recent_frames": 3, "tq": 716650.761128001, "t1": 716658.141491031, "ta": 716658.141491031, "te": 716658.180025861, "first_response_s": 7.380363030009903, "answer_total_s": 7.418897859985009, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 392, "content_group": "80b489d70e47927d1ac1fc04491e890987e7823748ec0ea7bf74582b30b28479", "question": {"question_id": "sample_392_a1273_q0", "video_id": 392, "video_path": "./videos/sample_392_real.mp4", "annotation_index": 1273, "question_index": 0, "question": "What kind of structure is visible in the distance right now?", "options": ["A. A tunnel.", "B. A skyscraper.", "C. A park.", "D. A bridge."], "answer": "D", "time_stamp_s": 135, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [131, 136], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_392_a1273_q0", "video_id": 392, "time_stamp_s": 135, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "598e055d49a1b9b0ae57484d491958140777ce60f933be87afe6d0d1aba5eb0c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [105.00721666666666, 106.00821666666667, 107.00921666666666, 108.01021666666666, 109.01121666666667, 110.01221666666666, 111.01321666666666, 112.01421666666667, 113.01521666666666, 114.01621666666666, 115.00053333333334, 116.00153333333333, 117.00253333333333, 118.00353333333334, 119.00453333333333, 120.00553333333333, 121.00653333333334, 122.00753333333333, 123.00853333333333, 124.00953333333334, 125.01053333333333, 126.01153333333333, 127.01253333333334, 128.01353333333333, 129.01453333333333, 130.01553333333334, 131.01653333333334, 132.00085, 133.00185, 134.00285], "recent_frames_sha256": "45f32b8b6824040705825c041f80c356c03249e28a72c9ce41a9ef647a63cc04", "num_recent_frames": 30, "tq": 716816.884258903, "t1": 716826.472370153, "ta": 716826.472370153, "te": 716826.508957267, "first_response_s": 9.588111249962822, "answer_total_s": 9.62469836405944, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_392_a1273_q0", "video_id": 392, "time_stamp_s": 135, "ground_truth": "D", "raw_output": "D. A bridge.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "de7f26dcf4429c72ec638903e2a424a6efdbdbcfe0742968d9bf99cb3f600b73", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pedestrians cross a wide street at a marked crosswalk, with traffic lights showing yellow before turning red.  \n- Vehicles, including black SUVs, a yellow taxi, and a silver sedan, navigate the intersection as traffic flows.  \n- A Starbucks storefront is visible on the right side of the street, with a pedestrian standing near the curb.\n[30-60s] - A white van with a visible logo drives leftward, passing a construction barrier on the left side of the road.  \n- A yellow taxi cab is seen moving forward in the center lane, approaching an intersection with traffic lights.  \n- A blue bus with colorful graphics enters the frame from the left, navigating the intersection while other vehicles wait at the crosswalk.\n[60-90s] - A red bus passes on the right, moving away from the camera's perspective.  \n- A silver sedan is seen driving ahead in the center lane, approaching an intersection.  \n- Construction barriers with \"SUPERFLEX\" signage line the right side of the road, indicating ongoing development.\n[90-120s] - A silver minivan is stationary in the center lane, facing forward, with brake lights illuminated.  \n- A blue sedan passes from left to right on the left lane, moving away from the camera.  \n- A white bus is visible ahead on the road, approaching a traffic light at the intersection.", "history_tokens": 295, "history_utf8_bytes": 1310, "recent_frame_times_s": [105.00721666666666, 106.00821666666667, 107.00921666666666, 108.01021666666666, 109.01121666666667, 110.01221666666666, 111.01321666666666, 112.01421666666667, 113.01521666666666, 114.01621666666666, 115.00053333333334, 116.00153333333333, 117.00253333333333, 118.00353333333334, 119.00453333333333, 120.00553333333333, 121.00653333333334, 122.00753333333333, 123.00853333333333, 124.00953333333334, 125.01053333333333, 126.01153333333333, 127.01253333333334, 128.01353333333333, 129.01453333333333, 130.01553333333334, 131.01653333333334, 132.00085, 133.00185, 134.00285], "recent_frames_sha256": "45f32b8b6824040705825c041f80c356c03249e28a72c9ce41a9ef647a63cc04", "num_recent_frames": 30, "tq": 716681.928943075, "t1": 716689.559747183, "ta": 716689.559747183, "te": 716689.749085339, "first_response_s": 7.630804107990116, "answer_total_s": 7.820142264012247, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 392, "content_group": "80b489d70e47927d1ac1fc04491e890987e7823748ec0ea7bf74582b30b28479", "question": {"question_id": "sample_392_a1274_q0", "video_id": 392, "video_path": "./videos/sample_392_real.mp4", "annotation_index": 1274, "question_index": 0, "question": "What type of clothing are most people wearing right now?", "options": ["A. Heavy coats.", "B. Business suits.", "C. Rain jackets.", "D. Casual summer outfits."], "answer": "D", "time_stamp_s": 265, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [262, 267], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_392_a1274_q0", "video_id": 392, "time_stamp_s": 265, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cf620545be92cd609d7cfc4096db72e98f160167631dd5cb628d58065e902a86", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [235.00375, 236.00475, 237.00575, 238.00675, 239.00775, 240.00875, 241.00975, 242.01075, 243.01175, 244.01275, 245.01375, 246.01475, 247.01575, 248.00006666666667, 249.00106666666667, 250.00206666666668, 251.00306666666665, 252.00406666666666, 253.00506666666666, 254.00606666666667, 255.00706666666667, 256.00806666666665, 257.0090666666667, 258.01006666666666, 259.0110666666667, 260.01206666666667, 261.01306666666665, 262.0140666666667, 263.01506666666666, 264.0160666666667], "recent_frames_sha256": "64855332f89ff5a0f01041992ef6ee0c9293fb5d34fda021e1861dd74f271d4d", "num_recent_frames": 30, "tq": 716826.519726955, "t1": 716837.59856814, "ta": 716837.59856814, "te": 716837.63931634, "first_response_s": 11.078841184964404, "answer_total_s": 11.11958938499447, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_392_a1274_q0", "video_id": 392, "time_stamp_s": 265, "ground_truth": "D", "raw_output": "D. Casual summer outfits.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "de4bc988059c50b12a3e1d060f2d41bb7bcb670757f4a2d38ff28cf852a0a133", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pedestrians cross a wide street at a marked crosswalk, with traffic lights showing yellow before turning red.  \n- Vehicles, including black SUVs, a yellow taxi, and a silver sedan, navigate the intersection as traffic flows.  \n- A Starbucks storefront is visible on the right side of the street, with a pedestrian standing near the curb.\n[30-60s] - A white van with a visible logo drives leftward, passing a construction barrier on the left side of the road.  \n- A yellow taxi cab is seen moving forward in the center lane, approaching an intersection with traffic lights.  \n- A blue bus with colorful graphics enters the frame from the left, navigating the intersection while other vehicles wait at the crosswalk.\n[60-90s] - A red bus passes on the right, moving away from the camera's perspective.  \n- A silver sedan is seen driving ahead in the center lane, approaching an intersection.  \n- Construction barriers with \"SUPERFLEX\" signage line the right side of the road, indicating ongoing development.\n[90-120s] - A silver minivan is stationary in the center lane, facing forward, with brake lights illuminated.  \n- A blue sedan passes from left to right on the left lane, moving away from the camera.  \n- A white bus is visible ahead on the road, approaching a traffic light at the intersection.\n[120-150s] - A cyclist rides across the street, passing under a large metal bridge structure.  \n- A white SUV is seen driving ahead, approaching and passing under the bridge.  \n- Traffic signs and construction barriers are visible on the right side of the road.\n[150-180s] - A black SUV with a yellow license plate is seen driving ahead, positioned in the center lane, moving forward along the street.  \n- A pedestrian crosses the street from left to right at a marked crosswalk, walking directly in front of the SUV.  \n- Blue bicycles are parked in a row along the right curb, adjacent to a bus stop shelter, with no visible movement or interaction.\n[180-210s] - A black SUV drives forward, following a yellow center line on a multi-lane urban street.  \n- Parked cars line both sides of the road, with a row of blue bicycles visible on the right.  \n- Traffic lights and street signs are visible, including a \"ONLY\" lane marking ahead.\n[210-240s] - Yellow taxis and a black SUV are visible on the road, with the SUV moving forward.  \n- A group of pedestrians, including cyclists, cross the street at a marked crosswalk.  \n- A tall brick building with fire escapes stands on the right, while a crane is visible in the background.", "history_tokens": 587, "history_utf8_bytes": 2539, "recent_frame_times_s": [235.00375, 236.00475, 237.00575, 238.00675, 239.00775, 240.00875, 241.00975, 242.01075, 243.01175, 244.01275, 245.01375, 246.01475, 247.01575, 248.00006666666667, 249.00106666666667, 250.00206666666668, 251.00306666666665, 252.00406666666666, 253.00506666666666, 254.00606666666667, 255.00706666666667, 256.00806666666665, 257.0090666666667, 258.01006666666666, 259.0110666666667, 260.01206666666667, 261.01306666666665, 262.0140666666667, 263.01506666666666, 264.0160666666667], "recent_frames_sha256": "64855332f89ff5a0f01041992ef6ee0c9293fb5d34fda021e1861dd74f271d4d", "num_recent_frames": 30, "tq": 716715.003974286, "t1": 716716.238943092, "ta": 716716.238943092, "te": 716716.467240168, "first_response_s": 1.23496880591847, "answer_total_s": 1.4632658819900826, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 392, "content_group": "80b489d70e47927d1ac1fc04491e890987e7823748ec0ea7bf74582b30b28479", "question": {"question_id": "sample_392_a1275_q0", "video_id": 392, "video_path": "./videos/sample_392_real.mp4", "annotation_index": 1275, "question_index": 0, "question": "What brand is the black SUV driving in front right now?", "options": ["A. Toyota.", "B. Ford.", "C. BMW.", "D. Benz."], "answer": "D", "time_stamp_s": 396, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [393, 398], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_392_a1275_q0", "video_id": 392, "time_stamp_s": 396, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a010d81c44a51c7493bc458bbbf1d31c6dc79a371a1f0448c0b9eb7a3bfd767d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [366.00128333333333, 367.0022833333333, 368.00328333333334, 369.0042833333333, 370.00528333333335, 371.00628333333333, 372.0072833333333, 373.00828333333334, 374.0092833333333, 375.01028333333335, 376.0112833333333, 377.01228333333336, 378.01328333333333, 379.0142833333333, 380.01528333333334, 381.0162833333333, 382.0006, 383.0016, 384.0026, 385.0036, 386.0046, 387.0056, 388.0066, 389.0076, 390.0086, 391.0096, 392.0106, 393.0116, 394.0126, 395.0136], "recent_frames_sha256": "c30cece2afffc5abf1a34e7c2683980d38083f5db22205844643ab80a9270bd8", "num_recent_frames": 30, "tq": 716837.652115296, "t1": 716849.770599123, "ta": 716849.770599123, "te": 716849.808522727, "first_response_s": 12.11848382698372, "answer_total_s": 12.156407431000844, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_392_a1275_q0", "video_id": 392, "time_stamp_s": 396, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "147d42307aa5943b7a20f73598d8ae6a340d9ef86a7662e786f429d7678782a9", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pedestrians cross a wide street at a marked crosswalk, with traffic lights showing yellow before turning red.  \n- Vehicles, including black SUVs, a yellow taxi, and a silver sedan, navigate the intersection as traffic flows.  \n- A Starbucks storefront is visible on the right side of the street, with a pedestrian standing near the curb.\n[30-60s] - A white van with a visible logo drives leftward, passing a construction barrier on the left side of the road.  \n- A yellow taxi cab is seen moving forward in the center lane, approaching an intersection with traffic lights.  \n- A blue bus with colorful graphics enters the frame from the left, navigating the intersection while other vehicles wait at the crosswalk.\n[60-90s] - A red bus passes on the right, moving away from the camera's perspective.  \n- A silver sedan is seen driving ahead in the center lane, approaching an intersection.  \n- Construction barriers with \"SUPERFLEX\" signage line the right side of the road, indicating ongoing development.\n[90-120s] - A silver minivan is stationary in the center lane, facing forward, with brake lights illuminated.  \n- A blue sedan passes from left to right on the left lane, moving away from the camera.  \n- A white bus is visible ahead on the road, approaching a traffic light at the intersection.\n[120-150s] - A cyclist rides across the street, passing under a large metal bridge structure.  \n- A white SUV is seen driving ahead, approaching and passing under the bridge.  \n- Traffic signs and construction barriers are visible on the right side of the road.\n[150-180s] - A black SUV with a yellow license plate is seen driving ahead, positioned in the center lane, moving forward along the street.  \n- A pedestrian crosses the street from left to right at a marked crosswalk, walking directly in front of the SUV.  \n- Blue bicycles are parked in a row along the right curb, adjacent to a bus stop shelter, with no visible movement or interaction.\n[180-210s] - A black SUV drives forward, following a yellow center line on a multi-lane urban street.  \n- Parked cars line both sides of the road, with a row of blue bicycles visible on the right.  \n- Traffic lights and street signs are visible, including a \"ONLY\" lane marking ahead.\n[210-240s] - Yellow taxis and a black SUV are visible on the road, with the SUV moving forward.  \n- A group of pedestrians, including cyclists, cross the street at a marked crosswalk.  \n- A tall brick building with fire escapes stands on the right, while a crane is visible in the background.\n[240-270s] - A cyclist rides across the street from right to left, passing a black sedan that is stationary at the intersection.  \n- A silver SUV drives through the intersection, moving from left to right, while pedestrians cross the street.  \n- A black sedan turns right at the intersection, followed by a silver SUV, as traffic flows through the crosswalk.\n[270-300s] - A silver SUV is stopped at a crosswalk, facing the camera, with traffic lights above it showing green for vehicles moving forward.\n- A blue taxi cab passes through the intersection, moving from left to right, with its driver visible and the vehicle in motion.\n- A pedestrian is crossing the street at the crosswalk, walking from right to left, near the curb on the right side of the frame.\n[300-330s] - A black sedan drives leftward across the intersection, passing a traffic light at 300.5s.\n- Pedestrians cross the street at a crosswalk near a building with a \"HOTEL\" sign at 302.5s.\n- A blue bus turns right at the corner, approaching a storefront with a red awning and \"DINER\" sign at 306.5s.\n[330-360s] - A black SUV drives forward, centered in the lane, approaching an underpass.  \n- A pedestrian bridge with a geometric design spans the street, visible above the road.  \n- Storefronts with bright signage line both sides of the street, including a \"SUNSHINE\" sign on the right.\n[360-390s] - A black SUV drives forward, maintaining position in the center lane, with traffic lights visible ahead.  \n- Pedestrians cross the street at a marked crosswalk, including a person in a red shirt and another in a dark jacket.  \n- A yellow taxi and a silver sedan are parked on the left side of the road, with a red brick building featuring signage on the right.", "history_tokens": 1019, "history_utf8_bytes": 4269, "recent_frame_times_s": [366.00128333333333, 367.0022833333333, 368.00328333333334, 369.0042833333333, 370.00528333333335, 371.00628333333333, 372.0072833333333, 373.00828333333334, 374.0092833333333, 375.01028333333335, 376.0112833333333, 377.01228333333336, 378.01328333333333, 379.0142833333333, 380.01528333333334, 381.0162833333333, 382.0006, 383.0016, 384.0026, 385.0036, 386.0046, 387.0056, 388.0066, 389.0076, 390.0086, 391.0096, 392.0106, 393.0116, 394.0126, 395.0136], "recent_frames_sha256": "c30cece2afffc5abf1a34e7c2683980d38083f5db22205844643ab80a9270bd8", "num_recent_frames": 30, "tq": 716758.665796916, "t1": 716764.793359171, "ta": 716764.793359171, "te": 716765.088390415, "first_response_s": 6.127562255016528, "answer_total_s": 6.4225934989517555, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 392, "content_group": "80b489d70e47927d1ac1fc04491e890987e7823748ec0ea7bf74582b30b28479", "question": {"question_id": "sample_392_a1276_q0", "video_id": 392, "video_path": "./videos/sample_392_real.mp4", "annotation_index": 1276, "question_index": 0, "question": "Which transportation service's bus is visible right now?", "options": ["A. Greyhound.", "B. Flixbus.", "C. Megabus.", "D. BoltBus."], "answer": "B", "time_stamp_s": 525, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [524, 529], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_392_a1276_q0", "video_id": 392, "time_stamp_s": 525, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "224bd0afedada7d715926df1baede919fd7381e1e12e43da2ada36f1386bf48e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [495.0135, 496.0145, 497.0155, 498.0165, 499.00081666666665, 500.0018166666667, 501.00281666666666, 502.0038166666667, 503.00481666666667, 504.00581666666665, 505.0068166666667, 506.00781666666666, 507.0088166666667, 508.00981666666667, 509.01081666666664, 510.0118166666667, 511.01281666666665, 512.0138166666667, 513.0148166666667, 514.0158166666666, 515.0001333333333, 516.0011333333333, 517.0021333333333, 518.0031333333334, 519.0041333333334, 520.0051333333333, 521.0061333333333, 522.0071333333333, 523.0081333333334, 524.0091333333334], "recent_frames_sha256": "2dbe01c1e90f8a94a75a512addaf7cd7e5bf24d3059ffa8ecbc33aed24fa827b", "num_recent_frames": 30, "tq": 716849.816304887, "t1": 716856.673103556, "ta": 716856.673103556, "te": 716856.711143109, "first_response_s": 6.8567986690904945, "answer_total_s": 6.894838222069666, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_392_a1276_q0", "video_id": 392, "time_stamp_s": 525, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "952ce1ef5c412335f606aa44e87a167e1de1e3963f03d048c071a9efd6988d19", "condition_order": ["notes", "recent"], "memory": "[150-180s] - A black SUV with a yellow license plate is seen driving ahead, positioned in the center lane, moving forward along the street.  \n- A pedestrian crosses the street from left to right at a marked crosswalk, walking directly in front of the SUV.  \n- Blue bicycles are parked in a row along the right curb, adjacent to a bus stop shelter, with no visible movement or interaction.\n[180-210s] - A black SUV drives forward, following a yellow center line on a multi-lane urban street.  \n- Parked cars line both sides of the road, with a row of blue bicycles visible on the right.  \n- Traffic lights and street signs are visible, including a \"ONLY\" lane marking ahead.\n[210-240s] - Yellow taxis and a black SUV are visible on the road, with the SUV moving forward.  \n- A group of pedestrians, including cyclists, cross the street at a marked crosswalk.  \n- A tall brick building with fire escapes stands on the right, while a crane is visible in the background.\n[240-270s] - A cyclist rides across the street from right to left, passing a black sedan that is stationary at the intersection.  \n- A silver SUV drives through the intersection, moving from left to right, while pedestrians cross the street.  \n- A black sedan turns right at the intersection, followed by a silver SUV, as traffic flows through the crosswalk.\n[270-300s] - A silver SUV is stopped at a crosswalk, facing the camera, with traffic lights above it showing green for vehicles moving forward.\n- A blue taxi cab passes through the intersection, moving from left to right, with its driver visible and the vehicle in motion.\n- A pedestrian is crossing the street at the crosswalk, walking from right to left, near the curb on the right side of the frame.\n[300-330s] - A black sedan drives leftward across the intersection, passing a traffic light at 300.5s.\n- Pedestrians cross the street at a crosswalk near a building with a \"HOTEL\" sign at 302.5s.\n- A blue bus turns right at the corner, approaching a storefront with a red awning and \"DINER\" sign at 306.5s.\n[330-360s] - A black SUV drives forward, centered in the lane, approaching an underpass.  \n- A pedestrian bridge with a geometric design spans the street, visible above the road.  \n- Storefronts with bright signage line both sides of the street, including a \"SUNSHINE\" sign on the right.\n[360-390s] - A black SUV drives forward, maintaining position in the center lane, with traffic lights visible ahead.  \n- Pedestrians cross the street at a marked crosswalk, including a person in a red shirt and another in a dark jacket.  \n- A yellow taxi and a silver sedan are parked on the left side of the road, with a red brick building featuring signage on the right.\n[390-420s] - A black SUV is stationary in the center of the road, facing the camera, with its brake lights illuminated.  \n- A silver SUV is parked on the right side of the road, partially visible, with its driver-side door open.  \n- A yellow taxi cab is visible on the left side of the road, moving away from the camera.\n[420-450s] - A black SUV is stationary at a traffic light, positioned centrally in the frame, with its brake lights illuminated.  \n- A yellow taxi cab is visible on the left side of the road, moving slowly or waiting at the intersection.  \n- A cyclist is seen riding across the street from right to left, passing through a crosswalk near the center of the frame.\n[450-480s] - A yellow taxi appears on the left side of the road, moving forward.  \n- Pedestrians cross the street at the crosswalk, some walking in groups, others alone.  \n- A white U-Haul truck is parked on the right side of the road, stationary.\n[480-510s] - A black SUV is driving straight ahead, positioned in the center of the road, moving forward past a crosswalk.  \n- A white sedan is visible ahead, turning right at the intersection, with traffic lights showing green.  \n- A pedestrian crossing is active, with people waiting to cross, and a \"ONE WAY\" sign is visible on the right side of the road.", "history_tokens": 981, "history_utf8_bytes": 3987, "recent_frame_times_s": [495.0135, 496.0145, 497.0155, 498.0165, 499.00081666666665, 500.0018166666667, 501.00281666666666, 502.0038166666667, 503.00481666666667, 504.00581666666665, 505.0068166666667, 506.00781666666666, 507.0088166666667, 508.00981666666667, 509.01081666666664, 510.0118166666667, 511.01281666666665, 512.0138166666667, 513.0148166666667, 514.0158166666666, 515.0001333333333, 516.0011333333333, 517.0021333333333, 518.0031333333334, 519.0041333333334, 520.0051333333333, 521.0061333333333, 522.0071333333333, 523.0081333333334, 524.0091333333334], "recent_frames_sha256": "2dbe01c1e90f8a94a75a512addaf7cd7e5bf24d3059ffa8ecbc33aed24fa827b", "num_recent_frames": 30, "tq": 716805.908076551, "t1": 716811.62598531, "ta": 716811.62598531, "te": 716811.664641625, "first_response_s": 5.717908758902922, "answer_total_s": 5.756565073970705, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 393, "content_group": "74f759d54da5371bdff7c6472e7992a7bf8fe2deb2182b2c2def8746ef04d91a", "question": {"question_id": "sample_393_a393_q0", "video_id": 393, "video_path": "./videos/sample_393_real.mp4", "annotation_index": 393, "question_index": 0, "question": "What kind of car is parked on the left side of the road now?", "options": ["A. Police car.", "B. Bus.", "C. Ambulance.", "D. Taxi."], "answer": "A", "time_stamp_s": 7, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_393_a393_q0", "video_id": 393, "time_stamp_s": 7, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "416fc41213242e108248b45213f80e89dbe1a7ce30a564dbca9ee69c86811b4b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.029, 1.0133166666666666, 2.0143166666666668, 3.0153166666666666, 4.0163166666666665, 5.000633333333333, 6.001633333333333], "recent_frames_sha256": "5992dc921001b5eeef31efc0d53be298a704f0ba40717e9f78d1dc78d01d2da7", "num_recent_frames": 7, "tq": 718894.053053864, "t1": 718906.048738458, "ta": 718906.048738458, "te": 718906.086142028, "first_response_s": 11.99568459391594, "answer_total_s": 12.033088163938373, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_393_a393_q0", "video_id": 393, "time_stamp_s": 7, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b9aa5c9e1845bdcff0243ef9319602bf362c86a7bb320cec6acaa0f52e0c4710", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.029, 1.0133166666666666, 2.0143166666666668, 3.0153166666666666, 4.0163166666666665, 5.000633333333333, 6.001633333333333], "recent_frames_sha256": "5992dc921001b5eeef31efc0d53be298a704f0ba40717e9f78d1dc78d01d2da7", "num_recent_frames": 7, "tq": 718977.857517518, "t1": 718984.15945485, "ta": 718984.15945485, "te": 718984.391868704, "first_response_s": 6.301937332027592, "answer_total_s": 6.534351186011918, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 393, "content_group": "74f759d54da5371bdff7c6472e7992a7bf8fe2deb2182b2c2def8746ef04d91a", "question": {"question_id": "sample_393_a394_q0", "video_id": 393, "video_path": "./videos/sample_393_real.mp4", "annotation_index": 394, "question_index": 0, "question": "What is the color of the traffic light now?", "options": ["A. Red.", "B. Green.", "C. Yellow.", "D. Orange."], "answer": "A", "time_stamp_s": 152, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [105, 110], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_393_a394_q0", "video_id": 393, "time_stamp_s": 152, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5c37131d982b94e07bf1386125787873078db41bf07c1de486566aacff7ced3c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [122.00085, 123.00185, 124.00285, 125.00385, 126.00485, 127.00585, 128.00685, 129.00785, 130.00885, 131.00985, 132.01085, 133.01185, 134.01285, 135.01385, 136.01485, 137.01585, 138.00016666666667, 139.00116666666668, 140.00216666666665, 141.00316666666666, 142.00416666666666, 143.00516666666667, 144.00616666666667, 145.00716666666668, 146.00816666666665, 147.00916666666666, 148.01016666666666, 149.01116666666667, 150.01216666666667, 151.01316666666668], "recent_frames_sha256": "5f0678aaf077cbc0866671a0cf6f8cafba20c633a0b10b2d47cf7031873d2d92", "num_recent_frames": 30, "tq": 718906.100649128, "t1": 718948.266261113, "ta": 718948.266261113, "te": 718948.46118, "first_response_s": 42.16561198502313, "answer_total_s": 42.36053087201435, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_393_a394_q0", "video_id": 393, "time_stamp_s": 152, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "50df7d8cac491a34ef51a75ac4d035febbee27995a96497663e8c016798f72db", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A white SUV with a visible license plate drives forward, followed by a black sedan, both navigating through traffic on a multi-lane urban street.  \n- A tall glass building with \"Sofitel\" signage stands prominently on the right, adjacent to a row of parked cars and storefronts.  \n- Pedestrians cross the street at a marked crosswalk, while a police car with blue and white markings passes by on the left side of the road.\n[30-60s] - A white SUV drives straight ahead, passing through a crosswalk under an elevated train track.  \n- A blue Tesla enters the frame from the left, moving forward on the same street.  \n- A pedestrian crosses the street at a marked crosswalk beneath the elevated structure.\n[60-90s] - A pedestrian crosses the street at a crosswalk, moving from right to left relative to the camera's perspective.  \n- A white van is parked on the right side of the road, adjacent to a storefront with a red sign.  \n- Traffic lights are visible overhead, showing red for the direction of oncoming traffic.\n[90-120s] - A black luxury sedan drives past the camera, passing a white SUV and a silver sedan on the left.  \n- A white sedan and a black SUV are seen driving in the opposite direction, with the black SUV turning right at an intersection.  \n- A large glass building with reflective windows is visible on the right side of the street, with a blue sign reading \"BANK OF AMERICA\" above it.\n[120-150s] - A black SUV is stopped at a crosswalk, facing the camera, with its brake lights illuminated.  \n- A white sports car is parked on the right side of the road, adjacent to the SUV.  \n- Pedestrians cross the street from left to right, moving across the crosswalk in front of the SUV.", "history_tokens": 404, "history_utf8_bytes": 1705, "recent_frame_times_s": [122.00085, 123.00185, 124.00285, 125.00385, 126.00485, 127.00585, 128.00685, 129.00785, 130.00885, 131.00985, 132.01085, 133.01185, 134.01285, 135.01385, 136.01485, 137.01585, 138.00016666666667, 139.00116666666668, 140.00216666666665, 141.00316666666666, 142.00416666666666, 143.00516666666667, 144.00616666666667, 145.00716666666668, 146.00816666666665, 147.00916666666666, 148.01016666666666, 149.01116666666667, 150.01216666666667, 151.01316666666668], "recent_frames_sha256": "5f0678aaf077cbc0866671a0cf6f8cafba20c633a0b10b2d47cf7031873d2d92", "num_recent_frames": 30, "tq": 719025.522654678, "t1": 719033.323021859, "ta": 719033.323021859, "te": 719033.671160443, "first_response_s": 7.800367181072943, "answer_total_s": 8.148505765013397, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 393, "content_group": "74f759d54da5371bdff7c6472e7992a7bf8fe2deb2182b2c2def8746ef04d91a", "question": {"question_id": "sample_393_a395_q0", "video_id": 393, "video_path": "./videos/sample_393_real.mp4", "annotation_index": 395, "question_index": 0, "question": "Right now, what type of vehicle is the black car on the left?", "options": ["A. Infiniti.", "B. Toyota.", "C. Honda.", "D. Lexus."], "answer": "A", "time_stamp_s": 214, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [210, 215], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_393_a395_q0", "video_id": 393, "time_stamp_s": 214, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "df3ac0d1c987773b536c22315b58420fef42669188d9357c0a66cd043294bdd8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [184.0128, 185.0138, 186.0148, 187.0158, 188.00011666666666, 189.00111666666666, 190.00211666666667, 191.00311666666667, 192.00411666666668, 193.00511666666668, 194.00611666666666, 195.00711666666666, 196.00811666666667, 197.00911666666667, 198.01011666666668, 199.01111666666668, 200.01211666666666, 201.01311666666666, 202.01411666666667, 203.01511666666667, 204.01611666666668, 205.00043333333332, 206.00143333333332, 207.00243333333333, 208.00343333333333, 209.00443333333334, 210.00543333333334, 211.00643333333332, 212.00743333333332, 213.00843333333333], "recent_frames_sha256": "d0793fcad5e11346a49aa50340ede74db7f6c15dd48c2e59bff98a5fb004c927", "num_recent_frames": 30, "tq": 718948.474794176, "t1": 718957.394729589, "ta": 718957.394729589, "te": 718957.433479589, "first_response_s": 8.919935412937775, "answer_total_s": 8.958685412886553, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_393_a395_q0", "video_id": 393, "time_stamp_s": 214, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "017e6b69cba475c783bd3e03ff7ab86303c17cd787a21ab8f99be82fe37bbac8", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A white SUV with a visible license plate drives forward, followed by a black sedan, both navigating through traffic on a multi-lane urban street.  \n- A tall glass building with \"Sofitel\" signage stands prominently on the right, adjacent to a row of parked cars and storefronts.  \n- Pedestrians cross the street at a marked crosswalk, while a police car with blue and white markings passes by on the left side of the road.\n[30-60s] - A white SUV drives straight ahead, passing through a crosswalk under an elevated train track.  \n- A blue Tesla enters the frame from the left, moving forward on the same street.  \n- A pedestrian crosses the street at a marked crosswalk beneath the elevated structure.\n[60-90s] - A pedestrian crosses the street at a crosswalk, moving from right to left relative to the camera's perspective.  \n- A white van is parked on the right side of the road, adjacent to a storefront with a red sign.  \n- Traffic lights are visible overhead, showing red for the direction of oncoming traffic.\n[90-120s] - A black luxury sedan drives past the camera, passing a white SUV and a silver sedan on the left.  \n- A white sedan and a black SUV are seen driving in the opposite direction, with the black SUV turning right at an intersection.  \n- A large glass building with reflective windows is visible on the right side of the street, with a blue sign reading \"BANK OF AMERICA\" above it.\n[120-150s] - A black SUV is stopped at a crosswalk, facing the camera, with its brake lights illuminated.  \n- A white sports car is parked on the right side of the road, adjacent to the SUV.  \n- Pedestrians cross the street from left to right, moving across the crosswalk in front of the SUV.\n[150-180s] - A black SUV with a visible license plate is stationary at a traffic light, positioned in the center of the frame.  \n- A white SUV is parked on the right side of the road, adjacent to the black SUV.  \n- Traffic lights and street signs are visible overhead, indicating an urban intersection with multiple lanes.\n[180-210s] - A cyclist in a white shirt rides a bicycle on the right side of the road, moving away from the camera.  \n- A black SUV with a visible license plate drives in the left lane, passing parked cars.  \n- A red car is parked on the right side of the street, adjacent to a sidewalk with pedestrians.", "history_tokens": 554, "history_utf8_bytes": 2333, "recent_frame_times_s": [184.0128, 185.0138, 186.0148, 187.0158, 188.00011666666666, 189.00111666666666, 190.00211666666667, 191.00311666666667, 192.00411666666668, 193.00511666666668, 194.00611666666666, 195.00711666666666, 196.00811666666667, 197.00911666666667, 198.01011666666668, 199.01111666666668, 200.01211666666666, 201.01311666666666, 202.01411666666667, 203.01511666666667, 204.01611666666668, 205.00043333333332, 206.00143333333332, 207.00243333333333, 208.00343333333333, 209.00443333333334, 210.00543333333334, 211.00643333333332, 212.00743333333332, 213.00843333333333], "recent_frames_sha256": "d0793fcad5e11346a49aa50340ede74db7f6c15dd48c2e59bff98a5fb004c927", "num_recent_frames": 30, "tq": 719044.95544651, "t1": 719045.821756909, "ta": 719045.821756909, "te": 719045.860518555, "first_response_s": 0.8663103990256786, "answer_total_s": 0.9050720450468361, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 393, "content_group": "74f759d54da5371bdff7c6472e7992a7bf8fe2deb2182b2c2def8746ef04d91a", "question": {"question_id": "sample_393_a396_q0", "video_id": 393, "video_path": "./videos/sample_393_real.mp4", "annotation_index": 396, "question_index": 0, "question": "What is the color of the traffic light now?", "options": ["A. Red.", "B. Green.", "C. Yellow.", "D. Orange."], "answer": "A", "time_stamp_s": 308, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [315, 320], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_393_a396_q0", "video_id": 393, "time_stamp_s": 308, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b3b6e401858eb35f2ae174ee2a8e0785e5099d092707e8c0eae8d6eda6d4fc53", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [278.0067, 279.0077, 280.0087, 281.0097, 282.0107, 283.0117, 284.0127, 285.0137, 286.0147, 287.0157, 288.0000166666667, 289.00101666666666, 290.0020166666667, 291.00301666666667, 292.00401666666664, 293.0050166666667, 294.00601666666665, 295.0070166666667, 296.00801666666666, 297.00901666666664, 298.0100166666667, 299.01101666666665, 300.0120166666667, 301.01301666666666, 302.0140166666667, 303.01501666666667, 304.01601666666664, 305.00033333333334, 306.0013333333333, 307.00233333333335], "recent_frames_sha256": "3f12283181aeec9a64a660d23fd717920aca5bae78d582487d97d85ba7beaf7a", "num_recent_frames": 30, "tq": 718957.455030234, "t1": 718969.152901651, "ta": 718969.152901651, "te": 718969.19263267, "first_response_s": 11.697871417040005, "answer_total_s": 11.737602436100133, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_393_a396_q0", "video_id": 393, "time_stamp_s": 308, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ffd07fa1d6cf83fdd72e1d30d4bef2a2cca46673ed3691fe95cf2ab3a7a994c1", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A white SUV with a visible license plate drives forward, followed by a black sedan, both navigating through traffic on a multi-lane urban street.  \n- A tall glass building with \"Sofitel\" signage stands prominently on the right, adjacent to a row of parked cars and storefronts.  \n- Pedestrians cross the street at a marked crosswalk, while a police car with blue and white markings passes by on the left side of the road.\n[30-60s] - A white SUV drives straight ahead, passing through a crosswalk under an elevated train track.  \n- A blue Tesla enters the frame from the left, moving forward on the same street.  \n- A pedestrian crosses the street at a marked crosswalk beneath the elevated structure.\n[60-90s] - A pedestrian crosses the street at a crosswalk, moving from right to left relative to the camera's perspective.  \n- A white van is parked on the right side of the road, adjacent to a storefront with a red sign.  \n- Traffic lights are visible overhead, showing red for the direction of oncoming traffic.\n[90-120s] - A black luxury sedan drives past the camera, passing a white SUV and a silver sedan on the left.  \n- A white sedan and a black SUV are seen driving in the opposite direction, with the black SUV turning right at an intersection.  \n- A large glass building with reflective windows is visible on the right side of the street, with a blue sign reading \"BANK OF AMERICA\" above it.\n[120-150s] - A black SUV is stopped at a crosswalk, facing the camera, with its brake lights illuminated.  \n- A white sports car is parked on the right side of the road, adjacent to the SUV.  \n- Pedestrians cross the street from left to right, moving across the crosswalk in front of the SUV.\n[150-180s] - A black SUV with a visible license plate is stationary at a traffic light, positioned in the center of the frame.  \n- A white SUV is parked on the right side of the road, adjacent to the black SUV.  \n- Traffic lights and street signs are visible overhead, indicating an urban intersection with multiple lanes.\n[180-210s] - A cyclist in a white shirt rides a bicycle on the right side of the road, moving away from the camera.  \n- A black SUV with a visible license plate drives in the left lane, passing parked cars.  \n- A red car is parked on the right side of the street, adjacent to a sidewalk with pedestrians.\n[210-240s] - A black SUV drives forward in the center lane, following traffic on a city street lined with parked cars.  \n- Yellow taxis and other vehicles move slowly or stop at intersections, indicating traffic congestion.  \n- Tall buildings with modern and classical architecture flank both sides of the street, with trees providing greenery along the sidewalks.\n[240-270s] - A black SUV is stationary in the center of the road, positioned between two lanes of traffic.  \n- A cyclist wearing a white shirt and dark pants rides past on the right side of the road, moving away from the camera.  \n- A white sedan is parked on the left side of the road, adjacent to a sidewalk lined with trees.\n[270-300s] - A white van is stopped at a crosswalk, facing the camera, with traffic lights above showing red.  \n- A black SUV turns right at the intersection, moving away from the camera’s perspective.  \n- A pedestrian crossing signal displays a red \"don't walk\" hand symbol, indicating no crossing is permitted.", "history_tokens": 783, "history_utf8_bytes": 3341, "recent_frame_times_s": [278.0067, 279.0077, 280.0087, 281.0097, 282.0107, 283.0117, 284.0127, 285.0137, 286.0147, 287.0157, 288.0000166666667, 289.00101666666666, 290.0020166666667, 291.00301666666667, 292.00401666666664, 293.0050166666667, 294.00601666666665, 295.0070166666667, 296.00801666666666, 297.00901666666664, 298.0100166666667, 299.01101666666665, 300.0120166666667, 301.01301666666666, 302.0140166666667, 303.01501666666667, 304.01601666666664, 305.00033333333334, 306.0013333333333, 307.00233333333335], "recent_frames_sha256": "3f12283181aeec9a64a660d23fd717920aca5bae78d582487d97d85ba7beaf7a", "num_recent_frames": 30, "tq": 719105.208018298, "t1": 719110.815182574, "ta": 719110.815182574, "te": 719110.852771925, "first_response_s": 5.6071642759488896, "answer_total_s": 5.644753627013415, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 393, "content_group": "74f759d54da5371bdff7c6472e7992a7bf8fe2deb2182b2c2def8746ef04d91a", "question": {"question_id": "sample_393_a397_q0", "video_id": 393, "video_path": "./videos/sample_393_real.mp4", "annotation_index": 397, "question_index": 0, "question": "Which street name is visible on the green sign right now?", "options": ["A. Broadway.", "B. Canal St.", "C. Centre St.", "D. East Broadway."], "answer": "C", "time_stamp_s": 420, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [420, 425], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_393_a397_q0", "video_id": 393, "time_stamp_s": 420, "ground_truth": "C", "raw_output": "B. Canal St.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "3679f7dbaa5f1fad2dc97e043b8e189e7359c3b2b2cabcfe9aa9cfae78c02664", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [390.00191666666666, 391.0029166666667, 392.00391666666667, 393.00491666666665, 394.0059166666667, 395.00691666666665, 396.0079166666667, 397.00891666666666, 398.00991666666664, 399.0109166666667, 400.01191666666665, 401.0129166666667, 402.01391666666666, 403.0149166666667, 404.01591666666667, 405.0002333333333, 406.00123333333335, 407.0022333333333, 408.00323333333336, 409.00423333333333, 410.0052333333333, 411.00623333333334, 412.0072333333333, 413.00823333333335, 414.0092333333333, 415.01023333333336, 416.01123333333334, 417.0122333333333, 418.01323333333335, 419.0142333333333], "recent_frames_sha256": "97080b0efff23299d47764526a23e62729df9a54e2ac6841bcc354d8dfc5a57f", "num_recent_frames": 30, "tq": 718969.21452883, "t1": 718977.639666417, "ta": 718977.639666417, "te": 718977.841230657, "first_response_s": 8.425137587008066, "answer_total_s": 8.626701826928183, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_393_a397_q0", "video_id": 393, "time_stamp_s": 420, "ground_truth": "C", "raw_output": "B. Canal St.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "9303d33fcc549e60efb92d9fd1f71fe1a140c5e2ddf2fc087a364ee59bee4a0b", "condition_order": ["recent", "notes"], "memory": "[30-60s] - A white SUV drives straight ahead, passing through a crosswalk under an elevated train track.  \n- A blue Tesla enters the frame from the left, moving forward on the same street.  \n- A pedestrian crosses the street at a marked crosswalk beneath the elevated structure.\n[60-90s] - A pedestrian crosses the street at a crosswalk, moving from right to left relative to the camera's perspective.  \n- A white van is parked on the right side of the road, adjacent to a storefront with a red sign.  \n- Traffic lights are visible overhead, showing red for the direction of oncoming traffic.\n[90-120s] - A black luxury sedan drives past the camera, passing a white SUV and a silver sedan on the left.  \n- A white sedan and a black SUV are seen driving in the opposite direction, with the black SUV turning right at an intersection.  \n- A large glass building with reflective windows is visible on the right side of the street, with a blue sign reading \"BANK OF AMERICA\" above it.\n[120-150s] - A black SUV is stopped at a crosswalk, facing the camera, with its brake lights illuminated.  \n- A white sports car is parked on the right side of the road, adjacent to the SUV.  \n- Pedestrians cross the street from left to right, moving across the crosswalk in front of the SUV.\n[150-180s] - A black SUV with a visible license plate is stationary at a traffic light, positioned in the center of the frame.  \n- A white SUV is parked on the right side of the road, adjacent to the black SUV.  \n- Traffic lights and street signs are visible overhead, indicating an urban intersection with multiple lanes.\n[180-210s] - A cyclist in a white shirt rides a bicycle on the right side of the road, moving away from the camera.  \n- A black SUV with a visible license plate drives in the left lane, passing parked cars.  \n- A red car is parked on the right side of the street, adjacent to a sidewalk with pedestrians.\n[210-240s] - A black SUV drives forward in the center lane, following traffic on a city street lined with parked cars.  \n- Yellow taxis and other vehicles move slowly or stop at intersections, indicating traffic congestion.  \n- Tall buildings with modern and classical architecture flank both sides of the street, with trees providing greenery along the sidewalks.\n[240-270s] - A black SUV is stationary in the center of the road, positioned between two lanes of traffic.  \n- A cyclist wearing a white shirt and dark pants rides past on the right side of the road, moving away from the camera.  \n- A white sedan is parked on the left side of the road, adjacent to a sidewalk lined with trees.\n[270-300s] - A white van is stopped at a crosswalk, facing the camera, with traffic lights above showing red.  \n- A black SUV turns right at the intersection, moving away from the camera’s perspective.  \n- A pedestrian crossing signal displays a red \"don't walk\" hand symbol, indicating no crossing is permitted.\n[300-330s] - A white van is stationary at the intersection, waiting for the traffic light to change.\n- Cars are parked along both sides of the street, with a line of vehicles extending into the distance.\n- Pedestrians are visible on the sidewalks, some standing near crosswalks and others walking along the street.\n[330-360s] - NYPD police vans and a white ambulance with \"EMERGENCY\" markings are parked or moving slowly on the street.  \n- A large white truck with \"CORREOS\" branding is visible, indicating postal service activity.  \n- The street is lined with parked cars and buildings, with a pedestrian overpass on the right side.\n[360-390s] - Black SUV drives forward, approaching a crosswalk with pedestrians crossing.\n- Pedestrians on both sides of the street are actively crossing the road.\n- Traffic lights change from red to green, allowing the SUV to proceed through the intersection.\n[390-420s] - A black SUV is stationary at the center of the crosswalk, facing the camera, with its brake lights illuminated.  \n- Pedestrians are actively crossing the street in both directions, some in groups, others individually, with varied attire and movement speeds.  \n- A white police vehicle passes on the right side of the frame, moving away from the camera, while other cars continue to navigate the intersection.", "history_tokens": 982, "history_utf8_bytes": 4226, "recent_frame_times_s": [390.00191666666666, 391.0029166666667, 392.00391666666667, 393.00491666666665, 394.0059166666667, 395.00691666666665, 396.0079166666667, 397.00891666666666, 398.00991666666664, 399.0109166666667, 400.01191666666665, 401.0129166666667, 402.01391666666666, 403.0149166666667, 404.01591666666667, 405.0002333333333, 406.00123333333335, 407.0022333333333, 408.00323333333336, 409.00423333333333, 410.0052333333333, 411.00623333333334, 412.0072333333333, 413.00823333333335, 414.0092333333333, 415.01023333333336, 416.01123333333334, 417.0122333333333, 418.01323333333335, 419.0142333333333], "recent_frames_sha256": "97080b0efff23299d47764526a23e62729df9a54e2ac6841bcc354d8dfc5a57f", "num_recent_frames": 30, "tq": 719147.218880306, "t1": 719155.09806883, "ta": 719155.09806883, "te": 719155.485258681, "first_response_s": 7.879188523977064, "answer_total_s": 8.266378375003114, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 395, "content_group": "37e241cac4e7c1584549c6471d19b9ef0f9f15a789d5689a93efde660b0f3b1f", "question": {"question_id": "sample_395_a2159_q0", "video_id": 395, "video_path": "./videos/sample_395_real.mp4", "annotation_index": 2159, "question_index": 0, "question": "What attributes describe the traffic light on the right side?", "options": ["A. It is red.", "B. It is green.", "C. It is yellow.", "D. It is blinking."], "answer": "B", "time_stamp_s": 7, "task_type": "Attribute Recognition", "required_ability": "episodic memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_395_a2159_q0", "video_id": 395, "time_stamp_s": 7, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ae17baa34962885718527ef6d38e037479aa439e600412b601adfa662351e4bc", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.02, 1.0043166666666667, 2.005316666666667, 3.0063166666666667, 4.007316666666667, 5.0083166666666665, 6.009316666666667], "recent_frames_sha256": "b58d5e3e479c11578203cf5838171d8adb15304eb58f8b7a78abcba17da4dc20", "num_recent_frames": 7, "tq": 716650.760850848, "t1": 716657.489963305, "ta": 716657.489963305, "te": 716657.527375213, "first_response_s": 6.72911245690193, "answer_total_s": 6.7665243649389595, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_395_a2159_q0", "video_id": 395, "time_stamp_s": 7, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5110790a795a182c7060b739d0dbcde9f1c3d6e32fb5a1e8dff1800309108312", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.02, 1.0043166666666667, 2.005316666666667, 3.0063166666666667, 4.007316666666667, 5.0083166666666665, 6.009316666666667], "recent_frames_sha256": "b58d5e3e479c11578203cf5838171d8adb15304eb58f8b7a78abcba17da4dc20", "num_recent_frames": 7, "tq": 716683.199422714, "t1": 716689.559747183, "ta": 716689.559747183, "te": 716689.749085339, "first_response_s": 6.360324469045736, "answer_total_s": 6.549662625067867, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 395, "content_group": "37e241cac4e7c1584549c6471d19b9ef0f9f15a789d5689a93efde660b0f3b1f", "question": {"question_id": "sample_395_a2160_q0", "video_id": 395, "video_path": "./videos/sample_395_real.mp4", "annotation_index": 2160, "question_index": 0, "question": "What building logo is visible in the background?", "options": ["A. MetLife.", "B. Citibank.", "C. Chase.", "D. Bank of America."], "answer": "A", "time_stamp_s": 123, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [119, 124], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_395_a2160_q0", "video_id": 395, "time_stamp_s": 123, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1ba436fada49d54492d30abdea3b10e7c5155eff9833c1c0ec1ae0f71e3bb909", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [93.0129, 94.0139, 95.0149, 96.0159, 97.00021666666666, 98.00121666666666, 99.00221666666667, 100.00321666666666, 101.00421666666666, 102.00521666666667, 103.00621666666666, 104.00721666666666, 105.00821666666667, 106.00921666666666, 107.01021666666666, 108.01121666666667, 109.01221666666666, 110.01321666666666, 111.01421666666667, 112.01521666666666, 113.01621666666666, 114.00053333333334, 115.00153333333333, 116.00253333333333, 117.00353333333334, 118.00453333333333, 119.00553333333333, 120.00653333333334, 121.00753333333333, 122.00853333333333], "recent_frames_sha256": "382578c3f3dfacded15604b47834569837f06f930546fa1dd96775cbcb204af8", "num_recent_frames": 30, "tq": 716657.56262678, "t1": 716664.873498208, "ta": 716664.873498208, "te": 716664.91250181, "first_response_s": 7.310871427995153, "answer_total_s": 7.349875029991381, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_395_a2160_q0", "video_id": 395, "time_stamp_s": 123, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8523196a96da6f1074c8469350eb12fe98e21f80b36ceed00813377395de808d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxis move along the street, with one prominently visible ahead of the camera's perspective.  \n- Pedestrians cross at intersections, including one walking across a crosswalk near a traffic light.  \n- Buildings line both sides of the street, featuring storefronts and signage, with some displaying \"BANK OF AMERICA\" and \"BANK OF AMERICA\" signs.\n[30-60s] - Yellow taxi in center lane moving forward, slightly ahead of other vehicles.\n- Pedestrian with pink umbrella crossing street on right side, near sidewalk.\n- White SUV parked on right, stationary, with American flag visible on building facade.\n[60-90s] - Yellow taxi in center lane moves forward, passing other vehicles on a multi-lane city street.  \n- Pedestrians cross at a crosswalk; traffic lights change from green to yellow.  \n- Buildings with scaffolding and American flags line the right side of the road.\n[90-120s] - A black SUV with license plate \"987654\" is driving ahead in the center lane, surrounded by other vehicles.\n- Yellow taxis and parked cars line both sides of the street, with trees and tall buildings in the background.\n- A cyclist passes on the left side of the road, moving in the same direction as the traffic.", "history_tokens": 283, "history_utf8_bytes": 1208, "recent_frame_times_s": [93.0129, 94.0139, 95.0149, 96.0159, 97.00021666666666, 98.00121666666666, 99.00221666666667, 100.00321666666666, 101.00421666666666, 102.00521666666667, 103.00621666666666, 104.00721666666666, 105.00821666666667, 106.00921666666666, 107.01021666666666, 108.01121666666667, 109.01221666666666, 110.01321666666666, 111.01421666666667, 112.01521666666666, 113.01621666666666, 114.00053333333334, 115.00153333333333, 116.00253333333333, 117.00353333333334, 118.00453333333333, 119.00553333333333, 120.00653333333334, 121.00753333333333, 122.00853333333333], "recent_frames_sha256": "382578c3f3dfacded15604b47834569837f06f930546fa1dd96775cbcb204af8", "num_recent_frames": 30, "tq": 716722.204539334, "t1": 716730.096313892, "ta": 716730.096313892, "te": 716730.143182197, "first_response_s": 7.891774557996541, "answer_total_s": 7.938642862951383, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 395, "content_group": "37e241cac4e7c1584549c6471d19b9ef0f9f15a789d5689a93efde660b0f3b1f", "question": {"question_id": "sample_395_a2161_q0", "video_id": 395, "video_path": "./videos/sample_395_real.mp4", "annotation_index": 2161, "question_index": 0, "question": "Right now, which traffic sign is visible near the traffic light?", "options": ["A. Stop sign.", "B. One way sign.", "C. Yield sign.", "D. Do not enter sign."], "answer": "B", "time_stamp_s": 238, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [238, 243], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_395_a2161_q0", "video_id": 395, "time_stamp_s": 238, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "03aa156ffa60afd55c5ebe38cd52b3a82dd8f527718635e7b92f1a5723eeb376", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [208.01111666666668, 209.01211666666666, 210.01311666666666, 211.01411666666667, 212.01511666666667, 213.01611666666668, 214.00043333333332, 215.00143333333332, 216.00243333333333, 217.00343333333333, 218.00443333333334, 219.00543333333334, 220.00643333333332, 221.00743333333332, 222.00843333333333, 223.00943333333333, 224.01043333333334, 225.01143333333334, 226.01243333333332, 227.01343333333332, 228.01443333333333, 229.01543333333333, 230.01643333333334, 231.00075, 232.00175, 233.00275, 234.00375, 235.00475, 236.00575, 237.00675], "recent_frames_sha256": "5882ffbb5e722edbb3f28725e4a5ca7b576200a24d4d1e0a58fd779e945cc97a", "num_recent_frames": 30, "tq": 716664.935616588, "t1": 716671.373061508, "ta": 716671.373061508, "te": 716671.523736242, "first_response_s": 6.437444920069538, "answer_total_s": 6.588119653984904, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_395_a2161_q0", "video_id": 395, "time_stamp_s": 238, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f2f809470ad8933dc6752bc1e93620d9b90fcae1f1ed766cc62814bc34cbf524", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxis move along the street, with one prominently visible ahead of the camera's perspective.  \n- Pedestrians cross at intersections, including one walking across a crosswalk near a traffic light.  \n- Buildings line both sides of the street, featuring storefronts and signage, with some displaying \"BANK OF AMERICA\" and \"BANK OF AMERICA\" signs.\n[30-60s] - Yellow taxi in center lane moving forward, slightly ahead of other vehicles.\n- Pedestrian with pink umbrella crossing street on right side, near sidewalk.\n- White SUV parked on right, stationary, with American flag visible on building facade.\n[60-90s] - Yellow taxi in center lane moves forward, passing other vehicles on a multi-lane city street.  \n- Pedestrians cross at a crosswalk; traffic lights change from green to yellow.  \n- Buildings with scaffolding and American flags line the right side of the road.\n[90-120s] - A black SUV with license plate \"987654\" is driving ahead in the center lane, surrounded by other vehicles.\n- Yellow taxis and parked cars line both sides of the street, with trees and tall buildings in the background.\n- A cyclist passes on the left side of the road, moving in the same direction as the traffic.\n[120-150s] - A black SUV with license plate \"123456\" is stationary in traffic, facing forward.  \n- A yellow taxi cab is visible ahead, also stopped, with its roof light illuminated.  \n- A red SUV is parked on the right side of the road, adjacent to a tree-lined sidewalk.\n[150-180s] - A black taxi cab is seen driving ahead in the center lane, moving forward through the city streets.\n- A white SUV is parked on the right side of the road, stationary near the curb.\n- A yellow taxi cab is visible on the right side of the road, moving slowly or stopped near the curb.\n[180-210s] - A black SUV passes left to right across the crosswalk at 188 seconds.\n- A cyclist in a blue shirt rides across the crosswalk from right to left at 194 seconds.\n- A gray SUV crosses the intersection from left to right at 206 seconds.", "history_tokens": 500, "history_utf8_bytes": 2022, "recent_frame_times_s": [208.01111666666668, 209.01211666666666, 210.01311666666666, 211.01411666666667, 212.01511666666667, 213.01611666666668, 214.00043333333332, 215.00143333333332, 216.00243333333333, 217.00343333333333, 218.00443333333334, 219.00543333333334, 220.00643333333332, 221.00743333333332, 222.00843333333333, 223.00943333333333, 224.01043333333334, 225.01143333333334, 226.01243333333332, 227.01343333333332, 228.01443333333333, 229.01543333333333, 230.01643333333334, 231.00075, 232.00175, 233.00275, 234.00375, 235.00475, 236.00575, 237.00675], "recent_frames_sha256": "5882ffbb5e722edbb3f28725e4a5ca7b576200a24d4d1e0a58fd779e945cc97a", "num_recent_frames": 30, "tq": 716751.497891607, "t1": 716753.536102002, "ta": 716753.536102002, "te": 716753.576706814, "first_response_s": 2.0382103950250894, "answer_total_s": 2.078815207001753, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 395, "content_group": "37e241cac4e7c1584549c6471d19b9ef0f9f15a789d5689a93efde660b0f3b1f", "question": {"question_id": "sample_395_a2162_q0", "video_id": 395, "video_path": "./videos/sample_395_real.mp4", "annotation_index": 2162, "question_index": 0, "question": "Right now, what is the color of the car directly in front of the camera?", "options": ["A. Blue.", "B. Red.", "C. Black.", "D. Grey."], "answer": "D", "time_stamp_s": 358, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [357, 362], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_395_a2162_q0", "video_id": 395, "time_stamp_s": 358, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3e030d1a2d3ddb19207dd4137708624f5b29db2acae36e317bf9a5eca00093a8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [328.01433333333335, 329.01533333333333, 330.0163333333333, 331.00065, 332.00165, 333.00265, 334.00365, 335.00465, 336.00565, 337.00665, 338.00765, 339.00865, 340.00965, 341.01065, 342.01165, 343.01265, 344.01365, 345.01465, 346.01565, 347.01665, 348.00096666666667, 349.00196666666665, 350.0029666666667, 351.00396666666666, 352.0049666666667, 353.00596666666667, 354.00696666666664, 355.0079666666667, 356.00896666666665, 357.0099666666667], "recent_frames_sha256": "7d5893e7803ab58aa4af69a9cd33f1e17e991bc82c6a6531406e1889d6a3dac9", "num_recent_frames": 30, "tq": 716671.550691885, "t1": 716676.690231861, "ta": 716676.690231861, "te": 716676.727547175, "first_response_s": 5.139539976022206, "answer_total_s": 5.176855290075764, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_395_a2162_q0", "video_id": 395, "time_stamp_s": 358, "ground_truth": "D", "raw_output": "C. Black.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "508e8c59921166827d17aa626a020b0ce77f6c8230427773fa306ec8be6550ec", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxis move along the street, with one prominently visible ahead of the camera's perspective.  \n- Pedestrians cross at intersections, including one walking across a crosswalk near a traffic light.  \n- Buildings line both sides of the street, featuring storefronts and signage, with some displaying \"BANK OF AMERICA\" and \"BANK OF AMERICA\" signs.\n[30-60s] - Yellow taxi in center lane moving forward, slightly ahead of other vehicles.\n- Pedestrian with pink umbrella crossing street on right side, near sidewalk.\n- White SUV parked on right, stationary, with American flag visible on building facade.\n[60-90s] - Yellow taxi in center lane moves forward, passing other vehicles on a multi-lane city street.  \n- Pedestrians cross at a crosswalk; traffic lights change from green to yellow.  \n- Buildings with scaffolding and American flags line the right side of the road.\n[90-120s] - A black SUV with license plate \"987654\" is driving ahead in the center lane, surrounded by other vehicles.\n- Yellow taxis and parked cars line both sides of the street, with trees and tall buildings in the background.\n- A cyclist passes on the left side of the road, moving in the same direction as the traffic.\n[120-150s] - A black SUV with license plate \"123456\" is stationary in traffic, facing forward.  \n- A yellow taxi cab is visible ahead, also stopped, with its roof light illuminated.  \n- A red SUV is parked on the right side of the road, adjacent to a tree-lined sidewalk.\n[150-180s] - A black taxi cab is seen driving ahead in the center lane, moving forward through the city streets.\n- A white SUV is parked on the right side of the road, stationary near the curb.\n- A yellow taxi cab is visible on the right side of the road, moving slowly or stopped near the curb.\n[180-210s] - A black SUV passes left to right across the crosswalk at 188 seconds.\n- A cyclist in a blue shirt rides across the crosswalk from right to left at 194 seconds.\n- A gray SUV crosses the intersection from left to right at 206 seconds.\n[210-240s] - A white SUV passes left to right across the foreground, followed by a black sedan and a silver sedan.\n- A black taxi with \"TAXI\" signage moves from right to left, then a blue convertible follows.\n- A pedestrian in a white shirt crosses the street from right to left, then a motorcyclist appears on the same side.\n[240-270s] - A black sedan drives forward, following a yellow taxi toward Grand Central Terminal's grand entrance.  \n- The terminal's ornate facade, featuring arched windows and a central emblem, dominates the view as the vehicles approach.  \n- A yellow \"ONLY\" lane marking and traffic signs are visible on the road, indicating restricted access or directional guidance.\n[270-300s] - Yellow taxi drives toward a grand building with ornate iron gates and a central statue.\n- Another yellow taxi enters from the left, merging with the first taxi as they approach the building's entrance.\n- The taxis proceed along a narrow street flanked by historic architecture and modern glass buildings.\n[300-330s] - Yellow taxi drives forward, entering a tunnel under a bridge, with its brake lights illuminated.  \n- Tunnel walls show concrete texture and yellow-and-black chevron markings; a traffic sign indicating a right turn is visible.  \n- The taxi exits the tunnel, emerging into daylight with tall buildings visible in the background.", "history_tokens": 802, "history_utf8_bytes": 3377, "recent_frame_times_s": [328.01433333333335, 329.01533333333333, 330.0163333333333, 331.00065, 332.00165, 333.00265, 334.00365, 335.00465, 336.00565, 337.00665, 338.00765, 339.00865, 340.00965, 341.01065, 342.01165, 343.01265, 344.01365, 345.01465, 346.01565, 347.01665, 348.00096666666667, 349.00196666666665, 350.0029666666667, 351.00396666666666, 352.0049666666667, 353.00596666666667, 354.00696666666664, 355.0079666666667, 356.00896666666665, 357.0099666666667], "recent_frames_sha256": "7d5893e7803ab58aa4af69a9cd33f1e17e991bc82c6a6531406e1889d6a3dac9", "num_recent_frames": 30, "tq": 716792.204833473, "t1": 716799.392176986, "ta": 716799.392176986, "te": 716799.667041773, "first_response_s": 7.187343513011001, "answer_total_s": 7.4622083000140265, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 395, "content_group": "37e241cac4e7c1584549c6471d19b9ef0f9f15a789d5689a93efde660b0f3b1f", "question": {"question_id": "sample_395_a2163_q0", "video_id": 395, "video_path": "./videos/sample_395_real.mp4", "annotation_index": 2163, "question_index": 0, "question": "Right now, what is the color of the taxi driving ahead?", "options": ["A. Red.", "B. Yellow.", "C. Blue.", "D. White."], "answer": "B", "time_stamp_s": 480, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [476, 481], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_395_a2163_q0", "video_id": 395, "time_stamp_s": 480, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "daf1ee14a04064fcf6ec2ba49f355ac794380d3ccfcea19ea07541eb40c16ad6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [450.00286666666665, 451.0038666666667, 452.00486666666666, 453.0058666666667, 454.00686666666667, 455.00786666666664, 456.0088666666667, 457.00986666666665, 458.0108666666667, 459.01186666666666, 460.01286666666664, 461.0138666666667, 462.01486666666665, 463.0158666666667, 464.0001833333333, 465.00118333333336, 466.00218333333333, 467.0031833333333, 468.00418333333334, 469.0051833333333, 470.00618333333335, 471.00718333333333, 472.0081833333333, 473.00918333333334, 474.0101833333333, 475.01118333333335, 476.0121833333333, 477.01318333333336, 478.01418333333334, 479.0151833333333], "recent_frames_sha256": "a9c912ab23598684e762a0e61c3f888fe07c8e63e4e1c10df7dd5037d7e28d80", "num_recent_frames": 30, "tq": 716676.757918281, "t1": 716682.96152052, "ta": 716682.96152052, "te": 716683.188232566, "first_response_s": 6.203602239023894, "answer_total_s": 6.43031428498216, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_395_a2163_q0", "video_id": 395, "time_stamp_s": 480, "ground_truth": "B", "raw_output": "B. Yellow.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "a711302c29c7ae25a7e01bae4977977a210af35930aba2d7f7b90a7979d9e851", "condition_order": ["recent", "notes"], "memory": "[90-120s] - A black SUV with license plate \"987654\" is driving ahead in the center lane, surrounded by other vehicles.\n- Yellow taxis and parked cars line both sides of the street, with trees and tall buildings in the background.\n- A cyclist passes on the left side of the road, moving in the same direction as the traffic.\n[120-150s] - A black SUV with license plate \"123456\" is stationary in traffic, facing forward.  \n- A yellow taxi cab is visible ahead, also stopped, with its roof light illuminated.  \n- A red SUV is parked on the right side of the road, adjacent to a tree-lined sidewalk.\n[150-180s] - A black taxi cab is seen driving ahead in the center lane, moving forward through the city streets.\n- A white SUV is parked on the right side of the road, stationary near the curb.\n- A yellow taxi cab is visible on the right side of the road, moving slowly or stopped near the curb.\n[180-210s] - A black SUV passes left to right across the crosswalk at 188 seconds.\n- A cyclist in a blue shirt rides across the crosswalk from right to left at 194 seconds.\n- A gray SUV crosses the intersection from left to right at 206 seconds.\n[210-240s] - A white SUV passes left to right across the foreground, followed by a black sedan and a silver sedan.\n- A black taxi with \"TAXI\" signage moves from right to left, then a blue convertible follows.\n- A pedestrian in a white shirt crosses the street from right to left, then a motorcyclist appears on the same side.\n[240-270s] - A black sedan drives forward, following a yellow taxi toward Grand Central Terminal's grand entrance.  \n- The terminal's ornate facade, featuring arched windows and a central emblem, dominates the view as the vehicles approach.  \n- A yellow \"ONLY\" lane marking and traffic signs are visible on the road, indicating restricted access or directional guidance.\n[270-300s] - Yellow taxi drives toward a grand building with ornate iron gates and a central statue.\n- Another yellow taxi enters from the left, merging with the first taxi as they approach the building's entrance.\n- The taxis proceed along a narrow street flanked by historic architecture and modern glass buildings.\n[300-330s] - Yellow taxi drives forward, entering a tunnel under a bridge, with its brake lights illuminated.  \n- Tunnel walls show concrete texture and yellow-and-black chevron markings; a traffic sign indicating a right turn is visible.  \n- The taxi exits the tunnel, emerging into daylight with tall buildings visible in the background.\n[330-360s] - A black sedan with red brake lights is stationary in a tunnel, positioned behind a yellow taxi.  \n- The tunnel’s archway reveals tall city buildings and traffic ahead, with a red light visible on the right.  \n- A yellow taxi is parked on the right side of the tunnel, adjacent to the black sedan.\n[360-390s] - A black sedan drives forward, following a line of yellow taxis on a multi-lane urban street.  \n- Construction barriers and orange cones line the left side of the road, indicating ongoing roadwork.  \n- Tall skyscrapers flank both sides of the street, with traffic lights and street signs visible overhead.\n[390-420s] - A black sedan drives forward, following a yellow taxi in the same lane, with both vehicles moving through a city street lined with tall buildings.  \n- Construction barriers and orange cones are visible on the right side of the road, indicating ongoing roadwork or construction.  \n- A \"No Left Turn\" sign is visible on the left side of the road, indicating traffic regulations for drivers.\n[420-450s] - A black sedan with a visible license plate is driving ahead of the camera vehicle on the right lane.\n- A yellow taxi is positioned in the left lane, slightly behind the black sedan.\n- Orange and white construction barriers line the right side of the road, indicating ongoing work.\n[450-480s] - Black sedan drives forward, passing yellow taxis on a multi-lane city street.  \n- Orange and white construction barriers line the right side of the road.  \n- Tall buildings flank both sides of the street, with trees and flags visible along the sidewalks.", "history_tokens": 963, "history_utf8_bytes": 4086, "recent_frame_times_s": [450.00286666666665, 451.0038666666667, 452.00486666666666, 453.0058666666667, 454.00686666666667, 455.00786666666664, 456.0088666666667, 457.00986666666665, 458.0108666666667, 459.01186666666666, 460.01286666666664, 461.0138666666667, 462.01486666666665, 463.0158666666667, 464.0001833333333, 465.00118333333336, 466.00218333333333, 467.0031833333333, 468.00418333333334, 469.0051833333333, 470.00618333333335, 471.00718333333333, 472.0081833333333, 473.00918333333334, 474.0101833333333, 475.01118333333335, 476.0121833333333, 477.01318333333336, 478.01418333333334, 479.0151833333333], "recent_frames_sha256": "a9c912ab23598684e762a0e61c3f888fe07c8e63e4e1c10df7dd5037d7e28d80", "num_recent_frames": 30, "tq": 716836.999883045, "t1": 716844.711355589, "ta": 716844.711355589, "te": 716845.030996997, "first_response_s": 7.711472544004209, "answer_total_s": 8.031113952049054, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 396, "content_group": "4fdd42d268137dc423167fb24226e7f4970bd5c6bc5c968c59457c54ced196a6", "question": {"question_id": "sample_396_a342_q0", "video_id": 396, "video_path": "./videos/sample_396_real.mp4", "annotation_index": 342, "question_index": 0, "question": "What is noticeable about the item emitting smoke on the right side of the street?", "options": ["A. It is completely covered in white paint.", "B. It has black stripes.", "C. It is orange and white with caution tapes around it.", "D. It is blue and white with warning signs around it."], "answer": "C", "time_stamp_s": 5, "task_type": "Attribute Recognition", "required_ability": "episodic memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_396_a342_q0", "video_id": 396, "time_stamp_s": 5, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6b56d4558344262f3cc4a55fa2ae36d0e30b174b21e248fec7d25570470d3533", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.027, 1.0113166666666666, 2.0123166666666665, 3.013316666666667, 4.014316666666667], "recent_frames_sha256": "70cb5bcf71e6062d5adc80c705181b4923a2a245ba603da8681453690afd55db", "num_recent_frames": 5, "tq": 716182.73672497, "t1": 716188.839733877, "ta": 716188.839733877, "te": 716188.877076798, "first_response_s": 6.103008906939067, "answer_total_s": 6.140351827954873, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_396_a342_q0", "video_id": 396, "time_stamp_s": 5, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0942fe0acd8ac15928353b54d7b1d7b262930181d61b2e2fa69cfff500abda91", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.027, 1.0113166666666666, 2.0123166666666665, 3.013316666666667, 4.014316666666667], "recent_frames_sha256": "70cb5bcf71e6062d5adc80c705181b4923a2a245ba603da8681453690afd55db", "num_recent_frames": 5, "tq": 716044.288978961, "t1": 716058.064578825, "ta": 716058.064578825, "te": 716058.106075859, "first_response_s": 13.775599864078686, "answer_total_s": 13.817096898099408, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 396, "content_group": "4fdd42d268137dc423167fb24226e7f4970bd5c6bc5c968c59457c54ced196a6", "question": {"question_id": "sample_396_a343_q0", "video_id": 396, "video_path": "./videos/sample_396_real.mp4", "annotation_index": 343, "question_index": 0, "question": "What type of vehicle is on the left-hand side traveling through the intersection right now?", "options": ["A. Sedan.", "B. SUV.", "C. Taxi.", "D. Motorcycle."], "answer": "B", "time_stamp_s": 95, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [95, 100], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_396_a343_q0", "video_id": 396, "time_stamp_s": 95, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e1e7cb66e5603a2cbbae0eb1c51f6fcbd64b191bf5c699d29cf1703699dd0a8c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [65.00858333333333, 66.00958333333334, 67.01058333333333, 68.01158333333333, 69.01258333333334, 70.01358333333333, 71.01458333333333, 72.01558333333334, 73.01658333333333, 74.0009, 75.0019, 76.0029, 77.0039, 78.0049, 79.0059, 80.0069, 81.0079, 82.0089, 83.0099, 84.0109, 85.0119, 86.0129, 87.0139, 88.0149, 89.0159, 90.00021666666666, 91.00121666666666, 92.00221666666667, 93.00321666666666, 94.00421666666666], "recent_frames_sha256": "48d60eb5b9134d916a52638b52eebf2e423835da43a24b82cf23bcd8369af6cf", "num_recent_frames": 30, "tq": 716188.901939938, "t1": 716199.707385751, "ta": 716199.707385751, "te": 716199.744447853, "first_response_s": 10.80544581299182, "answer_total_s": 10.842507914989255, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_396_a343_q0", "video_id": 396, "time_stamp_s": 95, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e6b40a35097318fcf5033d67351e8d4e5883f5a6e7fbc87f9d9e5ff6c70cec30", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Yellow taxis and other vehicles move along a wide urban street lined with tall buildings and trees.  \n- Pedestrians cross the street at a marked crosswalk, with some walking in groups and others individually.  \n- A traffic light changes, signaling vehicles to proceed while pedestrians continue crossing.\n[30-60s] - Pedestrians cross the street at a marked crosswalk, moving from left to right relative to the camera's perspective.\n- Yellow taxis and other vehicles, including a black SUV, navigate the intersection, with some stopping or yielding to pedestrians.\n- A green street sign reading \"BROADWAY\" is visible on the right side of the road, indicating the street name.\n[60-90s] - A yellow taxi is parked on the left side of the street near the curb.  \n- A black car is visible on the far left, partially in frame, moving slowly.  \n- The street is lined with tall buildings and trees, with a crosswalk in the foreground.", "history_tokens": 212, "history_utf8_bytes": 935, "recent_frame_times_s": [65.00858333333333, 66.00958333333334, 67.01058333333333, 68.01158333333333, 69.01258333333334, 70.01358333333333, 71.01458333333333, 72.01558333333334, 73.01658333333333, 74.0009, 75.0019, 76.0029, 77.0039, 78.0049, 79.0059, 80.0069, 81.0079, 82.0089, 83.0099, 84.0109, 85.0119, 86.0129, 87.0139, 88.0149, 89.0159, 90.00021666666666, 91.00121666666666, 92.00221666666667, 93.00321666666666, 94.00421666666666], "recent_frames_sha256": "48d60eb5b9134d916a52638b52eebf2e423835da43a24b82cf23bcd8369af6cf", "num_recent_frames": 30, "tq": 716081.747856143, "t1": 716082.905374302, "ta": 716082.905374302, "te": 716083.055402884, "first_response_s": 1.1575181588996202, "answer_total_s": 1.3075467409798875, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 396, "content_group": "4fdd42d268137dc423167fb24226e7f4970bd5c6bc5c968c59457c54ced196a6", "question": {"question_id": "sample_396_a344_q0", "video_id": 396, "video_path": "./videos/sample_396_real.mp4", "annotation_index": 344, "question_index": 0, "question": "What is the traffic light color right now?", "options": ["A. Red.", "B. Yellow.", "C. Green.", "D. Blinking."], "answer": "C", "time_stamp_s": 190, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [190, 195], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_396_a344_q0", "video_id": 396, "time_stamp_s": 190, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "363dff3774ad724879aa47fdae34e685308e05654cf272ac350d733a3afccf88", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [160.00348333333332, 161.00448333333333, 162.00548333333333, 163.00648333333334, 164.00748333333334, 165.00848333333334, 166.00948333333332, 167.01048333333333, 168.01148333333333, 169.01248333333334, 170.01348333333334, 171.01448333333335, 172.01548333333332, 173.01648333333333, 174.0008, 175.0018, 176.0028, 177.0038, 178.0048, 179.0058, 180.0068, 181.0078, 182.0088, 183.0098, 184.0108, 185.0118, 186.0128, 187.0138, 188.0148, 189.0158], "recent_frames_sha256": "2f84502756b7d41187233b4f44556bb1c668c3b4e335b42da91cb2decd879491", "num_recent_frames": 30, "tq": 716199.764548095, "t1": 716207.413469216, "ta": 716207.413469216, "te": 716207.450836338, "first_response_s": 7.648921121028252, "answer_total_s": 7.686288243043236, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_396_a344_q0", "video_id": 396, "time_stamp_s": 190, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0894e6f0dfc9eb4a0aa6085fadaa5b6d2eba744efac36a87e84fbcd2dedffcc0", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Yellow taxis and other vehicles move along a wide urban street lined with tall buildings and trees.  \n- Pedestrians cross the street at a marked crosswalk, with some walking in groups and others individually.  \n- A traffic light changes, signaling vehicles to proceed while pedestrians continue crossing.\n[30-60s] - Pedestrians cross the street at a marked crosswalk, moving from left to right relative to the camera's perspective.\n- Yellow taxis and other vehicles, including a black SUV, navigate the intersection, with some stopping or yielding to pedestrians.\n- A green street sign reading \"BROADWAY\" is visible on the right side of the road, indicating the street name.\n[60-90s] - A yellow taxi is parked on the left side of the street near the curb.  \n- A black car is visible on the far left, partially in frame, moving slowly.  \n- The street is lined with tall buildings and trees, with a crosswalk in the foreground.\n[90-120s] - A yellow taxi cab is seen driving ahead on the right side of the road, moving forward.\n- A red construction barrier is visible on the right side of the road, indicating road work or a temporary closure.\n- A pedestrian crossing is visible ahead, with a green traffic light indicating it is safe to cross.\n[120-150s] - Two cyclists cross the street from right to left, passing a crosswalk.\n- A pedestrian in a white shirt walks across the crosswalk from left to right.\n- A person in a red shirt walks on the sidewalk to the right, near parked cars.\n[150-180s] - A black sedan passes left to right across the street, followed by a yellow taxi.\n- Traffic lights at the intersection show green, allowing vehicles to proceed.\n- A white car is visible in the distance, moving away from the camera along the road.", "history_tokens": 407, "history_utf8_bytes": 1753, "recent_frame_times_s": [160.00348333333332, 161.00448333333333, 162.00548333333333, 163.00648333333334, 164.00748333333334, 165.00848333333334, 166.00948333333332, 167.01048333333333, 168.01148333333333, 169.01248333333334, 170.01348333333334, 171.01448333333335, 172.01548333333332, 173.01648333333333, 174.0008, 175.0018, 176.0028, 177.0038, 178.0048, 179.0058, 180.0068, 181.0078, 182.0088, 183.0098, 184.0108, 185.0118, 186.0128, 187.0138, 188.0148, 189.0158], "recent_frames_sha256": "2f84502756b7d41187233b4f44556bb1c668c3b4e335b42da91cb2decd879491", "num_recent_frames": 30, "tq": 716114.343050586, "t1": 716119.976990648, "ta": 716119.976990648, "te": 716120.015121785, "first_response_s": 5.633940062019974, "answer_total_s": 5.672071199049242, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 396, "content_group": "4fdd42d268137dc423167fb24226e7f4970bd5c6bc5c968c59457c54ced196a6", "question": {"question_id": "sample_396_a345_q0", "video_id": 396, "video_path": "./videos/sample_396_real.mp4", "annotation_index": 345, "question_index": 0, "question": "What is the traffic light color right now?", "options": ["A. Red.", "B. Yellow.", "C. Green.", "D. Blinking."], "answer": "A", "time_stamp_s": 276, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [285, 290], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_396_a345_q0", "video_id": 396, "time_stamp_s": 276, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4862f9204205993c30184c94f73f72a635b945c5593fc818aeb3e5342db517df", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [246.00606666666667, 247.00706666666667, 248.00806666666668, 249.00906666666666, 250.01006666666666, 251.01106666666666, 252.01206666666667, 253.01306666666667, 254.01406666666668, 255.01506666666666, 256.0160666666667, 257.00038333333333, 258.0013833333333, 259.00238333333334, 260.0033833333333, 261.00438333333335, 262.0053833333333, 263.00638333333336, 264.00738333333334, 265.0083833333333, 266.00938333333335, 267.0103833333333, 268.01138333333336, 269.01238333333333, 270.0133833333333, 271.01438333333334, 272.0153833333333, 273.01638333333335, 274.0007, 275.0017], "recent_frames_sha256": "cf3b63a4ddbab0147659da4fc87930639d9d30c5009d2fca3673e97fb0c4bea0", "num_recent_frames": 30, "tq": 716207.470986529, "t1": 716214.893809049, "ta": 716214.893809049, "te": 716214.931446692, "first_response_s": 7.422822520020418, "answer_total_s": 7.460460162954405, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_396_a345_q0", "video_id": 396, "time_stamp_s": 276, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "01517f02b71149c5083ba4370a4190e3d81b9f7a975ea306ba8ad5a04992625e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Yellow taxis and other vehicles move along a wide urban street lined with tall buildings and trees.  \n- Pedestrians cross the street at a marked crosswalk, with some walking in groups and others individually.  \n- A traffic light changes, signaling vehicles to proceed while pedestrians continue crossing.\n[30-60s] - Pedestrians cross the street at a marked crosswalk, moving from left to right relative to the camera's perspective.\n- Yellow taxis and other vehicles, including a black SUV, navigate the intersection, with some stopping or yielding to pedestrians.\n- A green street sign reading \"BROADWAY\" is visible on the right side of the road, indicating the street name.\n[60-90s] - A yellow taxi is parked on the left side of the street near the curb.  \n- A black car is visible on the far left, partially in frame, moving slowly.  \n- The street is lined with tall buildings and trees, with a crosswalk in the foreground.\n[90-120s] - A yellow taxi cab is seen driving ahead on the right side of the road, moving forward.\n- A red construction barrier is visible on the right side of the road, indicating road work or a temporary closure.\n- A pedestrian crossing is visible ahead, with a green traffic light indicating it is safe to cross.\n[120-150s] - Two cyclists cross the street from right to left, passing a crosswalk.\n- A pedestrian in a white shirt walks across the crosswalk from left to right.\n- A person in a red shirt walks on the sidewalk to the right, near parked cars.\n[150-180s] - A black sedan passes left to right across the street, followed by a yellow taxi.\n- Traffic lights at the intersection show green, allowing vehicles to proceed.\n- A white car is visible in the distance, moving away from the camera along the road.\n[180-210s] - A yellow taxi cab is visible in the distance, moving down the street.  \n- A pedestrian crosses the street at a crosswalk, moving from left to right.  \n- A white SUV is parked on the right side of the road, near a sidewalk.\n[210-240s] - A yellow taxi is visible in the distance, moving forward along the street.  \n- A cyclist crosses the street from right to left at a marked crosswalk.  \n- Orange construction barriers appear on the right side of the road, indicating road work.\n[240-270s] - A black motorcycle crosses the street from left to right, passing through the intersection.\n- A silver SUV follows the motorcycle, also crossing the street in the same direction.\n- A yellow taxi is parked on the left side of the road, stationary near the curb.", "history_tokens": 594, "history_utf8_bytes": 2519, "recent_frame_times_s": [246.00606666666667, 247.00706666666667, 248.00806666666668, 249.00906666666666, 250.01006666666666, 251.01106666666666, 252.01206666666667, 253.01306666666667, 254.01406666666668, 255.01506666666666, 256.0160666666667, 257.00038333333333, 258.0013833333333, 259.00238333333334, 260.0033833333333, 261.00438333333335, 262.0053833333333, 263.00638333333336, 264.00738333333334, 265.0083833333333, 266.00938333333335, 267.0103833333333, 268.01138333333336, 269.01238333333333, 270.0133833333333, 271.01438333333334, 272.0153833333333, 273.01638333333335, 274.0007, 275.0017], "recent_frames_sha256": "cf3b63a4ddbab0147659da4fc87930639d9d30c5009d2fca3673e97fb0c4bea0", "num_recent_frames": 30, "tq": 716154.195027278, "t1": 716161.972618466, "ta": 716161.972618466, "te": 716162.011461301, "first_response_s": 7.777591187972575, "answer_total_s": 7.816434022970498, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 396, "content_group": "4fdd42d268137dc423167fb24226e7f4970bd5c6bc5c968c59457c54ced196a6", "question": {"question_id": "sample_396_a346_q0", "video_id": 396, "video_path": "./videos/sample_396_real.mp4", "annotation_index": 346, "question_index": 0, "question": "What is the man wearing on his head right now?", "options": ["A. A red cap.", "B. A white hat.", "C. A blue cap.", "D. A black hat."], "answer": "C", "time_stamp_s": 382, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [380, 385], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_396_a346_q0", "video_id": 396, "time_stamp_s": 382, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "89640fe14ebe913c826e08a1e492b84886ea3f33f9dc4417304a53be349b8295", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [352.0119666666667, 353.01296666666667, 354.01396666666665, 355.0149666666667, 356.01596666666666, 357.00028333333336, 358.00128333333333, 359.0022833333333, 360.00328333333334, 361.0042833333333, 362.00528333333335, 363.00628333333333, 364.0072833333333, 365.00828333333334, 366.0092833333333, 367.01028333333335, 368.0112833333333, 369.01228333333336, 370.01328333333333, 371.0142833333333, 372.01528333333334, 373.0162833333333, 374.0006, 375.0016, 376.0026, 377.0036, 378.0046, 379.0056, 380.0066, 381.0076], "recent_frames_sha256": "12d87febf3d9abc8784dba3d44fc90daecb065e46f9a237dbd0a49d7341d4324", "num_recent_frames": 30, "tq": 716214.961143409, "t1": 716221.989902681, "ta": 716221.989902681, "te": 716222.026801351, "first_response_s": 7.028759271954186, "answer_total_s": 7.065657941973768, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_396_a346_q0", "video_id": 396, "time_stamp_s": 382, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "523d5b5d0f402daafbf18a56ce8452ec8d54a0323c48cf1b40ac965ce4a215d4", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Yellow taxis and other vehicles move along a wide urban street lined with tall buildings and trees.  \n- Pedestrians cross the street at a marked crosswalk, with some walking in groups and others individually.  \n- A traffic light changes, signaling vehicles to proceed while pedestrians continue crossing.\n[30-60s] - Pedestrians cross the street at a marked crosswalk, moving from left to right relative to the camera's perspective.\n- Yellow taxis and other vehicles, including a black SUV, navigate the intersection, with some stopping or yielding to pedestrians.\n- A green street sign reading \"BROADWAY\" is visible on the right side of the road, indicating the street name.\n[60-90s] - A yellow taxi is parked on the left side of the street near the curb.  \n- A black car is visible on the far left, partially in frame, moving slowly.  \n- The street is lined with tall buildings and trees, with a crosswalk in the foreground.\n[90-120s] - A yellow taxi cab is seen driving ahead on the right side of the road, moving forward.\n- A red construction barrier is visible on the right side of the road, indicating road work or a temporary closure.\n- A pedestrian crossing is visible ahead, with a green traffic light indicating it is safe to cross.\n[120-150s] - Two cyclists cross the street from right to left, passing a crosswalk.\n- A pedestrian in a white shirt walks across the crosswalk from left to right.\n- A person in a red shirt walks on the sidewalk to the right, near parked cars.\n[150-180s] - A black sedan passes left to right across the street, followed by a yellow taxi.\n- Traffic lights at the intersection show green, allowing vehicles to proceed.\n- A white car is visible in the distance, moving away from the camera along the road.\n[180-210s] - A yellow taxi cab is visible in the distance, moving down the street.  \n- A pedestrian crosses the street at a crosswalk, moving from left to right.  \n- A white SUV is parked on the right side of the road, near a sidewalk.\n[210-240s] - A yellow taxi is visible in the distance, moving forward along the street.  \n- A cyclist crosses the street from right to left at a marked crosswalk.  \n- Orange construction barriers appear on the right side of the road, indicating road work.\n[240-270s] - A black motorcycle crosses the street from left to right, passing through the intersection.\n- A silver SUV follows the motorcycle, also crossing the street in the same direction.\n- A yellow taxi is parked on the left side of the road, stationary near the curb.\n[270-300s] - A black sedan crosses the street from left to right, passing a yellow taxi parked on the left side.  \n- A silver sedan follows the black sedan, also crossing the street, while a white SUV waits at the intersection.  \n- A motorcycle with two riders enters the frame from the right, moving along the road toward the camera.\n[300-330s] - Yellow taxis move forward in traffic, maintaining lane positions on a multi-lane street.  \n- A silver SUV is parked on the right side of the road, adjacent to a sidewalk lined with trees.  \n- A pedestrian crossing signal displays a green light, indicating it is safe to cross.\n[330-360s] - Yellow taxi ahead turns right at intersection with green traffic light.  \n- Pedestrian crosses street at crosswalk, then walks away from camera.  \n- Left side of road has parked cars and trees lining the sidewalk.", "history_tokens": 796, "history_utf8_bytes": 3371, "recent_frame_times_s": [352.0119666666667, 353.01296666666667, 354.01396666666665, 355.0149666666667, 356.01596666666666, 357.00028333333336, 358.00128333333333, 359.0022833333333, 360.00328333333334, 361.0042833333333, 362.00528333333335, 363.00628333333333, 364.0072833333333, 365.00828333333334, 366.0092833333333, 367.01028333333335, 368.0112833333333, 369.01228333333336, 370.01328333333333, 371.0142833333333, 372.01528333333334, 373.0162833333333, 374.0006, 375.0016, 376.0026, 377.0036, 378.0046, 379.0056, 380.0066, 381.0076], "recent_frames_sha256": "12d87febf3d9abc8784dba3d44fc90daecb065e46f9a237dbd0a49d7341d4324", "num_recent_frames": 30, "tq": 716181.060504981, "t1": 716182.548078556, "ta": 716182.548078556, "te": 716182.698342072, "first_response_s": 1.487573574995622, "answer_total_s": 1.6378370909951627, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 397, "content_group": "4a82f7f6d4c422f4f3ad4b675b07c7910b667f7e89542a15846b37dbff3583d7", "question": {"question_id": "sample_397_a1113_q0", "video_id": 397, "video_path": "./videos/sample_397_real.mp4", "annotation_index": 1113, "question_index": 0, "question": "What is the shape of the large structure on the left side of the road right now?", "options": ["A. Cube.", "B. Pyramid.", "C. Sphere.", "D. Cone."], "answer": "C", "time_stamp_s": 4, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_397_a1113_q0", "video_id": 397, "time_stamp_s": 4, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bafb03ecaab509fbb8cea95bdc01deab2d2e554c3a12de51d1bb133224e98beb", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003], "recent_frames_sha256": "e1c7b17945769f947b8100c5f95209ed7c24fd8e9d948cbc05d8b582c9b13a02", "num_recent_frames": 4, "tq": 715691.902095645, "t1": 715697.784182685, "ta": 715697.784182685, "te": 715697.968296485, "first_response_s": 5.882087039994076, "answer_total_s": 6.06620084005408, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_397_a1113_q0", "video_id": 397, "time_stamp_s": 4, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7408104ab7f2202dbb75c688dedd4afa30bf85a10b1ebadfda029736f1b83f46", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003], "recent_frames_sha256": "e1c7b17945769f947b8100c5f95209ed7c24fd8e9d948cbc05d8b582c9b13a02", "num_recent_frames": 4, "tq": 715491.948979471, "t1": 715503.109437605, "ta": 715503.109437605, "te": 715503.521781827, "first_response_s": 11.16045813402161, "answer_total_s": 11.572802355978638, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 397, "content_group": "4a82f7f6d4c422f4f3ad4b675b07c7910b667f7e89542a15846b37dbff3583d7", "question": {"question_id": "sample_397_a1114_q0", "video_id": 397, "video_path": "./videos/sample_397_real.mp4", "annotation_index": 1114, "question_index": 0, "question": "What color are the traffic lights right now?", "options": ["A. Red.", "B. Yellow.", "C. Green.", "D. Blue."], "answer": "C", "time_stamp_s": 136, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [132, 137], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_397_a1114_q0", "video_id": 397, "time_stamp_s": 136, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "575fadd3840c337b4dc961f8678191da73ea29834eac826dc373938e504e3f98", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333], "recent_frames_sha256": "c2b1d71a786633771db5359a62361a1f8559f63e4ab1fdbc14112623f5f5b1b0", "num_recent_frames": 30, "tq": 715697.994069433, "t1": 715704.417071724, "ta": 715704.417071724, "te": 715704.564879631, "first_response_s": 6.423002291005105, "answer_total_s": 6.570810198085383, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_397_a1114_q0", "video_id": 397, "time_stamp_s": 136, "ground_truth": "C", "raw_output": "A. Red.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "0c26f4c069d79882a1e4d654fff71ecbf4305ed06d32fb1e340332da96d52658", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rain-slicked streets reflect neon signs and vehicle lights as the camera moves through Manhattan’s urban landscape.  \n- Yellow taxis and other cars navigate wet roads, with traffic lights and street signs visible at intersections.  \n- Large digital billboards display advertisements, including one for “The Cat in the Hat,” while pedestrians cross sidewalks under overcast skies.\n[30-60s] - Yellow taxis navigate wet streets, reflecting city lights; one passes a UPS truck.  \n- Pedestrians cross at marked crosswalks under overcast skies, with bare trees lining sidewalks.  \n- Vehicles, including SUVs and buses, move slowly through traffic, with traffic lights controlling flow.\n[60-90s] - Yellow taxis move forward on wet street, reflecting red brake lights.  \n- Pedestrian crosswalks are visible with white stripes, and traffic lights show red.  \n- Tall buildings line both sides of the street, with some scaffolding on the right.\n[90-120s] - Yellow taxi crosses the wet street at the intersection, moving from left to right.\n- Pedestrians are visible waiting at the crosswalk, some stepping onto the street as the taxi passes.\n- Traffic lights at the intersection are red, indicating vehicles must stop, with a few cars stationary on the road.", "history_tokens": 278, "history_utf8_bytes": 1263, "recent_frame_times_s": [106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333], "recent_frames_sha256": "c2b1d71a786633771db5359a62361a1f8559f63e4ab1fdbc14112623f5f5b1b0", "num_recent_frames": 30, "tq": 715534.160546141, "t1": 715540.402417391, "ta": 715540.402417391, "te": 715540.55534945, "first_response_s": 6.241871249978431, "answer_total_s": 6.394803308998235, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 397, "content_group": "4a82f7f6d4c422f4f3ad4b675b07c7910b667f7e89542a15846b37dbff3583d7", "question": {"question_id": "sample_397_a1115_q0", "video_id": 397, "video_path": "./videos/sample_397_real.mp4", "annotation_index": 1115, "question_index": 0, "question": "What is the weather like right now?", "options": ["A. Sunny.", "B. Snowy.", "C. Foggy and Rainy.", "D. Clear."], "answer": "C", "time_stamp_s": 267, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [264, 269], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_397_a1115_q0", "video_id": 397, "time_stamp_s": 267, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a6cc6da4baa8d085ec2ebe5ec8c52eef65a08d4d67dc63e401b6e44e33c865d3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575], "recent_frames_sha256": "6c0a0695c9a33787a1870116601cf95eb845505d77dd93e1412ba35fb7fb66ac", "num_recent_frames": 30, "tq": 715704.575447102, "t1": 715718.320813692, "ta": 715718.320813692, "te": 715718.504858677, "first_response_s": 13.745366589981131, "answer_total_s": 13.929411575081758, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_397_a1115_q0", "video_id": 397, "time_stamp_s": 267, "ground_truth": "C", "raw_output": "C. Foggy and Rainy.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "167c1ab93fb1ba914e3ee9dbc539d55131927cface499176cf0642615282db82", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rain-slicked streets reflect neon signs and vehicle lights as the camera moves through Manhattan’s urban landscape.  \n- Yellow taxis and other cars navigate wet roads, with traffic lights and street signs visible at intersections.  \n- Large digital billboards display advertisements, including one for “The Cat in the Hat,” while pedestrians cross sidewalks under overcast skies.\n[30-60s] - Yellow taxis navigate wet streets, reflecting city lights; one passes a UPS truck.  \n- Pedestrians cross at marked crosswalks under overcast skies, with bare trees lining sidewalks.  \n- Vehicles, including SUVs and buses, move slowly through traffic, with traffic lights controlling flow.\n[60-90s] - Yellow taxis move forward on wet street, reflecting red brake lights.  \n- Pedestrian crosswalks are visible with white stripes, and traffic lights show red.  \n- Tall buildings line both sides of the street, with some scaffolding on the right.\n[90-120s] - Yellow taxi crosses the wet street at the intersection, moving from left to right.\n- Pedestrians are visible waiting at the crosswalk, some stepping onto the street as the taxi passes.\n- Traffic lights at the intersection are red, indicating vehicles must stop, with a few cars stationary on the road.\n[120-150s] - A black SUV drives rightward across the wet street, passing a crosswalk with white stripes.\n- A yellow bus moves forward on the road, positioned ahead of the SUV.\n- A pedestrian in an orange jacket crosses the street from left to right, stepping over the crosswalk.\n[150-180s] - A white sedan drives forward on the wet road, its brake lights glowing red as it approaches a stop sign.  \n- A pedestrian in a yellow jacket crosses the street at a crosswalk, moving from right to left relative to the camera.  \n- Traffic lights at the intersection show green for the direction of travel, allowing vehicles to proceed.\n[180-210s] - A yellow taxi cab moves leftward across the wet street, passing a white sedan.  \n- A pedestrian with an umbrella crosses the street from right to left, stepping over the crosswalk.  \n- A black SUV drives rightward, approaching the intersection while traffic lights remain red.\n[210-240s] - Traffic lights change from red to green, allowing vehicles to proceed.\n- Yellow taxis and other cars move along the wet street, reflecting light from their headlights.\n- Pedestrians are visible on sidewalks, some crossing the street as traffic flows.", "history_tokens": 550, "history_utf8_bytes": 2444, "recent_frame_times_s": [237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575], "recent_frames_sha256": "6c0a0695c9a33787a1870116601cf95eb845505d77dd93e1412ba35fb7fb66ac", "num_recent_frames": 30, "tq": 715568.824530412, "t1": 715570.027434431, "ta": 715570.027434431, "te": 715570.329131914, "first_response_s": 1.2029040190391243, "answer_total_s": 1.5046015019761398, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 397, "content_group": "4a82f7f6d4c422f4f3ad4b675b07c7910b667f7e89542a15846b37dbff3583d7", "question": {"question_id": "sample_397_a1116_q0", "video_id": 397, "video_path": "./videos/sample_397_real.mp4", "annotation_index": 1116, "question_index": 0, "question": "What type of vehicle is the yellow car right now?", "options": ["A. Taxi.", "B. School bus.", "C. Firetruck.", "D. Police car."], "answer": "A", "time_stamp_s": 398, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [396, 401], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_397_a1116_q0", "video_id": 397, "time_stamp_s": 398, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6426c391fcf382d0eb4175b3d4cb7325ea70b3e9f0bc7447b50700f89d056c82", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.00028333333336, 385.00128333333333, 386.0022833333333, 387.00328333333334, 388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333], "recent_frames_sha256": "8fca7efc5eff203aa992df45209358269d3f18e0e9d8c2992daa87d9f1d3ed00", "num_recent_frames": 30, "tq": 715718.516043588, "t1": 715730.901248203, "ta": 715730.901248203, "te": 715731.08572732, "first_response_s": 12.385204614955, "answer_total_s": 12.569683731999248, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_397_a1116_q0", "video_id": 397, "time_stamp_s": 398, "ground_truth": "A", "raw_output": "A. Taxi.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "7d3084799b66bb241a1ec9dbf5621123b3e410875679df647f3c082b5abad96a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rain-slicked streets reflect neon signs and vehicle lights as the camera moves through Manhattan’s urban landscape.  \n- Yellow taxis and other cars navigate wet roads, with traffic lights and street signs visible at intersections.  \n- Large digital billboards display advertisements, including one for “The Cat in the Hat,” while pedestrians cross sidewalks under overcast skies.\n[30-60s] - Yellow taxis navigate wet streets, reflecting city lights; one passes a UPS truck.  \n- Pedestrians cross at marked crosswalks under overcast skies, with bare trees lining sidewalks.  \n- Vehicles, including SUVs and buses, move slowly through traffic, with traffic lights controlling flow.\n[60-90s] - Yellow taxis move forward on wet street, reflecting red brake lights.  \n- Pedestrian crosswalks are visible with white stripes, and traffic lights show red.  \n- Tall buildings line both sides of the street, with some scaffolding on the right.\n[90-120s] - Yellow taxi crosses the wet street at the intersection, moving from left to right.\n- Pedestrians are visible waiting at the crosswalk, some stepping onto the street as the taxi passes.\n- Traffic lights at the intersection are red, indicating vehicles must stop, with a few cars stationary on the road.\n[120-150s] - A black SUV drives rightward across the wet street, passing a crosswalk with white stripes.\n- A yellow bus moves forward on the road, positioned ahead of the SUV.\n- A pedestrian in an orange jacket crosses the street from left to right, stepping over the crosswalk.\n[150-180s] - A white sedan drives forward on the wet road, its brake lights glowing red as it approaches a stop sign.  \n- A pedestrian in a yellow jacket crosses the street at a crosswalk, moving from right to left relative to the camera.  \n- Traffic lights at the intersection show green for the direction of travel, allowing vehicles to proceed.\n[180-210s] - A yellow taxi cab moves leftward across the wet street, passing a white sedan.  \n- A pedestrian with an umbrella crosses the street from right to left, stepping over the crosswalk.  \n- A black SUV drives rightward, approaching the intersection while traffic lights remain red.\n[210-240s] - Traffic lights change from red to green, allowing vehicles to proceed.\n- Yellow taxis and other cars move along the wet street, reflecting light from their headlights.\n- Pedestrians are visible on sidewalks, some crossing the street as traffic flows.\n[240-270s] - Yellow taxi cab moves forward on wet street, reflecting red taillights.  \n- Pedestrian crosswalk with white stripes is visible ahead, with traffic lights showing green.  \n- Buildings line both sides of the street, with some displaying banners and flags.\n[270-300s] - Yellow taxis and other vehicles move slowly on wet city streets under overcast skies.  \n- Tall buildings line both sides of the road, with some displaying signage and bare trees.  \n- Traffic lights and street signs are visible, indicating an urban intersection with moderate traffic flow.\n[300-330s] - Red car in left lane moves forward, slightly ahead of yellow taxis.  \n- Yellow taxis in center lanes maintain steady pace, with rear lights illuminated.  \n- Traffic lights at intersection show green, allowing vehicles to proceed.\n[330-360s] - Yellow taxi cab moves forward on wet road, its brake lights glowing red.  \n- Black sedan follows closely behind, also navigating the rain-slicked street.  \n- Traffic lights at intersection show green, allowing vehicles to proceed through crosswalk.\n[360-390s] - Rain-slicked street reflects red taillights of multiple cars, including yellow taxis, moving slowly in traffic.  \n- Tall buildings line both sides of the street, with bare trees and parked cars visible along sidewalks.  \n- A white SUV and a white sedan pass by on the right, while a yellow taxi moves forward in the center lane.", "history_tokens": 874, "history_utf8_bytes": 3860, "recent_frame_times_s": [368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.00028333333336, 385.00128333333333, 386.0022833333333, 387.00328333333334, 388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333], "recent_frames_sha256": "8fca7efc5eff203aa992df45209358269d3f18e0e9d8c2992daa87d9f1d3ed00", "num_recent_frames": 30, "tq": 715617.643054719, "t1": 715624.806312965, "ta": 715624.806312965, "te": 715624.969616134, "first_response_s": 7.163258246029727, "answer_total_s": 7.3265614149859175, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 397, "content_group": "4a82f7f6d4c422f4f3ad4b675b07c7910b667f7e89542a15846b37dbff3583d7", "question": {"question_id": "sample_397_a1117_q0", "video_id": 397, "video_path": "./videos/sample_397_real.mp4", "annotation_index": 1117, "question_index": 0, "question": "What is the width of the road right now?", "options": ["A. Narrow.", "B. Tiny.", "C. Wide.", "D. Very narrow."], "answer": "C", "time_stamp_s": 530, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [528, 533], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_397_a1117_q0", "video_id": 397, "time_stamp_s": 530, "ground_truth": "C", "raw_output": "C. Wide.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "1744895d0630fa0d51d0809b7bd7d7037cfb22f568dac24583d4832e98854d4d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [500.01618333333334, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0008166666667, 519.0018166666666, 520.0028166666667, 521.0038166666667, 522.0048166666667, 523.0058166666666, 524.0068166666666, 525.0078166666667, 526.0088166666667, 527.0098166666667, 528.0108166666666, 529.0118166666666], "recent_frames_sha256": "6fa6046b2a5f5755f71ac441a1fd2a0f6dca6a442860b67a1c88e38cacd5de6d", "num_recent_frames": 30, "tq": 715731.094558952, "t1": 715745.29033752, "ta": 715745.29033752, "te": 715745.437517745, "first_response_s": 14.195778567926027, "answer_total_s": 14.342958792927675, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_397_a1117_q0", "video_id": 397, "time_stamp_s": 530, "ground_truth": "C", "raw_output": "C. Wide.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "238ae57ab5ece603769177f56503b4e8d671da4fe67ee911a2aa7926aa21ed62", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Yellow taxis move forward on wet street, reflecting red brake lights.  \n- Pedestrian crosswalks are visible with white stripes, and traffic lights show red.  \n- Tall buildings line both sides of the street, with some scaffolding on the right.\n[90-120s] - Yellow taxi crosses the wet street at the intersection, moving from left to right.\n- Pedestrians are visible waiting at the crosswalk, some stepping onto the street as the taxi passes.\n- Traffic lights at the intersection are red, indicating vehicles must stop, with a few cars stationary on the road.\n[120-150s] - A black SUV drives rightward across the wet street, passing a crosswalk with white stripes.\n- A yellow bus moves forward on the road, positioned ahead of the SUV.\n- A pedestrian in an orange jacket crosses the street from left to right, stepping over the crosswalk.\n[150-180s] - A white sedan drives forward on the wet road, its brake lights glowing red as it approaches a stop sign.  \n- A pedestrian in a yellow jacket crosses the street at a crosswalk, moving from right to left relative to the camera.  \n- Traffic lights at the intersection show green for the direction of travel, allowing vehicles to proceed.\n[180-210s] - A yellow taxi cab moves leftward across the wet street, passing a white sedan.  \n- A pedestrian with an umbrella crosses the street from right to left, stepping over the crosswalk.  \n- A black SUV drives rightward, approaching the intersection while traffic lights remain red.\n[210-240s] - Traffic lights change from red to green, allowing vehicles to proceed.\n- Yellow taxis and other cars move along the wet street, reflecting light from their headlights.\n- Pedestrians are visible on sidewalks, some crossing the street as traffic flows.\n[240-270s] - Yellow taxi cab moves forward on wet street, reflecting red taillights.  \n- Pedestrian crosswalk with white stripes is visible ahead, with traffic lights showing green.  \n- Buildings line both sides of the street, with some displaying banners and flags.\n[270-300s] - Yellow taxis and other vehicles move slowly on wet city streets under overcast skies.  \n- Tall buildings line both sides of the road, with some displaying signage and bare trees.  \n- Traffic lights and street signs are visible, indicating an urban intersection with moderate traffic flow.\n[300-330s] - Red car in left lane moves forward, slightly ahead of yellow taxis.  \n- Yellow taxis in center lanes maintain steady pace, with rear lights illuminated.  \n- Traffic lights at intersection show green, allowing vehicles to proceed.\n[330-360s] - Yellow taxi cab moves forward on wet road, its brake lights glowing red.  \n- Black sedan follows closely behind, also navigating the rain-slicked street.  \n- Traffic lights at intersection show green, allowing vehicles to proceed through crosswalk.\n[360-390s] - Rain-slicked street reflects red taillights of multiple cars, including yellow taxis, moving slowly in traffic.  \n- Tall buildings line both sides of the street, with bare trees and parked cars visible along sidewalks.  \n- A white SUV and a white sedan pass by on the right, while a yellow taxi moves forward in the center lane.\n[390-420s] - Yellow taxis move left to right across wet street, reflecting red brake lights.  \n- Pedestrians cross at crosswalk; one in dark coat walks toward camera.  \n- Traffic lights show red; vehicles halt at intersection, including silver sedan and black SUV.\n[420-450s] - Yellow taxis move left to right across wet street, reflecting red brake lights.  \n- Pedestrians cross street at crosswalk, some holding umbrellas.  \n- Traffic lights change green, allowing vehicles to proceed through intersection.\n[450-480s] - Red car drives forward on wet street, its brake lights glowing as it approaches intersection.  \n- Traffic flows steadily with multiple vehicles, including taxis and sedans, navigating the foggy urban environment.  \n- Street signs for “W 57th St” and “W 58th St” are visible, indicating the location as a major city thoroughfare.\n[480-510s] - A blue bus moves leftward across the street, passing a cyclist.  \n- Yellow taxis and a black SUV navigate the wet road, with traffic lights visible.  \n- Pedestrians cross the street under umbrellas, with one child in a bright pink outfit.", "history_tokens": 996, "history_utf8_bytes": 4275, "recent_frame_times_s": [500.01618333333334, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0008166666667, 519.0018166666666, 520.0028166666667, 521.0038166666667, 522.0048166666667, 523.0058166666666, 524.0068166666666, 525.0078166666667, 526.0088166666667, 527.0098166666667, 528.0108166666666, 529.0118166666666], "recent_frames_sha256": "6fa6046b2a5f5755f71ac441a1fd2a0f6dca6a442860b67a1c88e38cacd5de6d", "num_recent_frames": 30, "tq": 715683.108796743, "t1": 715691.669053876, "ta": 715691.669053876, "te": 715691.863138813, "first_response_s": 8.560257132980041, "answer_total_s": 8.754342069965787, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 398, "content_group": "936b2c1a20f19a7566293f963b9086b66ca1cf845dd936581b5120b7ca553a9c", "question": {"question_id": "sample_398_a320_q0", "video_id": 398, "video_path": "./videos/sample_398_real.mp4", "annotation_index": 320, "question_index": 0, "question": "What is the predominant vehicle type visible on the right side of the street right now?", "options": ["A. Red truck.", "B. Yellow car.", "C. White van.", "D. Blue bicycle."], "answer": "B", "time_stamp_s": 11, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_398_a320_q0", "video_id": 398, "time_stamp_s": 11, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bda262e6351dc62f3ab793a46d0ca20459068a3ab22380cc564012cd240fdd15", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.039, 1.0066333333333333, 2.007633333333333, 3.0086333333333335, 4.009633333333333, 5.010633333333334, 6.011633333333333, 7.0126333333333335, 8.013633333333333, 9.014633333333334, 10.015633333333334], "recent_frames_sha256": "05edbabaa1c44e8d4326a5a03824fe5596f8d73e760e9d877424b83bee82deed", "num_recent_frames": 11, "tq": 715468.25431514, "t1": 715468.998129943, "ta": 715468.998129943, "te": 715469.035426417, "first_response_s": 0.7438148030778393, "answer_total_s": 0.7811112770577893, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_398_a320_q0", "video_id": 398, "time_stamp_s": 11, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e1a7497bc5584b918ae996635217df3469d44c8f3c46381b437c99629aecf7de", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.039, 1.0066333333333333, 2.007633333333333, 3.0086333333333335, 4.009633333333333, 5.010633333333334, 6.011633333333333, 7.0126333333333335, 8.013633333333333, 9.014633333333334, 10.015633333333334], "recent_frames_sha256": "05edbabaa1c44e8d4326a5a03824fe5596f8d73e760e9d877424b83bee82deed", "num_recent_frames": 11, "tq": 715333.997530869, "t1": 715341.608336119, "ta": 715341.608336119, "te": 715341.769639125, "first_response_s": 7.6108052500057966, "answer_total_s": 7.772108256001957, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 398, "content_group": "936b2c1a20f19a7566293f963b9086b66ca1cf845dd936581b5120b7ca553a9c", "question": {"question_id": "sample_398_a321_q0", "video_id": 398, "video_path": "./videos/sample_398_real.mp4", "annotation_index": 321, "question_index": 0, "question": "What is the weather condition right now?", "options": ["A. Sunny.", "B. Snowy.", "C. Rainy.", "D. Clear."], "answer": "C", "time_stamp_s": 116, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [116, 121], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_398_a321_q0", "video_id": 398, "time_stamp_s": 116, "ground_truth": "C", "raw_output": "C. Rainy.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "6c8c6806a98ebc99c53b3ae4466d10e1c3f078f956794273683bdca08b548064", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [86.00821666666667, 87.00921666666666, 88.01021666666666, 89.01121666666667, 90.01221666666666, 91.01321666666666, 92.01421666666667, 93.01521666666666, 94.01621666666666, 95.00053333333334, 96.00153333333333, 97.00253333333333, 98.00353333333334, 99.00453333333333, 100.00553333333333, 101.00653333333334, 102.00753333333333, 103.00853333333333, 104.00953333333334, 105.01053333333333, 106.01153333333333, 107.01253333333334, 108.01353333333333, 109.01453333333333, 110.01553333333334, 111.01653333333333, 112.00085, 113.00185, 114.00285, 115.00385], "recent_frames_sha256": "f45c50d431f4f6b4aad46f237db9edaa21d47275a13066655eec373bc986d52c", "num_recent_frames": 30, "tq": 715469.049170286, "t1": 715479.661393034, "ta": 715479.661393034, "te": 715479.95818103, "first_response_s": 10.612222747993656, "answer_total_s": 10.90901074395515, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_398_a321_q0", "video_id": 398, "time_stamp_s": 116, "ground_truth": "C", "raw_output": "C. Rainy.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "d65f574428bc4b8fd5014249350683e466258fad0a5967aa1e5ed5a3009aecff", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rain-slicked street with yellow taxis and pedestrians crossing under umbrellas, flanked by tall buildings with lit storefronts.  \n- A black SUV and a blue bus pass through the intersection, while a cyclist navigates the crosswalk.  \n- Traffic lights change from red to green, allowing vehicles to proceed as pedestrians continue crossing.\n[30-60s] - Pedestrians cross the wet street at a crosswalk under umbrellas as traffic moves through the intersection.  \n- A yellow taxi and a black SUV pass each other on the road, with the taxi turning right at the corner.  \n- A red \"ITALIAN\" sign is visible on a storefront on the right side of the street, with a \"QUALITY\" sign above it.\n[60-90s] - Yellow taxi cab moves leftward across the wet street, passing a crosswalk.  \n- Pedestrians with umbrellas cross the street at the crosswalk, some moving toward the right.  \n- A black SUV is parked on the right side of the road, partially visible near the curb.", "history_tokens": 230, "history_utf8_bytes": 961, "recent_frame_times_s": [86.00821666666667, 87.00921666666666, 88.01021666666666, 89.01121666666667, 90.01221666666666, 91.01321666666666, 92.01421666666667, 93.01521666666666, 94.01621666666666, 95.00053333333334, 96.00153333333333, 97.00253333333333, 98.00353333333334, 99.00453333333333, 100.00553333333333, 101.00653333333334, 102.00753333333333, 103.00853333333333, 104.00953333333334, 105.01053333333333, 106.01153333333333, 107.01253333333334, 108.01353333333333, 109.01453333333333, 110.01553333333334, 111.01653333333333, 112.00085, 113.00185, 114.00285, 115.00385], "recent_frames_sha256": "f45c50d431f4f6b4aad46f237db9edaa21d47275a13066655eec373bc986d52c", "num_recent_frames": 30, "tq": 715364.57363255, "t1": 715370.45506939, "ta": 715370.45506939, "te": 715370.643393659, "first_response_s": 5.881436840048991, "answer_total_s": 6.069761109072715, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 398, "content_group": "936b2c1a20f19a7566293f963b9086b66ca1cf845dd936581b5120b7ca553a9c", "question": {"question_id": "sample_398_a322_q0", "video_id": 398, "video_path": "./videos/sample_398_real.mp4", "annotation_index": 322, "question_index": 0, "question": "Which type of establishment has a visible sign on the left side of the street right now?", "options": ["A. A cafe.", "B. A library.", "C. A tea room.", "D. A bookstore."], "answer": "C", "time_stamp_s": 232, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [232, 237], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_398_a322_q0", "video_id": 398, "time_stamp_s": 232, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "85e39d98d9b2d8c6d34f5b645132a710623d55b698e6bd5a62fe2a5d23fa8b1c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [202.00743333333332, 203.00843333333333, 204.00943333333333, 205.01043333333334, 206.01143333333334, 207.01243333333332, 208.01343333333332, 209.01443333333333, 210.01543333333333, 211.01643333333334, 212.00075, 213.00175, 214.00275, 215.00375, 216.00475, 217.00575, 218.00675, 219.00775, 220.00875, 221.00975, 222.01075, 223.01175, 224.01275, 225.01375, 226.01475, 227.01575, 228.00006666666667, 229.00106666666667, 230.00206666666668, 231.00306666666665], "recent_frames_sha256": "80e11cc886eb320363607c91e1e1296a6a10ef18d64ab17810114ef5acee3026", "num_recent_frames": 30, "tq": 715479.97035975, "t1": 715492.549179781, "ta": 715492.549179781, "te": 715492.586781921, "first_response_s": 12.578820031019859, "answer_total_s": 12.61642217100598, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_398_a322_q0", "video_id": 398, "time_stamp_s": 232, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "567b964e99e0324e29040f9a886d440d45eb8f4c9409295f6b8e32fb755037cb", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rain-slicked street with yellow taxis and pedestrians crossing under umbrellas, flanked by tall buildings with lit storefronts.  \n- A black SUV and a blue bus pass through the intersection, while a cyclist navigates the crosswalk.  \n- Traffic lights change from red to green, allowing vehicles to proceed as pedestrians continue crossing.\n[30-60s] - Pedestrians cross the wet street at a crosswalk under umbrellas as traffic moves through the intersection.  \n- A yellow taxi and a black SUV pass each other on the road, with the taxi turning right at the corner.  \n- A red \"ITALIAN\" sign is visible on a storefront on the right side of the street, with a \"QUALITY\" sign above it.\n[60-90s] - Yellow taxi cab moves leftward across the wet street, passing a crosswalk.  \n- Pedestrians with umbrellas cross the street at the crosswalk, some moving toward the right.  \n- A black SUV is parked on the right side of the road, partially visible near the curb.\n[90-120s] - A black SUV is stationary at a crosswalk, facing the camera, with its brake lights illuminated.  \n- A yellow taxi cab passes by on the right, moving away from the camera, while a white bus is visible further down the street.  \n- Construction scaffolding and orange traffic cones are positioned along the right side of the road, indicating ongoing work.\n[120-150s] - Yellow taxis are stationary or moving slowly in traffic on a wet street.  \n- Construction workers in high-visibility vests are visible near orange traffic cones on the left.  \n- A large white truck with a canopy is parked on the left side of the road.\n[150-180s] - Yellow taxis line the right side of the wet street, stationary or moving slowly.  \n- A large bus enters from the left, passing through traffic with visible route number \"100\" on its front.  \n- Construction scaffolding and orange traffic cones are visible on the right, indicating ongoing work.\n[180-210s] - A pedestrian with a blue umbrella crosses the wet street at a crosswalk, moving from left to right.\n- Traffic, including yellow taxis and sedans, is stopped at a red light, with brake lights illuminated.\n- A red double-decker bus is visible in the distance, stationary or moving slowly, aligned with the traffic flow.", "history_tokens": 525, "history_utf8_bytes": 2229, "recent_frame_times_s": [202.00743333333332, 203.00843333333333, 204.00943333333333, 205.01043333333334, 206.01143333333334, 207.01243333333332, 208.01343333333332, 209.01443333333333, 210.01543333333333, 211.01643333333334, 212.00075, 213.00175, 214.00275, 215.00375, 216.00475, 217.00575, 218.00675, 219.00775, 220.00875, 221.00975, 222.01075, 223.01175, 224.01275, 225.01375, 226.01475, 227.01575, 228.00006666666667, 229.00106666666667, 230.00206666666668, 231.00306666666665], "recent_frames_sha256": "80e11cc886eb320363607c91e1e1296a6a10ef18d64ab17810114ef5acee3026", "num_recent_frames": 30, "tq": 715397.543848569, "t1": 715404.907398866, "ta": 715404.907398866, "te": 715405.185817151, "first_response_s": 7.363550296984613, "answer_total_s": 7.64196858194191, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 398, "content_group": "936b2c1a20f19a7566293f963b9086b66ca1cf845dd936581b5120b7ca553a9c", "question": {"question_id": "sample_398_a323_q0", "video_id": 398, "video_path": "./videos/sample_398_real.mp4", "annotation_index": 323, "question_index": 0, "question": "Which company logo is visible on a truck right now?", "options": ["A. FedEx.", "B. Ryder.", "C. UPS.", "D. Amazon."], "answer": "B", "time_stamp_s": 350, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [348, 353], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_398_a323_q0", "video_id": 398, "time_stamp_s": 350, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "cdf482a82157ce194f70042630697c04f5f682928bca590816465f69ccc36c5c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [320.00865, 321.00965, 322.01065, 323.01165, 324.01265, 325.01365, 326.01465, 327.01565, 328.01665, 329.00096666666667, 330.00196666666665, 331.0029666666667, 332.00396666666666, 333.0049666666667, 334.00596666666667, 335.00696666666664, 336.0079666666667, 337.00896666666665, 338.0099666666667, 339.01096666666666, 340.0119666666667, 341.01296666666667, 342.01396666666665, 343.0149666666667, 344.01596666666666, 345.00028333333336, 346.00128333333333, 347.0022833333333, 348.00328333333334, 349.0042833333333], "recent_frames_sha256": "251d2983504fd5babd50006c895fa145985d5a06db8f9bf4fc3443d63d84619f", "num_recent_frames": 30, "tq": 715492.596180643, "t1": 715504.042247013, "ta": 715504.042247013, "te": 715504.07978043, "first_response_s": 11.446066370001063, "answer_total_s": 11.48359978699591, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_398_a323_q0", "video_id": 398, "time_stamp_s": 350, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "573c98e1f45e65ac5335db300504312356224c8bdcbecef89323954ad5647b66", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rain-slicked street with yellow taxis and pedestrians crossing under umbrellas, flanked by tall buildings with lit storefronts.  \n- A black SUV and a blue bus pass through the intersection, while a cyclist navigates the crosswalk.  \n- Traffic lights change from red to green, allowing vehicles to proceed as pedestrians continue crossing.\n[30-60s] - Pedestrians cross the wet street at a crosswalk under umbrellas as traffic moves through the intersection.  \n- A yellow taxi and a black SUV pass each other on the road, with the taxi turning right at the corner.  \n- A red \"ITALIAN\" sign is visible on a storefront on the right side of the street, with a \"QUALITY\" sign above it.\n[60-90s] - Yellow taxi cab moves leftward across the wet street, passing a crosswalk.  \n- Pedestrians with umbrellas cross the street at the crosswalk, some moving toward the right.  \n- A black SUV is parked on the right side of the road, partially visible near the curb.\n[90-120s] - A black SUV is stationary at a crosswalk, facing the camera, with its brake lights illuminated.  \n- A yellow taxi cab passes by on the right, moving away from the camera, while a white bus is visible further down the street.  \n- Construction scaffolding and orange traffic cones are positioned along the right side of the road, indicating ongoing work.\n[120-150s] - Yellow taxis are stationary or moving slowly in traffic on a wet street.  \n- Construction workers in high-visibility vests are visible near orange traffic cones on the left.  \n- A large white truck with a canopy is parked on the left side of the road.\n[150-180s] - Yellow taxis line the right side of the wet street, stationary or moving slowly.  \n- A large bus enters from the left, passing through traffic with visible route number \"100\" on its front.  \n- Construction scaffolding and orange traffic cones are visible on the right, indicating ongoing work.\n[180-210s] - A pedestrian with a blue umbrella crosses the wet street at a crosswalk, moving from left to right.\n- Traffic, including yellow taxis and sedans, is stopped at a red light, with brake lights illuminated.\n- A red double-decker bus is visible in the distance, stationary or moving slowly, aligned with the traffic flow.\n[210-240s] - Red traffic lights remain active for vehicles approaching the intersection, with a yellow taxi entering the frame from the left.  \n- A black SUV is stationary on the right side of the road, positioned near a crosswalk.  \n- The wet pavement reflects the red brake lights of cars, indicating recent or ongoing rain.\n[240-270s] - A black SUV with a visible license plate is stationary at a crosswalk, facing the camera.  \n- A red bus with \"Carnegie Hall\" signage passes on the left, moving away from the camera.  \n- A white sedan is seen driving past on the right, following the flow of traffic.\n[270-300s] - Rain-slicked street reflects vehicle headlights and brake lights, with cars moving slowly in traffic.  \n- A white Tesla and a silver SUV are visible on the right, while a black sedan is ahead in the lane.  \n- Pedestrians are seen on the sidewalk near a red-bricked building with a \"presented by\" sign.\n[300-330s] - A silver SUV with license plate \"55555\" drives forward on a wet street, positioned behind a black sedan.  \n- Yellow taxis and other vehicles move along the street, with one taxi passing on the left side.  \n- A \"freshdog\" storefront is visible on the left, with a large billboard above it displaying a portrait and text.", "history_tokens": 835, "history_utf8_bytes": 3483, "recent_frame_times_s": [320.00865, 321.00965, 322.01065, 323.01165, 324.01265, 325.01365, 326.01465, 327.01565, 328.01665, 329.00096666666667, 330.00196666666665, 331.0029666666667, 332.00396666666666, 333.0049666666667, 334.00596666666667, 335.00696666666664, 336.0079666666667, 337.00896666666665, 338.0099666666667, 339.01096666666666, 340.0119666666667, 341.01296666666667, 342.01396666666665, 343.0149666666667, 344.01596666666666, 345.00028333333336, 346.00128333333333, 347.0022833333333, 348.00328333333334, 349.0042833333333], "recent_frames_sha256": "251d2983504fd5babd50006c895fa145985d5a06db8f9bf4fc3443d63d84619f", "num_recent_frames": 30, "tq": 715428.071637382, "t1": 715434.089745, "ta": 715434.089745, "te": 715434.127919304, "first_response_s": 6.018107617972419, "answer_total_s": 6.056281921919435, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 398, "content_group": "936b2c1a20f19a7566293f963b9086b66ca1cf845dd936581b5120b7ca553a9c", "question": {"question_id": "sample_398_a324_q0", "video_id": 398, "video_path": "./videos/sample_398_real.mp4", "annotation_index": 324, "question_index": 0, "question": "Which establishment's sign is visible in the video right now?", "options": ["A. Starbucks.", "B. Dunkin'.", "C. McDonald's.", "D. Subway."], "answer": "B", "time_stamp_s": 467, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [464, 469], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_398_a324_q0", "video_id": 398, "time_stamp_s": 467, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f7fe95589b78efdde8a63b992363abf3b456399cb2de6004c699308a21b3a7e9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [437.0088666666667, 438.00986666666665, 439.0108666666667, 440.01186666666666, 441.01286666666664, 442.0138666666667, 443.01486666666665, 444.0158666666667, 445.0001833333333, 446.00118333333336, 447.00218333333333, 448.0031833333333, 449.00418333333334, 450.0051833333333, 451.00618333333335, 452.00718333333333, 453.0081833333333, 454.00918333333334, 455.0101833333333, 456.01118333333335, 457.0121833333333, 458.01318333333336, 459.01418333333334, 460.0151833333333, 461.01618333333334, 462.0005, 463.0015, 464.0025, 465.0035, 466.0045], "recent_frames_sha256": "12d1c416d42fccd8f8a2eb4cf8badbb9614fb92deb56552c2442cd2cc94a0221", "num_recent_frames": 30, "tq": 715504.087656529, "t1": 715515.730438744, "ta": 715515.730438744, "te": 715515.767799435, "first_response_s": 11.642782214912586, "answer_total_s": 11.680142905912362, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_398_a324_q0", "video_id": 398, "time_stamp_s": 467, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5aec0ac5f55b2584372e06c6bcadb48e3abeeae97b77b4db1137271a03f06bf9", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Yellow taxi cab moves leftward across the wet street, passing a crosswalk.  \n- Pedestrians with umbrellas cross the street at the crosswalk, some moving toward the right.  \n- A black SUV is parked on the right side of the road, partially visible near the curb.\n[90-120s] - A black SUV is stationary at a crosswalk, facing the camera, with its brake lights illuminated.  \n- A yellow taxi cab passes by on the right, moving away from the camera, while a white bus is visible further down the street.  \n- Construction scaffolding and orange traffic cones are positioned along the right side of the road, indicating ongoing work.\n[120-150s] - Yellow taxis are stationary or moving slowly in traffic on a wet street.  \n- Construction workers in high-visibility vests are visible near orange traffic cones on the left.  \n- A large white truck with a canopy is parked on the left side of the road.\n[150-180s] - Yellow taxis line the right side of the wet street, stationary or moving slowly.  \n- A large bus enters from the left, passing through traffic with visible route number \"100\" on its front.  \n- Construction scaffolding and orange traffic cones are visible on the right, indicating ongoing work.\n[180-210s] - A pedestrian with a blue umbrella crosses the wet street at a crosswalk, moving from left to right.\n- Traffic, including yellow taxis and sedans, is stopped at a red light, with brake lights illuminated.\n- A red double-decker bus is visible in the distance, stationary or moving slowly, aligned with the traffic flow.\n[210-240s] - Red traffic lights remain active for vehicles approaching the intersection, with a yellow taxi entering the frame from the left.  \n- A black SUV is stationary on the right side of the road, positioned near a crosswalk.  \n- The wet pavement reflects the red brake lights of cars, indicating recent or ongoing rain.\n[240-270s] - A black SUV with a visible license plate is stationary at a crosswalk, facing the camera.  \n- A red bus with \"Carnegie Hall\" signage passes on the left, moving away from the camera.  \n- A white sedan is seen driving past on the right, following the flow of traffic.\n[270-300s] - Rain-slicked street reflects vehicle headlights and brake lights, with cars moving slowly in traffic.  \n- A white Tesla and a silver SUV are visible on the right, while a black sedan is ahead in the lane.  \n- Pedestrians are seen on the sidewalk near a red-bricked building with a \"presented by\" sign.\n[300-330s] - A silver SUV with license plate \"55555\" drives forward on a wet street, positioned behind a black sedan.  \n- Yellow taxis and other vehicles move along the street, with one taxi passing on the left side.  \n- A \"freshdog\" storefront is visible on the left, with a large billboard above it displaying a portrait and text.\n[330-360s] - A large white and blue bus with \"MIDTOWN\" branding enters from the left, navigating through traffic cones on a wet street.  \n- A silver SUV is positioned ahead, moving slowly with its brake lights on, surrounded by orange traffic cones.  \n- Construction equipment and workers are visible on the right side of the road, near a \"MONTBLANC\" storefront.\n[360-390s] - Silver SUV with license plate \"123456\" moves forward through traffic, passing orange cones on wet road.  \n- White delivery truck with \"Hydro\" logo parked on left side, partially obscured by other vehicles.  \n- \"NORDST\" sign visible on right building facade, with pedestrians crossing street at crosswalk.\n[390-420s] - Rain-slicked street with multiple cars, including a black SUV in center and a white sedan on left, moving slowly through city traffic.  \n- Pedestrians with umbrellas cross street at intersections, some near red-painted bike lane on right.  \n- Tall buildings line both sides of street, with storefronts and signs visible, including a red \"N\" sign on right.\n[420-450s] - Yellow taxi cab enters frame from left, moving along wet street.  \n- Pedestrians cross street at crosswalk, some holding umbrellas.  \n- Black SUV remains stationary in traffic, rear lights illuminated.", "history_tokens": 983, "history_utf8_bytes": 4058, "recent_frame_times_s": [437.0088666666667, 438.00986666666665, 439.0108666666667, 440.01186666666666, 441.01286666666664, 442.0138666666667, 443.01486666666665, 444.0158666666667, 445.0001833333333, 446.00118333333336, 447.00218333333333, 448.0031833333333, 449.00418333333334, 450.0051833333333, 451.00618333333335, 452.00718333333333, 453.0081833333333, 454.00918333333334, 455.0101833333333, 456.01118333333335, 457.0121833333333, 458.01318333333336, 459.01418333333334, 460.0151833333333, 461.01618333333334, 462.0005, 463.0015, 464.0025, 465.0035, 466.0045], "recent_frames_sha256": "12d1c416d42fccd8f8a2eb4cf8badbb9614fb92deb56552c2442cd2cc94a0221", "num_recent_frames": 30, "tq": 715461.455096671, "t1": 715468.17711533, "ta": 715468.17711533, "te": 715468.215849514, "first_response_s": 6.722018658998422, "answer_total_s": 6.760752842994407, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 399, "content_group": "e7646a77a71760d382ad63b63a63501ce29b7c41d41fd5e0421d8d47c118e197", "question": {"question_id": "sample_399_a1985_q0", "video_id": 399, "video_path": "./videos/sample_399_real.mp4", "annotation_index": 1985, "question_index": 0, "question": "What is directly in front of the camera right now?", "options": ["A. A white car.", "B. A yellow taxi.", "C. A red car.", "D. A black SUV."], "answer": "B", "time_stamp_s": 6, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_399_a1985_q0", "video_id": 399, "time_stamp_s": 6, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e93201d312f0d4b5351087c83e6e8e3a67bb8a1f538203c3efe5a79fdc2687d1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.018, 1.0023166666666667, 2.0033166666666666, 3.0043166666666665, 4.005316666666666, 5.006316666666667], "recent_frames_sha256": "f1f588fc93db3f4cee8ca9641336c1ae8d435954b2f0215b491e298427144a20", "num_recent_frames": 6, "tq": 719261.582236073, "t1": 719262.167258453, "ta": 719262.167258453, "te": 719262.204726809, "first_response_s": 0.5850223799934611, "answer_total_s": 0.6224907360738143, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_399_a1985_q0", "video_id": 399, "time_stamp_s": 6, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "40ed27e82e38de343bbddedd70d979d0e598167489f4fed9ed501a508b8ee68e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.018, 1.0023166666666667, 2.0033166666666666, 3.0043166666666665, 4.005316666666666, 5.006316666666667], "recent_frames_sha256": "f1f588fc93db3f4cee8ca9641336c1ae8d435954b2f0215b491e298427144a20", "num_recent_frames": 6, "tq": 719310.912604869, "t1": 719317.803401794, "ta": 719317.803401794, "te": 719318.019391793, "first_response_s": 6.890796925057657, "answer_total_s": 7.106786923948675, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 399, "content_group": "e7646a77a71760d382ad63b63a63501ce29b7c41d41fd5e0421d8d47c118e197", "question": {"question_id": "sample_399_a1986_q0", "video_id": 399, "video_path": "./videos/sample_399_real.mp4", "annotation_index": 1986, "question_index": 0, "question": "What text is visible on the right side of the street right now?", "options": ["A. Excavator.", "B. CRANE.", "C. WEST NEW YORK.", "D. Loader."], "answer": "C", "time_stamp_s": 126, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [120, 125], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_399_a1986_q0", "video_id": 399, "time_stamp_s": 126, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9d09011592080968db349a59370f09f9b902e70abab711eea6449cebcf0719c5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [96.0139, 97.0149, 98.0159, 99.00021666666666, 100.00121666666666, 101.00221666666667, 102.00321666666666, 103.00421666666666, 104.00521666666667, 105.00621666666666, 106.00721666666666, 107.00821666666667, 108.00921666666666, 109.01021666666666, 110.01121666666667, 111.01221666666666, 112.01321666666666, 113.01421666666667, 114.01521666666666, 115.01621666666666, 116.00053333333334, 117.00153333333333, 118.00253333333333, 119.00353333333334, 120.00453333333333, 121.00553333333333, 122.00653333333334, 123.00753333333333, 124.00853333333333, 125.00953333333334], "recent_frames_sha256": "d5e63fa9822b4b04859d354d657ce72144862d20c3ce06a799213d3c09c1e666", "num_recent_frames": 30, "tq": 719262.217072921, "t1": 719273.287757651, "ta": 719273.287757651, "te": 719273.324551093, "first_response_s": 11.070684729958884, "answer_total_s": 11.107478172052652, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_399_a1986_q0", "video_id": 399, "time_stamp_s": 126, "ground_truth": "C", "raw_output": "C. WEST NEW YORK.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "d4eb40f3f0639ae75733246ddd642344ec75c877457957ad1d9bf470e44d7915", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxi cab drives forward on wet street, following traffic flow past tall buildings and bare trees.  \n- Blue bus passes on left, then a white sedan and black SUV appear, all moving along the road.  \n- Pedestrians are visible crossing at intersections, with traffic lights changing red to green.\n[30-60s] - Yellow taxi drives forward on wet street, maintaining position between lanes.  \n- White sedan and black SUV move slowly in adjacent lanes, navigating traffic.  \n- Pedestrians cross street at crosswalk, with traffic lights changing from red to green.\n[60-90s] - Yellow taxi cab moves forward on wet road, passing parked cars and pedestrians with umbrellas.  \n- A blue bus with \"MIDTOWN\" text on side enters frame from left, traveling in same direction.  \n- Pedestrians cross street at crosswalk; one person walks toward camera while others move away.\n[90-120s] - A white SUV with its brake lights on is stationary in traffic, surrounded by parked cars on both sides.  \n- A blue and yellow bus passes by on the left, moving in the same direction as the camera.  \n- The street is wet from rain, with reflections visible on the pavement and buildings lining the road.", "history_tokens": 274, "history_utf8_bytes": 1184, "recent_frame_times_s": [96.0139, 97.0149, 98.0159, 99.00021666666666, 100.00121666666666, 101.00221666666667, 102.00321666666666, 103.00421666666666, 104.00521666666667, 105.00621666666666, 106.00721666666666, 107.00821666666667, 108.00921666666666, 109.01021666666666, 110.01121666666667, 111.01221666666666, 112.01321666666666, 113.01421666666667, 114.01521666666666, 115.01621666666666, 116.00053333333334, 117.00153333333333, 118.00253333333333, 119.00353333333334, 120.00453333333333, 121.00553333333333, 122.00653333333334, 123.00753333333333, 124.00853333333333, 125.00953333333334], "recent_frames_sha256": "d5e63fa9822b4b04859d354d657ce72144862d20c3ce06a799213d3c09c1e666", "num_recent_frames": 30, "tq": 719341.860761521, "t1": 719344.300385304, "ta": 719344.300385304, "te": 719344.526554723, "first_response_s": 2.4396237829932943, "answer_total_s": 2.665793202002533, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 399, "content_group": "e7646a77a71760d382ad63b63a63501ce29b7c41d41fd5e0421d8d47c118e197", "question": {"question_id": "sample_399_a1987_q0", "video_id": 399, "video_path": "./videos/sample_399_real.mp4", "annotation_index": 1987, "question_index": 0, "question": "Which type of restaurant is visible on the right side right now?", "options": ["A. Italian restaurant.", "B. West Side Restaurant.", "C. Chinese restaurant.", "D. Mexican restaurant."], "answer": "B", "time_stamp_s": 240, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [240, 245], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_399_a1987_q0", "video_id": 399, "time_stamp_s": 240, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "61b49d6b250c02e65ebfb20c8bd3c269360687017516365a5fb09c6356c995a5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [210.01111666666668, 211.01211666666666, 212.01311666666666, 213.01411666666667, 214.01511666666667, 215.01611666666668, 216.00043333333332, 217.00143333333332, 218.00243333333333, 219.00343333333333, 220.00443333333334, 221.00543333333334, 222.00643333333332, 223.00743333333332, 224.00843333333333, 225.00943333333333, 226.01043333333334, 227.01143333333334, 228.01243333333332, 229.01343333333332, 230.01443333333333, 231.01543333333333, 232.01643333333334, 233.00075, 234.00175, 235.00275, 236.00375, 237.00475, 238.00575, 239.00675], "recent_frames_sha256": "4236f1778b77e0eec9a5787b78f7f0f8130f520d04bfbf02b03f59b999e85076", "num_recent_frames": 30, "tq": 719273.333777638, "t1": 719286.872529103, "ta": 719286.872529103, "te": 719286.909346028, "first_response_s": 13.538751464919187, "answer_total_s": 13.575568389962427, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_399_a1987_q0", "video_id": 399, "time_stamp_s": 240, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ecfee22130bf2896bd40659e70e86bd7e93073596466a6a27726a347f5eb6ef0", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxi cab drives forward on wet street, following traffic flow past tall buildings and bare trees.  \n- Blue bus passes on left, then a white sedan and black SUV appear, all moving along the road.  \n- Pedestrians are visible crossing at intersections, with traffic lights changing red to green.\n[30-60s] - Yellow taxi drives forward on wet street, maintaining position between lanes.  \n- White sedan and black SUV move slowly in adjacent lanes, navigating traffic.  \n- Pedestrians cross street at crosswalk, with traffic lights changing from red to green.\n[60-90s] - Yellow taxi cab moves forward on wet road, passing parked cars and pedestrians with umbrellas.  \n- A blue bus with \"MIDTOWN\" text on side enters frame from left, traveling in same direction.  \n- Pedestrians cross street at crosswalk; one person walks toward camera while others move away.\n[90-120s] - A white SUV with its brake lights on is stationary in traffic, surrounded by parked cars on both sides.  \n- A blue and yellow bus passes by on the left, moving in the same direction as the camera.  \n- The street is wet from rain, with reflections visible on the pavement and buildings lining the road.\n[120-150s] - A silver sedan drives forward down the wet street, flanked by parked cars on both sides.  \n- Orange construction barriers line the right side of the road, with a blue dumpster visible near the curb.  \n- Bare trees with no leaves line the street, their branches silhouetted against a gray, overcast sky.\n[150-180s] - A white SUV drives forward through a wet street, its brake lights glowing red as it approaches a crosswalk.  \n- Pedestrians with umbrellas cross the street at the crosswalk, some walking briskly while others pause near the curb.  \n- A tall building with a glass facade is visible in the distance, partially obscured by fog or mist.\n[180-210s] - A white pickup truck is stationary at a red light, positioned in the right lane, with its brake lights illuminated.  \n- A yellow construction vehicle is parked on the left side of the street, near the curb, with its engine off.  \n- A tall glass building rises in the background, partially obscured by mist, with no visible movement or activity.\n[210-240s] - A white pickup truck is stationary at a red light on the right side of the road, positioned behind a black SUV.  \n- A yellow construction vehicle is parked on the left side of the street, near the sidewalk.  \n- A pedestrian crosses the street from left to right, moving toward the right side of the frame.", "history_tokens": 591, "history_utf8_bytes": 2522, "recent_frame_times_s": [210.01111666666668, 211.01211666666666, 212.01311666666666, 213.01411666666667, 214.01511666666667, 215.01611666666668, 216.00043333333332, 217.00143333333332, 218.00243333333333, 219.00343333333333, 220.00443333333334, 221.00543333333334, 222.00643333333332, 223.00743333333332, 224.00843333333333, 225.00943333333333, 226.01043333333334, 227.01143333333334, 228.01243333333332, 229.01343333333332, 230.01443333333333, 231.01543333333333, 232.01643333333334, 233.00075, 234.00175, 235.00275, 236.00375, 237.00475, 238.00575, 239.00675], "recent_frames_sha256": "4236f1778b77e0eec9a5787b78f7f0f8130f520d04bfbf02b03f59b999e85076", "num_recent_frames": 30, "tq": 719375.16679485, "t1": 719382.525390135, "ta": 719382.525390135, "te": 719382.563013385, "first_response_s": 7.358595284982584, "answer_total_s": 7.396218535024673, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 399, "content_group": "e7646a77a71760d382ad63b63a63501ce29b7c41d41fd5e0421d8d47c118e197", "question": {"question_id": "sample_399_a1988_q0", "video_id": 399, "video_path": "./videos/sample_399_real.mp4", "annotation_index": 1988, "question_index": 0, "question": "What is the color of the traffic light right now?", "options": ["A. Green.", "B. Yellow.", "C. Red.", "D. Blue."], "answer": "C", "time_stamp_s": 362, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [360, 365], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_399_a1988_q0", "video_id": 399, "time_stamp_s": 362, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e657c56fedd3919b96c5a775a321aa3b9f0499fb9da2dd7ed8b7204b16aea573", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [332.0163333333333, 333.00065, 334.00165, 335.00265, 336.00365, 337.00465, 338.00565, 339.00665, 340.00765, 341.00865, 342.00965, 343.01065, 344.01165, 345.01265, 346.01365, 347.01465, 348.01565, 349.01665, 350.00096666666667, 351.00196666666665, 352.0029666666667, 353.00396666666666, 354.0049666666667, 355.00596666666667, 356.00696666666664, 357.0079666666667, 358.00896666666665, 359.0099666666667, 360.01096666666666, 361.0119666666667], "recent_frames_sha256": "7dd150b44a23d253df83896266fdf3d3e85e33e09d576eb2f38246e676b337e1", "num_recent_frames": 30, "tq": 719286.921103272, "t1": 719300.345462335, "ta": 719300.345462335, "te": 719300.388153907, "first_response_s": 13.424359063035809, "answer_total_s": 13.467050635023043, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_399_a1988_q0", "video_id": 399, "time_stamp_s": 362, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7b41f73ce901344b07a668db226217c8003e1f01ca95e08a64f36b7658d575dc", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow taxi cab drives forward on wet street, following traffic flow past tall buildings and bare trees.  \n- Blue bus passes on left, then a white sedan and black SUV appear, all moving along the road.  \n- Pedestrians are visible crossing at intersections, with traffic lights changing red to green.\n[30-60s] - Yellow taxi drives forward on wet street, maintaining position between lanes.  \n- White sedan and black SUV move slowly in adjacent lanes, navigating traffic.  \n- Pedestrians cross street at crosswalk, with traffic lights changing from red to green.\n[60-90s] - Yellow taxi cab moves forward on wet road, passing parked cars and pedestrians with umbrellas.  \n- A blue bus with \"MIDTOWN\" text on side enters frame from left, traveling in same direction.  \n- Pedestrians cross street at crosswalk; one person walks toward camera while others move away.\n[90-120s] - A white SUV with its brake lights on is stationary in traffic, surrounded by parked cars on both sides.  \n- A blue and yellow bus passes by on the left, moving in the same direction as the camera.  \n- The street is wet from rain, with reflections visible on the pavement and buildings lining the road.\n[120-150s] - A silver sedan drives forward down the wet street, flanked by parked cars on both sides.  \n- Orange construction barriers line the right side of the road, with a blue dumpster visible near the curb.  \n- Bare trees with no leaves line the street, their branches silhouetted against a gray, overcast sky.\n[150-180s] - A white SUV drives forward through a wet street, its brake lights glowing red as it approaches a crosswalk.  \n- Pedestrians with umbrellas cross the street at the crosswalk, some walking briskly while others pause near the curb.  \n- A tall building with a glass facade is visible in the distance, partially obscured by fog or mist.\n[180-210s] - A white pickup truck is stationary at a red light, positioned in the right lane, with its brake lights illuminated.  \n- A yellow construction vehicle is parked on the left side of the street, near the curb, with its engine off.  \n- A tall glass building rises in the background, partially obscured by mist, with no visible movement or activity.\n[210-240s] - A white pickup truck is stationary at a red light on the right side of the road, positioned behind a black SUV.  \n- A yellow construction vehicle is parked on the left side of the street, near the sidewalk.  \n- A pedestrian crosses the street from left to right, moving toward the right side of the frame.\n[240-270s] - A white police car with blue markings is parked on the left side of the street, stationary.  \n- A black SUV and a white pickup truck are visible ahead, moving slowly through the wet intersection.  \n- Pedestrians cross the street at a crosswalk, with one person holding a pink umbrella.\n[270-300s] - Yellow crane remains stationary on left side of street, surrounded by orange cones.  \n- Traffic lights change from red to green, allowing vehicles to proceed through intersection.  \n- Pedestrians cross street at crosswalk as cars move forward, with wet pavement reflecting lights.\n[300-330s] - A silver sedan drives rightward on a wet road, passing a crosswalk with white stripes.  \n- A pedestrian with an umbrella crosses the street at the crosswalk, moving from left to right.  \n- Traffic lights at the intersection show green for the direction of travel, allowing vehicles to proceed.\n[330-360s] - Yellow taxi cab moves rightward across intersection, passing traffic light.\n- Pedestrian in dark coat crosses street at crosswalk, moving left to right.\n- Rain-slicked pavement reflects streetlights and vehicle headlights.", "history_tokens": 853, "history_utf8_bytes": 3658, "recent_frame_times_s": [332.0163333333333, 333.00065, 334.00165, 335.00265, 336.00365, 337.00465, 338.00565, 339.00665, 340.00765, 341.00865, 342.00965, 343.01065, 344.01165, 345.01265, 346.01365, 347.01465, 348.01565, 349.01665, 350.00096666666667, 351.00196666666665, 352.0029666666667, 353.00396666666666, 354.0049666666667, 355.00596666666667, 356.00696666666664, 357.0079666666667, 358.00896666666665, 359.0099666666667, 360.01096666666666, 361.0119666666667], "recent_frames_sha256": "7dd150b44a23d253df83896266fdf3d3e85e33e09d576eb2f38246e676b337e1", "num_recent_frames": 30, "tq": 719409.022775451, "t1": 719417.002035664, "ta": 719417.002035664, "te": 719417.201737663, "first_response_s": 7.979260213091038, "answer_total_s": 8.178962212055922, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 399, "content_group": "e7646a77a71760d382ad63b63a63501ce29b7c41d41fd5e0421d8d47c118e197", "question": {"question_id": "sample_399_a1989_q0", "video_id": 399, "video_path": "./videos/sample_399_real.mp4", "annotation_index": 1989, "question_index": 0, "question": "What notable landmark is visible on the left side of the street right now?", "options": ["A. A statue of liberty.", "B. A large globe structure.", "C. A Ferris wheel.", "D. A library."], "answer": "B", "time_stamp_s": 481, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [480, 485], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_399_a1989_q0", "video_id": 399, "time_stamp_s": 481, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4ec235f0d9b600fc61d02cd0925044095fe17b55fdc4b71e505f32b328eabe94", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [451.0018666666667, 452.00286666666665, 453.0038666666667, 454.00486666666666, 455.0058666666667, 456.00686666666667, 457.00786666666664, 458.0088666666667, 459.00986666666665, 460.0108666666667, 461.01186666666666, 462.01286666666664, 463.0138666666667, 464.01486666666665, 465.0158666666667, 466.0001833333333, 467.00118333333336, 468.00218333333333, 469.0031833333333, 470.00418333333334, 471.0051833333333, 472.00618333333335, 473.00718333333333, 474.0081833333333, 475.00918333333334, 476.0101833333333, 477.01118333333335, 478.0121833333333, 479.01318333333336, 480.01418333333334], "recent_frames_sha256": "b03782d02468c074837d41374991cd81d50bda3563f9eb66b00fa1f85dca9148", "num_recent_frames": 30, "tq": 719300.397806607, "t1": 719310.866501309, "ta": 719310.866501309, "te": 719310.904161648, "first_response_s": 10.46869470202364, "answer_total_s": 10.50635504105594, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_399_a1989_q0", "video_id": 399, "time_stamp_s": 481, "ground_truth": "B", "raw_output": "None of the above.", "prediction": null, "status": "invalid", "format": "unparsed_or_ambiguous", "strict_format_valid": false, "correct": 0, "generation_id": "d5d082e6de849da1369f302f98bddc274df431310a09949e41a0f6bf1ad2d676", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Yellow taxi cab moves forward on wet road, passing parked cars and pedestrians with umbrellas.  \n- A blue bus with \"MIDTOWN\" text on side enters frame from left, traveling in same direction.  \n- Pedestrians cross street at crosswalk; one person walks toward camera while others move away.\n[90-120s] - A white SUV with its brake lights on is stationary in traffic, surrounded by parked cars on both sides.  \n- A blue and yellow bus passes by on the left, moving in the same direction as the camera.  \n- The street is wet from rain, with reflections visible on the pavement and buildings lining the road.\n[120-150s] - A silver sedan drives forward down the wet street, flanked by parked cars on both sides.  \n- Orange construction barriers line the right side of the road, with a blue dumpster visible near the curb.  \n- Bare trees with no leaves line the street, their branches silhouetted against a gray, overcast sky.\n[150-180s] - A white SUV drives forward through a wet street, its brake lights glowing red as it approaches a crosswalk.  \n- Pedestrians with umbrellas cross the street at the crosswalk, some walking briskly while others pause near the curb.  \n- A tall building with a glass facade is visible in the distance, partially obscured by fog or mist.\n[180-210s] - A white pickup truck is stationary at a red light, positioned in the right lane, with its brake lights illuminated.  \n- A yellow construction vehicle is parked on the left side of the street, near the curb, with its engine off.  \n- A tall glass building rises in the background, partially obscured by mist, with no visible movement or activity.\n[210-240s] - A white pickup truck is stationary at a red light on the right side of the road, positioned behind a black SUV.  \n- A yellow construction vehicle is parked on the left side of the street, near the sidewalk.  \n- A pedestrian crosses the street from left to right, moving toward the right side of the frame.\n[240-270s] - A white police car with blue markings is parked on the left side of the street, stationary.  \n- A black SUV and a white pickup truck are visible ahead, moving slowly through the wet intersection.  \n- Pedestrians cross the street at a crosswalk, with one person holding a pink umbrella.\n[270-300s] - Yellow crane remains stationary on left side of street, surrounded by orange cones.  \n- Traffic lights change from red to green, allowing vehicles to proceed through intersection.  \n- Pedestrians cross street at crosswalk as cars move forward, with wet pavement reflecting lights.\n[300-330s] - A silver sedan drives rightward on a wet road, passing a crosswalk with white stripes.  \n- A pedestrian with an umbrella crosses the street at the crosswalk, moving from left to right.  \n- Traffic lights at the intersection show green for the direction of travel, allowing vehicles to proceed.\n[330-360s] - Yellow taxi cab moves rightward across intersection, passing traffic light.\n- Pedestrian in dark coat crosses street at crosswalk, moving left to right.\n- Rain-slicked pavement reflects streetlights and vehicle headlights.\n[360-390s] - Yellow taxis and other vehicles navigate a wet, rain-slicked intersection with visible crosswalk lines.  \n- Pedestrians cross the street at the crosswalk, some holding umbrellas, as traffic lights change.  \n- Tall buildings with reflective glass facades line the street, partially obscured by mist or light rain.\n[390-420s] - Yellow taxi with flashing lights drives forward on wet street, positioned right of center.  \n- White NYPD van is parked on right side of road, partially visible near curb.  \n- Traffic lights show green, allowing vehicles to proceed through intersection.\n[420-450s] - Rain-slicked street reflects red taillights of multiple cars moving forward.  \n- Pedestrians cross at a crosswalk under overcast skies, some holding umbrellas.  \n- Construction barriers with yellow-and-black stripes line the right side of the road.\n[450-480s] - A black SUV is stationary in traffic, its brake lights illuminated, positioned behind a yellow taxi.  \n- A construction zone with yellow-and-white barriers is visible on the right side of the road.  \n- The wet pavement reflects the red brake lights of vehicles, indicating recent rain.", "history_tokens": 991, "history_utf8_bytes": 4241, "recent_frame_times_s": [451.0018666666667, 452.00286666666665, 453.0038666666667, 454.00486666666666, 455.0058666666667, 456.00686666666667, 457.00786666666664, 458.0088666666667, 459.00986666666665, 460.0108666666667, 461.01186666666666, 462.01286666666664, 463.0138666666667, 464.01486666666665, 465.0158666666667, 466.0001833333333, 467.00118333333336, 468.00218333333333, 469.0031833333333, 470.00418333333334, 471.0051833333333, 472.00618333333335, 473.00718333333333, 474.0081833333333, 475.00918333333334, 476.0101833333333, 477.01118333333335, 478.0121833333333, 479.01318333333336, 480.01418333333334], "recent_frames_sha256": "b03782d02468c074837d41374991cd81d50bda3563f9eb66b00fa1f85dca9148", "num_recent_frames": 30, "tq": 719441.495318551, "t1": 719443.630645948, "ta": null, "te": 719443.821258813, "first_response_s": 2.1353273970307782, "answer_total_s": 2.3259402620606124, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 401, "content_group": "873e2ec7db864276b8dfdd826338a219e443d6a0fe3a10ead2c982db5ef79f1b", "question": {"question_id": "sample_401_a1833_q0", "video_id": 401, "video_path": "./videos/sample_401_real.mp4", "annotation_index": 1833, "question_index": 0, "question": "What is the type of vehicle directly in front of the camera?", "options": ["A. A black sedan.", "B. A white bus.", "C. A white SUV.", "D. A white truck."], "answer": "C", "time_stamp_s": 4, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_401_a1833_q0", "video_id": 401, "time_stamp_s": 4, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b9a5734f88c8ada05bd495481458365914bb97486e2d934037c5072dbc83f3cc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.023, 1.0073166666666666, 2.0083166666666665, 3.009316666666667], "recent_frames_sha256": "6d6e85227cf450314bdcfe70a10c7224c226e6f7bb0b0e5aeef8dab80af63fa8", "num_recent_frames": 4, "tq": 716148.009101359, "t1": 716154.991255448, "ta": 716154.991255448, "te": 716155.028859789, "first_response_s": 6.982154088909738, "answer_total_s": 7.019758429960348, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_401_a1833_q0", "video_id": 401, "time_stamp_s": 4, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ebdfcaf512ff04a52b1088149a20b0a71a4df26b4e65426940854d77b65abd30", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.023, 1.0073166666666666, 2.0083166666666665, 3.009316666666667], "recent_frames_sha256": "6d6e85227cf450314bdcfe70a10c7224c226e6f7bb0b0e5aeef8dab80af63fa8", "num_recent_frames": 4, "tq": 715988.351730131, "t1": 715989.214514814, "ta": 715989.214514814, "te": 715989.252077882, "first_response_s": 0.8627846830058843, "answer_total_s": 0.900347750983201, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 401, "content_group": "873e2ec7db864276b8dfdd826338a219e443d6a0fe3a10ead2c982db5ef79f1b", "question": {"question_id": "sample_401_a1834_q0", "video_id": 401, "video_path": "./videos/sample_401_real.mp4", "annotation_index": 1834, "question_index": 0, "question": "Which establishment is next to the \"Happy Family\" restaurant?", "options": ["A. A bakery.", "B. A hair salon & spa.", "C. A nail salon.", "D. A gym."], "answer": "C", "time_stamp_s": 118, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [114, 119], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_401_a1834_q0", "video_id": 401, "time_stamp_s": 118, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8dad3fb69806d8dfdac2a2dcc939a647d2a45e76b379e800ad086281f69a580a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [88.0109, 89.0119, 90.0129, 91.0139, 92.0149, 93.0159, 94.00021666666666, 95.00121666666666, 96.00221666666667, 97.00321666666666, 98.00421666666666, 99.00521666666667, 100.00621666666666, 101.00721666666666, 102.00821666666667, 103.00921666666666, 104.01021666666666, 105.01121666666667, 106.01221666666666, 107.01321666666666, 108.01421666666667, 109.01521666666666, 110.01621666666666, 111.00053333333334, 112.00153333333333, 113.00253333333333, 114.00353333333334, 115.00453333333333, 116.00553333333333, 117.00653333333334], "recent_frames_sha256": "9534fb1cd30a60e9fc5a68b2b7ec752bdbd5c716eb616c0fd8fe854cb6b17418", "num_recent_frames": 30, "tq": 716155.050873809, "t1": 716162.902221384, "ta": 716162.902221384, "te": 716162.939361924, "first_response_s": 7.851347574964166, "answer_total_s": 7.888488114927895, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_401_a1834_q0", "video_id": 401, "time_stamp_s": 118, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9254f4d5d8b97bfbbc1a4aec403a8ee17d60f1c6ded1e24f5f84024a3acb405b", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rain-soaked urban street with wet pavement reflecting vehicle lights and tall buildings in background.  \n- Traffic flows with cars, including a silver sedan and yellow taxis, navigating intersections under overcast skies.  \n- Pedestrians with umbrellas walk along sidewalks near storefronts like Chase Bank, with red-painted bike lanes visible.\n[30-60s] - Silver sedan with yellow license plate stationary at traffic light, rear lights illuminated.  \n- Yellow taxi cab moving slowly in traffic lane ahead, partially obscured by other vehicles.  \n- Pedestrian with umbrella walking along sidewalk, moving away from camera toward right side of frame.\n[60-90s] - A silver sedan with a yellow license plate is stationary on a red-painted lane, facing forward, as rain continues to fall.  \n- Traffic lights change from red to green, allowing vehicles to proceed through the intersection.  \n- Pedestrians are visible crossing the street at the crosswalk, with some holding umbrellas.", "history_tokens": 210, "history_utf8_bytes": 987, "recent_frame_times_s": [88.0109, 89.0119, 90.0129, 91.0139, 92.0149, 93.0159, 94.00021666666666, 95.00121666666666, 96.00221666666667, 97.00321666666666, 98.00421666666666, 99.00521666666667, 100.00621666666666, 101.00721666666666, 102.00821666666667, 103.00921666666666, 104.01021666666666, 105.01121666666667, 106.01221666666666, 107.01321666666666, 108.01421666666667, 109.01521666666666, 110.01621666666666, 111.00053333333334, 112.00153333333333, 113.00253333333333, 114.00353333333334, 115.00453333333333, 116.00553333333333, 117.00653333333334], "recent_frames_sha256": "9534fb1cd30a60e9fc5a68b2b7ec752bdbd5c716eb616c0fd8fe854cb6b17418", "num_recent_frames": 30, "tq": 716018.388502049, "t1": 716020.209208873, "ta": 716020.209208873, "te": 716020.395699577, "first_response_s": 1.8207068239571527, "answer_total_s": 2.007197528029792, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 401, "content_group": "873e2ec7db864276b8dfdd826338a219e443d6a0fe3a10ead2c982db5ef79f1b", "question": {"question_id": "sample_401_a1835_q0", "video_id": 401, "video_path": "./videos/sample_401_real.mp4", "annotation_index": 1835, "question_index": 0, "question": "What is the color of the traffic light right now?", "options": ["A. Green.", "B. Yellow.", "C. Red.", "D. Blue."], "answer": "A", "time_stamp_s": 242, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [228, 233], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_401_a1835_q0", "video_id": 401, "time_stamp_s": 242, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c4ceb86f9c786b39bbfa6b2d346e6b36f7310c1976ce3cffb378fdc03738cae0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [212.00143333333332, 213.00243333333333, 214.00343333333333, 215.00443333333334, 216.00543333333334, 217.00643333333332, 218.00743333333332, 219.00843333333333, 220.00943333333333, 221.01043333333334, 222.01143333333334, 223.01243333333332, 224.01343333333332, 225.01443333333333, 226.01543333333333, 227.01643333333334, 228.00075, 229.00175, 230.00275, 231.00375, 232.00475, 233.00575, 234.00675, 235.00775, 236.00875, 237.00975, 238.01075, 239.01175, 240.01275, 241.01375], "recent_frames_sha256": "c9c2143d5e9901da1d190823243f784045e46ccca6309cad40bf20d604aae3c8", "num_recent_frames": 30, "tq": 716162.955562681, "t1": 716176.539119105, "ta": 716176.539119105, "te": 716176.576655794, "first_response_s": 13.583556424011476, "answer_total_s": 13.621093113091774, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_401_a1835_q0", "video_id": 401, "time_stamp_s": 242, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f456920922123205a1beba30b53ed0ae2f7632d73a6b9aec764dcb4449d7513a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rain-soaked urban street with wet pavement reflecting vehicle lights and tall buildings in background.  \n- Traffic flows with cars, including a silver sedan and yellow taxis, navigating intersections under overcast skies.  \n- Pedestrians with umbrellas walk along sidewalks near storefronts like Chase Bank, with red-painted bike lanes visible.\n[30-60s] - Silver sedan with yellow license plate stationary at traffic light, rear lights illuminated.  \n- Yellow taxi cab moving slowly in traffic lane ahead, partially obscured by other vehicles.  \n- Pedestrian with umbrella walking along sidewalk, moving away from camera toward right side of frame.\n[60-90s] - A silver sedan with a yellow license plate is stationary on a red-painted lane, facing forward, as rain continues to fall.  \n- Traffic lights change from red to green, allowing vehicles to proceed through the intersection.  \n- Pedestrians are visible crossing the street at the crosswalk, with some holding umbrellas.\n[90-120s] - A black SUV is parked on the right side of the street, facing the camera, with its brake lights illuminated.  \n- A person in a dark coat walks across the crosswalk from left to right, passing in front of the \"Rozzi\" storefront.  \n- The \"Rozzi\" storefront, with its green awning and \"The Shoe King\" sign, is visible on the left, with yellow and blue mailboxes nearby.\n[120-150s] - Vehicles, including a black SUV and a beige pickup truck, are stationary or moving slowly in traffic on a wet street.  \n- Pedestrians are visible crossing the street at a crosswalk, with traffic lights changing from green to red.  \n- Buildings with storefronts, such as \"Ronal\" and \"Café\", line the street, and rain is visibly falling.\n[150-180s] - A cyclist rides across the wet street, passing a red traffic light.  \n- A pedestrian with an umbrella crosses the street, moving from left to right.  \n- A blue car drives past the crosswalk, its headlights reflecting on the wet pavement.\n[180-210s] - A white SUV passes left to right across the wet street, followed by a black sedan.  \n- A yellow taxi cab moves forward in the center lane, with other vehicles in adjacent lanes.  \n- Traffic lights change from red to green, allowing vehicles to proceed through the intersection.\n[210-240s] - A gold SUV drives forward on a wet city street, its brake lights illuminated as it approaches an intersection.  \n- Yellow taxis and other vehicles, including a white delivery truck, are visible in traffic, with some cars turning or waiting at the intersection.  \n- Pedestrians are seen crossing the street at a crosswalk, with traffic lights changing from red to green.", "history_tokens": 611, "history_utf8_bytes": 2641, "recent_frame_times_s": [212.00143333333332, 213.00243333333333, 214.00343333333333, 215.00443333333334, 216.00543333333334, 217.00643333333332, 218.00743333333332, 219.00843333333333, 220.00943333333333, 221.01043333333334, 222.01143333333334, 223.01243333333332, 224.01343333333332, 225.01443333333333, 226.01543333333333, 227.01643333333334, 228.00075, 229.00175, 230.00275, 231.00375, 232.00475, 233.00575, 234.00675, 235.00775, 236.00875, 237.00975, 238.01075, 239.01175, 240.01275, 241.01375], "recent_frames_sha256": "c9c2143d5e9901da1d190823243f784045e46ccca6309cad40bf20d604aae3c8", "num_recent_frames": 30, "tq": 716064.058177948, "t1": 716071.212883655, "ta": 716071.212883655, "te": 716071.251951165, "first_response_s": 7.154705706983805, "answer_total_s": 7.193773217033595, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 401, "content_group": "873e2ec7db864276b8dfdd826338a219e443d6a0fe3a10ead2c982db5ef79f1b", "question": {"question_id": "sample_401_a1836_q0", "video_id": 401, "video_path": "./videos/sample_401_real.mp4", "annotation_index": 1836, "question_index": 0, "question": "What is the make of the white truck parked on the right side?", "options": ["A. U-Haul.", "B. Ryder.", "C. Penske.", "D. Budget."], "answer": "B", "time_stamp_s": 345, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [342, 347], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_401_a1836_q0", "video_id": 401, "time_stamp_s": 345, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fe7c940b839cfdfc1b4a89d562c113bffc757301e36381443930a81d7e662056", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [315.0043333333333, 316.00533333333334, 317.0063333333333, 318.00733333333335, 319.0083333333333, 320.00933333333336, 321.01033333333334, 322.0113333333333, 323.01233333333334, 324.0133333333333, 325.01433333333335, 326.01533333333333, 327.0163333333333, 328.00065, 329.00165, 330.00265, 331.00365, 332.00465, 333.00565, 334.00665, 335.00765, 336.00865, 337.00965, 338.01065, 339.01165, 340.01265, 341.01365, 342.01465, 343.01565, 344.01665], "recent_frames_sha256": "02ae1365019122c1c17880caf3e20e0f9aa951ea74ec06f9e627ccebb1ccc83c", "num_recent_frames": 30, "tq": 716176.589539402, "t1": 716188.839733877, "ta": 716188.839733877, "te": 716188.877076798, "first_response_s": 12.250194474938326, "answer_total_s": 12.287537395954132, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_401_a1836_q0", "video_id": 401, "time_stamp_s": 345, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "05ab0e9f4edcd7e229fefcf6c0663d088b1b579a3970a6ec2ae52c533368d771", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rain-soaked urban street with wet pavement reflecting vehicle lights and tall buildings in background.  \n- Traffic flows with cars, including a silver sedan and yellow taxis, navigating intersections under overcast skies.  \n- Pedestrians with umbrellas walk along sidewalks near storefronts like Chase Bank, with red-painted bike lanes visible.\n[30-60s] - Silver sedan with yellow license plate stationary at traffic light, rear lights illuminated.  \n- Yellow taxi cab moving slowly in traffic lane ahead, partially obscured by other vehicles.  \n- Pedestrian with umbrella walking along sidewalk, moving away from camera toward right side of frame.\n[60-90s] - A silver sedan with a yellow license plate is stationary on a red-painted lane, facing forward, as rain continues to fall.  \n- Traffic lights change from red to green, allowing vehicles to proceed through the intersection.  \n- Pedestrians are visible crossing the street at the crosswalk, with some holding umbrellas.\n[90-120s] - A black SUV is parked on the right side of the street, facing the camera, with its brake lights illuminated.  \n- A person in a dark coat walks across the crosswalk from left to right, passing in front of the \"Rozzi\" storefront.  \n- The \"Rozzi\" storefront, with its green awning and \"The Shoe King\" sign, is visible on the left, with yellow and blue mailboxes nearby.\n[120-150s] - Vehicles, including a black SUV and a beige pickup truck, are stationary or moving slowly in traffic on a wet street.  \n- Pedestrians are visible crossing the street at a crosswalk, with traffic lights changing from green to red.  \n- Buildings with storefronts, such as \"Ronal\" and \"Café\", line the street, and rain is visibly falling.\n[150-180s] - A cyclist rides across the wet street, passing a red traffic light.  \n- A pedestrian with an umbrella crosses the street, moving from left to right.  \n- A blue car drives past the crosswalk, its headlights reflecting on the wet pavement.\n[180-210s] - A white SUV passes left to right across the wet street, followed by a black sedan.  \n- A yellow taxi cab moves forward in the center lane, with other vehicles in adjacent lanes.  \n- Traffic lights change from red to green, allowing vehicles to proceed through the intersection.\n[210-240s] - A gold SUV drives forward on a wet city street, its brake lights illuminated as it approaches an intersection.  \n- Yellow taxis and other vehicles, including a white delivery truck, are visible in traffic, with some cars turning or waiting at the intersection.  \n- Pedestrians are seen crossing the street at a crosswalk, with traffic lights changing from red to green.\n[240-270s] - Yellow taxis and a white SUV are stopped at a red light on a wet city street.  \n- A tall building looms in the background, with bare trees lining the road.  \n- Traffic is dense, with cars and vans waiting, and a bus stop visible on the right.\n[270-300s] - Yellow taxis and a white SUV are stationary in traffic on a wet street, with red traffic lights visible.  \n- A tall building with \"BROOKLYN\" signage stands on the left, while a construction barrier lines the right side of the road.  \n- Rain is falling, and pedestrians are visible crossing the street near the center.\n[300-330s] - Yellow taxis and other vehicles navigate a wet urban street with traffic lights and crosswalks.  \n- A tall modern building stands prominently in the background, contrasting with older brick structures.  \n- Raindrops are visible on the windshield, indicating ongoing precipitation.", "history_tokens": 820, "history_utf8_bytes": 3522, "recent_frame_times_s": [315.0043333333333, 316.00533333333334, 317.0063333333333, 318.00733333333335, 319.0083333333333, 320.00933333333336, 321.01033333333334, 322.0113333333333, 323.01233333333334, 324.0133333333333, 325.01433333333335, 326.01533333333333, 327.0163333333333, 328.00065, 329.00165, 330.00265, 331.00365, 332.00465, 333.00565, 334.00665, 335.00765, 336.00865, 337.00965, 338.01065, 339.01165, 340.01265, 341.01365, 342.01465, 343.01565, 344.01665], "recent_frames_sha256": "02ae1365019122c1c17880caf3e20e0f9aa951ea74ec06f9e627ccebb1ccc83c", "num_recent_frames": 30, "tq": 716100.390142381, "t1": 716108.803631728, "ta": 716108.803631728, "te": 716108.844322858, "first_response_s": 8.413489347090945, "answer_total_s": 8.454180477070622, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 401, "content_group": "873e2ec7db864276b8dfdd826338a219e443d6a0fe3a10ead2c982db5ef79f1b", "question": {"question_id": "sample_401_a1837_q0", "video_id": 401, "video_path": "./videos/sample_401_real.mp4", "annotation_index": 1837, "question_index": 0, "question": "What brand is the white truck directly ahead right now?", "options": ["A. U-Haul.", "B. Ryder.", "C. Penske.", "D. Hill-Rom."], "answer": "D", "time_stamp_s": 460, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [456, 461], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_401_a1837_q0", "video_id": 401, "time_stamp_s": 460, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "10833b3e3281062b47c784c83d09a54a43c1dc057c972f1bf1c268cba2057da5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [430.00255, 431.00355, 432.00455, 433.00555, 434.00655, 435.00755, 436.00855, 437.00955, 438.01055, 439.01155, 440.01255, 441.01355, 442.01455, 443.01555, 444.01655, 445.00086666666664, 446.0018666666667, 447.00286666666665, 448.0038666666667, 449.00486666666666, 450.0058666666667, 451.00686666666667, 452.00786666666664, 453.0088666666667, 454.00986666666665, 455.0108666666667, 456.01186666666666, 457.01286666666664, 458.0138666666667, 459.01486666666665], "recent_frames_sha256": "12fac2d7003d96edffd4f2e22059adb3be2a4f199bd9d500e32f28ec88665abb", "num_recent_frames": 30, "tq": 716188.894700359, "t1": 716199.707385751, "ta": 716199.707385751, "te": 716199.744447853, "first_response_s": 10.812685391982086, "answer_total_s": 10.849747493979521, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_401_a1837_q0", "video_id": 401, "time_stamp_s": 460, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "24151e3055dd8afb0619a41dbf736c57def43e245d81ecc4196d107d76a7acd1", "condition_order": ["notes", "recent"], "memory": "[60-90s] - A silver sedan with a yellow license plate is stationary on a red-painted lane, facing forward, as rain continues to fall.  \n- Traffic lights change from red to green, allowing vehicles to proceed through the intersection.  \n- Pedestrians are visible crossing the street at the crosswalk, with some holding umbrellas.\n[90-120s] - A black SUV is parked on the right side of the street, facing the camera, with its brake lights illuminated.  \n- A person in a dark coat walks across the crosswalk from left to right, passing in front of the \"Rozzi\" storefront.  \n- The \"Rozzi\" storefront, with its green awning and \"The Shoe King\" sign, is visible on the left, with yellow and blue mailboxes nearby.\n[120-150s] - Vehicles, including a black SUV and a beige pickup truck, are stationary or moving slowly in traffic on a wet street.  \n- Pedestrians are visible crossing the street at a crosswalk, with traffic lights changing from green to red.  \n- Buildings with storefronts, such as \"Ronal\" and \"Café\", line the street, and rain is visibly falling.\n[150-180s] - A cyclist rides across the wet street, passing a red traffic light.  \n- A pedestrian with an umbrella crosses the street, moving from left to right.  \n- A blue car drives past the crosswalk, its headlights reflecting on the wet pavement.\n[180-210s] - A white SUV passes left to right across the wet street, followed by a black sedan.  \n- A yellow taxi cab moves forward in the center lane, with other vehicles in adjacent lanes.  \n- Traffic lights change from red to green, allowing vehicles to proceed through the intersection.\n[210-240s] - A gold SUV drives forward on a wet city street, its brake lights illuminated as it approaches an intersection.  \n- Yellow taxis and other vehicles, including a white delivery truck, are visible in traffic, with some cars turning or waiting at the intersection.  \n- Pedestrians are seen crossing the street at a crosswalk, with traffic lights changing from red to green.\n[240-270s] - Yellow taxis and a white SUV are stopped at a red light on a wet city street.  \n- A tall building looms in the background, with bare trees lining the road.  \n- Traffic is dense, with cars and vans waiting, and a bus stop visible on the right.\n[270-300s] - Yellow taxis and a white SUV are stationary in traffic on a wet street, with red traffic lights visible.  \n- A tall building with \"BROOKLYN\" signage stands on the left, while a construction barrier lines the right side of the road.  \n- Rain is falling, and pedestrians are visible crossing the street near the center.\n[300-330s] - Yellow taxis and other vehicles navigate a wet urban street with traffic lights and crosswalks.  \n- A tall modern building stands prominently in the background, contrasting with older brick structures.  \n- Raindrops are visible on the windshield, indicating ongoing precipitation.\n[330-360s] - Yellow taxi cab moves forward on wet street, reflecting ambient light.  \n- Black SUV with \"NYC\" license plate drives alongside, maintaining lane position.  \n- Traffic flows steadily with mixed vehicle types, including trucks and sedans, under overcast sky.\n[360-390s] - Yellow taxi cab moves forward in traffic, positioned between other vehicles on a wet city street.  \n- A white van is visible on the left side of the road, stationary or moving slowly.  \n- Pedestrians are seen crossing the street at a crosswalk, with one person holding an umbrella.\n[390-420s] - Yellow taxis and black SUVs are stationary at a red light on a wet, reflective street.  \n- A tall building looms in the background, partially obscured by mist or fog.  \n- Traffic lights and street signs are visible, with no pedestrians crossing the street.\n[420-450s] - A yellow taxi cab is stationary at the intersection, positioned between two black SUVs, with its brake lights illuminated.  \n- The road surface is wet, reflecting the overcast sky and surrounding buildings, indicating recent rain.  \n- Traffic lights are visible ahead, showing red, signaling vehicles to stop, including the central taxi and surrounding cars.", "history_tokens": 962, "history_utf8_bytes": 4070, "recent_frame_times_s": [430.00255, 431.00355, 432.00455, 433.00555, 434.00655, 435.00755, 436.00855, 437.00955, 438.01055, 439.01155, 440.01255, 441.01355, 442.01455, 443.01555, 444.01655, 445.00086666666664, 446.0018666666667, 447.00286666666665, 448.0038666666667, 449.00486666666666, 450.0058666666667, 451.00686666666667, 452.00786666666664, 453.0088666666667, 454.00986666666665, 455.0108666666667, 456.01186666666666, 457.01286666666664, 458.0138666666667, 459.01486666666665], "recent_frames_sha256": "12fac2d7003d96edffd4f2e22059adb3be2a4f199bd9d500e32f28ec88665abb", "num_recent_frames": 30, "tq": 716146.160047769, "t1": 716147.672905931, "ta": 716147.672905931, "te": 716147.974766901, "first_response_s": 1.512858162051998, "answer_total_s": 1.814719132031314, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 402, "content_group": "e9ec34a0957123673f2aa3bdcd339f9b6fce763b172adfb112373fab419af1ff", "question": {"question_id": "sample_402_a332_q0", "video_id": 402, "video_path": "./videos/sample_402_real.mp4", "annotation_index": 332, "question_index": 0, "question": "Which famous fast-food chain's logo can be seen on the left side of the street right now?", "options": ["A. Starbucks.", "B. McDonald's.", "C. Subway.", "D. Chipotle."], "answer": "D", "time_stamp_s": 4, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_402_a332_q0", "video_id": 402, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c85f4dfee25f35d364b6a5e1f83f6651477e22f57f885a32fc99fd9404f41de6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.039, 1.0066333333333333, 2.007633333333333, 3.0086333333333335], "recent_frames_sha256": "2150d047be6bb0349f73e70439ed17f3d4d55c56ca6483b90872b87f2a78b982", "num_recent_frames": 4, "tq": 719669.693716468, "t1": 719675.895893172, "ta": 719675.895893172, "te": 719675.934426056, "first_response_s": 6.202176703955047, "answer_total_s": 6.240709587931633, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_402_a332_q0", "video_id": 402, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7cec36feee388fe7623fb8177b19134f414df46afe32613c1dfaae02935460c6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.039, 1.0066333333333333, 2.007633333333333, 3.0086333333333335], "recent_frames_sha256": "2150d047be6bb0349f73e70439ed17f3d4d55c56ca6483b90872b87f2a78b982", "num_recent_frames": 4, "tq": 719511.68032218, "t1": 719523.521520899, "ta": 719523.521520899, "te": 719523.890479568, "first_response_s": 11.8411987189902, "answer_total_s": 12.210157388006337, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 402, "content_group": "e9ec34a0957123673f2aa3bdcd339f9b6fce763b172adfb112373fab419af1ff", "question": {"question_id": "sample_402_a333_q0", "video_id": 402, "video_path": "./videos/sample_402_real.mp4", "annotation_index": 333, "question_index": 0, "question": "What is the color of the traffic light right now?", "options": ["A. Red.", "B. Yellow.", "C. Blue.", "D. Green."], "answer": "D", "time_stamp_s": 63, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [118, 123], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_402_a333_q0", "video_id": 402, "time_stamp_s": 63, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8d83e53a7d640a590c8c31dfcadc9c32f2898abea9f0b6781acd9d1492e995d4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [33.005266666666664, 34.00626666666667, 35.007266666666666, 36.008266666666664, 37.00926666666667, 38.010266666666666, 39.011266666666664, 40.01226666666667, 41.01326666666667, 42.014266666666664, 43.01526666666667, 44.01626666666667, 45.00058333333333, 46.001583333333336, 47.002583333333334, 48.00358333333333, 49.004583333333336, 50.005583333333334, 51.00658333333333, 52.007583333333336, 53.008583333333334, 54.00958333333333, 55.01058333333334, 56.011583333333334, 57.01258333333333, 58.01358333333334, 59.014583333333334, 60.01558333333333, 61.01658333333334, 62.0009], "recent_frames_sha256": "e201e62061c1441911bd7180d8830ab671a96c7c42908f49c299f0d0aae4e232", "num_recent_frames": 30, "tq": 719675.947194553, "t1": 719683.506727062, "ta": 719683.506727062, "te": 719683.546203185, "first_response_s": 7.5595325090689585, "answer_total_s": 7.599008632008918, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_402_a333_q0", "video_id": 402, "time_stamp_s": 63, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "36d759a5b3975e38c15678f15b7426ee99894537dd3fdb4af898638f8ab4d4e0", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rain-soaked urban street with vehicles, including a black SUV and a white delivery truck, moving through traffic under overcast skies.  \n- Pedestrians with umbrellas cross the street at intersections, while a cyclist navigates through traffic near a traffic light.  \n- Tall buildings line both sides of the road, with a prominent skyscraper visible in the distance, and street signs and banners are intermittently visible.\n[30-60s] - Yellow bus moves forward slowly, following traffic on wet street.  \n- Raindrops streak across windshield, obscuring distant buildings and street signs.  \n- Pedestrians cross at crosswalks, some holding umbrellas, as vehicles navigate the wet road.", "history_tokens": 151, "history_utf8_bytes": 691, "recent_frame_times_s": [33.005266666666664, 34.00626666666667, 35.007266666666666, 36.008266666666664, 37.00926666666667, 38.010266666666666, 39.011266666666664, 40.01226666666667, 41.01326666666667, 42.014266666666664, 43.01526666666667, 44.01626666666667, 45.00058333333333, 46.001583333333336, 47.002583333333334, 48.00358333333333, 49.004583333333336, 50.005583333333334, 51.00658333333333, 52.007583333333336, 53.008583333333334, 54.00958333333333, 55.01058333333334, 56.011583333333334, 57.01258333333333, 58.01358333333334, 59.014583333333334, 60.01558333333333, 61.01658333333334, 62.0009], "recent_frames_sha256": "e201e62061c1441911bd7180d8830ab671a96c7c42908f49c299f0d0aae4e232", "num_recent_frames": 30, "tq": 719541.119939013, "t1": 719548.637594934, "ta": 719548.637594934, "te": 719548.942106765, "first_response_s": 7.517655920935795, "answer_total_s": 7.822167751961388, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 402, "content_group": "e9ec34a0957123673f2aa3bdcd339f9b6fce763b172adfb112373fab419af1ff", "question": {"question_id": "sample_402_a334_q0", "video_id": 402, "video_path": "./videos/sample_402_real.mp4", "annotation_index": 334, "question_index": 0, "question": "What is the name of the parking facility visible on the street sign right now?", "options": ["A. Central Parking.", "B. Manhattan Parking.", "C. New York Parking.", "D. Lincoln Center Parking."], "answer": "D", "time_stamp_s": 236, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [236, 241], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_402_a334_q0", "video_id": 402, "time_stamp_s": 236, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "606462b8a73b09b8a672dbc315782c1c77a71eb5d9f818152c5c4f3d91629163", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [206.01143333333334, 207.01243333333332, 208.01343333333332, 209.01443333333333, 210.01543333333333, 211.01643333333334, 212.00075, 213.00175, 214.00275, 215.00375, 216.00475, 217.00575, 218.00675, 219.00775, 220.00875, 221.00975, 222.01075, 223.01175, 224.01275, 225.01375, 226.01475, 227.01575, 228.00006666666667, 229.00106666666667, 230.00206666666668, 231.00306666666665, 232.00406666666666, 233.00506666666666, 234.00606666666667, 235.00706666666667], "recent_frames_sha256": "b2890a800c7a20ba3439924f15228cf14a4a58d1057542fe011cd4347afd6ce1", "num_recent_frames": 30, "tq": 719683.560376381, "t1": 719690.521297242, "ta": 719690.521297242, "te": 719690.559561343, "first_response_s": 6.960920860990882, "answer_total_s": 6.999184962012805, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_402_a334_q0", "video_id": 402, "time_stamp_s": 236, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "902eff07e8840d9b2c4fd463d44c9522a5f8b49d153fa393799e1876ba0f9a32", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rain-soaked urban street with vehicles, including a black SUV and a white delivery truck, moving through traffic under overcast skies.  \n- Pedestrians with umbrellas cross the street at intersections, while a cyclist navigates through traffic near a traffic light.  \n- Tall buildings line both sides of the road, with a prominent skyscraper visible in the distance, and street signs and banners are intermittently visible.\n[30-60s] - Yellow bus moves forward slowly, following traffic on wet street.  \n- Raindrops streak across windshield, obscuring distant buildings and street signs.  \n- Pedestrians cross at crosswalks, some holding umbrellas, as vehicles navigate the wet road.\n[60-90s] - Vehicles, including a black SUV and a yellow taxi, move slowly through wet streets with red brake lights reflecting on the pavement.  \n- A blue hybrid bus with \"HYBRID\" text on its side passes by on the right, while construction barriers and orange cones are visible on the sidewalk.  \n- Tall buildings line both sides of the street, with bare trees and a distant skyscraper partially obscured by fog or mist.\n[90-120s] - Rain-slicked street reflects red taillights of multiple cars, including a black SUV with a visible New York license plate.  \n- A yellow taxi and a white van move slowly through traffic, with a bus partially visible behind them.  \n- Tall glass skyscrapers dominate the background, with bare trees lining the sidewalk on the right.\n[120-150s] - Rain-slicked street reflects red brake lights of stopped cars, including a black SUV with a visible New York license plate.  \n- Pedestrians cross at a crosswalk under overcast skies, with a yellow taxi navigating traffic near a modern building entrance.  \n- A covered pedestrian bridge spans the road, with signage indicating “Palm Beach” and “B” on a nearby structure.\n[150-180s] - A yellow school bus is stationary in the center of a wet, congested urban street, surrounded by parked and moving vehicles.  \n- Rainwater reflects off the road surface, creating a glossy sheen, with brake lights from surrounding cars glowing red.  \n- Tall modern buildings and bare trees line the street, with an overpass visible on the right side of the frame.\n[180-210s] - Yellow taxi cab moves forward on wet street, positioned behind a yellow school bus.  \n- A blue bus appears on the right, approaching the intersection as traffic signals turn green.  \n- Pedestrians with umbrellas cross the street at a crosswalk, visible near the curb on the left.", "history_tokens": 570, "history_utf8_bytes": 2513, "recent_frame_times_s": [206.01143333333334, 207.01243333333332, 208.01343333333332, 209.01443333333333, 210.01543333333333, 211.01643333333334, 212.00075, 213.00175, 214.00275, 215.00375, 216.00475, 217.00575, 218.00675, 219.00775, 220.00875, 221.00975, 222.01075, 223.01175, 224.01275, 225.01375, 226.01475, 227.01575, 228.00006666666667, 229.00106666666667, 230.00206666666668, 231.00306666666665, 232.00406666666666, 233.00506666666666, 234.00606666666667, 235.00706666666667], "recent_frames_sha256": "b2890a800c7a20ba3439924f15228cf14a4a58d1057542fe011cd4347afd6ce1", "num_recent_frames": 30, "tq": 719587.868100252, "t1": 719589.67579146, "ta": 719589.67579146, "te": 719589.718751425, "first_response_s": 1.8076912079704925, "answer_total_s": 1.8506511730374768, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 402, "content_group": "e9ec34a0957123673f2aa3bdcd339f9b6fce763b172adfb112373fab419af1ff", "question": {"question_id": "sample_402_a335_q0", "video_id": 402, "video_path": "./videos/sample_402_real.mp4", "annotation_index": 335, "question_index": 0, "question": "What type of weather condition is being experienced right now?", "options": ["A. Sunny and clear.", "B. Snowy and blowing.", "C. Foggy and misty.", "D. Rainy and wet."], "answer": "D", "time_stamp_s": 357, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [354, 359], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_402_a335_q0", "video_id": 402, "time_stamp_s": 357, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b802e56d001221a07dcacc287e7e3a1c2f21c0b88da7a0d6f3a5fb9b4bdf399d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [327.01565, 328.01665, 329.00096666666667, 330.00196666666665, 331.0029666666667, 332.00396666666666, 333.0049666666667, 334.00596666666667, 335.00696666666664, 336.0079666666667, 337.00896666666665, 338.0099666666667, 339.01096666666666, 340.0119666666667, 341.01296666666667, 342.01396666666665, 343.0149666666667, 344.01596666666666, 345.00028333333336, 346.00128333333333, 347.0022833333333, 348.00328333333334, 349.0042833333333, 350.00528333333335, 351.00628333333333, 352.0072833333333, 353.00828333333334, 354.0092833333333, 355.01028333333335, 356.0112833333333], "recent_frames_sha256": "847e6a097b424471e3855ab14cdd2ac4955b164615df047b0c963e1c91e83f78", "num_recent_frames": 30, "tq": 719690.569849735, "t1": 719700.139940417, "ta": 719700.139940417, "te": 719700.180415517, "first_response_s": 9.57009068201296, "answer_total_s": 9.610565781942569, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_402_a335_q0", "video_id": 402, "time_stamp_s": 357, "ground_truth": "D", "raw_output": "D. Rainy and wet.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "479b0a48b9484d73ef361e630bc02c1ade4a328f629148cba00b0db96b30e563", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rain-soaked urban street with vehicles, including a black SUV and a white delivery truck, moving through traffic under overcast skies.  \n- Pedestrians with umbrellas cross the street at intersections, while a cyclist navigates through traffic near a traffic light.  \n- Tall buildings line both sides of the road, with a prominent skyscraper visible in the distance, and street signs and banners are intermittently visible.\n[30-60s] - Yellow bus moves forward slowly, following traffic on wet street.  \n- Raindrops streak across windshield, obscuring distant buildings and street signs.  \n- Pedestrians cross at crosswalks, some holding umbrellas, as vehicles navigate the wet road.\n[60-90s] - Vehicles, including a black SUV and a yellow taxi, move slowly through wet streets with red brake lights reflecting on the pavement.  \n- A blue hybrid bus with \"HYBRID\" text on its side passes by on the right, while construction barriers and orange cones are visible on the sidewalk.  \n- Tall buildings line both sides of the street, with bare trees and a distant skyscraper partially obscured by fog or mist.\n[90-120s] - Rain-slicked street reflects red taillights of multiple cars, including a black SUV with a visible New York license plate.  \n- A yellow taxi and a white van move slowly through traffic, with a bus partially visible behind them.  \n- Tall glass skyscrapers dominate the background, with bare trees lining the sidewalk on the right.\n[120-150s] - Rain-slicked street reflects red brake lights of stopped cars, including a black SUV with a visible New York license plate.  \n- Pedestrians cross at a crosswalk under overcast skies, with a yellow taxi navigating traffic near a modern building entrance.  \n- A covered pedestrian bridge spans the road, with signage indicating “Palm Beach” and “B” on a nearby structure.\n[150-180s] - A yellow school bus is stationary in the center of a wet, congested urban street, surrounded by parked and moving vehicles.  \n- Rainwater reflects off the road surface, creating a glossy sheen, with brake lights from surrounding cars glowing red.  \n- Tall modern buildings and bare trees line the street, with an overpass visible on the right side of the frame.\n[180-210s] - Yellow taxi cab moves forward on wet street, positioned behind a yellow school bus.  \n- A blue bus appears on the right, approaching the intersection as traffic signals turn green.  \n- Pedestrians with umbrellas cross the street at a crosswalk, visible near the curb on the left.\n[210-240s] - A silver pickup truck is stationary at a red light, positioned between a yellow taxi and a blue bus.  \n- A food truck is parked on the left side of the street, near a crosswalk.  \n- Pedestrians are crossing the street at the crosswalk, with some waiting at the curb.\n[240-270s] - A silver pickup truck drives forward on a wet city street, its brake lights glowing red as it approaches an intersection.  \n- A yellow taxi is visible to the right, moving in the same direction, with its rear lights also illuminated.  \n- Construction barriers with blue tarps line the left side of the road, indicating ongoing roadwork or maintenance.\n[270-300s] - Rain-slicked street reflects vehicle taillights as cars move slowly through an urban intersection.  \n- Construction scaffolding lines the right side of the road, with orange traffic barriers visible along the left.  \n- Pedestrians walk on sidewalks under overcast skies, with bare trees lining the street.\n[300-330s] - A black pickup truck with red brake lights is driving ahead on a wet road, its rear visible to the camera.  \n- A yellow taxi and a white van pass the truck on the left, while a dark sedan follows closely behind.  \n- The road curves slightly to the right, bordered by a stone wall and bare trees under overcast skies.", "history_tokens": 877, "history_utf8_bytes": 3807, "recent_frame_times_s": [327.01565, 328.01665, 329.00096666666667, 330.00196666666665, 331.0029666666667, 332.00396666666666, 333.0049666666667, 334.00596666666667, 335.00696666666664, 336.0079666666667, 337.00896666666665, 338.0099666666667, 339.01096666666666, 340.0119666666667, 341.01296666666667, 342.01396666666665, 343.0149666666667, 344.01596666666666, 345.00028333333336, 346.00128333333333, 347.0022833333333, 348.00328333333334, 349.0042833333333, 350.00528333333335, 351.00628333333333, 352.0072833333333, 353.00828333333334, 354.0092833333333, 355.01028333333335, 356.0112833333333], "recent_frames_sha256": "847e6a097b424471e3855ab14cdd2ac4955b164615df047b0c963e1c91e83f78", "num_recent_frames": 30, "tq": 719626.987612672, "t1": 719633.776295806, "ta": 719633.776295806, "te": 719634.076603349, "first_response_s": 6.788683134014718, "answer_total_s": 7.088990676915273, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 402, "content_group": "e9ec34a0957123673f2aa3bdcd339f9b6fce763b172adfb112373fab419af1ff", "question": {"question_id": "sample_402_a336_q0", "video_id": 402, "video_path": "./videos/sample_402_real.mp4", "annotation_index": 336, "question_index": 0, "question": "Which type of vehicle can be seen parked on the left side of the street right now?", "options": ["A. A truck.", "B. A bicycle.", "C. A white car.", "D. A motorcycle."], "answer": "C", "time_stamp_s": 473, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [472, 477], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_402_a336_q0", "video_id": 402, "time_stamp_s": 473, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d626a34bc2e6bff4f08f44475e345e222d19addb6745baccb2decc10fe0c3f03", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [443.01486666666665, 444.0158666666667, 445.0001833333333, 446.00118333333336, 447.00218333333333, 448.0031833333333, 449.00418333333334, 450.0051833333333, 451.00618333333335, 452.00718333333333, 453.0081833333333, 454.00918333333334, 455.0101833333333, 456.01118333333335, 457.0121833333333, 458.01318333333336, 459.01418333333334, 460.0151833333333, 461.01618333333334, 462.0005, 463.0015, 464.0025, 465.0035, 466.0045, 467.0055, 468.0065, 469.0075, 470.0085, 471.0095, 472.0105], "recent_frames_sha256": "1ee15a2da3972655d360e31040c8390fc7a96cad8128e26afaf19786456a6823", "num_recent_frames": 30, "tq": 719700.191049135, "t1": 719706.505288042, "ta": 719706.505288042, "te": 719706.543372308, "first_response_s": 6.314238906954415, "answer_total_s": 6.352323172963224, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_402_a336_q0", "video_id": 402, "time_stamp_s": 473, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8b0f87c63a72bd5fbbcd4248fcd30520755906f7867ac2b5d9ee5c4a9e04d7e5", "condition_order": ["notes", "recent"], "memory": "[90-120s] - Rain-slicked street reflects red taillights of multiple cars, including a black SUV with a visible New York license plate.  \n- A yellow taxi and a white van move slowly through traffic, with a bus partially visible behind them.  \n- Tall glass skyscrapers dominate the background, with bare trees lining the sidewalk on the right.\n[120-150s] - Rain-slicked street reflects red brake lights of stopped cars, including a black SUV with a visible New York license plate.  \n- Pedestrians cross at a crosswalk under overcast skies, with a yellow taxi navigating traffic near a modern building entrance.  \n- A covered pedestrian bridge spans the road, with signage indicating “Palm Beach” and “B” on a nearby structure.\n[150-180s] - A yellow school bus is stationary in the center of a wet, congested urban street, surrounded by parked and moving vehicles.  \n- Rainwater reflects off the road surface, creating a glossy sheen, with brake lights from surrounding cars glowing red.  \n- Tall modern buildings and bare trees line the street, with an overpass visible on the right side of the frame.\n[180-210s] - Yellow taxi cab moves forward on wet street, positioned behind a yellow school bus.  \n- A blue bus appears on the right, approaching the intersection as traffic signals turn green.  \n- Pedestrians with umbrellas cross the street at a crosswalk, visible near the curb on the left.\n[210-240s] - A silver pickup truck is stationary at a red light, positioned between a yellow taxi and a blue bus.  \n- A food truck is parked on the left side of the street, near a crosswalk.  \n- Pedestrians are crossing the street at the crosswalk, with some waiting at the curb.\n[240-270s] - A silver pickup truck drives forward on a wet city street, its brake lights glowing red as it approaches an intersection.  \n- A yellow taxi is visible to the right, moving in the same direction, with its rear lights also illuminated.  \n- Construction barriers with blue tarps line the left side of the road, indicating ongoing roadwork or maintenance.\n[270-300s] - Rain-slicked street reflects vehicle taillights as cars move slowly through an urban intersection.  \n- Construction scaffolding lines the right side of the road, with orange traffic barriers visible along the left.  \n- Pedestrians walk on sidewalks under overcast skies, with bare trees lining the street.\n[300-330s] - A black pickup truck with red brake lights is driving ahead on a wet road, its rear visible to the camera.  \n- A yellow taxi and a white van pass the truck on the left, while a dark sedan follows closely behind.  \n- The road curves slightly to the right, bordered by a stone wall and bare trees under overcast skies.\n[330-360s] - A black SUV drives ahead, its brake lights glowing red as it slows near a tunnel entrance.  \n- A yellow taxi passes on the left, its headlights on, navigating the wet road.  \n- The road curves slightly left, flanked by stone walls and bare trees, with a tunnel sign visible ahead.\n[360-390s] - Vehicles, including a black SUV and a pickup truck, are stopped in traffic with brake lights illuminated on a wet road.  \n- A large stone church with a prominent clock tower and arched windows is visible on the left side of the road.  \n- The road is flanked by bare trees and stone walls, with a “NO ENTRY” sign visible on the right.\n[390-420s] - A black SUV with license plate \"C8888\" is stationary in traffic, its brake lights illuminated.  \n- A yellow taxi passes on the left, moving away from the camera’s perspective.  \n- A white arrow painted on the road surface indicates a lane direction, visible near the crosswalk.\n[420-450s] - A silver SUV is stationary in traffic, its brake lights illuminated, positioned behind a yellow taxi.  \n- A white sedan enters the frame from the left, moving slowly through the wet street.  \n- Bare trees line the right side of the road, with snow patches visible on the sidewalk.", "history_tokens": 933, "history_utf8_bytes": 3926, "recent_frame_times_s": [443.01486666666665, 444.0158666666667, 445.0001833333333, 446.00118333333336, 447.00218333333333, 448.0031833333333, 449.00418333333334, 450.0051833333333, 451.00618333333335, 452.00718333333333, 453.0081833333333, 454.00918333333334, 455.0101833333333, 456.01118333333335, 457.0121833333333, 458.01318333333336, 459.01418333333334, 460.0151833333333, 461.01618333333334, 462.0005, 463.0015, 464.0025, 465.0035, 466.0045, 467.0055, 468.0065, 469.0075, 470.0085, 471.0095, 472.0105], "recent_frames_sha256": "1ee15a2da3972655d360e31040c8390fc7a96cad8128e26afaf19786456a6823", "num_recent_frames": 30, "tq": 719668.551742918, "t1": 719669.327448723, "ta": 719669.327448723, "te": 719669.675282804, "first_response_s": 0.7757058050483465, "answer_total_s": 1.1235398859716952, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 403, "content_group": "de04a6d99f13993dd6c573fc8e57d7832e7c3a281364653a18776bfc527a398d", "question": {"question_id": "sample_403_a960_q0", "video_id": 403, "video_path": "./videos/sample_403_real.mp4", "annotation_index": 960, "question_index": 0, "question": "Right now, what is the weather like on the street?", "options": ["A. Sunny.", "B. Snowy.", "C. Clear.", "D. Rainy."], "answer": "D", "time_stamp_s": 22, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_403_a960_q0", "video_id": 403, "time_stamp_s": 22, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a917605d7d6a1e507904da079048111e8ce8575676e826b1957b0de04237d660", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.023, 1.0073166666666666, 2.0083166666666665, 3.009316666666667, 4.010316666666666, 5.011316666666667, 6.012316666666667, 7.013316666666666, 8.014316666666666, 9.015316666666667, 10.016316666666667, 11.000633333333333, 12.001633333333332, 13.002633333333334, 14.003633333333333, 15.004633333333333, 16.005633333333332, 17.006633333333333, 18.007633333333334, 19.008633333333332, 20.009633333333333, 21.010633333333335], "recent_frames_sha256": "6c0946b527c2033f67f7445d3faddb77adc95bf6b0925144245f13e2da9572af", "num_recent_frames": 22, "tq": 715200.50842854, "t1": 715206.11277631, "ta": 715206.11277631, "te": 715206.317823757, "first_response_s": 5.604347769985907, "answer_total_s": 5.809395216987468, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_403_a960_q0", "video_id": 403, "time_stamp_s": 22, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "44c20d6ea68920d6b856e527c0f44f655a76b24eb4917fc5587ed097910c62c1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.023, 1.0073166666666666, 2.0083166666666665, 3.009316666666667, 4.010316666666666, 5.011316666666667, 6.012316666666667, 7.013316666666666, 8.014316666666666, 9.015316666666667, 10.016316666666667, 11.000633333333333, 12.001633333333332, 13.002633333333334, 14.003633333333333, 15.004633333333333, 16.005633333333332, 17.006633333333333, 18.007633333333334, 19.008633333333332, 20.009633333333333, 21.010633333333335], "recent_frames_sha256": "6c0946b527c2033f67f7445d3faddb77adc95bf6b0925144245f13e2da9572af", "num_recent_frames": 22, "tq": 710646.96771582, "t1": 710654.098938518, "ta": 710654.098938518, "te": 710654.137355789, "first_response_s": 7.131222698022611, "answer_total_s": 7.169639969011769, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 403, "content_group": "de04a6d99f13993dd6c573fc8e57d7832e7c3a281364653a18776bfc527a398d", "question": {"question_id": "sample_403_a961_q0", "video_id": 403, "video_path": "./videos/sample_403_real.mp4", "annotation_index": 961, "question_index": 0, "question": "What type of vehicle is directly in front of the camera right now?", "options": ["A. Taxi.", "B. Bus.", "C. Bicycle.", "D. Motorcycle."], "answer": "A", "time_stamp_s": 157, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [155, 160], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_403_a961_q0", "video_id": 403, "time_stamp_s": 157, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "db61895b8adfdf4873a765bb665243f6cf2334031ac958ecc34d5e057d55e147", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [127.01653333333333, 128.00085, 129.00185, 130.00285, 131.00385, 132.00485, 133.00585, 134.00685, 135.00785, 136.00885, 137.00985, 138.01085, 139.01185, 140.01285, 141.01385, 142.01485, 143.01585, 144.00016666666667, 145.00116666666668, 146.00216666666665, 147.00316666666666, 148.00416666666666, 149.00516666666667, 150.00616666666667, 151.00716666666668, 152.00816666666665, 153.00916666666666, 154.01016666666666, 155.01116666666667, 156.01216666666667], "recent_frames_sha256": "c019fe92c5e1a11ee967080874177f3c0490d4c9669d8fcbc27636a9053a1094", "num_recent_frames": 30, "tq": 715206.334751137, "t1": 715217.222261554, "ta": 715217.222261554, "te": 715217.266714214, "first_response_s": 10.887510417029262, "answer_total_s": 10.93196307704784, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_403_a961_q0", "video_id": 403, "time_stamp_s": 157, "ground_truth": "A", "raw_output": "A. Taxi.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "b03dfb76e43db3a60df353731a0cc9c71f37cde3dd5d358838bd34eaf72282ed", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rain-slicked street with vehicles (including a red car, yellow taxis, and a FedEx truck) moving through a city intersection with traffic lights and crosswalks.  \n- Tall buildings line both sides of the street, featuring illuminated windows and storefronts like \"Bvlgari\" and \"Macy's,\" with American flags visible.  \n- Pedestrians are seen walking along sidewalks, and a white van with \"EMERGENCY\" markings passes by, indicating active urban traffic flow.\n[30-60s] - Yellow taxis navigate wet streets, their headlights reflecting on the rain-slicked pavement.  \n- Pedestrians cross the street at marked crosswalks, some holding umbrellas against the rain.  \n- Storefronts on either side of the street display illuminated signs, including \"Saks Fifth Avenue\" and \"Bergdorf Goodman.\"\n[60-90s] - A white van is stationary at the crosswalk, positioned between two buildings with green-lit windows.  \n- A black SUV drives past the van, moving left to right across the wet street.  \n- A red car appears in the distance, approaching the intersection from the opposite direction.\n[90-120s] - Yellow taxis navigate wet streets, their brake lights reflecting on the rain-slicked pavement.  \n- Pedestrians cross intersections under umbrellas, some waiting at crosswalks near storefronts.  \n- A \"MOMA\" sign is visible on a building under construction, with scaffolding and orange safety barriers.\n[120-150s] - Yellow taxis and black sedans navigate wet streets, their brake lights glowing red.  \n- Pedestrians with umbrellas walk along sidewalks flanked by tall buildings and bare trees.  \n- American flags hang from building facades, swaying slightly in the rain.", "history_tokens": 389, "history_utf8_bytes": 1661, "recent_frame_times_s": [127.01653333333333, 128.00085, 129.00185, 130.00285, 131.00385, 132.00485, 133.00585, 134.00685, 135.00785, 136.00885, 137.00985, 138.01085, 139.01185, 140.01285, 141.01385, 142.01485, 143.01585, 144.00016666666667, 145.00116666666668, 146.00216666666665, 147.00316666666666, 148.00416666666666, 149.00516666666667, 150.00616666666667, 151.00716666666668, 152.00816666666665, 153.00916666666666, 154.01016666666666, 155.01116666666667, 156.01216666666667], "recent_frames_sha256": "c019fe92c5e1a11ee967080874177f3c0490d4c9669d8fcbc27636a9053a1094", "num_recent_frames": 30, "tq": 710691.466888121, "t1": 710691.932771068, "ta": 710691.932771068, "te": 710692.088962451, "first_response_s": 0.46588294696994126, "answer_total_s": 0.6220743299927562, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 403, "content_group": "de04a6d99f13993dd6c573fc8e57d7832e7c3a281364653a18776bfc527a398d", "question": {"question_id": "sample_403_a962_q0", "video_id": 403, "video_path": "./videos/sample_403_real.mp4", "annotation_index": 962, "question_index": 0, "question": "Which brand's store sign is seen on the right-hand side of the street right now?", "options": ["A. Nike.", "B. Tesla.", "C. Adidas.", "D. UGG."], "answer": "D", "time_stamp_s": 312, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [310, 315], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_403_a962_q0", "video_id": 403, "time_stamp_s": 312, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "362d51a825417a3b66c59e1bf211ecc9e37f1a3f2fe67ebe56a7bbd3045c7af0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [282.0047, 283.0057, 284.0067, 285.0077, 286.0087, 287.0097, 288.0107, 289.0117, 290.0127, 291.0137, 292.0147, 293.0157, 294.0000166666667, 295.00101666666666, 296.0020166666667, 297.00301666666667, 298.00401666666664, 299.0050166666667, 300.00601666666665, 301.0070166666667, 302.00801666666666, 303.00901666666664, 304.0100166666667, 305.01101666666665, 306.0120166666667, 307.01301666666666, 308.0140166666667, 309.01501666666667, 310.01601666666664, 311.00033333333334], "recent_frames_sha256": "ab0cf03d7a456ff5019f494fa3b29d7f3458964cb0ff6f611d9aad3900eba9b8", "num_recent_frames": 30, "tq": 715217.281898921, "t1": 715224.747961907, "ta": 715224.747961907, "te": 715224.785131959, "first_response_s": 7.466062985942699, "answer_total_s": 7.503233038005419, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_403_a962_q0", "video_id": 403, "time_stamp_s": 312, "ground_truth": "D", "raw_output": "D. UGG.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "64f3b4eba839c31ef268e5a1c6fc598d4443bc1d3d9a9093b47b8f2280ea5b5a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Rain-slicked street with vehicles (including a red car, yellow taxis, and a FedEx truck) moving through a city intersection with traffic lights and crosswalks.  \n- Tall buildings line both sides of the street, featuring illuminated windows and storefronts like \"Bvlgari\" and \"Macy's,\" with American flags visible.  \n- Pedestrians are seen walking along sidewalks, and a white van with \"EMERGENCY\" markings passes by, indicating active urban traffic flow.\n[30-60s] - Yellow taxis navigate wet streets, their headlights reflecting on the rain-slicked pavement.  \n- Pedestrians cross the street at marked crosswalks, some holding umbrellas against the rain.  \n- Storefronts on either side of the street display illuminated signs, including \"Saks Fifth Avenue\" and \"Bergdorf Goodman.\"\n[60-90s] - A white van is stationary at the crosswalk, positioned between two buildings with green-lit windows.  \n- A black SUV drives past the van, moving left to right across the wet street.  \n- A red car appears in the distance, approaching the intersection from the opposite direction.\n[90-120s] - Yellow taxis navigate wet streets, their brake lights reflecting on the rain-slicked pavement.  \n- Pedestrians cross intersections under umbrellas, some waiting at crosswalks near storefronts.  \n- A \"MOMA\" sign is visible on a building under construction, with scaffolding and orange safety barriers.\n[120-150s] - Yellow taxis and black sedans navigate wet streets, their brake lights glowing red.  \n- Pedestrians with umbrellas walk along sidewalks flanked by tall buildings and bare trees.  \n- American flags hang from building facades, swaying slightly in the rain.\n[150-180s] - Yellow taxi and black sedan stop at red light, facing camera, with wet pavement reflecting city lights.  \n- Pedestrians with umbrellas cross street at crosswalk, some holding bags or walking briskly.  \n- American flag hangs from building on right, swaying slightly in wind; traffic lights remain red.\n[180-210s] - Yellow taxi in foreground moves forward through wet street, reflecting city lights.  \n- Red traffic light at intersection turns green, allowing vehicles to proceed.  \n- Pedestrians cross street at crosswalk, some holding umbrellas against rain.\n[210-240s] - Yellow taxis navigate wet streets, reflecting city lights; one slows near crosswalks.  \n- Pedestrians cross at marked intersections, some holding umbrellas.  \n- Storefronts like H&M and Saks Fifth Avenue display illuminated signs; American flags hang from buildings.\n[240-270s] - Yellow taxi moves forward on wet street, reflecting city lights.  \n- Red motorcycle with rider navigates right lane, passing pedestrians.  \n- Pedestrians cross street at crosswalk, some holding umbrellas.\n[270-300s] - A yellow taxi is stationary at the intersection, its brake lights illuminated.  \n- Pedestrians cross the wet street at the crosswalk, some holding umbrellas.  \n- Cars, including a white sedan and a black SUV, pass through the intersection, with traffic lights showing red.", "history_tokens": 708, "history_utf8_bytes": 3017, "recent_frame_times_s": [282.0047, 283.0057, 284.0067, 285.0077, 286.0087, 287.0097, 288.0107, 289.0117, 290.0127, 291.0137, 292.0147, 293.0157, 294.0000166666667, 295.00101666666666, 296.0020166666667, 297.00301666666667, 298.00401666666664, 299.0050166666667, 300.00601666666665, 301.0070166666667, 302.00801666666666, 303.00901666666664, 304.0100166666667, 305.01101666666665, 306.0120166666667, 307.01301666666666, 308.0140166666667, 309.01501666666667, 310.01601666666664, 311.00033333333334], "recent_frames_sha256": "ab0cf03d7a456ff5019f494fa3b29d7f3458964cb0ff6f611d9aad3900eba9b8", "num_recent_frames": 30, "tq": 710730.507874663, "t1": 710731.673352597, "ta": 710731.673352597, "te": 710731.858731501, "first_response_s": 1.1654779340606183, "answer_total_s": 1.350856838049367, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 403, "content_group": "de04a6d99f13993dd6c573fc8e57d7832e7c3a281364653a18776bfc527a398d", "question": {"question_id": "sample_403_a963_q0", "video_id": 403, "video_path": "./videos/sample_403_real.mp4", "annotation_index": 963, "question_index": 0, "question": "What is the current condition of the pavement right now?", "options": ["A. Dry.", "B. Sandy.", "C. Snowy.", "D. Wet."], "answer": "D", "time_stamp_s": 465, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [465, 470], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_403_a963_q0", "video_id": 403, "time_stamp_s": 465, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c89d1c8017db37e35c5878cda2373c58bcb2a54b4e91ccead4da913a8ef13b9c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [435.00755, 436.00855, 437.00955, 438.01055, 439.01155, 440.01255, 441.01355, 442.01455, 443.01555, 444.01655, 445.00086666666664, 446.0018666666667, 447.00286666666665, 448.0038666666667, 449.00486666666666, 450.0058666666667, 451.00686666666667, 452.00786666666664, 453.0088666666667, 454.00986666666665, 455.0108666666667, 456.01186666666666, 457.01286666666664, 458.0138666666667, 459.01486666666665, 460.0158666666667, 461.0001833333333, 462.00118333333336, 463.00218333333333, 464.0031833333333], "recent_frames_sha256": "491497d6b2412047997dc0ff4c3b716223bc009bcbf44878d7e376e46b6f9466", "num_recent_frames": 30, "tq": 715224.798029735, "t1": 715236.436739087, "ta": 715236.436739087, "te": 715236.474735733, "first_response_s": 11.63870935200248, "answer_total_s": 11.676705998019315, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_403_a963_q0", "video_id": 403, "time_stamp_s": 465, "ground_truth": "D", "raw_output": "D. Wet.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "94a3ad45d83f883b8e934b7f48e145068e075d2688d169c113c76e0ce8dc79a8", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Yellow taxis navigate wet streets, their headlights reflecting on the rain-slicked pavement.  \n- Pedestrians cross the street at marked crosswalks, some holding umbrellas against the rain.  \n- Storefronts on either side of the street display illuminated signs, including \"Saks Fifth Avenue\" and \"Bergdorf Goodman.\"\n[60-90s] - A white van is stationary at the crosswalk, positioned between two buildings with green-lit windows.  \n- A black SUV drives past the van, moving left to right across the wet street.  \n- A red car appears in the distance, approaching the intersection from the opposite direction.\n[90-120s] - Yellow taxis navigate wet streets, their brake lights reflecting on the rain-slicked pavement.  \n- Pedestrians cross intersections under umbrellas, some waiting at crosswalks near storefronts.  \n- A \"MOMA\" sign is visible on a building under construction, with scaffolding and orange safety barriers.\n[120-150s] - Yellow taxis and black sedans navigate wet streets, their brake lights glowing red.  \n- Pedestrians with umbrellas walk along sidewalks flanked by tall buildings and bare trees.  \n- American flags hang from building facades, swaying slightly in the rain.\n[150-180s] - Yellow taxi and black sedan stop at red light, facing camera, with wet pavement reflecting city lights.  \n- Pedestrians with umbrellas cross street at crosswalk, some holding bags or walking briskly.  \n- American flag hangs from building on right, swaying slightly in wind; traffic lights remain red.\n[180-210s] - Yellow taxi in foreground moves forward through wet street, reflecting city lights.  \n- Red traffic light at intersection turns green, allowing vehicles to proceed.  \n- Pedestrians cross street at crosswalk, some holding umbrellas against rain.\n[210-240s] - Yellow taxis navigate wet streets, reflecting city lights; one slows near crosswalks.  \n- Pedestrians cross at marked intersections, some holding umbrellas.  \n- Storefronts like H&M and Saks Fifth Avenue display illuminated signs; American flags hang from buildings.\n[240-270s] - Yellow taxi moves forward on wet street, reflecting city lights.  \n- Red motorcycle with rider navigates right lane, passing pedestrians.  \n- Pedestrians cross street at crosswalk, some holding umbrellas.\n[270-300s] - A yellow taxi is stationary at the intersection, its brake lights illuminated.  \n- Pedestrians cross the wet street at the crosswalk, some holding umbrellas.  \n- Cars, including a white sedan and a black SUV, pass through the intersection, with traffic lights showing red.\n[300-330s] - A black SUV passes leftward across the wet street, its brake lights glowing red.  \n- A yellow taxi and a black sedan move rightward, following traffic flow.  \n- Pedestrians stand near a crosswalk on the right, waiting for the green light.\n[330-360s] - Rain-slicked street reflects vehicle lights and building signage, with traffic moving slowly under overcast skies.  \n- Pedestrians with umbrellas cross the street at marked crosswalks, some near storefronts like “Saks Fifth Avenue.”  \n- Scaffolding and construction barriers line the right side of the road, indicating ongoing urban development.\n[360-390s] - Red-painted bus lane on right side of street, marked with \"ONLY BUS\" text.  \n- Yellow taxi and black sedan move forward on wet road, reflecting city lights.  \n- Pedestrians with umbrellas cross street at crosswalks, some near storefronts with visible signage.\n[390-420s] - A black SUV with a visible \"NYC\" license plate drives leftward on a wet street, its brake lights illuminated.  \n- A red taxi is positioned ahead, also with brake lights on, moving slowly in traffic.  \n- Pedestrians with umbrellas cross the street at a crosswalk, some walking toward the camera while others move away.\n[420-450s] - A blue MTA bus with \"NYC\" branding enters from the right, moving along the wet street.  \n- A silver SUV is visible ahead, driving in the left lane, with its brake lights illuminated.  \n- A pedestrian in a dark coat crosses the street at a crosswalk, moving from right to left.", "history_tokens": 974, "history_utf8_bytes": 4061, "recent_frame_times_s": [435.00755, 436.00855, 437.00955, 438.01055, 439.01155, 440.01255, 441.01355, 442.01455, 443.01555, 444.01655, 445.00086666666664, 446.0018666666667, 447.00286666666665, 448.0038666666667, 449.00486666666666, 450.0058666666667, 451.00686666666667, 452.00786666666664, 453.0088666666667, 454.00986666666665, 455.0108666666667, 456.01186666666666, 457.01286666666664, 458.0138666666667, 459.01486666666665, 460.0158666666667, 461.0001833333333, 462.00118333333336, 463.00218333333333, 464.0031833333333], "recent_frames_sha256": "491497d6b2412047997dc0ff4c3b716223bc009bcbf44878d7e376e46b6f9466", "num_recent_frames": 30, "tq": 710770.970370998, "t1": 710771.99833694, "ta": 710771.99833694, "te": 710772.151800993, "first_response_s": 1.0279659419320524, "answer_total_s": 1.1814299949910492, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 403, "content_group": "de04a6d99f13993dd6c573fc8e57d7832e7c3a281364653a18776bfc527a398d", "question": {"question_id": "sample_403_a964_q0", "video_id": 403, "video_path": "./videos/sample_403_real.mp4", "annotation_index": 964, "question_index": 0, "question": "What makes of the yellow car is waiting at the red light right now?", "options": ["A. Honda.", "B. Ford.", "C. Toyota.", "D. Nissan."], "answer": "C", "time_stamp_s": 608, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [620, 625], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_403_a964_q0", "video_id": 403, "time_stamp_s": 608, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "db17abf072ea7bcbc319c2adcdfc2439218f4fb2feb27f0bd7da261a6d0cb975", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [578.0004, 579.0014, 580.0024, 581.0034, 582.0044, 583.0054, 584.0064, 585.0074, 586.0084, 587.0094, 588.0104, 589.0114, 590.0124, 591.0134, 592.0144, 593.0154, 594.0164, 595.0007166666667, 596.0017166666667, 597.0027166666666, 598.0037166666667, 599.0047166666667, 600.0057166666667, 601.0067166666666, 602.0077166666666, 603.0087166666667, 604.0097166666667, 605.0107166666667, 606.0117166666666, 607.0127166666666], "recent_frames_sha256": "ae99ae0c9568e7d053312f7963f866ba942932ecb366de566591dfc6a8db0e23", "num_recent_frames": 30, "tq": 715236.485503323, "t1": 715248.094340173, "ta": 715248.094340173, "te": 715248.13349058, "first_response_s": 11.608836849918589, "answer_total_s": 11.647987256990746, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_403_a964_q0", "video_id": 403, "time_stamp_s": 608, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e403e6aedb27555bcbdbca7d67b1de95548c726b1ea18606dfdc7ee22796c4bf", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Yellow taxi and black sedan stop at red light, facing camera, with wet pavement reflecting city lights.  \n- Pedestrians with umbrellas cross street at crosswalk, some holding bags or walking briskly.  \n- American flag hangs from building on right, swaying slightly in wind; traffic lights remain red.\n[180-210s] - Yellow taxi in foreground moves forward through wet street, reflecting city lights.  \n- Red traffic light at intersection turns green, allowing vehicles to proceed.  \n- Pedestrians cross street at crosswalk, some holding umbrellas against rain.\n[210-240s] - Yellow taxis navigate wet streets, reflecting city lights; one slows near crosswalks.  \n- Pedestrians cross at marked intersections, some holding umbrellas.  \n- Storefronts like H&M and Saks Fifth Avenue display illuminated signs; American flags hang from buildings.\n[240-270s] - Yellow taxi moves forward on wet street, reflecting city lights.  \n- Red motorcycle with rider navigates right lane, passing pedestrians.  \n- Pedestrians cross street at crosswalk, some holding umbrellas.\n[270-300s] - A yellow taxi is stationary at the intersection, its brake lights illuminated.  \n- Pedestrians cross the wet street at the crosswalk, some holding umbrellas.  \n- Cars, including a white sedan and a black SUV, pass through the intersection, with traffic lights showing red.\n[300-330s] - A black SUV passes leftward across the wet street, its brake lights glowing red.  \n- A yellow taxi and a black sedan move rightward, following traffic flow.  \n- Pedestrians stand near a crosswalk on the right, waiting for the green light.\n[330-360s] - Rain-slicked street reflects vehicle lights and building signage, with traffic moving slowly under overcast skies.  \n- Pedestrians with umbrellas cross the street at marked crosswalks, some near storefronts like “Saks Fifth Avenue.”  \n- Scaffolding and construction barriers line the right side of the road, indicating ongoing urban development.\n[360-390s] - Red-painted bus lane on right side of street, marked with \"ONLY BUS\" text.  \n- Yellow taxi and black sedan move forward on wet road, reflecting city lights.  \n- Pedestrians with umbrellas cross street at crosswalks, some near storefronts with visible signage.\n[390-420s] - A black SUV with a visible \"NYC\" license plate drives leftward on a wet street, its brake lights illuminated.  \n- A red taxi is positioned ahead, also with brake lights on, moving slowly in traffic.  \n- Pedestrians with umbrellas cross the street at a crosswalk, some walking toward the camera while others move away.\n[420-450s] - A blue MTA bus with \"NYC\" branding enters from the right, moving along the wet street.  \n- A silver SUV is visible ahead, driving in the left lane, with its brake lights illuminated.  \n- A pedestrian in a dark coat crosses the street at a crosswalk, moving from right to left.\n[450-480s] - A yellow taxi moves forward through the rain-slicked street, its brake lights glowing red.  \n- A blue and yellow bus is parked on the right side of the road, stationary near a red-painted bus lane.  \n- Pedestrians are visible on sidewalks, some holding umbrellas, as the street is wet from recent rain.\n[480-510s] - Yellow taxi in center lane, brake lights on, moving slowly through traffic.  \n- Black SUV to right, stationary at red light, rear lights illuminated.  \n- Wet pavement reflects vehicle lights; buildings line both sides of street.\n[510-540s] - Yellow taxi in center lane, brake lights on, stationary at red light.\n- Black sedan to left, brake lights illuminated, waiting at intersection.\n- Rain-slicked street reflects city lights; traffic congestion visible ahead.\n[540-570s] - Yellow taxi cab moves forward through wet city street, surrounded by other vehicles.  \n- Pedestrians cross street at crosswalk; some carry umbrellas.  \n- Raindrops streak across windshield, reflecting city lights and traffic.\n[570-600s] - Yellow taxi cab moves forward on wet street, its brake lights glowing red.  \n- Pedestrians cross street at crosswalk, some holding umbrellas.  \n- Orange traffic cones line the road, indicating construction or lane changes.", "history_tokens": 998, "history_utf8_bytes": 4132, "recent_frame_times_s": [578.0004, 579.0014, 580.0024, 581.0034, 582.0044, 583.0054, 584.0064, 585.0074, 586.0084, 587.0094, 588.0104, 589.0114, 590.0124, 591.0134, 592.0144, 593.0154, 594.0164, 595.0007166666667, 596.0017166666667, 597.0027166666666, 598.0037166666667, 599.0047166666667, 600.0057166666667, 601.0067166666666, 602.0077166666666, 603.0087166666667, 604.0097166666667, 605.0107166666667, 606.0117166666666, 607.0127166666666], "recent_frames_sha256": "ae99ae0c9568e7d053312f7963f866ba942932ecb366de566591dfc6a8db0e23", "num_recent_frames": 30, "tq": 715199.734747772, "t1": 715200.451843297, "ta": 715200.451843297, "te": 715200.491420108, "first_response_s": 0.7170955250039697, "answer_total_s": 0.7566723360214382, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 404, "content_group": "d3a4cb22f4bb3696d4b9adb20d145144774345e48ccc13b84312676bf673c815", "question": {"question_id": "sample_404_a229_q0", "video_id": 404, "video_path": "./videos/sample_404_real.mp4", "annotation_index": 229, "question_index": 0, "question": "Which of the following actions best summarizes what the individual just now did?", "options": ["A. The individual greeted the customers, prepared two glasses of wine, and served the drinks.", "B. The individual chatted with the customers, filled two glasses with ice, and arranged them on the counter.", "C. This person places three glass cups in front of the table.", "D. The individual cleaned the counter, arranged empty glasses, and interacted with other staff members."], "answer": "C", "time_stamp_s": 12, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_404_a229_q0", "video_id": 404, "time_stamp_s": 12, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "42f77f1a17a4a332b445de75e16cb1df78567ec4dffc7f2bd2b54454cfb19c77", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0], "recent_frames_sha256": "df4109a7c7014389c2a92f8a14712cb83b21a9295afc9c8540ce35ceaa7cf291", "num_recent_frames": 13, "tq": 719430.509693735, "t1": 719431.320251391, "ta": 719431.320251391, "te": 719431.358589141, "first_response_s": 0.8105576559901237, "answer_total_s": 0.8488954060012475, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_404_a229_q0", "video_id": 404, "time_stamp_s": 12, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ce02f123765ddf1e0b937fe820b0950ccbe932932fcb94dd61771b9b3bf0328e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0], "recent_frames_sha256": "df4109a7c7014389c2a92f8a14712cb83b21a9295afc9c8540ce35ceaa7cf291", "num_recent_frames": 13, "tq": 719286.389345877, "t1": 719293.427592353, "ta": 719293.427592353, "te": 719293.46563426, "first_response_s": 7.038246475975029, "answer_total_s": 7.076288382988423, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 404, "content_group": "d3a4cb22f4bb3696d4b9adb20d145144774345e48ccc13b84312676bf673c815", "question": {"question_id": "sample_404_a230_q0", "video_id": 404, "video_path": "./videos/sample_404_real.mp4", "annotation_index": 230, "question_index": 0, "question": "Which of the following options best summarizes the actions taken by the person just now?", "options": ["A. The person was rearranging glasses on the counter and chatting with colleagues.", "B. The person was cleaning the counter and organizing different bottles.", "C. The person was taking out a bottle from a refrigerator and pouring its contents into glasses with ice.", "D. The person was preparing food items and arranging plates and utensils."], "answer": "C", "time_stamp_s": 138, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [124, 134], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_404_a230_q0", "video_id": 404, "time_stamp_s": 138, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "56ca230e4fc170d4022e4df5740425541ffff98198462b9c41454b6b468ef493", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0], "recent_frames_sha256": "783dbd9fa00026020ac182bf0ef56d7a9beb9bd7fbff0baf43f70f1862b8e007", "num_recent_frames": 30, "tq": 719431.382116264, "t1": 719442.104264881, "ta": 719442.104264881, "te": 719442.142619544, "first_response_s": 10.722148617031053, "answer_total_s": 10.760503280092962, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_404_a230_q0", "video_id": 404, "time_stamp_s": 138, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ecce72ce65b06a229796b612a8d2dfaeae8028e1b35ee93876a612a6256a5546", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Bartender's hand pours red liquid from a bottle into a glass, then adds ice and a citrus slice.  \n- A woman in a white jacket stands at the bar, observing the bartender's actions.  \n- The bar counter is cluttered with bottles, glasses, and metal shakers, with patrons seated in the background.\n[30-60s] - Bartender pours liquid from a bottle into a metal shaker while customers watch.  \n- A woman in a white top leans forward, observing the drink preparation closely.  \n- The bar counter is cluttered with bottles, shakers, and a sink, with patrons seated in the background.\n[60-90s] - Bartender pours clear liquid from a blue bottle into a metal shaker.  \n- Shaker is then placed on a counter next to a glass with an orange-colored drink.  \n- A customer in a white shirt is visible in the background, seated at a table.\n[90-120s] - Bartender pours dark liquid from a bottle into a glass, then places the bottle into a refrigerator.  \n- The bartender’s hand is visible holding a bottle with an orange cap, positioned near the refrigerator door.  \n- The refrigerator interior contains various bottles, including a prominent orange-capped bottle being placed inside.", "history_tokens": 276, "history_utf8_bytes": 1176, "recent_frame_times_s": [109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0], "recent_frames_sha256": "783dbd9fa00026020ac182bf0ef56d7a9beb9bd7fbff0baf43f70f1862b8e007", "num_recent_frames": 30, "tq": 719323.742892633, "t1": 719325.299633655, "ta": 719325.299633655, "te": 719325.33779213, "first_response_s": 1.5567410220392048, "answer_total_s": 1.5948994969949126, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 404, "content_group": "d3a4cb22f4bb3696d4b9adb20d145144774345e48ccc13b84312676bf673c815", "question": {"question_id": "sample_404_a231_q0", "video_id": 404, "video_path": "./videos/sample_404_real.mp4", "annotation_index": 231, "question_index": 0, "question": "What best summarizes the actions performed by the individual just now?", "options": ["A. The individual cleaned the bar area, organized supplies, and inspected the beverage inventory.", "B. The individual prepared a batch of food ingredients, cooked them, and plated the dishes.", "C. The individual prepared garnishes, assembled multiple drinks.", "D. The individual greeted guests, took their orders, and rang up the sales at the cash register."], "answer": "C", "time_stamp_s": 258, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [248, 258], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_404_a231_q0", "video_id": 404, "time_stamp_s": 258, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2b1e3a6be94ec1409fb4e620bd64eb55e75ab99acca6061ac4fdd7a696a51d7c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0], "recent_frames_sha256": "9c2b6eef0bcd87b91dce534874888c6d9089d417109090e19cbb2b2f46d92854", "num_recent_frames": 30, "tq": 719442.156071974, "t1": 719449.594874622, "ta": 719449.594874622, "te": 719449.633309596, "first_response_s": 7.438802647986449, "answer_total_s": 7.477237622020766, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_404_a231_q0", "video_id": 404, "time_stamp_s": 258, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2651952a7269d1aad3734e38f105c1aacbd1a4e7b595e5c98b1782eadd3181c6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Bartender's hand pours red liquid from a bottle into a glass, then adds ice and a citrus slice.  \n- A woman in a white jacket stands at the bar, observing the bartender's actions.  \n- The bar counter is cluttered with bottles, glasses, and metal shakers, with patrons seated in the background.\n[30-60s] - Bartender pours liquid from a bottle into a metal shaker while customers watch.  \n- A woman in a white top leans forward, observing the drink preparation closely.  \n- The bar counter is cluttered with bottles, shakers, and a sink, with patrons seated in the background.\n[60-90s] - Bartender pours clear liquid from a blue bottle into a metal shaker.  \n- Shaker is then placed on a counter next to a glass with an orange-colored drink.  \n- A customer in a white shirt is visible in the background, seated at a table.\n[90-120s] - Bartender pours dark liquid from a bottle into a glass, then places the bottle into a refrigerator.  \n- The bartender’s hand is visible holding a bottle with an orange cap, positioned near the refrigerator door.  \n- The refrigerator interior contains various bottles, including a prominent orange-capped bottle being placed inside.\n[120-150s] - Bartender hands a glass of orange-colored drink to a customer seated at the bar.  \n- A large green bottle and a beer tap are visible on the bar counter.  \n- A customer in a green shirt is seen holding a glass and looking toward the bartender.\n[150-180s] - Bartender pours liquid from a shaker into a glass held by a customer.  \n- A group of patrons sits at the bar, observing the bartender’s actions.  \n- The bartender reaches into a refrigerator to retrieve a glass.\n[180-210s] - Two hands hold glasses, one with a cocktail and the other with a clear drink, clinking together in a toast.  \n- A third hand, wearing a dark sleeve, holds a cocktail shaker and pours liquid into the glass on the left.  \n- The bar counter holds ice, bottles, and a sink, with patrons visible in the background.\n[210-240s] - Bartender pours amber liquid from a bottle into a glass held by a customer.  \n- A woman in a white top gestures toward the bar while holding a drink.  \n- A man in a dark jacket smiles as he watches the bartender work.", "history_tokens": 539, "history_utf8_bytes": 2213, "recent_frame_times_s": [229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0], "recent_frames_sha256": "9c2b6eef0bcd87b91dce534874888c6d9089d417109090e19cbb2b2f46d92854", "num_recent_frames": 30, "tq": 719361.957407702, "t1": 719370.151655767, "ta": 719370.151655767, "te": 719370.342457786, "first_response_s": 8.194248065003194, "answer_total_s": 8.385050083976239, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 404, "content_group": "d3a4cb22f4bb3696d4b9adb20d145144774345e48ccc13b84312676bf673c815", "question": {"question_id": "sample_404_a232_q0", "video_id": 404, "video_path": "./videos/sample_404_real.mp4", "annotation_index": 232, "question_index": 0, "question": "Which of the following actions best summarizes what the individual just now did?", "options": ["A. The individual greeted customers, prepared a meal, and served it.", "B. The individual cleaned the bar area, organized supplies, and managed the inventory.", "C. The individual prepared a cocktail, stirred it, and placed it on the counter.", "D. The individual filled a glass with ice, poured a drink, and wiped the counter."], "answer": "C", "time_stamp_s": 382, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [372, 382], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_404_a232_q0", "video_id": 404, "time_stamp_s": 382, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "844539f044012f69951882a1758c475709929d2aa1d04b92da757291c9f9a39f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0], "recent_frames_sha256": "a0236dab2275ce73c92a8838bcb23e0b679379dc008707565727e8cc4033acc5", "num_recent_frames": 30, "tq": 719449.650227063, "t1": 719461.549372456, "ta": 719461.549372456, "te": 719461.586816198, "first_response_s": 11.899145393050276, "answer_total_s": 11.936589134973474, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_404_a232_q0", "video_id": 404, "time_stamp_s": 382, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2cfbc732ad5eba4fedfd4812ffd06b726bc8b7e676aa150213af984eb9ef09a1", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Bartender's hand pours red liquid from a bottle into a glass, then adds ice and a citrus slice.  \n- A woman in a white jacket stands at the bar, observing the bartender's actions.  \n- The bar counter is cluttered with bottles, glasses, and metal shakers, with patrons seated in the background.\n[30-60s] - Bartender pours liquid from a bottle into a metal shaker while customers watch.  \n- A woman in a white top leans forward, observing the drink preparation closely.  \n- The bar counter is cluttered with bottles, shakers, and a sink, with patrons seated in the background.\n[60-90s] - Bartender pours clear liquid from a blue bottle into a metal shaker.  \n- Shaker is then placed on a counter next to a glass with an orange-colored drink.  \n- A customer in a white shirt is visible in the background, seated at a table.\n[90-120s] - Bartender pours dark liquid from a bottle into a glass, then places the bottle into a refrigerator.  \n- The bartender’s hand is visible holding a bottle with an orange cap, positioned near the refrigerator door.  \n- The refrigerator interior contains various bottles, including a prominent orange-capped bottle being placed inside.\n[120-150s] - Bartender hands a glass of orange-colored drink to a customer seated at the bar.  \n- A large green bottle and a beer tap are visible on the bar counter.  \n- A customer in a green shirt is seen holding a glass and looking toward the bartender.\n[150-180s] - Bartender pours liquid from a shaker into a glass held by a customer.  \n- A group of patrons sits at the bar, observing the bartender’s actions.  \n- The bartender reaches into a refrigerator to retrieve a glass.\n[180-210s] - Two hands hold glasses, one with a cocktail and the other with a clear drink, clinking together in a toast.  \n- A third hand, wearing a dark sleeve, holds a cocktail shaker and pours liquid into the glass on the left.  \n- The bar counter holds ice, bottles, and a sink, with patrons visible in the background.\n[210-240s] - Bartender pours amber liquid from a bottle into a glass held by a customer.  \n- A woman in a white top gestures toward the bar while holding a drink.  \n- A man in a dark jacket smiles as he watches the bartender work.\n[240-270s] - Bartender places a lime wedge on a glass containing a clear liquid, positioned on the bar counter.  \n- A customer in a white shirt is seen holding a glass with an orange-colored drink, standing near the bar.  \n- The bartender’s hand moves toward a tray of ice cubes, indicating preparation for another drink.\n[270-300s] - Bartender pours liquid from a bottle into a glass held by a customer.  \n- A group of patrons sits at the bar, some holding drinks, others watching the bartender.  \n- The bar counter is cluttered with glasses, bottles, and mixing tools, reflecting a busy service environment.\n[300-330s] - Bartender’s hand reaches for a bottle from a lower shelf while others hold drinks.  \n- A group of patrons, including a woman with blonde hair and a man in a suit, are seated at the bar.  \n- The bar counter is cluttered with glasses, bottles, and a tray of ice.\n[330-360s] - Bartender pours drink from a shaker into a glass, serving customers at the bar.  \n- Customers seated at the bar are seen holding glasses, some with drinks, others waiting.  \n- Bar counter displays various bottles and glassware, with a stainless steel espresso machine in the background.", "history_tokens": 825, "history_utf8_bytes": 3401, "recent_frame_times_s": [353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0], "recent_frames_sha256": "a0236dab2275ce73c92a8838bcb23e0b679379dc008707565727e8cc4033acc5", "num_recent_frames": 30, "tq": 719392.895575614, "t1": 719394.370705077, "ta": 719394.370705077, "te": 719394.601553242, "first_response_s": 1.475129463011399, "answer_total_s": 1.7059776280075312, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 404, "content_group": "d3a4cb22f4bb3696d4b9adb20d145144774345e48ccc13b84312676bf673c815", "question": {"question_id": "sample_404_a233_q0", "video_id": 404, "video_path": "./videos/sample_404_real.mp4", "annotation_index": 233, "question_index": 0, "question": "Which of the following actions best summarizes what the individual just now did?", "options": ["A. The individual took drink orders from customers while others were conversing.", "B. The individual cleared dishes from the table while customers waited for their drinks.", "C. The individual entered order details on a tablet while talking with the customers.", "D. The individual prepared cocktails using a shaker while engaging with customers."], "answer": "C", "time_stamp_s": 506, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [496, 506], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_404_a233_q0", "video_id": 404, "time_stamp_s": 506, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0d3618bbefb6b0ba79c89f15860667d84d04b43317daae8490cf844eb85f8bbc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0], "recent_frames_sha256": "eed0163f4b203773ea02006b573ea8e807b964709383b3eeaef2c5ccfba33cfb", "num_recent_frames": 30, "tq": 719461.599854187, "t1": 719473.324782666, "ta": 719473.324782666, "te": 719473.362736733, "first_response_s": 11.7249284790596, "answer_total_s": 11.762882546056062, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_404_a233_q0", "video_id": 404, "time_stamp_s": 506, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6db5ac40a3dc5d169bbf8b90f4fa30f934a7be7949a436f6280e2a8cbf23061c", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Bartender pours clear liquid from a blue bottle into a metal shaker.  \n- Shaker is then placed on a counter next to a glass with an orange-colored drink.  \n- A customer in a white shirt is visible in the background, seated at a table.\n[90-120s] - Bartender pours dark liquid from a bottle into a glass, then places the bottle into a refrigerator.  \n- The bartender’s hand is visible holding a bottle with an orange cap, positioned near the refrigerator door.  \n- The refrigerator interior contains various bottles, including a prominent orange-capped bottle being placed inside.\n[120-150s] - Bartender hands a glass of orange-colored drink to a customer seated at the bar.  \n- A large green bottle and a beer tap are visible on the bar counter.  \n- A customer in a green shirt is seen holding a glass and looking toward the bartender.\n[150-180s] - Bartender pours liquid from a shaker into a glass held by a customer.  \n- A group of patrons sits at the bar, observing the bartender’s actions.  \n- The bartender reaches into a refrigerator to retrieve a glass.\n[180-210s] - Two hands hold glasses, one with a cocktail and the other with a clear drink, clinking together in a toast.  \n- A third hand, wearing a dark sleeve, holds a cocktail shaker and pours liquid into the glass on the left.  \n- The bar counter holds ice, bottles, and a sink, with patrons visible in the background.\n[210-240s] - Bartender pours amber liquid from a bottle into a glass held by a customer.  \n- A woman in a white top gestures toward the bar while holding a drink.  \n- A man in a dark jacket smiles as he watches the bartender work.\n[240-270s] - Bartender places a lime wedge on a glass containing a clear liquid, positioned on the bar counter.  \n- A customer in a white shirt is seen holding a glass with an orange-colored drink, standing near the bar.  \n- The bartender’s hand moves toward a tray of ice cubes, indicating preparation for another drink.\n[270-300s] - Bartender pours liquid from a bottle into a glass held by a customer.  \n- A group of patrons sits at the bar, some holding drinks, others watching the bartender.  \n- The bar counter is cluttered with glasses, bottles, and mixing tools, reflecting a busy service environment.\n[300-330s] - Bartender’s hand reaches for a bottle from a lower shelf while others hold drinks.  \n- A group of patrons, including a woman with blonde hair and a man in a suit, are seated at the bar.  \n- The bar counter is cluttered with glasses, bottles, and a tray of ice.\n[330-360s] - Bartender pours drink from a shaker into a glass, serving customers at the bar.  \n- Customers seated at the bar are seen holding glasses, some with drinks, others waiting.  \n- Bar counter displays various bottles and glassware, with a stainless steel espresso machine in the background.\n[360-390s] - Bartender’s hands actively stir a cocktail in a metal shaker, positioned on the bar counter.  \n- A green bottle and a brown bottle are visible on the bar, alongside a tray of ice cubes.  \n- Customers are seated at the bar, observing the bartender’s actions, with one person holding a glass.\n[390-420s] - Barista pours coffee from a machine into a cup while another person holds a glass nearby.  \n- A customer in a white shirt and brown apron stands at the counter, facing the barista.  \n- The barista’s hand reaches toward a green bag on the counter, possibly to retrieve an item.\n[420-450s] - Bartender’s hand holds a lime, preparing to squeeze it into a glass.  \n- A white cocktail glass sits on the bar, positioned near the bartender’s hand.  \n- Customers are seated at the bar, observing the bartender’s actions.\n[450-480s] - Barista hands a green cloth to a customer while standing behind the counter.  \n- A group of patrons sits at the bar, some holding drinks, others engaged in conversation.  \n- The bar area is cluttered with glasses, bottles, and equipment, including a coffee machine.", "history_tokens": 959, "history_utf8_bytes": 3937, "recent_frame_times_s": [477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0], "recent_frames_sha256": "eed0163f4b203773ea02006b573ea8e807b964709383b3eeaef2c5ccfba33cfb", "num_recent_frames": 30, "tq": 719424.02519939, "t1": 719430.293615734, "ta": 719430.293615734, "te": 719430.494599411, "first_response_s": 6.268416343955323, "answer_total_s": 6.469400021014735, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 405, "content_group": "d0696a3b857bd2d10170e9ffc2c9f1963b341414a380846f9dd63901b080c500", "question": {"question_id": "sample_405_a809_q0", "video_id": 405, "video_path": "./videos/sample_405_real.mp4", "annotation_index": 809, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual set the table with dishes and silverware before preparing a salad.", "B. The individual gathered ingredients for a dessert and started mixing them in a bowl.", "C. The individual prepared a drink by opening a bottle, removing the cork, and setting up glassware.", "D. The individual cooked a main course by grilling meat and adding spices to it."], "answer": "C", "time_stamp_s": 18, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_405_a809_q0", "video_id": 405, "time_stamp_s": 18, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "653a83d31596618ed74bf1fd28d4432ce6a8ff801ab6f5eb51239986dad24333", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.031015625, 1.011015625, 2.011015625, 3.011015625, 4.011015625, 5.011015625, 6.011015625, 7.011015625, 8.011015625, 9.011015625, 10.011015625, 11.011015625, 12.011015625, 13.011015625, 14.011015625, 15.011015625, 16.011015625, 17.011015625], "recent_frames_sha256": "f8e9f3a47f87419475ff510d65752738b334afe716082a85f9b93f34908a9038", "num_recent_frames": 18, "tq": 715287.230730065, "t1": 715288.58785044, "ta": 715288.58785044, "te": 715288.829652904, "first_response_s": 1.3571203749161214, "answer_total_s": 1.59892283892259, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_405_a809_q0", "video_id": 405, "time_stamp_s": 18, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "816eb97c76069ec64c08065d0c5229363034917339676465efa1944b418a1a45", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.031015625, 1.011015625, 2.011015625, 3.011015625, 4.011015625, 5.011015625, 6.011015625, 7.011015625, 8.011015625, 9.011015625, 10.011015625, 11.011015625, 12.011015625, 13.011015625, 14.011015625, 15.011015625, 16.011015625, 17.011015625], "recent_frames_sha256": "f8e9f3a47f87419475ff510d65752738b334afe716082a85f9b93f34908a9038", "num_recent_frames": 18, "tq": 710755.496834548, "t1": 710765.663323004, "ta": 710765.663323004, "te": 710765.882755424, "first_response_s": 10.166488456074148, "answer_total_s": 10.385920876055025, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 405, "content_group": "d0696a3b857bd2d10170e9ffc2c9f1963b341414a380846f9dd63901b080c500", "question": {"question_id": "sample_405_a810_q0", "video_id": 405, "video_path": "./videos/sample_405_real.mp4", "annotation_index": 810, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual chopped vegetables, added them to a bowl, and served a salad.", "B. The individual brewed coffee, added sugar and milk, and served it to the customer.", "C. The individual prepared a cocktail by adding ice to a shaker, pouring in ingredients.", "D. The individual poured wine into glasses and served them to the customers."], "answer": "C", "time_stamp_s": 131, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [121, 131], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_405_a810_q0", "video_id": 405, "time_stamp_s": 131, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "14a11d3612dfde4985de4e1aa68ca9f90ac71036b6e5ba962e94fbe65fea9a07", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [101.011015625, 102.011015625, 103.011015625, 104.011015625, 105.011015625, 106.011015625, 107.011015625, 108.011015625, 109.011015625, 110.011015625, 111.011015625, 112.011015625, 113.011015625, 114.011015625, 115.011015625, 116.011015625, 117.011015625, 118.011015625, 119.011015625, 120.011015625, 121.011015625, 122.011015625, 123.011015625, 124.011015625, 125.011015625, 126.011015625, 127.011015625, 128.011015625, 129.011015625, 130.011015625], "recent_frames_sha256": "03c2f43ee6e86470c92392204205ae06309a5db14bc74c76512e91e8511ec464", "num_recent_frames": 30, "tq": 715288.862356625, "t1": 715296.575352987, "ta": 715296.575352987, "te": 715296.618730826, "first_response_s": 7.712996362010017, "answer_total_s": 7.756374200922437, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_405_a810_q0", "video_id": 405, "time_stamp_s": 131, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8a5d070afa2d45c960e74543947bc0f870b8ee49bdfa83a3adbc7b4586df0c90", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Bartender opens a champagne bottle with a corkscrew, then places it on the bar counter.  \n- A green bottle (likely wine or champagne) is positioned on the bar, near the beer taps.  \n- A customer in a black jacket sits at the bar, holding a glass with an orange-colored drink.\n[30-60s] - Bartender hands a glass with orange drink to a customer while another customer holds a beer.  \n- A customer in a white shirt and another in a black jacket are seated at the bar, observing the bartender.  \n- The bartender uses a green-handled tool to handle a citrus fruit near a container of ice.\n[60-90s] - Barista’s hands are seen handling a small container, likely preparing or measuring ingredients.  \n- A customer in a white shirt is visible at the bar, interacting with the barista.  \n- The espresso machine is prominently positioned on the counter, with its digital display showing \"0:00\".\n[90-120s] - Bartender pours liquid from a green bottle into a metal shaker while customers watch.  \n- A customer in a dark suit holds a glass, positioned near the bar counter.  \n- The bar counter is cluttered with bottles, shakers, and a metal tray holding various items.", "history_tokens": 280, "history_utf8_bytes": 1167, "recent_frame_times_s": [101.011015625, 102.011015625, 103.011015625, 104.011015625, 105.011015625, 106.011015625, 107.011015625, 108.011015625, 109.011015625, 110.011015625, 111.011015625, 112.011015625, 113.011015625, 114.011015625, 115.011015625, 116.011015625, 117.011015625, 118.011015625, 119.011015625, 120.011015625, 121.011015625, 122.011015625, 123.011015625, 124.011015625, 125.011015625, 126.011015625, 127.011015625, 128.011015625, 129.011015625, 130.011015625], "recent_frames_sha256": "03c2f43ee6e86470c92392204205ae06309a5db14bc74c76512e91e8511ec464", "num_recent_frames": 30, "tq": 715187.131551541, "t1": 715189.047552545, "ta": 715189.047552545, "te": 715189.091303915, "first_response_s": 1.9160010039340705, "answer_total_s": 1.959752373979427, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 405, "content_group": "d0696a3b857bd2d10170e9ffc2c9f1963b341414a380846f9dd63901b080c500", "question": {"question_id": "sample_405_a811_q0", "video_id": 405, "video_path": "./videos/sample_405_real.mp4", "annotation_index": 811, "question_index": 0, "question": "Which of the following options best summarizes the content of the video just shown?", "options": ["A. The bartender prepared several coffee orders for a group of customers.", "B. The bartender checked customer IDs and handed out drink menus.", "C. The bartender placed two cocktails on the counter.", "D. The bartender restocked the bar with empty glass bottles while cleaning dishes."], "answer": "C", "time_stamp_s": 258, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [242, 252], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_405_a811_q0", "video_id": 405, "time_stamp_s": 258, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9ee7b9a59edb7bab650f2fd62d1ca9d0777622667992e4d33239ff455de521b4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [228.011015625, 229.011015625, 230.011015625, 231.011015625, 232.011015625, 233.011015625, 234.011015625, 235.011015625, 236.011015625, 237.011015625, 238.011015625, 239.011015625, 240.011015625, 241.011015625, 242.011015625, 243.011015625, 244.011015625, 245.011015625, 246.011015625, 247.011015625, 248.011015625, 249.011015625, 250.011015625, 251.011015625, 252.011015625, 253.011015625, 254.011015625, 255.011015625, 256.011015625, 257.011015625], "recent_frames_sha256": "081b750909aaf89706f4f65978ad473384722603b2198a67254ce719793e5f16", "num_recent_frames": 30, "tq": 715296.640896026, "t1": 715309.348509805, "ta": 715309.348509805, "te": 715309.388117003, "first_response_s": 12.707613778999075, "answer_total_s": 12.747220976976678, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_405_a811_q0", "video_id": 405, "time_stamp_s": 258, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b77a094003e570fe317cb1c78aec90cafadc55f025f86bd54de28933f54898f1", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Bartender opens a champagne bottle with a corkscrew, then places it on the bar counter.  \n- A green bottle (likely wine or champagne) is positioned on the bar, near the beer taps.  \n- A customer in a black jacket sits at the bar, holding a glass with an orange-colored drink.\n[30-60s] - Bartender hands a glass with orange drink to a customer while another customer holds a beer.  \n- A customer in a white shirt and another in a black jacket are seated at the bar, observing the bartender.  \n- The bartender uses a green-handled tool to handle a citrus fruit near a container of ice.\n[60-90s] - Barista’s hands are seen handling a small container, likely preparing or measuring ingredients.  \n- A customer in a white shirt is visible at the bar, interacting with the barista.  \n- The espresso machine is prominently positioned on the counter, with its digital display showing \"0:00\".\n[90-120s] - Bartender pours liquid from a green bottle into a metal shaker while customers watch.  \n- A customer in a dark suit holds a glass, positioned near the bar counter.  \n- The bar counter is cluttered with bottles, shakers, and a metal tray holding various items.\n[120-150s] - Bartender’s hands stir a cocktail in a metal shaker while facing customers.  \n- A woman in a white top watches the bartender, seated behind the bar.  \n- A man in a green jacket sits beside her, also observing the bartender’s actions.\n[150-180s] - Bartender stirs drink in metal shaker with long spoon, while holding another shaker steady.  \n- Two patrons (woman in white top, man in green jacket) watch attentively from behind the bar.  \n- Bar counter holds various bottles, ice, and tools; a large green bottle is prominent on left.\n[180-210s] - Bartender's hands pour liquid from a shaker into a metal cup, then place the cup on the bar counter.  \n- A woman in a white top and a man in a black jacket are seated at the bar, watching the bartender.  \n- The bar counter is cluttered with various bottles, a sink, and a tray of ice cubes.\n[210-240s] - Bartender retrieves a glass from a freezer and places it on the bar.  \n- A group of patrons sits at the bar, watching the bartender prepare drinks.  \n- The bartender pours a liquid from a bottle into a martini glass held by a patron.", "history_tokens": 564, "history_utf8_bytes": 2269, "recent_frame_times_s": [228.011015625, 229.011015625, 230.011015625, 231.011015625, 232.011015625, 233.011015625, 234.011015625, 235.011015625, 236.011015625, 237.011015625, 238.011015625, 239.011015625, 240.011015625, 241.011015625, 242.011015625, 243.011015625, 244.011015625, 245.011015625, 246.011015625, 247.011015625, 248.011015625, 249.011015625, 250.011015625, 251.011015625, 252.011015625, 253.011015625, 254.011015625, 255.011015625, 256.011015625, 257.011015625], "recent_frames_sha256": "081b750909aaf89706f4f65978ad473384722603b2198a67254ce719793e5f16", "num_recent_frames": 30, "tq": 715222.25791785, "t1": 715223.732193409, "ta": 715223.732193409, "te": 715223.884785692, "first_response_s": 1.4742755589541048, "answer_total_s": 1.6268678419291973, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 405, "content_group": "d0696a3b857bd2d10170e9ffc2c9f1963b341414a380846f9dd63901b080c500", "question": {"question_id": "sample_405_a812_q0", "video_id": 405, "video_path": "./videos/sample_405_real.mp4", "annotation_index": 812, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual garnished a cocktail with a cherry and served it.", "B. The individual prepared a cocktail by mixing ingredients and shaking them.", "C. The individual added ice and lime to a drink, garnished it, and placed it on the bar counter.", "D. The individual was preparing a hot drink by heating it on the stove."], "answer": "C", "time_stamp_s": 373, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [363, 373], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_405_a812_q0", "video_id": 405, "time_stamp_s": 373, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "18f5076dc29bc6cb70a4047d201aed07d4037ff074ca54ea327bae5f76baff4c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [343.011015625, 344.011015625, 345.011015625, 346.011015625, 347.011015625, 348.011015625, 349.011015625, 350.011015625, 351.011015625, 352.011015625, 353.011015625, 354.011015625, 355.011015625, 356.011015625, 357.011015625, 358.011015625, 359.011015625, 360.011015625, 361.011015625, 362.011015625, 363.011015625, 364.011015625, 365.011015625, 366.011015625, 367.011015625, 368.011015625, 369.011015625, 370.011015625, 371.011015625, 372.011015625], "recent_frames_sha256": "6c2701d396ae52c37a4bc73aa7e8de232d198d809067d8a4c08176f90a05120c", "num_recent_frames": 30, "tq": 715309.403306704, "t1": 715321.312372297, "ta": 715321.312372297, "te": 715321.353495506, "first_response_s": 11.909065593034029, "answer_total_s": 11.950188801973127, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_405_a812_q0", "video_id": 405, "time_stamp_s": 373, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "874562a7dba8271f39b96fb2b11b08f7d7200411fbe3b8451fde9cbd46cd7b77", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Bartender opens a champagne bottle with a corkscrew, then places it on the bar counter.  \n- A green bottle (likely wine or champagne) is positioned on the bar, near the beer taps.  \n- A customer in a black jacket sits at the bar, holding a glass with an orange-colored drink.\n[30-60s] - Bartender hands a glass with orange drink to a customer while another customer holds a beer.  \n- A customer in a white shirt and another in a black jacket are seated at the bar, observing the bartender.  \n- The bartender uses a green-handled tool to handle a citrus fruit near a container of ice.\n[60-90s] - Barista’s hands are seen handling a small container, likely preparing or measuring ingredients.  \n- A customer in a white shirt is visible at the bar, interacting with the barista.  \n- The espresso machine is prominently positioned on the counter, with its digital display showing \"0:00\".\n[90-120s] - Bartender pours liquid from a green bottle into a metal shaker while customers watch.  \n- A customer in a dark suit holds a glass, positioned near the bar counter.  \n- The bar counter is cluttered with bottles, shakers, and a metal tray holding various items.\n[120-150s] - Bartender’s hands stir a cocktail in a metal shaker while facing customers.  \n- A woman in a white top watches the bartender, seated behind the bar.  \n- A man in a green jacket sits beside her, also observing the bartender’s actions.\n[150-180s] - Bartender stirs drink in metal shaker with long spoon, while holding another shaker steady.  \n- Two patrons (woman in white top, man in green jacket) watch attentively from behind the bar.  \n- Bar counter holds various bottles, ice, and tools; a large green bottle is prominent on left.\n[180-210s] - Bartender's hands pour liquid from a shaker into a metal cup, then place the cup on the bar counter.  \n- A woman in a white top and a man in a black jacket are seated at the bar, watching the bartender.  \n- The bar counter is cluttered with various bottles, a sink, and a tray of ice cubes.\n[210-240s] - Bartender retrieves a glass from a freezer and places it on the bar.  \n- A group of patrons sits at the bar, watching the bartender prepare drinks.  \n- The bartender pours a liquid from a bottle into a martini glass held by a patron.\n[240-270s] - Bartender pours drink from green bottle into martini glass, then hands it to customer.  \n- Customer in dark jacket receives drink and raises glass for toast with another patron.  \n- Bar counter cluttered with ice, citrus, and bottles; patrons seated behind bar visible.\n[270-300s] - Bartender pours dark liquid from a tap into a glass, then adds a garnish from a nearby container.  \n- A customer in a dark suit holds a glass and watches the bartender’s actions.  \n- The bar counter is cluttered with various bottles, glasses, and a sink, with patrons seated in the background.\n[300-330s] - A bartender pours a drink into a glass while another person holds a bottle nearby.  \n- A woman in a white shirt stands behind the bar, observing the drink preparation.  \n- A man in a dark jacket reaches into a refrigerator to select a bottle.\n[330-360s] - Bartender pours orange-colored drink into a glass held by a customer.  \n- Another bartender hands a glass of clear liquid to a customer while others are engaged in pouring or serving.  \n- A large green bottle is visible on the bar counter, positioned near the pouring area.", "history_tokens": 834, "history_utf8_bytes": 3404, "recent_frame_times_s": [343.011015625, 344.011015625, 345.011015625, 346.011015625, 347.011015625, 348.011015625, 349.011015625, 350.011015625, 351.011015625, 352.011015625, 353.011015625, 354.011015625, 355.011015625, 356.011015625, 357.011015625, 358.011015625, 359.011015625, 360.011015625, 361.011015625, 362.011015625, 363.011015625, 364.011015625, 365.011015625, 366.011015625, 367.011015625, 368.011015625, 369.011015625, 370.011015625, 371.011015625, 372.011015625], "recent_frames_sha256": "6c2701d396ae52c37a4bc73aa7e8de232d198d809067d8a4c08176f90a05120c", "num_recent_frames": 30, "tq": 715253.725842772, "t1": 715254.697777583, "ta": 715254.697777583, "te": 715254.73651585, "first_response_s": 0.9719348109792918, "answer_total_s": 1.0106730778934434, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 405, "content_group": "d0696a3b857bd2d10170e9ffc2c9f1963b341414a380846f9dd63901b080c500", "question": {"question_id": "sample_405_a813_q0", "video_id": 405, "video_path": "./videos/sample_405_real.mp4", "annotation_index": 813, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual prepared a hot beverage by boiling water and steeping tea.", "B. The individual garnished a cocktail with a cherry and served it to a customer.", "C. The individual filled several glasses with ice cubes from a container in preparation for drinks.", "D. The individual prepared a meal by grilling various ingredients and plating them."], "answer": "C", "time_stamp_s": 494, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [484, 494], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_405_a813_q0", "video_id": 405, "time_stamp_s": 494, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b378dcccb98a5979bce28eaa6cb8e94d3c19be8d72ceed763ee16d0f86effb30", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [464.011015625, 465.011015625, 466.011015625, 467.011015625, 468.011015625, 469.011015625, 470.011015625, 471.011015625, 472.011015625, 473.011015625, 474.011015625, 475.011015625, 476.011015625, 477.011015625, 478.011015625, 479.011015625, 480.011015625, 481.011015625, 482.011015625, 483.011015625, 484.011015625, 485.011015625, 486.011015625, 487.011015625, 488.011015625, 489.011015625, 490.011015625, 491.011015625, 492.011015625, 493.011015625], "recent_frames_sha256": "a60d9412ab07d2b27aca37875313030f0da9fd2ec3faddb9a5ba7d2af1faa6ed", "num_recent_frames": 30, "tq": 715321.367233773, "t1": 715331.897843944, "ta": 715331.897843944, "te": 715331.938781857, "first_response_s": 10.530610171030276, "answer_total_s": 10.571548084029928, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_405_a813_q0", "video_id": 405, "time_stamp_s": 494, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1d57bd56244b8368f8ea18eb6afaf6b004c8f8357ccefb8d55cbed5b018c94fc", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Barista’s hands are seen handling a small container, likely preparing or measuring ingredients.  \n- A customer in a white shirt is visible at the bar, interacting with the barista.  \n- The espresso machine is prominently positioned on the counter, with its digital display showing \"0:00\".\n[90-120s] - Bartender pours liquid from a green bottle into a metal shaker while customers watch.  \n- A customer in a dark suit holds a glass, positioned near the bar counter.  \n- The bar counter is cluttered with bottles, shakers, and a metal tray holding various items.\n[120-150s] - Bartender’s hands stir a cocktail in a metal shaker while facing customers.  \n- A woman in a white top watches the bartender, seated behind the bar.  \n- A man in a green jacket sits beside her, also observing the bartender’s actions.\n[150-180s] - Bartender stirs drink in metal shaker with long spoon, while holding another shaker steady.  \n- Two patrons (woman in white top, man in green jacket) watch attentively from behind the bar.  \n- Bar counter holds various bottles, ice, and tools; a large green bottle is prominent on left.\n[180-210s] - Bartender's hands pour liquid from a shaker into a metal cup, then place the cup on the bar counter.  \n- A woman in a white top and a man in a black jacket are seated at the bar, watching the bartender.  \n- The bar counter is cluttered with various bottles, a sink, and a tray of ice cubes.\n[210-240s] - Bartender retrieves a glass from a freezer and places it on the bar.  \n- A group of patrons sits at the bar, watching the bartender prepare drinks.  \n- The bartender pours a liquid from a bottle into a martini glass held by a patron.\n[240-270s] - Bartender pours drink from green bottle into martini glass, then hands it to customer.  \n- Customer in dark jacket receives drink and raises glass for toast with another patron.  \n- Bar counter cluttered with ice, citrus, and bottles; patrons seated behind bar visible.\n[270-300s] - Bartender pours dark liquid from a tap into a glass, then adds a garnish from a nearby container.  \n- A customer in a dark suit holds a glass and watches the bartender’s actions.  \n- The bar counter is cluttered with various bottles, glasses, and a sink, with patrons seated in the background.\n[300-330s] - A bartender pours a drink into a glass while another person holds a bottle nearby.  \n- A woman in a white shirt stands behind the bar, observing the drink preparation.  \n- A man in a dark jacket reaches into a refrigerator to select a bottle.\n[330-360s] - Bartender pours orange-colored drink into a glass held by a customer.  \n- Another bartender hands a glass of clear liquid to a customer while others are engaged in pouring or serving.  \n- A large green bottle is visible on the bar counter, positioned near the pouring area.\n[360-390s] - Bartender hands a glass of orange cocktail to a customer while another customer holds a green drink.  \n- A second bartender places a lime wedge into a glass containing ice and a green liquid.  \n- The bar counter is cluttered with bottles, a sink, and various bar tools, with patrons seated in the background.\n[390-420s] - Bartender pours amber liquid from a bottle into a glass, with bottles and bar tools visible in background.  \n- Bar counter is cluttered with numerous empty glasses and bottles, indicating active drink preparation.  \n- A black bowl is held by the bartender, suggesting it may be used for garnish or ingredient prep.\n[420-450s] - Barista's hand places a white cup under the espresso machine's spout, initiating extraction.  \n- A dark liquid is poured from a bottle into a glass, likely for a drink preparation.  \n- The barista's hand moves toward a metal shaker or container on the counter, suggesting next step in drink assembly.\n[450-480s] - Bartender pours dark liquid from a bottle into a glass, then adds a small amount from a metal shaker.  \n- A customer in a green jacket watches the bartender’s actions while seated at the bar.  \n- The bartender’s hands are visible manipulating tools and bottles, with a white cloth bag labeled \"BELLE\" nearby.", "history_tokens": 993, "history_utf8_bytes": 4100, "recent_frame_times_s": [464.011015625, 465.011015625, 466.011015625, 467.011015625, 468.011015625, 469.011015625, 470.011015625, 471.011015625, 472.011015625, 473.011015625, 474.011015625, 475.011015625, 476.011015625, 477.011015625, 478.011015625, 479.011015625, 480.011015625, 481.011015625, 482.011015625, 483.011015625, 484.011015625, 485.011015625, 486.011015625, 487.011015625, 488.011015625, 489.011015625, 490.011015625, 491.011015625, 492.011015625, 493.011015625], "recent_frames_sha256": "a60d9412ab07d2b27aca37875313030f0da9fd2ec3faddb9a5ba7d2af1faa6ed", "num_recent_frames": 30, "tq": 715285.985406054, "t1": 715287.047444019, "ta": 715287.047444019, "te": 715287.205506412, "first_response_s": 1.0620379650499672, "answer_total_s": 1.2201003580121323, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 406, "content_group": "117165f95d612c9eabf530a77fcc8b6028ae7baf63fa2e9e6b9dbfd3af888b68", "question": {"question_id": "sample_406_a1851_q0", "video_id": 406, "video_path": "./videos/sample_406_real.mp4", "annotation_index": 1851, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual gathered ice cubes, placed them into hand-washing sink.", "B. The individual poured liquor into a shaker, added ice, and mixed the drink.", "C. The individual fetched a glass, filled it with ice, and added a slice of lemon.", "D. The individual prepared various garnishes and placed them on the edge of a glass."], "answer": "A", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_406_a1851_q0", "video_id": 406, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "25bdd92f69440a9715aadb024972bca5c77a7b1079449101b61457cdaa77b2e0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03203125, 1.01203125, 2.01203125, 3.01203125, 4.01203125, 5.01203125, 6.01203125, 7.01203125, 8.01203125, 9.01203125], "recent_frames_sha256": "bd1bee0cd2d332477737992a7bd4c887ca3b82c81fab2a08f2c581e718b45134", "num_recent_frames": 10, "tq": 710756.103987059, "t1": 710766.50828864, "ta": 710766.50828864, "te": 710766.549566461, "first_response_s": 10.40430158097297, "answer_total_s": 10.445579402032308, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_406_a1851_q0", "video_id": 406, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e6b577906bd668efb472392ab1454033af9a2ab41ab884dc0afb0295a605a0df", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03203125, 1.01203125, 2.01203125, 3.01203125, 4.01203125, 5.01203125, 6.01203125, 7.01203125, 8.01203125, 9.01203125], "recent_frames_sha256": "bd1bee0cd2d332477737992a7bd4c887ca3b82c81fab2a08f2c581e718b45134", "num_recent_frames": 10, "tq": 715194.536345541, "t1": 715200.451843297, "ta": 715200.451843297, "te": 715200.491420108, "first_response_s": 5.91549775598105, "answer_total_s": 5.955074566998519, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 406, "content_group": "117165f95d612c9eabf530a77fcc8b6028ae7baf63fa2e9e6b9dbfd3af888b68", "question": {"question_id": "sample_406_a1852_q0", "video_id": 406, "video_path": "./videos/sample_406_real.mp4", "annotation_index": 1852, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individua organized bar utensils, retrieved a measure cup, and poured a clear liquid into it.", "B. The individual gathered fresh herbs, chopped them finely, and stored them away.", "C. The individual garnished a cocktail with a fruit slice and stirred it gently.", "D. The individual placed ice cubes into glasses, poured liquor, and prepared to serve them."], "answer": "A", "time_stamp_s": 112, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [102, 112], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_406_a1852_q0", "video_id": 406, "time_stamp_s": 112, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "108dac852c2c4764dc694f8258cd9da2013b2d1073b269ca0643c2a36f207df5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [82.01203125, 83.01203125, 84.01203125, 85.01203125, 86.01203125, 87.01203125, 88.01203125, 89.01203125, 90.01203125, 91.01203125, 92.01203125, 93.01203125, 94.01203125, 95.01203125, 96.01203125, 97.01203125, 98.01203125, 99.01203125, 100.01203125, 101.01203125, 102.01203125, 103.01203125, 104.01203125, 105.01203125, 106.01203125, 107.01203125, 108.01203125, 109.01203125, 110.01203125, 111.01203125], "recent_frames_sha256": "3ceb0a3e04a56c1b7e118474460844f83a35187b10c0023666d86c2b143b3277", "num_recent_frames": 30, "tq": 710766.564922306, "t1": 710777.331248291, "ta": 710777.331248291, "te": 710777.369820701, "first_response_s": 10.766325984965079, "answer_total_s": 10.804898394970223, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_406_a1852_q0", "video_id": 406, "time_stamp_s": 112, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6e52c16b9d9a8f5d00f8ec920dae6c39f9d5bf7ffbb8f02ad27bdd64c952add9", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Bartender's hand reaches for a metal shaker and then places it on the counter.  \n- A customer in a green jacket stands at the bar, observing the bartender's actions.  \n- The bar counter is cluttered with various tools, glasses, and containers, including a sink and a tray of ice.\n[30-60s] - Bartender's hand places a glass on the bar, then picks up a bottle and pours liquid into it.  \n- A green bottle stands prominently on the bar, next to a sink and a metal tray.  \n- The bar area is busy with staff and patrons, visible in the background.\n[60-90s] - A bartender pours amber liquid from a bottle into a metal shaker, with a green bottle and other bar tools visible nearby.  \n- A customer in a dark jacket stands at the bar, facing the bartender, while another person in a white shirt is seated nearby.  \n- The bar counter is cluttered with glasses, a sink, and various bottles, with patrons seated in the background.", "history_tokens": 226, "history_utf8_bytes": 929, "recent_frame_times_s": [82.01203125, 83.01203125, 84.01203125, 85.01203125, 86.01203125, 87.01203125, 88.01203125, 89.01203125, 90.01203125, 91.01203125, 92.01203125, 93.01203125, 94.01203125, 95.01203125, 96.01203125, 97.01203125, 98.01203125, 99.01203125, 100.01203125, 101.01203125, 102.01203125, 103.01203125, 104.01203125, 105.01203125, 106.01203125, 107.01203125, 108.01203125, 109.01203125, 110.01203125, 111.01203125], "recent_frames_sha256": "3ceb0a3e04a56c1b7e118474460844f83a35187b10c0023666d86c2b143b3277", "num_recent_frames": 30, "tq": 715222.27712994, "t1": 715223.732193409, "ta": 715223.732193409, "te": 715223.884785692, "first_response_s": 1.455063469009474, "answer_total_s": 1.6076557519845665, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 406, "content_group": "117165f95d612c9eabf530a77fcc8b6028ae7baf63fa2e9e6b9dbfd3af888b68", "question": {"question_id": "sample_406_a1853_q0", "video_id": 406, "video_path": "./videos/sample_406_real.mp4", "annotation_index": 1853, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual mixed and poured cocktails into glasses placed on a napkin,.", "B. The individual poured beer into several glasses alongside the shaker.", "C. The individual arranged various spirits on the bar counter.", "D. The individual cleared empty glasses and sanitized the bar counter meticulously."], "answer": "A", "time_stamp_s": 214, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [204, 214], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_406_a1853_q0", "video_id": 406, "time_stamp_s": 214, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b21caf642d8c33b0df0847997342138c490709361c44a67cb6c875025b6d8993", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [184.01203125, 185.01203125, 186.01203125, 187.01203125, 188.01203125, 189.01203125, 190.01203125, 191.01203125, 192.01203125, 193.01203125, 194.01203125, 195.01203125, 196.01203125, 197.01203125, 198.01203125, 199.01203125, 200.01203125, 201.01203125, 202.01203125, 203.01203125, 204.01203125, 205.01203125, 206.01203125, 207.01203125, 208.01203125, 209.01203125, 210.01203125, 211.01203125, 212.01203125, 213.01203125], "recent_frames_sha256": "8f3fe6c0b4bfe39b6db2444d354e07c240ea84b0d9525cfe5e103ed0ec04d7d2", "num_recent_frames": 30, "tq": 710777.389381231, "t1": 710788.341240065, "ta": 710788.341240065, "te": 710788.63829983, "first_response_s": 10.951858834014274, "answer_total_s": 11.248918598983437, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_406_a1853_q0", "video_id": 406, "time_stamp_s": 214, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e891bb01c995a0d031847fc43e3f63713e95a3b12b480c59291e8e2031729a7c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Bartender's hand reaches for a metal shaker and then places it on the counter.  \n- A customer in a green jacket stands at the bar, observing the bartender's actions.  \n- The bar counter is cluttered with various tools, glasses, and containers, including a sink and a tray of ice.\n[30-60s] - Bartender's hand places a glass on the bar, then picks up a bottle and pours liquid into it.  \n- A green bottle stands prominently on the bar, next to a sink and a metal tray.  \n- The bar area is busy with staff and patrons, visible in the background.\n[60-90s] - A bartender pours amber liquid from a bottle into a metal shaker, with a green bottle and other bar tools visible nearby.  \n- A customer in a dark jacket stands at the bar, facing the bartender, while another person in a white shirt is seated nearby.  \n- The bar counter is cluttered with glasses, a sink, and various bottles, with patrons seated in the background.\n[90-120s] - Bartender’s hand places a metal shaker on the bar counter, then picks up a glass.  \n- A customer in a dark jacket stands behind the bar, observing the bartender’s actions.  \n- The bar area is cluttered with bottles, glasses, and metal containers, with patrons seated in the background.\n[120-150s] - Bartender pours liquid from a shaker into a glass held by a customer.  \n- Customer in a green shirt holds a glass, positioned near the bar counter.  \n- Bar counter is cluttered with glasses, bottles, and ice, with patrons seated nearby.\n[150-180s] - Bartender’s hand holds a metal shaker, preparing to mix a drink.  \n- A woman in a black top stands behind the bar, facing the bartender.  \n- The bar counter is cluttered with bottles, glasses, and ice trays.\n[180-210s] - Bartender’s hand stirs a metal shaker with a long spoon, while holding the shaker steady with the other hand.  \n- A green bottle and two small glasses sit on the bar counter, positioned to the left of the shaker.  \n- The bar area is busy with patrons seated at tables in the background, and a sink is visible to the right of the shaker.", "history_tokens": 514, "history_utf8_bytes": 2056, "recent_frame_times_s": [184.01203125, 185.01203125, 186.01203125, 187.01203125, 188.01203125, 189.01203125, 190.01203125, 191.01203125, 192.01203125, 193.01203125, 194.01203125, 195.01203125, 196.01203125, 197.01203125, 198.01203125, 199.01203125, 200.01203125, 201.01203125, 202.01203125, 203.01203125, 204.01203125, 205.01203125, 206.01203125, 207.01203125, 208.01203125, 209.01203125, 210.01203125, 211.01203125, 212.01203125, 213.01203125], "recent_frames_sha256": "8f3fe6c0b4bfe39b6db2444d354e07c240ea84b0d9525cfe5e103ed0ec04d7d2", "num_recent_frames": 30, "tq": 715253.729919993, "t1": 715254.697777583, "ta": 715254.697777583, "te": 715254.73651585, "first_response_s": 0.9678575900616124, "answer_total_s": 1.006595856975764, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 406, "content_group": "117165f95d612c9eabf530a77fcc8b6028ae7baf63fa2e9e6b9dbfd3af888b68", "question": {"question_id": "sample_406_a1854_q0", "video_id": 406, "video_path": "./videos/sample_406_real.mp4", "annotation_index": 1854, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual poured a liquid into a jigger, combined it with other ingredients, and prepared the mixture for a cocktail.", "B. The individual participated in a conversation with customers while cleaning glassware.", "C. The individual garnished drinks with fruit slices and served them to waiting customers.", "D. The individual took orders from a group of patrons and noted them down."], "answer": "A", "time_stamp_s": 316, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [306, 316], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_406_a1854_q0", "video_id": 406, "time_stamp_s": 316, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f670d92d9f91d352d87255ad178f3eb05d12e4fdd9a4a194fa25fcaf4fe51502", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [286.01203125, 287.01203125, 288.01203125, 289.01203125, 290.01203125, 291.01203125, 292.01203125, 293.01203125, 294.01203125, 295.01203125, 296.01203125, 297.01203125, 298.01203125, 299.01203125, 300.01203125, 301.01203125, 302.01203125, 303.01203125, 304.01203125, 305.01203125, 306.01203125, 307.01203125, 308.01203125, 309.01203125, 310.01203125, 311.01203125, 312.01203125, 313.01203125, 314.01203125, 315.01203125], "recent_frames_sha256": "598909935e971678d911f33524ce08ce37347af8f1e44bd7168035f3f18235d1", "num_recent_frames": 30, "tq": 710788.651306248, "t1": 710799.689047812, "ta": 710799.689047812, "te": 710799.72729261, "first_response_s": 11.037741563981399, "answer_total_s": 11.07598636194598, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_406_a1854_q0", "video_id": 406, "time_stamp_s": 316, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d800b1e150ad7a02d9b3446bc302e6d2487530bd4a319e2f2d72b8f67601b88e", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Bartender's hand reaches for a metal shaker and then places it on the counter.  \n- A customer in a green jacket stands at the bar, observing the bartender's actions.  \n- The bar counter is cluttered with various tools, glasses, and containers, including a sink and a tray of ice.\n[30-60s] - Bartender's hand places a glass on the bar, then picks up a bottle and pours liquid into it.  \n- A green bottle stands prominently on the bar, next to a sink and a metal tray.  \n- The bar area is busy with staff and patrons, visible in the background.\n[60-90s] - A bartender pours amber liquid from a bottle into a metal shaker, with a green bottle and other bar tools visible nearby.  \n- A customer in a dark jacket stands at the bar, facing the bartender, while another person in a white shirt is seated nearby.  \n- The bar counter is cluttered with glasses, a sink, and various bottles, with patrons seated in the background.\n[90-120s] - Bartender’s hand places a metal shaker on the bar counter, then picks up a glass.  \n- A customer in a dark jacket stands behind the bar, observing the bartender’s actions.  \n- The bar area is cluttered with bottles, glasses, and metal containers, with patrons seated in the background.\n[120-150s] - Bartender pours liquid from a shaker into a glass held by a customer.  \n- Customer in a green shirt holds a glass, positioned near the bar counter.  \n- Bar counter is cluttered with glasses, bottles, and ice, with patrons seated nearby.\n[150-180s] - Bartender’s hand holds a metal shaker, preparing to mix a drink.  \n- A woman in a black top stands behind the bar, facing the bartender.  \n- The bar counter is cluttered with bottles, glasses, and ice trays.\n[180-210s] - Bartender’s hand stirs a metal shaker with a long spoon, while holding the shaker steady with the other hand.  \n- A green bottle and two small glasses sit on the bar counter, positioned to the left of the shaker.  \n- The bar area is busy with patrons seated at tables in the background, and a sink is visible to the right of the shaker.\n[210-240s] - Bartender places two orange-colored drinks on the bar counter.  \n- A hand reaches for a small container, likely containing a garnish or ingredient.  \n- The bar area is busy with patrons seated at the bar, some holding drinks.\n[240-270s] - Bartender's hand pours orange liquid from a shaker into a glass, with patrons visible in the background.  \n- A metal shaker is placed on a white napkin, and the bartender's hand is seen holding a small glass.  \n- The bar counter is cluttered with bottles, glasses, and a sink, with a large crowd of people seated around the bar.\n[270-300s] - Bartender's hands manipulate a small orange slice with a tool while facing a group of patrons.  \n- A man in a green vest stands behind the bar, holding a metal shaker and looking toward the bartender.  \n- The bar counter displays multiple bottles, glasses, and a sink, with patrons seated in the background.", "history_tokens": 736, "history_utf8_bytes": 2958, "recent_frame_times_s": [286.01203125, 287.01203125, 288.01203125, 289.01203125, 290.01203125, 291.01203125, 292.01203125, 293.01203125, 294.01203125, 295.01203125, 296.01203125, 297.01203125, 298.01203125, 299.01203125, 300.01203125, 301.01203125, 302.01203125, 303.01203125, 304.01203125, 305.01203125, 306.01203125, 307.01203125, 308.01203125, 309.01203125, 310.01203125, 311.01203125, 312.01203125, 313.01203125, 314.01203125, 315.01203125], "recent_frames_sha256": "598909935e971678d911f33524ce08ce37347af8f1e44bd7168035f3f18235d1", "num_recent_frames": 30, "tq": 715279.685690699, "t1": 715287.047444019, "ta": 715287.047444019, "te": 715287.205506412, "first_response_s": 7.361753319972195, "answer_total_s": 7.51981571293436, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 406, "content_group": "117165f95d612c9eabf530a77fcc8b6028ae7baf63fa2e9e6b9dbfd3af888b68", "question": {"question_id": "sample_406_a1855_q0", "video_id": 406, "video_path": "./videos/sample_406_real.mp4", "annotation_index": 1855, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual taken just now?", "options": ["A. The individual prepared a cocktail by shaking ingredients, straining into a glass, and adding ice cubes.", "B. The individual organized garnishes on the bar counter, then served drinks to customers.", "C. The individual retrieved a bottle from a refrigerator, checked its contents, and placed it back.", "D. The individual opened a refrigerator, retrieved a bottle, and nearly filled it with liquid."], "answer": "A", "time_stamp_s": 412, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [408, 418], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_406_a1855_q0", "video_id": 406, "time_stamp_s": 412, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "aba708ec3a544c7c0402333625f69c7b3f8418e3561aba6dcc9048d2693c7136", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [382.01203125, 383.01203125, 384.01203125, 385.01203125, 386.01203125, 387.01203125, 388.01203125, 389.01203125, 390.01203125, 391.01203125, 392.01203125, 393.01203125, 394.01203125, 395.01203125, 396.01203125, 397.01203125, 398.01203125, 399.01203125, 400.01203125, 401.01203125, 402.01203125, 403.01203125, 404.01203125, 405.01203125, 406.01203125, 407.01203125, 408.01203125, 409.01203125, 410.01203125, 411.01203125], "recent_frames_sha256": "2d69715e72ca2a5b913cda5d007d25236e28a698faed496ba62adaf4a5fbec2d", "num_recent_frames": 30, "tq": 715187.136697892, "t1": 715194.488397776, "ta": 715194.488397776, "te": 715194.526287389, "first_response_s": 7.351699884049594, "answer_total_s": 7.389589497004636, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_406_a1855_q0", "video_id": 406, "time_stamp_s": 412, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f8b3227066e8e270d6de05fb94b5924c7979831b7f9584f0648cfc0889b8e866", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Bartender's hand reaches for a metal shaker and then places it on the counter.  \n- A customer in a green jacket stands at the bar, observing the bartender's actions.  \n- The bar counter is cluttered with various tools, glasses, and containers, including a sink and a tray of ice.\n[30-60s] - Bartender's hand places a glass on the bar, then picks up a bottle and pours liquid into it.  \n- A green bottle stands prominently on the bar, next to a sink and a metal tray.  \n- The bar area is busy with staff and patrons, visible in the background.\n[60-90s] - A bartender pours amber liquid from a bottle into a metal shaker, with a green bottle and other bar tools visible nearby.  \n- A customer in a dark jacket stands at the bar, facing the bartender, while another person in a white shirt is seated nearby.  \n- The bar counter is cluttered with glasses, a sink, and various bottles, with patrons seated in the background.\n[90-120s] - Bartender’s hand places a metal shaker on the bar counter, then picks up a glass.  \n- A customer in a dark jacket stands behind the bar, observing the bartender’s actions.  \n- The bar area is cluttered with bottles, glasses, and metal containers, with patrons seated in the background.\n[120-150s] - Bartender pours liquid from a shaker into a glass held by a customer.  \n- Customer in a green shirt holds a glass, positioned near the bar counter.  \n- Bar counter is cluttered with glasses, bottles, and ice, with patrons seated nearby.\n[150-180s] - Bartender’s hand holds a metal shaker, preparing to mix a drink.  \n- A woman in a black top stands behind the bar, facing the bartender.  \n- The bar counter is cluttered with bottles, glasses, and ice trays.\n[180-210s] - Bartender’s hand stirs a metal shaker with a long spoon, while holding the shaker steady with the other hand.  \n- A green bottle and two small glasses sit on the bar counter, positioned to the left of the shaker.  \n- The bar area is busy with patrons seated at tables in the background, and a sink is visible to the right of the shaker.\n[210-240s] - Bartender places two orange-colored drinks on the bar counter.  \n- A hand reaches for a small container, likely containing a garnish or ingredient.  \n- The bar area is busy with patrons seated at the bar, some holding drinks.\n[240-270s] - Bartender's hand pours orange liquid from a shaker into a glass, with patrons visible in the background.  \n- A metal shaker is placed on a white napkin, and the bartender's hand is seen holding a small glass.  \n- The bar counter is cluttered with bottles, glasses, and a sink, with a large crowd of people seated around the bar.\n[270-300s] - Bartender's hands manipulate a small orange slice with a tool while facing a group of patrons.  \n- A man in a green vest stands behind the bar, holding a metal shaker and looking toward the bartender.  \n- The bar counter displays multiple bottles, glasses, and a sink, with patrons seated in the background.\n[300-330s] - Bartender’s hands pour a dark liquid from a small bottle into a glass, then add ice and stir.  \n- A green bottle and a metal shaker are visible on the bar counter, with a customer seated nearby.  \n- The bar area is cluttered with various bottles, glasses, and tools, indicating active bartending.\n[330-360s] - Bartender pours amber liquid from a bottle into a glass, placing it on the bar.  \n- A customer in a green shirt stands near the bar, observing the drink preparation.  \n- The bar counter is cluttered with bottles, glasses, and ice, with multiple patrons seated in the background.\n[360-390s] - Bartender picks up a metal shaker and begins shaking it vigorously.  \n- A customer in a white shirt is visible in the background, standing near the bar.  \n- The bar counter is cluttered with various bottles, glasses, and tools, including a large green bottle and a metal ice bucket.", "history_tokens": 957, "history_utf8_bytes": 3858, "recent_frame_times_s": [382.01203125, 383.01203125, 384.01203125, 385.01203125, 386.01203125, 387.01203125, 388.01203125, 389.01203125, 390.01203125, 391.01203125, 392.01203125, 393.01203125, 394.01203125, 395.01203125, 396.01203125, 397.01203125, 398.01203125, 399.01203125, 400.01203125, 401.01203125, 402.01203125, 403.01203125, 404.01203125, 405.01203125, 406.01203125, 407.01203125, 408.01203125, 409.01203125, 410.01203125, 411.01203125], "recent_frames_sha256": "2d69715e72ca2a5b913cda5d007d25236e28a698faed496ba62adaf4a5fbec2d", "num_recent_frames": 30, "tq": 715306.357311615, "t1": 715308.157793478, "ta": 715308.157793478, "te": 715308.364600173, "first_response_s": 1.8004818629706278, "answer_total_s": 2.0072885579429567, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 408, "content_group": "93288c8b91635d009980cb6a4b965e24a9735478ef6e2826b1826ad130d2129a", "question": {"question_id": "sample_408_a1706_q0", "video_id": 408, "video_path": "./videos/sample_408_real.mp4", "annotation_index": 1706, "question_index": 0, "question": "Which of the following best summarizes the actions taken by the individual just now?", "options": ["A. The individual prepared a cocktail, straining it into a glass and adding a garnish.", "B. The individual prepared a cold brew coffee, pouring it into a glass and adding ice cubes.", "C. The individual set the table with cutlery and plates, then folded napkins.", "D. The individual poured a hot coffee, added milk and sugar, and stirred it before serving."], "answer": "A", "time_stamp_s": 13, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_408_a1706_q0", "video_id": 408, "time_stamp_s": 13, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e29c45ec73ecacbc41156839bd1ac932ec96f955850b9524a06313bac1dd1c99", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.048, 1.0156333333333334, 2.0166333333333335, 3.0176333333333334, 4.018633333333334, 5.019633333333333, 6.0206333333333335, 7.021633333333333, 8.022633333333333, 9.023633333333333, 10.024633333333334, 11.025633333333333, 12.026633333333333], "recent_frames_sha256": "4d91214329b22f70279e4e63b36b73b81250154ca4f366eeb287a9449498a614", "num_recent_frames": 13, "tq": 718722.539849202, "t1": 718729.314485436, "ta": 718729.314485436, "te": 718729.35268376, "first_response_s": 6.774636233923957, "answer_total_s": 6.812834557960741, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_408_a1706_q0", "video_id": 408, "time_stamp_s": 13, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "403f8b62c7de135c1583339ad2e6e486ff0f9a7e9a25aa7a49ff010cf8b262fd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.048, 1.0156333333333334, 2.0166333333333335, 3.0176333333333334, 4.018633333333334, 5.019633333333333, 6.0206333333333335, 7.021633333333333, 8.022633333333333, 9.023633333333333, 10.024633333333334, 11.025633333333333, 12.026633333333333], "recent_frames_sha256": "4d91214329b22f70279e4e63b36b73b81250154ca4f366eeb287a9449498a614", "num_recent_frames": 13, "tq": 718520.639120683, "t1": 718536.296207599, "ta": 718536.296207599, "te": 718536.337138616, "first_response_s": 15.657086916035041, "answer_total_s": 15.69801793305669, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 408, "content_group": "93288c8b91635d009980cb6a4b965e24a9735478ef6e2826b1826ad130d2129a", "question": {"question_id": "sample_408_a1707_q0", "video_id": 408, "video_path": "./videos/sample_408_real.mp4", "annotation_index": 1707, "question_index": 0, "question": "Which of the following best summarizes the actions taken by the individual just now?", "options": ["A. The individual cleaned the glasses, added garnishes, and served them to the customers.", "B. The individual scooped ice into glasses.", "C. The individual wiped down the counter, refilled condiment containers, and organized the bar area.", "D. The individual prepared different cocktails, added straws and stirrers, and placed them on the counter."], "answer": "B", "time_stamp_s": 183, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [173, 183], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_408_a1707_q0", "video_id": 408, "time_stamp_s": 183, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d68d5ac41095affa0f1f18f77357cc4dcc3ade15fd5947d0b30b06619cbcfa9a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [153.0008, 154.0018, 155.0028, 156.0038, 157.0048, 158.0058, 159.0068, 160.0078, 161.0088, 162.0098, 163.0108, 164.0118, 165.0128, 166.0138, 167.0148, 168.0158, 169.0168, 170.0178, 171.0188, 172.0198, 173.0208, 174.0218, 175.0228, 176.0238, 177.0248, 178.0258, 179.0268, 180.0278, 181.0288, 182.0298], "recent_frames_sha256": "a519df0c9a8f0a1a93a0bd0d6b85024163ae7f6fcf2dc532f8bfafecdc751f74", "num_recent_frames": 30, "tq": 718729.367266672, "t1": 718742.275280427, "ta": 718742.275280427, "te": 718742.314844664, "first_response_s": 12.908013754989952, "answer_total_s": 12.94757799198851, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_408_a1707_q0", "video_id": 408, "time_stamp_s": 183, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "05065aba52de5b7816b210d9e6ec1bbbf414ff3f388301cd4d5a526499c560d6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Bartender pours liquid from a red strainer into a martini glass, then transfers it to a white paper-lined tray.  \n- Bartender places a glass on the tray, then picks up a cocktail shaker and moves it toward a sink area.  \n- A customer is visible in the background, seated at a table with drinks and food, while the bartender continues preparing the drink.\n[30-60s] - Bartender's hand reaches for a bottle from a shelf, then moves to a cooler to retrieve a glass.  \n- A customer in a dark suit holds a glass, receiving a drink from the bartender.  \n- The bar counter is cluttered with bottles, glasses, and a coffee machine, with a sink and ice bin visible.\n[60-90s] - A hand holds a metal cup steady over a tray of ice, while another hand pours liquid from a shaker into the cup.  \n- The bar counter is cluttered with bottles, tools, and a tray of ice, with patrons visible in the background.  \n- The camera angle shifts slightly, showing the bar’s interior and the movement of the pouring action.\n[90-120s] - Bartender’s hand reaches into ice bin, then pulls out a metal shaker.  \n- Another hand holds a glass, preparing to pour liquid from a bottle.  \n- Bar counter shows various bottles, shakers, and a green cutting board with an orange.\n[120-150s] - Barista hands a white paper towel to a customer at the counter.  \n- Customer places a drink order on the counter, with a green cutting board and ice tray nearby.  \n- Barista reaches for a bottle of orange liquid from a shelf behind the counter.\n[150-180s] - Bartender pours amber liquid from a bottle into two tall glasses using a jigger.  \n- Glasses sit on a white tray atop a mirrored bar surface, surrounded by ice and garnishes.  \n- Background shows patrons seated at tables, with dim lighting and reflective surfaces.", "history_tokens": 436, "history_utf8_bytes": 1790, "recent_frame_times_s": [153.0008, 154.0018, 155.0028, 156.0038, 157.0048, 158.0058, 159.0068, 160.0078, 161.0088, 162.0098, 163.0108, 164.0118, 165.0128, 166.0138, 167.0148, 168.0158, 169.0168, 170.0178, 171.0188, 172.0198, 173.0208, 174.0218, 175.0228, 176.0238, 177.0248, 178.0258, 179.0268, 180.0278, 181.0288, 182.0298], "recent_frames_sha256": "a519df0c9a8f0a1a93a0bd0d6b85024163ae7f6fcf2dc532f8bfafecdc751f74", "num_recent_frames": 30, "tq": 718580.252348182, "t1": 718581.573959082, "ta": 718581.573959082, "te": 718581.611786722, "first_response_s": 1.3216108999913558, "answer_total_s": 1.3594385399483144, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 408, "content_group": "93288c8b91635d009980cb6a4b965e24a9735478ef6e2826b1826ad130d2129a", "question": {"question_id": "sample_408_a1708_q0", "video_id": 408, "video_path": "./videos/sample_408_real.mp4", "annotation_index": 1708, "question_index": 0, "question": "Which of the following best summarizes the actions taken by the individual just now?", "options": ["A. The individual mixed and served a drink, cleaned up the glasses, and rearranged the bottles.", "B. The individual poured champagne for customers.", "C. The individual prepared multiple cocktails, added garnishes, and served them to customers.", "D. The individual restocked the bar, washed and dried glasses, and set the table."], "answer": "B", "time_stamp_s": 347, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [346, 356], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_408_a1708_q0", "video_id": 408, "time_stamp_s": 347, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2c14869a8d9ff6adae505c92a616751ee7076816e8ffda80e033a77a85df1a8d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [317.03133333333335, 318.0323333333333, 319.03333333333336, 320.00096666666667, 321.00196666666665, 322.0029666666667, 323.00396666666666, 324.0049666666667, 325.00596666666667, 326.00696666666664, 327.0079666666667, 328.00896666666665, 329.0099666666667, 330.01096666666666, 331.0119666666667, 332.01296666666667, 333.01396666666665, 334.0149666666667, 335.01596666666666, 336.0169666666667, 337.01796666666667, 338.01896666666664, 339.0199666666667, 340.02096666666665, 341.0219666666667, 342.02296666666666, 343.0239666666667, 344.02496666666667, 345.02596666666665, 346.0269666666667], "recent_frames_sha256": "bb268916c8d627b3db030efe37bbeee6cf6758e3ffeaa5223ea526d1d9d2f185", "num_recent_frames": 30, "tq": 718742.330342493, "t1": 718754.292442687, "ta": 718754.292442687, "te": 718754.330704528, "first_response_s": 11.96210019395221, "answer_total_s": 12.00036203500349, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_408_a1708_q0", "video_id": 408, "time_stamp_s": 347, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9a04e09bd63cb69775ad7747985b7d7fb3c675a736c14ff016347554b73f15b3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Bartender pours liquid from a red strainer into a martini glass, then transfers it to a white paper-lined tray.  \n- Bartender places a glass on the tray, then picks up a cocktail shaker and moves it toward a sink area.  \n- A customer is visible in the background, seated at a table with drinks and food, while the bartender continues preparing the drink.\n[30-60s] - Bartender's hand reaches for a bottle from a shelf, then moves to a cooler to retrieve a glass.  \n- A customer in a dark suit holds a glass, receiving a drink from the bartender.  \n- The bar counter is cluttered with bottles, glasses, and a coffee machine, with a sink and ice bin visible.\n[60-90s] - A hand holds a metal cup steady over a tray of ice, while another hand pours liquid from a shaker into the cup.  \n- The bar counter is cluttered with bottles, tools, and a tray of ice, with patrons visible in the background.  \n- The camera angle shifts slightly, showing the bar’s interior and the movement of the pouring action.\n[90-120s] - Bartender’s hand reaches into ice bin, then pulls out a metal shaker.  \n- Another hand holds a glass, preparing to pour liquid from a bottle.  \n- Bar counter shows various bottles, shakers, and a green cutting board with an orange.\n[120-150s] - Barista hands a white paper towel to a customer at the counter.  \n- Customer places a drink order on the counter, with a green cutting board and ice tray nearby.  \n- Barista reaches for a bottle of orange liquid from a shelf behind the counter.\n[150-180s] - Bartender pours amber liquid from a bottle into two tall glasses using a jigger.  \n- Glasses sit on a white tray atop a mirrored bar surface, surrounded by ice and garnishes.  \n- Background shows patrons seated at tables, with dim lighting and reflective surfaces.\n[180-210s] - Bartender pours liquid from a bottle into two tall glasses filled with ice.  \n- Glasses are placed on a white napkin atop a dark, reflective bar surface.  \n- A large glass bottle and other bar tools are visible in the background.\n[210-240s] - A bartender's hand holds a green bottle, pouring liquid into three glasses filled with orange-colored drinks.  \n- A woman in a pink top stands behind the bar, observing the pouring action.  \n- The glasses are arranged on a white tray, positioned on the bar counter near a large bottle of liquor and ice trays.\n[240-270s] - Bartender adds a garnish to each of three tall glasses containing orange-colored cocktails.  \n- A hand holds a tray with the three glasses, positioned over a tray of ice and bottles.  \n- A second hand uses a spoon to place a garnish on the top of each drink.\n[270-300s] - A hand places a glass of amber-colored drink on a bar counter near a metal ice bucket.  \n- Two hands raise glasses in a toast, with one hand holding a glass containing a golden liquid.  \n- The bar counter features various bottles, a metal shaker, and a tray with garnishes, all under dim lighting.\n[300-330s] - Bartender's hand reaches for a bottle of \"Bourbon\" whiskey, lifting it from the bar shelf.  \n- A row of clear, empty glasses is arranged neatly on a white cloth on the bar surface.  \n- The bar area is cluttered with various bottles, shakers, and tools, indicating active preparation.", "history_tokens": 794, "history_utf8_bytes": 3236, "recent_frame_times_s": [317.03133333333335, 318.0323333333333, 319.03333333333336, 320.00096666666667, 321.00196666666665, 322.0029666666667, 323.00396666666666, 324.0049666666667, 325.00596666666667, 326.00696666666664, 327.0079666666667, 328.00896666666665, 329.0099666666667, 330.01096666666666, 331.0119666666667, 332.01296666666667, 333.01396666666665, 334.0149666666667, 335.01596666666666, 336.0169666666667, 337.01796666666667, 338.01896666666664, 339.0199666666667, 340.02096666666665, 341.0219666666667, 342.02296666666666, 343.0239666666667, 344.02496666666667, 345.02596666666665, 346.0269666666667], "recent_frames_sha256": "bb268916c8d627b3db030efe37bbeee6cf6758e3ffeaa5223ea526d1d9d2f185", "num_recent_frames": 30, "tq": 718624.10278548, "t1": 718625.976922331, "ta": 718625.976922331, "te": 718626.34994934, "first_response_s": 1.8741368510527536, "answer_total_s": 2.2471638600109145, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 408, "content_group": "93288c8b91635d009980cb6a4b965e24a9735478ef6e2826b1826ad130d2129a", "question": {"question_id": "sample_408_a1709_q0", "video_id": 408, "video_path": "./videos/sample_408_real.mp4", "annotation_index": 1709, "question_index": 0, "question": "Which of the following best summarizes the actions taken by the individuals just now?", "options": ["A. The individuals prepared and cleaned glasses, arranged spirits, and set up the bar for service.", "B. The individuals served drinks to customers, rearranged the menu items, and cleaned the bar.", "C. The individuals stocked the refrigerator with new items, prepared snacks, and wiped down shelves.", "D. The individuals mixed drinks while managing the bar area."], "answer": "D", "time_stamp_s": 529, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [519, 529], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_408_a1709_q0", "video_id": 408, "time_stamp_s": 529, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ba997945f9976fc61b53f92ca8e8a10e585ad869c982ff9c5bbbe1c8b9f8894d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [499.0131333333333, 500.01413333333335, 501.0151333333333, 502.01613333333336, 503.01713333333333, 504.0181333333333, 505.01913333333334, 506.0201333333333, 507.02113333333335, 508.02213333333333, 509.0231333333333, 510.02413333333334, 511.0251333333333, 512.0261333333333, 513.0271333333334, 514.0281333333334, 515.0291333333333, 516.0301333333333, 517.0311333333333, 518.0321333333334, 519.0331333333334, 520.0007666666667, 521.0017666666666, 522.0027666666666, 523.0037666666667, 524.0047666666667, 525.0057666666667, 526.0067666666666, 527.0077666666666, 528.0087666666667], "recent_frames_sha256": "21c9bdaf8009f2bdb12f2226d19cbb4a53b6435ea4eb834557f9c5fd3969f47c", "num_recent_frames": 30, "tq": 718754.346721541, "t1": 718768.205037737, "ta": 718768.205037737, "te": 718768.244618101, "first_response_s": 13.85831619601231, "answer_total_s": 13.897896560025401, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_408_a1709_q0", "video_id": 408, "time_stamp_s": 529, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7b669fdc9d04b42cba296c937ac2cdb30ef490fd4c9f9226ed804399a2a7598b", "condition_order": ["notes", "recent"], "memory": "[90-120s] - Bartender’s hand reaches into ice bin, then pulls out a metal shaker.  \n- Another hand holds a glass, preparing to pour liquid from a bottle.  \n- Bar counter shows various bottles, shakers, and a green cutting board with an orange.\n[120-150s] - Barista hands a white paper towel to a customer at the counter.  \n- Customer places a drink order on the counter, with a green cutting board and ice tray nearby.  \n- Barista reaches for a bottle of orange liquid from a shelf behind the counter.\n[150-180s] - Bartender pours amber liquid from a bottle into two tall glasses using a jigger.  \n- Glasses sit on a white tray atop a mirrored bar surface, surrounded by ice and garnishes.  \n- Background shows patrons seated at tables, with dim lighting and reflective surfaces.\n[180-210s] - Bartender pours liquid from a bottle into two tall glasses filled with ice.  \n- Glasses are placed on a white napkin atop a dark, reflective bar surface.  \n- A large glass bottle and other bar tools are visible in the background.\n[210-240s] - A bartender's hand holds a green bottle, pouring liquid into three glasses filled with orange-colored drinks.  \n- A woman in a pink top stands behind the bar, observing the pouring action.  \n- The glasses are arranged on a white tray, positioned on the bar counter near a large bottle of liquor and ice trays.\n[240-270s] - Bartender adds a garnish to each of three tall glasses containing orange-colored cocktails.  \n- A hand holds a tray with the three glasses, positioned over a tray of ice and bottles.  \n- A second hand uses a spoon to place a garnish on the top of each drink.\n[270-300s] - A hand places a glass of amber-colored drink on a bar counter near a metal ice bucket.  \n- Two hands raise glasses in a toast, with one hand holding a glass containing a golden liquid.  \n- The bar counter features various bottles, a metal shaker, and a tray with garnishes, all under dim lighting.\n[300-330s] - Bartender's hand reaches for a bottle of \"Bourbon\" whiskey, lifting it from the bar shelf.  \n- A row of clear, empty glasses is arranged neatly on a white cloth on the bar surface.  \n- The bar area is cluttered with various bottles, shakers, and tools, indicating active preparation.\n[330-360s] - Bartender pours champagne from a bottle into a glass held by a customer.  \n- Bar counter displays various liquor bottles and glasses, with a refrigerator visible in the background.  \n- A customer’s hand is seen holding a glass as the bartender pours.\n[360-390s] - Bartender's hand holds a metal shaker, positioned near a tap with a flowing liquid stream.  \n- A green cutting board with chopped ingredients is visible to the right of the shaker.  \n- The bar counter features multiple taps, bottles, and a tray with orange slices, all under dim lighting.\n[390-420s] - A bartender pours a dark liquid from a tap into a white cup, with the cup held steady by a hand in a white sleeve.  \n- The camera pans to show a busy bar counter with multiple patrons seated, some holding drinks, and a sink area with ice and glassware.  \n- A hand reaches for a glass on the counter, then moves toward a sink, suggesting preparation or cleanup activity.\n[420-450s] - Bartender’s hand holds a glass under a faucet, filling it with water.  \n- A large, ornate bottle of liquor sits prominently on the bar counter.  \n- The bar area is cluttered with various bottles, glasses, and a sink, with patrons visible in the background.\n[450-480s] - Barista hands wipe a glass with a cloth, then place it into a sink filled with ice.  \n- A black cloth is picked up and placed on the bar counter, near a sink and glassware.  \n- The camera pans across the bar, showing multiple sinks, bottles, and patrons seated at the bar.\n[480-510s] - A person in a dark shirt is seen washing a glass in a sink, using a white cloth or sponge.  \n- The sink area has a stainless steel countertop and a white appliance (possibly a water dispenser) nearby.  \n- A blue plastic container is visible on the counter, likely for waste or cleaning supplies.", "history_tokens": 995, "history_utf8_bytes": 4045, "recent_frame_times_s": [499.0131333333333, 500.01413333333335, 501.0151333333333, 502.01613333333336, 503.01713333333333, 504.0181333333333, 505.01913333333334, 506.0201333333333, 507.02113333333335, 508.02213333333333, 509.0231333333333, 510.02413333333334, 511.0251333333333, 512.0261333333333, 513.0271333333334, 514.0281333333334, 515.0291333333333, 516.0301333333333, 517.0311333333333, 518.0321333333334, 519.0331333333334, 520.0007666666667, 521.0017666666666, 522.0027666666666, 523.0037666666667, 524.0047666666667, 525.0057666666667, 526.0067666666666, 527.0077666666666, 528.0087666666667], "recent_frames_sha256": "21c9bdaf8009f2bdb12f2226d19cbb4a53b6435ea4eb834557f9c5fd3969f47c", "num_recent_frames": 30, "tq": 718672.582555401, "t1": 718673.913528182, "ta": 718673.913528182, "te": 718673.95103407, "first_response_s": 1.3309727809391916, "answer_total_s": 1.3684786689700559, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 408, "content_group": "93288c8b91635d009980cb6a4b965e24a9735478ef6e2826b1826ad130d2129a", "question": {"question_id": "sample_408_a1710_q0", "video_id": 408, "video_path": "./videos/sample_408_real.mp4", "annotation_index": 1710, "question_index": 0, "question": "Which of the following best summarizes the actions taken by the individual just now?", "options": ["A. The individual prepared different cocktails, added ice and garnishes, and served them to customers at the bar.", "B. The individual cooked food, plated the dishes, and served them to customers at the bar.", "C. The individual prepared different desserts, added toppings, and served them to customers at the bar.", "D. The individual set up bar decorations, cleaned the glasses, and served water to customers at the bar."], "answer": "A", "time_stamp_s": 702, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [692, 702], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_408_a1710_q0", "video_id": 408, "time_stamp_s": 702, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "24bac6120362fb0eafda95403f4f8ca902a01778ccaf6f63dff2054a4d661ebc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [672.0193, 673.0203, 674.0213, 675.0223, 676.0233, 677.0243, 678.0253, 679.0263, 680.0273, 681.0283, 682.0293, 683.0303, 684.0313, 685.0323, 686.0333, 687.0009333333334, 688.0019333333333, 689.0029333333333, 690.0039333333333, 691.0049333333334, 692.0059333333334, 693.0069333333333, 694.0079333333333, 695.0089333333333, 696.0099333333334, 697.0109333333334, 698.0119333333333, 699.0129333333333, 700.0139333333333, 701.0149333333334], "recent_frames_sha256": "72eaeca5c59ffa2dcc184fdd96d205438a87ff98e3416b1922ad00721ebff9e1", "num_recent_frames": 30, "tq": 718768.270255078, "t1": 718779.456426325, "ta": 718779.456426325, "te": 718779.494961618, "first_response_s": 11.186171247041784, "answer_total_s": 11.224706540000625, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_408_a1710_q0", "video_id": 408, "time_stamp_s": 702, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f1d297a1270509a32b9c6ab1fe6b1e5d6c077e3c64fd26a9bb2d096ae3425fa7", "condition_order": ["notes", "recent"], "memory": "[300-330s] - Bartender's hand reaches for a bottle of \"Bourbon\" whiskey, lifting it from the bar shelf.  \n- A row of clear, empty glasses is arranged neatly on a white cloth on the bar surface.  \n- The bar area is cluttered with various bottles, shakers, and tools, indicating active preparation.\n[330-360s] - Bartender pours champagne from a bottle into a glass held by a customer.  \n- Bar counter displays various liquor bottles and glasses, with a refrigerator visible in the background.  \n- A customer’s hand is seen holding a glass as the bartender pours.\n[360-390s] - Bartender's hand holds a metal shaker, positioned near a tap with a flowing liquid stream.  \n- A green cutting board with chopped ingredients is visible to the right of the shaker.  \n- The bar counter features multiple taps, bottles, and a tray with orange slices, all under dim lighting.\n[390-420s] - A bartender pours a dark liquid from a tap into a white cup, with the cup held steady by a hand in a white sleeve.  \n- The camera pans to show a busy bar counter with multiple patrons seated, some holding drinks, and a sink area with ice and glassware.  \n- A hand reaches for a glass on the counter, then moves toward a sink, suggesting preparation or cleanup activity.\n[420-450s] - Bartender’s hand holds a glass under a faucet, filling it with water.  \n- A large, ornate bottle of liquor sits prominently on the bar counter.  \n- The bar area is cluttered with various bottles, glasses, and a sink, with patrons visible in the background.\n[450-480s] - Barista hands wipe a glass with a cloth, then place it into a sink filled with ice.  \n- A black cloth is picked up and placed on the bar counter, near a sink and glassware.  \n- The camera pans across the bar, showing multiple sinks, bottles, and patrons seated at the bar.\n[480-510s] - A person in a dark shirt is seen washing a glass in a sink, using a white cloth or sponge.  \n- The sink area has a stainless steel countertop and a white appliance (possibly a water dispenser) nearby.  \n- A blue plastic container is visible on the counter, likely for waste or cleaning supplies.\n[510-540s] - Bartender’s hand reaches for a bottle of liquor from a tray on the bar counter.  \n- A customer in a red top is seated at the bar, facing the bartender.  \n- The bar counter is cluttered with glasses, ice, and various bottles, including a prominent bottle of whiskey.\n[540-570s] - Bartender’s hand reaches for a metal shaker, then places it on the bar counter.  \n- A woman in a pink top is seated at the bar, observing the bartender’s actions.  \n- The bar counter is cluttered with bottles, glasses, and a sink, with ice and various bar tools visible.\n[570-600s] - Bartender’s hand holds a metal shaker, preparing to shake a drink.  \n- A person in a pink shirt is visible in the background, working near the bar.  \n- The bar counter is cluttered with bottles, glasses, and a sink filled with water.\n[600-630s] - Bartender stirs a metal shaker with a long spoon while holding it steady on the bar.\n- A woman in a pink top sits at the bar, facing the bartender, with her hands near her face.\n- The bar counter features a large bottle, ice trays, and various bar tools, with a white napkin placed beside the shaker.\n[630-660s] - Bartender’s hand places a stirred cocktail into a glass on the bar, then adds a straw.  \n- A customer in a red top is seated at the bar, interacting with another person.  \n- The bar counter features a bottle of liquor, ice, and various bar tools, with a green napkin visible.\n[660-690s] - A bartender in a dark uniform is seen from behind, actively preparing drinks at a bar counter.  \n- A customer’s hand reaches for a bottle of alcohol, likely to pour a drink, while others are seated at the bar.  \n- The bar counter is cluttered with various bottles, glasses, and bar tools, indicating a busy service environment.", "history_tokens": 972, "history_utf8_bytes": 3880, "recent_frame_times_s": [672.0193, 673.0203, 674.0213, 675.0223, 676.0233, 677.0243, 678.0253, 679.0263, 680.0273, 681.0283, 682.0293, 683.0303, 684.0313, 685.0323, 686.0333, 687.0009333333334, 688.0019333333333, 689.0029333333333, 690.0039333333333, 691.0049333333334, 692.0059333333334, 693.0069333333333, 694.0079333333333, 695.0089333333333, 696.0099333333334, 697.0109333333334, 698.0119333333333, 699.0129333333333, 700.0139333333333, 701.0149333333334], "recent_frames_sha256": "72eaeca5c59ffa2dcc184fdd96d205438a87ff98e3416b1922ad00721ebff9e1", "num_recent_frames": 30, "tq": 718721.387344362, "t1": 718722.368464475, "ta": 718722.368464475, "te": 718722.516546076, "first_response_s": 0.9811201130505651, "answer_total_s": 1.1292017140658572, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 409, "content_group": "ef04dd7eabd683a9944056ab6e27f42eaef86787e6a4449ec833bd6a8e200e46", "question": {"question_id": "sample_409_a388_q0", "video_id": 409, "video_path": "./videos/sample_409_real.mp4", "annotation_index": 388, "question_index": 0, "question": "Which option best summarizes what was just shown?", "options": ["A. A person was preparing and serving hamburgers to a line of customers at a busy street corner.", "B. A mobile food truck opened its serving window near a shopping area in the morning.", "C. A vendor inside a food truck was grilling burgers on a barbecue and handing them to customers.", "D. A food truck got stuck in traffic and had to be manually pushed to the side of the road by several people."], "answer": "B", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_409_a388_q0", "video_id": 409, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "aca3aeb1624fc02c9810b8d39ce22b6d904ca6c3701594c2767304fd496b443e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "ac54fb59efe11e9757412dc53dd5e7bb7c0a5f75b4610c884d731c02854ecc80", "num_recent_frames": 11, "tq": 718494.611790234, "t1": 718499.985694521, "ta": 718499.985694521, "te": 718500.026296337, "first_response_s": 5.373904287000187, "answer_total_s": 5.414506103028543, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_409_a388_q0", "video_id": 409, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "950cd9e9ba86a84987ac09c0100e5676d965d657813004067acb2f043629385f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "ac54fb59efe11e9757412dc53dd5e7bb7c0a5f75b4610c884d731c02854ecc80", "num_recent_frames": 11, "tq": 718298.98720033, "t1": 718313.461055767, "ta": 718313.461055767, "te": 718313.654761956, "first_response_s": 14.47385543701239, "answer_total_s": 14.667561625945382, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 409, "content_group": "ef04dd7eabd683a9944056ab6e27f42eaef86787e6a4449ec833bd6a8e200e46", "question": {"question_id": "sample_409_a389_q0", "video_id": 409, "video_path": "./videos/sample_409_real.mp4", "annotation_index": 389, "question_index": 0, "question": "Which option best summarizes what was just shown?", "options": ["A. A person was cleaning the kitchen area and restocking spices and sauces.", "B. A vendor was arranging different types of drinks on the countertop in a food truck.", "C. Several people were unloading supplies from a truck into a storage area.", "D. A chef was heating oil in a pan to start cooking a meal."], "answer": "B", "time_stamp_s": 167, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [158, 168], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_409_a389_q0", "video_id": 409, "time_stamp_s": 167, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b7f492f91086cf10cae4127a39fe9e09f61e7487fbd12aff1e2295b440168272", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0], "recent_frames_sha256": "2f727dbf515db5c08fc5391a37121b7e2809c345b024a982341f69f1d1f73577", "num_recent_frames": 30, "tq": 718500.041121183, "t1": 718514.400814429, "ta": 718514.400814429, "te": 718514.441299104, "first_response_s": 14.359693246078677, "answer_total_s": 14.40017792105209, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_409_a389_q0", "video_id": 409, "time_stamp_s": 167, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "330a10bfdde7e26f845e0c37093599f56719180e865e3406f1141913bbc585a9", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A black food trailer labeled \"BURGER HYDEN\" is parked outdoors with its serving window open, revealing a clean, stainless steel interior kitchen.  \n- Inside, a person's hand is seen placing a black glove into a box labeled \"NITEL\" near a window, suggesting preparation or hygiene setup.  \n- The trailer's interior features stainless steel countertops, sinks, and a large ventilation hood, indicating a professional food preparation setup.\n[30-60s] - Hands in black gloves handle a black object, likely a kitchen tool, near a stainless steel appliance.  \n- The appliance, branded \"Diammond,\" has a visible control knob and a water tap, with a drawer underneath containing small items.  \n- A white box labeled \"NITRA\" sits on the counter, alongside other kitchen items, suggesting a setup or preparation phase.\n[60-90s] - Gloved hand lifts a metal fryer basket from a deep fryer, then places it on a countertop.  \n- The hand moves to a refrigerator, opens it, and retrieves a plastic container with a brownish substance.  \n- The container is placed on the counter next to another container holding red-pink contents, near a box of gloves and a cord.\n[90-120s] - A gloved hand opens a stainless steel refrigerator, revealing shelves with condiments and a white container on the bottom shelf.  \n- The hand removes a white container filled with sliced red onions, then places it on the counter.  \n- The hand subsequently removes another white container filled with sliced zucchini, placing it next to the onions on the counter.\n[120-150s] - Gloved hands transfer a container of shredded green vegetables from a shelf to a countertop.  \n- A second container, filled with brown granular substance, is placed beside the first.  \n- A hand reaches into a refrigerator, pulling out a can of soda and placing it on the counter.", "history_tokens": 415, "history_utf8_bytes": 1825, "recent_frame_times_s": [138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0], "recent_frames_sha256": "2f727dbf515db5c08fc5391a37121b7e2809c345b024a982341f69f1d1f73577", "num_recent_frames": 30, "tq": 718349.316954531, "t1": 718357.063801637, "ta": 718357.063801637, "te": 718357.406452712, "first_response_s": 7.746847106027417, "answer_total_s": 8.089498181012459, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 409, "content_group": "ef04dd7eabd683a9944056ab6e27f42eaef86787e6a4449ec833bd6a8e200e46", "question": {"question_id": "sample_409_a390_q0", "video_id": 409, "video_path": "./videos/sample_409_real.mp4", "annotation_index": 390, "question_index": 0, "question": "Which option best summarizes what was just shown?", "options": ["A. A person was unloading kitchen equipment from a truck and placing it on a counter.", "B. A person was stocking a refrigerator with beverages and condiments.", "C. A person was organizing cooking ingredients.", "D. A person was preparing ingredients for a recipe by mixing spices in different containers."], "answer": "C", "time_stamp_s": 326, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [316, 326], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_409_a390_q0", "video_id": 409, "time_stamp_s": 326, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2cd7769aa0c21e92e7a068b15eaa0592b437a6dff98bcd458a4281643eac6748", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0], "recent_frames_sha256": "c65eed296d005dce74606721c23687ad0751711e7eeb36a5a67d1d00e081d30e", "num_recent_frames": 30, "tq": 718514.457621246, "t1": 718521.594697035, "ta": 718521.594697035, "te": 718521.633845577, "first_response_s": 7.1370757890399545, "answer_total_s": 7.17622433102224, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_409_a390_q0", "video_id": 409, "time_stamp_s": 326, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "de6154c3cbb96e73bdcef2f8c9ffd3602032da29bc0397f6fb80d9413f3aaa17", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A black food trailer labeled \"BURGER HYDEN\" is parked outdoors with its serving window open, revealing a clean, stainless steel interior kitchen.  \n- Inside, a person's hand is seen placing a black glove into a box labeled \"NITEL\" near a window, suggesting preparation or hygiene setup.  \n- The trailer's interior features stainless steel countertops, sinks, and a large ventilation hood, indicating a professional food preparation setup.\n[30-60s] - Hands in black gloves handle a black object, likely a kitchen tool, near a stainless steel appliance.  \n- The appliance, branded \"Diammond,\" has a visible control knob and a water tap, with a drawer underneath containing small items.  \n- A white box labeled \"NITRA\" sits on the counter, alongside other kitchen items, suggesting a setup or preparation phase.\n[60-90s] - Gloved hand lifts a metal fryer basket from a deep fryer, then places it on a countertop.  \n- The hand moves to a refrigerator, opens it, and retrieves a plastic container with a brownish substance.  \n- The container is placed on the counter next to another container holding red-pink contents, near a box of gloves and a cord.\n[90-120s] - A gloved hand opens a stainless steel refrigerator, revealing shelves with condiments and a white container on the bottom shelf.  \n- The hand removes a white container filled with sliced red onions, then places it on the counter.  \n- The hand subsequently removes another white container filled with sliced zucchini, placing it next to the onions on the counter.\n[120-150s] - Gloved hands transfer a container of shredded green vegetables from a shelf to a countertop.  \n- A second container, filled with brown granular substance, is placed beside the first.  \n- A hand reaches into a refrigerator, pulling out a can of soda and placing it on the counter.\n[150-180s] - A gloved hand places a clear plastic bottle with a label onto a countertop, next to a row of colorful canned drinks.  \n- The hand then reaches into a refrigerator, pulling out two large orange squeeze bottles, which are placed on the counter.  \n- The refrigerator interior is visible, showing shelves with condiments and a yellow cloth on the bottom shelf.\n[180-210s] - Gloved hand lifts a black, rectangular object from a counter near a wall-mounted dispenser.  \n- The object is moved toward a trailer with \"BURGER HY\" visible on its side, suggesting a food service context.  \n- The trailer’s side panel shows condensation, indicating recent use or exposure to moisture.\n[210-240s] - A gloved hand opens a black trash bin with a blue liner, revealing a white object inside.  \n- The hand then moves to a stainless steel sink area, where a white container with brown granules is placed on the counter.  \n- A white container is lifted and placed next to the granules, suggesting preparation or organization of ingredients.\n[240-270s] - A gloved hand holds a white plastic container, positioning it near a stainless steel sink.  \n- The hand then moves the container toward a countertop with other food containers and a spray bottle.  \n- A cylindrical metal object with a perforated top is placed on the countertop, near a white box labeled \"Green Tea.\"\n[270-300s] - Person wearing black gloves places a metal container on the counter near a spray bottle and a box of salt.  \n- They then move the container to a lower shelf beneath the counter, where a green trash bin is visible.  \n- The person reaches for a yellow bottle, likely containing a liquid, while standing near the sink area.", "history_tokens": 807, "history_utf8_bytes": 3524, "recent_frame_times_s": [297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0], "recent_frames_sha256": "c65eed296d005dce74606721c23687ad0751711e7eeb36a5a67d1d00e081d30e", "num_recent_frames": 30, "tq": 718395.230694534, "t1": 718396.707160487, "ta": 718396.707160487, "te": 718396.746174137, "first_response_s": 1.4764659529319033, "answer_total_s": 1.515479602967389, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 409, "content_group": "ef04dd7eabd683a9944056ab6e27f42eaef86787e6a4449ec833bd6a8e200e46", "question": {"question_id": "sample_409_a391_q0", "video_id": 409, "video_path": "./videos/sample_409_real.mp4", "annotation_index": 391, "question_index": 0, "question": "Which best summarizes what was just shown?", "options": ["A. A burger was being freshly seasoned and prepared for customers.", "B. A chef was preparing a vegetarian dish by adding spices.", "C. A worker was cleaning a grill after a long day of cooking.", "D. An ice cream vendor was serving customers on a sunny day at the park."], "answer": "A", "time_stamp_s": 484, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [474, 484], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_409_a391_q0", "video_id": 409, "time_stamp_s": 484, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cd953d27e4c9ed9ae7a95f848ce47df0de4b4b1bedf5973fe2433491054ebd7b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [455.0, 456.0, 457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0], "recent_frames_sha256": "8485551a061cd09ed85979b409912379b93b68dfd248f35a870d90dc775c6361", "num_recent_frames": 30, "tq": 718521.652849232, "t1": 718537.432234212, "ta": 718537.432234212, "te": 718537.471804474, "first_response_s": 15.779384980094619, "answer_total_s": 15.818955242051743, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_409_a391_q0", "video_id": 409, "time_stamp_s": 484, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "18bb47ec9b67e3b3ec29de4a97831e4e397c718dfe2294a3e6cbc0d971d00be1", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A gloved hand opens a stainless steel refrigerator, revealing shelves with condiments and a white container on the bottom shelf.  \n- The hand removes a white container filled with sliced red onions, then places it on the counter.  \n- The hand subsequently removes another white container filled with sliced zucchini, placing it next to the onions on the counter.\n[120-150s] - Gloved hands transfer a container of shredded green vegetables from a shelf to a countertop.  \n- A second container, filled with brown granular substance, is placed beside the first.  \n- A hand reaches into a refrigerator, pulling out a can of soda and placing it on the counter.\n[150-180s] - A gloved hand places a clear plastic bottle with a label onto a countertop, next to a row of colorful canned drinks.  \n- The hand then reaches into a refrigerator, pulling out two large orange squeeze bottles, which are placed on the counter.  \n- The refrigerator interior is visible, showing shelves with condiments and a yellow cloth on the bottom shelf.\n[180-210s] - Gloved hand lifts a black, rectangular object from a counter near a wall-mounted dispenser.  \n- The object is moved toward a trailer with \"BURGER HY\" visible on its side, suggesting a food service context.  \n- The trailer’s side panel shows condensation, indicating recent use or exposure to moisture.\n[210-240s] - A gloved hand opens a black trash bin with a blue liner, revealing a white object inside.  \n- The hand then moves to a stainless steel sink area, where a white container with brown granules is placed on the counter.  \n- A white container is lifted and placed next to the granules, suggesting preparation or organization of ingredients.\n[240-270s] - A gloved hand holds a white plastic container, positioning it near a stainless steel sink.  \n- The hand then moves the container toward a countertop with other food containers and a spray bottle.  \n- A cylindrical metal object with a perforated top is placed on the countertop, near a white box labeled \"Green Tea.\"\n[270-300s] - Person wearing black gloves places a metal container on the counter near a spray bottle and a box of salt.  \n- They then move the container to a lower shelf beneath the counter, where a green trash bin is visible.  \n- The person reaches for a yellow bottle, likely containing a liquid, while standing near the sink area.\n[300-330s] - Two gloved hands open a white cabinet door, revealing a sink and plumbing beneath.  \n- A person in black gloves reaches into a refrigerator, pulling out a yellow box labeled \"TIGER\".  \n- The refrigerator interior contains condiments, beverages, and a yellow box on a shelf.\n[330-360s] - A gloved hand retrieves a remote control from a cabinet, then exits the frame.  \n- The remote is held up, showing its buttons, before being placed back into the cabinet.  \n- The cabinet door is closed, and the scene shifts to a countertop with various items, including a bag of food.\n[360-390s] - A gloved hand pours frozen food from a plastic bag into a metal fryer basket.  \n- The fryer basket is placed into a large industrial deep fryer unit.  \n- The fryer unit has a stainless steel surface and a control panel with a digital display.\n[390-420s] - A gloved hand lifts a basket of fries from a deep fryer, revealing golden-brown fries inside.  \n- The hand then moves the basket toward a refrigerator, where it is placed on a shelf alongside other food items.  \n- A separate gloved hand places raw burger patties onto a flat-top grill, preparing them for cooking.\n[420-450s] - A gloved hand uses a spatula to flip a burger patty on a hot griddle.  \n- Another gloved hand holds a second spatula, positioning it near the patty.  \n- A metal fry basket filled with golden fries sits to the right of the griddle.\n[450-480s] - Gloved hand uses spatula to flip two burger patties on a hot griddle.  \n- A third patty is added to the griddle, joining the two already cooking.  \n- A metal basket is placed on the counter beside the griddle, near a trash bin.", "history_tokens": 969, "history_utf8_bytes": 4018, "recent_frame_times_s": [455.0, 456.0, 457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0], "recent_frames_sha256": "8485551a061cd09ed85979b409912379b93b68dfd248f35a870d90dc775c6361", "num_recent_frames": 30, "tq": 718444.254862091, "t1": 718451.814707941, "ta": 718451.814707941, "te": 718452.163372718, "first_response_s": 7.559845849988051, "answer_total_s": 7.908510626992211, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 409, "content_group": "ef04dd7eabd683a9944056ab6e27f42eaef86787e6a4449ec833bd6a8e200e46", "question": {"question_id": "sample_409_a392_q0", "video_id": 409, "video_path": "./videos/sample_409_real.mp4", "annotation_index": 392, "question_index": 0, "question": "Which option best summarizes what was just shown?", "options": ["A. A chef was slicing vegetables and placing them on a plate.", "B. A person was manually operating a fryer to prepare French fries.", "C. Several patties and buns were being grilled on a hot surface by a worker.", "D. A person was cleaning up the kitchen area, wiping counters and washing dishes."], "answer": "C", "time_stamp_s": 642, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [632, 642], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_409_a392_q0", "video_id": 409, "time_stamp_s": 642, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bad954a8ac85b738dd5d126ae1937a06fc3c8d9de576c932303a4e38f45935f7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [613.0, 614.0, 615.0, 616.0, 617.0, 618.0, 619.0, 620.0, 621.0, 622.0, 623.0, 624.0, 625.0, 626.0, 627.0, 628.0, 629.0, 630.0, 631.0, 632.0, 633.0, 634.0, 635.0, 636.0, 637.0, 638.0, 639.0, 640.0, 641.0, 642.0], "recent_frames_sha256": "68e40f92be75b94fca0f8c21c72deb836783ea5b308a4203462bfba30e3fc4c8", "num_recent_frames": 30, "tq": 718537.492977945, "t1": 718546.01730977, "ta": 718546.01730977, "te": 718546.055029487, "first_response_s": 8.524331824970432, "answer_total_s": 8.562051541986875, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_409_a392_q0", "video_id": 409, "time_stamp_s": 642, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "31607d3727244337e4d18e3bf4d7d3165d5fca69dc0577ed29beec4221c81878", "condition_order": ["notes", "recent"], "memory": "[240-270s] - A gloved hand holds a white plastic container, positioning it near a stainless steel sink.  \n- The hand then moves the container toward a countertop with other food containers and a spray bottle.  \n- A cylindrical metal object with a perforated top is placed on the countertop, near a white box labeled \"Green Tea.\"\n[270-300s] - Person wearing black gloves places a metal container on the counter near a spray bottle and a box of salt.  \n- They then move the container to a lower shelf beneath the counter, where a green trash bin is visible.  \n- The person reaches for a yellow bottle, likely containing a liquid, while standing near the sink area.\n[300-330s] - Two gloved hands open a white cabinet door, revealing a sink and plumbing beneath.  \n- A person in black gloves reaches into a refrigerator, pulling out a yellow box labeled \"TIGER\".  \n- The refrigerator interior contains condiments, beverages, and a yellow box on a shelf.\n[330-360s] - A gloved hand retrieves a remote control from a cabinet, then exits the frame.  \n- The remote is held up, showing its buttons, before being placed back into the cabinet.  \n- The cabinet door is closed, and the scene shifts to a countertop with various items, including a bag of food.\n[360-390s] - A gloved hand pours frozen food from a plastic bag into a metal fryer basket.  \n- The fryer basket is placed into a large industrial deep fryer unit.  \n- The fryer unit has a stainless steel surface and a control panel with a digital display.\n[390-420s] - A gloved hand lifts a basket of fries from a deep fryer, revealing golden-brown fries inside.  \n- The hand then moves the basket toward a refrigerator, where it is placed on a shelf alongside other food items.  \n- A separate gloved hand places raw burger patties onto a flat-top grill, preparing them for cooking.\n[420-450s] - A gloved hand uses a spatula to flip a burger patty on a hot griddle.  \n- Another gloved hand holds a second spatula, positioning it near the patty.  \n- A metal fry basket filled with golden fries sits to the right of the griddle.\n[450-480s] - Gloved hand uses spatula to flip two burger patties on a hot griddle.  \n- A third patty is added to the griddle, joining the two already cooking.  \n- A metal basket is placed on the counter beside the griddle, near a trash bin.\n[480-510s] - Hand in black glove holds a clear container with a black lid, positioned over a flat grill surface.  \n- Two burger patties are visible on the grill, one being seasoned with a dark powder from the container.  \n- The container is then moved away, revealing a trash bin beneath the grill area.\n[510-540s] - Gloved hands place burger patties and sliced buns onto a hot griddle, with buns being arranged in a row.  \n- A spatula is used to handle the patties, while the buns are positioned adjacent to them on the griddle.  \n- The griddle surface shows visible grease and residue, indicating active cooking.\n[540-570s] - A gloved hand places a burger patty onto the griddle, joining others already cooking.  \n- Several burger buns are arranged neatly to the right of the griddle, some with sesame seeds.  \n- The griddle surface shows signs of use, with grease and residue from cooking.\n[570-600s] - A gloved hand moves burger buns to the right side of the griddle, positioning them near cooked patties.  \n- The griddle surface shows multiple burger patties (some raw, some cooked) and buns, with a spatula resting nearby.  \n- The hand’s motion suggests organizing or preparing to assemble burgers, with buns being placed in a row.\n[600-630s] - Two gloved hands use spatulas to flip and press burger patties on a hot griddle.  \n- Sliced buns are arranged to the right of the griddle, awaiting assembly.  \n- A small container of seasoning is briefly brought into view near the griddle.", "history_tokens": 957, "history_utf8_bytes": 3807, "recent_frame_times_s": [613.0, 614.0, 615.0, 616.0, 617.0, 618.0, 619.0, 620.0, 621.0, 622.0, 623.0, 624.0, 625.0, 626.0, 627.0, 628.0, 629.0, 630.0, 631.0, 632.0, 633.0, 634.0, 635.0, 636.0, 637.0, 638.0, 639.0, 640.0, 641.0, 642.0], "recent_frames_sha256": "68e40f92be75b94fca0f8c21c72deb836783ea5b308a4203462bfba30e3fc4c8", "num_recent_frames": 30, "tq": 718492.514335435, "t1": 718494.325067827, "ta": 718494.325067827, "te": 718494.565280037, "first_response_s": 1.8107323920121416, "answer_total_s": 2.050944602000527, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 411, "content_group": "a038f557fa6cf3a563140fd1f1f6efbbe3b883b3e9f384d2bdea737316a5058f", "question": {"question_id": "sample_411_a1500_q0", "video_id": 411, "video_path": "./videos/sample_411_real.mp4", "annotation_index": 1500, "question_index": 0, "question": "Which of the following options best summarizes the food preparation process just now?", "options": ["A. The cook added sautéed greens, a spoonful of sauce, and toppings from the counter to a plate for serving.", "B. The cook boiled pasta, seasoned it with herbs, and added it to the sauce.", "C. The cook prepared a salad by chopping vegetables and adding a vinaigrette.", "D. The cook grilled a steak, seasoned it with spices, and placed it on the plate."], "answer": "A", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_411_a1500_q0", "video_id": 411, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "985e6ac919d92bf19eeae3f2896e5de802b66e2ede8de43a19ef74cb9cf48a0c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "545beb6e6fa924c3ac6b1ee3afee8a16b4a9263f63d168f35a910ba1e13637ef", "num_recent_frames": 11, "tq": 715248.150707197, "t1": 715261.07844818, "ta": 715261.07844818, "te": 715261.118916999, "first_response_s": 12.927740982966498, "answer_total_s": 12.968209801940247, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_411_a1500_q0", "video_id": 411, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "825a992815871dac209d4a5ac35433bdcdb573abf032b87e67661f6ba031db42", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "545beb6e6fa924c3ac6b1ee3afee8a16b4a9263f63d168f35a910ba1e13637ef", "num_recent_frames": 11, "tq": 715296.6293333, "t1": 715308.157793478, "ta": 715308.157793478, "te": 715308.364600173, "first_response_s": 11.52846017794218, "answer_total_s": 11.735266872914508, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 411, "content_group": "a038f557fa6cf3a563140fd1f1f6efbbe3b883b3e9f384d2bdea737316a5058f", "question": {"question_id": "sample_411_a1501_q0", "video_id": 411, "video_path": "./videos/sample_411_real.mp4", "annotation_index": 1501, "question_index": 0, "question": "Which of the following options best summarizes the content of the video just shown?", "options": ["A. The chef grilled vegetables using a blowtorch.", "B. The chef prepared a stir-fry dish on a stove, adding various ingredients and seasoning.", "C. The chef fried items in a deep fryer and then drained them on a rack.", "D. The chef prepared a salad by chopping fresh vegetables and mixing them in a bowl."], "answer": "A", "time_stamp_s": 135, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [125, 135], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_411_a1501_q0", "video_id": 411, "time_stamp_s": 135, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e99a25786b6aa45246be8b2ef80dbd2fae1ffc8138bb29d7c45ad3e78d56bed0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0], "recent_frames_sha256": "49b9b6fb52f4d37691ae2624d7a041ea6edaaaabc6e0de54cece3b93a38fd28e", "num_recent_frames": 30, "tq": 715261.140090192, "t1": 715268.117564094, "ta": 715268.117564094, "te": 715268.159261048, "first_response_s": 6.977473902050406, "answer_total_s": 7.019170855986886, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_411_a1501_q0", "video_id": 411, "time_stamp_s": 135, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3030b01797a02cd6d4d104e674ee1a94bd1be85b07c0e87819bd19f93a8a39fd", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A chef stirs a bowl of greens and other ingredients with a spoon while standing near a griddle and various cooking stations.  \n- The chef moves the bowl to a different station, then adds more ingredients from a nearby container into the bowl.  \n- The chef continues stirring the bowl, which contains a mixture of greens and other ingredients, while another pot with greens is visible on the griddle nearby.\n[30-60s] - A chef stirs a pot of green vegetables with a spoon while standing at a stainless steel counter.  \n- Another chef places a bowl of greens on the counter next to a pan of cooked greens.  \n- A third chef holds a metal bowl and adds ingredients to a pan, then moves it to the side.\n[60-90s] - Hands use tongs to transfer cooked vegetables from a pan to a bowl.  \n- A second bowl containing chopped greens is placed beside the first bowl on the counter.  \n- The chef’s hands move toward a serving area where customers are seated at tables.\n[90-120s] - A chef transfers cooked greens from a pan to a plate while another pan with noodles is nearby.  \n- A hand reaches for a container of sauce or condiment from a station with multiple prep bowls.  \n- The chef moves a pan with greens to a different station, indicating a transition in cooking tasks.", "history_tokens": 292, "history_utf8_bytes": 1273, "recent_frame_times_s": [106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0], "recent_frames_sha256": "49b9b6fb52f4d37691ae2624d7a041ea6edaaaabc6e0de54cece3b93a38fd28e", "num_recent_frames": 30, "tq": 715331.240831747, "t1": 715333.732495421, "ta": 715333.732495421, "te": 715333.939663923, "first_response_s": 2.4916636740090325, "answer_total_s": 2.698832176043652, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 411, "content_group": "a038f557fa6cf3a563140fd1f1f6efbbe3b883b3e9f384d2bdea737316a5058f", "question": {"question_id": "sample_411_a1502_q0", "video_id": 411, "video_path": "./videos/sample_411_real.mp4", "annotation_index": 1502, "question_index": 0, "question": "Which of the following options best summarizes the recent food preparation process?", "options": ["A. The individual cooked a vegetable mix, plated it, and added some finishing touches for garnish.", "B. The individual sliced fruits and arranged them decoratively on a platter.", "C. The individual prepared a meat dish, seasoned it with various spices, and placed it on the grill.", "D. The individual mixed ingredients for a smoothie and poured it into a glass."], "answer": "A", "time_stamp_s": 260, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [250, 260], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_411_a1502_q0", "video_id": 411, "time_stamp_s": 260, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bf5d67e3c69d829b4d10035eb3ffb19a37d9b29840ad0ef0d3f3355fc1501399", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0], "recent_frames_sha256": "cb65b81b9fc2f74b90369ce3691bac149af53a347b1986d30c46333d95239f36", "num_recent_frames": 30, "tq": 715268.173952542, "t1": 715280.812721673, "ta": 715280.812721673, "te": 715280.976882349, "first_response_s": 12.638769131037407, "answer_total_s": 12.802929806988686, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_411_a1502_q0", "video_id": 411, "time_stamp_s": 260, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "deaed047ed1e4522ed299c2e72c1e463fe8a6972fb2c31b60d5931d842c6baac", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A chef stirs a bowl of greens and other ingredients with a spoon while standing near a griddle and various cooking stations.  \n- The chef moves the bowl to a different station, then adds more ingredients from a nearby container into the bowl.  \n- The chef continues stirring the bowl, which contains a mixture of greens and other ingredients, while another pot with greens is visible on the griddle nearby.\n[30-60s] - A chef stirs a pot of green vegetables with a spoon while standing at a stainless steel counter.  \n- Another chef places a bowl of greens on the counter next to a pan of cooked greens.  \n- A third chef holds a metal bowl and adds ingredients to a pan, then moves it to the side.\n[60-90s] - Hands use tongs to transfer cooked vegetables from a pan to a bowl.  \n- A second bowl containing chopped greens is placed beside the first bowl on the counter.  \n- The chef’s hands move toward a serving area where customers are seated at tables.\n[90-120s] - A chef transfers cooked greens from a pan to a plate while another pan with noodles is nearby.  \n- A hand reaches for a container of sauce or condiment from a station with multiple prep bowls.  \n- The chef moves a pan with greens to a different station, indicating a transition in cooking tasks.\n[120-150s] - Chef uses tongs to flip green vegetables on a flaming griddle, while another hand adds more greens nearby.  \n- A second chef’s hand reaches for a bowl of greens, then places it beside the griddle.  \n- The griddle surface shows scattered green vegetables and a small flame, with a bowl of greens and a plate nearby.\n[150-180s] - A chef holds a pan with green vegetables, moving it toward a griddle surface.  \n- Another chef in a white uniform is seen preparing food at a separate station, handling a plate with meat.  \n- The griddle area has multiple containers with various ingredients, including yellow and orange substances, positioned to the right.\n[180-210s] - A hand stirs a bowl of green vegetables with a spoon while another hand adds a yellow ingredient from a small container.  \n- The cooking area features multiple metal bowls and pans, with steam rising from the pots.  \n- A person’s arm reaches toward a container of yellow sauce, suggesting preparation for further cooking or seasoning.\n[210-240s] - Chef’s hands stir green vegetables in a pot on a stove, while another pot with noodles is nearby.  \n- A plate with greens and a small bowl of sauce are placed on the counter beside the cooking area.  \n- The chef moves the pot of vegetables toward a griddle, preparing to transfer or combine ingredients.", "history_tokens": 598, "history_utf8_bytes": 2609, "recent_frame_times_s": [231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0], "recent_frames_sha256": "cb65b81b9fc2f74b90369ce3691bac149af53a347b1986d30c46333d95239f36", "num_recent_frames": 30, "tq": 715358.75048705, "t1": 715370.45506939, "ta": 715370.45506939, "te": 715370.643393659, "first_response_s": 11.704582339967601, "answer_total_s": 11.892906608991325, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 411, "content_group": "a038f557fa6cf3a563140fd1f1f6efbbe3b883b3e9f384d2bdea737316a5058f", "question": {"question_id": "sample_411_a1503_q0", "video_id": 411, "video_path": "./videos/sample_411_real.mp4", "annotation_index": 1503, "question_index": 0, "question": "Which of the following options best summarizes the actions taken by the individual just now?", "options": ["A. The individual cleaned a tray, prepared vegetables and add cooking oil to the vegetables.", "B. The individual prepared a salad, dressed it with sauces, and served it to the customer.", "C. The individual grilled a meat patty, added cheese, and placed it in a bun.", "D. The individual was teaching a cooking class, demonstrating how to prepare different dishes."], "answer": "A", "time_stamp_s": 384, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [375, 385], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_411_a1503_q0", "video_id": 411, "time_stamp_s": 384, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5310f23d7464e28c69625b3ac021914d4c7459ff400f6985a601a83e638e5d24", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0], "recent_frames_sha256": "037e02d897b473d5f9945ba52835573e1894a8f3fe3cede15ff69798f2072f2e", "num_recent_frames": 30, "tq": 715280.993733437, "t1": 715288.58785044, "ta": 715288.58785044, "te": 715288.829652904, "first_response_s": 7.594117002910934, "answer_total_s": 7.835919466917403, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_411_a1503_q0", "video_id": 411, "time_stamp_s": 384, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8fc681815b508ff604a558e08aae0ae4b2e3fc334701103949880d261fd98f86", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A chef stirs a bowl of greens and other ingredients with a spoon while standing near a griddle and various cooking stations.  \n- The chef moves the bowl to a different station, then adds more ingredients from a nearby container into the bowl.  \n- The chef continues stirring the bowl, which contains a mixture of greens and other ingredients, while another pot with greens is visible on the griddle nearby.\n[30-60s] - A chef stirs a pot of green vegetables with a spoon while standing at a stainless steel counter.  \n- Another chef places a bowl of greens on the counter next to a pan of cooked greens.  \n- A third chef holds a metal bowl and adds ingredients to a pan, then moves it to the side.\n[60-90s] - Hands use tongs to transfer cooked vegetables from a pan to a bowl.  \n- A second bowl containing chopped greens is placed beside the first bowl on the counter.  \n- The chef’s hands move toward a serving area where customers are seated at tables.\n[90-120s] - A chef transfers cooked greens from a pan to a plate while another pan with noodles is nearby.  \n- A hand reaches for a container of sauce or condiment from a station with multiple prep bowls.  \n- The chef moves a pan with greens to a different station, indicating a transition in cooking tasks.\n[120-150s] - Chef uses tongs to flip green vegetables on a flaming griddle, while another hand adds more greens nearby.  \n- A second chef’s hand reaches for a bowl of greens, then places it beside the griddle.  \n- The griddle surface shows scattered green vegetables and a small flame, with a bowl of greens and a plate nearby.\n[150-180s] - A chef holds a pan with green vegetables, moving it toward a griddle surface.  \n- Another chef in a white uniform is seen preparing food at a separate station, handling a plate with meat.  \n- The griddle area has multiple containers with various ingredients, including yellow and orange substances, positioned to the right.\n[180-210s] - A hand stirs a bowl of green vegetables with a spoon while another hand adds a yellow ingredient from a small container.  \n- The cooking area features multiple metal bowls and pans, with steam rising from the pots.  \n- A person’s arm reaches toward a container of yellow sauce, suggesting preparation for further cooking or seasoning.\n[210-240s] - Chef’s hands stir green vegetables in a pot on a stove, while another pot with noodles is nearby.  \n- A plate with greens and a small bowl of sauce are placed on the counter beside the cooking area.  \n- The chef moves the pot of vegetables toward a griddle, preparing to transfer or combine ingredients.\n[240-270s] - Hands transfer chopped green vegetables from a metal container into a white bowl using a spoon.  \n- A metal griddle with cooked greens and a plate of bok choy are visible on the stainless steel counter.  \n- A yellow squeeze bottle and multiple condiment containers are arranged on the counter to the right.\n[270-300s] - Hands hold two bowls of green vegetables, one with a spoon, while another hand reaches for a squeeze bottle.  \n- A tray of bok choy and other greens sits on a metal surface, with a cutting board and various containers nearby.  \n- The chef moves toward a busy kitchen station where other staff are preparing food, with a focus on the food prep area.\n[300-330s] - Hands place a stack of plates on a stainless steel counter near a cutting board with sliced ingredients.  \n- A chef in a white uniform is seen moving in the background, handling food items at a station.  \n- A tray with bok choy is positioned on the counter, adjacent to a black tray containing dark liquid.\n[330-360s] - Hand wipes a stainless steel counter surface near a griddle with vegetables.  \n- Another chef in uniform cleans a nearby counter with a cloth.  \n- A pan with orange contents is placed on the griddle, then moved to a different station.", "history_tokens": 893, "history_utf8_bytes": 3859, "recent_frame_times_s": [355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0], "recent_frames_sha256": "037e02d897b473d5f9945ba52835573e1894a8f3fe3cede15ff69798f2072f2e", "num_recent_frames": 30, "tq": 715397.535070922, "t1": 715404.907398866, "ta": 715404.907398866, "te": 715405.185817151, "first_response_s": 7.372327944030985, "answer_total_s": 7.650746228988282, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 411, "content_group": "a038f557fa6cf3a563140fd1f1f6efbbe3b883b3e9f384d2bdea737316a5058f", "question": {"question_id": "sample_411_a1504_q0", "video_id": 411, "video_path": "./videos/sample_411_real.mp4", "annotation_index": 1504, "question_index": 0, "question": "Which of the following options best summarizes the actions just shown?", "options": ["A. The individual is arranging bok choy and other greens on a cooking surface and cooking them.", "B. The individual is mixing a salad with various dressings and plating it.", "C. The individual is marinating meat with different sauces and preparing it for grilling.", "D. The individual is seasoning fish and placing it onto a grill."], "answer": "A", "time_stamp_s": 510, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [500, 510], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_411_a1504_q0", "video_id": 411, "time_stamp_s": 510, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3bc463191ad44c77438c2fa2932c97c6c64b047418dd4de23f5f5f3d1616569d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0, 510.0], "recent_frames_sha256": "e3d1770b8df9e82cfada96716c52d1d3cee7006e03b793a1b877996666047507", "num_recent_frames": 30, "tq": 715288.851978784, "t1": 715296.575352987, "ta": 715296.575352987, "te": 715296.618730826, "first_response_s": 7.723374203080311, "answer_total_s": 7.766752041992731, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_411_a1504_q0", "video_id": 411, "time_stamp_s": 510, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "09db5391f9a988f9e069928b382df815ec718f48ae6a57e646d4b1f6acd9a5e0", "condition_order": ["recent", "notes"], "memory": "[90-120s] - A chef transfers cooked greens from a pan to a plate while another pan with noodles is nearby.  \n- A hand reaches for a container of sauce or condiment from a station with multiple prep bowls.  \n- The chef moves a pan with greens to a different station, indicating a transition in cooking tasks.\n[120-150s] - Chef uses tongs to flip green vegetables on a flaming griddle, while another hand adds more greens nearby.  \n- A second chef’s hand reaches for a bowl of greens, then places it beside the griddle.  \n- The griddle surface shows scattered green vegetables and a small flame, with a bowl of greens and a plate nearby.\n[150-180s] - A chef holds a pan with green vegetables, moving it toward a griddle surface.  \n- Another chef in a white uniform is seen preparing food at a separate station, handling a plate with meat.  \n- The griddle area has multiple containers with various ingredients, including yellow and orange substances, positioned to the right.\n[180-210s] - A hand stirs a bowl of green vegetables with a spoon while another hand adds a yellow ingredient from a small container.  \n- The cooking area features multiple metal bowls and pans, with steam rising from the pots.  \n- A person’s arm reaches toward a container of yellow sauce, suggesting preparation for further cooking or seasoning.\n[210-240s] - Chef’s hands stir green vegetables in a pot on a stove, while another pot with noodles is nearby.  \n- A plate with greens and a small bowl of sauce are placed on the counter beside the cooking area.  \n- The chef moves the pot of vegetables toward a griddle, preparing to transfer or combine ingredients.\n[240-270s] - Hands transfer chopped green vegetables from a metal container into a white bowl using a spoon.  \n- A metal griddle with cooked greens and a plate of bok choy are visible on the stainless steel counter.  \n- A yellow squeeze bottle and multiple condiment containers are arranged on the counter to the right.\n[270-300s] - Hands hold two bowls of green vegetables, one with a spoon, while another hand reaches for a squeeze bottle.  \n- A tray of bok choy and other greens sits on a metal surface, with a cutting board and various containers nearby.  \n- The chef moves toward a busy kitchen station where other staff are preparing food, with a focus on the food prep area.\n[300-330s] - Hands place a stack of plates on a stainless steel counter near a cutting board with sliced ingredients.  \n- A chef in a white uniform is seen moving in the background, handling food items at a station.  \n- A tray with bok choy is positioned on the counter, adjacent to a black tray containing dark liquid.\n[330-360s] - Hand wipes a stainless steel counter surface near a griddle with vegetables.  \n- Another chef in uniform cleans a nearby counter with a cloth.  \n- A pan with orange contents is placed on the griddle, then moved to a different station.\n[360-390s] - Chef places a metal bowl on stainless steel counter, then picks up a small pan with yellow contents.  \n- Hands arrange green leafy vegetables (bok choy) and chopped greens on a metal tray.  \n- A hand reaches for a container of sauce or condiment from a row of prep stations.\n[390-420s] - Chef uses a torch to sear green vegetables and a yellowish food item on a flat-top grill.  \n- Another chef in a white uniform is visible in the background, working near a pot on a stove.  \n- The flat-top grill is surrounded by metal containers holding various ingredients and utensils.\n[420-450s] - Hands transfer fresh green vegetables from a metal container to a flat griddle surface.  \n- Griddle holds multiple vegetable bunches, some already chopped, alongside small bowls of spices and sauces.  \n- Kitchen setup includes pots, pans, and utensils arranged around the griddle, indicating active food preparation.\n[450-480s] - Hand uses tongs to flip green vegetables on a metal griddle.  \n- Another hand holds a small pot with a whisk, stirring a yellow liquid.  \n- Griddle has multiple sections with different vegetables and condiments nearby.\n[480-510s] - Chef uses tongs to handle green vegetables on a metal prep surface.  \n- A small pan with a yellow liquid (likely oil or sauce) sits to the left of the prep area.  \n- Various containers with ingredients are arranged on the right side of the counter.", "history_tokens": 1011, "history_utf8_bytes": 4304, "recent_frame_times_s": [481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0, 510.0], "recent_frames_sha256": "e3d1770b8df9e82cfada96716c52d1d3cee7006e03b793a1b877996666047507", "num_recent_frames": 30, "tq": 715433.10914275, "t1": 715434.089745, "ta": 715434.089745, "te": 715434.127919304, "first_response_s": 0.980602249968797, "answer_total_s": 1.0187765539158136, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 413, "content_group": "bcf76dd2a885e5013fd62b2ad124d75a6bdc345ecc31ede014bea69abebb8a77", "question": {"question_id": "sample_413_a198_q0", "video_id": 413, "video_path": "./videos/sample_413_real.mp4", "annotation_index": 198, "question_index": 0, "question": "Which of the following options best summarizes the actions taking place just now?", "options": ["A. The individual prepared fresh lettuce by washing it thoroughly in a sink.", "B. The individual took lettuce from a drawer, cooked it briefly, and then placed it on a preparation surface.", "C. The individual retrieved spinach from a compartment, cooked it on a flat top grill, and seasoned it.", "D. The individual prepared a salad by chopping tomatoes and cucumbers and adding them to a bowl."], "answer": "C", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_413_a198_q0", "video_id": 413, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "99aa37c5bba7a1e54c1fefd1f7052789bb0a7f77642d26b17a43f2418c8949b8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.021015625, 1.001015625, 2.001015625, 3.001015625, 4.001015625, 5.001015625, 6.001015625, 7.001015625, 8.001015625, 9.001015625], "recent_frames_sha256": "4e37f6d74cb6334a662a3aa5a0eb0fac4dbb09523c7d870abb876e9228fac4a8", "num_recent_frames": 10, "tq": 716213.670962034, "t1": 716214.893809049, "ta": 716214.893809049, "te": 716214.931446692, "first_response_s": 1.2228470150148496, "answer_total_s": 1.2604846579488367, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_413_a198_q0", "video_id": 413, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fbe8bca9b56f92b8b1ac97335b2bd164b4cfa8371fdd9c4278f1d4f0249f569a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.021015625, 1.001015625, 2.001015625, 3.001015625, 4.001015625, 5.001015625, 6.001015625, 7.001015625, 8.001015625, 9.001015625], "recent_frames_sha256": "4e37f6d74cb6334a662a3aa5a0eb0fac4dbb09523c7d870abb876e9228fac4a8", "num_recent_frames": 10, "tq": 715977.826267388, "t1": 715989.214514814, "ta": 715989.214514814, "te": 715989.252077882, "first_response_s": 11.388247426017188, "answer_total_s": 11.425810493994504, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 413, "content_group": "bcf76dd2a885e5013fd62b2ad124d75a6bdc345ecc31ede014bea69abebb8a77", "question": {"question_id": "sample_413_a199_q0", "video_id": 413, "video_path": "./videos/sample_413_real.mp4", "annotation_index": 199, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now in the kitchen?", "options": ["A. The cook selected a frying pan, sautéed ingredients, and served them with a sauce.", "B. The cook retrieved pans, prepared a mixture, and added a creamy sauce to one pan.", "C. The cook diced vegetables, fried them, and placed them on a serving tray.", "D. The cook heated a pan, added oil, and mixed it with pre-prepared sauces."], "answer": "B", "time_stamp_s": 186, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [176, 186], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_413_a199_q0", "video_id": 413, "time_stamp_s": 186, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "25ffec519501c21c0c7304ab89b1347ac8e4a894867c046fffcb5352a2396604", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [156.001015625, 157.001015625, 158.001015625, 159.001015625, 160.001015625, 161.001015625, 162.001015625, 163.001015625, 164.001015625, 165.001015625, 166.001015625, 167.001015625, 168.001015625, 169.001015625, 170.001015625, 171.001015625, 172.001015625, 173.001015625, 174.001015625, 175.001015625, 176.001015625, 177.001015625, 178.001015625, 179.001015625, 180.001015625, 181.001015625, 182.001015625, 183.001015625, 184.001015625, 185.001015625], "recent_frames_sha256": "73a387d37c490ad9fe0148ecc3ae61b54d53b08028bc8bb1383835183b4067a3", "num_recent_frames": 30, "tq": 716214.967163259, "t1": 716221.989902681, "ta": 716221.989902681, "te": 716222.026801351, "first_response_s": 7.0227394219255075, "answer_total_s": 7.059638091945089, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_413_a199_q0", "video_id": 413, "time_stamp_s": 186, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2d81b3bacadf8619d05f9f475b7f47fa54e1bded8a645143e524cffed08c8011", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands transfer chopped greens from metal trays to a hot griddle, then add them to a pot of boiling liquid.  \n- A pot of steaming noodles is stirred with a spoon while another pot of greens is added to it.  \n- Multiple metal containers with various sauces and ingredients are arranged around the cooking area.\n[30-60s] - Chef uses tongs to stir greens in a pan on the stove.  \n- A flat griddle surface holds chopped greens and other ingredients nearby.  \n- A bowl of white liquid (likely batter or sauce) is being held and moved toward the griddle.\n[60-90s] - Chef's hands pour a yellowish liquid from a metal bowl into a pan containing greens.  \n- A second bowl of chopped nuts is added to the pan, followed by a spoonful of a brownish sauce.  \n- The pan is positioned on a stainless steel countertop with other cooking stations and ingredients nearby.\n[90-120s] - Chef stirs a pot of greens on the stove while another pot with a different ingredient is being stirred nearby.  \n- A metal tray holds chopped greens and a bowl of mixed ingredients, with a spoon resting in the bowl.  \n- The chef’s hands move between pots and bowls, indicating active preparation of multiple dishes simultaneously.\n[120-150s] - Chef stirs green leafy vegetables in a pan on a stove, using tongs to maneuver the contents.  \n- A second chef in a white uniform moves nearby, holding a large, wrapped item (possibly a food product or ingredient).  \n- The kitchen environment features multiple stovetops, sinks, and fryers, with various cooking utensils and ingredients visible.\n[150-180s] - A chef uses tongs to transfer cooked greens from a pan into small bowls placed on a metal tray.  \n- The chef’s hand moves the pan away, revealing a stainless steel countertop with various cooking utensils and ingredients nearby.  \n- A large bottle of oil is visible on the counter, and the chef reaches toward it, suggesting preparation for the next step.", "history_tokens": 450, "history_utf8_bytes": 1937, "recent_frame_times_s": [156.001015625, 157.001015625, 158.001015625, 159.001015625, 160.001015625, 161.001015625, 162.001015625, 163.001015625, 164.001015625, 165.001015625, 166.001015625, 167.001015625, 168.001015625, 169.001015625, 170.001015625, 171.001015625, 172.001015625, 173.001015625, 174.001015625, 175.001015625, 176.001015625, 177.001015625, 178.001015625, 179.001015625, 180.001015625, 181.001015625, 182.001015625, 183.001015625, 184.001015625, 185.001015625], "recent_frames_sha256": "73a387d37c490ad9fe0148ecc3ae61b54d53b08028bc8bb1383835183b4067a3", "num_recent_frames": 30, "tq": 716041.639058572, "t1": 716043.961974015, "ta": 716043.961974015, "te": 716044.241724866, "first_response_s": 2.322915442986414, "answer_total_s": 2.602666293969378, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 413, "content_group": "bcf76dd2a885e5013fd62b2ad124d75a6bdc345ecc31ede014bea69abebb8a77", "question": {"question_id": "sample_413_a200_q0", "video_id": 413, "video_path": "./videos/sample_413_real.mp4", "annotation_index": 200, "question_index": 0, "question": "Which of the following options best summarizes the recent activity just shown?", "options": ["A. The individual was plating a dish, adding final garnishes, and preparing the plate for serving.", "B. The individual was cooking an omelet, flipping it multiple times, and placing it on a plate.", "C. The individual was preparing a dish by stirring ingredients in a pan and adding various seasonings.", "D. The individual was cleaning the kitchen station, wiping surfaces, and organizing utensils."], "answer": "C", "time_stamp_s": 362, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [352, 362], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_413_a200_q0", "video_id": 413, "time_stamp_s": 362, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "773b61c1c9ac417bdf3cdd3297b2595d04d5aa9038ba671e7ac16e6dc9640d10", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [332.001015625, 333.001015625, 334.001015625, 335.001015625, 336.001015625, 337.001015625, 338.001015625, 339.001015625, 340.001015625, 341.001015625, 342.001015625, 343.001015625, 344.001015625, 345.001015625, 346.001015625, 347.001015625, 348.001015625, 349.001015625, 350.001015625, 351.001015625, 352.001015625, 353.001015625, 354.001015625, 355.001015625, 356.001015625, 357.001015625, 358.001015625, 359.001015625, 360.001015625, 361.001015625], "recent_frames_sha256": "78fa93ceacc4367abe2ec7d79626adeb234c56b93a936ef641840b450b7128e7", "num_recent_frames": 30, "tq": 716222.046657035, "t1": 716230.151177161, "ta": 716230.151177161, "te": 716230.188444333, "first_response_s": 8.104520126013085, "answer_total_s": 8.1417872980237, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_413_a200_q0", "video_id": 413, "time_stamp_s": 362, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bbc418588244e7ac7cf24934ae5ec830eb79a3069b7abcbb35c9b6dba97a2ea7", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hands transfer chopped greens from metal trays to a hot griddle, then add them to a pot of boiling liquid.  \n- A pot of steaming noodles is stirred with a spoon while another pot of greens is added to it.  \n- Multiple metal containers with various sauces and ingredients are arranged around the cooking area.\n[30-60s] - Chef uses tongs to stir greens in a pan on the stove.  \n- A flat griddle surface holds chopped greens and other ingredients nearby.  \n- A bowl of white liquid (likely batter or sauce) is being held and moved toward the griddle.\n[60-90s] - Chef's hands pour a yellowish liquid from a metal bowl into a pan containing greens.  \n- A second bowl of chopped nuts is added to the pan, followed by a spoonful of a brownish sauce.  \n- The pan is positioned on a stainless steel countertop with other cooking stations and ingredients nearby.\n[90-120s] - Chef stirs a pot of greens on the stove while another pot with a different ingredient is being stirred nearby.  \n- A metal tray holds chopped greens and a bowl of mixed ingredients, with a spoon resting in the bowl.  \n- The chef’s hands move between pots and bowls, indicating active preparation of multiple dishes simultaneously.\n[120-150s] - Chef stirs green leafy vegetables in a pan on a stove, using tongs to maneuver the contents.  \n- A second chef in a white uniform moves nearby, holding a large, wrapped item (possibly a food product or ingredient).  \n- The kitchen environment features multiple stovetops, sinks, and fryers, with various cooking utensils and ingredients visible.\n[150-180s] - A chef uses tongs to transfer cooked greens from a pan into small bowls placed on a metal tray.  \n- The chef’s hand moves the pan away, revealing a stainless steel countertop with various cooking utensils and ingredients nearby.  \n- A large bottle of oil is visible on the counter, and the chef reaches toward it, suggesting preparation for the next step.\n[180-210s] - Chef's hands move a metal plate across a stainless steel counter, passing it between stations.  \n- A steaming bowl is lifted from a hot surface, likely to be placed on the plate.  \n- Multiple bowls of ingredients and leafy greens are arranged on the counter, indicating preparation for a dish.\n[210-240s] - Chef transfers cooked greens from a metal plate to a serving tray using tongs.  \n- A second plate with cooked greens is placed on the counter, alongside a bowl of mixed grains.  \n- The chef moves toward a station with multiple food containers, including sauces and garnishes, to assemble a dish.\n[240-270s] - Hands transfer chopped green vegetables from a metal tray to a pot on a stove, stirring with a spoon.  \n- Steam rises from the pot as vegetables are cooked, with other ingredients like spices and sauces visible nearby.  \n- A tray of assorted prepared foods is seen in the background, suggesting a commercial kitchen setting.\n[270-300s] - Hands use tongs to transfer green leafy vegetables from a tray to a small pot.  \n- A second hand adds a spoonful of yellowish sauce from a container into the pot.  \n- The pot is then moved toward a stove area where other cooking stations are visible.\n[300-330s] - A chef in a white uniform is seen handling a tray with food items, likely preparing or serving dishes.  \n- The chef’s hands are actively engaged in placing or adjusting food on the tray, indicating a focused task.  \n- The kitchen environment includes stainless steel surfaces, various food containers, and cooking equipment, suggesting a professional setting.\n[330-360s] - Hands use tongs to transfer chopped vegetables from a metal tray into a frying pan on a stove.  \n- The pan contains a simmering yellowish liquid, likely a sauce or broth, with some vegetables already cooking.  \n- A second hand holds a spoon, poised to stir or add ingredients, while the other hand continues transferring vegetables.", "history_tokens": 892, "history_utf8_bytes": 3876, "recent_frame_times_s": [332.001015625, 333.001015625, 334.001015625, 335.001015625, 336.001015625, 337.001015625, 338.001015625, 339.001015625, 340.001015625, 341.001015625, 342.001015625, 343.001015625, 344.001015625, 345.001015625, 346.001015625, 347.001015625, 348.001015625, 349.001015625, 350.001015625, 351.001015625, 352.001015625, 353.001015625, 354.001015625, 355.001015625, 356.001015625, 357.001015625, 358.001015625, 359.001015625, 360.001015625, 361.001015625], "recent_frames_sha256": "78fa93ceacc4367abe2ec7d79626adeb234c56b93a936ef641840b450b7128e7", "num_recent_frames": 30, "tq": 716100.384323065, "t1": 716108.803631728, "ta": 716108.803631728, "te": 716108.844322858, "first_response_s": 8.419308662996627, "answer_total_s": 8.459999792976305, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 413, "content_group": "bcf76dd2a885e5013fd62b2ad124d75a6bdc345ecc31ede014bea69abebb8a77", "question": {"question_id": "sample_413_a201_q0", "video_id": 413, "video_path": "./videos/sample_413_real.mp4", "annotation_index": 201, "question_index": 0, "question": "Which of the following options best summarizes the actions of the individual just now?", "options": ["A. The individual cleaned the kitchen area and organized the utensils.", "B. The individual sautéed some vegetables, operated the stove, and managed multiple pans on a busy kitchen station.", "C. The individual prepared a salad by chopping and mixing fresh ingredients.", "D. The individual baked a cake, frosted it, and placed it in a refrigerator to cool."], "answer": "B", "time_stamp_s": 538, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [528, 538], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_413_a201_q0", "video_id": 413, "time_stamp_s": 538, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e21eade1889718555e1450f272eb62259d5c1852739168f5e619aea6567c621c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [508.001015625, 509.001015625, 510.001015625, 511.001015625, 512.001015625, 513.001015625, 514.001015625, 515.001015625, 516.001015625, 517.001015625, 518.001015625, 519.001015625, 520.001015625, 521.001015625, 522.001015625, 523.001015625, 524.001015625, 525.001015625, 526.001015625, 527.001015625, 528.001015625, 529.001015625, 530.001015625, 531.001015625, 532.001015625, 533.001015625, 534.001015625, 535.001015625, 536.001015625, 537.001015625], "recent_frames_sha256": "c7bb70e40c767e814fc15307ba935f3c435249a651046ac5d9f8dba712598ca1", "num_recent_frames": 30, "tq": 716230.21025529, "t1": 716237.689663401, "ta": 716237.689663401, "te": 716237.727166292, "first_response_s": 7.479408110957593, "answer_total_s": 7.516911001992412, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_413_a201_q0", "video_id": 413, "time_stamp_s": 538, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "36b7a62ecc5f18777aca21eefae6a59d0c075ac5be56c7b49ae4735ae6b80f34", "condition_order": ["notes", "recent"], "memory": "[120-150s] - Chef stirs green leafy vegetables in a pan on a stove, using tongs to maneuver the contents.  \n- A second chef in a white uniform moves nearby, holding a large, wrapped item (possibly a food product or ingredient).  \n- The kitchen environment features multiple stovetops, sinks, and fryers, with various cooking utensils and ingredients visible.\n[150-180s] - A chef uses tongs to transfer cooked greens from a pan into small bowls placed on a metal tray.  \n- The chef’s hand moves the pan away, revealing a stainless steel countertop with various cooking utensils and ingredients nearby.  \n- A large bottle of oil is visible on the counter, and the chef reaches toward it, suggesting preparation for the next step.\n[180-210s] - Chef's hands move a metal plate across a stainless steel counter, passing it between stations.  \n- A steaming bowl is lifted from a hot surface, likely to be placed on the plate.  \n- Multiple bowls of ingredients and leafy greens are arranged on the counter, indicating preparation for a dish.\n[210-240s] - Chef transfers cooked greens from a metal plate to a serving tray using tongs.  \n- A second plate with cooked greens is placed on the counter, alongside a bowl of mixed grains.  \n- The chef moves toward a station with multiple food containers, including sauces and garnishes, to assemble a dish.\n[240-270s] - Hands transfer chopped green vegetables from a metal tray to a pot on a stove, stirring with a spoon.  \n- Steam rises from the pot as vegetables are cooked, with other ingredients like spices and sauces visible nearby.  \n- A tray of assorted prepared foods is seen in the background, suggesting a commercial kitchen setting.\n[270-300s] - Hands use tongs to transfer green leafy vegetables from a tray to a small pot.  \n- A second hand adds a spoonful of yellowish sauce from a container into the pot.  \n- The pot is then moved toward a stove area where other cooking stations are visible.\n[300-330s] - A chef in a white uniform is seen handling a tray with food items, likely preparing or serving dishes.  \n- The chef’s hands are actively engaged in placing or adjusting food on the tray, indicating a focused task.  \n- The kitchen environment includes stainless steel surfaces, various food containers, and cooking equipment, suggesting a professional setting.\n[330-360s] - Hands use tongs to transfer chopped vegetables from a metal tray into a frying pan on a stove.  \n- The pan contains a simmering yellowish liquid, likely a sauce or broth, with some vegetables already cooking.  \n- A second hand holds a spoon, poised to stir or add ingredients, while the other hand continues transferring vegetables.\n[360-390s] - Hands transfer chopped green vegetables from a bowl to a metal tray near a stove.  \n- A stainless steel countertop holds multiple bowls with various ingredients, including a yellow liquid and a green paste.  \n- A large flat griddle with cooking pans and a sink area is visible in the background.\n[390-420s] - Chef stirs a pot of green vegetables with a spoon while holding a wooden bowl.  \n- A stainless steel tray with chopped greens is placed beside the pot on the counter.  \n- The chef moves the pot toward a sink area, preparing to transfer or clean the contents.\n[420-450s] - Chef transfers cooked greens from a pan to a plate lined with paper towel.  \n- Another chef is seen handling a yellow squeeze bottle near a station with multiple food trays.  \n- A handwritten note is held by one chef, positioned near the food prep area.\n[450-480s] - A hand holds a yellow container with a red cap, positioned near a stainless steel countertop with food trays.  \n- The hand then picks up a white paper receipt, which is later handed to another person wearing a white shirt.  \n- A pan with green vegetables is visible on a stove, while a stack of plates is placed nearby on the counter.\n[480-510s] - Hands stir green vegetables in a pot on a stove, with steam rising.  \n- A metal tray with various food items (e.g., eggs, potatoes) is visible to the right.  \n- The pot is moved slightly across the stovetop, indicating active cooking.", "history_tokens": 961, "history_utf8_bytes": 4112, "recent_frame_times_s": [508.001015625, 509.001015625, 510.001015625, 511.001015625, 512.001015625, 513.001015625, 514.001015625, 515.001015625, 516.001015625, 517.001015625, 518.001015625, 519.001015625, 520.001015625, 521.001015625, 522.001015625, 523.001015625, 524.001015625, 525.001015625, 526.001015625, 527.001015625, 528.001015625, 529.001015625, 530.001015625, 531.001015625, 532.001015625, 533.001015625, 534.001015625, 535.001015625, 536.001015625, 537.001015625], "recent_frames_sha256": "c7bb70e40c767e814fc15307ba935f3c435249a651046ac5d9f8dba712598ca1", "num_recent_frames": 30, "tq": 716154.209933179, "t1": 716161.972618466, "ta": 716161.972618466, "te": 716162.011461301, "first_response_s": 7.762685287045315, "answer_total_s": 7.801528122043237, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 413, "content_group": "bcf76dd2a885e5013fd62b2ad124d75a6bdc345ecc31ede014bea69abebb8a77", "question": {"question_id": "sample_413_a202_q0", "video_id": 413, "video_path": "./videos/sample_413_real.mp4", "annotation_index": 202, "question_index": 0, "question": "Which of the following options best summarizes the actions performed just now?", "options": ["A. The individual mixed a variety of raw ingredients in a bowl and started blending them.", "B. The individual sautéed green vegetables in a pan, transferred them to a serving dish, and prepared different sauce pans.", "C. The individual grilled several pieces of meat and then plated them with garnish.", "D. The individual baked a loaf of bread and buttered it before serving."], "answer": "B", "time_stamp_s": 714, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [704, 714], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_413_a202_q0", "video_id": 413, "time_stamp_s": 714, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7e322c76fc553eb02a98414c9e45183fe33ad66f8aa8661f6cb2adceb17f9c81", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [684.001015625, 685.001015625, 686.001015625, 687.001015625, 688.001015625, 689.001015625, 690.001015625, 691.001015625, 692.001015625, 693.001015625, 694.001015625, 695.001015625, 696.001015625, 697.001015625, 698.001015625, 699.001015625, 700.001015625, 701.001015625, 702.001015625, 703.001015625, 704.001015625, 705.001015625, 706.001015625, 707.001015625, 708.001015625, 709.001015625, 710.001015625, 711.001015625, 712.001015625, 713.001015625], "recent_frames_sha256": "b7d7f3f8d3bc36398f5f52d54af8ba4667ba54b894760738cf6775373179a835", "num_recent_frames": 30, "tq": 716237.743353324, "t1": 716274.369340982, "ta": 716274.369340982, "te": 716274.40698839, "first_response_s": 36.62598765804432, "answer_total_s": 36.66363506601192, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_413_a202_q0", "video_id": 413, "time_stamp_s": 714, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0dd5c46717e28fbf6cc49546e0b1dbb37c6c4943e16f82417b4efe9f984e295e", "condition_order": ["notes", "recent"], "memory": "[270-300s] - Hands use tongs to transfer green leafy vegetables from a tray to a small pot.  \n- A second hand adds a spoonful of yellowish sauce from a container into the pot.  \n- The pot is then moved toward a stove area where other cooking stations are visible.\n[300-330s] - A chef in a white uniform is seen handling a tray with food items, likely preparing or serving dishes.  \n- The chef’s hands are actively engaged in placing or adjusting food on the tray, indicating a focused task.  \n- The kitchen environment includes stainless steel surfaces, various food containers, and cooking equipment, suggesting a professional setting.\n[330-360s] - Hands use tongs to transfer chopped vegetables from a metal tray into a frying pan on a stove.  \n- The pan contains a simmering yellowish liquid, likely a sauce or broth, with some vegetables already cooking.  \n- A second hand holds a spoon, poised to stir or add ingredients, while the other hand continues transferring vegetables.\n[360-390s] - Hands transfer chopped green vegetables from a bowl to a metal tray near a stove.  \n- A stainless steel countertop holds multiple bowls with various ingredients, including a yellow liquid and a green paste.  \n- A large flat griddle with cooking pans and a sink area is visible in the background.\n[390-420s] - Chef stirs a pot of green vegetables with a spoon while holding a wooden bowl.  \n- A stainless steel tray with chopped greens is placed beside the pot on the counter.  \n- The chef moves the pot toward a sink area, preparing to transfer or clean the contents.\n[420-450s] - Chef transfers cooked greens from a pan to a plate lined with paper towel.  \n- Another chef is seen handling a yellow squeeze bottle near a station with multiple food trays.  \n- A handwritten note is held by one chef, positioned near the food prep area.\n[450-480s] - A hand holds a yellow container with a red cap, positioned near a stainless steel countertop with food trays.  \n- The hand then picks up a white paper receipt, which is later handed to another person wearing a white shirt.  \n- A pan with green vegetables is visible on a stove, while a stack of plates is placed nearby on the counter.\n[480-510s] - Hands stir green vegetables in a pot on a stove, with steam rising.  \n- A metal tray with various food items (e.g., eggs, potatoes) is visible to the right.  \n- The pot is moved slightly across the stovetop, indicating active cooking.\n[510-540s] - A chef stirs a steaming green vegetable dish in a pan on a commercial stove, using tongs.  \n- The chef then moves the pan to a different burner, continuing to stir the contents.  \n- A second pan with a yellowish liquid is visible nearby, suggesting simultaneous cooking tasks.\n[540-570s] - A person uses tongs to transfer steaming green vegetables from a pot into a small bowl.  \n- Another person holds a metal plate, positioned near the bowl, likely to receive or accompany the dish.  \n- The kitchen environment shows multiple pots, pans, and utensils, indicating active food preparation.\n[570-600s] - Hand holds a bowl of green salad, then places it on a plate with a piece of bread.  \n- Another hand pours a colorful mixture from a metal bowl into a small pan on a griddle.  \n- A hand cracks an egg into the pan, then uses a spatula to stir the contents.\n[600-630s] - Hand moves a pot with yellow liquid toward a griddle surface.  \n- A person’s hand reaches for a container of cheese near a sink.  \n- A metal tray with green leafy vegetables is being handled by a hand.\n[630-660s] - Hand moves a pot with green vegetables on a stove, then shifts to a pot with a yellow liquid.  \n- A hand picks up a small bowl of white powder, then reaches for a tray with multiple food containers.  \n- The hand places a bowl of chopped onions into a pot on the stove, near the green vegetables.\n[660-690s] - A hand adds green leafy vegetables into a pot on a stainless steel countertop.  \n- Another hand uses a white cloth to wipe a metal surface near a stove with multiple pots.  \n- A person in a white shirt stands near a stack of plates, appearing to prepare or organize them.", "history_tokens": 992, "history_utf8_bytes": 4110, "recent_frame_times_s": [684.001015625, 685.001015625, 686.001015625, 687.001015625, 688.001015625, 689.001015625, 690.001015625, 691.001015625, 692.001015625, 693.001015625, 694.001015625, 695.001015625, 696.001015625, 697.001015625, 698.001015625, 699.001015625, 700.001015625, 701.001015625, 702.001015625, 703.001015625, 704.001015625, 705.001015625, 706.001015625, 707.001015625, 708.001015625, 709.001015625, 710.001015625, 711.001015625, 712.001015625, 713.001015625], "recent_frames_sha256": "b7d7f3f8d3bc36398f5f52d54af8ba4667ba54b894760738cf6775373179a835", "num_recent_frames": 30, "tq": 716206.524616737, "t1": 716213.446515203, "ta": 716213.446515203, "te": 716213.63702759, "first_response_s": 6.921898465952836, "answer_total_s": 7.112410852918401, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 414, "content_group": "aa015e07d9ae3a80267a6d2b7af82562fe8724e4725c902e3f1f168990eeb83d", "question": {"question_id": "sample_414_a1267_q0", "video_id": 414, "video_path": "./videos/sample_414_real.mp4", "annotation_index": 1267, "question_index": 0, "question": "How can the actions just observed in the recent video segment be best summarized?", "options": ["A. A shopper selected and evaluated various fruit snacks before placing them in their basket, focusing on price comparison for different brands.", "B. A worker stocked fruit cups on supermarket shelves, arranging boxes and checking labels to ensure proper placement.", "C. A chef prepared a detailed shopping list, meticulously inspecting each item before selecting fruits and vegetables for a gourmet recipe.", "D. A child picked out colorful fruit snacks from a wide selection, expressing excitement over new flavors and brands."], "answer": "B", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_414_a1267_q0", "video_id": 414, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "69f108cf34793af590cfad191439d0e1316723dcc028063e4377b70f35904daf", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "6278f8014c1a0b658692b48bafd8704059950bcc1f5aec1099f5e2e31dc2c5f8", "num_recent_frames": 10, "tq": 718544.928207106, "t1": 718546.01730977, "ta": 718546.01730977, "te": 718546.055029487, "first_response_s": 1.0891026640310884, "answer_total_s": 1.126822381047532, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_414_a1267_q0", "video_id": 414, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ce8e1d179522aa9487b355fee07a0be0cccf9cf54e16f4cd97c2389f3b7b8276", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "6278f8014c1a0b658692b48bafd8704059950bcc1f5aec1099f5e2e31dc2c5f8", "num_recent_frames": 10, "tq": 718384.898172012, "t1": 718396.707160487, "ta": 718396.707160487, "te": 718396.746174137, "first_response_s": 11.808988475007936, "answer_total_s": 11.848002125043422, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 414, "content_group": "aa015e07d9ae3a80267a6d2b7af82562fe8724e4725c902e3f1f168990eeb83d", "question": {"question_id": "sample_414_a1268_q0", "video_id": 414, "video_path": "./videos/sample_414_real.mp4", "annotation_index": 1268, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. An individual restocks shelves with canned fruits while organizing other products.", "B. An individual maneuvers through a crowded farmers market, selecting fresh produce.", "C. An individual stacks canned soups on shelves while arranging sales tags.", "D. An individual organizes breakfast cereals on the shelves, ensuring everything is properly placed."], "answer": "A", "time_stamp_s": 149, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [139, 149], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_414_a1268_q0", "video_id": 414, "time_stamp_s": 149, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ab80aa292732ebf8acaffd6eef3096c4a84c309664df6ab4830ece4dcfbb21e0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333], "recent_frames_sha256": "4e7646da9a9402ae70bb45a0a5e9012c44e5c617d30e43e54277f95ba00cb8b0", "num_recent_frames": 30, "tq": 718546.084449908, "t1": 718553.814152024, "ta": 718553.814152024, "te": 718553.851947962, "first_response_s": 7.7297021159902215, "answer_total_s": 7.767498053959571, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_414_a1268_q0", "video_id": 414, "time_stamp_s": 149, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8edee19ddd769e034c33f7ec5e3035fa3a72626b373c8e8c28ee5e9570e488f2", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hand selects and places a box of \"Nestlé\" cereal into a shopping cart.  \n- Hand picks up a yellow-packaged \"Nestlé\" product from a shelf, then places it into a plastic bag.  \n- Hand reaches for a container of \"Nestlé\" product from a shelf, then places it into the plastic bag.\n[30-60s] - Hand reaches for a green Starbucks container from a shelf, then places it into a cardboard box on the floor.  \n- The box is positioned near a display of Starbucks products, with the hand continuing to pick up more containers.  \n- A second hand appears, assisting in placing additional containers into the box, indicating collaborative action.\n[60-90s] - A hand picks up a box of Dr. Oetker Mandarin Oranges from a shelf, then places it on a counter.  \n- The hand then reaches for a package of eggs, which are placed on the counter next to the orange box.  \n- The hand moves toward a shelf with various canned goods, including jars labeled \"Soy Sauce\" and \"Tomato Sauce,\" while the camera pans to show the shelf's contents.\n[90-120s] - Hand selects a blue-packaged product from shelf, then places it into a shopping cart.  \n- Hand picks up a brown paper bag, then places it into the cart.  \n- Shopping cart moves along aisle, passing shelves stocked with canned goods and packaged items.", "history_tokens": 313, "history_utf8_bytes": 1287, "recent_frame_times_s": [119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333], "recent_frames_sha256": "4e7646da9a9402ae70bb45a0a5e9012c44e5c617d30e43e54277f95ba00cb8b0", "num_recent_frames": 30, "tq": 718419.595063739, "t1": 718421.400263057, "ta": 718421.400263057, "te": 718421.641468298, "first_response_s": 1.8051993179833516, "answer_total_s": 2.046404559048824, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 414, "content_group": "aa015e07d9ae3a80267a6d2b7af82562fe8724e4725c902e3f1f168990eeb83d", "question": {"question_id": "sample_414_a1269_q0", "video_id": 414, "video_path": "./videos/sample_414_real.mp4", "annotation_index": 1269, "question_index": 0, "question": "Which of the following summaries best describes the recent actions carried out in the footage?", "options": ["A. The individual browsed through the cereal aisle, examined various boxes, and placed one in their cart.", "B. The individual navigated through the chocolate syrup section, compared brands, and added a specific syrup to their basket.", "C. The individual walked through the tea aisle, checked prices, and picked up a box of herbal tea.", "D. The individual strolled through the cereal aisle, checked prices, and appeared to be restocking shelves."], "answer": "D", "time_stamp_s": 288, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [278, 288], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_414_a1269_q0", "video_id": 414, "time_stamp_s": 288, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ce907899c0167bd3f2b49985ff29c0e1830d527089f0614562bab8923e1eb0bd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.00038333333333, 285.0013833333333, 286.00238333333334, 287.0033833333333], "recent_frames_sha256": "6f44d6d5652fcc3fd2c6e8a6fa57b407d645c8e4af0770e426c7734b420ae395", "num_recent_frames": 30, "tq": 718553.870519153, "t1": 718566.19860015, "ta": 718566.19860015, "te": 718566.23599514, "first_response_s": 12.32808099698741, "answer_total_s": 12.36547598708421, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_414_a1269_q0", "video_id": 414, "time_stamp_s": 288, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ecf045b9b1b6f492fb1a358d633fbc7a31bd29509ae48ab098e68bae204df73c", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Hand selects and places a box of \"Nestlé\" cereal into a shopping cart.  \n- Hand picks up a yellow-packaged \"Nestlé\" product from a shelf, then places it into a plastic bag.  \n- Hand reaches for a container of \"Nestlé\" product from a shelf, then places it into the plastic bag.\n[30-60s] - Hand reaches for a green Starbucks container from a shelf, then places it into a cardboard box on the floor.  \n- The box is positioned near a display of Starbucks products, with the hand continuing to pick up more containers.  \n- A second hand appears, assisting in placing additional containers into the box, indicating collaborative action.\n[60-90s] - A hand picks up a box of Dr. Oetker Mandarin Oranges from a shelf, then places it on a counter.  \n- The hand then reaches for a package of eggs, which are placed on the counter next to the orange box.  \n- The hand moves toward a shelf with various canned goods, including jars labeled \"Soy Sauce\" and \"Tomato Sauce,\" while the camera pans to show the shelf's contents.\n[90-120s] - Hand selects a blue-packaged product from shelf, then places it into a shopping cart.  \n- Hand picks up a brown paper bag, then places it into the cart.  \n- Shopping cart moves along aisle, passing shelves stocked with canned goods and packaged items.\n[120-150s] - Hand reaches for a box of Quaker Oatmeal on a shelf, then picks it up.  \n- A green plastic bag hangs from a hook near the shelf, possibly for recycling.  \n- The camera pans slightly to show more shelves stocked with various food items.\n[150-180s] - Hand selects a \"High Fiber Protein\" box from a shelf, then moves to another box labeled \"High Fiber Protein\" on the same shelf.  \n- The hand picks up a \"High Fiber Protein\" box, then places it back on the shelf.  \n- A shopping cart is visible in the foreground, positioned near the shelf.\n[180-210s] - Hand reaches for a box of \"Frosted Flakes\" cereal on a supermarket shelf.  \n- A cardboard box labeled \"CINNAMON TOASTERS\" is held and positioned near the cereal aisle.  \n- Price tags for various cereals, including \"Frosted Flakes\" and \"Cinnamon Toasters,\" are visible on the shelf.\n[210-240s] - Hand reaches for a box of Frosted Flakes cereal on a supermarket shelf.  \n- A large cardboard box labeled \"Reese's Puffs\" is being handled, with its contents partially visible.  \n- A shopping cart is positioned nearby, with another person in the background near a cardboard box.\n[240-270s] - A hand reaches for a yellow box of cereal labeled \"Frosted Flakes\" on a supermarket shelf.  \n- The hand then picks up a cardboard box labeled \"Hershey's Zero Sugar\" and moves it toward the camera.  \n- The camera pans slightly to show more cereal boxes on the shelf, including \"Frosted Flakes\" and \"Rice Krispies.\"", "history_tokens": 701, "history_utf8_bytes": 2752, "recent_frame_times_s": [258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.00038333333333, 285.0013833333333, 286.00238333333334, 287.0033833333333], "recent_frames_sha256": "6f44d6d5652fcc3fd2c6e8a6fa57b407d645c8e4af0770e426c7734b420ae395", "num_recent_frames": 30, "tq": 718457.715837075, "t1": 718459.196678682, "ta": 718459.196678682, "te": 718459.423117397, "first_response_s": 1.4808416069718078, "answer_total_s": 1.7072803219780326, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 414, "content_group": "aa015e07d9ae3a80267a6d2b7af82562fe8724e4725c902e3f1f168990eeb83d", "question": {"question_id": "sample_414_a1270_q0", "video_id": 414, "video_path": "./videos/sample_414_real.mp4", "annotation_index": 1270, "question_index": 0, "question": "Which of the following options best summarizes the action that just now took place?", "options": ["A. An individual sorted through various condiments, selecting and organizing jars of relish on the shelf.", "B. An individual restocked ketchup bottles, ensuring they were properly aligned and accessible for customers.", "C. An individual unpacked and restocked mayonnaise jars on the shelves, organizing them neatly in a supermarket aisle.", "D. An individual evaluated different brands of jam, comparing prices and features before making a purchase."], "answer": "C", "time_stamp_s": 427, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [417, 427], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_414_a1270_q0", "video_id": 414, "time_stamp_s": 427, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1913dd56c3f7cb590d80f5ac4c5d20cf269fe7a45055939a2e69f572e795c58d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0009166666667, 419.00191666666666, 420.0029166666667, 421.00391666666667, 422.00491666666665, 423.0059166666667, 424.00691666666665, 425.0079166666667, 426.00891666666666], "recent_frames_sha256": "b07c5fe2aaa4e62e1beb85c56818e0c48daf560ebe59c56003bf40612244bf2f", "num_recent_frames": 30, "tq": 718566.261245369, "t1": 718574.673086064, "ta": 718574.673086064, "te": 718574.710602686, "first_response_s": 8.411840695072897, "answer_total_s": 8.449357317062095, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_414_a1270_q0", "video_id": 414, "time_stamp_s": 427, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ded12e1af96218a6d84bfb49510e166d355f6cdeecba54fdd03b3fd71e9c3df4", "condition_order": ["notes", "recent"], "memory": "[60-90s] - A hand picks up a box of Dr. Oetker Mandarin Oranges from a shelf, then places it on a counter.  \n- The hand then reaches for a package of eggs, which are placed on the counter next to the orange box.  \n- The hand moves toward a shelf with various canned goods, including jars labeled \"Soy Sauce\" and \"Tomato Sauce,\" while the camera pans to show the shelf's contents.\n[90-120s] - Hand selects a blue-packaged product from shelf, then places it into a shopping cart.  \n- Hand picks up a brown paper bag, then places it into the cart.  \n- Shopping cart moves along aisle, passing shelves stocked with canned goods and packaged items.\n[120-150s] - Hand reaches for a box of Quaker Oatmeal on a shelf, then picks it up.  \n- A green plastic bag hangs from a hook near the shelf, possibly for recycling.  \n- The camera pans slightly to show more shelves stocked with various food items.\n[150-180s] - Hand selects a \"High Fiber Protein\" box from a shelf, then moves to another box labeled \"High Fiber Protein\" on the same shelf.  \n- The hand picks up a \"High Fiber Protein\" box, then places it back on the shelf.  \n- A shopping cart is visible in the foreground, positioned near the shelf.\n[180-210s] - Hand reaches for a box of \"Frosted Flakes\" cereal on a supermarket shelf.  \n- A cardboard box labeled \"CINNAMON TOASTERS\" is held and positioned near the cereal aisle.  \n- Price tags for various cereals, including \"Frosted Flakes\" and \"Cinnamon Toasters,\" are visible on the shelf.\n[210-240s] - Hand reaches for a box of Frosted Flakes cereal on a supermarket shelf.  \n- A large cardboard box labeled \"Reese's Puffs\" is being handled, with its contents partially visible.  \n- A shopping cart is positioned nearby, with another person in the background near a cardboard box.\n[240-270s] - A hand reaches for a yellow box of cereal labeled \"Frosted Flakes\" on a supermarket shelf.  \n- The hand then picks up a cardboard box labeled \"Hershey's Zero Sugar\" and moves it toward the camera.  \n- The camera pans slightly to show more cereal boxes on the shelf, including \"Frosted Flakes\" and \"Rice Krispies.\"\n[270-300s] - A hand reaches for a red-labeled jar of \"HOT COCOA\" on a shelf, positioned above other hot cocoa products.  \n- A brown paper bag is partially visible in the foreground, suggesting a shopping context.  \n- The shelf displays various packaged goods, including \"HOT COCOA\" and \"HOT COCOA\" in different brands, with price tags visible.\n[300-330s] - Hand reaches for a jar of mustard from a shelf stocked with condiments.  \n- Shopping cart is positioned near the shelf, with a box labeled \"SWEET POTATO\" visible in the cart.  \n- Shelf labels indicate \"Sauces\" and \"Mustard\" sections, with products like \"Honey Mustard\" and \"Dijon\" visible.\n[330-360s] - A hand reaches for a bottle of sauce from a shelf, then places it into a cardboard box.  \n- The box, labeled \"Masterpiece,\" contains multiple bottles of sauce and condiments, with a shopping cart visible nearby.  \n- The person adjusts the box’s position on the floor, preparing to move or organize its contents.\n[360-390s] - Hand reaches for a bottle of sauce from a shelf, selecting it from among similar products.  \n- A cardboard box with multiple bottles is placed on the floor, partially open, near the shopping cart.  \n- The camera pans across shelves stocked with various sauces and condiments, showing price tags and product labels.\n[390-420s] - Hand reaches for a jar of \"Sour Cream\" on a shelf, with price tag visible.  \n- Shelf displays multiple brands of mayonnaise and other condiments, including \"Best Foods\" and \"Hellmann's\".  \n- A cardboard box labeled \"BUTTER\" is placed on the floor near the shelf, suggesting a shopping cart or basket nearby.", "history_tokens": 961, "history_utf8_bytes": 3731, "recent_frame_times_s": [397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0009166666667, 419.00191666666666, 420.0029166666667, 421.00391666666667, 422.00491666666665, 423.0059166666667, 424.00691666666665, 425.0079166666667, 426.00891666666666], "recent_frames_sha256": "b07c5fe2aaa4e62e1beb85c56818e0c48daf560ebe59c56003bf40612244bf2f", "num_recent_frames": 30, "tq": 718499.262989426, "t1": 718507.189762327, "ta": 718507.189762327, "te": 718507.229946303, "first_response_s": 7.926772900973447, "answer_total_s": 7.966956876916811, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 414, "content_group": "aa015e07d9ae3a80267a6d2b7af82562fe8724e4725c902e3f1f168990eeb83d", "question": {"question_id": "sample_414_a1271_q0", "video_id": 414, "video_path": "./videos/sample_414_real.mp4", "annotation_index": 1271, "question_index": 0, "question": "Which of the following options best summarizes the actions taken just now?", "options": ["A. An individual browses through a section of fresh produce, selecting and bagging different vegetables and fruits.", "B. An individual stocks up on cleaning supplies, checking labels for ingredients, and placing several items in a cart.", "C. An individual browses through the salad dressing aisle, picks up and examines bottles, places one in a box, and continues down the aisle.", "D. An individual navigates through a hardware store, comparing different brands of paint and supplies before selecting and purchasing a few items."], "answer": "C", "time_stamp_s": 566, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [556, 566], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_414_a1271_q0", "video_id": 414, "time_stamp_s": 566, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "92b937ee502bff34cc9ed825bf08a0264e0e716dbe79555bd784f8f8925f5ca0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.00045, 552.00145, 553.00245, 554.00345, 555.00445, 556.00545, 557.00645, 558.00745, 559.00845, 560.00945, 561.01045, 562.01145, 563.01245, 564.01345, 565.01445], "recent_frames_sha256": "0e002630c6b6ba218465327bc7da065a88db8bf15148936f5bc72ac603fd0d3e", "num_recent_frames": 30, "tq": 718574.727825034, "t1": 718582.325185908, "ta": 718582.325185908, "te": 718582.36348895, "first_response_s": 7.597360874060541, "answer_total_s": 7.635663916007616, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_414_a1271_q0", "video_id": 414, "time_stamp_s": 566, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c8af5a51deb91c954a1b8477e94d8b27129a94d3ed0d92e093f2a190c346429d", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Hand selects a \"High Fiber Protein\" box from a shelf, then moves to another box labeled \"High Fiber Protein\" on the same shelf.  \n- The hand picks up a \"High Fiber Protein\" box, then places it back on the shelf.  \n- A shopping cart is visible in the foreground, positioned near the shelf.\n[180-210s] - Hand reaches for a box of \"Frosted Flakes\" cereal on a supermarket shelf.  \n- A cardboard box labeled \"CINNAMON TOASTERS\" is held and positioned near the cereal aisle.  \n- Price tags for various cereals, including \"Frosted Flakes\" and \"Cinnamon Toasters,\" are visible on the shelf.\n[210-240s] - Hand reaches for a box of Frosted Flakes cereal on a supermarket shelf.  \n- A large cardboard box labeled \"Reese's Puffs\" is being handled, with its contents partially visible.  \n- A shopping cart is positioned nearby, with another person in the background near a cardboard box.\n[240-270s] - A hand reaches for a yellow box of cereal labeled \"Frosted Flakes\" on a supermarket shelf.  \n- The hand then picks up a cardboard box labeled \"Hershey's Zero Sugar\" and moves it toward the camera.  \n- The camera pans slightly to show more cereal boxes on the shelf, including \"Frosted Flakes\" and \"Rice Krispies.\"\n[270-300s] - A hand reaches for a red-labeled jar of \"HOT COCOA\" on a shelf, positioned above other hot cocoa products.  \n- A brown paper bag is partially visible in the foreground, suggesting a shopping context.  \n- The shelf displays various packaged goods, including \"HOT COCOA\" and \"HOT COCOA\" in different brands, with price tags visible.\n[300-330s] - Hand reaches for a jar of mustard from a shelf stocked with condiments.  \n- Shopping cart is positioned near the shelf, with a box labeled \"SWEET POTATO\" visible in the cart.  \n- Shelf labels indicate \"Sauces\" and \"Mustard\" sections, with products like \"Honey Mustard\" and \"Dijon\" visible.\n[330-360s] - A hand reaches for a bottle of sauce from a shelf, then places it into a cardboard box.  \n- The box, labeled \"Masterpiece,\" contains multiple bottles of sauce and condiments, with a shopping cart visible nearby.  \n- The person adjusts the box’s position on the floor, preparing to move or organize its contents.\n[360-390s] - Hand reaches for a bottle of sauce from a shelf, selecting it from among similar products.  \n- A cardboard box with multiple bottles is placed on the floor, partially open, near the shopping cart.  \n- The camera pans across shelves stocked with various sauces and condiments, showing price tags and product labels.\n[390-420s] - Hand reaches for a jar of \"Sour Cream\" on a shelf, with price tag visible.  \n- Shelf displays multiple brands of mayonnaise and other condiments, including \"Best Foods\" and \"Hellmann's\".  \n- A cardboard box labeled \"BUTTER\" is placed on the floor near the shelf, suggesting a shopping cart or basket nearby.\n[420-450s] - Person's hand selects a jar of mayonnaise from a shelf, comparing it to other jars nearby.  \n- Multiple jars of mayonnaise are arranged on shelves with price tags visible, including a \"3 for $3\" deal.  \n- The person's hand moves to pick up a jar from a lower shelf, indicating a selection process.\n[450-480s] - A person in a black shirt walks down an aisle, passing shelves stocked with condiments and sauces.  \n- Another person is seen placing jars into a cardboard box on the floor near the shelves.  \n- The camera pans across shelves displaying various brands of mayonnaise and other jarred goods.\n[480-510s] - Hand selects a jar of mayonnaise from a shelf, placing it into a shopping cart.  \n- Shelf displays various mayonnaise brands with price tags visible.  \n- Cart contains multiple jars of mayonnaise, indicating a selection process.\n[510-540s] - Hand reaches for and selects a bottle of Heinz ketchup from a shelf.  \n- Hand then picks up a small ketchup packet from a lower shelf.  \n- Shelf displays various condiments, including mustard and salad dressings, with price tags visible.", "history_tokens": 1010, "history_utf8_bytes": 3945, "recent_frame_times_s": [536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.00045, 552.00145, 553.00245, 554.00345, 555.00445, 556.00545, 557.00645, 558.00745, 559.00845, 560.00945, 561.01045, 562.01145, 563.01245, 564.01345, 565.01445], "recent_frames_sha256": "0e002630c6b6ba218465327bc7da065a88db8bf15148936f5bc72ac603fd0d3e", "num_recent_frames": 30, "tq": 718543.539152274, "t1": 718544.542096624, "ta": 718544.542096624, "te": 718544.913209926, "first_response_s": 1.002944350009784, "answer_total_s": 1.374057651963085, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 415, "content_group": "78f5fba027845311eb0b706e3b22fbf067da7834de21617fa00cb6dfbef7dbe6", "question": {"question_id": "sample_415_a1616_q0", "video_id": 415, "video_path": "./videos/sample_415_real.mp4", "annotation_index": 1616, "question_index": 0, "question": "Which of the following options best summarizes the actions just taken?", "options": ["A. The individual prepared a sandwich, applied condiments, and wrapped it for serving.", "B. The individual selected toppings, spread sauce, and baked a pizza.", "C. The individual prepared a pizza peel, dusted it with flour, and placed a dough bag on the counter.", "D. The individual sliced vegetables, assembled a salad, and served it in a bowl."], "answer": "C", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [0, 10], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_415_a1616_q0", "video_id": 415, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cd7aa357d19f6010ddcd2694e61d2c8d4f4a3326493de2cb91b5e5c79c4a1487", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "69a8cb31c39eb41be894af2cafc47eba4c21abf2d3629b6fc8ca87a7d3863ec4", "num_recent_frames": 10, "tq": 719382.603319552, "t1": 719383.676776047, "ta": 719383.676776047, "te": 719383.717149073, "first_response_s": 1.073456494952552, "answer_total_s": 1.11382952099666, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_415_a1616_q0", "video_id": 415, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ad1c36525071eaf9550b8ab5fdde9ebe136bdb53e9d0a32f5cb4b577736c900b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "69a8cb31c39eb41be894af2cafc47eba4c21abf2d3629b6fc8ca87a7d3863ec4", "num_recent_frames": 10, "tq": 719418.212278177, "t1": 719430.293615734, "ta": 719430.293615734, "te": 719430.494599411, "first_response_s": 12.081337556941435, "answer_total_s": 12.282321234000847, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 415, "content_group": "78f5fba027845311eb0b706e3b22fbf067da7834de21617fa00cb6dfbef7dbe6", "question": {"question_id": "sample_415_a1617_q0", "video_id": 415, "video_path": "./videos/sample_415_real.mp4", "annotation_index": 1617, "question_index": 0, "question": "Which of the following options best summarizes the actions taken by the individual just now?", "options": ["A. The individual crafted a sandwich, adding lettuce and tomatoes, then cutting it in half before serving.", "B. The individual prepared a salad by mixing several ingredients and garnishing it with dressing.", "C. The individual baked a pizza, adding cheese and pepperoni, before placing it into the oven.", "D. The individual composed a pizza, topping it with spinach, mushrooms, and some type of reddish ingredient."], "answer": "D", "time_stamp_s": 188, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [178, 188], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_415_a1617_q0", "video_id": 415, "time_stamp_s": 188, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f647f5c3cb99b8260738c49bd3107b035519ab1d0876132bd74e7d73da3f440d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665], "recent_frames_sha256": "fe243c2be314d13b26067ff1612ac9ee64993770b00ffd18654bca01824b2afe", "num_recent_frames": 30, "tq": 719383.747760125, "t1": 719395.929816793, "ta": 719395.929816793, "te": 719396.15752306, "first_response_s": 12.18205666798167, "answer_total_s": 12.409762935014442, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_415_a1617_q0", "video_id": 415, "time_stamp_s": 188, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6f449400a4fc93a1bb32b9db83f4587c2e48d94ce9f91179bfcbcdf8fc2c6656", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands in blue gloves handle a plastic-wrapped dough, placing it onto a floured pizza base.  \n- Dough is kneaded and pressed into the center of the pizza base, then covered with flour.  \n- A wooden rolling pin and various toppings in metal containers are visible in the background.\n[30-60s] - Hands in blue gloves press and stretch dough on a floured surface, gradually flattening it into a circular shape.  \n- A wooden rolling pin rests to the left, unused during the kneading process.  \n- Background containers hold various toppings, including cheese, mushrooms, and tomatoes, arranged in a metal tray.\n[60-90s] - Hands in blue gloves knead dough on a floured surface, then lift and fold it repeatedly.  \n- A wooden rolling pin rests nearby on the white countertop.  \n- Background shows stainless steel food prep stations with various ingredients.\n[90-120s] - Hands in blue gloves spread dough on a floured surface, smoothing it out.  \n- A wooden rolling pin rests nearby, and a metal tray with various toppings is visible in the background.  \n- The dough is being stretched and flattened, preparing for further pizza assembly.\n[120-150s] - Hands in blue gloves spread tomato sauce evenly over a large, round pizza dough using a ladle.  \n- A wooden rolling pin rests on the left side of the work surface, near a plastic bag.  \n- The pizza dough is placed on a white paper sheet, with a container of flour visible to the right.\n[150-180s] - Pizza is being topped with green leafy vegetables using gloved hands.\n- A metal ladle is used to spread sauce over the pizza surface.\n- The pizza is placed on parchment paper, with toppings being added sequentially.", "history_tokens": 389, "history_utf8_bytes": 1666, "recent_frame_times_s": [158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665], "recent_frames_sha256": "fe243c2be314d13b26067ff1612ac9ee64993770b00ffd18654bca01824b2afe", "num_recent_frames": 30, "tq": 719478.385722429, "t1": 719486.032992815, "ta": 719486.032992815, "te": 719486.3979139, "first_response_s": 7.647270385990851, "answer_total_s": 8.012191470945254, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 415, "content_group": "78f5fba027845311eb0b706e3b22fbf067da7834de21617fa00cb6dfbef7dbe6", "question": {"question_id": "sample_415_a1618_q0", "video_id": 415, "video_path": "./videos/sample_415_real.mp4", "annotation_index": 1618, "question_index": 0, "question": "Which of the following options best summarizes the individual's actions just now?", "options": ["A. The individual prepares a pizza dough by rolling it out and forming a circular shape.", "B. The individual decorates a cake by applying frosting and adding toppings.", "C. The individual prepares a sandwich by layering ingredients and cutting it in half.", "D. The individual makes a sushi roll by spreading rice and adding fish."], "answer": "A", "time_stamp_s": 366, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [356, 366], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_415_a1618_q0", "video_id": 415, "time_stamp_s": 366, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a680817dc058ea5a47fe6bfa7d0086003a30380c1ac8c0112673b5ca00865a4e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335], "recent_frames_sha256": "729a3bda80c5392c485b750482d6f5b9c97781aeba797d8e93753424968be4f0", "num_recent_frames": 30, "tq": 719396.182568663, "t1": 719402.983737386, "ta": 719402.983737386, "te": 719403.020583063, "first_response_s": 6.801168722915463, "answer_total_s": 6.8380143999820575, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_415_a1618_q0", "video_id": 415, "time_stamp_s": 366, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d2b36dfa30125265510dc9ded1e0cab322c41ae6de5dde915e2333054e0dc4a4", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Hands in blue gloves handle a plastic-wrapped dough, placing it onto a floured pizza base.  \n- Dough is kneaded and pressed into the center of the pizza base, then covered with flour.  \n- A wooden rolling pin and various toppings in metal containers are visible in the background.\n[30-60s] - Hands in blue gloves press and stretch dough on a floured surface, gradually flattening it into a circular shape.  \n- A wooden rolling pin rests to the left, unused during the kneading process.  \n- Background containers hold various toppings, including cheese, mushrooms, and tomatoes, arranged in a metal tray.\n[60-90s] - Hands in blue gloves knead dough on a floured surface, then lift and fold it repeatedly.  \n- A wooden rolling pin rests nearby on the white countertop.  \n- Background shows stainless steel food prep stations with various ingredients.\n[90-120s] - Hands in blue gloves spread dough on a floured surface, smoothing it out.  \n- A wooden rolling pin rests nearby, and a metal tray with various toppings is visible in the background.  \n- The dough is being stretched and flattened, preparing for further pizza assembly.\n[120-150s] - Hands in blue gloves spread tomato sauce evenly over a large, round pizza dough using a ladle.  \n- A wooden rolling pin rests on the left side of the work surface, near a plastic bag.  \n- The pizza dough is placed on a white paper sheet, with a container of flour visible to the right.\n[150-180s] - Pizza is being topped with green leafy vegetables using gloved hands.\n- A metal ladle is used to spread sauce over the pizza surface.\n- The pizza is placed on parchment paper, with toppings being added sequentially.\n[180-210s] - Hands in blue gloves spread spinach over a pizza base on a wooden peel.  \n- Pizza toppings are arranged in a circular pattern, with sauce and cheese already applied.  \n- A plastic bag and a wooden spatula are visible on the counter to the left of the pizza.\n[210-240s] - Hands in blue gloves spread shredded cheese over a pizza base with spinach and sauce.  \n- Pizza is on a wooden board, surrounded by ingredient containers and a flour box.  \n- A knife and rolling pin are visible nearby on the counter.\n[240-270s] - Hands in blue gloves spread shredded cheese over a large pizza base with sauce, spinach, and other toppings.  \n- Pizza is placed on a wooden peel, with a container of flour nearby and various ingredient trays in the background.  \n- The pizza is being prepared for baking, with toppings evenly distributed across the dough.\n[270-300s] - Pizza, topped with greens and cheese, is lifted on a wooden peel by gloved hands.  \n- A knife and a container of flour are visible on the counter beside the peel.  \n- The pizza is moved toward a large, stainless steel oven with a digital display.\n[300-330s] - Hands in blue gloves handle a round pizza dough on a floured surface, with a wooden peel nearby.  \n- A plastic bag containing a ball of dough is placed beside the peel, then opened to reveal the dough inside.  \n- The dough is transferred from the bag to a white plastic container filled with flour, where it is pressed and mixed.\n[330-360s] - Hands in blue gloves lift and stretch dough over a floured surface, then place it back down.  \n- A wooden rolling pin rests nearby on the floured counter.  \n- Background shows a metal tray with various food ingredients in compartments.", "history_tokens": 794, "history_utf8_bytes": 3372, "recent_frame_times_s": [336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335, 349.01533333333333, 350.0163333333333, 351.01733333333334, 352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335], "recent_frames_sha256": "729a3bda80c5392c485b750482d6f5b9c97781aeba797d8e93753424968be4f0", "num_recent_frames": 30, "tq": 719528.459572647, "t1": 719535.07743277, "ta": 719535.07743277, "te": 719535.226230772, "first_response_s": 6.617860123049468, "answer_total_s": 6.766658124979585, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 415, "content_group": "78f5fba027845311eb0b706e3b22fbf067da7834de21617fa00cb6dfbef7dbe6", "question": {"question_id": "sample_415_a1619_q0", "video_id": 415, "video_path": "./videos/sample_415_real.mp4", "annotation_index": 1619, "question_index": 0, "question": "Which of the following options best summarizes the actions taking place just now?", "options": ["A. The individual was spreading sauce on a pizza base and putting toppings on it.", "B. The individual was applying flour to a pizza board and preparing the workstation for making pizza.", "C. The individual was washing kitchen utensils and cleaning the floor.", "D. The individual was grating cheese and chopping vegetables for a salad."], "answer": "B", "time_stamp_s": 539, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [534, 544], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_415_a1619_q0", "video_id": 415, "time_stamp_s": 539, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9f010d60692bac92e648793d5faa268b86e5a0d08a7ee9383703e80eaf9d63b1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0175, 519.0185, 520.0195, 521.0205, 522.0215, 523.0225, 524.0235, 525.0245, 526.0255, 527.0265, 528.0275, 529.0285, 530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334], "recent_frames_sha256": "5e7858196688208549d2f31ab1e609364baf053cabad250b9b07ac2618d9d253", "num_recent_frames": 30, "tq": 719403.040598567, "t1": 719410.20769029, "ta": 719410.20769029, "te": 719410.245209479, "first_response_s": 7.167091722949408, "answer_total_s": 7.204610912012868, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_415_a1619_q0", "video_id": 415, "time_stamp_s": 539, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bea661fa1419665bd80ba6194c7a757937b1325cd109b6fe57c65f667293dae9", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Hands in blue gloves knead dough on a floured surface, then lift and fold it repeatedly.  \n- A wooden rolling pin rests nearby on the white countertop.  \n- Background shows stainless steel food prep stations with various ingredients.\n[90-120s] - Hands in blue gloves spread dough on a floured surface, smoothing it out.  \n- A wooden rolling pin rests nearby, and a metal tray with various toppings is visible in the background.  \n- The dough is being stretched and flattened, preparing for further pizza assembly.\n[120-150s] - Hands in blue gloves spread tomato sauce evenly over a large, round pizza dough using a ladle.  \n- A wooden rolling pin rests on the left side of the work surface, near a plastic bag.  \n- The pizza dough is placed on a white paper sheet, with a container of flour visible to the right.\n[150-180s] - Pizza is being topped with green leafy vegetables using gloved hands.\n- A metal ladle is used to spread sauce over the pizza surface.\n- The pizza is placed on parchment paper, with toppings being added sequentially.\n[180-210s] - Hands in blue gloves spread spinach over a pizza base on a wooden peel.  \n- Pizza toppings are arranged in a circular pattern, with sauce and cheese already applied.  \n- A plastic bag and a wooden spatula are visible on the counter to the left of the pizza.\n[210-240s] - Hands in blue gloves spread shredded cheese over a pizza base with spinach and sauce.  \n- Pizza is on a wooden board, surrounded by ingredient containers and a flour box.  \n- A knife and rolling pin are visible nearby on the counter.\n[240-270s] - Hands in blue gloves spread shredded cheese over a large pizza base with sauce, spinach, and other toppings.  \n- Pizza is placed on a wooden peel, with a container of flour nearby and various ingredient trays in the background.  \n- The pizza is being prepared for baking, with toppings evenly distributed across the dough.\n[270-300s] - Pizza, topped with greens and cheese, is lifted on a wooden peel by gloved hands.  \n- A knife and a container of flour are visible on the counter beside the peel.  \n- The pizza is moved toward a large, stainless steel oven with a digital display.\n[300-330s] - Hands in blue gloves handle a round pizza dough on a floured surface, with a wooden peel nearby.  \n- A plastic bag containing a ball of dough is placed beside the peel, then opened to reveal the dough inside.  \n- The dough is transferred from the bag to a white plastic container filled with flour, where it is pressed and mixed.\n[330-360s] - Hands in blue gloves lift and stretch dough over a floured surface, then place it back down.  \n- A wooden rolling pin rests nearby on the floured counter.  \n- Background shows a metal tray with various food ingredients in compartments.\n[360-390s] - Hands in blue gloves press and stretch dough on a floured surface, then lift it with a cloth to reveal a larger, stretched dough piece.  \n- A wooden rolling pin rests on the counter beside the dough, while containers of toppings are visible in the background.  \n- The dough is lifted and placed back down, showing its stretched, thin texture as it’s handled.\n[390-420s] - Hands in blue gloves stretch and manipulate large, pale dough over a floured surface.  \n- A wooden rolling pin rests nearby on the white countertop.  \n- Background shows multiple stainless steel containers holding various ingredients.\n[420-450s] - Hands in blue gloves spread tomato sauce evenly over a large, round pizza dough using a ladle.  \n- A wooden rolling pin and a plastic-wrapped item are visible on the counter to the left.  \n- The pizza dough is positioned on a floured surface, with a metal container holding various toppings in the background.\n[450-480s] - Pizza dough, topped with sauce, is being sprinkled with shredded cheese by gloved hands.\n- A wooden pizza peel rests beside the pizza on a floured surface.\n- The pizza is positioned on a round wooden board, ready for baking or transport.\n[480-510s] - Two gloved hands grip the edges of a large, round pizza topped with sauce and cheese, positioned on a floured surface.  \n- The pizza is being gently rotated or adjusted on a white, floured countertop, with a wooden rolling pin and a container of flour nearby.  \n- A metal tray with various toppings is visible in the background, indicating a pizza preparation station.", "history_tokens": 1021, "history_utf8_bytes": 4336, "recent_frame_times_s": [509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0175, 519.0185, 520.0195, 521.0205, 522.0215, 523.0225, 524.0235, 525.0245, 526.0255, 527.0265, 528.0275, 529.0285, 530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334], "recent_frames_sha256": "5e7858196688208549d2f31ab1e609364baf053cabad250b9b07ac2618d9d253", "num_recent_frames": 30, "tq": 719581.796337037, "t1": 719589.67579146, "ta": 719589.67579146, "te": 719589.718751425, "first_response_s": 7.879454422974959, "answer_total_s": 7.922414388041943, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 415, "content_group": "78f5fba027845311eb0b706e3b22fbf067da7834de21617fa00cb6dfbef7dbe6", "question": {"question_id": "sample_415_a1620_q0", "video_id": 415, "video_path": "./videos/sample_415_real.mp4", "annotation_index": 1620, "question_index": 0, "question": "Which of the following options best summarizes the recent actions shown?", "options": ["A. The worker picked up dough, kneaded it, and placed it into a proofing oven.", "B. The worker stretched a pizza dough, then added marinara sauce to the center, spreading it out.", "C. The worker prepared a sandwich, added condiments, and wrapped it in paper.", "D. The worker chopped vegetables, placed them in a bowl, and added dressing."], "answer": "B", "time_stamp_s": 722, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "preparation_of_meals", "reference_interval_s": [712, 722], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_415_a1620_q0", "video_id": 415, "time_stamp_s": 722, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "46429a3b0f57df36340e014c60aeaab50e2fd7e199dbebe47963289b232af6c1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [692.0246666666667, 693.0256666666667, 694.0266666666666, 695.0276666666666, 696.0286666666667, 697.0296666666667, 698.0306666666667, 699.0316666666666, 700.0326666666666, 701.0003, 702.0013, 703.0023, 704.0033, 705.0043, 706.0053, 707.0063, 708.0073, 709.0083, 710.0093, 711.0103, 712.0113, 713.0123, 714.0133, 715.0143, 716.0153, 717.0163, 718.0173, 719.0183, 720.0193, 721.0203], "recent_frames_sha256": "769493c1bd69a0b171895d5a27b55884297bc9a4b26b5997f8ae0c68ed0c5f77", "num_recent_frames": 30, "tq": 719410.26474124, "t1": 719418.155260233, "ta": 719418.155260233, "te": 719418.193786197, "first_response_s": 7.890518993022852, "answer_total_s": 7.929044957039878, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_415_a1620_q0", "video_id": 415, "time_stamp_s": 722, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6444a932738f11e0641042032fc3818685a7ef0bfee8b71c0c2042095fd0931e", "condition_order": ["recent", "notes"], "memory": "[330-360s] - Hands in blue gloves lift and stretch dough over a floured surface, then place it back down.  \n- A wooden rolling pin rests nearby on the floured counter.  \n- Background shows a metal tray with various food ingredients in compartments.\n[360-390s] - Hands in blue gloves press and stretch dough on a floured surface, then lift it with a cloth to reveal a larger, stretched dough piece.  \n- A wooden rolling pin rests on the counter beside the dough, while containers of toppings are visible in the background.  \n- The dough is lifted and placed back down, showing its stretched, thin texture as it’s handled.\n[390-420s] - Hands in blue gloves stretch and manipulate large, pale dough over a floured surface.  \n- A wooden rolling pin rests nearby on the white countertop.  \n- Background shows multiple stainless steel containers holding various ingredients.\n[420-450s] - Hands in blue gloves spread tomato sauce evenly over a large, round pizza dough using a ladle.  \n- A wooden rolling pin and a plastic-wrapped item are visible on the counter to the left.  \n- The pizza dough is positioned on a floured surface, with a metal container holding various toppings in the background.\n[450-480s] - Pizza dough, topped with sauce, is being sprinkled with shredded cheese by gloved hands.\n- A wooden pizza peel rests beside the pizza on a floured surface.\n- The pizza is positioned on a round wooden board, ready for baking or transport.\n[480-510s] - Two gloved hands grip the edges of a large, round pizza topped with sauce and cheese, positioned on a floured surface.  \n- The pizza is being gently rotated or adjusted on a white, floured countertop, with a wooden rolling pin and a container of flour nearby.  \n- A metal tray with various toppings is visible in the background, indicating a pizza preparation station.\n[510-540s] - A large, round pizza topped with cheese and sauce rests on a wooden peel, positioned on a white countertop.  \n- The person, wearing blue gloves, is seen rolling out dough on the same countertop, near the pizza.  \n- The scene transitions to the person walking toward a stack of metal trays and wooden tools, indicating preparation for the next step.\n[540-570s] - Person wearing blue gloves reaches for a large, round, flour-dusted pizza dough on a white surface.  \n- They pick up a plastic-wrapped portion of dough, preparing to work with it near a metal countertop with ingredient containers.  \n- A wooden pizza peel rests beside the dough, and a knife lies nearby on the counter.\n[570-600s] - Hands in blue gloves knead dough on a floured surface, transitioning from a plastic bag to direct manipulation.  \n- A wooden rolling pin rests nearby, while a large, round pizza base is visible to the left.  \n- Background shows a stainless steel food prep station with multiple compartments holding ingredients like cheese, vegetables, and meats.\n[600-630s] - Hands in blue gloves press and stretch dough on a floured surface, then lift it to fold over itself.  \n- A wooden rolling pin rests nearby on the white countertop.  \n- The dough is transferred to a cloth-covered surface, likely for resting or proofing.\n[630-660s] - A large pizza with green peppers, mushrooms, and cheese is removed from a commercial oven using a metal pizza peel.  \n- The pizza is transferred to a wooden board placed on a stainless steel countertop.  \n- The person wearing blue gloves and a red shirt is seen handling the pizza and placing it on the board.\n[660-690s] - Two hands wearing blue gloves use a pizza cutter to slice a large, round pizza on a wooden board.  \n- The pizza, topped with cheese, green peppers, mushrooms, and ham, is placed on a cardboard box.  \n- The pizza is lifted and rotated slightly as the cutting continues, revealing its golden-brown crust.\n[690-720s] - A large, round pizza with green toppings is being placed on a metal tray by gloved hands.  \n- The pizza is positioned on a stainless steel counter next to other prepared pizzas.  \n- A large, raw dough ball is being stretched and flattened on a floured surface, with various toppings visible in containers behind.", "history_tokens": 959, "history_utf8_bytes": 4111, "recent_frame_times_s": [692.0246666666667, 693.0256666666667, 694.0266666666666, 695.0276666666666, 696.0286666666667, 697.0296666666667, 698.0306666666667, 699.0316666666666, 700.0326666666666, 701.0003, 702.0013, 703.0023, 704.0033, 705.0043, 706.0053, 707.0063, 708.0073, 709.0083, 710.0093, 711.0103, 712.0113, 713.0123, 714.0133, 715.0143, 716.0153, 717.0163, 718.0173, 719.0183, 720.0193, 721.0203], "recent_frames_sha256": "769493c1bd69a0b171895d5a27b55884297bc9a4b26b5997f8ae0c68ed0c5f77", "num_recent_frames": 30, "tq": 719638.589157839, "t1": 719644.406831866, "ta": 719644.406831866, "te": 719644.44441548, "first_response_s": 5.817674027057365, "answer_total_s": 5.855257641058415, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 416, "content_group": "681e08b88d9fb7420f6b3a40fa872e7459688e4a1e70031c4ee722626c3c68ce", "question": {"question_id": "sample_416_a5_q0", "video_id": 416, "video_path": "./videos/sample_416_real.mp4", "annotation_index": 5, "question_index": 0, "question": "What can be seen in the cockpit's center screen right now?", "options": ["A. A compass.", "B. A map.", "C. An altitude meter.", "D. A weather radar."], "answer": "B", "time_stamp_s": 6, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_416_a5_q0", "video_id": 416, "time_stamp_s": 6, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ff5a9ba026a2c4878c55db13bc08c654201be98dd46547b2d9af1e0bd82dbb0a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005], "recent_frames_sha256": "d59b396ff835c8aca7778fb6ebd2dc2a4d83c6b1bf741166d293121fe7bc704f", "num_recent_frames": 6, "tq": 710654.168189587, "t1": 710660.045304271, "ta": 710660.045304271, "te": 710660.083690782, "first_response_s": 5.877114684088156, "answer_total_s": 5.9155011950060725, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_416_a5_q0", "video_id": 416, "time_stamp_s": 6, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "84ce14c26c3521e669db72bacf469bc1ccfdbca48e01b40157b50f057d38d21f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005], "recent_frames_sha256": "d59b396ff835c8aca7778fb6ebd2dc2a4d83c6b1bf741166d293121fe7bc704f", "num_recent_frames": 6, "tq": 710463.803412819, "t1": 710475.49127646, "ta": 710475.49127646, "te": 710475.638732011, "first_response_s": 11.687863640952855, "answer_total_s": 11.835319191915914, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 416, "content_group": "681e08b88d9fb7420f6b3a40fa872e7459688e4a1e70031c4ee722626c3c68ce", "question": {"question_id": "sample_416_a6_q0", "video_id": 416, "video_path": "./videos/sample_416_real.mp4", "annotation_index": 6, "question_index": 0, "question": "What colors are the pilot's handheld controls right now?", "options": ["A. Black.", "B. Red and green.", "C. Yellow and blue.", "D. Black and orange."], "answer": "A", "time_stamp_s": 157, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [143, 163], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_416_a6_q0", "video_id": 416, "time_stamp_s": 157, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4882ed17413f387214b2c75e530a37983a9e8e8fb20297615f37c1d8e97c5a93", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334], "recent_frames_sha256": "59e5b4b9ce733d4c805069b0f4a4d1276dd191fbe74f0a776b7a1c10375d78a6", "num_recent_frames": 30, "tq": 710660.105121242, "t1": 710673.915928837, "ta": 710673.915928837, "te": 710673.955144285, "first_response_s": 13.810807595029473, "answer_total_s": 13.850023042992689, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_416_a6_q0", "video_id": 416, "time_stamp_s": 157, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e9c1dda99b44924f1a73a7321fed39792a601419448b51b0ed349d665215bff3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Helicopter pilot's hand grips control stick while flying over snowy mountains, with a map and stickers visible on the dashboard.  \n- A person in a red jacket is seen standing on a narrow cliffside path, with a yellow arrow pointing toward them.  \n- Interior shot shows a person placing a black bag with a cartoon design on a bed next to a radiator, with a small table nearby.\n[30-60s] - A hand wipes a white aircraft wing with a cloth, showing a small blue mark on the surface.  \n- The cockpit view shows the pilot’s legs and dashboard as the plane taxis on a grass runway.  \n- A helicopter flies low over the field, with people standing nearby observing the activity.\n[60-90s] - Pilot's hand gestures thumbs-up while seated in cockpit, indicating readiness or approval.\n- Aircraft ascends, revealing expansive urban landscape below with rivers and roads.\n- Wingtip visible on right side, showing aircraft's orientation as it climbs over mountainous terrain.\n[90-120s] - A top-down view from a helicopter cockpit shows a cityscape with mountains in the background, and a map overlay appears in the upper left corner.  \n- The pilot’s hands are visible on controls, with a digital display showing altitude and other flight data.  \n- The helicopter’s wing is visible on the right side of the frame, with the pilot wearing sunglasses and a scarf, looking toward the camera.\n[120-150s] - Pilot's hand grips control stick while adjusting flight path over mountainous terrain.  \n- Instrument panel displays navigation map and altimeter, indicating descent toward a valley.  \n- Landscape transitions from rocky cliffs to a coastal town with white buildings visible below.", "history_tokens": 366, "history_utf8_bytes": 1679, "recent_frame_times_s": [127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334], "recent_frames_sha256": "59e5b4b9ce733d4c805069b0f4a4d1276dd191fbe74f0a776b7a1c10375d78a6", "num_recent_frames": 30, "tq": 710517.613159231, "t1": 710524.184184207, "ta": 710524.184184207, "te": 710524.222235838, "first_response_s": 6.57102497597225, "answer_total_s": 6.609076606924646, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 416, "content_group": "681e08b88d9fb7420f6b3a40fa872e7459688e4a1e70031c4ee722626c3c68ce", "question": {"question_id": "sample_416_a7_q0", "video_id": 416, "video_path": "./videos/sample_416_real.mp4", "annotation_index": 7, "question_index": 0, "question": "What are the visible weather conditions right now?", "options": ["A. Clear sky with scattered clouds.", "B. Overcast sky with rain.", "C. Foggy with low visibility.", "D. Thunderstorms with lightning."], "answer": "A", "time_stamp_s": 301, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [286, 306], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_416_a7_q0", "video_id": 416, "time_stamp_s": 301, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0d838de115b69430ede860f430b3247b4a88d43d4e69a1f33583f389e67d7e95", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "703be9ff7e5663f12275a4d63467dfdd1df11743100a735fa761c6be80cfaa9c", "num_recent_frames": 30, "tq": 710673.983134387, "t1": 710686.96136153, "ta": 710686.96136153, "te": 710687.004103436, "first_response_s": 12.978227143059485, "answer_total_s": 13.020969049073756, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_416_a7_q0", "video_id": 416, "time_stamp_s": 301, "ground_truth": "A", "raw_output": "A. Clear sky with scattered clouds.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "8524a7fd4f6d8af1d8529c83893f1c2c71576ba66ee33e2f2b3055428cd107cc", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Helicopter pilot's hand grips control stick while flying over snowy mountains, with a map and stickers visible on the dashboard.  \n- A person in a red jacket is seen standing on a narrow cliffside path, with a yellow arrow pointing toward them.  \n- Interior shot shows a person placing a black bag with a cartoon design on a bed next to a radiator, with a small table nearby.\n[30-60s] - A hand wipes a white aircraft wing with a cloth, showing a small blue mark on the surface.  \n- The cockpit view shows the pilot’s legs and dashboard as the plane taxis on a grass runway.  \n- A helicopter flies low over the field, with people standing nearby observing the activity.\n[60-90s] - Pilot's hand gestures thumbs-up while seated in cockpit, indicating readiness or approval.\n- Aircraft ascends, revealing expansive urban landscape below with rivers and roads.\n- Wingtip visible on right side, showing aircraft's orientation as it climbs over mountainous terrain.\n[90-120s] - A top-down view from a helicopter cockpit shows a cityscape with mountains in the background, and a map overlay appears in the upper left corner.  \n- The pilot’s hands are visible on controls, with a digital display showing altitude and other flight data.  \n- The helicopter’s wing is visible on the right side of the frame, with the pilot wearing sunglasses and a scarf, looking toward the camera.\n[120-150s] - Pilot's hand grips control stick while adjusting flight path over mountainous terrain.  \n- Instrument panel displays navigation map and altimeter, indicating descent toward a valley.  \n- Landscape transitions from rocky cliffs to a coastal town with white buildings visible below.\n[150-180s] - Pilot's hands manipulate controls, with left hand on blue joystick and right hand near orange throttle.  \n- Instrument panel displays map, altimeter, and other flight data; a small sticker with a cartoon face is visible.  \n- Snow-covered mountain range and valley below, with a town visible in the distance under clear blue sky.\n[180-210s] - Pilot's hands grip controls, with left hand on blue throttle and right hand on stick, maintaining steady flight.\n- Instrument panel displays navigation map, altimeter, and other gauges, indicating active flight management.\n- Aircraft descends slightly, revealing snow-capped mountain peaks and valleys below, with clear sky overhead.\n[210-240s] - Pilot's hands grip controls in a glider cockpit, with a clear view of snowy mountains and valleys below.  \n- The glider's instrument panel displays flight data, including a map and altimeter, as the aircraft descends.  \n- A digital map overlay appears, showing a red path over a mountainous terrain with labeled locations.\n[240-270s] - Pilot’s hands adjust controls while seated in a glider cockpit, with a digital map and gauges visible.  \n- Snow-capped mountain peak dominates the right side of the frame, with rugged terrain and distant valleys below.  \n- The glider’s transparent canopy offers a clear view of the sky and landscape, with clouds drifting across the horizon.\n[270-300s] - Pilot's hands manipulate controls, with left hand on stick and right hand near throttle.  \n- Instrument panel displays navigation map and gauges, with a small blue object (possibly a GPS device) mounted near the left hand.  \n- Mountainous terrain with snow-covered peaks dominates the right side of the frame, while distant valleys and ridges stretch across the horizon.", "history_tokens": 761, "history_utf8_bytes": 3447, "recent_frame_times_s": [271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667], "recent_frames_sha256": "703be9ff7e5663f12275a4d63467dfdd1df11743100a735fa761c6be80cfaa9c", "num_recent_frames": 30, "tq": 710567.422322575, "t1": 710573.673709786, "ta": 710573.673709786, "te": 710573.973406701, "first_response_s": 6.2513872110284865, "answer_total_s": 6.551084125996567, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 416, "content_group": "681e08b88d9fb7420f6b3a40fa872e7459688e4a1e70031c4ee722626c3c68ce", "question": {"question_id": "sample_416_a8_q0", "video_id": 416, "video_path": "./videos/sample_416_real.mp4", "annotation_index": 8, "question_index": 0, "question": "What are colors of the curved flight path right now?", "options": ["A. Yellow and blue.", "B. Blue and white.", "C. Green and ograne.", "D. Red and blue."], "answer": "D", "time_stamp_s": 435, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [429, 449], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_416_a8_q0", "video_id": 416, "time_stamp_s": 435, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f7cdd743010a648dc2075b2b5e528096b9512dcaa1379e71e6c7406accc1bc1b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256, 427.0266, 428.0276, 429.0286, 430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333], "recent_frames_sha256": "e618724292d7ef25b7805ec48a0ff977b84fd0aeb2d5630e0474cb5f6903b147", "num_recent_frames": 30, "tq": 710687.012960476, "t1": 710698.326547559, "ta": 710698.326547559, "te": 710698.36464347, "first_response_s": 11.313587083015591, "answer_total_s": 11.351682994049042, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_416_a8_q0", "video_id": 416, "time_stamp_s": 435, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5c331b4be3ae969804e18f522325b8ad8c8d755d531bde94ee2c766fb8ac95aa", "condition_order": ["notes", "recent"], "memory": "[30-60s] - A hand wipes a white aircraft wing with a cloth, showing a small blue mark on the surface.  \n- The cockpit view shows the pilot’s legs and dashboard as the plane taxis on a grass runway.  \n- A helicopter flies low over the field, with people standing nearby observing the activity.\n[60-90s] - Pilot's hand gestures thumbs-up while seated in cockpit, indicating readiness or approval.\n- Aircraft ascends, revealing expansive urban landscape below with rivers and roads.\n- Wingtip visible on right side, showing aircraft's orientation as it climbs over mountainous terrain.\n[90-120s] - A top-down view from a helicopter cockpit shows a cityscape with mountains in the background, and a map overlay appears in the upper left corner.  \n- The pilot’s hands are visible on controls, with a digital display showing altitude and other flight data.  \n- The helicopter’s wing is visible on the right side of the frame, with the pilot wearing sunglasses and a scarf, looking toward the camera.\n[120-150s] - Pilot's hand grips control stick while adjusting flight path over mountainous terrain.  \n- Instrument panel displays navigation map and altimeter, indicating descent toward a valley.  \n- Landscape transitions from rocky cliffs to a coastal town with white buildings visible below.\n[150-180s] - Pilot's hands manipulate controls, with left hand on blue joystick and right hand near orange throttle.  \n- Instrument panel displays map, altimeter, and other flight data; a small sticker with a cartoon face is visible.  \n- Snow-covered mountain range and valley below, with a town visible in the distance under clear blue sky.\n[180-210s] - Pilot's hands grip controls, with left hand on blue throttle and right hand on stick, maintaining steady flight.\n- Instrument panel displays navigation map, altimeter, and other gauges, indicating active flight management.\n- Aircraft descends slightly, revealing snow-capped mountain peaks and valleys below, with clear sky overhead.\n[210-240s] - Pilot's hands grip controls in a glider cockpit, with a clear view of snowy mountains and valleys below.  \n- The glider's instrument panel displays flight data, including a map and altimeter, as the aircraft descends.  \n- A digital map overlay appears, showing a red path over a mountainous terrain with labeled locations.\n[240-270s] - Pilot’s hands adjust controls while seated in a glider cockpit, with a digital map and gauges visible.  \n- Snow-capped mountain peak dominates the right side of the frame, with rugged terrain and distant valleys below.  \n- The glider’s transparent canopy offers a clear view of the sky and landscape, with clouds drifting across the horizon.\n[270-300s] - Pilot's hands manipulate controls, with left hand on stick and right hand near throttle.  \n- Instrument panel displays navigation map and gauges, with a small blue object (possibly a GPS device) mounted near the left hand.  \n- Mountainous terrain with snow-covered peaks dominates the right side of the frame, while distant valleys and ridges stretch across the horizon.\n[300-330s] - Pilot's hands manipulate controls, with left hand on stick and right hand on throttle.  \n- Instrument panel displays flight data, including altimeter, attitude indicator, and map.  \n- Mountainous terrain with snow-covered peaks dominates the view outside the cockpit.\n[330-360s] - Pilot's hands manipulate controls, with left hand on stick and right hand on throttle/lever.  \n- Instrument panel displays flight data, including altimeter, attitude indicator, and map.  \n- Aircraft descends steeply toward a snow-dusted mountain cliff face, with visible rock textures and snow patches.\n[360-390s] - Pilot's hands manipulate controls, with left hand on blue joystick and right hand on throttle.  \n- Cockpit instruments display flight data, including a map and altimeter, with a red warning light illuminated.  \n- Mountainous terrain with snow patches and rocky cliffs dominates the view, with a distant town visible below.\n[390-420s] - Pilot's hands manipulate control stick and throttle, adjusting flight path over snowy terrain.  \n- Instrument panel displays altitude, speed, and navigation data; a map shows route over mountainous region.  \n- Aircraft glides smoothly, with visible clouds and snow-covered peaks below, indicating high-altitude flight.", "history_tokens": 953, "history_utf8_bytes": 4326, "recent_frame_times_s": [405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256, 427.0266, 428.0276, 429.0286, 430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333], "recent_frames_sha256": "e618724292d7ef25b7805ec48a0ff977b84fd0aeb2d5630e0474cb5f6903b147", "num_recent_frames": 30, "tq": 710599.695767996, "t1": 710601.489333855, "ta": 710601.489333855, "te": 710601.65017011, "first_response_s": 1.7935658589703962, "answer_total_s": 1.9544021140318364, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 416, "content_group": "681e08b88d9fb7420f6b3a40fa872e7459688e4a1e70031c4ee722626c3c68ce", "question": {"question_id": "sample_416_a9_q0", "video_id": 416, "video_path": "./videos/sample_416_real.mp4", "annotation_index": 9, "question_index": 0, "question": "What is located to the bottom-left of the cockpit's central control panel right now?", "options": ["A. A blue handle.", "B. A red button.", "C. An altitude meter.", "D. A compass."], "answer": "A", "time_stamp_s": 573, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [572, 592], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_416_a9_q0", "video_id": 416, "time_stamp_s": 573, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cd61beda0d4f3ba65ea2cad7ffadd49d00199bb9e7b8e873d6a21dc8d7128317", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333, 554.0201333333333, 555.0211333333333, 556.0221333333334, 557.0231333333334, 558.0241333333333, 559.0251333333333, 560.0261333333333, 561.0271333333334, 562.0281333333334, 563.0291333333333, 564.0301333333333, 565.0311333333333, 566.0321333333334, 567.0331333333334, 568.0007666666667, 569.0017666666666, 570.0027666666666, 571.0037666666667, 572.0047666666667], "recent_frames_sha256": "2eea48920749979fa1320fe5d627442c2e0e161815ea8e85a5dbba8b5b6065a9", "num_recent_frames": 30, "tq": 710698.38618267, "t1": 710709.585623714, "ta": 710709.585623714, "te": 710709.627529468, "first_response_s": 11.19944104400929, "answer_total_s": 11.241346798022278, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_416_a9_q0", "video_id": 416, "time_stamp_s": 573, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1d7a8e87561a61ebf89b9c29af603e07ced5a32205795a2a0d5d778c3cbebdd6", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Pilot's hands manipulate controls, with left hand on blue joystick and right hand near orange throttle.  \n- Instrument panel displays map, altimeter, and other flight data; a small sticker with a cartoon face is visible.  \n- Snow-covered mountain range and valley below, with a town visible in the distance under clear blue sky.\n[180-210s] - Pilot's hands grip controls, with left hand on blue throttle and right hand on stick, maintaining steady flight.\n- Instrument panel displays navigation map, altimeter, and other gauges, indicating active flight management.\n- Aircraft descends slightly, revealing snow-capped mountain peaks and valleys below, with clear sky overhead.\n[210-240s] - Pilot's hands grip controls in a glider cockpit, with a clear view of snowy mountains and valleys below.  \n- The glider's instrument panel displays flight data, including a map and altimeter, as the aircraft descends.  \n- A digital map overlay appears, showing a red path over a mountainous terrain with labeled locations.\n[240-270s] - Pilot’s hands adjust controls while seated in a glider cockpit, with a digital map and gauges visible.  \n- Snow-capped mountain peak dominates the right side of the frame, with rugged terrain and distant valleys below.  \n- The glider’s transparent canopy offers a clear view of the sky and landscape, with clouds drifting across the horizon.\n[270-300s] - Pilot's hands manipulate controls, with left hand on stick and right hand near throttle.  \n- Instrument panel displays navigation map and gauges, with a small blue object (possibly a GPS device) mounted near the left hand.  \n- Mountainous terrain with snow-covered peaks dominates the right side of the frame, while distant valleys and ridges stretch across the horizon.\n[300-330s] - Pilot's hands manipulate controls, with left hand on stick and right hand on throttle.  \n- Instrument panel displays flight data, including altimeter, attitude indicator, and map.  \n- Mountainous terrain with snow-covered peaks dominates the view outside the cockpit.\n[330-360s] - Pilot's hands manipulate controls, with left hand on stick and right hand on throttle/lever.  \n- Instrument panel displays flight data, including altimeter, attitude indicator, and map.  \n- Aircraft descends steeply toward a snow-dusted mountain cliff face, with visible rock textures and snow patches.\n[360-390s] - Pilot's hands manipulate controls, with left hand on blue joystick and right hand on throttle.  \n- Cockpit instruments display flight data, including a map and altimeter, with a red warning light illuminated.  \n- Mountainous terrain with snow patches and rocky cliffs dominates the view, with a distant town visible below.\n[390-420s] - Pilot's hands manipulate control stick and throttle, adjusting flight path over snowy terrain.  \n- Instrument panel displays altitude, speed, and navigation data; a map shows route over mountainous region.  \n- Aircraft glides smoothly, with visible clouds and snow-covered peaks below, indicating high-altitude flight.\n[420-450s] - Pilot's hands are visible on controls, with one hand gripping a blue joystick and the other near a throttle or lever, suggesting active flight management.\n- The cockpit dashboard displays multiple gauges and a digital map, indicating navigation and flight status.\n- The aircraft is flying over a vast, snow-covered mountain range with visible valleys and ridges, suggesting high-altitude terrain.\n[450-480s] - Pilot’s left hand grips a blue control stick, maintaining steady flight posture.\n- Instrument panel displays altitude, speed, and GPS map, indicating active navigation over mountainous terrain.\n- Aircraft descends slightly, revealing a steep, snow-dusted cliff face to the right and a valley below.\n[480-510s] - Pilot’s hand grips control stick, maintaining steady flight path.  \n- Instrument panel displays stable flight data, including altitude and speed.  \n- Snow-covered mountain range dominates right side of view, with clear sky above.\n[510-540s] - Pilot's hand adjusts controls while flying a glider over snow-covered mountains under clear skies.\n- Instrument panel displays navigation map and flight data, with a compass and altimeter visible.\n- Transition to 3D flight simulation showing red route lines over mountainous terrain with snow-capped peaks.\n[540-570s] - Red line traces a path across mountainous terrain, indicating flight route or navigation path.  \n- Blue and green markers appear along the route, possibly signifying waypoints or points of interest.  \n- Camera view shifts to cockpit perspective, showing pilot’s hands, instruments, and expansive mountainous landscape below.", "history_tokens": 1022, "history_utf8_bytes": 4661, "recent_frame_times_s": [543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333, 554.0201333333333, 555.0211333333333, 556.0221333333334, 557.0231333333334, 558.0241333333333, 559.0251333333333, 560.0261333333333, 561.0271333333334, 562.0281333333334, 563.0291333333333, 564.0301333333333, 565.0311333333333, 566.0321333333334, 567.0331333333334, 568.0007666666667, 569.0017666666666, 570.0027666666666, 571.0037666666667, 572.0047666666667], "recent_frames_sha256": "2eea48920749979fa1320fe5d627442c2e0e161815ea8e85a5dbba8b5b6065a9", "num_recent_frames": 30, "tq": 710646.254739289, "t1": 710654.098938518, "ta": 710654.098938518, "te": 710654.137355789, "first_response_s": 7.844199228915386, "answer_total_s": 7.882616499904543, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 418, "content_group": "0001738f053a0c82224009162f4a35384ad1263e7e4b924a0e70c4cebc274a96", "question": {"question_id": "sample_418_a114_q0", "video_id": 418, "video_path": "./videos/sample_418_real.mp4", "annotation_index": 114, "question_index": 0, "question": "What color is the hat the man is wearing right now?", "options": ["A. White.", "B. Blue.", "C. Gray.", "D. Black."], "answer": "C", "time_stamp_s": 2, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_418_a114_q0", "video_id": 418, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "B. Blue.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "e2a5895e42407194ed98520ad88d3c21d7ac63b78a9f86187d2e691ed32f5641", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001], "recent_frames_sha256": "62410be1975c8fba4db8aa67451d531be4e49c754a1072e184fa8fa839948bbc", "num_recent_frames": 2, "tq": 716576.310015826, "t1": 716586.68211963, "ta": 716586.68211963, "te": 716586.827974182, "first_response_s": 10.372103804023936, "answer_total_s": 10.517958355951123, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_418_a114_q0", "video_id": 418, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "B. Blue.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "9349e457cb8e7dfdfc2d481d729715bae450fb3617470b91299e3d38a787a268", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001], "recent_frames_sha256": "62410be1975c8fba4db8aa67451d531be4e49c754a1072e184fa8fa839948bbc", "num_recent_frames": 2, "tq": 716624.823990503, "t1": 716625.504516169, "ta": 716625.504516169, "te": 716625.66037371, "first_response_s": 0.6805256659863517, "answer_total_s": 0.8363832070026547, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 418, "content_group": "0001738f053a0c82224009162f4a35384ad1263e7e4b924a0e70c4cebc274a96", "question": {"question_id": "sample_418_a115_q0", "video_id": 418, "video_path": "./videos/sample_418_real.mp4", "annotation_index": 115, "question_index": 0, "question": "What is the primary color of the navigation panel right now?", "options": ["A. Yellow.", "B. Black.", "C. Blue.", "D. White."], "answer": "B", "time_stamp_s": 147, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [139, 159], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_418_a115_q0", "video_id": 418, "time_stamp_s": 147, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2ba29af4c209fda472befb4ac09e55037b7a9fe9ae9c72b53f041e77562e58a0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332], "recent_frames_sha256": "5b7dd9bb7d6b66ed5daa4ea995051d966123ead3095dafb875a5468b0cfabe38", "num_recent_frames": 30, "tq": 716586.836312167, "t1": 716597.856103232, "ta": 716597.856103232, "te": 716597.89324848, "first_response_s": 11.019791065016761, "answer_total_s": 11.056936313048936, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_418_a115_q0", "video_id": 418, "time_stamp_s": 147, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "786803e2920d17cbb5d1f8707692941c37bc080816cabbd76e6b330f60e0045a", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Man in cap and sunglasses prepares glider on grassy field, then boards aircraft.  \n- Glider takes off, revealing expansive landscape below with clouds and distant structures.  \n- Pilot views terrain from cockpit, including rocky cliffs and valleys, as aircraft ascends.\n[30-60s] - Pilot's hands manipulate controls in a glider cockpit, with a digital display showing flight data.  \n- Exterior view reveals a vast landscape of fields and distant mountains under partly cloudy skies.  \n- A glider is seen on the ground, stationary on a grassy field, with another glider visible in the background.\n[60-90s] - A hand opens a red-framed glass door, revealing a store interior with shelves of produce.  \n- A bicycle with a basket is parked outside, and a plastic bag is being placed into the basket.  \n- The scene transitions to a map showing routes between locations like Weyritz, Kiel, and Donauwoerth, with labeled distances.\n[90-120s] - Pilot's hands adjust controls while seated in a glider cockpit, with a digital display and analog gauges visible.  \n- The glider flies over a vast, patchwork landscape of fields and water bodies under a partly cloudy sky.  \n- A distant white glider is seen flying parallel to the camera’s glider, maintaining a consistent altitude.", "history_tokens": 295, "history_utf8_bytes": 1278, "recent_frame_times_s": [117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332], "recent_frames_sha256": "5b7dd9bb7d6b66ed5daa4ea995051d966123ead3095dafb875a5468b0cfabe38", "num_recent_frames": 30, "tq": 716656.351280115, "t1": 716658.141491031, "ta": 716658.141491031, "te": 716658.180025861, "first_response_s": 1.7902109160786495, "answer_total_s": 1.8287457460537553, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 418, "content_group": "0001738f053a0c82224009162f4a35384ad1263e7e4b924a0e70c4cebc274a96", "question": {"question_id": "sample_418_a116_q0", "video_id": 418, "video_path": "./videos/sample_418_real.mp4", "annotation_index": 116, "question_index": 0, "question": "What is the general shape of the fields visible right now?", "options": ["A. Circular.", "B. Triangular.", "C. Rectangular.", "D. Irregular."], "answer": "C", "time_stamp_s": 282, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [278, 298], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_418_a116_q0", "video_id": 418, "time_stamp_s": 282, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8dcb73827032cfda8e8e39818b4956328345427f912db035ec51973c6f1250af", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667], "recent_frames_sha256": "42fa9e84c8553c551adfe6bbc71bb33821df0c2d8ef2fc482ccf77dec142d9ca", "num_recent_frames": 30, "tq": 716597.899747906, "t1": 716608.840181675, "ta": 716608.840181675, "te": 716608.876519293, "first_response_s": 10.940433769021183, "answer_total_s": 10.976771386922337, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_418_a116_q0", "video_id": 418, "time_stamp_s": 282, "ground_truth": "C", "raw_output": "C. Rectangular.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "2aa7de19c2a4d52f14fe6e685fa79e3c4d6831c46f69b613aa872fcc2e59e4c7", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Man in cap and sunglasses prepares glider on grassy field, then boards aircraft.  \n- Glider takes off, revealing expansive landscape below with clouds and distant structures.  \n- Pilot views terrain from cockpit, including rocky cliffs and valleys, as aircraft ascends.\n[30-60s] - Pilot's hands manipulate controls in a glider cockpit, with a digital display showing flight data.  \n- Exterior view reveals a vast landscape of fields and distant mountains under partly cloudy skies.  \n- A glider is seen on the ground, stationary on a grassy field, with another glider visible in the background.\n[60-90s] - A hand opens a red-framed glass door, revealing a store interior with shelves of produce.  \n- A bicycle with a basket is parked outside, and a plastic bag is being placed into the basket.  \n- The scene transitions to a map showing routes between locations like Weyritz, Kiel, and Donauwoerth, with labeled distances.\n[90-120s] - Pilot's hands adjust controls while seated in a glider cockpit, with a digital display and analog gauges visible.  \n- The glider flies over a vast, patchwork landscape of fields and water bodies under a partly cloudy sky.  \n- A distant white glider is seen flying parallel to the camera’s glider, maintaining a consistent altitude.\n[120-150s] - Pilot in cockpit, wearing cap and sunglasses, smiles while flying.\n- Aircraft's wing and cockpit controls visible, with landscape below.\n- Clouds and terrain shift as plane moves, indicating flight progression.\n[150-180s] - Pilot’s hand grips control stick, adjusting flight path over varied terrain.  \n- Wingtip visible on right, casting shadow over green fields and towns below.  \n- Cloud cover shifts, revealing more of the landscape as aircraft descends.\n[180-210s] - A flight tracking interface displays a map with a flight path from Reykjavik to Stockholm, showing altitude and speed data.  \n- The interface includes a graph plotting altitude changes over time, with a blue line indicating flight altitude.  \n- A list of flight details, including departure and arrival times, is visible on the left side of the screen.\n[210-240s] - A flight tracking interface displays route details, including a map with a marked path from Stockholm to Göteborg, and a graph showing altitude changes over time.\n- A pilot's cockpit view shows a GPS screen with a map, where a finger interacts with the screen, likely adjusting or selecting a route.\n- The screen transitions to display weather patterns, including wind and pressure systems, overlaid on the map, indicating real-time flight conditions.\n[240-270s] - Pilot's hand points to a GPS map display showing flight path over terrain.  \n- Camera shifts to cockpit view, revealing pilot's legs and controls with a view of clouds and landscape below.  \n- Map display updates to show a red flight path with waypoints, including \"Munich\" and \"Bavaria\" labels.", "history_tokens": 659, "history_utf8_bytes": 2893, "recent_frame_times_s": [252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667], "recent_frames_sha256": "42fa9e84c8553c551adfe6bbc71bb33821df0c2d8ef2fc482ccf77dec142d9ca", "num_recent_frames": 30, "tq": 716696.148863524, "t1": 716703.57536613, "ta": 716703.57536613, "te": 716703.764062667, "first_response_s": 7.426502606016584, "answer_total_s": 7.615199143067002, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 418, "content_group": "0001738f053a0c82224009162f4a35384ad1263e7e4b924a0e70c4cebc274a96", "question": {"question_id": "sample_418_a117_q0", "video_id": 418, "video_path": "./videos/sample_418_real.mp4", "annotation_index": 117, "question_index": 0, "question": "What type of vehicles are visible right now?", "options": ["A. Cars.", "B. Bicycles.", "C. Gliders.", "D. Trains."], "answer": "C", "time_stamp_s": 426, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [417, 437], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_418_a117_q0", "video_id": 418, "time_stamp_s": 426, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ccf8bee80beb02e4a1782c0da17fab22b96c6a1e86b9f2952ded8fbedb871844", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [396.0289666666667, 397.02996666666667, 398.03096666666664, 399.0319666666667, 400.03296666666665, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246], "recent_frames_sha256": "37c8c8006bee091ef20a3795942b12f40e8113690529ad22b0bb2a4ff6c9f041", "num_recent_frames": 30, "tq": 716608.883141759, "t1": 716616.336737922, "ta": 716616.336737922, "te": 716616.373622434, "first_response_s": 7.453596163075417, "answer_total_s": 7.490480675012805, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_418_a117_q0", "video_id": 418, "time_stamp_s": 426, "ground_truth": "C", "raw_output": "C. Gliders.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "c115fc5b623fbf2db04cef15cdf74aaa2a14f13d9814fcc44e3047e6fb3772f3", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Man in cap and sunglasses prepares glider on grassy field, then boards aircraft.  \n- Glider takes off, revealing expansive landscape below with clouds and distant structures.  \n- Pilot views terrain from cockpit, including rocky cliffs and valleys, as aircraft ascends.\n[30-60s] - Pilot's hands manipulate controls in a glider cockpit, with a digital display showing flight data.  \n- Exterior view reveals a vast landscape of fields and distant mountains under partly cloudy skies.  \n- A glider is seen on the ground, stationary on a grassy field, with another glider visible in the background.\n[60-90s] - A hand opens a red-framed glass door, revealing a store interior with shelves of produce.  \n- A bicycle with a basket is parked outside, and a plastic bag is being placed into the basket.  \n- The scene transitions to a map showing routes between locations like Weyritz, Kiel, and Donauwoerth, with labeled distances.\n[90-120s] - Pilot's hands adjust controls while seated in a glider cockpit, with a digital display and analog gauges visible.  \n- The glider flies over a vast, patchwork landscape of fields and water bodies under a partly cloudy sky.  \n- A distant white glider is seen flying parallel to the camera’s glider, maintaining a consistent altitude.\n[120-150s] - Pilot in cockpit, wearing cap and sunglasses, smiles while flying.\n- Aircraft's wing and cockpit controls visible, with landscape below.\n- Clouds and terrain shift as plane moves, indicating flight progression.\n[150-180s] - Pilot’s hand grips control stick, adjusting flight path over varied terrain.  \n- Wingtip visible on right, casting shadow over green fields and towns below.  \n- Cloud cover shifts, revealing more of the landscape as aircraft descends.\n[180-210s] - A flight tracking interface displays a map with a flight path from Reykjavik to Stockholm, showing altitude and speed data.  \n- The interface includes a graph plotting altitude changes over time, with a blue line indicating flight altitude.  \n- A list of flight details, including departure and arrival times, is visible on the left side of the screen.\n[210-240s] - A flight tracking interface displays route details, including a map with a marked path from Stockholm to Göteborg, and a graph showing altitude changes over time.\n- A pilot's cockpit view shows a GPS screen with a map, where a finger interacts with the screen, likely adjusting or selecting a route.\n- The screen transitions to display weather patterns, including wind and pressure systems, overlaid on the map, indicating real-time flight conditions.\n[240-270s] - Pilot's hand points to a GPS map display showing flight path over terrain.  \n- Camera shifts to cockpit view, revealing pilot's legs and controls with a view of clouds and landscape below.  \n- Map display updates to show a red flight path with waypoints, including \"Munich\" and \"Bavaria\" labels.\n[270-300s] - Wingtip visible on right side of frame, extending diagonally across aerial view.  \n- Ground below shows patchwork farmland, roads, and a distinct circular water body near a cluster of buildings.  \n- Red arrow points to a specific area near the water body, indicating a target or point of interest.\n[300-330s] - Pilot’s hands grip controls, with a blue water bottle visible on the left side.  \n- The aircraft’s cockpit displays multiple gauges and a digital screen, showing flight data.  \n- The view outside reveals a vast landscape of green hills, forests, and distant mountains under a partly cloudy sky.\n[330-360s] - Pilot’s hands are visible on controls, with a blue object in left hand, suggesting active flight management.\n- Aircraft’s wing and cockpit frame are prominent, with clear view of green fields and distant hills below.\n- Sunlight creates glare on cockpit glass, slightly obscuring view of instruments and landscape.\n[360-390s] - Pilot’s hands adjust controls as glider descends toward runway.  \n- Sun glare intensifies, casting bright reflections across cockpit.  \n- Glider’s nose lowers as it approaches paved runway edge.\n[390-420s] - A man in a grey shirt and sunglasses holds a dark bottle while standing beside a glider on a runway.  \n- Another man in a dark shirt hands him the bottle, then gestures toward the glider’s cockpit.  \n- The glider’s transparent canopy is open, revealing the interior, with a clear view of the runway and grassy field beyond.", "history_tokens": 1008, "history_utf8_bytes": 4400, "recent_frame_times_s": [396.0289666666667, 397.02996666666667, 398.03096666666664, 399.0319666666667, 400.03296666666665, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246], "recent_frames_sha256": "37c8c8006bee091ef20a3795942b12f40e8113690529ad22b0bb2a4ff6c9f041", "num_recent_frames": 30, "tq": 716735.289412243, "t1": 716741.286306708, "ta": 716741.286306708, "te": 716741.47254456, "first_response_s": 5.996894465060905, "answer_total_s": 6.183132317033596, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 418, "content_group": "0001738f053a0c82224009162f4a35384ad1263e7e4b924a0e70c4cebc274a96", "question": {"question_id": "sample_418_a118_q0", "video_id": 418, "video_path": "./videos/sample_418_real.mp4", "annotation_index": 118, "question_index": 0, "question": "What is the predominant color of the mountains visible right now?", "options": ["A. Brown.", "B. Green.", "C. Gray.", "D. White."], "answer": "B", "time_stamp_s": 560, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [556, 576], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_418_a118_q0", "video_id": 418, "time_stamp_s": 560, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cf57eb706c9a5ed2717ebfcfe8256046e4cf4d3c5a8fb573f20c5edab5d0be39", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333, 554.0201333333333, 555.0211333333333, 556.0221333333334, 557.0231333333334, 558.0241333333333, 559.0251333333333], "recent_frames_sha256": "871cc6ff076f7a28eb1b89a2db15e145ee30cef69c083489d14ec79635201b23", "num_recent_frames": 30, "tq": 716616.381931297, "t1": 716624.777529607, "ta": 716624.777529607, "te": 716624.815778621, "first_response_s": 8.395598309929483, "answer_total_s": 8.433847323991358, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_418_a118_q0", "video_id": 418, "time_stamp_s": 560, "ground_truth": "B", "raw_output": "B. Green.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "8e907777f08c08aa8098448f2fedac85b66fd791319669c7673b4cb77536e5de", "condition_order": ["recent", "notes"], "memory": "[120-150s] - Pilot in cockpit, wearing cap and sunglasses, smiles while flying.\n- Aircraft's wing and cockpit controls visible, with landscape below.\n- Clouds and terrain shift as plane moves, indicating flight progression.\n[150-180s] - Pilot’s hand grips control stick, adjusting flight path over varied terrain.  \n- Wingtip visible on right, casting shadow over green fields and towns below.  \n- Cloud cover shifts, revealing more of the landscape as aircraft descends.\n[180-210s] - A flight tracking interface displays a map with a flight path from Reykjavik to Stockholm, showing altitude and speed data.  \n- The interface includes a graph plotting altitude changes over time, with a blue line indicating flight altitude.  \n- A list of flight details, including departure and arrival times, is visible on the left side of the screen.\n[210-240s] - A flight tracking interface displays route details, including a map with a marked path from Stockholm to Göteborg, and a graph showing altitude changes over time.\n- A pilot's cockpit view shows a GPS screen with a map, where a finger interacts with the screen, likely adjusting or selecting a route.\n- The screen transitions to display weather patterns, including wind and pressure systems, overlaid on the map, indicating real-time flight conditions.\n[240-270s] - Pilot's hand points to a GPS map display showing flight path over terrain.  \n- Camera shifts to cockpit view, revealing pilot's legs and controls with a view of clouds and landscape below.  \n- Map display updates to show a red flight path with waypoints, including \"Munich\" and \"Bavaria\" labels.\n[270-300s] - Wingtip visible on right side of frame, extending diagonally across aerial view.  \n- Ground below shows patchwork farmland, roads, and a distinct circular water body near a cluster of buildings.  \n- Red arrow points to a specific area near the water body, indicating a target or point of interest.\n[300-330s] - Pilot’s hands grip controls, with a blue water bottle visible on the left side.  \n- The aircraft’s cockpit displays multiple gauges and a digital screen, showing flight data.  \n- The view outside reveals a vast landscape of green hills, forests, and distant mountains under a partly cloudy sky.\n[330-360s] - Pilot’s hands are visible on controls, with a blue object in left hand, suggesting active flight management.\n- Aircraft’s wing and cockpit frame are prominent, with clear view of green fields and distant hills below.\n- Sunlight creates glare on cockpit glass, slightly obscuring view of instruments and landscape.\n[360-390s] - Pilot’s hands adjust controls as glider descends toward runway.  \n- Sun glare intensifies, casting bright reflections across cockpit.  \n- Glider’s nose lowers as it approaches paved runway edge.\n[390-420s] - A man in a grey shirt and sunglasses holds a dark bottle while standing beside a glider on a runway.  \n- Another man in a dark shirt hands him the bottle, then gestures toward the glider’s cockpit.  \n- The glider’s transparent canopy is open, revealing the interior, with a clear view of the runway and grassy field beyond.\n[420-450s] - Pilot in cockpit smiles and gestures toward camera while seated in glider.  \n- Glider’s transparent canopy is open, revealing interior controls and seat.  \n- Pilot’s hands are on controls, preparing for takeoff on runway.\n[450-480s] - Pilot's hands adjust controls as aircraft accelerates down runway.  \n- Instrument panel displays steady readings, indicating stable flight parameters.  \n- Clear sky with scattered clouds visible through cockpit windshield.\n[480-510s] - Pilot’s hands adjust controls while seated in a glider cockpit, with a blue water bottle visible on the left side.  \n- The glider’s instrument panel displays flight data, including an altimeter and attitude indicator, as the aircraft glides over green fields and distant hills.  \n- The sky is bright with scattered clouds, and the horizon reveals a mix of forested areas and open farmland beneath the aircraft.\n[510-540s] - Pilot's hands manipulate controls, with left hand near blue object and right hand on joystick.  \n- Aircraft's cockpit displays instruments, including a digital screen and analog gauges, with a clear view of the sky and terrain.  \n- Landscape below transitions from green fields to forested mountains, with clouds drifting overhead.", "history_tokens": 987, "history_utf8_bytes": 4369, "recent_frame_times_s": [530.0295, 531.0305, 532.0315, 533.0325, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.0171333333333, 552.0181333333334, 553.0191333333333, 554.0201333333333, 555.0211333333333, 556.0221333333334, 557.0231333333334, 558.0241333333333, 559.0251333333333], "recent_frames_sha256": "871cc6ff076f7a28eb1b89a2db15e145ee30cef69c083489d14ec79635201b23", "num_recent_frames": 30, "tq": 716780.822534338, "t1": 716787.648257342, "ta": 716787.648257342, "te": 716787.844569263, "first_response_s": 6.825723004061729, "answer_total_s": 7.022034925059415, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 419, "content_group": "c838fbb62c5ea0648fcefdf0471593788bcef56155cda0e8f804a684db9968d8", "question": {"question_id": "sample_419_a91_q0", "video_id": 419, "video_path": "./videos/sample_419_real.mp4", "annotation_index": 91, "question_index": 0, "question": "What object is visible on the left side of the cockpit?", "options": ["A. A blue handler.", "B. A red first aid kit.", "C. A yellow flashlight.", "D. A green map."], "answer": "A", "time_stamp_s": 9, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_419_a91_q0", "video_id": 419, "time_stamp_s": 9, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "660ca7c42a6091701db023ef32e16ed5e588ffcd5af8a0b78d47fd400f2895f7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.044, 1.0116333333333334, 2.0126333333333335, 3.0136333333333334, 4.014633333333333, 5.015633333333334, 6.016633333333333, 7.017633333333333, 8.018633333333334], "recent_frames_sha256": "6f6d0d5574e7fb0787ec983e9c6b2a718b925892b81a4afbac7b5ca27d13eb43", "num_recent_frames": 9, "tq": 715738.271541689, "t1": 715745.29033752, "ta": 715745.29033752, "te": 715745.437517745, "first_response_s": 7.018795830896124, "answer_total_s": 7.165976055897772, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_419_a91_q0", "video_id": 419, "time_stamp_s": 9, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "62a25512e806f96c32fcfef2649307f42844a7e97d36ad7c5354483739576463", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.044, 1.0116333333333334, 2.0126333333333335, 3.0136333333333334, 4.014633333333333, 5.015633333333334, 6.016633333333333, 7.017633333333333, 8.018633333333334], "recent_frames_sha256": "6f6d0d5574e7fb0787ec983e9c6b2a718b925892b81a4afbac7b5ca27d13eb43", "num_recent_frames": 9, "tq": 715539.944251021, "t1": 715540.402417391, "ta": 715540.402417391, "te": 715540.55534945, "first_response_s": 0.45816636993549764, "answer_total_s": 0.6110984289553016, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 419, "content_group": "c838fbb62c5ea0648fcefdf0471593788bcef56155cda0e8f804a684db9968d8", "question": {"question_id": "sample_419_a92_q0", "video_id": 419, "video_path": "./videos/sample_419_real.mp4", "annotation_index": 92, "question_index": 0, "question": "What is the dominant color of the pants the person is wearing right now?", "options": ["A. Beige.", "B. Blue.", "C. Black.", "D. Gray."], "answer": "A", "time_stamp_s": 158, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [145, 165], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_419_a92_q0", "video_id": 419, "time_stamp_s": 158, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "04f9156bcf7c69e31bad52de9eadb591f1cd3272b64c906bf9ea69d10b779aff", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [128.00516666666667, 129.00616666666667, 130.00716666666668, 131.00816666666665, 132.00916666666666, 133.01016666666666, 134.01116666666667, 135.01216666666667, 136.01316666666668, 137.01416666666665, 138.01516666666666, 139.01616666666666, 140.01716666666667, 141.01816666666667, 142.01916666666668, 143.02016666666665, 144.02116666666666, 145.02216666666666, 146.02316666666667, 147.02416666666667, 148.02516666666668, 149.02616666666665, 150.02716666666666, 151.02816666666666, 152.02916666666667, 153.03016666666667, 154.03116666666668, 155.03216666666665, 156.03316666666666, 157.0008], "recent_frames_sha256": "60c56fd730ce8e0a20250ab4a44a014b83b0a18ee06c27177703260ad97c0a7a", "num_recent_frames": 30, "tq": 715745.460958622, "t1": 715753.04296662, "ta": 715753.04296662, "te": 715753.080506796, "first_response_s": 7.58200799790211, "answer_total_s": 7.619548173970543, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_419_a92_q0", "video_id": 419, "time_stamp_s": 158, "ground_truth": "A", "raw_output": "A. Beige.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "23368fbc57314e2027bd9042880aedbd667471e210508e8e61c1cf5059c0f1ae", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pilot's hands manipulate controls in a glider cockpit, with a digital display showing flight data.  \n- The glider soars over rugged, rocky mountain terrain, with patches of green vegetation and distant snow-capped peaks.  \n- Clouds drift overhead, casting dynamic shadows across the landscape as the glider maintains a steady, forward trajectory.\n[30-60s] - Pilot’s legs and hands visible in glider cockpit, holding controls with blue object in left hand.\n- Glider flies along steep, rocky mountain ridge with expansive valley and distant snow-capped peaks below.\n- Cloud cover shifts, revealing patches of blue sky and changing light over the mountainous terrain.\n[60-90s] - Pilot's hands grip controls, with a blue joystick and instrument panel visible.  \n- Wingtip extends into frame, showing white wing against rocky terrain.  \n- Landscape below transitions from mountainous to green valleys with scattered buildings.\n[90-120s] - Pilot's hands grip controls with a blue stick and black joystick, seated in a glider cockpit.  \n- Dashboard displays multiple gauges and a digital screen showing flight data.  \n- Landscape below features green hills, a river, and scattered towns under a partly cloudy sky.\n[120-150s] - Pilot's hands grip controls, with left hand on blue joystick and right on throttle.  \n- Cockpit displays show flight instruments and a map, with a digital clock visible.  \n- Mountainous terrain and a valley with a road are visible through the windshield.", "history_tokens": 328, "history_utf8_bytes": 1486, "recent_frame_times_s": [128.00516666666667, 129.00616666666667, 130.00716666666668, 131.00816666666665, 132.00916666666666, 133.01016666666666, 134.01116666666667, 135.01216666666667, 136.01316666666668, 137.01416666666665, 138.01516666666666, 139.01616666666666, 140.01716666666667, 141.01816666666667, 142.01916666666668, 143.02016666666665, 144.02116666666666, 145.02216666666666, 146.02316666666667, 147.02416666666667, 148.02516666666668, 149.02616666666665, 150.02716666666666, 151.02816666666666, 152.02916666666667, 153.03016666666667, 154.03116666666668, 155.03216666666665, 156.03316666666666, 157.0008], "recent_frames_sha256": "60c56fd730ce8e0a20250ab4a44a014b83b0a18ee06c27177703260ad97c0a7a", "num_recent_frames": 30, "tq": 715575.062853132, "t1": 715581.921869431, "ta": 715581.921869431, "te": 715582.117701872, "first_response_s": 6.859016299014911, "answer_total_s": 7.0548487399937585, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 419, "content_group": "c838fbb62c5ea0648fcefdf0471593788bcef56155cda0e8f804a684db9968d8", "question": {"question_id": "sample_419_a93_q0", "video_id": 419, "video_path": "./videos/sample_419_real.mp4", "annotation_index": 93, "question_index": 0, "question": "Which way is the plane turning now?", "options": ["A. Left.", "B. Right.", "C. Up.", "D. Down."], "answer": "C", "time_stamp_s": 312, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [290, 310], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_419_a93_q0", "video_id": 419, "time_stamp_s": 312, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "562e7df882760db311bf18aaf5c850b43e3b140aaece5abcae3cea7e6b5c1ac3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [282.0257, 283.0267, 284.0277, 285.0287, 286.0297, 287.0307, 288.0317, 289.0327, 290.00033333333334, 291.0013333333333, 292.00233333333335, 293.00333333333333, 294.0043333333333, 295.00533333333334, 296.0063333333333, 297.00733333333335, 298.0083333333333, 299.00933333333336, 300.01033333333334, 301.0113333333333, 302.01233333333334, 303.0133333333333, 304.01433333333335, 305.01533333333333, 306.0163333333333, 307.01733333333334, 308.0183333333333, 309.01933333333335, 310.0203333333333, 311.02133333333336], "recent_frames_sha256": "c09d2a2e2673301930f08e2747c475fac20c83a9a6ceab905ede972a06cbe5e0", "num_recent_frames": 30, "tq": 715753.09283811, "t1": 715766.972670728, "ta": 715766.972670728, "te": 715767.010104876, "first_response_s": 13.879832617938519, "answer_total_s": 13.91726676595863, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_419_a93_q0", "video_id": 419, "time_stamp_s": 312, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "934d199306412b7a96fe0efec15d585f0645fdf50b19b784e5df6a91c08832d6", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pilot's hands manipulate controls in a glider cockpit, with a digital display showing flight data.  \n- The glider soars over rugged, rocky mountain terrain, with patches of green vegetation and distant snow-capped peaks.  \n- Clouds drift overhead, casting dynamic shadows across the landscape as the glider maintains a steady, forward trajectory.\n[30-60s] - Pilot’s legs and hands visible in glider cockpit, holding controls with blue object in left hand.\n- Glider flies along steep, rocky mountain ridge with expansive valley and distant snow-capped peaks below.\n- Cloud cover shifts, revealing patches of blue sky and changing light over the mountainous terrain.\n[60-90s] - Pilot's hands grip controls, with a blue joystick and instrument panel visible.  \n- Wingtip extends into frame, showing white wing against rocky terrain.  \n- Landscape below transitions from mountainous to green valleys with scattered buildings.\n[90-120s] - Pilot's hands grip controls with a blue stick and black joystick, seated in a glider cockpit.  \n- Dashboard displays multiple gauges and a digital screen showing flight data.  \n- Landscape below features green hills, a river, and scattered towns under a partly cloudy sky.\n[120-150s] - Pilot's hands grip controls, with left hand on blue joystick and right on throttle.  \n- Cockpit displays show flight instruments and a map, with a digital clock visible.  \n- Mountainous terrain and a valley with a road are visible through the windshield.\n[150-180s] - Pilot’s hands grip controls; left hand holds blue joystick, right hand on throttle.  \n- Cockpit displays show flight instruments and map; pilot’s legs are visible in beige pants.  \n- Landscape below features forested hills and a valley with a road; distant red vehicle visible.\n[180-210s] - Pilot's hands adjust controls while seated in glider cockpit, with left hand gripping blue stick and right hand manipulating joystick.  \n- Instrument panel displays flight data, including altimeter, attitude indicator, and digital readouts, with a map screen visible.  \n- Landscape below shows mountainous terrain with green valleys, roads, and a red-roofed building, viewed from high altitude.\n[210-240s] - Pilot's hand gestures toward the instrument panel while seated in a glider cockpit, with a map displayed on the screen.  \n- The glider's wing is visible on the left, flying over a landscape of green fields and a distant lake under a partly cloudy sky.  \n- The cockpit view shows the pilot’s legs and control stick, with a digital map and flight data overlay visible on the instrument panel.\n[240-270s] - Pilot's hands grip controls, with left hand on blue joystick and right hand near throttle.  \n- Instrument panel displays altitude, speed, and other flight metrics; digital screen shows navigation data.  \n- Aircraft glides over patchwork farmland and towns under partly cloudy sky, with terrain visible below.\n[270-300s] - Pilot's hands grip controls, with left hand on blue joystick and right hand near throttle.  \n- Aircraft's cockpit displays multiple gauges and a digital screen, showing flight data.  \n- Landscape below features rolling green hills, patches of farmland, and a small town with visible buildings.", "history_tokens": 717, "history_utf8_bytes": 3224, "recent_frame_times_s": [282.0257, 283.0267, 284.0277, 285.0287, 286.0297, 287.0307, 288.0317, 289.0327, 290.00033333333334, 291.0013333333333, 292.00233333333335, 293.00333333333333, 294.0043333333333, 295.00533333333334, 296.0063333333333, 297.00733333333335, 298.0083333333333, 299.00933333333336, 300.01033333333334, 301.0113333333333, 302.01233333333334, 303.0133333333333, 304.01433333333335, 305.01533333333333, 306.0163333333333, 307.01733333333334, 308.0183333333333, 309.01933333333335, 310.0203333333333, 311.02133333333336], "recent_frames_sha256": "c09d2a2e2673301930f08e2747c475fac20c83a9a6ceab905ede972a06cbe5e0", "num_recent_frames": 30, "tq": 715623.009521928, "t1": 715624.806312965, "ta": 715624.806312965, "te": 715624.969616134, "first_response_s": 1.7967910369625315, "answer_total_s": 1.9600942059187219, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 419, "content_group": "c838fbb62c5ea0648fcefdf0471593788bcef56155cda0e8f804a684db9968d8", "question": {"question_id": "sample_419_a94_q0", "video_id": 419, "video_path": "./videos/sample_419_real.mp4", "annotation_index": 94, "question_index": 0, "question": "What object is visible in the lower-left corner of the cockpit right now?", "options": ["A. A blue handler.", "B. A red first aid kit.", "C. A yellow flashlight.", "D. A green map."], "answer": "A", "time_stamp_s": 453, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [435, 455], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_419_a94_q0", "video_id": 419, "time_stamp_s": 453, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bbc37ed1987aace92d931314a7ca4f5fe6675e4f7fe08edb25fb3ec6ade779ec", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [423.0332333333333, 424.00086666666664, 425.0018666666667, 426.00286666666665, 427.0038666666667, 428.00486666666666, 429.0058666666667, 430.00686666666667, 431.00786666666664, 432.0088666666667, 433.00986666666665, 434.0108666666667, 435.01186666666666, 436.01286666666664, 437.0138666666667, 438.01486666666665, 439.0158666666667, 440.01686666666666, 441.0178666666667, 442.01886666666667, 443.01986666666664, 444.0208666666667, 445.02186666666665, 446.0228666666667, 447.02386666666666, 448.02486666666664, 449.0258666666667, 450.02686666666665, 451.0278666666667, 452.02886666666666], "recent_frames_sha256": "350f6e5dcff4b60817c4aff9b4cf4a6cc815bd850a98defe7b29deae3d7a6b7f", "num_recent_frames": 30, "tq": 715767.017964218, "t1": 715779.333556684, "ta": 715779.333556684, "te": 715779.371204333, "first_response_s": 12.315592465922236, "answer_total_s": 12.353240114985965, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_419_a94_q0", "video_id": 419, "time_stamp_s": 453, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "87e372e2adf8a1248384cd575b64d29a99f8a8f9669c068287b0f58b232cbd16", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Pilot’s legs and hands visible in glider cockpit, holding controls with blue object in left hand.\n- Glider flies along steep, rocky mountain ridge with expansive valley and distant snow-capped peaks below.\n- Cloud cover shifts, revealing patches of blue sky and changing light over the mountainous terrain.\n[60-90s] - Pilot's hands grip controls, with a blue joystick and instrument panel visible.  \n- Wingtip extends into frame, showing white wing against rocky terrain.  \n- Landscape below transitions from mountainous to green valleys with scattered buildings.\n[90-120s] - Pilot's hands grip controls with a blue stick and black joystick, seated in a glider cockpit.  \n- Dashboard displays multiple gauges and a digital screen showing flight data.  \n- Landscape below features green hills, a river, and scattered towns under a partly cloudy sky.\n[120-150s] - Pilot's hands grip controls, with left hand on blue joystick and right on throttle.  \n- Cockpit displays show flight instruments and a map, with a digital clock visible.  \n- Mountainous terrain and a valley with a road are visible through the windshield.\n[150-180s] - Pilot’s hands grip controls; left hand holds blue joystick, right hand on throttle.  \n- Cockpit displays show flight instruments and map; pilot’s legs are visible in beige pants.  \n- Landscape below features forested hills and a valley with a road; distant red vehicle visible.\n[180-210s] - Pilot's hands adjust controls while seated in glider cockpit, with left hand gripping blue stick and right hand manipulating joystick.  \n- Instrument panel displays flight data, including altimeter, attitude indicator, and digital readouts, with a map screen visible.  \n- Landscape below shows mountainous terrain with green valleys, roads, and a red-roofed building, viewed from high altitude.\n[210-240s] - Pilot's hand gestures toward the instrument panel while seated in a glider cockpit, with a map displayed on the screen.  \n- The glider's wing is visible on the left, flying over a landscape of green fields and a distant lake under a partly cloudy sky.  \n- The cockpit view shows the pilot’s legs and control stick, with a digital map and flight data overlay visible on the instrument panel.\n[240-270s] - Pilot's hands grip controls, with left hand on blue joystick and right hand near throttle.  \n- Instrument panel displays altitude, speed, and other flight metrics; digital screen shows navigation data.  \n- Aircraft glides over patchwork farmland and towns under partly cloudy sky, with terrain visible below.\n[270-300s] - Pilot's hands grip controls, with left hand on blue joystick and right hand near throttle.  \n- Aircraft's cockpit displays multiple gauges and a digital screen, showing flight data.  \n- Landscape below features rolling green hills, patches of farmland, and a small town with visible buildings.\n[300-330s] - Pilot’s hands manipulate controls, with left hand on stick and right hand on throttle/lever.  \n- Instrument panel displays altitude, speed, and other flight metrics; a digital screen shows flight data.  \n- Landscape below includes green fields, roads, and a town, with a large hill or ridge visible to the right.\n[330-360s] - Pilot's right hand gestures toward distant terrain while seated in glider cockpit.  \n- Left hand rests near control stick; both hands show active engagement with flight controls.  \n- Instrument panel displays altitude, speed, and compass readings; view shows expansive landscape below.\n[360-390s] - Pilot's hands manipulate controls while seated in a glider cockpit, with a clear view of the sky and landscape below.\n- A digital flight map displays a route over a detailed terrain, showing altitude and weather data.\n- The glider's cockpit instruments, including a compass and altimeter, are visible, indicating flight status and navigation.\n[390-420s] - Pilot’s hand adjusts control stick while seated in cockpit, with instrument panel visible.  \n- Wide aerial view shows green valleys, roads, and distant towns below, with wingtip in frame.  \n- Pilot smiles and waves to camera, indicating awareness of recording, with clear sky and clouds above.\n[420-450s] - Aircraft wing visible on right, extending into frame, with wingtip showing slight motion.\n- Cockpit instruments display active navigation map with route markers and altitude readouts.\n- Landscape below features patchwork of green fields, forests, and clustered towns under clear sky.", "history_tokens": 990, "history_utf8_bytes": 4456, "recent_frame_times_s": [423.0332333333333, 424.00086666666664, 425.0018666666667, 426.00286666666665, 427.0038666666667, 428.00486666666666, 429.0058666666667, 430.00686666666667, 431.00786666666664, 432.0088666666667, 433.00986666666665, 434.0108666666667, 435.01186666666666, 436.01286666666664, 437.0138666666667, 438.01486666666665, 439.0158666666667, 440.01686666666666, 441.0178666666667, 442.01886666666667, 443.01986666666664, 444.0208666666667, 445.02186666666665, 446.0228666666667, 447.02386666666666, 448.02486666666664, 449.0258666666667, 450.02686666666665, 451.0278666666667, 452.02886666666666], "recent_frames_sha256": "350f6e5dcff4b60817c4aff9b4cf4a6cc815bd850a98defe7b29deae3d7a6b7f", "num_recent_frames": 30, "tq": 715696.616990715, "t1": 715699.318214045, "ta": 715699.318214045, "te": 715699.356721955, "first_response_s": 2.701223329990171, "answer_total_s": 2.739731239969842, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 419, "content_group": "c838fbb62c5ea0648fcefdf0471593788bcef56155cda0e8f804a684db9968d8", "question": {"question_id": "sample_419_a95_q0", "video_id": 419, "video_path": "./videos/sample_419_real.mp4", "annotation_index": 95, "question_index": 0, "question": "What is the current lighting condition as seen right now?", "options": ["A. Bright and sunny.", "B. Overcast.", "C. Dusk.", "D. Night."], "answer": "A", "time_stamp_s": 594, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [580, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_419_a95_q0", "video_id": 419, "time_stamp_s": 594, "ground_truth": "A", "raw_output": "A. Bright and sunny.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "ae8cf71aeb6ce1abbeb1071c04ecd72240ef1af833c3e63dff81b2b3cc5d339e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [564.0074, 565.0084, 566.0094, 567.0104, 568.0114, 569.0124, 570.0134, 571.0144, 572.0154, 573.0164, 574.0174, 575.0184, 576.0194, 577.0204, 578.0214, 579.0224, 580.0234, 581.0244, 582.0254, 583.0264, 584.0274, 585.0284, 586.0294, 587.0304, 588.0314, 589.0324, 590.0000333333334, 591.0010333333333, 592.0020333333333, 593.0030333333333], "recent_frames_sha256": "da8a6b7d9f8375df77448277ddc1507865eaca2861d3b338d1c88a39b44f8f61", "num_recent_frames": 30, "tq": 715779.379578213, "t1": 715786.569495165, "ta": 715786.569495165, "te": 715786.792541095, "first_response_s": 7.189916952047497, "answer_total_s": 7.412962882081047, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_419_a95_q0", "video_id": 419, "time_stamp_s": 594, "ground_truth": "A", "raw_output": "A. Bright and sunny.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "b406f18244e6d77b383a4a6de4c4b9dc30efe81baeda7cdc7b936bb692df0989", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Pilot’s hands grip controls; left hand holds blue joystick, right hand on throttle.  \n- Cockpit displays show flight instruments and map; pilot’s legs are visible in beige pants.  \n- Landscape below features forested hills and a valley with a road; distant red vehicle visible.\n[180-210s] - Pilot's hands adjust controls while seated in glider cockpit, with left hand gripping blue stick and right hand manipulating joystick.  \n- Instrument panel displays flight data, including altimeter, attitude indicator, and digital readouts, with a map screen visible.  \n- Landscape below shows mountainous terrain with green valleys, roads, and a red-roofed building, viewed from high altitude.\n[210-240s] - Pilot's hand gestures toward the instrument panel while seated in a glider cockpit, with a map displayed on the screen.  \n- The glider's wing is visible on the left, flying over a landscape of green fields and a distant lake under a partly cloudy sky.  \n- The cockpit view shows the pilot’s legs and control stick, with a digital map and flight data overlay visible on the instrument panel.\n[240-270s] - Pilot's hands grip controls, with left hand on blue joystick and right hand near throttle.  \n- Instrument panel displays altitude, speed, and other flight metrics; digital screen shows navigation data.  \n- Aircraft glides over patchwork farmland and towns under partly cloudy sky, with terrain visible below.\n[270-300s] - Pilot's hands grip controls, with left hand on blue joystick and right hand near throttle.  \n- Aircraft's cockpit displays multiple gauges and a digital screen, showing flight data.  \n- Landscape below features rolling green hills, patches of farmland, and a small town with visible buildings.\n[300-330s] - Pilot’s hands manipulate controls, with left hand on stick and right hand on throttle/lever.  \n- Instrument panel displays altitude, speed, and other flight metrics; a digital screen shows flight data.  \n- Landscape below includes green fields, roads, and a town, with a large hill or ridge visible to the right.\n[330-360s] - Pilot's right hand gestures toward distant terrain while seated in glider cockpit.  \n- Left hand rests near control stick; both hands show active engagement with flight controls.  \n- Instrument panel displays altitude, speed, and compass readings; view shows expansive landscape below.\n[360-390s] - Pilot's hands manipulate controls while seated in a glider cockpit, with a clear view of the sky and landscape below.\n- A digital flight map displays a route over a detailed terrain, showing altitude and weather data.\n- The glider's cockpit instruments, including a compass and altimeter, are visible, indicating flight status and navigation.\n[390-420s] - Pilot’s hand adjusts control stick while seated in cockpit, with instrument panel visible.  \n- Wide aerial view shows green valleys, roads, and distant towns below, with wingtip in frame.  \n- Pilot smiles and waves to camera, indicating awareness of recording, with clear sky and clouds above.\n[420-450s] - Aircraft wing visible on right, extending into frame, with wingtip showing slight motion.\n- Cockpit instruments display active navigation map with route markers and altitude readouts.\n- Landscape below features patchwork of green fields, forests, and clustered towns under clear sky.\n[450-480s] - Pilot’s hands grip controls, with left hand near blue lever and right hand near throttle.  \n- Instrument panel displays multiple gauges, including altimeter, airspeed indicator, and attitude indicator.  \n- Landscape below features green fields, roads, and scattered buildings, viewed from high altitude.\n[480-510s] - Pilot's left hand grips a blue control stick, maintaining flight orientation.  \n- Dashboard displays show stable flight parameters, including altitude and speed.  \n- Landscape below features patchwork fields and distant urban areas under partly cloudy skies.\n[510-540s] - Pilot’s hand rests on control stick, occasionally adjusting it while flying.\n- Aircraft’s cockpit instruments display stable readings, including altimeter and speed indicators.\n- Landscape below transitions from open fields to forested areas as the plane banks slightly.\n[540-570s] - Pilot's hand grips blue control stick, maintaining steady flight path.  \n- Instrument panel displays altitude and speed, with GPS map showing route over fields.  \n- Landscape transitions from mountainous terrain to flat farmland with visible rivers and roads.", "history_tokens": 981, "history_utf8_bytes": 4478, "recent_frame_times_s": [564.0074, 565.0084, 566.0094, 567.0104, 568.0114, 569.0124, 570.0134, 571.0144, 572.0154, 573.0164, 574.0174, 575.0184, 576.0194, 577.0204, 578.0214, 579.0224, 580.0234, 581.0244, 582.0254, 583.0264, 584.0274, 585.0284, 586.0294, 587.0304, 588.0314, 589.0324, 590.0000333333334, 591.0010333333333, 592.0020333333333, 593.0030333333333], "recent_frames_sha256": "da8a6b7d9f8375df77448277ddc1507865eaca2861d3b338d1c88a39b44f8f61", "num_recent_frames": 30, "tq": 715730.218495497, "t1": 715738.032316579, "ta": 715738.032316579, "te": 715738.253855938, "first_response_s": 7.813821082003415, "answer_total_s": 8.035360440961085, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 420, "content_group": "fa1ddc02baefa977cd0726137921a80d19ca20e549728e187f03461432dad532", "question": {"question_id": "sample_420_a210_q0", "video_id": 420, "video_path": "./videos/sample_420_real.mp4", "annotation_index": 210, "question_index": 0, "question": "What object is pointing out the window right now?", "options": ["A. A pencil.", "B. A pen.", "C. A finger.", "D. A stick."], "answer": "C", "time_stamp_s": 10, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_420_a210_q0", "video_id": 420, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "268a36ebd1241e645c0da19c13157ae6fa2358ec5bf8bac3aa29bc42faab683d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "aa7999ab0872516a3085e73fcd5d2c48f714a54ffb7be6633afc23b3b8aab433", "num_recent_frames": 10, "tq": 717534.670897412, "t1": 717546.625712503, "ta": 717546.625712503, "te": 717546.663272158, "first_response_s": 11.954815090983175, "answer_total_s": 11.992374746012501, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_420_a210_q0", "video_id": 420, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "727a49ca9dcbb7e4bf9886c748dabd17822b6593ed0cbe8ac4b056757b6a90cc", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "aa7999ab0872516a3085e73fcd5d2c48f714a54ffb7be6633afc23b3b8aab433", "num_recent_frames": 10, "tq": 717594.246092114, "t1": 717594.680506551, "ta": 717594.680506551, "te": 717594.718332707, "first_response_s": 0.4344144370406866, "answer_total_s": 0.47224059293512255, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 420, "content_group": "fa1ddc02baefa977cd0726137921a80d19ca20e549728e187f03461432dad532", "question": {"question_id": "sample_420_a211_q0", "video_id": 420, "video_path": "./videos/sample_420_real.mp4", "annotation_index": 211, "question_index": 0, "question": "What is the weather condition right now?", "options": ["A. Clear skies.", "B. Heavy rain.", "C. Overcast with clouds.", "D. Snowing."], "answer": "C", "time_stamp_s": 129, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [123, 143], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_420_a211_q0", "video_id": 420, "time_stamp_s": 129, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "74fc654ca2f6797a92793200e6ecedd8edccdab39c8baa03cec4b0388d0d74e7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [99.03226666666667, 100.03326666666666, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279], "recent_frames_sha256": "15023ca2b14c7edf048366185ccb5ae6f8b178ec6be3f9a58ec3614f30a4d72f", "num_recent_frames": 30, "tq": 717546.674930017, "t1": 717557.923483822, "ta": 717557.923483822, "te": 717557.960909536, "first_response_s": 11.248553805053234, "answer_total_s": 11.28597951901611, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_420_a211_q0", "video_id": 420, "time_stamp_s": 129, "ground_truth": "C", "raw_output": "C. Overcast with clouds.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "89f0ff0c9a9ac4505de1f36e5c947e4026f6376894d5c0dba975d49f158d0c52", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pilot in cockpit, wearing sunglasses and cap, gestures with hand toward sky and controls.  \n- Aircraft flies over arid, cracked earth with scattered clouds above, showing wing and cockpit instruments.  \n- Sky transitions from partly cloudy to darker storm clouds, with pilot’s hand visible near control panel.\n[30-60s] - Pilot's hand gestures toward the instrument panel while flying over arid terrain.  \n- Cockpit view shows a digital map and various gauges, with the pilot’s hand pointing at a screen.  \n- Pilot, wearing sunglasses and a flight suit, smiles at the camera while seated in the cockpit.\n[60-90s] - Pilot's hand grips control stick, adjusting flight path through cloud layer.\n- Clouds stretch horizontally across sky, with sunlit horizon visible below.\n- Instrument panel displays active flight data, including altitude and navigation info.\n[90-120s] - Pilot's hand gestures toward the right, indicating a planned course change.\n- The aircraft's cockpit displays altitude and speed indicators, showing 3500 m AGL and 89km remaining to fly.\n- Dark storm clouds dominate the sky, with visible rain showers and potential for altitude gain during breaks.", "history_tokens": 261, "history_utf8_bytes": 1179, "recent_frame_times_s": [99.03226666666667, 100.03326666666666, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279], "recent_frames_sha256": "15023ca2b14c7edf048366185ccb5ae6f8b178ec6be3f9a58ec3614f30a4d72f", "num_recent_frames": 30, "tq": 717631.530732261, "t1": 717637.572581435, "ta": 717637.572581435, "te": 717637.83475515, "first_response_s": 6.041849173954688, "answer_total_s": 6.304022889002226, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 420, "content_group": "fa1ddc02baefa977cd0726137921a80d19ca20e549728e187f03461432dad532", "question": {"question_id": "sample_420_a212_q0", "video_id": 420, "video_path": "./videos/sample_420_real.mp4", "annotation_index": 212, "question_index": 0, "question": "What is the current speed of the wind?", "options": ["A. 20 kph.", "B. 25 kph.", "C. 30 kph.", "D. 35 kph."], "answer": "C", "time_stamp_s": 249, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [246, 266], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_420_a212_q0", "video_id": 420, "time_stamp_s": 249, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "948a941047962b388668d84fda9d6d733a5d34b07d10697eb061eead7645901f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333], "recent_frames_sha256": "938683574547af83292a59b1fbb9b1c0d832c2a93cdcdbaa590aeb27f80325ea", "num_recent_frames": 30, "tq": 717557.97245432, "t1": 717570.510993952, "ta": 717570.510993952, "te": 717570.550094969, "first_response_s": 12.538539631990716, "answer_total_s": 12.577640648931265, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_420_a212_q0", "video_id": 420, "time_stamp_s": 249, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "abecb272a1ff94a0ee1548fdd7e5e245905dfb7fe93baa8987f5bc91df8cc706", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pilot in cockpit, wearing sunglasses and cap, gestures with hand toward sky and controls.  \n- Aircraft flies over arid, cracked earth with scattered clouds above, showing wing and cockpit instruments.  \n- Sky transitions from partly cloudy to darker storm clouds, with pilot’s hand visible near control panel.\n[30-60s] - Pilot's hand gestures toward the instrument panel while flying over arid terrain.  \n- Cockpit view shows a digital map and various gauges, with the pilot’s hand pointing at a screen.  \n- Pilot, wearing sunglasses and a flight suit, smiles at the camera while seated in the cockpit.\n[60-90s] - Pilot's hand grips control stick, adjusting flight path through cloud layer.\n- Clouds stretch horizontally across sky, with sunlit horizon visible below.\n- Instrument panel displays active flight data, including altitude and navigation info.\n[90-120s] - Pilot's hand gestures toward the right, indicating a planned course change.\n- The aircraft's cockpit displays altitude and speed indicators, showing 3500 m AGL and 89km remaining to fly.\n- Dark storm clouds dominate the sky, with visible rain showers and potential for altitude gain during breaks.\n[120-150s] - Dark, dense clouds dominate the sky, with a visible arrow pointing toward Bitterwasser airfield.\n- Pilot’s hand is on the control stick, with instruments showing flight data.\n- Wingtip is visible against the cloudy backdrop, suggesting low-altitude flight.\n[150-180s] - Pilot’s hand rests on control stick, maintaining steady flight posture.\n- Wingtip glints under dim, diffused light as aircraft moves through overcast skies.\n- Ground below appears as a vast, flat expanse under low, heavy cloud cover.\n[180-210s] - Pilot’s hand holds camera, capturing stormy sky and terrain below.  \n- Aircraft’s wing and tail visible against dark, turbulent clouds.  \n- Dashboard displays show flight instruments, including speed and altitude indicators.\n[210-240s] - Pilot’s hand grips control stick, making minor adjustments while flying.\n- Clouds dominate the sky, with a visible horizon showing a warm glow near the ground.\n- Aircraft’s cockpit instruments display active flight data, including a digital map and altimeter.", "history_tokens": 500, "history_utf8_bytes": 2219, "recent_frame_times_s": [219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333], "recent_frames_sha256": "938683574547af83292a59b1fbb9b1c0d832c2a93cdcdbaa590aeb27f80325ea", "num_recent_frames": 30, "tq": 717674.034561754, "t1": 717675.83029602, "ta": 717675.83029602, "te": 717676.032081146, "first_response_s": 1.7957342660520226, "answer_total_s": 1.997519392054528, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 420, "content_group": "fa1ddc02baefa977cd0726137921a80d19ca20e549728e187f03461432dad532", "question": {"question_id": "sample_420_a213_q0", "video_id": 420, "video_path": "./videos/sample_420_real.mp4", "annotation_index": 213, "question_index": 0, "question": "What color is the horizon right now?", "options": ["A. Red.", "B. Yellow.", "C. Orange.", "D. Blue."], "answer": "C", "time_stamp_s": 382, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [369, 389], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_420_a213_q0", "video_id": 420, "time_stamp_s": 382, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8795af0aa3773a97f181d91ca5d2d5c78c68ec93acd8a1d0545f4b84ef350420", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665], "recent_frames_sha256": "4b9a4d26ecc36dcdeea10b9e38a69f218889eb5c5b22a9d31afa3dc43b15fde6", "num_recent_frames": 30, "tq": 717570.557324629, "t1": 717580.466196809, "ta": 717580.466196809, "te": 717580.504027666, "first_response_s": 9.908872179919854, "answer_total_s": 9.946703036897816, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_420_a213_q0", "video_id": 420, "time_stamp_s": 382, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6756dba128f7ba3b90431a0f5f18a7ede082aa61a160e2a7e2b8ea82a3edbaa9", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pilot in cockpit, wearing sunglasses and cap, gestures with hand toward sky and controls.  \n- Aircraft flies over arid, cracked earth with scattered clouds above, showing wing and cockpit instruments.  \n- Sky transitions from partly cloudy to darker storm clouds, with pilot’s hand visible near control panel.\n[30-60s] - Pilot's hand gestures toward the instrument panel while flying over arid terrain.  \n- Cockpit view shows a digital map and various gauges, with the pilot’s hand pointing at a screen.  \n- Pilot, wearing sunglasses and a flight suit, smiles at the camera while seated in the cockpit.\n[60-90s] - Pilot's hand grips control stick, adjusting flight path through cloud layer.\n- Clouds stretch horizontally across sky, with sunlit horizon visible below.\n- Instrument panel displays active flight data, including altitude and navigation info.\n[90-120s] - Pilot's hand gestures toward the right, indicating a planned course change.\n- The aircraft's cockpit displays altitude and speed indicators, showing 3500 m AGL and 89km remaining to fly.\n- Dark storm clouds dominate the sky, with visible rain showers and potential for altitude gain during breaks.\n[120-150s] - Dark, dense clouds dominate the sky, with a visible arrow pointing toward Bitterwasser airfield.\n- Pilot’s hand is on the control stick, with instruments showing flight data.\n- Wingtip is visible against the cloudy backdrop, suggesting low-altitude flight.\n[150-180s] - Pilot’s hand rests on control stick, maintaining steady flight posture.\n- Wingtip glints under dim, diffused light as aircraft moves through overcast skies.\n- Ground below appears as a vast, flat expanse under low, heavy cloud cover.\n[180-210s] - Pilot’s hand holds camera, capturing stormy sky and terrain below.  \n- Aircraft’s wing and tail visible against dark, turbulent clouds.  \n- Dashboard displays show flight instruments, including speed and altitude indicators.\n[210-240s] - Pilot’s hand grips control stick, making minor adjustments while flying.\n- Clouds dominate the sky, with a visible horizon showing a warm glow near the ground.\n- Aircraft’s cockpit instruments display active flight data, including a digital map and altimeter.\n[240-270s] - Pilot's hand grips control stick, adjusting flight path amid turbulent skies.\n- Dashboard displays active navigation map and flight instruments, indicating current altitude and speed.\n- Cloud cover dominates horizon, with visible atmospheric turbulence affecting flight stability.\n[270-300s] - Pilot's hand rests on the control stick, maintaining steady flight posture.\n- Dashboard displays show stable flight parameters with a \"C\" indicator illuminated.\n- Cloud cover above is dense and dark, contrasting with a faint golden glow near the horizon.\n[300-330s] - Pilot's hands are visible on controls, with left hand adjusting throttle or stick.  \n- Cockpit instruments display flight data, including a digital map with a 'C' marker.  \n- Clouds dominate the sky, with a visible horizon line and distant terrain below.\n[330-360s] - Pilot's hand gestures toward left side of cockpit, indicating alternate landing option.\n- Dashboard displays stable flight instruments with no significant changes.\n- Horizon shows orange sunset glow against darkening sky, with clouds moving across view.", "history_tokens": 733, "history_utf8_bytes": 3316, "recent_frame_times_s": [352.0183333333333, 353.01933333333335, 354.0203333333333, 355.02133333333336, 356.02233333333334, 357.0233333333333, 358.02433333333335, 359.0253333333333, 360.02633333333335, 361.02733333333333, 362.0283333333333, 363.02933333333334, 364.0303333333333, 365.03133333333335, 366.0323333333333, 367.03333333333336, 368.00096666666667, 369.00196666666665, 370.0029666666667, 371.00396666666666, 372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665], "recent_frames_sha256": "4b9a4d26ecc36dcdeea10b9e38a69f218889eb5c5b22a9d31afa3dc43b15fde6", "num_recent_frames": 30, "tq": 717705.355074811, "t1": 717706.905780366, "ta": 717706.905780366, "te": 717706.947604609, "first_response_s": 1.5507055550115183, "answer_total_s": 1.5925297979265451, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 420, "content_group": "fa1ddc02baefa977cd0726137921a80d19ca20e549728e187f03461432dad532", "question": {"question_id": "sample_420_a214_q0", "video_id": 420, "video_path": "./videos/sample_420_real.mp4", "annotation_index": 214, "question_index": 0, "question": "What color is the sky right now?", "options": ["A. Bright red.", "B. Dark grey.", "C. Clear with no clouds.", "D. Yellowish-orange."], "answer": "B", "time_stamp_s": 512, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [492, 512], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_420_a214_q0", "video_id": 420, "time_stamp_s": 512, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bbc6c90aa5d50532f38c6a8b7502f1bcb4e2c5dde8fe22771fc7208daa86eca4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667, 487.01986666666664, 488.0208666666667, 489.02186666666665, 490.0228666666667, 491.02386666666666, 492.02486666666664, 493.0258666666667, 494.02686666666665, 495.0278666666667, 496.02886666666666, 497.0298666666667, 498.03086666666667, 499.03186666666664, 500.0328666666667, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105], "recent_frames_sha256": "bbb2ec48cc9492c89470b37a39a3fbadbbbc56104c3301e9c6c5b26078126206", "num_recent_frames": 30, "tq": 717580.511582107, "t1": 717594.199924451, "ta": 717594.199924451, "te": 717594.238384544, "first_response_s": 13.688342343899421, "answer_total_s": 13.726802436984144, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_420_a214_q0", "video_id": 420, "time_stamp_s": 512, "ground_truth": "B", "raw_output": "B. Dark grey.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "f251be68a3edb788ccd96bd60875a6a7bb23ac8b63ab138c141dabd8842062c0", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Pilot's hand grips control stick, adjusting flight path through cloud layer.\n- Clouds stretch horizontally across sky, with sunlit horizon visible below.\n- Instrument panel displays active flight data, including altitude and navigation info.\n[90-120s] - Pilot's hand gestures toward the right, indicating a planned course change.\n- The aircraft's cockpit displays altitude and speed indicators, showing 3500 m AGL and 89km remaining to fly.\n- Dark storm clouds dominate the sky, with visible rain showers and potential for altitude gain during breaks.\n[120-150s] - Dark, dense clouds dominate the sky, with a visible arrow pointing toward Bitterwasser airfield.\n- Pilot’s hand is on the control stick, with instruments showing flight data.\n- Wingtip is visible against the cloudy backdrop, suggesting low-altitude flight.\n[150-180s] - Pilot’s hand rests on control stick, maintaining steady flight posture.\n- Wingtip glints under dim, diffused light as aircraft moves through overcast skies.\n- Ground below appears as a vast, flat expanse under low, heavy cloud cover.\n[180-210s] - Pilot’s hand holds camera, capturing stormy sky and terrain below.  \n- Aircraft’s wing and tail visible against dark, turbulent clouds.  \n- Dashboard displays show flight instruments, including speed and altitude indicators.\n[210-240s] - Pilot’s hand grips control stick, making minor adjustments while flying.\n- Clouds dominate the sky, with a visible horizon showing a warm glow near the ground.\n- Aircraft’s cockpit instruments display active flight data, including a digital map and altimeter.\n[240-270s] - Pilot's hand grips control stick, adjusting flight path amid turbulent skies.\n- Dashboard displays active navigation map and flight instruments, indicating current altitude and speed.\n- Cloud cover dominates horizon, with visible atmospheric turbulence affecting flight stability.\n[270-300s] - Pilot's hand rests on the control stick, maintaining steady flight posture.\n- Dashboard displays show stable flight parameters with a \"C\" indicator illuminated.\n- Cloud cover above is dense and dark, contrasting with a faint golden glow near the horizon.\n[300-330s] - Pilot's hands are visible on controls, with left hand adjusting throttle or stick.  \n- Cockpit instruments display flight data, including a digital map with a 'C' marker.  \n- Clouds dominate the sky, with a visible horizon line and distant terrain below.\n[330-360s] - Pilot's hand gestures toward left side of cockpit, indicating alternate landing option.\n- Dashboard displays stable flight instruments with no significant changes.\n- Horizon shows orange sunset glow against darkening sky, with clouds moving across view.\n[360-390s] - Pilot’s hand points to a navigation display showing a map with a red marker indicating a target or waypoint.  \n- The aircraft’s wing is visible on the left, extending outward against a backdrop of stormy clouds and a distant runway.  \n- The cockpit instruments, including a digital clock and altimeter, remain illuminated, with the horizon showing a mix of orange and gray skies.\n[390-420s] - Pilot, wearing a blue and yellow beanie and sunglasses, smiles and adjusts his hat while seated in the glider cockpit.  \n- The glider’s wing is visible on the right, extending outward against a backdrop of stormy clouds and a distant orange horizon.  \n- The cockpit’s instrument panel, including a digital display and analog gauges, remains illuminated as the aircraft flies over a vast, arid landscape.\n[420-450s] - Pilot adjusts sunglasses while seated in glider cockpit, looking toward camera.  \n- Cloudy sky with dramatic lighting visible through cockpit windshield.  \n- Pilot’s hands gesture near face, possibly adjusting equipment or signaling.\n[450-480s] - Pilot’s hands are on controls, with a digital display showing flight data.\n- The aircraft is flying low over a desert landscape with a visible runway.\n- A ground loop is occurring, indicated by the aircraft’s sideways movement and the pilot’s reaction.\n[480-510s] - Pilot’s hands are visible on controls, adjusting flight instruments during descent.  \n- The aircraft’s cockpit displays active navigation and flight data, with a digital map visible.  \n- Outside, the landscape transitions from dusk to night, with trees and open fields under a darkening sky.", "history_tokens": 960, "history_utf8_bytes": 4347, "recent_frame_times_s": [482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667, 487.01986666666664, 488.0208666666667, 489.02186666666665, 490.0228666666667, 491.02386666666666, 492.02486666666664, 493.0258666666667, 494.02686666666665, 495.0278666666667, 496.02886666666666, 497.0298666666667, 498.03086666666667, 499.03186666666664, 500.0328666666667, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105], "recent_frames_sha256": "bbb2ec48cc9492c89470b37a39a3fbadbbbc56104c3301e9c6c5b26078126206", "num_recent_frames": 30, "tq": 717743.839358479, "t1": 717750.788741721, "ta": 717750.788741721, "te": 717750.979019662, "first_response_s": 6.949383241939358, "answer_total_s": 7.13966118299868, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 421, "content_group": "92eda1f912b243cbb2fd73c1e9b0f8711685c26cb0a79de392671b1bc8e3cec2", "question": {"question_id": "sample_421_a71_q0", "video_id": 421, "video_path": "./videos/sample_421_real.mp4", "annotation_index": 71, "question_index": 0, "question": "What device is the person currently using to capture the video?", "options": ["A. Head-mounted camera.", "B. Smartphone.", "C. DSLR camera.", "D. Camcorder."], "answer": "A", "time_stamp_s": 1, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [0, 20], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_421_a71_q0", "video_id": 421, "time_stamp_s": 1, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f355f7bedf3a25417764e242e12b07aaf31c9d93320b4a3d2935e6038dbf7e2b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0], "recent_frames_sha256": "ffd5dc768eb00b3586a87a49ef5138aaed3fa84e23d8516841e2dec8c781bb05", "num_recent_frames": 2, "tq": 718882.403540076, "t1": 718893.996887749, "ta": 718893.996887749, "te": 718894.036648972, "first_response_s": 11.593347672955133, "answer_total_s": 11.633108895970508, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_421_a71_q0", "video_id": 421, "time_stamp_s": 1, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d74e1da6bcd04b9843bac5fb789e3277042396b3e5598015c2e90b31a90e682e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0], "recent_frames_sha256": "ffd5dc768eb00b3586a87a49ef5138aaed3fa84e23d8516841e2dec8c781bb05", "num_recent_frames": 2, "tq": 718722.540107348, "t1": 718735.420999038, "ta": 718735.420999038, "te": 718735.569425869, "first_response_s": 12.880891690030694, "answer_total_s": 13.02931852103211, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 421, "content_group": "92eda1f912b243cbb2fd73c1e9b0f8711685c26cb0a79de392671b1bc8e3cec2", "question": {"question_id": "sample_421_a72_q0", "video_id": 421, "video_path": "./videos/sample_421_real.mp4", "annotation_index": 72, "question_index": 0, "question": "What type of vehicle is visible in the parking lot right now?", "options": ["A. Car.", "B. Heavy truck.", "C. Bus.", "D. Helicopter."], "answer": "A", "time_stamp_s": 123, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [120, 140], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_421_a72_q0", "video_id": 421, "time_stamp_s": 123, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "141234d491fdf29fc8284b8b68843a32f5214ebb6f84c13a9efb01336bd775a1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0], "recent_frames_sha256": "049623d9a9f91160a70f871151909d8cf93a12405b2c7943fe0b0d80e515977d", "num_recent_frames": 30, "tq": 718894.050840736, "t1": 718906.048738458, "ta": 718906.048738458, "te": 718906.086142028, "first_response_s": 11.997897721943446, "answer_total_s": 12.03530129196588, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_421_a72_q0", "video_id": 421, "time_stamp_s": 123, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a826c2d8dd4c38e216f1bfa96bfbcf97cc87d6db141ca3d4abb4a76a59a797be", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a blue hoodie sits in a helicopter cockpit, wearing a headset and secured by a seatbelt, looking at the camera.  \n- The helicopter's interior features a control stick, a yellow-tipped lever, and a mounted camera above the pilot.  \n- The view outside shows a vast, flat landscape under a clear blue sky, with the helicopter in flight.\n[30-60s] - Pilot in blue hoodie adjusts controls while seated in helicopter cockpit.  \n- Helicopter flies over a wide river with dry, treeless terrain on either side.  \n- Camera captures cockpit instruments and rotating blades from inside the aircraft.\n[60-90s] - Pilot's hands actively manipulate control sticks and levers, adjusting flight path over urban and industrial zones.  \n- Helicopter's cockpit interior remains stable, with instruments and displays clearly visible, indicating steady flight.  \n- Ground below shows a mix of roads, buildings, and open land, with the helicopter maintaining a consistent altitude and trajectory.\n[90-120s] - Pilot's hands manipulate controls, adjusting flight path over urban landscape.  \n- Helicopter's cockpit interior shows instruments and a clear view of the ground below.  \n- Ground features include roads, buildings, and open fields under bright daylight.", "history_tokens": 270, "history_utf8_bytes": 1256, "recent_frame_times_s": [94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0], "recent_frames_sha256": "049623d9a9f91160a70f871151909d8cf93a12405b2c7943fe0b0d80e515977d", "num_recent_frames": 30, "tq": 718765.35481457, "t1": 718767.124132666, "ta": 718767.124132666, "te": 718767.165838117, "first_response_s": 1.7693180959904566, "answer_total_s": 1.8110235469648615, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 421, "content_group": "92eda1f912b243cbb2fd73c1e9b0f8711685c26cb0a79de392671b1bc8e3cec2", "question": {"question_id": "sample_421_a73_q0", "video_id": 421, "video_path": "./videos/sample_421_real.mp4", "annotation_index": 73, "question_index": 0, "question": "What type of aircraft is visible right now?", "options": ["A. Helicopter.", "B. Airplane.", "C. Drone.", "D. Glider."], "answer": "A", "time_stamp_s": 250, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [240, 260], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_421_a73_q0", "video_id": 421, "time_stamp_s": 250, "ground_truth": "A", "raw_output": "A. Helicopter.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "587cbfa5a31212fc9df0a9411a95edcb1d2e55873f91aca61a834ab456d7b957", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0], "recent_frames_sha256": "735c6d41b341caa22f92515e5932f2fd38ce0d97ff81aca77101f2378ae97f8c", "num_recent_frames": 30, "tq": 718906.096443989, "t1": 718948.266261113, "ta": 718948.266261113, "te": 718948.46118, "first_response_s": 42.16981712402776, "answer_total_s": 42.36473601101898, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_421_a73_q0", "video_id": 421, "time_stamp_s": 250, "ground_truth": "A", "raw_output": "A. Helicopter.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "26162913d3123b5c37bf6fc61024d31d3ff0f278612ad513f0720036cb687ab9", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a blue hoodie sits in a helicopter cockpit, wearing a headset and secured by a seatbelt, looking at the camera.  \n- The helicopter's interior features a control stick, a yellow-tipped lever, and a mounted camera above the pilot.  \n- The view outside shows a vast, flat landscape under a clear blue sky, with the helicopter in flight.\n[30-60s] - Pilot in blue hoodie adjusts controls while seated in helicopter cockpit.  \n- Helicopter flies over a wide river with dry, treeless terrain on either side.  \n- Camera captures cockpit instruments and rotating blades from inside the aircraft.\n[60-90s] - Pilot's hands actively manipulate control sticks and levers, adjusting flight path over urban and industrial zones.  \n- Helicopter's cockpit interior remains stable, with instruments and displays clearly visible, indicating steady flight.  \n- Ground below shows a mix of roads, buildings, and open land, with the helicopter maintaining a consistent altitude and trajectory.\n[90-120s] - Pilot's hands manipulate controls, adjusting flight path over urban landscape.  \n- Helicopter's cockpit interior shows instruments and a clear view of the ground below.  \n- Ground features include roads, buildings, and open fields under bright daylight.\n[120-150s] - Helicopter cockpit view shows pilot’s hands on controls, with a tablet mounted on the right side.  \n- Below, a sprawling urban area with roads, buildings, and parking lots is visible, including a large white building complex.  \n- The helicopter is flying low over open fields and industrial zones, with the horizon showing distant city structures under clear skies.\n[150-180s] - Pilot’s hands are visible on controls, with left hand near throttle and right hand near cyclic stick.  \n- Helicopter cockpit interior shows multiple gauges, a tablet mounted on right side, and a clear canopy.  \n- Ground below features a mix of urban structures, roads, and open fields under a clear blue sky.\n[180-210s] - Pilot's hands actively manipulate control sticks and levers, adjusting helicopter flight parameters.  \n- The helicopter's cockpit instruments display active readings, with a GPS device mounted near the pilot's right hand.  \n- The helicopter hovers low over a dry, grassy field, with distant buildings and a water tower visible in the background.\n[210-240s] - Pilot's hands manipulate control sticks and levers, adjusting helicopter controls.  \n- The cockpit view shows a dry, grassy field with distant buildings under clear skies.  \n- A tablet or display screen is mounted on the right side of the cockpit.", "history_tokens": 566, "history_utf8_bytes": 2581, "recent_frame_times_s": [221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0], "recent_frames_sha256": "735c6d41b341caa22f92515e5932f2fd38ce0d97ff81aca77101f2378ae97f8c", "num_recent_frames": 30, "tq": 718798.771427351, "t1": 718799.448953849, "ta": 718799.448953849, "te": 718799.748071293, "first_response_s": 0.6775264979805797, "answer_total_s": 0.976643941947259, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 421, "content_group": "92eda1f912b243cbb2fd73c1e9b0f8711685c26cb0a79de392671b1bc8e3cec2", "question": {"question_id": "sample_421_a74_q0", "video_id": 421, "video_path": "./videos/sample_421_real.mp4", "annotation_index": 74, "question_index": 0, "question": "What is the person grabbing from the food basket right now?", "options": ["A. Chicken strips.", "B. French fries.", "C. Onion rings.", "D. Mozzarella sticks."], "answer": "A", "time_stamp_s": 360, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [360, 380], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_421_a74_q0", "video_id": 421, "time_stamp_s": 360, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b226c34e4bc7992b5ad585cc2717042409e53ec953f47847378dfe40b299a9dc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0], "recent_frames_sha256": "4cbd2af56826e5d5442ccd49187c675cee3c8f0581e8588a3785382322e89cfd", "num_recent_frames": 30, "tq": 718948.470992131, "t1": 718957.394729589, "ta": 718957.394729589, "te": 718957.433479589, "first_response_s": 8.923737457953393, "answer_total_s": 8.96248745790217, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_421_a74_q0", "video_id": 421, "time_stamp_s": 360, "ground_truth": "A", "raw_output": "A. Chicken strips.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "a55f050473bc66be6691f6f70ac66b0c1a627e2dab266490b4dfe8950b1cc34a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a blue hoodie sits in a helicopter cockpit, wearing a headset and secured by a seatbelt, looking at the camera.  \n- The helicopter's interior features a control stick, a yellow-tipped lever, and a mounted camera above the pilot.  \n- The view outside shows a vast, flat landscape under a clear blue sky, with the helicopter in flight.\n[30-60s] - Pilot in blue hoodie adjusts controls while seated in helicopter cockpit.  \n- Helicopter flies over a wide river with dry, treeless terrain on either side.  \n- Camera captures cockpit instruments and rotating blades from inside the aircraft.\n[60-90s] - Pilot's hands actively manipulate control sticks and levers, adjusting flight path over urban and industrial zones.  \n- Helicopter's cockpit interior remains stable, with instruments and displays clearly visible, indicating steady flight.  \n- Ground below shows a mix of roads, buildings, and open land, with the helicopter maintaining a consistent altitude and trajectory.\n[90-120s] - Pilot's hands manipulate controls, adjusting flight path over urban landscape.  \n- Helicopter's cockpit interior shows instruments and a clear view of the ground below.  \n- Ground features include roads, buildings, and open fields under bright daylight.\n[120-150s] - Helicopter cockpit view shows pilot’s hands on controls, with a tablet mounted on the right side.  \n- Below, a sprawling urban area with roads, buildings, and parking lots is visible, including a large white building complex.  \n- The helicopter is flying low over open fields and industrial zones, with the horizon showing distant city structures under clear skies.\n[150-180s] - Pilot’s hands are visible on controls, with left hand near throttle and right hand near cyclic stick.  \n- Helicopter cockpit interior shows multiple gauges, a tablet mounted on right side, and a clear canopy.  \n- Ground below features a mix of urban structures, roads, and open fields under a clear blue sky.\n[180-210s] - Pilot's hands actively manipulate control sticks and levers, adjusting helicopter flight parameters.  \n- The helicopter's cockpit instruments display active readings, with a GPS device mounted near the pilot's right hand.  \n- The helicopter hovers low over a dry, grassy field, with distant buildings and a water tower visible in the background.\n[210-240s] - Pilot's hands manipulate control sticks and levers, adjusting helicopter controls.  \n- The cockpit view shows a dry, grassy field with distant buildings under clear skies.  \n- A tablet or display screen is mounted on the right side of the cockpit.\n[240-270s] - Helicopter cockpit view shows pilot's hand adjusting controls as the aircraft hovers low over dry grass.  \n- Exterior shot reveals helicopter landing on a grassy field near a commercial area with buildings and a water tower in the background.  \n- Interior of a fast-food restaurant is shown with a staff member at the counter, visibly reacting to the helicopter’s presence.\n[270-300s] - Cashier in blue shirt and cap stands behind counter, gesturing while speaking.  \n- Menu boards display food items above the counter; a Pepsi box sits on the counter.  \n- Employee in plaid shirt is visible in background, near a baking area.\n[300-330s] - A man in a grey jacket sits at a wooden table, holding a red cup, facing the camera.  \n- A woman in a black top sits beside him, also holding a red cup, with a child in a pink outfit seated next to her.  \n- A young boy in a grey shirt stands near the window, leaning against the booth, looking out.\n[330-360s] - A man in a grey hoodie sits at a wooden table, holding a red cup and gesturing with his hand.\n- A young girl in a red shirt sits beside him, eating from a red cup, while a woman with blonde hair sits across from them.\n- A boy in a grey shirt stands near the window, leaning on the counter and looking out, with a large circular sign visible outside.", "history_tokens": 887, "history_utf8_bytes": 3898, "recent_frame_times_s": [331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0], "recent_frames_sha256": "4cbd2af56826e5d5442ccd49187c675cee3c8f0581e8588a3785382322e89cfd", "num_recent_frames": 30, "tq": 718836.267278111, "t1": 718844.455427858, "ta": 718844.455427858, "te": 718844.894736474, "first_response_s": 8.188149747089483, "answer_total_s": 8.627458363072947, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 421, "content_group": "92eda1f912b243cbb2fd73c1e9b0f8711685c26cb0a79de392671b1bc8e3cec2", "question": {"question_id": "sample_421_a75_q0", "video_id": 421, "video_path": "./videos/sample_421_real.mp4", "annotation_index": 75, "question_index": 0, "question": "What navigational tool is visible on the screen right now?", "options": ["A. GPS device.", "B. Compass.", "C. Altimeter.", "D. Airspeed indicator."], "answer": "A", "time_stamp_s": 489, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [480, 500], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_421_a75_q0", "video_id": 421, "time_stamp_s": 489, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "66680f56fcb10b956cbbb8156a2c2e5f321e15e451e1f15d0ad81e246e147285", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0], "recent_frames_sha256": "04cb7e9040db61d266e10862ed04dcc90fc81ec5575c9675cc66d414db9cda5a", "num_recent_frames": 30, "tq": 718957.45109134, "t1": 718969.152901651, "ta": 718969.152901651, "te": 718969.19263267, "first_response_s": 11.701810310943983, "answer_total_s": 11.741541330004111, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_421_a75_q0", "video_id": 421, "time_stamp_s": 489, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f5bf9a0b24e0a33a16389946311459a478613d0e20aa6028738a7385ab1fef14", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Pilot's hands actively manipulate control sticks and levers, adjusting flight path over urban and industrial zones.  \n- Helicopter's cockpit interior remains stable, with instruments and displays clearly visible, indicating steady flight.  \n- Ground below shows a mix of roads, buildings, and open land, with the helicopter maintaining a consistent altitude and trajectory.\n[90-120s] - Pilot's hands manipulate controls, adjusting flight path over urban landscape.  \n- Helicopter's cockpit interior shows instruments and a clear view of the ground below.  \n- Ground features include roads, buildings, and open fields under bright daylight.\n[120-150s] - Helicopter cockpit view shows pilot’s hands on controls, with a tablet mounted on the right side.  \n- Below, a sprawling urban area with roads, buildings, and parking lots is visible, including a large white building complex.  \n- The helicopter is flying low over open fields and industrial zones, with the horizon showing distant city structures under clear skies.\n[150-180s] - Pilot’s hands are visible on controls, with left hand near throttle and right hand near cyclic stick.  \n- Helicopter cockpit interior shows multiple gauges, a tablet mounted on right side, and a clear canopy.  \n- Ground below features a mix of urban structures, roads, and open fields under a clear blue sky.\n[180-210s] - Pilot's hands actively manipulate control sticks and levers, adjusting helicopter flight parameters.  \n- The helicopter's cockpit instruments display active readings, with a GPS device mounted near the pilot's right hand.  \n- The helicopter hovers low over a dry, grassy field, with distant buildings and a water tower visible in the background.\n[210-240s] - Pilot's hands manipulate control sticks and levers, adjusting helicopter controls.  \n- The cockpit view shows a dry, grassy field with distant buildings under clear skies.  \n- A tablet or display screen is mounted on the right side of the cockpit.\n[240-270s] - Helicopter cockpit view shows pilot's hand adjusting controls as the aircraft hovers low over dry grass.  \n- Exterior shot reveals helicopter landing on a grassy field near a commercial area with buildings and a water tower in the background.  \n- Interior of a fast-food restaurant is shown with a staff member at the counter, visibly reacting to the helicopter’s presence.\n[270-300s] - Cashier in blue shirt and cap stands behind counter, gesturing while speaking.  \n- Menu boards display food items above the counter; a Pepsi box sits on the counter.  \n- Employee in plaid shirt is visible in background, near a baking area.\n[300-330s] - A man in a grey jacket sits at a wooden table, holding a red cup, facing the camera.  \n- A woman in a black top sits beside him, also holding a red cup, with a child in a pink outfit seated next to her.  \n- A young boy in a grey shirt stands near the window, leaning against the booth, looking out.\n[330-360s] - A man in a grey hoodie sits at a wooden table, holding a red cup and gesturing with his hand.\n- A young girl in a red shirt sits beside him, eating from a red cup, while a woman with blonde hair sits across from them.\n- A boy in a grey shirt stands near the window, leaning on the counter and looking out, with a large circular sign visible outside.\n[360-390s] - Pilot's hand manipulates control stick and throttle while seated in helicopter cockpit.  \n- Helicopter's dashboard displays various gauges and instruments, with a yellow knob visible.  \n- Ground view shows dry grass field and distant buildings under clear sky.\n[390-420s] - Pilot's hands manipulate control sticks and switches on the cockpit panel while seated in the helicopter.  \n- A tablet device is held in the pilot's left hand, displaying a map or navigation screen.  \n- The helicopter's rotor blades are visible extending outward from the cockpit, with the ground below showing dry grass and distant buildings.\n[420-450s] - Pilot's hand moves to adjust controls on the helicopter's dashboard.  \n- Helicopter's rotor blades begin to spin, indicating takeoff initiation.  \n- Ground view shows dry grass field with distant buildings and a water tower.\n[450-480s] - Helicopter cockpit view shows pilot’s hands on controls, with instruments and a tablet visible.  \n- Ground below transitions from dry fields to urban infrastructure, including roads, buildings, and a water tower.  \n- A large body of water and green fields become visible as the helicopter ascends, with distant wind turbines in the horizon.", "history_tokens": 1019, "history_utf8_bytes": 4517, "recent_frame_times_s": [460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0], "recent_frames_sha256": "04cb7e9040db61d266e10862ed04dcc90fc81ec5575c9675cc66d414db9cda5a", "num_recent_frames": 30, "tq": 718880.58196961, "t1": 718882.19344091, "ta": 718882.19344091, "te": 718882.383624536, "first_response_s": 1.6114713000133634, "answer_total_s": 1.8016549260355532, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 423, "content_group": "fb33764b39afd8b682b98f7513dea405eb2c08dc3d4fc9ab7c3f6fef32e8e4b1", "question": {"question_id": "sample_423_a1118_q0", "video_id": 423, "video_path": "./videos/sample_423_real.mp4", "annotation_index": 1118, "question_index": 0, "question": "Which type of vehicle is visible inside the hangar right now?", "options": ["A. Truck.", "B. Boat.", "C. Aircraft.", "D. Motorcycle."], "answer": "C", "time_stamp_s": 3, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_423_a1118_q0", "video_id": 423, "time_stamp_s": 3, "ground_truth": "C", "raw_output": "C. Aircraft.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "281d65804df3c60476471d76581f186d2c9526061c7f17c018fc4cbc1bfba53e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002], "recent_frames_sha256": "992232d71074788895b9f5e4da23de30131f8c8187bd84526ac2071d72bb8005", "num_recent_frames": 3, "tq": 717861.862617934, "t1": 717870.162362062, "ta": 717870.162362062, "te": 717870.393729626, "first_response_s": 8.299744128016755, "answer_total_s": 8.531111691961996, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_423_a1118_q0", "video_id": 423, "time_stamp_s": 3, "ground_truth": "C", "raw_output": "C. Aircraft.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "f342fd2c410dd39f7cbe31a53695497825a6a044ec48d01dabb90d6132e8b4f8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002], "recent_frames_sha256": "992232d71074788895b9f5e4da23de30131f8c8187bd84526ac2071d72bb8005", "num_recent_frames": 3, "tq": 717897.560255553, "t1": 717909.387145085, "ta": 717909.387145085, "te": 717909.579642956, "first_response_s": 11.826889532036148, "answer_total_s": 12.019387403037399, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 423, "content_group": "fb33764b39afd8b682b98f7513dea405eb2c08dc3d4fc9ab7c3f6fef32e8e4b1", "question": {"question_id": "sample_423_a1119_q0", "video_id": 423, "video_path": "./videos/sample_423_real.mp4", "annotation_index": 1119, "question_index": 0, "question": "Which device is currently placed on the right side of the cockpit?", "options": ["A. A GPS device.", "B. A radio transmitter.", "C. An altimeter.", "D. A fuel gauge."], "answer": "A", "time_stamp_s": 176, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [173, 178], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_423_a1119_q0", "video_id": 423, "time_stamp_s": 176, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a5b94e49c2ded9ca634454e57b85c0795f0932104e0a87c46bd203e61008a175", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665], "recent_frames_sha256": "a29801e49635dd909e1b34ccfba51b465b17b936ab9608e2f920da79e95f3828", "num_recent_frames": 30, "tq": 717870.41613811, "t1": 717877.12159255, "ta": 717877.12159255, "te": 717877.159753538, "first_response_s": 6.705454439972527, "answer_total_s": 6.743615427985787, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_423_a1119_q0", "video_id": 423, "time_stamp_s": 176, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "729feb472333a942fe8388cc0f53a1297f0a6a3b56aba972bfcff12750fb46b9", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand holds a black-and-white striped propeller blade near a blue helicopter, adjusting its position.  \n- The helicopter is parked outside a hangar labeled \"SKYLINK AVIATION,\" with its main rotor blades visible.  \n- The camera pans slightly, revealing a yellow vehicle and other aircraft in the background, indicating an airfield setting.\n[30-60s] - Person places black headset into cockpit storage compartment near pilot seat.  \n- Hands adjust headset straps and position it over head before securing it.  \n- Pilot’s feet rest on control stick, with cockpit instruments and dashboard visible in background.\n[60-90s] - Pilot's right hand grips the cyclic control stick, making subtle adjustments to helicopter pitch.  \n- Left foot presses the throttle lever, increasing engine power for takeoff.  \n- Cockpit instruments display active flight parameters, including engine RPM and altitude indicators.\n[90-120s] - Pilot's hands manipulate control sticks and pedals while seated in a helicopter cockpit.  \n- A smartphone displaying a map or navigation app is held in the pilot's right hand.  \n- The helicopter is stationary on a paved tarmac with buildings and fencing visible in the background.\n[120-150s] - Pilot's right hand manipulates a green-lit control lever on the instrument panel.  \n- Left hand holds a smartphone displaying a map or navigation app, positioned near the left side of the cockpit.  \n- Cockpit view shows a paved tarmac with distant buildings and a parked aircraft to the left.", "history_tokens": 328, "history_utf8_bytes": 1511, "recent_frame_times_s": [146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.00085, 152.00185, 153.00285, 154.00385, 155.00485, 156.00585, 157.00685, 158.00785, 159.00885, 160.00985, 161.01085, 162.01185, 163.01285, 164.01385, 165.01485, 166.01585, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665], "recent_frames_sha256": "a29801e49635dd909e1b34ccfba51b465b17b936ab9608e2f920da79e95f3828", "num_recent_frames": 30, "tq": 717946.098646381, "t1": 717947.971450774, "ta": 717947.971450774, "te": 717948.126925361, "first_response_s": 1.87280439294409, "answer_total_s": 2.0282789799384773, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 423, "content_group": "fb33764b39afd8b682b98f7513dea405eb2c08dc3d4fc9ab7c3f6fef32e8e4b1", "question": {"question_id": "sample_423_a1120_q0", "video_id": 423, "video_path": "./videos/sample_423_real.mp4", "annotation_index": 1120, "question_index": 0, "question": "What is right now the terrain mainly covered with, as seen from the flying POV?", "options": ["A. Desert.", "B. Urban buildings.", "C. Forest.", "D. Water bodies."], "answer": "C", "time_stamp_s": 349, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [346, 351], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_423_a1120_q0", "video_id": 423, "time_stamp_s": 349, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8dabb164dd8ce68fe29a915165d1c061774a0be437c3e8daeca1e93d9c330ea4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [319.0020166666667, 320.00301666666667, 321.00401666666664, 322.0050166666667, 323.00601666666665, 324.0070166666667, 325.00801666666666, 326.00901666666664, 327.0100166666667, 328.01101666666665, 329.0120166666667, 330.01301666666666, 331.0140166666667, 332.01501666666667, 333.01601666666664, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335], "recent_frames_sha256": "c6a697d640abd0f70d408c3e8a44ef87bfe0f23d21c1627006a931a40ebe0b30", "num_recent_frames": 30, "tq": 717877.180134044, "t1": 717883.465420767, "ta": 717883.465420767, "te": 717883.504823025, "first_response_s": 6.285286722937599, "answer_total_s": 6.324688980937935, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_423_a1120_q0", "video_id": 423, "time_stamp_s": 349, "ground_truth": "C", "raw_output": "D. Water bodies.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "efdcdd7021b0d17723c95913c065db577c7270000ce5524a099dd13c4acc52d7", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand holds a black-and-white striped propeller blade near a blue helicopter, adjusting its position.  \n- The helicopter is parked outside a hangar labeled \"SKYLINK AVIATION,\" with its main rotor blades visible.  \n- The camera pans slightly, revealing a yellow vehicle and other aircraft in the background, indicating an airfield setting.\n[30-60s] - Person places black headset into cockpit storage compartment near pilot seat.  \n- Hands adjust headset straps and position it over head before securing it.  \n- Pilot’s feet rest on control stick, with cockpit instruments and dashboard visible in background.\n[60-90s] - Pilot's right hand grips the cyclic control stick, making subtle adjustments to helicopter pitch.  \n- Left foot presses the throttle lever, increasing engine power for takeoff.  \n- Cockpit instruments display active flight parameters, including engine RPM and altitude indicators.\n[90-120s] - Pilot's hands manipulate control sticks and pedals while seated in a helicopter cockpit.  \n- A smartphone displaying a map or navigation app is held in the pilot's right hand.  \n- The helicopter is stationary on a paved tarmac with buildings and fencing visible in the background.\n[120-150s] - Pilot's right hand manipulates a green-lit control lever on the instrument panel.  \n- Left hand holds a smartphone displaying a map or navigation app, positioned near the left side of the cockpit.  \n- Cockpit view shows a paved tarmac with distant buildings and a parked aircraft to the left.\n[150-180s] - Pilot's hands adjust controls on the helicopter's yoke and foot pedals while seated in the cockpit.  \n- A smartphone displaying a map or navigation app is mounted on the right side of the cockpit.  \n- The helicopter is stationary on a cracked asphalt runway with distant buildings and open fields visible through the windshield.\n[180-210s] - Pilot's hands actively manipulate flight controls, adjusting pitch and yaw as the aircraft ascends.  \n- The cockpit dashboard displays fluctuating instrument readings, indicating active flight parameters.  \n- The aircraft's forward motion transitions from runway to open field, with the horizon and landscape shifting beneath.\n[210-240s] - Pilot's hands manipulate controls, with right hand adjusting throttle and left hand on yoke.  \n- Smartphone displays map or navigation data, positioned to the right of the pilot.  \n- Helicopter cockpit shows multiple gauges and a digital display indicating flight parameters.\n[240-270s] - Pilot's hands actively manipulate controls, including a joystick and throttle, while seated in the cockpit.  \n- A smartphone displaying a map is mounted on the right side of the dashboard, showing navigation data.  \n- The helicopter flies low over a patchwork of green and golden agricultural fields, with a distant white structure visible on the horizon.\n[270-300s] - Pilot's hands manipulate control stick and throttle while flying over farmland and water bodies.  \n- Smartphone mounted on dashboard displays a map, likely for navigation.  \n- Helicopter's transparent canopy offers wide view of green fields, brown farmland, and distant lakes.\n[300-330s] - Pilot's hands manipulate controls, with right hand adjusting throttle and left hand on yoke.  \n- Helicopter flies over a river with dense green forests on either side, showing a wide, winding waterway.  \n- A small digital display on the right side of the cockpit shows flight data, including altitude and speed.", "history_tokens": 748, "history_utf8_bytes": 3466, "recent_frame_times_s": [319.0020166666667, 320.00301666666667, 321.00401666666664, 322.0050166666667, 323.00601666666665, 324.0070166666667, 325.00801666666666, 326.00901666666664, 327.0100166666667, 328.01101666666665, 329.0120166666667, 330.01301666666666, 331.0140166666667, 332.01501666666667, 333.01601666666664, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334, 340.0063333333333, 341.00733333333335, 342.0083333333333, 343.00933333333336, 344.01033333333334, 345.0113333333333, 346.01233333333334, 347.0133333333333, 348.01433333333335], "recent_frames_sha256": "c6a697d640abd0f70d408c3e8a44ef87bfe0f23d21c1627006a931a40ebe0b30", "num_recent_frames": 30, "tq": 718002.839166891, "t1": 718004.440231309, "ta": 718004.440231309, "te": 718004.705132218, "first_response_s": 1.6010644180933014, "answer_total_s": 1.8659653270151466, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 423, "content_group": "fb33764b39afd8b682b98f7513dea405eb2c08dc3d4fc9ab7c3f6fef32e8e4b1", "question": {"question_id": "sample_423_a1121_q0", "video_id": 423, "video_path": "./videos/sample_423_real.mp4", "annotation_index": 1121, "question_index": 0, "question": "What instrument is the pilot using right now to navigate?", "options": ["A. Altimeter.", "B. Compass.", "C. GPS tablet.", "D. Map."], "answer": "C", "time_stamp_s": 522, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [519, 524], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_423_a1121_q0", "video_id": 423, "time_stamp_s": 522, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6415e13d0b06f83fad6e28d474b5de5dce85b37a7fd1602ad293e920dee54684", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336, 498.01418333333334, 499.0151833333333, 500.01618333333334, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0008166666667, 519.0018166666666, 520.0028166666667, 521.0038166666667], "recent_frames_sha256": "be0cb8e6d3f302239e5388f62854653d816df14939d29041a927153fbc6bff7b", "num_recent_frames": 30, "tq": 717883.536113444, "t1": 717890.291748168, "ta": 717890.291748168, "te": 717890.329085743, "first_response_s": 6.755634723929688, "answer_total_s": 6.792972299037501, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_423_a1121_q0", "video_id": 423, "time_stamp_s": 522, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0331ec71129eabbc8e1fb2a27e34c854a275a866aabe379a29cd445da178923c", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Pilot's hands manipulate control sticks and pedals while seated in a helicopter cockpit.  \n- A smartphone displaying a map or navigation app is held in the pilot's right hand.  \n- The helicopter is stationary on a paved tarmac with buildings and fencing visible in the background.\n[120-150s] - Pilot's right hand manipulates a green-lit control lever on the instrument panel.  \n- Left hand holds a smartphone displaying a map or navigation app, positioned near the left side of the cockpit.  \n- Cockpit view shows a paved tarmac with distant buildings and a parked aircraft to the left.\n[150-180s] - Pilot's hands adjust controls on the helicopter's yoke and foot pedals while seated in the cockpit.  \n- A smartphone displaying a map or navigation app is mounted on the right side of the cockpit.  \n- The helicopter is stationary on a cracked asphalt runway with distant buildings and open fields visible through the windshield.\n[180-210s] - Pilot's hands actively manipulate flight controls, adjusting pitch and yaw as the aircraft ascends.  \n- The cockpit dashboard displays fluctuating instrument readings, indicating active flight parameters.  \n- The aircraft's forward motion transitions from runway to open field, with the horizon and landscape shifting beneath.\n[210-240s] - Pilot's hands manipulate controls, with right hand adjusting throttle and left hand on yoke.  \n- Smartphone displays map or navigation data, positioned to the right of the pilot.  \n- Helicopter cockpit shows multiple gauges and a digital display indicating flight parameters.\n[240-270s] - Pilot's hands actively manipulate controls, including a joystick and throttle, while seated in the cockpit.  \n- A smartphone displaying a map is mounted on the right side of the dashboard, showing navigation data.  \n- The helicopter flies low over a patchwork of green and golden agricultural fields, with a distant white structure visible on the horizon.\n[270-300s] - Pilot's hands manipulate control stick and throttle while flying over farmland and water bodies.  \n- Smartphone mounted on dashboard displays a map, likely for navigation.  \n- Helicopter's transparent canopy offers wide view of green fields, brown farmland, and distant lakes.\n[300-330s] - Pilot's hands manipulate controls, with right hand adjusting throttle and left hand on yoke.  \n- Helicopter flies over a river with dense green forests on either side, showing a wide, winding waterway.  \n- A small digital display on the right side of the cockpit shows flight data, including altitude and speed.\n[330-360s] - Pilot's hands actively manipulate controls, with a smartphone displaying a map visible on the right side of the cockpit.  \n- The helicopter flies low over a wide river, with lush green forests and urban areas visible along the shoreline.  \n- The camera angle captures the expansive view through the transparent canopy, showing the river’s bend and distant landmasses.\n[360-390s] - Pilot's hands manipulate flight controls, including a joystick and throttle, while seated in a helicopter cockpit.  \n- A GPS device is mounted on the right side of the dashboard, displaying navigation data.  \n- The helicopter flies over a dense forest and a river, with a town and industrial structures visible below.\n[390-420s] - Pilot's hands manipulate controls as helicopter flies over dense forest canopy.  \n- A smartphone mounted on the right side displays a map or navigation app.  \n- At 410 seconds, helicopter descends toward a highway interchange with visible roads and buildings below.\n[420-450s] - Pilot's hands are visible on controls, maintaining steady flight.  \n- The helicopter's cockpit instruments and a mounted smartphone are in view.  \n- Below, a sprawling urban area with roads, buildings, and green fields is seen from high altitude.\n[450-480s] - Pilot's hands are visible on controls, adjusting flight path over urban landscape.  \n- Helicopter flies low over parking lots and roads, with buildings and green spaces below.  \n- Camera angle shifts slightly, revealing a large circular sports field and surrounding infrastructure.\n[480-510s] - Pilot's hands actively manipulate controls, including a joystick and throttle, while seated in the cockpit.  \n- A smartphone mounted on the left side displays a map or navigation app, aiding flight path management.  \n- The helicopter's view reveals a sprawling industrial complex with parking lots and roads, bathed in golden sunset light.", "history_tokens": 969, "history_utf8_bytes": 4454, "recent_frame_times_s": [492.0081833333333, 493.00918333333334, 494.0101833333333, 495.01118333333335, 496.0121833333333, 497.01318333333336, 498.01418333333334, 499.0151833333333, 500.01618333333334, 501.0005, 502.0015, 503.0025, 504.0035, 505.0045, 506.0055, 507.0065, 508.0075, 509.0085, 510.0095, 511.0105, 512.0115, 513.0125, 514.0135, 515.0145, 516.0155, 517.0165, 518.0008166666667, 519.0018166666666, 520.0028166666667, 521.0038166666667], "recent_frames_sha256": "be0cb8e6d3f302239e5388f62854653d816df14939d29041a927153fbc6bff7b", "num_recent_frames": 30, "tq": 718046.766564641, "t1": 718058.851668002, "ta": 718058.851668002, "te": 718059.124262861, "first_response_s": 12.085103360936046, "answer_total_s": 12.357698219944723, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 423, "content_group": "fb33764b39afd8b682b98f7513dea405eb2c08dc3d4fc9ab7c3f6fef32e8e4b1", "question": {"question_id": "sample_423_a1122_q0", "video_id": 423, "video_path": "./videos/sample_423_real.mp4", "annotation_index": 1122, "question_index": 0, "question": "Which device is placed next to the pilot's seat right now?", "options": ["A. A GPS device.", "B. A camera.", "C. An oxygen mask.", "D. A water bottle."], "answer": "B", "time_stamp_s": 696, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [692, 697], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_423_a1122_q0", "video_id": 423, "time_stamp_s": 696, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "aeeb838a0f321ac1c3b83cc62a9c32b3b134f076ace143988e7284c2e5aca6b8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [666.01535, 667.01635, 668.0006666666667, 669.0016666666667, 670.0026666666666, 671.0036666666666, 672.0046666666667, 673.0056666666667, 674.0066666666667, 675.0076666666666, 676.0086666666666, 677.0096666666667, 678.0106666666667, 679.0116666666667, 680.0126666666666, 681.0136666666667, 682.0146666666667, 683.0156666666667, 684.0166666666667, 685.0009833333334, 686.0019833333333, 687.0029833333333, 688.0039833333333, 689.0049833333334, 690.0059833333333, 691.0069833333333, 692.0079833333333, 693.0089833333334, 694.0099833333334, 695.0109833333333], "recent_frames_sha256": "57faf506dc046eb3c864d07497d9eb6a3d8d34f74a0ffb57bd02a31a3ec801a5", "num_recent_frames": 30, "tq": 717890.352636599, "t1": 717897.509137915, "ta": 717897.509137915, "te": 717897.548548545, "first_response_s": 7.156501315999776, "answer_total_s": 7.195911946007982, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_423_a1122_q0", "video_id": 423, "time_stamp_s": 696, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9734205e0f61c27fe8c70c5f5a5dc43f34021e94e4be053ee640c087e006d682", "condition_order": ["recent", "notes"], "memory": "[270-300s] - Pilot's hands manipulate control stick and throttle while flying over farmland and water bodies.  \n- Smartphone mounted on dashboard displays a map, likely for navigation.  \n- Helicopter's transparent canopy offers wide view of green fields, brown farmland, and distant lakes.\n[300-330s] - Pilot's hands manipulate controls, with right hand adjusting throttle and left hand on yoke.  \n- Helicopter flies over a river with dense green forests on either side, showing a wide, winding waterway.  \n- A small digital display on the right side of the cockpit shows flight data, including altitude and speed.\n[330-360s] - Pilot's hands actively manipulate controls, with a smartphone displaying a map visible on the right side of the cockpit.  \n- The helicopter flies low over a wide river, with lush green forests and urban areas visible along the shoreline.  \n- The camera angle captures the expansive view through the transparent canopy, showing the river’s bend and distant landmasses.\n[360-390s] - Pilot's hands manipulate flight controls, including a joystick and throttle, while seated in a helicopter cockpit.  \n- A GPS device is mounted on the right side of the dashboard, displaying navigation data.  \n- The helicopter flies over a dense forest and a river, with a town and industrial structures visible below.\n[390-420s] - Pilot's hands manipulate controls as helicopter flies over dense forest canopy.  \n- A smartphone mounted on the right side displays a map or navigation app.  \n- At 410 seconds, helicopter descends toward a highway interchange with visible roads and buildings below.\n[420-450s] - Pilot's hands are visible on controls, maintaining steady flight.  \n- The helicopter's cockpit instruments and a mounted smartphone are in view.  \n- Below, a sprawling urban area with roads, buildings, and green fields is seen from high altitude.\n[450-480s] - Pilot's hands are visible on controls, adjusting flight path over urban landscape.  \n- Helicopter flies low over parking lots and roads, with buildings and green spaces below.  \n- Camera angle shifts slightly, revealing a large circular sports field and surrounding infrastructure.\n[480-510s] - Pilot's hands actively manipulate controls, including a joystick and throttle, while seated in the cockpit.  \n- A smartphone mounted on the left side displays a map or navigation app, aiding flight path management.  \n- The helicopter's view reveals a sprawling industrial complex with parking lots and roads, bathed in golden sunset light.\n[510-540s] - Pilot's hands manipulate controls while a smartphone displays navigation data.  \n- Helicopter's cockpit view shows a vast agricultural field with winding roads and distant buildings.  \n- Sunlight glints off the helicopter’s transparent canopy as it flies over the terrain.\n[540-570s] - Pilot's hands are visible on controls, with a smartphone mounted nearby, likely for navigation or recording.  \n- The aircraft is flying low over brown agricultural fields, with a highway and distant industrial buildings visible below.  \n- The cockpit view shows a clear sky and horizon, with the aircraft maintaining a steady altitude and forward trajectory.\n[570-600s] - Pilot's hands adjust controls while flying over a large industrial complex with silos and warehouses.  \n- A smartphone displaying a map is mounted on the right side of the cockpit.  \n- The helicopter descends toward a paved area with visible parking spaces and surrounding greenery.\n[600-630s] - Helicopter pilot's hands manipulate controls, with a smartphone mounted on the right side of the cockpit.  \n- The helicopter hovers above a gravel airfield, with a black SUV parked nearby and a white building in the background.  \n- The helicopter's shadow is visible on the ground, indicating low sun angle, and the aircraft is positioned above a series of white poles.\n[630-660s] - Pilot's hands manipulate flight controls, including cyclic and collective levers, while seated in a helicopter cockpit.  \n- A smartphone mounted on the right side displays a map or navigation app, likely aiding in flight planning or real-time navigation.  \n- The helicopter is positioned on a grassy area adjacent to a paved runway, with the sun casting long shadows across the ground.\n[660-690s] - Pilot's hands manipulate control sticks and levers while seated in a helicopter cockpit.  \n- A smartphone is held in one hand, displaying a map or navigation screen.  \n- The helicopter is on a grassy field with a paved runway visible in the background.", "history_tokens": 988, "history_utf8_bytes": 4519, "recent_frame_times_s": [666.01535, 667.01635, 668.0006666666667, 669.0016666666667, 670.0026666666666, 671.0036666666666, 672.0046666666667, 673.0056666666667, 674.0066666666667, 675.0076666666666, 676.0086666666666, 677.0096666666667, 678.0106666666667, 679.0116666666667, 680.0126666666666, 681.0136666666667, 682.0146666666667, 683.0156666666667, 684.0166666666667, 685.0009833333334, 686.0019833333333, 687.0029833333333, 688.0039833333333, 689.0049833333334, 690.0059833333333, 691.0069833333333, 692.0079833333333, 693.0089833333334, 694.0099833333334, 695.0109833333333], "recent_frames_sha256": "57faf506dc046eb3c864d07497d9eb6a3d8d34f74a0ffb57bd02a31a3ec801a5", "num_recent_frames": 30, "tq": 718105.675902532, "t1": 718107.821308526, "ta": 718107.821308526, "te": 718107.866676963, "first_response_s": 2.1454059940297157, "answer_total_s": 2.190774431102909, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 424, "content_group": "ec65363495c655b1504629500da65b45cdf66c3b6f20d18aaa1fafddb3a0ad34", "question": {"question_id": "sample_424_a670_q0", "video_id": 424, "video_path": "./videos/sample_424_real.mp4", "annotation_index": 670, "question_index": 0, "question": "What color is the pilot's headset right now?", "options": ["A. Red.", "B. Blue.", "C. Black.", "D. White."], "answer": "C", "time_stamp_s": 3, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_424_a670_q0", "video_id": 424, "time_stamp_s": 3, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c61bd3ff2b3741dd7399c807d1fd4f7a8effac06737bce9aca8a4f323770842e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "e40fd186e210e071dd2e30c81b32e97afff933749a83de7013db40a78e289156", "num_recent_frames": 4, "tq": 718159.820547209, "t1": 718172.233494574, "ta": 718172.233494574, "te": 718172.271460486, "first_response_s": 12.412947364966385, "answer_total_s": 12.450913276989013, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_424_a670_q0", "video_id": 424, "time_stamp_s": 3, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5fced21e3bf0b927ca34bf9145a7551fca224a6f75cb5dd6c851419de06edff9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "e40fd186e210e071dd2e30c81b32e97afff933749a83de7013db40a78e289156", "num_recent_frames": 4, "tq": 718217.387273264, "t1": 718218.78657583, "ta": 718218.78657583, "te": 718218.826176454, "first_response_s": 1.399302565958351, "answer_total_s": 1.4389031899627298, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 424, "content_group": "ec65363495c655b1504629500da65b45cdf66c3b6f20d18aaa1fafddb3a0ad34", "question": {"question_id": "sample_424_a671_q0", "video_id": 424, "video_path": "./videos/sample_424_real.mp4", "annotation_index": 671, "question_index": 0, "question": "What is in the pilot's left hand right now?", "options": ["A. A map.", "B. A control stick.", "C. A headset.", "D. A smartphone."], "answer": "B", "time_stamp_s": 125, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [122, 127], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_424_a671_q0", "video_id": 424, "time_stamp_s": 125, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8170444e243cbc5ea0a27b97fe75272c62dea236ce5acd8e00571c1323c35d3c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0], "recent_frames_sha256": "20b6bd8b408627bf79e1ec012210a66a673c21074dcc02eb0ba239eb6b4c0330", "num_recent_frames": 30, "tq": 718172.280580672, "t1": 718185.65424169, "ta": 718185.65424169, "te": 718185.693835166, "first_response_s": 13.373661017976701, "answer_total_s": 13.41325449408032, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_424_a671_q0", "video_id": 424, "time_stamp_s": 125, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6004afb21f0db3856dadfd5f042c594df5b91073b64f682568c51b1c477d03ff", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man with a beard, wearing a grey hoodie and headset, sits in a helicopter cockpit, looking at the camera.  \n- The helicopter's rotor blades are visible spinning rapidly above him, with the cityscape below.  \n- The man remains seated, with his hands on controls, as the helicopter appears to be in flight.\n[30-60s] - Pilot seated in helicopter cockpit, wearing headset and grey hoodie, looking forward with hands on controls.\n- Helicopter's rotor blades spin rapidly, visible through the canopy, as the aircraft hovers over a sprawling urban landscape.\n- View from cockpit shows a GPS device displaying coordinates, with the horizon and cityscape below under an overcast sky.\n[60-90s] - Pilot in grey hoodie and cap seated in helicopter cockpit, looking forward.  \n- Helicopter's interior dashboard and control sticks visible, with a GPS screen displaying map.  \n- Exterior view shows suburban landscape with roads, buildings, and open fields under overcast sky.\n[90-120s] - Pilot adjusts headset and looks toward camera while seated in helicopter cockpit.  \n- Helicopter interior shows control stick, seatbelt, and instrument panel with yellow-tipped lever.  \n- Exterior view through windshield shows open field and distant trees under overcast sky.", "history_tokens": 274, "history_utf8_bytes": 1261, "recent_frame_times_s": [96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0], "recent_frames_sha256": "20b6bd8b408627bf79e1ec012210a66a673c21074dcc02eb0ba239eb6b4c0330", "num_recent_frames": 30, "tq": 718256.811371029, "t1": 718264.409278805, "ta": 718264.409278805, "te": 718264.675837087, "first_response_s": 7.597907776013017, "answer_total_s": 7.864466057973914, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 424, "content_group": "ec65363495c655b1504629500da65b45cdf66c3b6f20d18aaa1fafddb3a0ad34", "question": {"question_id": "sample_424_a672_q0", "video_id": 424, "video_path": "./videos/sample_424_real.mp4", "annotation_index": 672, "question_index": 0, "question": "What is the color of the top of the control stick handle right now?", "options": ["A. Red.", "B. Blue.", "C. Yellow.", "D. Green."], "answer": "C", "time_stamp_s": 246, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [244, 249], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_424_a672_q0", "video_id": 424, "time_stamp_s": 246, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "391a3ef6a041aa215ba489f00aa11bb11981395e29a55093c558e7596529d945", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0], "recent_frames_sha256": "320d7fc9f3a9654ae02b3183b505bad1559f839443f6383f92cb7a6eec03d327", "num_recent_frames": 30, "tq": 718185.704760844, "t1": 718198.086542919, "ta": 718198.086542919, "te": 718198.12635034, "first_response_s": 12.381782075040974, "answer_total_s": 12.421589495963417, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_424_a672_q0", "video_id": 424, "time_stamp_s": 246, "ground_truth": "C", "raw_output": "C. Yellow.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "55d64ff1c2d6411b9c1920bb3beca520df7a0466557140322f9d4dd97f44cad7", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man with a beard, wearing a grey hoodie and headset, sits in a helicopter cockpit, looking at the camera.  \n- The helicopter's rotor blades are visible spinning rapidly above him, with the cityscape below.  \n- The man remains seated, with his hands on controls, as the helicopter appears to be in flight.\n[30-60s] - Pilot seated in helicopter cockpit, wearing headset and grey hoodie, looking forward with hands on controls.\n- Helicopter's rotor blades spin rapidly, visible through the canopy, as the aircraft hovers over a sprawling urban landscape.\n- View from cockpit shows a GPS device displaying coordinates, with the horizon and cityscape below under an overcast sky.\n[60-90s] - Pilot in grey hoodie and cap seated in helicopter cockpit, looking forward.  \n- Helicopter's interior dashboard and control sticks visible, with a GPS screen displaying map.  \n- Exterior view shows suburban landscape with roads, buildings, and open fields under overcast sky.\n[90-120s] - Pilot adjusts headset and looks toward camera while seated in helicopter cockpit.  \n- Helicopter interior shows control stick, seatbelt, and instrument panel with yellow-tipped lever.  \n- Exterior view through windshield shows open field and distant trees under overcast sky.\n[120-150s] - A man in a grey hoodie and black cap stands outside a store, holding a wallet and gesturing while speaking to the camera.  \n- The camera perspective shifts to show the man handing over a small object (possibly a card or key) to the person filming.  \n- The store's glass doors and interior signage are visible, with a parking lot and buildings in the background.\n[150-180s] - A man in a white hoodie and black cap stands outside a store, holding a phone and gesturing toward the entrance.\n- Two individuals, one in a black hoodie and another in a bright yellow safety vest, enter the store's revolving door, with the latter adjusting her hair.\n- The woman in the yellow vest steps out, facing the camera, while the man in the hoodie remains outside, observing the scene.\n[180-210s] - Two individuals, one in a bright yellow vest and another in a white hoodie, stand outside a glass door, appearing to exit a building.  \n- A black coffee cup is held by an unseen person, positioned near the door, suggesting a handoff or interaction.  \n- The scene transitions to an outdoor field with a helicopter parked, indicating a shift in location or activity.\n[210-240s] - Pilot in grey hoodie and headset sits in helicopter cockpit, hands on controls, looking at camera.  \n- Helicopter's rotating blades are visible above, with cityscape below.  \n- Interior dashboard and seat belts are clearly visible, with a yellow object near pilot's right hand.", "history_tokens": 608, "history_utf8_bytes": 2713, "recent_frame_times_s": [217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0], "recent_frames_sha256": "320d7fc9f3a9654ae02b3183b505bad1559f839443f6383f92cb7a6eec03d327", "num_recent_frames": 30, "tq": 718292.495786196, "t1": 718298.793441624, "ta": 718298.793441624, "te": 718298.945733494, "first_response_s": 6.297655428061262, "answer_total_s": 6.449947298038751, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 424, "content_group": "ec65363495c655b1504629500da65b45cdf66c3b6f20d18aaa1fafddb3a0ad34", "question": {"question_id": "sample_424_a673_q0", "video_id": 424, "video_path": "./videos/sample_424_real.mp4", "annotation_index": 673, "question_index": 0, "question": "What is the scene below the helicopter now?", "options": ["A. A lake.", "B. A forest.", "C. A mountain.", "D. A city."], "answer": "B", "time_stamp_s": 369, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [366, 371], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_424_a673_q0", "video_id": 424, "time_stamp_s": 369, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a118e17c0e96be8f5f3a9e53cfb1f28cab7f8c8c27d5017cec4d3aac06a5aee3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0], "recent_frames_sha256": "35ff18b00c97ff3fa33eeeacc50cf388c17e26ad795397f6ec01f9025d90d338", "num_recent_frames": 30, "tq": 718198.140165165, "t1": 718208.384130818, "ta": 718208.384130818, "te": 718208.421270709, "first_response_s": 10.243965653004125, "answer_total_s": 10.28110554406885, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_424_a673_q0", "video_id": 424, "time_stamp_s": 369, "ground_truth": "B", "raw_output": "B. A forest.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "41b50855d7970871baf146c639845e6d1b54207a7696bb1d65c8cd79897f1c57", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man with a beard, wearing a grey hoodie and headset, sits in a helicopter cockpit, looking at the camera.  \n- The helicopter's rotor blades are visible spinning rapidly above him, with the cityscape below.  \n- The man remains seated, with his hands on controls, as the helicopter appears to be in flight.\n[30-60s] - Pilot seated in helicopter cockpit, wearing headset and grey hoodie, looking forward with hands on controls.\n- Helicopter's rotor blades spin rapidly, visible through the canopy, as the aircraft hovers over a sprawling urban landscape.\n- View from cockpit shows a GPS device displaying coordinates, with the horizon and cityscape below under an overcast sky.\n[60-90s] - Pilot in grey hoodie and cap seated in helicopter cockpit, looking forward.  \n- Helicopter's interior dashboard and control sticks visible, with a GPS screen displaying map.  \n- Exterior view shows suburban landscape with roads, buildings, and open fields under overcast sky.\n[90-120s] - Pilot adjusts headset and looks toward camera while seated in helicopter cockpit.  \n- Helicopter interior shows control stick, seatbelt, and instrument panel with yellow-tipped lever.  \n- Exterior view through windshield shows open field and distant trees under overcast sky.\n[120-150s] - A man in a grey hoodie and black cap stands outside a store, holding a wallet and gesturing while speaking to the camera.  \n- The camera perspective shifts to show the man handing over a small object (possibly a card or key) to the person filming.  \n- The store's glass doors and interior signage are visible, with a parking lot and buildings in the background.\n[150-180s] - A man in a white hoodie and black cap stands outside a store, holding a phone and gesturing toward the entrance.\n- Two individuals, one in a black hoodie and another in a bright yellow safety vest, enter the store's revolving door, with the latter adjusting her hair.\n- The woman in the yellow vest steps out, facing the camera, while the man in the hoodie remains outside, observing the scene.\n[180-210s] - Two individuals, one in a bright yellow vest and another in a white hoodie, stand outside a glass door, appearing to exit a building.  \n- A black coffee cup is held by an unseen person, positioned near the door, suggesting a handoff or interaction.  \n- The scene transitions to an outdoor field with a helicopter parked, indicating a shift in location or activity.\n[210-240s] - Pilot in grey hoodie and headset sits in helicopter cockpit, hands on controls, looking at camera.  \n- Helicopter's rotating blades are visible above, with cityscape below.  \n- Interior dashboard and seat belts are clearly visible, with a yellow object near pilot's right hand.\n[240-270s] - Pilot seated in helicopter cockpit, wearing headset and grey hoodie, looking forward.  \n- Helicopter rotor blades spinning rapidly above, visible through transparent canopy.  \n- Cityscape and open terrain visible below, suggesting flight over urban or suburban area.\n[270-300s] - Pilot seated in helicopter cockpit, wearing headset and grey hoodie, looking forward.  \n- Helicopter rotor blades visible in motion above, with cityscape below.  \n- Interior cockpit features include control yoke, seatbelt, and overhead panel with instruments.\n[300-330s] - Pilot seated in cockpit, wearing headset and hoodie, looking forward with hands on controls.  \n- Helicopter interior visible, including seatbelt, dashboard, and rotating blades overhead.  \n- Landscape below shows urban sprawl with buildings and open fields under overcast sky.\n[330-360s] - Pilot in grey hoodie smiles while seated in helicopter cockpit, wearing headset.  \n- Helicopter flies over forested terrain with visible houses and open fields below.  \n- Camera pans slightly to show cockpit instruments and external view of landscape.", "history_tokens": 849, "history_utf8_bytes": 3821, "recent_frame_times_s": [340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0], "recent_frames_sha256": "35ff18b00c97ff3fa33eeeacc50cf388c17e26ad795397f6ec01f9025d90d338", "num_recent_frames": 30, "tq": 718333.850016189, "t1": 718342.227724995, "ta": 718342.227724995, "te": 718342.419156274, "first_response_s": 8.377708805957809, "answer_total_s": 8.569140084902756, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 424, "content_group": "ec65363495c655b1504629500da65b45cdf66c3b6f20d18aaa1fafddb3a0ad34", "question": {"question_id": "sample_424_a674_q0", "video_id": 424, "video_path": "./videos/sample_424_real.mp4", "annotation_index": 674, "question_index": 0, "question": "What text is displayed on the screen right now?", "options": ["A. \"I apologize for the inconvenience. The footage contains private information.\".", "B. \"The video has been temporarily removed.\".", "C. \"Unfortunately I had to remove the footage because there was private information on an aircraft that was shown.\".", "D. \"I lost some footage, so I'll record more in another video. Sorry!\"."], "answer": "C", "time_stamp_s": 490, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [488, 493], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_424_a674_q0", "video_id": 424, "time_stamp_s": 490, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4e530d5622ea02279d93411fb7f9c548de912ebe398079a27d680a15eab24145", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0], "recent_frames_sha256": "b74672cb91e04f91d435755031263ab770d2943642b85e91b414f675b68d968e", "num_recent_frames": 30, "tq": 718208.433045563, "t1": 718217.329653284, "ta": 718217.329653284, "te": 718217.371909578, "first_response_s": 8.896607720991597, "answer_total_s": 8.938864014926367, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_424_a674_q0", "video_id": 424, "time_stamp_s": 490, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "33d841915045655afd56d173fcf869943de57dd5f04cf90f785a167946a69d75", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Pilot in grey hoodie and cap seated in helicopter cockpit, looking forward.  \n- Helicopter's interior dashboard and control sticks visible, with a GPS screen displaying map.  \n- Exterior view shows suburban landscape with roads, buildings, and open fields under overcast sky.\n[90-120s] - Pilot adjusts headset and looks toward camera while seated in helicopter cockpit.  \n- Helicopter interior shows control stick, seatbelt, and instrument panel with yellow-tipped lever.  \n- Exterior view through windshield shows open field and distant trees under overcast sky.\n[120-150s] - A man in a grey hoodie and black cap stands outside a store, holding a wallet and gesturing while speaking to the camera.  \n- The camera perspective shifts to show the man handing over a small object (possibly a card or key) to the person filming.  \n- The store's glass doors and interior signage are visible, with a parking lot and buildings in the background.\n[150-180s] - A man in a white hoodie and black cap stands outside a store, holding a phone and gesturing toward the entrance.\n- Two individuals, one in a black hoodie and another in a bright yellow safety vest, enter the store's revolving door, with the latter adjusting her hair.\n- The woman in the yellow vest steps out, facing the camera, while the man in the hoodie remains outside, observing the scene.\n[180-210s] - Two individuals, one in a bright yellow vest and another in a white hoodie, stand outside a glass door, appearing to exit a building.  \n- A black coffee cup is held by an unseen person, positioned near the door, suggesting a handoff or interaction.  \n- The scene transitions to an outdoor field with a helicopter parked, indicating a shift in location or activity.\n[210-240s] - Pilot in grey hoodie and headset sits in helicopter cockpit, hands on controls, looking at camera.  \n- Helicopter's rotating blades are visible above, with cityscape below.  \n- Interior dashboard and seat belts are clearly visible, with a yellow object near pilot's right hand.\n[240-270s] - Pilot seated in helicopter cockpit, wearing headset and grey hoodie, looking forward.  \n- Helicopter rotor blades spinning rapidly above, visible through transparent canopy.  \n- Cityscape and open terrain visible below, suggesting flight over urban or suburban area.\n[270-300s] - Pilot seated in helicopter cockpit, wearing headset and grey hoodie, looking forward.  \n- Helicopter rotor blades visible in motion above, with cityscape below.  \n- Interior cockpit features include control yoke, seatbelt, and overhead panel with instruments.\n[300-330s] - Pilot seated in cockpit, wearing headset and hoodie, looking forward with hands on controls.  \n- Helicopter interior visible, including seatbelt, dashboard, and rotating blades overhead.  \n- Landscape below shows urban sprawl with buildings and open fields under overcast sky.\n[330-360s] - Pilot in grey hoodie smiles while seated in helicopter cockpit, wearing headset.  \n- Helicopter flies over forested terrain with visible houses and open fields below.  \n- Camera pans slightly to show cockpit instruments and external view of landscape.\n[360-390s] - Helicopter cockpit view shows rotating blades and instrument panel with a digital display.\n- Ground below features leafless trees, open fields, and scattered buildings under a partly cloudy sky.\n- Camera angle shifts slightly, revealing more of the horizon and distant landscape as the helicopter moves forward.\n[390-420s] - Helicopter cockpit view shows spinning blades and instrument panel with a mounted camera.  \n- Landscape below consists of bare trees, a dirt path, and a distant building, with the helicopter descending toward a grassy area.  \n- Sky is overcast with visible clouds, and the horizon shows a faint line of distant hills or water.\n[420-450s] - Helicopter cockpit view shows rotating blades and dashboard instruments as it descends toward a paved area.  \n- A large white hangar with multiple garage doors and a red vehicle parked nearby becomes prominent in the foreground.  \n- The helicopter’s forward motion brings the hangar and surrounding trees into clearer focus, with the ground gradually approaching.\n[450-480s] - Helicopter cockpit view shows pilot’s hands on controls, with a large white hangar in the background.  \n- Pilot’s feet are visible on the foot pedals, and a headset hangs near the pilot’s head.  \n- The helicopter lifts off from the tarmac, ascending into the air with trees and hills visible in the distance.", "history_tokens": 996, "history_utf8_bytes": 4506, "recent_frame_times_s": [461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0], "recent_frames_sha256": "b74672cb91e04f91d435755031263ab770d2943642b85e91b414f675b68d968e", "num_recent_frames": 30, "tq": 718377.649631532, "t1": 718384.484848761, "ta": 718384.484848761, "te": 718384.860995503, "first_response_s": 6.835217228974216, "answer_total_s": 7.211363971000537, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 425, "content_group": "d97f2310c177a9573e5d2d81d0a824e982a7b55ed4224f36e7b58ff423ffa2e0", "question": {"question_id": "sample_425_a638_q0", "video_id": 425, "video_path": "./videos/sample_425_real.mp4", "annotation_index": 638, "question_index": 0, "question": "What is the primary color of the lever located on the left side of the cockpit?", "options": ["A. Red.", "B. Yellow.", "C. Blue.", "D. Green."], "answer": "C", "time_stamp_s": 2, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_425_a638_q0", "video_id": 425, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "eeba2701a778b06f438c010e54d0a2cf453bc080fe76b741d8f765707b49de95", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001], "recent_frames_sha256": "658488e23997f8b3efce7aaab06a54b713312c119d6e50f43353fa13c81d28a2", "num_recent_frames": 2, "tq": 718251.515754437, "t1": 718257.407500373, "ta": 718257.407500373, "te": 718257.445123991, "first_response_s": 5.891745936009102, "answer_total_s": 5.929369554040022, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_425_a638_q0", "video_id": 425, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a8f07d183a341704d757d38fe467c8f3dc962dca276ae95b31028b211bd44d90", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001], "recent_frames_sha256": "658488e23997f8b3efce7aaab06a54b713312c119d6e50f43353fa13c81d28a2", "num_recent_frames": 2, "tq": 718145.159649921, "t1": 718158.690648971, "ta": 718158.690648971, "te": 718158.892708691, "first_response_s": 13.530999050009996, "answer_total_s": 13.733058769954368, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 425, "content_group": "d97f2310c177a9573e5d2d81d0a824e982a7b55ed4224f36e7b58ff423ffa2e0", "question": {"question_id": "sample_425_a639_q0", "video_id": 425, "video_path": "./videos/sample_425_real.mp4", "annotation_index": 639, "question_index": 0, "question": "What is the predominant color of the device on the right side of the cockpit?", "options": ["A. Green.", "B. Blue.", "C. Yellow.", "D. Black."], "answer": "D", "time_stamp_s": 77, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [75, 80], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_425_a639_q0", "video_id": 425, "time_stamp_s": 77, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f7c2a9302fb44098083ae948cedc10f67d4731baf8b6e4c8143e79b0a013158f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666], "recent_frames_sha256": "1e7ea9a285319e0760379a7925ff58777f4076885ed83530f94c8906b5000be2", "num_recent_frames": 30, "tq": 718257.459159288, "t1": 718265.321666095, "ta": 718265.321666095, "te": 718265.361342985, "first_response_s": 7.862506807083264, "answer_total_s": 7.902183696976863, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_425_a639_q0", "video_id": 425, "time_stamp_s": 77, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "fa0341576bf181cebdc227e289be4f676fc5444e42da0f9c26b1302e65e8cfe7", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pilot's hand gestures toward a WeCride map overlay showing flight path and weather data.  \n- Aircraft cockpit view reveals control stick, gauges, and a digital display with navigation information.  \n- Landscape below transitions from urban areas to green fields as the aircraft descends.\n[30-60s] - Pilot's hand grips blue control stick, maintaining steady flight over green fields.  \n- Aircraft's cockpit displays show stable instruments, with a digital screen indicating flight data.  \n- Landscape features rolling green fields, distant trees, and scattered orange markers along the runway.", "history_tokens": 124, "history_utf8_bytes": 602, "recent_frame_times_s": [47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666], "recent_frames_sha256": "1e7ea9a285319e0760379a7925ff58777f4076885ed83530f94c8906b5000be2", "num_recent_frames": 30, "tq": 718178.694508834, "t1": 718185.151312913, "ta": 718185.151312913, "te": 718185.190327211, "first_response_s": 6.456804079003632, "answer_total_s": 6.495818377006799, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 425, "content_group": "d97f2310c177a9573e5d2d81d0a824e982a7b55ed4224f36e7b58ff423ffa2e0", "question": {"question_id": "sample_425_a640_q0", "video_id": 425, "video_path": "./videos/sample_425_real.mp4", "annotation_index": 640, "question_index": 0, "question": "What is visible on the screen in the cockpit right now?", "options": ["A. A speedometer.", "B. A map.", "C. An altimeter.", "D. A radar."], "answer": "B", "time_stamp_s": 154, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [150, 155], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_425_a640_q0", "video_id": 425, "time_stamp_s": 154, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b919ebc6f5bc4f72fe6029bc5fc1c11535e7bfb6a9ce0bf343ebf4bb32298f05", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333], "recent_frames_sha256": "43f10d3827ac981361ea4a343cb2af6b91dc48288e5fddb1ddd3c151a6cc908b", "num_recent_frames": 30, "tq": 718265.373740219, "t1": 718278.454053009, "ta": 718278.454053009, "te": 718278.492323398, "first_response_s": 13.08031278999988, "answer_total_s": 13.11858317896258, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_425_a640_q0", "video_id": 425, "time_stamp_s": 154, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d16a900271e5531c74c4e08bb574ec3d12212f40898d75a7f11b1ec9aa14d050", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pilot's hand gestures toward a WeCride map overlay showing flight path and weather data.  \n- Aircraft cockpit view reveals control stick, gauges, and a digital display with navigation information.  \n- Landscape below transitions from urban areas to green fields as the aircraft descends.\n[30-60s] - Pilot's hand grips blue control stick, maintaining steady flight over green fields.  \n- Aircraft's cockpit displays show stable instruments, with a digital screen indicating flight data.  \n- Landscape features rolling green fields, distant trees, and scattered orange markers along the runway.\n[60-90s] - Pilot's hand grips blue control stick while aircraft accelerates on grass runway.  \n- Dashboard displays active flight instruments and digital map; aircraft lifts off.  \n- Sky transitions from partly cloudy to overcast as aircraft ascends, revealing distant terrain.\n[90-120s] - Pilot's hands manipulate control stick and blue knob while seated in glider cockpit.  \n- Dashboard displays multiple gauges and a digital map; aircraft maintains steady flight.  \n- Landscape below transitions from cloudy sky to green fields and distant mountains.\n[120-150s] - Pilot's hands manipulate controls as the glider descends toward a grassy field.  \n- A white building and parked vehicles become visible on the left as the glider approaches the landing zone.  \n- The glider's cockpit instruments display flight data, with the horizon and clouds visible through the windshield.", "history_tokens": 312, "history_utf8_bytes": 1478, "recent_frame_times_s": [124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333], "recent_frames_sha256": "43f10d3827ac981361ea4a343cb2af6b91dc48288e5fddb1ddd3c151a6cc908b", "num_recent_frames": 30, "tq": 718207.351747142, "t1": 718210.288159411, "ta": 718210.288159411, "te": 718210.329516989, "first_response_s": 2.936412269016728, "answer_total_s": 2.977769846911542, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 425, "content_group": "d97f2310c177a9573e5d2d81d0a824e982a7b55ed4224f36e7b58ff423ffa2e0", "question": {"question_id": "sample_425_a641_q0", "video_id": 425, "video_path": "./videos/sample_425_real.mp4", "annotation_index": 641, "question_index": 0, "question": "What is the current weather condition outside the cockpit?", "options": ["A. Clear skies.", "B. Cloudy skies with light rain.", "C. Snowfall.", "D. Heavy thunderstorms."], "answer": "B", "time_stamp_s": 227, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [225, 230], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_425_a641_q0", "video_id": 425, "time_stamp_s": 227, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "90bdcac2ee4dff1d532c73f082abcbf5138a6a809255ab2bedc17298a7ea1be7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258], "recent_frames_sha256": "52a28114e94489f6620f79774ac2eaf543687426604c0ec3da83fa43275b7f5b", "num_recent_frames": 30, "tq": 718278.511381075, "t1": 718286.255827821, "ta": 718286.255827821, "te": 718286.293261964, "first_response_s": 7.744446745957248, "answer_total_s": 7.7818808889715, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_425_a641_q0", "video_id": 425, "time_stamp_s": 227, "ground_truth": "B", "raw_output": "B. Cloudy skies with light rain.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "832420cf0b1b631679d38652ed851d9b9ea9f6468a90e5ad4355364cab9a1c96", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pilot's hand gestures toward a WeCride map overlay showing flight path and weather data.  \n- Aircraft cockpit view reveals control stick, gauges, and a digital display with navigation information.  \n- Landscape below transitions from urban areas to green fields as the aircraft descends.\n[30-60s] - Pilot's hand grips blue control stick, maintaining steady flight over green fields.  \n- Aircraft's cockpit displays show stable instruments, with a digital screen indicating flight data.  \n- Landscape features rolling green fields, distant trees, and scattered orange markers along the runway.\n[60-90s] - Pilot's hand grips blue control stick while aircraft accelerates on grass runway.  \n- Dashboard displays active flight instruments and digital map; aircraft lifts off.  \n- Sky transitions from partly cloudy to overcast as aircraft ascends, revealing distant terrain.\n[90-120s] - Pilot's hands manipulate control stick and blue knob while seated in glider cockpit.  \n- Dashboard displays multiple gauges and a digital map; aircraft maintains steady flight.  \n- Landscape below transitions from cloudy sky to green fields and distant mountains.\n[120-150s] - Pilot's hands manipulate controls as the glider descends toward a grassy field.  \n- A white building and parked vehicles become visible on the left as the glider approaches the landing zone.  \n- The glider's cockpit instruments display flight data, with the horizon and clouds visible through the windshield.\n[150-180s] - Pilot’s hands grip controls, with left hand on blue joystick and right hand on orange throttle.  \n- Instrument panel displays navigation map and gauges, with a digital screen showing flight data.  \n- Aircraft moves forward on grass runway under cloudy sky, with distant buildings and trees visible.\n[180-210s] - Pilot’s hand grips blue control stick, maintaining steady flight posture.\n- Instrument panel displays active navigation map and flight instruments, with altitude and speed readings.\n- Cloud cover shifts dynamically overhead, with raindrops visible on cockpit windshield.", "history_tokens": 436, "history_utf8_bytes": 2078, "recent_frame_times_s": [197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258], "recent_frames_sha256": "52a28114e94489f6620f79774ac2eaf543687426604c0ec3da83fa43275b7f5b", "num_recent_frames": 30, "tq": 718223.511491439, "t1": 718225.69619201, "ta": 718225.69619201, "te": 718226.039639936, "first_response_s": 2.184700571000576, "answer_total_s": 2.5281484969891608, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 425, "content_group": "d97f2310c177a9573e5d2d81d0a824e982a7b55ed4224f36e7b58ff423ffa2e0", "question": {"question_id": "sample_425_a642_q0", "video_id": 425, "video_path": "./videos/sample_425_real.mp4", "annotation_index": 642, "question_index": 0, "question": "What is the pilot holding in his left hand right now?", "options": ["A. A joystick.", "B. A blue handle.", "C. A map.", "D. A throttle lever."], "answer": "B", "time_stamp_s": 307, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [300, 305], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_425_a642_q0", "video_id": 425, "time_stamp_s": 307, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b52f8376dad077e6791e0a57f9f48a79a9facf8d2be8517f2008f679a45ba453", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057], "recent_frames_sha256": "4f510748bfea496291ad9078bf2e579058c0ae70ce26e5994e4a378896d5e5c4", "num_recent_frames": 30, "tq": 718286.309507462, "t1": 718300.097115546, "ta": 718300.097115546, "te": 718300.137629983, "first_response_s": 13.787608084036037, "answer_total_s": 13.828122521052137, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_425_a642_q0", "video_id": 425, "time_stamp_s": 307, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c84e2609ffcf7b5ddd7569d1e7b16eb728067042756da2793ab05574d79784de", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pilot's hand gestures toward a WeCride map overlay showing flight path and weather data.  \n- Aircraft cockpit view reveals control stick, gauges, and a digital display with navigation information.  \n- Landscape below transitions from urban areas to green fields as the aircraft descends.\n[30-60s] - Pilot's hand grips blue control stick, maintaining steady flight over green fields.  \n- Aircraft's cockpit displays show stable instruments, with a digital screen indicating flight data.  \n- Landscape features rolling green fields, distant trees, and scattered orange markers along the runway.\n[60-90s] - Pilot's hand grips blue control stick while aircraft accelerates on grass runway.  \n- Dashboard displays active flight instruments and digital map; aircraft lifts off.  \n- Sky transitions from partly cloudy to overcast as aircraft ascends, revealing distant terrain.\n[90-120s] - Pilot's hands manipulate control stick and blue knob while seated in glider cockpit.  \n- Dashboard displays multiple gauges and a digital map; aircraft maintains steady flight.  \n- Landscape below transitions from cloudy sky to green fields and distant mountains.\n[120-150s] - Pilot's hands manipulate controls as the glider descends toward a grassy field.  \n- A white building and parked vehicles become visible on the left as the glider approaches the landing zone.  \n- The glider's cockpit instruments display flight data, with the horizon and clouds visible through the windshield.\n[150-180s] - Pilot’s hands grip controls, with left hand on blue joystick and right hand on orange throttle.  \n- Instrument panel displays navigation map and gauges, with a digital screen showing flight data.  \n- Aircraft moves forward on grass runway under cloudy sky, with distant buildings and trees visible.\n[180-210s] - Pilot’s hand grips blue control stick, maintaining steady flight posture.\n- Instrument panel displays active navigation map and flight instruments, with altitude and speed readings.\n- Cloud cover shifts dynamically overhead, with raindrops visible on cockpit windshield.\n[210-240s] - Pilot’s hand adjusts controls while flying through cloudy skies.  \n- Aircraft’s cockpit displays navigation map and instruments, with a blue object visible on the left.  \n- Landscape below shows patchwork fields and towns, with clouds moving overhead.\n[240-270s] - Pilot’s left hand grips a blue control stick while right hand rests near orange throttle lever.  \n- Instrument panel displays GPS map and altimeter, with altitude reading around 1600m.  \n- Cloud cover intensifies overhead, with snow shower warning text visible at 1600m altitude.\n[270-300s] - Pilot's left hand grips blue control stick, making minor adjustments while flying.\n- Instrument panel displays altitude, speed, and navigation data; digital screen shows map and flight path.\n- Clouds drift overhead, casting dynamic shadows over the green, patchwork landscape below.", "history_tokens": 632, "history_utf8_bytes": 2938, "recent_frame_times_s": [277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057], "recent_frames_sha256": "4f510748bfea496291ad9078bf2e579058c0ae70ce26e5994e4a378896d5e5c4", "num_recent_frames": 30, "tq": 718251.040928646, "t1": 718251.46676454, "ta": 718251.46676454, "te": 718251.504527381, "first_response_s": 0.4258358939550817, "answer_total_s": 0.46359873504843563, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 426, "content_group": "219e5b463d855466d41a7807d4a021a458bf2b57f6fe9b434bbf6e1a771053be", "question": {"question_id": "sample_426_a951_q0", "video_id": 426, "video_path": "./videos/sample_426_real.mp4", "annotation_index": 951, "question_index": 0, "question": "What is mounted on the left side of the helicopter cockpit right now?", "options": ["A. A phone.", "B. A GPS device.", "C. A tablet.", "D. A camera."], "answer": "C", "time_stamp_s": 4, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_426_a951_q0", "video_id": 426, "time_stamp_s": 4, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b73393ec93be7f8de3835eed6cc3654583554dc289493bf8b5cf168ff42e1b79", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0], "recent_frames_sha256": "150c95202f19878f3fadeb56a1662277b71ecf70dab6278ef8df7abf46d3afa7", "num_recent_frames": 5, "tq": 715856.138109978, "t1": 715861.161626773, "ta": 715861.161626773, "te": 715861.199137111, "first_response_s": 5.0235167948994786, "answer_total_s": 5.06102713290602, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_426_a951_q0", "video_id": 426, "time_stamp_s": 4, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b40be4fe01e1a3fae20fb3c9fd5578f85e3731c02b7ff879c865fc236f3a352e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0], "recent_frames_sha256": "150c95202f19878f3fadeb56a1662277b71ecf70dab6278ef8df7abf46d3afa7", "num_recent_frames": 5, "tq": 715697.999839781, "t1": 715699.318214045, "ta": 715699.318214045, "te": 715699.356721955, "first_response_s": 1.3183742640540004, "answer_total_s": 1.3568821740336716, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 426, "content_group": "219e5b463d855466d41a7807d4a021a458bf2b57f6fe9b434bbf6e1a771053be", "question": {"question_id": "sample_426_a952_q0", "video_id": 426, "video_path": "./videos/sample_426_real.mp4", "annotation_index": 952, "question_index": 0, "question": "What type of store is the person in right now?", "options": ["A. A clothing store.", "B. A pet store.", "C. A grocery store.", "D. A costco."], "answer": "D", "time_stamp_s": 196, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [129, 134], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_426_a952_q0", "video_id": 426, "time_stamp_s": 196, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6bf8b8392e25ab150230eb7ec923fe5c8177deb0f0caff0f815599bf04d23e52", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0], "recent_frames_sha256": "f757f58c88e0150dd47241d0bf1eb2655d5cef40faf4d15a9dfc40b194f1a465", "num_recent_frames": 30, "tq": 715861.211052532, "t1": 715872.406232951, "ta": 715872.406232951, "te": 715872.4463978, "first_response_s": 11.19518041901756, "answer_total_s": 11.235345268039964, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_426_a952_q0", "video_id": 426, "time_stamp_s": 196, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c4173b0b0234b44b1b9f146bdfa8c9d4872d5da977601912a7fb5b71c65cd9dd", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man with a beard, wearing a 'FLY' t-shirt and a helmet-mounted camera, sits in a helicopter cockpit, gesturing with his hands while speaking.  \n- The helicopter's interior features a black seat, yellow control levers, and a clear canopy offering a view of green fields and blue sky below.  \n- The man occasionally points outward, indicating the landscape or aircraft controls, while remaining seated and secured with a seatbelt.\n[30-60s] - Pilot gestures with right hand while seated in helicopter cockpit, facing camera.  \n- Helicopter flies over green fields and urban area, with visible river and industrial buildings below.  \n- Pilot adjusts controls and looks ahead, with helicopter's rotor blades spinning in view.\n[60-90s] - Pilot seated in helicopter cockpit, hands on controls, looking forward.  \n- Helicopter flying low over green fields and urban structures, with rotor blades visible.  \n- Clear blue sky with scattered clouds above, indicating daytime flight.\n[90-120s] - Man in helicopter cockpit gestures while speaking, with landscape visible through canopy.  \n- Man exits helicopter, standing outdoors under bright sun, speaking to camera with fence and sign in background.  \n- Hand reaches for \"Milk-Bone\" dog treats on store shelf, selecting a package.\n[120-150s] - Man holds a red \"Milk-Bone\" dog treat box while standing in a brightly lit warehouse store aisle.  \n- He turns to face the camera, smiling, with shelves of pet products and overhead signs visible in the background.  \n- Scene transitions to an outdoor parking lot under a clear blue sky, with cars parked and the man standing beside a dark SUV.\n[150-180s] - Man with beard and cap smiles while standing outdoors under bright sun, near a brick wall with red stripe and parking lot.  \n- Camera pans to show interior of a large store with high ceilings, shelves stocked with goods, and shoppers moving around.  \n- Close-up of hand reaching into a green basket filled with packaged food items on a store shelf.", "history_tokens": 446, "history_utf8_bytes": 2001, "recent_frame_times_s": [167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0], "recent_frames_sha256": "f757f58c88e0150dd47241d0bf1eb2655d5cef40faf4d15a9dfc40b194f1a465", "num_recent_frames": 30, "tq": 715750.289494012, "t1": 715752.019430933, "ta": 715752.019430933, "te": 715752.255979725, "first_response_s": 1.7299369210377336, "answer_total_s": 1.9664857130264863, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 426, "content_group": "219e5b463d855466d41a7807d4a021a458bf2b57f6fe9b434bbf6e1a771053be", "question": {"question_id": "sample_426_a953_q0", "video_id": 426, "video_path": "./videos/sample_426_real.mp4", "annotation_index": 953, "question_index": 0, "question": "What brand of chips is in the shopping cart right now?", "options": ["A. Lay's.", "B. Pringles.", "C. Miss Vickie's.", "D. Doritos."], "answer": "C", "time_stamp_s": 262, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [258, 263], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_426_a953_q0", "video_id": 426, "time_stamp_s": 262, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9f379018fdab99ff401503f7b6ca4d25ef2fbe17367bfea2028002d2c62f20b5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0], "recent_frames_sha256": "f85be05f05bae32d89b45c509dcedceb5698b59af0ad9d0e53f903bd84db6ada", "num_recent_frames": 30, "tq": 715872.460822366, "t1": 715883.862844665, "ta": 715883.862844665, "te": 715883.900500615, "first_response_s": 11.402022299007513, "answer_total_s": 11.439678249065764, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_426_a953_q0", "video_id": 426, "time_stamp_s": 262, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "060d6d31949da29f62041081083cbe5cf0ce07bd9c972f98177fb98d1b28408f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man with a beard, wearing a 'FLY' t-shirt and a helmet-mounted camera, sits in a helicopter cockpit, gesturing with his hands while speaking.  \n- The helicopter's interior features a black seat, yellow control levers, and a clear canopy offering a view of green fields and blue sky below.  \n- The man occasionally points outward, indicating the landscape or aircraft controls, while remaining seated and secured with a seatbelt.\n[30-60s] - Pilot gestures with right hand while seated in helicopter cockpit, facing camera.  \n- Helicopter flies over green fields and urban area, with visible river and industrial buildings below.  \n- Pilot adjusts controls and looks ahead, with helicopter's rotor blades spinning in view.\n[60-90s] - Pilot seated in helicopter cockpit, hands on controls, looking forward.  \n- Helicopter flying low over green fields and urban structures, with rotor blades visible.  \n- Clear blue sky with scattered clouds above, indicating daytime flight.\n[90-120s] - Man in helicopter cockpit gestures while speaking, with landscape visible through canopy.  \n- Man exits helicopter, standing outdoors under bright sun, speaking to camera with fence and sign in background.  \n- Hand reaches for \"Milk-Bone\" dog treats on store shelf, selecting a package.\n[120-150s] - Man holds a red \"Milk-Bone\" dog treat box while standing in a brightly lit warehouse store aisle.  \n- He turns to face the camera, smiling, with shelves of pet products and overhead signs visible in the background.  \n- Scene transitions to an outdoor parking lot under a clear blue sky, with cars parked and the man standing beside a dark SUV.\n[150-180s] - Man with beard and cap smiles while standing outdoors under bright sun, near a brick wall with red stripe and parking lot.  \n- Camera pans to show interior of a large store with high ceilings, shelves stocked with goods, and shoppers moving around.  \n- Close-up of hand reaching into a green basket filled with packaged food items on a store shelf.\n[180-210s] - Hand reaches for a package of \"Bounty\" paper towels on a pallet.  \n- A man in a grey shirt and cap gestures toward stacked blue pallets while speaking.  \n- A hand holds a black bag, preparing to carry items, near a display of canned goods.\n[210-240s] - Man in green shirt and cap smiles while gesturing toward shelves stocked with cereal boxes.  \n- He points to two jars of \"Dietary Fiber\" on a wooden surface, likely a display or counter.  \n- Camera pans to show aisles with snack items like \"Ruffles\" and \"Crisps\" as he pushes a shopping cart.", "history_tokens": 595, "history_utf8_bytes": 2560, "recent_frame_times_s": [233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0], "recent_frames_sha256": "f85be05f05bae32d89b45c509dcedceb5698b59af0ad9d0e53f903bd84db6ada", "num_recent_frames": 30, "tq": 715772.359666604, "t1": 715780.969493707, "ta": 715780.969493707, "te": 715781.196293474, "first_response_s": 8.609827102976851, "answer_total_s": 8.83662686997559, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 426, "content_group": "219e5b463d855466d41a7807d4a021a458bf2b57f6fe9b434bbf6e1a771053be", "question": {"question_id": "sample_426_a954_q0", "video_id": 426, "video_path": "./videos/sample_426_real.mp4", "annotation_index": 954, "question_index": 0, "question": "What brand of paper towels is visible on the ground right now?", "options": ["A. Bounty.", "B. Scott.", "C. Viva.", "D. Sparkle."], "answer": "B", "time_stamp_s": 391, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [387, 392], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_426_a954_q0", "video_id": 426, "time_stamp_s": 391, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7ccddcde1e47c8cebedf843cf416fbb1a825057f0256381d2bba8bc8a3b68540", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0], "recent_frames_sha256": "e9788f463d42d2f985e438d40e399cde5d8d632254010c6949856aa46162ce28", "num_recent_frames": 30, "tq": 715883.9097387, "t1": 715898.75055371, "ta": 715898.75055371, "te": 715898.787656978, "first_response_s": 14.840815010014921, "answer_total_s": 14.877918277983554, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_426_a954_q0", "video_id": 426, "time_stamp_s": 391, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ec5317a1c8f5b2952e530c9d7724fa61a1aecba4b27dd23f6ac1c20497a2a56b", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man with a beard, wearing a 'FLY' t-shirt and a helmet-mounted camera, sits in a helicopter cockpit, gesturing with his hands while speaking.  \n- The helicopter's interior features a black seat, yellow control levers, and a clear canopy offering a view of green fields and blue sky below.  \n- The man occasionally points outward, indicating the landscape or aircraft controls, while remaining seated and secured with a seatbelt.\n[30-60s] - Pilot gestures with right hand while seated in helicopter cockpit, facing camera.  \n- Helicopter flies over green fields and urban area, with visible river and industrial buildings below.  \n- Pilot adjusts controls and looks ahead, with helicopter's rotor blades spinning in view.\n[60-90s] - Pilot seated in helicopter cockpit, hands on controls, looking forward.  \n- Helicopter flying low over green fields and urban structures, with rotor blades visible.  \n- Clear blue sky with scattered clouds above, indicating daytime flight.\n[90-120s] - Man in helicopter cockpit gestures while speaking, with landscape visible through canopy.  \n- Man exits helicopter, standing outdoors under bright sun, speaking to camera with fence and sign in background.  \n- Hand reaches for \"Milk-Bone\" dog treats on store shelf, selecting a package.\n[120-150s] - Man holds a red \"Milk-Bone\" dog treat box while standing in a brightly lit warehouse store aisle.  \n- He turns to face the camera, smiling, with shelves of pet products and overhead signs visible in the background.  \n- Scene transitions to an outdoor parking lot under a clear blue sky, with cars parked and the man standing beside a dark SUV.\n[150-180s] - Man with beard and cap smiles while standing outdoors under bright sun, near a brick wall with red stripe and parking lot.  \n- Camera pans to show interior of a large store with high ceilings, shelves stocked with goods, and shoppers moving around.  \n- Close-up of hand reaching into a green basket filled with packaged food items on a store shelf.\n[180-210s] - Hand reaches for a package of \"Bounty\" paper towels on a pallet.  \n- A man in a grey shirt and cap gestures toward stacked blue pallets while speaking.  \n- A hand holds a black bag, preparing to carry items, near a display of canned goods.\n[210-240s] - Man in green shirt and cap smiles while gesturing toward shelves stocked with cereal boxes.  \n- He points to two jars of \"Dietary Fiber\" on a wooden surface, likely a display or counter.  \n- Camera pans to show aisles with snack items like \"Ruffles\" and \"Crisps\" as he pushes a shopping cart.\n[240-270s] - Man in green shirt and cap speaks to camera while standing in warehouse aisle.  \n- Shopping cart contains green bag, black bag, and a small item near the man's hand.  \n- Shelves behind him are stocked with large pallets of packaged goods, including purple and blue products.\n[270-300s] - Man in green shirt and cap speaks to camera while standing in aisle with tall shelves of packaged goods behind him.  \n- He gestures with hands while talking, occasionally looking around the store.  \n- Camera angle is low, capturing ceiling lights and shelves extending into background.\n[300-330s] - A person in a green shirt and black shorts is seen reaching for a stack of bottled water on a high shelf.  \n- They then bend down to place a large pack of bottled water into a shopping cart positioned nearby.  \n- The cart is already partially filled with other items, including a bag of paper towels and a box of cereal.\n[330-360s] - Hand selects a large package of Scott paper towels from a shelf, placing it into a shopping cart.  \n- Cart is pushed along an aisle lined with stacked paper towel products, including Bounty and Scott brands.  \n- A person wearing a cap and light-colored shirt is seen from a low-angle perspective, looking up at the ceiling and shelves while shopping.\n[360-390s] - Man in cap and green shirt gestures toward a black bag on asphalt, then points to a phone screen showing a load diagram.  \n- Phone screen displays \"Load\" with a diagram of a vehicle's weight distribution and a \"Longitudinal CG\" graph.  \n- Man turns to face camera, speaking while standing on a paved road under a clear blue sky.", "history_tokens": 972, "history_utf8_bytes": 4187, "recent_frame_times_s": [362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0], "recent_frames_sha256": "e9788f463d42d2f985e438d40e399cde5d8d632254010c6949856aa46162ce28", "num_recent_frames": 30, "tq": 715816.292098586, "t1": 715817.351336095, "ta": 715817.351336095, "te": 715817.389505967, "first_response_s": 1.059237509034574, "answer_total_s": 1.0974073810502887, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 426, "content_group": "219e5b463d855466d41a7807d4a021a458bf2b57f6fe9b434bbf6e1a771053be", "question": {"question_id": "sample_426_a955_q0", "video_id": 426, "video_path": "./videos/sample_426_real.mp4", "annotation_index": 955, "question_index": 0, "question": "Which brand of bottled water is visible on the passenger seat right now?", "options": ["A. Dasani.", "B. Evian.", "C. Ice Mountain.", "D. Aquafina."], "answer": "C", "time_stamp_s": 519, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [516, 521], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_426_a955_q0", "video_id": 426, "time_stamp_s": 519, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "35621b87e9866d7bf817ff150b5c6634d9b74d4dc2d3f9f22bcb40024beda5fd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0, 519.0], "recent_frames_sha256": "bf0a7d2301fa59747058d6a5809a5ac4a004c7e4c809cc1ca13bdd60fdcfbd18", "num_recent_frames": 30, "tq": 715898.798185713, "t1": 715905.066947566, "ta": 715905.066947566, "te": 715905.104406866, "first_response_s": 6.268761852988973, "answer_total_s": 6.306221153005026, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_426_a955_q0", "video_id": 426, "time_stamp_s": 519, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "84ae5853055338792ba17c59caeb91ec86cf1f46132aca3a6e7b46f66705979d", "condition_order": ["notes", "recent"], "memory": "[120-150s] - Man holds a red \"Milk-Bone\" dog treat box while standing in a brightly lit warehouse store aisle.  \n- He turns to face the camera, smiling, with shelves of pet products and overhead signs visible in the background.  \n- Scene transitions to an outdoor parking lot under a clear blue sky, with cars parked and the man standing beside a dark SUV.\n[150-180s] - Man with beard and cap smiles while standing outdoors under bright sun, near a brick wall with red stripe and parking lot.  \n- Camera pans to show interior of a large store with high ceilings, shelves stocked with goods, and shoppers moving around.  \n- Close-up of hand reaching into a green basket filled with packaged food items on a store shelf.\n[180-210s] - Hand reaches for a package of \"Bounty\" paper towels on a pallet.  \n- A man in a grey shirt and cap gestures toward stacked blue pallets while speaking.  \n- A hand holds a black bag, preparing to carry items, near a display of canned goods.\n[210-240s] - Man in green shirt and cap smiles while gesturing toward shelves stocked with cereal boxes.  \n- He points to two jars of \"Dietary Fiber\" on a wooden surface, likely a display or counter.  \n- Camera pans to show aisles with snack items like \"Ruffles\" and \"Crisps\" as he pushes a shopping cart.\n[240-270s] - Man in green shirt and cap speaks to camera while standing in warehouse aisle.  \n- Shopping cart contains green bag, black bag, and a small item near the man's hand.  \n- Shelves behind him are stocked with large pallets of packaged goods, including purple and blue products.\n[270-300s] - Man in green shirt and cap speaks to camera while standing in aisle with tall shelves of packaged goods behind him.  \n- He gestures with hands while talking, occasionally looking around the store.  \n- Camera angle is low, capturing ceiling lights and shelves extending into background.\n[300-330s] - A person in a green shirt and black shorts is seen reaching for a stack of bottled water on a high shelf.  \n- They then bend down to place a large pack of bottled water into a shopping cart positioned nearby.  \n- The cart is already partially filled with other items, including a bag of paper towels and a box of cereal.\n[330-360s] - Hand selects a large package of Scott paper towels from a shelf, placing it into a shopping cart.  \n- Cart is pushed along an aisle lined with stacked paper towel products, including Bounty and Scott brands.  \n- A person wearing a cap and light-colored shirt is seen from a low-angle perspective, looking up at the ceiling and shelves while shopping.\n[360-390s] - Man in cap and green shirt gestures toward a black bag on asphalt, then points to a phone screen showing a load diagram.  \n- Phone screen displays \"Load\" with a diagram of a vehicle's weight distribution and a \"Longitudinal CG\" graph.  \n- Man turns to face camera, speaking while standing on a paved road under a clear blue sky.\n[390-420s] - A man in a green shirt and black cap smiles at the camera while standing near a blue helicopter on a grassy field.  \n- Hands are seen placing a large package of bottled water into a black bag inside a car seat, then securing it with a red strap.  \n- The helicopter, marked with N815ST and \"R44\" on its side, is parked on grass with its rotor blades stationary, and a person is visible inside the cockpit.\n[420-450s] - A person places a large blue bag of \"Low Sodium\" chips into the helicopter's cockpit area.  \n- The helicopter's interior, including seats and controls, is visible as the person adjusts items inside.  \n- The person’s hand is seen reaching into the helicopter, organizing or securing the bag near the pilot’s seat.\n[450-480s] - Man in green shirt and cap gestures toward helicopter blades while speaking.  \n- Hand reaches into open cargo area, adjusting or retrieving items like snacks and bottled water.  \n- Helicopter interior shows packed supplies, including a bag of bread and plastic-wrapped items, near the passenger seat.\n[480-510s] - Pilot adjusts controls while seated in helicopter cockpit, preparing for takeoff.  \n- Helicopter begins to lift off from grassy field, rotor blades spinning rapidly.  \n- Exterior view shows helicopter ascending into clear blue sky, with trees and buildings in background.", "history_tokens": 1004, "history_utf8_bytes": 4251, "recent_frame_times_s": [490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0, 519.0], "recent_frames_sha256": "bf0a7d2301fa59747058d6a5809a5ac4a004c7e4c809cc1ca13bdd60fdcfbd18", "num_recent_frames": 30, "tq": 715855.283140962, "t1": 715856.085932479, "ta": 715856.085932479, "te": 715856.123458362, "first_response_s": 0.8027915169950575, "answer_total_s": 0.8403173999395221, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 427, "content_group": "e66bac6e0e7d4031dfddbaba2ccab077bc37f46bae15335d33cb1a7114e3a914", "question": {"question_id": "sample_427_a1344_q0", "video_id": 427, "video_path": "./videos/sample_427_real.mp4", "annotation_index": 1344, "question_index": 0, "question": "What color is the man's shirt right now?", "options": ["A. Blue.", "B. Red.", "C. Black.", "D. White."], "answer": "D", "time_stamp_s": 5, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_427_a1344_q0", "video_id": 427, "time_stamp_s": 5, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ab57bc88873b442912bac6f88b58ce783f253945995521890a79b1072eb5267c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "f164f7dcde4398f576eb7289e4b5615d85a8cc754261a103ee1b52b950fd0b0a", "num_recent_frames": 6, "tq": 718107.926147108, "t1": 718119.288091172, "ta": 718119.288091172, "te": 718119.325769373, "first_response_s": 11.361944064032286, "answer_total_s": 11.39962226501666, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_427_a1344_q0", "video_id": 427, "time_stamp_s": 5, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bc4d68a14d9d1a0d7a2665aa6532399b6c4b020daf2f65c8d9137bd8a4f66648", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "f164f7dcde4398f576eb7289e4b5615d85a8cc754261a103ee1b52b950fd0b0a", "num_recent_frames": 6, "tq": 718159.817908431, "t1": 718171.725021004, "ta": 718171.725021004, "te": 718171.951945163, "first_response_s": 11.907112572924234, "answer_total_s": 12.134036731906235, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 427, "content_group": "e66bac6e0e7d4031dfddbaba2ccab077bc37f46bae15335d33cb1a7114e3a914", "question": {"question_id": "sample_427_a1345_q0", "video_id": 427, "video_path": "./videos/sample_427_real.mp4", "annotation_index": 1345, "question_index": 0, "question": "What is the man in the video holding right now?", "options": ["A. A wrench.", "B. An air pump.", "C. A screwdriver.", "D. A flashlight."], "answer": "B", "time_stamp_s": 134, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [133, 138], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_427_a1345_q0", "video_id": 427, "time_stamp_s": 134, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8bc2d2aae043a7c3d7fa1c167d546f5e3b32d58904805583743b90b11ebe3e42", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0], "recent_frames_sha256": "4bfd7ad10219a69836c5ba7e2112379e23344a8a755aa3ef6bfadf30901d32d1", "num_recent_frames": 30, "tq": 718119.339999702, "t1": 718133.356903115, "ta": 718133.356903115, "te": 718133.395226514, "first_response_s": 14.016903413110413, "answer_total_s": 14.055226812022738, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_427_a1345_q0", "video_id": 427, "time_stamp_s": 134, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "72d1c3779ba41f085de64a887a5b363ae11845abd2af4178b85bdbc149c8fffe", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pilot seated in helicopter cockpit, wearing helmet and harness, with large tan bag strapped beside them.  \n- Helicopter descends toward a forested area, with visible control stick and instrument panel.  \n- Landscape transitions from open field to dense green trees as helicopter approaches ground.\n[30-60s] - Pilot's hands adjust controls while seated in a small aircraft cockpit, with a river and forest visible through the windshield.  \n- A passenger in a white shirt and shorts sits beside the pilot, secured by a seatbelt, looking toward the camera.  \n- The aircraft's interior shows a dashboard with gauges and a yellow control lever, with the pilot's shadow cast across the cockpit.\n[60-90s] - Man in white shirt gestures toward sunset over river while seated in helicopter cockpit.  \n- Helicopter’s rotor blades are stationary, positioned on grassy hillside overlooking water.  \n- Camera pans to reveal expansive river view with distant shoreline and sparse trees under clear sky.\n[90-120s] - A person's hands are seen handling a tan-colored tarp, unfolding it on grassy terrain near water.  \n- A helicopter is parked nearby, its rotors stationary, with the sun setting behind it, casting golden light across the scene.  \n- The tarp is being prepared for use, with hands adjusting its edges and securing it to the ground.", "history_tokens": 293, "history_utf8_bytes": 1340, "recent_frame_times_s": [105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0], "recent_frames_sha256": "4bfd7ad10219a69836c5ba7e2112379e23344a8a755aa3ef6bfadf30901d32d1", "num_recent_frames": 30, "tq": 718207.329228582, "t1": 718210.288159411, "ta": 718210.288159411, "te": 718210.329516989, "first_response_s": 2.9589308290742338, "answer_total_s": 3.000288406969048, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 427, "content_group": "e66bac6e0e7d4031dfddbaba2ccab077bc37f46bae15335d33cb1a7114e3a914", "question": {"question_id": "sample_427_a1346_q0", "video_id": 427, "video_path": "./videos/sample_427_real.mp4", "annotation_index": 1346, "question_index": 0, "question": "What color are the man's shorts right now?", "options": ["A. Black.", "B. Red.", "C. Blue.", "D. Green."], "answer": "C", "time_stamp_s": 267, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [266, 271], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_427_a1346_q0", "video_id": 427, "time_stamp_s": 267, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "335c97c56c11a9661e95bc41d00b3083e514bcacc78be1b3e412c80b434f09af", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0], "recent_frames_sha256": "3b23079f02f7065507e536568f3b4c21ec101d4d3f46e0942fed4a69d14077d7", "num_recent_frames": 30, "tq": 718133.409198694, "t1": 718143.929230778, "ta": 718143.929230778, "te": 718143.968393106, "first_response_s": 10.520032083964907, "answer_total_s": 10.559194411966018, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_427_a1346_q0", "video_id": 427, "time_stamp_s": 267, "ground_truth": "C", "raw_output": "C. Blue.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "09415009f6d1a9c15dab57c0ffd18699acf3142a1bd729b6bc21f914b588724d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pilot seated in helicopter cockpit, wearing helmet and harness, with large tan bag strapped beside them.  \n- Helicopter descends toward a forested area, with visible control stick and instrument panel.  \n- Landscape transitions from open field to dense green trees as helicopter approaches ground.\n[30-60s] - Pilot's hands adjust controls while seated in a small aircraft cockpit, with a river and forest visible through the windshield.  \n- A passenger in a white shirt and shorts sits beside the pilot, secured by a seatbelt, looking toward the camera.  \n- The aircraft's interior shows a dashboard with gauges and a yellow control lever, with the pilot's shadow cast across the cockpit.\n[60-90s] - Man in white shirt gestures toward sunset over river while seated in helicopter cockpit.  \n- Helicopter’s rotor blades are stationary, positioned on grassy hillside overlooking water.  \n- Camera pans to reveal expansive river view with distant shoreline and sparse trees under clear sky.\n[90-120s] - A person's hands are seen handling a tan-colored tarp, unfolding it on grassy terrain near water.  \n- A helicopter is parked nearby, its rotors stationary, with the sun setting behind it, casting golden light across the scene.  \n- The tarp is being prepared for use, with hands adjusting its edges and securing it to the ground.\n[120-150s] - Person inflates tent using pump, with watch visible on wrist.  \n- Tent gradually inflates and takes shape, positioned near helicopter.  \n- Helicopter remains stationary on grassy field, silhouetted against sunset.\n[150-180s] - A yellow tent is fully set up on a grassy hillside, with its entrance open and interior visible.  \n- A blue helicopter is parked nearby, positioned to the left of the tent.  \n- A man in a white shirt and black cap stands in front of the tent, gesturing toward it while speaking.\n[180-210s] - A yellow tent is set up with a white sleeping mat and a small table near the entrance.  \n- A black backpack is placed on the mat, and a red object (possibly a cup or container) sits on the table.  \n- The tent’s interior is illuminated by natural light, with trees visible through the open front.\n[210-240s] - Man in white shirt and cap gestures toward a tent and river at sunset, with a drone visible in background.  \n- Aerial view shows a yellow tent on a cliffside with a blue helicopter nearby, surrounded by trees and a river.  \n- Man holds a package of \"Barrister\" brand freeze-dried food, smiling at camera under a clear blue sky.", "history_tokens": 587, "history_utf8_bytes": 2511, "recent_frame_times_s": [238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0], "recent_frames_sha256": "3b23079f02f7065507e536568f3b4c21ec101d4d3f46e0942fed4a69d14077d7", "num_recent_frames": 30, "tq": 718237.634665938, "t1": 718238.863989258, "ta": 718238.863989258, "te": 718239.057082017, "first_response_s": 1.2293233199743554, "answer_total_s": 1.4224160789744928, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 427, "content_group": "e66bac6e0e7d4031dfddbaba2ccab077bc37f46bae15335d33cb1a7114e3a914", "question": {"question_id": "sample_427_a1347_q0", "video_id": 427, "video_path": "./videos/sample_427_real.mp4", "annotation_index": 1347, "question_index": 0, "question": "What is the main source of light illuminating the area right now?", "options": ["A. Street lamp.", "B. Campfire.", "C. Flashlight.", "D. Tent light."], "answer": "D", "time_stamp_s": 402, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [399, 404], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_427_a1347_q0", "video_id": 427, "time_stamp_s": 402, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4c9598ede112b7fe3e94148e65161f848fb91ae222deff5baec8d062c3d61580", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0], "recent_frames_sha256": "aaf3956ede6f7fc4ff414823fa5089df1d47877128cebafe8ea2fbfe56d09520", "num_recent_frames": 30, "tq": 718143.983985611, "t1": 718151.897138074, "ta": 718151.897138074, "te": 718151.93624282, "first_response_s": 7.913152463035658, "answer_total_s": 7.952257208991796, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_427_a1347_q0", "video_id": 427, "time_stamp_s": 402, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c25948c335c8e9fd4dd17faf4793d94b1d117fbe7262de72a5a9948a4291e77d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pilot seated in helicopter cockpit, wearing helmet and harness, with large tan bag strapped beside them.  \n- Helicopter descends toward a forested area, with visible control stick and instrument panel.  \n- Landscape transitions from open field to dense green trees as helicopter approaches ground.\n[30-60s] - Pilot's hands adjust controls while seated in a small aircraft cockpit, with a river and forest visible through the windshield.  \n- A passenger in a white shirt and shorts sits beside the pilot, secured by a seatbelt, looking toward the camera.  \n- The aircraft's interior shows a dashboard with gauges and a yellow control lever, with the pilot's shadow cast across the cockpit.\n[60-90s] - Man in white shirt gestures toward sunset over river while seated in helicopter cockpit.  \n- Helicopter’s rotor blades are stationary, positioned on grassy hillside overlooking water.  \n- Camera pans to reveal expansive river view with distant shoreline and sparse trees under clear sky.\n[90-120s] - A person's hands are seen handling a tan-colored tarp, unfolding it on grassy terrain near water.  \n- A helicopter is parked nearby, its rotors stationary, with the sun setting behind it, casting golden light across the scene.  \n- The tarp is being prepared for use, with hands adjusting its edges and securing it to the ground.\n[120-150s] - Person inflates tent using pump, with watch visible on wrist.  \n- Tent gradually inflates and takes shape, positioned near helicopter.  \n- Helicopter remains stationary on grassy field, silhouetted against sunset.\n[150-180s] - A yellow tent is fully set up on a grassy hillside, with its entrance open and interior visible.  \n- A blue helicopter is parked nearby, positioned to the left of the tent.  \n- A man in a white shirt and black cap stands in front of the tent, gesturing toward it while speaking.\n[180-210s] - A yellow tent is set up with a white sleeping mat and a small table near the entrance.  \n- A black backpack is placed on the mat, and a red object (possibly a cup or container) sits on the table.  \n- The tent’s interior is illuminated by natural light, with trees visible through the open front.\n[210-240s] - Man in white shirt and cap gestures toward a tent and river at sunset, with a drone visible in background.  \n- Aerial view shows a yellow tent on a cliffside with a blue helicopter nearby, surrounded by trees and a river.  \n- Man holds a package of \"Barrister\" brand freeze-dried food, smiling at camera under a clear blue sky.\n[240-270s] - Man holds a bag of \"Adventure\" brand cat food, smiling at camera under clear sky.  \n- Two hands light a fire using a flint and steel, with smoke rising from the embers.  \n- A helicopter is visible in the background, parked on a grassy field.\n[270-300s] - Man in white shirt and cap tends to a small fire with a stick, near a helicopter in a field.  \n- He then sits down, facing the camera, with the helicopter visible in the background.  \n- Hands open a package of \"Savory\" brand food, preparing to pour its contents into a metal container.\n[300-330s] - A man in a white shirt and cap holds a spoon over a bowl, appearing to eat or stir its contents.  \n- A water bottle is positioned to the left of the bowl on the table.  \n- The man’s facial expression and hand movements suggest he is actively engaged in eating or speaking.\n[330-360s] - Man in white shirt and cap sits at table outdoors, holding water bottle and bowl, surrounded by logs and campfire remnants.  \n- Aerial view reveals a yellow tent and blue helicopter (N3095A) parked on grassy cliff edge, with people gathered nearby.  \n- Man stands beside tent, smiling at camera, with helicopter visible behind him against twilight sky.\n[360-390s] - A man inside a tent, wearing a cap and t-shirt, looks at the camera while speaking.  \n- The tent interior is lit by a red lamp, with a small table and a black object (possibly a phone) on the floor.  \n- Outside the tent, a helicopter is visible on the ground near a body of water during twilight.", "history_tokens": 973, "history_utf8_bytes": 4029, "recent_frame_times_s": [373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0], "recent_frames_sha256": "aaf3956ede6f7fc4ff414823fa5089df1d47877128cebafe8ea2fbfe56d09520", "num_recent_frames": 30, "tq": 718283.774694911, "t1": 718285.059532794, "ta": 718285.059532794, "te": 718285.359480755, "first_response_s": 1.2848378830822185, "answer_total_s": 1.584785844082944, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 427, "content_group": "e66bac6e0e7d4031dfddbaba2ccab077bc37f46bae15335d33cb1a7114e3a914", "question": {"question_id": "sample_427_a1348_q0", "video_id": 427, "video_path": "./videos/sample_427_real.mp4", "annotation_index": 1348, "question_index": 0, "question": "What is the man setting up right now?", "options": ["A. A tent.", "B. A table.", "C. A chair.", "D. A blanket."], "answer": "A", "time_stamp_s": 535, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [532, 537], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_427_a1348_q0", "video_id": 427, "time_stamp_s": 535, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1b68b2257c25ece3e9b34cdbf3af42a084e4e22a6c713f00cf39d3dccc13099f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0], "recent_frames_sha256": "7d292d93a279d1b21040aa0cca33a27c4d69f45a13b5ea8a5fd63e72c13cfcb0", "num_recent_frames": 30, "tq": 718151.950659626, "t1": 718159.759847457, "ta": 718159.759847457, "te": 718159.797575703, "first_response_s": 7.8091878310078755, "answer_total_s": 7.846916076960042, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_427_a1348_q0", "video_id": 427, "time_stamp_s": 535, "ground_truth": "A", "raw_output": "A. A tent.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "74fbbdc7149e32cf3b28639adcd62843116406931ecb704fdafdd398fda00821", "condition_order": ["recent", "notes"], "memory": "[120-150s] - Person inflates tent using pump, with watch visible on wrist.  \n- Tent gradually inflates and takes shape, positioned near helicopter.  \n- Helicopter remains stationary on grassy field, silhouetted against sunset.\n[150-180s] - A yellow tent is fully set up on a grassy hillside, with its entrance open and interior visible.  \n- A blue helicopter is parked nearby, positioned to the left of the tent.  \n- A man in a white shirt and black cap stands in front of the tent, gesturing toward it while speaking.\n[180-210s] - A yellow tent is set up with a white sleeping mat and a small table near the entrance.  \n- A black backpack is placed on the mat, and a red object (possibly a cup or container) sits on the table.  \n- The tent’s interior is illuminated by natural light, with trees visible through the open front.\n[210-240s] - Man in white shirt and cap gestures toward a tent and river at sunset, with a drone visible in background.  \n- Aerial view shows a yellow tent on a cliffside with a blue helicopter nearby, surrounded by trees and a river.  \n- Man holds a package of \"Barrister\" brand freeze-dried food, smiling at camera under a clear blue sky.\n[240-270s] - Man holds a bag of \"Adventure\" brand cat food, smiling at camera under clear sky.  \n- Two hands light a fire using a flint and steel, with smoke rising from the embers.  \n- A helicopter is visible in the background, parked on a grassy field.\n[270-300s] - Man in white shirt and cap tends to a small fire with a stick, near a helicopter in a field.  \n- He then sits down, facing the camera, with the helicopter visible in the background.  \n- Hands open a package of \"Savory\" brand food, preparing to pour its contents into a metal container.\n[300-330s] - A man in a white shirt and cap holds a spoon over a bowl, appearing to eat or stir its contents.  \n- A water bottle is positioned to the left of the bowl on the table.  \n- The man’s facial expression and hand movements suggest he is actively engaged in eating or speaking.\n[330-360s] - Man in white shirt and cap sits at table outdoors, holding water bottle and bowl, surrounded by logs and campfire remnants.  \n- Aerial view reveals a yellow tent and blue helicopter (N3095A) parked on grassy cliff edge, with people gathered nearby.  \n- Man stands beside tent, smiling at camera, with helicopter visible behind him against twilight sky.\n[360-390s] - A man inside a tent, wearing a cap and t-shirt, looks at the camera while speaking.  \n- The tent interior is lit by a red lamp, with a small table and a black object (possibly a phone) on the floor.  \n- Outside the tent, a helicopter is visible on the ground near a body of water during twilight.\n[390-420s] - A man with a beard is speaking to the camera in a dark outdoor setting, with a lit tent visible behind him.  \n- The tent is illuminated from within, casting a warm glow against the night sky, and appears to be situated near a body of water.  \n- The camera pans to show a helicopter silhouetted against a twilight sky, positioned on a grassy area near the water’s edge.\n[420-450s] - A man with a beard lies on his back in a dimly lit tent, arms spread wide, facing the camera.  \n- The tent’s interior features a dark fabric wall with a circular opening above and scattered gear around.  \n- The man’s expression remains calm and relaxed, with slight head movements as he looks upward.\n[450-480s] - A man inside a tent holds up a smartphone displaying a time of 10:03, illuminated by a red light source nearby.  \n- The tent interior is dimly lit, with the man wearing a cap and a dark shirt, and a red-lit lantern visible on the tent’s edge.  \n- The scene transitions from an outdoor twilight view to the man’s indoor perspective, with no visible movement or interaction beyond holding the phone.\n[480-510s] - Helicopter with yellow canopy is stationary on grassy terrain near water, its rotor blades still.  \n- A man in a black shirt and cap appears, speaking to camera, with the helicopter visible behind him.  \n- Sky transitions from dark to partly cloudy with visible stars, suggesting dawn or dusk.", "history_tokens": 1022, "history_utf8_bytes": 4112, "recent_frame_times_s": [506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0], "recent_frames_sha256": "7d292d93a279d1b21040aa0cca33a27c4d69f45a13b5ea8a5fd63e72c13cfcb0", "num_recent_frames": 30, "tq": 718320.404400085, "t1": 718328.044503436, "ta": 718328.044503436, "te": 718328.235868288, "first_response_s": 7.640103350975551, "answer_total_s": 7.831468202988617, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 428, "content_group": "9496bde954b2d29393ef0ce3aad2ad441c3d7c98327338dd9d7ad338a04ce7cc", "question": {"question_id": "sample_428_a1258_q0", "video_id": 428, "video_path": "./videos/sample_428_real.mp4", "annotation_index": 1258, "question_index": 0, "question": "What is the name appearing on the aircraft?", "options": ["A. Rand.", "B. Rant.", "C. Ren.", "D. Raná."], "answer": "D", "time_stamp_s": 5, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_428_a1258_q0", "video_id": 428, "time_stamp_s": 5, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "dba6affabc220450e28a55c340119c44f8d6c30ca7f876e1b033c6aa95459a6b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004], "recent_frames_sha256": "0c27307a136e1bd7a2fb66e75de6fee10bc02c40fd4c7dd5e60c1947b8000b0c", "num_recent_frames": 5, "tq": 710315.609287346, "t1": 710326.210700371, "ta": 710326.210700371, "te": 710326.248875044, "first_response_s": 10.601413024938665, "answer_total_s": 10.639587698038667, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_428_a1258_q0", "video_id": 428, "time_stamp_s": 5, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c30c424bc5eda633897ac20a31a4baa61938cc9b095d38d88853c90362aefa10", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004], "recent_frames_sha256": "0c27307a136e1bd7a2fb66e75de6fee10bc02c40fd4c7dd5e60c1947b8000b0c", "num_recent_frames": 5, "tq": 710207.530468222, "t1": 710213.774600515, "ta": 710213.774600515, "te": 710213.812400719, "first_response_s": 6.2441322930390015, "answer_total_s": 6.281932497047819, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 428, "content_group": "9496bde954b2d29393ef0ce3aad2ad441c3d7c98327338dd9d7ad338a04ce7cc", "question": {"question_id": "sample_428_a1259_q0", "video_id": 428, "video_path": "./videos/sample_428_real.mp4", "annotation_index": 1259, "question_index": 0, "question": "What is the primary object right now attached in front of the yellow aircraft?", "options": ["A. A rope.", "B. A radar.", "C. A ladder.", "D. A parachute."], "answer": "A", "time_stamp_s": 83, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [80, 85], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_428_a1259_q0", "video_id": 428, "time_stamp_s": 83, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a0bf60342a318cd2f118b28d96f3859131aa474db5f22d9a4798ec1693ec7772", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666], "recent_frames_sha256": "b5a4806b921df159fef94b2296a0efe6e9a080f1d4c6c00bd2968e4f2bef349a", "num_recent_frames": 30, "tq": 710326.256993215, "t1": 710336.133658695, "ta": 710336.133658695, "te": 710336.170727862, "first_response_s": 9.876665480085649, "answer_total_s": 9.913734647096135, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_428_a1259_q0", "video_id": 428, "time_stamp_s": 83, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4e7e0b037f6401e86bc82b1bc5589fb3aa1ef8a371ef1d38076cf60c42c5b39f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A yellow biplane with \"Rana\" written on its fuselage is parked on a grassy field, with a person in uniform standing nearby.  \n- A man in sunglasses and a cap takes a selfie next to the aircraft, with text overlay indicating \"First flight in 1934.\"  \n- The biplane takes off from the grass field, ascending into the sky as the camera pans to follow its departure.\n[30-60s] - Man in dark sweater and cap smiles while holding camera, standing beside a yellow glider with \"JWKO 26\" on its side.  \n- Glider's wooden frame and white fabric wings are visible, with the man gesturing toward its structure.  \n- Camera pans to show glider’s underside and internal framework, then returns to the man facing forward.", "history_tokens": 178, "history_utf8_bytes": 716, "recent_frame_times_s": [53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666], "recent_frames_sha256": "b5a4806b921df159fef94b2296a0efe6e9a080f1d4c6c00bd2968e4f2bef349a", "num_recent_frames": 30, "tq": 710225.802214182, "t1": 710227.782350978, "ta": 710227.782350978, "te": 710227.828134234, "first_response_s": 1.9801367960171774, "answer_total_s": 2.025920051964931, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 428, "content_group": "9496bde954b2d29393ef0ce3aad2ad441c3d7c98327338dd9d7ad338a04ce7cc", "question": {"question_id": "sample_428_a1260_q0", "video_id": 428, "video_path": "./videos/sample_428_real.mp4", "annotation_index": 1260, "question_index": 0, "question": "What is the primary color of the aircraft nose right now?", "options": ["A. Blue.", "B. Red.", "C. White.", "D. Brown."], "answer": "D", "time_stamp_s": 162, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [160, 165], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_428_a1260_q0", "video_id": 428, "time_stamp_s": 162, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dd20ab0021156ef71808cb1f39d8dceac15a57f5ee4051d33890aed11892d2c9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334], "recent_frames_sha256": "8d7ab0b62ff345f43390dde8386becbf007e56607d05f7907b2ccdc9a44e68b3", "num_recent_frames": 30, "tq": 710336.179350823, "t1": 710347.657995861, "ta": 710347.657995861, "te": 710347.695322725, "first_response_s": 11.478645037976094, "answer_total_s": 11.515971901942976, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_428_a1260_q0", "video_id": 428, "time_stamp_s": 162, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f7aa5d9563b23eb56188765930705f2566e3e4b9a665e441bcdbbca21458a904", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A yellow biplane with \"Rana\" written on its fuselage is parked on a grassy field, with a person in uniform standing nearby.  \n- A man in sunglasses and a cap takes a selfie next to the aircraft, with text overlay indicating \"First flight in 1934.\"  \n- The biplane takes off from the grass field, ascending into the sky as the camera pans to follow its departure.\n[30-60s] - Man in dark sweater and cap smiles while holding camera, standing beside a yellow glider with \"JWKO 26\" on its side.  \n- Glider's wooden frame and white fabric wings are visible, with the man gesturing toward its structure.  \n- Camera pans to show glider’s underside and internal framework, then returns to the man facing forward.\n[60-90s] - A man in a black sweater and cap smiles while standing beside a glider, hand resting on its wooden frame.  \n- The camera pans to show the glider’s cockpit interior, featuring a circular instrument panel and a control stick.  \n- A second man in a black jacket and beanie is seen smiling at the camera, standing near the glider’s open cockpit.\n[90-120s] - A man in a brown flight helmet and sunglasses smiles at the camera from inside a biplane cockpit, with the aircraft's wooden frame and fabric wings visible.  \n- The camera shifts to a first-person view from the cockpit, showing the grassy field and distant horizon under a partly cloudy sky.  \n- The man is seen again, now looking toward the camera with a smile, as the biplane remains stationary on the grass field.\n[120-150s] - Pilot smiles broadly while wearing sunglasses and a brown flight hood, seated in a biplane cockpit.  \n- The aircraft’s wooden frame and fabric wings are visible, with the pilot’s hand resting near the controls.  \n- Below, a patchwork of green fields, trees, and a small village unfolds as the plane glides forward.", "history_tokens": 437, "history_utf8_bytes": 1834, "recent_frame_times_s": [132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334], "recent_frames_sha256": "8d7ab0b62ff345f43390dde8386becbf007e56607d05f7907b2ccdc9a44e68b3", "num_recent_frames": 30, "tq": 710252.860635996, "t1": 710260.01909596, "ta": 710260.01909596, "te": 710260.057784677, "first_response_s": 7.158459963975474, "answer_total_s": 7.197148681036197, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 428, "content_group": "9496bde954b2d29393ef0ce3aad2ad441c3d7c98327338dd9d7ad338a04ce7cc", "question": {"question_id": "sample_428_a1261_q0", "video_id": 428, "video_path": "./videos/sample_428_real.mp4", "annotation_index": 1261, "question_index": 0, "question": "What physical structure is visible in the background right now?", "options": ["A. A road.", "B. A lake.", "C. A bridge.", "D. A factory."], "answer": "A", "time_stamp_s": 240, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [240, 245], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_428_a1261_q0", "video_id": 428, "time_stamp_s": 240, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4454ed1a6aee10707c282bfcea0f8dd1b96872b88ed596b73210f58d2980be95", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334], "recent_frames_sha256": "ec358b71698be4fe3dac74a423f75122428ec947843973d5b21dee5282ef69b9", "num_recent_frames": 30, "tq": 710347.703507466, "t1": 710355.2426855, "ta": 710355.2426855, "te": 710355.280089544, "first_response_s": 7.539178033941425, "answer_total_s": 7.57658207800705, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_428_a1261_q0", "video_id": 428, "time_stamp_s": 240, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f2787d99c9daca1ff6b1536cb201e37d7b3f207055f1e0a18ee027a023f11e8f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A yellow biplane with \"Rana\" written on its fuselage is parked on a grassy field, with a person in uniform standing nearby.  \n- A man in sunglasses and a cap takes a selfie next to the aircraft, with text overlay indicating \"First flight in 1934.\"  \n- The biplane takes off from the grass field, ascending into the sky as the camera pans to follow its departure.\n[30-60s] - Man in dark sweater and cap smiles while holding camera, standing beside a yellow glider with \"JWKO 26\" on its side.  \n- Glider's wooden frame and white fabric wings are visible, with the man gesturing toward its structure.  \n- Camera pans to show glider’s underside and internal framework, then returns to the man facing forward.\n[60-90s] - A man in a black sweater and cap smiles while standing beside a glider, hand resting on its wooden frame.  \n- The camera pans to show the glider’s cockpit interior, featuring a circular instrument panel and a control stick.  \n- A second man in a black jacket and beanie is seen smiling at the camera, standing near the glider’s open cockpit.\n[90-120s] - A man in a brown flight helmet and sunglasses smiles at the camera from inside a biplane cockpit, with the aircraft's wooden frame and fabric wings visible.  \n- The camera shifts to a first-person view from the cockpit, showing the grassy field and distant horizon under a partly cloudy sky.  \n- The man is seen again, now looking toward the camera with a smile, as the biplane remains stationary on the grass field.\n[120-150s] - Pilot smiles broadly while wearing sunglasses and a brown flight hood, seated in a biplane cockpit.  \n- The aircraft’s wooden frame and fabric wings are visible, with the pilot’s hand resting near the controls.  \n- Below, a patchwork of green fields, trees, and a small village unfolds as the plane glides forward.\n[150-180s] - Wooden biplane's nose and cockpit frame visible from pilot's perspective, with a clear view of the landscape below.  \n- A second aircraft appears in the distance, flying ahead and slightly above the biplane.  \n- The camera pans slightly to the right, revealing more of the green and brown farmland below.\n[180-210s] - Pilot in brown cap and sunglasses looks down, then smiles at camera while seated in biplane cockpit.  \n- Camera shifts to forward view showing nose of aircraft flying over green fields and forested areas.  \n- Interior shot shows pilot’s feet on pedals and gloved hand near control stick, with red interior and wooden structure visible.\n[210-240s] - Pilot in foreground smiles, wearing a brown cap and sunglasses, seated in a biplane cockpit.  \n- Co-pilot visible in rear seat, wearing a dark helmet, looking forward.  \n- Exterior view shows expansive farmland below, with fields and scattered trees under clear skies.", "history_tokens": 655, "history_utf8_bytes": 2785, "recent_frame_times_s": [210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334], "recent_frames_sha256": "ec358b71698be4fe3dac74a423f75122428ec947843973d5b21dee5282ef69b9", "num_recent_frames": 30, "tq": 710289.462332787, "t1": 710291.251893003, "ta": 710291.251893003, "te": 710291.451039305, "first_response_s": 1.7895602160133421, "answer_total_s": 1.9887065179646015, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 428, "content_group": "9496bde954b2d29393ef0ce3aad2ad441c3d7c98327338dd9d7ad338a04ce7cc", "question": {"question_id": "sample_428_a1262_q0", "video_id": 428, "video_path": "./videos/sample_428_real.mp4", "annotation_index": 1262, "question_index": 0, "question": "What is the person in the aircraft wearing on his head right now?", "options": ["A. A leather aviator hat.", "B. A helmet.", "C. A beanie.", "D. A cap."], "answer": "A", "time_stamp_s": 322, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [320, 325], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_428_a1262_q0", "video_id": 428, "time_stamp_s": 322, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "65645086344c577011f1763ab2903af1a846bb4c8271fd8c7f242e5f0db20fe0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207], "recent_frames_sha256": "aa8a441ba11962a0056607c38bba14b9d822e358af52b5ca0cd5ebfaa3e09e05", "num_recent_frames": 30, "tq": 710355.294818598, "t1": 710366.329060174, "ta": 710366.329060174, "te": 710366.366856383, "first_response_s": 11.034241575980559, "answer_total_s": 11.072037785081193, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_428_a1262_q0", "video_id": 428, "time_stamp_s": 322, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "89e27d159c8b6270abf3e1ca7d5bb295f140328585931549cd16771dd794a7d3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A yellow biplane with \"Rana\" written on its fuselage is parked on a grassy field, with a person in uniform standing nearby.  \n- A man in sunglasses and a cap takes a selfie next to the aircraft, with text overlay indicating \"First flight in 1934.\"  \n- The biplane takes off from the grass field, ascending into the sky as the camera pans to follow its departure.\n[30-60s] - Man in dark sweater and cap smiles while holding camera, standing beside a yellow glider with \"JWKO 26\" on its side.  \n- Glider's wooden frame and white fabric wings are visible, with the man gesturing toward its structure.  \n- Camera pans to show glider’s underside and internal framework, then returns to the man facing forward.\n[60-90s] - A man in a black sweater and cap smiles while standing beside a glider, hand resting on its wooden frame.  \n- The camera pans to show the glider’s cockpit interior, featuring a circular instrument panel and a control stick.  \n- A second man in a black jacket and beanie is seen smiling at the camera, standing near the glider’s open cockpit.\n[90-120s] - A man in a brown flight helmet and sunglasses smiles at the camera from inside a biplane cockpit, with the aircraft's wooden frame and fabric wings visible.  \n- The camera shifts to a first-person view from the cockpit, showing the grassy field and distant horizon under a partly cloudy sky.  \n- The man is seen again, now looking toward the camera with a smile, as the biplane remains stationary on the grass field.\n[120-150s] - Pilot smiles broadly while wearing sunglasses and a brown flight hood, seated in a biplane cockpit.  \n- The aircraft’s wooden frame and fabric wings are visible, with the pilot’s hand resting near the controls.  \n- Below, a patchwork of green fields, trees, and a small village unfolds as the plane glides forward.\n[150-180s] - Wooden biplane's nose and cockpit frame visible from pilot's perspective, with a clear view of the landscape below.  \n- A second aircraft appears in the distance, flying ahead and slightly above the biplane.  \n- The camera pans slightly to the right, revealing more of the green and brown farmland below.\n[180-210s] - Pilot in brown cap and sunglasses looks down, then smiles at camera while seated in biplane cockpit.  \n- Camera shifts to forward view showing nose of aircraft flying over green fields and forested areas.  \n- Interior shot shows pilot’s feet on pedals and gloved hand near control stick, with red interior and wooden structure visible.\n[210-240s] - Pilot in foreground smiles, wearing a brown cap and sunglasses, seated in a biplane cockpit.  \n- Co-pilot visible in rear seat, wearing a dark helmet, looking forward.  \n- Exterior view shows expansive farmland below, with fields and scattered trees under clear skies.\n[240-270s] - Pilot in brown aviator hat and sunglasses smiles while seated in the cockpit of a biplane.  \n- Co-pilot in white helmet is visible behind, also wearing sunglasses, looking forward.  \n- Biplane’s wooden frame and open cockpit structure are visible, with fields and roads below.\n[270-300s] - A large, orange, curved structure (possibly a wind turbine or similar) dominates the foreground, with its top edge visible.  \n- The camera moves forward, revealing a vast agricultural landscape below, including green fields, brown plowed land, and scattered buildings.  \n- A small, dark object (possibly a drone or bird) is visible in the distance, moving across the green field.", "history_tokens": 814, "history_utf8_bytes": 3470, "recent_frame_times_s": [292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207], "recent_frames_sha256": "aa8a441ba11962a0056607c38bba14b9d822e358af52b5ca0cd5ebfaa3e09e05", "num_recent_frames": 30, "tq": 710313.781961784, "t1": 710315.369030264, "ta": 710315.369030264, "te": 710315.559540493, "first_response_s": 1.5870684799738228, "answer_total_s": 1.7775787089485675, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 429, "content_group": "5f90741a890c6d4050ee0eb89320842e1fc506f697feaad7c34f2673d5c4dab7", "question": {"question_id": "sample_429_a1230_q0", "video_id": 429, "video_path": "./videos/sample_429_real.mp4", "annotation_index": 1230, "question_index": 0, "question": "What is the alphanumeric code visible on the helicopter's tail right now?", "options": ["A. N939HS.", "B. N9398H.", "C. N939SH.", "D. N9399H."], "answer": "C", "time_stamp_s": 1, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_429_a1230_q0", "video_id": 429, "time_stamp_s": 1, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "85b951db6bdf18d08cb38137cf4194d8bd8c0dcd192d8989f1528b8ddd5a5bf3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0], "recent_frames_sha256": "07abf28a18fc257f5841624f640ccd45f95bb04206e9bb4a5a661be23bc75684", "num_recent_frames": 2, "tq": 716702.570092276, "t1": 716709.823734225, "ta": 716709.823734225, "te": 716709.862098664, "first_response_s": 7.253641949035227, "answer_total_s": 7.292006388073787, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_429_a1230_q0", "video_id": 429, "time_stamp_s": 1, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "15d42e7efcfae381470b111b3f13c88bea3aa5c904cb2479756cb93b943d991d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0], "recent_frames_sha256": "07abf28a18fc257f5841624f640ccd45f95bb04206e9bb4a5a661be23bc75684", "num_recent_frames": 2, "tq": 716751.857978609, "t1": 716753.536102002, "ta": 716753.536102002, "te": 716753.576706814, "first_response_s": 1.6781233929796144, "answer_total_s": 1.7187282049562782, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 429, "content_group": "5f90741a890c6d4050ee0eb89320842e1fc506f697feaad7c34f2673d5c4dab7", "question": {"question_id": "sample_429_a1231_q0", "video_id": 429, "video_path": "./videos/sample_429_real.mp4", "annotation_index": 1231, "question_index": 0, "question": "What color is the person on the right side of the picture wearing now?", "options": ["A. Blue.", "B. Yellow.", "C. White.", "D. Black."], "answer": "A", "time_stamp_s": 122, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [120, 125], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_429_a1231_q0", "video_id": 429, "time_stamp_s": 122, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c4b18ab94ad2ca9e4dc791728fa752bf22d9c21580fc23c205b4a178c8b67318", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0], "recent_frames_sha256": "a128680f4d26fbab06f5c02f87edbfce42acaaa38cc6be070857886674847f0c", "num_recent_frames": 30, "tq": 716709.87941211, "t1": 716717.158709966, "ta": 716717.158709966, "te": 716717.197284865, "first_response_s": 7.279297856031917, "answer_total_s": 7.3178727549966425, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_429_a1231_q0", "video_id": 429, "time_stamp_s": 122, "ground_truth": "A", "raw_output": "A. Blue.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "9f5efc6da92e466d007d7cc6d6b5193bedc989a49c686f0ed0780ae126107e14", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man with curly hair and a beard speaks to the camera, gesturing with his hands while standing on an airfield.  \n- Behind him, a blue and yellow helicopter (N935SH) is parked, with its rotor blades visible and stationary.  \n- The sky is bright blue with scattered white clouds, and the camera pans slightly to show the helicopter’s tail and rotor assembly.\n[30-60s] - Hand adjusts a blue helicopter tail rotor assembly near a cracked tarmac under a partly cloudy sky.  \n- Close-up of engine components with visible \"Lycoming\" branding and yellow hoses beneath the aircraft.  \n- Helicopter fuselage displays \"N939SH\" and \"R22 Beta II\" markings, with a coiled heat exchanger visible underneath.\n[60-90s] - A man with curly hair and a beard is speaking to the camera, standing outdoors on an airfield.  \n- Behind him, a blue and yellow helicopter (N839H) is parked on a cracked tarmac under a partly cloudy sky.  \n- The man gestures with his hands while speaking, occasionally waving to the camera.\n[90-120s] - Man in black shirt and cap sits in helicopter cockpit, looking forward.  \n- Pilot in patterned shirt and headphones holds phone, gesturing with right hand.  \n- Helicopter ascends, revealing river and urban landscape below through cockpit window.", "history_tokens": 307, "history_utf8_bytes": 1266, "recent_frame_times_s": [93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0], "recent_frames_sha256": "a128680f4d26fbab06f5c02f87edbfce42acaaa38cc6be070857886674847f0c", "num_recent_frames": 30, "tq": 716792.208276015, "t1": 716799.392176986, "ta": 716799.392176986, "te": 716799.667041773, "first_response_s": 7.183900970965624, "answer_total_s": 7.458765757968649, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 429, "content_group": "5f90741a890c6d4050ee0eb89320842e1fc506f697feaad7c34f2673d5c4dab7", "question": {"question_id": "sample_429_a1232_q0", "video_id": 429, "video_path": "./videos/sample_429_real.mp4", "annotation_index": 1232, "question_index": 0, "question": "What color are visible on the man's shirt right now?", "options": ["A. Black.", "B. White.", "C. Red.", "D. Blue."], "answer": "A", "time_stamp_s": 255, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [240, 245], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_429_a1232_q0", "video_id": 429, "time_stamp_s": 255, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5566faa56c0d2a9c370aee3866ee186cb90acc8454624ca901f06fc6298fbd94", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0], "recent_frames_sha256": "92e8dbd15d796d8e6bd6736d93ab13b4f30a79e6e584ffaa5da7821ffd8653c9", "num_recent_frames": 30, "tq": 716717.212642222, "t1": 716728.794286291, "ta": 716728.794286291, "te": 716728.833828607, "first_response_s": 11.581644069054164, "answer_total_s": 11.621186385047622, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_429_a1232_q0", "video_id": 429, "time_stamp_s": 255, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2169d5b991773de00264f176cfd8fb5efc40667325f0a9553ecb75c2bb9d7453", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man with curly hair and a beard speaks to the camera, gesturing with his hands while standing on an airfield.  \n- Behind him, a blue and yellow helicopter (N935SH) is parked, with its rotor blades visible and stationary.  \n- The sky is bright blue with scattered white clouds, and the camera pans slightly to show the helicopter’s tail and rotor assembly.\n[30-60s] - Hand adjusts a blue helicopter tail rotor assembly near a cracked tarmac under a partly cloudy sky.  \n- Close-up of engine components with visible \"Lycoming\" branding and yellow hoses beneath the aircraft.  \n- Helicopter fuselage displays \"N939SH\" and \"R22 Beta II\" markings, with a coiled heat exchanger visible underneath.\n[60-90s] - A man with curly hair and a beard is speaking to the camera, standing outdoors on an airfield.  \n- Behind him, a blue and yellow helicopter (N839H) is parked on a cracked tarmac under a partly cloudy sky.  \n- The man gestures with his hands while speaking, occasionally waving to the camera.\n[90-120s] - Man in black shirt and cap sits in helicopter cockpit, looking forward.  \n- Pilot in patterned shirt and headphones holds phone, gesturing with right hand.  \n- Helicopter ascends, revealing river and urban landscape below through cockpit window.\n[120-150s] - Two men in a helicopter cockpit, one in black shirt and blue shorts, the other in patterned shirt and shorts, both wearing headsets; the latter gestures while speaking.\n- Helicopter flies over a wide river with brown water, flanked by green forests under a partly cloudy sky.\n- Interior view shows cockpit instruments and controls, with the pilot’s hands visible on controls as the helicopter maneuvers over the landscape.\n[150-180s] - Pilot in black shirt grips controls, occasionally gesturing toward the landscape.  \n- Co-pilot in blue shirt holds phone, taking selfie while smiling and gesturing.  \n- Both wear headsets; helicopter flies low over green fields and a pond.\n[180-210s] - Pilot in black shirt smiles while seated in cockpit, hands on controls.  \n- Co-pilot in patterned shirt holds phone, gesturing with free hand.  \n- Helicopter’s rotor blades spin rapidly, visible through open canopy.\n[210-240s] - Pilot in cockpit gestures toward landscape while seated, with helicopter rotor visible overhead.  \n- Aerial view reveals a farm complex with red-roofed buildings, parking lots, and a circular pond.  \n- Helicopter descends toward the farm, showing parked vehicles and outdoor gathering areas.", "history_tokens": 588, "history_utf8_bytes": 2493, "recent_frame_times_s": [226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0], "recent_frames_sha256": "92e8dbd15d796d8e6bd6736d93ab13b4f30a79e6e584ffaa5da7821ffd8653c9", "num_recent_frames": 30, "tq": 716831.06751072, "t1": 716832.327809254, "ta": 716832.327809254, "te": 716832.365870081, "first_response_s": 1.2602985340636224, "answer_total_s": 1.298359361011535, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 429, "content_group": "5f90741a890c6d4050ee0eb89320842e1fc506f697feaad7c34f2673d5c4dab7", "question": {"question_id": "sample_429_a1233_q0", "video_id": 429, "video_path": "./videos/sample_429_real.mp4", "annotation_index": 1233, "question_index": 0, "question": "What is the predominant color of the landscape right now?", "options": ["A. Green.", "B. Blue.", "C. Yellow.", "D. Brown."], "answer": "A", "time_stamp_s": 364, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [360, 365], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_429_a1233_q0", "video_id": 429, "time_stamp_s": 364, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "68b8f60f1c76c34e66a3455d963b60bb0fee6f0499fc2984a1397987f2e6b4a8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0], "recent_frames_sha256": "2ebf4c945956c9f3f8b93983c63f39535cf705e531f18c0f890aa4c53b8c2e8f", "num_recent_frames": 30, "tq": 716728.850027302, "t1": 716740.553278439, "ta": 716740.553278439, "te": 716740.590138388, "first_response_s": 11.703251136932522, "answer_total_s": 11.740111085935496, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_429_a1233_q0", "video_id": 429, "time_stamp_s": 364, "ground_truth": "A", "raw_output": "A. Green.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "13ad4af529b3814304f32bcade13957153c83aeee610df2710752c7d12ee9400", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man with curly hair and a beard speaks to the camera, gesturing with his hands while standing on an airfield.  \n- Behind him, a blue and yellow helicopter (N935SH) is parked, with its rotor blades visible and stationary.  \n- The sky is bright blue with scattered white clouds, and the camera pans slightly to show the helicopter’s tail and rotor assembly.\n[30-60s] - Hand adjusts a blue helicopter tail rotor assembly near a cracked tarmac under a partly cloudy sky.  \n- Close-up of engine components with visible \"Lycoming\" branding and yellow hoses beneath the aircraft.  \n- Helicopter fuselage displays \"N939SH\" and \"R22 Beta II\" markings, with a coiled heat exchanger visible underneath.\n[60-90s] - A man with curly hair and a beard is speaking to the camera, standing outdoors on an airfield.  \n- Behind him, a blue and yellow helicopter (N839H) is parked on a cracked tarmac under a partly cloudy sky.  \n- The man gestures with his hands while speaking, occasionally waving to the camera.\n[90-120s] - Man in black shirt and cap sits in helicopter cockpit, looking forward.  \n- Pilot in patterned shirt and headphones holds phone, gesturing with right hand.  \n- Helicopter ascends, revealing river and urban landscape below through cockpit window.\n[120-150s] - Two men in a helicopter cockpit, one in black shirt and blue shorts, the other in patterned shirt and shorts, both wearing headsets; the latter gestures while speaking.\n- Helicopter flies over a wide river with brown water, flanked by green forests under a partly cloudy sky.\n- Interior view shows cockpit instruments and controls, with the pilot’s hands visible on controls as the helicopter maneuvers over the landscape.\n[150-180s] - Pilot in black shirt grips controls, occasionally gesturing toward the landscape.  \n- Co-pilot in blue shirt holds phone, taking selfie while smiling and gesturing.  \n- Both wear headsets; helicopter flies low over green fields and a pond.\n[180-210s] - Pilot in black shirt smiles while seated in cockpit, hands on controls.  \n- Co-pilot in patterned shirt holds phone, gesturing with free hand.  \n- Helicopter’s rotor blades spin rapidly, visible through open canopy.\n[210-240s] - Pilot in cockpit gestures toward landscape while seated, with helicopter rotor visible overhead.  \n- Aerial view reveals a farm complex with red-roofed buildings, parking lots, and a circular pond.  \n- Helicopter descends toward the farm, showing parked vehicles and outdoor gathering areas.\n[240-270s] - Pilot’s hands adjust controls inside helicopter cockpit, with dashboard and instruments visible.  \n- Helicopter hovers low over green field, approaching a red-roofed building.  \n- Ground crew members stand near the field’s edge, watching helicopter’s descent.\n[270-300s] - A police officer in tactical gear stands near a grassy field, gesturing toward distant vehicles.  \n- Another officer walks away from the camera, moving toward the vehicles in the field.  \n- A hand reaches out to point at the vehicles, indicating direction or focus.\n[300-330s] - A man with dark hair and a beard, wearing a black shirt and backpack, is speaking to the camera outdoors under a clear blue sky.  \n- He is seated in a vehicle, with a car visible to his right and trees in the background.  \n- The camera angle is low, capturing his face and upper body as he looks slightly upward and speaks.\n[330-360s] - Pilot in white \"FLY\" shirt and headset sits in helicopter cockpit, hands on controls.  \n- Helicopter flies over river with boats, then transitions to green fields and roads.  \n- Interior view shows dashboard, controls, and pilot’s hands adjusting flight instruments.", "history_tokens": 863, "history_utf8_bytes": 3670, "recent_frame_times_s": [335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0], "recent_frames_sha256": "2ebf4c945956c9f3f8b93983c63f39535cf705e531f18c0f890aa4c53b8c2e8f", "num_recent_frames": 30, "tq": 716862.443136418, "t1": 716868.384287447, "ta": 716868.384287447, "te": 716868.543085274, "first_response_s": 5.9411510289646685, "answer_total_s": 6.099948856048286, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 429, "content_group": "5f90741a890c6d4050ee0eb89320842e1fc506f697feaad7c34f2673d5c4dab7", "question": {"question_id": "sample_429_a1234_q0", "video_id": 429, "video_path": "./videos/sample_429_real.mp4", "annotation_index": 1234, "question_index": 0, "question": "What color is the man's shirt right now?", "options": ["A. Black.", "B. Blue.", "C. White.", "D. Red."], "answer": "A", "time_stamp_s": 482, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [480, 485], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_429_a1234_q0", "video_id": 429, "time_stamp_s": 482, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "499991f0c85801656d95e9c4acae2f8ee56bd97764ef72fafc1d37b8e2eb6c13", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [453.0, 454.0, 455.0, 456.0, 457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0], "recent_frames_sha256": "3d5b92fbfd270a92c3c9891d1e85a9ef879f04f03a6442da61d67b38a53fe796", "num_recent_frames": 30, "tq": 716740.596545938, "t1": 716751.814255427, "ta": 716751.814255427, "te": 716751.851655709, "first_response_s": 11.217709488933906, "answer_total_s": 11.25510977092199, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_429_a1234_q0", "video_id": 429, "time_stamp_s": 482, "ground_truth": "A", "raw_output": "C. White.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "a907d0537a5a09f47431b34585d1bc0df42218709901503491685cca7fd30f0f", "condition_order": ["recent", "notes"], "memory": "[60-90s] - A man with curly hair and a beard is speaking to the camera, standing outdoors on an airfield.  \n- Behind him, a blue and yellow helicopter (N839H) is parked on a cracked tarmac under a partly cloudy sky.  \n- The man gestures with his hands while speaking, occasionally waving to the camera.\n[90-120s] - Man in black shirt and cap sits in helicopter cockpit, looking forward.  \n- Pilot in patterned shirt and headphones holds phone, gesturing with right hand.  \n- Helicopter ascends, revealing river and urban landscape below through cockpit window.\n[120-150s] - Two men in a helicopter cockpit, one in black shirt and blue shorts, the other in patterned shirt and shorts, both wearing headsets; the latter gestures while speaking.\n- Helicopter flies over a wide river with brown water, flanked by green forests under a partly cloudy sky.\n- Interior view shows cockpit instruments and controls, with the pilot’s hands visible on controls as the helicopter maneuvers over the landscape.\n[150-180s] - Pilot in black shirt grips controls, occasionally gesturing toward the landscape.  \n- Co-pilot in blue shirt holds phone, taking selfie while smiling and gesturing.  \n- Both wear headsets; helicopter flies low over green fields and a pond.\n[180-210s] - Pilot in black shirt smiles while seated in cockpit, hands on controls.  \n- Co-pilot in patterned shirt holds phone, gesturing with free hand.  \n- Helicopter’s rotor blades spin rapidly, visible through open canopy.\n[210-240s] - Pilot in cockpit gestures toward landscape while seated, with helicopter rotor visible overhead.  \n- Aerial view reveals a farm complex with red-roofed buildings, parking lots, and a circular pond.  \n- Helicopter descends toward the farm, showing parked vehicles and outdoor gathering areas.\n[240-270s] - Pilot’s hands adjust controls inside helicopter cockpit, with dashboard and instruments visible.  \n- Helicopter hovers low over green field, approaching a red-roofed building.  \n- Ground crew members stand near the field’s edge, watching helicopter’s descent.\n[270-300s] - A police officer in tactical gear stands near a grassy field, gesturing toward distant vehicles.  \n- Another officer walks away from the camera, moving toward the vehicles in the field.  \n- A hand reaches out to point at the vehicles, indicating direction or focus.\n[300-330s] - A man with dark hair and a beard, wearing a black shirt and backpack, is speaking to the camera outdoors under a clear blue sky.  \n- He is seated in a vehicle, with a car visible to his right and trees in the background.  \n- The camera angle is low, capturing his face and upper body as he looks slightly upward and speaks.\n[330-360s] - Pilot in white \"FLY\" shirt and headset sits in helicopter cockpit, hands on controls.  \n- Helicopter flies over river with boats, then transitions to green fields and roads.  \n- Interior view shows dashboard, controls, and pilot’s hands adjusting flight instruments.\n[360-390s] - Helicopter cockpit view shows pilot’s hands on controls, with green fields and lake below.  \n- Pilot turns to face camera, wearing headset and white shirt, seated in open-cockpit aircraft.  \n- Camera shifts to dockside, showing a boat with group of people, one man gesturing toward the water.\n[390-420s] - A person’s hands grip a wakeboard’s handle, pulling it through choppy water, with the board’s underside visible.  \n- The wakeboarder’s feet are strapped to the board, and the board’s design features black and white graphics.  \n- A boat with multiple passengers is visible ahead, creating a wake as it moves through the water.\n[420-450s] - A man in a white t-shirt and cap gives a thumbs-up gesture while seated in a small aircraft cockpit.  \n- The aircraft is parked on a gravel surface with green fields and distant hills visible in the background.  \n- The cockpit interior features a clear canopy, control yokes, and a mounted camera above the pilot’s head.\n[450-480s] - Pilot in white shirt smiles while seated in helicopter cockpit, hands on controls.  \n- Helicopter hovers over river, sun reflecting off water surface.  \n- Second pilot in black shirt appears, seated in cockpit, looking forward.", "history_tokens": 984, "history_utf8_bytes": 4198, "recent_frame_times_s": [453.0, 454.0, 455.0, 456.0, 457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0], "recent_frames_sha256": "3d5b92fbfd270a92c3c9891d1e85a9ef879f04f03a6442da61d67b38a53fe796", "num_recent_frames": 30, "tq": 716905.129587687, "t1": 716906.157686315, "ta": 716906.157686315, "te": 716906.31602228, "first_response_s": 1.0280986280413345, "answer_total_s": 1.186434593051672, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 430, "content_group": "0ff55c663c26696b66f5b65e6b5b0f39f2a7240dcce5b93e3b06b66642321cb9", "question": {"question_id": "sample_430_a1353_q0", "video_id": 430, "video_path": "./videos/sample_430_real.mp4", "annotation_index": 1353, "question_index": 0, "question": "What object is mounted in front of the pilot on the left side?", "options": ["A. A map.", "B. A compass.", "C. A tablet.", "D. A camera."], "answer": "C", "time_stamp_s": 2, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_430_a1353_q0", "video_id": 430, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b20ec2eb277b13c53569439ca9238230a4969a5180104a97169e98bec8252390", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0], "recent_frames_sha256": "751bb1f44df5510ccf6696c7ee0e2e069061bcda424372aed4810baaf4722090", "num_recent_frames": 3, "tq": 710398.611225882, "t1": 710410.533193654, "ta": 710410.533193654, "te": 710410.573817156, "first_response_s": 11.921967772068456, "answer_total_s": 11.962591274059378, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_430_a1353_q0", "video_id": 430, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1cdd5e8a500eeb91bc1206518eac93d456dfa3626cf6c29b4ea12ecb5f2a4648", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0], "recent_frames_sha256": "751bb1f44df5510ccf6696c7ee0e2e069061bcda424372aed4810baaf4722090", "num_recent_frames": 3, "tq": 710456.709860303, "t1": 710463.462759465, "ta": 710463.462759465, "te": 710463.741539588, "first_response_s": 6.752899162005633, "answer_total_s": 7.0316792849916965, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 430, "content_group": "0ff55c663c26696b66f5b65e6b5b0f39f2a7240dcce5b93e3b06b66642321cb9", "question": {"question_id": "sample_430_a1354_q0", "video_id": 430, "video_path": "./videos/sample_430_real.mp4", "annotation_index": 1354, "question_index": 0, "question": "What type of footwear is the pilot wearing right now?", "options": ["A. Sandals.", "B. Dress shoes.", "C. Sneakers.", "D. Boots."], "answer": "C", "time_stamp_s": 127, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [126, 131], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_430_a1354_q0", "video_id": 430, "time_stamp_s": 127, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d3e1bffa96d9c9d340a4443e292f933ed5c92d1e8da6f52a57c7a53dc0b17f57", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0], "recent_frames_sha256": "e96ef6162fe1e34c6edb3dc71c1d2b00993073f81e1e8392b34c85f5f52caa2c", "num_recent_frames": 30, "tq": 710410.59506955, "t1": 710423.531331674, "ta": 710423.531331674, "te": 710423.57141571, "first_response_s": 12.936262123985216, "answer_total_s": 12.976346160052344, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_430_a1354_q0", "video_id": 430, "time_stamp_s": 127, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0993d17eaeed0c49d888dcd33184d566261a369cb8cac8fd574c1c03e667c156", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pilot in white shirt and headset sits in helicopter cockpit, gesturing with hands while speaking.  \n- Helicopter flies over green forest and farmland, with a river visible in the distance.  \n- Rotors spin rapidly, and the camera angle shifts slightly as the helicopter moves forward.\n[30-60s] - Pilot seated in cockpit, hands on controls, wearing headset and white shirt.  \n- Helicopter’s rotor blades visible, spinning above a sprawling urban landscape with roads, buildings, and water bodies.  \n- Camera angle shifts to show cockpit instruments and pilot’s hands adjusting controls as the helicopter descends over the city.\n[60-90s] - Pilot's hands manipulate controls while seated in helicopter cockpit.  \n- Helicopter flies over urban area with roads, buildings, and green spaces below.  \n- Camera angle shifts slightly, revealing more of the town layout and surrounding fields.\n[90-120s] - Pilot's hands manipulate controls as helicopter flies over urban and rural landscapes.  \n- A smartphone mounted on the dashboard displays navigation or flight data.  \n- Helicopter passes over a cluster of white silos and flooded fields, indicating changing terrain.", "history_tokens": 250, "history_utf8_bytes": 1174, "recent_frame_times_s": [98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0], "recent_frames_sha256": "e96ef6162fe1e34c6edb3dc71c1d2b00993073f81e1e8392b34c85f5f52caa2c", "num_recent_frames": 30, "tq": 710496.970510769, "t1": 710499.005872963, "ta": 710499.005872963, "te": 710499.225027274, "first_response_s": 2.0353621939430013, "answer_total_s": 2.254516504937783, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 430, "content_group": "0ff55c663c26696b66f5b65e6b5b0f39f2a7240dcce5b93e3b06b66642321cb9", "question": {"question_id": "sample_430_a1355_q0", "video_id": 430, "video_path": "./videos/sample_430_real.mp4", "annotation_index": 1355, "question_index": 0, "question": "What object is the man in the gray shirt holding right now?", "options": ["A. A backpack.", "B. A helmet.", "C. A purple bag.", "D. A clipboard."], "answer": "C", "time_stamp_s": 255, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [252, 257], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_430_a1355_q0", "video_id": 430, "time_stamp_s": 255, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cb2811672109989393b54091e88d5f35f3cbfc9e725c15090a5053f84623ca0e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0], "recent_frames_sha256": "ea463c6943bda501858fefd1da8010f1ef98d769ab571cb65eaa0a777ccb79aa", "num_recent_frames": 30, "tq": 710423.581949679, "t1": 710435.285500089, "ta": 710435.285500089, "te": 710435.325168635, "first_response_s": 11.70355041010771, "answer_total_s": 11.743218956049532, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_430_a1355_q0", "video_id": 430, "time_stamp_s": 255, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d2f912d9e1b05844eabf7aecc2f9cbdf4de0bbcaf2aab7c50bc110997f63dde0", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pilot in white shirt and headset sits in helicopter cockpit, gesturing with hands while speaking.  \n- Helicopter flies over green forest and farmland, with a river visible in the distance.  \n- Rotors spin rapidly, and the camera angle shifts slightly as the helicopter moves forward.\n[30-60s] - Pilot seated in cockpit, hands on controls, wearing headset and white shirt.  \n- Helicopter’s rotor blades visible, spinning above a sprawling urban landscape with roads, buildings, and water bodies.  \n- Camera angle shifts to show cockpit instruments and pilot’s hands adjusting controls as the helicopter descends over the city.\n[60-90s] - Pilot's hands manipulate controls while seated in helicopter cockpit.  \n- Helicopter flies over urban area with roads, buildings, and green spaces below.  \n- Camera angle shifts slightly, revealing more of the town layout and surrounding fields.\n[90-120s] - Pilot's hands manipulate controls as helicopter flies over urban and rural landscapes.  \n- A smartphone mounted on the dashboard displays navigation or flight data.  \n- Helicopter passes over a cluster of white silos and flooded fields, indicating changing terrain.\n[120-150s] - Pilot's hands manipulate controls as helicopter descends toward grassy field.  \n- Smartphone mounted on dashboard displays active navigation or flight data.  \n- Helicopter's rotor blades are visible, rotating as aircraft approaches ground.\n[150-180s] - Pilot adjusts headgear while seated in helicopter cockpit, looking toward camera.  \n- Hands grip control stick and throttle; seatbelt is fastened across torso.  \n- Helicopter rotor blades spin visibly, with grassy field and houses in background.\n[180-210s] - A man in a white shirt and cap sits in a small aircraft, smiling at the camera.  \n- Two women approach from a grassy field, one in a white t-shirt and denim shorts, the other in a black hoodie and shorts, both holding drinks.  \n- A group of people stands in the background near a church steeple, with shadows cast across the grass.\n[210-240s] - A group of children gathers around a blue and yellow helicopter on a grassy field, with some looking into the cockpit.  \n- One child in a red tank top and shorts stands near the helicopter’s open door, while others are positioned around the aircraft.  \n- A person in a black shirt and cap gestures toward the helicopter, possibly directing attention or explaining something to the group.", "history_tokens": 539, "history_utf8_bytes": 2434, "recent_frame_times_s": [226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0], "recent_frames_sha256": "ea463c6943bda501858fefd1da8010f1ef98d769ab571cb65eaa0a777ccb79aa", "num_recent_frames": 30, "tq": 710534.779356275, "t1": 710536.804283843, "ta": 710536.804283843, "te": 710537.066413937, "first_response_s": 2.024927568039857, "answer_total_s": 2.287057662033476, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 430, "content_group": "0ff55c663c26696b66f5b65e6b5b0f39f2a7240dcce5b93e3b06b66642321cb9", "question": {"question_id": "sample_430_a1356_q0", "video_id": 430, "video_path": "./videos/sample_430_real.mp4", "annotation_index": 1356, "question_index": 0, "question": "What color are the man's sunglasses's reflection right now?", "options": ["A. Red.", "B. Blue.", "C. Green.", "D. Yellow."], "answer": "B", "time_stamp_s": 381, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [378, 383], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_430_a1356_q0", "video_id": 430, "time_stamp_s": 381, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1300295813a1e4847fd0ba1e4cda934cfbe69d5c7f9974444728774badb75a5c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0], "recent_frames_sha256": "375f9e7c9acd1d878583ff96dbafcd37fba458e72057eba867bbe289c4ac4fd4", "num_recent_frames": 30, "tq": 710435.335320232, "t1": 710443.754010078, "ta": 710443.754010078, "te": 710443.793767014, "first_response_s": 8.41868984606117, "answer_total_s": 8.45844678208232, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_430_a1356_q0", "video_id": 430, "time_stamp_s": 381, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f0ed8687c59c7ab4437e7613ae8d0424334ae73cc1de72a9061b3fac5f46e3fe", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pilot in white shirt and headset sits in helicopter cockpit, gesturing with hands while speaking.  \n- Helicopter flies over green forest and farmland, with a river visible in the distance.  \n- Rotors spin rapidly, and the camera angle shifts slightly as the helicopter moves forward.\n[30-60s] - Pilot seated in cockpit, hands on controls, wearing headset and white shirt.  \n- Helicopter’s rotor blades visible, spinning above a sprawling urban landscape with roads, buildings, and water bodies.  \n- Camera angle shifts to show cockpit instruments and pilot’s hands adjusting controls as the helicopter descends over the city.\n[60-90s] - Pilot's hands manipulate controls while seated in helicopter cockpit.  \n- Helicopter flies over urban area with roads, buildings, and green spaces below.  \n- Camera angle shifts slightly, revealing more of the town layout and surrounding fields.\n[90-120s] - Pilot's hands manipulate controls as helicopter flies over urban and rural landscapes.  \n- A smartphone mounted on the dashboard displays navigation or flight data.  \n- Helicopter passes over a cluster of white silos and flooded fields, indicating changing terrain.\n[120-150s] - Pilot's hands manipulate controls as helicopter descends toward grassy field.  \n- Smartphone mounted on dashboard displays active navigation or flight data.  \n- Helicopter's rotor blades are visible, rotating as aircraft approaches ground.\n[150-180s] - Pilot adjusts headgear while seated in helicopter cockpit, looking toward camera.  \n- Hands grip control stick and throttle; seatbelt is fastened across torso.  \n- Helicopter rotor blades spin visibly, with grassy field and houses in background.\n[180-210s] - A man in a white shirt and cap sits in a small aircraft, smiling at the camera.  \n- Two women approach from a grassy field, one in a white t-shirt and denim shorts, the other in a black hoodie and shorts, both holding drinks.  \n- A group of people stands in the background near a church steeple, with shadows cast across the grass.\n[210-240s] - A group of children gathers around a blue and yellow helicopter on a grassy field, with some looking into the cockpit.  \n- One child in a red tank top and shorts stands near the helicopter’s open door, while others are positioned around the aircraft.  \n- A person in a black shirt and cap gestures toward the helicopter, possibly directing attention or explaining something to the group.\n[240-270s] - A man in a grey sweatshirt holds a purple bag while walking toward the helicopter, passing by a woman in a pink top holding a child.  \n- A group of young people, including one in a black \"Nike\" shirt, stand near the helicopter, observing the scene.  \n- The helicopter, with its rotors stationary, is positioned on a grassy field with a red brick building in the background.\n[270-300s] - A police officer in uniform stands on grass, gesturing with hands while facing the camera.  \n- Another officer walks toward the camera, carrying a bag, with a crowd of people visible in the background.  \n- The officer in the foreground adjusts his vest and looks around, with a red building and parked cars in the distance.\n[300-330s] - A young boy in a \"MOMMY\" shirt stands near adults, looking toward the camera with hands clasped.  \n- A man in a black shirt and sunglasses holds a phone, seemingly recording or taking a photo.  \n- A helicopter is parked on the grass, with people gathered around it, suggesting an event or activity.\n[330-360s] - A person in a dark blue shirt is seated behind a counter, interacting with a tablet device.  \n- Another individual in a red shirt and black apron stands beside them, also using a tablet.  \n- A hand extends from the viewer’s perspective, handing over a red card to the person behind the counter.", "history_tokens": 862, "history_utf8_bytes": 3780, "recent_frame_times_s": [352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0], "recent_frames_sha256": "375f9e7c9acd1d878583ff96dbafcd37fba458e72057eba867bbe289c4ac4fd4", "num_recent_frames": 30, "tq": 710567.451399347, "t1": 710573.673709786, "ta": 710573.673709786, "te": 710573.973406701, "first_response_s": 6.222310438985005, "answer_total_s": 6.522007353953086, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 430, "content_group": "0ff55c663c26696b66f5b65e6b5b0f39f2a7240dcce5b93e3b06b66642321cb9", "question": {"question_id": "sample_430_a1357_q0", "video_id": 430, "video_path": "./videos/sample_430_real.mp4", "annotation_index": 1357, "question_index": 0, "question": "What is the predominant color of the buildings in the background right now?", "options": ["A. Red.", "B. Blue.", "C. Green.", "D. Yellow."], "answer": "A", "time_stamp_s": 509, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [504, 509], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_430_a1357_q0", "video_id": 430, "time_stamp_s": 509, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0f860bf1694921a9d1114aaf347488f682f7e8fdb57958705d4dab438790c830", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0], "recent_frames_sha256": "b881d5a0d5a507011cdb68820efe26f058b6e2148f2d8873b9151a79c1c802a0", "num_recent_frames": 30, "tq": 710443.811245972, "t1": 710456.66247623, "ta": 710456.66247623, "te": 710456.700402172, "first_response_s": 12.851230257889256, "answer_total_s": 12.889156199991703, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_430_a1357_q0", "video_id": 430, "time_stamp_s": 509, "ground_truth": "A", "raw_output": "A. Red.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "bd91dba65d85691d9c4ce7b1d3d4d72b2796d8d7416aa065cb56256bdb15fa6f", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Pilot's hands manipulate controls as helicopter flies over urban and rural landscapes.  \n- A smartphone mounted on the dashboard displays navigation or flight data.  \n- Helicopter passes over a cluster of white silos and flooded fields, indicating changing terrain.\n[120-150s] - Pilot's hands manipulate controls as helicopter descends toward grassy field.  \n- Smartphone mounted on dashboard displays active navigation or flight data.  \n- Helicopter's rotor blades are visible, rotating as aircraft approaches ground.\n[150-180s] - Pilot adjusts headgear while seated in helicopter cockpit, looking toward camera.  \n- Hands grip control stick and throttle; seatbelt is fastened across torso.  \n- Helicopter rotor blades spin visibly, with grassy field and houses in background.\n[180-210s] - A man in a white shirt and cap sits in a small aircraft, smiling at the camera.  \n- Two women approach from a grassy field, one in a white t-shirt and denim shorts, the other in a black hoodie and shorts, both holding drinks.  \n- A group of people stands in the background near a church steeple, with shadows cast across the grass.\n[210-240s] - A group of children gathers around a blue and yellow helicopter on a grassy field, with some looking into the cockpit.  \n- One child in a red tank top and shorts stands near the helicopter’s open door, while others are positioned around the aircraft.  \n- A person in a black shirt and cap gestures toward the helicopter, possibly directing attention or explaining something to the group.\n[240-270s] - A man in a grey sweatshirt holds a purple bag while walking toward the helicopter, passing by a woman in a pink top holding a child.  \n- A group of young people, including one in a black \"Nike\" shirt, stand near the helicopter, observing the scene.  \n- The helicopter, with its rotors stationary, is positioned on a grassy field with a red brick building in the background.\n[270-300s] - A police officer in uniform stands on grass, gesturing with hands while facing the camera.  \n- Another officer walks toward the camera, carrying a bag, with a crowd of people visible in the background.  \n- The officer in the foreground adjusts his vest and looks around, with a red building and parked cars in the distance.\n[300-330s] - A young boy in a \"MOMMY\" shirt stands near adults, looking toward the camera with hands clasped.  \n- A man in a black shirt and sunglasses holds a phone, seemingly recording or taking a photo.  \n- A helicopter is parked on the grass, with people gathered around it, suggesting an event or activity.\n[330-360s] - A person in a dark blue shirt is seated behind a counter, interacting with a tablet device.  \n- Another individual in a red shirt and black apron stands beside them, also using a tablet.  \n- A hand extends from the viewer’s perspective, handing over a red card to the person behind the counter.\n[360-390s] - A man in a grey shirt and shorts sits on a bench holding a purple object, facing the camera.  \n- A man in a red shirt and black apron walks toward the camera, carrying black bags.  \n- The camera pans to show a \"Bubba's BBQ\" sign and outdoor seating area with people and vehicles in the background.\n[390-420s] - A man in a red shirt and blue apron hands a black trash bag to the camera person while standing near a \"Submarine\" sign.  \n- The camera person extends a hand to receive the bag, then gestures toward a nearby food stall.  \n- A second man, wearing a white shirt and cap, is seen eating ribs from a styrofoam container at an outdoor table.\n[420-450s] - Man in white t-shirt and cap takes a bite of a burger while seated under a wooden pergola.  \n- He then leans forward, gesturing with his hands while holding a black object, possibly a phone or camera.  \n- Background shows a yellow building with black-framed windows and a clear blue sky.\n[450-480s] - A man in a red shirt and dark shorts stands with hands on hips, facing a small blue helicopter on grass.  \n- Another person in a black top and shorts stands nearby, holding a water bottle.  \n- The camera operator’s hand reaches toward the helicopter’s cockpit, suggesting interaction or inspection.", "history_tokens": 986, "history_utf8_bytes": 4161, "recent_frame_times_s": [480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0], "recent_frames_sha256": "b881d5a0d5a507011cdb68820efe26f058b6e2148f2d8873b9151a79c1c802a0", "num_recent_frames": 30, "tq": 710599.708682378, "t1": 710601.489333855, "ta": 710601.489333855, "te": 710601.65017011, "first_response_s": 1.7806514769326895, "answer_total_s": 1.9414877319941297, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 432, "content_group": "81520497120df27eb82a393dd9d12f41cbd6b4d51e2ad63e8e4295da954285c2", "question": {"question_id": "sample_432_a1339_q0", "video_id": 432, "video_path": "./videos/sample_432_real.mp4", "annotation_index": 1339, "question_index": 0, "question": "What type of vehicle is visible from the cockpit view right now?", "options": ["A. Helicopter.", "B. Paraglider.", "C. Hot air balloon.", "D. Airplane."], "answer": "D", "time_stamp_s": 4, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_432_a1339_q0", "video_id": 432, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b8b0e68d77acc9f34fb5e063bdea921952892ecc0fa5ba08bafb571f01677bdf", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003], "recent_frames_sha256": "bbd040a011e021e830247b0837c6406448f1f534b3454c5a47ba7a6edf92acc6", "num_recent_frames": 4, "tq": 716213.679167324, "t1": 716214.893809049, "ta": 716214.893809049, "te": 716214.931446692, "first_response_s": 1.2146417250623927, "answer_total_s": 1.2522793679963797, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_432_a1339_q0", "video_id": 432, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a481db9e8c81e17b43482a8b4b1b0e8ad9d35831351fe16a2f844f9d4f6816fd", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003], "recent_frames_sha256": "bbd040a011e021e830247b0837c6406448f1f534b3454c5a47ba7a6edf92acc6", "num_recent_frames": 4, "tq": 716071.266416576, "t1": 716082.905374302, "ta": 716082.905374302, "te": 716083.055402884, "first_response_s": 11.638957725954242, "answer_total_s": 11.78898630803451, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 432, "content_group": "81520497120df27eb82a393dd9d12f41cbd6b4d51e2ad63e8e4295da954285c2", "question": {"question_id": "sample_432_a1340_q0", "video_id": 432, "video_path": "./videos/sample_432_real.mp4", "annotation_index": 1340, "question_index": 0, "question": "What is the plane flying above now?", "options": ["A. Above the islands.", "B. Above the field.", "C. Above the mountain.", "D. Above the lake."], "answer": "D", "time_stamp_s": 72, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [108, 113], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_432_a1340_q0", "video_id": 432, "time_stamp_s": 72, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9d3343c3db40c8657cb157663c85aab7bad5ba7b49178d287a56c07298343a31", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667], "recent_frames_sha256": "8a3a57b8c12ab7de43c39755e65b349a1b72ecaf16cef3c9ec2537148c45b9f7", "num_recent_frames": 30, "tq": 716214.968873422, "t1": 716221.989902681, "ta": 716221.989902681, "te": 716222.026801351, "first_response_s": 7.021029258961789, "answer_total_s": 7.057927928981371, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_432_a1340_q0", "video_id": 432, "time_stamp_s": 72, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "639fe768a5401c48099ce9fc131ff27fe899223c640e66335f9143654b575e21", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a grey shirt and cap sits on a red chair, holding a blue object, with a small aircraft and orange container nearby on grassy terrain.  \n- A small red-and-white biplane (N8-014) is parked on a runway, with a man walking toward it, set against a backdrop of mountains and clouds.  \n- A long white glider is being maneuvered across a grassy field, with a man walking alongside it, near a paved path, under a partly cloudy sky.\n[30-60s] - Pilot's hands manipulate controls while seated in a glider cockpit, with a digital display showing flight data.  \n- The glider moves forward along a runway, with mountains and clouds visible in the background.  \n- The pilot’s legs are visible, wearing shorts, and a watch is on the left wrist.", "history_tokens": 185, "history_utf8_bytes": 749, "recent_frame_times_s": [42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667], "recent_frames_sha256": "8a3a57b8c12ab7de43c39755e65b349a1b72ecaf16cef3c9ec2537148c45b9f7", "num_recent_frames": 30, "tq": 716100.406097758, "t1": 716108.803631728, "ta": 716108.803631728, "te": 716108.844322858, "first_response_s": 8.397533970070072, "answer_total_s": 8.438225100049749, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 432, "content_group": "81520497120df27eb82a393dd9d12f41cbd6b4d51e2ad63e8e4295da954285c2", "question": {"question_id": "sample_432_a1341_q0", "video_id": 432, "video_path": "./videos/sample_432_real.mp4", "annotation_index": 1341, "question_index": 0, "question": "What type of structure can be seen on the hilltop right now?", "options": ["A. Lighthouse.", "B. Windmill.", "C. Observation Deck.", "D. A red and white tower."], "answer": "D", "time_stamp_s": 252, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [216, 221], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_432_a1341_q0", "video_id": 432, "time_stamp_s": 252, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5cc0575e2719b963aa1d6379441f076e35375c073b06a92cfb8d61ae02778195", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334], "recent_frames_sha256": "6486c167fa8ebdf9e8823ef4ea76b96417b19534b0300e66a7178f125e61c777", "num_recent_frames": 30, "tq": 716222.048378177, "t1": 716230.151177161, "ta": 716230.151177161, "te": 716230.188444333, "first_response_s": 8.102798984036781, "answer_total_s": 8.140066156047396, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_432_a1341_q0", "video_id": 432, "time_stamp_s": 252, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e060c92211bfad92484ec18ba28f66cd4a96628bf2f4d7afb70b63f2a758435a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a grey shirt and cap sits on a red chair, holding a blue object, with a small aircraft and orange container nearby on grassy terrain.  \n- A small red-and-white biplane (N8-014) is parked on a runway, with a man walking toward it, set against a backdrop of mountains and clouds.  \n- A long white glider is being maneuvered across a grassy field, with a man walking alongside it, near a paved path, under a partly cloudy sky.\n[30-60s] - Pilot's hands manipulate controls while seated in a glider cockpit, with a digital display showing flight data.  \n- The glider moves forward along a runway, with mountains and clouds visible in the background.  \n- The pilot’s legs are visible, wearing shorts, and a watch is on the left wrist.\n[60-90s] - Pilot’s hands adjust controls while seated in the cockpit, with a blue wristband visible.  \n- Wingtip extends into frame, showing the aircraft’s flight path over turquoise waters and coastal terrain.  \n- Clouds drift across the sky, casting shadows over the landscape below as the plane glides forward.\n[90-120s] - Pilot adjusts controls while seated in glider cockpit, with instrument panel and feet visible.  \n- Glider flies over patchwork farmland and urban areas, with wing and sky visible through cockpit.  \n- Pilot looks toward camera, smiling, as glider banks slightly, revealing landscape below.\n[120-150s] - Pilot's hands are on controls, with a GPS screen visible in cockpit.  \n- Wingtip extends to right side of frame, showing aircraft's structure.  \n- Landscape below includes a large body of water and patchwork farmland.\n[150-180s] - Pilot’s hands adjust controls while seated in a glider cockpit, with legs visible in shorts.  \n- The glider’s instrument panel displays flight data, including altimeter and attitude indicators.  \n- Below, a patchwork of green and brown fields stretches toward a distant river and coastline under partly cloudy skies.\n[180-210s] - Pilot's hands adjust controls while seated in a glider cockpit, with a blue object visible on the left side.  \n- The glider's instrument panel displays various gauges and a digital screen, indicating flight data.  \n- The landscape below transitions from urban areas to open fields and mountains, with clouds partially obscuring the view.\n[210-240s] - Pilot's hands grip controls; right hand adjusts throttle, left hand holds blue object.  \n- Glider's cockpit displays instruments, including altimeter and speedometer, with visible legs in shorts.  \n- Landscape below shows rolling hills, roads, and distant structures under a partly cloudy sky.", "history_tokens": 601, "history_utf8_bytes": 2591, "recent_frame_times_s": [222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334], "recent_frames_sha256": "6486c167fa8ebdf9e8823ef4ea76b96417b19534b0300e66a7178f125e61c777", "num_recent_frames": 30, "tq": 716160.387759421, "t1": 716161.972618466, "ta": 716161.972618466, "te": 716162.011461301, "first_response_s": 1.584859044989571, "answer_total_s": 1.6237018799874932, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 432, "content_group": "81520497120df27eb82a393dd9d12f41cbd6b4d51e2ad63e8e4295da954285c2", "question": {"question_id": "sample_432_a1342_q0", "video_id": 432, "video_path": "./videos/sample_432_real.mp4", "annotation_index": 1342, "question_index": 0, "question": "What is the dominant color of the fields visible right now?", "options": ["A. Green.", "B. Yellow.", "C. Brown.", "D. Blue."], "answer": "A", "time_stamp_s": 326, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [324, 329], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_432_a1342_q0", "video_id": 432, "time_stamp_s": 326, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3a4d059f7379fcbc393b081b31274106d0226bc27313cded9359e042f6314f6c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247], "recent_frames_sha256": "4b8a56f5717e8b82b10fea257837aa32e46378aa5e29a44f705ffc5591d6b452", "num_recent_frames": 30, "tq": 716230.212186906, "t1": 716237.689663401, "ta": 716237.689663401, "te": 716237.727166292, "first_response_s": 7.477476494968869, "answer_total_s": 7.514979386003688, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_432_a1342_q0", "video_id": 432, "time_stamp_s": 326, "ground_truth": "A", "raw_output": "A. Green.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "7c13965905cbf73276edbdf5c8367895a7f37b4b12c36c2b6a655b36567bd333", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man in a grey shirt and cap sits on a red chair, holding a blue object, with a small aircraft and orange container nearby on grassy terrain.  \n- A small red-and-white biplane (N8-014) is parked on a runway, with a man walking toward it, set against a backdrop of mountains and clouds.  \n- A long white glider is being maneuvered across a grassy field, with a man walking alongside it, near a paved path, under a partly cloudy sky.\n[30-60s] - Pilot's hands manipulate controls while seated in a glider cockpit, with a digital display showing flight data.  \n- The glider moves forward along a runway, with mountains and clouds visible in the background.  \n- The pilot’s legs are visible, wearing shorts, and a watch is on the left wrist.\n[60-90s] - Pilot’s hands adjust controls while seated in the cockpit, with a blue wristband visible.  \n- Wingtip extends into frame, showing the aircraft’s flight path over turquoise waters and coastal terrain.  \n- Clouds drift across the sky, casting shadows over the landscape below as the plane glides forward.\n[90-120s] - Pilot adjusts controls while seated in glider cockpit, with instrument panel and feet visible.  \n- Glider flies over patchwork farmland and urban areas, with wing and sky visible through cockpit.  \n- Pilot looks toward camera, smiling, as glider banks slightly, revealing landscape below.\n[120-150s] - Pilot's hands are on controls, with a GPS screen visible in cockpit.  \n- Wingtip extends to right side of frame, showing aircraft's structure.  \n- Landscape below includes a large body of water and patchwork farmland.\n[150-180s] - Pilot’s hands adjust controls while seated in a glider cockpit, with legs visible in shorts.  \n- The glider’s instrument panel displays flight data, including altimeter and attitude indicators.  \n- Below, a patchwork of green and brown fields stretches toward a distant river and coastline under partly cloudy skies.\n[180-210s] - Pilot's hands adjust controls while seated in a glider cockpit, with a blue object visible on the left side.  \n- The glider's instrument panel displays various gauges and a digital screen, indicating flight data.  \n- The landscape below transitions from urban areas to open fields and mountains, with clouds partially obscuring the view.\n[210-240s] - Pilot's hands grip controls; right hand adjusts throttle, left hand holds blue object.  \n- Glider's cockpit displays instruments, including altimeter and speedometer, with visible legs in shorts.  \n- Landscape below shows rolling hills, roads, and distant structures under a partly cloudy sky.\n[240-270s] - Pilot’s hands grip controls, with left hand on blue joystick and right on throttle.  \n- Aircraft’s cockpit displays multiple gauges and a digital screen showing flight data.  \n- Landscape below features green fields, roads, and a distant tower, with clouds partially obscuring the view.\n[270-300s] - Pilot's hands grip controls, with left hand on blue joystick and right on black stick, both steady.  \n- Dashboard displays multiple gauges, including speedometer and altimeter, with a digital screen showing flight data.  \n- Below, green and brown fields stretch toward distant hills, with a river and urban area visible on the left.", "history_tokens": 748, "history_utf8_bytes": 3241, "recent_frame_times_s": [296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247], "recent_frames_sha256": "4b8a56f5717e8b82b10fea257837aa32e46378aa5e29a44f705ffc5591d6b452", "num_recent_frames": 30, "tq": 716181.040427094, "t1": 716182.548078556, "ta": 716182.548078556, "te": 716182.698342072, "first_response_s": 1.5076514619868249, "answer_total_s": 1.6579149779863656, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 432, "content_group": "81520497120df27eb82a393dd9d12f41cbd6b4d51e2ad63e8e4295da954285c2", "question": {"question_id": "sample_432_a1343_q0", "video_id": 432, "video_path": "./videos/sample_432_real.mp4", "annotation_index": 1343, "question_index": 0, "question": "What object is the pilot's right hand holding right now?", "options": ["A. A map.", "B. A throttle.", "C. A compass.", "D. A joystick."], "answer": "D", "time_stamp_s": 434, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [432, 437], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_432_a1343_q0", "video_id": 432, "time_stamp_s": 434, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b31880e1168a3f6623f50a711b16cd64eb8f058a57bfd5221afd433975a844f9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256, 427.0266, 428.0276, 429.0286, 430.0296, 431.0306, 432.0316, 433.0326], "recent_frames_sha256": "573292aaefec8d5ec378cd4a61e0da2752ea2faefb46f371d1dc6343ba1f906c", "num_recent_frames": 30, "tq": 716237.745146188, "t1": 716274.369340982, "ta": 716274.369340982, "te": 716274.40698839, "first_response_s": 36.62419479410164, "answer_total_s": 36.66184220206924, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_432_a1343_q0", "video_id": 432, "time_stamp_s": 434, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6f4021cf1b699486d599f94c41b7326f21afbe095139350b56bacefd092a9b4f", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Pilot's hands manipulate controls while seated in a glider cockpit, with a digital display showing flight data.  \n- The glider moves forward along a runway, with mountains and clouds visible in the background.  \n- The pilot’s legs are visible, wearing shorts, and a watch is on the left wrist.\n[60-90s] - Pilot’s hands adjust controls while seated in the cockpit, with a blue wristband visible.  \n- Wingtip extends into frame, showing the aircraft’s flight path over turquoise waters and coastal terrain.  \n- Clouds drift across the sky, casting shadows over the landscape below as the plane glides forward.\n[90-120s] - Pilot adjusts controls while seated in glider cockpit, with instrument panel and feet visible.  \n- Glider flies over patchwork farmland and urban areas, with wing and sky visible through cockpit.  \n- Pilot looks toward camera, smiling, as glider banks slightly, revealing landscape below.\n[120-150s] - Pilot's hands are on controls, with a GPS screen visible in cockpit.  \n- Wingtip extends to right side of frame, showing aircraft's structure.  \n- Landscape below includes a large body of water and patchwork farmland.\n[150-180s] - Pilot’s hands adjust controls while seated in a glider cockpit, with legs visible in shorts.  \n- The glider’s instrument panel displays flight data, including altimeter and attitude indicators.  \n- Below, a patchwork of green and brown fields stretches toward a distant river and coastline under partly cloudy skies.\n[180-210s] - Pilot's hands adjust controls while seated in a glider cockpit, with a blue object visible on the left side.  \n- The glider's instrument panel displays various gauges and a digital screen, indicating flight data.  \n- The landscape below transitions from urban areas to open fields and mountains, with clouds partially obscuring the view.\n[210-240s] - Pilot's hands grip controls; right hand adjusts throttle, left hand holds blue object.  \n- Glider's cockpit displays instruments, including altimeter and speedometer, with visible legs in shorts.  \n- Landscape below shows rolling hills, roads, and distant structures under a partly cloudy sky.\n[240-270s] - Pilot’s hands grip controls, with left hand on blue joystick and right on throttle.  \n- Aircraft’s cockpit displays multiple gauges and a digital screen showing flight data.  \n- Landscape below features green fields, roads, and a distant tower, with clouds partially obscuring the view.\n[270-300s] - Pilot's hands grip controls, with left hand on blue joystick and right on black stick, both steady.  \n- Dashboard displays multiple gauges, including speedometer and altimeter, with a digital screen showing flight data.  \n- Below, green and brown fields stretch toward distant hills, with a river and urban area visible on the left.\n[300-330s] - Pilot’s hands grip controls, with left hand on blue joystick and right on throttle, both steady during flight.\n- Dashboard displays altitude, speed, and GPS map; instruments show consistent readings as aircraft glides.\n- Landscape below features rolling green hills, farmland, and distant towns, viewed from a high, forward-facing perspective.\n[330-360s] - Pilot’s hands grip controls, with right hand adjusting a knob near the center console.  \n- Left hand holds a blue joystick, positioned near the left side of the cockpit.  \n- The aircraft’s dashboard displays multiple gauges and a small screen, with the pilot’s legs visible in shorts.\n[360-390s] - Pilot’s hands grip controls, with left hand on blue joystick and right hand on throttle.  \n- Instrument panel displays altitude, speed, and GPS map; compass and altimeter visible.  \n- Landscape below shows rolling hills, fields, and distant towns under cloudy sky.\n[390-420s] - Pilot’s hands manipulate controls while seated in a glider cockpit, with a blue joystick on the left and a black control stick on the right.\n- The glider’s instrument panel displays multiple gauges and a digital screen, with the pilot’s legs visible in gray shorts.\n- The landscape below features rolling green hills, patches of farmland, and distant mountains under a partly cloudy sky.", "history_tokens": 935, "history_utf8_bytes": 4148, "recent_frame_times_s": [404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256, 427.0266, 428.0276, 429.0286, 430.0296, 431.0306, 432.0316, 433.0326], "recent_frames_sha256": "573292aaefec8d5ec378cd4a61e0da2752ea2faefb46f371d1dc6343ba1f906c", "num_recent_frames": 30, "tq": 716211.855212211, "t1": 716213.446515203, "ta": 716213.446515203, "te": 716213.63702759, "first_response_s": 1.591302991961129, "answer_total_s": 1.7818153789266944, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 433, "content_group": "d2400dbb11310664c7a84eb00f64a1d6973b890f857d00b4d1045d069aceb55a", "question": {"question_id": "sample_433_a132_q0", "video_id": 433, "video_path": "./videos/sample_433_real.mp4", "annotation_index": 132, "question_index": 0, "question": "What color is the man's sweatshirt right now?", "options": ["A. Beige.", "B. Blue.", "C. Red.", "D. Green."], "answer": "A", "time_stamp_s": 4, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_433_a132_q0", "video_id": 433, "time_stamp_s": 4, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1d0520669e86cbbdaff7ba34f1e397d5df6174cb6861b5f7ea341e5c283878a0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003], "recent_frames_sha256": "f5633a21d2ad20f723645a257ffde3264656a006898cb52c5324448e838eed51", "num_recent_frames": 4, "tq": 710622.946373921, "t1": 710628.667230143, "ta": 710628.667230143, "te": 710628.705328576, "first_response_s": 5.720856221974827, "answer_total_s": 5.758954655029811, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_433_a132_q0", "video_id": 433, "time_stamp_s": 4, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "61c6aeec285ba1e0f05586bedde0b3c6c568e3238f1a92fab9eb60ad0c632dc4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003], "recent_frames_sha256": "f5633a21d2ad20f723645a257ffde3264656a006898cb52c5324448e838eed51", "num_recent_frames": 4, "tq": 710456.719978131, "t1": 710463.462759465, "ta": 710463.462759465, "te": 710463.741539588, "first_response_s": 6.742781333974563, "answer_total_s": 7.021561456960626, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 433, "content_group": "d2400dbb11310664c7a84eb00f64a1d6973b890f857d00b4d1045d069aceb55a", "question": {"question_id": "sample_433_a133_q0", "video_id": 433, "video_path": "./videos/sample_433_real.mp4", "annotation_index": 133, "question_index": 0, "question": "What type of vehicle appears near the open parking lot right now?", "options": ["A. Motorcycle.", "B. Helicopter.", "C. Bicycle.", "D. Car."], "answer": "D", "time_stamp_s": 126, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [137, 142], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_433_a133_q0", "video_id": 433, "time_stamp_s": 126, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f44add3d4f484d47596135bbb533d90dc8abb83680598d49198a40fef9063ee4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667], "recent_frames_sha256": "32a1e4905beb7e1a81c1e8c40b1a2ca402f42d56ffc9d884058a758089333cdc", "num_recent_frames": 30, "tq": 710628.72918615, "t1": 710639.937519071, "ta": 710639.937519071, "te": 710639.976036738, "first_response_s": 11.208332921029069, "answer_total_s": 11.246850588009693, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_433_a133_q0", "video_id": 433, "time_stamp_s": 126, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1b25eec7eee7107f3896911a59db491296cdb1dde9856a9403c5be4963f46880", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pilot in tan hoodie and headset sits in cockpit, hands on controls, looking forward.  \n- Helicopter interior visible with clear canopy, showing expansive fields below.  \n- Pilot briefly glances at phone in hand while seated, then returns focus to flight.\n[30-60s] - Pilot in tan hoodie and headset sits in cockpit, secured by seatbelt, facing camera.  \n- Helicopter cockpit view shows expansive landscape with lakes, roads, and greenery below.  \n- Instrument panel and control yoke visible, with camera mounted on top of cockpit.\n[60-90s] - Helicopter cockpit view shows pilot’s gloved hand near controls, with instruments and a mounted camera visible.  \n- Below, a golf course with water features and trees is seen, with a parking lot and road appearing as the helicopter descends.  \n- The landscape transitions from open fields to urban areas, with buildings and roads becoming more prominent as the helicopter moves forward.\n[90-120s] - Helicopter cockpit view shows instruments and controls with a clear sky above.\n- Below, a sprawling suburban landscape with roads, parking lots, and commercial buildings is visible.\n- The helicopter steadily moves forward, revealing more of the developed area as it flies over.", "history_tokens": 267, "history_utf8_bytes": 1229, "recent_frame_times_s": [96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667], "recent_frames_sha256": "32a1e4905beb7e1a81c1e8c40b1a2ca402f42d56ffc9d884058a758089333cdc", "num_recent_frames": 30, "tq": 710496.97362235, "t1": 710499.005872963, "ta": 710499.005872963, "te": 710499.225027274, "first_response_s": 2.032250612974167, "answer_total_s": 2.2514049239689484, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 433, "content_group": "d2400dbb11310664c7a84eb00f64a1d6973b890f857d00b4d1045d069aceb55a", "question": {"question_id": "sample_433_a134_q0", "video_id": 433, "video_path": "./videos/sample_433_real.mp4", "annotation_index": 134, "question_index": 0, "question": "What is the vehicle being operated right now?", "options": ["A. Airplane.", "B. Boat.", "C. Car.", "D. Helicopter."], "answer": "D", "time_stamp_s": 275, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [274, 279], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_433_a134_q0", "video_id": 433, "time_stamp_s": 275, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f8a51dcd6aca525f090990ef796f23bdebcefb9ffe9d1155f84dfba134d88ec4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667], "recent_frames_sha256": "3cf050090b2a9ec3718966476d77dcf093bf25e99ed22aa73e1a698ce6018b48", "num_recent_frames": 30, "tq": 710639.989889705, "t1": 710646.914085858, "ta": 710646.914085858, "te": 710646.952427899, "first_response_s": 6.924196153064258, "answer_total_s": 6.962538194027729, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_433_a134_q0", "video_id": 433, "time_stamp_s": 275, "ground_truth": "D", "raw_output": "D. Helicopter.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "da21bed7a4b9c22c355a2d01563b801dd15bf11d2955c1a0c99aca787bdd432c", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pilot in tan hoodie and headset sits in cockpit, hands on controls, looking forward.  \n- Helicopter interior visible with clear canopy, showing expansive fields below.  \n- Pilot briefly glances at phone in hand while seated, then returns focus to flight.\n[30-60s] - Pilot in tan hoodie and headset sits in cockpit, secured by seatbelt, facing camera.  \n- Helicopter cockpit view shows expansive landscape with lakes, roads, and greenery below.  \n- Instrument panel and control yoke visible, with camera mounted on top of cockpit.\n[60-90s] - Helicopter cockpit view shows pilot’s gloved hand near controls, with instruments and a mounted camera visible.  \n- Below, a golf course with water features and trees is seen, with a parking lot and road appearing as the helicopter descends.  \n- The landscape transitions from open fields to urban areas, with buildings and roads becoming more prominent as the helicopter moves forward.\n[90-120s] - Helicopter cockpit view shows instruments and controls with a clear sky above.\n- Below, a sprawling suburban landscape with roads, parking lots, and commercial buildings is visible.\n- The helicopter steadily moves forward, revealing more of the developed area as it flies over.\n[120-150s] - Helicopter cockpit view shows pilot's hands on controls as aircraft descends toward a grassy field.  \n- Ground below transitions from urban roads and buildings to open fields with scattered trees.  \n- Aircraft approaches a large building with a flat roof, likely an airport or industrial facility, as it nears landing.\n[150-180s] - Pilot's hands are visible on controls, adjusting levers and grips.  \n- Cockpit instruments display active flight data, including altimeter and attitude indicators.  \n- Ground view shows grassy field with distant buildings and parked vehicles.\n[180-210s] - Hand reaches for and pulls a door handle to enter a building.  \n- Interior view shows a long hallway with large windows overlooking a parking lot.  \n- Glass doors with \"MOD\" signs are visible as the person enters.\n[210-240s] - A person in a yellow shirt walks past a closed door in a hallway.  \n- A hand holds a red pizza box with \"DQ\" logo, moving toward an exit.  \n- The camera pans to show a parking lot with cars and a building entrance.\n[240-270s] - A blue and yellow helicopter (R22 Beta II) is parked on a grassy field with a red \"MODY\" sign in the foreground.  \n- The pilot's hand is seen reaching for and manipulating controls inside the cockpit, including a throttle lever and a control stick.  \n- The cockpit interior features a digital display showing a live feed of a person’s face, likely a camera mounted on the helicopter.", "history_tokens": 612, "history_utf8_bytes": 2671, "recent_frame_times_s": [245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275, 254.00375, 255.00475, 256.00575, 257.00675, 258.00775, 259.00875, 260.00975, 261.01075, 262.01175, 263.01275, 264.01375, 265.01475, 266.01575, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667], "recent_frames_sha256": "3cf050090b2a9ec3718966476d77dcf093bf25e99ed22aa73e1a698ce6018b48", "num_recent_frames": 30, "tq": 710543.725341684, "t1": 710550.624117245, "ta": 710550.624117245, "te": 710550.81844336, "first_response_s": 6.89877556101419, "answer_total_s": 7.0931016760878265, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 433, "content_group": "d2400dbb11310664c7a84eb00f64a1d6973b890f857d00b4d1045d069aceb55a", "question": {"question_id": "sample_433_a135_q0", "video_id": 433, "video_path": "./videos/sample_433_real.mp4", "annotation_index": 135, "question_index": 0, "question": "What type of headset is the man wearing right now?", "options": ["A. HiFi.", "B. Reverberant.", "C. No function.", "D. Aviation."], "answer": "D", "time_stamp_s": 413, "task_type": "Causal Reasoning", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [411, 416], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_433_a135_q0", "video_id": 433, "time_stamp_s": 413, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e6f94b9aa6a349aa5bd423e95f65df2d57152d11a73b6b4a21d4c3b5a3bcd094", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [383.01596666666666, 384.00028333333336, 385.00128333333333, 386.0022833333333, 387.00328333333334, 388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116], "recent_frames_sha256": "1c19c145c175c82a1bd59fa7d3a304b166abd9226e4b459be9009841ce73e1b7", "num_recent_frames": 30, "tq": 710646.965198376, "t1": 710660.045304271, "ta": 710660.045304271, "te": 710660.083690782, "first_response_s": 13.080105895060115, "answer_total_s": 13.118492405978031, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_433_a135_q0", "video_id": 433, "time_stamp_s": 413, "ground_truth": "D", "raw_output": "D. Aviation.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "a6c1eeff4d620c228aba3ae393150c0bb434ec64aa5a3e30e7d0b8c36bf603d3", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pilot in tan hoodie and headset sits in cockpit, hands on controls, looking forward.  \n- Helicopter interior visible with clear canopy, showing expansive fields below.  \n- Pilot briefly glances at phone in hand while seated, then returns focus to flight.\n[30-60s] - Pilot in tan hoodie and headset sits in cockpit, secured by seatbelt, facing camera.  \n- Helicopter cockpit view shows expansive landscape with lakes, roads, and greenery below.  \n- Instrument panel and control yoke visible, with camera mounted on top of cockpit.\n[60-90s] - Helicopter cockpit view shows pilot’s gloved hand near controls, with instruments and a mounted camera visible.  \n- Below, a golf course with water features and trees is seen, with a parking lot and road appearing as the helicopter descends.  \n- The landscape transitions from open fields to urban areas, with buildings and roads becoming more prominent as the helicopter moves forward.\n[90-120s] - Helicopter cockpit view shows instruments and controls with a clear sky above.\n- Below, a sprawling suburban landscape with roads, parking lots, and commercial buildings is visible.\n- The helicopter steadily moves forward, revealing more of the developed area as it flies over.\n[120-150s] - Helicopter cockpit view shows pilot's hands on controls as aircraft descends toward a grassy field.  \n- Ground below transitions from urban roads and buildings to open fields with scattered trees.  \n- Aircraft approaches a large building with a flat roof, likely an airport or industrial facility, as it nears landing.\n[150-180s] - Pilot's hands are visible on controls, adjusting levers and grips.  \n- Cockpit instruments display active flight data, including altimeter and attitude indicators.  \n- Ground view shows grassy field with distant buildings and parked vehicles.\n[180-210s] - Hand reaches for and pulls a door handle to enter a building.  \n- Interior view shows a long hallway with large windows overlooking a parking lot.  \n- Glass doors with \"MOD\" signs are visible as the person enters.\n[210-240s] - A person in a yellow shirt walks past a closed door in a hallway.  \n- A hand holds a red pizza box with \"DQ\" logo, moving toward an exit.  \n- The camera pans to show a parking lot with cars and a building entrance.\n[240-270s] - A blue and yellow helicopter (R22 Beta II) is parked on a grassy field with a red \"MODY\" sign in the foreground.  \n- The pilot's hand is seen reaching for and manipulating controls inside the cockpit, including a throttle lever and a control stick.  \n- The cockpit interior features a digital display showing a live feed of a person’s face, likely a camera mounted on the helicopter.\n[270-300s] - Pilot's hands manipulate control levers and switches on the cockpit panel.  \n- A text overlay appears, stating: \"I am smelling to make sure the engine is not flooded (if you smell a excessive amount of fuel it may be flooded).\"  \n- The helicopter's dashboard displays various gauges and indicators, with the view outside showing a grassy field and distant buildings.\n[300-330s] - Pilot's gloved hand grips the cyclic control stick, adjusting helicopter pitch.  \n- The helicopter's nose pitches upward as it lifts off from the grassy field.  \n- The cockpit view reveals a clear sky and distant buildings as the helicopter ascends.\n[330-360s] - Pilot in tan shirt and helmet seated in helicopter cockpit, hands on controls, looking forward.  \n- Helicopter interior shows clear canopy, dashboard, and seatbelt; sun glints through canopy.  \n- Cityscape below includes residential areas, roads, and greenery, visible through the transparent canopy.\n[360-390s] - Helicopter cockpit view shows pilot’s hands on controls with instruments active.  \n- Below, suburban landscape with houses and trees stretches under clear blue sky.  \n- Camera angle shifts slightly, revealing more of the horizon and distant urban sprawl.", "history_tokens": 890, "history_utf8_bytes": 3898, "recent_frame_times_s": [383.01596666666666, 384.00028333333336, 385.00128333333333, 386.0022833333333, 387.00328333333334, 388.0042833333333, 389.00528333333335, 390.00628333333333, 391.0072833333333, 392.00828333333334, 393.0092833333333, 394.01028333333335, 395.0112833333333, 396.01228333333336, 397.01328333333333, 398.0142833333333, 399.01528333333334, 400.0162833333333, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116], "recent_frames_sha256": "1c19c145c175c82a1bd59fa7d3a304b166abd9226e4b459be9009841ce73e1b7", "num_recent_frames": 30, "tq": 710579.585940139, "t1": 710587.548266091, "ta": 710587.548266091, "te": 710587.695626216, "first_response_s": 7.962325952015817, "answer_total_s": 8.109686076990329, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 433, "content_group": "d2400dbb11310664c7a84eb00f64a1d6973b890f857d00b4d1045d069aceb55a", "question": {"question_id": "sample_433_a136_q0", "video_id": 433, "video_path": "./videos/sample_433_real.mp4", "annotation_index": 136, "question_index": 0, "question": "What shape is the island in the water right now?", "options": ["A. Rectangular.", "B. Circular.", "C. Triangular.", "D. Oval."], "answer": "A", "time_stamp_s": 557, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [548, 553], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_433_a136_q0", "video_id": 433, "time_stamp_s": 557, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6db8130687a20ae48a5e8a72732bf32d3964c2cb8f3c45ac15bda829b3ff66ab", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [527.0098166666667, 528.0108166666666, 529.0118166666666, 530.0128166666667, 531.0138166666667, 532.0148166666667, 533.0158166666666, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.00045, 552.00145, 553.00245, 554.00345, 555.00445, 556.00545], "recent_frames_sha256": "74a0872498fb6f3ac9e9c72a92226a4843874eb80f5fe8c07b697bc67ca20e77", "num_recent_frames": 30, "tq": 710660.101124265, "t1": 710673.915928837, "ta": 710673.915928837, "te": 710673.955144285, "first_response_s": 13.81480457202997, "answer_total_s": 13.854020019993186, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_433_a136_q0", "video_id": 433, "time_stamp_s": 557, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "658d1999f944a3e3a5e8482c655689cf78d8230c0efa8815a794c3426ac07429", "condition_order": ["notes", "recent"], "memory": "[120-150s] - Helicopter cockpit view shows pilot's hands on controls as aircraft descends toward a grassy field.  \n- Ground below transitions from urban roads and buildings to open fields with scattered trees.  \n- Aircraft approaches a large building with a flat roof, likely an airport or industrial facility, as it nears landing.\n[150-180s] - Pilot's hands are visible on controls, adjusting levers and grips.  \n- Cockpit instruments display active flight data, including altimeter and attitude indicators.  \n- Ground view shows grassy field with distant buildings and parked vehicles.\n[180-210s] - Hand reaches for and pulls a door handle to enter a building.  \n- Interior view shows a long hallway with large windows overlooking a parking lot.  \n- Glass doors with \"MOD\" signs are visible as the person enters.\n[210-240s] - A person in a yellow shirt walks past a closed door in a hallway.  \n- A hand holds a red pizza box with \"DQ\" logo, moving toward an exit.  \n- The camera pans to show a parking lot with cars and a building entrance.\n[240-270s] - A blue and yellow helicopter (R22 Beta II) is parked on a grassy field with a red \"MODY\" sign in the foreground.  \n- The pilot's hand is seen reaching for and manipulating controls inside the cockpit, including a throttle lever and a control stick.  \n- The cockpit interior features a digital display showing a live feed of a person’s face, likely a camera mounted on the helicopter.\n[270-300s] - Pilot's hands manipulate control levers and switches on the cockpit panel.  \n- A text overlay appears, stating: \"I am smelling to make sure the engine is not flooded (if you smell a excessive amount of fuel it may be flooded).\"  \n- The helicopter's dashboard displays various gauges and indicators, with the view outside showing a grassy field and distant buildings.\n[300-330s] - Pilot's gloved hand grips the cyclic control stick, adjusting helicopter pitch.  \n- The helicopter's nose pitches upward as it lifts off from the grassy field.  \n- The cockpit view reveals a clear sky and distant buildings as the helicopter ascends.\n[330-360s] - Pilot in tan shirt and helmet seated in helicopter cockpit, hands on controls, looking forward.  \n- Helicopter interior shows clear canopy, dashboard, and seatbelt; sun glints through canopy.  \n- Cityscape below includes residential areas, roads, and greenery, visible through the transparent canopy.\n[360-390s] - Helicopter cockpit view shows pilot’s hands on controls with instruments active.  \n- Below, suburban landscape with houses and trees stretches under clear blue sky.  \n- Camera angle shifts slightly, revealing more of the horizon and distant urban sprawl.\n[390-420s] - Pilot in tan shirt and headset seated in helicopter cockpit, looking forward with hands on controls.  \n- Helicopter interior shows dashboard instruments and side-view mirrors; view outside reveals suburban landscape.  \n- Pilot briefly covers face with hand, then returns to forward gaze as helicopter continues flight.\n[420-450s] - Pilot seated in cockpit, wearing tan shirt and cap, looking forward with seatbelt fastened.  \n- Helicopter cockpit view shows control panel and windshield with visible horizon and river below.  \n- River stretches wide with brownish water, flanked by land and trees under clear blue sky.\n[450-480s] - Helicopter cockpit view shows pilot’s hand adjusting controls as aircraft flies low over river.  \n- Riverbanks with sparse vegetation and a small island become more prominent as helicopter approaches.  \n- Instrument panel and navigation screen remain visible, indicating steady flight path over water.\n[480-510s] - Helicopter cockpit view shows pilot's gloved hand near controls, with a tablet mounted on the left side.  \n- The helicopter is flying low over a wide river, with visible sandbars and tree-lined banks.  \n- Reflections of the pilot and cockpit interior are visible on the right-side window, indicating bright sunlight.\n[510-540s] - Helicopter cockpit view shows pilot’s hands on controls with a mounted camera above.  \n- Sun glints off the river’s surface, creating a bright reflection as the helicopter flies over the water.  \n- Riverbanks lined with trees and distant landmasses are visible under a clear blue sky.", "history_tokens": 968, "history_utf8_bytes": 4249, "recent_frame_times_s": [527.0098166666667, 528.0108166666666, 529.0118166666666, 530.0128166666667, 531.0138166666667, 532.0148166666667, 533.0158166666666, 534.0001333333333, 535.0011333333333, 536.0021333333333, 537.0031333333334, 538.0041333333334, 539.0051333333333, 540.0061333333333, 541.0071333333333, 542.0081333333334, 543.0091333333334, 544.0101333333333, 545.0111333333333, 546.0121333333333, 547.0131333333334, 548.0141333333333, 549.0151333333333, 550.0161333333333, 551.00045, 552.00145, 553.00245, 554.00345, 555.00445, 556.00545], "recent_frames_sha256": "74a0872498fb6f3ac9e9c72a92226a4843874eb80f5fe8c07b697bc67ca20e77", "num_recent_frames": 30, "tq": 710621.895332342, "t1": 710622.876575159, "ta": 710622.876575159, "te": 710622.913991854, "first_response_s": 0.9812428170116618, "answer_total_s": 1.0186595119303092, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 434, "content_group": "1dd933a194f9e6bd62daf77569e88d13f21bdf8d92e4a167a1d40660648c6700", "question": {"question_id": "sample_434_a2214_q0", "video_id": 434, "video_path": "./videos/sample_434_real.mp4", "annotation_index": 2214, "question_index": 0, "question": "What is the color of the pilot's headset right now?", "options": ["A. Black.", "B. Blue.", "C. Red.", "D. White."], "answer": "A", "time_stamp_s": 3, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_434_a2214_q0", "video_id": 434, "time_stamp_s": 3, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5f4dbfcb9d0bb34331abc67022424ae7023dd208bae0cd4b674ca2414fb3446e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "c338dc2c5deb69e038ef71780632da2136c559626542c0e0595339edc240fab5", "num_recent_frames": 4, "tq": 716610.998728554, "t1": 716616.336737922, "ta": 716616.336737922, "te": 716616.373622434, "first_response_s": 5.338009368046187, "answer_total_s": 5.374893879983574, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_434_a2214_q0", "video_id": 434, "time_stamp_s": 3, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cee99f75bb2ca00efda650673477958e489b29f568c0fad9cd6effefc0f76057", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "c338dc2c5deb69e038ef71780632da2136c559626542c0e0595339edc240fab5", "num_recent_frames": 4, "tq": 716435.020616019, "t1": 716448.797322794, "ta": 716448.797322794, "te": 716448.998387333, "first_response_s": 13.77670677495189, "answer_total_s": 13.977771313977428, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 434, "content_group": "1dd933a194f9e6bd62daf77569e88d13f21bdf8d92e4a167a1d40660648c6700", "question": {"question_id": "sample_434_a2215_q0", "video_id": 434, "video_path": "./videos/sample_434_real.mp4", "annotation_index": 2215, "question_index": 0, "question": "What device is currently mounted to the top of the helicopter's control panel?", "options": ["A. A camera.", "B. A GPS unit.", "C. An altimeter.", "D. A radar detector."], "answer": "A", "time_stamp_s": 127, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [124, 129], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_434_a2215_q0", "video_id": 434, "time_stamp_s": 127, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a489b2f190b2fe78623769d18e81fcfffdbb5cccf24ba6e5916a54b87e546505", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0], "recent_frames_sha256": "217d57e0dc9997ff2f14569dd562eb4e7c579f25227a9cf2797cbff66335f4d4", "num_recent_frames": 30, "tq": 716616.385520703, "t1": 716624.777529607, "ta": 716624.777529607, "te": 716624.815778621, "first_response_s": 8.392008903902024, "answer_total_s": 8.4302579179639, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_434_a2215_q0", "video_id": 434, "time_stamp_s": 127, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1a50cd2f1caa54d3ae8b8d9117f1eed18eb47d6147121c3ca098d8caf0b79eba", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man with a mustache, wearing a grey hoodie and a black cap, sits in a helicopter cockpit, smiling and gesturing with his hands while speaking.  \n- The helicopter's interior features a black seat with a yellow control stick, and a camera mounted above the pilot's head.  \n- The view outside shows a cloudy sky and a vast landscape below, including distant buildings and open fields.\n[30-60s] - Pilot in cockpit, wearing headset and grey hoodie, seated with seatbelt fastened, holding control stick with yellow knob.  \n- Helicopter interior visible, with transparent canopy showing cloudy sky and distant landscape below.  \n- Text overlay appears at 38s: \"To clarify – my first stop is at the high school, and after that, I’ll be flying over to the police station with the officer.\"\n[60-90s] - Pilot seated in cockpit, wearing grey sweater and black cap, looking forward with slight smile.  \n- Helicopter rotor blades spinning rapidly, visible in motion blur against cloudy sky.  \n- Landscape below shows flat terrain with scattered structures, viewed from elevated position.\n[90-120s] - Pilot in cockpit, hands on controls, looking out at cityscape below.  \n- Helicopter flies over residential areas, schools, and a river, with cloudy sky overhead.  \n- Camera pans to show a large parking lot and sports fields as the helicopter moves forward.", "history_tokens": 304, "history_utf8_bytes": 1358, "recent_frame_times_s": [98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0], "recent_frames_sha256": "217d57e0dc9997ff2f14569dd562eb4e7c579f25227a9cf2797cbff66335f4d4", "num_recent_frames": 30, "tq": 716480.712771619, "t1": 716487.514245025, "ta": 716487.514245025, "te": 716487.740948395, "first_response_s": 6.801473406027071, "answer_total_s": 7.028176776017062, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 434, "content_group": "1dd933a194f9e6bd62daf77569e88d13f21bdf8d92e4a167a1d40660648c6700", "question": {"question_id": "sample_434_a2216_q0", "video_id": 434, "video_path": "./videos/sample_434_real.mp4", "annotation_index": 2216, "question_index": 0, "question": "What is currently seen on the belt of the police officer?", "options": ["A. Flashlight.", "B. Handcuffs.", "C. Taser.", "D. Radio."], "answer": "C", "time_stamp_s": 248, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [248, 253], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_434_a2216_q0", "video_id": 434, "time_stamp_s": 248, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "507d64b41555d590b78dbc938621877195bc90fedb67abbe6d53991be2843822", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0], "recent_frames_sha256": "908b85f6d0ee911dcdafe53b8f193fa63116c2bc7288098b7d63ad283a1b9a1f", "num_recent_frames": 30, "tq": 716624.828162094, "t1": 716635.301797114, "ta": 716635.301797114, "te": 716635.339077505, "first_response_s": 10.473635019967332, "answer_total_s": 10.510915411054157, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_434_a2216_q0", "video_id": 434, "time_stamp_s": 248, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "890743c5455415be684a107f9f028ba247004d35c107a48a66b47ae44fcf54e0", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man with a mustache, wearing a grey hoodie and a black cap, sits in a helicopter cockpit, smiling and gesturing with his hands while speaking.  \n- The helicopter's interior features a black seat with a yellow control stick, and a camera mounted above the pilot's head.  \n- The view outside shows a cloudy sky and a vast landscape below, including distant buildings and open fields.\n[30-60s] - Pilot in cockpit, wearing headset and grey hoodie, seated with seatbelt fastened, holding control stick with yellow knob.  \n- Helicopter interior visible, with transparent canopy showing cloudy sky and distant landscape below.  \n- Text overlay appears at 38s: \"To clarify – my first stop is at the high school, and after that, I’ll be flying over to the police station with the officer.\"\n[60-90s] - Pilot seated in cockpit, wearing grey sweater and black cap, looking forward with slight smile.  \n- Helicopter rotor blades spinning rapidly, visible in motion blur against cloudy sky.  \n- Landscape below shows flat terrain with scattered structures, viewed from elevated position.\n[90-120s] - Pilot in cockpit, hands on controls, looking out at cityscape below.  \n- Helicopter flies over residential areas, schools, and a river, with cloudy sky overhead.  \n- Camera pans to show a large parking lot and sports fields as the helicopter moves forward.\n[120-150s] - Helicopter cockpit view shows spinning blades and instrument panel with a yellow \"Heli\" label on the right.\n- Below, a large green sports field with red running track and surrounding residential areas are visible.\n- The sky is overcast with gray clouds, and the horizon shows a faint orange glow near the horizon.\n[150-180s] - Helicopter cockpit view shows rotating blades and control panel with digital displays.\n- Ground below features a mix of residential houses, green fields, and a tennis court complex.\n- Camera pans slightly, revealing more of the suburban landscape as the helicopter moves forward.\n[180-210s] - Helicopter cockpit view shows pilot’s hand on control stick, with instruments and a small screen displaying flight data.\n- Ground below features a grassy field with parked cars and buildings under an overcast sky.\n- Helicopter remains stationary, with rotor blades visible in motion, suggesting preparation for takeoff or landing.\n[210-240s] - Pilot's hands manipulate control sticks and switches on the cockpit panel while seated.  \n- The helicopter's side door is opened, revealing the exterior with parked vehicles and a grassy field.  \n- The helicopter's exterior, marked \"R22 Beta II,\" is visible as the pilot adjusts the door handle.", "history_tokens": 585, "history_utf8_bytes": 2633, "recent_frame_times_s": [219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0], "recent_frames_sha256": "908b85f6d0ee911dcdafe53b8f193fa63116c2bc7288098b7d63ad283a1b9a1f", "num_recent_frames": 30, "tq": 716518.895841456, "t1": 716526.492888081, "ta": 716526.492888081, "te": 716526.768867365, "first_response_s": 7.5970466249855235, "answer_total_s": 7.873025908949785, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 434, "content_group": "1dd933a194f9e6bd62daf77569e88d13f21bdf8d92e4a167a1d40660648c6700", "question": {"question_id": "sample_434_a2217_q0", "video_id": 434, "video_path": "./videos/sample_434_real.mp4", "annotation_index": 2217, "question_index": 0, "question": "What color is the control stick's top?", "options": ["A. Yellow.", "B. Red.", "C. Blue.", "D. Green."], "answer": "A", "time_stamp_s": 376, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [372, 377], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_434_a2217_q0", "video_id": 434, "time_stamp_s": 376, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c1585830ab009be8783ad4a77306ea75bcc104ea93ec56a2f459f8c4c1831c88", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0], "recent_frames_sha256": "55a6ac56d7a5d2140d7383e57abdd3758e404ea9cb63bfb39f2f75881c4cfb1e", "num_recent_frames": 30, "tq": 716635.346943514, "t1": 716644.22991376, "ta": 716644.22991376, "te": 716644.451078873, "first_response_s": 8.882970246020705, "answer_total_s": 9.104135359055363, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_434_a2217_q0", "video_id": 434, "time_stamp_s": 376, "ground_truth": "A", "raw_output": "A. Yellow.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "f33ab5d55a6bbcf6e420438eed0a4f1c48a6110058c8b21d5e63013712341417", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A man with a mustache, wearing a grey hoodie and a black cap, sits in a helicopter cockpit, smiling and gesturing with his hands while speaking.  \n- The helicopter's interior features a black seat with a yellow control stick, and a camera mounted above the pilot's head.  \n- The view outside shows a cloudy sky and a vast landscape below, including distant buildings and open fields.\n[30-60s] - Pilot in cockpit, wearing headset and grey hoodie, seated with seatbelt fastened, holding control stick with yellow knob.  \n- Helicopter interior visible, with transparent canopy showing cloudy sky and distant landscape below.  \n- Text overlay appears at 38s: \"To clarify – my first stop is at the high school, and after that, I’ll be flying over to the police station with the officer.\"\n[60-90s] - Pilot seated in cockpit, wearing grey sweater and black cap, looking forward with slight smile.  \n- Helicopter rotor blades spinning rapidly, visible in motion blur against cloudy sky.  \n- Landscape below shows flat terrain with scattered structures, viewed from elevated position.\n[90-120s] - Pilot in cockpit, hands on controls, looking out at cityscape below.  \n- Helicopter flies over residential areas, schools, and a river, with cloudy sky overhead.  \n- Camera pans to show a large parking lot and sports fields as the helicopter moves forward.\n[120-150s] - Helicopter cockpit view shows spinning blades and instrument panel with a yellow \"Heli\" label on the right.\n- Below, a large green sports field with red running track and surrounding residential areas are visible.\n- The sky is overcast with gray clouds, and the horizon shows a faint orange glow near the horizon.\n[150-180s] - Helicopter cockpit view shows rotating blades and control panel with digital displays.\n- Ground below features a mix of residential houses, green fields, and a tennis court complex.\n- Camera pans slightly, revealing more of the suburban landscape as the helicopter moves forward.\n[180-210s] - Helicopter cockpit view shows pilot’s hand on control stick, with instruments and a small screen displaying flight data.\n- Ground below features a grassy field with parked cars and buildings under an overcast sky.\n- Helicopter remains stationary, with rotor blades visible in motion, suggesting preparation for takeoff or landing.\n[210-240s] - Pilot's hands manipulate control sticks and switches on the cockpit panel while seated.  \n- The helicopter's side door is opened, revealing the exterior with parked vehicles and a grassy field.  \n- The helicopter's exterior, marked \"R22 Beta II,\" is visible as the pilot adjusts the door handle.\n[240-270s] - A police officer in uniform stands beside a black police car, gesturing toward a dark gray sedan parked nearby.  \n- The officer appears to be conversing with someone off-camera, while the sedan’s driver-side window is partially open.  \n- A text overlay reveals that the officer, Troy, is retiring and will walk students out of the high school for the final time.\n[270-300s] - A police officer in uniform shakes hands with a person in a gray sweater near a parked police vehicle.  \n- A crowd of people stands in a parking lot, some holding cameras, as a child runs across the asphalt.  \n- A helicopter cockpit interior is shown with a man in a gray hoodie and cap seated, looking toward the camera.\n[300-330s] - Pilot in grey hoodie adjusts headset and grips controls, preparing for flight.  \n- Cop in uniform sits beside, also adjusting headset and looking forward.  \n- Helicopter cockpit view shows ground crew and police cars parked nearby.\n[330-360s] - Pilot gestures with hand while seated in cockpit, indicating direction or control input.  \n- Co-pilot (in uniform) points outward, likely directing attention to a specific ground feature or target.  \n- Helicopter flies over a large parking lot and adjacent sports fields, with buildings and roads visible below.", "history_tokens": 876, "history_utf8_bytes": 3916, "recent_frame_times_s": [347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0], "recent_frames_sha256": "55a6ac56d7a5d2140d7383e57abdd3758e404ea9cb63bfb39f2f75881c4cfb1e", "num_recent_frames": 30, "tq": 716561.817238872, "t1": 716563.388972381, "ta": 716563.388972381, "te": 716563.538593962, "first_response_s": 1.57173350895755, "answer_total_s": 1.721355089917779, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 434, "content_group": "1dd933a194f9e6bd62daf77569e88d13f21bdf8d92e4a167a1d40660648c6700", "question": {"question_id": "sample_434_a2218_q0", "video_id": 434, "video_path": "./videos/sample_434_real.mp4", "annotation_index": 2218, "question_index": 0, "question": "What color is the streamlining structure of the helicopter that is visible right now?", "options": ["A. Black.", "B. Red.", "C. Blue.", "D. Green."], "answer": "A", "time_stamp_s": 498, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [496, 501], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_434_a2218_q0", "video_id": 434, "time_stamp_s": 498, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "45dc6853b9ef80f8db1d3ba6a6fb9ee6f1ff731833fbb0b8ff4627408ad840f6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0], "recent_frames_sha256": "0ee83b5be92a857493c42137cf186a59d0288de03d2ee106f8de9d65ecfdc78c", "num_recent_frames": 30, "tq": 716644.469668937, "t1": 716650.681614875, "ta": 716650.681614875, "te": 716650.718986415, "first_response_s": 6.211945937946439, "answer_total_s": 6.249317477922887, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_434_a2218_q0", "video_id": 434, "time_stamp_s": 498, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "42d050392d85f8472aa20496358772c00de282b02720d86bad231c7b744676a2", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Pilot seated in cockpit, wearing grey sweater and black cap, looking forward with slight smile.  \n- Helicopter rotor blades spinning rapidly, visible in motion blur against cloudy sky.  \n- Landscape below shows flat terrain with scattered structures, viewed from elevated position.\n[90-120s] - Pilot in cockpit, hands on controls, looking out at cityscape below.  \n- Helicopter flies over residential areas, schools, and a river, with cloudy sky overhead.  \n- Camera pans to show a large parking lot and sports fields as the helicopter moves forward.\n[120-150s] - Helicopter cockpit view shows spinning blades and instrument panel with a yellow \"Heli\" label on the right.\n- Below, a large green sports field with red running track and surrounding residential areas are visible.\n- The sky is overcast with gray clouds, and the horizon shows a faint orange glow near the horizon.\n[150-180s] - Helicopter cockpit view shows rotating blades and control panel with digital displays.\n- Ground below features a mix of residential houses, green fields, and a tennis court complex.\n- Camera pans slightly, revealing more of the suburban landscape as the helicopter moves forward.\n[180-210s] - Helicopter cockpit view shows pilot’s hand on control stick, with instruments and a small screen displaying flight data.\n- Ground below features a grassy field with parked cars and buildings under an overcast sky.\n- Helicopter remains stationary, with rotor blades visible in motion, suggesting preparation for takeoff or landing.\n[210-240s] - Pilot's hands manipulate control sticks and switches on the cockpit panel while seated.  \n- The helicopter's side door is opened, revealing the exterior with parked vehicles and a grassy field.  \n- The helicopter's exterior, marked \"R22 Beta II,\" is visible as the pilot adjusts the door handle.\n[240-270s] - A police officer in uniform stands beside a black police car, gesturing toward a dark gray sedan parked nearby.  \n- The officer appears to be conversing with someone off-camera, while the sedan’s driver-side window is partially open.  \n- A text overlay reveals that the officer, Troy, is retiring and will walk students out of the high school for the final time.\n[270-300s] - A police officer in uniform shakes hands with a person in a gray sweater near a parked police vehicle.  \n- A crowd of people stands in a parking lot, some holding cameras, as a child runs across the asphalt.  \n- A helicopter cockpit interior is shown with a man in a gray hoodie and cap seated, looking toward the camera.\n[300-330s] - Pilot in grey hoodie adjusts headset and grips controls, preparing for flight.  \n- Cop in uniform sits beside, also adjusting headset and looking forward.  \n- Helicopter cockpit view shows ground crew and police cars parked nearby.\n[330-360s] - Pilot gestures with hand while seated in cockpit, indicating direction or control input.  \n- Co-pilot (in uniform) points outward, likely directing attention to a specific ground feature or target.  \n- Helicopter flies over a large parking lot and adjacent sports fields, with buildings and roads visible below.\n[360-390s] - Man in grey hoodie smiles while seated in helicopter cockpit, wearing headset and harness.  \n- Officer in dark uniform, wearing green ear protection and face mask, adjusts headset and looks at phone.  \n- Helicopter interior shows rotating blades and cityscape visible through curved windshield.\n[390-420s] - Man in grey hoodie smiles while seated in helicopter cockpit, wearing headset and harness.  \n- Pilot in black uniform with badge and headset adjusts earpiece, then rests hands on lap.  \n- Helicopter’s rotating blades visible overhead, with cityscape and open fields below.\n[420-450s] - Pilot in black uniform gestures with right hand while seated on right side of cockpit.  \n- Passenger in grey hoodie smiles and waves with left hand while seated on left side.  \n- Helicopter's rotor blades spin rapidly, visible above the cockpit canopy.\n[450-480s] - Two men seated in a helicopter cockpit; one in a grey hoodie and black helmet, the other in a dark uniform with headset and radio.  \n- The man in the uniform gestures with his right hand while speaking, and the man in the hoodie looks toward him.  \n- The helicopter’s view shows a sprawling urban landscape with roads, buildings, and a river below, under an overcast sky.", "history_tokens": 978, "history_utf8_bytes": 4368, "recent_frame_times_s": [469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0], "recent_frames_sha256": "0ee83b5be92a857493c42137cf186a59d0288de03d2ee106f8de9d65ecfdc78c", "num_recent_frames": 30, "tq": 716603.370969639, "t1": 716610.687784095, "ta": 716610.687784095, "te": 716610.969059585, "first_response_s": 7.316814455902204, "answer_total_s": 7.5980899459682405, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 435, "content_group": "ca9e2abc16d3bdd362dcc272c6244764aa3b14617d789865df51ba7b262ebb55", "question": {"question_id": "sample_435_a1461_q0", "video_id": 435, "video_path": "./videos/sample_435_real.mp4", "annotation_index": 1461, "question_index": 0, "question": "What instrument is visible on the pilot's lap right now?", "options": ["A. An altimeter.", "B. A compass.", "C. A throttle.", "D. A joystick."], "answer": "D", "time_stamp_s": 3, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_435_a1461_q0", "video_id": 435, "time_stamp_s": 3, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "25b3ea67fabc9778b92d852b5a9ca217a791920ac137dc09e13d69455e95d7a4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002], "recent_frames_sha256": "18c546e6a11e3ae8d2017be4e196d765f4d71dab907cc77b6e8c00024b15055a", "num_recent_frames": 3, "tq": 710551.699097686, "t1": 710563.238274778, "ta": 710563.238274778, "te": 710563.276732807, "first_response_s": 11.539177092025056, "answer_total_s": 11.577635121066123, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_435_a1461_q0", "video_id": 435, "time_stamp_s": 3, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ad4b071b3dda058e1de79c6c3ce8f0f55730a4a56a7ecf7152b656e4ff26de35", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002], "recent_frames_sha256": "18c546e6a11e3ae8d2017be4e196d765f4d71dab907cc77b6e8c00024b15055a", "num_recent_frames": 3, "tq": 710602.945536323, "t1": 710616.344973627, "ta": 710616.344973627, "te": 710616.382378062, "first_response_s": 13.399437304004095, "answer_total_s": 13.43684173899237, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 435, "content_group": "ca9e2abc16d3bdd362dcc272c6244764aa3b14617d789865df51ba7b262ebb55", "question": {"question_id": "sample_435_a1462_q0", "video_id": 435, "video_path": "./videos/sample_435_real.mp4", "annotation_index": 1462, "question_index": 0, "question": "Where is the airplane preparing to land?", "options": ["A. At the airport.", "B. On the mountain.", "C. In the field.", "D. On the grassland."], "answer": "D", "time_stamp_s": 78, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [75, 80], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_435_a1462_q0", "video_id": 435, "time_stamp_s": 78, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1a6455df5ff1068570dacab24c32862ec5769145b4e704ab06fd1de1887856fb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667], "recent_frames_sha256": "77eeb8376e10a7245a5eeada2c37e625e90aa1c86bbab2137289c2060e49fe9a", "num_recent_frames": 30, "tq": 710563.301473109, "t1": 710575.093356641, "ta": 710575.093356641, "te": 710575.130322098, "first_response_s": 11.791883531957865, "answer_total_s": 11.828848988981918, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_435_a1462_q0", "video_id": 435, "time_stamp_s": 78, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "41765d9faf766fc0119cee3022a7d90e5aaa1c0fbca341ab7592219a6201564e", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pilot's hands manipulate controls and interact with a digital display in the cockpit while flying over a rural landscape.  \n- The aircraft's nose points forward, with the horizon and terrain visible through the windshield, showing a mix of fields, trees, and infrastructure.  \n- The cockpit interior features a modern instrument panel with multiple screens and buttons, indicating active flight management.\n[30-60s] - Pilot's hands adjust controls as glider descends toward runway, with digital display showing flight data.  \n- Landscape transitions from forested areas to open green fields, with a road and distant buildings visible.  \n- Glider approaches runway head-on, with clouds overhead and terrain below becoming more defined.", "history_tokens": 149, "history_utf8_bytes": 744, "recent_frame_times_s": [48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333, 54.020633333333336, 55.021633333333334, 56.02263333333333, 57.023633333333336, 58.024633333333334, 59.02563333333333, 60.026633333333336, 61.027633333333334, 62.02863333333333, 63.02963333333334, 64.03063333333333, 65.03163333333333, 66.03263333333334, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667], "recent_frames_sha256": "77eeb8376e10a7245a5eeada2c37e625e90aa1c86bbab2137289c2060e49fe9a", "num_recent_frames": 30, "tq": 710634.392740752, "t1": 710641.294178942, "ta": 710641.294178942, "te": 710641.481047162, "first_response_s": 6.9014381900196895, "answer_total_s": 7.088306410005316, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 435, "content_group": "ca9e2abc16d3bdd362dcc272c6244764aa3b14617d789865df51ba7b262ebb55", "question": {"question_id": "sample_435_a1463_q0", "video_id": 435, "video_path": "./videos/sample_435_real.mp4", "annotation_index": 1463, "question_index": 0, "question": "What is the color of the handgrip the pilot's left hand is holding right now?", "options": ["A. Red.", "B. Yellow.", "C. Green.", "D. Blue."], "answer": "D", "time_stamp_s": 151, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [150, 155], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_435_a1463_q0", "video_id": 435, "time_stamp_s": 151, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "294073a293aa667411f7def790ff419bf022e0ebbe43a6b0b94fa4868485e965", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334], "recent_frames_sha256": "cb84bc53f06a1c795498722162ae81a1d96cbbf5496c1f889096ff3361547eef", "num_recent_frames": 30, "tq": 710575.147421003, "t1": 710586.318911469, "ta": 710586.318911469, "te": 710586.504523099, "first_response_s": 11.171490465989336, "answer_total_s": 11.35710209608078, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_435_a1463_q0", "video_id": 435, "time_stamp_s": 151, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0222097596e245c2df268e5e4bb9b3b46259eaec417c44c271f3d1c17bdb34bf", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pilot's hands manipulate controls and interact with a digital display in the cockpit while flying over a rural landscape.  \n- The aircraft's nose points forward, with the horizon and terrain visible through the windshield, showing a mix of fields, trees, and infrastructure.  \n- The cockpit interior features a modern instrument panel with multiple screens and buttons, indicating active flight management.\n[30-60s] - Pilot's hands adjust controls as glider descends toward runway, with digital display showing flight data.  \n- Landscape transitions from forested areas to open green fields, with a road and distant buildings visible.  \n- Glider approaches runway head-on, with clouds overhead and terrain below becoming more defined.\n[60-90s] - Pilot's hands actively manipulate control stick and throttle, adjusting flight path over open fields.  \n- Aircraft's cockpit displays show navigation map and instrument readings, indicating active flight management.  \n- Landscape transitions from overcast to bright daylight, with visible runway and surrounding farmland.\n[90-120s] - Pilot's hands grip controls with blue nail polish visible, operating a glider with a digital display showing flight data.  \n- Glider flies low over a dry, grassy field with a dirt track ahead, dust kicked up by the aircraft's movement.  \n- Clear blue sky with distant trees and a white structure on the left, suggesting an open-air field environment.\n[120-150s] - Pilot's hands manipulate controls while seated in a small aircraft cockpit, with a smartphone displaying a map mounted on the dashboard.  \n- The aircraft flies low over a green field, transitioning to a golden wheat field, with trees and distant structures visible on the horizon.  \n- The sky shows partly cloudy conditions, with sunlight casting shadows across the landscape below.", "history_tokens": 377, "history_utf8_bytes": 1836, "recent_frame_times_s": [121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334, 145.01153333333335, 146.01253333333332, 147.01353333333333, 148.01453333333333, 149.01553333333334, 150.01653333333334], "recent_frames_sha256": "cb84bc53f06a1c795498722162ae81a1d96cbbf5496c1f889096ff3361547eef", "num_recent_frames": 30, "tq": 710665.507684023, "t1": 710667.356426825, "ta": 710667.356426825, "te": 710667.63792948, "first_response_s": 1.848742802045308, "answer_total_s": 2.130245457054116, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 435, "content_group": "ca9e2abc16d3bdd362dcc272c6244764aa3b14617d789865df51ba7b262ebb55", "question": {"question_id": "sample_435_a1464_q0", "video_id": 435, "video_path": "./videos/sample_435_real.mp4", "annotation_index": 1464, "question_index": 0, "question": "What color is the handgrip on the left side right now?", "options": ["A. Red.", "B. Yellow.", "C. Green.", "D. Blue."], "answer": "D", "time_stamp_s": 227, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [225, 230], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_435_a1464_q0", "video_id": 435, "time_stamp_s": 227, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7ef81fafd3d5ecf78ab0d5e735216d877d6d0c4247d81c5daf2cfd31911ea781", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258], "recent_frames_sha256": "9068986d573be13c85ed02d482442a3d278c33c057df36e3ce1f7af2b2e0bd94", "num_recent_frames": 30, "tq": 710586.523152966, "t1": 710594.013953991, "ta": 710594.013953991, "te": 710594.051128997, "first_response_s": 7.490801024949178, "answer_total_s": 7.527976030949503, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_435_a1464_q0", "video_id": 435, "time_stamp_s": 227, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "71bafa43b41e4d813c7c1bc241179952121e0cf0b312406a1fac467bc44bae68", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pilot's hands manipulate controls and interact with a digital display in the cockpit while flying over a rural landscape.  \n- The aircraft's nose points forward, with the horizon and terrain visible through the windshield, showing a mix of fields, trees, and infrastructure.  \n- The cockpit interior features a modern instrument panel with multiple screens and buttons, indicating active flight management.\n[30-60s] - Pilot's hands adjust controls as glider descends toward runway, with digital display showing flight data.  \n- Landscape transitions from forested areas to open green fields, with a road and distant buildings visible.  \n- Glider approaches runway head-on, with clouds overhead and terrain below becoming more defined.\n[60-90s] - Pilot's hands actively manipulate control stick and throttle, adjusting flight path over open fields.  \n- Aircraft's cockpit displays show navigation map and instrument readings, indicating active flight management.  \n- Landscape transitions from overcast to bright daylight, with visible runway and surrounding farmland.\n[90-120s] - Pilot's hands grip controls with blue nail polish visible, operating a glider with a digital display showing flight data.  \n- Glider flies low over a dry, grassy field with a dirt track ahead, dust kicked up by the aircraft's movement.  \n- Clear blue sky with distant trees and a white structure on the left, suggesting an open-air field environment.\n[120-150s] - Pilot's hands manipulate controls while seated in a small aircraft cockpit, with a smartphone displaying a map mounted on the dashboard.  \n- The aircraft flies low over a green field, transitioning to a golden wheat field, with trees and distant structures visible on the horizon.  \n- The sky shows partly cloudy conditions, with sunlight casting shadows across the landscape below.\n[150-180s] - Pilot's hands adjust controls while a smartphone displaying a map is mounted in the cockpit.  \n- A man in a blue shirt runs toward the aircraft from the field, holding a device.  \n- The aircraft moves forward over a golden wheat field, with a white runway strip visible ahead.\n[180-210s] - A white glider with \"S-12\" markings is stationary on a golden wheat field, facing left.  \n- The glider's cockpit is visible, with a pilot seated inside, wearing a blue shirt.  \n- The camera pans slightly to the right, revealing the glider's tail and wings, with a red-tipped wingtip in the foreground.", "history_tokens": 530, "history_utf8_bytes": 2441, "recent_frame_times_s": [197.03016666666667, 198.03116666666668, 199.03216666666665, 200.03316666666666, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258], "recent_frames_sha256": "9068986d573be13c85ed02d482442a3d278c33c057df36e3ce1f7af2b2e0bd94", "num_recent_frames": 30, "tq": 710683.986411334, "t1": 710686.01249829, "ta": 710686.01249829, "te": 710686.363187837, "first_response_s": 2.026086956029758, "answer_total_s": 2.376776502933353, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 435, "content_group": "ca9e2abc16d3bdd362dcc272c6244764aa3b14617d789865df51ba7b262ebb55", "question": {"question_id": "sample_435_a1465_q0", "video_id": 435, "video_path": "./videos/sample_435_real.mp4", "annotation_index": 1465, "question_index": 0, "question": "What color is the aircraft's side window frame right now?", "options": ["A. Black.", "B. Grey.", "C. Blue.", "D. White."], "answer": "D", "time_stamp_s": 300, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "flying_pov", "reference_interval_s": [300, 305], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_435_a1465_q0", "video_id": 435, "time_stamp_s": 300, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6871a3f5e6bed8f4d662c402c7da3e8802475cb56dde4b59d18af2fdf9cdd519", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665], "recent_frames_sha256": "47855d5b0e355020beab90087fa250d8370445c6c9fe6df07962c5fcd715884c", "num_recent_frames": 30, "tq": 710594.06399279, "t1": 710602.675086981, "ta": 710602.675086981, "te": 710602.932788287, "first_response_s": 8.611094191088341, "answer_total_s": 8.868795497110114, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_435_a1465_q0", "video_id": 435, "time_stamp_s": 300, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6767cac89976f5fef36a5afe6c83b74cf41e6f89d08f9e87924c852787ab6056", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Pilot's hands manipulate controls and interact with a digital display in the cockpit while flying over a rural landscape.  \n- The aircraft's nose points forward, with the horizon and terrain visible through the windshield, showing a mix of fields, trees, and infrastructure.  \n- The cockpit interior features a modern instrument panel with multiple screens and buttons, indicating active flight management.\n[30-60s] - Pilot's hands adjust controls as glider descends toward runway, with digital display showing flight data.  \n- Landscape transitions from forested areas to open green fields, with a road and distant buildings visible.  \n- Glider approaches runway head-on, with clouds overhead and terrain below becoming more defined.\n[60-90s] - Pilot's hands actively manipulate control stick and throttle, adjusting flight path over open fields.  \n- Aircraft's cockpit displays show navigation map and instrument readings, indicating active flight management.  \n- Landscape transitions from overcast to bright daylight, with visible runway and surrounding farmland.\n[90-120s] - Pilot's hands grip controls with blue nail polish visible, operating a glider with a digital display showing flight data.  \n- Glider flies low over a dry, grassy field with a dirt track ahead, dust kicked up by the aircraft's movement.  \n- Clear blue sky with distant trees and a white structure on the left, suggesting an open-air field environment.\n[120-150s] - Pilot's hands manipulate controls while seated in a small aircraft cockpit, with a smartphone displaying a map mounted on the dashboard.  \n- The aircraft flies low over a green field, transitioning to a golden wheat field, with trees and distant structures visible on the horizon.  \n- The sky shows partly cloudy conditions, with sunlight casting shadows across the landscape below.\n[150-180s] - Pilot's hands adjust controls while a smartphone displaying a map is mounted in the cockpit.  \n- A man in a blue shirt runs toward the aircraft from the field, holding a device.  \n- The aircraft moves forward over a golden wheat field, with a white runway strip visible ahead.\n[180-210s] - A white glider with \"S-12\" markings is stationary on a golden wheat field, facing left.  \n- The glider's cockpit is visible, with a pilot seated inside, wearing a blue shirt.  \n- The camera pans slightly to the right, revealing the glider's tail and wings, with a red-tipped wingtip in the foreground.\n[210-240s] - Pilot raises arms in joy while seated in glider cockpit, holding control stick and rudder.  \n- Glider is positioned low over golden field, with other gliders visible in background.  \n- Interior view shows cockpit instruments, including digital display and analog gauges, with pilot’s hand on control stick.\n[240-270s] - Pilot grips blue control stick while flying over green fields under cloudy sky.  \n- Instrument panel displays flight data, including altimeter and GPS map.  \n- Aircraft descends slightly, approaching a field with visible farm structures.\n[270-300s] - Pilot's hand grips blue control stick while cockpit instruments display flight data.  \n- Aircraft glides over tilled field under cloudy sky, with distant trees lining horizon.  \n- Camera angle shifts to show pilot’s face and cockpit view as aircraft ascends into clearer sky.", "history_tokens": 723, "history_utf8_bytes": 3305, "recent_frame_times_s": [270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665], "recent_frames_sha256": "47855d5b0e355020beab90087fa250d8370445c6c9fe6df07962c5fcd715884c", "num_recent_frames": 30, "tq": 710709.145928832, "t1": 710719.699960262, "ta": 710719.699960262, "te": 710720.071405716, "first_response_s": 10.554031430045143, "answer_total_s": 10.925476884003729, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 436, "content_group": "142e8d3656332f7c0d37683fcb379e689a4f9df4fe6082925457d3dad39a592b", "question": {"question_id": "sample_436_a1926_q0", "video_id": 436, "video_path": "./videos/sample_436_real.mp4", "annotation_index": 1926, "question_index": 0, "question": "What is the person doing with the green and white cartons?", "options": ["A. Moving them to another room.", "B. Organizing them in the trolley.", "C. Unloading them onto the shelves.", "D. Throwing them away."], "answer": "C", "time_stamp_s": 20, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_436_a1926_q0", "video_id": 436, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f21ef573a7a8b5ae9448f7195e21d06d6d4b6fe869954e8ab9be84c4d5c4c4c3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019], "recent_frames_sha256": "f34a26954d9d2347b917f6bde08e255f41d7969a0561503daa96023a79feac80", "num_recent_frames": 20, "tq": 719517.692196955, "t1": 719528.923797589, "ta": 719528.923797589, "te": 719528.961321644, "first_response_s": 11.231600634055212, "answer_total_s": 11.269124689046293, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_436_a1926_q0", "video_id": 436, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "83f182e20a21189c58ce01061d356400e75e0aada202b31fb06cacdb19f6c4f0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019], "recent_frames_sha256": "f34a26954d9d2347b917f6bde08e255f41d7969a0561503daa96023a79feac80", "num_recent_frames": 20, "tq": 719582.931102384, "t1": 719589.67579146, "ta": 719589.67579146, "te": 719589.718751425, "first_response_s": 6.7446890759747475, "answer_total_s": 6.787649041041732, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 436, "content_group": "142e8d3656332f7c0d37683fcb379e689a4f9df4fe6082925457d3dad39a592b", "question": {"question_id": "sample_436_a1926_q1", "video_id": 436, "video_path": "./videos/sample_436_real.mp4", "annotation_index": 1926, "question_index": 1, "question": "What task is the person primarily engaged in right now?", "options": ["A. Cleaning the storage room.", "B. Counting inventory.", "C. Organizing and resupplying shelves.", "D. Moving trolleys to the front."], "answer": "C", "time_stamp_s": 54, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_436_a1926_q1", "video_id": 436, "time_stamp_s": 54, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "384f4e19597918f91d514b11f4de734f9216ee39585109b12d27d060e1a92b2a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [24.024, 25.025, 26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333], "recent_frames_sha256": "3354e04a778b9c31e0b2362bdd5df18d12fdca3560014ee0b0d03d855a8ac1fe", "num_recent_frames": 30, "tq": 719528.971951414, "t1": 719541.600147707, "ta": 719541.600147707, "te": 719541.638816267, "first_response_s": 12.628196293022484, "answer_total_s": 12.666864853003062, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_436_a1926_q1", "video_id": 436, "time_stamp_s": 54, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "22f62fd2cc20cdf9a6167641f4db33fb2d971d451914ea2dad40aee9cccaa857", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person pushes a shopping cart filled with green-packaged items through a warehouse aisle.  \n- Cart is maneuvered toward shelves, where items are placed onto white shelving units.  \n- Green-packaged items are stacked on shelves, with some already placed and others being added.", "history_tokens": 63, "history_utf8_bytes": 286, "recent_frame_times_s": [24.024, 25.025, 26.026, 27.027, 28.028, 29.029, 30.03, 31.031, 32.032, 33.033, 34.00063333333333, 35.00163333333333, 36.002633333333335, 37.00363333333333, 38.00463333333333, 39.005633333333336, 40.00663333333333, 41.00763333333333, 42.008633333333336, 43.00963333333333, 44.01063333333333, 45.011633333333336, 46.01263333333333, 47.01363333333333, 48.014633333333336, 49.015633333333334, 50.01663333333333, 51.017633333333336, 52.018633333333334, 53.01963333333333], "recent_frames_sha256": "3354e04a778b9c31e0b2362bdd5df18d12fdca3560014ee0b0d03d855a8ac1fe", "num_recent_frames": 30, "tq": 719596.411757866, "t1": 719597.571674799, "ta": 719597.571674799, "te": 719597.922607878, "first_response_s": 1.1599169329274446, "answer_total_s": 1.5108500119531527, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 436, "content_group": "142e8d3656332f7c0d37683fcb379e689a4f9df4fe6082925457d3dad39a592b", "question": {"question_id": "sample_436_a1927_q0", "video_id": 436, "video_path": "./videos/sample_436_real.mp4", "annotation_index": 1927, "question_index": 0, "question": "What action is the person holding the camera performing right now?", "options": ["A. Taking items off the shelves.", "B. Pushing a cart.", "C. Rearranging items on the shelves.", "D. Cleaning the aisle."], "answer": "B", "time_stamp_s": 139, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_436_a1927_q0", "video_id": 436, "time_stamp_s": 139, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1abe67d0f05738142431e2c9c716131fa70aca879ef609814ec53d69600b66f0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334], "recent_frames_sha256": "77b15117537a6e960fb79e1a1ff0f7607f6b0f68d97d4dd6fc974c326867fd3c", "num_recent_frames": 30, "tq": 719541.648042498, "t1": 719555.070478871, "ta": 719555.070478871, "te": 719555.108183947, "first_response_s": 13.422436372959055, "answer_total_s": 13.460141449002549, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_436_a1927_q0", "video_id": 436, "time_stamp_s": 139, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5890df3be9f37a657782d4c0410db1b4bde34babbeb5decb8334796977c37aed", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person pushes a shopping cart filled with green-packaged items through a warehouse aisle.  \n- Cart is maneuvered toward shelves, where items are placed onto white shelving units.  \n- Green-packaged items are stacked on shelves, with some already placed and others being added.\n[30-60s] - Shopping cart filled with green cartons moves along aisle, passing shelves stocked with various products.  \n- Hand reaches for and picks up a green carton from a shelf, then places it into the cart.  \n- Cart continues forward, navigating between aisles with shelves holding boxes and containers.\n[60-90s] - Person in black gloves picks up green-packaged items from shelf, placing them into shopping cart.  \n- Shopping cart contains multiple green-packaged items, with some items already placed in cart.  \n- Shelf holds white boxes with printed text and images, positioned above the green-packaged items.\n[90-120s] - Person in black gloves pushes shopping cart along aisle, collecting green-labeled items from shelves.  \n- Cart moves past shelves stocked with white boxes labeled \"Lab Coat\" and other products.  \n- Person continues pushing cart, navigating through aisles with various goods, including boxes and bottles.", "history_tokens": 264, "history_utf8_bytes": 1217, "recent_frame_times_s": [109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334], "recent_frames_sha256": "77b15117537a6e960fb79e1a1ff0f7607f6b0f68d97d4dd6fc974c326867fd3c", "num_recent_frames": 30, "tq": 719620.320228091, "t1": 719621.555676194, "ta": 719621.555676194, "te": 719621.898151704, "first_response_s": 1.2354481030488387, "answer_total_s": 1.5779236130183563, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 436, "content_group": "142e8d3656332f7c0d37683fcb379e689a4f9df4fe6082925457d3dad39a592b", "question": {"question_id": "sample_436_a1928_q0", "video_id": 436, "video_path": "./videos/sample_436_real.mp4", "annotation_index": 1928, "question_index": 0, "question": "What is the camera operator holding in his hands right now?", "options": ["A. A red crate.", "B. A green and white carton.", "C. A yogurt container.", "D. A bottle of milk."], "answer": "B", "time_stamp_s": 241, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_436_a1928_q0", "video_id": 436, "time_stamp_s": 241, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e6dfc9fd30283774778bce219bd8e24a84eefd6affefbda2e21772e111be9c06", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332], "recent_frames_sha256": "806b24f6ee440d37c04c18bcdf68a01ce4ba6268658220f6a3c3f22cfafcdcac", "num_recent_frames": 30, "tq": 719555.115990231, "t1": 719568.800065138, "ta": 719568.800065138, "te": 719568.838118592, "first_response_s": 13.68407490698155, "answer_total_s": 13.722128360997885, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_436_a1928_q0", "video_id": 436, "time_stamp_s": 241, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e1e96dac5592ade6961f34990d32d939663b20172ef1d8b52dc3d61a8e9c925a", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person pushes a shopping cart filled with green-packaged items through a warehouse aisle.  \n- Cart is maneuvered toward shelves, where items are placed onto white shelving units.  \n- Green-packaged items are stacked on shelves, with some already placed and others being added.\n[30-60s] - Shopping cart filled with green cartons moves along aisle, passing shelves stocked with various products.  \n- Hand reaches for and picks up a green carton from a shelf, then places it into the cart.  \n- Cart continues forward, navigating between aisles with shelves holding boxes and containers.\n[60-90s] - Person in black gloves picks up green-packaged items from shelf, placing them into shopping cart.  \n- Shopping cart contains multiple green-packaged items, with some items already placed in cart.  \n- Shelf holds white boxes with printed text and images, positioned above the green-packaged items.\n[90-120s] - Person in black gloves pushes shopping cart along aisle, collecting green-labeled items from shelves.  \n- Cart moves past shelves stocked with white boxes labeled \"Lab Coat\" and other products.  \n- Person continues pushing cart, navigating through aisles with various goods, including boxes and bottles.\n[120-150s] - Shopping carts filled with green-labeled bottles and a red basket are maneuvered through aisles lined with shelves stocked with various goods.  \n- A cart with a white item (possibly a box or container) is positioned near the center of the aisle, while another cart with green bottles is pushed ahead.  \n- The camera perspective shifts slightly, revealing more of the warehouse-like environment with metal shelving units and cardboard boxes on the right side.\n[150-180s] - Person wearing black gloves pushes a cart loaded with green-labeled cans through aisles.  \n- They stop at a shelf displaying \"Crème Fraîche\" priced at 37.95, then reach to adjust or remove a box from the shelf.  \n- The cart is maneuvered past shelves stocked with various canned goods and boxes, indicating movement through a retail storage area.\n[180-210s] - Person selects a box of \"Crème Fraîche\" priced at 33.50 from a shelf, placing it into a shopping cart.  \n- The cart, already filled with green-labeled yogurt containers, is pushed forward as the person moves along the aisle.  \n- The person’s gloved hands interact with the shelf, picking up and placing items, while the camera angle shifts to show the surrounding shelves stocked with similar products.\n[210-240s] - Person pushes shopping cart along aisle, selecting green-capped cans from shelf.  \n- Cart contains multiple green-capped cans, with person’s gloved hand reaching for more.  \n- Shelf displays various products, including white containers labeled \"Creme Fraiche\" and \"Sour Cream.\"", "history_tokens": 622, "history_utf8_bytes": 2764, "recent_frame_times_s": [211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332], "recent_frames_sha256": "806b24f6ee440d37c04c18bcdf68a01ce4ba6268658220f6a3c3f22cfafcdcac", "num_recent_frames": 30, "tq": 719655.707506179, "t1": 719656.722139754, "ta": 719656.722139754, "te": 719657.055281199, "first_response_s": 1.014633574988693, "answer_total_s": 1.3477750200545415, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 436, "content_group": "142e8d3656332f7c0d37683fcb379e689a4f9df4fe6082925457d3dad39a592b", "question": {"question_id": "sample_436_a1928_q1", "video_id": 436, "video_path": "./videos/sample_436_real.mp4", "annotation_index": 1928, "question_index": 1, "question": "What is the primary type of product seen on the shelves?", "options": ["A. Dairy products like milk and yogurt.", "B. Fresh vegetables.", "C. Canned goods.", "D. Electronics."], "answer": "A", "time_stamp_s": 260, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_436_a1928_q1", "video_id": 436, "time_stamp_s": 260, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9e5656089e12fdbc3ef11ce1eb568a9b233a35f61052e4566793c010445ab47f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335], "recent_frames_sha256": "24c0a87333b0e4b0b9fbd5898dadb249f6dbc2a3e6183cf5f0a1b7e362226fe6", "num_recent_frames": 30, "tq": 719568.847171698, "t1": 719582.873890291, "ta": 719582.873890291, "te": 719582.913615423, "first_response_s": 14.0267185929697, "answer_total_s": 14.066443725023419, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_436_a1928_q1", "video_id": 436, "time_stamp_s": 260, "ground_truth": "A", "raw_output": "A. Dairy products like milk and yogurt.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "45d898b7163696b9373659f2ba561a807590688286805ff82503ab41550b4934", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person pushes a shopping cart filled with green-packaged items through a warehouse aisle.  \n- Cart is maneuvered toward shelves, where items are placed onto white shelving units.  \n- Green-packaged items are stacked on shelves, with some already placed and others being added.\n[30-60s] - Shopping cart filled with green cartons moves along aisle, passing shelves stocked with various products.  \n- Hand reaches for and picks up a green carton from a shelf, then places it into the cart.  \n- Cart continues forward, navigating between aisles with shelves holding boxes and containers.\n[60-90s] - Person in black gloves picks up green-packaged items from shelf, placing them into shopping cart.  \n- Shopping cart contains multiple green-packaged items, with some items already placed in cart.  \n- Shelf holds white boxes with printed text and images, positioned above the green-packaged items.\n[90-120s] - Person in black gloves pushes shopping cart along aisle, collecting green-labeled items from shelves.  \n- Cart moves past shelves stocked with white boxes labeled \"Lab Coat\" and other products.  \n- Person continues pushing cart, navigating through aisles with various goods, including boxes and bottles.\n[120-150s] - Shopping carts filled with green-labeled bottles and a red basket are maneuvered through aisles lined with shelves stocked with various goods.  \n- A cart with a white item (possibly a box or container) is positioned near the center of the aisle, while another cart with green bottles is pushed ahead.  \n- The camera perspective shifts slightly, revealing more of the warehouse-like environment with metal shelving units and cardboard boxes on the right side.\n[150-180s] - Person wearing black gloves pushes a cart loaded with green-labeled cans through aisles.  \n- They stop at a shelf displaying \"Crème Fraîche\" priced at 37.95, then reach to adjust or remove a box from the shelf.  \n- The cart is maneuvered past shelves stocked with various canned goods and boxes, indicating movement through a retail storage area.\n[180-210s] - Person selects a box of \"Crème Fraîche\" priced at 33.50 from a shelf, placing it into a shopping cart.  \n- The cart, already filled with green-labeled yogurt containers, is pushed forward as the person moves along the aisle.  \n- The person’s gloved hands interact with the shelf, picking up and placing items, while the camera angle shifts to show the surrounding shelves stocked with similar products.\n[210-240s] - Person pushes shopping cart along aisle, selecting green-capped cans from shelf.  \n- Cart contains multiple green-capped cans, with person’s gloved hand reaching for more.  \n- Shelf displays various products, including white containers labeled \"Creme Fraiche\" and \"Sour Cream.\"", "history_tokens": 622, "history_utf8_bytes": 2764, "recent_frame_times_s": [230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335], "recent_frames_sha256": "24c0a87333b0e4b0b9fbd5898dadb249f6dbc2a3e6183cf5f0a1b7e362226fe6", "num_recent_frames": 30, "tq": 719657.084187741, "t1": 719669.327448723, "ta": 719669.327448723, "te": 719669.675282804, "first_response_s": 12.243260981980711, "answer_total_s": 12.59109506290406, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 437, "content_group": "9b4269aae5f41a9eedf0e6573492c98fcc2835067a7e94a5d3ac936d1b25882f", "question": {"question_id": "sample_437_a548_q0", "video_id": 437, "video_path": "./videos/sample_437_real.mp4", "annotation_index": 548, "question_index": 0, "question": "What distinguishing feature is described about the yogurt cups?", "options": ["A. They have a green label.", "B. They are stacked in red trays.", "C. They are white with blue labels.", "D. They are placed in a metal container."], "answer": "C", "time_stamp_s": 6, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_437_a548_q0", "video_id": 437, "time_stamp_s": 6, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "65f127bf6ca3a37a3d4ccb4513dd5ac6945270b80121972b4f5bafbee59dee27", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005], "recent_frames_sha256": "f03b06b16d0215f7cda1a8caf546dc9d1ea4f187a59c019e378b65fb61c1dc15", "num_recent_frames": 6, "tq": 716044.280345465, "t1": 716050.393615352, "ta": 716050.393615352, "te": 716050.547244757, "first_response_s": 6.113269886933267, "answer_total_s": 6.266899291891605, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_437_a548_q0", "video_id": 437, "time_stamp_s": 6, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3435523f75bcb782f5edc6be14091fdc3c5db49b023b76d6e4068ee44671a944", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005], "recent_frames_sha256": "f03b06b16d0215f7cda1a8caf546dc9d1ea4f187a59c019e378b65fb61c1dc15", "num_recent_frames": 6, "tq": 715856.143379991, "t1": 715866.719221053, "ta": 715866.719221053, "te": 715866.904577165, "first_response_s": 10.575841062003747, "answer_total_s": 10.761197174084373, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 437, "content_group": "9b4269aae5f41a9eedf0e6573492c98fcc2835067a7e94a5d3ac936d1b25882f", "question": {"question_id": "sample_437_a548_q1", "video_id": 437, "video_path": "./videos/sample_437_real.mp4", "annotation_index": 548, "question_index": 1, "question": "What action does the person perform with the yogurt cups?", "options": ["A. The person sorts the cups by flavor.", "B. The person moves the yogurt cups to the right shelving unit.", "C. The person stacks the cups in a corner.", "D. The person places the yogurt cups neatly on the shelf."], "answer": "D", "time_stamp_s": 17, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_437_a548_q1", "video_id": 437, "time_stamp_s": 17, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "30b3678e9975ae78f758e6337fcc084588dc25e65190e350dd8e04b879417be3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016], "recent_frames_sha256": "e5f0f827ea9da7008ec7665d9e445da3934ac36424a9448702d027259e517544", "num_recent_frames": 17, "tq": 716050.560430563, "t1": 716064.530466097, "ta": 716064.530466097, "te": 716064.569349087, "first_response_s": 13.970035534002818, "answer_total_s": 14.008918523904867, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_437_a548_q1", "video_id": 437, "time_stamp_s": 17, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "17550e08ea1cd217c08e13d8cf2635cde14b6da139af16d2b3ccee6a3541dce4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016], "recent_frames_sha256": "e5f0f827ea9da7008ec7665d9e445da3934ac36424a9448702d027259e517544", "num_recent_frames": 17, "tq": 715866.913710931, "t1": 715878.489516358, "ta": 715878.489516358, "te": 715878.718991296, "first_response_s": 11.575805427040905, "answer_total_s": 11.805280365049839, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 437, "content_group": "9b4269aae5f41a9eedf0e6573492c98fcc2835067a7e94a5d3ac936d1b25882f", "question": {"question_id": "sample_437_a549_q0", "video_id": 437, "video_path": "./videos/sample_437_real.mp4", "annotation_index": 549, "question_index": 0, "question": "What is the person holding right now?", "options": ["A. A bottle of juice.", "B. A carton of milk.", "C. A box of cereal.", "D. A can of soda."], "answer": "B", "time_stamp_s": 180, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_437_a549_q0", "video_id": 437, "time_stamp_s": 180, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "20de4245e9163970b13cc5a64a3bd7bccf80a3d89cf4ed5f44c9aec4b22e979f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667], "recent_frames_sha256": "c9e6d139aa69ff5966a160bbb192ad38ffad706b445b3d35e2d3b76342cf8220", "num_recent_frames": 30, "tq": 716064.57862114, "t1": 716076.961999569, "ta": 716076.961999569, "te": 716077.004620918, "first_response_s": 12.38337842898909, "answer_total_s": 12.42599977797363, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_437_a549_q0", "video_id": 437, "time_stamp_s": 180, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "276619a34776adddd4dc4dd0e564b95836b9e7c653db642231fe87dc1790adb9", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A gloved hand reaches for and selects yogurt containers from a refrigerated shelf.  \n- The hand moves items from the shelf to a nearby metal cart, which is positioned adjacent to the shelf.  \n- The shelf contains various dairy products, including yogurt and bottled beverages, arranged in organized rows.\n[30-60s] - Gloved hand stacks white cartons with blue logos on a metal shelf, aligning them vertically.  \n- Blue-packaged items are visible to the left, while brown-capped containers sit on a lower shelf.  \n- The carton stack is positioned near a white wall with vertical slots, suggesting a refrigerated storage unit.\n[60-90s] - A hand reaches for a stack of yogurt containers on a shelf, then moves to a cart holding muffin trays.  \n- The camera pans to show a metal cart stacked with yogurt containers and a tray of muffin cups on the floor.  \n- A smartphone with a visible screen is placed on the floor near the cart, displaying a map or app interface.\n[90-120s] - A person wearing black gloves reaches for and removes a green box labeled \"MELANOKOL\" from a shelf.  \n- The person then stacks multiple green boxes onto a metal shopping cart.  \n- The cart is positioned near a wall with stacked boxes and a red circular object on the floor nearby.\n[120-150s] - Gloved hand moves boxes of \"Vitamix\" and \"L'Oréal\" products along a shelf, adjusting their positions.  \n- A white plastic tray is placed on the shelf, partially covered by the boxes.  \n- The person’s arm and gloved hand are visible as they interact with the items, indicating manual handling.\n[150-180s] - Hand selects and places white boxes labeled \"Pure Milk\" into a metal shopping cart.  \n- Cart is positioned near shelves stocked with similar milk boxes, some with green branding.  \n- Hand continues selecting boxes, moving them from shelf to cart, indicating ongoing shopping activity.", "history_tokens": 439, "history_utf8_bytes": 1871, "recent_frame_times_s": [150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667], "recent_frames_sha256": "c9e6d139aa69ff5966a160bbb192ad38ffad706b445b3d35e2d3b76342cf8220", "num_recent_frames": 30, "tq": 715922.566939987, "t1": 715929.505013855, "ta": 715929.505013855, "te": 715929.696439998, "first_response_s": 6.938073868048377, "answer_total_s": 7.129500010982156, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 437, "content_group": "9b4269aae5f41a9eedf0e6573492c98fcc2835067a7e94a5d3ac936d1b25882f", "question": {"question_id": "sample_437_a550_q0", "video_id": 437, "video_path": "./videos/sample_437_real.mp4", "annotation_index": 550, "question_index": 0, "question": "What did the person pick up on the top shelf just now?", "options": ["A. Boxes of cereal.", "B. Cans of soup.", "C. Yogurt cups.", "D. Bottled water."], "answer": "C", "time_stamp_s": 327, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_437_a550_q0", "video_id": 437, "time_stamp_s": 327, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "77228231f1df1a8d54f08c830894377648887dfb34862deafe4b3b24af58540a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257], "recent_frames_sha256": "ac2c4b8b152c24898b7af61ee8171ce723728122a922854c4595921cf91fa8f5", "num_recent_frames": 30, "tq": 716077.014107203, "t1": 716088.804874834, "ta": 716088.804874834, "te": 716088.841786809, "first_response_s": 11.790767631027848, "answer_total_s": 11.827679606038146, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_437_a550_q0", "video_id": 437, "time_stamp_s": 327, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1b1b874364b1888a9c6f814aae2175a8bc28707d778e191ff6c3d1daac03023c", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A gloved hand reaches for and selects yogurt containers from a refrigerated shelf.  \n- The hand moves items from the shelf to a nearby metal cart, which is positioned adjacent to the shelf.  \n- The shelf contains various dairy products, including yogurt and bottled beverages, arranged in organized rows.\n[30-60s] - Gloved hand stacks white cartons with blue logos on a metal shelf, aligning them vertically.  \n- Blue-packaged items are visible to the left, while brown-capped containers sit on a lower shelf.  \n- The carton stack is positioned near a white wall with vertical slots, suggesting a refrigerated storage unit.\n[60-90s] - A hand reaches for a stack of yogurt containers on a shelf, then moves to a cart holding muffin trays.  \n- The camera pans to show a metal cart stacked with yogurt containers and a tray of muffin cups on the floor.  \n- A smartphone with a visible screen is placed on the floor near the cart, displaying a map or app interface.\n[90-120s] - A person wearing black gloves reaches for and removes a green box labeled \"MELANOKOL\" from a shelf.  \n- The person then stacks multiple green boxes onto a metal shopping cart.  \n- The cart is positioned near a wall with stacked boxes and a red circular object on the floor nearby.\n[120-150s] - Gloved hand moves boxes of \"Vitamix\" and \"L'Oréal\" products along a shelf, adjusting their positions.  \n- A white plastic tray is placed on the shelf, partially covered by the boxes.  \n- The person’s arm and gloved hand are visible as they interact with the items, indicating manual handling.\n[150-180s] - Hand selects and places white boxes labeled \"Pure Milk\" into a metal shopping cart.  \n- Cart is positioned near shelves stocked with similar milk boxes, some with green branding.  \n- Hand continues selecting boxes, moving them from shelf to cart, indicating ongoing shopping activity.\n[180-210s] - Hand reaches for a white box labeled \"4\" on a shelf, with price tag \"2.99\" visible nearby.  \n- Shelf is partially empty, with several boxes of similar products stacked on the floor beside it.  \n- A metal wire basket is positioned to the right, containing more packaged goods.\n[210-240s] - Person wearing black gloves picks up a white box from a shelf, then places it into a metal shopping cart.  \n- The shopping cart is positioned near a shelf stocked with similar white boxes, some labeled with prices like \"20\" and \"23\".  \n- The person continues to select additional boxes from the shelf, placing them into the cart while moving along the aisle.\n[240-270s] - A shopping cart is being pushed along a narrow aisle, with its contents partially visible.  \n- Shelves on the left hold various packaged goods, including boxes and containers, while the right side has more items like canned goods and boxes.  \n- The cart moves forward, passing by shelves stocked with products such as milk, yogurt, and other household items.\n[270-300s] - Hand reaches for yogurt containers on a refrigerated shelf, with price tag \"13\" visible.  \n- Shopping cart is positioned near the shelf, containing a red bowl and other items.  \n- Shelf displays stacked yogurt containers with blue and white packaging, alongside other dairy products.", "history_tokens": 749, "history_utf8_bytes": 3201, "recent_frame_times_s": [297.03006666666664, 298.0310666666667, 299.03206666666665, 300.0330666666667, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257], "recent_frames_sha256": "ac2c4b8b152c24898b7af61ee8171ce723728122a922854c4595921cf91fa8f5", "num_recent_frames": 30, "tq": 715951.938453416, "t1": 715954.376440917, "ta": 715954.376440917, "te": 715954.413194926, "first_response_s": 2.437987501034513, "answer_total_s": 2.4747415099991485, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 437, "content_group": "9b4269aae5f41a9eedf0e6573492c98fcc2835067a7e94a5d3ac936d1b25882f", "question": {"question_id": "sample_437_a551_q0", "video_id": 437, "video_path": "./videos/sample_437_real.mp4", "annotation_index": 551, "question_index": 0, "question": "What action is the person performing right now?", "options": ["A. Cleaning the shelves.", "B. Taking inventory.", "C. Organizing yogurt containers.", "D. Restocking fresh vegetables."], "answer": "C", "time_stamp_s": 645, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [600, 645], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_437_a551_q0", "video_id": 437, "time_stamp_s": 645, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b4aa787310556d501739875b2d84491bb410d71c7ff60eb7755a9b92ac0980af", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [615.0144, 616.0154, 617.0164, 618.0174, 619.0184, 620.0194, 621.0204, 622.0214, 623.0224, 624.0234, 625.0244, 626.0254, 627.0264, 628.0274, 629.0284, 630.0294, 631.0304, 632.0314, 633.0324, 634.0000333333334, 635.0010333333333, 636.0020333333333, 637.0030333333333, 638.0040333333334, 639.0050333333334, 640.0060333333333, 641.0070333333333, 642.0080333333333, 643.0090333333334, 644.0100333333334], "recent_frames_sha256": "c5067199a655dc4ee8232f661d1aaa50a9fbc19ac225f55db3a361256c9721c7", "num_recent_frames": 30, "tq": 716088.848672803, "t1": 716100.73227416, "ta": 716100.73227416, "te": 716100.769505034, "first_response_s": 11.883601356996223, "answer_total_s": 11.920832230942324, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_437_a551_q0", "video_id": 437, "time_stamp_s": 645, "ground_truth": "C", "raw_output": "C. Organizing yogurt containers.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "e8b0231797ceef7bbf1d189106869198839ed9729d64c4a6c3d1cf500648d8b9", "condition_order": ["notes", "recent"], "memory": "[240-270s] - A shopping cart is being pushed along a narrow aisle, with its contents partially visible.  \n- Shelves on the left hold various packaged goods, including boxes and containers, while the right side has more items like canned goods and boxes.  \n- The cart moves forward, passing by shelves stocked with products such as milk, yogurt, and other household items.\n[270-300s] - Hand reaches for yogurt containers on a refrigerated shelf, with price tag \"13\" visible.  \n- Shopping cart is positioned near the shelf, containing a red bowl and other items.  \n- Shelf displays stacked yogurt containers with blue and white packaging, alongside other dairy products.\n[300-330s] - Hand in black glove reaches for a white container labeled \"Yogurt\" on a metal shelf.  \n- Shopping cart with multiple yogurt containers is positioned below the shelf, moving slightly as the hand selects items.  \n- Shelf holds various packaged goods, including boxes and bottles, with some items stacked in white trays.\n[330-360s] - Hand in black glove reaches for a white container labeled \"GRADY\" on a high shelf.  \n- Shopping cart filled with blue-lidded containers is positioned below the shelf.  \n- Shelf holds various products including boxes, jars, and a green bag, with some items stacked in cardboard boxes.\n[360-390s] - Person in black gloves picks up yogurt containers from a shelf labeled \"13\" and places them into a shopping cart.  \n- The cart is positioned near a stack of blue and white yogurt containers on the floor.  \n- The shelf displays various yogurt brands, including \"Yoplait\" and \"Dairy Queen,\" with price tags visible.\n[390-420s] - Person wearing black gloves selects yogurt containers from a refrigerated shelf, placing them into a shopping cart.  \n- The shelf displays price tags (e.g., \"1.50\") and is stocked with various yogurt brands in blue and white packaging.  \n- The shopping cart, positioned to the right, contains multiple items, including red-packaged goods and other groceries.\n[420-450s] - Person wearing black gloves places yogurt containers onto a shopping cart in an aisle.  \n- Shopping cart is positioned between shelves stocked with yogurt and other dairy products.  \n- Shelves display price tags (e.g., \"1.35\" and \"1.50\") indicating product costs.\n[450-480s] - A person's hand reaches for a yogurt container on a lower shelf, near a stack of similar containers.  \n- The shopping cart, loaded with multiple yogurt containers, is positioned beside the shelf, slightly angled toward the aisle.  \n- The shelf above contains neatly stacked yogurt containers, while the shelf below has a few containers with visible price tags.\n[480-510s] - Person wearing black gloves reaches for a muffin tray on a metal shelf.  \n- Shopping cart is positioned beneath the shelf, containing various yogurt containers.  \n- Muffin tray is lifted from the shelf and moved toward the cart.\n[510-540s] - Person pushes shopping cart filled with blue-and-white patterned plates and yogurt cups through aisle.  \n- Cart moves past shelves stocked with various packaged goods, including boxes and containers.  \n- Person’s hand reaches for additional items, possibly to add to the cart or adjust current load.\n[540-570s] - Shopping cart contains multiple stacks of blue-and-white packaged items, likely yogurt or similar dairy products, arranged in a grid pattern.  \n- Cart is maneuvered through an aisle with shelves stocked with various food items, including boxes and containers, and green crates visible on the left.  \n- A hand reaches into the cart to adjust or reposition the stacked items, indicating active selection or organization.\n[570-600s] - A gloved hand reaches for a container of yogurt from a stack on a white shelf.  \n- The yogurt containers are arranged in multiple stacks, with some stacked vertically and others horizontally.  \n- The shelf is part of a brightly lit refrigerated section, with other food items visible in the background.\n[600-630s] - Person wearing black gloves arranges blue and white patterned bowls on a white countertop.  \n- Stacks of identical containers with blue and yellow labels are positioned to the right of the bowls.  \n- A green box labeled \"BIO\" and other packaged goods are visible on a lower shelf to the left.", "history_tokens": 969, "history_utf8_bytes": 4257, "recent_frame_times_s": [615.0144, 616.0154, 617.0164, 618.0174, 619.0184, 620.0194, 621.0204, 622.0214, 623.0224, 624.0234, 625.0244, 626.0254, 627.0264, 628.0274, 629.0284, 630.0294, 631.0304, 632.0314, 633.0324, 634.0000333333334, 635.0010333333333, 636.0020333333333, 637.0030333333333, 638.0040333333334, 639.0050333333334, 640.0060333333333, 641.0070333333333, 642.0080333333333, 643.0090333333334, 644.0100333333334], "recent_frames_sha256": "c5067199a655dc4ee8232f661d1aaa50a9fbc19ac225f55db3a361256c9721c7", "num_recent_frames": 30, "tq": 716041.634760004, "t1": 716043.961974015, "ta": 716043.961974015, "te": 716044.241724866, "first_response_s": 2.327214010991156, "answer_total_s": 2.60696486197412, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 438, "content_group": "2dcb09e3c2c355615831263788dfd480e00a6a0eebf374f98cdb111e2b019498", "question": {"question_id": "sample_438_a2110_q0", "video_id": 438, "video_path": "./videos/sample_438_real.mp4", "annotation_index": 2110, "question_index": 0, "question": "What is the person in the video organizing on the shelf?", "options": ["A. Boxes of cereal.", "B. Containers of yogurt.", "C. Bottles of milk.", "D. Packages of cheese."], "answer": "B", "time_stamp_s": 20, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_438_a2110_q0", "video_id": 438, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c9d85e81d795eb7034bf7a434f287504766bd643c1676bd321cdff78d162fb68", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.051, 1.0186333333333333, 2.019633333333333, 3.0206333333333335, 4.021633333333333, 5.022633333333333, 6.023633333333334, 7.024633333333333, 8.025633333333333, 9.026633333333333, 10.027633333333334, 11.028633333333334, 12.029633333333333, 13.030633333333334, 14.031633333333334, 15.032633333333333, 16.00026666666667, 17.001266666666666, 18.002266666666667, 19.003266666666665], "recent_frames_sha256": "4b1a15dcc8b703579bbce18fb2daa0e1e3f499df47a0d5bf28cb67179c2b551b", "num_recent_frames": 20, "tq": 715321.371617667, "t1": 715331.897843944, "ta": 715331.897843944, "te": 715331.938781857, "first_response_s": 10.526226276997477, "answer_total_s": 10.56716418999713, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_438_a2110_q0", "video_id": 438, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ae727bc9603c04aeaaa28f2d97c032c29b935be9e7c6de1ac2a3f27e0ad919de", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.051, 1.0186333333333333, 2.019633333333333, 3.0206333333333335, 4.021633333333333, 5.022633333333333, 6.023633333333334, 7.024633333333333, 8.025633333333333, 9.026633333333333, 10.027633333333334, 11.028633333333334, 12.029633333333333, 13.030633333333334, 14.031633333333334, 15.032633333333333, 16.00026666666667, 17.001266666666666, 18.002266666666667, 19.003266666666665], "recent_frames_sha256": "4b1a15dcc8b703579bbce18fb2daa0e1e3f499df47a0d5bf28cb67179c2b551b", "num_recent_frames": 20, "tq": 715371.645983578, "t1": 715381.833266126, "ta": 715381.833266126, "te": 715382.024409856, "first_response_s": 10.187282547936775, "answer_total_s": 10.378426277893595, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 438, "content_group": "2dcb09e3c2c355615831263788dfd480e00a6a0eebf374f98cdb111e2b019498", "question": {"question_id": "sample_438_a2111_q0", "video_id": 438, "video_path": "./videos/sample_438_real.mp4", "annotation_index": 2111, "question_index": 0, "question": "What is the person holding right now?", "options": ["A. A metal cart.", "B. A cardboard box.", "C. A green boxed item.", "D. A juice carton."], "answer": "B", "time_stamp_s": 141, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_438_a2111_q0", "video_id": 438, "time_stamp_s": 141, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5953008f15e6bc274b9e7f246923118549cf7a143fbf218c0932b563dc2567ea", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [111.02853333333333, 112.02953333333333, 113.03053333333334, 114.03153333333333, 115.03253333333333, 116.00016666666667, 117.00116666666666, 118.00216666666667, 119.00316666666667, 120.00416666666666, 121.00516666666667, 122.00616666666667, 123.00716666666666, 124.00816666666667, 125.00916666666667, 126.01016666666666, 127.01116666666667, 128.01216666666667, 129.01316666666668, 130.01416666666665, 131.01516666666666, 132.01616666666666, 133.01716666666667, 134.01816666666667, 135.01916666666668, 136.02016666666665, 137.02116666666666, 138.02216666666666, 139.02316666666667, 140.02416666666667], "recent_frames_sha256": "f47abe6791f10372aea2b4baf6e6529f5ca7b73c8d0f9b2eab7c202ee1d111e7", "num_recent_frames": 30, "tq": 715331.956348104, "t1": 715340.573009883, "ta": 715340.573009883, "te": 715340.614191602, "first_response_s": 8.616661779000424, "answer_total_s": 8.657843497931026, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_438_a2111_q0", "video_id": 438, "time_stamp_s": 141, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f3c9cf939bdc945c3d5da94e8b4c0171a8469a9f4da022ae6997f47993b591d7", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A gloved hand repeatedly selects and moves blue-and-white labeled containers from a white shelf, likely yogurt or similar dairy products.  \n- The hand also handles open cardboard cups, possibly for sampling or preparing to consume the product.  \n- The camera perspective is from a first-person viewpoint, showing the surrounding supermarket aisles with various products and shelves.\n[30-60s] - Person in black gloves picks up a white tray with circular cutouts from a shelf.  \n- Green crates labeled \"Pillsbury\" are stacked near the shelf, with some trays already placed on a cart.  \n- The cart holds multiple trays and is positioned between shelves stocked with various packaged goods.\n[60-90s] - Shopping cart moves along aisle, carrying white trays with circular cutouts.  \n- Cart passes shelves stocked with packaged goods and cardboard boxes.  \n- Green crates and stacked boxes are visible on the floor near the cart’s path.\n[90-120s] - Person picks up a white box labeled \"ZOMMARBAS\" from a lower shelf, then places it back after briefly examining it.  \n- The person then reaches for a white container with a blue lid, labeled \"MILK,\" from an upper shelf, and removes it.  \n- The person's gloved hands are visible as they handle the items, with the camera angle shifting to show the surrounding shelves stocked with various products.", "history_tokens": 299, "history_utf8_bytes": 1351, "recent_frame_times_s": [111.02853333333333, 112.02953333333333, 113.03053333333334, 114.03153333333333, 115.03253333333333, 116.00016666666667, 117.00116666666666, 118.00216666666667, 119.00316666666667, 120.00416666666666, 121.00516666666667, 122.00616666666667, 123.00716666666666, 124.00816666666667, 125.00916666666667, 126.01016666666666, 127.01116666666667, 128.01216666666667, 129.01316666666668, 130.01416666666665, 131.01516666666666, 132.01616666666666, 133.01716666666667, 134.01816666666667, 135.01916666666668, 136.02016666666665, 137.02116666666666, 138.02216666666666, 139.02316666666667, 140.02416666666667], "recent_frames_sha256": "f47abe6791f10372aea2b4baf6e6529f5ca7b73c8d0f9b2eab7c202ee1d111e7", "num_recent_frames": 30, "tq": 715410.039629619, "t1": 715416.962732609, "ta": 715416.962732609, "te": 715417.000175803, "first_response_s": 6.923102990025654, "answer_total_s": 6.960546183981933, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 438, "content_group": "2dcb09e3c2c355615831263788dfd480e00a6a0eebf374f98cdb111e2b019498", "question": {"question_id": "sample_438_a2111_q1", "video_id": 438, "video_path": "./videos/sample_438_real.mp4", "annotation_index": 2111, "question_index": 1, "question": "What did the person do after walking towards a set of shelves just now?", "options": ["A. Place green cartons.", "B. Organizes the cart.", "C. Cleans the floor.", "D. Adjusts the lighting."], "answer": "A", "time_stamp_s": 144, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_438_a2111_q1", "video_id": 438, "time_stamp_s": 144, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3f66f84e4113ac8948e03f018ad9e74a393b63606a74f21f352422a398081c04", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [114.03153333333333, 115.03253333333333, 116.00016666666667, 117.00116666666666, 118.00216666666667, 119.00316666666667, 120.00416666666666, 121.00516666666667, 122.00616666666667, 123.00716666666666, 124.00816666666667, 125.00916666666667, 126.01016666666666, 127.01116666666667, 128.01216666666667, 129.01316666666668, 130.01416666666665, 131.01516666666666, 132.01616666666666, 133.01716666666667, 134.01816666666667, 135.01916666666668, 136.02016666666665, 137.02116666666666, 138.02216666666666, 139.02316666666667, 140.02416666666667, 141.02516666666668, 142.02616666666665, 143.02716666666666], "recent_frames_sha256": "8d2df9dae8aa613740835f3c39e476d0375c64c4c763383117206fe448f37a22", "num_recent_frames": 30, "tq": 715340.629815109, "t1": 715347.197305383, "ta": 715347.197305383, "te": 715347.381142609, "first_response_s": 6.567490274086595, "answer_total_s": 6.751327500096522, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_438_a2111_q1", "video_id": 438, "time_stamp_s": 144, "ground_truth": "A", "raw_output": "A. Place green cartons.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "20c4768f356857b989f21db88a08fc61643db89dfe0b86830ea2dd5cee042a05", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A gloved hand repeatedly selects and moves blue-and-white labeled containers from a white shelf, likely yogurt or similar dairy products.  \n- The hand also handles open cardboard cups, possibly for sampling or preparing to consume the product.  \n- The camera perspective is from a first-person viewpoint, showing the surrounding supermarket aisles with various products and shelves.\n[30-60s] - Person in black gloves picks up a white tray with circular cutouts from a shelf.  \n- Green crates labeled \"Pillsbury\" are stacked near the shelf, with some trays already placed on a cart.  \n- The cart holds multiple trays and is positioned between shelves stocked with various packaged goods.\n[60-90s] - Shopping cart moves along aisle, carrying white trays with circular cutouts.  \n- Cart passes shelves stocked with packaged goods and cardboard boxes.  \n- Green crates and stacked boxes are visible on the floor near the cart’s path.\n[90-120s] - Person picks up a white box labeled \"ZOMMARBAS\" from a lower shelf, then places it back after briefly examining it.  \n- The person then reaches for a white container with a blue lid, labeled \"MILK,\" from an upper shelf, and removes it.  \n- The person's gloved hands are visible as they handle the items, with the camera angle shifting to show the surrounding shelves stocked with various products.", "history_tokens": 299, "history_utf8_bytes": 1351, "recent_frame_times_s": [114.03153333333333, 115.03253333333333, 116.00016666666667, 117.00116666666666, 118.00216666666667, 119.00316666666667, 120.00416666666666, 121.00516666666667, 122.00616666666667, 123.00716666666666, 124.00816666666667, 125.00916666666667, 126.01016666666666, 127.01116666666667, 128.01216666666667, 129.01316666666668, 130.01416666666665, 131.01516666666666, 132.01616666666666, 133.01716666666667, 134.01816666666667, 135.01916666666668, 136.02016666666665, 137.02116666666666, 138.02216666666666, 139.02316666666667, 140.02416666666667, 141.02516666666668, 142.02616666666665, 143.02716666666666], "recent_frames_sha256": "8d2df9dae8aa613740835f3c39e476d0375c64c4c763383117206fe448f37a22", "num_recent_frames": 30, "tq": 715417.023850659, "t1": 715423.400664121, "ta": 715423.400664121, "te": 715423.660331196, "first_response_s": 6.3768134620040655, "answer_total_s": 6.636480537010357, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 438, "content_group": "2dcb09e3c2c355615831263788dfd480e00a6a0eebf374f98cdb111e2b019498", "question": {"question_id": "sample_438_a2112_q0", "video_id": 438, "video_path": "./videos/sample_438_real.mp4", "annotation_index": 2112, "question_index": 0, "question": "What does the person do after adjusting the position of the milk cartons?", "options": ["A. Removes a carton from the shelf.", "B. Pulls forward another milk carton.", "C. Leaves the aisle.", "D. Talks to another person."], "answer": "B", "time_stamp_s": 429, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_438_a2112_q0", "video_id": 438, "time_stamp_s": 429, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "cafca3a3c677a615a575462ab2497cfc3f122acaa0fe2699d9d3ef9689aa4101", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [399.01623333333333, 400.0172333333333, 401.01823333333334, 402.0192333333333, 403.02023333333335, 404.0212333333333, 405.02223333333336, 406.02323333333334, 407.0242333333333, 408.02523333333335, 409.0262333333333, 410.02723333333336, 411.02823333333333, 412.0292333333333, 413.03023333333334, 414.0312333333333, 415.03223333333335, 416.0332333333333, 417.00086666666664, 418.0018666666667, 419.00286666666665, 420.0038666666667, 421.00486666666666, 422.0058666666667, 423.00686666666667, 424.00786666666664, 425.0088666666667, 426.00986666666665, 427.0108666666667, 428.01186666666666], "recent_frames_sha256": "b3c5a2fe74273ddfd623409c307147a16a3f02d8a2376128e68c7938914a9797", "num_recent_frames": 30, "tq": 715347.394143133, "t1": 715359.32239296, "ta": 715359.32239296, "te": 715359.363141871, "first_response_s": 11.928249827004038, "answer_total_s": 11.96899873809889, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_438_a2112_q0", "video_id": 438, "time_stamp_s": 429, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "90bf5c72ceb7667a4790078edbef070241c32ffd46c41f53f0e4dc4f79db60a4", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Shopping cart moves along aisle, carrying white trays with circular cutouts.  \n- Cart passes shelves stocked with packaged goods and cardboard boxes.  \n- Green crates and stacked boxes are visible on the floor near the cart’s path.\n[90-120s] - Person picks up a white box labeled \"ZOMMARBAS\" from a lower shelf, then places it back after briefly examining it.  \n- The person then reaches for a white container with a blue lid, labeled \"MILK,\" from an upper shelf, and removes it.  \n- The person's gloved hands are visible as they handle the items, with the camera angle shifting to show the surrounding shelves stocked with various products.\n[120-150s] - Person in black gloves picks up a box of \"Latté\" coffee from a shelf, then places it into a shopping cart.  \n- The cart, already containing a box of green eggs, is pushed forward as the person continues to browse shelves.  \n- The person reaches for a different product on a lower shelf, indicating a shift in selection focus.\n[150-180s] - Hand reaches for a white box labeled \"BIO\" on a metal shelf, then moves to grab a red-and-white patterned box below.  \n- The camera pans across shelves filled with boxes, containers, and a large bell mounted on the top shelf.  \n- A person’s gloved hand is seen interacting with items on the shelves, including pulling out a box from a lower shelf.\n[180-210s] - Person in black gloves reaches for a product on a lower shelf, near a green box labeled \"BIO\".  \n- Shelves display various dairy items, including bottles of \"Häagen-Dazs\" and \"Milk\" with price tags visible.  \n- A shopping cart is positioned near the bottom of the aisle, containing cardboard boxes and other items.\n[210-240s] - A shopping cart is being pushed through a warehouse aisle, carrying several cardboard boxes and stacked items.  \n- Shelves on either side are stocked with various packaged goods, including milk cartons, canned goods, and boxes.  \n- The cart moves past empty metal shelving units, indicating some areas are under restock or clearance.\n[240-270s] - Hand in black glove reaches for a green-labeled product on a shelf, then moves to grab a white box labeled \"LATHHOLDS\" priced at 24.90.  \n- The shopping cart is positioned to the right, partially visible with its wire basket structure.  \n- The camera pans slightly to reveal more shelves stocked with various items, including boxes and containers, with price tags visible.\n[270-300s] - Hand reaches for a green carton of milk labeled \"Sellelaine\" on a shelf.  \n- Price tags show \"21.50\" and \"23.50\" for different milk varieties.  \n- Shopping cart is positioned near the shelf, containing several cardboard boxes.\n[300-330s] - A person in black gloves handles a cardboard box near a shopping cart, moving it toward a shelf.  \n- The cart is loaded with multiple boxes and positioned between aisles stocked with various products.  \n- Shelves display items like milk cartons and packaged goods, with price tags visible on the shelves.\n[330-360s] - Person’s hand reaches for a green-labeled box on a white shelf, lifting it slightly.  \n- Empty metal wire shelves are visible below, with cardboard boxes and stacked items nearby.  \n- A red price tag labeled “23.4” is affixed to the shelf edge, indicating product pricing.\n[360-390s] - Person wearing black gloves places green-packaged items onto a white shelf, aligning them with price tags showing \"21\" and \"24\".  \n- A cardboard box with green packaging sits on the floor, partially filled with similar items.  \n- Shelf above contains various products, including white boxes labeled \"HONDA\" and other items, with red plastic bins underneath.\n[390-420s] - A person in a black jacket is pushing a cart loaded with cardboard boxes through a warehouse aisle.  \n- Green plastic crates stacked on metal racks are visible to the left, while shelves with canned goods and other products line the right.  \n- The cart moves forward, passing by a red trash can and various stacked boxes, indicating active inventory movement.", "history_tokens": 964, "history_utf8_bytes": 4013, "recent_frame_times_s": [399.01623333333333, 400.0172333333333, 401.01823333333334, 402.0192333333333, 403.02023333333335, 404.0212333333333, 405.02223333333336, 406.02323333333334, 407.0242333333333, 408.02523333333335, 409.0262333333333, 410.02723333333336, 411.02823333333333, 412.0292333333333, 413.03023333333334, 414.0312333333333, 415.03223333333335, 416.0332333333333, 417.00086666666664, 418.0018666666667, 419.00286666666665, 420.0038666666667, 421.00486666666666, 422.0058666666667, 423.00686666666667, 424.00786666666664, 425.0088666666667, 426.00986666666665, 427.0108666666667, 428.01186666666666], "recent_frames_sha256": "b3c5a2fe74273ddfd623409c307147a16a3f02d8a2376128e68c7938914a9797", "num_recent_frames": 30, "tq": 715497.371764106, "t1": 715503.109437605, "ta": 715503.109437605, "te": 715503.521781827, "first_response_s": 5.737673499039374, "answer_total_s": 6.150017720996402, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 438, "content_group": "2dcb09e3c2c355615831263788dfd480e00a6a0eebf374f98cdb111e2b019498", "question": {"question_id": "sample_438_a2113_q0", "video_id": 438, "video_path": "./videos/sample_438_real.mp4", "annotation_index": 2113, "question_index": 0, "question": "What brand of dairy products is prominently featured on the shelves right now?", "options": ["A. Kesella.", "B. Danone.", "C. Yoplait.", "D. Nestle."], "answer": "A", "time_stamp_s": 522, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [480, 526], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_438_a2113_q0", "video_id": 438, "time_stamp_s": 522, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6db9f5ba964144950017378ae71ddd0f01375fa22ffe1fc26facc39b08ed0468", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [492.00913333333335, 493.01013333333333, 494.0111333333333, 495.01213333333334, 496.0131333333333, 497.01413333333335, 498.0151333333333, 499.01613333333336, 500.01713333333333, 501.0181333333333, 502.01913333333334, 503.0201333333333, 504.02113333333335, 505.02213333333333, 506.0231333333333, 507.02413333333334, 508.0251333333333, 509.02613333333335, 510.0271333333333, 511.02813333333336, 512.0291333333333, 513.0301333333333, 514.0311333333333, 515.0321333333334, 516.0331333333334, 517.0007666666667, 518.0017666666666, 519.0027666666666, 520.0037666666667, 521.0047666666667], "recent_frames_sha256": "224a494c7a4db7992de9d7bb4b12ef7801e0eafc47f9b6a83592565118890596", "num_recent_frames": 30, "tq": 715359.372093505, "t1": 715371.406688103, "ta": 715371.406688103, "te": 715371.636911716, "first_response_s": 12.034594597993419, "answer_total_s": 12.264818210969679, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_438_a2113_q0", "video_id": 438, "time_stamp_s": 522, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1a01bd9b2d200fc84f18e760ffd30c7a85a2f63cca6a2bc8aaf1ee7c2e9b586f", "condition_order": ["recent", "notes"], "memory": "[150-180s] - Hand reaches for a white box labeled \"BIO\" on a metal shelf, then moves to grab a red-and-white patterned box below.  \n- The camera pans across shelves filled with boxes, containers, and a large bell mounted on the top shelf.  \n- A person’s gloved hand is seen interacting with items on the shelves, including pulling out a box from a lower shelf.\n[180-210s] - Person in black gloves reaches for a product on a lower shelf, near a green box labeled \"BIO\".  \n- Shelves display various dairy items, including bottles of \"Häagen-Dazs\" and \"Milk\" with price tags visible.  \n- A shopping cart is positioned near the bottom of the aisle, containing cardboard boxes and other items.\n[210-240s] - A shopping cart is being pushed through a warehouse aisle, carrying several cardboard boxes and stacked items.  \n- Shelves on either side are stocked with various packaged goods, including milk cartons, canned goods, and boxes.  \n- The cart moves past empty metal shelving units, indicating some areas are under restock or clearance.\n[240-270s] - Hand in black glove reaches for a green-labeled product on a shelf, then moves to grab a white box labeled \"LATHHOLDS\" priced at 24.90.  \n- The shopping cart is positioned to the right, partially visible with its wire basket structure.  \n- The camera pans slightly to reveal more shelves stocked with various items, including boxes and containers, with price tags visible.\n[270-300s] - Hand reaches for a green carton of milk labeled \"Sellelaine\" on a shelf.  \n- Price tags show \"21.50\" and \"23.50\" for different milk varieties.  \n- Shopping cart is positioned near the shelf, containing several cardboard boxes.\n[300-330s] - A person in black gloves handles a cardboard box near a shopping cart, moving it toward a shelf.  \n- The cart is loaded with multiple boxes and positioned between aisles stocked with various products.  \n- Shelves display items like milk cartons and packaged goods, with price tags visible on the shelves.\n[330-360s] - Person’s hand reaches for a green-labeled box on a white shelf, lifting it slightly.  \n- Empty metal wire shelves are visible below, with cardboard boxes and stacked items nearby.  \n- A red price tag labeled “23.4” is affixed to the shelf edge, indicating product pricing.\n[360-390s] - Person wearing black gloves places green-packaged items onto a white shelf, aligning them with price tags showing \"21\" and \"24\".  \n- A cardboard box with green packaging sits on the floor, partially filled with similar items.  \n- Shelf above contains various products, including white boxes labeled \"HONDA\" and other items, with red plastic bins underneath.\n[390-420s] - A person in a black jacket is pushing a cart loaded with cardboard boxes through a warehouse aisle.  \n- Green plastic crates stacked on metal racks are visible to the left, while shelves with canned goods and other products line the right.  \n- The cart moves forward, passing by a red trash can and various stacked boxes, indicating active inventory movement.\n[420-450s] - Hands in black gloves adjust a carton of \"Crème Fraîche\" priced at 34.95, moving it slightly on the shelf.  \n- The shelf label clearly displays \"Crème Fraîche 34.95\" above the product.  \n- A green and white carton is being handled, with its price tag visible and partially obscured by gloved fingers.\n[450-480s] - Person's hands, wearing black gloves, adjust a price tag labeled \"CRÈME FRAÎCHE 37.95\" on a shelf.  \n- The person's feet, clad in dark boots, are visible beneath the shelf, indicating they are standing while handling the tag.  \n- The shelf holds multiple boxes of \"CRÈME FRAÎCHE\" with price tags, and the person is interacting with the pricing display.\n[480-510s] - Person wearing black gloves reaches for a product on a shelf, then places it into a cardboard box.  \n- The box is positioned on a metal cart, which is loaded with other boxes and items.  \n- Shelves are stocked with various products, including canned goods and packaged items, with price tags visible.", "history_tokens": 994, "history_utf8_bytes": 4020, "recent_frame_times_s": [492.00913333333335, 493.01013333333333, 494.0111333333333, 495.01213333333334, 496.0131333333333, 497.01413333333335, 498.0151333333333, 499.01613333333336, 500.01713333333333, 501.0181333333333, 502.01913333333334, 503.0201333333333, 504.02113333333335, 505.02213333333333, 506.0231333333333, 507.02413333333334, 508.0251333333333, 509.02613333333335, 510.0271333333333, 511.02813333333336, 512.0291333333333, 513.0301333333333, 514.0311333333333, 515.0321333333334, 516.0331333333334, 517.0007666666667, 518.0017666666666, 519.0027666666666, 520.0037666666667, 521.0047666666667], "recent_frames_sha256": "224a494c7a4db7992de9d7bb4b12ef7801e0eafc47f9b6a83592565118890596", "num_recent_frames": 30, "tq": 715525.218389066, "t1": 715528.880485598, "ta": 715528.880485598, "te": 715528.920077054, "first_response_s": 3.6620965319452807, "answer_total_s": 3.70168798789382, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 439, "content_group": "58b13b5a47f4b325b1abe2d72c43a402921857c7e05d11971d39a3f9f4c02965", "question": {"question_id": "sample_439_a1725_q0", "video_id": 439, "video_path": "./videos/sample_439_real.mp4", "annotation_index": 1725, "question_index": 0, "question": "What is the primary product seen on the cart?", "options": ["A. Yogurt cups.", "B. Cream cartons.", "C. Milk or a similar product in red and white packaging.", "D. Cheese blocks."], "answer": "C", "time_stamp_s": 9, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_439_a1725_q0", "video_id": 439, "time_stamp_s": 9, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4ec90baab298a49470658b8fec0defe03a2ce7aa3dc7a088aca6e3c107ecf752", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.052, 1.0196333333333334, 2.0206333333333335, 3.0216333333333334, 4.022633333333333, 5.023633333333334, 6.024633333333333, 7.025633333333333, 8.026633333333333], "recent_frames_sha256": "87facf47495dc786d7d630b1a4dc447b0f90bbb7470daa1441df712721e0535f", "num_recent_frames": 9, "tq": 715905.119823879, "t1": 715912.482594413, "ta": 715912.482594413, "te": 715912.519277332, "first_response_s": 7.362770534004085, "answer_total_s": 7.399453453021124, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_439_a1725_q0", "video_id": 439, "time_stamp_s": 9, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "20e5b3cb70ea69b30a91eb50bf9508f15a26914b3ed22ad78d74f590eba8b52b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.052, 1.0196333333333334, 2.0206333333333335, 3.0216333333333334, 4.022633333333333, 5.023633333333334, 6.024633333333333, 7.025633333333333, 8.026633333333333], "recent_frames_sha256": "87facf47495dc786d7d630b1a4dc447b0f90bbb7470daa1441df712721e0535f", "num_recent_frames": 9, "tq": 715953.178919556, "t1": 715954.376440917, "ta": 715954.376440917, "te": 715954.413194926, "first_response_s": 1.1975213610567153, "answer_total_s": 1.2342753700213507, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 439, "content_group": "58b13b5a47f4b325b1abe2d72c43a402921857c7e05d11971d39a3f9f4c02965", "question": {"question_id": "sample_439_a1725_q1", "video_id": 439, "video_path": "./videos/sample_439_real.mp4", "annotation_index": 1725, "question_index": 1, "question": "Where is the cart filled with cardboard boxes and packs of products located in relation to the shelves?", "options": ["A. To the right.", "B. In the center.", "C. To the left.", "D. Behind the shelves."], "answer": "C", "time_stamp_s": 10, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_439_a1725_q1", "video_id": 439, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0b03481071100383cbb03902561a929352cd269f9c640b3d020690647a7b2d2e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.052, 1.0196333333333334, 2.0206333333333335, 3.0216333333333334, 4.022633333333333, 5.023633333333334, 6.024633333333333, 7.025633333333333, 8.026633333333333, 9.027633333333334], "recent_frames_sha256": "890ecf0f74928623571578e094633be7555f22eb85e5e493e66d0ab14bbc38fa", "num_recent_frames": 10, "tq": 715912.534018271, "t1": 715923.331123032, "ta": 715923.331123032, "te": 715923.368685668, "first_response_s": 10.797104761004448, "answer_total_s": 10.834667396964505, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_439_a1725_q1", "video_id": 439, "time_stamp_s": 10, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d3b4b9da87eab1b78f3fcae72acb641143730e824b79d14873ba03ae936cdfa2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.052, 1.0196333333333334, 2.0206333333333335, 3.0216333333333334, 4.022633333333333, 5.023633333333334, 6.024633333333333, 7.025633333333333, 8.026633333333333, 9.027633333333334], "recent_frames_sha256": "890ecf0f74928623571578e094633be7555f22eb85e5e493e66d0ab14bbc38fa", "num_recent_frames": 10, "tq": 715954.435425053, "t1": 715966.124508745, "ta": 715966.124508745, "te": 715966.312316307, "first_response_s": 11.689083692035638, "answer_total_s": 11.87689125398174, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 439, "content_group": "58b13b5a47f4b325b1abe2d72c43a402921857c7e05d11971d39a3f9f4c02965", "question": {"question_id": "sample_439_a1726_q0", "video_id": 439, "video_path": "./videos/sample_439_real.mp4", "annotation_index": 1726, "question_index": 0, "question": "What does the camera capture as it navigates through the shelves?", "options": ["A. Detailed arrangement of goods.", "B. A person stacking boxes.", "C. An empty aisle.", "D. A cart being loaded."], "answer": "A", "time_stamp_s": 176, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_439_a1726_q0", "video_id": 439, "time_stamp_s": 176, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3b72b995ad983780a8a787db5837c901fc6582c087c7483f1a3d213bdb0f7bc2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [146.03116666666668, 147.03216666666665, 148.03316666666666, 149.0008, 150.0018, 151.0028, 152.0038, 153.0048, 154.0058, 155.0068, 156.0078, 157.0088, 158.0098, 159.0108, 160.0118, 161.0128, 162.0138, 163.0148, 164.0158, 165.0168, 166.0178, 167.0188, 168.0198, 169.0208, 170.0218, 171.0228, 172.0238, 173.0248, 174.0258, 175.0268], "recent_frames_sha256": "f4d242b4e1c2d477a90cf2ffffbe97bbf63df8f747840ba4748160106085e5eb", "num_recent_frames": 30, "tq": 715923.385070003, "t1": 715930.639161457, "ta": 715930.639161457, "te": 715930.676759459, "first_response_s": 7.254091453971341, "answer_total_s": 7.291689455974847, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_439_a1726_q0", "video_id": 439, "time_stamp_s": 176, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9abbdb02ef09481f5ea61e7970fc56be14d1254ff4baa62187695e61d3f70a45", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand reaches for a product on a nearly empty shelf, with price tags visible (e.g., $1.99, $2.99).  \n- Shopping carts filled with boxes are parked near the shelves, suggesting restocking or inventory management.  \n- The camera pans across shelves displaying various packaged goods, including canned items and boxes, with some shelves appearing depleted.\n[30-60s] - A person in black gloves picks up a red-packaged item from a shelf, then places it into a cardboard box on the floor.  \n- The person moves to another shelf, selecting more items and placing them into the same box.  \n- The box is positioned near a metal cart, with other boxes and stacked goods visible in the background.\n[60-90s] - Person's hand reaches for a carton of \"Sour Cream & Chive\" milk, priced at 31€, on a supermarket shelf.  \n- The shelf is partially empty, with some products missing, and the person is positioned near the bottom shelf.  \n- A cardboard box is visible on the floor near the shelf, suggesting a restocking or clearance activity.\n[90-120s] - Person wearing black gloves places a red-packaged item onto a shelf, then adjusts nearby white boxes labeled \"20\" and \"14\".  \n- The person's hands move to rearrange or inspect items on the shelf, including a box with \"20\" and \"14\" pricing tags.  \n- A cardboard box is visible on the floor near the person’s feet, suggesting ongoing inventory or packing activity.\n[120-150s] - Person wearing black gloves reaches for a box labeled \"Mjolk\" priced at 20.50, then moves it to the left.  \n- The person's legs and feet are visible as they stand on a gray floor, with a brown paper bag on the ground.  \n- A metal shopping cart is positioned to the left, containing cardboard boxes and other items.", "history_tokens": 429, "history_utf8_bytes": 1739, "recent_frame_times_s": [146.03116666666668, 147.03216666666665, 148.03316666666666, 149.0008, 150.0018, 151.0028, 152.0038, 153.0048, 154.0058, 155.0068, 156.0078, 157.0088, 158.0098, 159.0108, 160.0118, 161.0128, 162.0138, 163.0148, 164.0158, 165.0168, 166.0178, 167.0188, 168.0198, 169.0208, 170.0218, 171.0228, 172.0238, 173.0248, 174.0258, 175.0268], "recent_frames_sha256": "f4d242b4e1c2d477a90cf2ffffbe97bbf63df8f747840ba4748160106085e5eb", "num_recent_frames": 30, "tq": 715999.770336546, "t1": 716001.858740793, "ta": 716001.858740793, "te": 716001.898709892, "first_response_s": 2.0884042469551787, "answer_total_s": 2.1283733459422365, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 439, "content_group": "58b13b5a47f4b325b1abe2d72c43a402921857c7e05d11971d39a3f9f4c02965", "question": {"question_id": "sample_439_a1726_q1", "video_id": 439, "video_path": "./videos/sample_439_real.mp4", "annotation_index": 1726, "question_index": 1, "question": "How are the yogurt cartons labeled that the camera captures in detail right now?", "options": ["A. \"Mild yogurt\".", "B. \"Low-fat yogurt\".", "C. \"Greek yogurt\".", "D. \"Flavored yogurt\"."], "answer": "A", "time_stamp_s": 179, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_439_a1726_q1", "video_id": 439, "time_stamp_s": 179, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "dacba807552454f6735bd9272a8902869546064355f96be8879b88897de8a0f7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [149.0008, 150.0018, 151.0028, 152.0038, 153.0048, 154.0058, 155.0068, 156.0078, 157.0088, 158.0098, 159.0108, 160.0118, 161.0128, 162.0138, 163.0148, 164.0158, 165.0168, 166.0178, 167.0188, 168.0198, 169.0208, 170.0218, 171.0228, 172.0238, 173.0248, 174.0258, 175.0268, 176.0278, 177.0288, 178.0298], "recent_frames_sha256": "502b77be3a6cd0312828a3a12b878b1abfd01b53b4796e23204e1f6de0cea2f5", "num_recent_frames": 30, "tq": 715930.697585371, "t1": 715942.759714661, "ta": 715942.759714661, "te": 715942.797306233, "first_response_s": 12.062129290075973, "answer_total_s": 12.099720861995593, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_439_a1726_q1", "video_id": 439, "time_stamp_s": 179, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2d29597d228ee4d009017bfaaf3caae6a280b62bb3c1354748969a6ad3c78e4f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A hand reaches for a product on a nearly empty shelf, with price tags visible (e.g., $1.99, $2.99).  \n- Shopping carts filled with boxes are parked near the shelves, suggesting restocking or inventory management.  \n- The camera pans across shelves displaying various packaged goods, including canned items and boxes, with some shelves appearing depleted.\n[30-60s] - A person in black gloves picks up a red-packaged item from a shelf, then places it into a cardboard box on the floor.  \n- The person moves to another shelf, selecting more items and placing them into the same box.  \n- The box is positioned near a metal cart, with other boxes and stacked goods visible in the background.\n[60-90s] - Person's hand reaches for a carton of \"Sour Cream & Chive\" milk, priced at 31€, on a supermarket shelf.  \n- The shelf is partially empty, with some products missing, and the person is positioned near the bottom shelf.  \n- A cardboard box is visible on the floor near the shelf, suggesting a restocking or clearance activity.\n[90-120s] - Person wearing black gloves places a red-packaged item onto a shelf, then adjusts nearby white boxes labeled \"20\" and \"14\".  \n- The person's hands move to rearrange or inspect items on the shelf, including a box with \"20\" and \"14\" pricing tags.  \n- A cardboard box is visible on the floor near the person’s feet, suggesting ongoing inventory or packing activity.\n[120-150s] - Person wearing black gloves reaches for a box labeled \"Mjolk\" priced at 20.50, then moves it to the left.  \n- The person's legs and feet are visible as they stand on a gray floor, with a brown paper bag on the ground.  \n- A metal shopping cart is positioned to the left, containing cardboard boxes and other items.", "history_tokens": 429, "history_utf8_bytes": 1739, "recent_frame_times_s": [149.0008, 150.0018, 151.0028, 152.0038, 153.0048, 154.0058, 155.0068, 156.0078, 157.0088, 158.0098, 159.0108, 160.0118, 161.0128, 162.0138, 163.0148, 164.0158, 165.0168, 166.0178, 167.0188, 168.0198, 169.0208, 170.0218, 171.0228, 172.0238, 173.0248, 174.0258, 175.0268, 176.0278, 177.0288, 178.0298], "recent_frames_sha256": "502b77be3a6cd0312828a3a12b878b1abfd01b53b4796e23204e1f6de0cea2f5", "num_recent_frames": 30, "tq": 716001.947533477, "t1": 716007.781769109, "ta": 716007.781769109, "te": 716007.819714131, "first_response_s": 5.834235631977208, "answer_total_s": 5.872180653968826, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 439, "content_group": "58b13b5a47f4b325b1abe2d72c43a402921857c7e05d11971d39a3f9f4c02965", "question": {"question_id": "sample_439_a1727_q0", "video_id": 439, "video_path": "./videos/sample_439_real.mp4", "annotation_index": 1727, "question_index": 0, "question": "What does the person do after reaching towards the shelf?", "options": ["A. Knocks over a carton.", "B. Picks up a carton.", "C. Rearranges the shelf.", "D. Walks away."], "answer": "B", "time_stamp_s": 583, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [540, 587], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_439_a1727_q0", "video_id": 439, "time_stamp_s": 583, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "08328d92b6e0f6d41ed232a0db0ee346a4bd10004a98900d4a22bb10f493d4b3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [553.0044, 554.0054, 555.0064, 556.0074, 557.0084, 558.0094, 559.0104, 560.0114, 561.0124, 562.0134, 563.0144, 564.0154, 565.0164, 566.0174, 567.0184, 568.0194, 569.0204, 570.0214, 571.0224, 572.0234, 573.0244, 574.0254, 575.0264, 576.0274, 577.0284, 578.0294, 579.0304, 580.0314, 581.0324, 582.0000333333334], "recent_frames_sha256": "1600eccd79c4a7db8e73bf6ecf4111b10844a6295ee4ea25f8338f74da80735a", "num_recent_frames": 30, "tq": 715942.808257476, "t1": 715953.1303115, "ta": 715953.1303115, "te": 715953.16821528, "first_response_s": 10.322054024087265, "answer_total_s": 10.35995780408848, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_439_a1727_q0", "video_id": 439, "time_stamp_s": 583, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "54cbf13b56f942c0466e6720414682e74ab26a532ee0d57d7a5471100ae57625", "condition_order": ["recent", "notes"], "memory": "[210-240s] - A person's feet in red shoes are visible at the bottom right, standing near a metal cart.  \n- Shelves are stocked with various packaged goods, including boxes of \"HALLON KESAR\" and \"BREAD\" products.  \n- A green crate filled with bottled beverages is positioned on the right side of the aisle.\n[240-270s] - A hand in black gloves picks up a red box of \"Kefir\" from a shelf, then places it back down.  \n- The shelf displays various dairy products, including \"Veta\" and \"Kefir\" brands, with price tags visible.  \n- A cardboard box is positioned on the floor beneath the shelf, partially obscured by the products.\n[270-300s] - A person's hand reaches for a product on a shelf, then moves to pick up a box from a lower shelf.  \n- The camera pans across shelves stocked with dairy products, including yogurt and milk, with price tags visible.  \n- A shopping cart is positioned near the shelves, containing various items and cardboard boxes.\n[300-330s] - Hand reaches for a blue-lidded container on a shelf, then moves to pick up a white-lidded container nearby.  \n- Price tags for various containers (e.g., $3.99, $2.99) are visible on the shelf, indicating product pricing.  \n- The shelf holds multiple containers of similar products, with some stacked or grouped together.\n[330-360s] - A hand in black gloves picks up a blue-lidded container from a shelf labeled \"37.95\" near a \"GreeKirk\" sign.  \n- The camera pans to show stacked green crates and cardboard boxes on a cart, with a red circular object (possibly a container) on the floor nearby.  \n- The scene transitions to a shelf with various dairy products, including tubs of yogurt and containers of \"GreeKirk\" brand items.\n[360-390s] - Hand reaches for a white container labeled \"Grektek\" priced at 37.95, then picks up multiple similar containers from a shelf.  \n- Shopping cart holds several \"Grektek\" containers and a tray of muffin cups, positioned near a green box of packaged goods.  \n- Shelves are stocked with various products, including boxes of \"Grektek\" and other brands, with some items in cardboard boxes and others in plastic containers.\n[390-420s] - Hand reaches for a blue container labeled \"Sour Cream\" on a shelf, then picks up a tray of muffin cups from below.  \n- The person walks through a warehouse aisle, passing shelves stocked with boxes and green crates, carrying the tray.  \n- A cart is visible in the background, loaded with various packaged goods, including boxes and bottles.\n[420-450s] - A person's gloved hands reach for a box labeled \"25g\" on a shelf, with price tags visible nearby.  \n- The shelf contains various packaged goods, including boxes and cans, arranged in rows.  \n- The person's hands are positioned near the bottom shelf, indicating they are selecting or examining an item.\n[450-480s] - A person wearing black gloves reaches for a product on a shelf, then moves to another shelf to pick up a different item.  \n- The camera pans to show a storage area with stacked boxes and a green cart, indicating a warehouse or backroom setting.  \n- The shelves are stocked with various packaged goods, including boxes and cans, with price tags visible.\n[480-510s] - Hand reaches for a product box on a shelf, with price tags visible below.  \n- Shelf contains various packaged goods, including boxes labeled \"Cereals\" and \"Fruit.\"  \n- Person’s hand moves toward a box marked \"25g\" as they browse items.\n[510-540s] - Person wearing black gloves picks up a box from a shelf labeled \"20%\".  \n- They place the box into a shopping cart filled with other cardboard boxes.  \n- The cart moves along an aisle lined with shelves stocked with various packaged goods.\n[540-570s] - Person wearing black gloves picks up a box from a shelf labeled \"14\" and places it into a shopping cart.  \n- Shopping cart is positioned near a stack of boxes, with other items like eggs and packaged goods visible on adjacent shelves.  \n- The person moves the cart slightly to the right, revealing more shelves stocked with various products.", "history_tokens": 990, "history_utf8_bytes": 4010, "recent_frame_times_s": [553.0044, 554.0054, 555.0064, 556.0074, 557.0084, 558.0094, 559.0104, 560.0114, 561.0124, 562.0134, 563.0144, 564.0154, 565.0164, 566.0174, 567.0184, 568.0194, 569.0204, 570.0214, 571.0224, 572.0234, 573.0244, 574.0254, 575.0264, 576.0274, 577.0284, 578.0294, 579.0304, 580.0314, 581.0324, 582.0000333333334], "recent_frames_sha256": "1600eccd79c4a7db8e73bf6ecf4111b10844a6295ee4ea25f8338f74da80735a", "num_recent_frames": 30, "tq": 716125.797379375, "t1": 716133.005266204, "ta": 716133.005266204, "te": 716133.560069477, "first_response_s": 7.207886829040945, "answer_total_s": 7.762690101983026, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 440, "content_group": "2eb878e55ac8099d1aa28cb9e4ca508109b1977c8c72ace2cae4f5601cd284ef", "question": {"question_id": "sample_440_a722_q0", "video_id": 440, "video_path": "./videos/sample_440_real.mp4", "annotation_index": 722, "question_index": 0, "question": "What type of drink cartons did the individual rearranging first?", "options": ["A. Orange juice.", "B. Yoghurt.", "C. Chocolate milk.", "D. Apple juice."], "answer": "B", "time_stamp_s": 3, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_440_a722_q0", "video_id": 440, "time_stamp_s": 3, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e45f04a7fa2f01d4874a6ae2f805c4c3a07eecf9c62f7bda6479fb05a1052ebe", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.055, 1.0226333333333333, 2.023633333333333], "recent_frames_sha256": "775a3857353c8c90d282213565273cb3de59c5419886424191cca62a3b42b428", "num_recent_frames": 3, "tq": 710354.8085633, "t1": 710355.2426855, "ta": 710355.2426855, "te": 710355.280089544, "first_response_s": 0.4341222000075504, "answer_total_s": 0.4715262440731749, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_440_a722_q0", "video_id": 440, "time_stamp_s": 3, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e00ee227f09c6008d79966982494afc9b62f3c4ccbf387f30f9a81f612fa7705", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.055, 1.0226333333333333, 2.023633333333333], "recent_frames_sha256": "775a3857353c8c90d282213565273cb3de59c5419886424191cca62a3b42b428", "num_recent_frames": 3, "tq": 710207.530747286, "t1": 710213.774600515, "ta": 710213.774600515, "te": 710213.812400719, "first_response_s": 6.243853228981607, "answer_total_s": 6.281653432990424, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 440, "content_group": "2eb878e55ac8099d1aa28cb9e4ca508109b1977c8c72ace2cae4f5601cd284ef", "question": {"question_id": "sample_440_a723_q0", "video_id": 440, "video_path": "./videos/sample_440_real.mp4", "annotation_index": 723, "question_index": 0, "question": "What specific product label is visible in the close-up at the end of the video?", "options": ["A. Danone Greek Yogurt.", "B. Arla Mild Yoghurt.", "C. Yoplait Fruit Yogurt.", "D. Activia Natural Yogurt."], "answer": "B", "time_stamp_s": 160, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_440_a723_q0", "video_id": 440, "time_stamp_s": 160, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2bfc8df554ddb5abfb658b9bf611baaaa0e87382f648724e265c0e690902df7f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [130.01816666666667, 131.01916666666668, 132.02016666666665, 133.02116666666666, 134.02216666666666, 135.02316666666667, 136.02416666666667, 137.02516666666668, 138.02616666666665, 139.02716666666666, 140.02816666666666, 141.02916666666667, 142.03016666666667, 143.03116666666668, 144.03216666666665, 145.03316666666666, 146.0008, 147.0018, 148.0028, 149.0038, 150.0048, 151.0058, 152.0068, 153.0078, 154.0088, 155.0098, 156.0108, 157.0118, 158.0128, 159.0138], "recent_frames_sha256": "583d45ef83eb76d838a996e99f1800816d86bade58d927d1f284f4f6a773ac7c", "num_recent_frames": 30, "tq": 710355.296369968, "t1": 710366.329060174, "ta": 710366.329060174, "te": 710366.366856383, "first_response_s": 11.032690205960535, "answer_total_s": 11.070486415061168, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_440_a723_q0", "video_id": 440, "time_stamp_s": 160, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "19610c88d2c1ddb7fe6b9fde60d5b909f56b2f87ea20346e227f41b059a9df3f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person wearing black gloves picks up various items from shelves, including cartons and cans, while moving through aisles.  \n- Shopping cart is filled with boxes and items, positioned near stacked cardboard packages against the wall.  \n- Shelves display price tags and product labels, with some items like \"Vitamix\" and \"25\" clearly visible.\n[30-60s] - A person in black gloves reaches for a product on a shelf, then moves to a cart loaded with boxes.  \n- The cart is positioned near stacked crates of goods, with shelves displaying various packaged items.  \n- The camera pans to show the cart’s contents and surrounding shelves, highlighting the organized storage layout.\n[60-90s] - Person's gloved hand reaches for a product labeled \"Crème Fraîche\" priced at 3.30€ on a shelf.  \n- The shopping cart, loaded with cardboard boxes, is positioned beside the shelf, slightly to the right.  \n- The shelf displays multiple containers of \"Crème Fraîche\" and other items, with price tags clearly visible.\n[90-120s] - A shopping cart with cardboard boxes is pushed through aisles, passing shelves stocked with canned goods and packaged items.  \n- The cart moves past shelves displaying products like \"Creme Fraiche\" and \"Lipton\" tea, with price tags visible.  \n- The cart’s contents remain unchanged as it navigates the store’s narrow aisles, surrounded by stacked boxes and shelves.\n[120-150s] - Hand reaches for a box of \"BIO-TECH\" products on a shelf, with price tags visible.  \n- Camera pans to show a cart filled with cardboard boxes near stacked green crates.  \n- Shelf displays various product boxes, including \"BIO-TECH\" and \"BIO-TECH\" variants, with price tags indicating $10, $16, $17, $20, and $22.", "history_tokens": 425, "history_utf8_bytes": 1722, "recent_frame_times_s": [130.01816666666667, 131.01916666666668, 132.02016666666665, 133.02116666666666, 134.02216666666666, 135.02316666666667, 136.02416666666667, 137.02516666666668, 138.02616666666665, 139.02716666666666, 140.02816666666666, 141.02916666666667, 142.03016666666667, 143.03116666666668, 144.03216666666665, 145.03316666666666, 146.0008, 147.0018, 148.0028, 149.0038, 150.0048, 151.0058, 152.0068, 153.0078, 154.0088, 155.0098, 156.0108, 157.0118, 158.0128, 159.0138], "recent_frames_sha256": "583d45ef83eb76d838a996e99f1800816d86bade58d927d1f284f4f6a773ac7c", "num_recent_frames": 30, "tq": 710245.636041093, "t1": 710247.176044779, "ta": 710247.176044779, "te": 710247.213026467, "first_response_s": 1.5400036859791726, "answer_total_s": 1.5769853739766404, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 440, "content_group": "2eb878e55ac8099d1aa28cb9e4ca508109b1977c8c72ace2cae4f5601cd284ef", "question": {"question_id": "sample_440_a724_q0", "video_id": 440, "video_path": "./videos/sample_440_real.mp4", "annotation_index": 724, "question_index": 0, "question": "What is the video primarily showing in the storage room right now?", "options": ["A. Inspecting crates.", "B. Stocking shelves.", "C. Moving through aisles.", "D. Organizing products."], "answer": "C", "time_stamp_s": 294, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_440_a724_q0", "video_id": 440, "time_stamp_s": 294, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0bb28ae49d4fdb755c67d675c0064c403324c2f75b5859f68e605882f168822e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [264.0187, 265.0197, 266.0207, 267.0217, 268.0227, 269.0237, 270.0247, 271.0257, 272.0267, 273.0277, 274.0287, 275.0297, 276.0307, 277.0317, 278.0327, 279.00033333333334, 280.0013333333333, 281.00233333333335, 282.00333333333333, 283.0043333333333, 284.00533333333334, 285.0063333333333, 286.00733333333335, 287.0083333333333, 288.00933333333336, 289.01033333333334, 290.0113333333333, 291.01233333333334, 292.0133333333333, 293.01433333333335], "recent_frames_sha256": "686da660c6a7bbe7e0ac5fc7f4cd7281f97ab62958f8e2e3466efc6604035649", "num_recent_frames": 30, "tq": 710366.385131479, "t1": 710377.470980935, "ta": 710377.470980935, "te": 710377.507412332, "first_response_s": 11.085849456023425, "answer_total_s": 11.122280852985568, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_440_a724_q0", "video_id": 440, "time_stamp_s": 294, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f1ff6fd1e4f060032ce029f690d729882762ad14b5909a55c8d44173d6ca0e71", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person wearing black gloves picks up various items from shelves, including cartons and cans, while moving through aisles.  \n- Shopping cart is filled with boxes and items, positioned near stacked cardboard packages against the wall.  \n- Shelves display price tags and product labels, with some items like \"Vitamix\" and \"25\" clearly visible.\n[30-60s] - A person in black gloves reaches for a product on a shelf, then moves to a cart loaded with boxes.  \n- The cart is positioned near stacked crates of goods, with shelves displaying various packaged items.  \n- The camera pans to show the cart’s contents and surrounding shelves, highlighting the organized storage layout.\n[60-90s] - Person's gloved hand reaches for a product labeled \"Crème Fraîche\" priced at 3.30€ on a shelf.  \n- The shopping cart, loaded with cardboard boxes, is positioned beside the shelf, slightly to the right.  \n- The shelf displays multiple containers of \"Crème Fraîche\" and other items, with price tags clearly visible.\n[90-120s] - A shopping cart with cardboard boxes is pushed through aisles, passing shelves stocked with canned goods and packaged items.  \n- The cart moves past shelves displaying products like \"Creme Fraiche\" and \"Lipton\" tea, with price tags visible.  \n- The cart’s contents remain unchanged as it navigates the store’s narrow aisles, surrounded by stacked boxes and shelves.\n[120-150s] - Hand reaches for a box of \"BIO-TECH\" products on a shelf, with price tags visible.  \n- Camera pans to show a cart filled with cardboard boxes near stacked green crates.  \n- Shelf displays various product boxes, including \"BIO-TECH\" and \"BIO-TECH\" variants, with price tags indicating $10, $16, $17, $20, and $22.\n[150-180s] - A person wearing black gloves reaches for a cardboard box on a metal shelf.  \n- The shelf holds multiple stacked boxes of \"Kraft\" brand products and green beverage cans.  \n- The camera pans slightly, revealing more shelves with assorted packaged goods and cardboard boxes.\n[180-210s] - A person in black gloves reaches for a cardboard box on a metal shelf.  \n- The shelf holds stacked boxes, some labeled with red and white branding, and other items like bottled beverages.  \n- The camera pans across the aisle, revealing more shelves with various products and a shopping cart nearby.\n[210-240s] - Person wearing black gloves reaches for a box labeled \"MILD VANILJ\" priced at 20.95.  \n- The person's feet are visible on the floor, standing between shelves stocked with similar products.  \n- A shopping cart with cardboard boxes is positioned nearby, suggesting the person is gathering items for purchase.\n[240-270s] - Person in dark clothing reaches for a box labeled \"16\" on a high shelf, then pulls it down.  \n- Shopping cart with cardboard boxes is positioned nearby, slightly to the right of the person.  \n- Shelves are stocked with various boxed products, including items labeled \"10\" and \"30\" on adjacent shelves.", "history_tokens": 716, "history_utf8_bytes": 2955, "recent_frame_times_s": [264.0187, 265.0197, 266.0207, 267.0217, 268.0227, 269.0237, 270.0247, 271.0257, 272.0267, 273.0277, 274.0287, 275.0297, 276.0307, 277.0317, 278.0327, 279.00033333333334, 280.0013333333333, 281.00233333333335, 282.00333333333333, 283.0043333333333, 284.00533333333334, 285.0063333333333, 286.00733333333335, 287.0083333333333, 288.00933333333336, 289.01033333333334, 290.0113333333333, 291.01233333333334, 292.0133333333333, 293.01433333333335], "recent_frames_sha256": "686da660c6a7bbe7e0ac5fc7f4cd7281f97ab62958f8e2e3466efc6604035649", "num_recent_frames": 30, "tq": 710284.137896887, "t1": 710291.251893003, "ta": 710291.251893003, "te": 710291.451039305, "first_response_s": 7.113996115978807, "answer_total_s": 7.313142417930067, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 440, "content_group": "2eb878e55ac8099d1aa28cb9e4ca508109b1977c8c72ace2cae4f5601cd284ef", "question": {"question_id": "sample_440_a725_q1", "video_id": 440, "video_path": "./videos/sample_440_real.mp4", "annotation_index": 725, "question_index": 1, "question": "What color is the cart used by the person in the supermarket right now?", "options": ["A. Blue.", "B. Red.", "C. Green.", "D. Yellow."], "answer": "B", "time_stamp_s": 426, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_440_a725_q1", "video_id": 440, "time_stamp_s": 426, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2d2453e8b8794e5681b97e936c38a5914cab90fb1042352c80d57bf68fb5b6f3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [396.0172333333333, 397.01823333333334, 398.0192333333333, 399.02023333333335, 400.0212333333333, 401.02223333333336, 402.02323333333334, 403.0242333333333, 404.02523333333335, 405.0262333333333, 406.02723333333336, 407.02823333333333, 408.0292333333333, 409.03023333333334, 410.0312333333333, 411.03223333333335, 412.0332333333333, 413.00086666666664, 414.0018666666667, 415.00286666666665, 416.0038666666667, 417.00486666666666, 418.0058666666667, 419.00686666666667, 420.00786666666664, 421.0088666666667, 422.00986666666665, 423.0108666666667, 424.01186666666666, 425.01286666666664], "recent_frames_sha256": "d0f880071d08f9944865844e76299cb4d1a99e694b549201060e2ff6df4c2618", "num_recent_frames": 30, "tq": 710377.514409587, "t1": 710390.906830433, "ta": 710390.906830433, "te": 710390.944370731, "first_response_s": 13.392420846037567, "answer_total_s": 13.429961143992841, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_440_a725_q1", "video_id": 440, "time_stamp_s": 426, "ground_truth": "B", "raw_output": "B. Red.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "85f25d97fca1c27df90e10ed1bd3403c2eabdc8b0938128245d029e5501f2b99", "condition_order": ["notes", "recent"], "memory": "[30-60s] - A person in black gloves reaches for a product on a shelf, then moves to a cart loaded with boxes.  \n- The cart is positioned near stacked crates of goods, with shelves displaying various packaged items.  \n- The camera pans to show the cart’s contents and surrounding shelves, highlighting the organized storage layout.\n[60-90s] - Person's gloved hand reaches for a product labeled \"Crème Fraîche\" priced at 3.30€ on a shelf.  \n- The shopping cart, loaded with cardboard boxes, is positioned beside the shelf, slightly to the right.  \n- The shelf displays multiple containers of \"Crème Fraîche\" and other items, with price tags clearly visible.\n[90-120s] - A shopping cart with cardboard boxes is pushed through aisles, passing shelves stocked with canned goods and packaged items.  \n- The cart moves past shelves displaying products like \"Creme Fraiche\" and \"Lipton\" tea, with price tags visible.  \n- The cart’s contents remain unchanged as it navigates the store’s narrow aisles, surrounded by stacked boxes and shelves.\n[120-150s] - Hand reaches for a box of \"BIO-TECH\" products on a shelf, with price tags visible.  \n- Camera pans to show a cart filled with cardboard boxes near stacked green crates.  \n- Shelf displays various product boxes, including \"BIO-TECH\" and \"BIO-TECH\" variants, with price tags indicating $10, $16, $17, $20, and $22.\n[150-180s] - A person wearing black gloves reaches for a cardboard box on a metal shelf.  \n- The shelf holds multiple stacked boxes of \"Kraft\" brand products and green beverage cans.  \n- The camera pans slightly, revealing more shelves with assorted packaged goods and cardboard boxes.\n[180-210s] - A person in black gloves reaches for a cardboard box on a metal shelf.  \n- The shelf holds stacked boxes, some labeled with red and white branding, and other items like bottled beverages.  \n- The camera pans across the aisle, revealing more shelves with various products and a shopping cart nearby.\n[210-240s] - Person wearing black gloves reaches for a box labeled \"MILD VANILJ\" priced at 20.95.  \n- The person's feet are visible on the floor, standing between shelves stocked with similar products.  \n- A shopping cart with cardboard boxes is positioned nearby, suggesting the person is gathering items for purchase.\n[240-270s] - Person in dark clothing reaches for a box labeled \"16\" on a high shelf, then pulls it down.  \n- Shopping cart with cardboard boxes is positioned nearby, slightly to the right of the person.  \n- Shelves are stocked with various boxed products, including items labeled \"10\" and \"30\" on adjacent shelves.\n[270-300s] - Person picks up a blue box from a shelf, then places it into a shopping cart.  \n- Shopping cart is loaded with multiple cardboard boxes and other items, moving through aisles.  \n- Aisle contains shelves stocked with various packaged goods, including food items and household products.\n[300-330s] - Person pushes a cart loaded with red crates and white boxes through a warehouse aisle.  \n- Cart is maneuvered past stacked crates and shelves holding various packaged goods.  \n- Person’s hand reaches for a product label on a shelf, indicating interaction with inventory.\n[330-360s] - Person picks up a box of \"Bounty\" paper towels from a shelf, placing it into a red shopping cart.  \n- The cart is pushed through an aisle, passing by stacked crates of goods and a refrigerated section.  \n- The person navigates through a storage area with multiple red crates and stacked boxes, moving toward a doorway.\n[360-390s] - Red cart loaded with white boxes moves through aisle, passing green crates of goods.  \n- Person in black gloves pushes cart, navigating between shelves stocked with various products.  \n- Cardboard boxes and packaging materials are visible on floor and stacked near shelves.\n[390-420s] - A gloved hand reaches for a white box labeled \"MÜLK\" on a shelf, then places it back onto the shelf.  \n- The shelf has a price tag of \"26\" visible beneath the box.  \n- A red plastic cart is positioned nearby, holding stacks of white boxes.", "history_tokens": 978, "history_utf8_bytes": 4061, "recent_frame_times_s": [396.0172333333333, 397.01823333333334, 398.0192333333333, 399.02023333333335, 400.0212333333333, 401.02223333333336, 402.02323333333334, 403.0242333333333, 404.02523333333335, 405.0262333333333, 406.02723333333336, 407.02823333333333, 408.0292333333333, 409.03023333333334, 410.0312333333333, 411.03223333333335, 412.0332333333333, 413.00086666666664, 414.0018666666667, 415.00286666666665, 416.0038666666667, 417.00486666666666, 418.0058666666667, 419.00686666666667, 420.00786666666664, 421.0088666666667, 422.00986666666665, 423.0108666666667, 424.01186666666666, 425.01286666666664], "recent_frames_sha256": "d0f880071d08f9944865844e76299cb4d1a99e694b549201060e2ff6df4c2618", "num_recent_frames": 30, "tq": 710335.796792351, "t1": 710342.448997139, "ta": 710342.448997139, "te": 710342.852057736, "first_response_s": 6.6522047880571336, "answer_total_s": 7.055265385075472, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 440, "content_group": "2eb878e55ac8099d1aa28cb9e4ca508109b1977c8c72ace2cae4f5601cd284ef", "question": {"question_id": "sample_440_a725_q0", "video_id": 440, "video_path": "./videos/sample_440_real.mp4", "annotation_index": 725, "question_index": 0, "question": "What type of products is the person handling in the supermarket aisle?", "options": ["A. Bread loaves.", "B. Canned goods.", "C. Milk cartons.", "D. Fruit packages."], "answer": "C", "time_stamp_s": 440, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_440_a725_q0", "video_id": 440, "time_stamp_s": 440, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5005ab996138ed56bd8fea21647593762e9f36263a41f9f3e1c3056887334a2e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [410.0312333333333, 411.03223333333335, 412.0332333333333, 413.00086666666664, 414.0018666666667, 415.00286666666665, 416.0038666666667, 417.00486666666666, 418.0058666666667, 419.00686666666667, 420.00786666666664, 421.0088666666667, 422.00986666666665, 423.0108666666667, 424.01186666666666, 425.01286666666664, 426.0138666666667, 427.01486666666665, 428.0158666666667, 429.01686666666666, 430.0178666666667, 431.01886666666667, 432.01986666666664, 433.0208666666667, 434.02186666666665, 435.0228666666667, 436.02386666666666, 437.02486666666664, 438.0258666666667, 439.02686666666665], "recent_frames_sha256": "7fa726541f78b12c09ca057276b834027d0ea353967ba093373a55e4bbc451a2", "num_recent_frames": 30, "tq": 710390.952559783, "t1": 710398.563290593, "ta": 710398.563290593, "te": 710398.600812522, "first_response_s": 7.610730809974484, "answer_total_s": 7.648252738988958, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_440_a725_q0", "video_id": 440, "time_stamp_s": 440, "ground_truth": "C", "raw_output": "C. Milk cartons.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "c8cb5f61241aebae14e9664351650f60f3d0c3125902aa8d4de05e376d0e0e2c", "condition_order": ["notes", "recent"], "memory": "[30-60s] - A person in black gloves reaches for a product on a shelf, then moves to a cart loaded with boxes.  \n- The cart is positioned near stacked crates of goods, with shelves displaying various packaged items.  \n- The camera pans to show the cart’s contents and surrounding shelves, highlighting the organized storage layout.\n[60-90s] - Person's gloved hand reaches for a product labeled \"Crème Fraîche\" priced at 3.30€ on a shelf.  \n- The shopping cart, loaded with cardboard boxes, is positioned beside the shelf, slightly to the right.  \n- The shelf displays multiple containers of \"Crème Fraîche\" and other items, with price tags clearly visible.\n[90-120s] - A shopping cart with cardboard boxes is pushed through aisles, passing shelves stocked with canned goods and packaged items.  \n- The cart moves past shelves displaying products like \"Creme Fraiche\" and \"Lipton\" tea, with price tags visible.  \n- The cart’s contents remain unchanged as it navigates the store’s narrow aisles, surrounded by stacked boxes and shelves.\n[120-150s] - Hand reaches for a box of \"BIO-TECH\" products on a shelf, with price tags visible.  \n- Camera pans to show a cart filled with cardboard boxes near stacked green crates.  \n- Shelf displays various product boxes, including \"BIO-TECH\" and \"BIO-TECH\" variants, with price tags indicating $10, $16, $17, $20, and $22.\n[150-180s] - A person wearing black gloves reaches for a cardboard box on a metal shelf.  \n- The shelf holds multiple stacked boxes of \"Kraft\" brand products and green beverage cans.  \n- The camera pans slightly, revealing more shelves with assorted packaged goods and cardboard boxes.\n[180-210s] - A person in black gloves reaches for a cardboard box on a metal shelf.  \n- The shelf holds stacked boxes, some labeled with red and white branding, and other items like bottled beverages.  \n- The camera pans across the aisle, revealing more shelves with various products and a shopping cart nearby.\n[210-240s] - Person wearing black gloves reaches for a box labeled \"MILD VANILJ\" priced at 20.95.  \n- The person's feet are visible on the floor, standing between shelves stocked with similar products.  \n- A shopping cart with cardboard boxes is positioned nearby, suggesting the person is gathering items for purchase.\n[240-270s] - Person in dark clothing reaches for a box labeled \"16\" on a high shelf, then pulls it down.  \n- Shopping cart with cardboard boxes is positioned nearby, slightly to the right of the person.  \n- Shelves are stocked with various boxed products, including items labeled \"10\" and \"30\" on adjacent shelves.\n[270-300s] - Person picks up a blue box from a shelf, then places it into a shopping cart.  \n- Shopping cart is loaded with multiple cardboard boxes and other items, moving through aisles.  \n- Aisle contains shelves stocked with various packaged goods, including food items and household products.\n[300-330s] - Person pushes a cart loaded with red crates and white boxes through a warehouse aisle.  \n- Cart is maneuvered past stacked crates and shelves holding various packaged goods.  \n- Person’s hand reaches for a product label on a shelf, indicating interaction with inventory.\n[330-360s] - Person picks up a box of \"Bounty\" paper towels from a shelf, placing it into a red shopping cart.  \n- The cart is pushed through an aisle, passing by stacked crates of goods and a refrigerated section.  \n- The person navigates through a storage area with multiple red crates and stacked boxes, moving toward a doorway.\n[360-390s] - Red cart loaded with white boxes moves through aisle, passing green crates of goods.  \n- Person in black gloves pushes cart, navigating between shelves stocked with various products.  \n- Cardboard boxes and packaging materials are visible on floor and stacked near shelves.\n[390-420s] - A gloved hand reaches for a white box labeled \"MÜLK\" on a shelf, then places it back onto the shelf.  \n- The shelf has a price tag of \"26\" visible beneath the box.  \n- A red plastic cart is positioned nearby, holding stacks of white boxes.", "history_tokens": 978, "history_utf8_bytes": 4061, "recent_frame_times_s": [410.0312333333333, 411.03223333333335, 412.0332333333333, 413.00086666666664, 414.0018666666667, 415.00286666666665, 416.0038666666667, 417.00486666666666, 418.0058666666667, 419.00686666666667, 420.00786666666664, 421.0088666666667, 422.00986666666665, 423.0108666666667, 424.01186666666666, 425.01286666666664, 426.0138666666667, 427.01486666666665, 428.0158666666667, 429.01686666666666, 430.0178666666667, 431.01886666666667, 432.01986666666664, 433.0208666666667, 434.02186666666665, 435.0228666666667, 436.02386666666666, 437.02486666666664, 438.0258666666667, 439.02686666666665], "recent_frames_sha256": "7fa726541f78b12c09ca057276b834027d0ea353967ba093373a55e4bbc451a2", "num_recent_frames": 30, "tq": 710342.900929124, "t1": 710354.510104545, "ta": 710354.510104545, "te": 710354.771616787, "first_response_s": 11.60917542106472, "answer_total_s": 11.870687662973069, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 441, "content_group": "cdc9ba98f3abf6920c92e4a55bd49243f5137eb18f31ee8f224bd10687025205", "question": {"question_id": "sample_441_a1838_q0", "video_id": 441, "video_path": "./videos/sample_441_real.mp4", "annotation_index": 1838, "question_index": 0, "question": "What is the person consistently doing throughout the entire scene?", "options": ["A. Taking inventory of products.", "B. Rearranging boxes randomly.", "C. Cleaning the storage area.", "D. Sorting and placing products methodically."], "answer": "D", "time_stamp_s": 20, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_441_a1838_q0", "video_id": 441, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "73653938d33963f2219a86fc66e5ee39a66e1255f8d94769cbda42c6dce2a89d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.034, 1.0016333333333334, 2.0026333333333333, 3.003633333333333, 4.0046333333333335, 5.005633333333333, 6.006633333333333, 7.007633333333334, 8.008633333333334, 9.009633333333333, 10.010633333333333, 11.011633333333334, 12.012633333333333, 13.013633333333333, 14.014633333333334, 15.015633333333334, 16.016633333333335, 17.017633333333333, 18.018633333333334, 19.019633333333335], "recent_frames_sha256": "91d3150bcf0ea002acd24148641ba941771aa7e7e4b58ca04a64dbf433c4f3f5", "num_recent_frames": 20, "tq": 718481.465168655, "t1": 718487.325105805, "ta": 718487.325105805, "te": 718487.363509784, "first_response_s": 5.859937149914913, "answer_total_s": 5.89834112895187, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_441_a1838_q0", "video_id": 441, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8fd35bad87fba26d4a685c713817bc8af799b0651717b5b0cd4ccc0a9125c162", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.034, 1.0016333333333334, 2.0026333333333333, 3.003633333333333, 4.0046333333333335, 5.005633333333333, 6.006633333333333, 7.007633333333334, 8.008633333333334, 9.009633333333333, 10.010633333333333, 11.011633333333334, 12.012633333333333, 13.013633333333333, 14.014633333333334, 15.015633333333334, 16.016633333333335, 17.017633333333333, 18.018633333333334, 19.019633333333335], "recent_frames_sha256": "91d3150bcf0ea002acd24148641ba941771aa7e7e4b58ca04a64dbf433c4f3f5", "num_recent_frames": 20, "tq": 718342.453987795, "t1": 718357.063801637, "ta": 718357.063801637, "te": 718357.406452712, "first_response_s": 14.609813841991127, "answer_total_s": 14.952464916976169, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 441, "content_group": "cdc9ba98f3abf6920c92e4a55bd49243f5137eb18f31ee8f224bd10687025205", "question": {"question_id": "sample_441_a1839_q0", "video_id": 441, "video_path": "./videos/sample_441_real.mp4", "annotation_index": 1839, "question_index": 0, "question": "What did the person pick up from the cart and place into the left-side shelves just now?", "options": ["A. Yogurt cups.", "B. Green Cartons of milk.", "C. Boxes of green-colored items.", "D. Containers of cream."], "answer": "B", "time_stamp_s": 154, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_441_a1839_q0", "video_id": 441, "time_stamp_s": 154, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1ba497dd74823050eb1d7e01565061347ed22a9768bd4c06789b3e96cd34109c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [124.02453333333334, 125.02553333333333, 126.02653333333333, 127.02753333333334, 128.02853333333334, 129.02953333333335, 130.03053333333332, 131.03153333333333, 132.03253333333333, 133.00016666666667, 134.00116666666668, 135.00216666666665, 136.00316666666666, 137.00416666666666, 138.00516666666667, 139.00616666666667, 140.00716666666668, 141.00816666666665, 142.00916666666666, 143.01016666666666, 144.01116666666667, 145.01216666666667, 146.01316666666668, 147.01416666666665, 148.01516666666666, 149.01616666666666, 150.01716666666667, 151.01816666666667, 152.01916666666668, 153.02016666666665], "recent_frames_sha256": "790e2852ee429c0f853a00e0e5ac62309f3b07a6c6070149885ba81232a5fa95", "num_recent_frames": 30, "tq": 718487.374146743, "t1": 718499.985694521, "ta": 718499.985694521, "te": 718500.026296337, "first_response_s": 12.6115477780113, "answer_total_s": 12.652149594039656, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_441_a1839_q0", "video_id": 441, "time_stamp_s": 154, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e9565e06b1f26a0dbe90d1ae4c8cfc2ccc4d7ec4a6ba8351e85f9ff27a8768af", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person wearing black gloves pushes a metal shopping cart through aisles stocked with various products.  \n- Cart moves past shelves holding items like canned goods, boxes, and containers, with some shelves partially empty.  \n- The cart’s path is guided by the person’s hand movements, navigating between aisles and avoiding obstacles.\n[30-60s] - Hand reaches for red-packaged items on a lower shelf, pulling a cart toward the aisle.  \n- Cart moves past shelves stocked with white boxes and blue cans, navigating between aisles.  \n- Green crates and cardboard boxes are visible on the floor to the right, near stacked pallets.\n[60-90s] - Shopping cart filled with red-packaged items moves slowly along an aisle, passing shelves stocked with various goods.  \n- Shelves display price tags (e.g., \"12\", \"15\") and products like canned goods and boxes.  \n- Cart’s contents remain unchanged as it progresses through the aisle.\n[90-120s] - Person in black gloves reaches for a green box labeled \"LATTIJO\" on a shelf, then removes it.  \n- The person's feet are visible on the floor, wearing dark pants and brown boots, as they stand near the shelf.  \n- The shelf has multiple items, including white boxes with blue labels, and a price tag showing \"13.50\" above the shelf.\n[120-150s] - Shopping cart moves forward through aisle with mostly empty shelves, passing boxes of \"Kraft\" products.  \n- Green and white boxes are stacked on lower shelves to the right, near a metal cart.  \n- Camera pans slightly right, revealing more shelves stocked with various items, including canned goods and packaged foods.", "history_tokens": 374, "history_utf8_bytes": 1608, "recent_frame_times_s": [124.02453333333334, 125.02553333333333, 126.02653333333333, 127.02753333333334, 128.02853333333334, 129.02953333333335, 130.03053333333332, 131.03153333333333, 132.03253333333333, 133.00016666666667, 134.00116666666668, 135.00216666666665, 136.00316666666666, 137.00416666666666, 138.00516666666667, 139.00616666666667, 140.00716666666668, 141.00816666666665, 142.00916666666666, 143.01016666666666, 144.01116666666667, 145.01216666666667, 146.01316666666668, 147.01416666666665, 148.01516666666666, 149.01616666666666, 150.01716666666667, 151.01816666666667, 152.01916666666668, 153.02016666666665], "recent_frames_sha256": "790e2852ee429c0f853a00e0e5ac62309f3b07a6c6070149885ba81232a5fa95", "num_recent_frames": 30, "tq": 718395.224370766, "t1": 718396.707160487, "ta": 718396.707160487, "te": 718396.746174137, "first_response_s": 1.482789720990695, "answer_total_s": 1.5218033710261807, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 441, "content_group": "cdc9ba98f3abf6920c92e4a55bd49243f5137eb18f31ee8f224bd10687025205", "question": {"question_id": "sample_441_a1840_q0", "video_id": 441, "video_path": "./videos/sample_441_real.mp4", "annotation_index": 1840, "question_index": 0, "question": "Where are the dairy products and other food items primarily located in the storage room?", "options": ["A. On the left shelves.", "B. On the right shelves.", "C. On the central aisle.", "D. Near the entrance."], "answer": "B", "time_stamp_s": 300, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_441_a1840_q0", "video_id": 441, "time_stamp_s": 300, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0b144d2811c8ad86b864c80176844b839243a101618e1d3786824f25f9fba99b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [270.0037, 271.0047, 272.0057, 273.0067, 274.0077, 275.0087, 276.0097, 277.0107, 278.0117, 279.0127, 280.0137, 281.0147, 282.0157, 283.0167, 284.0177, 285.0187, 286.0197, 287.0207, 288.0217, 289.0227, 290.0237, 291.0247, 292.0257, 293.0267, 294.0277, 295.0287, 296.0297, 297.0307, 298.0317, 299.0327], "recent_frames_sha256": "ff533716d9e105da18d449c65623989b0a519f7c46fd35cab7d091dc24a16f93", "num_recent_frames": 30, "tq": 718500.039377874, "t1": 718514.400814429, "ta": 718514.400814429, "te": 718514.441299104, "first_response_s": 14.361436555045657, "answer_total_s": 14.40192123001907, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_441_a1840_q0", "video_id": 441, "time_stamp_s": 300, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f05ecd5fc29c65fd5890867cb73094cbb28dd0f18ad3bbe78079b0c2fd2d5560", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person wearing black gloves pushes a metal shopping cart through aisles stocked with various products.  \n- Cart moves past shelves holding items like canned goods, boxes, and containers, with some shelves partially empty.  \n- The cart’s path is guided by the person’s hand movements, navigating between aisles and avoiding obstacles.\n[30-60s] - Hand reaches for red-packaged items on a lower shelf, pulling a cart toward the aisle.  \n- Cart moves past shelves stocked with white boxes and blue cans, navigating between aisles.  \n- Green crates and cardboard boxes are visible on the floor to the right, near stacked pallets.\n[60-90s] - Shopping cart filled with red-packaged items moves slowly along an aisle, passing shelves stocked with various goods.  \n- Shelves display price tags (e.g., \"12\", \"15\") and products like canned goods and boxes.  \n- Cart’s contents remain unchanged as it progresses through the aisle.\n[90-120s] - Person in black gloves reaches for a green box labeled \"LATTIJO\" on a shelf, then removes it.  \n- The person's feet are visible on the floor, wearing dark pants and brown boots, as they stand near the shelf.  \n- The shelf has multiple items, including white boxes with blue labels, and a price tag showing \"13.50\" above the shelf.\n[120-150s] - Shopping cart moves forward through aisle with mostly empty shelves, passing boxes of \"Kraft\" products.  \n- Green and white boxes are stacked on lower shelves to the right, near a metal cart.  \n- Camera pans slightly right, revealing more shelves stocked with various items, including canned goods and packaged foods.\n[150-180s] - A person's hand reaches for a product labeled \"Frisch\" on a shelf, with price tags visible nearby.  \n- The shopping cart, positioned to the right, contains multiple green-capped bottles.  \n- The shelf displays various items, including large containers and boxes, with price tags indicating costs like \"33.50\" and \"25\".\n[180-210s] - Hand reaches for a product labeled \"Lait Frais\" priced at 2.50€ on a shelf.  \n- Shopping cart is positioned below the shelf, containing green-labeled items.  \n- Shelf displays multiple \"Crème Fraîche\" containers with price tags visible.\n[210-240s] - Shopping cart moves through aisle, carrying green-packaged goods, past shelves stocked with blue-labeled containers.  \n- Camera pans to reveal storage area with metal racks holding cardboard boxes and stacked white-packaged items.  \n- Cart continues forward, passing by more shelves with assorted products, including red-packaged goods near the end of the aisle.\n[240-270s] - Shopping cart contains red-packaged items and green crates with circular cutouts, positioned near shelves stocked with blue and white products.  \n- A person’s gloved hand reaches into the cart, interacting with the red-packaged items.  \n- The cart is moving slowly through a narrow aisle, with shelves on both sides displaying various goods.\n[270-300s] - Person pushes shopping cart loaded with red-and-white boxes through warehouse aisle.  \n- Cart moves past stacked green crates and shelves holding various packaged goods.  \n- Person navigates cart around corner, passing shelves stocked with cylindrical containers.", "history_tokens": 741, "history_utf8_bytes": 3204, "recent_frame_times_s": [270.0037, 271.0047, 272.0057, 273.0067, 274.0077, 275.0087, 276.0097, 277.0107, 278.0117, 279.0127, 280.0137, 281.0147, 282.0157, 283.0167, 284.0177, 285.0187, 286.0197, 287.0207, 288.0217, 289.0227, 290.0237, 291.0247, 292.0257, 293.0267, 294.0277, 295.0287, 296.0297, 297.0307, 298.0317, 299.0327], "recent_frames_sha256": "ff533716d9e105da18d449c65623989b0a519f7c46fd35cab7d091dc24a16f93", "num_recent_frames": 30, "tq": 718432.224734258, "t1": 718438.97332018, "ta": 718438.97332018, "te": 718439.011235954, "first_response_s": 6.74858592194505, "answer_total_s": 6.786501695984043, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 441, "content_group": "cdc9ba98f3abf6920c92e4a55bd49243f5137eb18f31ee8f224bd10687025205", "question": {"question_id": "sample_441_a1840_q1", "video_id": 441, "video_path": "./videos/sample_441_real.mp4", "annotation_index": 1840, "question_index": 1, "question": "What activity is the individual primarily engaged in just now?", "options": ["A. Pushing a loaded cart.", "B. Stocking shelves.", "C. Taking inventory.", "D. Cleaning the area."], "answer": "A", "time_stamp_s": 300, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_441_a1840_q1", "video_id": 441, "time_stamp_s": 300, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "334281f3133878002c6100cadd736966043a5d47922bd232de8c573724035e26", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [270.0037, 271.0047, 272.0057, 273.0067, 274.0077, 275.0087, 276.0097, 277.0107, 278.0117, 279.0127, 280.0137, 281.0147, 282.0157, 283.0167, 284.0177, 285.0187, 286.0197, 287.0207, 288.0217, 289.0227, 290.0237, 291.0247, 292.0257, 293.0267, 294.0277, 295.0287, 296.0297, 297.0307, 298.0317, 299.0327], "recent_frames_sha256": "ff533716d9e105da18d449c65623989b0a519f7c46fd35cab7d091dc24a16f93", "num_recent_frames": 30, "tq": 718514.455703879, "t1": 718521.594697035, "ta": 718521.594697035, "te": 718521.633845577, "first_response_s": 7.1389931560261175, "answer_total_s": 7.178141698008403, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_441_a1840_q1", "video_id": 441, "time_stamp_s": 300, "ground_truth": "A", "raw_output": "A. Pushing a loaded cart.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "204c3500700442f0a6e10bb209ec418e20b64b222f2ab5834774273c6e6d8dc0", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person wearing black gloves pushes a metal shopping cart through aisles stocked with various products.  \n- Cart moves past shelves holding items like canned goods, boxes, and containers, with some shelves partially empty.  \n- The cart’s path is guided by the person’s hand movements, navigating between aisles and avoiding obstacles.\n[30-60s] - Hand reaches for red-packaged items on a lower shelf, pulling a cart toward the aisle.  \n- Cart moves past shelves stocked with white boxes and blue cans, navigating between aisles.  \n- Green crates and cardboard boxes are visible on the floor to the right, near stacked pallets.\n[60-90s] - Shopping cart filled with red-packaged items moves slowly along an aisle, passing shelves stocked with various goods.  \n- Shelves display price tags (e.g., \"12\", \"15\") and products like canned goods and boxes.  \n- Cart’s contents remain unchanged as it progresses through the aisle.\n[90-120s] - Person in black gloves reaches for a green box labeled \"LATTIJO\" on a shelf, then removes it.  \n- The person's feet are visible on the floor, wearing dark pants and brown boots, as they stand near the shelf.  \n- The shelf has multiple items, including white boxes with blue labels, and a price tag showing \"13.50\" above the shelf.\n[120-150s] - Shopping cart moves forward through aisle with mostly empty shelves, passing boxes of \"Kraft\" products.  \n- Green and white boxes are stacked on lower shelves to the right, near a metal cart.  \n- Camera pans slightly right, revealing more shelves stocked with various items, including canned goods and packaged foods.\n[150-180s] - A person's hand reaches for a product labeled \"Frisch\" on a shelf, with price tags visible nearby.  \n- The shopping cart, positioned to the right, contains multiple green-capped bottles.  \n- The shelf displays various items, including large containers and boxes, with price tags indicating costs like \"33.50\" and \"25\".\n[180-210s] - Hand reaches for a product labeled \"Lait Frais\" priced at 2.50€ on a shelf.  \n- Shopping cart is positioned below the shelf, containing green-labeled items.  \n- Shelf displays multiple \"Crème Fraîche\" containers with price tags visible.\n[210-240s] - Shopping cart moves through aisle, carrying green-packaged goods, past shelves stocked with blue-labeled containers.  \n- Camera pans to reveal storage area with metal racks holding cardboard boxes and stacked white-packaged items.  \n- Cart continues forward, passing by more shelves with assorted products, including red-packaged goods near the end of the aisle.\n[240-270s] - Shopping cart contains red-packaged items and green crates with circular cutouts, positioned near shelves stocked with blue and white products.  \n- A person’s gloved hand reaches into the cart, interacting with the red-packaged items.  \n- The cart is moving slowly through a narrow aisle, with shelves on both sides displaying various goods.\n[270-300s] - Person pushes shopping cart loaded with red-and-white boxes through warehouse aisle.  \n- Cart moves past stacked green crates and shelves holding various packaged goods.  \n- Person navigates cart around corner, passing shelves stocked with cylindrical containers.", "history_tokens": 741, "history_utf8_bytes": 3204, "recent_frame_times_s": [270.0037, 271.0047, 272.0057, 273.0067, 274.0077, 275.0087, 276.0097, 277.0107, 278.0117, 279.0127, 280.0137, 281.0147, 282.0157, 283.0167, 284.0177, 285.0187, 286.0197, 287.0207, 288.0217, 289.0227, 290.0237, 291.0247, 292.0257, 293.0267, 294.0277, 295.0287, 296.0297, 297.0307, 298.0317, 299.0327], "recent_frames_sha256": "ff533716d9e105da18d449c65623989b0a519f7c46fd35cab7d091dc24a16f93", "num_recent_frames": 30, "tq": 718439.029422575, "t1": 718451.814707941, "ta": 718451.814707941, "te": 718452.163372718, "first_response_s": 12.785285366000608, "answer_total_s": 13.133950143004768, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 441, "content_group": "cdc9ba98f3abf6920c92e4a55bd49243f5137eb18f31ee8f224bd10687025205", "question": {"question_id": "sample_441_a1841_q0", "video_id": 441, "video_path": "./videos/sample_441_real.mp4", "annotation_index": 1841, "question_index": 0, "question": "How are the boxed items labeled on the right side shelves in the storage room right now?", "options": ["A. \"DAIRY\".", "B. \"FRESH\".", "C. \"PRVIA\".", "D. \"GROCERY\"."], "answer": "C", "time_stamp_s": 422, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_441_a1841_q0", "video_id": 441, "time_stamp_s": 422, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "04d5f26136ad70a1af87d35679eecaf80b3381a3b2382e1e56749b3b917bb4d4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [392.0256, 393.0266, 394.0276, 395.0286, 396.0296, 397.0306, 398.0316, 399.0326, 400.0002333333333, 401.00123333333335, 402.0022333333333, 403.00323333333336, 404.00423333333333, 405.0052333333333, 406.00623333333334, 407.0072333333333, 408.00823333333335, 409.0092333333333, 410.01023333333336, 411.01123333333334, 412.0122333333333, 413.01323333333335, 414.0142333333333, 415.01523333333336, 416.01623333333333, 417.0172333333333, 418.01823333333334, 419.0192333333333, 420.02023333333335, 421.0212333333333], "recent_frames_sha256": "3238f76c233dbe5b4c390a1eacc49f2e86845f9540d8392e38c3eeac01c14612", "num_recent_frames": 30, "tq": 718521.651057734, "t1": 718537.432234212, "ta": 718537.432234212, "te": 718537.471804474, "first_response_s": 15.781176478019916, "answer_total_s": 15.82074673997704, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_441_a1841_q0", "video_id": 441, "time_stamp_s": 422, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6741d3ac5a025e108417b716d3bd2599078fbd1633b1424b8c0d089e7701d750", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Hand reaches for red-packaged items on a lower shelf, pulling a cart toward the aisle.  \n- Cart moves past shelves stocked with white boxes and blue cans, navigating between aisles.  \n- Green crates and cardboard boxes are visible on the floor to the right, near stacked pallets.\n[60-90s] - Shopping cart filled with red-packaged items moves slowly along an aisle, passing shelves stocked with various goods.  \n- Shelves display price tags (e.g., \"12\", \"15\") and products like canned goods and boxes.  \n- Cart’s contents remain unchanged as it progresses through the aisle.\n[90-120s] - Person in black gloves reaches for a green box labeled \"LATTIJO\" on a shelf, then removes it.  \n- The person's feet are visible on the floor, wearing dark pants and brown boots, as they stand near the shelf.  \n- The shelf has multiple items, including white boxes with blue labels, and a price tag showing \"13.50\" above the shelf.\n[120-150s] - Shopping cart moves forward through aisle with mostly empty shelves, passing boxes of \"Kraft\" products.  \n- Green and white boxes are stacked on lower shelves to the right, near a metal cart.  \n- Camera pans slightly right, revealing more shelves stocked with various items, including canned goods and packaged foods.\n[150-180s] - A person's hand reaches for a product labeled \"Frisch\" on a shelf, with price tags visible nearby.  \n- The shopping cart, positioned to the right, contains multiple green-capped bottles.  \n- The shelf displays various items, including large containers and boxes, with price tags indicating costs like \"33.50\" and \"25\".\n[180-210s] - Hand reaches for a product labeled \"Lait Frais\" priced at 2.50€ on a shelf.  \n- Shopping cart is positioned below the shelf, containing green-labeled items.  \n- Shelf displays multiple \"Crème Fraîche\" containers with price tags visible.\n[210-240s] - Shopping cart moves through aisle, carrying green-packaged goods, past shelves stocked with blue-labeled containers.  \n- Camera pans to reveal storage area with metal racks holding cardboard boxes and stacked white-packaged items.  \n- Cart continues forward, passing by more shelves with assorted products, including red-packaged goods near the end of the aisle.\n[240-270s] - Shopping cart contains red-packaged items and green crates with circular cutouts, positioned near shelves stocked with blue and white products.  \n- A person’s gloved hand reaches into the cart, interacting with the red-packaged items.  \n- The cart is moving slowly through a narrow aisle, with shelves on both sides displaying various goods.\n[270-300s] - Person pushes shopping cart loaded with red-and-white boxes through warehouse aisle.  \n- Cart moves past stacked green crates and shelves holding various packaged goods.  \n- Person navigates cart around corner, passing shelves stocked with cylindrical containers.\n[300-330s] - A shopping cart is pushed along an aisle, passing stacks of boxed goods and crates of produce.  \n- The cart contains red-packaged items, likely beverages, and moves past shelves stocked with various products.  \n- The environment is a warehouse or backroom with white walls, fluorescent lighting, and multiple carts and crates stacked along the sides.\n[330-360s] - Shopping cart with red-packaged goods moves along aisle, passing stacked boxes and shelves.  \n- Metal shelving units hold various products, including white boxes labeled \"Pills\" and \"Pill.\"  \n- Cart navigates through narrow aisle, passing green crates and cardboard boxes on floor.\n[360-390s] - A shopping cart filled with green-capped bottles is pushed along an aisle, passing stacks of crates and cardboard boxes.  \n- The cart moves past shelves stocked with various packaged goods, including boxes labeled \"10% OFF\" and \"10% OFF\" signs.  \n- The cart’s path is flanked by metal shelving units holding assorted products, with some shelves partially filled and others empty.\n[390-420s] - A gloved hand points to a stack of white cardboard boxes with circular cutouts, placed atop other cardboard boxes.  \n- The hand then moves to lift a large, flat cardboard box from a pile, revealing its underside and edges.  \n- The camera pans to show a long aisle with shelves stocked with various products, including boxes labeled \"PRIME\" and \"Coca-Cola\".", "history_tokens": 998, "history_utf8_bytes": 4280, "recent_frame_times_s": [392.0256, 393.0266, 394.0276, 395.0286, 396.0296, 397.0306, 398.0316, 399.0326, 400.0002333333333, 401.00123333333335, 402.0022333333333, 403.00323333333336, 404.00423333333333, 405.0052333333333, 406.00623333333334, 407.0072333333333, 408.00823333333335, 409.0092333333333, 410.01023333333336, 411.01123333333334, 412.0122333333333, 413.01323333333335, 414.0142333333333, 415.01523333333336, 416.01623333333333, 417.0172333333333, 418.01823333333334, 419.0192333333333, 420.02023333333335, 421.0212333333333], "recent_frames_sha256": "3238f76c233dbe5b4c390a1eacc49f2e86845f9540d8392e38c3eeac01c14612", "num_recent_frames": 30, "tq": 718479.945333849, "t1": 718481.104342625, "ta": 718481.104342625, "te": 718481.441540692, "first_response_s": 1.1590087759541348, "answer_total_s": 1.4962068429449573, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 442, "content_group": "f791358427d135e615492a46d3e64daf57c6c19444fc1fc1744275e46f4d06c6", "question": {"question_id": "sample_442_a380_q0", "video_id": 442, "video_path": "./videos/sample_442_real.mp4", "annotation_index": 380, "question_index": 0, "question": "What type of container is the person placing on the shelves?", "options": ["A. Blue and white yogurt containers.", "B. Small cardboard boxes.", "C. Large glass jars.", "D. Metal cans."], "answer": "A", "time_stamp_s": 18, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_442_a380_q0", "video_id": 442, "time_stamp_s": 18, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "24dd59255e1f464ca6efdcbaf54c5f7d7bd630972411f339f70fb8d77d192009", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "90a32cd8213b105522d2f22a0e38d9f134d62cfced019300fa9b62c36ea495a7", "num_recent_frames": 18, "tq": 717329.752429847, "t1": 717341.513751312, "ta": 717341.513751312, "te": 717341.556939178, "first_response_s": 11.761321465019137, "answer_total_s": 11.804509331006557, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_442_a380_q0", "video_id": 442, "time_stamp_s": 18, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0cb7d6d607b64c1caf0530396af7d18a5d133181d48de75f43593fda7af029b1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017], "recent_frames_sha256": "90a32cd8213b105522d2f22a0e38d9f134d62cfced019300fa9b62c36ea495a7", "num_recent_frames": 18, "tq": 717379.762198293, "t1": 717390.137101016, "ta": 717390.137101016, "te": 717390.439507261, "first_response_s": 10.374902723007835, "answer_total_s": 10.677308968035504, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 442, "content_group": "f791358427d135e615492a46d3e64daf57c6c19444fc1fc1744275e46f4d06c6", "question": {"question_id": "sample_442_a381_q0", "video_id": 442, "video_path": "./videos/sample_442_real.mp4", "annotation_index": 381, "question_index": 0, "question": "What label is visible on the boxes stacked on the floor in the storage room right now?", "options": ["A. ALPHA.", "B. CHARLIE.", "C. Valio and BRAVO.", "D. DELTA."], "answer": "C", "time_stamp_s": 259, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_442_a381_q0", "video_id": 442, "time_stamp_s": 259, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c7d090c7c55ca06998f6198cc592820e7d33249843fc1a37f6096a112383b598", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333], "recent_frames_sha256": "dd4148c38180a1bc3a263e5fe3b86eb619911b68693ba8f62710c544aa54bb7e", "num_recent_frames": 30, "tq": 717341.568967142, "t1": 717348.98387418, "ta": 717348.98387418, "te": 717349.021216312, "first_response_s": 7.414907037978992, "answer_total_s": 7.452249169931747, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_442_a381_q0", "video_id": 442, "time_stamp_s": 259, "ground_truth": "C", "raw_output": "C. Valio and BRAVO.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "08738575892022e0bd63c4c44db2864cfe5d351ccf1e85b6bd8a59c28b0a0ab8", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Shopping cart moves through aisles, carrying multiple containers of yogurt and other items.  \n- Shelves display various products, including yogurt, snacks, and packaged goods, with price tags visible.  \n- Refrigerated section contains orange-colored items, possibly juices or beverages, with a warning sign indicating \"DOOR CLOSED.\"\n[30-60s] - Hand reaches into a freezer to retrieve a container of yogurt, then places it on a cart.  \n- Cart is loaded with multiple yogurt containers and a box of cereal, positioned near a stack of eggs.  \n- Person moves toward a storage area with shelves holding various packaged goods and boxes, including a large cardboard box labeled \"EGG\".\n[60-90s] - Person picks up a container from a shelf, then places it on a cart.  \n- Cart is loaded with multiple containers and a box of items.  \n- Person moves to another shelf, selecting more containers and placing them on the cart.\n[90-120s] - Shopping cart contains multiple stacks of yogurt containers and water bottles, positioned near a refrigerated section displaying various yogurt brands with price tags.  \n- Refrigerated shelves hold neatly arranged yogurt cups, with visible price labels indicating \"15\" and \"10\" for different types.  \n- The cart is moved slightly forward, revealing more of the store's interior, including shelving units and a red display rack in the background.\n[120-150s] - Hand reaches for yogurt containers on a shelf, with price tags visible (e.g., \"15€\" and \"10€\").  \n- A cart filled with yogurt cups and other items is positioned near the shelf, suggesting restocking or shopping activity.  \n- The camera pans slightly, revealing more yogurt products and price signs on adjacent shelves.\n[150-180s] - A person's hand reaches for a yogurt container on a refrigerated shelf, with price tags visible below.  \n- The camera pans across the aisle, showing stacked boxes of paper towels and other grocery items on the floor.  \n- The shelf displays various yogurt brands with price labels, including \"Crème Fraîche\" and \"Palmé Fréjus,\" while the person continues to browse.\n[180-210s] - Person uses gloved hands to place a cardboard box with white bottles onto a shelf labeled \"VISPGRADE 29.95\".  \n- The box is positioned under a price tag marked \"18.95\" on the same shelf.  \n- The person then moves the box slightly to the right, aligning it with other items on the shelf.\n[210-240s] - A shopping cart holds a box of green vegetables and a tray of muffins, positioned near a cardboard box on the floor.  \n- The cart is pushed through a warehouse aisle lined with shelves stocked with packaged goods and refrigerated units.  \n- Boxes labeled \"NYPON SOPPA\" are visible on shelves, with price tags indicating $17 and $18, while other boxes are stacked on the floor.", "history_tokens": 654, "history_utf8_bytes": 2788, "recent_frame_times_s": [229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.01743333333334, 252.01843333333332, 253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333], "recent_frames_sha256": "dd4148c38180a1bc3a263e5fe3b86eb619911b68693ba8f62710c544aa54bb7e", "num_recent_frames": 30, "tq": 717446.725784024, "t1": 717447.391443616, "ta": 717447.391443616, "te": 717447.688744837, "first_response_s": 0.6656595920212567, "answer_total_s": 0.9629608129616827, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 442, "content_group": "f791358427d135e615492a46d3e64daf57c6c19444fc1fc1744275e46f4d06c6", "question": {"question_id": "sample_442_a382_q0", "video_id": 442, "video_path": "./videos/sample_442_real.mp4", "annotation_index": 382, "question_index": 0, "question": "What brand of juice cartons is the person handling?", "options": ["A. BRAVO.", "B. EXOTISK JUICE.", "C. TROPICANA.", "D. DELIGHT JUICE."], "answer": "A", "time_stamp_s": 782, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [780, 840], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_442_a382_q0", "video_id": 442, "time_stamp_s": 782, "ground_truth": "A", "raw_output": "A. BRAVO.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "b84c22d8138acdfe0f0b9c524291334d5924610b4ffabbf8bbc043b73a63010e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [752.0179333333333, 753.0189333333333, 754.0199333333334, 755.0209333333333, 756.0219333333333, 757.0229333333333, 758.0239333333334, 759.0249333333334, 760.0259333333333, 761.0269333333333, 762.0279333333333, 763.0289333333334, 764.0299333333334, 765.0309333333333, 766.0319333333333, 767.0329333333333, 768.0005666666667, 769.0015666666667, 770.0025666666667, 771.0035666666666, 772.0045666666666, 773.0055666666667, 774.0065666666667, 775.0075666666667, 776.0085666666666, 777.0095666666666, 778.0105666666667, 779.0115666666667, 780.0125666666667, 781.0135666666666], "recent_frames_sha256": "176160d699120dc014a576cfcd50a15c91972e1fac318cee16fb38d24c6b0c47", "num_recent_frames": 30, "tq": 717349.033157042, "t1": 717360.010048881, "ta": 717360.010048881, "te": 717360.199554292, "first_response_s": 10.976891839061864, "answer_total_s": 11.166397250024602, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_442_a382_q0", "video_id": 442, "time_stamp_s": 782, "ground_truth": "A", "raw_output": "A. BRAVO.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "d75a019a042ed9bc7cfdd58cd1d425cf1b4766b591b7edfd415e5dfc7b33afbf", "condition_order": ["recent", "notes"], "memory": "[420-450s] - Hand in black gloves picks up a yellow-packaged item from a refrigerated shelf.  \n- The hand moves toward a pile of cardboard boxes on the floor, which are labeled with \"BANANA\" and \"BANANA\" logos.  \n- The hand places the item into a cardboard box, which is part of a larger stack of similar boxes.\n[450-480s] - A person wearing black gloves is seen handling cardboard boxes near a refrigerated shelf stocked with yogurt products.  \n- The person moves boxes from a shelf to a pile on the floor, indicating restocking or inventory management.  \n- A large open cardboard box is visible on the floor, containing several smaller boxes, suggesting unloading or sorting activity.\n[480-510s] - A hand reaches into a cardboard box filled with white packages, likely product boxes, near a refrigerated shelf.  \n- The camera pans to show a refrigerated display unit stocked with various milk cartons and juice boxes, labeled with prices.  \n- The scene includes a large pile of cardboard boxes on the floor, some open and others stacked, suggesting a warehouse or storage area adjacent to the store shelves.\n[510-540s] - A gloved hand reaches into a refrigerated display, selecting a yellow-packaged product from among other items.  \n- Several cardboard boxes labeled \"BANAT\" are stacked on a pallet nearby, with one box partially open, revealing white items inside.  \n- The refrigerated shelf contains various beverages, including bottles and cartons, with price tags visible beneath them.\n[540-570s] - A person wearing black gloves picks up a white box from a pile of cardboard boxes labeled \"BRAYO\" on the floor.  \n- The person moves toward a refrigerated display case filled with \"YO YO\" yogurt products, which are arranged on shelves with price tags.  \n- The person reaches into the refrigerated case, appearing to select or adjust items on the shelf.\n[570-600s] - A hand reaches for a carton of \"MILD YOGHURT\" on a shelf, with price tag \"21.00\" visible below.  \n- The shelf holds multiple cartons of yogurt and milk, with labels showing nutritional info and branding.  \n- The camera pans slightly, revealing adjacent shelves stocked with similar dairy products and price tags.\n[600-630s] - Hand reaches for a carton on a shelf, then moves to a lower shelf, possibly selecting or adjusting items.  \n- Shelf labels indicate prices (e.g., \"21\" and \"24\"), suggesting a retail or warehouse setting with organized product placement.  \n- A large cardboard box is visible on the floor, indicating storage or unpacking activity in the area.\n[630-660s] - Worker uses orange tool to lift and move cardboard boxes labeled \"BRAYO\" on a conveyor belt.  \n- Refrigerated display shelves are stocked with various packaged goods, some labeled with prices like \"26\" and \"27\".  \n- Worker’s gloved hands interact with items on the shelf, possibly adjusting or retrieving products.\n[660-690s] - Person wearing black gloves places a cardboard box under a shelf stocked with juice cartons, then moves to another shelf.  \n- A metal shelving unit holds juice cartons with price tags (e.g., \"1.79\") and is adjacent to a pile of cardboard boxes.  \n- A green plastic bin and a metal cart with assorted goods are visible near a door in the background.\n[690-720s] - A hand reaches for a bottle of \"Bravo\" orange juice on a shelf, with price tags visible.  \n- A forklift is positioned near stacked cardboard boxes labeled \"Bravo\" on the floor.  \n- The shelf displays multiple bottles of orange juice, some with price tags indicating \"39.95\" and \"40.95\".\n[720-750s] - A person wearing black gloves picks up a yellow box from a shelf in a warehouse setting.  \n- The shelf contains multiple rows of yellow and red boxes, with price tags visible beneath each row.  \n- The person moves the box toward a pile of similar boxes on the floor, indicating a sorting or inventory activity.\n[750-780s] - A gloved hand reaches for a red box on a shelf, then moves to pick up a cardboard box from the floor.  \n- The shelf contains neatly stacked yellow and red boxes, with price tags visible beneath them.  \n- The floor is cluttered with multiple cardboard boxes, some labeled \"DANFO\" and others stacked near a metal shelving unit.", "history_tokens": 1009, "history_utf8_bytes": 4194, "recent_frame_times_s": [752.0179333333333, 753.0189333333333, 754.0199333333334, 755.0209333333333, 756.0219333333333, 757.0229333333333, 758.0239333333334, 759.0249333333334, 760.0259333333333, 761.0269333333333, 762.0279333333333, 763.0289333333334, 764.0299333333334, 765.0309333333333, 766.0319333333333, 767.0329333333333, 768.0005666666667, 769.0015666666667, 770.0025666666667, 771.0035666666666, 772.0045666666666, 773.0055666666667, 774.0065666666667, 775.0075666666667, 776.0085666666666, 777.0095666666666, 778.0105666666667, 779.0115666666667, 780.0125666666667, 781.0135666666666], "recent_frames_sha256": "176160d699120dc014a576cfcd50a15c91972e1fac318cee16fb38d24c6b0c47", "num_recent_frames": 30, "tq": 717575.653318387, "t1": 717581.526853067, "ta": 717581.526853067, "te": 717581.750640136, "first_response_s": 5.873534679994918, "answer_total_s": 6.097321748966351, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 442, "content_group": "f791358427d135e615492a46d3e64daf57c6c19444fc1fc1744275e46f4d06c6", "question": {"question_id": "sample_442_a382_q1", "video_id": 442, "video_path": "./videos/sample_442_real.mp4", "annotation_index": 382, "question_index": 1, "question": "What are the colors of the juice cartons being handled by the person?", "options": ["A. Green with white and yello detailing.", "B. Blue with yellow detailing.", "C. Red with white detailing.", "D. Pink with green detailing."], "answer": "A", "time_stamp_s": 794, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [780, 840], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_442_a382_q1", "video_id": 442, "time_stamp_s": 794, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b369350aaf43f26a19ab7eb1314c649dc0aa168bc79914c933423601a707d742", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [764.0299333333334, 765.0309333333333, 766.0319333333333, 767.0329333333333, 768.0005666666667, 769.0015666666667, 770.0025666666667, 771.0035666666666, 772.0045666666666, 773.0055666666667, 774.0065666666667, 775.0075666666667, 776.0085666666666, 777.0095666666666, 778.0105666666667, 779.0115666666667, 780.0125666666667, 781.0135666666666, 782.0145666666666, 783.0155666666667, 784.0165666666667, 785.0175666666667, 786.0185666666666, 787.0195666666667, 788.0205666666667, 789.0215666666667, 790.0225666666666, 791.0235666666666, 792.0245666666667, 793.0255666666667], "recent_frames_sha256": "a78d08bc930b68c13c3a07b12068ebd392093ade752d18ede115de63f1603b38", "num_recent_frames": 30, "tq": 717360.213233396, "t1": 717367.931180482, "ta": 717367.931180482, "te": 717367.971063581, "first_response_s": 7.717947086086497, "answer_total_s": 7.757830185000785, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_442_a382_q1", "video_id": 442, "time_stamp_s": 794, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c9de99ece8a9ff66dcdfd0ea2fe78453cbdf96b57a9b495a2e170436b2f4b638", "condition_order": ["recent", "notes"], "memory": "[420-450s] - Hand in black gloves picks up a yellow-packaged item from a refrigerated shelf.  \n- The hand moves toward a pile of cardboard boxes on the floor, which are labeled with \"BANANA\" and \"BANANA\" logos.  \n- The hand places the item into a cardboard box, which is part of a larger stack of similar boxes.\n[450-480s] - A person wearing black gloves is seen handling cardboard boxes near a refrigerated shelf stocked with yogurt products.  \n- The person moves boxes from a shelf to a pile on the floor, indicating restocking or inventory management.  \n- A large open cardboard box is visible on the floor, containing several smaller boxes, suggesting unloading or sorting activity.\n[480-510s] - A hand reaches into a cardboard box filled with white packages, likely product boxes, near a refrigerated shelf.  \n- The camera pans to show a refrigerated display unit stocked with various milk cartons and juice boxes, labeled with prices.  \n- The scene includes a large pile of cardboard boxes on the floor, some open and others stacked, suggesting a warehouse or storage area adjacent to the store shelves.\n[510-540s] - A gloved hand reaches into a refrigerated display, selecting a yellow-packaged product from among other items.  \n- Several cardboard boxes labeled \"BANAT\" are stacked on a pallet nearby, with one box partially open, revealing white items inside.  \n- The refrigerated shelf contains various beverages, including bottles and cartons, with price tags visible beneath them.\n[540-570s] - A person wearing black gloves picks up a white box from a pile of cardboard boxes labeled \"BRAYO\" on the floor.  \n- The person moves toward a refrigerated display case filled with \"YO YO\" yogurt products, which are arranged on shelves with price tags.  \n- The person reaches into the refrigerated case, appearing to select or adjust items on the shelf.\n[570-600s] - A hand reaches for a carton of \"MILD YOGHURT\" on a shelf, with price tag \"21.00\" visible below.  \n- The shelf holds multiple cartons of yogurt and milk, with labels showing nutritional info and branding.  \n- The camera pans slightly, revealing adjacent shelves stocked with similar dairy products and price tags.\n[600-630s] - Hand reaches for a carton on a shelf, then moves to a lower shelf, possibly selecting or adjusting items.  \n- Shelf labels indicate prices (e.g., \"21\" and \"24\"), suggesting a retail or warehouse setting with organized product placement.  \n- A large cardboard box is visible on the floor, indicating storage or unpacking activity in the area.\n[630-660s] - Worker uses orange tool to lift and move cardboard boxes labeled \"BRAYO\" on a conveyor belt.  \n- Refrigerated display shelves are stocked with various packaged goods, some labeled with prices like \"26\" and \"27\".  \n- Worker’s gloved hands interact with items on the shelf, possibly adjusting or retrieving products.\n[660-690s] - Person wearing black gloves places a cardboard box under a shelf stocked with juice cartons, then moves to another shelf.  \n- A metal shelving unit holds juice cartons with price tags (e.g., \"1.79\") and is adjacent to a pile of cardboard boxes.  \n- A green plastic bin and a metal cart with assorted goods are visible near a door in the background.\n[690-720s] - A hand reaches for a bottle of \"Bravo\" orange juice on a shelf, with price tags visible.  \n- A forklift is positioned near stacked cardboard boxes labeled \"Bravo\" on the floor.  \n- The shelf displays multiple bottles of orange juice, some with price tags indicating \"39.95\" and \"40.95\".\n[720-750s] - A person wearing black gloves picks up a yellow box from a shelf in a warehouse setting.  \n- The shelf contains multiple rows of yellow and red boxes, with price tags visible beneath each row.  \n- The person moves the box toward a pile of similar boxes on the floor, indicating a sorting or inventory activity.\n[750-780s] - A gloved hand reaches for a red box on a shelf, then moves to pick up a cardboard box from the floor.  \n- The shelf contains neatly stacked yellow and red boxes, with price tags visible beneath them.  \n- The floor is cluttered with multiple cardboard boxes, some labeled \"DANFO\" and others stacked near a metal shelving unit.", "history_tokens": 1009, "history_utf8_bytes": 4194, "recent_frame_times_s": [764.0299333333334, 765.0309333333333, 766.0319333333333, 767.0329333333333, 768.0005666666667, 769.0015666666667, 770.0025666666667, 771.0035666666666, 772.0045666666666, 773.0055666666667, 774.0065666666667, 775.0075666666667, 776.0085666666666, 777.0095666666666, 778.0105666666667, 779.0115666666667, 780.0125666666667, 781.0135666666666, 782.0145666666666, 783.0155666666667, 784.0165666666667, 785.0175666666667, 786.0185666666666, 787.0195666666667, 788.0205666666667, 789.0215666666667, 790.0225666666666, 791.0235666666666, 792.0245666666667, 793.0255666666667], "recent_frames_sha256": "a78d08bc930b68c13c3a07b12068ebd392093ade752d18ede115de63f1603b38", "num_recent_frames": 30, "tq": 717581.76958839, "t1": 717594.680506551, "ta": 717594.680506551, "te": 717594.718332707, "first_response_s": 12.910918161040172, "answer_total_s": 12.948744316934608, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 442, "content_group": "f791358427d135e615492a46d3e64daf57c6c19444fc1fc1744275e46f4d06c6", "question": {"question_id": "sample_442_a383_q0", "video_id": 442, "video_path": "./videos/sample_442_real.mp4", "annotation_index": 383, "question_index": 0, "question": "What color are the gloves seen in the scene?", "options": ["A. Black.", "B. Red.", "C. White.", "D. Blue."], "answer": "A", "time_stamp_s": 1005, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [960, 1010], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_442_a383_q0", "video_id": 442, "time_stamp_s": 1005, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4f4cfad3d7361fac4df4e4ed2ecbc005a715117434c6c4115f3bd112cd5c72f4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [975.0073666666667, 976.0083666666667, 977.0093666666667, 978.0103666666666, 979.0113666666666, 980.0123666666667, 981.0133666666667, 982.0143666666667, 983.0153666666666, 984.0163666666666, 985.0173666666667, 986.0183666666667, 987.0193666666667, 988.0203666666666, 989.0213666666667, 990.0223666666667, 991.0233666666667, 992.0243666666667, 993.0253666666666, 994.0263666666667, 995.0273666666667, 996.0283666666667, 997.0293666666666, 998.0303666666666, 999.0313666666667, 1000.0323666666667, 1001.0, 1002.001, 1003.002, 1004.003], "recent_frames_sha256": "7a5d1dd1a00f0543fa421ff67575a9855fdef31cac3a08d77f4844a02dd0da65", "num_recent_frames": 30, "tq": 717367.989021795, "t1": 717379.704790005, "ta": 717379.704790005, "te": 717379.74745209, "first_response_s": 11.715768210007809, "answer_total_s": 11.758430295041762, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_442_a383_q0", "video_id": 442, "time_stamp_s": 1005, "ground_truth": "A", "raw_output": "A. Black.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "33f64d7bae7c3b7efb1cef176bf3a65f83c9c607d56f7a40c7cfc75342cb41a9", "condition_order": ["recent", "notes"], "memory": "[630-660s] - Worker uses orange tool to lift and move cardboard boxes labeled \"BRAYO\" on a conveyor belt.  \n- Refrigerated display shelves are stocked with various packaged goods, some labeled with prices like \"26\" and \"27\".  \n- Worker’s gloved hands interact with items on the shelf, possibly adjusting or retrieving products.\n[660-690s] - Person wearing black gloves places a cardboard box under a shelf stocked with juice cartons, then moves to another shelf.  \n- A metal shelving unit holds juice cartons with price tags (e.g., \"1.79\") and is adjacent to a pile of cardboard boxes.  \n- A green plastic bin and a metal cart with assorted goods are visible near a door in the background.\n[690-720s] - A hand reaches for a bottle of \"Bravo\" orange juice on a shelf, with price tags visible.  \n- A forklift is positioned near stacked cardboard boxes labeled \"Bravo\" on the floor.  \n- The shelf displays multiple bottles of orange juice, some with price tags indicating \"39.95\" and \"40.95\".\n[720-750s] - A person wearing black gloves picks up a yellow box from a shelf in a warehouse setting.  \n- The shelf contains multiple rows of yellow and red boxes, with price tags visible beneath each row.  \n- The person moves the box toward a pile of similar boxes on the floor, indicating a sorting or inventory activity.\n[750-780s] - A gloved hand reaches for a red box on a shelf, then moves to pick up a cardboard box from the floor.  \n- The shelf contains neatly stacked yellow and red boxes, with price tags visible beneath them.  \n- The floor is cluttered with multiple cardboard boxes, some labeled \"DANFO\" and others stacked near a metal shelving unit.\n[780-810s] - A hand in a black glove picks up a green box labeled \"TROPISK\" from a lower shelf beneath red boxes.  \n- The green box is placed into a cardboard box on the floor, which already contains other items.  \n- The camera pans to show multiple cardboard boxes labeled \"DUNLOP\" stacked on the floor near a large stainless steel refrigerator.\n[810-840s] - Red and green product boxes are stacked on metal shelves, with price tags visible (e.g., \"28\" and \"25\").\n- A hand reaches into the frame to adjust or retrieve items from the shelf.\n- Cardboard boxes labeled \"BRAIO\" are scattered on the floor, some open and others stacked, near a doorway.\n[840-870s] - Person wearing black gloves places a cardboard box labeled \"BRAND\" onto a conveyor belt in a warehouse setting.  \n- A stack of yellow \"BRAVO\" juice boxes is visible on a shelf above, with a barcode scanner positioned nearby.  \n- The warehouse contains multiple cardboard boxes, pallets, and shelving units filled with various products.\n[870-900s] - Person wearing black gloves removes a yellow \"BONNIE\" box from a shelf labeled \"17.95\" and places it on a black mat.  \n- A cardboard box labeled \"DANONE\" is visible on the mat, near the person's hand.  \n- The shelf contains multiple rows of colorful juice boxes, with price tags indicating \"17\" and \"18\" for different brands.\n[900-930s] - A person wearing black gloves places a cardboard box labeled \"BRAVO\" onto a gray platform near a shelf stocked with yellow and red product boxes.  \n- The platform is positioned in front of a shelf with price tags indicating \"17\" and \"18\" for various items.  \n- The person then opens the box, revealing multiple yellow-packaged items inside, and proceeds to place them onto the shelf.\n[930-960s] - A shopping cart with green and white packaging is positioned near a red pallet of boxes, with a black dog lying nearby.  \n- Refrigerated units line the right side of the aisle, displaying various food items, while shelves with white boxes are visible on the left.  \n- The camera pans to show a hallway with multiple doors, including one with a lit window, and a red fire extinguisher mounted on the wall.\n[960-990s] - A shopping cart is positioned near stacked cardboard boxes and shelves stocked with goods.  \n- A large white refrigerated unit with a fan grille and metal trim is visible, showing signs of wear and dirt.  \n- The camera pans to reveal a doorway leading to another area with a forklift and more storage units.", "history_tokens": 1019, "history_utf8_bytes": 4127, "recent_frame_times_s": [975.0073666666667, 976.0083666666667, 977.0093666666667, 978.0103666666666, 979.0113666666666, 980.0123666666667, 981.0133666666667, 982.0143666666667, 983.0153666666666, 984.0163666666666, 985.0173666666667, 986.0183666666667, 987.0193666666667, 988.0203666666666, 989.0213666666667, 990.0223666666667, 991.0233666666667, 992.0243666666667, 993.0253666666666, 994.0263666666667, 995.0273666666667, 996.0283666666667, 997.0293666666666, 998.0303666666666, 999.0313666666667, 1000.0323666666667, 1001.0, 1002.001, 1003.002, 1004.003], "recent_frames_sha256": "7a5d1dd1a00f0543fa421ff67575a9855fdef31cac3a08d77f4844a02dd0da65", "num_recent_frames": 30, "tq": 717656.0484344, "t1": 717662.562054957, "ta": 717662.562054957, "te": 717662.718191985, "first_response_s": 6.513620557030663, "answer_total_s": 6.669757585041225, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 443, "content_group": "67935fdf2f269aa4d69dd5375cc8c922a51f057922cd740c30aa521cd5d7fda3", "question": {"question_id": "sample_443_a38_q0", "video_id": 443, "video_path": "./videos/sample_443_real.mp4", "annotation_index": 38, "question_index": 0, "question": "What is the gloved hand reaching towards at the beginning of the video?", "options": ["A. Yogurt containers.", "B. Milk cartons.", "C. Juice bottles.", "D. Cheese blocks."], "answer": "A", "time_stamp_s": 1, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_443_a38_q0", "video_id": 443, "time_stamp_s": 1, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "81b1a47b797d35b54cb4ef2fbc7f34b20ccdc67b65a3ee8bcaeb1bce7993c591", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0], "recent_frames_sha256": "e77b0154020d1e6995e3dc3dd761d14733528f190e5f3dc4de179eff564abe4b", "num_recent_frames": 1, "tq": 718977.869131904, "t1": 718985.259925696, "ta": 718985.259925696, "te": 718985.298165679, "first_response_s": 7.390793791972101, "answer_total_s": 7.42903377499897, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_443_a38_q0", "video_id": 443, "time_stamp_s": 1, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "da6741db016d1a5373eb6e82b93ee2c787cac17e40a80920f6557432c61f6419", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0], "recent_frames_sha256": "e77b0154020d1e6995e3dc3dd761d14733528f190e5f3dc4de179eff564abe4b", "num_recent_frames": 1, "tq": 719034.579172144, "t1": 719045.821756909, "ta": 719045.821756909, "te": 719045.860518555, "first_response_s": 11.242584765073843, "answer_total_s": 11.281346411095, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 443, "content_group": "67935fdf2f269aa4d69dd5375cc8c922a51f057922cd740c30aa521cd5d7fda3", "question": {"question_id": "sample_443_a38_q1", "video_id": 443, "video_path": "./videos/sample_443_real.mp4", "annotation_index": 38, "question_index": 1, "question": "What color is the packaging of the yogurt containers?", "options": ["A. Red and white.", "B. Blue and white.", "C. Green and white.", "D. Yellow and white."], "answer": "B", "time_stamp_s": 10, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_443_a38_q1", "video_id": 443, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0994efaa661bb18a80e24e726079665f83060035c1094e9c645bf955b689f7fa", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "24b3d89706dbfe8caf8aeb73bd9235f59d06ce693ec797b8f22c37b66da68bbc", "num_recent_frames": 10, "tq": 718985.314175004, "t1": 718998.327208059, "ta": 718998.327208059, "te": 718998.365394765, "first_response_s": 13.01303305500187, "answer_total_s": 13.051219761022367, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_443_a38_q1", "video_id": 443, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e6931e9db56185418e16c522b98d8ff453d0172245eece5609f06dba51d6ade2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009], "recent_frames_sha256": "24b3d89706dbfe8caf8aeb73bd9235f59d06ce693ec797b8f22c37b66da68bbc", "num_recent_frames": 10, "tq": 719045.873615844, "t1": 719088.45020565, "ta": 719088.45020565, "te": 719088.675114509, "first_response_s": 42.57658980600536, "answer_total_s": 42.801498665008694, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 443, "content_group": "67935fdf2f269aa4d69dd5375cc8c922a51f057922cd740c30aa521cd5d7fda3", "question": {"question_id": "sample_443_a39_q0", "video_id": 443, "video_path": "./videos/sample_443_real.mp4", "annotation_index": 39, "question_index": 0, "question": "What does the individual do after picking up the yogurt container?", "options": ["A. Opens it.", "B. Discards it.", "C. Hands it to someone else.", "D. pick it up on the shelf."], "answer": "D", "time_stamp_s": 145, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_443_a39_q0", "video_id": 443, "time_stamp_s": 145, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "17659a6da6966876a858bef90d37cef4af8dd5b10632a7fcc569fb5687121471", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334], "recent_frames_sha256": "bf1ec7cd96e6a16f71a419b471025c43a35ab70f3fd2c48472a5614990038c82", "num_recent_frames": 30, "tq": 718998.388385184, "t1": 719006.390497056, "ta": 719006.390497056, "te": 719006.428503736, "first_response_s": 8.002111871959642, "answer_total_s": 8.040118552045897, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_443_a39_q0", "video_id": 443, "time_stamp_s": 145, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9b1cc6391bc11ebbffffb859bb4390fbd6f63bb1573899fdddf978e734946cf5", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Gloved hands systematically place blue-labeled containers onto a rotating white tray beneath a metal shelf.  \n- The tray, marked with price tags (e.g., \"14\" and \"15\"), holds multiple containers as it rotates, suggesting a packaging or sorting operation.  \n- The environment features stacked shelves with various products and cardboard boxes, indicating a warehouse or distribution center setting.\n[30-60s] - Gloved hand picks up yogurt containers from a rotating tray, moving them to a cardboard box.  \n- Containers are stacked in rows on white trays, with price tags visible (e.g., \"14\" and \"15\").  \n- Background shows shelves stocked with similar yogurt containers and a large cardboard box labeled \"BIOVIA\".\n[60-90s] - Hand in black glove places yogurt containers onto a white tray with circular cutouts.  \n- Shelves stocked with stacked yogurt containers labeled \"YOGURT\" and \"14\" price tag visible.  \n- Camera pans across shelves, showing multiple rows of yogurt containers and cardboard boxes.\n[90-120s] - A gloved hand reaches for and removes a container from a refrigerated shelf.  \n- The shelf holds multiple stacked containers of yogurt with blue and white labels.  \n- Cardboard boxes with circular cutouts are visible below the shelf, likely for packaging or storage.", "history_tokens": 292, "history_utf8_bytes": 1288, "recent_frame_times_s": [115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333, 143.00953333333334, 144.01053333333334], "recent_frames_sha256": "bf1ec7cd96e6a16f71a419b471025c43a35ab70f3fd2c48472a5614990038c82", "num_recent_frames": 30, "tq": 719116.628697026, "t1": 719123.640863854, "ta": 719123.640863854, "te": 719123.682525952, "first_response_s": 7.012166827917099, "answer_total_s": 7.053828925942071, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 443, "content_group": "67935fdf2f269aa4d69dd5375cc8c922a51f057922cd740c30aa521cd5d7fda3", "question": {"question_id": "sample_443_a40_q0", "video_id": 443, "video_path": "./videos/sample_443_real.mp4", "annotation_index": 40, "question_index": 0, "question": "What does the individual do after picking up the large cardboard box?", "options": ["A. Places it back on the shelf.", "B. Moves it to another room.", "C. Examines it and sets it aside.", "D. Take out the orange juice inside and put it on the shelf."], "answer": "D", "time_stamp_s": 300, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_443_a40_q0", "video_id": 443, "time_stamp_s": 300, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e4953445e937b0e5755a0ba0142f8bb5f3eb4809c0f981318c5f1ae45e7b1106", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665], "recent_frames_sha256": "cd93d82ef30426e60f33cd08b20c4dc9187f5e5b65674bd008589a682740dc5a", "num_recent_frames": 30, "tq": 719006.442314653, "t1": 719019.316975786, "ta": 719019.316975786, "te": 719019.355246354, "first_response_s": 12.874661133042537, "answer_total_s": 12.912931701052003, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_443_a40_q0", "video_id": 443, "time_stamp_s": 300, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "51c93776b36bd993f6d4590dc3de5fad0392cdc5d6e0a7233f0bf554dde4f91c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Gloved hands systematically place blue-labeled containers onto a rotating white tray beneath a metal shelf.  \n- The tray, marked with price tags (e.g., \"14\" and \"15\"), holds multiple containers as it rotates, suggesting a packaging or sorting operation.  \n- The environment features stacked shelves with various products and cardboard boxes, indicating a warehouse or distribution center setting.\n[30-60s] - Gloved hand picks up yogurt containers from a rotating tray, moving them to a cardboard box.  \n- Containers are stacked in rows on white trays, with price tags visible (e.g., \"14\" and \"15\").  \n- Background shows shelves stocked with similar yogurt containers and a large cardboard box labeled \"BIOVIA\".\n[60-90s] - Hand in black glove places yogurt containers onto a white tray with circular cutouts.  \n- Shelves stocked with stacked yogurt containers labeled \"YOGURT\" and \"14\" price tag visible.  \n- Camera pans across shelves, showing multiple rows of yogurt containers and cardboard boxes.\n[90-120s] - A gloved hand reaches for and removes a container from a refrigerated shelf.  \n- The shelf holds multiple stacked containers of yogurt with blue and white labels.  \n- Cardboard boxes with circular cutouts are visible below the shelf, likely for packaging or storage.\n[120-150s] - Gloved hand picks up a container from a metal shelf, then places it onto a cardboard box below.  \n- Multiple containers are stacked on the shelf, with price tags visible beneath them.  \n- The camera pans slightly to show more containers on the shelf and the cardboard box accumulating items.\n[150-180s] - A gloved hand places a white tray with circular cutouts onto a shelf in a refrigerated section.  \n- The tray holds multiple containers of \"Crème Fraîche\" with blue and white labels, positioned near other dairy products.  \n- The camera pans to show shelves stocked with various packaged goods, including boxes labeled \"Stora\" and \"Vola,\" behind the tray.\n[180-210s] - Gloved hands place yellow-packaged items onto a shelf in a refrigerated storage area.  \n- A blue vertical line appears on screen, possibly indicating a visual guide or measurement.  \n- The scene transitions to a wider view of a storage room with stacked cardboard boxes labeled \"DAY\" and \"BRANDS\".\n[210-240s] - Gloved hands open a cardboard box revealing yellow product packages.  \n- The box is then placed on a shelf alongside other similar boxes, with price tags visible above.  \n- A metal cart with green and yellow items is positioned near a door in the background.\n[240-270s] - Gloved hands open a cardboard box labeled \"BRAVO\" to reveal yellow-packaged items inside.  \n- The person moves the opened box toward a refrigerated shelf, positioning it for storage.  \n- Multiple similar boxes are stacked nearby, some already opened, indicating ongoing inventory handling.\n[270-300s] - Gloved hands open a cardboard box labeled \"BRAVO\" containing yellow cartons, then place them on a shelf.  \n- A large refrigerated unit with a \"17\" label is visible in the background, alongside other stacked boxes.  \n- The worker moves to another area, revealing more boxes and a cart with green crates, indicating ongoing inventory handling.", "history_tokens": 741, "history_utf8_bytes": 3203, "recent_frame_times_s": [270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666, 283.0160666666667, 284.01706666666666, 285.01806666666664, 286.0190666666667, 287.02006666666665, 288.0210666666667, 289.02206666666666, 290.0230666666667, 291.02406666666667, 292.02506666666665, 293.0260666666667, 294.02706666666666, 295.0280666666667, 296.02906666666667, 297.03006666666664, 298.0310666666667, 299.03206666666665], "recent_frames_sha256": "cd93d82ef30426e60f33cd08b20c4dc9187f5e5b65674bd008589a682740dc5a", "num_recent_frames": 30, "tq": 719176.252359874, "t1": 719178.228163334, "ta": 719178.228163334, "te": 719178.267583976, "first_response_s": 1.975803459994495, "answer_total_s": 2.0152241020696238, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 443, "content_group": "67935fdf2f269aa4d69dd5375cc8c922a51f057922cd740c30aa521cd5d7fda3", "question": {"question_id": "sample_443_a41_q0", "video_id": 443, "video_path": "./videos/sample_443_real.mp4", "annotation_index": 41, "question_index": 0, "question": "What is the scene focusing on in the store right now?", "options": ["A. The checkout counter.", "B. A different set of shelves with beverages.", "C. The entrance of the store.", "D. A display of snacks."], "answer": "B", "time_stamp_s": 439, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_443_a41_q0", "video_id": 443, "time_stamp_s": 439, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b4cc6b05881c87186c5b5a39dc889eb5104790e119934ddaaf534fdc46f858f0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256, 427.0266, 428.0276, 429.0286, 430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333], "recent_frames_sha256": "6b62fc90322a8c5e7024f86950370429393155f407eef0dcf544d00f8c28e414", "num_recent_frames": 30, "tq": 719019.366135753, "t1": 719034.532677797, "ta": 719034.532677797, "te": 719034.569701575, "first_response_s": 15.166542044025846, "answer_total_s": 15.20356582198292, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_443_a41_q0", "video_id": 443, "time_stamp_s": 439, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4f550aa3a89496d16fd80ea635d33add98ab7ed65b0230e1080b1f8340814b72", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Gloved hand picks up yogurt containers from a rotating tray, moving them to a cardboard box.  \n- Containers are stacked in rows on white trays, with price tags visible (e.g., \"14\" and \"15\").  \n- Background shows shelves stocked with similar yogurt containers and a large cardboard box labeled \"BIOVIA\".\n[60-90s] - Hand in black glove places yogurt containers onto a white tray with circular cutouts.  \n- Shelves stocked with stacked yogurt containers labeled \"YOGURT\" and \"14\" price tag visible.  \n- Camera pans across shelves, showing multiple rows of yogurt containers and cardboard boxes.\n[90-120s] - A gloved hand reaches for and removes a container from a refrigerated shelf.  \n- The shelf holds multiple stacked containers of yogurt with blue and white labels.  \n- Cardboard boxes with circular cutouts are visible below the shelf, likely for packaging or storage.\n[120-150s] - Gloved hand picks up a container from a metal shelf, then places it onto a cardboard box below.  \n- Multiple containers are stacked on the shelf, with price tags visible beneath them.  \n- The camera pans slightly to show more containers on the shelf and the cardboard box accumulating items.\n[150-180s] - A gloved hand places a white tray with circular cutouts onto a shelf in a refrigerated section.  \n- The tray holds multiple containers of \"Crème Fraîche\" with blue and white labels, positioned near other dairy products.  \n- The camera pans to show shelves stocked with various packaged goods, including boxes labeled \"Stora\" and \"Vola,\" behind the tray.\n[180-210s] - Gloved hands place yellow-packaged items onto a shelf in a refrigerated storage area.  \n- A blue vertical line appears on screen, possibly indicating a visual guide or measurement.  \n- The scene transitions to a wider view of a storage room with stacked cardboard boxes labeled \"DAY\" and \"BRANDS\".\n[210-240s] - Gloved hands open a cardboard box revealing yellow product packages.  \n- The box is then placed on a shelf alongside other similar boxes, with price tags visible above.  \n- A metal cart with green and yellow items is positioned near a door in the background.\n[240-270s] - Gloved hands open a cardboard box labeled \"BRAVO\" to reveal yellow-packaged items inside.  \n- The person moves the opened box toward a refrigerated shelf, positioning it for storage.  \n- Multiple similar boxes are stacked nearby, some already opened, indicating ongoing inventory handling.\n[270-300s] - Gloved hands open a cardboard box labeled \"BRAVO\" containing yellow cartons, then place them on a shelf.  \n- A large refrigerated unit with a \"17\" label is visible in the background, alongside other stacked boxes.  \n- The worker moves to another area, revealing more boxes and a cart with green crates, indicating ongoing inventory handling.\n[300-330s] - Gloved hand removes a yellow \"TROPISK\" juice carton from a shelf, placing it into a cardboard box.  \n- The box is labeled \"BRAND\" and is positioned on the floor near other stacked boxes.  \n- Background shows a warehouse-like setting with shelves stocked with various products and a shopping cart nearby.\n[330-360s] - Gloved hand opens a cardboard box, revealing packaged goods inside.  \n- Yellow boxes labeled \"BRAVO\" are stacked on shelves in the background.  \n- A green shopping cart with items is positioned near stacked boxes and shelves.\n[360-390s] - Gloved hands move a large cardboard box labeled \"BRAVO\" across a warehouse floor, passing by stacked boxes and shelves.  \n- A person in black gloves picks up a yellow \"BRAVO\" box from a shelf, then places it into a cardboard box on the floor.  \n- The camera pans to show a refrigerated section with red and green boxes, as the person continues to handle boxes near the shelves.\n[390-420s] - A hand in a black glove picks up a red and yellow juice box from a shelf.  \n- The shelf contains multiple juice boxes, some in red and yellow packaging, others in green.  \n- The camera pans to show a room with cardboard boxes and shelves stocked with more juice boxes.", "history_tokens": 957, "history_utf8_bytes": 4025, "recent_frame_times_s": [409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256, 427.0266, 428.0276, 429.0286, 430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333], "recent_frames_sha256": "6b62fc90322a8c5e7024f86950370429393155f407eef0dcf544d00f8c28e414", "num_recent_frames": 30, "tq": 719213.768551482, "t1": 719218.919252544, "ta": 719218.919252544, "te": 719218.956553429, "first_response_s": 5.150701061938889, "answer_total_s": 5.188001947011799, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 444, "content_group": "8db3084e606ea90e59710799a3322a01ea2fa218b0ea6138684c99620b92ad1c", "question": {"question_id": "sample_444_a206_q0", "video_id": 444, "video_path": "./videos/sample_444_real.mp4", "annotation_index": 206, "question_index": 0, "question": "What might the person do next after revealing more cartons in the box?", "options": ["A. Leave the store.", "B. Start arranging the new cartons on the shelf.", "C. Throw away the cartons.", "D. Close the refrigerated display."], "answer": "B", "time_stamp_s": 19, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_444_a206_q0", "video_id": 444, "time_stamp_s": 19, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "729b57e19c3a5a648ac63589b9cb363120e2d5f49c557bb14af113048fbd9ba0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018], "recent_frames_sha256": "53a2e01ac30f5e97068418762a12432bc37b98e6a83c72a90bd06a84f8172ba8", "num_recent_frames": 19, "tq": 717485.661068372, "t1": 717497.701208367, "ta": 717497.701208367, "te": 717498.087500015, "first_response_s": 12.040139995049685, "answer_total_s": 12.426431643078104, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_444_a206_q0", "video_id": 444, "time_stamp_s": 19, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "25747bd9145e918d8323698b25455e575f2fd90a1b1ad8f897682781b2a5bad1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018], "recent_frames_sha256": "53a2e01ac30f5e97068418762a12432bc37b98e6a83c72a90bd06a84f8172ba8", "num_recent_frames": 19, "tq": 717534.664573644, "t1": 717535.663921658, "ta": 717535.663921658, "te": 717536.035921768, "first_response_s": 0.9993480138946325, "answer_total_s": 1.3713481239974499, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 444, "content_group": "8db3084e606ea90e59710799a3322a01ea2fa218b0ea6138684c99620b92ad1c", "question": {"question_id": "sample_444_a207_q0", "video_id": 444, "video_path": "./videos/sample_444_real.mp4", "annotation_index": 207, "question_index": 0, "question": "What is being placed on the refrigerated shelf right now?", "options": ["A. Cartons of milk.", "B. Bottles of water.", "C. Packs of juice.", "D. Bags of vegetables."], "answer": "A", "time_stamp_s": 143, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_444_a207_q0", "video_id": 444, "time_stamp_s": 143, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bf0aa0b1d9b196bd9b7f9058a2876b98030d888ae2f9f1d0520f83e79bf6d2e8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333], "recent_frames_sha256": "e042e7d6e4791981f3d96ded80134db71d5def13666332738833dd93aa057431", "num_recent_frames": 30, "tq": 717498.103515906, "t1": 717510.121384572, "ta": 717510.121384572, "te": 717510.159766039, "first_response_s": 12.017868665978312, "answer_total_s": 12.05625013296958, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_444_a207_q0", "video_id": 444, "time_stamp_s": 143, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7a42b765f097ec6d3339986e190c5d1750db99e1b3772f12cc1995bf3cf537dd", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person wearing black gloves picks up packaged snacks from a refrigerated display unit.  \n- Several cardboard boxes and loose snack packages are scattered on the tiled floor near the display.  \n- The camera pans to show a red vacuum cleaner and more boxes on the floor, indicating a cleaning or restocking activity.\n[30-60s] - Hands in black gloves arrange packaged goods on a refrigerated shelf, moving items into position.  \n- The camera pans to reveal a cluttered floor area with cardboard boxes and a red shopping cart nearby.  \n- A second refrigerated display case is visible to the right, containing other packaged items.\n[60-90s] - A person wearing black gloves is actively sorting through cardboard boxes on a conveyor belt.  \n- The conveyor belt moves boxes toward a refrigerated section displaying packaged goods.  \n- Boxes are being rearranged and pushed along the belt, with some items spilling out onto the floor.\n[90-120s] - A person wearing black gloves is seen handling cardboard boxes near a refrigerated display case.  \n- The display case contains neatly arranged packaged goods on one side and scattered boxes on the other.  \n- A red hydraulic jack is visible nearby, suggesting equipment for moving heavy items.", "history_tokens": 264, "history_utf8_bytes": 1240, "recent_frame_times_s": [113.0129, 114.0139, 115.0149, 116.0159, 117.0169, 118.0179, 119.0189, 120.0199, 121.0209, 122.0219, 123.0229, 124.0239, 125.0249, 126.0259, 127.0269, 128.0279, 129.0289, 130.0299, 131.0309, 132.0319, 133.0329, 134.00053333333332, 135.00153333333333, 136.00253333333333, 137.00353333333334, 138.00453333333334, 139.00553333333335, 140.00653333333332, 141.00753333333333, 142.00853333333333], "recent_frames_sha256": "e042e7d6e4791981f3d96ded80134db71d5def13666332738833dd93aa057431", "num_recent_frames": 30, "tq": 717567.793092144, "t1": 717569.784123111, "ta": 717569.784123111, "te": 717570.087898941, "first_response_s": 1.9910309670958668, "answer_total_s": 2.29480679705739, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 444, "content_group": "8db3084e606ea90e59710799a3322a01ea2fa218b0ea6138684c99620b92ad1c", "question": {"question_id": "sample_444_a208_q0", "video_id": 444, "video_path": "./videos/sample_444_real.mp4", "annotation_index": 208, "question_index": 0, "question": "Where is the cardboard box placed after the person removes items from it?", "options": ["A. On the top shelf.", "B. On the floor.", "C. On the bottom shelf.", "D. On the cart."], "answer": "A", "time_stamp_s": 283, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_444_a208_q0", "video_id": 444, "time_stamp_s": 283, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "79a2fd6a05fbcf033874b598743ad744140d8d686b538d52c69c7a5970118de0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666], "recent_frames_sha256": "f85a113925f9e29a6ae3a542ee63b7b61989ad0ff20f897f0b9b7a231af1a2db", "num_recent_frames": 30, "tq": 717510.177067096, "t1": 717517.395550555, "ta": 717517.395550555, "te": 717517.432739802, "first_response_s": 7.218483458971605, "answer_total_s": 7.255672706058249, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_444_a208_q0", "video_id": 444, "time_stamp_s": 283, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1c8d3c2b939c55d3da1cc9f20399fd8d4799bee93b7686cca312a47b534234c1", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person wearing black gloves picks up packaged snacks from a refrigerated display unit.  \n- Several cardboard boxes and loose snack packages are scattered on the tiled floor near the display.  \n- The camera pans to show a red vacuum cleaner and more boxes on the floor, indicating a cleaning or restocking activity.\n[30-60s] - Hands in black gloves arrange packaged goods on a refrigerated shelf, moving items into position.  \n- The camera pans to reveal a cluttered floor area with cardboard boxes and a red shopping cart nearby.  \n- A second refrigerated display case is visible to the right, containing other packaged items.\n[60-90s] - A person wearing black gloves is actively sorting through cardboard boxes on a conveyor belt.  \n- The conveyor belt moves boxes toward a refrigerated section displaying packaged goods.  \n- Boxes are being rearranged and pushed along the belt, with some items spilling out onto the floor.\n[90-120s] - A person wearing black gloves is seen handling cardboard boxes near a refrigerated display case.  \n- The display case contains neatly arranged packaged goods on one side and scattered boxes on the other.  \n- A red hydraulic jack is visible nearby, suggesting equipment for moving heavy items.\n[120-150s] - Worker's gloved hands move packages of snacks from a conveyor belt to a refrigerated display shelf.  \n- Cardboard boxes are stacked on the floor near the conveyor, with some showing product labels.  \n- The refrigerated shelf has a white interior, with some scattered crumbs or debris visible.\n[150-180s] - A person in black gloves handles cardboard boxes near a refrigerated display case.  \n- The display case contains neatly arranged packaged goods, including blue and white items.  \n- Cardboard boxes are piled on the floor, some partially covering the display case’s base.\n[180-210s] - Person wearing black gloves moves cardboard boxes around a refrigerated display case.  \n- Refrigerated case contains stacks of packaged goods, some in blue and white wrappers.  \n- Cardboard boxes are piled on the floor near the case, with some partially open or stacked.\n[210-240s] - Person wearing black gloves and dark clothing is actively sorting and moving cardboard boxes on a tiled floor near a refrigerated display case.  \n- A pile of aluminum-wrapped items (possibly frozen goods) is visible beside the cardboard boxes, suggesting a cleanup or restocking activity.  \n- The refrigerated display case contains neatly arranged packaged goods, contrasting with the disorganized cardboard boxes on the floor.\n[240-270s] - A person in black gloves is actively sorting through a pile of cardboard boxes on a tiled floor near a refrigerated display case.  \n- The refrigerated case contains neatly arranged packages of cheese and other dairy products, with some boxes stacked on the floor beside it.  \n- A red-handled hand truck is positioned nearby, suggesting it may be used to move the cardboard boxes or other items.", "history_tokens": 639, "history_utf8_bytes": 2964, "recent_frame_times_s": [253.01943333333332, 254.02043333333333, 255.02143333333333, 256.0224333333333, 257.02343333333334, 258.0244333333333, 259.02543333333335, 260.02643333333333, 261.0274333333333, 262.02843333333334, 263.0294333333333, 264.03043333333335, 265.0314333333333, 266.03243333333336, 267.00006666666667, 268.00106666666665, 269.0020666666667, 270.00306666666665, 271.0040666666667, 272.00506666666666, 273.00606666666664, 274.0070666666667, 275.00806666666665, 276.0090666666667, 277.01006666666666, 278.0110666666667, 279.01206666666667, 280.01306666666665, 281.0140666666667, 282.01506666666666], "recent_frames_sha256": "f85a113925f9e29a6ae3a542ee63b7b61989ad0ff20f897f0b9b7a231af1a2db", "num_recent_frames": 30, "tq": 717617.645383143, "t1": 717624.641626341, "ta": 717624.641626341, "te": 717624.946489342, "first_response_s": 6.99624319805298, "answer_total_s": 7.301106199040078, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 444, "content_group": "8db3084e606ea90e59710799a3322a01ea2fa218b0ea6138684c99620b92ad1c", "question": {"question_id": "sample_444_a209_q1", "video_id": 444, "video_path": "./videos/sample_444_real.mp4", "annotation_index": 209, "question_index": 1, "question": "Where are the folded cardboard trays located in relation to the camera's view right now?", "options": ["A. To the left of the camera.", "B. To the right of the camera.", "C. Directly in front of the camera.", "D. Behind the camera."], "answer": "B", "time_stamp_s": 416, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_444_a209_q1", "video_id": 444, "time_stamp_s": 416, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e02ff97e6684d7537d29531dfec2ffeb67f4e3e6ecb4862791cb3743c8e133d2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665, 394.0269666666667, 395.02796666666666, 396.0289666666667, 397.02996666666667, 398.03096666666664, 399.0319666666667, 400.03296666666665, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146], "recent_frames_sha256": "f4776e2ba69c9af8f7bac9b11d0e816be0cb90746b696735cef097ddf8aa0c55", "num_recent_frames": 30, "tq": 717517.451952008, "t1": 717524.440213429, "ta": 717524.440213429, "te": 717524.4775471, "first_response_s": 6.9882614210946485, "answer_total_s": 7.025595092098229, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_444_a209_q1", "video_id": 444, "time_stamp_s": 416, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0c66988f494a1117de58760f84544f752b348d226156f6694066d2c84217795e", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person wearing black gloves picks up packaged snacks from a refrigerated display unit.  \n- Several cardboard boxes and loose snack packages are scattered on the tiled floor near the display.  \n- The camera pans to show a red vacuum cleaner and more boxes on the floor, indicating a cleaning or restocking activity.\n[30-60s] - Hands in black gloves arrange packaged goods on a refrigerated shelf, moving items into position.  \n- The camera pans to reveal a cluttered floor area with cardboard boxes and a red shopping cart nearby.  \n- A second refrigerated display case is visible to the right, containing other packaged items.\n[60-90s] - A person wearing black gloves is actively sorting through cardboard boxes on a conveyor belt.  \n- The conveyor belt moves boxes toward a refrigerated section displaying packaged goods.  \n- Boxes are being rearranged and pushed along the belt, with some items spilling out onto the floor.\n[90-120s] - A person wearing black gloves is seen handling cardboard boxes near a refrigerated display case.  \n- The display case contains neatly arranged packaged goods on one side and scattered boxes on the other.  \n- A red hydraulic jack is visible nearby, suggesting equipment for moving heavy items.\n[120-150s] - Worker's gloved hands move packages of snacks from a conveyor belt to a refrigerated display shelf.  \n- Cardboard boxes are stacked on the floor near the conveyor, with some showing product labels.  \n- The refrigerated shelf has a white interior, with some scattered crumbs or debris visible.\n[150-180s] - A person in black gloves handles cardboard boxes near a refrigerated display case.  \n- The display case contains neatly arranged packaged goods, including blue and white items.  \n- Cardboard boxes are piled on the floor, some partially covering the display case’s base.\n[180-210s] - Person wearing black gloves moves cardboard boxes around a refrigerated display case.  \n- Refrigerated case contains stacks of packaged goods, some in blue and white wrappers.  \n- Cardboard boxes are piled on the floor near the case, with some partially open or stacked.\n[210-240s] - Person wearing black gloves and dark clothing is actively sorting and moving cardboard boxes on a tiled floor near a refrigerated display case.  \n- A pile of aluminum-wrapped items (possibly frozen goods) is visible beside the cardboard boxes, suggesting a cleanup or restocking activity.  \n- The refrigerated display case contains neatly arranged packaged goods, contrasting with the disorganized cardboard boxes on the floor.\n[240-270s] - A person in black gloves is actively sorting through a pile of cardboard boxes on a tiled floor near a refrigerated display case.  \n- The refrigerated case contains neatly arranged packages of cheese and other dairy products, with some boxes stacked on the floor beside it.  \n- A red-handled hand truck is positioned nearby, suggesting it may be used to move the cardboard boxes or other items.\n[270-300s] - Person wearing black gloves arranges white-capped containers in a cardboard box on a tiled floor.  \n- Refrigerated display cases hold various packaged dairy products, including orange and blue-wrapped items.  \n- A stack of brown cardboard boxes with white-capped containers is positioned near the display case.\n[300-330s] - Person pushes cart with multiple cardboard boxes of yogurt past refrigerated display cases.  \n- Boxes contain various colored yogurt cups, some stacked in rows, others partially unpacked.  \n- Refrigerated cases display assorted dairy products, including cheese and other chilled items, with price tags visible.\n[330-360s] - A person in black clothing pushes a cart loaded with numerous small, colorful cups across a tiled floor.  \n- The cart moves past a refrigerated display case filled with assorted packaged dairy products, including cheese and yogurt.  \n- The cart’s contents are arranged in rows, with some cups in cardboard boxes, and the person navigates carefully around the display.\n[360-390s] - Shopping cart filled with multiple cardboard boxes of yogurt, positioned near a refrigerated display case.  \n- Refrigerated case contains various yogurt containers and other chilled items, with cardboard boxes partially blocking some sections.  \n- Person’s gloved hand is visible near the cart, suggesting active selection or adjustment of items.", "history_tokens": 930, "history_utf8_bytes": 4357, "recent_frame_times_s": [386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665, 394.0269666666667, 395.02796666666666, 396.0289666666667, 397.02996666666667, 398.03096666666664, 399.0319666666667, 400.03296666666665, 401.0006, 402.0016, 403.0026, 404.0036, 405.0046, 406.0056, 407.0066, 408.0076, 409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146], "recent_frames_sha256": "f4776e2ba69c9af8f7bac9b11d0e816be0cb90746b696735cef097ddf8aa0c55", "num_recent_frames": 30, "tq": 717656.062928654, "t1": 717662.562054957, "ta": 717662.562054957, "te": 717662.718191985, "first_response_s": 6.499126303009689, "answer_total_s": 6.655263331020251, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 444, "content_group": "8db3084e606ea90e59710799a3322a01ea2fa218b0ea6138684c99620b92ad1c", "question": {"question_id": "sample_444_a209_q0", "video_id": 444, "video_path": "./videos/sample_444_real.mp4", "annotation_index": 209, "question_index": 0, "question": "What main activity was carried out just now?", "options": ["A. Move the drinks from the cart to the refrigerated shelf.", "B. Cleaning the store aisles.", "C. Shopping for groceries.", "D. Checking out at the register."], "answer": "A", "time_stamp_s": 439, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_444_a209_q0", "video_id": 444, "time_stamp_s": 439, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "758f093399efddd38ec7ad5cf67f1ed7b53897c45eb66323e2203b0ccc56ebe8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256, 427.0266, 428.0276, 429.0286, 430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333], "recent_frames_sha256": "b51d80332f143e79fc2004ed03aa7d4554a455a438203f41227fc74f76e387e1", "num_recent_frames": 30, "tq": 717524.486093465, "t1": 717534.617338792, "ta": 717534.617338792, "te": 717534.654759958, "first_response_s": 10.131245326949283, "answer_total_s": 10.168666493031196, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_444_a209_q0", "video_id": 444, "time_stamp_s": 439, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e566c4a84422fb78f60dcb4decd03e4562c0447fb437e31e5f23a966c59db708", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person wearing black gloves picks up packaged snacks from a refrigerated display unit.  \n- Several cardboard boxes and loose snack packages are scattered on the tiled floor near the display.  \n- The camera pans to show a red vacuum cleaner and more boxes on the floor, indicating a cleaning or restocking activity.\n[30-60s] - Hands in black gloves arrange packaged goods on a refrigerated shelf, moving items into position.  \n- The camera pans to reveal a cluttered floor area with cardboard boxes and a red shopping cart nearby.  \n- A second refrigerated display case is visible to the right, containing other packaged items.\n[60-90s] - A person wearing black gloves is actively sorting through cardboard boxes on a conveyor belt.  \n- The conveyor belt moves boxes toward a refrigerated section displaying packaged goods.  \n- Boxes are being rearranged and pushed along the belt, with some items spilling out onto the floor.\n[90-120s] - A person wearing black gloves is seen handling cardboard boxes near a refrigerated display case.  \n- The display case contains neatly arranged packaged goods on one side and scattered boxes on the other.  \n- A red hydraulic jack is visible nearby, suggesting equipment for moving heavy items.\n[120-150s] - Worker's gloved hands move packages of snacks from a conveyor belt to a refrigerated display shelf.  \n- Cardboard boxes are stacked on the floor near the conveyor, with some showing product labels.  \n- The refrigerated shelf has a white interior, with some scattered crumbs or debris visible.\n[150-180s] - A person in black gloves handles cardboard boxes near a refrigerated display case.  \n- The display case contains neatly arranged packaged goods, including blue and white items.  \n- Cardboard boxes are piled on the floor, some partially covering the display case’s base.\n[180-210s] - Person wearing black gloves moves cardboard boxes around a refrigerated display case.  \n- Refrigerated case contains stacks of packaged goods, some in blue and white wrappers.  \n- Cardboard boxes are piled on the floor near the case, with some partially open or stacked.\n[210-240s] - Person wearing black gloves and dark clothing is actively sorting and moving cardboard boxes on a tiled floor near a refrigerated display case.  \n- A pile of aluminum-wrapped items (possibly frozen goods) is visible beside the cardboard boxes, suggesting a cleanup or restocking activity.  \n- The refrigerated display case contains neatly arranged packaged goods, contrasting with the disorganized cardboard boxes on the floor.\n[240-270s] - A person in black gloves is actively sorting through a pile of cardboard boxes on a tiled floor near a refrigerated display case.  \n- The refrigerated case contains neatly arranged packages of cheese and other dairy products, with some boxes stacked on the floor beside it.  \n- A red-handled hand truck is positioned nearby, suggesting it may be used to move the cardboard boxes or other items.\n[270-300s] - Person wearing black gloves arranges white-capped containers in a cardboard box on a tiled floor.  \n- Refrigerated display cases hold various packaged dairy products, including orange and blue-wrapped items.  \n- A stack of brown cardboard boxes with white-capped containers is positioned near the display case.\n[300-330s] - Person pushes cart with multiple cardboard boxes of yogurt past refrigerated display cases.  \n- Boxes contain various colored yogurt cups, some stacked in rows, others partially unpacked.  \n- Refrigerated cases display assorted dairy products, including cheese and other chilled items, with price tags visible.\n[330-360s] - A person in black clothing pushes a cart loaded with numerous small, colorful cups across a tiled floor.  \n- The cart moves past a refrigerated display case filled with assorted packaged dairy products, including cheese and yogurt.  \n- The cart’s contents are arranged in rows, with some cups in cardboard boxes, and the person navigates carefully around the display.\n[360-390s] - Shopping cart filled with multiple cardboard boxes of yogurt, positioned near a refrigerated display case.  \n- Refrigerated case contains various yogurt containers and other chilled items, with cardboard boxes partially blocking some sections.  \n- Person’s gloved hand is visible near the cart, suggesting active selection or adjustment of items.\n[390-420s] - Person’s hands are seen placing white-capped containers into a cardboard box on a refrigerated display.  \n- The display contains multiple rows of colorful, sealed containers, with a stack of empty cardboard boxes nearby.  \n- The camera angle is tilted, showing the person’s lower body and the tiled floor beneath the display.", "history_tokens": 1005, "history_utf8_bytes": 4700, "recent_frame_times_s": [409.0086, 410.0096, 411.0106, 412.0116, 413.0126, 414.0136, 415.0146, 416.0156, 417.0166, 418.0176, 419.0186, 420.0196, 421.0206, 422.0216, 423.0226, 424.0236, 425.0246, 426.0256, 427.0266, 428.0276, 429.0286, 430.0296, 431.0306, 432.0316, 433.0326, 434.0002333333333, 435.00123333333335, 436.0022333333333, 437.00323333333336, 438.00423333333333], "recent_frames_sha256": "b51d80332f143e79fc2004ed03aa7d4554a455a438203f41227fc74f76e387e1", "num_recent_frames": 30, "tq": 717668.689395692, "t1": 717675.83029602, "ta": 717675.83029602, "te": 717676.032081146, "first_response_s": 7.140900328056887, "answer_total_s": 7.342685454059392, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 445, "content_group": "200f5db39ac079224a58d7ae710eb85f0f90eb5191d2ea3ee244a7210b66fff4", "question": {"question_id": "sample_445_a1793_q0", "video_id": 445, "video_path": "./videos/sample_445_real.mp4", "annotation_index": 1793, "question_index": 0, "question": "What is the person maneuvering at the start of the video?", "options": ["A. A cart.", "B. A trolley.", "C. A box.", "D. A crate."], "answer": "A", "time_stamp_s": 8, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_445_a1793_q0", "video_id": 445, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7cb8b77acd94def4c64a03ff06fd6c7477c4fabd423668356230cd269c5aaa9a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007], "recent_frames_sha256": "7dcb058e1c51c50c24bbc6a3634752b0783a04c53e8591074dd74d7de2467282", "num_recent_frames": 8, "tq": 717557.972747565, "t1": 717570.510993952, "ta": 717570.510993952, "te": 717570.550094969, "first_response_s": 12.538246387033723, "answer_total_s": 12.577347403974272, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_445_a1793_q0", "video_id": 445, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d3af48aff6d0c203f0625f4d7e6601dc4968ddff145f94c2c408f478a9cc6b82", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007], "recent_frames_sha256": "7dcb058e1c51c50c24bbc6a3634752b0783a04c53e8591074dd74d7de2467282", "num_recent_frames": 8, "tq": 717618.318300352, "t1": 717624.641626341, "ta": 717624.641626341, "te": 717624.946489342, "first_response_s": 6.323325989069417, "answer_total_s": 6.628188990056515, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 445, "content_group": "200f5db39ac079224a58d7ae710eb85f0f90eb5191d2ea3ee244a7210b66fff4", "question": {"question_id": "sample_445_a1794_q0", "video_id": 445, "video_path": "./videos/sample_445_real.mp4", "annotation_index": 1794, "question_index": 0, "question": "What kind of products is the person handling?", "options": ["A. Dairy products.", "B. Bakery items.", "C. Canned goods.", "D. Fresh produce."], "answer": "A", "time_stamp_s": 180, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_445_a1794_q0", "video_id": 445, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "860b859d053ad54b35dc056290c9677a605f8deaac3a73cc78ee2118cf2c4a47", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667], "recent_frames_sha256": "d6780cd3464cdcf9d8edd1b9571933f89b3acc4af825d914d33c05757845374f", "num_recent_frames": 30, "tq": 717570.55912753, "t1": 717580.466196809, "ta": 717580.466196809, "te": 717580.504027666, "first_response_s": 9.907069278997369, "answer_total_s": 9.944900135975331, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_445_a1794_q0", "video_id": 445, "time_stamp_s": 180, "ground_truth": "A", "raw_output": "A. Dairy products.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "77ec335af8c5c31f1c7a311f350693f6518ce0a7aa4c4ccfda6c3cf5a1ff9e57", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person pushes shopping cart through aisles, navigating between shelves stocked with toilet paper, yogurt, and other goods.  \n- Hands reach for and select items from shelves, including boxes labeled \"15\" and \"18\", while cart moves forward.  \n- Cart passes through narrow aisles, revealing shelves with price tags and product packaging, including \"Nestlé\" and \"Dairy Queen\" brands.\n[30-60s] - Person wearing black gloves picks up red-packaged items from a shelf, then places them into a cardboard box.  \n- The person moves along the aisle, gathering more products, including boxes of what appear to be snacks or frozen goods.  \n- A large pile of white cylindrical items (possibly diapers or similar products) is visible on a table or cart nearby.\n[60-90s] - Person wearing black gloves picks up a cardboard box from a pile of similar boxes on the floor.  \n- The box is placed on top of a stack of toilet paper rolls, which are arranged in multiple rows.  \n- The person’s hands are visible as they handle the box, with no other objects or people in the immediate vicinity.\n[90-120s] - Shopping cart moves through aisle, carrying multiple boxes of toilet paper and other goods.  \n- Shelves on left and right are stocked with various products, including canned goods and packaged items.  \n- Cart passes by stacked boxes and pallets, indicating a warehouse or backroom setting.\n[120-150s] - Person wearing black gloves unseals plastic wrap covering stacked yogurt containers.  \n- Yogurt containers are arranged in multiple rows on a pallet, with some cardboard boxes nearby.  \n- Person uses a tool to cut the plastic wrap, then begins removing the yogurt containers from the pallet.\n[150-180s] - Person in black gloves picks up a container of yogurt from a plastic-wrapped stack on a shelf.  \n- The shopping cart is positioned to the left, partially filled with items.  \n- Shelf displays various yogurt brands, including blue and white containers, with price tags visible.", "history_tokens": 446, "history_utf8_bytes": 1979, "recent_frame_times_s": [150.01653333333334, 151.01753333333335, 152.01853333333332, 153.01953333333333, 154.02053333333333, 155.02153333333334, 156.02253333333334, 157.02353333333335, 158.02453333333332, 159.02553333333333, 160.02653333333333, 161.02753333333334, 162.02853333333334, 163.02953333333335, 164.03053333333332, 165.03153333333333, 166.03253333333333, 167.00016666666667, 168.00116666666668, 169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667], "recent_frames_sha256": "d6780cd3464cdcf9d8edd1b9571933f89b3acc4af825d914d33c05757845374f", "num_recent_frames": 30, "tq": 717674.047667963, "t1": 717675.83029602, "ta": 717675.83029602, "te": 717676.032081146, "first_response_s": 1.7826280570589006, "answer_total_s": 1.984413183061406, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 445, "content_group": "200f5db39ac079224a58d7ae710eb85f0f90eb5191d2ea3ee244a7210b66fff4", "question": {"question_id": "sample_445_a1795_q0", "video_id": 445, "video_path": "./videos/sample_445_real.mp4", "annotation_index": 1795, "question_index": 0, "question": "What is the main activity of the person in the storage room?", "options": ["A. Checking inventory levels.", "B. Stocking and organizing cartons on shelves.", "C. Cleaning the storage room.", "D. Labeling the cartons."], "answer": "B", "time_stamp_s": 340, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_445_a1795_q0", "video_id": 445, "time_stamp_s": 340, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3a9a87fb97386ca7a1797551d89dc9d1ff9ca349e03986fd6ebc65d492419c6c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317, 333.0327, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334], "recent_frames_sha256": "f153d160671547b69c68e563cc4be62ee93d755eeb5eecfe843dab2ff34170bd", "num_recent_frames": 30, "tq": 717580.5133463, "t1": 717594.199924451, "ta": 717594.199924451, "te": 717594.238384544, "first_response_s": 13.686578150955029, "answer_total_s": 13.725038244039752, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_445_a1795_q0", "video_id": 445, "time_stamp_s": 340, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "09ffa13cbafdf585321f0043c3f2ad41962319124e0c17efe66c1db00316e183", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person pushes shopping cart through aisles, navigating between shelves stocked with toilet paper, yogurt, and other goods.  \n- Hands reach for and select items from shelves, including boxes labeled \"15\" and \"18\", while cart moves forward.  \n- Cart passes through narrow aisles, revealing shelves with price tags and product packaging, including \"Nestlé\" and \"Dairy Queen\" brands.\n[30-60s] - Person wearing black gloves picks up red-packaged items from a shelf, then places them into a cardboard box.  \n- The person moves along the aisle, gathering more products, including boxes of what appear to be snacks or frozen goods.  \n- A large pile of white cylindrical items (possibly diapers or similar products) is visible on a table or cart nearby.\n[60-90s] - Person wearing black gloves picks up a cardboard box from a pile of similar boxes on the floor.  \n- The box is placed on top of a stack of toilet paper rolls, which are arranged in multiple rows.  \n- The person’s hands are visible as they handle the box, with no other objects or people in the immediate vicinity.\n[90-120s] - Shopping cart moves through aisle, carrying multiple boxes of toilet paper and other goods.  \n- Shelves on left and right are stocked with various products, including canned goods and packaged items.  \n- Cart passes by stacked boxes and pallets, indicating a warehouse or backroom setting.\n[120-150s] - Person wearing black gloves unseals plastic wrap covering stacked yogurt containers.  \n- Yogurt containers are arranged in multiple rows on a pallet, with some cardboard boxes nearby.  \n- Person uses a tool to cut the plastic wrap, then begins removing the yogurt containers from the pallet.\n[150-180s] - Person in black gloves picks up a container of yogurt from a plastic-wrapped stack on a shelf.  \n- The shopping cart is positioned to the left, partially filled with items.  \n- Shelf displays various yogurt brands, including blue and white containers, with price tags visible.\n[180-210s] - Person in black gloves picks up a stack of yogurt cups from a cardboard tray on the floor.  \n- The yogurt cups are arranged in a grid pattern, with some already placed on a nearby wire rack.  \n- The person moves toward a shelf stocked with various food items, including canned goods and packaged snacks.\n[210-240s] - Person in black gloves picks up a container of orange juice from a shelf.  \n- They then select a box of yogurt, placing it on the floor next to other groceries.  \n- A price tag for \"VISPGRÄDDE\" at 18.50 is visible on the shelf as they reach for items.\n[240-270s] - Person reaches for a product on a shelf, with hand visible in black sleeve.  \n- Shelf displays various packaged goods, including red and white containers labeled \"VANILLA\" and \"31%\".  \n- Price tags show \"31%\" and \"35%\" near the products, indicating pricing information.\n[270-300s] - Hand reaches into a shelf gap to retrieve a product, then pulls out a box of yogurt.  \n- The person walks toward a pile of cardboard boxes on the floor, carrying the yogurt box.  \n- The shelf above displays various yogurt brands with price tags, including \"31\" and \"33\" labels.\n[300-330s] - Person wearing black gloves reaches for a red box labeled \"35\" on a shelf.  \n- They pick up the box and place it into a cardboard box held in their other hand.  \n- The shelf displays multiple similar red boxes with price tags, including \"28\" and \"35\".", "history_tokens": 818, "history_utf8_bytes": 3401, "recent_frame_times_s": [310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0167, 318.0177, 319.0187, 320.0197, 321.0207, 322.0217, 323.0227, 324.0237, 325.0247, 326.0257, 327.0267, 328.0277, 329.0287, 330.0297, 331.0307, 332.0317, 333.0327, 334.00033333333334, 335.0013333333333, 336.00233333333335, 337.00333333333333, 338.0043333333333, 339.00533333333334], "recent_frames_sha256": "f153d160671547b69c68e563cc4be62ee93d755eeb5eecfe843dab2ff34170bd", "num_recent_frames": 30, "tq": 717711.542401808, "t1": 717718.39654139, "ta": 717718.39654139, "te": 717718.435583993, "first_response_s": 6.854139582021162, "answer_total_s": 6.893182185012847, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 445, "content_group": "200f5db39ac079224a58d7ae710eb85f0f90eb5191d2ea3ee244a7210b66fff4", "question": {"question_id": "sample_445_a1796_q0", "video_id": 445, "video_path": "./videos/sample_445_real.mp4", "annotation_index": 1796, "question_index": 0, "question": "What type of containers is being placed into the wire cart?", "options": ["A. White and blue labeled.", "B. Red and white labeled.", "C. Green and white labeled.", "D. Yellow labeled."], "answer": "A", "time_stamp_s": 487, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_445_a1796_q0", "video_id": 445, "time_stamp_s": 487, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "823e0ab902d4a04777ab089c150a2ffecffe6f0459b2be6f28f2d61f0f7bc3d3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [457.02323333333334, 458.0242333333333, 459.02523333333335, 460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667], "recent_frames_sha256": "bed1594ac6d11bcc0ccdfde55d2e37e0e9a88f8ad5336f20b4bd416c3927b8d8", "num_recent_frames": 30, "tq": 717594.247959184, "t1": 717605.366915604, "ta": 717605.366915604, "te": 717605.400959498, "first_response_s": 11.118956419988535, "answer_total_s": 11.153000314021483, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_445_a1796_q0", "video_id": 445, "time_stamp_s": 487, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9b63c74a9f949da8e54c01499ca04eba13f376f11be2de913284b856863dac23", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Shopping cart moves through aisle, carrying multiple boxes of toilet paper and other goods.  \n- Shelves on left and right are stocked with various products, including canned goods and packaged items.  \n- Cart passes by stacked boxes and pallets, indicating a warehouse or backroom setting.\n[120-150s] - Person wearing black gloves unseals plastic wrap covering stacked yogurt containers.  \n- Yogurt containers are arranged in multiple rows on a pallet, with some cardboard boxes nearby.  \n- Person uses a tool to cut the plastic wrap, then begins removing the yogurt containers from the pallet.\n[150-180s] - Person in black gloves picks up a container of yogurt from a plastic-wrapped stack on a shelf.  \n- The shopping cart is positioned to the left, partially filled with items.  \n- Shelf displays various yogurt brands, including blue and white containers, with price tags visible.\n[180-210s] - Person in black gloves picks up a stack of yogurt cups from a cardboard tray on the floor.  \n- The yogurt cups are arranged in a grid pattern, with some already placed on a nearby wire rack.  \n- The person moves toward a shelf stocked with various food items, including canned goods and packaged snacks.\n[210-240s] - Person in black gloves picks up a container of orange juice from a shelf.  \n- They then select a box of yogurt, placing it on the floor next to other groceries.  \n- A price tag for \"VISPGRÄDDE\" at 18.50 is visible on the shelf as they reach for items.\n[240-270s] - Person reaches for a product on a shelf, with hand visible in black sleeve.  \n- Shelf displays various packaged goods, including red and white containers labeled \"VANILLA\" and \"31%\".  \n- Price tags show \"31%\" and \"35%\" near the products, indicating pricing information.\n[270-300s] - Hand reaches into a shelf gap to retrieve a product, then pulls out a box of yogurt.  \n- The person walks toward a pile of cardboard boxes on the floor, carrying the yogurt box.  \n- The shelf above displays various yogurt brands with price tags, including \"31\" and \"33\" labels.\n[300-330s] - Person wearing black gloves reaches for a red box labeled \"35\" on a shelf.  \n- They pick up the box and place it into a cardboard box held in their other hand.  \n- The shelf displays multiple similar red boxes with price tags, including \"28\" and \"35\".\n[330-360s] - Person in black gloves picks up a red box from a shelf labeled \"35€\" while holding a cardboard box.  \n- The person places the red box into the cardboard box, which is positioned on the floor near the shelf.  \n- The shelf contains various products, including boxes priced at 15€, 28€, and 10€, with some items partially visible.\n[360-390s] - Person wearing black gloves and dark pants is seen handling cardboard boxes near a pile of assorted packaged goods.  \n- A green box labeled \"OATLY\" and red boxes with white labels are visible among the scattered items on the floor.  \n- The person’s feet, clad in white sneakers, are positioned near the pile, suggesting active movement or sorting.\n[390-420s] - Hand reaches for a product on a shelf, likely selecting or adjusting an item.  \n- Shelf displays various packaged goods with price tags visible, including items labeled \"19€\" and \"10€\".  \n- The camera pans across the aisle, showing stacked boxes and organized shelves with products like KESO and other brands.\n[420-450s] - Person in black jacket walks past shelves stocked with packaged goods, including red and white boxes labeled \"OZEA\" and \"Coca-Cola\".  \n- The person's hand reaches toward a shelf holding various containers, possibly selecting or examining items.  \n- A shopping cart is visible nearby, suggesting the person is shopping or restocking.\n[450-480s] - Person in black gloves picks up a red-and-white packaged item from a shelf, placing it into a cardboard box.  \n- The box is positioned on a low shelf, with price tags visible above it.  \n- The person then moves to a different area, where a large pile of yogurt containers and other packaged goods are stacked on the floor.", "history_tokens": 981, "history_utf8_bytes": 4039, "recent_frame_times_s": [457.02323333333334, 458.0242333333333, 459.02523333333335, 460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667], "recent_frames_sha256": "bed1594ac6d11bcc0ccdfde55d2e37e0e9a88f8ad5336f20b4bd416c3927b8d8", "num_recent_frames": 30, "tq": 717756.425264415, "t1": 717764.57368037, "ta": 717764.57368037, "te": 717764.881507818, "first_response_s": 8.14841595501639, "answer_total_s": 8.456243403023109, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 445, "content_group": "200f5db39ac079224a58d7ae710eb85f0f90eb5191d2ea3ee244a7210b66fff4", "question": {"question_id": "sample_445_a1796_q1", "video_id": 445, "video_path": "./videos/sample_445_real.mp4", "annotation_index": 1796, "question_index": 1, "question": "What is the person doing after lifting the white-labeled items?", "options": ["A. Put them on the cart.", "B. Sorting and organizing items.", "C. Pushing the cart out of the room.", "D. Disposing of the items."], "answer": "A", "time_stamp_s": 494, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_445_a1796_q1", "video_id": 445, "time_stamp_s": 494, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1b70d41b1d20083d0086e7b1389876c2596574102420792dcf4f3aed5d814592", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667, 487.01986666666664, 488.0208666666667, 489.02186666666665, 490.0228666666667, 491.02386666666666, 492.02486666666664, 493.0258666666667], "recent_frames_sha256": "fde91f50982f3d9feecf068a463bddbd957557c70f473180ad28ece6b2f95c15", "num_recent_frames": 30, "tq": 717605.407383375, "t1": 717618.272170997, "ta": 717618.272170997, "te": 717618.310378789, "first_response_s": 12.864787622005679, "answer_total_s": 12.902995413984172, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_445_a1796_q1", "video_id": 445, "time_stamp_s": 494, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9502c6b891b88c2a8a9bd211cb32c6496ca46bd67bdb8ca760139d5f3370b0cc", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Shopping cart moves through aisle, carrying multiple boxes of toilet paper and other goods.  \n- Shelves on left and right are stocked with various products, including canned goods and packaged items.  \n- Cart passes by stacked boxes and pallets, indicating a warehouse or backroom setting.\n[120-150s] - Person wearing black gloves unseals plastic wrap covering stacked yogurt containers.  \n- Yogurt containers are arranged in multiple rows on a pallet, with some cardboard boxes nearby.  \n- Person uses a tool to cut the plastic wrap, then begins removing the yogurt containers from the pallet.\n[150-180s] - Person in black gloves picks up a container of yogurt from a plastic-wrapped stack on a shelf.  \n- The shopping cart is positioned to the left, partially filled with items.  \n- Shelf displays various yogurt brands, including blue and white containers, with price tags visible.\n[180-210s] - Person in black gloves picks up a stack of yogurt cups from a cardboard tray on the floor.  \n- The yogurt cups are arranged in a grid pattern, with some already placed on a nearby wire rack.  \n- The person moves toward a shelf stocked with various food items, including canned goods and packaged snacks.\n[210-240s] - Person in black gloves picks up a container of orange juice from a shelf.  \n- They then select a box of yogurt, placing it on the floor next to other groceries.  \n- A price tag for \"VISPGRÄDDE\" at 18.50 is visible on the shelf as they reach for items.\n[240-270s] - Person reaches for a product on a shelf, with hand visible in black sleeve.  \n- Shelf displays various packaged goods, including red and white containers labeled \"VANILLA\" and \"31%\".  \n- Price tags show \"31%\" and \"35%\" near the products, indicating pricing information.\n[270-300s] - Hand reaches into a shelf gap to retrieve a product, then pulls out a box of yogurt.  \n- The person walks toward a pile of cardboard boxes on the floor, carrying the yogurt box.  \n- The shelf above displays various yogurt brands with price tags, including \"31\" and \"33\" labels.\n[300-330s] - Person wearing black gloves reaches for a red box labeled \"35\" on a shelf.  \n- They pick up the box and place it into a cardboard box held in their other hand.  \n- The shelf displays multiple similar red boxes with price tags, including \"28\" and \"35\".\n[330-360s] - Person in black gloves picks up a red box from a shelf labeled \"35€\" while holding a cardboard box.  \n- The person places the red box into the cardboard box, which is positioned on the floor near the shelf.  \n- The shelf contains various products, including boxes priced at 15€, 28€, and 10€, with some items partially visible.\n[360-390s] - Person wearing black gloves and dark pants is seen handling cardboard boxes near a pile of assorted packaged goods.  \n- A green box labeled \"OATLY\" and red boxes with white labels are visible among the scattered items on the floor.  \n- The person’s feet, clad in white sneakers, are positioned near the pile, suggesting active movement or sorting.\n[390-420s] - Hand reaches for a product on a shelf, likely selecting or adjusting an item.  \n- Shelf displays various packaged goods with price tags visible, including items labeled \"19€\" and \"10€\".  \n- The camera pans across the aisle, showing stacked boxes and organized shelves with products like KESO and other brands.\n[420-450s] - Person in black jacket walks past shelves stocked with packaged goods, including red and white boxes labeled \"OZEA\" and \"Coca-Cola\".  \n- The person's hand reaches toward a shelf holding various containers, possibly selecting or examining items.  \n- A shopping cart is visible nearby, suggesting the person is shopping or restocking.\n[450-480s] - Person in black gloves picks up a red-and-white packaged item from a shelf, placing it into a cardboard box.  \n- The box is positioned on a low shelf, with price tags visible above it.  \n- The person then moves to a different area, where a large pile of yogurt containers and other packaged goods are stacked on the floor.", "history_tokens": 981, "history_utf8_bytes": 4039, "recent_frame_times_s": [464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667, 487.01986666666664, 488.0208666666667, 489.02186666666665, 490.0228666666667, 491.02386666666666, 492.02486666666664, 493.0258666666667], "recent_frames_sha256": "fde91f50982f3d9feecf068a463bddbd957557c70f473180ad28ece6b2f95c15", "num_recent_frames": 30, "tq": 717764.923028153, "t1": 717778.814259359, "ta": 717778.814259359, "te": 717779.043319657, "first_response_s": 13.89123120601289, "answer_total_s": 14.120291503961198, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 446, "content_group": "c4a7f4fb7b1347c4edc364340c8a7b9e7c5777de4de02519e2afee0dba104152", "question": {"question_id": "sample_446_a1452_q0", "video_id": 446, "video_path": "./videos/sample_446_real.mp4", "annotation_index": 1452, "question_index": 0, "question": "What is prominently visible on top of the table at the start of the video?", "options": ["A. A stack of green boxes.", "B. A stack of white cartons labeled \"JO\".", "C. A stack of red cartons labeled \"YO\".", "D. A stack of blue containers labeled \"Mild Yogurt\"."], "answer": "B", "time_stamp_s": 1, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_446_a1452_q0", "video_id": 446, "time_stamp_s": 1, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5837dc7a7e907d63e804cb42a461671d6626313e0da2d268994486bf87407e4f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.042], "recent_frames_sha256": "7e7bcdd279f3869f0549e6145db24e793a89e3e9f214b9ba92916b45a1a43db4", "num_recent_frames": 1, "tq": 715353.725704798, "t1": 715359.32239296, "ta": 715359.32239296, "te": 715359.363141871, "first_response_s": 5.596688161953352, "answer_total_s": 5.637437073048204, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_446_a1452_q0", "video_id": 446, "time_stamp_s": 1, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0996437b96af15db4962b832104b20ac82f0e132972ed30cc5f1d6298e2c9e61", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.042], "recent_frames_sha256": "7e7bcdd279f3869f0549e6145db24e793a89e3e9f214b9ba92916b45a1a43db4", "num_recent_frames": 1, "tq": 715187.139565062, "t1": 715189.047552545, "ta": 715189.047552545, "te": 715189.091303915, "first_response_s": 1.9079874829621986, "answer_total_s": 1.951738853007555, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 446, "content_group": "c4a7f4fb7b1347c4edc364340c8a7b9e7c5777de4de02519e2afee0dba104152", "question": {"question_id": "sample_446_a1453_q0", "video_id": 446, "video_path": "./videos/sample_446_real.mp4", "annotation_index": 1453, "question_index": 0, "question": "What brand name appears on the green cartons being holding by the person?", "options": ["A. KESO.", "B. Bregott.", "C. Arla.", "D. Lurpak."], "answer": "B", "time_stamp_s": 172, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_446_a1453_q0", "video_id": 446, "time_stamp_s": 172, "ground_truth": "B", "raw_output": "B. Bregott.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "732b1554af589b5c6c2c65875e483a37f5312dd7c5ab7ebde0b937e8d8fa38bc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [142.01716666666667, 143.01816666666667, 144.01916666666668, 145.02016666666665, 146.02116666666666, 147.02216666666666, 148.02316666666667, 149.02416666666667, 150.02516666666668, 151.02616666666665, 152.02716666666666, 153.02816666666666, 154.02916666666667, 155.03016666666667, 156.03116666666668, 157.03216666666665, 158.03316666666666, 159.0008, 160.0018, 161.0028, 162.0038, 163.0048, 164.0058, 165.0068, 166.0078, 167.0088, 168.0098, 169.0108, 170.0118, 171.0128], "recent_frames_sha256": "22ecc19ae51d64df8bfc4c5642e59013581fe11e56e31f07f6f5562279ea8536", "num_recent_frames": 30, "tq": 715359.378234278, "t1": 715371.406688103, "ta": 715371.406688103, "te": 715371.636911716, "first_response_s": 12.028453825041652, "answer_total_s": 12.258677438017912, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_446_a1453_q0", "video_id": 446, "time_stamp_s": 172, "ground_truth": "B", "raw_output": "B. Bregott.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "526ad3065e9d444cddafad422f418bc3d3b0e3dcc59b4c643bdde3bb3f62114c", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person in dark clothing walks through a warehouse aisle, passing stacks of packaged goods including yogurt and eggs.  \n- They approach a green \"Bregott\" branded cart and begin sorting or moving items from pallets to the cart.  \n- The environment features metal shelving, cardboard boxes, and various product displays on the floor.\n[30-60s] - Person in black gloves picks up a carton of milk from a shelf, placing it into a cardboard box on the floor.  \n- The carton is labeled \"Crème Fraîche\" with a price tag of \"15.00\" visible on the shelf.  \n- The person then moves the box toward a green \"Energizer\" branded carton, which is stacked with other items on the floor.\n[60-90s] - Person in black pants walks past stacked boxes of yogurt and paper towels, moving toward a green \"Bargain\" box.  \n- Boxes of yogurt and paper towels are arranged on the floor, with some items in plastic-wrapped piles.  \n- A metal cart with stacked boxes is visible near the right side of the frame, partially covered by plastic sheeting.\n[90-120s] - Person in black gloves picks up a cardboard box containing white cups from a shelf.  \n- They carry the box toward a pile of other boxes, including green \"Briquet\" boxes and red cartons, near a wall.  \n- The person places the box down among other items, including egg cartons and plastic-wrapped goods.\n[120-150s] - Person in black gloves picks up orange-packaged items from a shelf, moving them into a cart.  \n- Shelf displays price tags (e.g., \"12.99\") and various product types, including jars and boxes.  \n- Cart is positioned near the shelf, with items being transferred from the shelf to the cart.", "history_tokens": 407, "history_utf8_bytes": 1643, "recent_frame_times_s": [142.01716666666667, 143.01816666666667, 144.01916666666668, 145.02016666666665, 146.02116666666666, 147.02216666666666, 148.02316666666667, 149.02416666666667, 150.02516666666668, 151.02616666666665, 152.02716666666666, 153.02816666666666, 154.02916666666667, 155.03016666666667, 156.03116666666668, 157.03216666666665, 158.03316666666666, 159.0008, 160.0018, 161.0028, 162.0038, 163.0048, 164.0058, 165.0068, 166.0078, 167.0088, 168.0098, 169.0108, 170.0118, 171.0128], "recent_frames_sha256": "22ecc19ae51d64df8bfc4c5642e59013581fe11e56e31f07f6f5562279ea8536", "num_recent_frames": 30, "tq": 715229.666977682, "t1": 715235.475585196, "ta": 715235.475585196, "te": 715235.714677287, "first_response_s": 5.80860751401633, "answer_total_s": 6.047699604998343, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 446, "content_group": "c4a7f4fb7b1347c4edc364340c8a7b9e7c5777de4de02519e2afee0dba104152", "question": {"question_id": "sample_446_a1454_q0", "video_id": 446, "video_path": "./videos/sample_446_real.mp4", "annotation_index": 1454, "question_index": 0, "question": "What is the individual wearing on their hands while handling the yogurt containers?", "options": ["A. Gloves.", "B. Mittens.", "C. Bare hands.", "D. Bandages."], "answer": "A", "time_stamp_s": 331, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_446_a1454_q0", "video_id": 446, "time_stamp_s": 331, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9861e0bae498d2b256d1fea070ffa7d239a692cbdeda137553af401786ea2785", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [301.00933333333336, 302.01033333333334, 303.0113333333333, 304.01233333333334, 305.0133333333333, 306.01433333333335, 307.01533333333333, 308.0163333333333, 309.01733333333334, 310.0183333333333, 311.01933333333335, 312.0203333333333, 313.02133333333336, 314.02233333333334, 315.0233333333333, 316.02433333333335, 317.0253333333333, 318.02633333333335, 319.02733333333333, 320.0283333333333, 321.02933333333334, 322.0303333333333, 323.03133333333335, 324.0323333333333, 325.03333333333336, 326.00096666666667, 327.00196666666665, 328.0029666666667, 329.00396666666666, 330.0049666666667], "recent_frames_sha256": "d599f8afb88b10a1c019418e4df207494041beba1eb7a5720bf666f070a21ad5", "num_recent_frames": 30, "tq": 715371.652035783, "t1": 715382.87623093, "ta": 715382.87623093, "te": 715382.916206524, "first_response_s": 11.224195146933198, "answer_total_s": 11.264170740963891, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_446_a1454_q0", "video_id": 446, "time_stamp_s": 331, "ground_truth": "A", "raw_output": "A. Gloves.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "12a8499720c2abd348264097df7a105e8c58580083efcd40cee7e019d5781fe4", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person in dark clothing walks through a warehouse aisle, passing stacks of packaged goods including yogurt and eggs.  \n- They approach a green \"Bregott\" branded cart and begin sorting or moving items from pallets to the cart.  \n- The environment features metal shelving, cardboard boxes, and various product displays on the floor.\n[30-60s] - Person in black gloves picks up a carton of milk from a shelf, placing it into a cardboard box on the floor.  \n- The carton is labeled \"Crème Fraîche\" with a price tag of \"15.00\" visible on the shelf.  \n- The person then moves the box toward a green \"Energizer\" branded carton, which is stacked with other items on the floor.\n[60-90s] - Person in black pants walks past stacked boxes of yogurt and paper towels, moving toward a green \"Bargain\" box.  \n- Boxes of yogurt and paper towels are arranged on the floor, with some items in plastic-wrapped piles.  \n- A metal cart with stacked boxes is visible near the right side of the frame, partially covered by plastic sheeting.\n[90-120s] - Person in black gloves picks up a cardboard box containing white cups from a shelf.  \n- They carry the box toward a pile of other boxes, including green \"Briquet\" boxes and red cartons, near a wall.  \n- The person places the box down among other items, including egg cartons and plastic-wrapped goods.\n[120-150s] - Person in black gloves picks up orange-packaged items from a shelf, moving them into a cart.  \n- Shelf displays price tags (e.g., \"12.99\") and various product types, including jars and boxes.  \n- Cart is positioned near the shelf, with items being transferred from the shelf to the cart.\n[150-180s] - Person in black gloves picks up a carton of eggs from a pallet near a green \"Bregot\" box.  \n- They move the carton toward a shopping cart filled with other items, including yogurt and paper towels.  \n- The person then places the egg carton into the shopping cart, which is positioned near a stack of paper towels and a cardboard box.\n[180-210s] - Person wearing black gloves reaches for a product on a high shelf, then places it into a cardboard box.  \n- The box is positioned on the floor near a stack of toilet paper rolls, with shelves stocked with various items behind.  \n- The person’s arm extends upward to retrieve a product from the top shelf, then lowers it into the box.\n[210-240s] - Person in black gloves picks up a white bottle from a shelf while holding a carton of yogurt.  \n- The carton of yogurt is placed on a metal cart, which also holds a box of eggs and a red container.  \n- The person moves the cart toward a refrigerated section, where they reach for a bottle of milk.\n[240-270s] - Hand reaches for a box labeled \"CREME\" on a high shelf, then pulls it down.  \n- The box is moved to a lower shelf, revealing more products beneath.  \n- A red trash bin is visible on the floor near the shelf.\n[270-300s] - Hand in black glove picks up a white container from a shelf, then places it into a shopping cart.  \n- Shopping cart contains multiple containers, some with blue lids, and is positioned near a shelf stocked with various products.  \n- Shelf displays price tags, including “31” and “16,” indicating product costs, and features items like yogurt and condiments.\n[300-330s] - Person holds a tray of yogurt containers while standing in front of a refrigerated shelf stocked with various dairy products.  \n- The person reaches for a bottle of water from the top shelf of the refrigerator, which is filled with multiple bottles.  \n- A red shopping cart with stacked items, including a box of cookies, is visible to the right of the person.", "history_tokens": 884, "history_utf8_bytes": 3624, "recent_frame_times_s": [301.00933333333336, 302.01033333333334, 303.0113333333333, 304.01233333333334, 305.0133333333333, 306.01433333333335, 307.01533333333333, 308.0163333333333, 309.01733333333334, 310.0183333333333, 311.01933333333335, 312.0203333333333, 313.02133333333336, 314.02233333333334, 315.0233333333333, 316.02433333333335, 317.0253333333333, 318.02633333333335, 319.02733333333333, 320.0283333333333, 321.02933333333334, 322.0303333333333, 323.03133333333335, 324.0323333333333, 325.03333333333336, 326.00096666666667, 327.00196666666665, 328.0029666666667, 329.00396666666666, 330.0049666666667], "recent_frames_sha256": "d599f8afb88b10a1c019418e4df207494041beba1eb7a5720bf666f070a21ad5", "num_recent_frames": 30, "tq": 715279.695992102, "t1": 715287.047444019, "ta": 715287.047444019, "te": 715287.205506412, "first_response_s": 7.351451916969381, "answer_total_s": 7.5095143099315464, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 446, "content_group": "c4a7f4fb7b1347c4edc364340c8a7b9e7c5777de4de02519e2afee0dba104152", "question": {"question_id": "sample_446_a1455_q0", "video_id": 446, "video_path": "./videos/sample_446_real.mp4", "annotation_index": 1455, "question_index": 0, "question": "What brand is printed on the white box near the worker's knees?", "options": ["A. Arla.", "B. Valio.", "C. Alpro.", "D. Oatly."], "answer": "B", "time_stamp_s": 491, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_446_a1455_q0", "video_id": 446, "time_stamp_s": 491, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3224d3babce6fade6d756dd8e5fa8673704f12cf5aa07dc075c99be514e5096b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [461.0025, 462.0035, 463.0045, 464.0055, 465.0065, 466.0075, 467.0085, 468.0095, 469.0105, 470.0115, 471.0125, 472.0135, 473.0145, 474.0155, 475.0165, 476.0175, 477.0185, 478.0195, 479.0205, 480.0215, 481.0225, 482.0235, 483.0245, 484.0255, 485.0265, 486.0275, 487.0285, 488.0295, 489.0305, 490.0315], "recent_frames_sha256": "ff916ffeb51e1e52d9f717f20c19dd3048ac6c04972eb6e8dd8297e9fc766d2c", "num_recent_frames": 30, "tq": 715382.932028338, "t1": 715393.112077452, "ta": 715393.112077452, "te": 715393.150181042, "first_response_s": 10.180049114045687, "answer_total_s": 10.218152704066597, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_446_a1455_q0", "video_id": 446, "time_stamp_s": 491, "ground_truth": "B", "raw_output": "A. Arla.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "6a8181cc76d9be4b9adee04bbb54788b23263d8076fcf73adc383715cd08a498", "condition_order": ["notes", "recent"], "memory": "[90-120s] - Person in black gloves picks up a cardboard box containing white cups from a shelf.  \n- They carry the box toward a pile of other boxes, including green \"Briquet\" boxes and red cartons, near a wall.  \n- The person places the box down among other items, including egg cartons and plastic-wrapped goods.\n[120-150s] - Person in black gloves picks up orange-packaged items from a shelf, moving them into a cart.  \n- Shelf displays price tags (e.g., \"12.99\") and various product types, including jars and boxes.  \n- Cart is positioned near the shelf, with items being transferred from the shelf to the cart.\n[150-180s] - Person in black gloves picks up a carton of eggs from a pallet near a green \"Bregot\" box.  \n- They move the carton toward a shopping cart filled with other items, including yogurt and paper towels.  \n- The person then places the egg carton into the shopping cart, which is positioned near a stack of paper towels and a cardboard box.\n[180-210s] - Person wearing black gloves reaches for a product on a high shelf, then places it into a cardboard box.  \n- The box is positioned on the floor near a stack of toilet paper rolls, with shelves stocked with various items behind.  \n- The person’s arm extends upward to retrieve a product from the top shelf, then lowers it into the box.\n[210-240s] - Person in black gloves picks up a white bottle from a shelf while holding a carton of yogurt.  \n- The carton of yogurt is placed on a metal cart, which also holds a box of eggs and a red container.  \n- The person moves the cart toward a refrigerated section, where they reach for a bottle of milk.\n[240-270s] - Hand reaches for a box labeled \"CREME\" on a high shelf, then pulls it down.  \n- The box is moved to a lower shelf, revealing more products beneath.  \n- A red trash bin is visible on the floor near the shelf.\n[270-300s] - Hand in black glove picks up a white container from a shelf, then places it into a shopping cart.  \n- Shopping cart contains multiple containers, some with blue lids, and is positioned near a shelf stocked with various products.  \n- Shelf displays price tags, including “31” and “16,” indicating product costs, and features items like yogurt and condiments.\n[300-330s] - Person holds a tray of yogurt containers while standing in front of a refrigerated shelf stocked with various dairy products.  \n- The person reaches for a bottle of water from the top shelf of the refrigerator, which is filled with multiple bottles.  \n- A red shopping cart with stacked items, including a box of cookies, is visible to the right of the person.\n[330-360s] - Hands in black gloves pick up and rearrange yogurt containers on a white shelf.  \n- Blue and yellow product boxes are visible on adjacent shelves to the left.  \n- A red crate with bottled water is positioned on the right side of the shelf.\n[360-390s] - Hand reaches for a can of beverage from a shelf, placing it atop a tray of yogurt cups.  \n- The tray, holding multiple yogurt cups, is carried through aisles past shelves stocked with oils, snacks, and other goods.  \n- A red shopping cart is visible nearby, suggesting the person is shopping or restocking.\n[390-420s] - Person wearing black gloves arranges multiple small yogurt cups on a white tray, placing them in a grid pattern.  \n- The tray is positioned on a brightly lit supermarket shelf, surrounded by stacks of blue-labeled containers and green packaging.  \n- The person’s hands move methodically, adjusting the yogurt cups’ positions while maintaining a consistent spatial layout.\n[420-450s] - Person wearing black gloves places yogurt cups onto a white tray, arranging them in a grid pattern.  \n- The tray is positioned on a metal shelf, with other yogurt containers and blue-labeled items visible nearby.  \n- A green box labeled \"BIO\" is stacked on a lower shelf, partially obscured by cardboard boxes.\n[450-480s] - Person in black gloves picks up a white box labeled \"Kraft\" from a shelf.  \n- They place the box into a shopping cart positioned nearby.  \n- The cart contains other items, including a green box and a white container.", "history_tokens": 987, "history_utf8_bytes": 4111, "recent_frame_times_s": [461.0025, 462.0035, 463.0045, 464.0055, 465.0065, 466.0075, 467.0085, 468.0095, 469.0105, 470.0115, 471.0125, 472.0135, 473.0145, 474.0155, 475.0165, 476.0175, 477.0185, 478.0195, 479.0205, 480.0215, 481.0225, 482.0235, 483.0245, 484.0255, 485.0265, 486.0275, 487.0285, 488.0295, 489.0305, 490.0315], "recent_frames_sha256": "ff916ffeb51e1e52d9f717f20c19dd3048ac6c04972eb6e8dd8297e9fc766d2c", "num_recent_frames": 30, "tq": 715318.980320047, "t1": 715320.190721521, "ta": 715320.190721521, "te": 715320.386717607, "first_response_s": 1.210401474032551, "answer_total_s": 1.4063975600292906, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 446, "content_group": "c4a7f4fb7b1347c4edc364340c8a7b9e7c5777de4de02519e2afee0dba104152", "question": {"question_id": "sample_446_a1456_q0", "video_id": 446, "video_path": "./videos/sample_446_real.mp4", "annotation_index": 1456, "question_index": 0, "question": "What indicates that the restocking task is nearly complete?", "options": ["A. The person leaves the area.", "B. Everything items in the box has been put on the shelves.", "C. The items are being packed into the box.", "D. The camera shows an empty warehouse."], "answer": "B", "time_stamp_s": 594, "task_type": "Causal Reasoning", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [540, 597], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_446_a1456_q0", "video_id": 446, "time_stamp_s": 594, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "37390115c1677b7d3a53046f721eb3486e5d479936fd46309e374560dac15bcc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [564.0054, 565.0064, 566.0074, 567.0084, 568.0094, 569.0104, 570.0114, 571.0124, 572.0134, 573.0144, 574.0154, 575.0164, 576.0174, 577.0184, 578.0194, 579.0204, 580.0214, 581.0224, 582.0234, 583.0244, 584.0254, 585.0264, 586.0274, 587.0284, 588.0294, 589.0304, 590.0314, 591.0324, 592.0000333333334, 593.0010333333333], "recent_frames_sha256": "74f48a5d5fda467ba261167f6bb99796af809cbfd4e5f6effa5e6831850b6678", "num_recent_frames": 30, "tq": 715393.166670421, "t1": 715403.043713549, "ta": 715403.043713549, "te": 715403.08136513, "first_response_s": 9.87704312801361, "answer_total_s": 9.914694709004834, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_446_a1456_q0", "video_id": 446, "time_stamp_s": 594, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cba73c69e9b43b431391a290bb0fba3c304a6d7655a659124fb837f1170d8cdd", "condition_order": ["notes", "recent"], "memory": "[180-210s] - Person wearing black gloves reaches for a product on a high shelf, then places it into a cardboard box.  \n- The box is positioned on the floor near a stack of toilet paper rolls, with shelves stocked with various items behind.  \n- The person’s arm extends upward to retrieve a product from the top shelf, then lowers it into the box.\n[210-240s] - Person in black gloves picks up a white bottle from a shelf while holding a carton of yogurt.  \n- The carton of yogurt is placed on a metal cart, which also holds a box of eggs and a red container.  \n- The person moves the cart toward a refrigerated section, where they reach for a bottle of milk.\n[240-270s] - Hand reaches for a box labeled \"CREME\" on a high shelf, then pulls it down.  \n- The box is moved to a lower shelf, revealing more products beneath.  \n- A red trash bin is visible on the floor near the shelf.\n[270-300s] - Hand in black glove picks up a white container from a shelf, then places it into a shopping cart.  \n- Shopping cart contains multiple containers, some with blue lids, and is positioned near a shelf stocked with various products.  \n- Shelf displays price tags, including “31” and “16,” indicating product costs, and features items like yogurt and condiments.\n[300-330s] - Person holds a tray of yogurt containers while standing in front of a refrigerated shelf stocked with various dairy products.  \n- The person reaches for a bottle of water from the top shelf of the refrigerator, which is filled with multiple bottles.  \n- A red shopping cart with stacked items, including a box of cookies, is visible to the right of the person.\n[330-360s] - Hands in black gloves pick up and rearrange yogurt containers on a white shelf.  \n- Blue and yellow product boxes are visible on adjacent shelves to the left.  \n- A red crate with bottled water is positioned on the right side of the shelf.\n[360-390s] - Hand reaches for a can of beverage from a shelf, placing it atop a tray of yogurt cups.  \n- The tray, holding multiple yogurt cups, is carried through aisles past shelves stocked with oils, snacks, and other goods.  \n- A red shopping cart is visible nearby, suggesting the person is shopping or restocking.\n[390-420s] - Person wearing black gloves arranges multiple small yogurt cups on a white tray, placing them in a grid pattern.  \n- The tray is positioned on a brightly lit supermarket shelf, surrounded by stacks of blue-labeled containers and green packaging.  \n- The person’s hands move methodically, adjusting the yogurt cups’ positions while maintaining a consistent spatial layout.\n[420-450s] - Person wearing black gloves places yogurt cups onto a white tray, arranging them in a grid pattern.  \n- The tray is positioned on a metal shelf, with other yogurt containers and blue-labeled items visible nearby.  \n- A green box labeled \"BIO\" is stacked on a lower shelf, partially obscured by cardboard boxes.\n[450-480s] - Person in black gloves picks up a white box labeled \"Kraft\" from a shelf.  \n- They place the box into a shopping cart positioned nearby.  \n- The cart contains other items, including a green box and a white container.\n[480-510s] - Person wearing black gloves places a green box onto a lower shelf while holding a white box labeled \"Mela\" in the other hand.  \n- The person then moves the white box to the floor, revealing a partially filled cardboard box beneath it.  \n- The person’s right hand reaches toward a metal shelf unit to the right, which contains stacked items and a red shopping cart nearby.\n[510-540s] - Person wearing black gloves places green-packaged items onto a metal shelf, then moves to another shelf to place more items.  \n- A cardboard box lies on the floor near the person’s feet, and a red cart is visible in the background.  \n- The person’s hands are actively handling products, with one hand holding a green box and the other placing items on the shelf.\n[540-570s] - Person wearing black gloves picks up green-and-white packaged items from a cardboard box on the floor.  \n- Items are placed onto a white shelf stocked with milk cartons and red plastic containers.  \n- A white box labeled \"MILK\" is visible on the floor nearby, suggesting ongoing inventory organization.", "history_tokens": 992, "history_utf8_bytes": 4232, "recent_frame_times_s": [564.0054, 565.0064, 566.0074, 567.0084, 568.0094, 569.0104, 570.0114, 571.0124, 572.0134, 573.0144, 574.0154, 575.0164, 576.0174, 577.0184, 578.0194, 579.0204, 580.0214, 581.0224, 582.0234, 583.0244, 584.0254, 585.0264, 586.0274, 587.0284, 588.0294, 589.0304, 590.0314, 591.0324, 592.0000333333334, 593.0010333333333], "recent_frames_sha256": "74f48a5d5fda467ba261167f6bb99796af809cbfd4e5f6effa5e6831850b6678", "num_recent_frames": 30, "tq": 715346.360903321, "t1": 715353.374962573, "ta": 715353.374962573, "te": 715353.695504222, "first_response_s": 7.014059252105653, "answer_total_s": 7.334600900998339, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 447, "content_group": "01dafaeff066daf757e536cec705a1307db9d9cbe6bab8f03f196e727d48aab1", "question": {"question_id": "sample_447_a469_q0", "video_id": 447, "video_path": "./videos/sample_447_real.mp4", "annotation_index": 469, "question_index": 0, "question": "What action does the person perform after kneeling down?", "options": ["A. Breaking down cardboard boxes.", "B. Placing and organizing boxes of milk on a shelf.", "C. Placing cartons on a metal cart.", "D. Removing gloves."], "answer": "B", "time_stamp_s": 8, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_447_a469_q0", "video_id": 447, "time_stamp_s": 8, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cff87a84452b071bd88f2bc9ba74008c0e370ccafbf9edd62c649e6d55b398fc", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.054, 1.0216333333333334, 2.0226333333333333, 3.023633333333333, 4.024633333333333, 5.025633333333333, 6.026633333333334, 7.027633333333333], "recent_frames_sha256": "ff19d15878d1052c1253a79c2702125db0d06a631bda8f61dbbe7ce6a2fe85a2", "num_recent_frames": 8, "tq": 715892.072336757, "t1": 715898.75055371, "ta": 715898.75055371, "te": 715898.787656978, "first_response_s": 6.678216953063384, "answer_total_s": 6.715320221032016, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_447_a469_q0", "video_id": 447, "time_stamp_s": 8, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3ad145089acd101df4ce4dcb0fd684774893aff86f98cf9403f6b82cd60d5673", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.054, 1.0216333333333334, 2.0226333333333333, 3.023633333333333, 4.024633333333333, 5.025633333333333, 6.026633333333334, 7.027633333333333], "recent_frames_sha256": "ff19d15878d1052c1253a79c2702125db0d06a631bda8f61dbbe7ce6a2fe85a2", "num_recent_frames": 8, "tq": 715930.695751508, "t1": 715941.364100068, "ta": 715941.364100068, "te": 715941.623529864, "first_response_s": 10.66834855999332, "answer_total_s": 10.927778356010094, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 447, "content_group": "01dafaeff066daf757e536cec705a1307db9d9cbe6bab8f03f196e727d48aab1", "question": {"question_id": "sample_447_a470_q0", "video_id": 447, "video_path": "./videos/sample_447_real.mp4", "annotation_index": 470, "question_index": 0, "question": "What kind of items is the person reaching for on the cart?", "options": ["A. Cheese blocks.", "B. Yogurt cups.", "C. Milk cartons.", "D. Bread loaves."], "answer": "B", "time_stamp_s": 163, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_447_a470_q0", "video_id": 447, "time_stamp_s": 163, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "984692e323f65fa1262fad9111d63553a0fe3020e43c1088666159b370366638", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [133.02016666666665, 134.02116666666666, 135.02216666666666, 136.02316666666667, 137.02416666666667, 138.02516666666668, 139.02616666666665, 140.02716666666666, 141.02816666666666, 142.02916666666667, 143.03016666666667, 144.03116666666668, 145.03216666666665, 146.03316666666666, 147.0008, 148.0018, 149.0028, 150.0038, 151.0048, 152.0058, 153.0068, 154.0078, 155.0088, 156.0098, 157.0108, 158.0118, 159.0128, 160.0138, 161.0148, 162.0158], "recent_frames_sha256": "0f8233b415734904a77899de0a8ca1084bae1c38c2c64637cee01f8287254728", "num_recent_frames": 30, "tq": 715898.803692615, "t1": 715905.066947566, "ta": 715905.066947566, "te": 715905.104406866, "first_response_s": 6.263254950987175, "answer_total_s": 6.300714251003228, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_447_a470_q0", "video_id": 447, "time_stamp_s": 163, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "906d743a345b9d2f4ca5f2ca2439a7afeb59779ff9b78af8abe0478691340a23", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person wearing black gloves and dark pants is unboxing items from a cardboard box on a store floor.  \n- They place green-packaged products onto a shelf, aligning them with existing items, while other boxes are visible nearby.  \n- The person then opens the box further, revealing more items inside, and begins to sort or arrange them.\n[30-60s] - Person in black gloves pushes a shopping cart through aisles, passing shelves stocked with Valio and Bresson products.  \n- Cart is loaded with a red crate of Mmmmm! chocolate bars and later filled with yogurt containers from a green pallet.  \n- Person places yogurt packs into the cart while standing near a plastic-wrapped stack of similar items on a green pallet.\n[60-90s] - Person pushes cart loaded with yogurt containers and paper towels through aisle, passing shelves stocked with various goods.  \n- Cart moves past a red bucket and cardboard boxes, then approaches a refrigerated section with empty shelves.  \n- Person places yogurt containers onto the refrigerated shelf, which has price tags and other items like bowls and containers nearby.\n[90-120s] - Person pushes shopping cart past shelves stocked with paper towels and toilet paper, then stops near a red cart loaded with bottled water.  \n- Person reaches for a box of \"Sensodyne\" toothpaste on a shelf, with price tag visible at $8.00.  \n- Person’s feet are visible on the floor, wearing black pants and shoes, as they stand near the shelf.\n[120-150s] - Person in dark clothing pushes red shopping cart through aisle, selecting items from shelves.  \n- Cart contains multiple blue-packaged goods and a stack of white cylindrical products.  \n- Shelves display price tags (e.g., \"15¢\", \"14¢\") and various packaged goods, including green boxes and brown cardboard items.", "history_tokens": 406, "history_utf8_bytes": 1791, "recent_frame_times_s": [133.02016666666665, 134.02116666666666, 135.02216666666666, 136.02316666666667, 137.02416666666667, 138.02516666666668, 139.02616666666665, 140.02716666666666, 141.02816666666666, 142.02916666666667, 143.03016666666667, 144.03116666666668, 145.03216666666665, 146.03316666666666, 147.0008, 148.0018, 149.0028, 150.0038, 151.0048, 152.0058, 153.0068, 154.0078, 155.0088, 156.0098, 157.0108, 158.0118, 159.0128, 160.0138, 161.0148, 162.0158], "recent_frames_sha256": "0f8233b415734904a77899de0a8ca1084bae1c38c2c64637cee01f8287254728", "num_recent_frames": 30, "tq": 715970.619809516, "t1": 715977.097102697, "ta": 715977.097102697, "te": 715977.136505326, "first_response_s": 6.477293181000277, "answer_total_s": 6.516695810016245, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 447, "content_group": "01dafaeff066daf757e536cec705a1307db9d9cbe6bab8f03f196e727d48aab1", "question": {"question_id": "sample_447_a471_q0", "video_id": 447, "video_path": "./videos/sample_447_real.mp4", "annotation_index": 471, "question_index": 0, "question": "What type of items is the viewer primarily handling in the video?", "options": ["A. Electronic gadgets.", "B. Dairy products.", "C. Clothing accessories.", "D. Stationery products."], "answer": "B", "time_stamp_s": 340, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_447_a471_q0", "video_id": 447, "time_stamp_s": 340, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "52313e34e9e25c9ca957ed15ecb38b3a21518118d3e671948fd5068a36bfaa6c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [310.0303333333333, 311.03133333333335, 312.0323333333333, 313.03333333333336, 314.00096666666667, 315.00196666666665, 316.0029666666667, 317.00396666666666, 318.0049666666667, 319.00596666666667, 320.00696666666664, 321.0079666666667, 322.00896666666665, 323.0099666666667, 324.01096666666666, 325.0119666666667, 326.01296666666667, 327.01396666666665, 328.0149666666667, 329.01596666666666, 330.0169666666667, 331.01796666666667, 332.01896666666664, 333.0199666666667, 334.02096666666665, 335.0219666666667, 336.02296666666666, 337.0239666666667, 338.02496666666667, 339.02596666666665], "recent_frames_sha256": "cf206168d44b1b897e7070ed259ab75dfc20a59757678c87b5ac343ca7c92568", "num_recent_frames": 30, "tq": 715905.119486373, "t1": 715912.482594413, "ta": 715912.482594413, "te": 715912.519277332, "first_response_s": 7.363108039950021, "answer_total_s": 7.39979095896706, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_447_a471_q0", "video_id": 447, "time_stamp_s": 340, "ground_truth": "B", "raw_output": "B. Dairy products.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "14810d26bd38d4706d1e103846aa83f64896c2b37644532360b6ff34b850fb28", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Person wearing black gloves and dark pants is unboxing items from a cardboard box on a store floor.  \n- They place green-packaged products onto a shelf, aligning them with existing items, while other boxes are visible nearby.  \n- The person then opens the box further, revealing more items inside, and begins to sort or arrange them.\n[30-60s] - Person in black gloves pushes a shopping cart through aisles, passing shelves stocked with Valio and Bresson products.  \n- Cart is loaded with a red crate of Mmmmm! chocolate bars and later filled with yogurt containers from a green pallet.  \n- Person places yogurt packs into the cart while standing near a plastic-wrapped stack of similar items on a green pallet.\n[60-90s] - Person pushes cart loaded with yogurt containers and paper towels through aisle, passing shelves stocked with various goods.  \n- Cart moves past a red bucket and cardboard boxes, then approaches a refrigerated section with empty shelves.  \n- Person places yogurt containers onto the refrigerated shelf, which has price tags and other items like bowls and containers nearby.\n[90-120s] - Person pushes shopping cart past shelves stocked with paper towels and toilet paper, then stops near a red cart loaded with bottled water.  \n- Person reaches for a box of \"Sensodyne\" toothpaste on a shelf, with price tag visible at $8.00.  \n- Person’s feet are visible on the floor, wearing black pants and shoes, as they stand near the shelf.\n[120-150s] - Person in dark clothing pushes red shopping cart through aisle, selecting items from shelves.  \n- Cart contains multiple blue-packaged goods and a stack of white cylindrical products.  \n- Shelves display price tags (e.g., \"15¢\", \"14¢\") and various packaged goods, including green boxes and brown cardboard items.\n[150-180s] - Person in black gloves picks up a container of yogurt from a shelf, then places it into a shopping cart.  \n- The cart is positioned near a section with various packaged goods, including boxes of eggs and other items.  \n- The person continues to move through the aisle, selecting additional items from the shelves.\n[180-210s] - Person in dark jacket and gloves reaches for a product on a high shelf while holding a cardboard box with white items.  \n- Shopping cart is positioned nearby, filled with various items including a stack of green boxes and a red container.  \n- Shelves display multiple products, including blue and white containers, with price tags visible, and a red fire extinguisher in the background.\n[210-240s] - Person in black gloves picks up white boxes labeled \"BIO\" from a shelf, placing them into a red shopping basket.  \n- Red plastic bins and other products are visible on the shelf, with price tags indicating \"28\" and \"29\".  \n- The person continues selecting items, moving boxes from the shelf to the basket while standing near a red bucket.\n[240-270s] - Person in black gloves pushes a shopping cart through a cluttered aisle, navigating around stacked boxes and crates.  \n- The cart contains various items, including blue-packaged goods and a red plastic crate, as the person moves forward.  \n- Shelves are densely packed with products, including boxes labeled \"PR\" and \"200,\" indicating a warehouse or storage area.\n[270-300s] - Person pushes shopping cart past stacked cardboard boxes and pallets.  \n- Cart moves along aisle with shelves stocked with various products.  \n- Person navigates through warehouse-like environment with forklifts and storage racks.\n[300-330s] - Worker places a cardboard box containing white cylindrical items onto a shelf, aligning it with existing stock.  \n- Worker then picks up another identical box from the floor, preparing to stack or arrange it nearby.  \n- A pile of cardboard boxes is visible on the floor, suggesting ongoing inventory or packing activity.", "history_tokens": 863, "history_utf8_bytes": 3825, "recent_frame_times_s": [310.0303333333333, 311.03133333333335, 312.0323333333333, 313.03333333333336, 314.00096666666667, 315.00196666666665, 316.0029666666667, 317.00396666666666, 318.0049666666667, 319.00596666666667, 320.00696666666664, 321.0079666666667, 322.00896666666665, 323.0099666666667, 324.01096666666666, 325.0119666666667, 326.01296666666667, 327.01396666666665, 328.0149666666667, 329.01596666666666, 330.0169666666667, 331.01796666666667, 332.01896666666664, 333.0199666666667, 334.02096666666665, 335.0219666666667, 336.02296666666666, 337.0239666666667, 338.02496666666667, 339.02596666666665], "recent_frames_sha256": "cf206168d44b1b897e7070ed259ab75dfc20a59757678c87b5ac343ca7c92568", "num_recent_frames": 30, "tq": 716030.287607937, "t1": 716031.49607016, "ta": 716031.49607016, "te": 716031.681574712, "first_response_s": 1.208462222944945, "answer_total_s": 1.3939667750382796, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 447, "content_group": "01dafaeff066daf757e536cec705a1307db9d9cbe6bab8f03f196e727d48aab1", "question": {"question_id": "sample_447_a472_q0", "video_id": 447, "video_path": "./videos/sample_447_real.mp4", "annotation_index": 472, "question_index": 0, "question": "What does the individual do after moving away from the shelf?", "options": ["A. Picks up another item to place on the shelf.", "B. Carries a cardboard box towards a stack of boxes.", "C. Sits down to take a break.", "D. Leaves the storage room."], "answer": "B", "time_stamp_s": 496, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_447_a472_q0", "video_id": 447, "time_stamp_s": 496, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1d0ed7e4559b50a6ab8e969dd6f478221f48363beda5f4901b32dcc03e0dbada", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [466.0195, 467.0205, 468.0215, 469.0225, 470.0235, 471.0245, 472.0255, 473.0265, 474.0275, 475.0285, 476.0295, 477.0305, 478.0315, 479.0325, 480.00013333333334, 481.0011333333333, 482.00213333333335, 483.0031333333333, 484.00413333333336, 485.00513333333333, 486.0061333333333, 487.00713333333334, 488.0081333333333, 489.00913333333335, 490.01013333333333, 491.0111333333333, 492.01213333333334, 493.0131333333333, 494.01413333333335, 495.0151333333333], "recent_frames_sha256": "347892e0eba8da08e48b632f40454b07e757b6c7816ad68195314b7d7aeaa5b4", "num_recent_frames": 30, "tq": 715912.531876622, "t1": 715923.331123032, "ta": 715923.331123032, "te": 715923.368685668, "first_response_s": 10.799246410024352, "answer_total_s": 10.83680904598441, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_447_a472_q0", "video_id": 447, "time_stamp_s": 496, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "be527a87ae8d9336bb0620f0e43f8e2ea8d8763e5f893975edebeabd616b993b", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Person pushes shopping cart past shelves stocked with paper towels and toilet paper, then stops near a red cart loaded with bottled water.  \n- Person reaches for a box of \"Sensodyne\" toothpaste on a shelf, with price tag visible at $8.00.  \n- Person’s feet are visible on the floor, wearing black pants and shoes, as they stand near the shelf.\n[120-150s] - Person in dark clothing pushes red shopping cart through aisle, selecting items from shelves.  \n- Cart contains multiple blue-packaged goods and a stack of white cylindrical products.  \n- Shelves display price tags (e.g., \"15¢\", \"14¢\") and various packaged goods, including green boxes and brown cardboard items.\n[150-180s] - Person in black gloves picks up a container of yogurt from a shelf, then places it into a shopping cart.  \n- The cart is positioned near a section with various packaged goods, including boxes of eggs and other items.  \n- The person continues to move through the aisle, selecting additional items from the shelves.\n[180-210s] - Person in dark jacket and gloves reaches for a product on a high shelf while holding a cardboard box with white items.  \n- Shopping cart is positioned nearby, filled with various items including a stack of green boxes and a red container.  \n- Shelves display multiple products, including blue and white containers, with price tags visible, and a red fire extinguisher in the background.\n[210-240s] - Person in black gloves picks up white boxes labeled \"BIO\" from a shelf, placing them into a red shopping basket.  \n- Red plastic bins and other products are visible on the shelf, with price tags indicating \"28\" and \"29\".  \n- The person continues selecting items, moving boxes from the shelf to the basket while standing near a red bucket.\n[240-270s] - Person in black gloves pushes a shopping cart through a cluttered aisle, navigating around stacked boxes and crates.  \n- The cart contains various items, including blue-packaged goods and a red plastic crate, as the person moves forward.  \n- Shelves are densely packed with products, including boxes labeled \"PR\" and \"200,\" indicating a warehouse or storage area.\n[270-300s] - Person pushes shopping cart past stacked cardboard boxes and pallets.  \n- Cart moves along aisle with shelves stocked with various products.  \n- Person navigates through warehouse-like environment with forklifts and storage racks.\n[300-330s] - Worker places a cardboard box containing white cylindrical items onto a shelf, aligning it with existing stock.  \n- Worker then picks up another identical box from the floor, preparing to stack or arrange it nearby.  \n- A pile of cardboard boxes is visible on the floor, suggesting ongoing inventory or packing activity.\n[330-360s] - Person wearing gloves picks up a cardboard box from the floor near shelves.  \n- They push a metal cart toward a pile of boxes, then begin sorting through them.  \n- Boxes are stacked in a disorganized pile on the floor, with some labeled and others unmarked.\n[360-390s] - Person's hand reaches for a box labeled \"25.99\" on a shelf, then picks up a box labeled \"29.99\" from the same shelf.  \n- The person walks away from the shelf, carrying the selected box, and approaches a pile of cardboard boxes on the floor.  \n- The person uses a forklift to lift the pile of boxes, indicating a transition from shelf selection to moving items.\n[390-420s] - Worker uses forklift to move stack of boxes across warehouse floor.  \n- Boxes are placed on shelves, with some already stacked on top of each other.  \n- Worker’s gloved hands handle boxes, placing them on shelves near price tags.\n[420-450s] - Person wearing black gloves and jacket is kneeling on floor, reaching for items on shelf.  \n- They are handling a cardboard box containing white cylindrical containers, placing them on the shelf.  \n- Shelf has price tags (e.g., \"16\") and other packaged goods, including boxes labeled \"NATURE\" and \"10\".\n[450-480s] - Person wearing black gloves picks up a blue and white box from a shelf, placing it into a cardboard box on the floor.  \n- The person then reaches for another box, labeled with a price tag of \"20\", and places it into the same cardboard box.  \n- A red pallet jack is visible in the background, positioned near a stack of cardboard boxes.", "history_tokens": 1015, "history_utf8_bytes": 4274, "recent_frame_times_s": [466.0195, 467.0205, 468.0215, 469.0225, 470.0235, 471.0245, 472.0255, 473.0265, 474.0275, 475.0285, 476.0295, 477.0305, 478.0315, 479.0325, 480.00013333333334, 481.0011333333333, 482.00213333333335, 483.0031333333333, 484.00413333333336, 485.00513333333333, 486.0061333333333, 487.00713333333334, 488.0081333333333, 489.00913333333335, 490.01013333333333, 491.0111333333333, 492.01213333333334, 493.0131333333333, 494.01413333333335, 495.0151333333333], "recent_frames_sha256": "347892e0eba8da08e48b632f40454b07e757b6c7816ad68195314b7d7aeaa5b4", "num_recent_frames": 30, "tq": 716076.445702341, "t1": 716082.905374302, "ta": 716082.905374302, "te": 716083.055402884, "first_response_s": 6.459671960910782, "answer_total_s": 6.60970054299105, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 447, "content_group": "01dafaeff066daf757e536cec705a1307db9d9cbe6bab8f03f196e727d48aab1", "question": {"question_id": "sample_447_a473_q0", "video_id": 447, "video_path": "./videos/sample_447_real.mp4", "annotation_index": 473, "question_index": 0, "question": "What is the person wearing on his right wrist?", "options": ["A. A silver watch.", "B. A leather bracelet.", "C. A gold bracelet.", "D. A rubber band."], "answer": "C", "time_stamp_s": 581, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [540, 599], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_447_a473_q0", "video_id": 447, "time_stamp_s": 581, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6546fd5f222511e6bba464f47c054453655dbf0980c0c634029ed3b87d4add99", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [551.0044, 552.0054, 553.0064, 554.0074, 555.0084, 556.0094, 557.0104, 558.0114, 559.0124, 560.0134, 561.0144, 562.0154, 563.0164, 564.0174, 565.0184, 566.0194, 567.0204, 568.0214, 569.0224, 570.0234, 571.0244, 572.0254, 573.0264, 574.0274, 575.0284, 576.0294, 577.0304, 578.0314, 579.0324, 580.0000333333334], "recent_frames_sha256": "a9bdab6afe8973755d8b0e96e72cbb473da7ac80463b6cc6adc5cbad953125e7", "num_recent_frames": 30, "tq": 715923.383183009, "t1": 715930.639161457, "ta": 715930.639161457, "te": 715930.676759459, "first_response_s": 7.255978447967209, "answer_total_s": 7.293576449970715, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_447_a473_q0", "video_id": 447, "time_stamp_s": 581, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ee5ba06ddd61357c396d91c5879e5b36f4ad75eae6bfb2a5ecd634d41b37f4c1", "condition_order": ["recent", "notes"], "memory": "[180-210s] - Person in dark jacket and gloves reaches for a product on a high shelf while holding a cardboard box with white items.  \n- Shopping cart is positioned nearby, filled with various items including a stack of green boxes and a red container.  \n- Shelves display multiple products, including blue and white containers, with price tags visible, and a red fire extinguisher in the background.\n[210-240s] - Person in black gloves picks up white boxes labeled \"BIO\" from a shelf, placing them into a red shopping basket.  \n- Red plastic bins and other products are visible on the shelf, with price tags indicating \"28\" and \"29\".  \n- The person continues selecting items, moving boxes from the shelf to the basket while standing near a red bucket.\n[240-270s] - Person in black gloves pushes a shopping cart through a cluttered aisle, navigating around stacked boxes and crates.  \n- The cart contains various items, including blue-packaged goods and a red plastic crate, as the person moves forward.  \n- Shelves are densely packed with products, including boxes labeled \"PR\" and \"200,\" indicating a warehouse or storage area.\n[270-300s] - Person pushes shopping cart past stacked cardboard boxes and pallets.  \n- Cart moves along aisle with shelves stocked with various products.  \n- Person navigates through warehouse-like environment with forklifts and storage racks.\n[300-330s] - Worker places a cardboard box containing white cylindrical items onto a shelf, aligning it with existing stock.  \n- Worker then picks up another identical box from the floor, preparing to stack or arrange it nearby.  \n- A pile of cardboard boxes is visible on the floor, suggesting ongoing inventory or packing activity.\n[330-360s] - Person wearing gloves picks up a cardboard box from the floor near shelves.  \n- They push a metal cart toward a pile of boxes, then begin sorting through them.  \n- Boxes are stacked in a disorganized pile on the floor, with some labeled and others unmarked.\n[360-390s] - Person's hand reaches for a box labeled \"25.99\" on a shelf, then picks up a box labeled \"29.99\" from the same shelf.  \n- The person walks away from the shelf, carrying the selected box, and approaches a pile of cardboard boxes on the floor.  \n- The person uses a forklift to lift the pile of boxes, indicating a transition from shelf selection to moving items.\n[390-420s] - Worker uses forklift to move stack of boxes across warehouse floor.  \n- Boxes are placed on shelves, with some already stacked on top of each other.  \n- Worker’s gloved hands handle boxes, placing them on shelves near price tags.\n[420-450s] - Person wearing black gloves and jacket is kneeling on floor, reaching for items on shelf.  \n- They are handling a cardboard box containing white cylindrical containers, placing them on the shelf.  \n- Shelf has price tags (e.g., \"16\") and other packaged goods, including boxes labeled \"NATURE\" and \"10\".\n[450-480s] - Person wearing black gloves picks up a blue and white box from a shelf, placing it into a cardboard box on the floor.  \n- The person then reaches for another box, labeled with a price tag of \"20\", and places it into the same cardboard box.  \n- A red pallet jack is visible in the background, positioned near a stack of cardboard boxes.\n[480-510s] - Person in black gloves reaches for a product on a high shelf, pulling it down with a blue tool.  \n- A pallet jack with stacked cardboard boxes is positioned nearby, suggesting ongoing inventory movement.  \n- The person’s gloved hand is actively engaged in removing or adjusting a product from the shelf.\n[510-540s] - Person's gloved hands reach for and lift a white box labeled \"GARANT SOL\" from a high shelf.  \n- The person's feet are visible on the floor, wearing dark pants and brown boots, near cardboard boxes.  \n- A price tag showing \"34.95\" is visible on the shelf as the person adjusts the box.\n[540-570s] - Person wearing black gloves and dark pants reaches into a low shelf to retrieve a cardboard box.  \n- The person lifts the box from the shelf and places it onto a red shopping cart.  \n- Several other cardboard boxes are visible on the floor near the cart, suggesting ongoing inventory handling.", "history_tokens": 996, "history_utf8_bytes": 4186, "recent_frame_times_s": [551.0044, 552.0054, 553.0064, 554.0074, 555.0084, 556.0094, 557.0104, 558.0114, 559.0124, 560.0134, 561.0144, 562.0154, 563.0164, 564.0174, 565.0184, 566.0194, 567.0204, 568.0214, 569.0224, 570.0234, 571.0244, 572.0254, 573.0264, 574.0274, 575.0284, 576.0294, 577.0304, 578.0314, 579.0324, 580.0000333333334], "recent_frames_sha256": "a9bdab6afe8973755d8b0e96e72cbb473da7ac80463b6cc6adc5cbad953125e7", "num_recent_frames": 30, "tq": 716106.985865121, "t1": 716108.803631728, "ta": 716108.803631728, "te": 716108.844322858, "first_response_s": 1.8177666070405394, "answer_total_s": 1.8584577370202169, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 448, "content_group": "e0728c6969dc5d5b6560e2499117824ad79a42a471c3ddd0ff47f44290e9f53b", "question": {"question_id": "sample_448_a956_q0", "video_id": 448, "video_path": "./videos/sample_448_real.mp4", "annotation_index": 956, "question_index": 0, "question": "What is the state of the shelves as the individual continues to stock them?", "options": ["A. Shelves are mostly empty.", "B. The shelves are already full.", "C. Shelves are cluttered and disorganized.", "D. Shelves are orderly and packed with products."], "answer": "D", "time_stamp_s": 20, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_448_a956_q0", "video_id": 448, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "888cf7a6baf82b14bde517084306d4ed9cfeaa2273d9b07808c63d395d235923", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.034, 1.0016333333333334, 2.0026333333333333, 3.003633333333333, 4.0046333333333335, 5.005633333333333, 6.006633333333333, 7.007633333333334, 8.008633333333334, 9.009633333333333, 10.010633333333333, 11.011633333333334, 12.012633333333333, 13.013633333333333, 14.014633333333334, 15.015633333333334, 16.016633333333335, 17.017633333333333, 18.018633333333334, 19.019633333333335], "recent_frames_sha256": "ca280b8b1858b3524e3c633c089b5c609ab19a13b1530c4dc7a8fa907bb997ad", "num_recent_frames": 20, "tq": 717732.063906513, "t1": 717732.693218926, "ta": 717732.693218926, "te": 717732.730468339, "first_response_s": 0.6293124129297212, "answer_total_s": 0.6665618260158226, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_448_a956_q0", "video_id": 448, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "10dcbb315fdf9cada6fbaec70c022a20bb488c77001344003d72e1eba2bca90f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.034, 1.0016333333333334, 2.0026333333333333, 3.003633333333333, 4.0046333333333335, 5.005633333333333, 6.006633333333333, 7.007633333333334, 8.008633333333334, 9.009633333333333, 10.010633333333333, 11.011633333333334, 12.012633333333333, 13.013633333333333, 14.014633333333334, 15.015633333333334, 16.016633333333335, 17.017633333333333, 18.018633333333334, 19.019633333333335], "recent_frames_sha256": "ca280b8b1858b3524e3c633c089b5c609ab19a13b1530c4dc7a8fa907bb997ad", "num_recent_frames": 20, "tq": 717779.892883366, "t1": 717791.795795649, "ta": 717791.795795649, "te": 717792.00041583, "first_response_s": 11.902912283083424, "answer_total_s": 12.107532464084215, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 448, "content_group": "e0728c6969dc5d5b6560e2499117824ad79a42a471c3ddd0ff47f44290e9f53b", "question": {"question_id": "sample_448_a957_q0", "video_id": 448, "video_path": "./videos/sample_448_real.mp4", "annotation_index": 957, "question_index": 0, "question": "What type of perspective is shown in the video?", "options": ["A. Third-person perspective.", "B. Aerial perspective.", "C. First-person perspective.", "D. Side perspective."], "answer": "C", "time_stamp_s": 143, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_448_a957_q0", "video_id": 448, "time_stamp_s": 143, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b6e68ee49b40440bbf66f2b064c66719e697759ced277fb71fdc1391fe3c9e56", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [113.01353333333333, 114.01453333333333, 115.01553333333334, 116.01653333333333, 117.01753333333333, 118.01853333333334, 119.01953333333333, 120.02053333333333, 121.02153333333334, 122.02253333333333, 123.02353333333333, 124.02453333333334, 125.02553333333333, 126.02653333333333, 127.02753333333334, 128.02853333333334, 129.02953333333335, 130.03053333333332, 131.03153333333333, 132.03253333333333, 133.00016666666667, 134.00116666666668, 135.00216666666665, 136.00316666666666, 137.00416666666666, 138.00516666666667, 139.00616666666667, 140.00716666666668, 141.00816666666665, 142.00916666666666], "recent_frames_sha256": "c51a93e91f3ddcb809f114bce12744333b4d6850457bb40a56b8638eefbb3ec9", "num_recent_frames": 30, "tq": 717732.744571854, "t1": 717744.43421427, "ta": 717744.43421427, "te": 717744.478128269, "first_response_s": 11.689642415964045, "answer_total_s": 11.733556414954364, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_448_a957_q0", "video_id": 448, "time_stamp_s": 143, "ground_truth": "C", "raw_output": "C. First-person perspective.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "7a1fc8beb50f6d5443d2e6c764894340d7b9de27ff9fec3db4cc890279c3b8b1", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Worker in black gloves and jacket picks up white boxes from shelves and places them into a red shopping cart.  \n- Boxes are stacked on the floor near the cart, indicating ongoing inventory movement.  \n- Shelves are densely packed with various products, including boxes labeled with price tags.\n[30-60s] - Person’s hand reaches for a box on a high shelf, then pulls it down.  \n- A shopping cart is pushed along the aisle, carrying several cardboard boxes.  \n- The cart moves past stacked boxes and shelves, navigating through a cluttered storage area.\n[60-90s] - Person's gloved hands reach for and pick up a box labeled \"Kaffee\" priced at 15.50 from a shelf.  \n- The box is lifted slightly, revealing its green and white packaging with a logo.  \n- The person's other hand is visible near the shelf, possibly holding or adjusting another item.\n[90-120s] - Person in black gloves picks up green-packaged items from shelf, places them in cart.  \n- Cart is loaded with multiple cardboard boxes and green-packaged goods, moving along aisle.  \n- Person walks past shelves with price tags (e.g., \"14.99\", \"15.99\") while handling items.", "history_tokens": 280, "history_utf8_bytes": 1140, "recent_frame_times_s": [113.01353333333333, 114.01453333333333, 115.01553333333334, 116.01653333333333, 117.01753333333333, 118.01853333333334, 119.01953333333333, 120.02053333333333, 121.02153333333334, 122.02253333333333, 123.02353333333333, 124.02453333333334, 125.02553333333333, 126.02653333333333, 127.02753333333334, 128.02853333333334, 129.02953333333335, 130.03053333333332, 131.03153333333333, 132.03253333333333, 133.00016666666667, 134.00116666666668, 135.00216666666665, 136.00316666666666, 137.00416666666666, 138.00516666666667, 139.00616666666667, 140.00716666666668, 141.00816666666665, 142.00916666666666], "recent_frames_sha256": "c51a93e91f3ddcb809f114bce12744333b4d6850457bb40a56b8638eefbb3ec9", "num_recent_frames": 30, "tq": 717822.700430328, "t1": 717825.630089623, "ta": 717825.630089623, "te": 717826.067311884, "first_response_s": 2.929659295012243, "answer_total_s": 3.3668815559940413, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 448, "content_group": "e0728c6969dc5d5b6560e2499117824ad79a42a471c3ddd0ff47f44290e9f53b", "question": {"question_id": "sample_448_a958_q0", "video_id": 448, "video_path": "./videos/sample_448_real.mp4", "annotation_index": 958, "question_index": 0, "question": "What color are the cartons of milk on the shelf?", "options": ["A. Yellow with different colored sections.", "B. White with different colored sections.", "C. Green with different colored sections.", "D. Red with different colored sections."], "answer": "B", "time_stamp_s": 291, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_448_a958_q0", "video_id": 448, "time_stamp_s": 291, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5ea1eaca05b764fdaf43de56d45d9c30e6b97dd4c7665437484cdcc9e067cbc8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [261.0280666666667, 262.02906666666667, 263.03006666666664, 264.0310666666667, 265.03206666666665, 266.0330666666667, 267.0007, 268.0017, 269.0027, 270.0037, 271.0047, 272.0057, 273.0067, 274.0077, 275.0087, 276.0097, 277.0107, 278.0117, 279.0127, 280.0137, 281.0147, 282.0157, 283.0167, 284.0177, 285.0187, 286.0197, 287.0207, 288.0217, 289.0227, 290.0237], "recent_frames_sha256": "6c337e52dcebd526555659a904a3bb1d75d309c2c9ff29b03ed13d46ed23a990", "num_recent_frames": 30, "tq": 717744.492467874, "t1": 717756.942654172, "ta": 717756.942654172, "te": 717756.980657234, "first_response_s": 12.45018629799597, "answer_total_s": 12.488189360010438, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_448_a958_q0", "video_id": 448, "time_stamp_s": 291, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cd9a68b8d7eb00e99a6ec93750ccc7ea7f8344e2395fa7d00e1ec885ca878ca4", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Worker in black gloves and jacket picks up white boxes from shelves and places them into a red shopping cart.  \n- Boxes are stacked on the floor near the cart, indicating ongoing inventory movement.  \n- Shelves are densely packed with various products, including boxes labeled with price tags.\n[30-60s] - Person’s hand reaches for a box on a high shelf, then pulls it down.  \n- A shopping cart is pushed along the aisle, carrying several cardboard boxes.  \n- The cart moves past stacked boxes and shelves, navigating through a cluttered storage area.\n[60-90s] - Person's gloved hands reach for and pick up a box labeled \"Kaffee\" priced at 15.50 from a shelf.  \n- The box is lifted slightly, revealing its green and white packaging with a logo.  \n- The person's other hand is visible near the shelf, possibly holding or adjusting another item.\n[90-120s] - Person in black gloves picks up green-packaged items from shelf, places them in cart.  \n- Cart is loaded with multiple cardboard boxes and green-packaged goods, moving along aisle.  \n- Person walks past shelves with price tags (e.g., \"14.99\", \"15.99\") while handling items.\n[120-150s] - Person removes a \"VISPGRADE\" box from a shelf, revealing a price tag of \"31.95\" beneath it.\n- The person then stacks multiple cardboard boxes onto a metal cart, moving them away from the shelf.\n- Boxes are piled on the floor near the cart, indicating a bulk collection or sorting activity.\n[150-180s] - Person wearing black gloves picks up a cardboard box from a pile on the floor.  \n- They place the box onto a metal shelf stocked with various product boxes, including \"LIFETIME\" and \"BAGGOKA\" brands.  \n- The person adjusts the box position on the shelf, aligning it with price tags indicating $16.95 and $19.95.\n[180-210s] - Person wearing black gloves picks up a box labeled \"22\" from a high shelf.  \n- They move to a lower shelf, placing a purple box labeled \"25\" onto the shelf.  \n- The person then walks toward a pile of cardboard boxes on the floor, carrying a box labeled \"26\".\n[210-240s] - Hands in black gloves pick up and place items like \"Coca-Cola\" and \"Coca-Cola Light\" bottles on shelves.  \n- A pile of cardboard boxes is visible on the floor near a green shopping cart.  \n- The person moves between shelves, adjusting products and occasionally reaching for items from lower shelves.\n[240-270s] - Worker's gloved hands lift and carry multiple cardboard boxes, some labeled \"Sagolika,\" through a cluttered warehouse floor.  \n- Boxes are stacked and moved around, with some being opened to reveal packaged goods like \"Pillsbury\" items.  \n- The worker navigates between piles of boxes and shelves stocked with various products, including \"Pillsbury\" and \"Sagolika\" branded items.", "history_tokens": 696, "history_utf8_bytes": 2746, "recent_frame_times_s": [261.0280666666667, 262.02906666666667, 263.03006666666664, 264.0310666666667, 265.03206666666665, 266.0330666666667, 267.0007, 268.0017, 269.0027, 270.0037, 271.0047, 272.0057, 273.0067, 274.0077, 275.0087, 276.0097, 277.0107, 278.0117, 279.0127, 280.0137, 281.0147, 282.0157, 283.0167, 284.0177, 285.0187, 286.0197, 287.0207, 288.0217, 289.0227, 290.0237], "recent_frames_sha256": "6c337e52dcebd526555659a904a3bb1d75d309c2c9ff29b03ed13d46ed23a990", "num_recent_frames": 30, "tq": 717889.123525977, "t1": 717892.003292199, "ta": 717892.003292199, "te": 717892.20161401, "first_response_s": 2.8797662219731137, "answer_total_s": 3.078088033013046, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 448, "content_group": "e0728c6969dc5d5b6560e2499117824ad79a42a471c3ddd0ff47f44290e9f53b", "question": {"question_id": "sample_448_a959_q1", "video_id": 448, "video_path": "./videos/sample_448_real.mp4", "annotation_index": 959, "question_index": 1, "question": "What action did the person perform repeatedly just now?", "options": ["A. Organizing products on shelves.", "B. Flattening cardboard boxes.", "C. Picking up and placing boxes in a cart.", "D. Moving the cart towards the door."], "answer": "C", "time_stamp_s": 431, "task_type": "Action Recognition", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_448_a959_q1", "video_id": 448, "time_stamp_s": 431, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "efbf571a336b12ad1b8fc664dd240e04312a933d5052b98e9213ef2664aa3933", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [401.00123333333335, 402.0022333333333, 403.00323333333336, 404.00423333333333, 405.0052333333333, 406.00623333333334, 407.0072333333333, 408.00823333333335, 409.0092333333333, 410.01023333333336, 411.01123333333334, 412.0122333333333, 413.01323333333335, 414.0142333333333, 415.01523333333336, 416.01623333333333, 417.0172333333333, 418.01823333333334, 419.0192333333333, 420.02023333333335, 421.0212333333333, 422.02223333333336, 423.02323333333334, 424.0242333333333, 425.02523333333335, 426.0262333333333, 427.02723333333336, 428.02823333333333, 429.0292333333333, 430.03023333333334], "recent_frames_sha256": "8ebf3d47854687c24fa7215cd03cb653cbbdcbbc322620c3e8f1f520fa3775e2", "num_recent_frames": 30, "tq": 717756.992142587, "t1": 717765.438216335, "ta": 717765.438216335, "te": 717765.476503743, "first_response_s": 8.446073748054914, "answer_total_s": 8.484361156006344, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_448_a959_q1", "video_id": 448, "time_stamp_s": 431, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "60982d515ee283614fc02800b76ba76da9a6b25b04a57c5b7a6650d40fac155e", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Person’s hand reaches for a box on a high shelf, then pulls it down.  \n- A shopping cart is pushed along the aisle, carrying several cardboard boxes.  \n- The cart moves past stacked boxes and shelves, navigating through a cluttered storage area.\n[60-90s] - Person's gloved hands reach for and pick up a box labeled \"Kaffee\" priced at 15.50 from a shelf.  \n- The box is lifted slightly, revealing its green and white packaging with a logo.  \n- The person's other hand is visible near the shelf, possibly holding or adjusting another item.\n[90-120s] - Person in black gloves picks up green-packaged items from shelf, places them in cart.  \n- Cart is loaded with multiple cardboard boxes and green-packaged goods, moving along aisle.  \n- Person walks past shelves with price tags (e.g., \"14.99\", \"15.99\") while handling items.\n[120-150s] - Person removes a \"VISPGRADE\" box from a shelf, revealing a price tag of \"31.95\" beneath it.\n- The person then stacks multiple cardboard boxes onto a metal cart, moving them away from the shelf.\n- Boxes are piled on the floor near the cart, indicating a bulk collection or sorting activity.\n[150-180s] - Person wearing black gloves picks up a cardboard box from a pile on the floor.  \n- They place the box onto a metal shelf stocked with various product boxes, including \"LIFETIME\" and \"BAGGOKA\" brands.  \n- The person adjusts the box position on the shelf, aligning it with price tags indicating $16.95 and $19.95.\n[180-210s] - Person wearing black gloves picks up a box labeled \"22\" from a high shelf.  \n- They move to a lower shelf, placing a purple box labeled \"25\" onto the shelf.  \n- The person then walks toward a pile of cardboard boxes on the floor, carrying a box labeled \"26\".\n[210-240s] - Hands in black gloves pick up and place items like \"Coca-Cola\" and \"Coca-Cola Light\" bottles on shelves.  \n- A pile of cardboard boxes is visible on the floor near a green shopping cart.  \n- The person moves between shelves, adjusting products and occasionally reaching for items from lower shelves.\n[240-270s] - Worker's gloved hands lift and carry multiple cardboard boxes, some labeled \"Sagolika,\" through a cluttered warehouse floor.  \n- Boxes are stacked and moved around, with some being opened to reveal packaged goods like \"Pillsbury\" items.  \n- The worker navigates between piles of boxes and shelves stocked with various products, including \"Pillsbury\" and \"Sagolika\" branded items.\n[270-300s] - Person wearing black gloves picks up a cardboard box from a pile on the floor.  \n- They carry the box toward a store aisle with shelves stocked with various products.  \n- The person places the box on a shelf near items labeled with prices like \"31.99\" and \"20.99\".\n[300-330s] - Person wearing black gloves picks up a white plastic container from a shelf.  \n- The container is placed into a cardboard box on the floor.  \n- A pile of cardboard boxes is visible near a green cart in the background.\n[330-360s] - Person in dark clothing picks up a cardboard box from the floor near a shopping cart.  \n- They place a box of \"GRANDE\" items (price tag visible) onto a high shelf.  \n- Several other cardboard boxes are scattered on the floor and shelves around them.\n[360-390s] - Person wearing black gloves picks up a cardboard box from a low shelf, then places it on the floor.  \n- The shelf above has visible price tags (e.g., \"31\" and \"20\") and partially stocked items like \"Viscose\" and \"Honeycomb\" products.  \n- Several other cardboard boxes are scattered on the floor near the person’s feet.\n[390-420s] - Person places a cardboard box onto a shelf, then removes it, revealing a price tag of \"31\" on the shelf.  \n- The person walks past a pile of cardboard boxes on the floor, moving toward a cart with green boxes.  \n- A red plastic crate and a metal cart are visible near the pile of boxes, with the person stepping over them.", "history_tokens": 1004, "history_utf8_bytes": 3884, "recent_frame_times_s": [401.00123333333335, 402.0022333333333, 403.00323333333336, 404.00423333333333, 405.0052333333333, 406.00623333333334, 407.0072333333333, 408.00823333333335, 409.0092333333333, 410.01023333333336, 411.01123333333334, 412.0122333333333, 413.01323333333335, 414.0142333333333, 415.01523333333336, 416.01623333333333, 417.0172333333333, 418.01823333333334, 419.0192333333333, 420.02023333333335, 421.0212333333333, 422.02223333333336, 423.02323333333334, 424.0242333333333, 425.02523333333335, 426.0262333333333, 427.02723333333336, 428.02823333333333, 429.0292333333333, 430.03023333333334], "recent_frames_sha256": "8ebf3d47854687c24fa7215cd03cb653cbbdcbbc322620c3e8f1f520fa3775e2", "num_recent_frames": 30, "tq": 717931.920892039, "t1": 717940.798892206, "ta": 717940.798892206, "te": 717941.044356915, "first_response_s": 8.878000167082064, "answer_total_s": 9.123464876087382, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 448, "content_group": "e0728c6969dc5d5b6560e2499117824ad79a42a471c3ddd0ff47f44290e9f53b", "question": {"question_id": "sample_448_a959_q0", "video_id": 448, "video_path": "./videos/sample_448_real.mp4", "annotation_index": 959, "question_index": 0, "question": "What color are the boxes labeled \"Bregott\"?", "options": ["A. Red.", "B. Blue.", "C. Green.", "D. Orange."], "answer": "C", "time_stamp_s": 435, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_448_a959_q0", "video_id": 448, "time_stamp_s": 435, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "54a33aaf582ba0ce6a7ffef11d7a10d34deb6e4979d09caebefa46192dc50f84", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [405.0052333333333, 406.00623333333334, 407.0072333333333, 408.00823333333335, 409.0092333333333, 410.01023333333336, 411.01123333333334, 412.0122333333333, 413.01323333333335, 414.0142333333333, 415.01523333333336, 416.01623333333333, 417.0172333333333, 418.01823333333334, 419.0192333333333, 420.02023333333335, 421.0212333333333, 422.02223333333336, 423.02323333333334, 424.0242333333333, 425.02523333333335, 426.0262333333333, 427.02723333333336, 428.02823333333333, 429.0292333333333, 430.03023333333334, 431.0312333333333, 432.03223333333335, 433.0332333333333, 434.00086666666664], "recent_frames_sha256": "6768a4fb9be0bcf30d45e76c3e6e489e0896ecc9439398d09d0ef14f72e55746", "num_recent_frames": 30, "tq": 717765.485994916, "t1": 717779.693097086, "ta": 717779.693097086, "te": 717779.882814078, "first_response_s": 14.207102170097642, "answer_total_s": 14.396819162066095, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_448_a959_q0", "video_id": 448, "time_stamp_s": 435, "ground_truth": "C", "raw_output": "C. Green.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "dafe61b9b5560e8db0e5643bc0b8338b9522cc166420a0b276575bddfe6ed5ab", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Person’s hand reaches for a box on a high shelf, then pulls it down.  \n- A shopping cart is pushed along the aisle, carrying several cardboard boxes.  \n- The cart moves past stacked boxes and shelves, navigating through a cluttered storage area.\n[60-90s] - Person's gloved hands reach for and pick up a box labeled \"Kaffee\" priced at 15.50 from a shelf.  \n- The box is lifted slightly, revealing its green and white packaging with a logo.  \n- The person's other hand is visible near the shelf, possibly holding or adjusting another item.\n[90-120s] - Person in black gloves picks up green-packaged items from shelf, places them in cart.  \n- Cart is loaded with multiple cardboard boxes and green-packaged goods, moving along aisle.  \n- Person walks past shelves with price tags (e.g., \"14.99\", \"15.99\") while handling items.\n[120-150s] - Person removes a \"VISPGRADE\" box from a shelf, revealing a price tag of \"31.95\" beneath it.\n- The person then stacks multiple cardboard boxes onto a metal cart, moving them away from the shelf.\n- Boxes are piled on the floor near the cart, indicating a bulk collection or sorting activity.\n[150-180s] - Person wearing black gloves picks up a cardboard box from a pile on the floor.  \n- They place the box onto a metal shelf stocked with various product boxes, including \"LIFETIME\" and \"BAGGOKA\" brands.  \n- The person adjusts the box position on the shelf, aligning it with price tags indicating $16.95 and $19.95.\n[180-210s] - Person wearing black gloves picks up a box labeled \"22\" from a high shelf.  \n- They move to a lower shelf, placing a purple box labeled \"25\" onto the shelf.  \n- The person then walks toward a pile of cardboard boxes on the floor, carrying a box labeled \"26\".\n[210-240s] - Hands in black gloves pick up and place items like \"Coca-Cola\" and \"Coca-Cola Light\" bottles on shelves.  \n- A pile of cardboard boxes is visible on the floor near a green shopping cart.  \n- The person moves between shelves, adjusting products and occasionally reaching for items from lower shelves.\n[240-270s] - Worker's gloved hands lift and carry multiple cardboard boxes, some labeled \"Sagolika,\" through a cluttered warehouse floor.  \n- Boxes are stacked and moved around, with some being opened to reveal packaged goods like \"Pillsbury\" items.  \n- The worker navigates between piles of boxes and shelves stocked with various products, including \"Pillsbury\" and \"Sagolika\" branded items.\n[270-300s] - Person wearing black gloves picks up a cardboard box from a pile on the floor.  \n- They carry the box toward a store aisle with shelves stocked with various products.  \n- The person places the box on a shelf near items labeled with prices like \"31.99\" and \"20.99\".\n[300-330s] - Person wearing black gloves picks up a white plastic container from a shelf.  \n- The container is placed into a cardboard box on the floor.  \n- A pile of cardboard boxes is visible near a green cart in the background.\n[330-360s] - Person in dark clothing picks up a cardboard box from the floor near a shopping cart.  \n- They place a box of \"GRANDE\" items (price tag visible) onto a high shelf.  \n- Several other cardboard boxes are scattered on the floor and shelves around them.\n[360-390s] - Person wearing black gloves picks up a cardboard box from a low shelf, then places it on the floor.  \n- The shelf above has visible price tags (e.g., \"31\" and \"20\") and partially stocked items like \"Viscose\" and \"Honeycomb\" products.  \n- Several other cardboard boxes are scattered on the floor near the person’s feet.\n[390-420s] - Person places a cardboard box onto a shelf, then removes it, revealing a price tag of \"31\" on the shelf.  \n- The person walks past a pile of cardboard boxes on the floor, moving toward a cart with green boxes.  \n- A red plastic crate and a metal cart are visible near the pile of boxes, with the person stepping over them.", "history_tokens": 1004, "history_utf8_bytes": 3884, "recent_frame_times_s": [405.0052333333333, 406.00623333333334, 407.0072333333333, 408.00823333333335, 409.0092333333333, 410.01023333333336, 411.01123333333334, 412.0122333333333, 413.01323333333335, 414.0142333333333, 415.01523333333336, 416.01623333333333, 417.0172333333333, 418.01823333333334, 419.0192333333333, 420.02023333333335, 421.0212333333333, 422.02223333333336, 423.02323333333334, 424.0242333333333, 425.02523333333335, 426.0262333333333, 427.02723333333336, 428.02823333333333, 429.0292333333333, 430.03023333333334, 431.0312333333333, 432.03223333333335, 433.0332333333333, 434.00086666666664], "recent_frames_sha256": "6768a4fb9be0bcf30d45e76c3e6e489e0896ecc9439398d09d0ef14f72e55746", "num_recent_frames": 30, "tq": 717941.072971834, "t1": 717947.971450774, "ta": 717947.971450774, "te": 717948.126925361, "first_response_s": 6.898478940012865, "answer_total_s": 7.053953527007252, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 449, "content_group": "4393a549211c22a795d406f966430994e52b85cf4d40030f38dbaa38deb72881", "question": {"question_id": "sample_449_a595_q0", "video_id": 449, "video_path": "./videos/sample_449_real.mp4", "annotation_index": 595, "question_index": 0, "question": "What object is being pushed at the beginning of the video?", "options": ["A. A stroller.", "B. A metal shopping cart.", "C. A suitcase.", "D. A wheelbarrow."], "answer": "B", "time_stamp_s": 20, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_449_a595_q0", "video_id": 449, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7bf9de26b1c67a3f0ec9f44181d645f6b69337a79b3b44d95c87a0611792bbdf", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019], "recent_frames_sha256": "84c9b77a76b236675e078b5a93fb7693a5884b8f95459a35920ffff7b2f4a227", "num_recent_frames": 20, "tq": 719293.484680244, "t1": 719300.345462335, "ta": 719300.345462335, "te": 719300.388153907, "first_response_s": 6.860782091040164, "answer_total_s": 6.903473663027398, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_449_a595_q0", "video_id": 449, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3d6425f5d0c916bcc932e652124c601645fbba7b03c93c1cb3a97df6d7a40c33", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003, 4.004, 5.005, 6.006, 7.007, 8.008, 9.009, 10.01, 11.011, 12.012, 13.013, 14.014, 15.015, 16.016, 17.017, 18.018, 19.019], "recent_frames_sha256": "84c9b77a76b236675e078b5a93fb7693a5884b8f95459a35920ffff7b2f4a227", "num_recent_frames": 20, "tq": 718997.257151201, "t1": 719005.306542453, "ta": 719005.306542453, "te": 719005.34472596, "first_response_s": 8.049391251988709, "answer_total_s": 8.087574759032577, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 449, "content_group": "4393a549211c22a795d406f966430994e52b85cf4d40030f38dbaa38deb72881", "question": {"question_id": "sample_449_a596_q0", "video_id": 449, "video_path": "./videos/sample_449_real.mp4", "annotation_index": 596, "question_index": 0, "question": "What action is being performed by the person with gloved hands?", "options": ["A. Washing the tomatoes.", "B. Rearranging and picking up tomatoes.", "C. Cutting the tomatoes.", "D. Weighing the tomatoes."], "answer": "B", "time_stamp_s": 243, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_449_a596_q0", "video_id": 449, "time_stamp_s": 243, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2b48bbfe08d89f150d16976992fada5d861d5ff7ef4896aa17276149a23e2ce7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333], "recent_frames_sha256": "30da10cb7afa50cea2d957bc71c2efc5f53ca8571a4c4925be43cfde16ed791f", "num_recent_frames": 30, "tq": 719300.401367148, "t1": 719310.866501309, "ta": 719310.866501309, "te": 719310.904161648, "first_response_s": 10.465134160942398, "answer_total_s": 10.502794499974698, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_449_a596_q0", "video_id": 449, "time_stamp_s": 243, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "993661b84ff592f69c1f6af2cbb4d11db96b2508cb0180407f77537be9cad7fe", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Person wearing black gloves pushes a gray plastic crate with a rectangular, textured object inside through a supermarket aisle.  \n- The crate is moved past produce displays featuring cucumbers, lemons, and bananas, with price tags visible on the shelves.  \n- The person’s hands grip the crate’s edges as they navigate the tiled floor, passing by stacked red plastic bins.\n[30-60s] - Hands in black gloves select and handle individually wrapped cucumbers from a display bin.  \n- Cucumbers are arranged in plastic-wrapped bundles, with price tags visible on some packages.  \n- Yellow lemons are displayed in a separate bin to the right, adjacent to the cucumber section.\n[60-90s] - Hands in black gloves sort through a pile of yellow lemons, occasionally selecting and moving individual fruits.  \n- A bin of green cucumbers is visible to the left, with price tags indicating \"1.99\" and \"2.99\" for different varieties.  \n- The lemons are arranged in a large bin with a red metal frame, and some are being moved to the side as part of the sorting process.\n[90-120s] - A gloved hand reaches into a crate of avocados, selecting one.  \n- The hand then moves to a display of packaged cheese, with labels visible.  \n- A tray of cauliflower is positioned next to the cheese, with a green vegetable display in the background.\n[120-150s] - Hands in black gloves pick up a white mushroom from a bin of fresh mushrooms.  \n- The person then moves to a bin of green limes, selecting one and placing it into a separate container.  \n- A brown paper bag is placed into the bin of limes, likely to be used for packaging.\n[150-180s] - Hand selects a container of cherry tomatoes from a display shelf.  \n- Cart is pushed forward, carrying a bag and a small container of tomatoes.  \n- Price tags for various tomato packages are visible on the shelf.\n[180-210s] - Person wearing black gloves reaches for a plastic bag of tomatoes from a shelf.  \n- Tomatoes are displayed in multiple sections: loose, packaged, and in crates with price tags.  \n- The person’s hand moves toward a specific package, indicating selection.\n[210-240s] - Hands in black gloves pick and sort tomatoes from a bin, moving them between plastic-wrapped packages and loose tomatoes.  \n- Loose tomatoes are piled in a blue bin, while packaged tomatoes are arranged in rows on the shelf.  \n- Price tags (e.g., \"549\" and \"549\") are visible on the shelf, indicating pricing for different tomato types.", "history_tokens": 590, "history_utf8_bytes": 2459, "recent_frame_times_s": [213.0128, 214.0138, 215.0148, 216.0158, 217.0168, 218.0178, 219.0188, 220.0198, 221.0208, 222.0218, 223.0228, 224.0238, 225.0248, 226.0258, 227.0268, 228.0278, 229.0288, 230.0298, 231.0308, 232.0318, 233.0328, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333], "recent_frames_sha256": "30da10cb7afa50cea2d957bc71c2efc5f53ca8571a4c4925be43cfde16ed791f", "num_recent_frames": 30, "tq": 719057.026074105, "t1": 719088.45020565, "ta": 719088.45020565, "te": 719088.675114509, "first_response_s": 31.424131545005366, "answer_total_s": 31.6490404040087, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 449, "content_group": "4393a549211c22a795d406f966430994e52b85cf4d40030f38dbaa38deb72881", "question": {"question_id": "sample_449_a597_q0", "video_id": 449, "video_path": "./videos/sample_449_real.mp4", "annotation_index": 597, "question_index": 0, "question": "What does the person do with the tomatoes that fell on the floor?", "options": ["A. Leaves them on the floor.", "B. Places them in a plastic bag.", "C. Puts them back in the shelf.", "D. Throws them away."], "answer": "C", "time_stamp_s": 490, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_449_a597_q0", "video_id": 449, "time_stamp_s": 490, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c19cc12032065c5f6de0af7fa6e7b56fd4154b7e7fed620237f895985d0cd49e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667, 487.01986666666664, 488.0208666666667, 489.02186666666665], "recent_frames_sha256": "06b3baedfcddac9a1f9e81d2b256ffe870396094ef4baa25d46dee51cbb4096d", "num_recent_frames": 30, "tq": 719310.91621736, "t1": 719318.492331661, "ta": 719318.492331661, "te": 719318.529739687, "first_response_s": 7.576114301104099, "answer_total_s": 7.613522327039391, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_449_a597_q0", "video_id": 449, "time_stamp_s": 490, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8713f10c400b778742082ada6554f40989f4510a0ffa91c82027fd6c01ae0538", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Hands in black gloves sort through a pile of yellow lemons, occasionally selecting and moving individual fruits.  \n- A bin of green cucumbers is visible to the left, with price tags indicating \"1.99\" and \"2.99\" for different varieties.  \n- The lemons are arranged in a large bin with a red metal frame, and some are being moved to the side as part of the sorting process.\n[90-120s] - A gloved hand reaches into a crate of avocados, selecting one.  \n- The hand then moves to a display of packaged cheese, with labels visible.  \n- A tray of cauliflower is positioned next to the cheese, with a green vegetable display in the background.\n[120-150s] - Hands in black gloves pick up a white mushroom from a bin of fresh mushrooms.  \n- The person then moves to a bin of green limes, selecting one and placing it into a separate container.  \n- A brown paper bag is placed into the bin of limes, likely to be used for packaging.\n[150-180s] - Hand selects a container of cherry tomatoes from a display shelf.  \n- Cart is pushed forward, carrying a bag and a small container of tomatoes.  \n- Price tags for various tomato packages are visible on the shelf.\n[180-210s] - Person wearing black gloves reaches for a plastic bag of tomatoes from a shelf.  \n- Tomatoes are displayed in multiple sections: loose, packaged, and in crates with price tags.  \n- The person’s hand moves toward a specific package, indicating selection.\n[210-240s] - Hands in black gloves pick and sort tomatoes from a bin, moving them between plastic-wrapped packages and loose tomatoes.  \n- Loose tomatoes are piled in a blue bin, while packaged tomatoes are arranged in rows on the shelf.  \n- Price tags (e.g., \"549\" and \"549\") are visible on the shelf, indicating pricing for different tomato types.\n[240-270s] - Hands in black gloves sort through a pile of small, round, orange tomatoes in a supermarket display.  \n- A crate of large, round, red tomatoes is visible to the left, while a crate of small, round, orange tomatoes is to the right.  \n- A crate of green, leafy lettuce wrapped in plastic sits centrally between the two tomato crates.\n[270-300s] - Hand in black glove picks up a plastic-wrapped head of lettuce from a display bin.  \n- Hand then reaches toward a bin of cherry tomatoes, selecting one with a small tag attached.  \n- The selected tomato is placed into a black shopping cart that already contains other produce items.\n[300-330s] - Hands in black gloves select and handle bright orange cherry tomatoes from a black plastic crate.  \n- Price tags (e.g., \"3.99\" and \"3.89\") are visible on the crate, indicating cost per unit.  \n- The tomatoes are displayed alongside other produce, including lettuce and larger tomatoes, in a supermarket setting.\n[330-360s] - Hands in black gloves select and handle bright red tomatoes from a black plastic crate.  \n- Price tags (e.g., \"3.90\") are visible on the tomatoes and adjacent produce like lettuce.  \n- The camera pans slightly, showing multiple tomato crates and other vegetables in the supermarket aisle.\n[360-390s] - Hand in black glove picks up a tomato from a tray, then places it back.  \n- Tomato trays are arranged in rows with price tags visible; some tomatoes still have stems attached.  \n- Cabbage and other vegetables are displayed in adjacent trays, with price signs indicating cost.\n[390-420s] - Hand in black glove picks up a tomato from a bin of red tomatoes.  \n- Hand moves to select another tomato from a different bin nearby.  \n- Hand places a tomato back into the bin after briefly examining it.\n[420-450s] - Hand in black glove picks up a tomato from a bin of red tomatoes.  \n- A plastic crate with a grid pattern holds several tomatoes and some loose ones.  \n- A bin of green cabbage sits between bins of red tomatoes and another bin of red tomatoes.\n[450-480s] - A person wearing black gloves picks up a head of cabbage from a plastic-wrapped display.  \n- The cabbage is positioned between rows of small red tomatoes and other vegetables.  \n- The person’s hand moves to inspect the cabbage’s label, which reads “BIO” and “Cabbage.”", "history_tokens": 998, "history_utf8_bytes": 4103, "recent_frame_times_s": [460.0262333333333, 461.02723333333336, 462.02823333333333, 463.0292333333333, 464.03023333333334, 465.0312333333333, 466.03223333333335, 467.0332333333333, 468.00086666666664, 469.0018666666667, 470.00286666666665, 471.0038666666667, 472.00486666666666, 473.0058666666667, 474.00686666666667, 475.00786666666664, 476.0088666666667, 477.00986666666665, 478.0108666666667, 479.01186666666666, 480.01286666666664, 481.0138666666667, 482.01486666666665, 483.0158666666667, 484.01686666666666, 485.0178666666667, 486.01886666666667, 487.01986666666664, 488.0208666666667, 489.02186666666665], "recent_frames_sha256": "06b3baedfcddac9a1f9e81d2b256ffe870396094ef4baa25d46dee51cbb4096d", "num_recent_frames": 30, "tq": 719147.242535019, "t1": 719155.09806883, "ta": 719155.09806883, "te": 719155.485258681, "first_response_s": 7.855533811030909, "answer_total_s": 8.24272366205696, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 449, "content_group": "4393a549211c22a795d406f966430994e52b85cf4d40030f38dbaa38deb72881", "question": {"question_id": "sample_449_a598_q0", "video_id": 449, "video_path": "./videos/sample_449_real.mp4", "annotation_index": 598, "question_index": 0, "question": "What is the person holding in his hand right now?", "options": ["A. A red basket.", "B. A plastic bag.", "C. A cardboard tray.", "D. A shopping list."], "answer": "C", "time_stamp_s": 725, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "storage_manage", "reference_interval_s": [720, 780], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_449_a598_q0", "video_id": 449, "time_stamp_s": 725, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0120571a516de1b3cac27a8d2e12237b501eef6326cedfcaadb06a1b65d77772", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [695.0276666666666, 696.0286666666667, 697.0296666666667, 698.0306666666667, 699.0316666666666, 700.0326666666666, 701.0003, 702.0013, 703.0023, 704.0033, 705.0043, 706.0053, 707.0063, 708.0073, 709.0083, 710.0093, 711.0103, 712.0113, 713.0123, 714.0133, 715.0143, 716.0153, 717.0163, 718.0173, 719.0183, 720.0193, 721.0203, 722.0213, 723.0223, 724.0233], "recent_frames_sha256": "23b85c8884b446cf91993239b0e07386d2a600e57563980981e78608ea78f176", "num_recent_frames": 30, "tq": 719318.544053741, "t1": 719331.602815231, "ta": 719331.602815231, "te": 719331.640132362, "first_response_s": 13.058761489926837, "answer_total_s": 13.096078620990738, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_449_a598_q0", "video_id": 449, "time_stamp_s": 725, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "54093ccdb3f8a9915092193c0de06e4f3cef4f9ce37e466483f6f3afaedd2405", "condition_order": ["notes", "recent"], "memory": "[300-330s] - Hands in black gloves select and handle bright orange cherry tomatoes from a black plastic crate.  \n- Price tags (e.g., \"3.99\" and \"3.89\") are visible on the crate, indicating cost per unit.  \n- The tomatoes are displayed alongside other produce, including lettuce and larger tomatoes, in a supermarket setting.\n[330-360s] - Hands in black gloves select and handle bright red tomatoes from a black plastic crate.  \n- Price tags (e.g., \"3.90\") are visible on the tomatoes and adjacent produce like lettuce.  \n- The camera pans slightly, showing multiple tomato crates and other vegetables in the supermarket aisle.\n[360-390s] - Hand in black glove picks up a tomato from a tray, then places it back.  \n- Tomato trays are arranged in rows with price tags visible; some tomatoes still have stems attached.  \n- Cabbage and other vegetables are displayed in adjacent trays, with price signs indicating cost.\n[390-420s] - Hand in black glove picks up a tomato from a bin of red tomatoes.  \n- Hand moves to select another tomato from a different bin nearby.  \n- Hand places a tomato back into the bin after briefly examining it.\n[420-450s] - Hand in black glove picks up a tomato from a bin of red tomatoes.  \n- A plastic crate with a grid pattern holds several tomatoes and some loose ones.  \n- A bin of green cabbage sits between bins of red tomatoes and another bin of red tomatoes.\n[450-480s] - A person wearing black gloves picks up a head of cabbage from a plastic-wrapped display.  \n- The cabbage is positioned between rows of small red tomatoes and other vegetables.  \n- The person’s hand moves to inspect the cabbage’s label, which reads “BIO” and “Cabbage.”\n[480-510s] - Hand in black glove picks up an orange tomato from the floor near a shopping cart.  \n- Tomato display includes loose tomatoes and packaged ones, with price tags visible (e.g., 39, 46, 25).  \n- Shopping cart is positioned near the produce section, with a red basket nearby.\n[510-540s] - Avocados in green mesh bags are piled on the right side of the produce display.  \n- Packaged tomatoes in clear plastic containers are arranged in rows on a metal shelf to the left.  \n- A gloved hand is visible near the bottom of the frame, interacting with the produce.\n[540-570s] - Person in black gloves picks up a brown paper bag and an orange from the floor near a produce display.  \n- They place the orange and paper bag into a shopping cart, which already contains a cabbage and other items.  \n- The cart is pushed toward a produce section with tomatoes and cabbages, where price tags are visible.\n[570-600s] - Hand in black glove picks up a plastic bag of mixed apples from a shelf.  \n- Shopping cart is visible nearby, containing some items.  \n- Price tag for apples shows \"1.49\" and \"1.99\" in different sections.\n[600-630s] - A hand reaches into a bin of green apples, selecting one.  \n- The bin is labeled \"APPLE\" with a price tag of \"32.98\" visible.  \n- The camera pans slightly to show adjacent bins of red and yellow apples.\n[630-660s] - A shopping cart is pushed along a tiled floor, passing rows of fruit displays.  \n- The cart moves past bins of green and red apples, with price tags visible.  \n- A red plastic basket is seen on the floor near the fruit section.\n[660-690s] - A person's hand reaches toward a bin of apples, indicating selection or purchase.  \n- The apples are displayed in a bin with a price tag showing \"34\" and \"34.95\" indicating cost.  \n- The bin is positioned on a supermarket shelf alongside other produce, including oranges and pears.\n[690-720s] - A hand in a black glove reaches toward a bin of green apples on a supermarket shelf.  \n- The bin of green apples is positioned below a bin of red apples, both on a metal shelf with price tags.  \n- The camera pans slightly to show the full shelf, including oranges on the top shelf and a price tag reading \"34.95\" for the red apples.", "history_tokens": 983, "history_utf8_bytes": 3904, "recent_frame_times_s": [695.0276666666666, 696.0286666666667, 697.0296666666667, 698.0306666666667, 699.0316666666666, 700.0326666666666, 701.0003, 702.0013, 703.0023, 704.0033, 705.0043, 706.0053, 707.0063, 708.0073, 709.0083, 710.0093, 711.0103, 712.0113, 713.0123, 714.0133, 715.0143, 716.0153, 717.0163, 718.0173, 719.0183, 720.0193, 721.0203, 722.0213, 723.0223, 724.0233], "recent_frames_sha256": "23b85c8884b446cf91993239b0e07386d2a600e57563980981e78608ea78f176", "num_recent_frames": 30, "tq": 719225.581187054, "t1": 719232.678683315, "ta": 719232.678683315, "te": 719232.716851359, "first_response_s": 7.09749626100529, "answer_total_s": 7.135664304951206, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 449, "content_group": "4393a549211c22a795d406f966430994e52b85cf4d40030f38dbaa38deb72881", "question": {"question_id": "sample_449_a599_q0", "video_id": 449, "video_path": "./videos/sample_449_real.mp4", "annotation_index": 599, "question_index": 0, "question": "What price was displayed on the sign above the shelf with the pears?", "options": ["A. 29.95.", "B. 33.95.", "C. 39.95.", "D. 35.95."], "answer": "B", "time_stamp_s": 958, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "storage_manage", "reference_interval_s": [900, 958], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_449_a599_q0", "video_id": 449, "time_stamp_s": 958, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "686e2643e8be9f13245b4190683881d2a64f0c108690be0048faeb5bcda45625", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [928.0271, 929.0281, 930.0291, 931.0301, 932.0311, 933.0321, 934.0331, 935.0007333333333, 936.0017333333333, 937.0027333333334, 938.0037333333333, 939.0047333333333, 940.0057333333333, 941.0067333333334, 942.0077333333334, 943.0087333333333, 944.0097333333333, 945.0107333333333, 946.0117333333334, 947.0127333333334, 948.0137333333333, 949.0147333333333, 950.0157333333333, 951.0167333333334, 952.0177333333334, 953.0187333333333, 954.0197333333333, 955.0207333333333, 956.0217333333334, 957.0227333333333], "recent_frames_sha256": "6a920bfb69c93d22f00bb30d8b123e0fdc92fbdb3d582e345256deca27129f1f", "num_recent_frames": 30, "tq": 719331.648338638, "t1": 719342.628996058, "ta": 719342.628996058, "te": 719342.851203288, "first_response_s": 10.980657420004718, "answer_total_s": 11.20286464993842, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_449_a599_q0", "video_id": 449, "time_stamp_s": 958, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4ec4fe0c255eaa23b6af64dc9befc02ad8e9654edad607b81e3fda2d90b27ed9", "condition_order": ["notes", "recent"], "memory": "[540-570s] - Person in black gloves picks up a brown paper bag and an orange from the floor near a produce display.  \n- They place the orange and paper bag into a shopping cart, which already contains a cabbage and other items.  \n- The cart is pushed toward a produce section with tomatoes and cabbages, where price tags are visible.\n[570-600s] - Hand in black glove picks up a plastic bag of mixed apples from a shelf.  \n- Shopping cart is visible nearby, containing some items.  \n- Price tag for apples shows \"1.49\" and \"1.99\" in different sections.\n[600-630s] - A hand reaches into a bin of green apples, selecting one.  \n- The bin is labeled \"APPLE\" with a price tag of \"32.98\" visible.  \n- The camera pans slightly to show adjacent bins of red and yellow apples.\n[630-660s] - A shopping cart is pushed along a tiled floor, passing rows of fruit displays.  \n- The cart moves past bins of green and red apples, with price tags visible.  \n- A red plastic basket is seen on the floor near the fruit section.\n[660-690s] - A person's hand reaches toward a bin of apples, indicating selection or purchase.  \n- The apples are displayed in a bin with a price tag showing \"34\" and \"34.95\" indicating cost.  \n- The bin is positioned on a supermarket shelf alongside other produce, including oranges and pears.\n[690-720s] - A hand in a black glove reaches toward a bin of green apples on a supermarket shelf.  \n- The bin of green apples is positioned below a bin of red apples, both on a metal shelf with price tags.  \n- The camera pans slightly to show the full shelf, including oranges on the top shelf and a price tag reading \"34.95\" for the red apples.\n[720-750s] - Person wearing black gloves picks up a plastic bag from a fruit display shelf.  \n- The person walks away from the fruit section, carrying the bag, while a shopping cart is visible nearby.  \n- The camera pans to show a variety of fruits, including oranges, apples, and pears, arranged on shelves.\n[750-780s] - Aisle displays feature crates of yellow citrus fruits (likely apricots or small oranges) with price tags showing \"41\" and \"32\" (currency unspecified).  \n- Adjacent to the citrus, bags of orange-colored produce (possibly oranges or tangerines) are stacked in a bin with a price tag reading \"32\".  \n- The camera pans right, revealing more produce shelves stocked with apples, pears, and other fruits, with a shopping cart visible near the end of the aisle.\n[780-810s] - Avocados in green mesh bags are displayed on the right side of the produce stand.  \n- Plastic containers of orange-colored produce (possibly cherry tomatoes or small oranges) are arranged in rows on a black tray.  \n- A red shopping basket is partially visible at the bottom right corner of the frame.\n[810-840s] - Hands in black gloves pick up a plastic container of cherry tomatoes from a display tray.  \n- The container is lifted and carried away from the produce section, moving toward the store's aisle.  \n- The camera pans to show a display of mushrooms and other produce as the person walks past.\n[840-870s] - Gloved hand picks up a plastic container of cherry tomatoes from a refrigerated display.  \n- Several identical containers are arranged in rows on the display, with price tags visible.  \n- The display is flanked by other produce, including garlic and packaged items, in adjacent bins.\n[870-900s] - A gloved hand picks up a plastic container of cherry tomatoes from a display shelf.  \n- The hand moves the container away from the shelf, revealing more containers behind it.  \n- The camera pans to show a shopping cart with a red basket, positioned near the produce section.\n[900-930s] - Person wearing black gloves pushes a shopping cart with a box of eggs on it, moving past produce aisles.  \n- Cart contains multiple egg cartons and a plastic container with bananas, positioned near a display of packaged pears.  \n- Produce section features clear plastic containers of green and yellow pears, with price tags visible on the shelves.", "history_tokens": 974, "history_utf8_bytes": 3988, "recent_frame_times_s": [928.0271, 929.0281, 930.0291, 931.0301, 932.0311, 933.0321, 934.0331, 935.0007333333333, 936.0017333333333, 937.0027333333334, 938.0037333333333, 939.0047333333333, 940.0057333333333, 941.0067333333334, 942.0077333333334, 943.0087333333333, 944.0097333333333, 945.0107333333333, 946.0117333333334, 947.0127333333334, 948.0137333333333, 949.0147333333333, 950.0157333333333, 951.0167333333334, 952.0177333333334, 953.0187333333333, 954.0197333333333, 955.0207333333333, 956.0217333333334, 957.0227333333333], "recent_frames_sha256": "6a920bfb69c93d22f00bb30d8b123e0fdc92fbdb3d582e345256deca27129f1f", "num_recent_frames": 30, "tq": 719283.963853952, "t1": 719293.427592353, "ta": 719293.427592353, "te": 719293.46563426, "first_response_s": 9.463738400954753, "answer_total_s": 9.501780307968147, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 450, "content_group": "e9dc14b113af2bd8f6fae9d92cd72f19bd6210ee0703ab2ad11f094344902452", "question": {"question_id": "sample_450_a992_q0", "video_id": 450, "video_path": "./videos/sample_450_real.mp4", "annotation_index": 992, "question_index": 0, "question": "What type of sign is displayed on the pole right now?", "options": ["A. Bus zone sign.", "B. Speed limit sign.", "C. No parking sign.", "D. Pedestrian crossing sign."], "answer": "A", "time_stamp_s": 4, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_450_a992_q0", "video_id": 450, "time_stamp_s": 4, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "316ddbd896b59c13483e5002f74cd7969e1a6bf28bf0ae867e8408cfc2f47d9b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0], "recent_frames_sha256": "473b64216b15ed6b047f93a18817eb203b142dd78cf24570b0eebd46d3800470", "num_recent_frames": 5, "tq": 717414.469819965, "t1": 717421.883193716, "ta": 717421.883193716, "te": 717421.919907649, "first_response_s": 7.413373751100153, "answer_total_s": 7.450087684090249, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_450_a992_q0", "video_id": 450, "time_stamp_s": 4, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "238e545773cad83e6c031aba4e8cdaef0742792a18326a01dc9c74b8d34ffa1e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0], "recent_frames_sha256": "473b64216b15ed6b047f93a18817eb203b142dd78cf24570b0eebd46d3800470", "num_recent_frames": 5, "tq": 717461.872745512, "t1": 717473.818218029, "ta": 717473.818218029, "te": 717474.126979942, "first_response_s": 11.945472516934387, "answer_total_s": 12.254234429914504, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 450, "content_group": "e9dc14b113af2bd8f6fae9d92cd72f19bd6210ee0703ab2ad11f094344902452", "question": {"question_id": "sample_450_a993_q0", "video_id": 450, "video_path": "./videos/sample_450_real.mp4", "annotation_index": 993, "question_index": 0, "question": "What color is the car visible in the distance on the right side of the road?", "options": ["A. White.", "B. Red.", "C. Blue.", "D. Black."], "answer": "A", "time_stamp_s": 114, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [112, 117], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_450_a993_q0", "video_id": 450, "time_stamp_s": 114, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "765097ac7ee32f1af26533b626d6e06bfe268b0b1ec1c26150113925f46e6517", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0], "recent_frames_sha256": "4261ac86674e151fd2de499be1db0e1cd174798728b414950685a3024687b699", "num_recent_frames": 30, "tq": 717421.937968599, "t1": 717433.808883915, "ta": 717433.808883915, "te": 717433.84659619, "first_response_s": 11.870915315928869, "answer_total_s": 11.90862759097945, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_450_a993_q0", "video_id": 450, "time_stamp_s": 114, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "468a4f7293c417659b183697c9e834c4599826d0d4fa3a9c8940b049f1edc7ef", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands maneuver steering wheel as bus moves forward past trees, a river, and urban buildings.  \n- Bus passes a \"No Entry\" sign and approaches a toll booth area with overhead signage.  \n- Driver's left hand briefly touches dashboard controls while maintaining control of the vehicle.\n[30-60s] - Driver's hands grip steering wheel, navigating urban street with traffic lights and construction cranes visible ahead.  \n- Right side mirror reflects passing vehicles and roadside buildings, while left side shows a pedestrian crossing.  \n- Road signs and street markings indicate lane changes and traffic flow, with a white car and red car passing by.\n[60-90s] - Driver's hands grip steering wheel, maintaining control as vehicle navigates urban road.  \n- Right-side mirror reflects passing vehicles and roadside scenery.  \n- Construction site with cranes and scaffolding visible ahead, indicating ongoing development.", "history_tokens": 192, "history_utf8_bytes": 930, "recent_frame_times_s": [85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0], "recent_frames_sha256": "4261ac86674e151fd2de499be1db0e1cd174798728b414950685a3024687b699", "num_recent_frames": 30, "tq": 717495.300642071, "t1": 717496.845049438, "ta": 717496.845049438, "te": 717496.883920626, "first_response_s": 1.544407367007807, "answer_total_s": 1.5832785550737754, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 450, "content_group": "e9dc14b113af2bd8f6fae9d92cd72f19bd6210ee0703ab2ad11f094344902452", "question": {"question_id": "sample_450_a994_q0", "video_id": 450, "video_path": "./videos/sample_450_real.mp4", "annotation_index": 994, "question_index": 0, "question": "What color is the sign visible on the left side of the road right now?", "options": ["A. Blue.", "B. Red.", "C. Yellow.", "D. Green."], "answer": "A", "time_stamp_s": 227, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [224, 229], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_450_a994_q0", "video_id": 450, "time_stamp_s": 227, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e73e9ef402b56b54123336b4250988eb91c679123c9ace7a2cf7a256227ecb26", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0], "recent_frames_sha256": "f08799971a90cc77bf07a2fb3ee88d9e5bdbf768c721f6ee3670f9ff97e765c2", "num_recent_frames": 30, "tq": 717433.862714131, "t1": 717442.054920873, "ta": 717442.054920873, "te": 717442.092392212, "first_response_s": 8.192206742009148, "answer_total_s": 8.229678080999292, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_450_a994_q0", "video_id": 450, "time_stamp_s": 227, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3f4c3ba3025fe7f3dd3e01cf8d8c8120c09a43af7b688accee8f8943469e8797", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands maneuver steering wheel as bus moves forward past trees, a river, and urban buildings.  \n- Bus passes a \"No Entry\" sign and approaches a toll booth area with overhead signage.  \n- Driver's left hand briefly touches dashboard controls while maintaining control of the vehicle.\n[30-60s] - Driver's hands grip steering wheel, navigating urban street with traffic lights and construction cranes visible ahead.  \n- Right side mirror reflects passing vehicles and roadside buildings, while left side shows a pedestrian crossing.  \n- Road signs and street markings indicate lane changes and traffic flow, with a white car and red car passing by.\n[60-90s] - Driver's hands grip steering wheel, maintaining control as vehicle navigates urban road.  \n- Right-side mirror reflects passing vehicles and roadside scenery.  \n- Construction site with cranes and scaffolding visible ahead, indicating ongoing development.\n[90-120s] - Driver's hands are on the steering wheel, with the left hand occasionally adjusting position while the right hand remains steady.  \n- The bus is stationary at a red traffic light, with the driver waiting for the signal to change.  \n- The view through the windshield shows a city street with buildings, trees, and a clear sky, indicating daytime.\n[120-150s] - Driver's hands are on the steering wheel, navigating through traffic on a city street.  \n- A red traffic light is visible ahead, which turns green as the bus proceeds.  \n- A \"SUNSET MALL\" sign is seen on the left side of the road, indicating an upcoming commercial area.\n[150-180s] - Driver's hands remain on steering wheel, maintaining control of bus through traffic.  \n- Vehicles ahead, including a black SUV and silver sedan, are stationary or moving slowly in traffic.  \n- Sunlight reflects off windshield, indicating clear weather and daytime driving conditions.\n[180-210s] - Driver's hands grip steering wheel as bus navigates urban intersection under bright sun.\n- Traffic ahead includes cars and a bus, with buildings and signage visible on both sides of road.\n- Bus approaches crosswalk and turns right, passing commercial structures with clear sky overhead.", "history_tokens": 471, "history_utf8_bytes": 2169, "recent_frame_times_s": [198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0], "recent_frames_sha256": "f08799971a90cc77bf07a2fb3ee88d9e5bdbf768c721f6ee3670f9ff97e765c2", "num_recent_frames": 30, "tq": 717529.335782926, "t1": 717535.663921658, "ta": 717535.663921658, "te": 717536.035921768, "first_response_s": 6.328138732002117, "answer_total_s": 6.700138842104934, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 450, "content_group": "e9dc14b113af2bd8f6fae9d92cd72f19bd6210ee0703ab2ad11f094344902452", "question": {"question_id": "sample_450_a995_q0", "video_id": 450, "video_path": "./videos/sample_450_real.mp4", "annotation_index": 995, "question_index": 0, "question": "What color are the parking signs visible on the right side of the road right now?", "options": ["A. Blue.", "B. Red.", "C. Yellow.", "D. Green."], "answer": "A", "time_stamp_s": 227, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [336, 341], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_450_a995_q0", "video_id": 450, "time_stamp_s": 227, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5f3c6aaa848a147febd2031d5977a143e00de079493b5d19db8b8cb6a2175878", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0], "recent_frames_sha256": "f08799971a90cc77bf07a2fb3ee88d9e5bdbf768c721f6ee3670f9ff97e765c2", "num_recent_frames": 30, "tq": 717442.122813728, "t1": 717448.88053435, "ta": 717448.88053435, "te": 717448.917252279, "first_response_s": 6.757720622001216, "answer_total_s": 6.794438550947234, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_450_a995_q0", "video_id": 450, "time_stamp_s": 227, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1b0a0279634665cdefe2572be48c3f9d03ee188b101fb2d5ca70fb6759979233", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands maneuver steering wheel as bus moves forward past trees, a river, and urban buildings.  \n- Bus passes a \"No Entry\" sign and approaches a toll booth area with overhead signage.  \n- Driver's left hand briefly touches dashboard controls while maintaining control of the vehicle.\n[30-60s] - Driver's hands grip steering wheel, navigating urban street with traffic lights and construction cranes visible ahead.  \n- Right side mirror reflects passing vehicles and roadside buildings, while left side shows a pedestrian crossing.  \n- Road signs and street markings indicate lane changes and traffic flow, with a white car and red car passing by.\n[60-90s] - Driver's hands grip steering wheel, maintaining control as vehicle navigates urban road.  \n- Right-side mirror reflects passing vehicles and roadside scenery.  \n- Construction site with cranes and scaffolding visible ahead, indicating ongoing development.\n[90-120s] - Driver's hands are on the steering wheel, with the left hand occasionally adjusting position while the right hand remains steady.  \n- The bus is stationary at a red traffic light, with the driver waiting for the signal to change.  \n- The view through the windshield shows a city street with buildings, trees, and a clear sky, indicating daytime.\n[120-150s] - Driver's hands are on the steering wheel, navigating through traffic on a city street.  \n- A red traffic light is visible ahead, which turns green as the bus proceeds.  \n- A \"SUNSET MALL\" sign is seen on the left side of the road, indicating an upcoming commercial area.\n[150-180s] - Driver's hands remain on steering wheel, maintaining control of bus through traffic.  \n- Vehicles ahead, including a black SUV and silver sedan, are stationary or moving slowly in traffic.  \n- Sunlight reflects off windshield, indicating clear weather and daytime driving conditions.\n[180-210s] - Driver's hands grip steering wheel as bus navigates urban intersection under bright sun.\n- Traffic ahead includes cars and a bus, with buildings and signage visible on both sides of road.\n- Bus approaches crosswalk and turns right, passing commercial structures with clear sky overhead.", "history_tokens": 471, "history_utf8_bytes": 2169, "recent_frame_times_s": [198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0, 216.0, 217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0], "recent_frames_sha256": "f08799971a90cc77bf07a2fb3ee88d9e5bdbf768c721f6ee3670f9ff97e765c2", "num_recent_frames": 30, "tq": 717536.052248732, "t1": 717547.343145664, "ta": 717547.343145664, "te": 717547.379850106, "first_response_s": 11.290896932012402, "answer_total_s": 11.327601374010555, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 450, "content_group": "e9dc14b113af2bd8f6fae9d92cd72f19bd6210ee0703ab2ad11f094344902452", "question": {"question_id": "sample_450_a996_q0", "video_id": 450, "video_path": "./videos/sample_450_real.mp4", "annotation_index": 996, "question_index": 0, "question": "What type car is the orange car visible right now?", "options": ["A. SUV.", "B. Van.", "C. Bus.", "D. Truck."], "answer": "A", "time_stamp_s": 449, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [448, 453], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_450_a996_q0", "video_id": 450, "time_stamp_s": 449, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c5ee3dbb9da3e5c69145324c328837b9fac271d7e86e724a585484108f5130d8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [420.0, 421.0, 422.0, 423.0, 424.0, 425.0, 426.0, 427.0, 428.0, 429.0, 430.0, 431.0, 432.0, 433.0, 434.0, 435.0, 436.0, 437.0, 438.0, 439.0, 440.0, 441.0, 442.0, 443.0, 444.0, 445.0, 446.0, 447.0, 448.0, 449.0], "recent_frames_sha256": "a0c3817d5c8d6a20616cd648ef396975abb45c2e2b8acdbfc36934be5b3e80bf", "num_recent_frames": 30, "tq": 717448.933857753, "t1": 717461.669681549, "ta": 717461.669681549, "te": 717461.856559573, "first_response_s": 12.735823795897886, "answer_total_s": 12.922701819916256, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_450_a996_q0", "video_id": 450, "time_stamp_s": 449, "ground_truth": "A", "raw_output": "A. SUV.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "de920dedb60f30f2a05091d61792ce1e489f0e81f4bb5cb2825cfcd3b11d2af4", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands maneuver steering wheel as bus moves forward past trees, a river, and urban buildings.  \n- Bus passes a \"No Entry\" sign and approaches a toll booth area with overhead signage.  \n- Driver's left hand briefly touches dashboard controls while maintaining control of the vehicle.\n[30-60s] - Driver's hands grip steering wheel, navigating urban street with traffic lights and construction cranes visible ahead.  \n- Right side mirror reflects passing vehicles and roadside buildings, while left side shows a pedestrian crossing.  \n- Road signs and street markings indicate lane changes and traffic flow, with a white car and red car passing by.\n[60-90s] - Driver's hands grip steering wheel, maintaining control as vehicle navigates urban road.  \n- Right-side mirror reflects passing vehicles and roadside scenery.  \n- Construction site with cranes and scaffolding visible ahead, indicating ongoing development.\n[90-120s] - Driver's hands are on the steering wheel, with the left hand occasionally adjusting position while the right hand remains steady.  \n- The bus is stationary at a red traffic light, with the driver waiting for the signal to change.  \n- The view through the windshield shows a city street with buildings, trees, and a clear sky, indicating daytime.\n[120-150s] - Driver's hands are on the steering wheel, navigating through traffic on a city street.  \n- A red traffic light is visible ahead, which turns green as the bus proceeds.  \n- A \"SUNSET MALL\" sign is seen on the left side of the road, indicating an upcoming commercial area.\n[150-180s] - Driver's hands remain on steering wheel, maintaining control of bus through traffic.  \n- Vehicles ahead, including a black SUV and silver sedan, are stationary or moving slowly in traffic.  \n- Sunlight reflects off windshield, indicating clear weather and daytime driving conditions.\n[180-210s] - Driver's hands grip steering wheel as bus navigates urban intersection under bright sun.\n- Traffic ahead includes cars and a bus, with buildings and signage visible on both sides of road.\n- Bus approaches crosswalk and turns right, passing commercial structures with clear sky overhead.\n[210-240s] - Driver's hands are on the steering wheel, navigating through city traffic.  \n- A white van and a black SUV are visible ahead, with the SUV stopping at a traffic light.  \n- The bus passes by modern buildings and trees, with a construction crane visible in the distance.\n[240-270s] - Driver's hands grip steering wheel, navigating through city streets with visible traffic and buildings.  \n- White van is directly ahead, moving slowly, with other vehicles and pedestrians visible in surrounding lanes.  \n- Urban environment features tall buildings, street signs, and trees lining the road, under clear blue sky.\n[270-300s] - Driver's hands grip steering wheel, making minor adjustments while navigating urban street.  \n- Vehicles, including a white van and a blue car, pass by on the road ahead.  \n- Street signs and buildings, including a blue storefront and a tall glass building, are visible on either side.\n[300-330s] - Driver's hands grip steering wheel, making minor adjustments while navigating urban street.  \n- Traffic flows steadily with cars and pedestrians visible at intersections.  \n- Modern buildings and street signs line the road, with clear sky overhead.\n[330-360s] - Driver's hands on steering wheel, navigating through urban streets with visible traffic and pedestrians.  \n- Red traffic light ahead at intersection, with pedestrians crossing the street.  \n- Tall building visible in distance, surrounded by commercial structures and street signs.\n[360-390s] - Driver's hands on steering wheel, left hand steady, right hand slightly adjusting grip.  \n- Traffic light changes from red to green, allowing bus to proceed forward.  \n- Pedestrians cross street at intersection as bus approaches.\n[390-420s] - Driver's hands on steering wheel, navigating through city streets with buildings and traffic visible.  \n- Red traffic light ahead at intersection, with vehicles and pedestrians crossing.  \n- Blue bus stop shelter on left side of road, with signage indicating bus route or stop number.", "history_tokens": 913, "history_utf8_bytes": 4188, "recent_frame_times_s": [420.0, 421.0, 422.0, 423.0, 424.0, 425.0, 426.0, 427.0, 428.0, 429.0, 430.0, 431.0, 432.0, 433.0, 434.0, 435.0, 436.0, 437.0, 438.0, 439.0, 440.0, 441.0, 442.0, 443.0, 444.0, 445.0, 446.0, 447.0, 448.0, 449.0], "recent_frames_sha256": "a0c3817d5c8d6a20616cd648ef396975abb45c2e2b8acdbfc36934be5b3e80bf", "num_recent_frames": 30, "tq": 717605.031316874, "t1": 717612.286946841, "ta": 717612.286946841, "te": 717612.444976621, "first_response_s": 7.255629967083223, "answer_total_s": 7.4136597469914705, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 451, "content_group": "65b59c58093d5900acd1fc89bd602d227d8e1c6950bb133104b8e137f75a9bdd", "question": {"question_id": "sample_451_a163_q0", "video_id": 451, "video_path": "./videos/sample_451_real.mp4", "annotation_index": 163, "question_index": 0, "question": "What brand's advertisement is visible on the back of the bus right now?", "options": ["A. Toyota.", "B. Chevrolet.", "C. Nissan.", "D. Ford."], "answer": "D", "time_stamp_s": 4, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_451_a163_q0", "video_id": 451, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b2da8ee63f7f6d32675d8c051ff240540846f7b738a37aa7820fb32f40080904", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.045999461206896554, 1.0115167025862069, 2.011516702586207, 3.011516702586207], "recent_frames_sha256": "fe040d06109a4f2817978650df7ef28d34312c079c4113e2ee7c429c2eb1501b", "num_recent_frames": 4, "tq": 716001.940862047, "t1": 716007.113236163, "ta": 716007.113236163, "te": 716007.151143875, "first_response_s": 5.172374116024002, "answer_total_s": 5.210281827952713, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_451_a163_q0", "video_id": 451, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6692531d9e49c104833c73920c57d1395d69dcc925b95e21b04f65f7ecda1806", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.045999461206896554, 1.0115167025862069, 2.011516702586207, 3.011516702586207], "recent_frames_sha256": "fe040d06109a4f2817978650df7ef28d34312c079c4113e2ee7c429c2eb1501b", "num_recent_frames": 4, "tq": 715872.461207193, "t1": 715878.489516358, "ta": 715878.489516358, "te": 715878.718991296, "first_response_s": 6.028309165034443, "answer_total_s": 6.257784103043377, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 451, "content_group": "65b59c58093d5900acd1fc89bd602d227d8e1c6950bb133104b8e137f75a9bdd", "question": {"question_id": "sample_451_a164_q0", "video_id": 451, "video_path": "./videos/sample_451_real.mp4", "annotation_index": 164, "question_index": 0, "question": "What company's logo is visible on the left side of the building right now?", "options": ["A. Intel.", "B. Tesla.", "C. AT&T.", "D. Optus."], "answer": "D", "time_stamp_s": 115, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [115, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_451_a164_q0", "video_id": 451, "time_stamp_s": 115, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a5e7e0efe099e2752672cd3559a9a161045a40b4dc6a7a967d83a74e617d91d7", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [85.0115167025862, 86.0115167025862, 87.0115167025862, 88.0115167025862, 89.0115167025862, 90.0115167025862, 91.0115167025862, 92.0115167025862, 93.0115167025862, 94.0115167025862, 95.0115167025862, 96.0115167025862, 97.0115167025862, 98.0115167025862, 99.0115167025862, 100.0115167025862, 101.0115167025862, 102.0115167025862, 103.0115167025862, 104.0115167025862, 105.0115167025862, 106.0115167025862, 107.0115167025862, 108.0115167025862, 109.0115167025862, 110.0115167025862, 111.0115167025862, 112.0115167025862, 113.0115167025862, 114.0115167025862], "recent_frames_sha256": "ed561d41b76107e888b091ccf9fd47fdbb42c4a9a72dbd82274f73e6f695bc26", "num_recent_frames": 30, "tq": 716007.162067714, "t1": 716018.927287673, "ta": 716018.927287673, "te": 716018.964814241, "first_response_s": 11.765219958964735, "answer_total_s": 11.802746527013369, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_451_a164_q0", "video_id": 451, "time_stamp_s": 115, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b6ae1badc6b7f4897423cb09d738cebbe2aff67e5dc66cb119c49b4f7ee2323c", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver's hands grip steering wheel as bus navigates urban streets, passing buildings and other vehicles.  \n- Bus approaches and crosses intersections with traffic lights, including a green light at 0:06.  \n- Right-side mirror reflects passing traffic and urban scenery, while left-side mirror shows oncoming vehicles.\n[30-60s] - Driver's hands on steering wheel, adjusting grip as bus approaches intersection.  \n- Orange and blue bus ahead, slowing down and turning right at traffic signal.  \n- Pedestrian crossing visible on left, with cars stopped at red light.\n[60-90s] - Driver's hands are on the steering wheel, navigating the bus through city streets.  \n- A yellow taxi is visible ahead, moving in the same direction as the bus.  \n- The bus approaches an intersection with traffic lights, which are currently green.", "history_tokens": 186, "history_utf8_bytes": 831, "recent_frame_times_s": [85.0115167025862, 86.0115167025862, 87.0115167025862, 88.0115167025862, 89.0115167025862, 90.0115167025862, 91.0115167025862, 92.0115167025862, 93.0115167025862, 94.0115167025862, 95.0115167025862, 96.0115167025862, 97.0115167025862, 98.0115167025862, 99.0115167025862, 100.0115167025862, 101.0115167025862, 102.0115167025862, 103.0115167025862, 104.0115167025862, 105.0115167025862, 106.0115167025862, 107.0115167025862, 108.0115167025862, 109.0115167025862, 110.0115167025862, 111.0115167025862, 112.0115167025862, 113.0115167025862, 114.0115167025862], "recent_frames_sha256": "ed561d41b76107e888b091ccf9fd47fdbb42c4a9a72dbd82274f73e6f695bc26", "num_recent_frames": 30, "tq": 715904.409378259, "t1": 715911.37810449, "ta": 715911.37810449, "te": 715911.714415171, "first_response_s": 6.968726231018081, "answer_total_s": 7.30503691197373, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 451, "content_group": "65b59c58093d5900acd1fc89bd602d227d8e1c6950bb133104b8e137f75a9bdd", "question": {"question_id": "sample_451_a165_q0", "video_id": 451, "video_path": "./videos/sample_451_real.mp4", "annotation_index": 165, "question_index": 0, "question": "What is the current status of the traffic light ahead?", "options": ["A. Red.", "B. Yellow.", "C. Flashing.", "D. Green."], "answer": "D", "time_stamp_s": 232, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [230, 235], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_451_a165_q0", "video_id": 451, "time_stamp_s": 232, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "463cc88704f09b9c0bd9154c7dc14135bc61f1d17ca7b2adf408d2ba8e4980f3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [202.01151670258622, 203.01151670258622, 204.01151670258622, 205.01151670258622, 206.01151670258622, 207.01151670258622, 208.01151670258622, 209.01151670258622, 210.01151670258622, 211.01151670258622, 212.01151670258622, 213.01151670258622, 214.01151670258622, 215.01151670258622, 216.01151670258622, 217.01151670258622, 218.01151670258622, 219.01151670258622, 220.01151670258622, 221.01151670258622, 222.01151670258622, 223.01151670258622, 224.01151670258622, 225.01151670258622, 226.01151670258622, 227.01151670258622, 228.01151670258622, 229.01151670258622, 230.01151670258622, 231.01151670258622], "recent_frames_sha256": "4ab7b5c5e15c920b3282125d49bc1c1834813affbff208ba325f22bf36c4f223", "num_recent_frames": 30, "tq": 716018.97652894, "t1": 716030.723513455, "ta": 716030.723513455, "te": 716030.759994868, "first_response_s": 11.74698451498989, "answer_total_s": 11.783465927932411, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_451_a165_q0", "video_id": 451, "time_stamp_s": 232, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b6e51b7916988daf99aacb45bffda97063279fec2d2851d9c6340a6ac660f74f", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver's hands grip steering wheel as bus navigates urban streets, passing buildings and other vehicles.  \n- Bus approaches and crosses intersections with traffic lights, including a green light at 0:06.  \n- Right-side mirror reflects passing traffic and urban scenery, while left-side mirror shows oncoming vehicles.\n[30-60s] - Driver's hands on steering wheel, adjusting grip as bus approaches intersection.  \n- Orange and blue bus ahead, slowing down and turning right at traffic signal.  \n- Pedestrian crossing visible on left, with cars stopped at red light.\n[60-90s] - Driver's hands are on the steering wheel, navigating the bus through city streets.  \n- A yellow taxi is visible ahead, moving in the same direction as the bus.  \n- The bus approaches an intersection with traffic lights, which are currently green.\n[90-120s] - Driver's hands grip steering wheel, navigating through city streets with visible traffic and pedestrians.  \n- A yellow bus is seen ahead, followed by a blue bus turning left at an intersection.  \n- The bus passes under an elevated structure, with \"LANE\" painted on the road surface.\n[120-150s] - Driver's hands remain on steering wheel, occasionally adjusting grip as bus navigates urban street.  \n- Pedestrians and cyclists are visible on sidewalks and bike lanes, moving in various directions.  \n- A black sedan passes the bus on the right, followed by a yellow bus, indicating traffic flow in the city.\n[150-180s] - Driver's hands grip steering wheel, maintaining control as bus navigates urban street.  \n- Pedestrians cross street at intersection, moving from right to left relative to bus direction.  \n- Buildings and trees line both sides of road; distant skyscraper visible in background.\n[180-210s] - Driver's hands are on the steering wheel, controlling the bus as it stops at a crosswalk.  \n- Pedestrians cross the street in front of the bus, some carrying bags or walking in groups.  \n- The bus is stationary at an intersection with shops and trees lining the street.", "history_tokens": 463, "history_utf8_bytes": 2022, "recent_frame_times_s": [202.01151670258622, 203.01151670258622, 204.01151670258622, 205.01151670258622, 206.01151670258622, 207.01151670258622, 208.01151670258622, 209.01151670258622, 210.01151670258622, 211.01151670258622, 212.01151670258622, 213.01151670258622, 214.01151670258622, 215.01151670258622, 216.01151670258622, 217.01151670258622, 218.01151670258622, 219.01151670258622, 220.01151670258622, 221.01151670258622, 222.01151670258622, 223.01151670258622, 224.01151670258622, 225.01151670258622, 226.01151670258622, 227.01151670258622, 228.01151670258622, 229.01151670258622, 230.01151670258622, 231.01151670258622], "recent_frames_sha256": "4ab7b5c5e15c920b3282125d49bc1c1834813affbff208ba325f22bf36c4f223", "num_recent_frames": 30, "tq": 715939.46367558, "t1": 715941.364100068, "ta": 715941.364100068, "te": 715941.623529864, "first_response_s": 1.9004244880052283, "answer_total_s": 2.1598542840220034, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 451, "content_group": "65b59c58093d5900acd1fc89bd602d227d8e1c6950bb133104b8e137f75a9bdd", "question": {"question_id": "sample_451_a166_q0", "video_id": 451, "video_path": "./videos/sample_451_real.mp4", "annotation_index": 166, "question_index": 0, "question": "What brand is visible on the building right now?", "options": ["A. Citibank.", "B. Westpac.", "C. ANZ.", "D. Coleslocal."], "answer": "D", "time_stamp_s": 346, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [345, 350], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_451_a166_q0", "video_id": 451, "time_stamp_s": 346, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b6f2b7f97909bfac572ae71aac79418f08ec262196b14217563a15b1ff917e49", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [316.0115167025862, 317.0115167025862, 318.0115167025862, 319.0115167025862, 320.0115167025862, 321.0115167025862, 322.0115167025862, 323.0115167025862, 324.0115167025862, 325.0115167025862, 326.0115167025862, 327.0115167025862, 328.0115167025862, 329.0115167025862, 330.0115167025862, 331.0115167025862, 332.0115167025862, 333.0115167025862, 334.0115167025862, 335.0115167025862, 336.0115167025862, 337.0115167025862, 338.0115167025862, 339.0115167025862, 340.0115167025862, 341.0115167025862, 342.0115167025862, 343.0115167025862, 344.0115167025862, 345.0115167025862], "recent_frames_sha256": "b13c11523a714bcbd5e606ba8a897f472c38c9dd7fb7bb5fa4c63680d6286d1f", "num_recent_frames": 30, "tq": 716030.769729254, "t1": 716042.170694132, "ta": 716042.170694132, "te": 716042.207633216, "first_response_s": 11.400964878033847, "answer_total_s": 11.437903962098062, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_451_a166_q0", "video_id": 451, "time_stamp_s": 346, "ground_truth": "D", "raw_output": "C. ANZ.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "7869937c618f703a9025217037428e809e9c3720cd2a67f757674249f1e1846e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver's hands grip steering wheel as bus navigates urban streets, passing buildings and other vehicles.  \n- Bus approaches and crosses intersections with traffic lights, including a green light at 0:06.  \n- Right-side mirror reflects passing traffic and urban scenery, while left-side mirror shows oncoming vehicles.\n[30-60s] - Driver's hands on steering wheel, adjusting grip as bus approaches intersection.  \n- Orange and blue bus ahead, slowing down and turning right at traffic signal.  \n- Pedestrian crossing visible on left, with cars stopped at red light.\n[60-90s] - Driver's hands are on the steering wheel, navigating the bus through city streets.  \n- A yellow taxi is visible ahead, moving in the same direction as the bus.  \n- The bus approaches an intersection with traffic lights, which are currently green.\n[90-120s] - Driver's hands grip steering wheel, navigating through city streets with visible traffic and pedestrians.  \n- A yellow bus is seen ahead, followed by a blue bus turning left at an intersection.  \n- The bus passes under an elevated structure, with \"LANE\" painted on the road surface.\n[120-150s] - Driver's hands remain on steering wheel, occasionally adjusting grip as bus navigates urban street.  \n- Pedestrians and cyclists are visible on sidewalks and bike lanes, moving in various directions.  \n- A black sedan passes the bus on the right, followed by a yellow bus, indicating traffic flow in the city.\n[150-180s] - Driver's hands grip steering wheel, maintaining control as bus navigates urban street.  \n- Pedestrians cross street at intersection, moving from right to left relative to bus direction.  \n- Buildings and trees line both sides of road; distant skyscraper visible in background.\n[180-210s] - Driver's hands are on the steering wheel, controlling the bus as it stops at a crosswalk.  \n- Pedestrians cross the street in front of the bus, some carrying bags or walking in groups.  \n- The bus is stationary at an intersection with shops and trees lining the street.\n[210-240s] - Driver's hands grip steering wheel, making minor adjustments as bus navigates urban street.  \n- Pedestrians cross street at intersection; traffic lights change from green to red.  \n- Bus approaches a crosswalk with visible signage and storefronts on either side.\n[240-270s] - A silver sedan is stationary at the intersection, positioned to the right of the bus's forward view.  \n- A group of pedestrians crosses the street from left to right, moving across the crosswalk in front of the bus.  \n- A blue and white bus is visible in the distance, approaching from the opposite direction on the same road.\n[270-300s] - Driver's left hand grips steering wheel, right hand near dashboard controls.  \n- Yellow taxi approaches from right, stops at intersection, then proceeds.  \n- Pedestrians cross street at crosswalk; some wait at curb, others move across.\n[300-330s] - Driver's left hand rests on the steering wheel, with a tablet mounted nearby.  \n- A yellow bus approaches from the right, crossing the intersection.  \n- Pedestrians are visible crossing the street ahead, near a traffic light.", "history_tokens": 723, "history_utf8_bytes": 3126, "recent_frame_times_s": [316.0115167025862, 317.0115167025862, 318.0115167025862, 319.0115167025862, 320.0115167025862, 321.0115167025862, 322.0115167025862, 323.0115167025862, 324.0115167025862, 325.0115167025862, 326.0115167025862, 327.0115167025862, 328.0115167025862, 329.0115167025862, 330.0115167025862, 331.0115167025862, 332.0115167025862, 333.0115167025862, 334.0115167025862, 335.0115167025862, 336.0115167025862, 337.0115167025862, 338.0115167025862, 339.0115167025862, 340.0115167025862, 341.0115167025862, 342.0115167025862, 343.0115167025862, 344.0115167025862, 345.0115167025862], "recent_frames_sha256": "b13c11523a714bcbd5e606ba8a897f472c38c9dd7fb7bb5fa4c63680d6286d1f", "num_recent_frames": 30, "tq": 715964.925864837, "t1": 715966.124508745, "ta": 715966.124508745, "te": 715966.312316307, "first_response_s": 1.1986439080210403, "answer_total_s": 1.3864514699671417, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 451, "content_group": "65b59c58093d5900acd1fc89bd602d227d8e1c6950bb133104b8e137f75a9bdd", "question": {"question_id": "sample_451_a167_q0", "video_id": 451, "video_path": "./videos/sample_451_real.mp4", "annotation_index": 167, "question_index": 0, "question": "Which brand's logo is visible on the right side of the road right now?", "options": ["A. McDonald's.", "B. KFC.", "C. Subway.", "D. Starbucks."], "answer": "D", "time_stamp_s": 464, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [460, 465], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_451_a167_q0", "video_id": 451, "time_stamp_s": 464, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "40953638dfef151c3fc45d26ede70c17c0f5c4e1de464042f7ad18976363a719", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [434.0115167025862, 435.0115167025862, 436.0115167025862, 437.0115167025862, 438.0115167025862, 439.0115167025862, 440.0115167025862, 441.0115167025862, 442.0115167025862, 443.0115167025862, 444.0115167025862, 445.0115167025862, 446.0115167025862, 447.0115167025862, 448.0115167025862, 449.0115167025862, 450.0115167025862, 451.0115167025862, 452.0115167025862, 453.0115167025862, 454.0115167025862, 455.0115167025862, 456.0115167025862, 457.0115167025862, 458.0115167025862, 459.0115167025862, 460.0115167025862, 461.0115167025862, 462.0115167025862, 463.0115167025862], "recent_frames_sha256": "35a4dbfb4c8cf3f1772424c952b429a52023449998ea49d94cb21ac16c5acc51", "num_recent_frames": 30, "tq": 716042.217295849, "t1": 716050.393615352, "ta": 716050.393615352, "te": 716050.547244757, "first_response_s": 8.176319502992555, "answer_total_s": 8.329948907950893, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_451_a167_q0", "video_id": 451, "time_stamp_s": 464, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "39cce3bde8934e8aac1fe3bbe2f70bf09fc69030c23d4e1921f1b551782dc499", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver's hands grip steering wheel as bus navigates urban streets, passing buildings and other vehicles.  \n- Bus approaches and crosses intersections with traffic lights, including a green light at 0:06.  \n- Right-side mirror reflects passing traffic and urban scenery, while left-side mirror shows oncoming vehicles.\n[30-60s] - Driver's hands on steering wheel, adjusting grip as bus approaches intersection.  \n- Orange and blue bus ahead, slowing down and turning right at traffic signal.  \n- Pedestrian crossing visible on left, with cars stopped at red light.\n[60-90s] - Driver's hands are on the steering wheel, navigating the bus through city streets.  \n- A yellow taxi is visible ahead, moving in the same direction as the bus.  \n- The bus approaches an intersection with traffic lights, which are currently green.\n[90-120s] - Driver's hands grip steering wheel, navigating through city streets with visible traffic and pedestrians.  \n- A yellow bus is seen ahead, followed by a blue bus turning left at an intersection.  \n- The bus passes under an elevated structure, with \"LANE\" painted on the road surface.\n[120-150s] - Driver's hands remain on steering wheel, occasionally adjusting grip as bus navigates urban street.  \n- Pedestrians and cyclists are visible on sidewalks and bike lanes, moving in various directions.  \n- A black sedan passes the bus on the right, followed by a yellow bus, indicating traffic flow in the city.\n[150-180s] - Driver's hands grip steering wheel, maintaining control as bus navigates urban street.  \n- Pedestrians cross street at intersection, moving from right to left relative to bus direction.  \n- Buildings and trees line both sides of road; distant skyscraper visible in background.\n[180-210s] - Driver's hands are on the steering wheel, controlling the bus as it stops at a crosswalk.  \n- Pedestrians cross the street in front of the bus, some carrying bags or walking in groups.  \n- The bus is stationary at an intersection with shops and trees lining the street.\n[210-240s] - Driver's hands grip steering wheel, making minor adjustments as bus navigates urban street.  \n- Pedestrians cross street at intersection; traffic lights change from green to red.  \n- Bus approaches a crosswalk with visible signage and storefronts on either side.\n[240-270s] - A silver sedan is stationary at the intersection, positioned to the right of the bus's forward view.  \n- A group of pedestrians crosses the street from left to right, moving across the crosswalk in front of the bus.  \n- A blue and white bus is visible in the distance, approaching from the opposite direction on the same road.\n[270-300s] - Driver's left hand grips steering wheel, right hand near dashboard controls.  \n- Yellow taxi approaches from right, stops at intersection, then proceeds.  \n- Pedestrians cross street at crosswalk; some wait at curb, others move across.\n[300-330s] - Driver's left hand rests on the steering wheel, with a tablet mounted nearby.  \n- A yellow bus approaches from the right, crossing the intersection.  \n- Pedestrians are visible crossing the street ahead, near a traffic light.\n[330-360s] - Driver's hands on steering wheel, preparing to move forward.  \n- Pedestrians cross street at intersection, some near crosswalk signals.  \n- Bus approaches intersection with traffic lights and urban buildings visible.\n[360-390s] - Driver's hands on steering wheel, navigating through urban streets with visible storefronts and trees lining the road.  \n- A yellow bus overtakes the vehicle ahead, followed by a blue bus approaching from the opposite direction.  \n- The bus passes a construction zone marked by blue barriers and signage indicating \"A city shaped by transport.\"\n[390-420s] - Driver's hands grip steering wheel, making slight adjustments as bus navigates urban road.  \n- Construction zones with orange barriers and cranes visible on right side of road.  \n- Modern high-rise buildings and historic architecture appear in background as bus proceeds forward.\n[420-450s] - Driver's hands remain on steering wheel, maintaining control as bus proceeds forward.  \n- Construction barriers and orange cones line the road, indicating active roadwork ahead.  \n- City skyline with tall buildings and cranes visible in distance, suggesting urban development.", "history_tokens": 974, "history_utf8_bytes": 4297, "recent_frame_times_s": [434.0115167025862, 435.0115167025862, 436.0115167025862, 437.0115167025862, 438.0115167025862, 439.0115167025862, 440.0115167025862, 441.0115167025862, 442.0115167025862, 443.0115167025862, 444.0115167025862, 445.0115167025862, 446.0115167025862, 447.0115167025862, 448.0115167025862, 449.0115167025862, 450.0115167025862, 451.0115167025862, 452.0115167025862, 453.0115167025862, 454.0115167025862, 455.0115167025862, 456.0115167025862, 457.0115167025862, 458.0115167025862, 459.0115167025862, 460.0115167025862, 461.0115167025862, 462.0115167025862, 463.0115167025862], "recent_frames_sha256": "35a4dbfb4c8cf3f1772424c952b429a52023449998ea49d94cb21ac16c5acc51", "num_recent_frames": 30, "tq": 715999.748740089, "t1": 716001.858740793, "ta": 716001.858740793, "te": 716001.898709892, "first_response_s": 2.1100007039494812, "answer_total_s": 2.149969802936539, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 452, "content_group": "b8922d3f074c88930b8a3be251b42976337157b97524ee15b9be6c39e1f6630b", "question": {"question_id": "sample_452_a751_q0", "video_id": 452, "video_path": "./videos/sample_452_real.mp4", "annotation_index": 751, "question_index": 0, "question": "What is the current weather like outside?", "options": ["A. Rainy and cloudy.", "B. Snowy with heavy clouds.", "C. Sunny with clear skies.", "D. Windy and overcast."], "answer": "C", "time_stamp_s": 3, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_452_a751_q0", "video_id": 452, "time_stamp_s": 3, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dc59c7b5dd1b4db11a6e240499efc63fe708beca27d8b1b21a7d9d9ef42aeb6c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.041015625, 1.0065328663793103, 2.0065328663793105], "recent_frames_sha256": "a243a6f6eb407a220b86db23fde574ea6af79dfb99493b0033005c7e63f0cfb5", "num_recent_frames": 3, "tq": 716670.222486361, "t1": 716671.373061508, "ta": 716671.373061508, "te": 716671.523736242, "first_response_s": 1.150575147010386, "answer_total_s": 1.3012498809257522, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_452_a751_q0", "video_id": 452, "time_stamp_s": 3, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2e3cc8a1e72bac2f1502f45db9d011c4c6963869fc1f1a5a238d89e4fb4a48c6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.041015625, 1.0065328663793103, 2.0065328663793105], "recent_frames_sha256": "a243a6f6eb407a220b86db23fde574ea6af79dfb99493b0033005c7e63f0cfb5", "num_recent_frames": 3, "tq": 716526.815937643, "t1": 716538.612425963, "ta": 716538.612425963, "te": 716538.650154579, "first_response_s": 11.796488319989294, "answer_total_s": 11.834216935909353, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 452, "content_group": "b8922d3f074c88930b8a3be251b42976337157b97524ee15b9be6c39e1f6630b", "question": {"question_id": "sample_452_a752_q0", "video_id": 452, "video_path": "./videos/sample_452_real.mp4", "annotation_index": 752, "question_index": 0, "question": "What color is the suv that is visible ahead?", "options": ["A. Orange.", "B. Blue.", "C. Black.", "D. Green."], "answer": "C", "time_stamp_s": 101, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [97, 102], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_452_a752_q0", "video_id": 452, "time_stamp_s": 101, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6e8e4a2ba5e1dfc25670a8d2ba52de8bace0512df9e04b0901ebbfd4564cc654", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [71.00653286637932, 72.00653286637932, 73.00653286637932, 74.00653286637932, 75.00653286637932, 76.00653286637932, 77.00653286637932, 78.00653286637932, 79.00653286637932, 80.00653286637932, 81.00653286637932, 82.00653286637932, 83.00653286637932, 84.00653286637932, 85.00653286637932, 86.00653286637932, 87.00653286637932, 88.00653286637932, 89.00653286637932, 90.00653286637932, 91.00653286637932, 92.00653286637932, 93.00653286637932, 94.00653286637932, 95.00653286637932, 96.00653286637932, 97.00653286637932, 98.00653286637932, 99.00653286637932, 100.00653286637932], "recent_frames_sha256": "d52eade2d48ade8c64bb925357d4cb4edc8face126432d0ec1dcd5cdbe63a447", "num_recent_frames": 30, "tq": 716671.556578443, "t1": 716676.690231861, "ta": 716676.690231861, "te": 716676.727547175, "first_response_s": 5.133653417928144, "answer_total_s": 5.170968731981702, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_452_a752_q0", "video_id": 452, "time_stamp_s": 101, "ground_truth": "C", "raw_output": "C. Black.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "da802ef5167217b5e6f480d7f8fcb6c5fab88b209fd81ad0530c2529e42272b7", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver's hands on steering wheel, navigating a city street with buildings and trees on either side.  \n- A black Toyota pickup truck is visible ahead, moving slowly in the same direction.  \n- Sunlight creates glare on the windshield, with a \"30\" speed limit sign visible on the right.\n[30-60s] - Driver's hands grip steering wheel as bus navigates urban intersection with Toyota pickup truck ahead.  \n- Bus passes \"City Arts Cafe\" and other storefronts, then turns right onto a street with construction barriers.  \n- Sun glare visible on windshield as bus continues forward, with tall buildings and palm trees lining the road.\n[60-90s] - Driver's left hand adjusts steering wheel while right hand remains on wheel, indicating controlled maneuvering.  \n- A white bus with blue markings overtakes the vehicle from the right, moving ahead on the same lane.  \n- Bright sunlight creates glare on the windshield, partially obscuring distant traffic and buildings.", "history_tokens": 211, "history_utf8_bytes": 966, "recent_frame_times_s": [71.00653286637932, 72.00653286637932, 73.00653286637932, 74.00653286637932, 75.00653286637932, 76.00653286637932, 77.00653286637932, 78.00653286637932, 79.00653286637932, 80.00653286637932, 81.00653286637932, 82.00653286637932, 83.00653286637932, 84.00653286637932, 85.00653286637932, 86.00653286637932, 87.00653286637932, 88.00653286637932, 89.00653286637932, 90.00653286637932, 91.00653286637932, 92.00653286637932, 93.00653286637932, 94.00653286637932, 95.00653286637932, 96.00653286637932, 97.00653286637932, 98.00653286637932, 99.00653286637932, 100.00653286637932], "recent_frames_sha256": "d52eade2d48ade8c64bb925357d4cb4edc8face126432d0ec1dcd5cdbe63a447", "num_recent_frames": 30, "tq": 716568.284664375, "t1": 716575.902052358, "ta": 716575.902052358, "te": 716576.27635105, "first_response_s": 7.61738798301667, "answer_total_s": 7.991686674999073, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 452, "content_group": "b8922d3f074c88930b8a3be251b42976337157b97524ee15b9be6c39e1f6630b", "question": {"question_id": "sample_452_a753_q0", "video_id": 452, "video_path": "./videos/sample_452_real.mp4", "annotation_index": 753, "question_index": 0, "question": "What brand name is visible on the large sign on the left side of the road?", "options": ["A. WESTIE.", "B. SYNAPSE.", "C. FASHION.", "D. COFFEE."], "answer": "B", "time_stamp_s": 198, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [194, 199], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_452_a753_q0", "video_id": 452, "time_stamp_s": 198, "ground_truth": "B", "raw_output": "C. FASHION.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "ff2d18f62482baaee168728180053136411dde611e61373814a945c5ac37a1ec", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [168.0065328663793, 169.0065328663793, 170.0065328663793, 171.0065328663793, 172.0065328663793, 173.0065328663793, 174.0065328663793, 175.0065328663793, 176.0065328663793, 177.0065328663793, 178.0065328663793, 179.0065328663793, 180.0065328663793, 181.0065328663793, 182.0065328663793, 183.0065328663793, 184.0065328663793, 185.0065328663793, 186.0065328663793, 187.0065328663793, 188.0065328663793, 189.0065328663793, 190.0065328663793, 191.0065328663793, 192.0065328663793, 193.0065328663793, 194.0065328663793, 195.0065328663793, 196.0065328663793, 197.0065328663793], "recent_frames_sha256": "19c53c86f1fb19dabbcdd60fbe59ec088434e4d44c94dd92bf92982af56ee1f3", "num_recent_frames": 30, "tq": 716676.762996401, "t1": 716682.96152052, "ta": 716682.96152052, "te": 716683.188232566, "first_response_s": 6.198524118983187, "answer_total_s": 6.425236164941452, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_452_a753_q0", "video_id": 452, "time_stamp_s": 198, "ground_truth": "B", "raw_output": "C. FASHION.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "2fa356a05aec4e75654da29fc71e1a487ad51f591cb2737b84d0333a648bd760", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver's hands on steering wheel, navigating a city street with buildings and trees on either side.  \n- A black Toyota pickup truck is visible ahead, moving slowly in the same direction.  \n- Sunlight creates glare on the windshield, with a \"30\" speed limit sign visible on the right.\n[30-60s] - Driver's hands grip steering wheel as bus navigates urban intersection with Toyota pickup truck ahead.  \n- Bus passes \"City Arts Cafe\" and other storefronts, then turns right onto a street with construction barriers.  \n- Sun glare visible on windshield as bus continues forward, with tall buildings and palm trees lining the road.\n[60-90s] - Driver's left hand adjusts steering wheel while right hand remains on wheel, indicating controlled maneuvering.  \n- A white bus with blue markings overtakes the vehicle from the right, moving ahead on the same lane.  \n- Bright sunlight creates glare on the windshield, partially obscuring distant traffic and buildings.\n[90-120s] - Driver's hands grip steering wheel, navigating through urban streets with visible traffic and construction zones.  \n- Sunlight glares through windshield, casting bright reflections on dashboard and road ahead.  \n- Vehicle passes intersections and commercial buildings, with palm trees and utility poles lining the road.\n[120-150s] - Driver's hands grip steering wheel, shifting from left to right as vehicle turns right at intersection.  \n- Sun glare visible through windshield, casting bright reflections on dashboard and road ahead.  \n- Traffic light changes from red to green, allowing vehicle to proceed through intersection.\n[150-180s] - Driver's hands are on the steering wheel, making slight adjustments as the bus moves forward.  \n- A red building with a \"CLINIC\" sign is visible on the left side of the road.  \n- The bus passes a parked motorcycle and continues down a tree-lined street.", "history_tokens": 408, "history_utf8_bytes": 1875, "recent_frame_times_s": [168.0065328663793, 169.0065328663793, 170.0065328663793, 171.0065328663793, 172.0065328663793, 173.0065328663793, 174.0065328663793, 175.0065328663793, 176.0065328663793, 177.0065328663793, 178.0065328663793, 179.0065328663793, 180.0065328663793, 181.0065328663793, 182.0065328663793, 183.0065328663793, 184.0065328663793, 185.0065328663793, 186.0065328663793, 187.0065328663793, 188.0065328663793, 189.0065328663793, 190.0065328663793, 191.0065328663793, 192.0065328663793, 193.0065328663793, 194.0065328663793, 195.0065328663793, 196.0065328663793, 197.0065328663793], "recent_frames_sha256": "19c53c86f1fb19dabbcdd60fbe59ec088434e4d44c94dd92bf92982af56ee1f3", "num_recent_frames": 30, "tq": 716603.378266623, "t1": 716610.687784095, "ta": 716610.687784095, "te": 716610.969059585, "first_response_s": 7.309517471934669, "answer_total_s": 7.590792962000705, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 452, "content_group": "b8922d3f074c88930b8a3be251b42976337157b97524ee15b9be6c39e1f6630b", "question": {"question_id": "sample_452_a754_q0", "video_id": 452, "video_path": "./videos/sample_452_real.mp4", "annotation_index": 754, "question_index": 0, "question": "What brand name is visible on the building to the right?", "options": ["A. 3HB.", "B. 3HT.", "C. 5HB.", "D. 5HT."], "answer": "A", "time_stamp_s": 294, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [291, 296], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_452_a754_q0", "video_id": 452, "time_stamp_s": 294, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "26944ade39abc3ed924c539cb7af976e0483442944da31e02d13a6e3a2c5197d", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [264.0065328663793, 265.0065328663793, 266.0065328663793, 267.0065328663793, 268.0065328663793, 269.0065328663793, 270.0065328663793, 271.0065328663793, 272.0065328663793, 273.0065328663793, 274.0065328663793, 275.0065328663793, 276.0065328663793, 277.0065328663793, 278.0065328663793, 279.0065328663793, 280.0065328663793, 281.0065328663793, 282.0065328663793, 283.0065328663793, 284.0065328663793, 285.0065328663793, 286.0065328663793, 287.0065328663793, 288.0065328663793, 289.0065328663793, 290.0065328663793, 291.0065328663793, 292.0065328663793, 293.0065328663793], "recent_frames_sha256": "d9b3701ab5d7fa519e50d245edffbad7d8e6579bd32e50e6c00b38dfaeab0926", "num_recent_frames": 30, "tq": 716683.204636955, "t1": 716690.841588157, "ta": 716690.841588157, "te": 716690.881257151, "first_response_s": 7.636951201944612, "answer_total_s": 7.676620195969008, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_452_a754_q0", "video_id": 452, "time_stamp_s": 294, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d38887e6235ec0c1a97e0f973dbf750b46fd73582d62dbc9c054f2164c73cfc5", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver's hands on steering wheel, navigating a city street with buildings and trees on either side.  \n- A black Toyota pickup truck is visible ahead, moving slowly in the same direction.  \n- Sunlight creates glare on the windshield, with a \"30\" speed limit sign visible on the right.\n[30-60s] - Driver's hands grip steering wheel as bus navigates urban intersection with Toyota pickup truck ahead.  \n- Bus passes \"City Arts Cafe\" and other storefronts, then turns right onto a street with construction barriers.  \n- Sun glare visible on windshield as bus continues forward, with tall buildings and palm trees lining the road.\n[60-90s] - Driver's left hand adjusts steering wheel while right hand remains on wheel, indicating controlled maneuvering.  \n- A white bus with blue markings overtakes the vehicle from the right, moving ahead on the same lane.  \n- Bright sunlight creates glare on the windshield, partially obscuring distant traffic and buildings.\n[90-120s] - Driver's hands grip steering wheel, navigating through urban streets with visible traffic and construction zones.  \n- Sunlight glares through windshield, casting bright reflections on dashboard and road ahead.  \n- Vehicle passes intersections and commercial buildings, with palm trees and utility poles lining the road.\n[120-150s] - Driver's hands grip steering wheel, shifting from left to right as vehicle turns right at intersection.  \n- Sun glare visible through windshield, casting bright reflections on dashboard and road ahead.  \n- Traffic light changes from red to green, allowing vehicle to proceed through intersection.\n[150-180s] - Driver's hands are on the steering wheel, making slight adjustments as the bus moves forward.  \n- A red building with a \"CLINIC\" sign is visible on the left side of the road.  \n- The bus passes a parked motorcycle and continues down a tree-lined street.\n[180-210s] - Driver's hands maintain steady grip on steering wheel while navigating urban street.  \n- Vehicles, including a red car and a white van, pass by on the road ahead.  \n- Buildings with signage, such as \"BAGS & CO\" and \"THE WOODS,\" are visible on either side of the road.\n[210-240s] - Driver's hands maintain steady grip on steering wheel, navigating through urban streets.  \n- Traffic light turns green, allowing vehicle to proceed straight ahead.  \n- Pedestrian crossing appears ahead, with no visible pedestrians currently crossing.\n[240-270s] - Driver's hands are on the steering wheel, with the left hand slightly adjusting position as the bus approaches an intersection.  \n- Traffic light changes from red to green, allowing the bus to proceed forward.  \n- Pedestrian crossing area is visible on the left side of the road, with no pedestrians currently crossing.", "history_tokens": 614, "history_utf8_bytes": 2753, "recent_frame_times_s": [264.0065328663793, 265.0065328663793, 266.0065328663793, 267.0065328663793, 268.0065328663793, 269.0065328663793, 270.0065328663793, 271.0065328663793, 272.0065328663793, 273.0065328663793, 274.0065328663793, 275.0065328663793, 276.0065328663793, 277.0065328663793, 278.0065328663793, 279.0065328663793, 280.0065328663793, 281.0065328663793, 282.0065328663793, 283.0065328663793, 284.0065328663793, 285.0065328663793, 286.0065328663793, 287.0065328663793, 288.0065328663793, 289.0065328663793, 290.0065328663793, 291.0065328663793, 292.0065328663793, 293.0065328663793], "recent_frames_sha256": "d9b3701ab5d7fa519e50d245edffbad7d8e6579bd32e50e6c00b38dfaeab0926", "num_recent_frames": 30, "tq": 716629.849161529, "t1": 716637.165747716, "ta": 716637.165747716, "te": 716637.577046879, "first_response_s": 7.316586186992936, "answer_total_s": 7.727885350002907, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 452, "content_group": "b8922d3f074c88930b8a3be251b42976337157b97524ee15b9be6c39e1f6630b", "question": {"question_id": "sample_452_a755_q0", "video_id": 452, "video_path": "./videos/sample_452_real.mp4", "annotation_index": 755, "question_index": 0, "question": "What is the current color of the nearest car parked on the left side of the road?", "options": ["A. Black.", "B. Red.", "C. White.", "D. Blue."], "answer": "C", "time_stamp_s": 390, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [388, 393], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_452_a755_q0", "video_id": 452, "time_stamp_s": 390, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1eaac2e5b855c837167f7521626676dbfec93b6ac3b62eaef122c4e65c869b69", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [360.0065328663793, 361.0065328663793, 362.0065328663793, 363.0065328663793, 364.0065328663793, 365.0065328663793, 366.0065328663793, 367.0065328663793, 368.0065328663793, 369.0065328663793, 370.0065328663793, 371.0065328663793, 372.0065328663793, 373.0065328663793, 374.0065328663793, 375.0065328663793, 376.0065328663793, 377.0065328663793, 378.0065328663793, 379.0065328663793, 380.0065328663793, 381.0065328663793, 382.0065328663793, 383.0065328663793, 384.0065328663793, 385.0065328663793, 386.0065328663793, 387.0065328663793, 388.0065328663793, 389.0065328663793], "recent_frames_sha256": "cbdfe2db77a967fa31bf7e4b761bfa29f64cc4807072a48dc971c07493196099", "num_recent_frames": 30, "tq": 716690.899351027, "t1": 716702.503403554, "ta": 716702.503403554, "te": 716702.544085926, "first_response_s": 11.604052526992746, "answer_total_s": 11.644734899047762, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_452_a755_q0", "video_id": 452, "time_stamp_s": 390, "ground_truth": "C", "raw_output": "C. White.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "5fea7c9f4353cd12c42972a7baad4af55f4776fd4a4e13ebd0631204d35fa072", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Driver's hands on steering wheel, navigating a city street with buildings and trees on either side.  \n- A black Toyota pickup truck is visible ahead, moving slowly in the same direction.  \n- Sunlight creates glare on the windshield, with a \"30\" speed limit sign visible on the right.\n[30-60s] - Driver's hands grip steering wheel as bus navigates urban intersection with Toyota pickup truck ahead.  \n- Bus passes \"City Arts Cafe\" and other storefronts, then turns right onto a street with construction barriers.  \n- Sun glare visible on windshield as bus continues forward, with tall buildings and palm trees lining the road.\n[60-90s] - Driver's left hand adjusts steering wheel while right hand remains on wheel, indicating controlled maneuvering.  \n- A white bus with blue markings overtakes the vehicle from the right, moving ahead on the same lane.  \n- Bright sunlight creates glare on the windshield, partially obscuring distant traffic and buildings.\n[90-120s] - Driver's hands grip steering wheel, navigating through urban streets with visible traffic and construction zones.  \n- Sunlight glares through windshield, casting bright reflections on dashboard and road ahead.  \n- Vehicle passes intersections and commercial buildings, with palm trees and utility poles lining the road.\n[120-150s] - Driver's hands grip steering wheel, shifting from left to right as vehicle turns right at intersection.  \n- Sun glare visible through windshield, casting bright reflections on dashboard and road ahead.  \n- Traffic light changes from red to green, allowing vehicle to proceed through intersection.\n[150-180s] - Driver's hands are on the steering wheel, making slight adjustments as the bus moves forward.  \n- A red building with a \"CLINIC\" sign is visible on the left side of the road.  \n- The bus passes a parked motorcycle and continues down a tree-lined street.\n[180-210s] - Driver's hands maintain steady grip on steering wheel while navigating urban street.  \n- Vehicles, including a red car and a white van, pass by on the road ahead.  \n- Buildings with signage, such as \"BAGS & CO\" and \"THE WOODS,\" are visible on either side of the road.\n[210-240s] - Driver's hands maintain steady grip on steering wheel, navigating through urban streets.  \n- Traffic light turns green, allowing vehicle to proceed straight ahead.  \n- Pedestrian crossing appears ahead, with no visible pedestrians currently crossing.\n[240-270s] - Driver's hands are on the steering wheel, with the left hand slightly adjusting position as the bus approaches an intersection.  \n- Traffic light changes from red to green, allowing the bus to proceed forward.  \n- Pedestrian crossing area is visible on the left side of the road, with no pedestrians currently crossing.\n[270-300s] - Driver's hand rests on steering wheel, maintaining control as bus waits at red light.  \n- Pedestrians cross street at intersection, moving from left to right relative to bus.  \n- Traffic lights change from green to red, signaling bus to stop.\n[300-330s] - Driver's hands are on the steering wheel, controlling the bus as it proceeds through an urban intersection.  \n- A red bus is visible to the left, moving in the same direction, while a white car passes on the right.  \n- The bus navigates a street lined with commercial buildings and trees under clear blue skies.\n[330-360s] - Driver's hands grip steering wheel, maintaining control as vehicle moves forward on urban road.  \n- Traffic includes cars and a white van, with vehicles passing on both sides of the road.  \n- Road features trees, utility poles, and buildings lining the street under clear blue sky.\n[360-390s] - Driver's hands grip steering wheel, making slight adjustments while navigating residential street.  \n- Yellow SUV is directly ahead, moving slowly, with driver's right hand occasionally gesturing toward it.  \n- Left side mirror reflects passing vehicles and street scenery, indicating continuous forward motion.", "history_tokens": 884, "history_utf8_bytes": 3954, "recent_frame_times_s": [360.0065328663793, 361.0065328663793, 362.0065328663793, 363.0065328663793, 364.0065328663793, 365.0065328663793, 366.0065328663793, 367.0065328663793, 368.0065328663793, 369.0065328663793, 370.0065328663793, 371.0065328663793, 372.0065328663793, 373.0065328663793, 374.0065328663793, 375.0065328663793, 376.0065328663793, 377.0065328663793, 378.0065328663793, 379.0065328663793, 380.0065328663793, 381.0065328663793, 382.0065328663793, 383.0065328663793, 384.0065328663793, 385.0065328663793, 386.0065328663793, 387.0065328663793, 388.0065328663793, 389.0065328663793], "recent_frames_sha256": "cbdfe2db77a967fa31bf7e4b761bfa29f64cc4807072a48dc971c07493196099", "num_recent_frames": 30, "tq": 716663.616761201, "t1": 716669.816051772, "ta": 716669.816051772, "te": 716670.19485043, "first_response_s": 6.199290571035817, "answer_total_s": 6.578089229064062, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 453, "content_group": "30a795eca90cad2a8c1ead57209ea597d3ead6653cd9d41d4d38797c09d6ae73", "question": {"question_id": "sample_453_a362_q0", "video_id": 453, "video_path": "./videos/sample_453_real.mp4", "annotation_index": 362, "question_index": 0, "question": "What is the color of the bus zone sign visible right now?", "options": ["A. Red and white.", "B. Blue and white.", "C. Green and white.", "D. Black and yellow."], "answer": "A", "time_stamp_s": 4, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_453_a362_q0", "video_id": 453, "time_stamp_s": 4, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "49cc56f42cdb9b5de7c9d45b254aa27d6192ca8f62c94fdda9623d218388cffe", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003], "recent_frames_sha256": "13bda67ef488657cc3762ae306ba11e13d07fa670d2cc18a55772e366766fd46", "num_recent_frames": 4, "tq": 718185.220639421, "t1": 718185.65424169, "ta": 718185.65424169, "te": 718185.693835166, "first_response_s": 0.43360226892400533, "answer_total_s": 0.47319574502762407, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_453_a362_q0", "video_id": 453, "time_stamp_s": 4, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bd21427fb250a5ba71c2a901b25441e6bbe450d8168e8f84443c11523870ef48", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002, 3.003], "recent_frames_sha256": "13bda67ef488657cc3762ae306ba11e13d07fa670d2cc18a55772e366766fd46", "num_recent_frames": 4, "tq": 718224.421983448, "t1": 718225.69619201, "ta": 718225.69619201, "te": 718226.039639936, "first_response_s": 1.2742085619829595, "answer_total_s": 1.6176564879715443, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 453, "content_group": "30a795eca90cad2a8c1ead57209ea597d3ead6653cd9d41d4d38797c09d6ae73", "question": {"question_id": "sample_453_a363_q0", "video_id": 453, "video_path": "./videos/sample_453_real.mp4", "annotation_index": 363, "question_index": 0, "question": "What is the color of the traffic light right now?", "options": ["A. Green.", "B. Yellow.", "C. Red.", "D. Blue."], "answer": "A", "time_stamp_s": 199, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [200, 205], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_453_a363_q0", "video_id": 453, "time_stamp_s": 199, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ec47c7244537c174cb4db253ab67bdb2b569c5440fef1ea49a2c6f58ddbb506f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668], "recent_frames_sha256": "2a832e5c20e8f685ccebe41236570796f80ad4015f64cdc305e6a9042f1cecc1", "num_recent_frames": 30, "tq": 718185.706885115, "t1": 718198.086542919, "ta": 718198.086542919, "te": 718198.12635034, "first_response_s": 12.37965780403465, "answer_total_s": 12.419465224957094, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_453_a363_q0", "video_id": 453, "time_stamp_s": 199, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "cdc098c380e75556c2231597ed46e50d5d597cac33e0c3ce93bea879925a4c86", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands are on the steering wheel, maneuvering the bus through city streets with visible traffic and buildings.  \n- Two digital screens mounted on the dashboard display real-time navigation and rear-view footage.  \n- The bus passes by street signs, including a \"No Parking\" sign, and navigates through an urban environment with trees and parked vehicles.\n[30-60s] - Driver's hands maintain steady control of the steering wheel while navigating urban streets.  \n- Dashboard displays show vehicle speed and other metrics, with a digital clock indicating time.  \n- Multiple screens above the windshield show live camera feeds and route information.\n[60-90s] - Driver's hands remain steady on the steering wheel, navigating through urban traffic.  \n- Multiple screens display route maps and real-time traffic data, aiding navigation.  \n- Vehicles, including trucks and cars, pass by on the road ahead, indicating active street movement.\n[90-120s] - Driver's hands are on the steering wheel, with the left hand occasionally adjusting the wheel.  \n- A large orange truck is directly ahead, stopped at a traffic light, with its headlights on.  \n- The bus's dashboard displays a speedometer reading around 14 mph, and the driver is navigating through a city street lined with trees and buildings.\n[120-150s] - Driver's hands maneuver steering wheel, adjusting direction as bus navigates urban street.  \n- Bus passes under a covered pedestrian walkway with visible signage and storefronts.  \n- Traffic ahead includes a large orange construction vehicle and other vehicles on multi-lane road.\n[150-180s] - Driver's hands remain steady on the steering wheel, with right hand slightly adjusting grip.  \n- Red vehicle ahead shows illuminated brake lights, indicating stop or slow movement.  \n- Left-side red truck is stationary, positioned parallel to the bus’s lane.", "history_tokens": 401, "history_utf8_bytes": 1873, "recent_frame_times_s": [169.00216666666665, 170.00316666666666, 171.00416666666666, 172.00516666666667, 173.00616666666667, 174.00716666666668, 175.00816666666665, 176.00916666666666, 177.01016666666666, 178.01116666666667, 179.01216666666667, 180.01316666666668, 181.01416666666665, 182.01516666666666, 183.01616666666666, 184.01716666666667, 185.01816666666667, 186.01916666666668, 187.02016666666665, 188.02116666666666, 189.02216666666666, 190.02316666666667, 191.02416666666667, 192.02516666666668, 193.02616666666665, 194.02716666666666, 195.02816666666666, 196.02916666666667, 197.03016666666667, 198.03116666666668], "recent_frames_sha256": "2a832e5c20e8f685ccebe41236570796f80ad4015f64cdc305e6a9042f1cecc1", "num_recent_frames": 30, "tq": 718277.658182772, "t1": 718285.059532794, "ta": 718285.059532794, "te": 718285.359480755, "first_response_s": 7.401350022060797, "answer_total_s": 7.701297983061522, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 453, "content_group": "30a795eca90cad2a8c1ead57209ea597d3ead6653cd9d41d4d38797c09d6ae73", "question": {"question_id": "sample_453_a364_q0", "video_id": 453, "video_path": "./videos/sample_453_real.mp4", "annotation_index": 364, "question_index": 0, "question": "What can be identified about the current traffic light status for vehicles?", "options": ["A. Red light.", "B. Yellow light.", "C. Green light.", "D. Flashing light."], "answer": "C", "time_stamp_s": 402, "task_type": "Attribute Recognition", "required_ability": "episodic memory", "video_category": "driving", "reference_interval_s": [400, 405], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_453_a364_q0", "video_id": 453, "time_stamp_s": 402, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3058511ea033204684fa83100e89eaf1c1a040f0a83e8167df503644c05b096d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.0169666666667, 385.01796666666667, 386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665, 394.0269666666667, 395.02796666666666, 396.0289666666667, 397.02996666666667, 398.03096666666664, 399.0319666666667, 400.03296666666665, 401.0006], "recent_frames_sha256": "89b67d4e3858ae2ee2e39be58e3e04d4486bb051ec1a9bba6014324f84ccf8c3", "num_recent_frames": 30, "tq": 718198.142962981, "t1": 718208.384130818, "ta": 718208.384130818, "te": 718208.421270709, "first_response_s": 10.241167836938985, "answer_total_s": 10.27830772800371, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_453_a364_q0", "video_id": 453, "time_stamp_s": 402, "ground_truth": "C", "raw_output": "C. Green light.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "a629f2f4ccfa67ba5627a83a89022befa52521cc17cd91fbaa77eb45e4da1d3f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands are on the steering wheel, maneuvering the bus through city streets with visible traffic and buildings.  \n- Two digital screens mounted on the dashboard display real-time navigation and rear-view footage.  \n- The bus passes by street signs, including a \"No Parking\" sign, and navigates through an urban environment with trees and parked vehicles.\n[30-60s] - Driver's hands maintain steady control of the steering wheel while navigating urban streets.  \n- Dashboard displays show vehicle speed and other metrics, with a digital clock indicating time.  \n- Multiple screens above the windshield show live camera feeds and route information.\n[60-90s] - Driver's hands remain steady on the steering wheel, navigating through urban traffic.  \n- Multiple screens display route maps and real-time traffic data, aiding navigation.  \n- Vehicles, including trucks and cars, pass by on the road ahead, indicating active street movement.\n[90-120s] - Driver's hands are on the steering wheel, with the left hand occasionally adjusting the wheel.  \n- A large orange truck is directly ahead, stopped at a traffic light, with its headlights on.  \n- The bus's dashboard displays a speedometer reading around 14 mph, and the driver is navigating through a city street lined with trees and buildings.\n[120-150s] - Driver's hands maneuver steering wheel, adjusting direction as bus navigates urban street.  \n- Bus passes under a covered pedestrian walkway with visible signage and storefronts.  \n- Traffic ahead includes a large orange construction vehicle and other vehicles on multi-lane road.\n[150-180s] - Driver's hands remain steady on the steering wheel, with right hand slightly adjusting grip.  \n- Red vehicle ahead shows illuminated brake lights, indicating stop or slow movement.  \n- Left-side red truck is stationary, positioned parallel to the bus’s lane.\n[180-210s] - Driver's hands grip steering wheel, navigating through urban streets with traffic lights and vehicles ahead.  \n- Bus dashboard displays speed and other metrics; multiple screens show live camera feeds from different angles.  \n- Red car ahead stops at intersection, followed by a white van and a large red truck on the left.\n[210-240s] - Driver's hands are on the steering wheel, with right hand occasionally adjusting controls.  \n- Dashboard displays show speed and other metrics, with a digital clock reading \"12:00\" at 210 seconds.  \n- Road ahead features traffic, pedestrians, and tall buildings, with a red car visible in front.\n[240-270s] - Driver's hands remain on steering wheel, maintaining control of bus.  \n- Digital display shows route number \"177\" and destination \"Sungai Besi\".  \n- Right-side screen displays a map with route guidance, while left screen shows a passenger or driver interface.\n[270-300s] - Driver's hands grip steering wheel, with left hand occasionally adjusting controls.  \n- Bus navigates urban street with traffic lights and other vehicles, including a yellow bus ahead.  \n- Dashboard displays speed and route information; screens show navigation and rear-view footage.\n[300-330s] - Driver's hands remain steady on the steering wheel, maintaining control of the bus.  \n- A white delivery truck with \"Green Coast\" branding is directly ahead, stationary or moving slowly.  \n- The bus's digital dashboard displays route information and speed, indicating active navigation.\n[330-360s] - Driver's hands are on the steering wheel, navigating through traffic with a \"Green Coast\" sign visible ahead.  \n- Multiple digital screens display route maps and traffic information, with a GPS device on the right.  \n- The bus passes under an elevated structure, with pedestrians and vehicles visible on the street.\n[360-390s] - Driver's hands grip steering wheel, making minor adjustments as bus navigates urban street.  \n- Multiple screens display route maps and traffic info; bus passes intersections with green lights.  \n- On-screen digital clock shows 360.5 seconds, indicating time within the video segment.", "history_tokens": 884, "history_utf8_bytes": 4016, "recent_frame_times_s": [372.0049666666667, 373.00596666666667, 374.00696666666664, 375.0079666666667, 376.00896666666665, 377.0099666666667, 378.01096666666666, 379.0119666666667, 380.01296666666667, 381.01396666666665, 382.0149666666667, 383.01596666666666, 384.0169666666667, 385.01796666666667, 386.01896666666664, 387.0199666666667, 388.02096666666665, 389.0219666666667, 390.02296666666666, 391.0239666666667, 392.02496666666667, 393.02596666666665, 394.0269666666667, 395.02796666666666, 396.0289666666667, 397.02996666666667, 398.03096666666664, 399.0319666666667, 400.03296666666665, 401.0006], "recent_frames_sha256": "89b67d4e3858ae2ee2e39be58e3e04d4486bb051ec1a9bba6014324f84ccf8c3", "num_recent_frames": 30, "tq": 718333.856482448, "t1": 718342.227724995, "ta": 718342.227724995, "te": 718342.419156274, "first_response_s": 8.371242546942085, "answer_total_s": 8.562673825887032, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 453, "content_group": "30a795eca90cad2a8c1ead57209ea597d3ead6653cd9d41d4d38797c09d6ae73", "question": {"question_id": "sample_453_a365_q0", "video_id": 453, "video_path": "./videos/sample_453_real.mp4", "annotation_index": 365, "question_index": 0, "question": "What is the time displayed on the dashboard right now?", "options": ["A. 7:10:30.", "B. 7:11:02.", "C. 7:12:15.", "D. 7:11:45."], "answer": "B", "time_stamp_s": 606, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [600, 605], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_453_a365_q0", "video_id": 453, "time_stamp_s": 606, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d2d30250f8f2af56a3b8b96c8348a1cd4896ff6a8c0696b3f29f88291ee7bb0c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [576.0087666666667, 577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0167666666666, 585.0177666666667, 586.0187666666667, 587.0197666666667, 588.0207666666666, 589.0217666666666, 590.0227666666667, 591.0237666666667, 592.0247666666667, 593.0257666666666, 594.0267666666666, 595.0277666666667, 596.0287666666667, 597.0297666666667, 598.0307666666666, 599.0317666666666, 600.0327666666667, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044], "recent_frames_sha256": "a19166495d6770c4d663af770264f5b275c30d61acda2142de88a9ccc4e64061", "num_recent_frames": 30, "tq": 718208.435123887, "t1": 718217.329653284, "ta": 718217.329653284, "te": 718217.371909578, "first_response_s": 8.894529397017322, "answer_total_s": 8.936785690952092, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_453_a365_q0", "video_id": 453, "time_stamp_s": 606, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "427df07f599aac85d0338bab6ac553da525a0f09b336244e3bcacf4190bc469d", "condition_order": ["recent", "notes"], "memory": "[180-210s] - Driver's hands grip steering wheel, navigating through urban streets with traffic lights and vehicles ahead.  \n- Bus dashboard displays speed and other metrics; multiple screens show live camera feeds from different angles.  \n- Red car ahead stops at intersection, followed by a white van and a large red truck on the left.\n[210-240s] - Driver's hands are on the steering wheel, with right hand occasionally adjusting controls.  \n- Dashboard displays show speed and other metrics, with a digital clock reading \"12:00\" at 210 seconds.  \n- Road ahead features traffic, pedestrians, and tall buildings, with a red car visible in front.\n[240-270s] - Driver's hands remain on steering wheel, maintaining control of bus.  \n- Digital display shows route number \"177\" and destination \"Sungai Besi\".  \n- Right-side screen displays a map with route guidance, while left screen shows a passenger or driver interface.\n[270-300s] - Driver's hands grip steering wheel, with left hand occasionally adjusting controls.  \n- Bus navigates urban street with traffic lights and other vehicles, including a yellow bus ahead.  \n- Dashboard displays speed and route information; screens show navigation and rear-view footage.\n[300-330s] - Driver's hands remain steady on the steering wheel, maintaining control of the bus.  \n- A white delivery truck with \"Green Coast\" branding is directly ahead, stationary or moving slowly.  \n- The bus's digital dashboard displays route information and speed, indicating active navigation.\n[330-360s] - Driver's hands are on the steering wheel, navigating through traffic with a \"Green Coast\" sign visible ahead.  \n- Multiple digital screens display route maps and traffic information, with a GPS device on the right.  \n- The bus passes under an elevated structure, with pedestrians and vehicles visible on the street.\n[360-390s] - Driver's hands grip steering wheel, making minor adjustments as bus navigates urban street.  \n- Multiple screens display route maps and traffic info; bus passes intersections with green lights.  \n- On-screen digital clock shows 360.5 seconds, indicating time within the video segment.\n[390-420s] - Driver's hands are on the steering wheel, with the left hand near the left column and the right hand near the right column, both hands slightly turned to the left.\n- The bus is moving forward on a city street, passing buildings and trees, with a green light visible ahead.\n- The bus's dashboard displays a speedometer and other gauges, and the driver's left hand is near the left column, while the right hand is near the right column.\n[420-450s] - Driver's hands are on the steering wheel, actively maneuvering the bus through traffic.  \n- A red car is visible ahead, moving in the same direction as the bus.  \n- The bus is approaching an intersection with traffic lights and other vehicles, including a yellow taxi.\n[450-480s] - Driver's hands remain on steering wheel, maintaining control as bus navigates intersection.  \n- Traffic lights ahead show green, allowing vehicles to proceed through the intersection.  \n- Urban skyline with tall buildings and trees visible in background, indicating city environment.\n[480-510s] - Driver's hands maintain steady grip on steering wheel, with left hand slightly adjusting position.  \n- Right-side monitor displays changing traffic or route information, while left monitor shows a static image.  \n- Traffic light ahead turns green, allowing bus to proceed through intersection with cars and pedestrians visible.\n[510-540s] - Driver's hands grip steering wheel, occasionally adjusting position while navigating urban streets.  \n- Multiple digital screens display route maps and vehicle diagnostics, with one screen showing a live camera feed of the road ahead.  \n- Bus passes through intersections with traffic lights, passing pedestrians and vehicles, including a yellow taxi and a green double-decker bus.\n[540-570s] - Driver's hands remain on steering wheel, maintaining control as bus navigates urban street.  \n- Pedestrians cross street at intersection, with traffic lights changing to green.  \n- Buildings and trees line both sides of road, with vehicles moving in both directions.\n[570-600s] - Driver's left hand grips steering wheel, right hand occasionally adjusts controls.  \n- Two smartphones mounted on dashboard display live feeds or navigation maps.  \n- Traffic flows steadily with cars and pedestrians visible on city street.", "history_tokens": 975, "history_utf8_bytes": 4438, "recent_frame_times_s": [576.0087666666667, 577.0097666666667, 578.0107666666667, 579.0117666666666, 580.0127666666667, 581.0137666666667, 582.0147666666667, 583.0157666666667, 584.0167666666666, 585.0177666666667, 586.0187666666667, 587.0197666666667, 588.0207666666666, 589.0217666666666, 590.0227666666667, 591.0237666666667, 592.0247666666667, 593.0257666666666, 594.0267666666666, 595.0277666666667, 596.0287666666667, 597.0297666666667, 598.0307666666666, 599.0317666666666, 600.0327666666667, 601.0004, 602.0014, 603.0024, 604.0034, 605.0044], "recent_frames_sha256": "a19166495d6770c4d663af770264f5b275c30d61acda2142de88a9ccc4e64061", "num_recent_frames": 30, "tq": 718395.253096273, "t1": 718396.707160487, "ta": 718396.707160487, "te": 718396.746174137, "first_response_s": 1.4540642139036208, "answer_total_s": 1.4930778639391065, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 453, "content_group": "30a795eca90cad2a8c1ead57209ea597d3ead6653cd9d41d4d38797c09d6ae73", "question": {"question_id": "sample_453_a366_q0", "video_id": 453, "video_path": "./videos/sample_453_real.mp4", "annotation_index": 366, "question_index": 0, "question": "What is the current speed limit for this road?", "options": ["A. 50.", "B. 60.", "C. 70.", "D. 80."], "answer": "C", "time_stamp_s": 804, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [800, 805], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_453_a366_q0", "video_id": 453, "time_stamp_s": 804, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8f09f33922ed8085df434c94389ccfb99bbf7972deb97c9edfec297a7067aed1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [774.0065666666667, 775.0075666666667, 776.0085666666666, 777.0095666666666, 778.0105666666667, 779.0115666666667, 780.0125666666667, 781.0135666666666, 782.0145666666666, 783.0155666666667, 784.0165666666667, 785.0175666666667, 786.0185666666666, 787.0195666666667, 788.0205666666667, 789.0215666666667, 790.0225666666666, 791.0235666666666, 792.0245666666667, 793.0255666666667, 794.0265666666667, 795.0275666666666, 796.0285666666666, 797.0295666666667, 798.0305666666667, 799.0315666666667, 800.0325666666666, 801.0002, 802.0012, 803.0022], "recent_frames_sha256": "e5b930b3623ba8f6e81358f65a554af88d54c6e8c192a6601d2bc8afa521a19e", "num_recent_frames": 30, "tq": 718217.389352087, "t1": 718224.372761554, "ta": 718224.372761554, "te": 718224.411837914, "first_response_s": 6.9834094669204205, "answer_total_s": 7.022485826979391, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_453_a366_q0", "video_id": 453, "time_stamp_s": 804, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e9c7c94b12492786f8a5e87eb7d65b44fa50f35fdbdfb47eb32cafdc66101cbe", "condition_order": ["recent", "notes"], "memory": "[330-360s] - Driver's hands are on the steering wheel, navigating through traffic with a \"Green Coast\" sign visible ahead.  \n- Multiple digital screens display route maps and traffic information, with a GPS device on the right.  \n- The bus passes under an elevated structure, with pedestrians and vehicles visible on the street.\n[360-390s] - Driver's hands grip steering wheel, making minor adjustments as bus navigates urban street.  \n- Multiple screens display route maps and traffic info; bus passes intersections with green lights.  \n- On-screen digital clock shows 360.5 seconds, indicating time within the video segment.\n[390-420s] - Driver's hands are on the steering wheel, with the left hand near the left column and the right hand near the right column, both hands slightly turned to the left.\n- The bus is moving forward on a city street, passing buildings and trees, with a green light visible ahead.\n- The bus's dashboard displays a speedometer and other gauges, and the driver's left hand is near the left column, while the right hand is near the right column.\n[420-450s] - Driver's hands are on the steering wheel, actively maneuvering the bus through traffic.  \n- A red car is visible ahead, moving in the same direction as the bus.  \n- The bus is approaching an intersection with traffic lights and other vehicles, including a yellow taxi.\n[450-480s] - Driver's hands remain on steering wheel, maintaining control as bus navigates intersection.  \n- Traffic lights ahead show green, allowing vehicles to proceed through the intersection.  \n- Urban skyline with tall buildings and trees visible in background, indicating city environment.\n[480-510s] - Driver's hands maintain steady grip on steering wheel, with left hand slightly adjusting position.  \n- Right-side monitor displays changing traffic or route information, while left monitor shows a static image.  \n- Traffic light ahead turns green, allowing bus to proceed through intersection with cars and pedestrians visible.\n[510-540s] - Driver's hands grip steering wheel, occasionally adjusting position while navigating urban streets.  \n- Multiple digital screens display route maps and vehicle diagnostics, with one screen showing a live camera feed of the road ahead.  \n- Bus passes through intersections with traffic lights, passing pedestrians and vehicles, including a yellow taxi and a green double-decker bus.\n[540-570s] - Driver's hands remain on steering wheel, maintaining control as bus navigates urban street.  \n- Pedestrians cross street at intersection, with traffic lights changing to green.  \n- Buildings and trees line both sides of road, with vehicles moving in both directions.\n[570-600s] - Driver's left hand grips steering wheel, right hand occasionally adjusts controls.  \n- Two smartphones mounted on dashboard display live feeds or navigation maps.  \n- Traffic flows steadily with cars and pedestrians visible on city street.\n[600-630s] - Driver's left hand grips steering wheel, right hand occasionally adjusts controls.  \n- Yellow bus overtakes from right, then slows as traffic builds ahead.  \n- Dashboard displays speed and fuel gauge; multiple screens show route and traffic info.\n[630-660s] - Driver's left hand grips steering wheel, right hand moves toward control panel.  \n- Yellow bus ahead turns left at intersection, followed by red car.  \n- Dashboard displays speedometer reading 30 km/h, with route map visible on right screen.\n[660-690s] - Driver's hands grip steering wheel, making minor adjustments as bus navigates city street.  \n- Multiple digital screens display route maps and real-time traffic data.  \n- Bus passes under a blue construction barrier with visible signage.\n[690-720s] - Driver's hands are on the steering wheel, with right hand occasionally adjusting position.  \n- Multiple screens display route maps and real-time traffic data.  \n- Pedestrians cross the street at a marked crosswalk ahead.\n[720-750s] - Driver's hands remain on steering wheel, with right hand slightly adjusting position.  \n- Left side of dashboard displays green digital readout showing \"000\" (likely route or stop number).  \n- Right side of dashboard shows vehicle speedometer and tachometer with needle indicating low RPM.\n[750-780s] - Driver's hands grip steering wheel, navigating through urban streets with visible traffic and buildings.  \n- Two smartphones mounted on dashboard display live feeds or maps, aiding navigation.  \n- Bus passes by a large, ornate building on the left, transitioning into a more modern cityscape with tall buildings.", "history_tokens": 1002, "history_utf8_bytes": 4551, "recent_frame_times_s": [774.0065666666667, 775.0075666666667, 776.0085666666666, 777.0095666666666, 778.0105666666667, 779.0115666666667, 780.0125666666667, 781.0135666666666, 782.0145666666666, 783.0155666666667, 784.0165666666667, 785.0175666666667, 786.0185666666666, 787.0195666666667, 788.0205666666667, 789.0215666666667, 790.0225666666666, 791.0235666666666, 792.0245666666667, 793.0255666666667, 794.0265666666667, 795.0275666666666, 796.0285666666666, 797.0295666666667, 798.0305666666667, 799.0315666666667, 800.0325666666666, 801.0002, 802.0012, 803.0022], "recent_frames_sha256": "e5b930b3623ba8f6e81358f65a554af88d54c6e8c192a6601d2bc8afa521a19e", "num_recent_frames": 30, "tq": 718444.264029091, "t1": 718451.814707941, "ta": 718451.814707941, "te": 718452.163372718, "first_response_s": 7.550678850035183, "answer_total_s": 7.899343627039343, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 454, "content_group": "cd8176d8436094725b5e7be66a559f73a4c577c04f604d44c6652ce84c0915fe", "question": {"question_id": "sample_454_a893_q0", "video_id": 454, "video_path": "./videos/sample_454_real.mp4", "annotation_index": 893, "question_index": 0, "question": "What color is the vest the man is wearing right now?", "options": ["A. Green.", "B. Orange.", "C. Red.", "D. Yellow."], "answer": "A", "time_stamp_s": 3, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_454_a893_q0", "video_id": 454, "time_stamp_s": 3, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "94e2ebdf554a39b82b3233c2ba3d302cceb9e50c21921cf240921bcc1c36e402", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "7c0ce07481297b89b1d19649527739b90568c6157ebf7d26234adfe64638fb21", "num_recent_frames": 4, "tq": 717979.495546908, "t1": 717985.958609061, "ta": 717985.958609061, "te": 717985.998852532, "first_response_s": 6.463062152964994, "answer_total_s": 6.503305624006316, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_454_a893_q0", "video_id": 454, "time_stamp_s": 3, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f92ae0689b194b4f0fd97b6e098d7d6885034c3204ee7a4323266e5dbe95f59d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "7c0ce07481297b89b1d19649527739b90568c6157ebf7d26234adfe64638fb21", "num_recent_frames": 4, "tq": 718028.027183001, "t1": 718029.511899397, "ta": 718029.511899397, "te": 718029.704772428, "first_response_s": 1.4847163959639147, "answer_total_s": 1.6775894269812852, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 454, "content_group": "cd8176d8436094725b5e7be66a559f73a4c577c04f604d44c6652ce84c0915fe", "question": {"question_id": "sample_454_a894_q0", "video_id": 454, "video_path": "./videos/sample_454_real.mp4", "annotation_index": 894, "question_index": 0, "question": "What is mounted on the dashboard right now?", "options": ["A. A phone with GPS application.", "B. A camera.", "C. A radio.", "D. A small fan."], "answer": "A", "time_stamp_s": 130, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [130, 135], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_454_a894_q0", "video_id": 454, "time_stamp_s": 130, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cb6c67913bbe7535071f4e66b13ae9b058536d05fac0e5331790485a441dce70", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0], "recent_frames_sha256": "69e0b810149a5fd06ac5d4e8ea46e030c1849ff1b239affdeba0523da6481de8", "num_recent_frames": 30, "tq": 717986.014041578, "t1": 717997.896461531, "ta": 717997.896461531, "te": 717997.934120561, "first_response_s": 11.88241995300632, "answer_total_s": 11.920078982948326, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_454_a894_q0", "video_id": 454, "time_stamp_s": 130, "ground_truth": "A", "raw_output": "A. A phone with GPS application.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "9963e559bd7deb28163d8524a2cdd019ab50619651c71d40cf802956e40e0e0c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a black beanie and yellow safety vest stands inside a bus, speaking to the camera while looking around.  \n- He moves toward the bus's rear, then uses a long-handled tool to adjust or clean the floor area between rows of seats.  \n- The bus interior features gray seats with orange seatbelt buckles and a long aisle running down the center.\n[30-60s] - Driver's hand presses buttons on the bus's control panel while seated at the wheel.  \n- Interior view shows rows of empty blue seats with orange seatbelts, aligned along the bus’s length.  \n- Front windshield reveals a road intersection with traffic, side mirrors, and a smartphone mounted on the dashboard.\n[60-90s] - Driver's hands are on the steering wheel, navigating the bus through a suburban intersection with visible traffic and street signs.  \n- A smartphone mounted on the dashboard displays a map or navigation app, indicating route guidance.  \n- The bus interior features blue seats with yellow seatbelts, and the camera pans to show the empty passenger area.\n[90-120s] - Driver's hand grips steering wheel, with smartphone mounted on dashboard, facing forward road.\n- Interior view shows blue seats and windows revealing passing landscape, with sunlight casting shadows.\n- Dashboard instruments and windshield view show clear road ahead, indicating bus is in motion.", "history_tokens": 292, "history_utf8_bytes": 1350, "recent_frame_times_s": [101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0], "recent_frames_sha256": "69e0b810149a5fd06ac5d4e8ea46e030c1849ff1b239affdeba0523da6481de8", "num_recent_frames": 30, "tq": 718065.531904213, "t1": 718067.24589388, "ta": 718067.24589388, "te": 718067.562926191, "first_response_s": 1.7139896670123562, "answer_total_s": 2.0310219780076295, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 454, "content_group": "cd8176d8436094725b5e7be66a559f73a4c577c04f604d44c6652ce84c0915fe", "question": {"question_id": "sample_454_a895_q0", "video_id": 454, "video_path": "./videos/sample_454_real.mp4", "annotation_index": 895, "question_index": 0, "question": "What color is the dashboard right now?", "options": ["A. Blue.", "B. Black.", "C. Gray.", "D. Brown."], "answer": "B", "time_stamp_s": 263, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [260, 265], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_454_a895_q0", "video_id": 454, "time_stamp_s": 263, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "44837e6ced3ff187da396b722bc3d27c68d452570f6ee747c5a5f31babf932a4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0], "recent_frames_sha256": "c0f991fe8b455e8c921a16e5fa50bd6b160e408c74588788953aa4ed71566808", "num_recent_frames": 30, "tq": 717997.954190035, "t1": 718005.716390698, "ta": 718005.716390698, "te": 718005.756182358, "first_response_s": 7.76220066298265, "answer_total_s": 7.801992323016748, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_454_a895_q0", "video_id": 454, "time_stamp_s": 263, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "90432fcfda74bd08a6d84489fb026a2c1eb4cb42b6fa93a21171fb10fa27575f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a black beanie and yellow safety vest stands inside a bus, speaking to the camera while looking around.  \n- He moves toward the bus's rear, then uses a long-handled tool to adjust or clean the floor area between rows of seats.  \n- The bus interior features gray seats with orange seatbelt buckles and a long aisle running down the center.\n[30-60s] - Driver's hand presses buttons on the bus's control panel while seated at the wheel.  \n- Interior view shows rows of empty blue seats with orange seatbelts, aligned along the bus’s length.  \n- Front windshield reveals a road intersection with traffic, side mirrors, and a smartphone mounted on the dashboard.\n[60-90s] - Driver's hands are on the steering wheel, navigating the bus through a suburban intersection with visible traffic and street signs.  \n- A smartphone mounted on the dashboard displays a map or navigation app, indicating route guidance.  \n- The bus interior features blue seats with yellow seatbelts, and the camera pans to show the empty passenger area.\n[90-120s] - Driver's hand grips steering wheel, with smartphone mounted on dashboard, facing forward road.\n- Interior view shows blue seats and windows revealing passing landscape, with sunlight casting shadows.\n- Dashboard instruments and windshield view show clear road ahead, indicating bus is in motion.\n[120-150s] - Driver's left hand grips steering wheel, maintaining control as vehicle navigates road.  \n- Smartphone mounted on dashboard displays navigation or map, aiding route guidance.  \n- Road ahead shows clear lane markings, with occasional vehicles and roadside trees visible.\n[150-180s] - Driver's hand grips steering wheel, navigating a curve on a paved road.  \n- Smartphone mounted on dashboard displays navigation or map data.  \n- Road ahead shows clear lane markings, trees, and a distant yellow vehicle.\n[180-210s] - Driver's hand remains on steering wheel, maintaining control as vehicle navigates curves.  \n- Road surface shows clear lane markings and a slight curve to the right, with trees lining the roadside.  \n- Vehicle's dashboard displays active navigation, with a GPS device mounted near the steering wheel.\n[210-240s] - Driver's hand grips steering wheel as bus navigates a curve on a multi-lane road.  \n- Smartphone mounted on dashboard displays navigation or map data.  \n- Road ahead shows clear lane markings, with trees and roadside structures visible.", "history_tokens": 532, "history_utf8_bytes": 2430, "recent_frame_times_s": [234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0], "recent_frames_sha256": "c0f991fe8b455e8c921a16e5fa50bd6b160e408c74588788953aa4ed71566808", "num_recent_frames": 30, "tq": 718105.658688742, "t1": 718107.821308526, "ta": 718107.821308526, "te": 718107.866676963, "first_response_s": 2.1626197840087116, "answer_total_s": 2.207988221081905, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 454, "content_group": "cd8176d8436094725b5e7be66a559f73a4c577c04f604d44c6652ce84c0915fe", "question": {"question_id": "sample_454_a896_q0", "video_id": 454, "video_path": "./videos/sample_454_real.mp4", "annotation_index": 896, "question_index": 0, "question": "What type of vehicle is the vehicle ahead right now?", "options": ["A. Taxi.", "B. Delivery van.", "C. School bus.", "D. Ambulance."], "answer": "C", "time_stamp_s": 393, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [390, 395], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_454_a896_q0", "video_id": 454, "time_stamp_s": 393, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4cc1ece7570882409cb5b7861a912cc287fdea762cc46098bcc5b3294847a7ab", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0], "recent_frames_sha256": "8439051953753ad4fefc690cacd0458e01a7dd450bb92aa4cf5a13496c6b1980", "num_recent_frames": 30, "tq": 718005.778872715, "t1": 718017.461091209, "ta": 718017.461091209, "te": 718017.503271728, "first_response_s": 11.682218494010158, "answer_total_s": 11.724399013095535, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_454_a896_q0", "video_id": 454, "time_stamp_s": 393, "ground_truth": "C", "raw_output": "C. School bus.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "fdd47c268859de63ed8e80054882c27df9702bee1d1a43ec454eff004838f14f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A man in a black beanie and yellow safety vest stands inside a bus, speaking to the camera while looking around.  \n- He moves toward the bus's rear, then uses a long-handled tool to adjust or clean the floor area between rows of seats.  \n- The bus interior features gray seats with orange seatbelt buckles and a long aisle running down the center.\n[30-60s] - Driver's hand presses buttons on the bus's control panel while seated at the wheel.  \n- Interior view shows rows of empty blue seats with orange seatbelts, aligned along the bus’s length.  \n- Front windshield reveals a road intersection with traffic, side mirrors, and a smartphone mounted on the dashboard.\n[60-90s] - Driver's hands are on the steering wheel, navigating the bus through a suburban intersection with visible traffic and street signs.  \n- A smartphone mounted on the dashboard displays a map or navigation app, indicating route guidance.  \n- The bus interior features blue seats with yellow seatbelts, and the camera pans to show the empty passenger area.\n[90-120s] - Driver's hand grips steering wheel, with smartphone mounted on dashboard, facing forward road.\n- Interior view shows blue seats and windows revealing passing landscape, with sunlight casting shadows.\n- Dashboard instruments and windshield view show clear road ahead, indicating bus is in motion.\n[120-150s] - Driver's left hand grips steering wheel, maintaining control as vehicle navigates road.  \n- Smartphone mounted on dashboard displays navigation or map, aiding route guidance.  \n- Road ahead shows clear lane markings, with occasional vehicles and roadside trees visible.\n[150-180s] - Driver's hand grips steering wheel, navigating a curve on a paved road.  \n- Smartphone mounted on dashboard displays navigation or map data.  \n- Road ahead shows clear lane markings, trees, and a distant yellow vehicle.\n[180-210s] - Driver's hand remains on steering wheel, maintaining control as vehicle navigates curves.  \n- Road surface shows clear lane markings and a slight curve to the right, with trees lining the roadside.  \n- Vehicle's dashboard displays active navigation, with a GPS device mounted near the steering wheel.\n[210-240s] - Driver's hand grips steering wheel as bus navigates a curve on a multi-lane road.  \n- Smartphone mounted on dashboard displays navigation or map data.  \n- Road ahead shows clear lane markings, with trees and roadside structures visible.\n[240-270s] - Driver's hand is on the steering wheel, guiding the truck along a winding road.  \n- A smartphone mounted on the dashboard displays navigation or route information.  \n- The truck's rearview mirror reflects the road behind, showing a clear path ahead.\n[270-300s] - Driver's hand on steering wheel, navigating a multi-lane road with clear lane markings.\n- A smartphone mounted on the dashboard displays a map or navigation app.\n- A large vehicle (possibly a truck) is visible ahead, moving in the same direction as the camera vehicle.\n[300-330s] - Driver's hand grips steering wheel, maintaining control as vehicle navigates highway.\n- Smartphone mounted on dashboard displays navigation or media, positioned near driver's left hand.\n- Road ahead shows clear lanes with occasional vehicles, bordered by trees and concrete barriers.\n[330-360s] - Driver's hand remains on steering wheel, maintaining control as truck navigates a curve.  \n- Road signs and lane markings are visible ahead, indicating a turn or intersection.  \n- Interior dashboard displays and rearview mirror reflect the truck’s ongoing movement.\n[360-390s] - Driver's hands are on the steering wheel, navigating the bus through a curve.  \n- A yellow school bus is directly ahead, following the same path.  \n- The bus interior includes a dashboard with gauges and a mounted smartphone.", "history_tokens": 838, "history_utf8_bytes": 3792, "recent_frame_times_s": [364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0], "recent_frames_sha256": "8439051953753ad4fefc690cacd0458e01a7dd450bb92aa4cf5a13496c6b1980", "num_recent_frames": 30, "tq": 718151.21245516, "t1": 718158.690648971, "ta": 718158.690648971, "te": 718158.892708691, "first_response_s": 7.478193811024539, "answer_total_s": 7.680253530968912, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 454, "content_group": "cd8176d8436094725b5e7be66a559f73a4c577c04f604d44c6652ce84c0915fe", "question": {"question_id": "sample_454_a897_q0", "video_id": 454, "video_path": "./videos/sample_454_real.mp4", "annotation_index": 897, "question_index": 0, "question": "What is attached to the dashboard right now?", "options": ["A. A notebook.", "B. A GPS device.", "C. A mobile phone.", "D. A calculator."], "answer": "C", "time_stamp_s": 521, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [520, 525], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_454_a897_q0", "video_id": 454, "time_stamp_s": 521, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "37850736a382af9f729fc9b9e7d072abf7e70dc1e699ba82663a03e5fbd0baba", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0], "recent_frames_sha256": "afed01247196324c8dd0a2e1ae75945af78370e8b9f3e570c151add2a66a61f5", "num_recent_frames": 30, "tq": 718017.51881636, "t1": 718027.980116642, "ta": 718027.980116642, "te": 718028.017821886, "first_response_s": 10.461300281924196, "answer_total_s": 10.499005525954999, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_454_a897_q0", "video_id": 454, "time_stamp_s": 521, "ground_truth": "C", "raw_output": "C. A mobile phone.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "c9a4f62018f069472341ada56e14f7dda46758b67556e7eb27df45039d1a0dc5", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Driver's hands are on the steering wheel, navigating the bus through a suburban intersection with visible traffic and street signs.  \n- A smartphone mounted on the dashboard displays a map or navigation app, indicating route guidance.  \n- The bus interior features blue seats with yellow seatbelts, and the camera pans to show the empty passenger area.\n[90-120s] - Driver's hand grips steering wheel, with smartphone mounted on dashboard, facing forward road.\n- Interior view shows blue seats and windows revealing passing landscape, with sunlight casting shadows.\n- Dashboard instruments and windshield view show clear road ahead, indicating bus is in motion.\n[120-150s] - Driver's left hand grips steering wheel, maintaining control as vehicle navigates road.  \n- Smartphone mounted on dashboard displays navigation or map, aiding route guidance.  \n- Road ahead shows clear lane markings, with occasional vehicles and roadside trees visible.\n[150-180s] - Driver's hand grips steering wheel, navigating a curve on a paved road.  \n- Smartphone mounted on dashboard displays navigation or map data.  \n- Road ahead shows clear lane markings, trees, and a distant yellow vehicle.\n[180-210s] - Driver's hand remains on steering wheel, maintaining control as vehicle navigates curves.  \n- Road surface shows clear lane markings and a slight curve to the right, with trees lining the roadside.  \n- Vehicle's dashboard displays active navigation, with a GPS device mounted near the steering wheel.\n[210-240s] - Driver's hand grips steering wheel as bus navigates a curve on a multi-lane road.  \n- Smartphone mounted on dashboard displays navigation or map data.  \n- Road ahead shows clear lane markings, with trees and roadside structures visible.\n[240-270s] - Driver's hand is on the steering wheel, guiding the truck along a winding road.  \n- A smartphone mounted on the dashboard displays navigation or route information.  \n- The truck's rearview mirror reflects the road behind, showing a clear path ahead.\n[270-300s] - Driver's hand on steering wheel, navigating a multi-lane road with clear lane markings.\n- A smartphone mounted on the dashboard displays a map or navigation app.\n- A large vehicle (possibly a truck) is visible ahead, moving in the same direction as the camera vehicle.\n[300-330s] - Driver's hand grips steering wheel, maintaining control as vehicle navigates highway.\n- Smartphone mounted on dashboard displays navigation or media, positioned near driver's left hand.\n- Road ahead shows clear lanes with occasional vehicles, bordered by trees and concrete barriers.\n[330-360s] - Driver's hand remains on steering wheel, maintaining control as truck navigates a curve.  \n- Road signs and lane markings are visible ahead, indicating a turn or intersection.  \n- Interior dashboard displays and rearview mirror reflect the truck’s ongoing movement.\n[360-390s] - Driver's hands are on the steering wheel, navigating the bus through a curve.  \n- A yellow school bus is directly ahead, following the same path.  \n- The bus interior includes a dashboard with gauges and a mounted smartphone.\n[390-420s] - Driver's hands are on the steering wheel, maneuvering the bus through a turn.  \n- A yellow school bus is directly ahead, following the same path.  \n- The bus interior includes a mounted smartphone and dashboard instruments.\n[420-450s] - Driver's hands are on the steering wheel, maneuvering the bus to make a right turn at an intersection.  \n- A yellow school bus is directly ahead, positioned to turn right, with its front facing the driver’s view.  \n- The bus’s side mirror reflects the driver’s hand and part of the dashboard, indicating a focused driving posture.\n[450-480s] - A yellow school bus is directly ahead, stationary or moving slowly, with its rear lights illuminated.  \n- The bus driver’s hand is visible on the steering wheel, indicating active control or preparation to maneuver.  \n- A smartphone mounted on the dashboard displays a map or navigation app, suggesting route guidance.\n[480-510s] - Yellow school bus ahead is stationary, with its rear lights illuminated, indicating it may be stopped or turning.  \n- Driver’s view shows a clear windshield with reflections of the sun and surrounding environment.  \n- A smartphone mounted on the dashboard displays a map or navigation app, suggesting route guidance is active.", "history_tokens": 962, "history_utf8_bytes": 4376, "recent_frame_times_s": [492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0], "recent_frames_sha256": "afed01247196324c8dd0a2e1ae75945af78370e8b9f3e570c151add2a66a61f5", "num_recent_frames": 30, "tq": 718195.854273631, "t1": 718196.919270125, "ta": 718196.919270125, "te": 718197.188089094, "first_response_s": 1.0649964939802885, "answer_total_s": 1.3338154630037025, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 455, "content_group": "f4da523c2db14143b693b70ef394776b9340c6224716135727df3916abcec3e4", "question": {"question_id": "sample_455_a1676_q0", "video_id": 455, "video_path": "./videos/sample_455_real.mp4", "annotation_index": 1676, "question_index": 0, "question": "What kind of lighting condition is present right now in the video?", "options": ["A. Daylight.", "B. Dusk.", "C. Nighttime.", "D. Dawn."], "answer": "C", "time_stamp_s": 3, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_455_a1676_q0", "video_id": 455, "time_stamp_s": 3, "ground_truth": "C", "raw_output": "C. Nighttime.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "4e268a819be00001fdff1ce646e11ddecce3bfdead0a8de7b7171bc02baf5698", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "06b2b2ba200b94db1cd3d8a215a9c660b29046206da4bf4107bd3687919e82eb", "num_recent_frames": 4, "tq": 717460.894347961, "t1": 717461.669681549, "ta": 717461.669681549, "te": 717461.856559573, "first_response_s": 0.7753335880115628, "answer_total_s": 0.9622116120299324, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_455_a1676_q0", "video_id": 455, "time_stamp_s": 3, "ground_truth": "C", "raw_output": "C. Nighttime.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "263ea928c539b25a2a73a6a1040baac6ef209218116d0cd4e0496b68f5202e8f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0], "recent_frames_sha256": "06b2b2ba200b94db1cd3d8a215a9c660b29046206da4bf4107bd3687919e82eb", "num_recent_frames": 4, "tq": 717305.038077686, "t1": 717317.077599627, "ta": 717317.077599627, "te": 717317.435409453, "first_response_s": 12.039521940983832, "answer_total_s": 12.397331767017022, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 455, "content_group": "f4da523c2db14143b693b70ef394776b9340c6224716135727df3916abcec3e4", "question": {"question_id": "sample_455_a1677_q0", "video_id": 455, "video_path": "./videos/sample_455_real.mp4", "annotation_index": 1677, "question_index": 0, "question": "What type of traffic signal is present right now?", "options": ["A. A green light.", "B. A yellow light.", "C. A flashing light.", "D. A red light."], "answer": "D", "time_stamp_s": 136, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [133, 138], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_455_a1677_q0", "video_id": 455, "time_stamp_s": 136, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0abcb372b87408ecd29dc2909ffde528aa9804745787f37cba013247d50dc651", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0], "recent_frames_sha256": "74b94e3c3e22082b268f1649203316af024da59734284b6486c3281694889c7a", "num_recent_frames": 30, "tq": 717461.881202175, "t1": 717474.923337678, "ta": 717474.923337678, "te": 717474.962876122, "first_response_s": 13.042135502910241, "answer_total_s": 13.081673946930096, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_455_a1677_q0", "video_id": 455, "time_stamp_s": 136, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a10217b162e8f1f4baa35b55f2f971d5cc065a53a9d3306056607010f9acbe89", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A smartphone mounted on the dashboard displays a screen with text and icons, likely showing navigation or vehicle info.  \n- The bus's interior dashboard glows with illuminated gauges and indicators, including speedometer and fuel gauge, under low-light conditions.  \n- The bus is driving at night on a road with visible lane markings, streetlights, and occasional traffic signs, with the camera perspective from the driver’s seat.\n[30-60s] - Driver's hands are on the steering wheel, navigating a dark road with illuminated dashboard gauges.  \n- A smartphone mounted on the left side displays a map or navigation app, guiding the route.  \n- The vehicle moves steadily forward, passing streetlights and occasional roadside signs under low ambient light.\n[60-90s] - Driver's hands are on the steering wheel, making minor adjustments while driving at night.  \n- A smartphone mounted on the dashboard displays a map or navigation app, with visible text and icons.  \n- The vehicle's dashboard lights illuminate various gauges, including speedometer and fuel level, indicating active operation.\n[90-120s] - Driver's hands are on the steering wheel, navigating a dark road with illuminated dashboard gauges.  \n- A smartphone mounted on the left side of the dashboard displays a map or navigation app.  \n- The vehicle approaches a traffic light at an intersection, with brake lights of oncoming vehicles visible ahead.", "history_tokens": 299, "history_utf8_bytes": 1422, "recent_frame_times_s": [107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0], "recent_frames_sha256": "74b94e3c3e22082b268f1649203316af024da59734284b6486c3281694889c7a", "num_recent_frames": 30, "tq": 717353.569744419, "t1": 717354.611577407, "ta": 717354.611577407, "te": 717354.907406571, "first_response_s": 1.0418329880340025, "answer_total_s": 1.3376621520146728, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 455, "content_group": "f4da523c2db14143b693b70ef394776b9340c6224716135727df3916abcec3e4", "question": {"question_id": "sample_455_a1678_q0", "video_id": 455, "video_path": "./videos/sample_455_real.mp4", "annotation_index": 1678, "question_index": 0, "question": "What type of vehicle is visible directly ahead the camera right now?", "options": ["A. A sedan.", "B. A motorcycle.", "C. A truck.", "D. A bicycle."], "answer": "C", "time_stamp_s": 267, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [266, 271], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_455_a1678_q0", "video_id": 455, "time_stamp_s": 267, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8d6213f49181fffc6e3fcc9c57e4e15b8eea3024690467e8a61cfdc1b933bcc6", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0], "recent_frames_sha256": "9d39e997520c8bce36692f595ae2d47c6ba16f12a2982c4c2b02a115b3bec45b", "num_recent_frames": 30, "tq": 717474.977282043, "t1": 717485.605814998, "ta": 717485.605814998, "te": 717485.644934075, "first_response_s": 10.628532955073752, "answer_total_s": 10.667652031988837, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_455_a1678_q0", "video_id": 455, "time_stamp_s": 267, "ground_truth": "C", "raw_output": "C. A truck.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "1558b447c49f78e9c82c789fbd8528515048c953963dda10a51cb15842577c12", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A smartphone mounted on the dashboard displays a screen with text and icons, likely showing navigation or vehicle info.  \n- The bus's interior dashboard glows with illuminated gauges and indicators, including speedometer and fuel gauge, under low-light conditions.  \n- The bus is driving at night on a road with visible lane markings, streetlights, and occasional traffic signs, with the camera perspective from the driver’s seat.\n[30-60s] - Driver's hands are on the steering wheel, navigating a dark road with illuminated dashboard gauges.  \n- A smartphone mounted on the left side displays a map or navigation app, guiding the route.  \n- The vehicle moves steadily forward, passing streetlights and occasional roadside signs under low ambient light.\n[60-90s] - Driver's hands are on the steering wheel, making minor adjustments while driving at night.  \n- A smartphone mounted on the dashboard displays a map or navigation app, with visible text and icons.  \n- The vehicle's dashboard lights illuminate various gauges, including speedometer and fuel level, indicating active operation.\n[90-120s] - Driver's hands are on the steering wheel, navigating a dark road with illuminated dashboard gauges.  \n- A smartphone mounted on the left side of the dashboard displays a map or navigation app.  \n- The vehicle approaches a traffic light at an intersection, with brake lights of oncoming vehicles visible ahead.\n[120-150s] - Driver's hand holds smartphone displaying map, positioned on dashboard near steering wheel.  \n- Dashboard instruments glow with orange lights, showing speed and other metrics.  \n- Vehicle navigates a dark intersection with traffic lights and other vehicles visible through windshield.\n[150-180s] - A smartphone mounted on the dashboard displays a map or navigation app, showing route details.\n- The bus's dashboard lights are illuminated, indicating active vehicle systems and speedometer readings.\n- The bus is navigating a multi-lane intersection at night, with traffic lights and other vehicles visible ahead.\n[180-210s] - A smartphone mounted on the dashboard displays a map or navigation app, likely guiding the truck driver.\n- The truck's dashboard lights illuminate the steering wheel and gauges, indicating active vehicle systems.\n- The truck is stationary at an intersection with traffic lights, as other vehicles pass by in the background.\n[210-240s] - Driver's hands are on the steering wheel, making slight adjustments as the truck navigates a dark intersection.\n- A smartphone mounted on the dashboard displays a map or navigation app, indicating route guidance.\n- The truck's dashboard lights illuminate various gauges, showing speed and engine status as the vehicle moves through traffic.", "history_tokens": 569, "history_utf8_bytes": 2739, "recent_frame_times_s": [238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0, 247.0, 248.0, 249.0, 250.0, 251.0, 252.0, 253.0, 254.0, 255.0, 256.0, 257.0, 258.0, 259.0, 260.0, 261.0, 262.0, 263.0, 264.0, 265.0, 266.0, 267.0], "recent_frames_sha256": "9d39e997520c8bce36692f595ae2d47c6ba16f12a2982c4c2b02a115b3bec45b", "num_recent_frames": 30, "tq": 717384.299925368, "t1": 717390.137101016, "ta": 717390.137101016, "te": 717390.439507261, "first_response_s": 5.837175647960976, "answer_total_s": 6.1395818929886445, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 455, "content_group": "f4da523c2db14143b693b70ef394776b9340c6224716135727df3916abcec3e4", "question": {"question_id": "sample_455_a1679_q0", "video_id": 455, "video_path": "./videos/sample_455_real.mp4", "annotation_index": 1679, "question_index": 0, "question": "What is the color of the other bus visible right now?", "options": ["A. Red.", "B. Green.", "C. Yellow.", "D. Blue."], "answer": "C", "time_stamp_s": 400, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [399, 404], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_455_a1679_q0", "video_id": 455, "time_stamp_s": 400, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a7c909f1f08ec32482672257021c40088a972d5c3fc076814bbff6e7ad5365a3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0], "recent_frames_sha256": "793183c102d0e8582e42855b5a822f64d518e6e2a87dad8e299232b8d616abd5", "num_recent_frames": 30, "tq": 717485.656298262, "t1": 717497.701208367, "ta": 717497.701208367, "te": 717498.087500015, "first_response_s": 12.044910105061717, "answer_total_s": 12.431201753090136, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_455_a1679_q0", "video_id": 455, "time_stamp_s": 400, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ae976836c5e96c1966321de0d0830f447a07d1c9abe66dddce4907bc07cae400", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A smartphone mounted on the dashboard displays a screen with text and icons, likely showing navigation or vehicle info.  \n- The bus's interior dashboard glows with illuminated gauges and indicators, including speedometer and fuel gauge, under low-light conditions.  \n- The bus is driving at night on a road with visible lane markings, streetlights, and occasional traffic signs, with the camera perspective from the driver’s seat.\n[30-60s] - Driver's hands are on the steering wheel, navigating a dark road with illuminated dashboard gauges.  \n- A smartphone mounted on the left side displays a map or navigation app, guiding the route.  \n- The vehicle moves steadily forward, passing streetlights and occasional roadside signs under low ambient light.\n[60-90s] - Driver's hands are on the steering wheel, making minor adjustments while driving at night.  \n- A smartphone mounted on the dashboard displays a map or navigation app, with visible text and icons.  \n- The vehicle's dashboard lights illuminate various gauges, including speedometer and fuel level, indicating active operation.\n[90-120s] - Driver's hands are on the steering wheel, navigating a dark road with illuminated dashboard gauges.  \n- A smartphone mounted on the left side of the dashboard displays a map or navigation app.  \n- The vehicle approaches a traffic light at an intersection, with brake lights of oncoming vehicles visible ahead.\n[120-150s] - Driver's hand holds smartphone displaying map, positioned on dashboard near steering wheel.  \n- Dashboard instruments glow with orange lights, showing speed and other metrics.  \n- Vehicle navigates a dark intersection with traffic lights and other vehicles visible through windshield.\n[150-180s] - A smartphone mounted on the dashboard displays a map or navigation app, showing route details.\n- The bus's dashboard lights are illuminated, indicating active vehicle systems and speedometer readings.\n- The bus is navigating a multi-lane intersection at night, with traffic lights and other vehicles visible ahead.\n[180-210s] - A smartphone mounted on the dashboard displays a map or navigation app, likely guiding the truck driver.\n- The truck's dashboard lights illuminate the steering wheel and gauges, indicating active vehicle systems.\n- The truck is stationary at an intersection with traffic lights, as other vehicles pass by in the background.\n[210-240s] - Driver's hands are on the steering wheel, making slight adjustments as the truck navigates a dark intersection.\n- A smartphone mounted on the dashboard displays a map or navigation app, indicating route guidance.\n- The truck's dashboard lights illuminate various gauges, showing speed and engine status as the vehicle moves through traffic.\n[240-270s] - Driver's hands are on the steering wheel, navigating through traffic at night.  \n- A smartphone mounted on the left side displays a map or navigation app.  \n- The dashboard lights illuminate the instrument cluster, showing vehicle speed and other metrics.\n[270-300s] - Driver's hands are on the steering wheel, navigating through traffic at night.  \n- A smartphone mounted on the dashboard displays a map or navigation app.  \n- The truck's dashboard lights illuminate the controls, with speed and RPM indicators visible.\n[300-330s] - Driver's hands are on the steering wheel, maintaining control of the truck.  \n- A smartphone mounted on the dashboard displays a map or navigation app.  \n- The truck's illuminated dashboard gauges and indicators are active, showing operational status.\n[330-360s] - Driver's hands are on the steering wheel, navigating a curved road at night.  \n- Dashboard lights illuminate the interior, showing speed and other gauges.  \n- A smartphone mounted on the left side displays a map or navigation app.\n[360-390s] - Driver's hands maintain steady control of the steering wheel while navigating a dark road at night.\n- Dashboard instruments glow with orange illumination, indicating active vehicle systems.\n- A smartphone mounted on the dashboard displays a map or navigation app, aiding the driver's route.", "history_tokens": 866, "history_utf8_bytes": 4086, "recent_frame_times_s": [371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0], "recent_frames_sha256": "793183c102d0e8582e42855b5a822f64d518e6e2a87dad8e299232b8d616abd5", "num_recent_frames": 30, "tq": 717426.441201085, "t1": 717427.905929856, "ta": 717427.905929856, "te": 717428.206310451, "first_response_s": 1.4647287710104138, "answer_total_s": 1.7651093660388142, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 455, "content_group": "f4da523c2db14143b693b70ef394776b9340c6224716135727df3916abcec3e4", "question": {"question_id": "sample_455_a1680_q0", "video_id": 455, "video_path": "./videos/sample_455_real.mp4", "annotation_index": 1680, "question_index": 0, "question": "What is mounted on the dashboard right now?", "options": ["A. A phone with GPS application.", "B. A radio receiver.", "C. An air freshener.", "D. A digital clock."], "answer": "A", "time_stamp_s": 536, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [532, 537], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_455_a1680_q0", "video_id": 455, "time_stamp_s": 536, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2a8af1686f27460647a262026f5af929e8414216a836199b7d38864269e505c5", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0], "recent_frames_sha256": "67a6f90a7217fae48a670f6d0a0c86c228b09722a2f9597c124421ef5f44a092", "num_recent_frames": 30, "tq": 717498.097815372, "t1": 717510.121384572, "ta": 717510.121384572, "te": 717510.159766039, "first_response_s": 12.02356919995509, "answer_total_s": 12.061950666946359, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_455_a1680_q0", "video_id": 455, "time_stamp_s": 536, "ground_truth": "A", "raw_output": "A. A phone with GPS application.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "be68e382b1fcdfdd70301db27cf565f5c235ac4efdd428e27afbe06831e04671", "condition_order": ["notes", "recent"], "memory": "[30-60s] - Driver's hands are on the steering wheel, navigating a dark road with illuminated dashboard gauges.  \n- A smartphone mounted on the left side displays a map or navigation app, guiding the route.  \n- The vehicle moves steadily forward, passing streetlights and occasional roadside signs under low ambient light.\n[60-90s] - Driver's hands are on the steering wheel, making minor adjustments while driving at night.  \n- A smartphone mounted on the dashboard displays a map or navigation app, with visible text and icons.  \n- The vehicle's dashboard lights illuminate various gauges, including speedometer and fuel level, indicating active operation.\n[90-120s] - Driver's hands are on the steering wheel, navigating a dark road with illuminated dashboard gauges.  \n- A smartphone mounted on the left side of the dashboard displays a map or navigation app.  \n- The vehicle approaches a traffic light at an intersection, with brake lights of oncoming vehicles visible ahead.\n[120-150s] - Driver's hand holds smartphone displaying map, positioned on dashboard near steering wheel.  \n- Dashboard instruments glow with orange lights, showing speed and other metrics.  \n- Vehicle navigates a dark intersection with traffic lights and other vehicles visible through windshield.\n[150-180s] - A smartphone mounted on the dashboard displays a map or navigation app, showing route details.\n- The bus's dashboard lights are illuminated, indicating active vehicle systems and speedometer readings.\n- The bus is navigating a multi-lane intersection at night, with traffic lights and other vehicles visible ahead.\n[180-210s] - A smartphone mounted on the dashboard displays a map or navigation app, likely guiding the truck driver.\n- The truck's dashboard lights illuminate the steering wheel and gauges, indicating active vehicle systems.\n- The truck is stationary at an intersection with traffic lights, as other vehicles pass by in the background.\n[210-240s] - Driver's hands are on the steering wheel, making slight adjustments as the truck navigates a dark intersection.\n- A smartphone mounted on the dashboard displays a map or navigation app, indicating route guidance.\n- The truck's dashboard lights illuminate various gauges, showing speed and engine status as the vehicle moves through traffic.\n[240-270s] - Driver's hands are on the steering wheel, navigating through traffic at night.  \n- A smartphone mounted on the left side displays a map or navigation app.  \n- The dashboard lights illuminate the instrument cluster, showing vehicle speed and other metrics.\n[270-300s] - Driver's hands are on the steering wheel, navigating through traffic at night.  \n- A smartphone mounted on the dashboard displays a map or navigation app.  \n- The truck's dashboard lights illuminate the controls, with speed and RPM indicators visible.\n[300-330s] - Driver's hands are on the steering wheel, maintaining control of the truck.  \n- A smartphone mounted on the dashboard displays a map or navigation app.  \n- The truck's illuminated dashboard gauges and indicators are active, showing operational status.\n[330-360s] - Driver's hands are on the steering wheel, navigating a curved road at night.  \n- Dashboard lights illuminate the interior, showing speed and other gauges.  \n- A smartphone mounted on the left side displays a map or navigation app.\n[360-390s] - Driver's hands maintain steady control of the steering wheel while navigating a dark road at night.\n- Dashboard instruments glow with orange illumination, indicating active vehicle systems.\n- A smartphone mounted on the dashboard displays a map or navigation app, aiding the driver's route.\n[390-420s] - Driver's hand grips steering wheel, maintaining control as vehicle navigates road.\n- Smartphone mounted on dashboard displays active navigation or map.\n- Road transitions from dark, illuminated by headlights to bright daylight with visible lane markings and roadside trees.\n[420-450s] - Driver's hand remains on steering wheel, guiding bus through a right turn at an intersection.  \n- A smartphone mounted on the dashboard displays navigation or route information.  \n- The bus's interior dashboard shows illuminated gauges, indicating active vehicle systems.\n[450-480s] - Driver's hand grips steering wheel, maintaining control as vehicle navigates a curved road.  \n- Dashboard displays show vehicle speed and other metrics, indicating active driving.  \n- Road ahead features clear lane markings and a distant horizon with trees and sky visible.\n[480-510s] - Driver's hand remains on steering wheel, maintaining control as vehicle navigates curve.  \n- Road surface shows clear lane markings and slight curvature ahead.  \n- Side mirrors reflect adjacent traffic and roadside vegetation.", "history_tokens": 1004, "history_utf8_bytes": 4742, "recent_frame_times_s": [507.0, 508.0, 509.0, 510.0, 511.0, 512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0], "recent_frames_sha256": "67a6f90a7217fae48a670f6d0a0c86c228b09722a2f9597c124421ef5f44a092", "num_recent_frames": 30, "tq": 717458.67849115, "t1": 717460.440360337, "ta": 717460.440360337, "te": 717460.853091907, "first_response_s": 1.761869187001139, "answer_total_s": 2.1746007569599897, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 457, "content_group": "fef39f187177c123d2340a83a190215f7fc055ff20ca8cf23f68d381d7a15d48", "question": {"question_id": "sample_457_a282_q0", "video_id": 457, "video_path": "./videos/sample_457_real.mp4", "annotation_index": 282, "question_index": 0, "question": "Right now, what is the main color of the bus in front?", "options": ["A. Yellow.", "B. Red.", "C. Blue.", "D. Green."], "answer": "A", "time_stamp_s": 19, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_457_a282_q0", "video_id": 457, "time_stamp_s": 19, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3417880fca60aa9c9ee7a01640cb8a57272e00362656157a876a15bb6e913958", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.036, 1.0036333333333334, 2.0046333333333335, 3.0056333333333334, 4.006633333333333, 5.007633333333334, 6.008633333333333, 7.009633333333333, 8.010633333333333, 9.011633333333334, 10.012633333333333, 11.013633333333333, 12.014633333333334, 13.015633333333334, 14.016633333333333, 15.017633333333333, 16.018633333333334, 17.019633333333335, 18.020633333333333], "recent_frames_sha256": "f73dc15c6cd33a84b673435e5a8c97143f263d371a8798a8e5bc91f3944530f6", "num_recent_frames": 19, "tq": 718817.35005752, "t1": 718828.100636635, "ta": 718828.100636635, "te": 718828.138355632, "first_response_s": 10.750579115003347, "answer_total_s": 10.788298111991026, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_457_a282_q0", "video_id": 457, "time_stamp_s": 19, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "83092bc0412294be40abb38da6bf7ceda5f358bd66e7c16777c9686a1385a2df", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.036, 1.0036333333333334, 2.0046333333333335, 3.0056333333333334, 4.006633333333333, 5.007633333333334, 6.008633333333333, 7.009633333333333, 8.010633333333333, 9.011633333333334, 10.012633333333333, 11.013633333333333, 12.014633333333334, 13.015633333333334, 14.016633333333333, 15.017633333333333, 16.018633333333334, 17.019633333333335, 18.020633333333333], "recent_frames_sha256": "f73dc15c6cd33a84b673435e5a8c97143f263d371a8798a8e5bc91f3944530f6", "num_recent_frames": 19, "tq": 718867.456569877, "t1": 718873.935366946, "ta": 718873.935366946, "te": 718874.333357172, "first_response_s": 6.478797069052234, "answer_total_s": 6.8767872949829325, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 457, "content_group": "fef39f187177c123d2340a83a190215f7fc055ff20ca8cf23f68d381d7a15d48", "question": {"question_id": "sample_457_a283_q0", "video_id": 457, "video_path": "./videos/sample_457_real.mp4", "annotation_index": 283, "question_index": 0, "question": "What is the yellow vehicle on the left side of the street right now?", "options": ["A. DHL van.", "B. Police car.", "C. Fire truck.", "D. Food truck."], "answer": "A", "time_stamp_s": 116, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [115, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_457_a283_q0", "video_id": 457, "time_stamp_s": 116, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "cf136be9473e6fb3d44b18ec0a58d6425c9a6919d82ca3e8d3284a99b5bd62c6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [86.0219, 87.0229, 88.0239, 89.0249, 90.0259, 91.0269, 92.0279, 93.0289, 94.0299, 95.0309, 96.0319, 97.0329, 98.00053333333334, 99.00153333333333, 100.00253333333333, 101.00353333333334, 102.00453333333333, 103.00553333333333, 104.00653333333334, 105.00753333333333, 106.00853333333333, 107.00953333333334, 108.01053333333333, 109.01153333333333, 110.01253333333334, 111.01353333333333, 112.01453333333333, 113.01553333333334, 114.01653333333333, 115.01753333333333], "recent_frames_sha256": "d820463efd150067aaf41347049cbbe9cf114ddaaa164418550977a20a947fe4", "num_recent_frames": 30, "tq": 718828.147794512, "t1": 718836.78095463, "ta": 718836.78095463, "te": 718836.822512742, "first_response_s": 8.63316011801362, "answer_total_s": 8.67471823003143, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_457_a283_q0", "video_id": 457, "time_stamp_s": 116, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a622967c6b0dc89dfb4993d6a7c36bc58f992757dc402ed61096c101f94aa55a", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow bus with \"E2124\" and \"ART\" truck visible ahead, both stationary at intersection.  \n- Driver's hands on steering wheel, navigating through traffic with pedestrians and vehicles around.  \n- Urban environment with tall buildings, street signs, and traffic lights indicating stoppage.\n[30-60s] - Yellow bus (E2124) stationary behind the camera, displaying route info and advertisements on its rear.  \n- Driver’s hand visible on the steering wheel, indicating the bus is not moving.  \n- Urban street scene with pedestrians, cars, and buildings in the background, including a \"B\" sign on the left.\n[60-90s] - Yellow bus (E2124) is directly ahead, moving slowly through traffic.  \n- Driver’s hands are on the steering wheel, navigating the bus.  \n- Pedestrians and cyclists are visible on sidewalks and bike lanes to the left.", "history_tokens": 203, "history_utf8_bytes": 840, "recent_frame_times_s": [86.0219, 87.0229, 88.0239, 89.0249, 90.0259, 91.0269, 92.0279, 93.0289, 94.0299, 95.0309, 96.0319, 97.0329, 98.00053333333334, 99.00153333333333, 100.00253333333333, 101.00353333333334, 102.00453333333333, 103.00553333333333, 104.00653333333334, 105.00753333333333, 106.00853333333333, 107.00953333333334, 108.01053333333333, 109.01153333333333, 110.01253333333334, 111.01353333333333, 112.01453333333333, 113.01553333333334, 114.01653333333333, 115.01753333333333], "recent_frames_sha256": "d820463efd150067aaf41347049cbbe9cf114ddaaa164418550977a20a947fe4", "num_recent_frames": 30, "tq": 718898.506626705, "t1": 718900.297333752, "ta": 718900.297333752, "te": 718900.498340101, "first_response_s": 1.7907070469809696, "answer_total_s": 1.9917133959243074, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 457, "content_group": "fef39f187177c123d2340a83a190215f7fc055ff20ca8cf23f68d381d7a15d48", "question": {"question_id": "sample_457_a284_q0", "video_id": 457, "video_path": "./videos/sample_457_real.mp4", "annotation_index": 284, "question_index": 0, "question": "Right now, what is the speed limit indicated on the yellow bus?", "options": ["A. 90 km/h.", "B. 30 km/h.", "C. 60 km/h.", "D. 80 km/h."], "answer": "A", "time_stamp_s": 232, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [230, 235], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_457_a284_q0", "video_id": 457, "time_stamp_s": 232, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "87571e1291496efb097f377a8c7c642dd2130cf5fe83f9ed7c3d4475b896f439", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [202.00443333333334, 203.00543333333334, 204.00643333333332, 205.00743333333332, 206.00843333333333, 207.00943333333333, 208.01043333333334, 209.01143333333334, 210.01243333333332, 211.01343333333332, 212.01443333333333, 213.01543333333333, 214.01643333333334, 215.01743333333334, 216.01843333333332, 217.01943333333332, 218.02043333333333, 219.02143333333333, 220.02243333333334, 221.02343333333334, 222.02443333333332, 223.02543333333332, 224.02643333333333, 225.02743333333333, 226.02843333333334, 227.02943333333334, 228.03043333333332, 229.03143333333333, 230.03243333333333, 231.00006666666667], "recent_frames_sha256": "078472ae74908b0fb61f6b70540fb735cb08f767d33e2f7d2db784c1454725bf", "num_recent_frames": 30, "tq": 718836.834722301, "t1": 718849.541327212, "ta": 718849.541327212, "te": 718849.579759804, "first_response_s": 12.706604911014438, "answer_total_s": 12.74503750295844, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_457_a284_q0", "video_id": 457, "time_stamp_s": 232, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4c011f94a1d296178943a0f944cad6ca8ca31521b7c0c61cdf385d9915e87ded", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow bus with \"E2124\" and \"ART\" truck visible ahead, both stationary at intersection.  \n- Driver's hands on steering wheel, navigating through traffic with pedestrians and vehicles around.  \n- Urban environment with tall buildings, street signs, and traffic lights indicating stoppage.\n[30-60s] - Yellow bus (E2124) stationary behind the camera, displaying route info and advertisements on its rear.  \n- Driver’s hand visible on the steering wheel, indicating the bus is not moving.  \n- Urban street scene with pedestrians, cars, and buildings in the background, including a \"B\" sign on the left.\n[60-90s] - Yellow bus (E2124) is directly ahead, moving slowly through traffic.  \n- Driver’s hands are on the steering wheel, navigating the bus.  \n- Pedestrians and cyclists are visible on sidewalks and bike lanes to the left.\n[90-120s] - Driver's hands grip steering wheel, maneuvering bus through city traffic.  \n- Yellow bus ahead with brake lights on, followed by red car and white sedan.  \n- Urban street lined with tall buildings, trees, and pedestrians on sidewalks.\n[120-150s] - Yellow bus (route 224) directly ahead, stationary in traffic, with rear display showing route info and advertisements.  \n- Driver’s hand on steering wheel, navigating through urban street with multiple cars and pedestrians visible.  \n- Traffic lights and surrounding buildings indicate a busy city intersection with moderate congestion.\n[150-180s] - Yellow bus with \"E224\" route number is directly ahead, stationary in traffic.  \n- Driver's hands are on the steering wheel, navigating through urban streets with tall buildings and trees.  \n- Red car and other vehicles are visible in traffic behind and to the side of the yellow bus.\n[180-210s] - Yellow bus ahead displays route number \"E2184\" and route map on its rear.  \n- Driver's hands are on steering wheel, navigating through traffic with other vehicles.  \n- Traffic lights change from red to green, allowing bus to proceed forward.", "history_tokens": 469, "history_utf8_bytes": 1991, "recent_frame_times_s": [202.00443333333334, 203.00543333333334, 204.00643333333332, 205.00743333333332, 206.00843333333333, 207.00943333333333, 208.01043333333334, 209.01143333333334, 210.01243333333332, 211.01343333333332, 212.01443333333333, 213.01543333333333, 214.01643333333334, 215.01743333333334, 216.01843333333332, 217.01943333333332, 218.02043333333333, 219.02143333333333, 220.02243333333334, 221.02343333333334, 222.02443333333332, 223.02543333333332, 224.02643333333333, 225.02743333333333, 226.02843333333334, 227.02943333333334, 228.03043333333332, 229.03143333333333, 230.03243333333333, 231.00006666666667], "recent_frames_sha256": "078472ae74908b0fb61f6b70540fb735cb08f767d33e2f7d2db784c1454725bf", "num_recent_frames": 30, "tq": 718962.3743453, "t1": 718963.41195675, "ta": 718963.41195675, "te": 718963.450476135, "first_response_s": 1.0376114499522373, "answer_total_s": 1.076130834990181, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 457, "content_group": "fef39f187177c123d2340a83a190215f7fc055ff20ca8cf23f68d381d7a15d48", "question": {"question_id": "sample_457_a285_q0", "video_id": 457, "video_path": "./videos/sample_457_real.mp4", "annotation_index": 285, "question_index": 0, "question": "Right now, what is the background color of the sign indicating changed traffic conditions?", "options": ["A. Yellow.", "B. Blue.", "C. Red.", "D. White."], "answer": "A", "time_stamp_s": 345, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [345, 350], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_457_a285_q0", "video_id": 457, "time_stamp_s": 345, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8720f2846d6517b229d2dad51134289ef81c5ff85e7587cf72e3f6f6e2a0ede1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [315.01733333333334, 316.0183333333333, 317.01933333333335, 318.0203333333333, 319.02133333333336, 320.02233333333334, 321.0233333333333, 322.02433333333335, 323.0253333333333, 324.02633333333335, 325.02733333333333, 326.0283333333333, 327.02933333333334, 328.0303333333333, 329.03133333333335, 330.0323333333333, 331.03333333333336, 332.00096666666667, 333.00196666666665, 334.0029666666667, 335.00396666666666, 336.0049666666667, 337.00596666666667, 338.00696666666664, 339.0079666666667, 340.00896666666665, 341.0099666666667, 342.01096666666666, 343.0119666666667, 344.01296666666667], "recent_frames_sha256": "4826037cbf2e9521f0558ec25c31d0d7a4b4a9920f063e4c3c67d57b4acaa23c", "num_recent_frames": 30, "tq": 718849.589598669, "t1": 718859.766596775, "ta": 718859.766596775, "te": 718859.918810825, "first_response_s": 10.176998106064275, "answer_total_s": 10.329212156007998, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_457_a285_q0", "video_id": 457, "time_stamp_s": 345, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "b95057d30cef5591f7300233d14eb494f2a4ae1ce13b8ec4098bfd6e79a6ee98", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Yellow bus with \"E2124\" and \"ART\" truck visible ahead, both stationary at intersection.  \n- Driver's hands on steering wheel, navigating through traffic with pedestrians and vehicles around.  \n- Urban environment with tall buildings, street signs, and traffic lights indicating stoppage.\n[30-60s] - Yellow bus (E2124) stationary behind the camera, displaying route info and advertisements on its rear.  \n- Driver’s hand visible on the steering wheel, indicating the bus is not moving.  \n- Urban street scene with pedestrians, cars, and buildings in the background, including a \"B\" sign on the left.\n[60-90s] - Yellow bus (E2124) is directly ahead, moving slowly through traffic.  \n- Driver’s hands are on the steering wheel, navigating the bus.  \n- Pedestrians and cyclists are visible on sidewalks and bike lanes to the left.\n[90-120s] - Driver's hands grip steering wheel, maneuvering bus through city traffic.  \n- Yellow bus ahead with brake lights on, followed by red car and white sedan.  \n- Urban street lined with tall buildings, trees, and pedestrians on sidewalks.\n[120-150s] - Yellow bus (route 224) directly ahead, stationary in traffic, with rear display showing route info and advertisements.  \n- Driver’s hand on steering wheel, navigating through urban street with multiple cars and pedestrians visible.  \n- Traffic lights and surrounding buildings indicate a busy city intersection with moderate congestion.\n[150-180s] - Yellow bus with \"E224\" route number is directly ahead, stationary in traffic.  \n- Driver's hands are on the steering wheel, navigating through urban streets with tall buildings and trees.  \n- Red car and other vehicles are visible in traffic behind and to the side of the yellow bus.\n[180-210s] - Yellow bus ahead displays route number \"E2184\" and route map on its rear.  \n- Driver's hands are on steering wheel, navigating through traffic with other vehicles.  \n- Traffic lights change from red to green, allowing bus to proceed forward.\n[210-240s] - Yellow bus (E212A) ahead displays route info and advertisements on its rear; driver's hands on steering wheel.  \n- Traffic includes red cars and motorcycles; bus slows as it approaches a stop.  \n- Driver’s left hand moves slightly, possibly adjusting controls or checking a device mounted near the steering wheel.\n[240-270s] - Yellow bus (E2124) stationary at intersection, rear displaying \"E2124\" and \"ELECTRIC BUS\" text.  \n- Driver's hand on steering wheel, bus appears to be waiting at traffic light.  \n- Pedestrian visible on sidewalk to right, near parked white van.\n[270-300s] - Yellow bus (E2124) ahead is stationary or moving slowly, with its rear display showing route info and a photo.  \n- Driver’s hands are on the steering wheel, navigating through traffic with other vehicles around.  \n- A red car is visible to the right, moving alongside the bus, with a highway overpass overhead.\n[300-330s] - Yellow double-decker bus ahead, stationary in traffic, with \"90\" route number visible on rear.  \n- Driver's hand on steering wheel, navigating through urban traffic with multiple lanes and vehicles.  \n- Construction site with blue fencing and cranes visible on left, alongside elevated road infrastructure.", "history_tokens": 772, "history_utf8_bytes": 3224, "recent_frame_times_s": [315.01733333333334, 316.0183333333333, 317.01933333333335, 318.0203333333333, 319.02133333333336, 320.02233333333334, 321.0233333333333, 322.02433333333335, 323.0253333333333, 324.02633333333335, 325.02733333333333, 326.0283333333333, 327.02933333333334, 328.0303333333333, 329.03133333333335, 330.0323333333333, 331.03333333333336, 332.00096666666667, 333.00196666666665, 334.0029666666667, 335.00396666666666, 336.0049666666667, 337.00596666666667, 338.00696666666664, 339.0079666666667, 340.00896666666665, 341.0099666666667, 342.01096666666666, 343.0119666666667, 344.01296666666667], "recent_frames_sha256": "4826037cbf2e9521f0558ec25c31d0d7a4b4a9920f063e4c3c67d57b4acaa23c", "num_recent_frames": 30, "tq": 718990.999567872, "t1": 718997.188256725, "ta": 718997.188256725, "te": 718997.22726233, "first_response_s": 6.188688852940686, "answer_total_s": 6.2276944579789415, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 457, "content_group": "fef39f187177c123d2340a83a190215f7fc055ff20ca8cf23f68d381d7a15d48", "question": {"question_id": "sample_457_a286_q0", "video_id": 457, "video_path": "./videos/sample_457_real.mp4", "annotation_index": 286, "question_index": 0, "question": "Right now, what architectural style is predominant in the buildings visible on the left side of the street?", "options": ["A. Georgian.", "B. Gothic.", "C. Modern.", "D. Art Deco."], "answer": "A", "time_stamp_s": 468, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [460, 465], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_457_a286_q0", "video_id": 457, "time_stamp_s": 468, "ground_truth": "A", "raw_output": "C. Modern.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "dc4948b21c3c8dda3cd6220f990970649d19992df0163be2aa817403559837ca", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [438.00686666666667, 439.00786666666664, 440.0088666666667, 441.00986666666665, 442.0108666666667, 443.01186666666666, 444.01286666666664, 445.0138666666667, 446.01486666666665, 447.0158666666667, 448.01686666666666, 449.0178666666667, 450.01886666666667, 451.01986666666664, 452.0208666666667, 453.02186666666665, 454.0228666666667, 455.02386666666666, 456.02486666666664, 457.0258666666667, 458.02686666666665, 459.0278666666667, 460.02886666666666, 461.0298666666667, 462.03086666666667, 463.03186666666664, 464.0328666666667, 465.0005, 466.0015, 467.0025], "recent_frames_sha256": "23067f380b52cde0cc3001873efd12941ad903dfc20e39f6412dc18affc300b2", "num_recent_frames": 30, "tq": 718859.927533656, "t1": 718867.294727521, "ta": 718867.294727521, "te": 718867.447225894, "first_response_s": 7.367193865007721, "answer_total_s": 7.519692237954587, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_457_a286_q0", "video_id": 457, "time_stamp_s": 468, "ground_truth": "A", "raw_output": "C. Modern.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "5d8af957e4e15b9df7df1b5d6d5a315fbd79ec561a580ed4d56b8555562eaa04", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Yellow bus (E2124) stationary behind the camera, displaying route info and advertisements on its rear.  \n- Driver’s hand visible on the steering wheel, indicating the bus is not moving.  \n- Urban street scene with pedestrians, cars, and buildings in the background, including a \"B\" sign on the left.\n[60-90s] - Yellow bus (E2124) is directly ahead, moving slowly through traffic.  \n- Driver’s hands are on the steering wheel, navigating the bus.  \n- Pedestrians and cyclists are visible on sidewalks and bike lanes to the left.\n[90-120s] - Driver's hands grip steering wheel, maneuvering bus through city traffic.  \n- Yellow bus ahead with brake lights on, followed by red car and white sedan.  \n- Urban street lined with tall buildings, trees, and pedestrians on sidewalks.\n[120-150s] - Yellow bus (route 224) directly ahead, stationary in traffic, with rear display showing route info and advertisements.  \n- Driver’s hand on steering wheel, navigating through urban street with multiple cars and pedestrians visible.  \n- Traffic lights and surrounding buildings indicate a busy city intersection with moderate congestion.\n[150-180s] - Yellow bus with \"E224\" route number is directly ahead, stationary in traffic.  \n- Driver's hands are on the steering wheel, navigating through urban streets with tall buildings and trees.  \n- Red car and other vehicles are visible in traffic behind and to the side of the yellow bus.\n[180-210s] - Yellow bus ahead displays route number \"E2184\" and route map on its rear.  \n- Driver's hands are on steering wheel, navigating through traffic with other vehicles.  \n- Traffic lights change from red to green, allowing bus to proceed forward.\n[210-240s] - Yellow bus (E212A) ahead displays route info and advertisements on its rear; driver's hands on steering wheel.  \n- Traffic includes red cars and motorcycles; bus slows as it approaches a stop.  \n- Driver’s left hand moves slightly, possibly adjusting controls or checking a device mounted near the steering wheel.\n[240-270s] - Yellow bus (E2124) stationary at intersection, rear displaying \"E2124\" and \"ELECTRIC BUS\" text.  \n- Driver's hand on steering wheel, bus appears to be waiting at traffic light.  \n- Pedestrian visible on sidewalk to right, near parked white van.\n[270-300s] - Yellow bus (E2124) ahead is stationary or moving slowly, with its rear display showing route info and a photo.  \n- Driver’s hands are on the steering wheel, navigating through traffic with other vehicles around.  \n- A red car is visible to the right, moving alongside the bus, with a highway overpass overhead.\n[300-330s] - Yellow double-decker bus ahead, stationary in traffic, with \"90\" route number visible on rear.  \n- Driver's hand on steering wheel, navigating through urban traffic with multiple lanes and vehicles.  \n- Construction site with blue fencing and cranes visible on left, alongside elevated road infrastructure.\n[330-360s] - Yellow bus ahead maintains steady pace on highway, navigating under overpasses.  \n- Driver’s hand grips steering wheel, with dashboard instruments visible.  \n- Urban skyline with tall buildings and greenery appears on left side of road.\n[360-390s] - Driver's hands on steering wheel, navigating through traffic on a highway.\n- Yellow bus ahead, maintaining distance as traffic flows.\n- Overhead signs indicate \"AL-SAJID\" and \"2417\" as the vehicle approaches an interchange.\n[390-420s] - Driver's hands are visible on the steering wheel, maintaining control of the bus.  \n- A blue car is directly ahead, followed by a silver sedan and a red car in adjacent lanes.  \n- The bus is on a multi-lane highway with a modern building on the left and traffic lights ahead.\n[420-450s] - Driver's hands on steering wheel, navigating through traffic on a multi-lane highway.\n- A yellow taxi overtakes the bus from the right lane, moving at a faster pace.\n- A large, curved overpass structure is visible ahead, with vehicles passing underneath.", "history_tokens": 958, "history_utf8_bytes": 3972, "recent_frame_times_s": [438.00686666666667, 439.00786666666664, 440.0088666666667, 441.00986666666665, 442.0108666666667, 443.01186666666666, 444.01286666666664, 445.0138666666667, 446.01486666666665, 447.0158666666667, 448.01686666666666, 449.0178666666667, 450.01886666666667, 451.01986666666664, 452.0208666666667, 453.02186666666665, 454.0228666666667, 455.02386666666666, 456.02486666666664, 457.0258666666667, 458.02686666666665, 459.0278666666667, 460.02886666666666, 461.0298666666667, 462.03086666666667, 463.03186666666664, 464.0328666666667, 465.0005, 466.0015, 467.0025], "recent_frames_sha256": "23067f380b52cde0cc3001873efd12941ad903dfc20e39f6412dc18affc300b2", "num_recent_frames": 30, "tq": 719025.541780033, "t1": 719033.323021859, "ta": 719033.323021859, "te": 719033.671160443, "first_response_s": 7.781241826014593, "answer_total_s": 8.129380409955047, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 458, "content_group": "056cc23f5faf71556e0e611faec58ee292ba267e54da39a99a05fd86b5beab5b", "question": {"question_id": "sample_458_a1802_q0", "video_id": 458, "video_path": "./videos/sample_458_real.mp4", "annotation_index": 1802, "question_index": 0, "question": "What color is the car directly in front right now?", "options": ["A. White.", "B. Black.", "C. Yellow.", "D. Green."], "answer": "A", "time_stamp_s": 4, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_458_a1802_q0", "video_id": 458, "time_stamp_s": 4, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "642d66ade9796da3265bcb89bf1ad9a9c8e8195e5e3d7c446eab6c798690abd8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.043, 1.0106333333333333, 2.011633333333333, 3.0126333333333335], "recent_frames_sha256": "743db2dbf687d1fc75eb00bca70446951f9d13664bccaa4e2645a27f24307a43", "num_recent_frames": 4, "tq": 719562.947264163, "t1": 719568.800065138, "ta": 719568.800065138, "te": 719568.838118592, "first_response_s": 5.852800974971615, "answer_total_s": 5.89085442898795, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_458_a1802_q0", "video_id": 458, "time_stamp_s": 4, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0519da4b6d90567c915090acf6bd5a7d9f529a8f78d09a2622b075cef7cbb1b8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.043, 1.0106333333333333, 2.011633333333333, 3.0126333333333335], "recent_frames_sha256": "743db2dbf687d1fc75eb00bca70446951f9d13664bccaa4e2645a27f24307a43", "num_recent_frames": 4, "tq": 719614.85564335, "t1": 719621.555676194, "ta": 719621.555676194, "te": 719621.898151704, "first_response_s": 6.70003284397535, "answer_total_s": 7.042508353944868, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 458, "content_group": "056cc23f5faf71556e0e611faec58ee292ba267e54da39a99a05fd86b5beab5b", "question": {"question_id": "sample_458_a1803_q0", "video_id": 458, "video_path": "./videos/sample_458_real.mp4", "annotation_index": 1803, "question_index": 0, "question": "What brand logo is visible on the rear of the car directly in front right now?", "options": ["A. Toyota.", "B. Honda.", "C. Audi.", "D. Porsche."], "answer": "D", "time_stamp_s": 112, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [109, 114], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_458_a1803_q0", "video_id": 458, "time_stamp_s": 112, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9d8e199b2dc9f7b992d9142b6acd7155f992a9942adf9cc0af87a1f2ac547c60", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [82.0249, 83.0259, 84.0269, 85.0279, 86.0289, 87.0299, 88.0309, 89.0319, 90.0329, 91.00053333333334, 92.00153333333333, 93.00253333333333, 94.00353333333334, 95.00453333333333, 96.00553333333333, 97.00653333333334, 98.00753333333333, 99.00853333333333, 100.00953333333334, 101.01053333333333, 102.01153333333333, 103.01253333333334, 104.01353333333333, 105.01453333333333, 106.01553333333334, 107.01653333333333, 108.01753333333333, 109.01853333333334, 110.01953333333333, 111.02053333333333], "recent_frames_sha256": "f936bd4049aa348ec1ca6a880245992bdf4ae5542fdc66cf3ca6105d4588d1bf", "num_recent_frames": 30, "tq": 719568.853355996, "t1": 719582.873890291, "ta": 719582.873890291, "te": 719582.913615423, "first_response_s": 14.020534295006655, "answer_total_s": 14.060259427060373, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_458_a1803_q0", "video_id": 458, "time_stamp_s": 112, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "105474bcec54e46e1da3ad5b9303303f845c940bd685d05059191571e046b7b6", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands grip steering wheel as bus navigates highway with multiple lanes and traffic signs.  \n- Road signs indicate directions to \"HOSPITALS\" and \"STANLEY\" with exits for \"Kew\" and \"Logan\".  \n- Urban landscape with buildings, trees, and overpasses visible as bus moves forward.\n[30-60s] - Driver's hands grip steering wheel as bus navigates urban road with traffic and construction cranes visible.  \n- Road signs indicate upcoming exits for \"Vailtura St\" and \"Staten\" with a yellow \"SCHOOL ZONE\" sign overhead.  \n- Bus passes under an overpass, then enters a tunnel, with buildings and greenery lining the route.\n[60-90s] - Driver's hands remain steady on the steering wheel, navigating through traffic.  \n- A red car is directly ahead, moving slowly in the same lane.  \n- Construction barriers and billboards line the right side of the road.", "history_tokens": 213, "history_utf8_bytes": 859, "recent_frame_times_s": [82.0249, 83.0259, 84.0269, 85.0279, 86.0289, 87.0299, 88.0309, 89.0319, 90.0329, 91.00053333333334, 92.00153333333333, 93.00253333333333, 94.00353333333334, 95.00453333333333, 96.00553333333333, 97.00653333333334, 98.00753333333333, 99.00853333333333, 100.00953333333334, 101.01053333333333, 102.01153333333333, 103.01253333333334, 104.01353333333333, 105.01453333333333, 106.01553333333334, 107.01653333333333, 108.01753333333333, 109.01853333333334, 110.01953333333333, 111.02053333333333], "recent_frames_sha256": "f936bd4049aa348ec1ca6a880245992bdf4ae5542fdc66cf3ca6105d4588d1bf", "num_recent_frames": 30, "tq": 719650.470464106, "t1": 719656.722139754, "ta": 719656.722139754, "te": 719657.055281199, "first_response_s": 6.251675648032688, "answer_total_s": 6.584817093098536, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 458, "content_group": "056cc23f5faf71556e0e611faec58ee292ba267e54da39a99a05fd86b5beab5b", "question": {"question_id": "sample_458_a1804_q0", "video_id": 458, "video_path": "./videos/sample_458_real.mp4", "annotation_index": 1804, "question_index": 0, "question": "What colored barriers are visible on the passenger-side sidewalk right now?", "options": ["A. Red.", "B. Green.", "C. Yellow.", "D. Blue and white."], "answer": "D", "time_stamp_s": 219, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [218, 223], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_458_a1804_q0", "video_id": 458, "time_stamp_s": 219, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1f534664fe228d37933d2a3cda8b841f659674b4c44824bc1715d50c89063220", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [189.0318, 190.0328, 191.00043333333332, 192.00143333333332, 193.00243333333333, 194.00343333333333, 195.00443333333334, 196.00543333333334, 197.00643333333332, 198.00743333333332, 199.00843333333333, 200.00943333333333, 201.01043333333334, 202.01143333333334, 203.01243333333332, 204.01343333333332, 205.01443333333333, 206.01543333333333, 207.01643333333334, 208.01743333333334, 209.01843333333332, 210.01943333333332, 211.02043333333333, 212.02143333333333, 213.02243333333334, 214.02343333333334, 215.02443333333332, 216.02543333333332, 217.02643333333333, 218.02743333333333], "recent_frames_sha256": "7e4bf01c373e1dc1c04fd7e70f9aea1b0bfc8f6382e2ed3ee79ee1596b880188", "num_recent_frames": 30, "tq": 719582.937573878, "t1": 719590.722813605, "ta": 719590.722813605, "te": 719590.761159099, "first_response_s": 7.7852397270035, "answer_total_s": 7.823585221078247, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_458_a1804_q0", "video_id": 458, "time_stamp_s": 219, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "707b1aa576ccdd3437a8d4ec7eb14bd10ab069f710aa098ec9b3f6ebf750bc7b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands grip steering wheel as bus navigates highway with multiple lanes and traffic signs.  \n- Road signs indicate directions to \"HOSPITALS\" and \"STANLEY\" with exits for \"Kew\" and \"Logan\".  \n- Urban landscape with buildings, trees, and overpasses visible as bus moves forward.\n[30-60s] - Driver's hands grip steering wheel as bus navigates urban road with traffic and construction cranes visible.  \n- Road signs indicate upcoming exits for \"Vailtura St\" and \"Staten\" with a yellow \"SCHOOL ZONE\" sign overhead.  \n- Bus passes under an overpass, then enters a tunnel, with buildings and greenery lining the route.\n[60-90s] - Driver's hands remain steady on the steering wheel, navigating through traffic.  \n- A red car is directly ahead, moving slowly in the same lane.  \n- Construction barriers and billboards line the right side of the road.\n[90-120s] - Traffic congestion persists with multiple cars, including a red sedan and a silver SUV, stationary or moving slowly ahead of the bus.  \n- A large white truck with \"Santos\" branding is visible on the right side of the road, partially obstructing the view.  \n- The bus driver’s hand is visible on the steering wheel, indicating active control of the vehicle amidst the traffic.\n[120-150s] - A yellow bus passes on the right, moving forward through traffic.  \n- A red car is directly ahead, stationary in the lane.  \n- A construction site with blue fencing is visible on the left side of the road.\n[150-180s] - Driver's hands grip steering wheel, navigating through traffic with consistent forward motion.\n- Red car ahead maintains steady pace, positioned centrally in the lane, with other vehicles flanking it.\n- Urban environment features tall buildings, greenery, and traffic signals, with a prominent tower visible in the distance.\n[180-210s] - Driver's hands grip steering wheel, navigating through traffic with occasional lane changes.  \n- Red sports car ahead maintains steady pace, followed by a white sedan and other vehicles.  \n- Urban street scene features buildings, palm trees, and a gas station on the left, with traffic lights and signs visible.", "history_tokens": 498, "history_utf8_bytes": 2131, "recent_frame_times_s": [189.0318, 190.0328, 191.00043333333332, 192.00143333333332, 193.00243333333333, 194.00343333333333, 195.00443333333334, 196.00543333333334, 197.00643333333332, 198.00743333333332, 199.00843333333333, 200.00943333333333, 201.01043333333334, 202.01143333333334, 203.01243333333332, 204.01343333333332, 205.01443333333333, 206.01543333333333, 207.01643333333334, 208.01743333333334, 209.01843333333332, 210.01943333333332, 211.02043333333333, 212.02143333333333, 213.02243333333334, 214.02343333333334, 215.02443333333332, 216.02543333333332, 217.02643333333333, 218.02743333333333], "recent_frames_sha256": "7e4bf01c373e1dc1c04fd7e70f9aea1b0bfc8f6382e2ed3ee79ee1596b880188", "num_recent_frames": 30, "tq": 719689.380973236, "t1": 719689.991702901, "ta": 719689.991702901, "te": 719690.029187283, "first_response_s": 0.6107296649133787, "answer_total_s": 0.6482140469597653, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 458, "content_group": "056cc23f5faf71556e0e611faec58ee292ba267e54da39a99a05fd86b5beab5b", "question": {"question_id": "sample_458_a1805_q0", "video_id": 458, "video_path": "./videos/sample_458_real.mp4", "annotation_index": 1805, "question_index": 0, "question": "What is the color of the vehicle approaching the driver's right side right now?", "options": ["A. Green.", "B. Red.", "C. Blue.", "D. Yellow."], "answer": "A", "time_stamp_s": 327, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [327, 332], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_458_a1805_q0", "video_id": 458, "time_stamp_s": 327, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "55533fe34a2b8150c9257026d8b1c1b0106651d8c704471f20203aaaa4474663", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [297.0063333333333, 298.00733333333335, 299.0083333333333, 300.00933333333336, 301.01033333333334, 302.0113333333333, 303.01233333333334, 304.0133333333333, 305.01433333333335, 306.01533333333333, 307.0163333333333, 308.01733333333334, 309.0183333333333, 310.01933333333335, 311.0203333333333, 312.02133333333336, 313.02233333333334, 314.0233333333333, 315.02433333333335, 316.0253333333333, 317.02633333333335, 318.02733333333333, 319.0283333333333, 320.02933333333334, 321.0303333333333, 322.03133333333335, 323.0323333333333, 324.03333333333336, 325.00096666666667, 326.00196666666665], "recent_frames_sha256": "456a2bb66ae525973b8d4b84b5cb824ecabd2c9e03d12c9636616a7a36b500cb", "num_recent_frames": 30, "tq": 719590.776795228, "t1": 719604.407840375, "ta": 719604.407840375, "te": 719604.449116388, "first_response_s": 13.631045146961696, "answer_total_s": 13.672321159974672, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_458_a1805_q0", "video_id": 458, "time_stamp_s": 327, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "78329264827e1842866dd4bff4a639351374ed860ad8608e8c1276e4f01d94ed", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands grip steering wheel as bus navigates highway with multiple lanes and traffic signs.  \n- Road signs indicate directions to \"HOSPITALS\" and \"STANLEY\" with exits for \"Kew\" and \"Logan\".  \n- Urban landscape with buildings, trees, and overpasses visible as bus moves forward.\n[30-60s] - Driver's hands grip steering wheel as bus navigates urban road with traffic and construction cranes visible.  \n- Road signs indicate upcoming exits for \"Vailtura St\" and \"Staten\" with a yellow \"SCHOOL ZONE\" sign overhead.  \n- Bus passes under an overpass, then enters a tunnel, with buildings and greenery lining the route.\n[60-90s] - Driver's hands remain steady on the steering wheel, navigating through traffic.  \n- A red car is directly ahead, moving slowly in the same lane.  \n- Construction barriers and billboards line the right side of the road.\n[90-120s] - Traffic congestion persists with multiple cars, including a red sedan and a silver SUV, stationary or moving slowly ahead of the bus.  \n- A large white truck with \"Santos\" branding is visible on the right side of the road, partially obstructing the view.  \n- The bus driver’s hand is visible on the steering wheel, indicating active control of the vehicle amidst the traffic.\n[120-150s] - A yellow bus passes on the right, moving forward through traffic.  \n- A red car is directly ahead, stationary in the lane.  \n- A construction site with blue fencing is visible on the left side of the road.\n[150-180s] - Driver's hands grip steering wheel, navigating through traffic with consistent forward motion.\n- Red car ahead maintains steady pace, positioned centrally in the lane, with other vehicles flanking it.\n- Urban environment features tall buildings, greenery, and traffic signals, with a prominent tower visible in the distance.\n[180-210s] - Driver's hands grip steering wheel, navigating through traffic with occasional lane changes.  \n- Red sports car ahead maintains steady pace, followed by a white sedan and other vehicles.  \n- Urban street scene features buildings, palm trees, and a gas station on the left, with traffic lights and signs visible.\n[210-240s] - Driver's hands grip steering wheel, navigating through traffic on a multi-lane road.  \n- Vehicles including sedans and SUVs move alongside and ahead, with traffic lights changing green.  \n- Roadside scenery includes buildings, trees, and utility poles, with a \"MAGAZINE\" sign visible above.\n[240-270s] - Driver's hands are on the steering wheel, navigating through traffic.  \n- Multiple vehicles, including sedans and SUVs, are visible ahead, some with brake lights on.  \n- The sky shows a sunset hue, with power lines and trees lining the road.\n[270-300s] - Yellow bus ahead maintains steady pace, slightly right of center lane.  \n- Driver’s hands grip steering wheel, navigating through traffic with moderate speed.  \n- Traffic lights change green, allowing vehicles to proceed forward.", "history_tokens": 689, "history_utf8_bytes": 2935, "recent_frame_times_s": [297.0063333333333, 298.00733333333335, 299.0083333333333, 300.00933333333336, 301.01033333333334, 302.0113333333333, 303.01233333333334, 304.0133333333333, 305.01433333333335, 306.01533333333333, 307.0163333333333, 308.01733333333334, 309.0183333333333, 310.01933333333335, 311.0203333333333, 312.02133333333336, 313.02233333333334, 314.0233333333333, 315.02433333333335, 316.0253333333333, 317.02633333333335, 318.02733333333333, 319.0283333333333, 320.02933333333334, 321.0303333333333, 322.03133333333335, 323.0323333333333, 324.03333333333336, 325.00096666666667, 326.00196666666665], "recent_frames_sha256": "456a2bb66ae525973b8d4b84b5cb824ecabd2c9e03d12c9636616a7a36b500cb", "num_recent_frames": 30, "tq": 719706.168144309, "t1": 719712.908195081, "ta": 719712.908195081, "te": 719713.135636506, "first_response_s": 6.74005077208858, "answer_total_s": 6.967492197058164, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 458, "content_group": "056cc23f5faf71556e0e611faec58ee292ba267e54da39a99a05fd86b5beab5b", "question": {"question_id": "sample_458_a1806_q0", "video_id": 458, "video_path": "./videos/sample_458_real.mp4", "annotation_index": 1806, "question_index": 0, "question": "What is the make of the vehicle directly in front right now?", "options": ["A. Toyota.", "B. Honda.", "C. Nissan.", "D. Mitsubishi."], "answer": "D", "time_stamp_s": 438, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [436, 441], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_458_a1806_q0", "video_id": 458, "time_stamp_s": 438, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8b35bd642ef6164d9635f2c4e2191f25184f1f1638fb1fa5a27f1f3deecec244", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [408.0172333333333, 409.01823333333334, 410.0192333333333, 411.02023333333335, 412.0212333333333, 413.02223333333336, 414.02323333333334, 415.0242333333333, 416.02523333333335, 417.0262333333333, 418.02723333333336, 419.02823333333333, 420.0292333333333, 421.03023333333334, 422.0312333333333, 423.03223333333335, 424.0332333333333, 425.00086666666664, 426.0018666666667, 427.00286666666665, 428.0038666666667, 429.00486666666666, 430.0058666666667, 431.00686666666667, 432.00786666666664, 433.0088666666667, 434.00986666666665, 435.0108666666667, 436.01186666666666, 437.01286666666664], "recent_frames_sha256": "dea966f30aa142e7cabda4f868cf97cdff7459d5e1ec71b8fe6e13f1e61dc80a", "num_recent_frames": 30, "tq": 719604.465209831, "t1": 719614.802910633, "ta": 719614.802910633, "te": 719614.843034675, "first_response_s": 10.337700802017935, "answer_total_s": 10.377824843977578, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_458_a1806_q0", "video_id": 458, "time_stamp_s": 438, "ground_truth": "D", "raw_output": "C. Nissan.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "3fc9594bdb765e025a5f78448928440d84e08a552095a84c306586ee67c0e847", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands grip steering wheel as bus navigates highway with multiple lanes and traffic signs.  \n- Road signs indicate directions to \"HOSPITALS\" and \"STANLEY\" with exits for \"Kew\" and \"Logan\".  \n- Urban landscape with buildings, trees, and overpasses visible as bus moves forward.\n[30-60s] - Driver's hands grip steering wheel as bus navigates urban road with traffic and construction cranes visible.  \n- Road signs indicate upcoming exits for \"Vailtura St\" and \"Staten\" with a yellow \"SCHOOL ZONE\" sign overhead.  \n- Bus passes under an overpass, then enters a tunnel, with buildings and greenery lining the route.\n[60-90s] - Driver's hands remain steady on the steering wheel, navigating through traffic.  \n- A red car is directly ahead, moving slowly in the same lane.  \n- Construction barriers and billboards line the right side of the road.\n[90-120s] - Traffic congestion persists with multiple cars, including a red sedan and a silver SUV, stationary or moving slowly ahead of the bus.  \n- A large white truck with \"Santos\" branding is visible on the right side of the road, partially obstructing the view.  \n- The bus driver’s hand is visible on the steering wheel, indicating active control of the vehicle amidst the traffic.\n[120-150s] - A yellow bus passes on the right, moving forward through traffic.  \n- A red car is directly ahead, stationary in the lane.  \n- A construction site with blue fencing is visible on the left side of the road.\n[150-180s] - Driver's hands grip steering wheel, navigating through traffic with consistent forward motion.\n- Red car ahead maintains steady pace, positioned centrally in the lane, with other vehicles flanking it.\n- Urban environment features tall buildings, greenery, and traffic signals, with a prominent tower visible in the distance.\n[180-210s] - Driver's hands grip steering wheel, navigating through traffic with occasional lane changes.  \n- Red sports car ahead maintains steady pace, followed by a white sedan and other vehicles.  \n- Urban street scene features buildings, palm trees, and a gas station on the left, with traffic lights and signs visible.\n[210-240s] - Driver's hands grip steering wheel, navigating through traffic on a multi-lane road.  \n- Vehicles including sedans and SUVs move alongside and ahead, with traffic lights changing green.  \n- Roadside scenery includes buildings, trees, and utility poles, with a \"MAGAZINE\" sign visible above.\n[240-270s] - Driver's hands are on the steering wheel, navigating through traffic.  \n- Multiple vehicles, including sedans and SUVs, are visible ahead, some with brake lights on.  \n- The sky shows a sunset hue, with power lines and trees lining the road.\n[270-300s] - Yellow bus ahead maintains steady pace, slightly right of center lane.  \n- Driver’s hands grip steering wheel, navigating through traffic with moderate speed.  \n- Traffic lights change green, allowing vehicles to proceed forward.\n[300-330s] - Driver's hands are on the steering wheel, navigating through traffic during twilight.  \n- A yellow \"SLOW\" sign is visible on the right side of the road, indicating a speed restriction.  \n- Multiple vehicles, including buses and cars, are present in the traffic flow ahead.\n[330-360s] - Driver's hands are on the steering wheel, navigating a multi-lane road with moderate traffic.  \n- A white sedan is visible to the left, moving in the same direction as the bus.  \n- The sky shows a soft gradient of dusk, with trees lining the road and utility poles visible along the roadside.\n[360-390s] - Driver's hand rests on steering wheel, maintaining control of the bus.  \n- Traffic congestion persists with multiple vehicles halted or moving slowly ahead.  \n- Road signs indicate \"MAYBELL\" and \"SOUTH\" directions, with a billboard visible on the right.\n[390-420s] - Driver's hands are on the steering wheel, navigating through traffic during twilight.\n- A yellow \"ONE WAY\" sign is visible on the right side of the road, indicating directional traffic flow.\n- Vehicles ahead, including a white sedan and a red car, are moving slowly or stopped at intersections.", "history_tokens": 966, "history_utf8_bytes": 4102, "recent_frame_times_s": [408.0172333333333, 409.01823333333334, 410.0192333333333, 411.02023333333335, 412.0212333333333, 413.02223333333336, 414.02323333333334, 415.0242333333333, 416.02523333333335, 417.0262333333333, 418.02723333333336, 419.02823333333333, 420.0292333333333, 421.03023333333334, 422.0312333333333, 423.03223333333335, 424.0332333333333, 425.00086666666664, 426.0018666666667, 427.00286666666665, 428.0038666666667, 429.00486666666666, 430.0058666666667, 431.00686666666667, 432.00786666666664, 433.0088666666667, 434.00986666666665, 435.0108666666667, 436.01186666666666, 437.01286666666664], "recent_frames_sha256": "dea966f30aa142e7cabda4f868cf97cdff7459d5e1ec71b8fe6e13f1e61dc80a", "num_recent_frames": 30, "tq": 719730.868835718, "t1": 719735.305994652, "ta": 719735.305994652, "te": 719735.455146637, "first_response_s": 4.437158933957107, "answer_total_s": 4.586310919024982, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 459, "content_group": "6dbdcf0a35514b372c1df8a1e732237dd53b7b6fcda6991e360dfada804f0971", "question": {"question_id": "sample_459_a403_q0", "video_id": 459, "video_path": "./videos/sample_459_real.mp4", "annotation_index": 403, "question_index": 0, "question": "What is the sticker on the windshield saying right now?", "options": ["A. PLEASE PAY FARE.", "B. PLEASE HAND UP.", "C. PLEASE EXIT.", "D. PLEASE TAKE SEATS."], "answer": "B", "time_stamp_s": 4, "task_type": "Causal Reasoning", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_459_a403_q0", "video_id": 459, "time_stamp_s": 4, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ca0ed83afe18e3fcfe2c3fe684215dae9a83b00ed0ead3b577255a7b81e74540", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.036, 1.0036333333333334, 2.0046333333333335, 3.0056333333333334], "recent_frames_sha256": "94a4022d2cfb337e5dbddd94deb9c8ea110ec873e8d65d05dcb2f90a6c7dbe70", "num_recent_frames": 4, "tq": 710464.337448169, "t1": 710476.08777841, "ta": 710476.08777841, "te": 710476.125246674, "first_response_s": 11.750330240931362, "answer_total_s": 11.787798505043611, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_459_a403_q0", "video_id": 459, "time_stamp_s": 4, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "64059992e7068a2a61d4c8a87662ae483afc3594b63dcba11817a7da4c7be2ea", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.036, 1.0036333333333334, 2.0046333333333335, 3.0056333333333334], "recent_frames_sha256": "94a4022d2cfb337e5dbddd94deb9c8ea110ec873e8d65d05dcb2f90a6c7dbe70", "num_recent_frames": 4, "tq": 710524.790710418, "t1": 710536.804283843, "ta": 710536.804283843, "te": 710537.066413937, "first_response_s": 12.013573425007053, "answer_total_s": 12.275703519000672, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 459, "content_group": "6dbdcf0a35514b372c1df8a1e732237dd53b7b6fcda6991e360dfada804f0971", "question": {"question_id": "sample_459_a404_q0", "video_id": 459, "video_path": "./videos/sample_459_real.mp4", "annotation_index": 404, "question_index": 0, "question": "What device is located to the right side of the steering wheel right now?", "options": ["A. A digital device.", "B. A water bottle.", "C. A map.", "D. A book."], "answer": "A", "time_stamp_s": 123, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [119, 124], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_459_a404_q0", "video_id": 459, "time_stamp_s": 123, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "75385201c2221ecbde93687f6441cbe95a8ee6ddbcb2395a61ba6c1ea7eb063d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [93.0289, 94.0299, 95.0309, 96.0319, 97.0329, 98.00053333333334, 99.00153333333333, 100.00253333333333, 101.00353333333334, 102.00453333333333, 103.00553333333333, 104.00653333333334, 105.00753333333333, 106.00853333333333, 107.00953333333334, 108.01053333333333, 109.01153333333333, 110.01253333333334, 111.01353333333333, 112.01453333333333, 113.01553333333334, 114.01653333333333, 115.01753333333333, 116.01853333333334, 117.01953333333333, 118.02053333333333, 119.02153333333334, 120.02253333333333, 121.02353333333333, 122.02453333333334], "recent_frames_sha256": "b1b012c9e1cae4f92fe369ab75656efaa6f334399415718415385a1c716bf3bc", "num_recent_frames": 30, "tq": 710476.144979052, "t1": 710486.827788571, "ta": 710486.827788571, "te": 710486.864698887, "first_response_s": 10.68280951899942, "answer_total_s": 10.719719834974967, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_459_a404_q0", "video_id": 459, "time_stamp_s": 123, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bfbf943cfb904979d4bd3ee2b150db664690f6d9694eb6eecc76ada37a0075bc", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands grip steering wheel as bus travels down a tree-lined road during twilight.  \n- Road signs and utility poles are visible ahead; a yellow sign reads \"RUA SANTO\" at 0:00.  \n- A silver sedan passes on the right, followed by a dark SUV, while the bus continues forward.\n[30-60s] - Driver's hands on steering wheel, navigating through a suburban intersection with visible traffic lights and road signs.  \n- A red gas station with a prominent sign is visible on the left side of the road.  \n- Vehicles, including a white sedan and a black SUV, are seen moving across the intersection.\n[60-90s] - Driver's hands are on the steering wheel, maneuvering the vehicle through a roundabout.  \n- A green car is seen turning left at the roundabout, positioned ahead of the driver's vehicle.  \n- The road ahead features utility poles and buildings, with a clear view of the horizon during twilight.\n[90-120s] - Driver's hands are on the steering wheel, navigating a residential street with parked cars and utility poles.  \n- A red SUV passes on the right, followed by a yellow taxi and a white van.  \n- The sky shows a soft pink and orange gradient, indicating late afternoon or early evening.", "history_tokens": 284, "history_utf8_bytes": 1201, "recent_frame_times_s": [93.0289, 94.0299, 95.0309, 96.0319, 97.0329, 98.00053333333334, 99.00153333333333, 100.00253333333333, 101.00353333333334, 102.00453333333333, 103.00553333333333, 104.00653333333334, 105.00753333333333, 106.00853333333333, 107.00953333333334, 108.01053333333333, 109.01153333333333, 110.01253333333334, 111.01353333333333, 112.01453333333333, 113.01553333333334, 114.01653333333333, 115.01753333333333, 116.01853333333334, 117.01953333333333, 118.02053333333333, 119.02153333333334, 120.02253333333333, 121.02353333333333, 122.02453333333334], "recent_frames_sha256": "b1b012c9e1cae4f92fe369ab75656efaa6f334399415718415385a1c716bf3bc", "num_recent_frames": 30, "tq": 710567.43125193, "t1": 710573.673709786, "ta": 710573.673709786, "te": 710573.973406701, "first_response_s": 6.242457856074907, "answer_total_s": 6.542154771042988, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 459, "content_group": "6dbdcf0a35514b372c1df8a1e732237dd53b7b6fcda6991e360dfada804f0971", "question": {"question_id": "sample_459_a405_q0", "video_id": 459, "video_path": "./videos/sample_459_real.mp4", "annotation_index": 405, "question_index": 0, "question": "What street is visible on the signpost right now?", "options": ["A. Oak Street.", "B. Maple Street.", "C. Elm Street.", "D. Jersey Street."], "answer": "D", "time_stamp_s": 242, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [238, 243], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_459_a405_q0", "video_id": 459, "time_stamp_s": 242, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ec7ed9ae8f78b924b83c07807083719a34b53603fedb6153d184cc1039465cc6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [212.01443333333333, 213.01543333333333, 214.01643333333334, 215.01743333333334, 216.01843333333332, 217.01943333333332, 218.02043333333333, 219.02143333333333, 220.02243333333334, 221.02343333333334, 222.02443333333332, 223.02543333333332, 224.02643333333333, 225.02743333333333, 226.02843333333334, 227.02943333333334, 228.03043333333332, 229.03143333333333, 230.03243333333333, 231.00006666666667, 232.00106666666667, 233.00206666666668, 234.00306666666665, 235.00406666666666, 236.00506666666666, 237.00606666666667, 238.00706666666667, 239.00806666666668, 240.00906666666666, 241.01006666666666], "recent_frames_sha256": "72b1226b8eb8d366d5e22d053cfde1f20c34db1228b1bd2eae67e5ce002cf8c2", "num_recent_frames": 30, "tq": 710486.886475558, "t1": 710499.828418774, "ta": 710499.828418774, "te": 710499.865578617, "first_response_s": 12.941943215904757, "answer_total_s": 12.97910305892583, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_459_a405_q0", "video_id": 459, "time_stamp_s": 242, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2d5e7d15e9deab31d14285afd907774fee121c613273eca3f7e0b0b55a1ecf7c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands grip steering wheel as bus travels down a tree-lined road during twilight.  \n- Road signs and utility poles are visible ahead; a yellow sign reads \"RUA SANTO\" at 0:00.  \n- A silver sedan passes on the right, followed by a dark SUV, while the bus continues forward.\n[30-60s] - Driver's hands on steering wheel, navigating through a suburban intersection with visible traffic lights and road signs.  \n- A red gas station with a prominent sign is visible on the left side of the road.  \n- Vehicles, including a white sedan and a black SUV, are seen moving across the intersection.\n[60-90s] - Driver's hands are on the steering wheel, maneuvering the vehicle through a roundabout.  \n- A green car is seen turning left at the roundabout, positioned ahead of the driver's vehicle.  \n- The road ahead features utility poles and buildings, with a clear view of the horizon during twilight.\n[90-120s] - Driver's hands are on the steering wheel, navigating a residential street with parked cars and utility poles.  \n- A red SUV passes on the right, followed by a yellow taxi and a white van.  \n- The sky shows a soft pink and orange gradient, indicating late afternoon or early evening.\n[120-150s] - Driver's hands grip steering wheel, making slight adjustments as bus navigates residential street.  \n- A white pickup truck is seen driving in the opposite direction, passing the bus.  \n- The bus approaches a street corner with a yellow \"No Parking\" sign visible on the left side of the road.\n[150-180s] - Driver's hands are on the steering wheel, navigating a residential street.  \n- A white van is visible ahead, moving slowly or stopping.  \n- The sky shows a soft pink and orange hue, indicating dusk or early evening.\n[180-210s] - Driver's hands are on the steering wheel, navigating a residential street with houses and trees on both sides.  \n- A red car is seen driving in the opposite direction, passing the bus.  \n- The bus approaches a building with a sign reading \"LifePsyche\" on the left side of the road.\n[210-240s] - Driver's hands grip steering wheel as bus navigates residential street with parked cars and trees lining sidewalks.  \n- \"SPECIALIST CENTRE\" sign visible on building to left as bus passes through neighborhood.  \n- Bus continues forward, passing utility poles and a white van on right side of road.", "history_tokens": 556, "history_utf8_bytes": 2341, "recent_frame_times_s": [212.01443333333333, 213.01543333333333, 214.01643333333334, 215.01743333333334, 216.01843333333332, 217.01943333333332, 218.02043333333333, 219.02143333333333, 220.02243333333334, 221.02343333333334, 222.02443333333332, 223.02543333333332, 224.02643333333333, 225.02743333333333, 226.02843333333334, 227.02943333333334, 228.03043333333332, 229.03143333333333, 230.03243333333333, 231.00006666666667, 232.00106666666667, 233.00206666666668, 234.00306666666665, 235.00406666666666, 236.00506666666666, 237.00606666666667, 238.00706666666667, 239.00806666666668, 240.00906666666666, 241.01006666666666], "recent_frames_sha256": "72b1226b8eb8d366d5e22d053cfde1f20c34db1228b1bd2eae67e5ce002cf8c2", "num_recent_frames": 30, "tq": 710599.700165275, "t1": 710601.489333855, "ta": 710601.489333855, "te": 710601.65017011, "first_response_s": 1.7891685799695551, "answer_total_s": 1.9500048350309953, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 459, "content_group": "6dbdcf0a35514b372c1df8a1e732237dd53b7b6fcda6991e360dfada804f0971", "question": {"question_id": "sample_459_a406_q0", "video_id": 459, "video_path": "./videos/sample_459_real.mp4", "annotation_index": 406, "question_index": 0, "question": "What sign is visible to the right of the intersection right now?", "options": ["A. STOP.", "B. YIELD.", "C. NO ENTRY.", "D. GIVE WAY."], "answer": "D", "time_stamp_s": 360, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [357, 362], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_459_a406_q0", "video_id": 459, "time_stamp_s": 360, "ground_truth": "D", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "bf9e915c0beedd44102e8e8ab0f9619bf6ba6654cbfcb45bb25842b946c96005", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [330.0323333333333, 331.03333333333336, 332.00096666666667, 333.00196666666665, 334.0029666666667, 335.00396666666666, 336.0049666666667, 337.00596666666667, 338.00696666666664, 339.0079666666667, 340.00896666666665, 341.0099666666667, 342.01096666666666, 343.0119666666667, 344.01296666666667, 345.01396666666665, 346.0149666666667, 347.01596666666666, 348.0169666666667, 349.01796666666667, 350.01896666666664, 351.0199666666667, 352.02096666666665, 353.0219666666667, 354.02296666666666, 355.0239666666667, 356.02496666666667, 357.02596666666665, 358.0269666666667, 359.02796666666666], "recent_frames_sha256": "5a7ed5ec005b9c348a89589451f4898ecb2e70f0d959c24126aa0bf394374ea2", "num_recent_frames": 30, "tq": 710499.883726657, "t1": 710511.837895583, "ta": 710511.837895583, "te": 710511.87816997, "first_response_s": 11.954168925993145, "answer_total_s": 11.994443312985823, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_459_a406_q0", "video_id": 459, "time_stamp_s": 360, "ground_truth": "D", "raw_output": "B. YIELD.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "82b12900909084e42a407532e8d3aaefadaff5044a35f42c7b8244f1158cbdfb", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands grip steering wheel as bus travels down a tree-lined road during twilight.  \n- Road signs and utility poles are visible ahead; a yellow sign reads \"RUA SANTO\" at 0:00.  \n- A silver sedan passes on the right, followed by a dark SUV, while the bus continues forward.\n[30-60s] - Driver's hands on steering wheel, navigating through a suburban intersection with visible traffic lights and road signs.  \n- A red gas station with a prominent sign is visible on the left side of the road.  \n- Vehicles, including a white sedan and a black SUV, are seen moving across the intersection.\n[60-90s] - Driver's hands are on the steering wheel, maneuvering the vehicle through a roundabout.  \n- A green car is seen turning left at the roundabout, positioned ahead of the driver's vehicle.  \n- The road ahead features utility poles and buildings, with a clear view of the horizon during twilight.\n[90-120s] - Driver's hands are on the steering wheel, navigating a residential street with parked cars and utility poles.  \n- A red SUV passes on the right, followed by a yellow taxi and a white van.  \n- The sky shows a soft pink and orange gradient, indicating late afternoon or early evening.\n[120-150s] - Driver's hands grip steering wheel, making slight adjustments as bus navigates residential street.  \n- A white pickup truck is seen driving in the opposite direction, passing the bus.  \n- The bus approaches a street corner with a yellow \"No Parking\" sign visible on the left side of the road.\n[150-180s] - Driver's hands are on the steering wheel, navigating a residential street.  \n- A white van is visible ahead, moving slowly or stopping.  \n- The sky shows a soft pink and orange hue, indicating dusk or early evening.\n[180-210s] - Driver's hands are on the steering wheel, navigating a residential street with houses and trees on both sides.  \n- A red car is seen driving in the opposite direction, passing the bus.  \n- The bus approaches a building with a sign reading \"LifePsyche\" on the left side of the road.\n[210-240s] - Driver's hands grip steering wheel as bus navigates residential street with parked cars and trees lining sidewalks.  \n- \"SPECIALIST CENTRE\" sign visible on building to left as bus passes through neighborhood.  \n- Bus continues forward, passing utility poles and a white van on right side of road.\n[240-270s] - Driver's hands are on the steering wheel, navigating a residential street with houses and fences on the left.  \n- A black SUV is ahead, followed by a white sedan, as the bus moves forward.  \n- A yellow school bus passes on the right, and a pedestrian in a blue shirt walks on the sidewalk.\n[270-300s] - Driver's hands are on the steering wheel, navigating a suburban road with trees and houses on both sides.  \n- A yellow school bus is visible ahead, moving slowly in the same direction.  \n- The sky shows a soft pink and orange hue, indicating either dawn or dusk.\n[300-330s] - Driver's hands grip steering wheel, maintaining control as vehicle navigates suburban road.  \n- Road signs and utility poles line the street, with vehicles including cars and a van visible ahead.  \n- Sky shows soft twilight hues, indicating late afternoon or early evening driving conditions.\n[330-360s] - Driver's hands on steering wheel, navigating through residential street with houses and trees on both sides.\n- Orange bus approaches from opposite direction, turns right at intersection, and merges into traffic.\n- Traffic lights and road signs visible, including a yield sign and directional arrows on the road surface.", "history_tokens": 831, "history_utf8_bytes": 3559, "recent_frame_times_s": [330.0323333333333, 331.03333333333336, 332.00096666666667, 333.00196666666665, 334.0029666666667, 335.00396666666666, 336.0049666666667, 337.00596666666667, 338.00696666666664, 339.0079666666667, 340.00896666666665, 341.0099666666667, 342.01096666666666, 343.0119666666667, 344.01296666666667, 345.01396666666665, 346.0149666666667, 347.01596666666666, 348.0169666666667, 349.01796666666667, 350.01896666666664, 351.0199666666667, 352.02096666666665, 353.0219666666667, 354.02296666666666, 355.0239666666667, 356.02496666666667, 357.02596666666665, 358.0269666666667, 359.02796666666666], "recent_frames_sha256": "5a7ed5ec005b9c348a89589451f4898ecb2e70f0d959c24126aa0bf394374ea2", "num_recent_frames": 30, "tq": 710639.215385482, "t1": 710641.294178942, "ta": 710641.294178942, "te": 710641.481047162, "first_response_s": 2.0787934600375593, "answer_total_s": 2.265661680023186, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 459, "content_group": "6dbdcf0a35514b372c1df8a1e732237dd53b7b6fcda6991e360dfada804f0971", "question": {"question_id": "sample_459_a407_q0", "video_id": 459, "video_path": "./videos/sample_459_real.mp4", "annotation_index": 407, "question_index": 0, "question": "What color is the first car on the left side of the road right now?", "options": ["A. Green.", "B. Blue.", "C. Silver.", "D. Red."], "answer": "D", "time_stamp_s": 478, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [476, 481], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_459_a407_q0", "video_id": 459, "time_stamp_s": 478, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9ccfead61cff1e4f7913c9233a7adce7b874ca99b79b856a06f8fb10d3a896e8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [448.01686666666666, 449.0178666666667, 450.01886666666667, 451.01986666666664, 452.0208666666667, 453.02186666666665, 454.0228666666667, 455.02386666666666, 456.02486666666664, 457.0258666666667, 458.02686666666665, 459.0278666666667, 460.02886666666666, 461.0298666666667, 462.03086666666667, 463.03186666666664, 464.0328666666667, 465.0005, 466.0015, 467.0025, 468.0035, 469.0045, 470.0055, 471.0065, 472.0075, 473.0085, 474.0095, 475.0105, 476.0115, 477.0125], "recent_frames_sha256": "7dfa75a6a999f551c7fe767072b33598e05da57c444e943e8884970db7bb4c59", "num_recent_frames": 30, "tq": 710511.889107096, "t1": 710524.738928983, "ta": 710524.738928983, "te": 710524.778348638, "first_response_s": 12.849821886979043, "answer_total_s": 12.889241541968659, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_459_a407_q0", "video_id": 459, "time_stamp_s": 478, "ground_truth": "D", "raw_output": "C. Silver.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "d4ca9612e8581a5e0548046dd63445034298ff3aaf51d35220d4866886981732", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands grip steering wheel as bus travels down a tree-lined road during twilight.  \n- Road signs and utility poles are visible ahead; a yellow sign reads \"RUA SANTO\" at 0:00.  \n- A silver sedan passes on the right, followed by a dark SUV, while the bus continues forward.\n[30-60s] - Driver's hands on steering wheel, navigating through a suburban intersection with visible traffic lights and road signs.  \n- A red gas station with a prominent sign is visible on the left side of the road.  \n- Vehicles, including a white sedan and a black SUV, are seen moving across the intersection.\n[60-90s] - Driver's hands are on the steering wheel, maneuvering the vehicle through a roundabout.  \n- A green car is seen turning left at the roundabout, positioned ahead of the driver's vehicle.  \n- The road ahead features utility poles and buildings, with a clear view of the horizon during twilight.\n[90-120s] - Driver's hands are on the steering wheel, navigating a residential street with parked cars and utility poles.  \n- A red SUV passes on the right, followed by a yellow taxi and a white van.  \n- The sky shows a soft pink and orange gradient, indicating late afternoon or early evening.\n[120-150s] - Driver's hands grip steering wheel, making slight adjustments as bus navigates residential street.  \n- A white pickup truck is seen driving in the opposite direction, passing the bus.  \n- The bus approaches a street corner with a yellow \"No Parking\" sign visible on the left side of the road.\n[150-180s] - Driver's hands are on the steering wheel, navigating a residential street.  \n- A white van is visible ahead, moving slowly or stopping.  \n- The sky shows a soft pink and orange hue, indicating dusk or early evening.\n[180-210s] - Driver's hands are on the steering wheel, navigating a residential street with houses and trees on both sides.  \n- A red car is seen driving in the opposite direction, passing the bus.  \n- The bus approaches a building with a sign reading \"LifePsyche\" on the left side of the road.\n[210-240s] - Driver's hands grip steering wheel as bus navigates residential street with parked cars and trees lining sidewalks.  \n- \"SPECIALIST CENTRE\" sign visible on building to left as bus passes through neighborhood.  \n- Bus continues forward, passing utility poles and a white van on right side of road.\n[240-270s] - Driver's hands are on the steering wheel, navigating a residential street with houses and fences on the left.  \n- A black SUV is ahead, followed by a white sedan, as the bus moves forward.  \n- A yellow school bus passes on the right, and a pedestrian in a blue shirt walks on the sidewalk.\n[270-300s] - Driver's hands are on the steering wheel, navigating a suburban road with trees and houses on both sides.  \n- A yellow school bus is visible ahead, moving slowly in the same direction.  \n- The sky shows a soft pink and orange hue, indicating either dawn or dusk.\n[300-330s] - Driver's hands grip steering wheel, maintaining control as vehicle navigates suburban road.  \n- Road signs and utility poles line the street, with vehicles including cars and a van visible ahead.  \n- Sky shows soft twilight hues, indicating late afternoon or early evening driving conditions.\n[330-360s] - Driver's hands on steering wheel, navigating through residential street with houses and trees on both sides.\n- Orange bus approaches from opposite direction, turns right at intersection, and merges into traffic.\n- Traffic lights and road signs visible, including a yield sign and directional arrows on the road surface.\n[360-390s] - Driver's hands maneuver steering wheel as bus navigates intersection with traffic lights and vehicles.  \n- Orange truck with flashing lights is directly ahead, followed by a silver sedan.  \n- Road signs and utility poles visible in background; sky shows sunset hues.\n[390-420s] - Driver's hands grip steering wheel, maintaining control as bus navigates suburban streets.  \n- Road signs and utility poles line the route, with vehicles including cars and a truck visible ahead.  \n- Sky shows twilight hues, with streetlights beginning to illuminate the road.\n[420-450s] - Driver's hands grip steering wheel, maintaining control as bus navigates suburban road.  \n- Orange school bus overtakes from left, then exits frame; other vehicles pass in both directions.  \n- Road signs and utility poles line the street; sky shows soft twilight hues.", "history_tokens": 1021, "history_utf8_bytes": 4411, "recent_frame_times_s": [448.01686666666666, 449.0178666666667, 450.01886666666667, 451.01986666666664, 452.0208666666667, 453.02186666666665, 454.0228666666667, 455.02386666666666, 456.02486666666664, 457.0258666666667, 458.02686666666665, 459.0278666666667, 460.02886666666666, 461.0298666666667, 462.03086666666667, 463.03186666666664, 464.0328666666667, 465.0005, 466.0015, 467.0025, 468.0035, 469.0045, 470.0055, 471.0065, 472.0075, 473.0085, 474.0095, 475.0105, 476.0115, 477.0125], "recent_frames_sha256": "7dfa75a6a999f551c7fe767072b33598e05da57c444e943e8884970db7bb4c59", "num_recent_frames": 30, "tq": 710665.514630547, "t1": 710667.356426825, "ta": 710667.356426825, "te": 710667.63792948, "first_response_s": 1.8417962780222297, "answer_total_s": 2.1232989330310374, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 460, "content_group": "3787d3fad88b1aafff5e430b0be8c423d2318103e5587ee6a72e8126db6c6575", "question": {"question_id": "sample_460_a269_q0", "video_id": 460, "video_path": "./videos/sample_460_real.mp4", "annotation_index": 269, "question_index": 0, "question": "What type of weather condition is present right now?", "options": ["A. Sunny.", "B. Stormy.", "C. Foggy.", "D. Rainy."], "answer": "A", "time_stamp_s": 95, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_460_a269_q0", "video_id": 460, "time_stamp_s": 95, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e131deeb836292fb77f3e0dd5040f7984e1bba40038be6e3d844e8934ee5b1bf", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [65.0009, 66.0019, 67.0029, 68.0039, 69.0049, 70.0059, 71.0069, 72.0079, 73.0089, 74.0099, 75.0109, 76.0119, 77.0129, 78.0139, 79.0149, 80.0159, 81.0169, 82.0179, 83.0189, 84.0199, 85.0209, 86.0219, 87.0229, 88.0239, 89.0249, 90.0259, 91.0269, 92.0279, 93.0289, 94.0299], "recent_frames_sha256": "61c990b1614de0d7f8621ab1e26116748726bf73112d6f8310bb797b5d07b1f8", "num_recent_frames": 30, "tq": 715267.211491849, "t1": 715268.117564094, "ta": 715268.117564094, "te": 715268.159261048, "first_response_s": 0.9060722449794412, "answer_total_s": 0.9477691989159212, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_460_a269_q0", "video_id": 460, "time_stamp_s": 95, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7884dd4e689f0798b863fd5b199369618ec0d667d1125034ba67d46eb01c720f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands grip steering wheel as bus navigates suburban streets with houses and utility poles on either side.  \n- Traffic includes cars and a blue bus ahead, with occasional lane changes and stops at intersections.  \n- Road signs, including \"SOUTH\" and \"SOUTH BAY,\" are visible; sky shows twilight hues with streetlights beginning to illuminate.\n[30-60s] - Driver's hands grip steering wheel, navigating through residential streets with moderate traffic.\n- Red car with flashing lights (possibly emergency vehicle) is visible ahead, followed by other vehicles.\n- Road signs and streetlights are visible, indicating a suburban setting with utility poles and houses lining the road.\n[60-90s] - Driver's hands grip steering wheel, navigating through traffic with consistent speed.  \n- Vehicles ahead, including a white car and red SUV, move slowly or stop at intersections.  \n- Road signs and streetlights are visible, indicating urban traffic conditions during twilight.", "history_tokens": 206, "history_utf8_bytes": 983, "recent_frame_times_s": [65.0009, 66.0019, 67.0029, 68.0039, 69.0049, 70.0059, 71.0069, 72.0079, 73.0089, 74.0099, 75.0109, 76.0119, 77.0129, 78.0139, 79.0149, 80.0159, 81.0169, 82.0179, 83.0189, 84.0199, 85.0209, 86.0219, 87.0229, 88.0239, 89.0249, 90.0259, 91.0269, 92.0279, 93.0289, 94.0299], "recent_frames_sha256": "61c990b1614de0d7f8621ab1e26116748726bf73112d6f8310bb797b5d07b1f8", "num_recent_frames": 30, "tq": 715331.237568462, "t1": 715333.732495421, "ta": 715333.732495421, "te": 715333.939663923, "first_response_s": 2.4949269589269534, "answer_total_s": 2.702095460961573, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 460, "content_group": "3787d3fad88b1aafff5e430b0be8c423d2318103e5587ee6a72e8126db6c6575", "question": {"question_id": "sample_460_a270_q0", "video_id": 460, "video_path": "./videos/sample_460_real.mp4", "annotation_index": 270, "question_index": 0, "question": "What is the current color of the sky?", "options": ["A. Orange.", "B. Blue.", "C. Grey.", "D. Pink."], "answer": "A", "time_stamp_s": 119, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [116, 121], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_460_a270_q0", "video_id": 460, "time_stamp_s": 119, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "362b1783bec182111f2cd00ac93f072dd7943846373ed66d00c4a2e6acbe9525", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [89.0249, 90.0259, 91.0269, 92.0279, 93.0289, 94.0299, 95.0309, 96.0319, 97.0329, 98.00053333333334, 99.00153333333333, 100.00253333333333, 101.00353333333334, 102.00453333333333, 103.00553333333333, 104.00653333333334, 105.00753333333333, 106.00853333333333, 107.00953333333334, 108.01053333333333, 109.01153333333333, 110.01253333333334, 111.01353333333333, 112.01453333333333, 113.01553333333334, 114.01653333333333, 115.01753333333333, 116.01853333333334, 117.01953333333333, 118.02053333333333], "recent_frames_sha256": "bf387eda9230458a12545f6fa5af5273da184ad4ace6d6a144894217fb3f8d59", "num_recent_frames": 30, "tq": 715268.177745106, "t1": 715280.812721673, "ta": 715280.812721673, "te": 715280.976882349, "first_response_s": 12.634976567002013, "answer_total_s": 12.799137242953293, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_460_a270_q0", "video_id": 460, "time_stamp_s": 119, "ground_truth": "A", "raw_output": "A. Orange.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "09ed3f13bba77b13186c01ffdff0146364529aea18e287ce1a90edf9dbb325ba", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands grip steering wheel as bus navigates suburban streets with houses and utility poles on either side.  \n- Traffic includes cars and a blue bus ahead, with occasional lane changes and stops at intersections.  \n- Road signs, including \"SOUTH\" and \"SOUTH BAY,\" are visible; sky shows twilight hues with streetlights beginning to illuminate.\n[30-60s] - Driver's hands grip steering wheel, navigating through residential streets with moderate traffic.\n- Red car with flashing lights (possibly emergency vehicle) is visible ahead, followed by other vehicles.\n- Road signs and streetlights are visible, indicating a suburban setting with utility poles and houses lining the road.\n[60-90s] - Driver's hands grip steering wheel, navigating through traffic with consistent speed.  \n- Vehicles ahead, including a white car and red SUV, move slowly or stop at intersections.  \n- Road signs and streetlights are visible, indicating urban traffic conditions during twilight.", "history_tokens": 206, "history_utf8_bytes": 983, "recent_frame_times_s": [89.0249, 90.0259, 91.0269, 92.0279, 93.0289, 94.0299, 95.0309, 96.0319, 97.0329, 98.00053333333334, 99.00153333333333, 100.00253333333333, 101.00353333333334, 102.00453333333333, 103.00553333333333, 104.00653333333334, 105.00753333333333, 106.00853333333333, 107.00953333333334, 108.01053333333333, 109.01153333333333, 110.01253333333334, 111.01353333333333, 112.01453333333333, 113.01553333333334, 114.01653333333333, 115.01753333333333, 116.01853333333334, 117.01953333333333, 118.02053333333333], "recent_frames_sha256": "bf387eda9230458a12545f6fa5af5273da184ad4ace6d6a144894217fb3f8d59", "num_recent_frames": 30, "tq": 715333.988753217, "t1": 715341.608336119, "ta": 715341.608336119, "te": 715341.769639125, "first_response_s": 7.619582901941612, "answer_total_s": 7.780885907937773, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 460, "content_group": "3787d3fad88b1aafff5e430b0be8c423d2318103e5587ee6a72e8126db6c6575", "question": {"question_id": "sample_460_a272_q0", "video_id": 460, "video_path": "./videos/sample_460_real.mp4", "annotation_index": 272, "question_index": 0, "question": "What is the number displayed on the electronic screen of the bus in front?", "options": ["A. 590.", "B. 591.", "C. 1314.", "D. G1314."], "answer": "A", "time_stamp_s": 350, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [348, 353], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_460_a272_q0", "video_id": 460, "time_stamp_s": 350, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a7801f528522761875650606e0bbe4084a834cf13346a070c0fafd04d1ce190c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [320.02233333333334, 321.0233333333333, 322.02433333333335, 323.0253333333333, 324.02633333333335, 325.02733333333333, 326.0283333333333, 327.02933333333334, 328.0303333333333, 329.03133333333335, 330.0323333333333, 331.03333333333336, 332.00096666666667, 333.00196666666665, 334.0029666666667, 335.00396666666666, 336.0049666666667, 337.00596666666667, 338.00696666666664, 339.0079666666667, 340.00896666666665, 341.0099666666667, 342.01096666666666, 343.0119666666667, 344.01296666666667, 345.01396666666665, 346.0149666666667, 347.01596666666666, 348.0169666666667, 349.01796666666667], "recent_frames_sha256": "548b1ccf0815172e5770def4485ce6fbc103928c098125bf7598976a95f6848e", "num_recent_frames": 30, "tq": 715280.997350379, "t1": 715288.58785044, "ta": 715288.58785044, "te": 715288.829652904, "first_response_s": 7.590500060934573, "answer_total_s": 7.832302524941042, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_460_a272_q0", "video_id": 460, "time_stamp_s": 350, "ground_truth": "A", "raw_output": "A. 590.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "6c60d6b505d0782c5d883d99b861a6faa96a1ec106f458324d768b4173ecb13f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands grip steering wheel as bus navigates suburban streets with houses and utility poles on either side.  \n- Traffic includes cars and a blue bus ahead, with occasional lane changes and stops at intersections.  \n- Road signs, including \"SOUTH\" and \"SOUTH BAY,\" are visible; sky shows twilight hues with streetlights beginning to illuminate.\n[30-60s] - Driver's hands grip steering wheel, navigating through residential streets with moderate traffic.\n- Red car with flashing lights (possibly emergency vehicle) is visible ahead, followed by other vehicles.\n- Road signs and streetlights are visible, indicating a suburban setting with utility poles and houses lining the road.\n[60-90s] - Driver's hands grip steering wheel, navigating through traffic with consistent speed.  \n- Vehicles ahead, including a white car and red SUV, move slowly or stop at intersections.  \n- Road signs and streetlights are visible, indicating urban traffic conditions during twilight.\n[90-120s] - Driver's hands are on the steering wheel, navigating a road with visible traffic and street signs.  \n- The sky displays a warm orange hue, indicating sunset, with power lines and trees lining the road.  \n- A green highway sign is visible ahead, indicating a route or direction for drivers.\n[120-150s] - Driver's hands grip steering wheel, making minor adjustments while navigating suburban road.  \n- Orange sunset sky casts warm glow over streetlights and utility poles lining the road.  \n- Vehicle moves forward, passing parked cars and residential buildings on either side.\n[150-180s] - Driver's hands grip steering wheel, maintaining control as vehicle navigates traffic.  \n- Orange sunset sky dominates horizon, casting warm glow over road and surrounding structures.  \n- Vehicles, including a red car and a green van, move in adjacent lanes, indicating active traffic flow.\n[180-210s] - Driver's hands grip steering wheel, navigating road with visible dashboard instruments.  \n- Sunset sky transitions from orange to deep blue as vehicle moves forward.  \n- Road signs and streetlights become more prominent as dusk sets in.\n[210-240s] - Driver's hands grip steering wheel as bus navigates traffic at dusk.  \n- Road signs and streetlights illuminate the scene; vehicles move in both directions.  \n- Traffic light turns green, allowing bus to proceed through intersection.\n[240-270s] - Driver's hands grip steering wheel as vehicle moves forward on road during sunset.\n- Yellow bus with \"SCHOOL\" sign ahead, stationary or slow-moving in traffic.\n- Road signs and streetlights visible, with sky transitioning to orange and pink hues.\n[270-300s] - Driver's hand is on the steering wheel, making minor adjustments while navigating traffic.  \n- A yellow school bus is directly ahead, stationary in traffic, with its rear display showing route number 590.  \n- The dashboard displays illuminated indicators, suggesting the bus is in motion or preparing to move, with ambient streetlights and dusk sky visible through the windshield.\n[300-330s] - Driver's hands are on the steering wheel, navigating the bus through traffic.  \n- A yellow school bus is visible ahead, moving in the same direction.  \n- The sky shows twilight hues with streetlights and vehicle headlights illuminating the road.", "history_tokens": 717, "history_utf8_bytes": 3284, "recent_frame_times_s": [320.02233333333334, 321.0233333333333, 322.02433333333335, 323.0253333333333, 324.02633333333335, 325.02733333333333, 326.0283333333333, 327.02933333333334, 328.0303333333333, 329.03133333333335, 330.0323333333333, 331.03333333333336, 332.00096666666667, 333.00196666666665, 334.0029666666667, 335.00396666666666, 336.0049666666667, 337.00596666666667, 338.00696666666664, 339.0079666666667, 340.00896666666665, 341.0099666666667, 342.01096666666666, 343.0119666666667, 344.01296666666667, 345.01396666666665, 346.0149666666667, 347.01596666666666, 348.0169666666667, 349.01796666666667], "recent_frames_sha256": "548b1ccf0815172e5770def4485ce6fbc103928c098125bf7598976a95f6848e", "num_recent_frames": 30, "tq": 715397.528981376, "t1": 715404.907398866, "ta": 715404.907398866, "te": 715405.185817151, "first_response_s": 7.378417490050197, "answer_total_s": 7.656835775007494, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 460, "content_group": "3787d3fad88b1aafff5e430b0be8c423d2318103e5587ee6a72e8126db6c6575", "question": {"question_id": "sample_460_a271_q0", "video_id": 460, "video_path": "./videos/sample_460_real.mp4", "annotation_index": 271, "question_index": 0, "question": "What is the color of the traffic light right now?", "options": ["A. Red.", "B. Green.", "C. Yellow.", "D. Blue."], "answer": "A", "time_stamp_s": 362, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [232, 237], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_460_a271_q0", "video_id": 460, "time_stamp_s": 362, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6d399fc0f62e4315c16dbc4dbf9dc5816a7f3cdef41ef0c5ef6717bfedef9385", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [332.00096666666667, 333.00196666666665, 334.0029666666667, 335.00396666666666, 336.0049666666667, 337.00596666666667, 338.00696666666664, 339.0079666666667, 340.00896666666665, 341.0099666666667, 342.01096666666666, 343.0119666666667, 344.01296666666667, 345.01396666666665, 346.0149666666667, 347.01596666666666, 348.0169666666667, 349.01796666666667, 350.01896666666664, 351.0199666666667, 352.02096666666665, 353.0219666666667, 354.02296666666666, 355.0239666666667, 356.02496666666667, 357.02596666666665, 358.0269666666667, 359.02796666666666, 360.0289666666667, 361.02996666666667], "recent_frames_sha256": "e1bc2a845573b0b3f8ff7ab37e42c6a6cbc386794668e629860953b15c86e66d", "num_recent_frames": 30, "tq": 715288.856073276, "t1": 715296.575352987, "ta": 715296.575352987, "te": 715296.618730826, "first_response_s": 7.7192797110183164, "answer_total_s": 7.762657549930736, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_460_a271_q0", "video_id": 460, "time_stamp_s": 362, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3fddeec69c565e4677900737c585db305a24d9c26e8b8a8fabca0d6e82f12ef5", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands grip steering wheel as bus navigates suburban streets with houses and utility poles on either side.  \n- Traffic includes cars and a blue bus ahead, with occasional lane changes and stops at intersections.  \n- Road signs, including \"SOUTH\" and \"SOUTH BAY,\" are visible; sky shows twilight hues with streetlights beginning to illuminate.\n[30-60s] - Driver's hands grip steering wheel, navigating through residential streets with moderate traffic.\n- Red car with flashing lights (possibly emergency vehicle) is visible ahead, followed by other vehicles.\n- Road signs and streetlights are visible, indicating a suburban setting with utility poles and houses lining the road.\n[60-90s] - Driver's hands grip steering wheel, navigating through traffic with consistent speed.  \n- Vehicles ahead, including a white car and red SUV, move slowly or stop at intersections.  \n- Road signs and streetlights are visible, indicating urban traffic conditions during twilight.\n[90-120s] - Driver's hands are on the steering wheel, navigating a road with visible traffic and street signs.  \n- The sky displays a warm orange hue, indicating sunset, with power lines and trees lining the road.  \n- A green highway sign is visible ahead, indicating a route or direction for drivers.\n[120-150s] - Driver's hands grip steering wheel, making minor adjustments while navigating suburban road.  \n- Orange sunset sky casts warm glow over streetlights and utility poles lining the road.  \n- Vehicle moves forward, passing parked cars and residential buildings on either side.\n[150-180s] - Driver's hands grip steering wheel, maintaining control as vehicle navigates traffic.  \n- Orange sunset sky dominates horizon, casting warm glow over road and surrounding structures.  \n- Vehicles, including a red car and a green van, move in adjacent lanes, indicating active traffic flow.\n[180-210s] - Driver's hands grip steering wheel, navigating road with visible dashboard instruments.  \n- Sunset sky transitions from orange to deep blue as vehicle moves forward.  \n- Road signs and streetlights become more prominent as dusk sets in.\n[210-240s] - Driver's hands grip steering wheel as bus navigates traffic at dusk.  \n- Road signs and streetlights illuminate the scene; vehicles move in both directions.  \n- Traffic light turns green, allowing bus to proceed through intersection.\n[240-270s] - Driver's hands grip steering wheel as vehicle moves forward on road during sunset.\n- Yellow bus with \"SCHOOL\" sign ahead, stationary or slow-moving in traffic.\n- Road signs and streetlights visible, with sky transitioning to orange and pink hues.\n[270-300s] - Driver's hand is on the steering wheel, making minor adjustments while navigating traffic.  \n- A yellow school bus is directly ahead, stationary in traffic, with its rear display showing route number 590.  \n- The dashboard displays illuminated indicators, suggesting the bus is in motion or preparing to move, with ambient streetlights and dusk sky visible through the windshield.\n[300-330s] - Driver's hands are on the steering wheel, navigating the bus through traffic.  \n- A yellow school bus is visible ahead, moving in the same direction.  \n- The sky shows twilight hues with streetlights and vehicle headlights illuminating the road.\n[330-360s] - Driver's hands are on the steering wheel, navigating traffic during twilight.\n- A yellow school bus is directly ahead, stationary or moving slowly in the same lane.\n- The sky displays orange and purple hues, indicating sunset, with streetlights and vehicle headlights illuminating the road.", "history_tokens": 783, "history_utf8_bytes": 3588, "recent_frame_times_s": [332.00096666666667, 333.00196666666665, 334.0029666666667, 335.00396666666666, 336.0049666666667, 337.00596666666667, 338.00696666666664, 339.0079666666667, 340.00896666666665, 341.0099666666667, 342.01096666666666, 343.0119666666667, 344.01296666666667, 345.01396666666665, 346.0149666666667, 347.01596666666666, 348.0169666666667, 349.01796666666667, 350.01896666666664, 351.0199666666667, 352.02096666666665, 353.0219666666667, 354.02296666666666, 355.0239666666667, 356.02496666666667, 357.02596666666665, 358.0269666666667, 359.02796666666666, 360.0289666666667, 361.02996666666667], "recent_frames_sha256": "e1bc2a845573b0b3f8ff7ab37e42c6a6cbc386794668e629860953b15c86e66d", "num_recent_frames": 30, "tq": 715410.045209973, "t1": 715416.962732609, "ta": 715416.962732609, "te": 715417.000175803, "first_response_s": 6.91752263600938, "answer_total_s": 6.9549658299656585, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 460, "content_group": "3787d3fad88b1aafff5e430b0be8c423d2318103e5587ee6a72e8126db6c6575", "question": {"question_id": "sample_460_a273_q0", "video_id": 460, "video_path": "./videos/sample_460_real.mp4", "annotation_index": 273, "question_index": 0, "question": "Which supermarket logo is visible on the right side right now?", "options": ["A. Aldi.", "B. Woolworths.", "C. IGA.", "D. Coles."], "answer": "D", "time_stamp_s": 466, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [464, 469], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_460_a273_q0", "video_id": 460, "time_stamp_s": 466, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c4dc843db52fcd24c0363cab2afa68dc1b1ed1fac97d3779e43f93a624644c20", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [436.00486666666666, 437.0058666666667, 438.00686666666667, 439.00786666666664, 440.0088666666667, 441.00986666666665, 442.0108666666667, 443.01186666666666, 444.01286666666664, 445.0138666666667, 446.01486666666665, 447.0158666666667, 448.01686666666666, 449.0178666666667, 450.01886666666667, 451.01986666666664, 452.0208666666667, 453.02186666666665, 454.0228666666667, 455.02386666666666, 456.02486666666664, 457.0258666666667, 458.02686666666665, 459.0278666666667, 460.02886666666666, 461.0298666666667, 462.03086666666667, 463.03186666666664, 464.0328666666667, 465.0005], "recent_frames_sha256": "db0fefc726f2b15673152f6bee1d1eba7d59005cacd3ff11cdc57e7c14d67f7f", "num_recent_frames": 30, "tq": 715296.634197063, "t1": 715309.348509805, "ta": 715309.348509805, "te": 715309.388117003, "first_response_s": 12.714312741998583, "answer_total_s": 12.753919939976186, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_460_a273_q0", "video_id": 460, "time_stamp_s": 466, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "467bb95205a4b86296dedf7203936cf0cedcb7c783385773fb2590afb9eaa0ba", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Driver's hands grip steering wheel as bus navigates suburban streets with houses and utility poles on either side.  \n- Traffic includes cars and a blue bus ahead, with occasional lane changes and stops at intersections.  \n- Road signs, including \"SOUTH\" and \"SOUTH BAY,\" are visible; sky shows twilight hues with streetlights beginning to illuminate.\n[30-60s] - Driver's hands grip steering wheel, navigating through residential streets with moderate traffic.\n- Red car with flashing lights (possibly emergency vehicle) is visible ahead, followed by other vehicles.\n- Road signs and streetlights are visible, indicating a suburban setting with utility poles and houses lining the road.\n[60-90s] - Driver's hands grip steering wheel, navigating through traffic with consistent speed.  \n- Vehicles ahead, including a white car and red SUV, move slowly or stop at intersections.  \n- Road signs and streetlights are visible, indicating urban traffic conditions during twilight.\n[90-120s] - Driver's hands are on the steering wheel, navigating a road with visible traffic and street signs.  \n- The sky displays a warm orange hue, indicating sunset, with power lines and trees lining the road.  \n- A green highway sign is visible ahead, indicating a route or direction for drivers.\n[120-150s] - Driver's hands grip steering wheel, making minor adjustments while navigating suburban road.  \n- Orange sunset sky casts warm glow over streetlights and utility poles lining the road.  \n- Vehicle moves forward, passing parked cars and residential buildings on either side.\n[150-180s] - Driver's hands grip steering wheel, maintaining control as vehicle navigates traffic.  \n- Orange sunset sky dominates horizon, casting warm glow over road and surrounding structures.  \n- Vehicles, including a red car and a green van, move in adjacent lanes, indicating active traffic flow.\n[180-210s] - Driver's hands grip steering wheel, navigating road with visible dashboard instruments.  \n- Sunset sky transitions from orange to deep blue as vehicle moves forward.  \n- Road signs and streetlights become more prominent as dusk sets in.\n[210-240s] - Driver's hands grip steering wheel as bus navigates traffic at dusk.  \n- Road signs and streetlights illuminate the scene; vehicles move in both directions.  \n- Traffic light turns green, allowing bus to proceed through intersection.\n[240-270s] - Driver's hands grip steering wheel as vehicle moves forward on road during sunset.\n- Yellow bus with \"SCHOOL\" sign ahead, stationary or slow-moving in traffic.\n- Road signs and streetlights visible, with sky transitioning to orange and pink hues.\n[270-300s] - Driver's hand is on the steering wheel, making minor adjustments while navigating traffic.  \n- A yellow school bus is directly ahead, stationary in traffic, with its rear display showing route number 590.  \n- The dashboard displays illuminated indicators, suggesting the bus is in motion or preparing to move, with ambient streetlights and dusk sky visible through the windshield.\n[300-330s] - Driver's hands are on the steering wheel, navigating the bus through traffic.  \n- A yellow school bus is visible ahead, moving in the same direction.  \n- The sky shows twilight hues with streetlights and vehicle headlights illuminating the road.\n[330-360s] - Driver's hands are on the steering wheel, navigating traffic during twilight.\n- A yellow school bus is directly ahead, stationary or moving slowly in the same lane.\n- The sky displays orange and purple hues, indicating sunset, with streetlights and vehicle headlights illuminating the road.\n[360-390s] - Driver's hands on steering wheel, navigating through traffic at dusk.  \n- Yellow school bus ahead, stationary or moving slowly in traffic.  \n- Streetlights and vehicle headlights illuminate the road as dusk transitions to night.\n[390-420s] - A yellow school bus is directly ahead, stationary at a traffic light with its brake lights illuminated.  \n- A silver sedan is positioned immediately in front of the bus, also stopped at the light.  \n- The driver’s hand is visible on the steering wheel, with a smartphone mounted on the dashboard to the left.\n[420-450s] - A yellow school bus is directly ahead, stopped at a red light, with its brake lights illuminated.  \n- A white sedan is positioned immediately in front of the bus, also stopped at the intersection.  \n- Traffic lights and street signs are visible, with the red light currently active for the direction of travel.", "history_tokens": 984, "history_utf8_bytes": 4478, "recent_frame_times_s": [436.00486666666666, 437.0058666666667, 438.00686666666667, 439.00786666666664, 440.0088666666667, 441.00986666666665, 442.0108666666667, 443.01186666666666, 444.01286666666664, 445.0138666666667, 446.01486666666665, 447.0158666666667, 448.01686666666666, 449.0178666666667, 450.01886666666667, 451.01986666666664, 452.0208666666667, 453.02186666666665, 454.0228666666667, 455.02386666666666, 456.02486666666664, 457.0258666666667, 458.02686666666665, 459.0278666666667, 460.02886666666666, 461.0298666666667, 462.03086666666667, 463.03186666666664, 464.0328666666667, 465.0005], "recent_frames_sha256": "db0fefc726f2b15673152f6bee1d1eba7d59005cacd3ff11cdc57e7c14d67f7f", "num_recent_frames": 30, "tq": 715438.646149008, "t1": 715445.414676736, "ta": 715445.414676736, "te": 715445.45268442, "first_response_s": 6.768527728039771, "answer_total_s": 6.806535412091762, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 461, "content_group": "ec86623259bbcb65ec8dd0434a8c0014bee3d6831f560be13121de60a3057926", "question": {"question_id": "sample_461_a2057_q0", "video_id": 461, "video_path": "./videos/sample_461_real.mp4", "annotation_index": 2057, "question_index": 0, "question": "What prominent signs are displayed above the entrance of the art show?", "options": ["A. \"ART EXHIBITION\" and \"MODERN ART\".", "B. \"CONTEMPORARY ART\" and \"MODERN EXHIBITION\".", "C. \"LA EXHIBITION\" and \"CONTEMPORARY + MODERN\".", "D. \"LA ART SHOW\" and \"MODERN + CONTEMPORARY\"."], "answer": "D", "time_stamp_s": 4, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_461_a2057_q0", "video_id": 461, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8fa22fadea19478372344c2ddd3c2e037d9d1a4441bc55074b42f961905371e4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0], "recent_frames_sha256": "0f1e5c3d15b78d2dee1c918cc69cc2a9f14e03095c85607adf79cd00810fcf02", "num_recent_frames": 5, "tq": 719726.799946307, "t1": 719730.982151289, "ta": 719730.982151289, "te": 719731.015377167, "first_response_s": 4.182204982032999, "answer_total_s": 4.2154308600584045, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_461_a2057_q0", "video_id": 461, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "645959546259a46ce529f52a88c9cab5c3b813f87057d4e05c1e67e353f12134", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0], "recent_frames_sha256": "0f1e5c3d15b78d2dee1c918cc69cc2a9f14e03095c85607adf79cd00810fcf02", "num_recent_frames": 5, "tq": 719576.415119519, "t1": 719589.67579146, "ta": 719589.67579146, "te": 719589.718751425, "first_response_s": 13.26067194098141, "answer_total_s": 13.303631906048395, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 461, "content_group": "ec86623259bbcb65ec8dd0434a8c0014bee3d6831f560be13121de60a3057926", "question": {"question_id": "sample_461_a2057_q1", "video_id": 461, "video_path": "./videos/sample_461_real.mp4", "annotation_index": 2057, "question_index": 1, "question": "Which description best fits the scene within the exhibition space?", "options": ["A. A spacious, well-lit area with various art pieces and installations.", "B. A small room with a few art pieces.", "C. An outdoor exhibition with sculptures and paintings.", "D. A dark room with illuminated paintings."], "answer": "A", "time_stamp_s": 11, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_461_a2057_q1", "video_id": 461, "time_stamp_s": 11, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "30ac7eda669f8f5b9e02d0cfb5399054651559b935681f1b0f6e7828f563b4f3", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0], "recent_frames_sha256": "06169f583690f18a5a4ad83488111161d933f4cb20fc0bb0b48d04d632d42f81", "num_recent_frames": 12, "tq": 719731.020887718, "t1": 719735.555313916, "ta": 719735.555313916, "te": 719735.588445946, "first_response_s": 4.534426197991706, "answer_total_s": 4.567558228038251, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_461_a2057_q1", "video_id": 461, "time_stamp_s": 11, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a9def403de6cfa506b5e0c046e1064f475772a3efa005e1a1ad1da4a4956402a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0], "recent_frames_sha256": "06169f583690f18a5a4ad83488111161d933f4cb20fc0bb0b48d04d632d42f81", "num_recent_frames": 12, "tq": 719589.742610263, "t1": 719597.571674799, "ta": 719597.571674799, "te": 719597.922607878, "first_response_s": 7.829064535908401, "answer_total_s": 8.17999761493411, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 461, "content_group": "ec86623259bbcb65ec8dd0434a8c0014bee3d6831f560be13121de60a3057926", "question": {"question_id": "sample_461_a2058_q0", "video_id": 461, "video_path": "./videos/sample_461_real.mp4", "annotation_index": 2058, "question_index": 0, "question": "What is the subject of the poster on the white wall?", "options": ["A. A modern art exhibition.", "B. A famous painting.", "C. An art gallery event.", "D. The movie \"Parasite\"."], "answer": "D", "time_stamp_s": 167, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_461_a2058_q0", "video_id": 461, "time_stamp_s": 167, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9746834358fa63d5c3ac4ddb2808a8b52bc6e29f99aaa1b839b349aea9d701a9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0], "recent_frames_sha256": "dcac31844d99b27191bbd11518557d6d45907771fa21263b2ef2ba3d4823ed96", "num_recent_frames": 30, "tq": 719735.59384273, "t1": 719739.332633413, "ta": 719739.332633413, "te": 719739.365510388, "first_response_s": 3.7387906829826534, "answer_total_s": 3.771667658002116, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_461_a2058_q0", "video_id": 461, "time_stamp_s": 167, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4680ae711ceb12e11e9ce3bed20d7203c7bd7477c9d8339fc1e8a5999bb6328d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A large spherical sculpture with intricate patterns is displayed near the center of the exhibition hall, attracting several visitors.  \n- A blue interactive kiosk with a screen and buttons is positioned near the entrance, with people gathered around it.  \n- The floor features illuminated \"ART SHOW\" text, guiding visitors through the space, while large white curtains and structural pillars frame the exhibition area.\n[30-60s] - A large metallic paper airplane sculpture dominates the foreground, angled diagonally across the floor.  \n- A blue wall displays a plaque titled \"SAVAGE INTENTION\" with text and QR codes, positioned near the sculpture.  \n- A large teal artwork labeled \"CHUNI PARK\" hangs on a white wall, featuring abstract clouds and a grassy field with small figures at its base.\n[60-90s] - A large teal painting with a textured surface, featuring a green field with houses, trees, and clouds, is displayed on a white wall.  \n- To the left, a smaller framed artwork with a black-and-white image is mounted on the wall.  \n- A white plaque with text is affixed to the wall beside the large painting, providing information about the artwork.\n[90-120s] - A man in a brown coat walks past a large yellow artwork depicting a forest path with red objects.  \n- The camera pans to show a golden-yellow wall mural with small vehicles embedded in a textured surface.  \n- A woman takes a photo of the artwork with her phone while standing near the golden-yellow mural.\n[120-150s] - A large orange painting with a blossoming tree is displayed on the left wall.  \n- A central painting depicts floating white clouds with yellow centers above a blue sea, positioned between the orange and green artworks.  \n- A green painting filled with dense foliage is mounted on the right wall, adjacent to the central piece.", "history_tokens": 399, "history_utf8_bytes": 1821, "recent_frame_times_s": [138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0], "recent_frames_sha256": "dcac31844d99b27191bbd11518557d6d45907771fa21263b2ef2ba3d4823ed96", "num_recent_frames": 30, "tq": 719638.554464134, "t1": 719644.406831866, "ta": 719644.406831866, "te": 719644.44441548, "first_response_s": 5.8523677319753915, "answer_total_s": 5.889951345976442, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 461, "content_group": "ec86623259bbcb65ec8dd0434a8c0014bee3d6831f560be13121de60a3057926", "question": {"question_id": "sample_461_a2059_q0", "video_id": 461, "video_path": "./videos/sample_461_real.mp4", "annotation_index": 2059, "question_index": 0, "question": "What word is featured in the artwork's black frame?", "options": ["A. LOVE.", "B. HOPE.", "C. PEACE.", "D. GOD."], "answer": "D", "time_stamp_s": 480, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_461_a2059_q0", "video_id": 461, "time_stamp_s": 480, "ground_truth": "D", "raw_output": "D. GOD.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "79ce64a9f05b001bfc6d7d6187cd9ee0a3d137ab7387baba09457d4f2ec06e6b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [451.0, 452.0, 453.0, 454.0, 455.0, 456.0, 457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0], "recent_frames_sha256": "b97a35b599c9ea9d0823b85e4984c00cfa9e94eea56de29636c1f14749b6da4a", "num_recent_frames": 30, "tq": 719739.371167217, "t1": 719744.196371311, "ta": 719744.196371311, "te": 719744.327284198, "first_response_s": 4.825204093940556, "answer_total_s": 4.956116980989464, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_461_a2059_q0", "video_id": 461, "time_stamp_s": 480, "ground_truth": "D", "raw_output": "D. GOD.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "8f9ae690454a902886e7ba94934775af51186b18ba2c1a137667b7b70cd7e08b", "condition_order": ["notes", "recent"], "memory": "[150-180s] - A framed abstract portrait with bold colors and stylized faces hangs on a white wall, positioned above a plaque for \"PARASITE\" by ZIBEZI.\n- A large black-and-white artwork with a red dress and blue headpiece is displayed below the plaque, featuring intricate line work.\n- The camera pans right, revealing more abstract paintings, including a red patterned piece and a colorful, geometrically complex artwork, all mounted on white walls.\n[180-210s] - A black-and-white abstract portrait with geometric patterns and a red heart is centrally displayed, flanked by other artworks.  \n- To its right, a large black square with a pink top border is mounted on the wall, appearing as a minimalist piece.  \n- Below the central portrait, a colorful, cartoonish artwork featuring multiple characters and objects is visible, with smaller character illustrations scattered on the floor nearby.\n[210-240s] - A blue sign labeled \"01/800\" hangs near the ceiling, indicating an edition number for an artwork.  \n- The camera pans across a wall displaying colorful, abstract paintings, including a prominent green-framed piece with stylized faces.  \n- Below the green-framed artwork, a black-and-white piece with red hearts is mounted, followed by a pink canvas with abstract figures.\n[240-270s] - Abstract paintings with vibrant, overlapping shapes are displayed in a grid on a white wall.  \n- A large, colorful abstract diptych hangs prominently on an adjacent wall, drawing attention from viewers.  \n- People are seen walking through the gallery, observing the artworks, with some stopping to look closely at specific pieces.\n[270-300s] - Two abstract paintings by Emma Larsson hang side-by-side, featuring colorful, organic shapes with a mix of earthy and vibrant tones.  \n- A large, dynamic artwork with black-and-white figures and bold blue and red geometric overlays is displayed to the right, drawing attention with its stark contrast.  \n- Visitors are seen walking through the gallery, pausing to observe the art, with one person standing near a table and another walking past the paintings.\n[300-330s] - Two large abstract paintings hang side-by-side on a white wall, one with vibrant floral patterns and the other with bold geometric shapes.  \n- A third painting, titled \"TAYLOR KESTON BURGESS,\" is visible on the left wall, featuring a yellow background with dynamic, colorful forms.  \n- A small digital display mounted on the wall shows a preview of one of the artworks.\n[330-360s] - A woman in a red coat stands before a large abstract painting by Heather Chontos, gesturing toward it.  \n- Another woman in a beige coat walks past, briefly pausing to observe a different abstract piece.  \n- The camera pans right, revealing a third large abstract painting with dense, colorful forms on the adjacent wall.\n[360-390s] - A large abstract painting with bold red, orange, and purple circular forms dominates the left wall.  \n- A textured, layered textile artwork by Alfredo Romero hangs on the right wall, appearing to be made of stacked fabric strips.  \n- Visitors walk through the gallery, some pausing to observe the artworks, while others move along the corridor.\n[390-420s] - Two abstract paintings by Caroline DeSenaPalo are displayed side-by-side on a white wall, with the left piece featuring red, orange, and green shapes against a dark background.  \n- A large, colorful abstract painting with swirling forms in blue, green, yellow, and pink hangs on a wall, drawing attention from viewers.  \n- A blue sign reading \"FABRIK PROJECTS\" is mounted on a white wall above a section of the gallery, indicating an exhibitor or artist space.\n[420-450s] - A black paper airplane sculpture rests on a white pedestal near a wall displaying Val Kilmer’s artworks.  \n- A woman in a red jacket walks past the sculpture, moving from left to right across the frame.  \n- The camera pans left, revealing a row of framed paintings on the wall, including abstract and figurative pieces.\n[450-480s] - A framed abstract piece with the word \"GOD\" in white text is centrally displayed, flanked by smaller panels.  \n- To the right of \"GOD,\" a vertical stack of three colored panels (red, blue, green) each bearing the word \"GOD\" in white.  \n- The camera pans right, revealing a series of abstract paintings with muted tones and textured surfaces, including one with a prominent red triangle.", "history_tokens": 999, "history_utf8_bytes": 4379, "recent_frame_times_s": [451.0, 452.0, 453.0, 454.0, 455.0, 456.0, 457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0], "recent_frames_sha256": "b97a35b599c9ea9d0823b85e4984c00cfa9e94eea56de29636c1f14749b6da4a", "num_recent_frames": 30, "tq": 719721.587281202, "t1": 719722.365076392, "ta": 719722.365076392, "te": 719722.514665924, "first_response_s": 0.7777951899915934, "answer_total_s": 0.9273847220465541, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 461, "content_group": "ec86623259bbcb65ec8dd0434a8c0014bee3d6831f560be13121de60a3057926", "question": {"question_id": "sample_461_a2059_q1", "video_id": 461, "video_path": "./videos/sample_461_real.mp4", "annotation_index": 2059, "question_index": 1, "question": "What kind of designs are shown in the top row of the six-paintings segments?", "options": ["A. Tree-like figures in a mist.", "B. Animal figures.", "C. Geometric shapes.", "D. Human silhouettes."], "answer": "A", "time_stamp_s": 486, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_461_a2059_q1", "video_id": 461, "time_stamp_s": 486, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "954d5acb8e99c5a57c487ac6901b5a5a67832ad1cf4302c315362dfc4854ff47", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0], "recent_frames_sha256": "23f63c5ba90ae0722ee76c13b16a787225da7b108cda87b515730b1ac2bc56b8", "num_recent_frames": 30, "tq": 719744.333072136, "t1": 719748.499622354, "ta": 719748.499622354, "te": 719748.537422159, "first_response_s": 4.166550218011253, "answer_total_s": 4.204350022948347, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_461_a2059_q1", "video_id": 461, "time_stamp_s": 486, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "571d0b24e2cf808634989914a060deb4888a19f003dfa94efb2f63d3649a4446", "condition_order": ["notes", "recent"], "memory": "[150-180s] - A framed abstract portrait with bold colors and stylized faces hangs on a white wall, positioned above a plaque for \"PARASITE\" by ZIBEZI.\n- A large black-and-white artwork with a red dress and blue headpiece is displayed below the plaque, featuring intricate line work.\n- The camera pans right, revealing more abstract paintings, including a red patterned piece and a colorful, geometrically complex artwork, all mounted on white walls.\n[180-210s] - A black-and-white abstract portrait with geometric patterns and a red heart is centrally displayed, flanked by other artworks.  \n- To its right, a large black square with a pink top border is mounted on the wall, appearing as a minimalist piece.  \n- Below the central portrait, a colorful, cartoonish artwork featuring multiple characters and objects is visible, with smaller character illustrations scattered on the floor nearby.\n[210-240s] - A blue sign labeled \"01/800\" hangs near the ceiling, indicating an edition number for an artwork.  \n- The camera pans across a wall displaying colorful, abstract paintings, including a prominent green-framed piece with stylized faces.  \n- Below the green-framed artwork, a black-and-white piece with red hearts is mounted, followed by a pink canvas with abstract figures.\n[240-270s] - Abstract paintings with vibrant, overlapping shapes are displayed in a grid on a white wall.  \n- A large, colorful abstract diptych hangs prominently on an adjacent wall, drawing attention from viewers.  \n- People are seen walking through the gallery, observing the artworks, with some stopping to look closely at specific pieces.\n[270-300s] - Two abstract paintings by Emma Larsson hang side-by-side, featuring colorful, organic shapes with a mix of earthy and vibrant tones.  \n- A large, dynamic artwork with black-and-white figures and bold blue and red geometric overlays is displayed to the right, drawing attention with its stark contrast.  \n- Visitors are seen walking through the gallery, pausing to observe the art, with one person standing near a table and another walking past the paintings.\n[300-330s] - Two large abstract paintings hang side-by-side on a white wall, one with vibrant floral patterns and the other with bold geometric shapes.  \n- A third painting, titled \"TAYLOR KESTON BURGESS,\" is visible on the left wall, featuring a yellow background with dynamic, colorful forms.  \n- A small digital display mounted on the wall shows a preview of one of the artworks.\n[330-360s] - A woman in a red coat stands before a large abstract painting by Heather Chontos, gesturing toward it.  \n- Another woman in a beige coat walks past, briefly pausing to observe a different abstract piece.  \n- The camera pans right, revealing a third large abstract painting with dense, colorful forms on the adjacent wall.\n[360-390s] - A large abstract painting with bold red, orange, and purple circular forms dominates the left wall.  \n- A textured, layered textile artwork by Alfredo Romero hangs on the right wall, appearing to be made of stacked fabric strips.  \n- Visitors walk through the gallery, some pausing to observe the artworks, while others move along the corridor.\n[390-420s] - Two abstract paintings by Caroline DeSenaPalo are displayed side-by-side on a white wall, with the left piece featuring red, orange, and green shapes against a dark background.  \n- A large, colorful abstract painting with swirling forms in blue, green, yellow, and pink hangs on a wall, drawing attention from viewers.  \n- A blue sign reading \"FABRIK PROJECTS\" is mounted on a white wall above a section of the gallery, indicating an exhibitor or artist space.\n[420-450s] - A black paper airplane sculpture rests on a white pedestal near a wall displaying Val Kilmer’s artworks.  \n- A woman in a red jacket walks past the sculpture, moving from left to right across the frame.  \n- The camera pans left, revealing a row of framed paintings on the wall, including abstract and figurative pieces.\n[450-480s] - A framed abstract piece with the word \"GOD\" in white text is centrally displayed, flanked by smaller panels.  \n- To the right of \"GOD,\" a vertical stack of three colored panels (red, blue, green) each bearing the word \"GOD\" in white.  \n- The camera pans right, revealing a series of abstract paintings with muted tones and textured surfaces, including one with a prominent red triangle.", "history_tokens": 999, "history_utf8_bytes": 4379, "recent_frame_times_s": [457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0], "recent_frames_sha256": "23f63c5ba90ae0722ee76c13b16a787225da7b108cda87b515730b1ac2bc56b8", "num_recent_frames": 30, "tq": 719722.537353311, "t1": 719726.74768758, "ta": 719726.74768758, "te": 719726.784819562, "first_response_s": 4.2103342689806595, "answer_total_s": 4.247466251021251, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 462, "content_group": "e7a0ec32b7df42af54603e3040686dd131d78b73d1c269a40568e74570cf9101", "question": {"question_id": "sample_462_a203_q0", "video_id": 462, "video_path": "./videos/sample_462_real.mp4", "annotation_index": 203, "question_index": 0, "question": "Which artist's work has appeared in the video?", "options": ["A. Vincent van Gogh.", "B. Pablo Picasso.", "C. Stephen Rowe.", "D. Claude Monet."], "answer": "C", "time_stamp_s": 9, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_462_a203_q0", "video_id": 462, "time_stamp_s": 9, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1cd3d598aa425879c60635819a42209a7147b9643bc52f236d879e48177dc66f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03997395833333333, 1.006640625, 2.006640625, 3.006640625, 4.006640625, 5.006640625, 6.006640625, 7.006640625, 8.006640625], "recent_frames_sha256": "0a7f53bfe2b9fff9ec3e8feadb718425c2e2ea5db921aed0e81fa90205137e74", "num_recent_frames": 9, "tq": 718343.152189326, "t1": 718358.056504987, "ta": 718358.056504987, "te": 718358.094018253, "first_response_s": 14.904315660940483, "answer_total_s": 14.941828927025199, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_462_a203_q0", "video_id": 462, "time_stamp_s": 9, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6e84f176ced5a248b4adba7a2c31a0543d8a4f7144ac984a07c9fa2b56af3116", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03997395833333333, 1.006640625, 2.006640625, 3.006640625, 4.006640625, 5.006640625, 6.006640625, 7.006640625, 8.006640625], "recent_frames_sha256": "0a7f53bfe2b9fff9ec3e8feadb718425c2e2ea5db921aed0e81fa90205137e74", "num_recent_frames": 9, "tq": 718402.598994804, "t1": 718408.669609403, "ta": 718408.669609403, "te": 718408.85929898, "first_response_s": 6.070614599040709, "answer_total_s": 6.260304176015779, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 462, "content_group": "e7a0ec32b7df42af54603e3040686dd131d78b73d1c269a40568e74570cf9101", "question": {"question_id": "sample_462_a204_q1", "video_id": 462, "video_path": "./videos/sample_462_real.mp4", "annotation_index": 204, "question_index": 1, "question": "What is depicted in the painting shown in the video right now?", "options": ["A. A wave breaking in the ocean.", "B. A forest scene.", "C. An abstract pattern.", "D. A cityscape."], "answer": "A", "time_stamp_s": 162, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_462_a204_q1", "video_id": 462, "time_stamp_s": 162, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e4aa89c79474561448eae225e50b5ebdc197f170144ad5869f12cda317117d60", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [132.006640625, 133.006640625, 134.006640625, 135.006640625, 136.006640625, 137.006640625, 138.006640625, 139.006640625, 140.006640625, 141.006640625, 142.006640625, 143.006640625, 144.006640625, 145.006640625, 146.006640625, 147.006640625, 148.006640625, 149.006640625, 150.006640625, 151.006640625, 152.006640625, 153.006640625, 154.006640625, 155.006640625, 156.006640625, 157.006640625, 158.006640625, 159.006640625, 160.006640625, 161.006640625], "recent_frames_sha256": "45363a4e30fe350e2f07394bbbaf72cfe5d6f43afc88e736326d45347cef859e", "num_recent_frames": 30, "tq": 718358.109770411, "t1": 718370.156606245, "ta": 718370.156606245, "te": 718370.194819445, "first_response_s": 12.046835833927616, "answer_total_s": 12.085049033979885, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_462_a204_q1", "video_id": 462, "time_stamp_s": 162, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "89f24907bf35d9322f9a2a5d13dcd00b25fee6d4fe57c50de41ad31c490a611b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A colorful abstract painting with clustered dots is displayed on the left wall, adjacent to a large, sprawling abstract piece by Stephen Rouse.  \n- The camera pans right to reveal a tall, multi-tiered sculpture by Zellene Schlosberg, composed of wooden frames, wires, and colorful tubes, mounted vertically on a white wall.  \n- Gallery visitors are seen walking through the space, with some pausing to observe the artworks, particularly near the Schlosberg sculpture.\n[30-60s] - \"ARCADIA\" sign prominently displayed on a dark wall above framed artworks.  \n- Two large black-and-white portrait prints by \"Anna Damer\" hang side by side on a dark wall.  \n- A group of visitors gathers around a central artwork, with some pointing or discussing the piece.\n[60-90s] - A large screen displays a serene forest scene with a purple sky and a distant mountain, positioned above a smaller screen showing a road with a car.  \n- The camera pans right, revealing a wall with three framed artworks labeled \"Jung Bong,\" each depicting abstract or landscape imagery.  \n- Below the framed artworks, a large canvas shows a dramatic tornado over a town, with a sign reading \"ARCA\" visible above it.\n[90-120s] - A large framed photograph of a stormy sky over a town is displayed on the left wall.  \n- Above it, a smaller screen shows a blue-tinted interior scene with a figure in white.  \n- To the right, a larger screen displays a woman walking down an escalator, with a sign above reading \"Simon Denny.\"\n[120-150s] - A large framed painting of a woman in a pink ruffled dress is displayed prominently on the left wall.  \n- To the right, a series of three smaller framed artworks depicting fiery scenes are mounted vertically.  \n- A large framed painting of a pyramid engulfed in flames, labeled \"West Coast,\" is positioned to the right of the fiery artworks.", "history_tokens": 429, "history_utf8_bytes": 1849, "recent_frame_times_s": [132.006640625, 133.006640625, 134.006640625, 135.006640625, 136.006640625, 137.006640625, 138.006640625, 139.006640625, 140.006640625, 141.006640625, 142.006640625, 143.006640625, 144.006640625, 145.006640625, 146.006640625, 147.006640625, 148.006640625, 149.006640625, 150.006640625, 151.006640625, 152.006640625, 153.006640625, 154.006640625, 155.006640625, 156.006640625, 157.006640625, 158.006640625, 159.006640625, 160.006640625, 161.006640625], "recent_frames_sha256": "45363a4e30fe350e2f07394bbbaf72cfe5d6f43afc88e736326d45347cef859e", "num_recent_frames": 30, "tq": 718449.886506581, "t1": 718451.814707941, "ta": 718451.814707941, "te": 718452.163372718, "first_response_s": 1.9282013600459322, "answer_total_s": 2.276866137050092, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 462, "content_group": "e7a0ec32b7df42af54603e3040686dd131d78b73d1c269a40568e74570cf9101", "question": {"question_id": "sample_462_a204_q0", "video_id": 462, "video_path": "./videos/sample_462_real.mp4", "annotation_index": 204, "question_index": 0, "question": "Where is the black sign with white text describing \"Irwin Cumberland\" located in relation to the paintings?", "options": ["A. Below the painting.", "B. To the left of the painting.", "C. Above the painting.", "D. To the right of the painting."], "answer": "C", "time_stamp_s": 177, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_462_a204_q0", "video_id": 462, "time_stamp_s": 177, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d9ffa88c8f6d8676b80c9fbed53ee4922ca8ae69755ab168c427091c7bb1dab6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [147.006640625, 148.006640625, 149.006640625, 150.006640625, 151.006640625, 152.006640625, 153.006640625, 154.006640625, 155.006640625, 156.006640625, 157.006640625, 158.006640625, 159.006640625, 160.006640625, 161.006640625, 162.006640625, 163.006640625, 164.006640625, 165.006640625, 166.006640625, 167.006640625, 168.006640625, 169.006640625, 170.006640625, 171.006640625, 172.006640625, 173.006640625, 174.006640625, 175.006640625, 176.006640625], "recent_frames_sha256": "a738765e9496a69e26e2c30cc3fc25e20da38a97c6d7048d82a6660647a4faa8", "num_recent_frames": 30, "tq": 718370.212626216, "t1": 718382.792363958, "ta": 718382.792363958, "te": 718382.841169749, "first_response_s": 12.5797377419658, "answer_total_s": 12.628543533035554, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_462_a204_q0", "video_id": 462, "time_stamp_s": 177, "ground_truth": "C", "raw_output": "C. Above the painting.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "b402cfe86f9ba544fd65bde7d94155bf1ebc6db7babdc33d8e21708fade4f5f5", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A colorful abstract painting with clustered dots is displayed on the left wall, adjacent to a large, sprawling abstract piece by Stephen Rouse.  \n- The camera pans right to reveal a tall, multi-tiered sculpture by Zellene Schlosberg, composed of wooden frames, wires, and colorful tubes, mounted vertically on a white wall.  \n- Gallery visitors are seen walking through the space, with some pausing to observe the artworks, particularly near the Schlosberg sculpture.\n[30-60s] - \"ARCADIA\" sign prominently displayed on a dark wall above framed artworks.  \n- Two large black-and-white portrait prints by \"Anna Damer\" hang side by side on a dark wall.  \n- A group of visitors gathers around a central artwork, with some pointing or discussing the piece.\n[60-90s] - A large screen displays a serene forest scene with a purple sky and a distant mountain, positioned above a smaller screen showing a road with a car.  \n- The camera pans right, revealing a wall with three framed artworks labeled \"Jung Bong,\" each depicting abstract or landscape imagery.  \n- Below the framed artworks, a large canvas shows a dramatic tornado over a town, with a sign reading \"ARCA\" visible above it.\n[90-120s] - A large framed photograph of a stormy sky over a town is displayed on the left wall.  \n- Above it, a smaller screen shows a blue-tinted interior scene with a figure in white.  \n- To the right, a larger screen displays a woman walking down an escalator, with a sign above reading \"Simon Denny.\"\n[120-150s] - A large framed painting of a woman in a pink ruffled dress is displayed prominently on the left wall.  \n- To the right, a series of three smaller framed artworks depicting fiery scenes are mounted vertically.  \n- A large framed painting of a pyramid engulfed in flames, labeled \"West Coast,\" is positioned to the right of the fiery artworks.", "history_tokens": 429, "history_utf8_bytes": 1849, "recent_frame_times_s": [147.006640625, 148.006640625, 149.006640625, 150.006640625, 151.006640625, 152.006640625, 153.006640625, 154.006640625, 155.006640625, 156.006640625, 157.006640625, 158.006640625, 159.006640625, 160.006640625, 161.006640625, 162.006640625, 163.006640625, 164.006640625, 165.006640625, 166.006640625, 167.006640625, 168.006640625, 169.006640625, 170.006640625, 171.006640625, 172.006640625, 173.006640625, 174.006640625, 175.006640625, 176.006640625], "recent_frames_sha256": "a738765e9496a69e26e2c30cc3fc25e20da38a97c6d7048d82a6660647a4faa8", "num_recent_frames": 30, "tq": 718452.21257372, "t1": 718459.196678682, "ta": 718459.196678682, "te": 718459.423117397, "first_response_s": 6.984104961971752, "answer_total_s": 7.210543676977977, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 462, "content_group": "e7a0ec32b7df42af54603e3040686dd131d78b73d1c269a40568e74570cf9101", "question": {"question_id": "sample_462_a205_q0", "video_id": 462, "video_path": "./videos/sample_462_real.mp4", "annotation_index": 205, "question_index": 0, "question": "which painting did the camera focus on before revealing the name \"Kesja Tabaczuk\"?", "options": ["A. A painting of a rural landscape.", "B. A mirror.", "C. A bookshelf.", "D. A window."], "answer": "A", "time_stamp_s": 339, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "art_show", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_462_a205_q0", "video_id": 462, "time_stamp_s": 339, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a5cb39a319914ccc62d159bc306f6bf585500eb73f176ba9fc528230d41b3862", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [309.006640625, 310.006640625, 311.006640625, 312.006640625, 313.006640625, 314.006640625, 315.006640625, 316.006640625, 317.006640625, 318.006640625, 319.006640625, 320.006640625, 321.006640625, 322.006640625, 323.006640625, 324.006640625, 325.006640625, 326.006640625, 327.006640625, 328.006640625, 329.006640625, 330.006640625, 331.006640625, 332.006640625, 333.006640625, 334.006640625, 335.006640625, 336.006640625, 337.006640625, 338.006640625], "recent_frames_sha256": "d9c3c2f9b420beb859d02a8c576207d2b6eaaabafed9f51e8ba5d3ef08847573", "num_recent_frames": 30, "tq": 718382.855412982, "t1": 718390.500461205, "ta": 718390.500461205, "te": 718390.538110778, "first_response_s": 7.6450482229702175, "answer_total_s": 7.682697795913555, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_462_a205_q0", "video_id": 462, "time_stamp_s": 339, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0b1871714e455443361fc19515de2dee59dd654add7509f222d1e29f7506ba8f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A colorful abstract painting with clustered dots is displayed on the left wall, adjacent to a large, sprawling abstract piece by Stephen Rouse.  \n- The camera pans right to reveal a tall, multi-tiered sculpture by Zellene Schlosberg, composed of wooden frames, wires, and colorful tubes, mounted vertically on a white wall.  \n- Gallery visitors are seen walking through the space, with some pausing to observe the artworks, particularly near the Schlosberg sculpture.\n[30-60s] - \"ARCADIA\" sign prominently displayed on a dark wall above framed artworks.  \n- Two large black-and-white portrait prints by \"Anna Damer\" hang side by side on a dark wall.  \n- A group of visitors gathers around a central artwork, with some pointing or discussing the piece.\n[60-90s] - A large screen displays a serene forest scene with a purple sky and a distant mountain, positioned above a smaller screen showing a road with a car.  \n- The camera pans right, revealing a wall with three framed artworks labeled \"Jung Bong,\" each depicting abstract or landscape imagery.  \n- Below the framed artworks, a large canvas shows a dramatic tornado over a town, with a sign reading \"ARCA\" visible above it.\n[90-120s] - A large framed photograph of a stormy sky over a town is displayed on the left wall.  \n- Above it, a smaller screen shows a blue-tinted interior scene with a figure in white.  \n- To the right, a larger screen displays a woman walking down an escalator, with a sign above reading \"Simon Denny.\"\n[120-150s] - A large framed painting of a woman in a pink ruffled dress is displayed prominently on the left wall.  \n- To the right, a series of three smaller framed artworks depicting fiery scenes are mounted vertically.  \n- A large framed painting of a pyramid engulfed in flames, labeled \"West Coast,\" is positioned to the right of the fiery artworks.\n[150-180s] - A large framed painting of a turquoise underwater scene is mounted centrally on a white wall, flanked by other aquatic-themed artworks.  \n- Below it, a horizontal photograph captures a dynamic ocean wave cresting with white foam, positioned directly beneath the central painting.  \n- To the right, a vertical painting depicts a greenish-blue aquatic environment with visible textures, labeled \"Tina Cavanagh\" above it.\n[180-210s] - A large, central painting depicts underwater scenery with a swimmer, flanked by two similar artworks on a white wall.  \n- A smaller, lower painting shows turbulent ocean waves crashing on rocks, positioned beneath the central piece.  \n- People are seen walking through the gallery space, observing the artworks, with some standing near the paintings.\n[210-240s] - A wall-mounted display titled \"ARCADIA\" features multiple framed artworks arranged in a grid, each depicting human figures in various poses and expressions.  \n- The artworks are uniformly framed in gold-toned frames and mounted on a dark gray wall, with small white labels beneath each frame.  \n- Visitors are seen walking past the display, observing the art, with some pausing to look at specific pieces, indicating public engagement with the exhibit.\n[240-270s] - A large framed painting titled \"Arcadia\" by Antonio Tavera is displayed on a wall, featuring multiple portraits in a grid layout.  \n- The camera pans to reveal a different painting titled \"Aida Viana,\" depicting a figure in a forest setting, mounted on a white wall.  \n- The exhibition space includes other artworks and visitors walking by, with signage indicating artist names above the paintings.\n[270-300s] - A framed portrait of a woman with blonde hair and red lips is displayed, labeled \"Lena Mork.\"\n- Below it, two more portraits are visible: one of a blonde woman and another of a dark-skinned woman, both in dark settings.\n- To the right, a large painting depicts figures on a stone structure by the sea, labeled \"Anna Westerlund.\"\n[300-330s] - Three large, colorful paintings hang side-by-side on a white wall, depicting stylized scenes with figures and animals.  \n- The camera pans right, revealing a wall of black-and-white framed photographs arranged in a grid, labeled \"New Designs.\"  \n- A large framed landscape painting with an orange sunset and silhouetted structures is mounted above the photograph wall, under a sign reading \"Homes Mural.\"", "history_tokens": 972, "history_utf8_bytes": 4283, "recent_frame_times_s": [309.006640625, 310.006640625, 311.006640625, 312.006640625, 313.006640625, 314.006640625, 315.006640625, 316.006640625, 317.006640625, 318.006640625, 319.006640625, 320.006640625, 321.006640625, 322.006640625, 323.006640625, 324.006640625, 325.006640625, 326.006640625, 327.006640625, 328.006640625, 329.006640625, 330.006640625, 331.006640625, 332.006640625, 333.006640625, 334.006640625, 335.006640625, 336.006640625, 337.006640625, 338.006640625], "recent_frames_sha256": "d9c3c2f9b420beb859d02a8c576207d2b6eaaabafed9f51e8ba5d3ef08847573", "num_recent_frames": 30, "tq": 718506.135108187, "t1": 718507.189762327, "ta": 718507.189762327, "te": 718507.229946303, "first_response_s": 1.0546541400253773, "answer_total_s": 1.0948381159687415, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 462, "content_group": "e7a0ec32b7df42af54603e3040686dd131d78b73d1c269a40568e74570cf9101", "question": {"question_id": "sample_462_a205_q1", "video_id": 462, "video_path": "./videos/sample_462_real.mp4", "annotation_index": 205, "question_index": 1, "question": "What is the last name shown in the video?", "options": ["A. Michael Miller.", "B. Kesja Tabaczuk.", "C. John Smith.", "D. Sarah Parker."], "answer": "B", "time_stamp_s": 354, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_462_a205_q1", "video_id": 462, "time_stamp_s": 354, "ground_truth": "B", "raw_output": "B. Kesja Tabaczuk.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "eee27ed1b447cc3c5864db2cfc1801f4a007392332e461cd5be1573a8d3862ca", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [324.006640625, 325.006640625, 326.006640625, 327.006640625, 328.006640625, 329.006640625, 330.006640625, 331.006640625, 332.006640625, 333.006640625, 334.006640625, 335.006640625, 336.006640625, 337.006640625, 338.006640625, 339.006640625, 340.006640625, 341.006640625, 342.006640625, 343.006640625, 344.006640625, 345.006640625, 346.006640625, 347.006640625, 348.006640625, 349.006640625, 350.006640625, 351.006640625, 352.006640625, 353.006640625], "recent_frames_sha256": "d17c3f8a4061310796be40bfc9df6ed65a594c1a6e0ccc05d39ee1160e7cde65", "num_recent_frames": 30, "tq": 718390.548902709, "t1": 718402.269641055, "ta": 718402.269641055, "te": 718402.590154953, "first_response_s": 11.720738345989957, "answer_total_s": 12.041252243914641, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_462_a205_q1", "video_id": 462, "time_stamp_s": 354, "ground_truth": "B", "raw_output": "B. Kesja Tabaczuk.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "a3451bfade240e8e55c904470e62c8e71f337db4b4655f63504d42e2a394792b", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A colorful abstract painting with clustered dots is displayed on the left wall, adjacent to a large, sprawling abstract piece by Stephen Rouse.  \n- The camera pans right to reveal a tall, multi-tiered sculpture by Zellene Schlosberg, composed of wooden frames, wires, and colorful tubes, mounted vertically on a white wall.  \n- Gallery visitors are seen walking through the space, with some pausing to observe the artworks, particularly near the Schlosberg sculpture.\n[30-60s] - \"ARCADIA\" sign prominently displayed on a dark wall above framed artworks.  \n- Two large black-and-white portrait prints by \"Anna Damer\" hang side by side on a dark wall.  \n- A group of visitors gathers around a central artwork, with some pointing or discussing the piece.\n[60-90s] - A large screen displays a serene forest scene with a purple sky and a distant mountain, positioned above a smaller screen showing a road with a car.  \n- The camera pans right, revealing a wall with three framed artworks labeled \"Jung Bong,\" each depicting abstract or landscape imagery.  \n- Below the framed artworks, a large canvas shows a dramatic tornado over a town, with a sign reading \"ARCA\" visible above it.\n[90-120s] - A large framed photograph of a stormy sky over a town is displayed on the left wall.  \n- Above it, a smaller screen shows a blue-tinted interior scene with a figure in white.  \n- To the right, a larger screen displays a woman walking down an escalator, with a sign above reading \"Simon Denny.\"\n[120-150s] - A large framed painting of a woman in a pink ruffled dress is displayed prominently on the left wall.  \n- To the right, a series of three smaller framed artworks depicting fiery scenes are mounted vertically.  \n- A large framed painting of a pyramid engulfed in flames, labeled \"West Coast,\" is positioned to the right of the fiery artworks.\n[150-180s] - A large framed painting of a turquoise underwater scene is mounted centrally on a white wall, flanked by other aquatic-themed artworks.  \n- Below it, a horizontal photograph captures a dynamic ocean wave cresting with white foam, positioned directly beneath the central painting.  \n- To the right, a vertical painting depicts a greenish-blue aquatic environment with visible textures, labeled \"Tina Cavanagh\" above it.\n[180-210s] - A large, central painting depicts underwater scenery with a swimmer, flanked by two similar artworks on a white wall.  \n- A smaller, lower painting shows turbulent ocean waves crashing on rocks, positioned beneath the central piece.  \n- People are seen walking through the gallery space, observing the artworks, with some standing near the paintings.\n[210-240s] - A wall-mounted display titled \"ARCADIA\" features multiple framed artworks arranged in a grid, each depicting human figures in various poses and expressions.  \n- The artworks are uniformly framed in gold-toned frames and mounted on a dark gray wall, with small white labels beneath each frame.  \n- Visitors are seen walking past the display, observing the art, with some pausing to look at specific pieces, indicating public engagement with the exhibit.\n[240-270s] - A large framed painting titled \"Arcadia\" by Antonio Tavera is displayed on a wall, featuring multiple portraits in a grid layout.  \n- The camera pans to reveal a different painting titled \"Aida Viana,\" depicting a figure in a forest setting, mounted on a white wall.  \n- The exhibition space includes other artworks and visitors walking by, with signage indicating artist names above the paintings.\n[270-300s] - A framed portrait of a woman with blonde hair and red lips is displayed, labeled \"Lena Mork.\"\n- Below it, two more portraits are visible: one of a blonde woman and another of a dark-skinned woman, both in dark settings.\n- To the right, a large painting depicts figures on a stone structure by the sea, labeled \"Anna Westerlund.\"\n[300-330s] - Three large, colorful paintings hang side-by-side on a white wall, depicting stylized scenes with figures and animals.  \n- The camera pans right, revealing a wall of black-and-white framed photographs arranged in a grid, labeled \"New Designs.\"  \n- A large framed landscape painting with an orange sunset and silhouetted structures is mounted above the photograph wall, under a sign reading \"Homes Mural.\"", "history_tokens": 972, "history_utf8_bytes": 4283, "recent_frame_times_s": [324.006640625, 325.006640625, 326.006640625, 327.006640625, 328.006640625, 329.006640625, 330.006640625, 331.006640625, 332.006640625, 333.006640625, 334.006640625, 335.006640625, 336.006640625, 337.006640625, 338.006640625, 339.006640625, 340.006640625, 341.006640625, 342.006640625, 343.006640625, 344.006640625, 345.006640625, 346.006640625, 347.006640625, 348.006640625, 349.006640625, 350.006640625, 351.006640625, 352.006640625, 353.006640625], "recent_frames_sha256": "d17c3f8a4061310796be40bfc9df6ed65a594c1a6e0ccc05d39ee1160e7cde65", "num_recent_frames": 30, "tq": 718507.26450961, "t1": 718520.291125685, "ta": 718520.291125685, "te": 718520.6034884, "first_response_s": 13.026616074959747, "answer_total_s": 13.338978789979592, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 463, "content_group": "1d41440c0f959d0366b0faa71510e2c8793ed449c2bea3567cc51f7f4febb4de", "question": {"question_id": "sample_463_a818_q0", "video_id": 463, "video_path": "./videos/sample_463_real.mp4", "annotation_index": 818, "question_index": 0, "question": "What is the color of the nameplate seen above the painting?", "options": ["A. White with black text.", "B. Black with white text.", "C. Gold with black text.", "D. Wooden with white text."], "answer": "B", "time_stamp_s": 172, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_463_a818_q0", "video_id": 463, "time_stamp_s": 172, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0cde4cf4ac7db3a58ca3c7ad4134728ec612210289aa7d8b84841aa9f4809776", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [142.006640625, 143.006640625, 144.006640625, 145.006640625, 146.006640625, 147.006640625, 148.006640625, 149.006640625, 150.006640625, 151.006640625, 152.006640625, 153.006640625, 154.006640625, 155.006640625, 156.006640625, 157.006640625, 158.006640625, 159.006640625, 160.006640625, 161.006640625, 162.006640625, 163.006640625, 164.006640625, 165.006640625, 166.006640625, 167.006640625, 168.006640625, 169.006640625, 170.006640625, 171.006640625], "recent_frames_sha256": "e32edb1e7d9e65d795c5b2a16021d8ac9da927d9568a664e92355e77ecb201d2", "num_recent_frames": 30, "tq": 717948.162030533, "t1": 717958.403686846, "ta": 717958.403686846, "te": 717958.440936518, "first_response_s": 10.241656313068233, "answer_total_s": 10.27890598506201, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_463_a818_q0", "video_id": 463, "time_stamp_s": 172, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b435d04337e5eddf221c5ad9b076b52f96fb984eb835df6d568a83e76d41da4a", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Camera pans across a gallery wall displaying various framed paintings, including portraits and landscapes, with labels like \"The Best\" and \"The Best\" visible above some pieces.  \n- A few visitors are seen observing the art, with one person seated and another standing near the right side of the frame.  \n- The ceiling features recessed lighting and black panels, with a sign reading \"Museums\" visible at the top left corner.\n[30-60s] - A person with red hair is partially visible on the left, observing art near a portrait of a woman.  \n- The camera pans right, revealing a series of framed artworks, including a large painting of a woman with a child and a portrait of a woman with dark hair.  \n- A sign labeled \"Mary Jane Angell\" is visible above a dark-framed painting, while another sign labeled \"Jane Bremner\" is positioned above a portrait of a woman.\n[60-90s] - A large framed painting of a winged horse is centrally displayed, labeled \"J. B. Wills\" above it.  \n- The camera pans slightly to the right, revealing a visitor in a dark jacket observing the artwork.  \n- A sign reading \"Mary Jane Russell\" is visible above another painting to the left of the winged horse.\n[90-120s] - A man in a dark jacket stands near a wall of framed paintings, gesturing toward them.  \n- Two large gold-framed portraits of women hang side by side under a \"Caroline Nichols\" sign.  \n- A woman with curly hair is seen in a mirror reflection, seated at a table with fruit, framed in a large black-and-gold frame.\n[120-150s] - A wall-mounted sign labeled \"Stephen Mackey\" is visible above a grid of framed portraits in ornate gold frames.  \n- The camera pans to reveal a large framed portrait of a woman in a blue dress, positioned centrally on the wall.  \n- To the left, a framed portrait of a woman in a teal coat is displayed, with a smaller framed piece below it showing a man in a suit.", "history_tokens": 453, "history_utf8_bytes": 1887, "recent_frame_times_s": [142.006640625, 143.006640625, 144.006640625, 145.006640625, 146.006640625, 147.006640625, 148.006640625, 149.006640625, 150.006640625, 151.006640625, 152.006640625, 153.006640625, 154.006640625, 155.006640625, 156.006640625, 157.006640625, 158.006640625, 159.006640625, 160.006640625, 161.006640625, 162.006640625, 163.006640625, 164.006640625, 165.006640625, 166.006640625, 167.006640625, 168.006640625, 169.006640625, 170.006640625, 171.006640625], "recent_frames_sha256": "e32edb1e7d9e65d795c5b2a16021d8ac9da927d9568a664e92355e77ecb201d2", "num_recent_frames": 30, "tq": 718041.231188617, "t1": 718041.738220016, "ta": 718041.738220016, "te": 718041.780709168, "first_response_s": 0.5070313990581781, "answer_total_s": 0.5495205509942025, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 463, "content_group": "1d41440c0f959d0366b0faa71510e2c8793ed449c2bea3567cc51f7f4febb4de", "question": {"question_id": "sample_463_a818_q1", "video_id": 463, "video_path": "./videos/sample_463_real.mp4", "annotation_index": 818, "question_index": 1, "question": "What type of paintings are mainly displayed right now?", "options": ["A. Abstract paintings.", "B. Portraits.", "C. Floral paintings.", "D. Landscape paintings."], "answer": "C", "time_stamp_s": 180, "task_type": "Clips Summarize", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_463_a818_q1", "video_id": 463, "time_stamp_s": 180, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4394d9fbf46be061489620a24cd8f5ae03b70cb7bbd129282ffdef7f1cd0688a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.006640625, 151.006640625, 152.006640625, 153.006640625, 154.006640625, 155.006640625, 156.006640625, 157.006640625, 158.006640625, 159.006640625, 160.006640625, 161.006640625, 162.006640625, 163.006640625, 164.006640625, 165.006640625, 166.006640625, 167.006640625, 168.006640625, 169.006640625, 170.006640625, 171.006640625, 172.006640625, 173.006640625, 174.006640625, 175.006640625, 176.006640625, 177.006640625, 178.006640625, 179.006640625], "recent_frames_sha256": "052795a2d9432f39db80638847f8738668e8dcb0dca6f82c33073c8126af809c", "num_recent_frames": 30, "tq": 717958.449868245, "t1": 717970.898976493, "ta": 717970.898976493, "te": 717970.936709567, "first_response_s": 12.449108247994445, "answer_total_s": 12.486841321922839, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_463_a818_q1", "video_id": 463, "time_stamp_s": 180, "ground_truth": "C", "raw_output": "C. Floral paintings.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "2e152eea4a5cf5be44718cfae87009e24d25442d6bf18cb571b8102db1edc2d0", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Camera pans across a gallery wall displaying various framed paintings, including portraits and landscapes, with labels like \"The Best\" and \"The Best\" visible above some pieces.  \n- A few visitors are seen observing the art, with one person seated and another standing near the right side of the frame.  \n- The ceiling features recessed lighting and black panels, with a sign reading \"Museums\" visible at the top left corner.\n[30-60s] - A person with red hair is partially visible on the left, observing art near a portrait of a woman.  \n- The camera pans right, revealing a series of framed artworks, including a large painting of a woman with a child and a portrait of a woman with dark hair.  \n- A sign labeled \"Mary Jane Angell\" is visible above a dark-framed painting, while another sign labeled \"Jane Bremner\" is positioned above a portrait of a woman.\n[60-90s] - A large framed painting of a winged horse is centrally displayed, labeled \"J. B. Wills\" above it.  \n- The camera pans slightly to the right, revealing a visitor in a dark jacket observing the artwork.  \n- A sign reading \"Mary Jane Russell\" is visible above another painting to the left of the winged horse.\n[90-120s] - A man in a dark jacket stands near a wall of framed paintings, gesturing toward them.  \n- Two large gold-framed portraits of women hang side by side under a \"Caroline Nichols\" sign.  \n- A woman with curly hair is seen in a mirror reflection, seated at a table with fruit, framed in a large black-and-gold frame.\n[120-150s] - A wall-mounted sign labeled \"Stephen Mackey\" is visible above a grid of framed portraits in ornate gold frames.  \n- The camera pans to reveal a large framed portrait of a woman in a blue dress, positioned centrally on the wall.  \n- To the left, a framed portrait of a woman in a teal coat is displayed, with a smaller framed piece below it showing a man in a suit.\n[150-180s] - A large floral painting with a woman in a garden is centered on the wall, flanked by smaller floral artworks.  \n- Above it, a painting titled \"Aurora Borealis\" depicts glowing flowers against a dark background.  \n- The camera pans slightly to the right, revealing more floral-themed paintings on the adjacent wall.", "history_tokens": 531, "history_utf8_bytes": 2215, "recent_frame_times_s": [150.006640625, 151.006640625, 152.006640625, 153.006640625, 154.006640625, 155.006640625, 156.006640625, 157.006640625, 158.006640625, 159.006640625, 160.006640625, 161.006640625, 162.006640625, 163.006640625, 164.006640625, 165.006640625, 166.006640625, 167.006640625, 168.006640625, 169.006640625, 170.006640625, 171.006640625, 172.006640625, 173.006640625, 174.006640625, 175.006640625, 176.006640625, 177.006640625, 178.006640625, 179.006640625], "recent_frames_sha256": "052795a2d9432f39db80638847f8738668e8dcb0dca6f82c33073c8126af809c", "num_recent_frames": 30, "tq": 718052.14074835, "t1": 718058.851668002, "ta": 718058.851668002, "te": 718059.124262861, "first_response_s": 6.710919652017765, "answer_total_s": 6.983514511026442, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 463, "content_group": "1d41440c0f959d0366b0faa71510e2c8793ed449c2bea3567cc51f7f4febb4de", "question": {"question_id": "sample_463_a819_q0", "video_id": 463, "video_path": "./videos/sample_463_real.mp4", "annotation_index": 819, "question_index": 0, "question": "What is on top of the stack of books leftside on the small table?", "options": ["A. A blue-colored book.", "B. A green-colored book.", "C. A red-colored book.", "D. An orange-colored book."], "answer": "D", "time_stamp_s": 324, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_463_a819_q0", "video_id": 463, "time_stamp_s": 324, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "aeabc4824352f5ba54d6da2e09ae4a186f50e3f370ed15ae38a818438db2cdab", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [294.006640625, 295.006640625, 296.006640625, 297.006640625, 298.006640625, 299.006640625, 300.006640625, 301.006640625, 302.006640625, 303.006640625, 304.006640625, 305.006640625, 306.006640625, 307.006640625, 308.006640625, 309.006640625, 310.006640625, 311.006640625, 312.006640625, 313.006640625, 314.006640625, 315.006640625, 316.006640625, 317.006640625, 318.006640625, 319.006640625, 320.006640625, 321.006640625, 322.006640625, 323.006640625], "recent_frames_sha256": "1518e48d5de63316e3edf775b78ccbfaf287222139c56292c2b9eac714e9ebcb", "num_recent_frames": 30, "tq": 717970.94416958, "t1": 717985.958609061, "ta": 717985.958609061, "te": 717985.998852532, "first_response_s": 15.0144394809613, "answer_total_s": 15.054682952002622, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_463_a819_q0", "video_id": 463, "time_stamp_s": 324, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b3ec596901756c3664458ab8b9dddce199616283f522655b2f3974b15e8deecb", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Camera pans across a gallery wall displaying various framed paintings, including portraits and landscapes, with labels like \"The Best\" and \"The Best\" visible above some pieces.  \n- A few visitors are seen observing the art, with one person seated and another standing near the right side of the frame.  \n- The ceiling features recessed lighting and black panels, with a sign reading \"Museums\" visible at the top left corner.\n[30-60s] - A person with red hair is partially visible on the left, observing art near a portrait of a woman.  \n- The camera pans right, revealing a series of framed artworks, including a large painting of a woman with a child and a portrait of a woman with dark hair.  \n- A sign labeled \"Mary Jane Angell\" is visible above a dark-framed painting, while another sign labeled \"Jane Bremner\" is positioned above a portrait of a woman.\n[60-90s] - A large framed painting of a winged horse is centrally displayed, labeled \"J. B. Wills\" above it.  \n- The camera pans slightly to the right, revealing a visitor in a dark jacket observing the artwork.  \n- A sign reading \"Mary Jane Russell\" is visible above another painting to the left of the winged horse.\n[90-120s] - A man in a dark jacket stands near a wall of framed paintings, gesturing toward them.  \n- Two large gold-framed portraits of women hang side by side under a \"Caroline Nichols\" sign.  \n- A woman with curly hair is seen in a mirror reflection, seated at a table with fruit, framed in a large black-and-gold frame.\n[120-150s] - A wall-mounted sign labeled \"Stephen Mackey\" is visible above a grid of framed portraits in ornate gold frames.  \n- The camera pans to reveal a large framed portrait of a woman in a blue dress, positioned centrally on the wall.  \n- To the left, a framed portrait of a woman in a teal coat is displayed, with a smaller framed piece below it showing a man in a suit.\n[150-180s] - A large floral painting with a woman in a garden is centered on the wall, flanked by smaller floral artworks.  \n- Above it, a painting titled \"Aurora Borealis\" depicts glowing flowers against a dark background.  \n- The camera pans slightly to the right, revealing more floral-themed paintings on the adjacent wall.\n[180-210s] - A large framed painting of two women amidst red roses is displayed on a white wall, adjacent to smaller floral artworks.  \n- Above a series of two large framed cityscape paintings, a sign reads \"Alessio Dotta,\" indicating the artist.  \n- A blue sign indicating \"721/820\" is mounted on a white pillar, likely denoting an exhibition or catalog number.\n[210-240s] - A large abstract painting with black, white, and orange geometric shapes is mounted on the left wall.  \n- A red, textured bear-shaped artwork hangs on the right wall, adjacent to a smaller framed piece.  \n- A visitor in a pink outfit walks past the bear artwork, moving toward the right side of the frame.\n[240-270s] - A black-framed 3D sculpture filled with colorful candy wrappers is mounted on a white wall, casting a shadow on the wall below.\n- To its right, a large abstract painting with bold red, orange, and green strokes dominates the wall space.\n- Visitors walk past the artworks, with one person in a white shirt and dark pants moving toward the right side of the frame.\n[270-300s] - A mannequin displays a patterned jacket with floral embroidery, positioned centrally on a pedestal.  \n- To the left, a large abstract painting with brown, white, and blue swirls hangs on the wall.  \n- A blue sign labeled \"228/824\" is mounted on the ceiling, indicating an exhibit or gallery section.", "history_tokens": 869, "history_utf8_bytes": 3586, "recent_frame_times_s": [294.006640625, 295.006640625, 296.006640625, 297.006640625, 298.006640625, 299.006640625, 300.006640625, 301.006640625, 302.006640625, 303.006640625, 304.006640625, 305.006640625, 306.006640625, 307.006640625, 308.006640625, 309.006640625, 310.006640625, 311.006640625, 312.006640625, 313.006640625, 314.006640625, 315.006640625, 316.006640625, 317.006640625, 318.006640625, 319.006640625, 320.006640625, 321.006640625, 322.006640625, 323.006640625], "recent_frames_sha256": "1518e48d5de63316e3edf775b78ccbfaf287222139c56292c2b9eac714e9ebcb", "num_recent_frames": 30, "tq": 718096.359229868, "t1": 718107.821308526, "ta": 718107.821308526, "te": 718107.866676963, "first_response_s": 11.46207865793258, "answer_total_s": 11.507447095005773, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 463, "content_group": "1d41440c0f959d0366b0faa71510e2c8793ed449c2bea3567cc51f7f4febb4de", "question": {"question_id": "sample_463_a820_q0", "video_id": 463, "video_path": "./videos/sample_463_real.mp4", "annotation_index": 820, "question_index": 0, "question": "Where is the photograph of the sunset with mountains positioned in the new set of artworks?", "options": ["A. At the bottom section of the wall.", "B. At the topmost position.", "C. Below the old, weathered door frame.", "D. Next to the close-up of flowers."], "answer": "B", "time_stamp_s": 499, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_463_a820_q0", "video_id": 463, "time_stamp_s": 499, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7ce47f4792362418f410328c69abeabf6b0529c1f77d67f487686840a841ea56", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [469.006640625, 470.006640625, 471.006640625, 472.006640625, 473.006640625, 474.006640625, 475.006640625, 476.006640625, 477.006640625, 478.006640625, 479.006640625, 480.006640625, 481.006640625, 482.006640625, 483.006640625, 484.006640625, 485.006640625, 486.006640625, 487.006640625, 488.006640625, 489.006640625, 490.006640625, 491.006640625, 492.006640625, 493.006640625, 494.006640625, 495.006640625, 496.006640625, 497.006640625, 498.006640625], "recent_frames_sha256": "c40d2158439cbedbab3ba3a813b4aa365901feb0dd85d5a9973498581704f64b", "num_recent_frames": 30, "tq": 717986.007929193, "t1": 717997.896461531, "ta": 717997.896461531, "te": 717997.934120561, "first_response_s": 11.888532338081859, "answer_total_s": 11.926191368023865, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_463_a820_q0", "video_id": 463, "time_stamp_s": 499, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "928d66a8c65b1315d0e5f17ca1518cf42261645ba15b2f184ad2ec6848d16e35", "condition_order": ["recent", "notes"], "memory": "[150-180s] - A large floral painting with a woman in a garden is centered on the wall, flanked by smaller floral artworks.  \n- Above it, a painting titled \"Aurora Borealis\" depicts glowing flowers against a dark background.  \n- The camera pans slightly to the right, revealing more floral-themed paintings on the adjacent wall.\n[180-210s] - A large framed painting of two women amidst red roses is displayed on a white wall, adjacent to smaller floral artworks.  \n- Above a series of two large framed cityscape paintings, a sign reads \"Alessio Dotta,\" indicating the artist.  \n- A blue sign indicating \"721/820\" is mounted on a white pillar, likely denoting an exhibition or catalog number.\n[210-240s] - A large abstract painting with black, white, and orange geometric shapes is mounted on the left wall.  \n- A red, textured bear-shaped artwork hangs on the right wall, adjacent to a smaller framed piece.  \n- A visitor in a pink outfit walks past the bear artwork, moving toward the right side of the frame.\n[240-270s] - A black-framed 3D sculpture filled with colorful candy wrappers is mounted on a white wall, casting a shadow on the wall below.\n- To its right, a large abstract painting with bold red, orange, and green strokes dominates the wall space.\n- Visitors walk past the artworks, with one person in a white shirt and dark pants moving toward the right side of the frame.\n[270-300s] - A mannequin displays a patterned jacket with floral embroidery, positioned centrally on a pedestal.  \n- To the left, a large abstract painting with brown, white, and blue swirls hangs on the wall.  \n- A blue sign labeled \"228/824\" is mounted on the ceiling, indicating an exhibit or gallery section.\n[300-330s] - Two circular framed artworks depicting abstract human forms are mounted side-by-side on a white wall.  \n- To the left, a grid of colorful, square textile pieces is displayed on a white wall, with a small plaque visible below.  \n- A group of visitors, including a woman in a gray jacket and a man in a suit, are seen walking past the artworks, observing the exhibits.\n[330-360s] - A large portrait of a blonde woman with sunglasses and a blue bubblegum bubble is prominently displayed on a white wall.  \n- Two abstract, stylized portraits of figures with crowns and expressive faces are mounted side by side on the same wall.  \n- A row of three framed portraits, including a nun in white, a nun in black, and the blonde woman with bubblegum, is visible along the wall.\n[360-390s] - A large X-ray style artwork of a van with internal structure visible, mounted on a wall.  \n- Adjacent to it, a smaller X-ray style artwork of a truck is displayed.  \n- A colorful abstract painting depicting a beach scene with umbrellas and rocks is visible to the left of the van artwork.\n[390-420s] - A large, intricate black-and-white portrait composed of numerous small dots is mounted on a white wall, with visitors walking past in the background.\n- The camera pans to reveal two large abstract paintings: one with blue and white strokes on a light background, and another predominantly dark with abstract forms.\n- A close-up shot highlights the detailed dot pattern of the portrait, emphasizing its texture and the precision of the composition.\n[420-450s] - A large, intricate portrait made of bottle caps is displayed on a white wall, with a grid-like pattern forming the image.  \n- The camera pans to reveal another large artwork, this one depicting a face in blue tones, also constructed from small, reflective elements.  \n- Visitors are seen walking around and observing the artworks, with some stopping to look closely at the pieces.\n[450-480s] - A large blue-toned portrait, composed of numerous small dots, is mounted on a white wall, with visitors observing it.  \n- The camera pans to reveal a gallery space with multiple framed black-and-white photographs, including a striking image of a cheetah walking beside a human figure.  \n- A blue sign reading \"PHOTO INDEPENDENT\" is visible on the ceiling, indicating the exhibition's name or theme.", "history_tokens": 950, "history_utf8_bytes": 4048, "recent_frame_times_s": [469.006640625, 470.006640625, 471.006640625, 472.006640625, 473.006640625, 474.006640625, 475.006640625, 476.006640625, 477.006640625, 478.006640625, 479.006640625, 480.006640625, 481.006640625, 482.006640625, 483.006640625, 484.006640625, 485.006640625, 486.006640625, 487.006640625, 488.006640625, 489.006640625, 490.006640625, 491.006640625, 492.006640625, 493.006640625, 494.006640625, 495.006640625, 496.006640625, 497.006640625, 498.006640625], "recent_frames_sha256": "c40d2158439cbedbab3ba3a813b4aa365901feb0dd85d5a9973498581704f64b", "num_recent_frames": 30, "tq": 718151.22583788, "t1": 718158.690648971, "ta": 718158.690648971, "te": 718158.892708691, "first_response_s": 7.46481109096203, "answer_total_s": 7.666870810906403, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 463, "content_group": "1d41440c0f959d0366b0faa71510e2c8793ed449c2bea3567cc51f7f4febb4de", "question": {"question_id": "sample_463_a821_q0", "video_id": 463, "video_path": "./videos/sample_463_real.mp4", "annotation_index": 821, "question_index": 0, "question": "Which names are revealed below the photographs right now?", "options": ["A. ERICA KELLY MARTIN.", "B. FERNANDO GUERRERO.", "C. ERICA KELLY MARTIN.", "D. JOHN DOE."], "answer": "C", "time_stamp_s": 596, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [540, 599], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_463_a821_q0", "video_id": 463, "time_stamp_s": 596, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "47e27f9ce76af11ee368c40ea476d4304eb383547813f67124a415c205e2fc9f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [566.006640625, 567.006640625, 568.006640625, 569.006640625, 570.006640625, 571.006640625, 572.006640625, 573.006640625, 574.006640625, 575.006640625, 576.006640625, 577.006640625, 578.006640625, 579.006640625, 580.006640625, 581.006640625, 582.006640625, 583.006640625, 584.006640625, 585.006640625, 586.006640625, 587.006640625, 588.006640625, 589.006640625, 590.006640625, 591.006640625, 592.006640625, 593.006640625, 594.006640625, 595.006640625], "recent_frames_sha256": "fb302d5c919a96846f3134bbf2c896757a62a993fd846ace566c99b58a38617a", "num_recent_frames": 30, "tq": 717997.948454597, "t1": 718005.716390698, "ta": 718005.716390698, "te": 718005.756182358, "first_response_s": 7.767936100950465, "answer_total_s": 7.807727760984562, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_463_a821_q0", "video_id": 463, "time_stamp_s": 596, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0378fcbfc83bfafe7263a3a4a086f02b6c742558ff5a7b85171ff6ed4cc844e7", "condition_order": ["recent", "notes"], "memory": "[240-270s] - A black-framed 3D sculpture filled with colorful candy wrappers is mounted on a white wall, casting a shadow on the wall below.\n- To its right, a large abstract painting with bold red, orange, and green strokes dominates the wall space.\n- Visitors walk past the artworks, with one person in a white shirt and dark pants moving toward the right side of the frame.\n[270-300s] - A mannequin displays a patterned jacket with floral embroidery, positioned centrally on a pedestal.  \n- To the left, a large abstract painting with brown, white, and blue swirls hangs on the wall.  \n- A blue sign labeled \"228/824\" is mounted on the ceiling, indicating an exhibit or gallery section.\n[300-330s] - Two circular framed artworks depicting abstract human forms are mounted side-by-side on a white wall.  \n- To the left, a grid of colorful, square textile pieces is displayed on a white wall, with a small plaque visible below.  \n- A group of visitors, including a woman in a gray jacket and a man in a suit, are seen walking past the artworks, observing the exhibits.\n[330-360s] - A large portrait of a blonde woman with sunglasses and a blue bubblegum bubble is prominently displayed on a white wall.  \n- Two abstract, stylized portraits of figures with crowns and expressive faces are mounted side by side on the same wall.  \n- A row of three framed portraits, including a nun in white, a nun in black, and the blonde woman with bubblegum, is visible along the wall.\n[360-390s] - A large X-ray style artwork of a van with internal structure visible, mounted on a wall.  \n- Adjacent to it, a smaller X-ray style artwork of a truck is displayed.  \n- A colorful abstract painting depicting a beach scene with umbrellas and rocks is visible to the left of the van artwork.\n[390-420s] - A large, intricate black-and-white portrait composed of numerous small dots is mounted on a white wall, with visitors walking past in the background.\n- The camera pans to reveal two large abstract paintings: one with blue and white strokes on a light background, and another predominantly dark with abstract forms.\n- A close-up shot highlights the detailed dot pattern of the portrait, emphasizing its texture and the precision of the composition.\n[420-450s] - A large, intricate portrait made of bottle caps is displayed on a white wall, with a grid-like pattern forming the image.  \n- The camera pans to reveal another large artwork, this one depicting a face in blue tones, also constructed from small, reflective elements.  \n- Visitors are seen walking around and observing the artworks, with some stopping to look closely at the pieces.\n[450-480s] - A large blue-toned portrait, composed of numerous small dots, is mounted on a white wall, with visitors observing it.  \n- The camera pans to reveal a gallery space with multiple framed black-and-white photographs, including a striking image of a cheetah walking beside a human figure.  \n- A blue sign reading \"PHOTO INDEPENDENT\" is visible on the ceiling, indicating the exhibition's name or theme.\n[480-510s] - A man in a maroon sweater and dark jacket walks past framed black-and-white photographs on a white wall, carrying a black backpack.  \n- The camera pans right, revealing more artworks, including a large horizontal image of ocean waves and a smaller vertical image of a beach scene.  \n- The name \"LESSIE CHAN\" is visible in lowercase letters beneath the wave photograph, indicating the artist.\n[510-540s] - A large framed photograph of a beach scene with waves and a distant pier is displayed on the left wall.  \n- To its right, a framed image of a \"STANDARD OIL PRODUCTS\" sign stands in a barren, open field under a cloudy sky.  \n- A woman in a black outfit is seen adjusting the hat of a seated woman in a wheelchair, both positioned near the center of the gallery space.\n[540-570s] - A digital display shows a black-and-white image of a person with the text \"UNRAVELLED\" and \"POLA RUBIS / SHEILA DARCEY\" above it.  \n- To the right, large abstract paintings with gold and black patterns are mounted on the wall.  \n- Below the digital display, a QR code and text indicate \"POLA RUBIS / SHEILA DARCEY\" and \"UNRAVELLED\" with a website address.", "history_tokens": 996, "history_utf8_bytes": 4192, "recent_frame_times_s": [566.006640625, 567.006640625, 568.006640625, 569.006640625, 570.006640625, 571.006640625, 572.006640625, 573.006640625, 574.006640625, 575.006640625, 576.006640625, 577.006640625, 578.006640625, 579.006640625, 580.006640625, 581.006640625, 582.006640625, 583.006640625, 584.006640625, 585.006640625, 586.006640625, 587.006640625, 588.006640625, 589.006640625, 590.006640625, 591.006640625, 592.006640625, 593.006640625, 594.006640625, 595.006640625], "recent_frames_sha256": "fb302d5c919a96846f3134bbf2c896757a62a993fd846ace566c99b58a38617a", "num_recent_frames": 30, "tq": 718184.141340115, "t1": 718185.151312913, "ta": 718185.151312913, "te": 718185.190327211, "first_response_s": 1.0099727980559692, "answer_total_s": 1.048987096059136, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 464, "content_group": "e06bb952d840dc0f551b2029bffd1dcc6f8d48ca19b3688d8914345cd7903c8b", "question": {"question_id": "sample_464_a173_q0", "video_id": 464, "video_path": "./videos/sample_464_real.mp4", "annotation_index": 173, "question_index": 0, "question": "What words are written on the painting in the lower left corner of the wall?", "options": ["A. \"WE SELL ART\".", "B. \"BUY & SELL ART\".", "C. \"WE BUY & SELL LUXURY\".", "D. \"ART FOR SALE\"."], "answer": "C", "time_stamp_s": 6, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_464_a173_q0", "video_id": 464, "time_stamp_s": 6, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e5aca686a384e6526baa486f5021abc515e5ea8387563efbdb6ae7066273dfe0", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.041015625, 1.0076822916666666, 2.007682291666667, 3.007682291666667, 4.007682291666667, 5.007682291666667], "recent_frames_sha256": "f0351bc5fdc7752fad9c0711fd55043447e926282189e3a9dbc8e96943dcefe3", "num_recent_frames": 6, "tq": 718844.935786986, "t1": 718849.541327212, "ta": 718849.541327212, "te": 718849.579759804, "first_response_s": 4.605540225980803, "answer_total_s": 4.643972817924805, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_464_a173_q0", "video_id": 464, "time_stamp_s": 6, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "832c57ff6c5033964c17df270fb7b0fff6f70c1d10a15e6a8e8fbb0fd5c50591", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.041015625, 1.0076822916666666, 2.007682291666667, 3.007682291666667, 4.007682291666667, 5.007682291666667], "recent_frames_sha256": "f0351bc5fdc7752fad9c0711fd55043447e926282189e3a9dbc8e96943dcefe3", "num_recent_frames": 6, "tq": 718703.884371569, "t1": 718716.392139028, "ta": 718716.392139028, "te": 718716.436551591, "first_response_s": 12.507767458911985, "answer_total_s": 12.552180022001266, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 464, "content_group": "e06bb952d840dc0f551b2029bffd1dcc6f8d48ca19b3688d8914345cd7903c8b", "question": {"question_id": "sample_464_a173_q1", "video_id": 464, "video_path": "./videos/sample_464_real.mp4", "annotation_index": 173, "question_index": 1, "question": "How many pieces of art paintings are displayed in the \"ARTSNITCH\" section?", "options": ["A. Two.", "B. Three.", "C. Four.", "D. Five."], "answer": "B", "time_stamp_s": 10, "task_type": "Counting", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_464_a173_q1", "video_id": 464, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "C. Four.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "bec148cf07efe046784cd0623906c73acfc49821603525d3c83b7d249e985513", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.041015625, 1.0076822916666666, 2.007682291666667, 3.007682291666667, 4.007682291666667, 5.007682291666667, 6.007682291666667, 7.007682291666667, 8.007682291666667, 9.007682291666667], "recent_frames_sha256": "8a9136c9e907627b00809a7777d1417b0787b739d873cc961215ba7231d91311", "num_recent_frames": 10, "tq": 718849.595683649, "t1": 718859.766596775, "ta": 718859.766596775, "te": 718859.918810825, "first_response_s": 10.170913126086816, "answer_total_s": 10.323127176030539, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_464_a173_q1", "video_id": 464, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "C. Four.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "6ddee896eda1ae15b1f67e6552dd530cec5734c9c7d875af3026c5c5f211b6bc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.041015625, 1.0076822916666666, 2.007682291666667, 3.007682291666667, 4.007682291666667, 5.007682291666667, 6.007682291666667, 7.007682291666667, 8.007682291666667, 9.007682291666667], "recent_frames_sha256": "8a9136c9e907627b00809a7777d1417b0787b739d873cc961215ba7231d91311", "num_recent_frames": 10, "tq": 718716.467440356, "t1": 718722.368464475, "ta": 718722.368464475, "te": 718722.516546076, "first_response_s": 5.901024118997157, "answer_total_s": 6.049105720012449, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 464, "content_group": "e06bb952d840dc0f551b2029bffd1dcc6f8d48ca19b3688d8914345cd7903c8b", "question": {"question_id": "sample_464_a174_q0", "video_id": 464, "video_path": "./videos/sample_464_real.mp4", "annotation_index": 174, "question_index": 0, "question": "What action is being performed by a person in a jacket near the graphic painting?", "options": ["A. Taking a picture.", "B. Painting.", "C. Cleaning the artwork.", "D. Pointing at the artwork."], "answer": "A", "time_stamp_s": 154, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_464_a174_q0", "video_id": 464, "time_stamp_s": 154, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4a33c9ff39f294831d98582cf6659cc9dfa3229507ce5e232cde31859c256cbc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [124.00768229166667, 125.00768229166667, 126.00768229166667, 127.00768229166667, 128.00768229166667, 129.00768229166667, 130.00768229166667, 131.00768229166667, 132.00768229166667, 133.00768229166667, 134.00768229166667, 135.00768229166667, 136.00768229166667, 137.00768229166667, 138.00768229166667, 139.00768229166667, 140.00768229166667, 141.00768229166667, 142.00768229166667, 143.00768229166667, 144.00768229166667, 145.00768229166667, 146.00768229166667, 147.00768229166667, 148.00768229166667, 149.00768229166667, 150.00768229166667, 151.00768229166667, 152.00768229166667, 153.00768229166667], "recent_frames_sha256": "6a6d4fd0637c3f531df2b05ffe96606776e799f175824ae228cdce143f0f6fd8", "num_recent_frames": 30, "tq": 718859.933330851, "t1": 718867.294727521, "ta": 718867.294727521, "te": 718867.447225894, "first_response_s": 7.361396669992246, "answer_total_s": 7.513895042939112, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_464_a174_q0", "video_id": 464, "time_stamp_s": 154, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "467a2a0668965b5104c079b525f51ef68ff66403e039640bc7d939047c5ae20a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Artworks on white walls include framed pieces with neon text (\"WE GUY'S LUXURY\") and abstract compositions with golden, spiky patterns.  \n- A large, square golden artwork with intricate, radial designs is displayed next to a smaller, circular golden piece with a dark background.  \n- The camera pans across the gallery, revealing multiple framed artworks and a few visitors observing the exhibits.\n[30-60s] - A framed artwork with a white, textured, flower-like pattern is displayed on the left wall.  \n- To its right, a dark-framed piece features golden, ornate, abstract designs against a black background.  \n- The camera pans left, revealing a third artwork with a central cartoonish face surrounded by intricate gold patterns, mounted on a dark wall.\n[60-90s] - A large black-and-white photograph of a couple embracing is displayed prominently on a wall, surrounded by other framed images.  \n- The wall features a collection of smaller black-and-white photographs arranged in a grid, with a larger central piece drawing attention.  \n- A person in a dark jacket walks past the display, briefly pausing to observe the artwork.\n[90-120s] - A woman in a brown coat stands near a wall of colorful abstract paintings, holding a phone.  \n- A man in a patterned shirt and cap walks past, gesturing toward artwork while holding a clipboard.  \n- A group of people, including a man in a blue shirt, are seated or standing near a table with art pieces displayed.\n[120-150s] - A woman in a patterned jacket stands near a wall of colorful abstract paintings, holding a phone.  \n- The camera pans right, revealing three digital displays showing vibrant, glowing artwork, including a blue-toned deer and a tree.  \n- Above the digital displays, small framed artworks of cartoonish faces are mounted on the wall.", "history_tokens": 405, "history_utf8_bytes": 1808, "recent_frame_times_s": [124.00768229166667, 125.00768229166667, 126.00768229166667, 127.00768229166667, 128.00768229166667, 129.00768229166667, 130.00768229166667, 131.00768229166667, 132.00768229166667, 133.00768229166667, 134.00768229166667, 135.00768229166667, 136.00768229166667, 137.00768229166667, 138.00768229166667, 139.00768229166667, 140.00768229166667, 141.00768229166667, 142.00768229166667, 143.00768229166667, 144.00768229166667, 145.00768229166667, 146.00768229166667, 147.00768229166667, 148.00768229166667, 149.00768229166667, 150.00768229166667, 151.00768229166667, 152.00768229166667, 153.00768229166667], "recent_frames_sha256": "6a6d4fd0637c3f531df2b05ffe96606776e799f175824ae228cdce143f0f6fd8", "num_recent_frames": 30, "tq": 718765.350972209, "t1": 718767.124132666, "ta": 718767.124132666, "te": 718767.165838117, "first_response_s": 1.7731604570290074, "answer_total_s": 1.8148659080034122, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 464, "content_group": "e06bb952d840dc0f551b2029bffd1dcc6f8d48ca19b3688d8914345cd7903c8b", "question": {"question_id": "sample_464_a175_q0", "video_id": 464, "video_path": "./videos/sample_464_real.mp4", "annotation_index": 175, "question_index": 0, "question": "What text is visible on the artwork of the muscular man holding a basket of lemons?", "options": ["A. \"Lemon Art BRAND\".", "B. \"Lemon Lad BRAND\".", "C. \"Lemon Grove BRAND\".", "D. \"Lemon Orchard BRAND\"."], "answer": "B", "time_stamp_s": 280, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_464_a175_q0", "video_id": 464, "time_stamp_s": 280, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "35c1a59351d92791b71fd95c2e7e7f583b4140bfd8f88411f1bddc42ff4eeb2b", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [250.00768229166667, 251.00768229166667, 252.00768229166667, 253.00768229166667, 254.00768229166667, 255.00768229166667, 256.00768229166664, 257.00768229166664, 258.00768229166664, 259.00768229166664, 260.00768229166664, 261.00768229166664, 262.00768229166664, 263.00768229166664, 264.00768229166664, 265.00768229166664, 266.00768229166664, 267.00768229166664, 268.00768229166664, 269.00768229166664, 270.00768229166664, 271.00768229166664, 272.00768229166664, 273.00768229166664, 274.00768229166664, 275.00768229166664, 276.00768229166664, 277.00768229166664, 278.00768229166664, 279.00768229166664], "recent_frames_sha256": "f93ea96b2f2a9b1623b2f9351d23e7427abf5a68cb713d05568aa8b4b4b73514", "num_recent_frames": 30, "tq": 718867.462384172, "t1": 718880.939216187, "ta": 718880.939216187, "te": 718880.977319751, "first_response_s": 13.476832014974207, "answer_total_s": 13.5149355790345, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_464_a175_q0", "video_id": 464, "time_stamp_s": 280, "ground_truth": "B", "raw_output": "B. \"Lemon Lad BRAND\".", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "edcc299c162705f1c16d6537bffaa8d687256b9e52eef9ae877a83ec11684a44", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Artworks on white walls include framed pieces with neon text (\"WE GUY'S LUXURY\") and abstract compositions with golden, spiky patterns.  \n- A large, square golden artwork with intricate, radial designs is displayed next to a smaller, circular golden piece with a dark background.  \n- The camera pans across the gallery, revealing multiple framed artworks and a few visitors observing the exhibits.\n[30-60s] - A framed artwork with a white, textured, flower-like pattern is displayed on the left wall.  \n- To its right, a dark-framed piece features golden, ornate, abstract designs against a black background.  \n- The camera pans left, revealing a third artwork with a central cartoonish face surrounded by intricate gold patterns, mounted on a dark wall.\n[60-90s] - A large black-and-white photograph of a couple embracing is displayed prominently on a wall, surrounded by other framed images.  \n- The wall features a collection of smaller black-and-white photographs arranged in a grid, with a larger central piece drawing attention.  \n- A person in a dark jacket walks past the display, briefly pausing to observe the artwork.\n[90-120s] - A woman in a brown coat stands near a wall of colorful abstract paintings, holding a phone.  \n- A man in a patterned shirt and cap walks past, gesturing toward artwork while holding a clipboard.  \n- A group of people, including a man in a blue shirt, are seated or standing near a table with art pieces displayed.\n[120-150s] - A woman in a patterned jacket stands near a wall of colorful abstract paintings, holding a phone.  \n- The camera pans right, revealing three digital displays showing vibrant, glowing artwork, including a blue-toned deer and a tree.  \n- Above the digital displays, small framed artworks of cartoonish faces are mounted on the wall.\n[150-180s] - A man in a black shirt is seen crouching near a colorful abstract painting on the floor, appearing to interact with or examine it.  \n- A woman in a patterned top stands nearby, observing the scene, while other visitors move around the gallery space.  \n- The wall displays multiple framed artworks, including a large blue canvas labeled \"Liu Dadi\" and a series of small, colorful rectangular pieces arranged in a row.\n[180-210s] - A blue textured artwork with faint outlines is mounted on a white wall, labeled \"Liu Dadi\" above it.\n- To the left, a dark gray abstract painting with a textured surface is visible, adjacent to a red textured panel.\n- A person in a dark shirt and light-colored pants walks past the artworks, partially obscuring the view.\n[210-240s] - Two large red textured canvases are displayed side-by-side on a white wall, with a crowd of people observing them.  \n- The camera pans right, revealing a blue abstract painting and a group of visitors gathered near a table with a floral arrangement.  \n- A wall-mounted shelf filled with colorful canned goods is visible, with visitors examining the items and reading accompanying text panels.\n[240-270s] - A wall displays circular plates with blue text, including \"KENT\" and \"KENTUCKY,\" arranged in a grid pattern.  \n- Visitors walk past shelves stocked with colorful canned goods, some holding bags or looking at items.  \n- A large abstract painting with bold red, yellow, and green hues hangs on a white wall, framed in black, with people viewing it.", "history_tokens": 759, "history_utf8_bytes": 3339, "recent_frame_times_s": [250.00768229166667, 251.00768229166667, 252.00768229166667, 253.00768229166667, 254.00768229166667, 255.00768229166667, 256.00768229166664, 257.00768229166664, 258.00768229166664, 259.00768229166664, 260.00768229166664, 261.00768229166664, 262.00768229166664, 263.00768229166664, 264.00768229166664, 265.00768229166664, 266.00768229166664, 267.00768229166664, 268.00768229166664, 269.00768229166664, 270.00768229166664, 271.00768229166664, 272.00768229166664, 273.00768229166664, 274.00768229166664, 275.00768229166664, 276.00768229166664, 277.00768229166664, 278.00768229166664, 279.00768229166664], "recent_frames_sha256": "f93ea96b2f2a9b1623b2f9351d23e7427abf5a68cb713d05568aa8b4b4b73514", "num_recent_frames": 30, "tq": 718793.497504638, "t1": 718799.448953849, "ta": 718799.448953849, "te": 718799.748071293, "first_response_s": 5.951449210988358, "answer_total_s": 6.250566654955037, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 464, "content_group": "e06bb952d840dc0f551b2029bffd1dcc6f8d48ca19b3688d8914345cd7903c8b", "question": {"question_id": "sample_464_a176_q0", "video_id": 464, "video_path": "./videos/sample_464_real.mp4", "annotation_index": 176, "question_index": 0, "question": "What is depicted in the top left painting on the white wall?", "options": ["A. A vivid sunset over a hilly landscape.", "B. A stormy scene with lightning over a dark road.", "C. A monochromatic, foggy landscape with twisted trees.", "D. An abstract painting with splashes of colors."], "answer": "B", "time_stamp_s": 420, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_464_a176_q0", "video_id": 464, "time_stamp_s": 420, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "139894341a96e6f07360a74a3b0d639e6641b57259c4677b57f4970b808ad8c8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [390.00768229166664, 391.00768229166664, 392.00768229166664, 393.00768229166664, 394.00768229166664, 395.00768229166664, 396.00768229166664, 397.00768229166664, 398.00768229166664, 399.00768229166664, 400.00768229166664, 401.00768229166664, 402.00768229166664, 403.00768229166664, 404.00768229166664, 405.00768229166664, 406.00768229166664, 407.00768229166664, 408.00768229166664, 409.00768229166664, 410.00768229166664, 411.00768229166664, 412.00768229166664, 413.00768229166664, 414.00768229166664, 415.00768229166664, 416.00768229166664, 417.00768229166664, 418.00768229166664, 419.00768229166664], "recent_frames_sha256": "5e9659b40dae55d9fd99c18e8d1770bc6208ec00d34ea769596729b6bfa2094f", "num_recent_frames": 30, "tq": 718880.987560851, "t1": 718893.996887749, "ta": 718893.996887749, "te": 718894.036648972, "first_response_s": 13.009326897910796, "answer_total_s": 13.049088120926172, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_464_a176_q0", "video_id": 464, "time_stamp_s": 420, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2cd21a5cda80163c8d2a498d973607cc0e734191c7d5c022c878c8a547a79a8c", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A woman in a brown coat stands near a wall of colorful abstract paintings, holding a phone.  \n- A man in a patterned shirt and cap walks past, gesturing toward artwork while holding a clipboard.  \n- A group of people, including a man in a blue shirt, are seated or standing near a table with art pieces displayed.\n[120-150s] - A woman in a patterned jacket stands near a wall of colorful abstract paintings, holding a phone.  \n- The camera pans right, revealing three digital displays showing vibrant, glowing artwork, including a blue-toned deer and a tree.  \n- Above the digital displays, small framed artworks of cartoonish faces are mounted on the wall.\n[150-180s] - A man in a black shirt is seen crouching near a colorful abstract painting on the floor, appearing to interact with or examine it.  \n- A woman in a patterned top stands nearby, observing the scene, while other visitors move around the gallery space.  \n- The wall displays multiple framed artworks, including a large blue canvas labeled \"Liu Dadi\" and a series of small, colorful rectangular pieces arranged in a row.\n[180-210s] - A blue textured artwork with faint outlines is mounted on a white wall, labeled \"Liu Dadi\" above it.\n- To the left, a dark gray abstract painting with a textured surface is visible, adjacent to a red textured panel.\n- A person in a dark shirt and light-colored pants walks past the artworks, partially obscuring the view.\n[210-240s] - Two large red textured canvases are displayed side-by-side on a white wall, with a crowd of people observing them.  \n- The camera pans right, revealing a blue abstract painting and a group of visitors gathered near a table with a floral arrangement.  \n- A wall-mounted shelf filled with colorful canned goods is visible, with visitors examining the items and reading accompanying text panels.\n[240-270s] - A wall displays circular plates with blue text, including \"KENT\" and \"KENTUCKY,\" arranged in a grid pattern.  \n- Visitors walk past shelves stocked with colorful canned goods, some holding bags or looking at items.  \n- A large abstract painting with bold red, yellow, and green hues hangs on a white wall, framed in black, with people viewing it.\n[270-300s] - A framed painting of a vintage wooden car parked in front of a red building labeled \"TROPICAL BANANA MOTEL\" is displayed on the left wall.  \n- To its right, a poster for \"Hollywood's Whimsical Fountain\" with palm trees and a fountain is mounted above a \"Lemon Lad\" sign featuring a man holding a lemon.  \n- A dark, abstract sculpture rests on a white pedestal near the center, with a blue plastic chair mounted on a shelf above it.\n[300-330s] - A black chair is positioned near a tall, vertically oriented, intricately carved wooden sculpture.  \n- A small, dark-colored bust sculpture rests on a black pedestal, flanked by two large, colorful paintings.  \n- The camera pans right, revealing a vibrant, abstract portrait of a woman in a red outfit, mounted on the wall.\n[330-360s] - A black sculpture of a seated figure is displayed on a pedestal, positioned between two large paintings.  \n- The painting to the right depicts three women in athletic wear against a red background, while the one to the left shows a man’s face with vibrant, layered colors and text.  \n- The camera pans right, revealing a golf-themed painting with a golfer mid-swing, followed by a series of abstract and figurative artworks on adjacent walls.\n[360-390s] - Abstract painting with red, yellow, and blue geometric shapes hangs on a white wall, partially obscured by a person’s arm.  \n- Three small, colorful, box-like sculptures are mounted vertically on the wall, each with a descriptive plaque.  \n- A large, framed landscape painting depicting trees and figures is displayed on the wall, with two ceramic vases and a conical object placed on a wooden table in front.\n[390-420s] - A large, colorful abstract painting with zebra-like patterns dominates the right wall, positioned above a dark, textured piece.  \n- To the left, a vertical arrangement of carved wooden figures stands against the wall, with a hanging woven textile above them.  \n- The camera pans right, revealing more abstract and landscape paintings, including a striking black-and-white storm scene and a warm-toned sunset piece.", "history_tokens": 990, "history_utf8_bytes": 4293, "recent_frame_times_s": [390.00768229166664, 391.00768229166664, 392.00768229166664, 393.00768229166664, 394.00768229166664, 395.00768229166664, 396.00768229166664, 397.00768229166664, 398.00768229166664, 399.00768229166664, 400.00768229166664, 401.00768229166664, 402.00768229166664, 403.00768229166664, 404.00768229166664, 405.00768229166664, 406.00768229166664, 407.00768229166664, 408.00768229166664, 409.00768229166664, 410.00768229166664, 411.00768229166664, 412.00768229166664, 413.00768229166664, 414.00768229166664, 415.00768229166664, 416.00768229166664, 417.00768229166664, 418.00768229166664, 419.00768229166664], "recent_frames_sha256": "5e9659b40dae55d9fd99c18e8d1770bc6208ec00d34ea769596729b6bfa2094f", "num_recent_frames": 30, "tq": 718843.396247246, "t1": 718844.455427858, "ta": 718844.455427858, "te": 718844.894736474, "first_response_s": 1.059180612093769, "answer_total_s": 1.4984892280772328, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 465, "content_group": "4abc48c4dd6362f263fed00dfd38ace2715834721ece5c6fad485bb594cd3257", "question": {"question_id": "sample_465_a1584_q0", "video_id": 465, "video_path": "./videos/sample_465_real.mp4", "annotation_index": 1584, "question_index": 0, "question": "Where are the artist labels located in relation to the paintings?", "options": ["A. Above the paintings.", "B. Next to the paintings.", "C. Below the paintings.", "D. On the paintings."], "answer": "A", "time_stamp_s": 9, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_465_a1584_q0", "video_id": 465, "time_stamp_s": 9, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "64a7d98b3cdbfea195a8fcad69ba49157e5de3fffcec1dcb2e64a66dd1b1927e", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0490234375, 1.0156901041666666, 2.0156901041666666, 3.0156901041666666, 4.015690104166667, 5.015690104166667, 6.015690104166667, 7.015690104166667, 8.015690104166667], "recent_frames_sha256": "6af3f56ad45f1a3ccfeff27ec5dd1ad80d0239e4610bcda624426734c119fe67", "num_recent_frames": 9, "tq": 719293.497090797, "t1": 719300.345462335, "ta": 719300.345462335, "te": 719300.388153907, "first_response_s": 6.848371537984349, "answer_total_s": 6.891063109971583, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_465_a1584_q0", "video_id": 465, "time_stamp_s": 9, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "156c1b4a3bd95d2559cf3102e6637b39cb62adc5a0ff7575e315b4dfba47dc7c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0490234375, 1.0156901041666666, 2.0156901041666666, 3.0156901041666666, 4.015690104166667, 5.015690104166667, 6.015690104166667, 7.015690104166667, 8.015690104166667], "recent_frames_sha256": "6af3f56ad45f1a3ccfeff27ec5dd1ad80d0239e4610bcda624426734c119fe67", "num_recent_frames": 9, "tq": 719111.574033039, "t1": 719123.640863854, "ta": 719123.640863854, "te": 719123.682525952, "first_response_s": 12.066830814932473, "answer_total_s": 12.108492912957445, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 465, "content_group": "4abc48c4dd6362f263fed00dfd38ace2715834721ece5c6fad485bb594cd3257", "question": {"question_id": "sample_465_a1584_q1", "video_id": 465, "video_path": "./videos/sample_465_real.mp4", "annotation_index": 1584, "question_index": 1, "question": "Which of the following options best describes these artworks?", "options": ["A. A mix of abstract paintings with vibrant colors and sculptures on pedestals.", "B. A series of black and white photographs.", "C. A collection of modern furniture designs.", "D. A display of classical paintings with gold frames."], "answer": "A", "time_stamp_s": 20, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_465_a1584_q1", "video_id": 465, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "64d5629c0a740be9907beffe58d3ece174d7cfc2dd7978098936c794aab9f2e8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0490234375, 1.0156901041666666, 2.0156901041666666, 3.0156901041666666, 4.015690104166667, 5.015690104166667, 6.015690104166667, 7.015690104166667, 8.015690104166667, 9.015690104166667, 10.015690104166667, 11.015690104166667, 12.015690104166667, 13.015690104166667, 14.015690104166667, 15.015690104166667, 16.015690104166666, 17.015690104166666, 18.015690104166666, 19.015690104166666], "recent_frames_sha256": "7eb3b88674cb3dfaf085d5dfdd7360de4e2c8cfb6e0ff0c73b5e1176258fdd26", "num_recent_frames": 20, "tq": 719300.40369138, "t1": 719310.866501309, "ta": 719310.866501309, "te": 719310.904161648, "first_response_s": 10.462809928925708, "answer_total_s": 10.500470267958008, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_465_a1584_q1", "video_id": 465, "time_stamp_s": 20, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e156be6a63878a64126229b6191d99e083b8b11a08ef76462d22cce5b18a2c7c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0490234375, 1.0156901041666666, 2.0156901041666666, 3.0156901041666666, 4.015690104166667, 5.015690104166667, 6.015690104166667, 7.015690104166667, 8.015690104166667, 9.015690104166667, 10.015690104166667, 11.015690104166667, 12.015690104166667, 13.015690104166667, 14.015690104166667, 15.015690104166667, 16.015690104166666, 17.015690104166666, 18.015690104166666, 19.015690104166666], "recent_frames_sha256": "7eb3b88674cb3dfaf085d5dfdd7360de4e2c8cfb6e0ff0c73b5e1176258fdd26", "num_recent_frames": 20, "tq": 719123.703660325, "t1": 719131.334933819, "ta": 719131.334933819, "te": 719131.372820489, "first_response_s": 7.6312734939856455, "answer_total_s": 7.669160163961351, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 465, "content_group": "4abc48c4dd6362f263fed00dfd38ace2715834721ece5c6fad485bb594cd3257", "question": {"question_id": "sample_465_a1585_q1", "video_id": 465, "video_path": "./videos/sample_465_real.mp4", "annotation_index": 1585, "question_index": 1, "question": "Why are there reflections on the surface of the tall painting?", "options": ["A. Because it has a glossy finish.", "B. Because it is covered in glass.", "C. Because it is illuminated by several spotlights.", "D. Because the camera is using a flash."], "answer": "C", "time_stamp_s": 484, "task_type": "Causal Reasoning", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_465_a1585_q1", "video_id": 465, "time_stamp_s": 484, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "9eabcdcdc3723bf2fe9041d7eae0d33431e3d09c57ee9f967e92d0e095ddb560", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [454.01569010416665, 455.01569010416665, 456.01569010416665, 457.01569010416665, 458.01569010416665, 459.01569010416665, 460.01569010416665, 461.01569010416665, 462.01569010416665, 463.01569010416665, 464.01569010416665, 465.01569010416665, 466.01569010416665, 467.01569010416665, 468.01569010416665, 469.01569010416665, 470.01569010416665, 471.01569010416665, 472.01569010416665, 473.01569010416665, 474.01569010416665, 475.01569010416665, 476.01569010416665, 477.01569010416665, 478.01569010416665, 479.01569010416665, 480.01569010416665, 481.01569010416665, 482.01569010416665, 483.01569010416665], "recent_frames_sha256": "11f5a27b760772aac8b11793f9ddd292ef0307c82d2ff2168a0685d9cc0f91fd", "num_recent_frames": 30, "tq": 719310.918414353, "t1": 719318.492331661, "ta": 719318.492331661, "te": 719318.529739687, "first_response_s": 7.573917308007367, "answer_total_s": 7.611325333942659, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_465_a1585_q1", "video_id": 465, "time_stamp_s": 484, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5b0e0e684eeff833ca69ce560947dd7a84163dfb846e1be68de577b111f92d8f", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Red-toned abstract paintings dominate the left wall, with one featuring a reclining figure.  \n- A cartoonish character on a blue scooter is centrally displayed, flanked by red and black artworks.  \n- A visitor in a red jacket walks past, partially visible near the right edge of the frame.\n[180-210s] - A woman in a dark coat walks past colorful, framed artworks on a white wall.  \n- The camera pans to reveal three abstract paintings with floral motifs, each in different color backgrounds (blue, black, yellow).  \n- A small table with a chair is positioned near the paintings, with a person seated at it.\n[210-240s] - A man in a white shirt walks past blue abstract paintings, pausing to observe a large blue seascape piece.  \n- A large black canvas with colorful geometric shapes is displayed prominently on a white wall.  \n- Visitors move through the gallery, some stopping to view artworks, including a blue grid painting and a sculpture of stacked figures.\n[240-270s] - A large, colorful abstract sculpture with layered, organic forms is mounted on a white wall, positioned to the left of two smaller sculptures.  \n- To the right, two smaller sculptures—one with a green figure atop a globe-like base and another with stacked, rounded forms—stand on white pedestals.  \n- A visitor walks past the sculptures, moving from right to left across the frame, while other attendees are visible in the background.\n[270-300s] - A large red canvas with a white bowl centered on it is displayed on a white wall.  \n- A sign reading \"MORRISON GALLERY 813/912\" is mounted on the ceiling above the gallery space.  \n- A visitor in a red shirt walks past the artworks, moving from left to right along the gallery corridor.\n[300-330s] - A large painting of a canal scene with buildings and trees is displayed on the wall, featuring a prominent dome structure and floating lanterns.  \n- To the right, smaller paintings depict Parisian scenes with the Eiffel Tower and other landmarks, each mounted on the wall with handles.  \n- The camera pans left, revealing a yellow geometric sculpture and a series of pink and yellow cube-like sculptures arranged in a line on the wall.\n[330-360s] - A man in a beige jacket walks past a wall of geometric, pastel-colored sculptures.  \n- A large, vibrant orange abstract painting is displayed next to a portrait with fragmented, grid-like features.  \n- A group of visitors is seen in the background, moving through the gallery space.\n[360-390s] - A bald man in a brown jacket walks past a series of abstract paintings on a white wall.  \n- The camera pans left, revealing three large abstract paintings with varied color palettes (gray, beige, and white) displayed side by side.  \n- The camera continues panning left, showing a large green and white abstract painting above two smaller framed pieces on the floor.\n[390-420s] - A large blue panel with horizontal seams is mounted on a white wall, adjacent to a framed abstract artwork with orange and brown gradients.  \n- A shark painting titled \"PIGMENT GALLERY\" is displayed on another wall, featuring two sharks with orange splatters and a price tag of $809,906.  \n- People are seen walking through the gallery space, with one individual in a wheelchair passing by the blue panel.\n[420-450s] - A large, colorful abstract painting depicting figures on horses is mounted on a white wall, with a \"MOSAIC\" sign above it.  \n- To its right, a black-and-white photograph of a seated nude figure is displayed, with visitors walking past.  \n- The camera pans right, revealing a gray wall with a small, colorful painting of a tree and birds, and people moving through the gallery space.\n[450-480s] - A large painting depicting a rainy forest road with water droplets on the glass surface is displayed on a white wall.  \n- Adjacent to it, a vibrant abstract painting of a tree with yellow and white blossoms and birds in flight is mounted on a white wall.  \n- A colorful, stylized still life painting featuring teapots, vases, and fruit is positioned against a green wall, with a person partially visible in the background.", "history_tokens": 955, "history_utf8_bytes": 4102, "recent_frame_times_s": [454.01569010416665, 455.01569010416665, 456.01569010416665, 457.01569010416665, 458.01569010416665, 459.01569010416665, 460.01569010416665, 461.01569010416665, 462.01569010416665, 463.01569010416665, 464.01569010416665, 465.01569010416665, 466.01569010416665, 467.01569010416665, 468.01569010416665, 469.01569010416665, 470.01569010416665, 471.01569010416665, 472.01569010416665, 473.01569010416665, 474.01569010416665, 475.01569010416665, 476.01569010416665, 477.01569010416665, 478.01569010416665, 479.01569010416665, 480.01569010416665, 481.01569010416665, 482.01569010416665, 483.01569010416665], "recent_frames_sha256": "11f5a27b760772aac8b11793f9ddd292ef0307c82d2ff2168a0685d9cc0f91fd", "num_recent_frames": 30, "tq": 719267.063142011, "t1": 719272.744403054, "ta": 719272.744403054, "te": 719272.782827818, "first_response_s": 5.681261043064296, "answer_total_s": 5.719685807009228, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 465, "content_group": "4abc48c4dd6362f263fed00dfd38ace2715834721ece5c6fad485bb594cd3257", "question": {"question_id": "sample_465_a1585_q0", "video_id": 465, "video_path": "./videos/sample_465_real.mp4", "annotation_index": 1585, "question_index": 0, "question": "What is prominently featured in this tall, vertical painting?", "options": ["A. Characters in vibrant outfits.", "B. A dark blue center with white edges.", "C. Abstract shapes and vibrant colors.", "D. Geometric and floral patterns."], "answer": "B", "time_stamp_s": 487, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_465_a1585_q0", "video_id": 465, "time_stamp_s": 487, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a0c287e49241408bb733ddf03701a03edb9b5c75749c4da5b6d85f33bebcb408", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [457.01569010416665, 458.01569010416665, 459.01569010416665, 460.01569010416665, 461.01569010416665, 462.01569010416665, 463.01569010416665, 464.01569010416665, 465.01569010416665, 466.01569010416665, 467.01569010416665, 468.01569010416665, 469.01569010416665, 470.01569010416665, 471.01569010416665, 472.01569010416665, 473.01569010416665, 474.01569010416665, 475.01569010416665, 476.01569010416665, 477.01569010416665, 478.01569010416665, 479.01569010416665, 480.01569010416665, 481.01569010416665, 482.01569010416665, 483.01569010416665, 484.01569010416665, 485.01569010416665, 486.01569010416665], "recent_frames_sha256": "fe31e9fd246524d7849c28238747c2811166d78e055a79304b7911d44b6f4a28", "num_recent_frames": 30, "tq": 719318.545807892, "t1": 719331.602815231, "ta": 719331.602815231, "te": 719331.640132362, "first_response_s": 13.057007338968106, "answer_total_s": 13.094324470032007, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_465_a1585_q0", "video_id": 465, "time_stamp_s": 487, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4df510c9ffec70942b37c81530f04ca3531a07d14b1b6a4880cf3c6d6ee1bbd5", "condition_order": ["notes", "recent"], "memory": "[150-180s] - Red-toned abstract paintings dominate the left wall, with one featuring a reclining figure.  \n- A cartoonish character on a blue scooter is centrally displayed, flanked by red and black artworks.  \n- A visitor in a red jacket walks past, partially visible near the right edge of the frame.\n[180-210s] - A woman in a dark coat walks past colorful, framed artworks on a white wall.  \n- The camera pans to reveal three abstract paintings with floral motifs, each in different color backgrounds (blue, black, yellow).  \n- A small table with a chair is positioned near the paintings, with a person seated at it.\n[210-240s] - A man in a white shirt walks past blue abstract paintings, pausing to observe a large blue seascape piece.  \n- A large black canvas with colorful geometric shapes is displayed prominently on a white wall.  \n- Visitors move through the gallery, some stopping to view artworks, including a blue grid painting and a sculpture of stacked figures.\n[240-270s] - A large, colorful abstract sculpture with layered, organic forms is mounted on a white wall, positioned to the left of two smaller sculptures.  \n- To the right, two smaller sculptures—one with a green figure atop a globe-like base and another with stacked, rounded forms—stand on white pedestals.  \n- A visitor walks past the sculptures, moving from right to left across the frame, while other attendees are visible in the background.\n[270-300s] - A large red canvas with a white bowl centered on it is displayed on a white wall.  \n- A sign reading \"MORRISON GALLERY 813/912\" is mounted on the ceiling above the gallery space.  \n- A visitor in a red shirt walks past the artworks, moving from left to right along the gallery corridor.\n[300-330s] - A large painting of a canal scene with buildings and trees is displayed on the wall, featuring a prominent dome structure and floating lanterns.  \n- To the right, smaller paintings depict Parisian scenes with the Eiffel Tower and other landmarks, each mounted on the wall with handles.  \n- The camera pans left, revealing a yellow geometric sculpture and a series of pink and yellow cube-like sculptures arranged in a line on the wall.\n[330-360s] - A man in a beige jacket walks past a wall of geometric, pastel-colored sculptures.  \n- A large, vibrant orange abstract painting is displayed next to a portrait with fragmented, grid-like features.  \n- A group of visitors is seen in the background, moving through the gallery space.\n[360-390s] - A bald man in a brown jacket walks past a series of abstract paintings on a white wall.  \n- The camera pans left, revealing three large abstract paintings with varied color palettes (gray, beige, and white) displayed side by side.  \n- The camera continues panning left, showing a large green and white abstract painting above two smaller framed pieces on the floor.\n[390-420s] - A large blue panel with horizontal seams is mounted on a white wall, adjacent to a framed abstract artwork with orange and brown gradients.  \n- A shark painting titled \"PIGMENT GALLERY\" is displayed on another wall, featuring two sharks with orange splatters and a price tag of $809,906.  \n- People are seen walking through the gallery space, with one individual in a wheelchair passing by the blue panel.\n[420-450s] - A large, colorful abstract painting depicting figures on horses is mounted on a white wall, with a \"MOSAIC\" sign above it.  \n- To its right, a black-and-white photograph of a seated nude figure is displayed, with visitors walking past.  \n- The camera pans right, revealing a gray wall with a small, colorful painting of a tree and birds, and people moving through the gallery space.\n[450-480s] - A large painting depicting a rainy forest road with water droplets on the glass surface is displayed on a white wall.  \n- Adjacent to it, a vibrant abstract painting of a tree with yellow and white blossoms and birds in flight is mounted on a white wall.  \n- A colorful, stylized still life painting featuring teapots, vases, and fruit is positioned against a green wall, with a person partially visible in the background.", "history_tokens": 955, "history_utf8_bytes": 4102, "recent_frame_times_s": [457.01569010416665, 458.01569010416665, 459.01569010416665, 460.01569010416665, 461.01569010416665, 462.01569010416665, 463.01569010416665, 464.01569010416665, 465.01569010416665, 466.01569010416665, 467.01569010416665, 468.01569010416665, 469.01569010416665, 470.01569010416665, 471.01569010416665, 472.01569010416665, 473.01569010416665, 474.01569010416665, 475.01569010416665, 476.01569010416665, 477.01569010416665, 478.01569010416665, 479.01569010416665, 480.01569010416665, 481.01569010416665, 482.01569010416665, 483.01569010416665, 484.01569010416665, 485.01569010416665, 486.01569010416665], "recent_frames_sha256": "fe31e9fd246524d7849c28238747c2811166d78e055a79304b7911d44b6f4a28", "num_recent_frames": 30, "tq": 719272.801672621, "t1": 719286.018335262, "ta": 719286.018335262, "te": 719286.327300633, "first_response_s": 13.216662640916184, "answer_total_s": 13.52562801190652, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 465, "content_group": "4abc48c4dd6362f263fed00dfd38ace2715834721ece5c6fad485bb594cd3257", "question": {"question_id": "sample_465_a1585_q2", "video_id": 465, "video_path": "./videos/sample_465_real.mp4", "annotation_index": 1585, "question_index": 2, "question": "What is being displayed on the video now?", "options": ["A. A bookshelf filled with books.", "B. A painting depicting a bookshelf.", "C. A painting with many trees.", "D. A painting with many people in it."], "answer": "B", "time_stamp_s": 532, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_465_a1585_q2", "video_id": 465, "time_stamp_s": 532, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b2704ff2953e3c215eb193db5afeb9eae6a920de28c6d16481489f4befe9f497", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [502.01569010416665, 503.01569010416665, 504.01569010416665, 505.01569010416665, 506.01569010416665, 507.01569010416665, 508.01569010416665, 509.01569010416665, 510.01569010416665, 511.01569010416665, 512.0156901041667, 513.0156901041667, 514.0156901041667, 515.0156901041667, 516.0156901041667, 517.0156901041667, 518.0156901041667, 519.0156901041667, 520.0156901041667, 521.0156901041667, 522.0156901041667, 523.0156901041667, 524.0156901041667, 525.0156901041667, 526.0156901041667, 527.0156901041667, 528.0156901041667, 529.0156901041667, 530.0156901041667, 531.0156901041667], "recent_frames_sha256": "ab0e431e23e02a882a4d85c9ce8deb1b2bea381731acb31de17b63cbf8bf6c24", "num_recent_frames": 30, "tq": 719331.650317776, "t1": 719342.628996058, "ta": 719342.628996058, "te": 719342.851203288, "first_response_s": 10.978678282001056, "answer_total_s": 11.200885511934757, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_465_a1585_q2", "video_id": 465, "time_stamp_s": 532, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b444d4551ff04b9df0892668c12cba549d532858feb091626354191ddfea41d9", "condition_order": ["notes", "recent"], "memory": "[180-210s] - A woman in a dark coat walks past colorful, framed artworks on a white wall.  \n- The camera pans to reveal three abstract paintings with floral motifs, each in different color backgrounds (blue, black, yellow).  \n- A small table with a chair is positioned near the paintings, with a person seated at it.\n[210-240s] - A man in a white shirt walks past blue abstract paintings, pausing to observe a large blue seascape piece.  \n- A large black canvas with colorful geometric shapes is displayed prominently on a white wall.  \n- Visitors move through the gallery, some stopping to view artworks, including a blue grid painting and a sculpture of stacked figures.\n[240-270s] - A large, colorful abstract sculpture with layered, organic forms is mounted on a white wall, positioned to the left of two smaller sculptures.  \n- To the right, two smaller sculptures—one with a green figure atop a globe-like base and another with stacked, rounded forms—stand on white pedestals.  \n- A visitor walks past the sculptures, moving from right to left across the frame, while other attendees are visible in the background.\n[270-300s] - A large red canvas with a white bowl centered on it is displayed on a white wall.  \n- A sign reading \"MORRISON GALLERY 813/912\" is mounted on the ceiling above the gallery space.  \n- A visitor in a red shirt walks past the artworks, moving from left to right along the gallery corridor.\n[300-330s] - A large painting of a canal scene with buildings and trees is displayed on the wall, featuring a prominent dome structure and floating lanterns.  \n- To the right, smaller paintings depict Parisian scenes with the Eiffel Tower and other landmarks, each mounted on the wall with handles.  \n- The camera pans left, revealing a yellow geometric sculpture and a series of pink and yellow cube-like sculptures arranged in a line on the wall.\n[330-360s] - A man in a beige jacket walks past a wall of geometric, pastel-colored sculptures.  \n- A large, vibrant orange abstract painting is displayed next to a portrait with fragmented, grid-like features.  \n- A group of visitors is seen in the background, moving through the gallery space.\n[360-390s] - A bald man in a brown jacket walks past a series of abstract paintings on a white wall.  \n- The camera pans left, revealing three large abstract paintings with varied color palettes (gray, beige, and white) displayed side by side.  \n- The camera continues panning left, showing a large green and white abstract painting above two smaller framed pieces on the floor.\n[390-420s] - A large blue panel with horizontal seams is mounted on a white wall, adjacent to a framed abstract artwork with orange and brown gradients.  \n- A shark painting titled \"PIGMENT GALLERY\" is displayed on another wall, featuring two sharks with orange splatters and a price tag of $809,906.  \n- People are seen walking through the gallery space, with one individual in a wheelchair passing by the blue panel.\n[420-450s] - A large, colorful abstract painting depicting figures on horses is mounted on a white wall, with a \"MOSAIC\" sign above it.  \n- To its right, a black-and-white photograph of a seated nude figure is displayed, with visitors walking past.  \n- The camera pans right, revealing a gray wall with a small, colorful painting of a tree and birds, and people moving through the gallery space.\n[450-480s] - A large painting depicting a rainy forest road with water droplets on the glass surface is displayed on a white wall.  \n- Adjacent to it, a vibrant abstract painting of a tree with yellow and white blossoms and birds in flight is mounted on a white wall.  \n- A colorful, stylized still life painting featuring teapots, vases, and fruit is positioned against a green wall, with a person partially visible in the background.\n[480-510s] - A tall, narrow framed artwork depicting a landscape with a dark sky and golden field is mounted on a white wall, partially obscured by a white curtain to its right.  \n- Several smaller framed artworks are stacked on the floor in front of the tall piece, including a yellow-framed portrait and a black-and-white image.  \n- A woman in a black top and patterned pants points to a large, colorful, vertically striped artwork on the wall, while two other people stand nearby observing.", "history_tokens": 992, "history_utf8_bytes": 4293, "recent_frame_times_s": [502.01569010416665, 503.01569010416665, 504.01569010416665, 505.01569010416665, 506.01569010416665, 507.01569010416665, 508.01569010416665, 509.01569010416665, 510.01569010416665, 511.01569010416665, 512.0156901041667, 513.0156901041667, 514.0156901041667, 515.0156901041667, 516.0156901041667, 517.0156901041667, 518.0156901041667, 519.0156901041667, 520.0156901041667, 521.0156901041667, 522.0156901041667, 523.0156901041667, 524.0156901041667, 525.0156901041667, 526.0156901041667, 527.0156901041667, 528.0156901041667, 529.0156901041667, 530.0156901041667, 531.0156901041667], "recent_frames_sha256": "ab0e431e23e02a882a4d85c9ce8deb1b2bea381731acb31de17b63cbf8bf6c24", "num_recent_frames": 30, "tq": 719291.978564706, "t1": 719293.427592353, "ta": 719293.427592353, "te": 719293.46563426, "first_response_s": 1.4490276469150558, "answer_total_s": 1.4870695539284497, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 466, "content_group": "deb5d93367273bc9234e4a41ed5fbff9a93069a99b1ef3ecc8217faf1e2b31be", "question": {"question_id": "sample_466_a265_q0", "video_id": 466, "video_path": "./videos/sample_466_real.mp4", "annotation_index": 265, "question_index": 0, "question": "What object is the blue gorilla holding?", "options": ["A. A banana.", "B. A small sculpture.", "C. A book.", "D. A cylindrical object labeled \"USA\"."], "answer": "D", "time_stamp_s": 8, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_466_a265_q0", "video_id": 466, "time_stamp_s": 8, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "606c550254f9377e15526d06de20663e9538736244a93704561122bf03c29d5d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.052018229166666666, 1.0186848958333334, 2.018684895833333, 3.018684895833333, 4.018684895833333, 5.018684895833333, 6.018684895833333, 7.018684895833333], "recent_frames_sha256": "b4c4ec990490375c9df9dbc85d50b15fa7bd7945afd61ff50ead34ad194dd96e", "num_recent_frames": 8, "tq": 716199.764847049, "t1": 716207.413469216, "ta": 716207.413469216, "te": 716207.450836338, "first_response_s": 7.648622166947462, "answer_total_s": 7.685989288962446, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_466_a265_q0", "video_id": 466, "time_stamp_s": 8, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "de711b24ea6eb3f5e8989125467b7b3c4c2243d42638a07b788b6b729cff2dcc", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.052018229166666666, 1.0186848958333334, 2.018684895833333, 3.018684895833333, 4.018684895833333, 5.018684895833333, 6.018684895833333, 7.018684895833333], "recent_frames_sha256": "b4c4ec990490375c9df9dbc85d50b15fa7bd7945afd61ff50ead34ad194dd96e", "num_recent_frames": 8, "tq": 716237.738935416, "t1": 716238.228689679, "ta": 716238.228689679, "te": 716238.266344152, "first_response_s": 0.48975426296237856, "answer_total_s": 0.5274087360594422, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 466, "content_group": "deb5d93367273bc9234e4a41ed5fbff9a93069a99b1ef3ecc8217faf1e2b31be", "question": {"question_id": "sample_466_a266_q0", "video_id": 466, "video_path": "./videos/sample_466_real.mp4", "annotation_index": 266, "question_index": 0, "question": "What is the title of the text written on this wall?", "options": ["A. \"RAINTYPE LORENZO MARINI\".", "B. \"SUNSHINE\".", "C. \"LIFE IN COLOR\".", "D. \"NIGHT LIGHTS\"."], "answer": "A", "time_stamp_s": 164, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_466_a266_q0", "video_id": 466, "time_stamp_s": 164, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "078fbe1a81604e06fc5179afa2dc11765899a7deeb9e202df0218b2cb9633683", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [134.01868489583333, 135.01868489583333, 136.01868489583333, 137.01868489583333, 138.01868489583333, 139.01868489583333, 140.01868489583333, 141.01868489583333, 142.01868489583333, 143.01868489583333, 144.01868489583333, 145.01868489583333, 146.01868489583333, 147.01868489583333, 148.01868489583333, 149.01868489583333, 150.01868489583333, 151.01868489583333, 152.01868489583333, 153.01868489583333, 154.01868489583333, 155.01868489583333, 156.01868489583333, 157.01868489583333, 158.01868489583333, 159.01868489583333, 160.01868489583333, 161.01868489583333, 162.01868489583333, 163.01868489583333], "recent_frames_sha256": "161510b26614f3be2e59de8f914bcc95b08410f98024df1c080b6892aa21311c", "num_recent_frames": 30, "tq": 716207.472977006, "t1": 716214.893809049, "ta": 716214.893809049, "te": 716214.931446692, "first_response_s": 7.420832043047994, "answer_total_s": 7.4584696859819815, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_466_a266_q0", "video_id": 466, "time_stamp_s": 164, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fbbe2fbae50d4ffcada26905fba1c348a305e8a73ee802a2d8d26265cf64fda2", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Red gorilla sculpture stands prominently on a white pedestal, facing left, with two other colorful gorilla sculptures beside it.  \n- A man in a white cap walks past the sculptures, observing them, while a woman with a black bag walks by, looking at a large portrait of a woman with glasses.  \n- The camera pans to reveal a large abstract painting with vertical colored lines on the left wall, adjacent to the portrait.\n[30-60s] - A large, circular red and white abstract sculpture with floral cutouts is mounted on a wall, adjacent to a colorful geometric artwork.  \n- A blue, ribbed, car-shaped sculpture with metallic wheels rests on a white pedestal, positioned near a wall displaying vibrant, stylized portraits.  \n- A visitor in a plaid shirt walks past the car sculpture, moving toward the right side of the frame, while other attendees are visible in the background.\n[60-90s] - A red canvas with black, textured, abstract patterns is mounted on a white wall, positioned to the left of a black panel with reflective text.  \n- The black panel displays the phrase \"ALL YOU NEED IS LOVE\" in large, white, uppercase letters, with a glossy surface reflecting ambient light.  \n- A group of visitors is seen walking past the artworks, with some pausing to observe the pieces, indicating active engagement with the exhibition.\n[90-120s] - Two stylized figurines (pink and black) stand on pedestals in front of a framed painting depicting cartoonish figures in a street scene.  \n- A large painting of two cartoon figures in hoodies against a Starry Night backdrop is displayed on a wall, with visitors walking nearby.  \n- A mosaic portrait of a woman’s face is mounted on a white wall, with people observing it and other artworks in the gallery space.\n[120-150s] - A large blue and red abstract painting with white cloud-like shapes is displayed on a white wall, viewed from the left side of the frame.  \n- A translucent, blue, wave-like sculpture hangs vertically on an adjacent wall, catching light and appearing to ripple.  \n- A woman in a blue top and white pants sits on a colorful beach ball sculpture, positioned on a white pedestal, facing away from the camera.", "history_tokens": 482, "history_utf8_bytes": 2178, "recent_frame_times_s": [134.01868489583333, 135.01868489583333, 136.01868489583333, 137.01868489583333, 138.01868489583333, 139.01868489583333, 140.01868489583333, 141.01868489583333, 142.01868489583333, 143.01868489583333, 144.01868489583333, 145.01868489583333, 146.01868489583333, 147.01868489583333, 148.01868489583333, 149.01868489583333, 150.01868489583333, 151.01868489583333, 152.01868489583333, 153.01868489583333, 154.01868489583333, 155.01868489583333, 156.01868489583333, 157.01868489583333, 158.01868489583333, 159.01868489583333, 160.01868489583333, 161.01868489583333, 162.01868489583333, 163.01868489583333], "recent_frames_sha256": "161510b26614f3be2e59de8f914bcc95b08410f98024df1c080b6892aa21311c", "num_recent_frames": 30, "tq": 716306.995804508, "t1": 716307.999101184, "ta": 716307.999101184, "te": 716308.183499262, "first_response_s": 1.0032966759754345, "answer_total_s": 1.187694753985852, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 466, "content_group": "deb5d93367273bc9234e4a41ed5fbff9a93069a99b1ef3ecc8217faf1e2b31be", "question": {"question_id": "sample_466_a266_q1", "video_id": 466, "video_path": "./videos/sample_466_real.mp4", "annotation_index": 266, "question_index": 1, "question": "What significant installation is revealed in the center of the gallery right now?", "options": ["A. A large sculpture in the center.", "B. A collection of paintings on the walls.", "C. A video projection.", "D. Numerous small, colorful items hanging from the ceiling."], "answer": "D", "time_stamp_s": 171, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_466_a266_q1", "video_id": 466, "time_stamp_s": 171, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1643c4aa57e3710229776622a50127aaa55fb6d0a87366eb5368a54977ea81af", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [141.01868489583333, 142.01868489583333, 143.01868489583333, 144.01868489583333, 145.01868489583333, 146.01868489583333, 147.01868489583333, 148.01868489583333, 149.01868489583333, 150.01868489583333, 151.01868489583333, 152.01868489583333, 153.01868489583333, 154.01868489583333, 155.01868489583333, 156.01868489583333, 157.01868489583333, 158.01868489583333, 159.01868489583333, 160.01868489583333, 161.01868489583333, 162.01868489583333, 163.01868489583333, 164.01868489583333, 165.01868489583333, 166.01868489583333, 167.01868489583333, 168.01868489583333, 169.01868489583333, 170.01868489583333], "recent_frames_sha256": "a1f5cd8cacec8e7cc3ff62cc36e692b16c5a5af0051c85ba8868d4e62357a4c0", "num_recent_frames": 30, "tq": 716214.963127055, "t1": 716221.989902681, "ta": 716221.989902681, "te": 716222.026801351, "first_response_s": 7.026775626000017, "answer_total_s": 7.063674296019599, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_466_a266_q1", "video_id": 466, "time_stamp_s": 171, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "28f6d905317ac71af688cd97c17f189748a5ba43f174f41e858d2ea4a850801f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Red gorilla sculpture stands prominently on a white pedestal, facing left, with two other colorful gorilla sculptures beside it.  \n- A man in a white cap walks past the sculptures, observing them, while a woman with a black bag walks by, looking at a large portrait of a woman with glasses.  \n- The camera pans to reveal a large abstract painting with vertical colored lines on the left wall, adjacent to the portrait.\n[30-60s] - A large, circular red and white abstract sculpture with floral cutouts is mounted on a wall, adjacent to a colorful geometric artwork.  \n- A blue, ribbed, car-shaped sculpture with metallic wheels rests on a white pedestal, positioned near a wall displaying vibrant, stylized portraits.  \n- A visitor in a plaid shirt walks past the car sculpture, moving toward the right side of the frame, while other attendees are visible in the background.\n[60-90s] - A red canvas with black, textured, abstract patterns is mounted on a white wall, positioned to the left of a black panel with reflective text.  \n- The black panel displays the phrase \"ALL YOU NEED IS LOVE\" in large, white, uppercase letters, with a glossy surface reflecting ambient light.  \n- A group of visitors is seen walking past the artworks, with some pausing to observe the pieces, indicating active engagement with the exhibition.\n[90-120s] - Two stylized figurines (pink and black) stand on pedestals in front of a framed painting depicting cartoonish figures in a street scene.  \n- A large painting of two cartoon figures in hoodies against a Starry Night backdrop is displayed on a wall, with visitors walking nearby.  \n- A mosaic portrait of a woman’s face is mounted on a white wall, with people observing it and other artworks in the gallery space.\n[120-150s] - A large blue and red abstract painting with white cloud-like shapes is displayed on a white wall, viewed from the left side of the frame.  \n- A translucent, blue, wave-like sculpture hangs vertically on an adjacent wall, catching light and appearing to ripple.  \n- A woman in a blue top and white pants sits on a colorful beach ball sculpture, positioned on a white pedestal, facing away from the camera.", "history_tokens": 482, "history_utf8_bytes": 2178, "recent_frame_times_s": [141.01868489583333, 142.01868489583333, 143.01868489583333, 144.01868489583333, 145.01868489583333, 146.01868489583333, 147.01868489583333, 148.01868489583333, 149.01868489583333, 150.01868489583333, 151.01868489583333, 152.01868489583333, 153.01868489583333, 154.01868489583333, 155.01868489583333, 156.01868489583333, 157.01868489583333, 158.01868489583333, 159.01868489583333, 160.01868489583333, 161.01868489583333, 162.01868489583333, 163.01868489583333, 164.01868489583333, 165.01868489583333, 166.01868489583333, 167.01868489583333, 168.01868489583333, 169.01868489583333, 170.01868489583333], "recent_frames_sha256": "a1f5cd8cacec8e7cc3ff62cc36e692b16c5a5af0051c85ba8868d4e62357a4c0", "num_recent_frames": 30, "tq": 716308.211237554, "t1": 716320.193731459, "ta": 716320.193731459, "te": 716320.416698296, "first_response_s": 11.98249390500132, "answer_total_s": 12.205460741999559, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 466, "content_group": "deb5d93367273bc9234e4a41ed5fbff9a93069a99b1ef3ecc8217faf1e2b31be", "question": {"question_id": "sample_466_a267_q0", "video_id": 466, "video_path": "./videos/sample_466_real.mp4", "annotation_index": 267, "question_index": 0, "question": "What appears below the four smaller frames as the camera pans to the left?", "options": ["A. Another set of photographs.", "B. An empty white wall space.", "C. A sculpture.", "D. A window."], "answer": "B", "time_stamp_s": 340, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "art_show", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_466_a267_q0", "video_id": 466, "time_stamp_s": 340, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "41ce5779826a88f27faf27bb34f22052dba9be4efaf14b9ddc7fcdd4f0b6ec37", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [310.01868489583336, 311.01868489583336, 312.01868489583336, 313.01868489583336, 314.01868489583336, 315.01868489583336, 316.01868489583336, 317.01868489583336, 318.01868489583336, 319.01868489583336, 320.01868489583336, 321.01868489583336, 322.01868489583336, 323.01868489583336, 324.01868489583336, 325.01868489583336, 326.01868489583336, 327.01868489583336, 328.01868489583336, 329.01868489583336, 330.01868489583336, 331.01868489583336, 332.01868489583336, 333.01868489583336, 334.01868489583336, 335.01868489583336, 336.01868489583336, 337.01868489583336, 338.01868489583336, 339.01868489583336], "recent_frames_sha256": "06bddf2d52cf9a6b5b55da29ffd0e621e6201b3fe093b7e9a0a657183e2e11ea", "num_recent_frames": 30, "tq": 716222.042972126, "t1": 716230.151177161, "ta": 716230.151177161, "te": 716230.188444333, "first_response_s": 8.108205034979619, "answer_total_s": 8.145472206990235, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_466_a267_q0", "video_id": 466, "time_stamp_s": 340, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ca55deb872485ce6ed00b2a5ee6cf53abdb4f3d95bacdb02c389778f17dc0a79", "condition_order": ["recent", "notes"], "memory": "[30-60s] - A large, circular red and white abstract sculpture with floral cutouts is mounted on a wall, adjacent to a colorful geometric artwork.  \n- A blue, ribbed, car-shaped sculpture with metallic wheels rests on a white pedestal, positioned near a wall displaying vibrant, stylized portraits.  \n- A visitor in a plaid shirt walks past the car sculpture, moving toward the right side of the frame, while other attendees are visible in the background.\n[60-90s] - A red canvas with black, textured, abstract patterns is mounted on a white wall, positioned to the left of a black panel with reflective text.  \n- The black panel displays the phrase \"ALL YOU NEED IS LOVE\" in large, white, uppercase letters, with a glossy surface reflecting ambient light.  \n- A group of visitors is seen walking past the artworks, with some pausing to observe the pieces, indicating active engagement with the exhibition.\n[90-120s] - Two stylized figurines (pink and black) stand on pedestals in front of a framed painting depicting cartoonish figures in a street scene.  \n- A large painting of two cartoon figures in hoodies against a Starry Night backdrop is displayed on a wall, with visitors walking nearby.  \n- A mosaic portrait of a woman’s face is mounted on a white wall, with people observing it and other artworks in the gallery space.\n[120-150s] - A large blue and red abstract painting with white cloud-like shapes is displayed on a white wall, viewed from the left side of the frame.  \n- A translucent, blue, wave-like sculpture hangs vertically on an adjacent wall, catching light and appearing to ripple.  \n- A woman in a blue top and white pants sits on a colorful beach ball sculpture, positioned on a white pedestal, facing away from the camera.\n[150-180s] - A mannequin in blue attire sits atop a large, colorful beach ball, positioned near a display panel with text about \"RAINTYPE\" by Lorenzo Marini.\n- The camera pans to reveal a wide art gallery space filled with visitors, featuring a mirrored floor and suspended colorful objects hanging from the ceiling.\n- People are seen walking through the gallery, some stopping to observe artworks, including a large circular piece on a white wall.\n[180-210s] - A woman in a yellow shirt walks leftward, carrying a black bag, while looking down at her phone.  \n- A man in a plaid shirt walks rightward, holding a phone up as if taking a photo.  \n- A transparent, suspended structure filled with colorful, floating objects is visible in the center of the room.\n[210-240s] - A red sculpture with elongated limbs is suspended mid-air, appearing to float or be in motion.  \n- A framed painting of a man in a blue shirt with \"TASTE THE FEELING\" text is displayed on the left wall.  \n- A large abstract painting with colorful balloons and a face is mounted on the right wall, adjacent to the red sculpture.\n[240-270s] - A vibrant, abstract painting with geometric shapes and bold colors is displayed in a black frame, positioned left of a red wire sculpture.  \n- The red wire sculpture, shaped like a human head with intricate branching patterns, is mounted on a white wall and partially obscures the view of the adjacent painting.  \n- A large, framed painting depicting underwater swimmers in turquoise water is visible to the right of the red sculpture, with a crowd of people in the background.\n[270-300s] - A black-and-white abstract painting with a central golden streak is mounted on a white wall, adjacent to a textured black-and-white piece.  \n- A vibrant, graffiti-style artwork with multiple faces and colorful splashes is displayed to the right of the black-and-white piece.  \n- A sign labeled \"PIGMENT GALLERY 920\" is visible above a white display case containing a small sculpture and a dark alligator figurine.\n[300-330s] - A person with dark hair stands facing two large abstract paintings with vibrant, swirling lines on beige backgrounds.  \n- The camera pans right, revealing a gallery wall with smaller framed artworks, including a prominent yellow panel and several monochromatic pieces.  \n- The camera continues to pan, showing a series of black-and-white photographs arranged in a grid, with small informational plaques beside each.", "history_tokens": 940, "history_utf8_bytes": 4197, "recent_frame_times_s": [310.01868489583336, 311.01868489583336, 312.01868489583336, 313.01868489583336, 314.01868489583336, 315.01868489583336, 316.01868489583336, 317.01868489583336, 318.01868489583336, 319.01868489583336, 320.01868489583336, 321.01868489583336, 322.01868489583336, 323.01868489583336, 324.01868489583336, 325.01868489583336, 326.01868489583336, 327.01868489583336, 328.01868489583336, 329.01868489583336, 330.01868489583336, 331.01868489583336, 332.01868489583336, 333.01868489583336, 334.01868489583336, 335.01868489583336, 336.01868489583336, 337.01868489583336, 338.01868489583336, 339.01868489583336], "recent_frames_sha256": "06bddf2d52cf9a6b5b55da29ffd0e621e6201b3fe093b7e9a0a657183e2e11ea", "num_recent_frames": 30, "tq": 716367.41006092, "t1": 716369.226643196, "ta": 716369.226643196, "te": 716369.268492929, "first_response_s": 1.8165822759037837, "answer_total_s": 1.8584320090012625, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 466, "content_group": "deb5d93367273bc9234e4a41ed5fbff9a93069a99b1ef3ecc8217faf1e2b31be", "question": {"question_id": "sample_466_a268_q0", "video_id": 466, "video_path": "./videos/sample_466_real.mp4", "annotation_index": 268, "question_index": 0, "question": "What is the man doing in the sequences shown on the television screen?", "options": ["A. Painting.", "B. Drawing.", "C. Working with metal objects.", "D. Writing."], "answer": "C", "time_stamp_s": 490, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "art_show", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_466_a268_q0", "video_id": 466, "time_stamp_s": 490, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f5ea6e5dda2423f73335414c938e697d0f81d9596860ba40da09dfcdc9d2963a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [460.01868489583336, 461.01868489583336, 462.01868489583336, 463.01868489583336, 464.01868489583336, 465.01868489583336, 466.01868489583336, 467.01868489583336, 468.01868489583336, 469.01868489583336, 470.01868489583336, 471.01868489583336, 472.01868489583336, 473.01868489583336, 474.01868489583336, 475.01868489583336, 476.01868489583336, 477.01868489583336, 478.01868489583336, 479.01868489583336, 480.01868489583336, 481.01868489583336, 482.01868489583336, 483.01868489583336, 484.01868489583336, 485.01868489583336, 486.01868489583336, 487.01868489583336, 488.01868489583336, 489.01868489583336], "recent_frames_sha256": "723e41e338258d02c9536d3fc1618c8f9f294dbc23e8cbe72c101320fcd0291c", "num_recent_frames": 30, "tq": 716230.206727754, "t1": 716237.689663401, "ta": 716237.689663401, "te": 716237.727166292, "first_response_s": 7.4829356470145285, "answer_total_s": 7.520438538049348, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_466_a268_q0", "video_id": 466, "time_stamp_s": 490, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b9d17f41da747adc9961d924ec70472d22ba0e11e409d83cec4e0b334db5ade8", "condition_order": ["recent", "notes"], "memory": "[150-180s] - A mannequin in blue attire sits atop a large, colorful beach ball, positioned near a display panel with text about \"RAINTYPE\" by Lorenzo Marini.\n- The camera pans to reveal a wide art gallery space filled with visitors, featuring a mirrored floor and suspended colorful objects hanging from the ceiling.\n- People are seen walking through the gallery, some stopping to observe artworks, including a large circular piece on a white wall.\n[180-210s] - A woman in a yellow shirt walks leftward, carrying a black bag, while looking down at her phone.  \n- A man in a plaid shirt walks rightward, holding a phone up as if taking a photo.  \n- A transparent, suspended structure filled with colorful, floating objects is visible in the center of the room.\n[210-240s] - A red sculpture with elongated limbs is suspended mid-air, appearing to float or be in motion.  \n- A framed painting of a man in a blue shirt with \"TASTE THE FEELING\" text is displayed on the left wall.  \n- A large abstract painting with colorful balloons and a face is mounted on the right wall, adjacent to the red sculpture.\n[240-270s] - A vibrant, abstract painting with geometric shapes and bold colors is displayed in a black frame, positioned left of a red wire sculpture.  \n- The red wire sculpture, shaped like a human head with intricate branching patterns, is mounted on a white wall and partially obscures the view of the adjacent painting.  \n- A large, framed painting depicting underwater swimmers in turquoise water is visible to the right of the red sculpture, with a crowd of people in the background.\n[270-300s] - A black-and-white abstract painting with a central golden streak is mounted on a white wall, adjacent to a textured black-and-white piece.  \n- A vibrant, graffiti-style artwork with multiple faces and colorful splashes is displayed to the right of the black-and-white piece.  \n- A sign labeled \"PIGMENT GALLERY 920\" is visible above a white display case containing a small sculpture and a dark alligator figurine.\n[300-330s] - A person with dark hair stands facing two large abstract paintings with vibrant, swirling lines on beige backgrounds.  \n- The camera pans right, revealing a gallery wall with smaller framed artworks, including a prominent yellow panel and several monochromatic pieces.  \n- The camera continues to pan, showing a series of black-and-white photographs arranged in a grid, with small informational plaques beside each.\n[330-360s] - A large abstract painting with vibrant splashes of orange, red, blue, and green dominates the center of the wall.  \n- Four framed black-and-white cityscape photographs are arranged in a 2x2 grid to the right of the abstract piece.  \n- A smaller framed artwork with a dark, possibly reflective surface is positioned to the left of the abstract painting.\n[360-390s] - Camera pans left across a row of black-framed artworks depicting birds and palm trees on white walls.  \n- A blue sign labeled \"STEP 8\" is visible on a ceiling beam, indicating an exhibition section.  \n- A group of visitors, including a person in a green jacket and another holding a phone, are seen observing large black-and-white wall sculptures.\n[390-420s] - Left wall-mounted sculpture: intricate wire mesh forming abstract, elongated figure with limbs and head, casting shadow on wall.\n- Right wall-mounted sculpture: similar wire mesh structure, smaller and more compact, positioned near corner, casting distinct shadow.\n- Camera pans right, focusing on right sculpture, then shifts to left, revealing both sculptures in context against plain white walls.\n[420-450s] - A high-heeled shoe sculpture made of tangled wire is mounted on a white wall, illuminated by spotlights.  \n- To its right, a smaller, abstract wire sculpture is partially visible.  \n- The camera pans left, revealing a wire sculpture of a dog with tangled wire forming its body and head, casting a shadow on the wall.\n[450-480s] - A man in a green shirt and cap walks past a wall-mounted abstract wire sculpture, gesturing toward it.  \n- Another person is seen taking photos of the sculpture with a smartphone.  \n- The sculpture casts a distinct shadow on the white wall, emphasizing its three-dimensional form.", "history_tokens": 951, "history_utf8_bytes": 4211, "recent_frame_times_s": [460.01868489583336, 461.01868489583336, 462.01868489583336, 463.01868489583336, 464.01868489583336, 465.01868489583336, 466.01868489583336, 467.01868489583336, 468.01868489583336, 469.01868489583336, 470.01868489583336, 471.01868489583336, 472.01868489583336, 473.01868489583336, 474.01868489583336, 475.01868489583336, 476.01868489583336, 477.01868489583336, 478.01868489583336, 479.01868489583336, 480.01868489583336, 481.01868489583336, 482.01868489583336, 483.01868489583336, 484.01868489583336, 485.01868489583336, 486.01868489583336, 487.01868489583336, 488.01868489583336, 489.01868489583336], "recent_frames_sha256": "723e41e338258d02c9536d3fc1618c8f9f294dbc23e8cbe72c101320fcd0291c", "num_recent_frames": 30, "tq": 716414.794754895, "t1": 716422.717396094, "ta": 716422.717396094, "te": 716422.918758096, "first_response_s": 7.922641198965721, "answer_total_s": 8.124003201024607, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 467, "content_group": "b2941e09b35c55f13a4c379959f2a43f3550a0b8be461e60962b81b55154521d", "question": {"question_id": "sample_467_a1293_q0", "video_id": 467, "video_path": "./videos/sample_467_real.mp4", "annotation_index": 1293, "question_index": 0, "question": "What are some people doing with their smartphones?", "options": ["A. Making calls.", "B. Texting.", "C. Playing games.", "D. Taking photos."], "answer": "D", "time_stamp_s": 15, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_467_a1293_q0", "video_id": 467, "time_stamp_s": 15, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b73577a70d2b1f165aa9cf3d301336b2bea06b610a2f6021cd38bd5aff077e61", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03802083333333333, 1.0046875, 2.0046875, 3.0046875, 4.0046875, 5.0046875, 6.0046875, 7.0046875, 8.0046875, 9.0046875, 10.0046875, 11.0046875, 12.0046875, 13.0046875, 14.0046875], "recent_frames_sha256": "071c7d1944dec0195e692837f3bd5185ffed8fa4c105f76f8564fcea6b6df7ff", "num_recent_frames": 15, "tq": 716978.471798606, "t1": 716989.87273167, "ta": 716989.87273167, "te": 716989.90974066, "first_response_s": 11.400933064054698, "answer_total_s": 11.437942054006271, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_467_a1293_q0", "video_id": 467, "time_stamp_s": 15, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "46f42e21c8da87d91ddfa38d75d5e2b09da78206837dbbf1b4d39bbacf666780", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03802083333333333, 1.0046875, 2.0046875, 3.0046875, 4.0046875, 5.0046875, 6.0046875, 7.0046875, 8.0046875, 9.0046875, 10.0046875, 11.0046875, 12.0046875, 13.0046875, 14.0046875], "recent_frames_sha256": "071c7d1944dec0195e692837f3bd5185ffed8fa4c105f76f8564fcea6b6df7ff", "num_recent_frames": 15, "tq": 717031.057178451, "t1": 717042.557186747, "ta": 717042.557186747, "te": 717042.59870754, "first_response_s": 11.500008295988664, "answer_total_s": 11.541529088979587, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 467, "content_group": "b2941e09b35c55f13a4c379959f2a43f3550a0b8be461e60962b81b55154521d", "question": {"question_id": "sample_467_a1293_q1", "video_id": 467, "video_path": "./videos/sample_467_real.mp4", "annotation_index": 1293, "question_index": 1, "question": "Which of the following best describes the overall content of the video clip?", "options": ["A. A tour of an art gallery showcasing nature and wildlife photography.", "B. A walkthrough of a historical museum.", "C. A visit to a contemporary art exhibition.", "D. A day at an amusement park."], "answer": "A", "time_stamp_s": 19, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_467_a1293_q1", "video_id": 467, "time_stamp_s": 19, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "61da3de91e8415f19e35800c80f688b4383942842c014da7327619dac859e637", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03802083333333333, 1.0046875, 2.0046875, 3.0046875, 4.0046875, 5.0046875, 6.0046875, 7.0046875, 8.0046875, 9.0046875, 10.0046875, 11.0046875, 12.0046875, 13.0046875, 14.0046875, 15.0046875, 16.0046875, 17.0046875, 18.0046875], "recent_frames_sha256": "fcae297b92e8c1dac041763d3fae6b3547a9dec10638ffa79bf4d206f76cbfdc", "num_recent_frames": 19, "tq": 716989.923583599, "t1": 716997.57231295, "ta": 716997.57231295, "te": 716997.61068827, "first_response_s": 7.648729350999929, "answer_total_s": 7.687104670912959, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_467_a1293_q1", "video_id": 467, "time_stamp_s": 19, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4213ad7ac75f6c6fc56a6e1eeb01050c025a37db137e48f255d247a7ae856425", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03802083333333333, 1.0046875, 2.0046875, 3.0046875, 4.0046875, 5.0046875, 6.0046875, 7.0046875, 8.0046875, 9.0046875, 10.0046875, 11.0046875, 12.0046875, 13.0046875, 14.0046875, 15.0046875, 16.0046875, 17.0046875, 18.0046875], "recent_frames_sha256": "fcae297b92e8c1dac041763d3fae6b3547a9dec10638ffa79bf4d206f76cbfdc", "num_recent_frames": 19, "tq": 717042.618212616, "t1": 717055.237077749, "ta": 717055.237077749, "te": 717055.38598549, "first_response_s": 12.61886513303034, "answer_total_s": 12.767772874096408, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 467, "content_group": "b2941e09b35c55f13a4c379959f2a43f3550a0b8be461e60962b81b55154521d", "question": {"question_id": "sample_467_a1294_q0", "video_id": 467, "video_path": "./videos/sample_467_real.mp4", "annotation_index": 1294, "question_index": 0, "question": "How many portraits of women are shown on the walls right now?", "options": ["A. Two.", "B. Four.", "C. Three.", "D. Five."], "answer": "C", "time_stamp_s": 172, "task_type": "Counting", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_467_a1294_q0", "video_id": 467, "time_stamp_s": 172, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "022c158724e47a1d62a0a039baf27ca1e8dcd8d41e07ce2be437b0617e995838", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [142.0046875, 143.0046875, 144.0046875, 145.0046875, 146.0046875, 147.0046875, 148.0046875, 149.0046875, 150.0046875, 151.0046875, 152.0046875, 153.0046875, 154.0046875, 155.0046875, 156.0046875, 157.0046875, 158.0046875, 159.0046875, 160.0046875, 161.0046875, 162.0046875, 163.0046875, 164.0046875, 165.0046875, 166.0046875, 167.0046875, 168.0046875, 169.0046875, 170.0046875, 171.0046875], "recent_frames_sha256": "e8a6cec6bfe7f790843a0dcc36891e17eba6aec6035b5f36b2f3a01b62d856a7", "num_recent_frames": 30, "tq": 716997.625599499, "t1": 717009.190656217, "ta": 717009.190656217, "te": 717009.227905607, "first_response_s": 11.565056718070991, "answer_total_s": 11.602306107990444, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_467_a1294_q0", "video_id": 467, "time_stamp_s": 172, "ground_truth": "C", "raw_output": "C. Three.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "855eb3eaedb0685b6e425969dee568750e028f2411c72de31e194ce5ddf66a13", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A group of visitors, including a man in a light shirt and lanyard, gather around a giraffe painting, with some taking photos.  \n- A large, vibrant abstract painting with red and orange streaks dominates a wall, drawing attention from passersby.  \n- People move through the gallery, observing various artworks, including marine life and floral scenes, as the camera pans across the space.\n[30-60s] - A large framed painting of a crocodile underwater is mounted on a white wall, adjacent to a vibrant abstract artwork.  \n- The camera pans right, revealing a blue wall with a white label displaying \"@johanartist\" and contact details.  \n- A large portrait of a man with red markings on his face is displayed on a blue wall, with visitors walking by in the background.\n[60-90s] - A large, stylized portrait of Marilyn Monroe blowing a bubblegum bubble is displayed on a white wall, surrounded by fragmented, box-like structures.  \n- To the right, a large, colorful artwork depicting a Tiffany & Co. jewelry can with \"JEWELRY SOUP\" text is mounted on a wall, featuring a turquoise and silver design.  \n- Visitors are seen walking through the gallery space, observing the artworks, with some stopping to look at the pieces.\n[90-120s] - A large, colorful painting of a man's face with a glowing green halo is mounted on a white wall, adjacent to a group of smaller, vibrant pop-art prints.  \n- A Coca-Cola themed artwork featuring the American flag and the iconic logo is displayed next to a painting of a bull made from dollar bills.  \n- Visitors walk through the gallery, pausing to view the artworks, with some individuals standing near the Coca-Cola piece and others examining the pop-art prints.\n[120-150s] - A large portrait of a man in a dark suit sits on a white wall, flanked by other artworks including a Union Jack-themed piece.  \n- A visitor in a red jacket stands near the portrait, observing the artwork.  \n- The camera pans right, revealing more colorful, framed artworks on adjacent walls.", "history_tokens": 458, "history_utf8_bytes": 2008, "recent_frame_times_s": [142.0046875, 143.0046875, 144.0046875, 145.0046875, 146.0046875, 147.0046875, 148.0046875, 149.0046875, 150.0046875, 151.0046875, 152.0046875, 153.0046875, 154.0046875, 155.0046875, 156.0046875, 157.0046875, 158.0046875, 159.0046875, 160.0046875, 161.0046875, 162.0046875, 163.0046875, 164.0046875, 165.0046875, 166.0046875, 167.0046875, 168.0046875, 169.0046875, 170.0046875, 171.0046875], "recent_frames_sha256": "e8a6cec6bfe7f790843a0dcc36891e17eba6aec6035b5f36b2f3a01b62d856a7", "num_recent_frames": 30, "tq": 717101.994870806, "t1": 717103.568390434, "ta": 717103.568390434, "te": 717103.720781551, "first_response_s": 1.5735196280293167, "answer_total_s": 1.7259107449790463, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 467, "content_group": "b2941e09b35c55f13a4c379959f2a43f3550a0b8be461e60962b81b55154521d", "question": {"question_id": "sample_467_a1295_q0", "video_id": 467, "video_path": "./videos/sample_467_real.mp4", "annotation_index": 1295, "question_index": 0, "question": "What words are written on the sign above painting shown right now?", "options": ["A. P B G print bakery.", "B. L M N art studio.", "C. Q R S gallery.", "D. T U V design hub."], "answer": "A", "time_stamp_s": 324, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_467_a1295_q0", "video_id": 467, "time_stamp_s": 324, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "39dfc51e10b35b181fcad106a29a6ee3b56804ecd11b33193ad657d833d48f17", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [294.0046875, 295.0046875, 296.0046875, 297.0046875, 298.0046875, 299.0046875, 300.0046875, 301.0046875, 302.0046875, 303.0046875, 304.0046875, 305.0046875, 306.0046875, 307.0046875, 308.0046875, 309.0046875, 310.0046875, 311.0046875, 312.0046875, 313.0046875, 314.0046875, 315.0046875, 316.0046875, 317.0046875, 318.0046875, 319.0046875, 320.0046875, 321.0046875, 322.0046875, 323.0046875], "recent_frames_sha256": "7c93410c99a00449fa4f359ecb7f90e94e00240ee8af48aead53920506fdab20", "num_recent_frames": 30, "tq": 717009.235988756, "t1": 717020.170066771, "ta": 717020.170066771, "te": 717020.202848541, "first_response_s": 10.934078015037812, "answer_total_s": 10.966859785025008, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_467_a1295_q0", "video_id": 467, "time_stamp_s": 324, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a92c1fb0e10f2cb919d63cdd3f4d45829fe5e9bd18698539557b65ce8257387a", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A group of visitors, including a man in a light shirt and lanyard, gather around a giraffe painting, with some taking photos.  \n- A large, vibrant abstract painting with red and orange streaks dominates a wall, drawing attention from passersby.  \n- People move through the gallery, observing various artworks, including marine life and floral scenes, as the camera pans across the space.\n[30-60s] - A large framed painting of a crocodile underwater is mounted on a white wall, adjacent to a vibrant abstract artwork.  \n- The camera pans right, revealing a blue wall with a white label displaying \"@johanartist\" and contact details.  \n- A large portrait of a man with red markings on his face is displayed on a blue wall, with visitors walking by in the background.\n[60-90s] - A large, stylized portrait of Marilyn Monroe blowing a bubblegum bubble is displayed on a white wall, surrounded by fragmented, box-like structures.  \n- To the right, a large, colorful artwork depicting a Tiffany & Co. jewelry can with \"JEWELRY SOUP\" text is mounted on a wall, featuring a turquoise and silver design.  \n- Visitors are seen walking through the gallery space, observing the artworks, with some stopping to look at the pieces.\n[90-120s] - A large, colorful painting of a man's face with a glowing green halo is mounted on a white wall, adjacent to a group of smaller, vibrant pop-art prints.  \n- A Coca-Cola themed artwork featuring the American flag and the iconic logo is displayed next to a painting of a bull made from dollar bills.  \n- Visitors walk through the gallery, pausing to view the artworks, with some individuals standing near the Coca-Cola piece and others examining the pop-art prints.\n[120-150s] - A large portrait of a man in a dark suit sits on a white wall, flanked by other artworks including a Union Jack-themed piece.  \n- A visitor in a red jacket stands near the portrait, observing the artwork.  \n- The camera pans right, revealing more colorful, framed artworks on adjacent walls.\n[150-180s] - A large, colorful painting of a woman's face with blue eyes and red lips is prominently displayed on the left wall.  \n- To its right, a black-and-white portrait of a woman with a fragmented, collage-style background is mounted.  \n- The camera pans slightly to the right, revealing a third portrait of a woman with red lips and a black-and-white collage effect on the far right.\n[180-210s] - A large framed portrait of Audrey Hepburn in a black dress with a teal background and arched design is displayed on a black wall.  \n- The portrait is illuminated by spotlights, casting a soft glow and creating a sparkling effect on the wall.  \n- The camera pans slightly to the right, revealing part of the exhibition space with other artworks and visitors in the background.\n[210-240s] - A man in a black outfit gestures toward a large, abstract sculpture on a pedestal.  \n- The sculpture features flowing, curved metal forms mounted on a white pedestal.  \n- A blue sign with \"MARK SPARK\" is visible above a white wall, indicating an artist or brand.\n[240-270s] - A white wall displays multiple ceramic sculptures, including a head with spiky greenery and a screaming face, mounted centrally.  \n- To the left, a seated female figure with a textured dress is positioned next to a pig-like sculpture on a pedestal.  \n- The camera pans slightly, revealing additional sculptures on pedestals and walls, including a figure with an umbrella and another with a hat, all arranged in a gallery setting.\n[270-300s] - A woman in a black hat and patterned dress stands beside a tall, ornate sculpture with a large black hat and wings, observing nearby artworks.  \n- A blue sign labeled \"PBC 1025/1128\" hangs from the ceiling, indicating an exhibition section.  \n- Two large, colorful paintings depicting cycling scenes and abstract skies are mounted on adjacent walls, with one showing a horse-drawn carriage and cyclists.", "history_tokens": 901, "history_utf8_bytes": 3924, "recent_frame_times_s": [294.0046875, 295.0046875, 296.0046875, 297.0046875, 298.0046875, 299.0046875, 300.0046875, 301.0046875, 302.0046875, 303.0046875, 304.0046875, 305.0046875, 306.0046875, 307.0046875, 308.0046875, 309.0046875, 310.0046875, 311.0046875, 312.0046875, 313.0046875, 314.0046875, 315.0046875, 316.0046875, 317.0046875, 318.0046875, 319.0046875, 320.0046875, 321.0046875, 322.0046875, 323.0046875], "recent_frames_sha256": "7c93410c99a00449fa4f359ecb7f90e94e00240ee8af48aead53920506fdab20", "num_recent_frames": 30, "tq": 717179.717879615, "t1": 717185.912753711, "ta": 717185.912753711, "te": 717185.945724005, "first_response_s": 6.194874095963314, "answer_total_s": 6.227844389970414, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 467, "content_group": "b2941e09b35c55f13a4c379959f2a43f3550a0b8be461e60962b81b55154521d", "question": {"question_id": "sample_467_a1296_q0", "video_id": 467, "video_path": "./videos/sample_467_real.mp4", "annotation_index": 1296, "question_index": 0, "question": "What is the name on the sign partially visible in the background wall?", "options": ["A. \"Hazel's Story\".", "B. \"Gallery Night\".", "C. \"Art Showcase\".", "D. \"Modern Art\"."], "answer": "A", "time_stamp_s": 585, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [540, 589], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_467_a1296_q0", "video_id": 467, "time_stamp_s": 585, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c5680920aef9dd9db781fadc9d87513cfb8e4da087625d3ae457d6ac8a132d81", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [555.0046875, 556.0046875, 557.0046875, 558.0046875, 559.0046875, 560.0046875, 561.0046875, 562.0046875, 563.0046875, 564.0046875, 565.0046875, 566.0046875, 567.0046875, 568.0046875, 569.0046875, 570.0046875, 571.0046875, 572.0046875, 573.0046875, 574.0046875, 575.0046875, 576.0046875, 577.0046875, 578.0046875, 579.0046875, 580.0046875, 581.0046875, 582.0046875, 583.0046875, 584.0046875], "recent_frames_sha256": "6b49ba6f1f0cd761c2052219221606a0659ebe6bd7b9dcc6e6895c85174ddc23", "num_recent_frames": 30, "tq": 717020.208046875, "t1": 717031.019054256, "ta": 717031.019054256, "te": 717031.051811735, "first_response_s": 10.811007381067611, "answer_total_s": 10.843764860066585, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_467_a1296_q0", "video_id": 467, "time_stamp_s": 585, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b4e27b4ccdbfbbeb1bb52d2963f3def71f0da5839da7525dd1c28d1005a28921", "condition_order": ["recent", "notes"], "memory": "[210-240s] - A man in a black outfit gestures toward a large, abstract sculpture on a pedestal.  \n- The sculpture features flowing, curved metal forms mounted on a white pedestal.  \n- A blue sign with \"MARK SPARK\" is visible above a white wall, indicating an artist or brand.\n[240-270s] - A white wall displays multiple ceramic sculptures, including a head with spiky greenery and a screaming face, mounted centrally.  \n- To the left, a seated female figure with a textured dress is positioned next to a pig-like sculpture on a pedestal.  \n- The camera pans slightly, revealing additional sculptures on pedestals and walls, including a figure with an umbrella and another with a hat, all arranged in a gallery setting.\n[270-300s] - A woman in a black hat and patterned dress stands beside a tall, ornate sculpture with a large black hat and wings, observing nearby artworks.  \n- A blue sign labeled \"PBC 1025/1128\" hangs from the ceiling, indicating an exhibition section.  \n- Two large, colorful paintings depicting cycling scenes and abstract skies are mounted on adjacent walls, with one showing a horse-drawn carriage and cyclists.\n[300-330s] - A large mural depicts a surreal sky with purple and blue clouds over green hills, featuring a small yellow sun and floating objects.  \n- To the right, a painting shows a green forest scene framed by a doorway, with a checkered floor and a red object near the base.  \n- A person walks past the murals, moving from left to right, partially visible in the background.\n[330-360s] - A painting depicts a serene landscape with a river, trees, and a distant house, viewed through an open window with a checkered floor in the foreground.\n- To the right, a painting shows a yellow arched doorway leading to a similar outdoor scene, with a red apple and a white vase on the checkered floor.\n- A third painting, partially visible, features a large white circular shape on a plain background, positioned between the two landscape paintings.\n[360-390s] - A large blue painting with a child's face partially submerged in water, signed by the artist, is displayed on a white wall.  \n- To its left, a colorful abstract painting with a green creature holding a red flame is visible.  \n- A person in dark clothing walks past the paintings, moving from left to right in the background.\n[390-420s] - A vibrant yellow wall displays a large, colorful abstract painting with a central black circular motif.  \n- The gallery sign \"193 GALLERY 1023/1124\" is mounted above the yellow wall, indicating the gallery's location.  \n- The camera pans to reveal a wide, open exhibition space with multiple artworks on display, including a series of three abstract paintings with yellow and black elements.\n[420-450s] - A vibrant, colorful abstract painting with geometric patterns is mounted on a bright yellow wall, drawing attention from viewers.  \n- Black-and-white photographic portraits of men, labeled \"Samuel Cueto,\" are displayed on a white wall, contrasting with the adjacent yellow wall.  \n- A group of visitors, including a man in a plaid shirt and a woman in a green jacket, are seen walking through the gallery space, observing the artworks.\n[450-480s] - A large, abstract painting with vibrant colors and dynamic brushstrokes is displayed on a white wall, viewed from a slight angle.  \n- A man in a black shirt walks past the painting, moving toward a table with art-related materials.  \n- The camera pans to reveal a yellow wall with three distinct artworks: a portrait with green sunglasses, a blue abstract piece, and a textured green canvas.\n[480-510s] - A person in a blue shirt and hat is seen holding a phone, capturing images of the art.  \n- The camera pans across a series of large, colorful abstract paintings on white walls.  \n- A pink sign with text is briefly visible near the bottom right corner of the frame.\n[510-540s] - A large abstract painting with vibrant colors and dynamic figures dominates the left wall.  \n- A bronze sculpture of a dog, detailed with textured surface, stands on a pedestal near the center.  \n- A large black-and-white textured painting with pink flamingos and human figures is displayed on the right wall.\n[540-570s] - A large red canvas with dense text patterns is displayed, showing a corridor-like scene.  \n- Adjacent to it, a blue canvas depicts a cityscape with water reflections.  \n- A white pedestal holds a white abstract sculpture near the blue canvas.", "history_tokens": 1022, "history_utf8_bytes": 4431, "recent_frame_times_s": [555.0046875, 556.0046875, 557.0046875, 558.0046875, 559.0046875, 560.0046875, 561.0046875, 562.0046875, 563.0046875, 564.0046875, 565.0046875, 566.0046875, 567.0046875, 568.0046875, 569.0046875, 570.0046875, 571.0046875, 572.0046875, 573.0046875, 574.0046875, 575.0046875, 576.0046875, 577.0046875, 578.0046875, 579.0046875, 580.0046875, 581.0046875, 582.0046875, 583.0046875, 584.0046875], "recent_frames_sha256": "6b49ba6f1f0cd761c2052219221606a0659ebe6bd7b9dcc6e6895c85174ddc23", "num_recent_frames": 30, "tq": 717248.883432313, "t1": 717250.193414806, "ta": 717250.193414806, "te": 717250.23148005, "first_response_s": 1.3099824930541217, "answer_total_s": 1.348047737032175, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 468, "content_group": "7df2246c61e18f51cae9f203a29cbd91c575b085c2dfdc48fbce128c0f3b3ee3", "question": {"question_id": "sample_468_a603_q0", "video_id": 468, "video_path": "./videos/sample_468_real.mp4", "annotation_index": 603, "question_index": 0, "question": "Which of the following best describes the sequence of artworks shown just now?", "options": ["A. Large square painting, two smaller square artworks, another concentric circle piece.", "B. Concentric circles, geometric triangles, vibrant circular piece.", "C. Crisscrossing pattern, concentric circles, geometric triangles.", "D. Vibrant circular piece, geometric triangles, crisscrossing pattern."], "answer": "C", "time_stamp_s": 176, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_468_a603_q0", "video_id": 468, "time_stamp_s": 176, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "58db85125a9dd2c8f95793620b944204d03bd598ebdf0da98a000a4771dae2ac", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [146.01764322916668, 147.01764322916668, 148.01764322916668, 149.01764322916668, 150.01764322916668, 151.01764322916668, 152.01764322916668, 153.01764322916668, 154.01764322916668, 155.01764322916668, 156.01764322916668, 157.01764322916668, 158.01764322916668, 159.01764322916668, 160.01764322916668, 161.01764322916668, 162.01764322916668, 163.01764322916668, 164.01764322916668, 165.01764322916668, 166.01764322916668, 167.01764322916668, 168.01764322916668, 169.01764322916668, 170.01764322916668, 171.01764322916668, 172.01764322916668, 173.01764322916668, 174.01764322916668, 175.01764322916668], "recent_frames_sha256": "76fd85527560b8ef265635e8586ec8ad2242528b2d597b5c158f996abc5c6a11", "num_recent_frames": 30, "tq": 717428.245606486, "t1": 717433.808883915, "ta": 717433.808883915, "te": 717433.84659619, "first_response_s": 5.563277428969741, "answer_total_s": 5.600989704020321, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_468_a603_q0", "video_id": 468, "time_stamp_s": 176, "ground_truth": "C", "raw_output": "C. Crisscrossing pattern, concentric circles, geometric triangles.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "1cd0e46b94fa9b5af2b848fd24c7e7c0ff04b0706bedb9c904bcfeb372ee1f04", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Two framed abstract portraits with red and blue tones hang side-by-side on a white wall, with a small informational plaque nearby.  \n- A large abstract painting with blue and red elements is displayed on a corner wall, adjacent to a smaller red-toned artwork.  \n- A group of visitors walks past vibrant, colorful paintings depicting stylized African figures, including one with a yellow background and another with a red background.\n[30-60s] - A woman in a black suit stands at a table, examining art pieces and interacting with a laptop.  \n- Abstract paintings with vibrant colors and geometric patterns are displayed on white walls, including a large piece with blue, yellow, and red swirls.  \n- A display table features two pink abstract artworks and a small white box, positioned near a seated individual.\n[60-90s] - Abstract painting with warm tones and curved lines is centrally framed, flanked by a minimalist branch-like piece to its left and a textured green-yellow canvas above it.  \n- A vertical stack of three abstract panels with earthy tones and subtle gradients is mounted to the right of the central piece.  \n- The camera pans right, revealing a vibrant, graffiti-style artwork with bold colors and chaotic lines, positioned next to a similarly abstract piece with pink and purple hues.\n[90-120s] - A vibrant abstract painting with pink, purple, and blue splashes is mounted on a white wall, positioned above a beige abstract piece.  \n- To the right, a series of framed artworks includes a colorful portrait and a light blue piece depicting abstract human figures.  \n- The camera pans right, revealing a large, bold abstract portrait with orange, yellow, and black strokes, adjacent to the smaller framed pieces.\n[120-150s] - A woman in a beige coat stands near a large abstract painting with orange, gray, and white swirls, observing it closely.  \n- A blue sign reading \"AZART GALLERY 1005\" hangs from the ceiling, indicating the gallery's location.  \n- A table displays art books and sculptures, with visitors walking past, including a person in a bright pink jacket.", "history_tokens": 454, "history_utf8_bytes": 2095, "recent_frame_times_s": [146.01764322916668, 147.01764322916668, 148.01764322916668, 149.01764322916668, 150.01764322916668, 151.01764322916668, 152.01764322916668, 153.01764322916668, 154.01764322916668, 155.01764322916668, 156.01764322916668, 157.01764322916668, 158.01764322916668, 159.01764322916668, 160.01764322916668, 161.01764322916668, 162.01764322916668, 163.01764322916668, 164.01764322916668, 165.01764322916668, 166.01764322916668, 167.01764322916668, 168.01764322916668, 169.01764322916668, 170.01764322916668, 171.01764322916668, 172.01764322916668, 173.01764322916668, 174.01764322916668, 175.01764322916668], "recent_frames_sha256": "76fd85527560b8ef265635e8586ec8ad2242528b2d597b5c158f996abc5c6a11", "num_recent_frames": 30, "tq": 717509.27763596, "t1": 717511.460194982, "ta": 717511.460194982, "te": 717512.027282361, "first_response_s": 2.182559021981433, "answer_total_s": 2.7496464010328054, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 468, "content_group": "7df2246c61e18f51cae9f203a29cbd91c575b085c2dfdc48fbce128c0f3b3ee3", "question": {"question_id": "sample_468_a604_q1", "video_id": 468, "video_path": "./videos/sample_468_real.mp4", "annotation_index": 604, "question_index": 1, "question": "What is located to the left of the sculpture?", "options": ["A. A painting depicting people and a river.", "B. A doorway.", "C. Another sculpture.", "D. A painting depicting mountains and people."], "answer": "D", "time_stamp_s": 487, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_468_a604_q1", "video_id": 468, "time_stamp_s": 487, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7b75eaa189282d67a7d6c5d36d5d160bd8412910c0dae4de251064052f4f4389", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [457.01764322916665, 458.01764322916665, 459.01764322916665, 460.01764322916665, 461.01764322916665, 462.01764322916665, 463.01764322916665, 464.01764322916665, 465.01764322916665, 466.01764322916665, 467.01764322916665, 468.01764322916665, 469.01764322916665, 470.01764322916665, 471.01764322916665, 472.01764322916665, 473.01764322916665, 474.01764322916665, 475.01764322916665, 476.01764322916665, 477.01764322916665, 478.01764322916665, 479.01764322916665, 480.01764322916665, 481.01764322916665, 482.01764322916665, 483.01764322916665, 484.01764322916665, 485.01764322916665, 486.01764322916665], "recent_frames_sha256": "8ffafb035848873137de2a8cff2f496ffd6bcb8d00179d47bc1f250a14a899d4", "num_recent_frames": 30, "tq": 717433.866175088, "t1": 717442.054920873, "ta": 717442.054920873, "te": 717442.092392212, "first_response_s": 8.188745785038918, "answer_total_s": 8.226217124029063, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_468_a604_q1", "video_id": 468, "time_stamp_s": 487, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "db09051ad1cfab619709c97500686f70022f6095b16f335f0cfba510b5960094", "condition_order": ["recent", "notes"], "memory": "[150-180s] - A large blue abstract painting with white lines dominates the left side of the wall.  \n- To its right, a series of smaller, colorful circular and geometric artworks are displayed, including a prominent rainbow-colored circular piece.  \n- The camera pans right, revealing a white curtain partially obscuring the view of additional artworks.\n[180-210s] - A golden, sculptural \"BLA BLA BLA\" installation hangs on a white wall, partially obscured by a person's head in frame.  \n- A grid of framed record art pieces, featuring colorful vinyl labels and stylized faces, is mounted on the adjacent wall.  \n- A blue sign reading \"ICE GALLERY 1981/1980\" is visible above the ceiling, indicating the gallery's name and year.\n[210-240s] - A large, colorful, framed artwork depicting a stylized face with intricate patterns hangs on a white wall.  \n- A black, circular object with white text reading \"THE ART OF\" sits on a small white pedestal near a display case.  \n- A tall, illuminated display case with multiple compartments, each showcasing different artworks, is positioned to the right of the circular object.\n[240-270s] - A large, cow-shaped sculpture made of recycled materials is displayed indoors, surrounded by visitors.  \n- People are seen observing and photographing the sculpture, with some holding signs or pointing at it.  \n- The sculpture is positioned near a wall with framed artwork, including a prominent painting of a blue-skinned figure playing a flute.\n[270-300s] - A large, colorful circular mosaic artwork with concentric rings is mounted on a white wall, positioned above a smaller similar piece.  \n- A 3D sculpted human face, constructed from stacked cubes, is displayed on a pedestal to the left of the circular artworks.  \n- Visitors, including a man in a red jacket and a woman in a white top, are seen walking past the artworks, observing them.\n[300-330s] - A black-and-white framed portrait of a man playing a guitar, with the text \"LEAD SLY\" prominently displayed, is mounted on a white wall.  \n- To the right of the portrait, a series of circular, colorful paintings depicting landscapes are arranged vertically.  \n- A tall, dark-colored lamp with a glass base and multiple curved arms stands on a white pedestal, positioned between the portrait and the landscape paintings.\n[330-360s] - A silver, leafy sculpture with a face is displayed on a wooden pedestal, surrounded by other sculptures.  \n- A large, ornate-framed painting of a nude figure is mounted on the wall, with a smaller painting to its right.  \n- Visitors are seen walking through the gallery, observing the art, with some standing near the sculptures and paintings.\n[360-390s] - A large, ornate gold-framed painting depicts a classical scene with figures in a dimly lit setting, positioned left of a textured, multi-colored abstract piece.  \n- The abstract artwork, composed of layered, spiky materials in warm and cool tones, hangs adjacent to the painting, creating a contrast in texture and style.  \n- A person in a blue top is partially visible on the right, appearing to interact with or observe the artworks, though their specific action is unclear.\n[390-420s] - A large black-framed artwork depicting a stylized rabbit head hangs prominently on the wall.  \n- Below it, a smaller framed piece with the text \"GORT KLAATU BARADA NIKTO\" is visible.  \n- To the right, a colorful abstract painting with vibrant hues is mounted on the wall.\n[420-450s] - A large, glittery yellow and blue abstract painting is centrally displayed on a white wall, surrounded by other colorful artworks.  \n- A woman in a dark tank top and jeans stands near a large black-and-white abstract sculpture, observing it closely.  \n- A man in a plaid shirt walks past the sculpture, moving toward the right side of the frame, while another person in a striped shirt and pink pants is visible further back.\n[450-480s] - A large, textured painting depicting dogs in a forest setting is mounted on a white wall, with snowflakes visibly falling in the scene.\n- To the left, a smaller painting shows a landscape with mountains and a lake, while to the right, a red abstract painting hangs above a display of small framed artworks.\n- A man in a colorful shirt stands near a sculpture of a cow, observing the art, while other visitors are visible in the background.", "history_tokens": 997, "history_utf8_bytes": 4334, "recent_frame_times_s": [457.01764322916665, 458.01764322916665, 459.01764322916665, 460.01764322916665, 461.01764322916665, 462.01764322916665, 463.01764322916665, 464.01764322916665, 465.01764322916665, 466.01764322916665, 467.01764322916665, 468.01764322916665, 469.01764322916665, 470.01764322916665, 471.01764322916665, 472.01764322916665, 473.01764322916665, 474.01764322916665, 475.01764322916665, 476.01764322916665, 477.01764322916665, 478.01764322916665, 479.01764322916665, 480.01764322916665, 481.01764322916665, 482.01764322916665, 483.01764322916665, 484.01764322916665, 485.01764322916665, 486.01764322916665], "recent_frames_sha256": "8ffafb035848873137de2a8cff2f496ffd6bcb8d00179d47bc1f250a14a899d4", "num_recent_frames": 30, "tq": 717600.052786436, "t1": 717612.286946841, "ta": 717612.286946841, "te": 717612.444976621, "first_response_s": 12.234160405001603, "answer_total_s": 12.39219018490985, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 468, "content_group": "7df2246c61e18f51cae9f203a29cbd91c575b085c2dfdc48fbce128c0f3b3ee3", "question": {"question_id": "sample_468_a604_q0", "video_id": 468, "video_path": "./videos/sample_468_real.mp4", "annotation_index": 604, "question_index": 0, "question": "What is depicted in the sculpture shown just now", "options": ["A. A person holding a tree.", "B. A person holding a book.", "C. A person holding a bird.", "D. A person holding a house."], "answer": "D", "time_stamp_s": 488, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "art_show", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_468_a604_q0", "video_id": 468, "time_stamp_s": 488, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "45b820632fe04a4f01f458ab4abfce8b1b5afd462e6aefe1962bc090bd10c707", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [458.01764322916665, 459.01764322916665, 460.01764322916665, 461.01764322916665, 462.01764322916665, 463.01764322916665, 464.01764322916665, 465.01764322916665, 466.01764322916665, 467.01764322916665, 468.01764322916665, 469.01764322916665, 470.01764322916665, 471.01764322916665, 472.01764322916665, 473.01764322916665, 474.01764322916665, 475.01764322916665, 476.01764322916665, 477.01764322916665, 478.01764322916665, 479.01764322916665, 480.01764322916665, 481.01764322916665, 482.01764322916665, 483.01764322916665, 484.01764322916665, 485.01764322916665, 486.01764322916665, 487.01764322916665], "recent_frames_sha256": "1883df0889819d7dff1ac8984fc98c4c52d1128240c051b08a69b6ecaef60d52", "num_recent_frames": 30, "tq": 717442.126656305, "t1": 717448.88053435, "ta": 717448.88053435, "te": 717448.917252279, "first_response_s": 6.753878045012243, "answer_total_s": 6.790595973958261, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_468_a604_q0", "video_id": 468, "time_stamp_s": 488, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "859ec3bc0b66abfbcd235d50977dde2dd185cd88873bc4000bfd1b17bcd0167b", "condition_order": ["recent", "notes"], "memory": "[150-180s] - A large blue abstract painting with white lines dominates the left side of the wall.  \n- To its right, a series of smaller, colorful circular and geometric artworks are displayed, including a prominent rainbow-colored circular piece.  \n- The camera pans right, revealing a white curtain partially obscuring the view of additional artworks.\n[180-210s] - A golden, sculptural \"BLA BLA BLA\" installation hangs on a white wall, partially obscured by a person's head in frame.  \n- A grid of framed record art pieces, featuring colorful vinyl labels and stylized faces, is mounted on the adjacent wall.  \n- A blue sign reading \"ICE GALLERY 1981/1980\" is visible above the ceiling, indicating the gallery's name and year.\n[210-240s] - A large, colorful, framed artwork depicting a stylized face with intricate patterns hangs on a white wall.  \n- A black, circular object with white text reading \"THE ART OF\" sits on a small white pedestal near a display case.  \n- A tall, illuminated display case with multiple compartments, each showcasing different artworks, is positioned to the right of the circular object.\n[240-270s] - A large, cow-shaped sculpture made of recycled materials is displayed indoors, surrounded by visitors.  \n- People are seen observing and photographing the sculpture, with some holding signs or pointing at it.  \n- The sculpture is positioned near a wall with framed artwork, including a prominent painting of a blue-skinned figure playing a flute.\n[270-300s] - A large, colorful circular mosaic artwork with concentric rings is mounted on a white wall, positioned above a smaller similar piece.  \n- A 3D sculpted human face, constructed from stacked cubes, is displayed on a pedestal to the left of the circular artworks.  \n- Visitors, including a man in a red jacket and a woman in a white top, are seen walking past the artworks, observing them.\n[300-330s] - A black-and-white framed portrait of a man playing a guitar, with the text \"LEAD SLY\" prominently displayed, is mounted on a white wall.  \n- To the right of the portrait, a series of circular, colorful paintings depicting landscapes are arranged vertically.  \n- A tall, dark-colored lamp with a glass base and multiple curved arms stands on a white pedestal, positioned between the portrait and the landscape paintings.\n[330-360s] - A silver, leafy sculpture with a face is displayed on a wooden pedestal, surrounded by other sculptures.  \n- A large, ornate-framed painting of a nude figure is mounted on the wall, with a smaller painting to its right.  \n- Visitors are seen walking through the gallery, observing the art, with some standing near the sculptures and paintings.\n[360-390s] - A large, ornate gold-framed painting depicts a classical scene with figures in a dimly lit setting, positioned left of a textured, multi-colored abstract piece.  \n- The abstract artwork, composed of layered, spiky materials in warm and cool tones, hangs adjacent to the painting, creating a contrast in texture and style.  \n- A person in a blue top is partially visible on the right, appearing to interact with or observe the artworks, though their specific action is unclear.\n[390-420s] - A large black-framed artwork depicting a stylized rabbit head hangs prominently on the wall.  \n- Below it, a smaller framed piece with the text \"GORT KLAATU BARADA NIKTO\" is visible.  \n- To the right, a colorful abstract painting with vibrant hues is mounted on the wall.\n[420-450s] - A large, glittery yellow and blue abstract painting is centrally displayed on a white wall, surrounded by other colorful artworks.  \n- A woman in a dark tank top and jeans stands near a large black-and-white abstract sculpture, observing it closely.  \n- A man in a plaid shirt walks past the sculpture, moving toward the right side of the frame, while another person in a striped shirt and pink pants is visible further back.\n[450-480s] - A large, textured painting depicting dogs in a forest setting is mounted on a white wall, with snowflakes visibly falling in the scene.\n- To the left, a smaller painting shows a landscape with mountains and a lake, while to the right, a red abstract painting hangs above a display of small framed artworks.\n- A man in a colorful shirt stands near a sculpture of a cow, observing the art, while other visitors are visible in the background.", "history_tokens": 997, "history_utf8_bytes": 4334, "recent_frame_times_s": [458.01764322916665, 459.01764322916665, 460.01764322916665, 461.01764322916665, 462.01764322916665, 463.01764322916665, 464.01764322916665, 465.01764322916665, 466.01764322916665, 467.01764322916665, 468.01764322916665, 469.01764322916665, 470.01764322916665, 471.01764322916665, 472.01764322916665, 473.01764322916665, 474.01764322916665, 475.01764322916665, 476.01764322916665, 477.01764322916665, 478.01764322916665, 479.01764322916665, 480.01764322916665, 481.01764322916665, 482.01764322916665, 483.01764322916665, 484.01764322916665, 485.01764322916665, 486.01764322916665, 487.01764322916665], "recent_frames_sha256": "1883df0889819d7dff1ac8984fc98c4c52d1128240c051b08a69b6ecaef60d52", "num_recent_frames": 30, "tq": 717612.469872778, "t1": 717624.641626341, "ta": 717624.641626341, "te": 717624.946489342, "first_response_s": 12.17175356298685, "answer_total_s": 12.476616563973948, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 468, "content_group": "7df2246c61e18f51cae9f203a29cbd91c575b085c2dfdc48fbce128c0f3b3ee3", "question": {"question_id": "sample_468_a604_q2", "video_id": 468, "video_path": "./videos/sample_468_real.mp4", "annotation_index": 604, "question_index": 2, "question": "What text is seen directly above the colorful painting shown right now?", "options": ["A. \"Gallery of Modern Art\".", "B. \"Sunset Landscape\".", "C. \"Art Exhibition\".", "D. \"Wonsook Kim\"."], "answer": "D", "time_stamp_s": 490, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_468_a604_q2", "video_id": 468, "time_stamp_s": 490, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "88016c4e91b61076c0076fd3890db96792c5deb4416cf35a70482dafaa3c3639", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [460.01764322916665, 461.01764322916665, 462.01764322916665, 463.01764322916665, 464.01764322916665, 465.01764322916665, 466.01764322916665, 467.01764322916665, 468.01764322916665, 469.01764322916665, 470.01764322916665, 471.01764322916665, 472.01764322916665, 473.01764322916665, 474.01764322916665, 475.01764322916665, 476.01764322916665, 477.01764322916665, 478.01764322916665, 479.01764322916665, 480.01764322916665, 481.01764322916665, 482.01764322916665, 483.01764322916665, 484.01764322916665, 485.01764322916665, 486.01764322916665, 487.01764322916665, 488.01764322916665, 489.01764322916665], "recent_frames_sha256": "d5a3a24845917b1edc7ed82ac31930c892077c943db46f3a36f16ffbd788c901", "num_recent_frames": 30, "tq": 717448.937961218, "t1": 717461.669681549, "ta": 717461.669681549, "te": 717461.856559573, "first_response_s": 12.731720331008546, "answer_total_s": 12.918598355026916, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_468_a604_q2", "video_id": 468, "time_stamp_s": 490, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a68658d4d318cf115ff2c2c35863f9c4a9d793bba9ac25e5d78753fdca6759ec", "condition_order": ["recent", "notes"], "memory": "[150-180s] - A large blue abstract painting with white lines dominates the left side of the wall.  \n- To its right, a series of smaller, colorful circular and geometric artworks are displayed, including a prominent rainbow-colored circular piece.  \n- The camera pans right, revealing a white curtain partially obscuring the view of additional artworks.\n[180-210s] - A golden, sculptural \"BLA BLA BLA\" installation hangs on a white wall, partially obscured by a person's head in frame.  \n- A grid of framed record art pieces, featuring colorful vinyl labels and stylized faces, is mounted on the adjacent wall.  \n- A blue sign reading \"ICE GALLERY 1981/1980\" is visible above the ceiling, indicating the gallery's name and year.\n[210-240s] - A large, colorful, framed artwork depicting a stylized face with intricate patterns hangs on a white wall.  \n- A black, circular object with white text reading \"THE ART OF\" sits on a small white pedestal near a display case.  \n- A tall, illuminated display case with multiple compartments, each showcasing different artworks, is positioned to the right of the circular object.\n[240-270s] - A large, cow-shaped sculpture made of recycled materials is displayed indoors, surrounded by visitors.  \n- People are seen observing and photographing the sculpture, with some holding signs or pointing at it.  \n- The sculpture is positioned near a wall with framed artwork, including a prominent painting of a blue-skinned figure playing a flute.\n[270-300s] - A large, colorful circular mosaic artwork with concentric rings is mounted on a white wall, positioned above a smaller similar piece.  \n- A 3D sculpted human face, constructed from stacked cubes, is displayed on a pedestal to the left of the circular artworks.  \n- Visitors, including a man in a red jacket and a woman in a white top, are seen walking past the artworks, observing them.\n[300-330s] - A black-and-white framed portrait of a man playing a guitar, with the text \"LEAD SLY\" prominently displayed, is mounted on a white wall.  \n- To the right of the portrait, a series of circular, colorful paintings depicting landscapes are arranged vertically.  \n- A tall, dark-colored lamp with a glass base and multiple curved arms stands on a white pedestal, positioned between the portrait and the landscape paintings.\n[330-360s] - A silver, leafy sculpture with a face is displayed on a wooden pedestal, surrounded by other sculptures.  \n- A large, ornate-framed painting of a nude figure is mounted on the wall, with a smaller painting to its right.  \n- Visitors are seen walking through the gallery, observing the art, with some standing near the sculptures and paintings.\n[360-390s] - A large, ornate gold-framed painting depicts a classical scene with figures in a dimly lit setting, positioned left of a textured, multi-colored abstract piece.  \n- The abstract artwork, composed of layered, spiky materials in warm and cool tones, hangs adjacent to the painting, creating a contrast in texture and style.  \n- A person in a blue top is partially visible on the right, appearing to interact with or observe the artworks, though their specific action is unclear.\n[390-420s] - A large black-framed artwork depicting a stylized rabbit head hangs prominently on the wall.  \n- Below it, a smaller framed piece with the text \"GORT KLAATU BARADA NIKTO\" is visible.  \n- To the right, a colorful abstract painting with vibrant hues is mounted on the wall.\n[420-450s] - A large, glittery yellow and blue abstract painting is centrally displayed on a white wall, surrounded by other colorful artworks.  \n- A woman in a dark tank top and jeans stands near a large black-and-white abstract sculpture, observing it closely.  \n- A man in a plaid shirt walks past the sculpture, moving toward the right side of the frame, while another person in a striped shirt and pink pants is visible further back.\n[450-480s] - A large, textured painting depicting dogs in a forest setting is mounted on a white wall, with snowflakes visibly falling in the scene.\n- To the left, a smaller painting shows a landscape with mountains and a lake, while to the right, a red abstract painting hangs above a display of small framed artworks.\n- A man in a colorful shirt stands near a sculpture of a cow, observing the art, while other visitors are visible in the background.", "history_tokens": 997, "history_utf8_bytes": 4334, "recent_frame_times_s": [460.01764322916665, 461.01764322916665, 462.01764322916665, 463.01764322916665, 464.01764322916665, 465.01764322916665, 466.01764322916665, 467.01764322916665, 468.01764322916665, 469.01764322916665, 470.01764322916665, 471.01764322916665, 472.01764322916665, 473.01764322916665, 474.01764322916665, 475.01764322916665, 476.01764322916665, 477.01764322916665, 478.01764322916665, 479.01764322916665, 480.01764322916665, 481.01764322916665, 482.01764322916665, 483.01764322916665, 484.01764322916665, 485.01764322916665, 486.01764322916665, 487.01764322916665, 488.01764322916665, 489.01764322916665], "recent_frames_sha256": "d5a3a24845917b1edc7ed82ac31930c892077c943db46f3a36f16ffbd788c901", "num_recent_frames": 30, "tq": 717624.976673427, "t1": 717625.942044515, "ta": 717625.942044515, "te": 717626.319519573, "first_response_s": 0.9653710880083963, "answer_total_s": 1.3428461459698156, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 468, "content_group": "7df2246c61e18f51cae9f203a29cbd91c575b085c2dfdc48fbce128c0f3b3ee3", "question": {"question_id": "sample_468_a605_q0", "video_id": 468, "video_path": "./videos/sample_468_real.mp4", "annotation_index": 605, "question_index": 0, "question": "What text is displayed above the screen currently shown in the video?", "options": ["A. Gallery Name.", "B. Exhibit Title.", "C. Artist's Signature.", "D. Jin Hyu Lee."], "answer": "D", "time_stamp_s": 583, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [540, 588], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_468_a605_q0", "video_id": 468, "time_stamp_s": 583, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e3e1544cc68704f00f74fdf1280ba95e85619cf0559d0754aad2cfd8e5bccbe9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [553.0176432291667, 554.0176432291667, 555.0176432291667, 556.0176432291667, 557.0176432291667, 558.0176432291667, 559.0176432291667, 560.0176432291667, 561.0176432291667, 562.0176432291667, 563.0176432291667, 564.0176432291667, 565.0176432291667, 566.0176432291667, 567.0176432291667, 568.0176432291667, 569.0176432291667, 570.0176432291667, 571.0176432291667, 572.0176432291667, 573.0176432291667, 574.0176432291667, 575.0176432291667, 576.0176432291667, 577.0176432291667, 578.0176432291667, 579.0176432291667, 580.0176432291667, 581.0176432291667, 582.0176432291667], "recent_frames_sha256": "e601eb58c1588e5b9b9f3a67cf2400e69411157c8582c7a930d7d4b91ddab2ca", "num_recent_frames": 30, "tq": 717461.877306574, "t1": 717474.923337678, "ta": 717474.923337678, "te": 717474.962876122, "first_response_s": 13.046031103935093, "answer_total_s": 13.085569547954947, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_468_a605_q0", "video_id": 468, "time_stamp_s": 583, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5e923a45b5d2503f5d2fef5bf4b307204c20e0fa820d97e1d3ee7c7da0864ac8", "condition_order": ["recent", "notes"], "memory": "[270-300s] - A large, colorful circular mosaic artwork with concentric rings is mounted on a white wall, positioned above a smaller similar piece.  \n- A 3D sculpted human face, constructed from stacked cubes, is displayed on a pedestal to the left of the circular artworks.  \n- Visitors, including a man in a red jacket and a woman in a white top, are seen walking past the artworks, observing them.\n[300-330s] - A black-and-white framed portrait of a man playing a guitar, with the text \"LEAD SLY\" prominently displayed, is mounted on a white wall.  \n- To the right of the portrait, a series of circular, colorful paintings depicting landscapes are arranged vertically.  \n- A tall, dark-colored lamp with a glass base and multiple curved arms stands on a white pedestal, positioned between the portrait and the landscape paintings.\n[330-360s] - A silver, leafy sculpture with a face is displayed on a wooden pedestal, surrounded by other sculptures.  \n- A large, ornate-framed painting of a nude figure is mounted on the wall, with a smaller painting to its right.  \n- Visitors are seen walking through the gallery, observing the art, with some standing near the sculptures and paintings.\n[360-390s] - A large, ornate gold-framed painting depicts a classical scene with figures in a dimly lit setting, positioned left of a textured, multi-colored abstract piece.  \n- The abstract artwork, composed of layered, spiky materials in warm and cool tones, hangs adjacent to the painting, creating a contrast in texture and style.  \n- A person in a blue top is partially visible on the right, appearing to interact with or observe the artworks, though their specific action is unclear.\n[390-420s] - A large black-framed artwork depicting a stylized rabbit head hangs prominently on the wall.  \n- Below it, a smaller framed piece with the text \"GORT KLAATU BARADA NIKTO\" is visible.  \n- To the right, a colorful abstract painting with vibrant hues is mounted on the wall.\n[420-450s] - A large, glittery yellow and blue abstract painting is centrally displayed on a white wall, surrounded by other colorful artworks.  \n- A woman in a dark tank top and jeans stands near a large black-and-white abstract sculpture, observing it closely.  \n- A man in a plaid shirt walks past the sculpture, moving toward the right side of the frame, while another person in a striped shirt and pink pants is visible further back.\n[450-480s] - A large, textured painting depicting dogs in a forest setting is mounted on a white wall, with snowflakes visibly falling in the scene.\n- To the left, a smaller painting shows a landscape with mountains and a lake, while to the right, a red abstract painting hangs above a display of small framed artworks.\n- A man in a colorful shirt stands near a sculpture of a cow, observing the art, while other visitors are visible in the background.\n[480-510s] - A white pedestal holds a ceramic sculpture with a wooden base, positioned near a wall.  \n- A large painting titled \"Wonsook Kim\" depicts stylized figures in a landscape with mountains and a winding path.  \n- Several smaller framed artworks, including abstract and figurative pieces, are mounted on the wall adjacent to the large painting.\n[510-540s] - A blue sign labeled \"PONDER VOY 402\" is mounted on a white tiled wall, adjacent to a large gray panel.  \n- The gray panel displays the name \"Jin Hyu Lee\" in black text, with a digital screen and a poster featuring \"Bande Box\" and \"JIN HYU LEE\" positioned below it.  \n- A large, colorful mosaic artwork depicting a building facade with numerous windows and vibrant, abstract elements is mounted on the wall to the right of the panel.\n[540-570s] - A large, red, pixelated portrait of a face is displayed on a white wall, with two circular objects (possibly CDs or coins) affixed to its upper right and lower right corners.\n- To the left of the portrait, a large informational panel about \"Jin Hyu Lee\" is mounted on the wall, featuring a photograph of a man in climbing gear and text detailing his background.\n- The camera pans left, revealing a large, grid-like artwork composed of numerous small photographs arranged in rows and columns, positioned to the left of the red portrait.", "history_tokens": 979, "history_utf8_bytes": 4203, "recent_frame_times_s": [553.0176432291667, 554.0176432291667, 555.0176432291667, 556.0176432291667, 557.0176432291667, 558.0176432291667, 559.0176432291667, 560.0176432291667, 561.0176432291667, 562.0176432291667, 563.0176432291667, 564.0176432291667, 565.0176432291667, 566.0176432291667, 567.0176432291667, 568.0176432291667, 569.0176432291667, 570.0176432291667, 571.0176432291667, 572.0176432291667, 573.0176432291667, 574.0176432291667, 575.0176432291667, 576.0176432291667, 577.0176432291667, 578.0176432291667, 579.0176432291667, 580.0176432291667, 581.0176432291667, 582.0176432291667], "recent_frames_sha256": "e601eb58c1588e5b9b9f3a67cf2400e69411157c8582c7a930d7d4b91ddab2ca", "num_recent_frames": 30, "tq": 717650.260186247, "t1": 717662.562054957, "ta": 717662.562054957, "te": 717662.718191985, "first_response_s": 12.301868710084818, "answer_total_s": 12.45800573809538, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 469, "content_group": "dcd2eaa7b4d0cadb60f8c3d659bfababaf6378addd6df245d5fad81ed724422d", "question": {"question_id": "sample_469_a1964_q0", "video_id": 469, "video_path": "./videos/sample_469_real.mp4", "annotation_index": 1964, "question_index": 0, "question": "What shape is the transparent sculpture placed on the clear pedestal shown just now?", "options": ["A. Star.", "B. Circle.", "C. Heart.", "D. Triangle."], "answer": "C", "time_stamp_s": 173, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_469_a1964_q0", "video_id": 469, "time_stamp_s": 173, "ground_truth": "C", "raw_output": "C. Heart.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "143d9d8ebb3869131d4f45912e4060367b8ec0c3855487cfa4df810bd1280895", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [143.01067708333332, 144.01067708333332, 145.01067708333332, 146.01067708333332, 147.01067708333332, 148.01067708333332, 149.01067708333332, 150.01067708333332, 151.01067708333332, 152.01067708333332, 153.01067708333332, 154.01067708333332, 155.01067708333332, 156.01067708333332, 157.01067708333332, 158.01067708333332, 159.01067708333332, 160.01067708333332, 161.01067708333332, 162.01067708333332, 163.01067708333332, 164.01067708333332, 165.01067708333332, 166.01067708333332, 167.01067708333332, 168.01067708333332, 169.01067708333332, 170.01067708333332, 171.01067708333332, 172.01067708333332], "recent_frames_sha256": "08f16d5bb61d719bbb105dca15a61a0482ba03ed4d363c7554659bd8edf7807c", "num_recent_frames": 30, "tq": 710018.722878556, "t1": 710020.638007857, "ta": 710020.638007857, "te": 710020.793197314, "first_response_s": 1.915129301021807, "answer_total_s": 2.07031875802204, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_469_a1964_q0", "video_id": 469, "time_stamp_s": 173, "ground_truth": "C", "raw_output": "C. Heart.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "ebc0e4e6378aa19cc1fb9932530e9cb0fe8526e097edc1ce3c8a77f4101aa35e", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A large screen displays a grid of images, then transitions to a mosaic portrait of a person with red and purple tones.  \n- Gallery Elim's exhibition space features black-and-white abstract art, including a series of four vertical panels depicting blurred human forms.  \n- The gallery walls are adorned with colorful pop-art prints and other artworks, with visitors walking through the space.\n[30-60s] - A woman in a light blue sleeveless top stands near a wall displaying abstract paintings, her gaze directed toward the art.  \n- The camera pans right, revealing a series of colorful, abstract canvases with intricate patterns, arranged in a grid.  \n- A large horizontal photograph of a woman in profile is mounted above a smaller abstract piece, with a digital display screen visible to the right.\n[60-90s] - A woman in a yellow jacket stands near a wall displaying colorful abstract paintings, holding a phone.  \n- A large, vibrant yellow textured artwork is mounted on the wall, positioned below a framed abstract piece.  \n- The gallery space features multiple artworks, including a grid of colorful, vertically striped panels with pixelated lower sections.\n[90-120s] - A group of colorful, stylized figurines in dynamic poses are displayed on black circular bases, positioned against a white wall with abstract art behind them.  \n- A large, circular metallic sculpture depicting a seated figure atop a globe-like structure is mounted on the wall, with descriptive plaques nearby.  \n- A series of abstract paintings with vibrant vertical stripes and textured surfaces are arranged in a row, adjacent to a pink patterned textile piece.\n[120-150s] - A pink patterned textile hangs on the wall, partially covered by scattered pink powder on the floor.  \n- A circular gold-toned artwork with black speckles is mounted above a black-framed piece with golden, textured vertical elements.  \n- To the left, a teal canvas depicting a pomegranate is visible, alongside other colorful abstract paintings.", "history_tokens": 423, "history_utf8_bytes": 2006, "recent_frame_times_s": [143.01067708333332, 144.01067708333332, 145.01067708333332, 146.01067708333332, 147.01067708333332, 148.01067708333332, 149.01067708333332, 150.01067708333332, 151.01067708333332, 152.01067708333332, 153.01067708333332, 154.01067708333332, 155.01067708333332, 156.01067708333332, 157.01067708333332, 158.01067708333332, 159.01067708333332, 160.01067708333332, 161.01067708333332, 162.01067708333332, 163.01067708333332, 164.01067708333332, 165.01067708333332, 166.01067708333332, 167.01067708333332, 168.01067708333332, 169.01067708333332, 170.01067708333332, 171.01067708333332, 172.01067708333332], "recent_frames_sha256": "08f16d5bb61d719bbb105dca15a61a0482ba03ed4d363c7554659bd8edf7807c", "num_recent_frames": 30, "tq": 710095.954027467, "t1": 710101.486293464, "ta": 710101.486293464, "te": 710101.671633212, "first_response_s": 5.5322659969097, "answer_total_s": 5.717605744954199, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 469, "content_group": "dcd2eaa7b4d0cadb60f8c3d659bfababaf6378addd6df245d5fad81ed724422d", "question": {"question_id": "sample_469_a1965_q0", "video_id": 469, "video_path": "./videos/sample_469_real.mp4", "annotation_index": 1965, "question_index": 0, "question": "What name is visible above a large painting of a face with bold, expressive brushstrokes?", "options": ["A. VEILLEUX.", "B. CICIOVAN.", "C. MONET.", "D. TREMBLAY."], "answer": "D", "time_stamp_s": 321, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_469_a1965_q0", "video_id": 469, "time_stamp_s": 321, "ground_truth": "D", "raw_output": "D. TREMBLAY.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "4d58f969a94523ced34921cfbd3b1608a9c11339036b04615ab360142bea530d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [291.01067708333335, 292.01067708333335, 293.01067708333335, 294.01067708333335, 295.01067708333335, 296.01067708333335, 297.01067708333335, 298.01067708333335, 299.01067708333335, 300.01067708333335, 301.01067708333335, 302.01067708333335, 303.01067708333335, 304.01067708333335, 305.01067708333335, 306.01067708333335, 307.01067708333335, 308.01067708333335, 309.01067708333335, 310.01067708333335, 311.01067708333335, 312.01067708333335, 313.01067708333335, 314.01067708333335, 315.01067708333335, 316.01067708333335, 317.01067708333335, 318.01067708333335, 319.01067708333335, 320.01067708333335], "recent_frames_sha256": "6db0034d44f7c1a82dce27e91e021dae7073ec67c82d3982606b34a7c65e5a09", "num_recent_frames": 30, "tq": 710020.831760908, "t1": 710028.895189787, "ta": 710028.895189787, "te": 710029.118923049, "first_response_s": 8.06342887901701, "answer_total_s": 8.28716214094311, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_469_a1965_q0", "video_id": 469, "time_stamp_s": 321, "ground_truth": "D", "raw_output": "D. TREMBLAY.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "5bfeab7e7b5667ea5ebd8801bc2c87cba5978f87e716eb0f37da515a1e2bb16f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A large screen displays a grid of images, then transitions to a mosaic portrait of a person with red and purple tones.  \n- Gallery Elim's exhibition space features black-and-white abstract art, including a series of four vertical panels depicting blurred human forms.  \n- The gallery walls are adorned with colorful pop-art prints and other artworks, with visitors walking through the space.\n[30-60s] - A woman in a light blue sleeveless top stands near a wall displaying abstract paintings, her gaze directed toward the art.  \n- The camera pans right, revealing a series of colorful, abstract canvases with intricate patterns, arranged in a grid.  \n- A large horizontal photograph of a woman in profile is mounted above a smaller abstract piece, with a digital display screen visible to the right.\n[60-90s] - A woman in a yellow jacket stands near a wall displaying colorful abstract paintings, holding a phone.  \n- A large, vibrant yellow textured artwork is mounted on the wall, positioned below a framed abstract piece.  \n- The gallery space features multiple artworks, including a grid of colorful, vertically striped panels with pixelated lower sections.\n[90-120s] - A group of colorful, stylized figurines in dynamic poses are displayed on black circular bases, positioned against a white wall with abstract art behind them.  \n- A large, circular metallic sculpture depicting a seated figure atop a globe-like structure is mounted on the wall, with descriptive plaques nearby.  \n- A series of abstract paintings with vibrant vertical stripes and textured surfaces are arranged in a row, adjacent to a pink patterned textile piece.\n[120-150s] - A pink patterned textile hangs on the wall, partially covered by scattered pink powder on the floor.  \n- A circular gold-toned artwork with black speckles is mounted above a black-framed piece with golden, textured vertical elements.  \n- To the left, a teal canvas depicting a pomegranate is visible, alongside other colorful abstract paintings.\n[150-180s] - A person in dark clothing stands near a white shelving unit displaying various handbags and accessories.  \n- A large, colorful mosaic artwork with circular patterns dominates the wall, transitioning from teal to blue.  \n- A transparent acrylic heart sculpture with a gradient of pink to yellow sits on a pedestal, positioned near a framed photograph of a crowded event.\n[180-210s] - A large abstract painting with two human-like silhouettes hangs on a white wall, flanked by small sculptures on pedestals.  \n- To the right, a series of colorful, vertically arranged artworks are displayed in a white shelving unit.  \n- The camera pans left, revealing a blue sign labeled \"1102\" above a doorway leading to another gallery area.\n[210-240s] - A visitor in a blue patterned jacket walks past a wall of colorful square panels.  \n- A large black geometric sculpture dominates the central wall space.  \n- The \"Peri & Fine\" logo is visible on the ceiling above the sculpture.\n[240-270s] - A metallic, abstract sculpture with a square cutout stands on a white pedestal, positioned left of a framed painting.  \n- Two tall, black pedestal sculptures with metallic tops are displayed next to a large, ornate gold-framed abstract painting.  \n- A smaller, similarly framed abstract painting is mounted to the right of the larger one, both on a white wall.\n[270-300s] - A bronze bull sculpture stands on a white pedestal, positioned between two framed artworks.  \n- To the left, a series of portrait paintings with yellow and black abstract elements are displayed.  \n- A metal wire sculpture of a deer is visible on the right, near a crowd of attendees.", "history_tokens": 803, "history_utf8_bytes": 3658, "recent_frame_times_s": [291.01067708333335, 292.01067708333335, 293.01067708333335, 294.01067708333335, 295.01067708333335, 296.01067708333335, 297.01067708333335, 298.01067708333335, 299.01067708333335, 300.01067708333335, 301.01067708333335, 302.01067708333335, 303.01067708333335, 304.01067708333335, 305.01067708333335, 306.01067708333335, 307.01067708333335, 308.01067708333335, 309.01067708333335, 310.01067708333335, 311.01067708333335, 312.01067708333335, 313.01067708333335, 314.01067708333335, 315.01067708333335, 316.01067708333335, 317.01067708333335, 318.01067708333335, 319.01067708333335, 320.01067708333335], "recent_frames_sha256": "6db0034d44f7c1a82dce27e91e021dae7073ec67c82d3982606b34a7c65e5a09", "num_recent_frames": 30, "tq": 710146.139141441, "t1": 710151.645792765, "ta": 710151.645792765, "te": 710151.860824554, "first_response_s": 5.506651323987171, "answer_total_s": 5.721683113020845, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 469, "content_group": "dcd2eaa7b4d0cadb60f8c3d659bfababaf6378addd6df245d5fad81ed724422d", "question": {"question_id": "sample_469_a1965_q1", "video_id": 469, "video_path": "./videos/sample_469_real.mp4", "annotation_index": 1965, "question_index": 1, "question": "Which names are visible now", "options": ["A. VEILLEUX and MONET.", "B. MONET and TREMBLAY.", "C. CICIOVAN and VEILLEUX.", "D. TREMBLAY and CICIOVAN."], "answer": "D", "time_stamp_s": 333, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_469_a1965_q1", "video_id": 469, "time_stamp_s": 333, "ground_truth": "D", "raw_output": "C. CICIOVAN and VEILLEUX.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "c792bfae35b2e6091e5b875ddb49b5cdeba2997206946f4b3ce25b0f917717d8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [303.01067708333335, 304.01067708333335, 305.01067708333335, 306.01067708333335, 307.01067708333335, 308.01067708333335, 309.01067708333335, 310.01067708333335, 311.01067708333335, 312.01067708333335, 313.01067708333335, 314.01067708333335, 315.01067708333335, 316.01067708333335, 317.01067708333335, 318.01067708333335, 319.01067708333335, 320.01067708333335, 321.01067708333335, 322.01067708333335, 323.01067708333335, 324.01067708333335, 325.01067708333335, 326.01067708333335, 327.01067708333335, 328.01067708333335, 329.01067708333335, 330.01067708333335, 331.01067708333335, 332.01067708333335], "recent_frames_sha256": "973e7de21ae983e530f2b1a6d8a2565ee23447a3713e2d6778b41fa13a30914b", "num_recent_frames": 30, "tq": 710029.162268312, "t1": 710036.058577866, "ta": 710036.058577866, "te": 710036.498330462, "first_response_s": 6.896309553994797, "answer_total_s": 7.336062150076032, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_469_a1965_q1", "video_id": 469, "time_stamp_s": 333, "ground_truth": "D", "raw_output": "D. TREMBLAY and CICIOVAN.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "16f036fe3b02ef7c77d54e29b2e93a81a8c05d6ec1a03fdd9cf776629ddd739c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A large screen displays a grid of images, then transitions to a mosaic portrait of a person with red and purple tones.  \n- Gallery Elim's exhibition space features black-and-white abstract art, including a series of four vertical panels depicting blurred human forms.  \n- The gallery walls are adorned with colorful pop-art prints and other artworks, with visitors walking through the space.\n[30-60s] - A woman in a light blue sleeveless top stands near a wall displaying abstract paintings, her gaze directed toward the art.  \n- The camera pans right, revealing a series of colorful, abstract canvases with intricate patterns, arranged in a grid.  \n- A large horizontal photograph of a woman in profile is mounted above a smaller abstract piece, with a digital display screen visible to the right.\n[60-90s] - A woman in a yellow jacket stands near a wall displaying colorful abstract paintings, holding a phone.  \n- A large, vibrant yellow textured artwork is mounted on the wall, positioned below a framed abstract piece.  \n- The gallery space features multiple artworks, including a grid of colorful, vertically striped panels with pixelated lower sections.\n[90-120s] - A group of colorful, stylized figurines in dynamic poses are displayed on black circular bases, positioned against a white wall with abstract art behind them.  \n- A large, circular metallic sculpture depicting a seated figure atop a globe-like structure is mounted on the wall, with descriptive plaques nearby.  \n- A series of abstract paintings with vibrant vertical stripes and textured surfaces are arranged in a row, adjacent to a pink patterned textile piece.\n[120-150s] - A pink patterned textile hangs on the wall, partially covered by scattered pink powder on the floor.  \n- A circular gold-toned artwork with black speckles is mounted above a black-framed piece with golden, textured vertical elements.  \n- To the left, a teal canvas depicting a pomegranate is visible, alongside other colorful abstract paintings.\n[150-180s] - A person in dark clothing stands near a white shelving unit displaying various handbags and accessories.  \n- A large, colorful mosaic artwork with circular patterns dominates the wall, transitioning from teal to blue.  \n- A transparent acrylic heart sculpture with a gradient of pink to yellow sits on a pedestal, positioned near a framed photograph of a crowded event.\n[180-210s] - A large abstract painting with two human-like silhouettes hangs on a white wall, flanked by small sculptures on pedestals.  \n- To the right, a series of colorful, vertically arranged artworks are displayed in a white shelving unit.  \n- The camera pans left, revealing a blue sign labeled \"1102\" above a doorway leading to another gallery area.\n[210-240s] - A visitor in a blue patterned jacket walks past a wall of colorful square panels.  \n- A large black geometric sculpture dominates the central wall space.  \n- The \"Peri & Fine\" logo is visible on the ceiling above the sculpture.\n[240-270s] - A metallic, abstract sculpture with a square cutout stands on a white pedestal, positioned left of a framed painting.  \n- Two tall, black pedestal sculptures with metallic tops are displayed next to a large, ornate gold-framed abstract painting.  \n- A smaller, similarly framed abstract painting is mounted to the right of the larger one, both on a white wall.\n[270-300s] - A bronze bull sculpture stands on a white pedestal, positioned between two framed artworks.  \n- To the left, a series of portrait paintings with yellow and black abstract elements are displayed.  \n- A metal wire sculpture of a deer is visible on the right, near a crowd of attendees.\n[300-330s] - A large vertical painting by \"CLAUDE GLUTIER\" is prominently displayed, featuring abstract figures and geometric shapes, with a red door beneath it.  \n- To the right, a colorful abstract painting by \"TREMBLAY\" is visible, with vibrant hues and dynamic brushstrokes.  \n- A person in a light blue shirt stands near the \"TREMBLAY\" artwork, observing it while others browse nearby pieces.", "history_tokens": 901, "history_utf8_bytes": 4056, "recent_frame_times_s": [303.01067708333335, 304.01067708333335, 305.01067708333335, 306.01067708333335, 307.01067708333335, 308.01067708333335, 309.01067708333335, 310.01067708333335, 311.01067708333335, 312.01067708333335, 313.01067708333335, 314.01067708333335, 315.01067708333335, 316.01067708333335, 317.01067708333335, 318.01067708333335, 319.01067708333335, 320.01067708333335, 321.01067708333335, 322.01067708333335, 323.01067708333335, 324.01067708333335, 325.01067708333335, 326.01067708333335, 327.01067708333335, 328.01067708333335, 329.01067708333335, 330.01067708333335, 331.01067708333335, 332.01067708333335], "recent_frames_sha256": "973e7de21ae983e530f2b1a6d8a2565ee23447a3713e2d6778b41fa13a30914b", "num_recent_frames": 30, "tq": 710161.131183678, "t1": 710163.04838702, "ta": 710163.04838702, "te": 710163.498883204, "first_response_s": 1.9172033419599757, "answer_total_s": 2.3676995259011164, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 469, "content_group": "dcd2eaa7b4d0cadb60f8c3d659bfababaf6378addd6df245d5fad81ed724422d", "question": {"question_id": "sample_469_a1966_q1", "video_id": 469, "video_path": "./videos/sample_469_real.mp4", "annotation_index": 1966, "question_index": 1, "question": "What is on the table beneath the lower part of the display?", "options": ["A. Two books and a box.", "B. one book and a box.", "C. A sculpture.", "D. A vase."], "answer": "A", "time_stamp_s": 490, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_469_a1966_q1", "video_id": 469, "time_stamp_s": 490, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3529a713af5c7b9c5812fb300b91d19c59da5632523b08556599003cd66d8b23", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [460.01067708333335, 461.01067708333335, 462.01067708333335, 463.01067708333335, 464.01067708333335, 465.01067708333335, 466.01067708333335, 467.01067708333335, 468.01067708333335, 469.01067708333335, 470.01067708333335, 471.01067708333335, 472.01067708333335, 473.01067708333335, 474.01067708333335, 475.01067708333335, 476.01067708333335, 477.01067708333335, 478.01067708333335, 479.01067708333335, 480.01067708333335, 481.01067708333335, 482.01067708333335, 483.01067708333335, 484.01067708333335, 485.01067708333335, 486.01067708333335, 487.01067708333335, 488.01067708333335, 489.01067708333335], "recent_frames_sha256": "7df2db9571b7fac625552d262e195e6a1e231febe600eb2ce482fab1ef5a75ea", "num_recent_frames": 30, "tq": 710036.516639853, "t1": 710046.708072352, "ta": 710046.708072352, "te": 710046.745267796, "first_response_s": 10.19143249897752, "answer_total_s": 10.22862794296816, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_469_a1966_q1", "video_id": 469, "time_stamp_s": 490, "ground_truth": "A", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d0352fe63d25df8412a83314355dae026efa5ee379882b33fc575466e4b1a6d7", "condition_order": ["recent", "notes"], "memory": "[150-180s] - A person in dark clothing stands near a white shelving unit displaying various handbags and accessories.  \n- A large, colorful mosaic artwork with circular patterns dominates the wall, transitioning from teal to blue.  \n- A transparent acrylic heart sculpture with a gradient of pink to yellow sits on a pedestal, positioned near a framed photograph of a crowded event.\n[180-210s] - A large abstract painting with two human-like silhouettes hangs on a white wall, flanked by small sculptures on pedestals.  \n- To the right, a series of colorful, vertically arranged artworks are displayed in a white shelving unit.  \n- The camera pans left, revealing a blue sign labeled \"1102\" above a doorway leading to another gallery area.\n[210-240s] - A visitor in a blue patterned jacket walks past a wall of colorful square panels.  \n- A large black geometric sculpture dominates the central wall space.  \n- The \"Peri & Fine\" logo is visible on the ceiling above the sculpture.\n[240-270s] - A metallic, abstract sculpture with a square cutout stands on a white pedestal, positioned left of a framed painting.  \n- Two tall, black pedestal sculptures with metallic tops are displayed next to a large, ornate gold-framed abstract painting.  \n- A smaller, similarly framed abstract painting is mounted to the right of the larger one, both on a white wall.\n[270-300s] - A bronze bull sculpture stands on a white pedestal, positioned between two framed artworks.  \n- To the left, a series of portrait paintings with yellow and black abstract elements are displayed.  \n- A metal wire sculpture of a deer is visible on the right, near a crowd of attendees.\n[300-330s] - A large vertical painting by \"CLAUDE GLUTIER\" is prominently displayed, featuring abstract figures and geometric shapes, with a red door beneath it.  \n- To the right, a colorful abstract painting by \"TREMBLAY\" is visible, with vibrant hues and dynamic brushstrokes.  \n- A person in a light blue shirt stands near the \"TREMBLAY\" artwork, observing it while others browse nearby pieces.\n[330-360s] - Artworks by \"TREMBLAY\" and \"CICIOVAN\" are displayed on adjacent walls, with \"CICIOVAN\" featuring a vibrant, abstract piece and \"TREMBLAY\" showing a stylized portrait.  \n- A black chair and white display shelves with smaller artworks are positioned beneath the main canvases.  \n- The camera pans to reveal a sculpture of a horse and rider on a pedestal, with the name \"POTENZA\" prominently displayed above it.\n[360-390s] - A large black metal sculpture of a bird with intricate wing patterns dominates the center of the gallery space.  \n- A blue sign labeled \"GALERIE FISHERBACH 1108\" hangs overhead, indicating the gallery's location.  \n- Artworks, including a framed religious painting and circular portraits, are displayed on a dark green wall to the right.\n[390-420s] - A large, white, sculptural piece with intricate, branching forms is displayed on a dark pedestal, surrounded by visitors.  \n- A framed painting of a woman in a bikini, with vibrant orange and blue tones, hangs on the wall to the right of the sculpture.  \n- A man in a dark hoodie and face mask stands near the sculpture, observing it while holding a phone.\n[420-450s] - A framed painting of a woman with long blonde hair, draped in a light-colored garment, is mounted on a dark teal wall, positioned to the left of a smaller framed portrait.  \n- To the right of the blonde woman painting, a smaller, square-framed portrait depicts a person with a hand near their face, set against a dark background.  \n- Below the blonde woman painting, four framed abstract line drawings are arranged in a 2x2 grid, each with a light-colored mat and minimalistic black ink lines.\n[450-480s] - A framed painting of a nude woman with flowing hair is displayed on a teal wall, positioned above a shelf with a triangular ceramic dish and a small box.  \n- To the left, a series of framed artworks in black and gold frames are arranged in a grid pattern, with a golden-framed piece centered above them.  \n- The camera pans slightly to the right, revealing more framed pieces and a small plaque above the central golden frame, all mounted on the same teal wall.", "history_tokens": 989, "history_utf8_bytes": 4174, "recent_frame_times_s": [460.01067708333335, 461.01067708333335, 462.01067708333335, 463.01067708333335, 464.01067708333335, 465.01067708333335, 466.01067708333335, 467.01067708333335, 468.01067708333335, 469.01067708333335, 470.01067708333335, 471.01067708333335, 472.01067708333335, 473.01067708333335, 474.01067708333335, 475.01067708333335, 476.01067708333335, 477.01067708333335, 478.01067708333335, 479.01067708333335, 480.01067708333335, 481.01067708333335, 482.01067708333335, 483.01067708333335, 484.01067708333335, 485.01067708333335, 486.01067708333335, 487.01067708333335, 488.01067708333335, 489.01067708333335], "recent_frames_sha256": "7df2db9571b7fac625552d262e195e6a1e231febe600eb2ce482fab1ef5a75ea", "num_recent_frames": 30, "tq": 710198.750033077, "t1": 710199.80747646, "ta": 710199.80747646, "te": 710200.028918857, "first_response_s": 1.0574433830333874, "answer_total_s": 1.2788857800187543, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 469, "content_group": "dcd2eaa7b4d0cadb60f8c3d659bfababaf6378addd6df245d5fad81ed724422d", "question": {"question_id": "sample_469_a1966_q0", "video_id": 469, "video_path": "./videos/sample_469_real.mp4", "annotation_index": 1966, "question_index": 0, "question": "What is the appearance of the pink ceramic dish shown on the wall?", "options": ["A. It has floral designs.", "B. It is plain with no designs.", "C. It has geometric patterns.", "D. It has star designs."], "answer": "D", "time_stamp_s": 492, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_469_a1966_q0", "video_id": 469, "time_stamp_s": 492, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ea1a1cfd8c9f40dbaef3d62f6e327f64894299f60c64ac9c0222918d3dfbf9ab", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [462.01067708333335, 463.01067708333335, 464.01067708333335, 465.01067708333335, 466.01067708333335, 467.01067708333335, 468.01067708333335, 469.01067708333335, 470.01067708333335, 471.01067708333335, 472.01067708333335, 473.01067708333335, 474.01067708333335, 475.01067708333335, 476.01067708333335, 477.01067708333335, 478.01067708333335, 479.01067708333335, 480.01067708333335, 481.01067708333335, 482.01067708333335, 483.01067708333335, 484.01067708333335, 485.01067708333335, 486.01067708333335, 487.01067708333335, 488.01067708333335, 489.01067708333335, 490.01067708333335, 491.01067708333335], "recent_frames_sha256": "eb28f35945ebadb9364b5c9aff6d97d8740991c40e64ded60fd6a23278adf0b1", "num_recent_frames": 30, "tq": 710046.764566748, "t1": 710052.855213154, "ta": 710052.855213154, "te": 710052.89195796, "first_response_s": 6.09064640593715, "answer_total_s": 6.127391211921349, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_469_a1966_q0", "video_id": 469, "time_stamp_s": 492, "ground_truth": "D", "raw_output": "D. It has star designs.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "36c2be5d29338f400b36f8e1b5f2414ceb1af21e47de79008909e38c805fc839", "condition_order": ["recent", "notes"], "memory": "[150-180s] - A person in dark clothing stands near a white shelving unit displaying various handbags and accessories.  \n- A large, colorful mosaic artwork with circular patterns dominates the wall, transitioning from teal to blue.  \n- A transparent acrylic heart sculpture with a gradient of pink to yellow sits on a pedestal, positioned near a framed photograph of a crowded event.\n[180-210s] - A large abstract painting with two human-like silhouettes hangs on a white wall, flanked by small sculptures on pedestals.  \n- To the right, a series of colorful, vertically arranged artworks are displayed in a white shelving unit.  \n- The camera pans left, revealing a blue sign labeled \"1102\" above a doorway leading to another gallery area.\n[210-240s] - A visitor in a blue patterned jacket walks past a wall of colorful square panels.  \n- A large black geometric sculpture dominates the central wall space.  \n- The \"Peri & Fine\" logo is visible on the ceiling above the sculpture.\n[240-270s] - A metallic, abstract sculpture with a square cutout stands on a white pedestal, positioned left of a framed painting.  \n- Two tall, black pedestal sculptures with metallic tops are displayed next to a large, ornate gold-framed abstract painting.  \n- A smaller, similarly framed abstract painting is mounted to the right of the larger one, both on a white wall.\n[270-300s] - A bronze bull sculpture stands on a white pedestal, positioned between two framed artworks.  \n- To the left, a series of portrait paintings with yellow and black abstract elements are displayed.  \n- A metal wire sculpture of a deer is visible on the right, near a crowd of attendees.\n[300-330s] - A large vertical painting by \"CLAUDE GLUTIER\" is prominently displayed, featuring abstract figures and geometric shapes, with a red door beneath it.  \n- To the right, a colorful abstract painting by \"TREMBLAY\" is visible, with vibrant hues and dynamic brushstrokes.  \n- A person in a light blue shirt stands near the \"TREMBLAY\" artwork, observing it while others browse nearby pieces.\n[330-360s] - Artworks by \"TREMBLAY\" and \"CICIOVAN\" are displayed on adjacent walls, with \"CICIOVAN\" featuring a vibrant, abstract piece and \"TREMBLAY\" showing a stylized portrait.  \n- A black chair and white display shelves with smaller artworks are positioned beneath the main canvases.  \n- The camera pans to reveal a sculpture of a horse and rider on a pedestal, with the name \"POTENZA\" prominently displayed above it.\n[360-390s] - A large black metal sculpture of a bird with intricate wing patterns dominates the center of the gallery space.  \n- A blue sign labeled \"GALERIE FISHERBACH 1108\" hangs overhead, indicating the gallery's location.  \n- Artworks, including a framed religious painting and circular portraits, are displayed on a dark green wall to the right.\n[390-420s] - A large, white, sculptural piece with intricate, branching forms is displayed on a dark pedestal, surrounded by visitors.  \n- A framed painting of a woman in a bikini, with vibrant orange and blue tones, hangs on the wall to the right of the sculpture.  \n- A man in a dark hoodie and face mask stands near the sculpture, observing it while holding a phone.\n[420-450s] - A framed painting of a woman with long blonde hair, draped in a light-colored garment, is mounted on a dark teal wall, positioned to the left of a smaller framed portrait.  \n- To the right of the blonde woman painting, a smaller, square-framed portrait depicts a person with a hand near their face, set against a dark background.  \n- Below the blonde woman painting, four framed abstract line drawings are arranged in a 2x2 grid, each with a light-colored mat and minimalistic black ink lines.\n[450-480s] - A framed painting of a nude woman with flowing hair is displayed on a teal wall, positioned above a shelf with a triangular ceramic dish and a small box.  \n- To the left, a series of framed artworks in black and gold frames are arranged in a grid pattern, with a golden-framed piece centered above them.  \n- The camera pans slightly to the right, revealing more framed pieces and a small plaque above the central golden frame, all mounted on the same teal wall.", "history_tokens": 989, "history_utf8_bytes": 4174, "recent_frame_times_s": [462.01067708333335, 463.01067708333335, 464.01067708333335, 465.01067708333335, 466.01067708333335, 467.01067708333335, 468.01067708333335, 469.01067708333335, 470.01067708333335, 471.01067708333335, 472.01067708333335, 473.01067708333335, 474.01067708333335, 475.01067708333335, 476.01067708333335, 477.01067708333335, 478.01067708333335, 479.01067708333335, 480.01067708333335, 481.01067708333335, 482.01067708333335, 483.01067708333335, 484.01067708333335, 485.01067708333335, 486.01067708333335, 487.01067708333335, 488.01067708333335, 489.01067708333335, 490.01067708333335, 491.01067708333335], "recent_frames_sha256": "eb28f35945ebadb9364b5c9aff6d97d8740991c40e64ded60fd6a23278adf0b1", "num_recent_frames": 30, "tq": 710200.070561458, "t1": 710205.782356327, "ta": 710205.782356327, "te": 710206.077702379, "first_response_s": 5.711794869042933, "answer_total_s": 6.007140920963138, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 471, "content_group": "ac8a2f9587a947ad89664fd9c82f20d8bf93a530e9cc297827812f6f4af95a3e", "question": {"question_id": "sample_471_a508_q0", "video_id": 471, "video_path": "./videos/sample_471_real.mp4", "annotation_index": 508, "question_index": 0, "question": "What is the position of the third painting in relation to the second painting?", "options": ["A. To the left.", "B. To the right.", "C. Above.", "D. Below."], "answer": "B", "time_stamp_s": 13, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_471_a508_q0", "video_id": 471, "time_stamp_s": 13, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ccf0b66bd8a3c475a6c533de4ab71004baf010e91e78ebba050843e2c0ff45d0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.04700520833333333, 1.013671875, 2.013671875, 3.013671875, 4.013671875, 5.013671875, 6.013671875, 7.013671875, 8.013671875, 9.013671875, 10.013671875, 11.013671875, 12.013671875], "recent_frames_sha256": "7c3ed298a4e18c2bdd63a72e43b7893c2b2290882f34953af6ef70c129e9fedb", "num_recent_frames": 13, "tq": 718017.524013697, "t1": 718027.980116642, "ta": 718027.980116642, "te": 718028.017821886, "first_response_s": 10.456102944910526, "answer_total_s": 10.49380818894133, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_471_a508_q0", "video_id": 471, "time_stamp_s": 13, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cf6424eb124e0ad716e65c28aa9740df07d713794847e068aeb46fabf272c7b1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.04700520833333333, 1.013671875, 2.013671875, 3.013671875, 4.013671875, 5.013671875, 6.013671875, 7.013671875, 8.013671875, 9.013671875, 10.013671875, 11.013671875, 12.013671875], "recent_frames_sha256": "7c3ed298a4e18c2bdd63a72e43b7893c2b2290882f34953af6ef70c129e9fedb", "num_recent_frames": 13, "tq": 718072.894157769, "t1": 718079.748833107, "ta": 718079.748833107, "te": 718079.939788476, "first_response_s": 6.854675337905064, "answer_total_s": 7.045630706939846, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 471, "content_group": "ac8a2f9587a947ad89664fd9c82f20d8bf93a530e9cc297827812f6f4af95a3e", "question": {"question_id": "sample_471_a508_q1", "video_id": 471, "video_path": "./videos/sample_471_real.mp4", "annotation_index": 508, "question_index": 1, "question": "What distinguishes the figures in the third painting?", "options": ["A. They have blue hair and dark bodies.", "B. They have orange hair and pale bodies.", "C. They have green hair and yellow bodies.", "D. They have black hair and white bodies."], "answer": "B", "time_stamp_s": 16, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_471_a508_q1", "video_id": 471, "time_stamp_s": 16, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "160483810d902e4ab154138df3e8bf6788ccca9cfacb648c814a9b63f9d0a51d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.04700520833333333, 1.013671875, 2.013671875, 3.013671875, 4.013671875, 5.013671875, 6.013671875, 7.013671875, 8.013671875, 9.013671875, 10.013671875, 11.013671875, 12.013671875, 13.013671875, 14.013671875, 15.013671875], "recent_frames_sha256": "b31fb872a0dc1f7b66dcd313871e542fe474846953f816f23ce065cff3cbbd68", "num_recent_frames": 16, "tq": 718028.03787646, "t1": 718035.784141565, "ta": 718035.784141565, "te": 718035.822568828, "first_response_s": 7.746265104971826, "answer_total_s": 7.784692368004471, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_471_a508_q1", "video_id": 471, "time_stamp_s": 16, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3c0d39c5f8ab0c02a0a321c7ad7d14c2fef668f032711721694f1aa54ab7559f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.04700520833333333, 1.013671875, 2.013671875, 3.013671875, 4.013671875, 5.013671875, 6.013671875, 7.013671875, 8.013671875, 9.013671875, 10.013671875, 11.013671875, 12.013671875, 13.013671875, 14.013671875, 15.013671875], "recent_frames_sha256": "b31fb872a0dc1f7b66dcd313871e542fe474846953f816f23ce065cff3cbbd68", "num_recent_frames": 16, "tq": 718079.974900283, "t1": 718090.696380945, "ta": 718090.696380945, "te": 718090.736624382, "first_response_s": 10.72148066200316, "answer_total_s": 10.761724098934792, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 471, "content_group": "ac8a2f9587a947ad89664fd9c82f20d8bf93a530e9cc297827812f6f4af95a3e", "question": {"question_id": "sample_471_a509_q0", "video_id": 471, "video_path": "./videos/sample_471_real.mp4", "annotation_index": 509, "question_index": 0, "question": "What characteristic is shared by the white shapes on the wooden panel pieces?", "options": ["A. They are all triangular.", "B. They are all raised and cast shadows.", "C. They all have a blue background.", "D. They all include floral designs."], "answer": "B", "time_stamp_s": 496, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_471_a509_q0", "video_id": 471, "time_stamp_s": 496, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fdb30fe3da05909d19a921c267e3a17906d1fcbffb5bbebb12c97188d31a17cf", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [466.013671875, 467.013671875, 468.013671875, 469.013671875, 470.013671875, 471.013671875, 472.013671875, 473.013671875, 474.013671875, 475.013671875, 476.013671875, 477.013671875, 478.013671875, 479.013671875, 480.013671875, 481.013671875, 482.013671875, 483.013671875, 484.013671875, 485.013671875, 486.013671875, 487.013671875, 488.013671875, 489.013671875, 490.013671875, 491.013671875, 492.013671875, 493.013671875, 494.013671875, 495.013671875], "recent_frames_sha256": "adbb61a22139490f19036191f1ee69b025f3f6c0c576a6ba89cb887e7b083dbd", "num_recent_frames": 30, "tq": 718035.84029635, "t1": 718047.457601427, "ta": 718047.457601427, "te": 718047.499837693, "first_response_s": 11.617305077030323, "answer_total_s": 11.659541342989542, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_471_a509_q0", "video_id": 471, "time_stamp_s": 496, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "29651a301461e3c49df1a49d64b640dd2dcb5f9fc061c570f2dd0990e6fd6a7d", "condition_order": ["recent", "notes"], "memory": "[150-180s] - A grid of framed artworks, each containing a cartoonish dollar bill design, is mounted on a white wall.  \n- A large, colorful painting of a lion with a black-and-white mane dominates the adjacent wall, surrounded by vibrant splashes of red, yellow, and blue.  \n- To the right of the lion painting, a similarly styled painting of a leopard with black spots is displayed, set against a backdrop of abstract, multicolored brushstrokes.\n[180-210s] - A large, colorful abstract painting with swirling patterns and vibrant hues is displayed on the wall.  \n- To its right, a grid of small, framed images arranged in a structured pattern is mounted on the wall.  \n- A group of visitors is seen walking along the gallery corridor, observing the artworks.\n[210-240s] - A row of small, framed abstract artworks hangs on a white wall, each with a black frame and white matting.  \n- The camera pans right to reveal a large, abstract painting with yellow and black tones depicting stylized human figures.  \n- Adjacent to it, another large painting features two figures with elongated heads and bodies in warm tones, set against a blue and red background.\n[240-270s] - A vibrant, colorful portrait of LeBron James in a Lakers jersey is displayed on a white wall, with abstract splashes of paint behind him.  \n- To the right, a portrait of Kobe Bryant in a Lakers jersey, holding a championship trophy, is shown with similar abstract background.  \n- A large, dark-toned painting depicting a figure under an umbrella amidst a crowd of small, colorful dots is visible to the right of Kobe’s portrait.\n[270-300s] - A large abstract painting with concentric red and black rings on a pink background is mounted on a white wall.  \n- A colorful, cartoonish mural featuring animals and hearts is visible on an adjacent wall.  \n- A group of visitors, including a man in a white coat, walks past the artworks in the background.\n[300-330s] - A large abstract painting with layered textures and dark markings dominates the wall, positioned centrally in the frame.  \n- To its left, a cluster of smaller framed artworks, mostly monochrome sketches, are arranged in a grid-like pattern.  \n- A visitor in a purple top walks past the right side of the frame, moving away from the camera.\n[330-360s] - A large red abstract painting with the word \"Divine\" in black vertical text is displayed on a white wall.  \n- To its right, a complex multi-panel artwork composed of red, orange, and black geometric shapes with abstract figures is mounted.  \n- The camera pans right, revealing a tall, vertically oriented artwork with layered orange, red, and blue frames surrounding a central black-and-white textured panel.\n[360-390s] - A large, framed abstract painting with a brownish landscape and a yellow sun is displayed on a white wall.  \n- To its right, a series of three vertical panels with bamboo-like motifs and a yellow sun are mounted side by side.  \n- A group of visitors is seen observing a large, detailed painting of a skeletal figure seated beside a tree with red apples, positioned on a white wall.\n[390-420s] - Red wall displays \"PARTIES GALLERY WITH ST JUDS\" text and colorful abstract paintings arranged in a grid.  \n- A large circular artwork with concentric patterns and human-like figures is mounted on the wall, adjacent to smaller rectangular pieces.  \n- The camera pans right, revealing more abstract portraits with vibrant colors and distinct facial features, labeled \"METAL ART\" on the wall.\n[420-450s] - A framed artwork with abstract, dark blue and pink swirls is mounted on a gray wall, adjacent to other framed pieces.  \n- The camera pans right, revealing a series of black-and-white abstract prints and two horizontal color prints with floral and organic patterns.  \n- A blue sign labeled \"1206\" is visible above a white wall displaying \"J&J ART\" and various colorful artworks below.\n[450-480s] - A large black-and-white abstract painting is mounted on the wall, positioned to the left of a vibrant, multicolored abstract piece.  \n- A television screen displays a black-and-white image of a person's face, situated to the right of the multicolored painting.  \n- A visitor in a green jacket walks past the artworks, moving from right to left across the frame.", "history_tokens": 976, "history_utf8_bytes": 4262, "recent_frame_times_s": [466.013671875, 467.013671875, 468.013671875, 469.013671875, 470.013671875, 471.013671875, 472.013671875, 473.013671875, 474.013671875, 475.013671875, 476.013671875, 477.013671875, 478.013671875, 479.013671875, 480.013671875, 481.013671875, 482.013671875, 483.013671875, 484.013671875, 485.013671875, 486.013671875, 487.013671875, 488.013671875, 489.013671875, 490.013671875, 491.013671875, 492.013671875, 493.013671875, 494.013671875, 495.013671875], "recent_frames_sha256": "adbb61a22139490f19036191f1ee69b025f3f6c0c576a6ba89cb887e7b083dbd", "num_recent_frames": 30, "tq": 718216.308648547, "t1": 718218.78657583, "ta": 718218.78657583, "te": 718218.826176454, "first_response_s": 2.4779272829182446, "answer_total_s": 2.5175279069226235, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 471, "content_group": "ac8a2f9587a947ad89664fd9c82f20d8bf93a530e9cc297827812f6f4af95a3e", "question": {"question_id": "sample_471_a510_q0", "video_id": 471, "video_path": "./videos/sample_471_real.mp4", "annotation_index": 510, "question_index": 0, "question": "Compared to the colorful string patterns, where are the black canvases with smiley decorations on the top of these two squares?", "options": ["A. Directly above them.", "B. To the left of them.", "C. To the right of them.", "D. Below them."], "answer": "C", "time_stamp_s": 643, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [600, 643], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_471_a510_q0", "video_id": 471, "time_stamp_s": 643, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e3fb8509ed41823698db1f30d16cbbe5b543cb123c32afc079e01f75efd8f865", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [613.013671875, 614.013671875, 615.013671875, 616.013671875, 617.013671875, 618.013671875, 619.013671875, 620.013671875, 621.013671875, 622.013671875, 623.013671875, 624.013671875, 625.013671875, 626.013671875, 627.013671875, 628.013671875, 629.013671875, 630.013671875, 631.013671875, 632.013671875, 633.013671875, 634.013671875, 635.013671875, 636.013671875, 637.013671875, 638.013671875, 639.013671875, 640.013671875, 641.013671875, 642.013671875], "recent_frames_sha256": "264037c3ad83c17a2cee5a4786fccb21e0f16a917480d4d20c957493231f741c", "num_recent_frames": 30, "tq": 718047.51421014, "t1": 718059.695162074, "ta": 718059.695162074, "te": 718059.732866143, "first_response_s": 12.180951933958568, "answer_total_s": 12.218656003009528, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_471_a510_q0", "video_id": 471, "time_stamp_s": 643, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ac55b13c752fe942886762cc81c02b4384cccd518de104e4377501aa863803f0", "condition_order": ["recent", "notes"], "memory": "[270-300s] - A large abstract painting with concentric red and black rings on a pink background is mounted on a white wall.  \n- A colorful, cartoonish mural featuring animals and hearts is visible on an adjacent wall.  \n- A group of visitors, including a man in a white coat, walks past the artworks in the background.\n[300-330s] - A large abstract painting with layered textures and dark markings dominates the wall, positioned centrally in the frame.  \n- To its left, a cluster of smaller framed artworks, mostly monochrome sketches, are arranged in a grid-like pattern.  \n- A visitor in a purple top walks past the right side of the frame, moving away from the camera.\n[330-360s] - A large red abstract painting with the word \"Divine\" in black vertical text is displayed on a white wall.  \n- To its right, a complex multi-panel artwork composed of red, orange, and black geometric shapes with abstract figures is mounted.  \n- The camera pans right, revealing a tall, vertically oriented artwork with layered orange, red, and blue frames surrounding a central black-and-white textured panel.\n[360-390s] - A large, framed abstract painting with a brownish landscape and a yellow sun is displayed on a white wall.  \n- To its right, a series of three vertical panels with bamboo-like motifs and a yellow sun are mounted side by side.  \n- A group of visitors is seen observing a large, detailed painting of a skeletal figure seated beside a tree with red apples, positioned on a white wall.\n[390-420s] - Red wall displays \"PARTIES GALLERY WITH ST JUDS\" text and colorful abstract paintings arranged in a grid.  \n- A large circular artwork with concentric patterns and human-like figures is mounted on the wall, adjacent to smaller rectangular pieces.  \n- The camera pans right, revealing more abstract portraits with vibrant colors and distinct facial features, labeled \"METAL ART\" on the wall.\n[420-450s] - A framed artwork with abstract, dark blue and pink swirls is mounted on a gray wall, adjacent to other framed pieces.  \n- The camera pans right, revealing a series of black-and-white abstract prints and two horizontal color prints with floral and organic patterns.  \n- A blue sign labeled \"1206\" is visible above a white wall displaying \"J&J ART\" and various colorful artworks below.\n[450-480s] - A large black-and-white abstract painting is mounted on the wall, positioned to the left of a vibrant, multicolored abstract piece.  \n- A television screen displays a black-and-white image of a person's face, situated to the right of the multicolored painting.  \n- A visitor in a green jacket walks past the artworks, moving from right to left across the frame.\n[480-510s] - Abstract paintings with geometric shapes and vibrant colors are displayed in a grid pattern on a white wall.  \n- A wooden panel with a white circular object centered on it is mounted to the wall, positioned below the abstract paintings.  \n- The camera pans slightly to the right, revealing more abstract artworks with colorful, stylized tree-like forms.\n[510-540s] - Abstract geometric paintings with vibrant colors are displayed vertically on a white wall.  \n- Black-and-white mountainous landscape paintings are positioned to the left of the colorful abstract works.  \n- A red-framed painting with desert motifs and cacti is mounted below a smaller, ornate piece featuring a table with flowers.\n[540-570s] - A series of abstract paintings with gold leaf and pastel backgrounds are mounted vertically on a white wall.  \n- To the left, a framed photograph of two pink roses is displayed next to a painting of a vibrant flower field.  \n- The camera pans right, revealing a grid of colorful, cartoonish artworks featuring animals and geometric patterns.\n[570-600s] - A vibrant, abstract painting with swirling colors and white lines is displayed on the right wall.  \n- A framed illustration of a whimsical house with a smiling moon and a fairy above it is centered on the wall.  \n- A colorful, stylized painting of a tree with a white rabbit and a blue bird is positioned below the house illustration.\n[600-630s] - A framed painting of a cat with yellow eyes and a small flower on its head is mounted on a white wall, positioned between other artworks.  \n- To the left, a colorful abstract painting with blue and green swirls is visible, while to the right, a vibrant orange and pink abstract piece hangs.  \n- Below the cat painting, a framed sketch of a cartoon character in a red chair is displayed, with a small plaque beneath it.", "history_tokens": 1021, "history_utf8_bytes": 4509, "recent_frame_times_s": [613.013671875, 614.013671875, 615.013671875, 616.013671875, 617.013671875, 618.013671875, 619.013671875, 620.013671875, 621.013671875, 622.013671875, 623.013671875, 624.013671875, 625.013671875, 626.013671875, 627.013671875, 628.013671875, 629.013671875, 630.013671875, 631.013671875, 632.013671875, 633.013671875, 634.013671875, 635.013671875, 636.013671875, 637.013671875, 638.013671875, 639.013671875, 640.013671875, 641.013671875, 642.013671875], "recent_frames_sha256": "264037c3ad83c17a2cee5a4786fccb21e0f16a917480d4d20c957493231f741c", "num_recent_frames": 30, "tq": 718262.33093914, "t1": 718264.409278805, "ta": 718264.409278805, "te": 718264.675837087, "first_response_s": 2.0783396649640054, "answer_total_s": 2.3448979469249025, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 471, "content_group": "ac8a2f9587a947ad89664fd9c82f20d8bf93a530e9cc297827812f6f4af95a3e", "question": {"question_id": "sample_471_a510_q1", "video_id": 471, "video_path": "./videos/sample_471_real.mp4", "annotation_index": 510, "question_index": 1, "question": "What can be inferred about the layout of the gallery space based on the video content?", "options": ["A. The gallery is very crowded with limited space.", "B. The artworks are displayed haphazardly.", "C. The gallery is open with artworks neatly displayed and visible visitors.", "D. The lighting is dim and focused on certain artworks."], "answer": "C", "time_stamp_s": 643, "task_type": "Causal Reasoning", "required_ability": "episodic memory", "video_category": "art_show", "reference_interval_s": [600, 643], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_471_a510_q1", "video_id": 471, "time_stamp_s": 643, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b3df1ff97cc2f10fb73a711e029598e80f1945748a382339da6a7df3715fb067", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [613.013671875, 614.013671875, 615.013671875, 616.013671875, 617.013671875, 618.013671875, 619.013671875, 620.013671875, 621.013671875, 622.013671875, 623.013671875, 624.013671875, 625.013671875, 626.013671875, 627.013671875, 628.013671875, 629.013671875, 630.013671875, 631.013671875, 632.013671875, 633.013671875, 634.013671875, 635.013671875, 636.013671875, 637.013671875, 638.013671875, 639.013671875, 640.013671875, 641.013671875, 642.013671875], "recent_frames_sha256": "264037c3ad83c17a2cee5a4786fccb21e0f16a917480d4d20c957493231f741c", "num_recent_frames": 30, "tq": 718059.742089071, "t1": 718072.847290004, "ta": 718072.847290004, "te": 718072.884448501, "first_response_s": 13.105200933059677, "answer_total_s": 13.142359430086799, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_471_a510_q1", "video_id": 471, "time_stamp_s": 643, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e07413abe44eb26568834c92e4e31de449736c7c8661f2de2b3e116b6377cf42", "condition_order": ["recent", "notes"], "memory": "[270-300s] - A large abstract painting with concentric red and black rings on a pink background is mounted on a white wall.  \n- A colorful, cartoonish mural featuring animals and hearts is visible on an adjacent wall.  \n- A group of visitors, including a man in a white coat, walks past the artworks in the background.\n[300-330s] - A large abstract painting with layered textures and dark markings dominates the wall, positioned centrally in the frame.  \n- To its left, a cluster of smaller framed artworks, mostly monochrome sketches, are arranged in a grid-like pattern.  \n- A visitor in a purple top walks past the right side of the frame, moving away from the camera.\n[330-360s] - A large red abstract painting with the word \"Divine\" in black vertical text is displayed on a white wall.  \n- To its right, a complex multi-panel artwork composed of red, orange, and black geometric shapes with abstract figures is mounted.  \n- The camera pans right, revealing a tall, vertically oriented artwork with layered orange, red, and blue frames surrounding a central black-and-white textured panel.\n[360-390s] - A large, framed abstract painting with a brownish landscape and a yellow sun is displayed on a white wall.  \n- To its right, a series of three vertical panels with bamboo-like motifs and a yellow sun are mounted side by side.  \n- A group of visitors is seen observing a large, detailed painting of a skeletal figure seated beside a tree with red apples, positioned on a white wall.\n[390-420s] - Red wall displays \"PARTIES GALLERY WITH ST JUDS\" text and colorful abstract paintings arranged in a grid.  \n- A large circular artwork with concentric patterns and human-like figures is mounted on the wall, adjacent to smaller rectangular pieces.  \n- The camera pans right, revealing more abstract portraits with vibrant colors and distinct facial features, labeled \"METAL ART\" on the wall.\n[420-450s] - A framed artwork with abstract, dark blue and pink swirls is mounted on a gray wall, adjacent to other framed pieces.  \n- The camera pans right, revealing a series of black-and-white abstract prints and two horizontal color prints with floral and organic patterns.  \n- A blue sign labeled \"1206\" is visible above a white wall displaying \"J&J ART\" and various colorful artworks below.\n[450-480s] - A large black-and-white abstract painting is mounted on the wall, positioned to the left of a vibrant, multicolored abstract piece.  \n- A television screen displays a black-and-white image of a person's face, situated to the right of the multicolored painting.  \n- A visitor in a green jacket walks past the artworks, moving from right to left across the frame.\n[480-510s] - Abstract paintings with geometric shapes and vibrant colors are displayed in a grid pattern on a white wall.  \n- A wooden panel with a white circular object centered on it is mounted to the wall, positioned below the abstract paintings.  \n- The camera pans slightly to the right, revealing more abstract artworks with colorful, stylized tree-like forms.\n[510-540s] - Abstract geometric paintings with vibrant colors are displayed vertically on a white wall.  \n- Black-and-white mountainous landscape paintings are positioned to the left of the colorful abstract works.  \n- A red-framed painting with desert motifs and cacti is mounted below a smaller, ornate piece featuring a table with flowers.\n[540-570s] - A series of abstract paintings with gold leaf and pastel backgrounds are mounted vertically on a white wall.  \n- To the left, a framed photograph of two pink roses is displayed next to a painting of a vibrant flower field.  \n- The camera pans right, revealing a grid of colorful, cartoonish artworks featuring animals and geometric patterns.\n[570-600s] - A vibrant, abstract painting with swirling colors and white lines is displayed on the right wall.  \n- A framed illustration of a whimsical house with a smiling moon and a fairy above it is centered on the wall.  \n- A colorful, stylized painting of a tree with a white rabbit and a blue bird is positioned below the house illustration.\n[600-630s] - A framed painting of a cat with yellow eyes and a small flower on its head is mounted on a white wall, positioned between other artworks.  \n- To the left, a colorful abstract painting with blue and green swirls is visible, while to the right, a vibrant orange and pink abstract piece hangs.  \n- Below the cat painting, a framed sketch of a cartoon character in a red chair is displayed, with a small plaque beneath it.", "history_tokens": 1021, "history_utf8_bytes": 4509, "recent_frame_times_s": [613.013671875, 614.013671875, 615.013671875, 616.013671875, 617.013671875, 618.013671875, 619.013671875, 620.013671875, 621.013671875, 622.013671875, 623.013671875, 624.013671875, 625.013671875, 626.013671875, 627.013671875, 628.013671875, 629.013671875, 630.013671875, 631.013671875, 632.013671875, 633.013671875, 634.013671875, 635.013671875, 636.013671875, 637.013671875, 638.013671875, 639.013671875, 640.013671875, 641.013671875, 642.013671875], "recent_frames_sha256": "264037c3ad83c17a2cee5a4786fccb21e0f16a917480d4d20c957493231f741c", "num_recent_frames": 30, "tq": 718264.731309417, "t1": 718272.473742546, "ta": 718272.473742546, "te": 718272.512022071, "first_response_s": 7.74243312899489, "answer_total_s": 7.780712653999217, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 472, "content_group": "bca4c2d66300efe9c00c2fb070993cd0acd36663f748645047e80014e4a2a0f8", "question": {"question_id": "sample_472_a600_q0", "video_id": 472, "video_path": "./videos/sample_472_real.mp4", "annotation_index": 600, "question_index": 0, "question": "What is the color of the frame of the artwork featuring the robot boy with a cheerful expression and arms raised?", "options": ["A. Black.", "B. Orange.", "C. Metallic gray.", "D. Blue."], "answer": "B", "time_stamp_s": 179, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_472_a600_q0", "video_id": 472, "time_stamp_s": 179, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "11aadb0d2d43702ed5f6b9a10a653a15a362e44e7d0c3e623be1aa61edee4891", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [149.01666666666668, 150.01666666666668, 151.01666666666668, 152.01666666666668, 153.01666666666668, 154.01666666666668, 155.01666666666668, 156.01666666666668, 157.01666666666668, 158.01666666666668, 159.01666666666668, 160.01666666666668, 161.01666666666668, 162.01666666666668, 163.01666666666668, 164.01666666666668, 165.01666666666668, 166.01666666666668, 167.01666666666668, 168.01666666666668, 169.01666666666668, 170.01666666666668, 171.01666666666668, 172.01666666666668, 173.01666666666668, 174.01666666666668, 175.01666666666668, 176.01666666666668, 177.01666666666668, 178.01666666666668], "recent_frames_sha256": "ed535e9738013dc94f12dd72e1dccfeaf0965f9e517a551f008f4e5405928cd3", "num_recent_frames": 30, "tq": 716395.161569564, "t1": 716408.557300988, "ta": 716408.557300988, "te": 716408.594661826, "first_response_s": 13.395731423981488, "answer_total_s": 13.433092262013815, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_472_a600_q0", "video_id": 472, "time_stamp_s": 179, "ground_truth": "B", "raw_output": "B. Orange.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "53b59dd06346693d1c22f4c3e591c5cc70ce182be2d96e6b3733edc9449b2faa", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Abstract colorful paintings with bold shapes and vibrant hues are displayed on white walls, with visitors walking through the gallery space.  \n- A section features circular, textured artworks with abstract landscapes, accompanied by small white cups placed on colored square panels.  \n- Two distinct paintings—one depicting cherry blossoms and another with a stylized face—are mounted side by side, with a sign indicating \"1212\" above them.\n[30-60s] - A pink cherry blossom tree painting is displayed on the left, with black branches against a soft pink background.\n- To its right, a colorful winter landscape painting shows figures in a snowy scene with purple mountains and a setting sun.\n- Below the winter scene, two gray cartoon bear paintings are mounted, followed by a series of stylized human portraits in green, pink, and black canvases.\n[60-90s] - A red canvas with a cartoon cat character wearing a black and white outfit is displayed on a white wall, positioned to the left of a yellow canvas with a similar character.  \n- The yellow canvas, featuring a cartoon cat with a black and white outfit, is mounted on the wall to the right of the red canvas.  \n- A green canvas with a cartoon cat character, also in a black and white outfit, is visible to the right of the yellow canvas, with the cat making a hand gesture.\n[90-120s] - A man in a black jacket walks past a large abstract painting on the left wall, then stops to examine smaller framed artworks on the right wall.  \n- A woman in a black outfit is seated on the right, looking at a phone, while a man in a dark suit sits on the left, also observing the screen.  \n- The camera pans upward to reveal a ceiling with exposed beams and lighting fixtures, then moves to show a wall of colorful abstract paintings.\n[120-150s] - Wooden display units with framed images and blue LED lights are mounted on a white wall, labeled \"SULEBOX\" at the bottom.  \n- A large abstract painting with vibrant blue, green, and orange swirls hangs on the wall to the left.  \n- A blue price tag reading \"1290\" is visible above a white surface, possibly a display or table.", "history_tokens": 479, "history_utf8_bytes": 2130, "recent_frame_times_s": [149.01666666666668, 150.01666666666668, 151.01666666666668, 152.01666666666668, 153.01666666666668, 154.01666666666668, 155.01666666666668, 156.01666666666668, 157.01666666666668, 158.01666666666668, 159.01666666666668, 160.01666666666668, 161.01666666666668, 162.01666666666668, 163.01666666666668, 164.01666666666668, 165.01666666666668, 166.01666666666668, 167.01666666666668, 168.01666666666668, 169.01666666666668, 170.01666666666668, 171.01666666666668, 172.01666666666668, 173.01666666666668, 174.01666666666668, 175.01666666666668, 176.01666666666668, 177.01666666666668, 178.01666666666668], "recent_frames_sha256": "ed535e9738013dc94f12dd72e1dccfeaf0965f9e517a551f008f4e5405928cd3", "num_recent_frames": 30, "tq": 716505.108110273, "t1": 716512.301366922, "ta": 716512.301366922, "te": 716512.449653587, "first_response_s": 7.193256648955867, "answer_total_s": 7.341543313930742, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 472, "content_group": "bca4c2d66300efe9c00c2fb070993cd0acd36663f748645047e80014e4a2a0f8", "question": {"question_id": "sample_472_a600_q1", "video_id": 472, "video_path": "./videos/sample_472_real.mp4", "annotation_index": 600, "question_index": 1, "question": "What was the general theme of the artworks displayed on the wall just now?", "options": ["A. Nature landscapes.", "B. Abstract art.", "C. A robot boy character.", "D. Historical events."], "answer": "C", "time_stamp_s": 180, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_472_a600_q1", "video_id": 472, "time_stamp_s": 180, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "23c6ee2652341395d239dce6388144adc549ab0917061bc3a75761f981abd9cf", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [150.01666666666668, 151.01666666666668, 152.01666666666668, 153.01666666666668, 154.01666666666668, 155.01666666666668, 156.01666666666668, 157.01666666666668, 158.01666666666668, 159.01666666666668, 160.01666666666668, 161.01666666666668, 162.01666666666668, 163.01666666666668, 164.01666666666668, 165.01666666666668, 166.01666666666668, 167.01666666666668, 168.01666666666668, 169.01666666666668, 170.01666666666668, 171.01666666666668, 172.01666666666668, 173.01666666666668, 174.01666666666668, 175.01666666666668, 176.01666666666668, 177.01666666666668, 178.01666666666668, 179.01666666666668], "recent_frames_sha256": "d3f753fe272b87936b3e1ffda68133ed20625940febd2eb3ab8c82d0eff8775b", "num_recent_frames": 30, "tq": 716408.602745268, "t1": 716423.390978758, "ta": 716423.390978758, "te": 716423.428799937, "first_response_s": 14.788233489962295, "answer_total_s": 14.826054668985307, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_472_a600_q1", "video_id": 472, "time_stamp_s": 180, "ground_truth": "C", "raw_output": "C. A robot boy character.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "2a02d9d506cb0e8c28112625c89b162786b86e3f435ec6ed93dc1cf2c7ad20c2", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Abstract colorful paintings with bold shapes and vibrant hues are displayed on white walls, with visitors walking through the gallery space.  \n- A section features circular, textured artworks with abstract landscapes, accompanied by small white cups placed on colored square panels.  \n- Two distinct paintings—one depicting cherry blossoms and another with a stylized face—are mounted side by side, with a sign indicating \"1212\" above them.\n[30-60s] - A pink cherry blossom tree painting is displayed on the left, with black branches against a soft pink background.\n- To its right, a colorful winter landscape painting shows figures in a snowy scene with purple mountains and a setting sun.\n- Below the winter scene, two gray cartoon bear paintings are mounted, followed by a series of stylized human portraits in green, pink, and black canvases.\n[60-90s] - A red canvas with a cartoon cat character wearing a black and white outfit is displayed on a white wall, positioned to the left of a yellow canvas with a similar character.  \n- The yellow canvas, featuring a cartoon cat with a black and white outfit, is mounted on the wall to the right of the red canvas.  \n- A green canvas with a cartoon cat character, also in a black and white outfit, is visible to the right of the yellow canvas, with the cat making a hand gesture.\n[90-120s] - A man in a black jacket walks past a large abstract painting on the left wall, then stops to examine smaller framed artworks on the right wall.  \n- A woman in a black outfit is seated on the right, looking at a phone, while a man in a dark suit sits on the left, also observing the screen.  \n- The camera pans upward to reveal a ceiling with exposed beams and lighting fixtures, then moves to show a wall of colorful abstract paintings.\n[120-150s] - Wooden display units with framed images and blue LED lights are mounted on a white wall, labeled \"SULEBOX\" at the bottom.  \n- A large abstract painting with vibrant blue, green, and orange swirls hangs on the wall to the left.  \n- A blue price tag reading \"1290\" is visible above a white surface, possibly a display or table.\n[150-180s] - Artworks by Tezuka Osamu are displayed on a white wall, including framed pieces with distinct color schemes and character depictions.  \n- A central orange-framed piece shows a cartoon character with a flame-like background, while adjacent pieces feature different characters and styles.  \n- The camera pans across the wall, highlighting various framed artworks, including one with a red background and a character holding a device.", "history_tokens": 571, "history_utf8_bytes": 2575, "recent_frame_times_s": [150.01666666666668, 151.01666666666668, 152.01666666666668, 153.01666666666668, 154.01666666666668, 155.01666666666668, 156.01666666666668, 157.01666666666668, 158.01666666666668, 159.01666666666668, 160.01666666666668, 161.01666666666668, 162.01666666666668, 163.01666666666668, 164.01666666666668, 165.01666666666668, 166.01666666666668, 167.01666666666668, 168.01666666666668, 169.01666666666668, 170.01666666666668, 171.01666666666668, 172.01666666666668, 173.01666666666668, 174.01666666666668, 175.01666666666668, 176.01666666666668, 177.01666666666668, 178.01666666666668, 179.01666666666668], "recent_frames_sha256": "d3f753fe272b87936b3e1ffda68133ed20625940febd2eb3ab8c82d0eff8775b", "num_recent_frames": 30, "tq": 716524.79281868, "t1": 716526.492888081, "ta": 716526.492888081, "te": 716526.768867365, "first_response_s": 1.700069400947541, "answer_total_s": 1.9760486849118024, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 472, "content_group": "bca4c2d66300efe9c00c2fb070993cd0acd36663f748645047e80014e4a2a0f8", "question": {"question_id": "sample_472_a601_q1", "video_id": 472, "video_path": "./videos/sample_472_real.mp4", "annotation_index": 601, "question_index": 1, "question": "What name is displayed beneath the paintings of a tiger with a red flower on its head?", "options": ["A. TTODOA.", "B. NAM JI HYUNG.", "C. \"SERENE\".", "D. \"ARTIST\"."], "answer": "B", "time_stamp_s": 335, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_472_a601_q1", "video_id": 472, "time_stamp_s": 335, "ground_truth": "B", "raw_output": "B. NAM JI HYUNG.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "633bbaf0f1f7fc509fa6a4877ddf9c37dbaa09c8b7fb05074f9087cd293809cc", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [305.01666666666665, 306.01666666666665, 307.01666666666665, 308.01666666666665, 309.01666666666665, 310.01666666666665, 311.01666666666665, 312.01666666666665, 313.01666666666665, 314.01666666666665, 315.01666666666665, 316.01666666666665, 317.01666666666665, 318.01666666666665, 319.01666666666665, 320.01666666666665, 321.01666666666665, 322.01666666666665, 323.01666666666665, 324.01666666666665, 325.01666666666665, 326.01666666666665, 327.01666666666665, 328.01666666666665, 329.01666666666665, 330.01666666666665, 331.01666666666665, 332.01666666666665, 333.01666666666665, 334.01666666666665], "recent_frames_sha256": "e5a64a59393a9fe2fdab91ab31aef2932872989a7016b070ebace23d4b08d15b", "num_recent_frames": 30, "tq": 716423.437655087, "t1": 716435.657773209, "ta": 716435.657773209, "te": 716435.989621567, "first_response_s": 12.22011812205892, "answer_total_s": 12.551966479979455, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_472_a601_q1", "video_id": 472, "time_stamp_s": 335, "ground_truth": "B", "raw_output": "B. NAM JI HYUNG.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "eae34fd3ba06351550e60b1e3f770ade6c341a43ace04afd42c05acbc7c55e0f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Abstract colorful paintings with bold shapes and vibrant hues are displayed on white walls, with visitors walking through the gallery space.  \n- A section features circular, textured artworks with abstract landscapes, accompanied by small white cups placed on colored square panels.  \n- Two distinct paintings—one depicting cherry blossoms and another with a stylized face—are mounted side by side, with a sign indicating \"1212\" above them.\n[30-60s] - A pink cherry blossom tree painting is displayed on the left, with black branches against a soft pink background.\n- To its right, a colorful winter landscape painting shows figures in a snowy scene with purple mountains and a setting sun.\n- Below the winter scene, two gray cartoon bear paintings are mounted, followed by a series of stylized human portraits in green, pink, and black canvases.\n[60-90s] - A red canvas with a cartoon cat character wearing a black and white outfit is displayed on a white wall, positioned to the left of a yellow canvas with a similar character.  \n- The yellow canvas, featuring a cartoon cat with a black and white outfit, is mounted on the wall to the right of the red canvas.  \n- A green canvas with a cartoon cat character, also in a black and white outfit, is visible to the right of the yellow canvas, with the cat making a hand gesture.\n[90-120s] - A man in a black jacket walks past a large abstract painting on the left wall, then stops to examine smaller framed artworks on the right wall.  \n- A woman in a black outfit is seated on the right, looking at a phone, while a man in a dark suit sits on the left, also observing the screen.  \n- The camera pans upward to reveal a ceiling with exposed beams and lighting fixtures, then moves to show a wall of colorful abstract paintings.\n[120-150s] - Wooden display units with framed images and blue LED lights are mounted on a white wall, labeled \"SULEBOX\" at the bottom.  \n- A large abstract painting with vibrant blue, green, and orange swirls hangs on the wall to the left.  \n- A blue price tag reading \"1290\" is visible above a white surface, possibly a display or table.\n[150-180s] - Artworks by Tezuka Osamu are displayed on a white wall, including framed pieces with distinct color schemes and character depictions.  \n- A central orange-framed piece shows a cartoon character with a flame-like background, while adjacent pieces feature different characters and styles.  \n- The camera pans across the wall, highlighting various framed artworks, including one with a red background and a character holding a device.\n[180-210s] - A framed cartoon character with red boots and a black belt is displayed against a green background, signed by the artist.  \n- Adjacent to it, a framed artwork of a character in a blue outfit is shown, with a QR code and descriptive plaque nearby.  \n- The camera pans to reveal a series of four abstract, colorful glass panels arranged in a grid, each encased in an orange frame.\n[210-240s] - A large abstract painting with a green and yellow split, labeled \"KIM EUN MI,\" is displayed on a white wall.  \n- Below it, a red abstract piece with a grid pattern is mounted, followed by a blue floral artwork featuring white birds.  \n- The blue artwork is positioned above a small white shelf holding two rabbit figurines, with a QR code and text nearby.\n[240-270s] - A framed cartoon of Astro Boy flying with a rocket trail is displayed, with a signature visible in the corner.\n- Below it, another framed piece shows Astro Boy standing on a pink background, wearing red boots and a black belt.\n- A third framed artwork depicts two Astro Boy figures on a yellow background, one facing left and the other right.\n[270-300s] - A large canvas depicting a stylized face with floral patterns is mounted on a white wall, labeled \"SONG KWANG YEON.\"  \n- Below, a display table showcases luxury items including red high heels, gold bowls, and woven handbags.  \n- To the right, another canvas features a profile with ornate, colorful floral motifs, positioned next to a blue plaque with text.\n[300-330s] - A large framed abstract painting hangs above three smaller, colorful paintings on a white wall.  \n- A blue painting with floral motifs and a gray stone base is displayed next to a red abstract piece.  \n- The camera pans right, revealing more vibrant, stylized artworks including a pink piece with a figure and a green landscape with a tiger.", "history_tokens": 1000, "history_utf8_bytes": 4418, "recent_frame_times_s": [305.01666666666665, 306.01666666666665, 307.01666666666665, 308.01666666666665, 309.01666666666665, 310.01666666666665, 311.01666666666665, 312.01666666666665, 313.01666666666665, 314.01666666666665, 315.01666666666665, 316.01666666666665, 317.01666666666665, 318.01666666666665, 319.01666666666665, 320.01666666666665, 321.01666666666665, 322.01666666666665, 323.01666666666665, 324.01666666666665, 325.01666666666665, 326.01666666666665, 327.01666666666665, 328.01666666666665, 329.01666666666665, 330.01666666666665, 331.01666666666665, 332.01666666666665, 333.01666666666665, 334.01666666666665], "recent_frames_sha256": "e5a64a59393a9fe2fdab91ab31aef2932872989a7016b070ebace23d4b08d15b", "num_recent_frames": 30, "tq": 716574.469723471, "t1": 716575.902052358, "ta": 716575.902052358, "te": 716576.27635105, "first_response_s": 1.4323288870509714, "answer_total_s": 1.8066275790333748, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 472, "content_group": "bca4c2d66300efe9c00c2fb070993cd0acd36663f748645047e80014e4a2a0f8", "question": {"question_id": "sample_472_a601_q0", "video_id": 472, "video_path": "./videos/sample_472_real.mp4", "annotation_index": 601, "question_index": 0, "question": "What is the spatial relationship between the tiger and panda painting and the illustration labeled \"TTODOA\"?", "options": ["A. The tiger and panda painting is to the left of \"TTODOA\".", "B. The tiger and panda painting is to the right of \"TTODOA\".", "C. The tiger and panda painting is above \"TTODOA\".", "D. The tiger and panda painting is below \"TTODOA\"."], "answer": "A", "time_stamp_s": 343, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_472_a601_q0", "video_id": 472, "time_stamp_s": 343, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d72ac3d282e8674c21a2cee1d33254bb4c7c2d1136ef7cb76b39099cb5d6f360", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [313.01666666666665, 314.01666666666665, 315.01666666666665, 316.01666666666665, 317.01666666666665, 318.01666666666665, 319.01666666666665, 320.01666666666665, 321.01666666666665, 322.01666666666665, 323.01666666666665, 324.01666666666665, 325.01666666666665, 326.01666666666665, 327.01666666666665, 328.01666666666665, 329.01666666666665, 330.01666666666665, 331.01666666666665, 332.01666666666665, 333.01666666666665, 334.01666666666665, 335.01666666666665, 336.01666666666665, 337.01666666666665, 338.01666666666665, 339.01666666666665, 340.01666666666665, 341.01666666666665, 342.01666666666665], "recent_frames_sha256": "7a0aed35f0de1bfa03cd9e6d2e342ba5add648c35aee69518ff0a849f78cd2c9", "num_recent_frames": 30, "tq": 716436.000792053, "t1": 716449.690308575, "ta": 716449.690308575, "te": 716449.727912863, "first_response_s": 13.689516522106715, "answer_total_s": 13.727120810071938, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_472_a601_q0", "video_id": 472, "time_stamp_s": 343, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a05f3a4954b519126b24265cfd2961e88911e9b2b5b5ec26f24c4364298655e7", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Abstract colorful paintings with bold shapes and vibrant hues are displayed on white walls, with visitors walking through the gallery space.  \n- A section features circular, textured artworks with abstract landscapes, accompanied by small white cups placed on colored square panels.  \n- Two distinct paintings—one depicting cherry blossoms and another with a stylized face—are mounted side by side, with a sign indicating \"1212\" above them.\n[30-60s] - A pink cherry blossom tree painting is displayed on the left, with black branches against a soft pink background.\n- To its right, a colorful winter landscape painting shows figures in a snowy scene with purple mountains and a setting sun.\n- Below the winter scene, two gray cartoon bear paintings are mounted, followed by a series of stylized human portraits in green, pink, and black canvases.\n[60-90s] - A red canvas with a cartoon cat character wearing a black and white outfit is displayed on a white wall, positioned to the left of a yellow canvas with a similar character.  \n- The yellow canvas, featuring a cartoon cat with a black and white outfit, is mounted on the wall to the right of the red canvas.  \n- A green canvas with a cartoon cat character, also in a black and white outfit, is visible to the right of the yellow canvas, with the cat making a hand gesture.\n[90-120s] - A man in a black jacket walks past a large abstract painting on the left wall, then stops to examine smaller framed artworks on the right wall.  \n- A woman in a black outfit is seated on the right, looking at a phone, while a man in a dark suit sits on the left, also observing the screen.  \n- The camera pans upward to reveal a ceiling with exposed beams and lighting fixtures, then moves to show a wall of colorful abstract paintings.\n[120-150s] - Wooden display units with framed images and blue LED lights are mounted on a white wall, labeled \"SULEBOX\" at the bottom.  \n- A large abstract painting with vibrant blue, green, and orange swirls hangs on the wall to the left.  \n- A blue price tag reading \"1290\" is visible above a white surface, possibly a display or table.\n[150-180s] - Artworks by Tezuka Osamu are displayed on a white wall, including framed pieces with distinct color schemes and character depictions.  \n- A central orange-framed piece shows a cartoon character with a flame-like background, while adjacent pieces feature different characters and styles.  \n- The camera pans across the wall, highlighting various framed artworks, including one with a red background and a character holding a device.\n[180-210s] - A framed cartoon character with red boots and a black belt is displayed against a green background, signed by the artist.  \n- Adjacent to it, a framed artwork of a character in a blue outfit is shown, with a QR code and descriptive plaque nearby.  \n- The camera pans to reveal a series of four abstract, colorful glass panels arranged in a grid, each encased in an orange frame.\n[210-240s] - A large abstract painting with a green and yellow split, labeled \"KIM EUN MI,\" is displayed on a white wall.  \n- Below it, a red abstract piece with a grid pattern is mounted, followed by a blue floral artwork featuring white birds.  \n- The blue artwork is positioned above a small white shelf holding two rabbit figurines, with a QR code and text nearby.\n[240-270s] - A framed cartoon of Astro Boy flying with a rocket trail is displayed, with a signature visible in the corner.\n- Below it, another framed piece shows Astro Boy standing on a pink background, wearing red boots and a black belt.\n- A third framed artwork depicts two Astro Boy figures on a yellow background, one facing left and the other right.\n[270-300s] - A large canvas depicting a stylized face with floral patterns is mounted on a white wall, labeled \"SONG KWANG YEON.\"  \n- Below, a display table showcases luxury items including red high heels, gold bowls, and woven handbags.  \n- To the right, another canvas features a profile with ornate, colorful floral motifs, positioned next to a blue plaque with text.\n[300-330s] - A large framed abstract painting hangs above three smaller, colorful paintings on a white wall.  \n- A blue painting with floral motifs and a gray stone base is displayed next to a red abstract piece.  \n- The camera pans right, revealing more vibrant, stylized artworks including a pink piece with a figure and a green landscape with a tiger.", "history_tokens": 1000, "history_utf8_bytes": 4418, "recent_frame_times_s": [313.01666666666665, 314.01666666666665, 315.01666666666665, 316.01666666666665, 317.01666666666665, 318.01666666666665, 319.01666666666665, 320.01666666666665, 321.01666666666665, 322.01666666666665, 323.01666666666665, 324.01666666666665, 325.01666666666665, 326.01666666666665, 327.01666666666665, 328.01666666666665, 329.01666666666665, 330.01666666666665, 331.01666666666665, 332.01666666666665, 333.01666666666665, 334.01666666666665, 335.01666666666665, 336.01666666666665, 337.01666666666665, 338.01666666666665, 339.01666666666665, 340.01666666666665, 341.01666666666665, 342.01666666666665], "recent_frames_sha256": "7a0aed35f0de1bfa03cd9e6d2e342ba5add648c35aee69518ff0a849f78cd2c9", "num_recent_frames": 30, "tq": 716576.307886104, "t1": 716586.480248375, "ta": 716586.480248375, "te": 716586.516822799, "first_response_s": 10.172362270997837, "answer_total_s": 10.20893669500947, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 472, "content_group": "bca4c2d66300efe9c00c2fb070993cd0acd36663f748645047e80014e4a2a0f8", "question": {"question_id": "sample_472_a602_q0", "video_id": 472, "video_path": "./videos/sample_472_real.mp4", "annotation_index": 602, "question_index": 0, "question": "What action does the camera take after focusing on the green object?", "options": ["A. Zooms out to show the entire gallery.", "B. Moves to the floor.", "C. Focuses on a different box.", "D. Shifts to show a painting of a girl standing under balloons floating in the sky."], "answer": "D", "time_stamp_s": 509, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_472_a602_q0", "video_id": 472, "time_stamp_s": 509, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6238b9bb907bdce0b822f69edba9dda8ba958260100ee4b351bc7c4979bfb5df", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [479.01666666666665, 480.01666666666665, 481.01666666666665, 482.01666666666665, 483.01666666666665, 484.01666666666665, 485.01666666666665, 486.01666666666665, 487.01666666666665, 488.01666666666665, 489.01666666666665, 490.01666666666665, 491.01666666666665, 492.01666666666665, 493.01666666666665, 494.01666666666665, 495.01666666666665, 496.01666666666665, 497.01666666666665, 498.01666666666665, 499.01666666666665, 500.01666666666665, 501.01666666666665, 502.01666666666665, 503.01666666666665, 504.01666666666665, 505.01666666666665, 506.01666666666665, 507.01666666666665, 508.01666666666665], "recent_frames_sha256": "e336968f254a97d653323030cf79af448435dd6c5dad86afdbb472e2614976c6", "num_recent_frames": 30, "tq": 716449.737289147, "t1": 716464.137611179, "ta": 716464.137611179, "te": 716464.174809379, "first_response_s": 14.400322032044642, "answer_total_s": 14.437520232051611, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_472_a602_q0", "video_id": 472, "time_stamp_s": 509, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6105416514d2a292639033f81a42ddf8873a7cc9b7b09d6d635d24f50a01dfa7", "condition_order": ["recent", "notes"], "memory": "[150-180s] - Artworks by Tezuka Osamu are displayed on a white wall, including framed pieces with distinct color schemes and character depictions.  \n- A central orange-framed piece shows a cartoon character with a flame-like background, while adjacent pieces feature different characters and styles.  \n- The camera pans across the wall, highlighting various framed artworks, including one with a red background and a character holding a device.\n[180-210s] - A framed cartoon character with red boots and a black belt is displayed against a green background, signed by the artist.  \n- Adjacent to it, a framed artwork of a character in a blue outfit is shown, with a QR code and descriptive plaque nearby.  \n- The camera pans to reveal a series of four abstract, colorful glass panels arranged in a grid, each encased in an orange frame.\n[210-240s] - A large abstract painting with a green and yellow split, labeled \"KIM EUN MI,\" is displayed on a white wall.  \n- Below it, a red abstract piece with a grid pattern is mounted, followed by a blue floral artwork featuring white birds.  \n- The blue artwork is positioned above a small white shelf holding two rabbit figurines, with a QR code and text nearby.\n[240-270s] - A framed cartoon of Astro Boy flying with a rocket trail is displayed, with a signature visible in the corner.\n- Below it, another framed piece shows Astro Boy standing on a pink background, wearing red boots and a black belt.\n- A third framed artwork depicts two Astro Boy figures on a yellow background, one facing left and the other right.\n[270-300s] - A large canvas depicting a stylized face with floral patterns is mounted on a white wall, labeled \"SONG KWANG YEON.\"  \n- Below, a display table showcases luxury items including red high heels, gold bowls, and woven handbags.  \n- To the right, another canvas features a profile with ornate, colorful floral motifs, positioned next to a blue plaque with text.\n[300-330s] - A large framed abstract painting hangs above three smaller, colorful paintings on a white wall.  \n- A blue painting with floral motifs and a gray stone base is displayed next to a red abstract piece.  \n- The camera pans right, revealing more vibrant, stylized artworks including a pink piece with a figure and a green landscape with a tiger.\n[330-360s] - A framed painting of a white tiger with a red flag is mounted on a white wall, positioned above a black-and-white portrait of a cat.  \n- Below the cat portrait, a framed artwork of butterflies is displayed, followed by a blue-framed piece featuring colorful butterflies.  \n- A transparent acrylic case holds a sculpted image of a French Bulldog, positioned above a white pedestal with two colorful, abstract figurines.\n[360-390s] - A blue sign with \"FLOOR 2\" and \"12:24\" is visible on a ceiling structure.  \n- The camera pans across a wall displaying various metallic and reflective art panels, including spiral and geometric designs.  \n- The lighting shifts dynamically, highlighting different textures and colors of the art pieces.\n[390-420s] - A large metallic artwork with concentric circular patterns is displayed on a dark wall, illuminated by colored lights.  \n- To its left, a screen shows a dynamic, colorful aurora over water, with changing hues of green, purple, and blue.  \n- The camera pans to reveal a gallery space with multiple artworks, including smaller framed pieces and a sign indicating \"BRYAN RUT 1223\" above a white wall.\n[420-450s] - A collection of six paintings, including a blue background with a bird, a sunflower, and a red apple, is displayed on a white wall.  \n- To the right, a large abstract artwork with black and white tones depicting tree-like structures is mounted.  \n- A vibrant, geometrically patterned painting with bold colors and a distant horizon is positioned next to the abstract piece.\n[450-480s] - A blue sign labeled \"FLORENCE 1221\" hangs above a white wall, indicating an exhibit section.  \n- The camera pans left, revealing a series of colorful, abstract paintings with horizontal stripes.  \n- A group of floral artworks, including roses and sunflowers, is displayed in a grid on the wall to the left.", "history_tokens": 962, "history_utf8_bytes": 4152, "recent_frame_times_s": [479.01666666666665, 480.01666666666665, 481.01666666666665, 482.01666666666665, 483.01666666666665, 484.01666666666665, 485.01666666666665, 486.01666666666665, 487.01666666666665, 488.01666666666665, 489.01666666666665, 490.01666666666665, 491.01666666666665, 492.01666666666665, 493.01666666666665, 494.01666666666665, 495.01666666666665, 496.01666666666665, 497.01666666666665, 498.01666666666665, 499.01666666666665, 500.01666666666665, 501.01666666666665, 502.01666666666665, 503.01666666666665, 504.01666666666665, 505.01666666666665, 506.01666666666665, 507.01666666666665, 508.01666666666665], "recent_frames_sha256": "e336968f254a97d653323030cf79af448435dd6c5dad86afdbb472e2614976c6", "num_recent_frames": 30, "tq": 716629.807880157, "t1": 716637.165747716, "ta": 716637.165747716, "te": 716637.577046879, "first_response_s": 7.357867558952421, "answer_total_s": 7.769166721962392, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 473, "content_group": "fcf43243dfdd86802cb4c9a63b211e0e5dd69f6975ff14615723842073fa03fb", "question": {"question_id": "sample_473_a2087_q1", "video_id": 473, "video_path": "./videos/sample_473_real.mp4", "annotation_index": 2087, "question_index": 1, "question": "What text is visible in the central painting with the figure wearing boxing gloves?", "options": ["A. \"STING LIKE QUEEN BEE\".", "B. \"SUGAR\".", "C. \"FIGHT LIKE A CHAMPION\".", "D. \"WINNER TAKES ALL\"."], "answer": "A", "time_stamp_s": 3, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_473_a2087_q1", "video_id": 473, "time_stamp_s": 3, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2b7a10338c06c4784bf4d7d9dec22f171203dbe68a93bdd7066a8a0b7193ce73", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03802083333333333, 1.0046875, 2.0046875], "recent_frames_sha256": "72fed17fab6b1041bb25c839abd6f44aeb18f448c958d0f84ba573a021c68334", "num_recent_frames": 3, "tq": 717676.083173938, "t1": 717676.876432572, "ta": 717676.876432572, "te": 717676.915686001, "first_response_s": 0.7932586340466514, "answer_total_s": 0.8325120629742742, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_473_a2087_q1", "video_id": 473, "time_stamp_s": 3, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2dd4385c99d8e3d4340d0324980fb07ee66250abd3b0c8e81e91f5b8cdeae52b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03802083333333333, 1.0046875, 2.0046875], "recent_frames_sha256": "72fed17fab6b1041bb25c839abd6f44aeb18f448c958d0f84ba573a021c68334", "num_recent_frames": 3, "tq": 717719.083264865, "t1": 717731.83772679, "ta": 717731.83772679, "te": 717732.02770021, "first_response_s": 12.754461925011128, "answer_total_s": 12.94443534500897, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 473, "content_group": "fcf43243dfdd86802cb4c9a63b211e0e5dd69f6975ff14615723842073fa03fb", "question": {"question_id": "sample_473_a2087_q0", "video_id": 473, "video_path": "./videos/sample_473_real.mp4", "annotation_index": 2087, "question_index": 0, "question": "Where is the painting with the text \"STING LIKE QUEEN BEE\" located in relation to the other two paintings?", "options": ["A. On the left.", "B. In the center.", "C. On the right.", "D. Above the other two."], "answer": "B", "time_stamp_s": 6, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_473_a2087_q0", "video_id": 473, "time_stamp_s": 6, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a338bb623ba084abdfd36a7c74771e271fef93a55e9becb2e8f4a10876e42edb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03802083333333333, 1.0046875, 2.0046875, 3.0046875, 4.0046875, 5.0046875], "recent_frames_sha256": "4e67023b95ff4d2414b1c30894e84630ba8bc058c2ef2d1fcf43c4773e160bb0", "num_recent_frames": 6, "tq": 717676.940096272, "t1": 717688.774204858, "ta": 717688.774204858, "te": 717688.814964952, "first_response_s": 11.834108585957438, "answer_total_s": 11.874868679908104, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_473_a2087_q0", "video_id": 473, "time_stamp_s": 6, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "dba6c9e021895e2b3337a58199a50e000027228c5dc365104c042efd349c8321", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03802083333333333, 1.0046875, 2.0046875, 3.0046875, 4.0046875, 5.0046875], "recent_frames_sha256": "4e67023b95ff4d2414b1c30894e84630ba8bc058c2ef2d1fcf43c4773e160bb0", "num_recent_frames": 6, "tq": 717732.041861672, "t1": 717739.323958688, "ta": 717739.323958688, "te": 717739.361801263, "first_response_s": 7.282097015995532, "answer_total_s": 7.319939590990543, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 473, "content_group": "fcf43243dfdd86802cb4c9a63b211e0e5dd69f6975ff14615723842073fa03fb", "question": {"question_id": "sample_473_a2087_q2", "video_id": 473, "video_path": "./videos/sample_473_real.mp4", "annotation_index": 2087, "question_index": 2, "question": "Which painting includes a seaside scene with birds flying around?", "options": ["A. The painting of a mother holding a baby.", "B. The painting with the text \"SUGAR\".", "C. The painting of the oversized shark and pig.", "D. The painting with anthropomorphic figures."], "answer": "C", "time_stamp_s": 25, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_473_a2087_q2", "video_id": 473, "time_stamp_s": 25, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "33be0474e50ca51962dfa002521c4e17986b417f96d4432bd5291e7961be64c9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03802083333333333, 1.0046875, 2.0046875, 3.0046875, 4.0046875, 5.0046875, 6.0046875, 7.0046875, 8.0046875, 9.0046875, 10.0046875, 11.0046875, 12.0046875, 13.0046875, 14.0046875, 15.0046875, 16.0046875, 17.0046875, 18.0046875, 19.0046875, 20.0046875, 21.0046875, 22.0046875, 23.0046875, 24.0046875], "recent_frames_sha256": "bc3c2d9568990d4f1cc5c9d31b128b18bd5d3ac8786c730932de47e6a1e28565", "num_recent_frames": 25, "tq": 717688.832553616, "t1": 717699.718197822, "ta": 717699.718197822, "te": 717699.77501536, "first_response_s": 10.885644205962308, "answer_total_s": 10.942461743950844, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_473_a2087_q2", "video_id": 473, "time_stamp_s": 25, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "415d82c9560a6923e67f3a3c8ed7a61efb0f726f10fbbee15a29a01db7658e73", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03802083333333333, 1.0046875, 2.0046875, 3.0046875, 4.0046875, 5.0046875, 6.0046875, 7.0046875, 8.0046875, 9.0046875, 10.0046875, 11.0046875, 12.0046875, 13.0046875, 14.0046875, 15.0046875, 16.0046875, 17.0046875, 18.0046875, 19.0046875, 20.0046875, 21.0046875, 22.0046875, 23.0046875, 24.0046875], "recent_frames_sha256": "bc3c2d9568990d4f1cc5c9d31b128b18bd5d3ac8786c730932de47e6a1e28565", "num_recent_frames": 25, "tq": 717739.371484215, "t1": 717750.788741721, "ta": 717750.788741721, "te": 717750.979019662, "first_response_s": 11.417257505934685, "answer_total_s": 11.607535446994007, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 473, "content_group": "fcf43243dfdd86802cb4c9a63b211e0e5dd69f6975ff14615723842073fa03fb", "question": {"question_id": "sample_473_a2088_q0", "video_id": 473, "video_path": "./videos/sample_473_real.mp4", "annotation_index": 2088, "question_index": 0, "question": "What is the price tag seen below the artist's name, Anthony Ausgang?", "options": ["A. $150.", "B. $300.", "C. $450.", "D. $600."], "answer": "B", "time_stamp_s": 328, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_473_a2088_q0", "video_id": 473, "time_stamp_s": 328, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "eff37811352c854ac939f1d63c5a8afa1dca233a9e8aa8848a962c16bfdeeab2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [298.0046875, 299.0046875, 300.0046875, 301.0046875, 302.0046875, 303.0046875, 304.0046875, 305.0046875, 306.0046875, 307.0046875, 308.0046875, 309.0046875, 310.0046875, 311.0046875, 312.0046875, 313.0046875, 314.0046875, 315.0046875, 316.0046875, 317.0046875, 318.0046875, 319.0046875, 320.0046875, 321.0046875, 322.0046875, 323.0046875, 324.0046875, 325.0046875, 326.0046875, 327.0046875], "recent_frames_sha256": "285e491abf480681427cf525fe7e6a4a8657a0a0bf43b90cb596a5ecbf84f5c8", "num_recent_frames": 30, "tq": 717699.809199001, "t1": 717712.512564579, "ta": 717712.512564579, "te": 717712.550471905, "first_response_s": 12.703365577966906, "answer_total_s": 12.741272903978825, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_473_a2088_q0", "video_id": 473, "time_stamp_s": 328, "ground_truth": "B", "raw_output": "B. $300.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "66d6395b94698f44f6a116c2d91bd214eacab78f31097f262f99554caf66bacf", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A large shark painting with a human figure on its back is displayed prominently on a white wall, surrounded by other colorful artworks.  \n- The camera pans across various framed paintings, including vibrant pop-art pieces and surreal scenes, with some artworks featuring bold text like \"STING LIKE A BEAR.\"  \n- Visitors are seen walking through the gallery space, observing the art, with some pausing to look at specific pieces, particularly the shark painting.\n[30-60s] - A large heart-shaped painting with ornate gold detailing and a face is prominently displayed on the wall.  \n- A framed black-and-white portrait of a woman with a crown is mounted above a framed image of a horse's head.  \n- A small white panda figurine stands on a black pedestal near a framed abstract artwork.\n[60-90s] - A yellow flower is superimposed over a skull in a framed artwork, positioned centrally on the wall.  \n- To the right, a painting depicts a figure draped in teal fabric, with another nude figure partially visible beside it.  \n- A large abstract painting with red and blue hues is mounted below a black-and-white sculpture of intertwined figures.\n[90-120s] - A framed painting of a red-haired girl in a bamboo grove is displayed on the wall, with a gold ornate frame.  \n- Below it, a painting of a skeleton with long blonde hair is visible, also in a decorative frame.  \n- A woman in a pink top walks past a display of sculpted figures, including a green frog and a yellow creature, on black pedestals.\n[120-150s] - Two identical blue-dressed dolls with red noses stand side-by-side on a white pedestal, facing forward.  \n- A large, colorful painting depicting a crowded scene hangs on the wall above them, with a small plaque beneath it.  \n- To the right of the dolls, a dark-framed painting of a woman with horns and two kneeling figures is visible, followed by a smaller owl painting.\n[150-180s] - A large framed painting depicts a chaotic battle scene with multiple figures in dynamic poses.  \n- To its right, a sculpture of a skull with a black, cloud-like mass erupting from its top, featuring a central eye.  \n- Below the sculpture, a smaller framed painting shows a person lying on the ground with boots stepping on them, set against a red background.\n[180-210s] - A table covered in black cloth displays various purple and blue crystal-like objects and metallic figurines.  \n- Two ornate, fairy-themed wall sculptures with red-haired figures are mounted side by side on a white wall.  \n- A framed black-and-white photograph of a person holding a hat hangs above the fairy sculptures.\n[210-240s] - A large, dark, textured sculpture hangs on the wall, positioned to the left of a framed painting of a crucified figure.  \n- Below the crucifixion painting, a framed McDonald's logo with birds is mounted, followed by a screen displaying blue cat-like figures.  \n- A colorful, whimsical painting of a castle and trees is visible beneath the McDonald's artwork, with a small, detailed sculpture of a creature near its base.\n[240-270s] - A framed painting of a tree with green leaves and a mossy trunk is centered on the wall.  \n- To its right, a black-framed artwork depicts a figure in a dark robe standing atop red flames.  \n- Below the tree painting, a framed piece shows a cat wearing a ruffled collar and holding a small object.\n[270-300s] - A pink seahorse sculpture is mounted on the wall, positioned above a blue and orange seahorse sculpture.  \n- A framed painting depicting a whimsical scene with a pink boat and lotus flowers is displayed to the right of a tall vertical painting.  \n- A large framed artwork with a surreal figure and lightning bolts is visible on the wall, adjacent to a smaller framed piece.", "history_tokens": 855, "history_utf8_bytes": 3726, "recent_frame_times_s": [298.0046875, 299.0046875, 300.0046875, 301.0046875, 302.0046875, 303.0046875, 304.0046875, 305.0046875, 306.0046875, 307.0046875, 308.0046875, 309.0046875, 310.0046875, 311.0046875, 312.0046875, 313.0046875, 314.0046875, 315.0046875, 316.0046875, 317.0046875, 318.0046875, 319.0046875, 320.0046875, 321.0046875, 322.0046875, 323.0046875, 324.0046875, 325.0046875, 326.0046875, 327.0046875], "recent_frames_sha256": "285e491abf480681427cf525fe7e6a4a8657a0a0bf43b90cb596a5ecbf84f5c8", "num_recent_frames": 30, "tq": 717830.730923011, "t1": 717862.585664809, "ta": 717862.585664809, "te": 717862.847489839, "first_response_s": 31.85474179801531, "answer_total_s": 32.11656682798639, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 473, "content_group": "fcf43243dfdd86802cb4c9a63b211e0e5dd69f6975ff14615723842073fa03fb", "question": {"question_id": "sample_473_a2088_q1", "video_id": 473, "video_path": "./videos/sample_473_real.mp4", "annotation_index": 2088, "question_index": 1, "question": "What does this sculpture, fixed to the wall in the video, demonstrate?", "options": ["A. As a colorful parrot with extended wings.", "B. As a Venus flytrap with a pink tongue.", "C. As a metallic robot with glowing eyes.", "D. As a large tree with hanging fruits."], "answer": "B", "time_stamp_s": 329, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_473_a2088_q1", "video_id": 473, "time_stamp_s": 329, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4fa0f8abc8699d4bf608466729e3abe19500a7d4f931b2ad0fa1b8269a42c052", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [299.0046875, 300.0046875, 301.0046875, 302.0046875, 303.0046875, 304.0046875, 305.0046875, 306.0046875, 307.0046875, 308.0046875, 309.0046875, 310.0046875, 311.0046875, 312.0046875, 313.0046875, 314.0046875, 315.0046875, 316.0046875, 317.0046875, 318.0046875, 319.0046875, 320.0046875, 321.0046875, 322.0046875, 323.0046875, 324.0046875, 325.0046875, 326.0046875, 327.0046875, 328.0046875], "recent_frames_sha256": "4af680663d6728b27391c837abba339b967b212c30dc8cccae0ad0ee39a112f9", "num_recent_frames": 30, "tq": 717712.566987137, "t1": 717719.036990323, "ta": 717719.036990323, "te": 717719.074837464, "first_response_s": 6.470003186026588, "answer_total_s": 6.507850327063352, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_473_a2088_q1", "video_id": 473, "time_stamp_s": 329, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "027f68bb7f8a2d5ee306a24a6a5b782aa6fc747f31379e334a2acd7cc20e3d6f", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A large shark painting with a human figure on its back is displayed prominently on a white wall, surrounded by other colorful artworks.  \n- The camera pans across various framed paintings, including vibrant pop-art pieces and surreal scenes, with some artworks featuring bold text like \"STING LIKE A BEAR.\"  \n- Visitors are seen walking through the gallery space, observing the art, with some pausing to look at specific pieces, particularly the shark painting.\n[30-60s] - A large heart-shaped painting with ornate gold detailing and a face is prominently displayed on the wall.  \n- A framed black-and-white portrait of a woman with a crown is mounted above a framed image of a horse's head.  \n- A small white panda figurine stands on a black pedestal near a framed abstract artwork.\n[60-90s] - A yellow flower is superimposed over a skull in a framed artwork, positioned centrally on the wall.  \n- To the right, a painting depicts a figure draped in teal fabric, with another nude figure partially visible beside it.  \n- A large abstract painting with red and blue hues is mounted below a black-and-white sculpture of intertwined figures.\n[90-120s] - A framed painting of a red-haired girl in a bamboo grove is displayed on the wall, with a gold ornate frame.  \n- Below it, a painting of a skeleton with long blonde hair is visible, also in a decorative frame.  \n- A woman in a pink top walks past a display of sculpted figures, including a green frog and a yellow creature, on black pedestals.\n[120-150s] - Two identical blue-dressed dolls with red noses stand side-by-side on a white pedestal, facing forward.  \n- A large, colorful painting depicting a crowded scene hangs on the wall above them, with a small plaque beneath it.  \n- To the right of the dolls, a dark-framed painting of a woman with horns and two kneeling figures is visible, followed by a smaller owl painting.\n[150-180s] - A large framed painting depicts a chaotic battle scene with multiple figures in dynamic poses.  \n- To its right, a sculpture of a skull with a black, cloud-like mass erupting from its top, featuring a central eye.  \n- Below the sculpture, a smaller framed painting shows a person lying on the ground with boots stepping on them, set against a red background.\n[180-210s] - A table covered in black cloth displays various purple and blue crystal-like objects and metallic figurines.  \n- Two ornate, fairy-themed wall sculptures with red-haired figures are mounted side by side on a white wall.  \n- A framed black-and-white photograph of a person holding a hat hangs above the fairy sculptures.\n[210-240s] - A large, dark, textured sculpture hangs on the wall, positioned to the left of a framed painting of a crucified figure.  \n- Below the crucifixion painting, a framed McDonald's logo with birds is mounted, followed by a screen displaying blue cat-like figures.  \n- A colorful, whimsical painting of a castle and trees is visible beneath the McDonald's artwork, with a small, detailed sculpture of a creature near its base.\n[240-270s] - A framed painting of a tree with green leaves and a mossy trunk is centered on the wall.  \n- To its right, a black-framed artwork depicts a figure in a dark robe standing atop red flames.  \n- Below the tree painting, a framed piece shows a cat wearing a ruffled collar and holding a small object.\n[270-300s] - A pink seahorse sculpture is mounted on the wall, positioned above a blue and orange seahorse sculpture.  \n- A framed painting depicting a whimsical scene with a pink boat and lotus flowers is displayed to the right of a tall vertical painting.  \n- A large framed artwork with a surreal figure and lightning bolts is visible on the wall, adjacent to a smaller framed piece.", "history_tokens": 855, "history_utf8_bytes": 3726, "recent_frame_times_s": [299.0046875, 300.0046875, 301.0046875, 302.0046875, 303.0046875, 304.0046875, 305.0046875, 306.0046875, 307.0046875, 308.0046875, 309.0046875, 310.0046875, 311.0046875, 312.0046875, 313.0046875, 314.0046875, 315.0046875, 316.0046875, 317.0046875, 318.0046875, 319.0046875, 320.0046875, 321.0046875, 322.0046875, 323.0046875, 324.0046875, 325.0046875, 326.0046875, 327.0046875, 328.0046875], "recent_frames_sha256": "4af680663d6728b27391c837abba339b967b212c30dc8cccae0ad0ee39a112f9", "num_recent_frames": 30, "tq": 717862.865958597, "t1": 717870.928253664, "ta": 717870.928253664, "te": 717870.969692515, "first_response_s": 8.062295067007653, "answer_total_s": 8.103733917931095, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 475, "content_group": "ff9748774612440d19ba1a87fc2ed5556c6a2b2bc635c790dc14af9736b4cf93", "question": {"question_id": "sample_475_a1286_q0", "video_id": 475, "video_path": "./videos/sample_475_real.mp4", "annotation_index": 1286, "question_index": 0, "question": "What are the patterns and text on the rectangular boxes of the tall sculpture?", "options": ["A. Stripes, polka dots, \"BANG!\", \"Soup\".", "B. Polka dots, stripes, \"POW!\", \"Brillo\".", "C. Chevron, zigzags, \"WOW!\", \"Coca-Cola\".", "D. Dots, lines, \"BOOM!\", \"Pepsi\"."], "answer": "B", "time_stamp_s": 10, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_475_a1286_q0", "video_id": 475, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a7107c9d37944448a196d6a8a66dc618be128bf4f9115a7ae9b23360220fc46d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03899739583333333, 1.0056640625, 2.0056640625, 3.0056640625, 4.0056640625, 5.0056640625, 6.0056640625, 7.0056640625, 8.0056640625, 9.0056640625], "recent_frames_sha256": "ba5ab85c108d095154503860aaab927b653009b3595b8735ea3d1ee1d49e0c1b", "num_recent_frames": 10, "tq": 716100.779289049, "t1": 716114.593629251, "ta": 716114.593629251, "te": 716114.631277624, "first_response_s": 13.814340202021413, "answer_total_s": 13.851988575072028, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_475_a1286_q0", "video_id": 475, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "68c69c67049c9224edb04c1cb55c3da80964a77755f8bb23bcc88b836cbaa030", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03899739583333333, 1.0056640625, 2.0056640625, 3.0056640625, 4.0056640625, 5.0056640625, 6.0056640625, 7.0056640625, 8.0056640625, 9.0056640625], "recent_frames_sha256": "ba5ab85c108d095154503860aaab927b653009b3595b8735ea3d1ee1d49e0c1b", "num_recent_frames": 10, "tq": 716162.948539032, "t1": 716175.694180624, "ta": 716175.694180624, "te": 716175.732272991, "first_response_s": 12.745641591958702, "answer_total_s": 12.78373395896051, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 475, "content_group": "ff9748774612440d19ba1a87fc2ed5556c6a2b2bc635c790dc14af9736b4cf93", "question": {"question_id": "sample_475_a1286_q1", "video_id": 475, "video_path": "./videos/sample_475_real.mp4", "annotation_index": 1286, "question_index": 1, "question": "What does the large wall-mounted artwork say right now?", "options": ["A. \"LIVE LIFE TO THE FULLEST\".", "B. \"ART IS LIFE\".", "C. \"IN MY LIFE I LOVE YOU MORE\".", "D. \"LOVE MAKES LIFE BEAUTIFUL\"."], "answer": "C", "time_stamp_s": 27, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_475_a1286_q1", "video_id": 475, "time_stamp_s": 27, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b7c8d3b62833cf4cc1a69ea8c7090569b5c2bc478370bb34fe5d6d210e2481e8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03899739583333333, 1.0056640625, 2.0056640625, 3.0056640625, 4.0056640625, 5.0056640625, 6.0056640625, 7.0056640625, 8.0056640625, 9.0056640625, 10.0056640625, 11.0056640625, 12.0056640625, 13.0056640625, 14.0056640625, 15.0056640625, 16.0056640625, 17.0056640625, 18.0056640625, 19.0056640625, 20.0056640625, 21.0056640625, 22.0056640625, 23.0056640625, 24.0056640625, 25.0056640625, 26.0056640625], "recent_frames_sha256": "83c6a08709e985b63adb66abc2c510ad8f7647e9696f49de9e1b0fb58fc77d53", "num_recent_frames": 27, "tq": 716114.638678752, "t1": 716126.312393098, "ta": 716126.312393098, "te": 716126.349781441, "first_response_s": 11.673714346019551, "answer_total_s": 11.711102689034306, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_475_a1286_q1", "video_id": 475, "time_stamp_s": 27, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9e19073cc39218c1a8d3df00c317096fa3ac9aabe28d3c3e027eba17022a15c3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03899739583333333, 1.0056640625, 2.0056640625, 3.0056640625, 4.0056640625, 5.0056640625, 6.0056640625, 7.0056640625, 8.0056640625, 9.0056640625, 10.0056640625, 11.0056640625, 12.0056640625, 13.0056640625, 14.0056640625, 15.0056640625, 16.0056640625, 17.0056640625, 18.0056640625, 19.0056640625, 20.0056640625, 21.0056640625, 22.0056640625, 23.0056640625, 24.0056640625, 25.0056640625, 26.0056640625], "recent_frames_sha256": "83c6a08709e985b63adb66abc2c510ad8f7647e9696f49de9e1b0fb58fc77d53", "num_recent_frames": 27, "tq": 716175.743688059, "t1": 716182.548078556, "ta": 716182.548078556, "te": 716182.698342072, "first_response_s": 6.804390496923588, "answer_total_s": 6.954654012923129, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 475, "content_group": "ff9748774612440d19ba1a87fc2ed5556c6a2b2bc635c790dc14af9736b4cf93", "question": {"question_id": "sample_475_a1287_q0", "video_id": 475, "video_path": "./videos/sample_475_real.mp4", "annotation_index": 1287, "question_index": 0, "question": "What action does the camera perform after showing the \"Bruce Lurie Gallery 1315\" sign?", "options": ["A. Pans left.", "B. Zooms in.", "C. Pans upward.", "D. Tilts downward."], "answer": "D", "time_stamp_s": 174, "task_type": "Action Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_475_a1287_q0", "video_id": 475, "time_stamp_s": 174, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c5366b4260736c6d17ce13d9632bed0fbc0e1daa9adb9be6abcc219d0e45aa1c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [144.0056640625, 145.0056640625, 146.0056640625, 147.0056640625, 148.0056640625, 149.0056640625, 150.0056640625, 151.0056640625, 152.0056640625, 153.0056640625, 154.0056640625, 155.0056640625, 156.0056640625, 157.0056640625, 158.0056640625, 159.0056640625, 160.0056640625, 161.0056640625, 162.0056640625, 163.0056640625, 164.0056640625, 165.0056640625, 166.0056640625, 167.0056640625, 168.0056640625, 169.0056640625, 170.0056640625, 171.0056640625, 172.0056640625, 173.0056640625], "recent_frames_sha256": "dd40b798afc256697b5bcac607a5198c6f461e19fbb1801dee1c00695b2857f3", "num_recent_frames": 30, "tq": 716126.358146102, "t1": 716140.255339434, "ta": 716140.255339434, "te": 716140.292392924, "first_response_s": 13.897193331969902, "answer_total_s": 13.934246821911074, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_475_a1287_q0", "video_id": 475, "time_stamp_s": 174, "ground_truth": "D", "raw_output": "A. Pans left.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "d446d4271c53fa613fc31bc1b6bbfb081cb6f635a02683d20c97b6a392631db4", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A colorful, three-dimensional \"POW!\" sign with a dice pattern is displayed on a pedestal, surrounded by visitors.  \n- A large, abstract artwork spelling \"I'M MY LIFE I LOVE YOU MOM\" in vibrant, flower-patterned letters is mounted on a white wall, drawing attention from multiple viewers.  \n- People are seen walking through the gallery, observing various artworks, including a vertical strip of colorful paintings and a large, abstract piece with bold geometric shapes.\n[30-60s] - A large, colorful 3D \"WHOOOM!\" sign is mounted on a white wall, with its letters in bright hues and bold outlines.  \n- The camera pans left, revealing a blue sign labeled \"ART IN ROOM 1311\" above a gallery wall displaying abstract and cubist paintings.  \n- Several framed artworks, including portraits and abstract compositions, are arranged on the wall, with some featuring vibrant colors and geometric shapes.\n[60-90s] - A large abstract painting with vibrant, chaotic brushstrokes dominates the center of the wall, surrounded by smaller framed artworks.  \n- A decorative, textured table display features tarot cards, candles, and a small framed photo, positioned against a white wall.  \n- A tall, leafy plant casts a distinct shadow across the wall, partially obscuring the artwork behind it.\n[90-120s] - A framed painting of a woman in a green dress with a red sash, standing beside a sewing machine, is displayed on a white wall.  \n- Adjacent to it, a large abstract painting with white, yellow, and brown floral-like forms against a green and blue background is mounted.  \n- A blue sign reading \"GALLERY ARTS 1313\" is visible above the paintings, indicating the gallery's location.\n[120-150s] - A framed painting of a woman in yellow attire with a red skirt, seated behind a wooden cabinet filled with small objects, is displayed on a white wall.  \n- To its right, a vibrant abstract painting with blue, yellow, and green hues depicting a landscape with trees and flowing water is visible.  \n- The camera pans left, revealing two tall, textured green panels with embedded black spheres, mounted side by side on the wall.", "history_tokens": 481, "history_utf8_bytes": 2117, "recent_frame_times_s": [144.0056640625, 145.0056640625, 146.0056640625, 147.0056640625, 148.0056640625, 149.0056640625, 150.0056640625, 151.0056640625, 152.0056640625, 153.0056640625, 154.0056640625, 155.0056640625, 156.0056640625, 157.0056640625, 158.0056640625, 159.0056640625, 160.0056640625, 161.0056640625, 162.0056640625, 163.0056640625, 164.0056640625, 165.0056640625, 166.0056640625, 167.0056640625, 168.0056640625, 169.0056640625, 170.0056640625, 171.0056640625, 172.0056640625, 173.0056640625], "recent_frames_sha256": "dd40b798afc256697b5bcac607a5198c6f461e19fbb1801dee1c00695b2857f3", "num_recent_frames": 30, "tq": 716220.592787272, "t1": 716228.635984255, "ta": 716228.635984255, "te": 716228.859041539, "first_response_s": 8.043196983053349, "answer_total_s": 8.266254267073236, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 475, "content_group": "ff9748774612440d19ba1a87fc2ed5556c6a2b2bc635c790dc14af9736b4cf93", "question": {"question_id": "sample_475_a1288_q0", "video_id": 475, "video_path": "./videos/sample_475_real.mp4", "annotation_index": 1288, "question_index": 0, "question": "Where is the artist's signature located in the pool scene painting?", "options": ["A. At the top of the painting.", "B. On the left side of the painting.", "C. At the lower edge of the painting.", "D. In the center of the painting."], "answer": "C", "time_stamp_s": 336, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_475_a1288_q0", "video_id": 475, "time_stamp_s": 336, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "aaf695da4d99b53ee3c81690d8341d50ffcc03054ed2a38845a18c9344cbbe1e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [306.0056640625, 307.0056640625, 308.0056640625, 309.0056640625, 310.0056640625, 311.0056640625, 312.0056640625, 313.0056640625, 314.0056640625, 315.0056640625, 316.0056640625, 317.0056640625, 318.0056640625, 319.0056640625, 320.0056640625, 321.0056640625, 322.0056640625, 323.0056640625, 324.0056640625, 325.0056640625, 326.0056640625, 327.0056640625, 328.0056640625, 329.0056640625, 330.0056640625, 331.0056640625, 332.0056640625, 333.0056640625, 334.0056640625, 335.0056640625], "recent_frames_sha256": "7499e0f3e2fdc03dfe60151f074f351e1d54d89024606a3856ba1df490335154", "num_recent_frames": 30, "tq": 716140.299881351, "t1": 716154.991255448, "ta": 716154.991255448, "te": 716155.028859789, "first_response_s": 14.691374097019434, "answer_total_s": 14.728978438070044, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_475_a1288_q0", "video_id": 475, "time_stamp_s": 336, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "56a56c179d48834d094ae20b6fb58bcd4116a7ecbdd82a8e72d8e4c5d405365f", "condition_order": ["recent", "notes"], "memory": "[30-60s] - A large, colorful 3D \"WHOOOM!\" sign is mounted on a white wall, with its letters in bright hues and bold outlines.  \n- The camera pans left, revealing a blue sign labeled \"ART IN ROOM 1311\" above a gallery wall displaying abstract and cubist paintings.  \n- Several framed artworks, including portraits and abstract compositions, are arranged on the wall, with some featuring vibrant colors and geometric shapes.\n[60-90s] - A large abstract painting with vibrant, chaotic brushstrokes dominates the center of the wall, surrounded by smaller framed artworks.  \n- A decorative, textured table display features tarot cards, candles, and a small framed photo, positioned against a white wall.  \n- A tall, leafy plant casts a distinct shadow across the wall, partially obscuring the artwork behind it.\n[90-120s] - A framed painting of a woman in a green dress with a red sash, standing beside a sewing machine, is displayed on a white wall.  \n- Adjacent to it, a large abstract painting with white, yellow, and brown floral-like forms against a green and blue background is mounted.  \n- A blue sign reading \"GALLERY ARTS 1313\" is visible above the paintings, indicating the gallery's location.\n[120-150s] - A framed painting of a woman in yellow attire with a red skirt, seated behind a wooden cabinet filled with small objects, is displayed on a white wall.  \n- To its right, a vibrant abstract painting with blue, yellow, and green hues depicting a landscape with trees and flowing water is visible.  \n- The camera pans left, revealing two tall, textured green panels with embedded black spheres, mounted side by side on the wall.\n[150-180s] - A group of visitors walks through the gallery, observing artworks on the walls.  \n- A large, colorful comic-style artwork titled \"GUERRA\" is prominently displayed on the right.  \n- A blue sign reading \"BRUCE LUMS CONTEST 1315\" is mounted on the wall above the gallery space.\n[180-210s] - A large abstract painting with black, white, and red splashes is mounted on the wall, positioned between two smaller framed artworks.  \n- Below it, a framed photograph of a snowy landscape with trees and a path is displayed, followed by another framed image of a rocky shoreline with turquoise water.  \n- To the left, a framed piece featuring a geometric pattern of overlapping hexagons is visible, with a light fixture above it casting illumination.\n[210-240s] - A blue sign reading \"BETTYMANN GALLERY 1917\" is mounted on a white wall, indicating the gallery's name and number.  \n- Abstract paintings with vibrant blues, greens, and purples are displayed in gold frames, arranged in rows along the white walls.  \n- Ceramic vases sit atop white cylindrical pedestals, positioned between the paintings, adding a tactile element to the gallery's layout.\n[240-270s] - A woman in a green top stands near a table, observing art pieces on the wall.  \n- The camera pans to reveal a large white wall displaying multiple abstract paintings in wooden frames, mounted on a white wall with wooden shelves.  \n- A sign reading \"GALLERY KARO\" is visible on a white wall, indicating the exhibition space.\n[270-300s] - Three vertically oriented, colorful, striped skateboard-shaped art pieces are mounted on a white wall, with a lit skateboard beneath them.  \n- A display of Cindy Shana’s artwork features a grid of red and white abstract pieces, positioned above a blue and white abstract display.  \n- A box of red apples is mounted on the wall, labeled \"Byungnook Yoon,\" with a box of green apples below it, labeled \"Sanghwa Shin.\"\n[300-330s] - A framed artwork labeled \"Byungrock Yoon\" displays a vibrant arrangement of red and green apples in a basket.  \n- Adjacent to it, a framed piece by \"Sangheol Shin\" shows a textured, abstract sculpture-like form against a dark background.  \n- The camera pans slightly to reveal a third framed artwork below, featuring a cascading, glittery texture within a light-colored frame.", "history_tokens": 935, "history_utf8_bytes": 3947, "recent_frame_times_s": [306.0056640625, 307.0056640625, 308.0056640625, 309.0056640625, 310.0056640625, 311.0056640625, 312.0056640625, 313.0056640625, 314.0056640625, 315.0056640625, 316.0056640625, 317.0056640625, 318.0056640625, 319.0056640625, 320.0056640625, 321.0056640625, 322.0056640625, 323.0056640625, 324.0056640625, 325.0056640625, 326.0056640625, 327.0056640625, 328.0056640625, 329.0056640625, 330.0056640625, 331.0056640625, 332.0056640625, 333.0056640625, 334.0056640625, 335.0056640625], "recent_frames_sha256": "7499e0f3e2fdc03dfe60151f074f351e1d54d89024606a3856ba1df490335154", "num_recent_frames": 30, "tq": 716301.519441107, "t1": 716307.999101184, "ta": 716307.999101184, "te": 716308.183499262, "first_response_s": 6.479660076904111, "answer_total_s": 6.664058154914528, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 475, "content_group": "ff9748774612440d19ba1a87fc2ed5556c6a2b2bc635c790dc14af9736b4cf93", "question": {"question_id": "sample_475_a1289_q0", "video_id": 475, "video_path": "./videos/sample_475_real.mp4", "annotation_index": 1289, "question_index": 0, "question": "What is written on the sign above the wall just now?", "options": ["A. \"PULA\" and \"1341\" with \"NEW YORK | USA\" below.", "B. \"PULA\" and \"1341\" with \"REYKJAVÍK | ICELAND\" below.", "C. \"PULA\" and \"1341\" with \"TOKYO | JAPAN\" below.", "D. \"PULA\" and \"1341\" with \"PARIS | FRANCE\" below."], "answer": "B", "time_stamp_s": 586, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "art_show", "reference_interval_s": [540, 590], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_475_a1289_q0", "video_id": 475, "time_stamp_s": 586, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3ebae98bab9986f9b7f06a4005fc4ad4adf1c4d003ee7ebbd63c3497758384cb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [556.0056640625, 557.0056640625, 558.0056640625, 559.0056640625, 560.0056640625, 561.0056640625, 562.0056640625, 563.0056640625, 564.0056640625, 565.0056640625, 566.0056640625, 567.0056640625, 568.0056640625, 569.0056640625, 570.0056640625, 571.0056640625, 572.0056640625, 573.0056640625, 574.0056640625, 575.0056640625, 576.0056640625, 577.0056640625, 578.0056640625, 579.0056640625, 580.0056640625, 581.0056640625, 582.0056640625, 583.0056640625, 584.0056640625, 585.0056640625], "recent_frames_sha256": "379c1ff77917121b47d30ba79f5de0f6e4ba6afdfdb97439c0de8980b7817a3e", "num_recent_frames": 30, "tq": 716155.043907061, "t1": 716162.902221384, "ta": 716162.902221384, "te": 716162.939361924, "first_response_s": 7.858314323006198, "answer_total_s": 7.8954548629699275, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_475_a1289_q0", "video_id": 475, "time_stamp_s": 586, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0367bb110620c2ffa7c0e23f1de5132a801e366d76101267e0b8a80c9e1a878e", "condition_order": ["recent", "notes"], "memory": "[240-270s] - A woman in a green top stands near a table, observing art pieces on the wall.  \n- The camera pans to reveal a large white wall displaying multiple abstract paintings in wooden frames, mounted on a white wall with wooden shelves.  \n- A sign reading \"GALLERY KARO\" is visible on a white wall, indicating the exhibition space.\n[270-300s] - Three vertically oriented, colorful, striped skateboard-shaped art pieces are mounted on a white wall, with a lit skateboard beneath them.  \n- A display of Cindy Shana’s artwork features a grid of red and white abstract pieces, positioned above a blue and white abstract display.  \n- A box of red apples is mounted on the wall, labeled \"Byungnook Yoon,\" with a box of green apples below it, labeled \"Sanghwa Shin.\"\n[300-330s] - A framed artwork labeled \"Byungrock Yoon\" displays a vibrant arrangement of red and green apples in a basket.  \n- Adjacent to it, a framed piece by \"Sangheol Shin\" shows a textured, abstract sculpture-like form against a dark background.  \n- The camera pans slightly to reveal a third framed artwork below, featuring a cascading, glittery texture within a light-colored frame.\n[330-360s] - A framed artwork with a map-like design and handwritten text is displayed on a white wall, accompanied by a small informational plaque.  \n- The camera pans right to reveal a vibrant, colorful collage of various logos and cartoon characters, including recognizable brands and pop culture icons.  \n- Below the collage, three textured, geometric panels in red, gray, and green are mounted vertically, each with a small plaque beside them.\n[360-390s] - A colorful, abstract painting of cartoon ducks in dynamic poses is displayed in a clear case, with QR codes visible on the left.\n- Adjacent to the painting, a series of rectangular glass cases showcase dense, colorful bead-like materials in various hues (yellow, red, pink, blue, purple).\n- The camera pans right, revealing a white wall with multiple transparent display cases, each containing different colored, textured materials, including a red panel labeled \"Ryan Cho.\"\n[390-420s] - A large, vibrant pink and purple textured artwork with a vertical dark stripe is displayed on a white wall, drawing attention from viewers.  \n- The camera pans to reveal a gallery space with multiple visitors observing various artworks, including abstract pieces and framed prints.  \n- A sign reading \"KATHERINE FILKE Intuitive Line Works\" is visible above a large black-and-white abstract line drawing, indicating the artist's section.\n[420-450s] - A large black-and-white abstract painting with intricate branching patterns dominates the center of the wall.  \n- To its left, a vertical stack of smaller framed artworks, all in black and white, is mounted on the wall.  \n- The gallery’s name, \"GALLERY 1202,\" is visible in white text above the central artwork.\n[450-480s] - A large red abstract painting with blue-green accents is displayed on the right wall, labeled \"LINDA FRUM\" and \"Abstract Painting.\"  \n- To its left, three smaller abstract paintings in blue and pink tones hang on the same wall.  \n- A red-framed artwork featuring a group of figures in white is visible on the left side of the frame, partially obscured by people walking by.\n[480-510s] - A large framed painting of a woman surrounded by red, doll-like figures is displayed on a white wall with red trim.  \n- A pink-framed artwork depicting a perfume bottle with a woman's face and the text \"HAPPY NEW BURGER\" is shown.  \n- A blue sign reading \"DESERT VALLEY GALLERY 1324\" is mounted on a white wall above a display of framed artworks.\n[510-540s] - A wall displays multiple framed artworks, including a prominent black-and-white portrait in an ornate frame.  \n- Below the artworks, a shelf holds several black-and-white baseball caps with visible logos.  \n- The wall also features a large framed piece with the text \"HOLLYWOOD\" and a stylized image of three figures.\n[540-570s] - A wall displays framed artworks, including a Mickey Mouse piece in a blue frame and a portrait in a black frame.  \n- A long horizontal artwork with text and illustrations hangs above smaller framed pieces.  \n- A sign reading \"TOPSTONE GALLERY 1339\" is visible on the ceiling, indicating the gallery's location.", "history_tokens": 999, "history_utf8_bytes": 4272, "recent_frame_times_s": [556.0056640625, 557.0056640625, 558.0056640625, 559.0056640625, 560.0056640625, 561.0056640625, 562.0056640625, 563.0056640625, 564.0056640625, 565.0056640625, 566.0056640625, 567.0056640625, 568.0056640625, 569.0056640625, 570.0056640625, 571.0056640625, 572.0056640625, 573.0056640625, 574.0056640625, 575.0056640625, 576.0056640625, 577.0056640625, 578.0056640625, 579.0056640625, 580.0056640625, 581.0056640625, 582.0056640625, 583.0056640625, 584.0056640625, 585.0056640625], "recent_frames_sha256": "379c1ff77917121b47d30ba79f5de0f6e4ba6afdfdb97439c0de8980b7817a3e", "num_recent_frames": 30, "tq": 716367.387466403, "t1": 716369.226643196, "ta": 716369.226643196, "te": 716369.268492929, "first_response_s": 1.8391767930006608, "answer_total_s": 1.8810265260981396, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 476, "content_group": "164a9facb6375b585cce4971f66bbcba5c07b5b5855ec495a94e0d894cb957c8", "question": {"question_id": "sample_476_a1197_q0", "video_id": 476, "video_path": "./videos/sample_476_real.mp4", "annotation_index": 1197, "question_index": 0, "question": "How are the four smaller rectangular frames arranged?", "options": ["A. Horizontally in a single row.", "B. Vertically in a single column.", "C. In a 2x2 grid.", "D. In a diagonal line."], "answer": "C", "time_stamp_s": 9, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_476_a1197_q0", "video_id": 476, "time_stamp_s": 9, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ce195f9b67c6bc2316347dc1dee23a8e373ff285bdd8ef5be50d74ff7eab3f29", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.04602864583333333, 1.0126953125, 2.0126953125, 3.0126953125, 4.0126953125, 5.0126953125, 6.0126953125, 7.0126953125, 8.0126953125], "recent_frames_sha256": "4779502c077eb1e7e2a187ce2c92b205ccb900b4f7f88e05738b07d3d1b50964", "num_recent_frames": 9, "tq": 715527.467384448, "t1": 715528.066299407, "ta": 715528.066299407, "te": 715528.10475253, "first_response_s": 0.5989149590022862, "answer_total_s": 0.6373680819524452, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_476_a1197_q0", "video_id": 476, "time_stamp_s": 9, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "30729f5d8f230e593ff9b05a6d323db10e00f328ddcc21959b48ff3feddb8435", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.04602864583333333, 1.0126953125, 2.0126953125, 3.0126953125, 4.0126953125, 5.0126953125, 6.0126953125, 7.0126953125, 8.0126953125], "recent_frames_sha256": "4779502c077eb1e7e2a187ce2c92b205ccb900b4f7f88e05738b07d3d1b50964", "num_recent_frames": 9, "tq": 715450.616033597, "t1": 715456.795758668, "ta": 715456.795758668, "te": 715456.832917, "first_response_s": 6.179725070949644, "answer_total_s": 6.216883403016254, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 476, "content_group": "164a9facb6375b585cce4971f66bbcba5c07b5b5855ec495a94e0d894cb957c8", "question": {"question_id": "sample_476_a1197_q1", "video_id": 476, "video_path": "./videos/sample_476_real.mp4", "annotation_index": 1197, "question_index": 1, "question": "What does the sign on the white wall read?", "options": ["A. \"GALERIE DE' ARTS 1343 SANTA MONICA, CA\".", "B. \"ART GALLERY SANTA MONICA\".", "C. \"DE' ARTS GALLERY 1234 SANTA MONICA, CA\".", "D. \"SANTA MONICA ART GALLERY\"."], "answer": "A", "time_stamp_s": 15, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_476_a1197_q1", "video_id": 476, "time_stamp_s": 15, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7627949bc7a499543f17795574b5fa9e8c3cb495b68d4fba26b2d40189353ef9", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.04602864583333333, 1.0126953125, 2.0126953125, 3.0126953125, 4.0126953125, 5.0126953125, 6.0126953125, 7.0126953125, 8.0126953125, 9.0126953125, 10.0126953125, 11.0126953125, 12.0126953125, 13.0126953125, 14.0126953125], "recent_frames_sha256": "1289d388ead6d6fd74109026b9d76bd47a66b832c55c8365e23b03e85d5e1228", "num_recent_frames": 15, "tq": 715528.11881224, "t1": 715539.888573112, "ta": 715539.888573112, "te": 715539.926731666, "first_response_s": 11.769760872004554, "answer_total_s": 11.807919426006265, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_476_a1197_q1", "video_id": 476, "time_stamp_s": 15, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8661528a66389ae889c43e369abd486346bdae37dcf4d05f21a8b62d860c8226", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.04602864583333333, 1.0126953125, 2.0126953125, 3.0126953125, 4.0126953125, 5.0126953125, 6.0126953125, 7.0126953125, 8.0126953125, 9.0126953125, 10.0126953125, 11.0126953125, 12.0126953125, 13.0126953125, 14.0126953125], "recent_frames_sha256": "1289d388ead6d6fd74109026b9d76bd47a66b832c55c8365e23b03e85d5e1228", "num_recent_frames": 15, "tq": 715456.852698983, "t1": 715468.17711533, "ta": 715468.17711533, "te": 715468.215849514, "first_response_s": 11.324416346964426, "answer_total_s": 11.36315053096041, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 476, "content_group": "164a9facb6375b585cce4971f66bbcba5c07b5b5855ec495a94e0d894cb957c8", "question": {"question_id": "sample_476_a1198_q1", "video_id": 476, "video_path": "./videos/sample_476_real.mp4", "annotation_index": 1198, "question_index": 1, "question": "Where are the black metallic sculptures positioned in the gallery?", "options": ["A. On the floor.", "B. On white and blakc pedestals.", "C. On a wooden table.", "D. Hanging from the ceiling."], "answer": "B", "time_stamp_s": 167, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_476_a1198_q1", "video_id": 476, "time_stamp_s": 167, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "84334fcd43dfbb62899e40c7af1aab41a4db35dc81e989386f5868dd8cc920ad", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [137.0126953125, 138.0126953125, 139.0126953125, 140.0126953125, 141.0126953125, 142.0126953125, 143.0126953125, 144.0126953125, 145.0126953125, 146.0126953125, 147.0126953125, 148.0126953125, 149.0126953125, 150.0126953125, 151.0126953125, 152.0126953125, 153.0126953125, 154.0126953125, 155.0126953125, 156.0126953125, 157.0126953125, 158.0126953125, 159.0126953125, 160.0126953125, 161.0126953125, 162.0126953125, 163.0126953125, 164.0126953125, 165.0126953125, 166.0126953125], "recent_frames_sha256": "ed084288a278e5eb7678d0e285864f379837572fc5a5672df840ea34019807df", "num_recent_frames": 30, "tq": 715539.941939572, "t1": 715552.096254854, "ta": 715552.096254854, "te": 715552.134361427, "first_response_s": 12.15431528200861, "answer_total_s": 12.192421855055727, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_476_a1198_q1", "video_id": 476, "time_stamp_s": 167, "ground_truth": "B", "raw_output": "B. On white and blakc pedestals.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "464733a86b0396ac033208e870e0963c8fc773311c34e0457dc2fe702a96e20e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Blue-toned abstract artworks, including human figures and aquatic scenes, are displayed on white walls in a gallery.  \n- A sign reading \"GALERIE DE ARTS 1343\" hangs above the gallery space, indicating the location.  \n- Framed illustrations of vintage cameras and a red typewriter are mounted on adjacent walls, showcasing retro technology.\n[30-60s] - A large framed red typewriter illustration labeled \"WORD\" is centrally displayed on a white wall, surrounded by smaller framed typewriter artworks in various colors.  \n- To the right, a yellow-framed poster depicts a typewriter with the text \"THE FIRST WORD\" beneath it, positioned next to a vertical stack of circular framed artworks.  \n- The camera pans slightly to reveal a small wooden table and two dark wooden chairs beneath the artwork, with a sign above indicating \"MAISON MASOR ART\" and a price of \"13.43\".\n[60-90s] - Large blue and gold abstract paintings dominate the wall, with two tall vertical pieces flanking smaller horizontal ones.  \n- A sign reading \"FILMMAKERS STUDIO 1347\" is mounted above the artworks, indicating the exhibit's location.  \n- The camera pans right, revealing more abstract pieces with vibrant colors and bold lines, including one with a prominent face motif.\n[90-120s] - A large, vertically oriented painting with blue and yellow hues dominates the right wall, positioned above smaller framed pieces.  \n- An orange price tag reading \"OKAYSPARK 1349\" is affixed to a white wall panel near the ceiling.  \n- A pair of green, bulb-shaped wall sconces with warm light are mounted on a gray wall, flanking a central artwork.\n[120-150s] - A large orange textured painting with blue figures is displayed on the left wall.  \n- A black-and-blue abstract painting with lightning-like lines is mounted to the right of the orange piece.  \n- A green sculptural object sits on a white pedestal in the foreground, partially obscuring the view of the artworks.", "history_tokens": 453, "history_utf8_bytes": 1941, "recent_frame_times_s": [137.0126953125, 138.0126953125, 139.0126953125, 140.0126953125, 141.0126953125, 142.0126953125, 143.0126953125, 144.0126953125, 145.0126953125, 146.0126953125, 147.0126953125, 148.0126953125, 149.0126953125, 150.0126953125, 151.0126953125, 152.0126953125, 153.0126953125, 154.0126953125, 155.0126953125, 156.0126953125, 157.0126953125, 158.0126953125, 159.0126953125, 160.0126953125, 161.0126953125, 162.0126953125, 163.0126953125, 164.0126953125, 165.0126953125, 166.0126953125], "recent_frames_sha256": "ed084288a278e5eb7678d0e285864f379837572fc5a5672df840ea34019807df", "num_recent_frames": 30, "tq": 715501.992497735, "t1": 715503.109437605, "ta": 715503.109437605, "te": 715503.521781827, "first_response_s": 1.1169398700585589, "answer_total_s": 1.5292840920155868, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 476, "content_group": "164a9facb6375b585cce4971f66bbcba5c07b5b5855ec495a94e0d894cb957c8", "question": {"question_id": "sample_476_a1198_q0", "video_id": 476, "video_path": "./videos/sample_476_real.mp4", "annotation_index": 1198, "question_index": 0, "question": "What does the blue sign overhead read?", "options": ["A. \"ART UNIFIED 1359, VENICE | CA. MODERN + CONTEMPORARY.\".", "B. \"ARTISTIC INSPIRATION 123, LA.\".", "C. \"MODERN ART SHOW 2024.\".", "D. \"VENICE ART EXHIBITION 2023.\"."], "answer": "A", "time_stamp_s": 172, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_476_a1198_q0", "video_id": 476, "time_stamp_s": 172, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "71377789e20a1b3a82c4026ba32b9928f32575869f731165a7c6d37b7602295c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [142.0126953125, 143.0126953125, 144.0126953125, 145.0126953125, 146.0126953125, 147.0126953125, 148.0126953125, 149.0126953125, 150.0126953125, 151.0126953125, 152.0126953125, 153.0126953125, 154.0126953125, 155.0126953125, 156.0126953125, 157.0126953125, 158.0126953125, 159.0126953125, 160.0126953125, 161.0126953125, 162.0126953125, 163.0126953125, 164.0126953125, 165.0126953125, 166.0126953125, 167.0126953125, 168.0126953125, 169.0126953125, 170.0126953125, 171.0126953125], "recent_frames_sha256": "b46518f77c8fe3f725beb58eb73273b2b23971603e83b1aee8dc8d05a88545b5", "num_recent_frames": 30, "tq": 715552.147094352, "t1": 715564.271178549, "ta": 715564.271178549, "te": 715564.314262964, "first_response_s": 12.124084196984768, "answer_total_s": 12.16716861189343, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_476_a1198_q0", "video_id": 476, "time_stamp_s": 172, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6bba7e90dcb4ddfe31fd43ae752106f8619086715bbf57ae888519ee305363cd", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Blue-toned abstract artworks, including human figures and aquatic scenes, are displayed on white walls in a gallery.  \n- A sign reading \"GALERIE DE ARTS 1343\" hangs above the gallery space, indicating the location.  \n- Framed illustrations of vintage cameras and a red typewriter are mounted on adjacent walls, showcasing retro technology.\n[30-60s] - A large framed red typewriter illustration labeled \"WORD\" is centrally displayed on a white wall, surrounded by smaller framed typewriter artworks in various colors.  \n- To the right, a yellow-framed poster depicts a typewriter with the text \"THE FIRST WORD\" beneath it, positioned next to a vertical stack of circular framed artworks.  \n- The camera pans slightly to reveal a small wooden table and two dark wooden chairs beneath the artwork, with a sign above indicating \"MAISON MASOR ART\" and a price of \"13.43\".\n[60-90s] - Large blue and gold abstract paintings dominate the wall, with two tall vertical pieces flanking smaller horizontal ones.  \n- A sign reading \"FILMMAKERS STUDIO 1347\" is mounted above the artworks, indicating the exhibit's location.  \n- The camera pans right, revealing more abstract pieces with vibrant colors and bold lines, including one with a prominent face motif.\n[90-120s] - A large, vertically oriented painting with blue and yellow hues dominates the right wall, positioned above smaller framed pieces.  \n- An orange price tag reading \"OKAYSPARK 1349\" is affixed to a white wall panel near the ceiling.  \n- A pair of green, bulb-shaped wall sconces with warm light are mounted on a gray wall, flanking a central artwork.\n[120-150s] - A large orange textured painting with blue figures is displayed on the left wall.  \n- A black-and-blue abstract painting with lightning-like lines is mounted to the right of the orange piece.  \n- A green sculptural object sits on a white pedestal in the foreground, partially obscuring the view of the artworks.", "history_tokens": 453, "history_utf8_bytes": 1941, "recent_frame_times_s": [142.0126953125, 143.0126953125, 144.0126953125, 145.0126953125, 146.0126953125, 147.0126953125, 148.0126953125, 149.0126953125, 150.0126953125, 151.0126953125, 152.0126953125, 153.0126953125, 154.0126953125, 155.0126953125, 156.0126953125, 157.0126953125, 158.0126953125, 159.0126953125, 160.0126953125, 161.0126953125, 162.0126953125, 163.0126953125, 164.0126953125, 165.0126953125, 166.0126953125, 167.0126953125, 168.0126953125, 169.0126953125, 170.0126953125, 171.0126953125], "recent_frames_sha256": "b46518f77c8fe3f725beb58eb73273b2b23971603e83b1aee8dc8d05a88545b5", "num_recent_frames": 30, "tq": 715503.545778887, "t1": 715515.039850006, "ta": 715515.039850006, "te": 715515.077786046, "first_response_s": 11.494071118999273, "answer_total_s": 11.532007158966735, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 476, "content_group": "164a9facb6375b585cce4971f66bbcba5c07b5b5855ec495a94e0d894cb957c8", "question": {"question_id": "sample_476_a1198_q2", "video_id": 476, "video_path": "./videos/sample_476_real.mp4", "annotation_index": 1198, "question_index": 2, "question": "What kind of artworks are displayed on the partition wall?", "options": ["A. Sculptures.", "B. Framed prints.", "C. Digital screens.", "D. Posters."], "answer": "B", "time_stamp_s": 173, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_476_a1198_q2", "video_id": 476, "time_stamp_s": 173, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "239371bf71b8583b61320353801d4853dbd9511dae978b81f882b3ea4f2f5db1", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [143.0126953125, 144.0126953125, 145.0126953125, 146.0126953125, 147.0126953125, 148.0126953125, 149.0126953125, 150.0126953125, 151.0126953125, 152.0126953125, 153.0126953125, 154.0126953125, 155.0126953125, 156.0126953125, 157.0126953125, 158.0126953125, 159.0126953125, 160.0126953125, 161.0126953125, 162.0126953125, 163.0126953125, 164.0126953125, 165.0126953125, 166.0126953125, 167.0126953125, 168.0126953125, 169.0126953125, 170.0126953125, 171.0126953125, 172.0126953125], "recent_frames_sha256": "f2bae68c2ccf844f354a83435bac7f4e6a01785401007466331cf7b71ff4aab0", "num_recent_frames": 30, "tq": 715564.327471156, "t1": 715575.725733842, "ta": 715575.725733842, "te": 715575.765102392, "first_response_s": 11.398262685979716, "answer_total_s": 11.437631235923618, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_476_a1198_q2", "video_id": 476, "time_stamp_s": 173, "ground_truth": "B", "raw_output": "A. Sculptures.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "266aa034b538ce462fb8d15b1cb5eb26deb5470744df5ebbc1fd8d760922831e", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Blue-toned abstract artworks, including human figures and aquatic scenes, are displayed on white walls in a gallery.  \n- A sign reading \"GALERIE DE ARTS 1343\" hangs above the gallery space, indicating the location.  \n- Framed illustrations of vintage cameras and a red typewriter are mounted on adjacent walls, showcasing retro technology.\n[30-60s] - A large framed red typewriter illustration labeled \"WORD\" is centrally displayed on a white wall, surrounded by smaller framed typewriter artworks in various colors.  \n- To the right, a yellow-framed poster depicts a typewriter with the text \"THE FIRST WORD\" beneath it, positioned next to a vertical stack of circular framed artworks.  \n- The camera pans slightly to reveal a small wooden table and two dark wooden chairs beneath the artwork, with a sign above indicating \"MAISON MASOR ART\" and a price of \"13.43\".\n[60-90s] - Large blue and gold abstract paintings dominate the wall, with two tall vertical pieces flanking smaller horizontal ones.  \n- A sign reading \"FILMMAKERS STUDIO 1347\" is mounted above the artworks, indicating the exhibit's location.  \n- The camera pans right, revealing more abstract pieces with vibrant colors and bold lines, including one with a prominent face motif.\n[90-120s] - A large, vertically oriented painting with blue and yellow hues dominates the right wall, positioned above smaller framed pieces.  \n- An orange price tag reading \"OKAYSPARK 1349\" is affixed to a white wall panel near the ceiling.  \n- A pair of green, bulb-shaped wall sconces with warm light are mounted on a gray wall, flanking a central artwork.\n[120-150s] - A large orange textured painting with blue figures is displayed on the left wall.  \n- A black-and-blue abstract painting with lightning-like lines is mounted to the right of the orange piece.  \n- A green sculptural object sits on a white pedestal in the foreground, partially obscuring the view of the artworks.", "history_tokens": 453, "history_utf8_bytes": 1941, "recent_frame_times_s": [143.0126953125, 144.0126953125, 145.0126953125, 146.0126953125, 147.0126953125, 148.0126953125, 149.0126953125, 150.0126953125, 151.0126953125, 152.0126953125, 153.0126953125, 154.0126953125, 155.0126953125, 156.0126953125, 157.0126953125, 158.0126953125, 159.0126953125, 160.0126953125, 161.0126953125, 162.0126953125, 163.0126953125, 164.0126953125, 165.0126953125, 166.0126953125, 167.0126953125, 168.0126953125, 169.0126953125, 170.0126953125, 171.0126953125, 172.0126953125], "recent_frames_sha256": "f2bae68c2ccf844f354a83435bac7f4e6a01785401007466331cf7b71ff4aab0", "num_recent_frames": 30, "tq": 715515.088682155, "t1": 715527.217257422, "ta": 715527.217257422, "te": 715527.434934947, "first_response_s": 12.128575267037377, "answer_total_s": 12.3462527920492, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 477, "content_group": "0ab06265ce36654e203357cb572ff738e30995b92a86676340f78f38e6c6d48f", "question": {"question_id": "sample_477_a2119_q0", "video_id": 477, "video_path": "./videos/sample_477_real.mp4", "annotation_index": 2119, "question_index": 0, "question": "What are the small components of the display shown right now?", "options": ["A. Small paintings.", "B. Cylindrical objects.", "C. Rectangular tiles.", "D. Triangular pieces."], "answer": "B", "time_stamp_s": 15, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_477_a2119_q0", "video_id": 477, "time_stamp_s": 15, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4975ce842e9f8f162b8e3066561e60357157538f77ab174afbadeb225afc152c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.04296875, 1.0096354166666666, 2.009635416666667, 3.009635416666667, 4.009635416666667, 5.009635416666667, 6.009635416666667, 7.009635416666667, 8.009635416666667, 9.009635416666667, 10.009635416666667, 11.009635416666667, 12.009635416666667, 13.009635416666667, 14.009635416666667], "recent_frames_sha256": "756140998d2c1958e19662fcb2354bdcf5d1875550ce2de77eeff6a11ddf0880", "num_recent_frames": 15, "tq": 718328.264270551, "t1": 718334.707208479, "ta": 718334.707208479, "te": 718334.746334539, "first_response_s": 6.4429379280190915, "answer_total_s": 6.482063987990841, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_477_a2119_q0", "video_id": 477, "time_stamp_s": 15, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5e94ed0918f29d1e00f2aedd52c9c0d7ffb36c7cbf0795347351446081301be5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.04296875, 1.0096354166666666, 2.009635416666667, 3.009635416666667, 4.009635416666667, 5.009635416666667, 6.009635416666667, 7.009635416666667, 8.009635416666667, 9.009635416666667, 10.009635416666667, 11.009635416666667, 12.009635416666667, 13.009635416666667, 14.009635416666667], "recent_frames_sha256": "756140998d2c1958e19662fcb2354bdcf5d1875550ce2de77eeff6a11ddf0880", "num_recent_frames": 15, "tq": 718382.851596007, "t1": 718384.484848761, "ta": 718384.484848761, "te": 718384.860995503, "first_response_s": 1.633252753992565, "answer_total_s": 2.0093994960188866, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 477, "content_group": "0ab06265ce36654e203357cb572ff738e30995b92a86676340f78f38e6c6d48f", "question": {"question_id": "sample_477_a2120_q0", "video_id": 477, "video_path": "./videos/sample_477_real.mp4", "annotation_index": 2120, "question_index": 0, "question": "How many donuts are displayed in the framed grid on the white wall?", "options": ["A. 12.", "B. 14.", "C. 16.", "D. 18."], "answer": "C", "time_stamp_s": 143, "task_type": "Counting", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_477_a2120_q0", "video_id": 477, "time_stamp_s": 143, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c584c25cd3f522e99c56aa5fe803c7bcc079c37bc2bc7a996db146864c5892ce", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [113.00963541666667, 114.00963541666667, 115.00963541666667, 116.00963541666667, 117.00963541666667, 118.00963541666667, 119.00963541666667, 120.00963541666667, 121.00963541666667, 122.00963541666667, 123.00963541666667, 124.00963541666667, 125.00963541666667, 126.00963541666667, 127.00963541666667, 128.00963541666667, 129.00963541666667, 130.00963541666667, 131.00963541666667, 132.00963541666667, 133.00963541666667, 134.00963541666667, 135.00963541666667, 136.00963541666667, 137.00963541666667, 138.00963541666667, 139.00963541666667, 140.00963541666667, 141.00963541666667, 142.00963541666667], "recent_frames_sha256": "816fd62713ddce8464fe98cc384ae2fcd5bda0010676206f230872d2592ec1a2", "num_recent_frames": 30, "tq": 718334.771235746, "t1": 718343.09864222, "ta": 718343.09864222, "te": 718343.136703656, "first_response_s": 8.32740647403989, "answer_total_s": 8.365467910072766, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_477_a2120_q0", "video_id": 477, "time_stamp_s": 143, "ground_truth": "C", "raw_output": "C. 16.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "8113d7f8b20f8c8d24c93c8c4661525a0d28312902e2059b648f4fae34173502", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A glass sculpture with vertical blue-tinted panels is mounted on a wooden base, casting shadows on the wall.  \n- A large, colorful, modernized Mona Lisa portrait hangs on the wall, flanked by other artworks.  \n- A portrait composed of numerous small, round, amber-colored glass beads forms a detailed face, positioned next to a dark, mesh-like artwork.\n[30-60s] - A large blue dot-matrix portrait dominates the left wall, with a smaller orange portrait visible to its right.  \n- A blue astronaut sculpture stands on a pedestal near the center-right, while a smaller blue figure in uniform is positioned to its right.  \n- A sign labeled \"612\" hangs above the wall, indicating the gallery's section number.\n[60-90s] - A man in a dark uniform and cap stands with arms crossed, observing a large colorful dot-patterned artwork.  \n- He shifts his gaze to a large black-and-white fingerprint artwork with overlaid text like \"WANT\" and \"KISS.\"  \n- The camera pans right, revealing a wide, abstract painting filled with multicolored dots, positioned next to the fingerprint piece.\n[90-120s] - A large abstract painting with a beach scene and colorful dots is displayed on the left wall.  \n- A series of framed portraits, featuring classical busts with surreal elements like flowers and butterflies, are arranged in a grid on the right wall.  \n- A large spray can artwork, labeled \"Dom Pérignon,\" hangs prominently on the wall, positioned between the abstract painting and the portrait series.", "history_tokens": 340, "history_utf8_bytes": 1495, "recent_frame_times_s": [113.00963541666667, 114.00963541666667, 115.00963541666667, 116.00963541666667, 117.00963541666667, 118.00963541666667, 119.00963541666667, 120.00963541666667, 121.00963541666667, 122.00963541666667, 123.00963541666667, 124.00963541666667, 125.00963541666667, 126.00963541666667, 127.00963541666667, 128.00963541666667, 129.00963541666667, 130.00963541666667, 131.00963541666667, 132.00963541666667, 133.00963541666667, 134.00963541666667, 135.00963541666667, 136.00963541666667, 137.00963541666667, 138.00963541666667, 139.00963541666667, 140.00963541666667, 141.00963541666667, 142.00963541666667], "recent_frames_sha256": "816fd62713ddce8464fe98cc384ae2fcd5bda0010676206f230872d2592ec1a2", "num_recent_frames": 30, "tq": 718413.803310944, "t1": 718421.400263057, "ta": 718421.400263057, "te": 718421.641468298, "first_response_s": 7.596952112973668, "answer_total_s": 7.83815735403914, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 477, "content_group": "0ab06265ce36654e203357cb572ff738e30995b92a86676340f78f38e6c6d48f", "question": {"question_id": "sample_477_a2120_q1", "video_id": 477, "video_path": "./videos/sample_477_real.mp4", "annotation_index": 2120, "question_index": 1, "question": "What text is displayed above the blonde woman in the artwork?", "options": ["A. \"BUT I'M A FIRST CLASS GIRL… I CAN'T FLY COACH.\".", "B. \"LET'S TRAVEL THE WORLD TOGETHER… & NEVER LOOK BACK.\".", "C. \"LIVE LOVE LAUGH… ALWAYS AND FOREVER.\".", "D. \"DREAM BIG… AND NEVER GIVE UP.\"."], "answer": "A", "time_stamp_s": 147, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_477_a2120_q1", "video_id": 477, "time_stamp_s": 147, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "31d0501e8480a2855629c42d284994a7103e7a966ffe36e1744a80f527599033", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [117.00963541666667, 118.00963541666667, 119.00963541666667, 120.00963541666667, 121.00963541666667, 122.00963541666667, 123.00963541666667, 124.00963541666667, 125.00963541666667, 126.00963541666667, 127.00963541666667, 128.00963541666667, 129.00963541666667, 130.00963541666667, 131.00963541666667, 132.00963541666667, 133.00963541666667, 134.00963541666667, 135.00963541666667, 136.00963541666667, 137.00963541666667, 138.00963541666667, 139.00963541666667, 140.00963541666667, 141.00963541666667, 142.00963541666667, 143.00963541666667, 144.00963541666667, 145.00963541666667, 146.00963541666667], "recent_frames_sha256": "46565425c657d471eea7e689ad979139fd67911cfded62aafae2bf0115c89dfc", "num_recent_frames": 30, "tq": 718343.149896202, "t1": 718358.056504987, "ta": 718358.056504987, "te": 718358.094018253, "first_response_s": 14.906608784920536, "answer_total_s": 14.944122051005252, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_477_a2120_q1", "video_id": 477, "time_stamp_s": 147, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5a307d7a14cf03016ff1b3faa7ca720713c74234cf96ee9a10ea5c2980f1d620", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A glass sculpture with vertical blue-tinted panels is mounted on a wooden base, casting shadows on the wall.  \n- A large, colorful, modernized Mona Lisa portrait hangs on the wall, flanked by other artworks.  \n- A portrait composed of numerous small, round, amber-colored glass beads forms a detailed face, positioned next to a dark, mesh-like artwork.\n[30-60s] - A large blue dot-matrix portrait dominates the left wall, with a smaller orange portrait visible to its right.  \n- A blue astronaut sculpture stands on a pedestal near the center-right, while a smaller blue figure in uniform is positioned to its right.  \n- A sign labeled \"612\" hangs above the wall, indicating the gallery's section number.\n[60-90s] - A man in a dark uniform and cap stands with arms crossed, observing a large colorful dot-patterned artwork.  \n- He shifts his gaze to a large black-and-white fingerprint artwork with overlaid text like \"WANT\" and \"KISS.\"  \n- The camera pans right, revealing a wide, abstract painting filled with multicolored dots, positioned next to the fingerprint piece.\n[90-120s] - A large abstract painting with a beach scene and colorful dots is displayed on the left wall.  \n- A series of framed portraits, featuring classical busts with surreal elements like flowers and butterflies, are arranged in a grid on the right wall.  \n- A large spray can artwork, labeled \"Dom Pérignon,\" hangs prominently on the wall, positioned between the abstract painting and the portrait series.", "history_tokens": 340, "history_utf8_bytes": 1495, "recent_frame_times_s": [117.00963541666667, 118.00963541666667, 119.00963541666667, 120.00963541666667, 121.00963541666667, 122.00963541666667, 123.00963541666667, 124.00963541666667, 125.00963541666667, 126.00963541666667, 127.00963541666667, 128.00963541666667, 129.00963541666667, 130.00963541666667, 131.00963541666667, 132.00963541666667, 133.00963541666667, 134.00963541666667, 135.00963541666667, 136.00963541666667, 137.00963541666667, 138.00963541666667, 139.00963541666667, 140.00963541666667, 141.00963541666667, 142.00963541666667, 143.00963541666667, 144.00963541666667, 145.00963541666667, 146.00963541666667], "recent_frames_sha256": "46565425c657d471eea7e689ad979139fd67911cfded62aafae2bf0115c89dfc", "num_recent_frames": 30, "tq": 718421.677159975, "t1": 718427.49835742, "ta": 718427.49835742, "te": 718427.53673018, "first_response_s": 5.821197444922291, "answer_total_s": 5.859570204978809, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 477, "content_group": "0ab06265ce36654e203357cb572ff738e30995b92a86676340f78f38e6c6d48f", "question": {"question_id": "sample_477_a2121_q0", "video_id": 477, "video_path": "./videos/sample_477_real.mp4", "annotation_index": 2121, "question_index": 0, "question": "What is prominently mounted on the wal right now?", "options": ["A. A large, intricate tapestry.", "B. A framed palette with blobs of paint.", "C. A large, textured 3D artwork of a lion's head.", "D. A black and white sketch."], "answer": "C", "time_stamp_s": 434, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_477_a2121_q0", "video_id": 477, "time_stamp_s": 434, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "eaba8cead999ce2a55028cb6c84793b678fbe1ae959cfcf837452cb72967aa92", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [404.00963541666664, 405.00963541666664, 406.00963541666664, 407.00963541666664, 408.00963541666664, 409.00963541666664, 410.00963541666664, 411.00963541666664, 412.00963541666664, 413.00963541666664, 414.00963541666664, 415.00963541666664, 416.00963541666664, 417.00963541666664, 418.00963541666664, 419.00963541666664, 420.00963541666664, 421.00963541666664, 422.00963541666664, 423.00963541666664, 424.00963541666664, 425.00963541666664, 426.00963541666664, 427.00963541666664, 428.00963541666664, 429.00963541666664, 430.00963541666664, 431.00963541666664, 432.00963541666664, 433.00963541666664], "recent_frames_sha256": "a04db545292063c5c78f6afd256352fc32df9e75d778c445350f26b3d3f741f9", "num_recent_frames": 30, "tq": 718358.106054024, "t1": 718370.156606245, "ta": 718370.156606245, "te": 718370.194819445, "first_response_s": 12.050552221015096, "answer_total_s": 12.088765421067365, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_477_a2121_q0", "video_id": 477, "time_stamp_s": 434, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a16b42f33fef29fa26df917e77ad69f1724cc6f7145862a644109840c1d96af2", "condition_order": ["recent", "notes"], "memory": "[90-120s] - A large abstract painting with a beach scene and colorful dots is displayed on the left wall.  \n- A series of framed portraits, featuring classical busts with surreal elements like flowers and butterflies, are arranged in a grid on the right wall.  \n- A large spray can artwork, labeled \"Dom Pérignon,\" hangs prominently on the wall, positioned between the abstract painting and the portrait series.\n[120-150s] - A large yellow spray can painting with text and a blue nozzle is mounted on a white wall, positioned left of a colorful graffiti-style artwork.  \n- The graffiti artwork features cartoonish figures, text like \"HEE HEE\" and \"HO HO,\" and a trumpet, displayed in a white frame.  \n- To the right of the graffiti, a framed piece shows a cartoon girl with blonde hair and a speech bubble reading \"BUT MY FIRST CLASS CAN'T FLY COACH.\"\n[150-180s] - A comic panel with a blonde character and dialogue about \"glass\" and \"coach\" is partially visible on the left.  \n- A central panel shows a dark-haired character embracing another, with text reading \"I'm not a... I'm not a... I'm not a...\" and \"I'm not a... I'm not a... I'm not a...\".  \n- The camera pans right, revealing a series of abstract, three-dimensional heart and circular artworks made of layered blue and white elements.\n[180-210s] - A blue and white butterfly sculpture radiates outward from a central point, creating a dynamic, three-dimensional effect.  \n- A circular arrangement of dark and light blue dots forms a pattern on a white wall, positioned to the right of the butterfly sculpture.  \n- A visitor walks past the butterfly sculpture, moving from left to right, while another person stands near the dot artwork, observing it.\n[210-240s] - A colorful abstract painting with a prominent eye and playing card motif is displayed on the left wall.  \n- A black-framed artwork featuring a spherical pattern of white and blue dots is mounted to the right of the abstract piece.  \n- A realistic depiction of a Veuve Clicquot champagne bottle, with a yellow strap, is shown on the far right, mounted on a white wall.\n[240-270s] - A large abstract painting with horizontal blue and yellow lines is mounted on a light blue wall, viewed from a low angle.  \n- Two visitors, one in a black jacket and another in a dark suit, are seen observing the artwork from the left side of the frame.  \n- The camera pans right, revealing more framed paintings on adjacent walls, including a landscape with sailboats and floral still lifes.\n[270-300s] - A large, abstract painting with vibrant orange, yellow, and red hues is displayed in a black frame against a blue wall.  \n- To its left, a smaller painting in an ornate gold frame depicts a rural scene with a house and trees.  \n- A visitor in a dark jacket walks past the paintings, moving from right to left in the background.\n[300-330s] - A framed abstract painting with concentric circles in red, white, and blue is displayed on a dark wall.  \n- To its right, another abstract piece features overlapping yellow and cyan circles with a horizontal yellow line.  \n- A vibrant, swirling abstract painting in red, yellow, and blue hangs next to the second piece, with a small plaque beneath it.\n[330-360s] - A large, vertically oriented abstract painting with a blue and green background and orange-red swirling forms is displayed on a pillar, partially obscured by people.  \n- A framed landscape painting with tall, thin trees against a pale sky and a golden foreground hangs on a wall, viewed by visitors.  \n- People are seen walking through the gallery, some stopping to observe artworks, while others are seated at a table near the paintings.\n[360-390s] - A framed painting of a woman in a wide-brimmed hat rests against a blue wall, her hand near her face.  \n- To its right, a smaller gold-framed landscape painting depicts a figure under a tree, with a plaque beneath it.  \n- Further right, a colorful abstract painting with bold diagonal stripes is displayed next to another gold-framed landscape.\n[390-420s] - A large, colorful abstract tapestry with intricate patterns hangs prominently on a white wall, drawing attention from viewers.  \n- To its right, a smaller, vibrant abstract painting with bold vertical stripes in orange, green, pink, and blue is displayed.  \n- The camera pans right, revealing a landscape painting of a coastal town with a road and ocean, positioned next to the striped artwork.", "history_tokens": 1015, "history_utf8_bytes": 4423, "recent_frame_times_s": [404.00963541666664, 405.00963541666664, 406.00963541666664, 407.00963541666664, 408.00963541666664, 409.00963541666664, 410.00963541666664, 411.00963541666664, 412.00963541666664, 413.00963541666664, 414.00963541666664, 415.00963541666664, 416.00963541666664, 417.00963541666664, 418.00963541666664, 419.00963541666664, 420.00963541666664, 421.00963541666664, 422.00963541666664, 423.00963541666664, 424.00963541666664, 425.00963541666664, 426.00963541666664, 427.00963541666664, 428.00963541666664, 429.00963541666664, 430.00963541666664, 431.00963541666664, 432.00963541666664, 433.00963541666664], "recent_frames_sha256": "a04db545292063c5c78f6afd256352fc32df9e75d778c445350f26b3d3f741f9", "num_recent_frames": 30, "tq": 718506.124109863, "t1": 718507.189762327, "ta": 718507.189762327, "te": 718507.229946303, "first_response_s": 1.0656524640507996, "answer_total_s": 1.1058364399941638, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 477, "content_group": "0ab06265ce36654e203357cb572ff738e30995b92a86676340f78f38e6c6d48f", "question": {"question_id": "sample_477_a2121_q1", "video_id": 477, "video_path": "./videos/sample_477_real.mp4", "annotation_index": 2121, "question_index": 1, "question": "What is the inscription at the bottom of the framed palette?", "options": ["A. 1.2.34.", "B. 2.5.89.", "C. 3.6.61.", "D. 4.7.73."], "answer": "C", "time_stamp_s": 436, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_477_a2121_q1", "video_id": 477, "time_stamp_s": 436, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b432c0925e1d9e2805726bf05cc44ef5e22f2e1a90b21e6e0e5369c21ba78f0f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [406.00963541666664, 407.00963541666664, 408.00963541666664, 409.00963541666664, 410.00963541666664, 411.00963541666664, 412.00963541666664, 413.00963541666664, 414.00963541666664, 415.00963541666664, 416.00963541666664, 417.00963541666664, 418.00963541666664, 419.00963541666664, 420.00963541666664, 421.00963541666664, 422.00963541666664, 423.00963541666664, 424.00963541666664, 425.00963541666664, 426.00963541666664, 427.00963541666664, 428.00963541666664, 429.00963541666664, 430.00963541666664, 431.00963541666664, 432.00963541666664, 433.00963541666664, 434.00963541666664, 435.00963541666664], "recent_frames_sha256": "79f450f19aaad20dac783c883f71893e81ff0aa53ef48239de716924069cdc70", "num_recent_frames": 30, "tq": 718370.208267901, "t1": 718382.792363958, "ta": 718382.792363958, "te": 718382.841169749, "first_response_s": 12.584096056991257, "answer_total_s": 12.63290184806101, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_477_a2121_q1", "video_id": 477, "time_stamp_s": 436, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8e73db7a3f8b9b5455d6c8adc0b39ea151267d8ba12671beec6f8f107576cd5d", "condition_order": ["recent", "notes"], "memory": "[90-120s] - A large abstract painting with a beach scene and colorful dots is displayed on the left wall.  \n- A series of framed portraits, featuring classical busts with surreal elements like flowers and butterflies, are arranged in a grid on the right wall.  \n- A large spray can artwork, labeled \"Dom Pérignon,\" hangs prominently on the wall, positioned between the abstract painting and the portrait series.\n[120-150s] - A large yellow spray can painting with text and a blue nozzle is mounted on a white wall, positioned left of a colorful graffiti-style artwork.  \n- The graffiti artwork features cartoonish figures, text like \"HEE HEE\" and \"HO HO,\" and a trumpet, displayed in a white frame.  \n- To the right of the graffiti, a framed piece shows a cartoon girl with blonde hair and a speech bubble reading \"BUT MY FIRST CLASS CAN'T FLY COACH.\"\n[150-180s] - A comic panel with a blonde character and dialogue about \"glass\" and \"coach\" is partially visible on the left.  \n- A central panel shows a dark-haired character embracing another, with text reading \"I'm not a... I'm not a... I'm not a...\" and \"I'm not a... I'm not a... I'm not a...\".  \n- The camera pans right, revealing a series of abstract, three-dimensional heart and circular artworks made of layered blue and white elements.\n[180-210s] - A blue and white butterfly sculpture radiates outward from a central point, creating a dynamic, three-dimensional effect.  \n- A circular arrangement of dark and light blue dots forms a pattern on a white wall, positioned to the right of the butterfly sculpture.  \n- A visitor walks past the butterfly sculpture, moving from left to right, while another person stands near the dot artwork, observing it.\n[210-240s] - A colorful abstract painting with a prominent eye and playing card motif is displayed on the left wall.  \n- A black-framed artwork featuring a spherical pattern of white and blue dots is mounted to the right of the abstract piece.  \n- A realistic depiction of a Veuve Clicquot champagne bottle, with a yellow strap, is shown on the far right, mounted on a white wall.\n[240-270s] - A large abstract painting with horizontal blue and yellow lines is mounted on a light blue wall, viewed from a low angle.  \n- Two visitors, one in a black jacket and another in a dark suit, are seen observing the artwork from the left side of the frame.  \n- The camera pans right, revealing more framed paintings on adjacent walls, including a landscape with sailboats and floral still lifes.\n[270-300s] - A large, abstract painting with vibrant orange, yellow, and red hues is displayed in a black frame against a blue wall.  \n- To its left, a smaller painting in an ornate gold frame depicts a rural scene with a house and trees.  \n- A visitor in a dark jacket walks past the paintings, moving from right to left in the background.\n[300-330s] - A framed abstract painting with concentric circles in red, white, and blue is displayed on a dark wall.  \n- To its right, another abstract piece features overlapping yellow and cyan circles with a horizontal yellow line.  \n- A vibrant, swirling abstract painting in red, yellow, and blue hangs next to the second piece, with a small plaque beneath it.\n[330-360s] - A large, vertically oriented abstract painting with a blue and green background and orange-red swirling forms is displayed on a pillar, partially obscured by people.  \n- A framed landscape painting with tall, thin trees against a pale sky and a golden foreground hangs on a wall, viewed by visitors.  \n- People are seen walking through the gallery, some stopping to observe artworks, while others are seated at a table near the paintings.\n[360-390s] - A framed painting of a woman in a wide-brimmed hat rests against a blue wall, her hand near her face.  \n- To its right, a smaller gold-framed landscape painting depicts a figure under a tree, with a plaque beneath it.  \n- Further right, a colorful abstract painting with bold diagonal stripes is displayed next to another gold-framed landscape.\n[390-420s] - A large, colorful abstract tapestry with intricate patterns hangs prominently on a white wall, drawing attention from viewers.  \n- To its right, a smaller, vibrant abstract painting with bold vertical stripes in orange, green, pink, and blue is displayed.  \n- The camera pans right, revealing a landscape painting of a coastal town with a road and ocean, positioned next to the striped artwork.", "history_tokens": 1015, "history_utf8_bytes": 4423, "recent_frame_times_s": [406.00963541666664, 407.00963541666664, 408.00963541666664, 409.00963541666664, 410.00963541666664, 411.00963541666664, 412.00963541666664, 413.00963541666664, 414.00963541666664, 415.00963541666664, 416.00963541666664, 417.00963541666664, 418.00963541666664, 419.00963541666664, 420.00963541666664, 421.00963541666664, 422.00963541666664, 423.00963541666664, 424.00963541666664, 425.00963541666664, 426.00963541666664, 427.00963541666664, 428.00963541666664, 429.00963541666664, 430.00963541666664, 431.00963541666664, 432.00963541666664, 433.00963541666664, 434.00963541666664, 435.00963541666664], "recent_frames_sha256": "79f450f19aaad20dac783c883f71893e81ff0aa53ef48239de716924069cdc70", "num_recent_frames": 30, "tq": 718507.258725623, "t1": 718520.291125685, "ta": 718520.291125685, "te": 718520.6034884, "first_response_s": 13.03240006195847, "answer_total_s": 13.344762776978314, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 478, "content_group": "3e7e5d84099eab5e8ce5cf289e8e735ccc5bd16fb24962935688c27feb6fd664", "question": {"question_id": "sample_478_a2065_q0", "video_id": 478, "video_path": "./videos/sample_478_real.mp4", "annotation_index": 2065, "question_index": 0, "question": "What is displayed on the blue sign overhead?", "options": ["A. \"Exhibit Closed 625/724\".", "B. \"Gallery Entrance 622/625\".", "C. \"Montague Gallery 625/724\".", "D. \"Montague Gallery 625/725\"."], "answer": "C", "time_stamp_s": 15, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_478_a2065_q0", "video_id": 478, "time_stamp_s": 15, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "be53cb61466d7a420e6d66005e62d20933e850e6003ab72800b2bc3816970dbe", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03600260416666667, 1.0026692708333333, 2.002669270833333, 3.002669270833333, 4.002669270833334, 5.002669270833334, 6.002669270833334, 7.002669270833334, 8.002669270833334, 9.002669270833334, 10.002669270833334, 11.002669270833334, 12.002669270833334, 13.002669270833334, 14.002669270833334], "recent_frames_sha256": "02a467604f79abca7757b3a7712aef86b1b995a2dedacc8a031cc3a201fe8d41", "num_recent_frames": 15, "tq": 717474.171541083, "t1": 717474.923337678, "ta": 717474.923337678, "te": 717474.962876122, "first_response_s": 0.751796594937332, "answer_total_s": 0.791335038957186, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_478_a2065_q0", "video_id": 478, "time_stamp_s": 15, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1c8389c62da04f1ecbf907107f83008f01f8a4713789ea9097847a35fb928415", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03600260416666667, 1.0026692708333333, 2.002669270833333, 3.002669270833333, 4.002669270833334, 5.002669270833334, 6.002669270833334, 7.002669270833334, 8.002669270833334, 9.002669270833334, 10.002669270833334, 11.002669270833334, 12.002669270833334, 13.002669270833334, 14.002669270833334], "recent_frames_sha256": "02a467604f79abca7757b3a7712aef86b1b995a2dedacc8a031cc3a201fe8d41", "num_recent_frames": 15, "tq": 717517.44820341, "t1": 717523.48189285, "ta": 717523.48189285, "te": 717523.776577046, "first_response_s": 6.033689439995214, "answer_total_s": 6.328373636002652, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 478, "content_group": "3e7e5d84099eab5e8ce5cf289e8e735ccc5bd16fb24962935688c27feb6fd664", "question": {"question_id": "sample_478_a2066_q0", "video_id": 478, "video_path": "./videos/sample_478_real.mp4", "annotation_index": 2066, "question_index": 0, "question": "How are the three framed pieces arranged on the wall?", "options": ["A. In a vertical line.", "B. In a diagonal line.", "C. In a horizontal line.", "D. In a circular pattern."], "answer": "C", "time_stamp_s": 175, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_478_a2066_q0", "video_id": 478, "time_stamp_s": 175, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8686a122a569892241fd42624da135c7b030ba990380b6492c3ead77d0217770", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [145.00266927083334, 146.00266927083334, 147.00266927083334, 148.00266927083334, 149.00266927083334, 150.00266927083334, 151.00266927083334, 152.00266927083334, 153.00266927083334, 154.00266927083334, 155.00266927083334, 156.00266927083334, 157.00266927083334, 158.00266927083334, 159.00266927083334, 160.00266927083334, 161.00266927083334, 162.00266927083334, 163.00266927083334, 164.00266927083334, 165.00266927083334, 166.00266927083334, 167.00266927083334, 168.00266927083334, 169.00266927083334, 170.00266927083334, 171.00266927083334, 172.00266927083334, 173.00266927083334, 174.00266927083334], "recent_frames_sha256": "337b68883a191069c617fdbb7e5e5a3851a04d46193af8f68833d2f285414ab9", "num_recent_frames": 30, "tq": 717474.97924213, "t1": 717485.605814998, "ta": 717485.605814998, "te": 717485.644934075, "first_response_s": 10.62657286808826, "answer_total_s": 10.665691945003346, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_478_a2066_q0", "video_id": 478, "time_stamp_s": 175, "ground_truth": "C", "raw_output": "C. In a horizontal line.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "d13f359d28641ab0a1d3be1f36d568c4c15434a54a83a08eade66520bda09d5d", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Abstract paintings with bold geometric shapes and vibrant colors are displayed on white walls, including a large piece with a stylized face and another with a prominent yellow star.  \n- A blue sign labeled \"2023/724A\" hangs from the ceiling, indicating an exhibit or gallery section.  \n- Visitors walk through the gallery, observing the art, while staff members are seen attending to display areas or equipment.\n[30-60s] - A red-hooded visitor stands near a wall-mounted abstract sculpture with hanging geometric shapes.  \n- A large, transparent glass sculpture with swirling internal patterns is displayed on a pedestal, viewed from multiple angles.  \n- A reflective, angular sculpture depicting a cracked egg with red interior is positioned on a stand, surrounded by other visitors.\n[60-90s] - A large abstract painting with vertical bands of black, yellow, blue, red, and orange is mounted on a white wall.  \n- Two glass sculptures—a tall orange one and a smaller blue teardrop-shaped one—are displayed on pedestals nearby.  \n- A wall-mounted artwork composed of multiple colorful, swirling glass panels is positioned to the right of the sculptures.\n[90-120s] - A cluster of metallic, wing-like sculptures is mounted on a white wall, casting shadows.  \n- A large, translucent blue glass sculpture with internal rings is displayed on a pedestal, reflecting light.  \n- A series of colorful, ring-shaped glass art pieces are arranged in a cascading pattern on the wall, with some rings overlapping.\n[120-150s] - A tall, translucent blue sculpture with internal light patterns is viewed by visitors, one man leaning in closely.  \n- A group of people, including a woman in a red top, stand near a large yellow sculpture with embedded dark figures.  \n- A blue sign with numbers \"620/788\" and \"629/773\" is mounted on a wall, indicating exhibit or room identifiers.", "history_tokens": 423, "history_utf8_bytes": 1874, "recent_frame_times_s": [145.00266927083334, 146.00266927083334, 147.00266927083334, 148.00266927083334, 149.00266927083334, 150.00266927083334, 151.00266927083334, 152.00266927083334, 153.00266927083334, 154.00266927083334, 155.00266927083334, 156.00266927083334, 157.00266927083334, 158.00266927083334, 159.00266927083334, 160.00266927083334, 161.00266927083334, 162.00266927083334, 163.00266927083334, 164.00266927083334, 165.00266927083334, 166.00266927083334, 167.00266927083334, 168.00266927083334, 169.00266927083334, 170.00266927083334, 171.00266927083334, 172.00266927083334, 173.00266927083334, 174.00266927083334], "recent_frames_sha256": "337b68883a191069c617fdbb7e5e5a3851a04d46193af8f68833d2f285414ab9", "num_recent_frames": 30, "tq": 717562.609390807, "t1": 717569.784123111, "ta": 717569.784123111, "te": 717570.087898941, "first_response_s": 7.174732304061763, "answer_total_s": 7.478508134023286, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 478, "content_group": "3e7e5d84099eab5e8ce5cf289e8e735ccc5bd16fb24962935688c27feb6fd664", "question": {"question_id": "sample_478_a2067_q0", "video_id": 478, "video_path": "./videos/sample_478_real.mp4", "annotation_index": 2067, "question_index": 0, "question": "What is the lighting condition in the gallery space?", "options": ["A. Dim and dark.", "B. Bright and natural.", "C. Well-lit with ceiling-mounted lights.", "D. Dark with spotlights."], "answer": "C", "time_stamp_s": 339, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_478_a2067_q0", "video_id": 478, "time_stamp_s": 339, "ground_truth": "C", "raw_output": "C. Well-lit with ceiling-mounted lights.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "0d395908494ad68dfc373150e7214c1e8b4432c89e6f3aec9e36d8ffbc014d9a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [309.00266927083334, 310.00266927083334, 311.00266927083334, 312.00266927083334, 313.00266927083334, 314.00266927083334, 315.00266927083334, 316.00266927083334, 317.00266927083334, 318.00266927083334, 319.00266927083334, 320.00266927083334, 321.00266927083334, 322.00266927083334, 323.00266927083334, 324.00266927083334, 325.00266927083334, 326.00266927083334, 327.00266927083334, 328.00266927083334, 329.00266927083334, 330.00266927083334, 331.00266927083334, 332.00266927083334, 333.00266927083334, 334.00266927083334, 335.00266927083334, 336.00266927083334, 337.00266927083334, 338.00266927083334], "recent_frames_sha256": "cd682d81c0760dce60479f8d8afbdbbc62e6192f42983dcbdba029d1d6121b0a", "num_recent_frames": 30, "tq": 717485.658121279, "t1": 717497.701208367, "ta": 717497.701208367, "te": 717498.087500015, "first_response_s": 12.043087088037282, "answer_total_s": 12.4293787360657, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_478_a2067_q0", "video_id": 478, "time_stamp_s": 339, "ground_truth": "C", "raw_output": "C. Well-lit with ceiling-mounted lights.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "846e18bef8a5f892275bf4c6ad7d4914e5b29b57148a36c03d6586e660c695d5", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Abstract paintings with bold geometric shapes and vibrant colors are displayed on white walls, including a large piece with a stylized face and another with a prominent yellow star.  \n- A blue sign labeled \"2023/724A\" hangs from the ceiling, indicating an exhibit or gallery section.  \n- Visitors walk through the gallery, observing the art, while staff members are seen attending to display areas or equipment.\n[30-60s] - A red-hooded visitor stands near a wall-mounted abstract sculpture with hanging geometric shapes.  \n- A large, transparent glass sculpture with swirling internal patterns is displayed on a pedestal, viewed from multiple angles.  \n- A reflective, angular sculpture depicting a cracked egg with red interior is positioned on a stand, surrounded by other visitors.\n[60-90s] - A large abstract painting with vertical bands of black, yellow, blue, red, and orange is mounted on a white wall.  \n- Two glass sculptures—a tall orange one and a smaller blue teardrop-shaped one—are displayed on pedestals nearby.  \n- A wall-mounted artwork composed of multiple colorful, swirling glass panels is positioned to the right of the sculptures.\n[90-120s] - A cluster of metallic, wing-like sculptures is mounted on a white wall, casting shadows.  \n- A large, translucent blue glass sculpture with internal rings is displayed on a pedestal, reflecting light.  \n- A series of colorful, ring-shaped glass art pieces are arranged in a cascading pattern on the wall, with some rings overlapping.\n[120-150s] - A tall, translucent blue sculpture with internal light patterns is viewed by visitors, one man leaning in closely.  \n- A group of people, including a woman in a red top, stand near a large yellow sculpture with embedded dark figures.  \n- A blue sign with numbers \"620/788\" and \"629/773\" is mounted on a wall, indicating exhibit or room identifiers.\n[150-180s] - A large yellow canvas with black zebra silhouettes is displayed, then the camera pans to reveal a glass-encased sculpture of intertwined animal figures.  \n- The sculpture, visible through glass, is positioned centrally in a gallery space with visitors and other artworks in the background.  \n- The camera then moves to show three framed prints of abstract, layered, peach-toned forms mounted side by side on a dark wall.\n[180-210s] - Three vertically aligned framed artworks with textured surfaces (dark green, reddish-brown, yellow) are mounted on a white wall.  \n- A transparent display case with miniature figurines and decorative elements is positioned to the right of the artworks.  \n- Framed illustrations of stylized vehicles and a whimsical creature with floral adornments are visible on adjacent walls.\n[210-240s] - Abstract art with red tape elements mounted on dark wall, adjacent to gold-framed botanical prints.  \n- Leftward pan reveals a large sketch of a woman in a dress with flowing lines, framed in light wood.  \n- Further left, another sketch depicts a figure crouching on textured white paper, also in a light wooden frame.\n[240-270s] - Two framed artworks on a dark wall: top features a girl with a book and abstract white shapes, bottom shows a figure with a book and geometric forms.  \n- Adjacent to them, four black square shadow boxes mounted on a white wall, each containing a small circular object.  \n- A large white wall displays a single black-and-white drawing of an elephant walking on a thin red line.\n[270-300s] - A framed artwork depicts an elephant walking on a tightrope, suspended against a plain background.  \n- Below, a series of framed pieces show stylized, colorful scenes with animals and plants, arranged vertically on a white wall.  \n- A transparent display case holds a detailed diorama of palm trees and miniature figures, positioned on a shelf beneath the framed artworks.\n[300-330s] - A framed artwork depicts a child in a white dress holding a purple object, suspended in a glass case.  \n- Adjacent to it, another framed piece shows a figure with a large, tangled mass of white material resembling hair or wires.  \n- The camera pans right, revealing a series of colorful abstract paintings in wooden frames mounted on a dark wall.", "history_tokens": 937, "history_utf8_bytes": 4167, "recent_frame_times_s": [309.00266927083334, 310.00266927083334, 311.00266927083334, 312.00266927083334, 313.00266927083334, 314.00266927083334, 315.00266927083334, 316.00266927083334, 317.00266927083334, 318.00266927083334, 319.00266927083334, 320.00266927083334, 321.00266927083334, 322.00266927083334, 323.00266927083334, 324.00266927083334, 325.00266927083334, 326.00266927083334, 327.00266927083334, 328.00266927083334, 329.00266927083334, 330.00266927083334, 331.00266927083334, 332.00266927083334, 333.00266927083334, 334.00266927083334, 335.00266927083334, 336.00266927083334, 337.00266927083334, 338.00266927083334], "recent_frames_sha256": "cd682d81c0760dce60479f8d8afbdbbc62e6192f42983dcbdba029d1d6121b0a", "num_recent_frames": 30, "tq": 717622.645701605, "t1": 717625.942044515, "ta": 717625.942044515, "te": 717626.319519573, "first_response_s": 3.296342910034582, "answer_total_s": 3.6738179679960012, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 478, "content_group": "3e7e5d84099eab5e8ce5cf289e8e735ccc5bd16fb24962935688c27feb6fd664", "question": {"question_id": "sample_478_a2067_q1", "video_id": 478, "video_path": "./videos/sample_478_real.mp4", "annotation_index": 2067, "question_index": 1, "question": "Based on the camera movement and gallery setup, what might the camera show next?", "options": ["A. An outdoor scene.", "B. Detailed close-ups of other artworks.", "C. The entrance of the gallery.", "D. A lecture or discussion area."], "answer": "B", "time_stamp_s": 339, "task_type": "Prospective Reasoning", "required_ability": "episodic memory", "video_category": "art_show", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_478_a2067_q1", "video_id": 478, "time_stamp_s": 339, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4640595b7f2059f90da477347a50b20721c6c8de1cec83e1f1c4b2287308813b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [309.00266927083334, 310.00266927083334, 311.00266927083334, 312.00266927083334, 313.00266927083334, 314.00266927083334, 315.00266927083334, 316.00266927083334, 317.00266927083334, 318.00266927083334, 319.00266927083334, 320.00266927083334, 321.00266927083334, 322.00266927083334, 323.00266927083334, 324.00266927083334, 325.00266927083334, 326.00266927083334, 327.00266927083334, 328.00266927083334, 329.00266927083334, 330.00266927083334, 331.00266927083334, 332.00266927083334, 333.00266927083334, 334.00266927083334, 335.00266927083334, 336.00266927083334, 337.00266927083334, 338.00266927083334], "recent_frames_sha256": "cd682d81c0760dce60479f8d8afbdbbc62e6192f42983dcbdba029d1d6121b0a", "num_recent_frames": 30, "tq": 717498.099970523, "t1": 717510.121384572, "ta": 717510.121384572, "te": 717510.159766039, "first_response_s": 12.021414048969746, "answer_total_s": 12.059795515961014, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_478_a2067_q1", "video_id": 478, "time_stamp_s": 339, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ed8a37eb041f90728ac795c60dd1bf7525e20cd9e395f726ba0d1a9e9e02213c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Abstract paintings with bold geometric shapes and vibrant colors are displayed on white walls, including a large piece with a stylized face and another with a prominent yellow star.  \n- A blue sign labeled \"2023/724A\" hangs from the ceiling, indicating an exhibit or gallery section.  \n- Visitors walk through the gallery, observing the art, while staff members are seen attending to display areas or equipment.\n[30-60s] - A red-hooded visitor stands near a wall-mounted abstract sculpture with hanging geometric shapes.  \n- A large, transparent glass sculpture with swirling internal patterns is displayed on a pedestal, viewed from multiple angles.  \n- A reflective, angular sculpture depicting a cracked egg with red interior is positioned on a stand, surrounded by other visitors.\n[60-90s] - A large abstract painting with vertical bands of black, yellow, blue, red, and orange is mounted on a white wall.  \n- Two glass sculptures—a tall orange one and a smaller blue teardrop-shaped one—are displayed on pedestals nearby.  \n- A wall-mounted artwork composed of multiple colorful, swirling glass panels is positioned to the right of the sculptures.\n[90-120s] - A cluster of metallic, wing-like sculptures is mounted on a white wall, casting shadows.  \n- A large, translucent blue glass sculpture with internal rings is displayed on a pedestal, reflecting light.  \n- A series of colorful, ring-shaped glass art pieces are arranged in a cascading pattern on the wall, with some rings overlapping.\n[120-150s] - A tall, translucent blue sculpture with internal light patterns is viewed by visitors, one man leaning in closely.  \n- A group of people, including a woman in a red top, stand near a large yellow sculpture with embedded dark figures.  \n- A blue sign with numbers \"620/788\" and \"629/773\" is mounted on a wall, indicating exhibit or room identifiers.\n[150-180s] - A large yellow canvas with black zebra silhouettes is displayed, then the camera pans to reveal a glass-encased sculpture of intertwined animal figures.  \n- The sculpture, visible through glass, is positioned centrally in a gallery space with visitors and other artworks in the background.  \n- The camera then moves to show three framed prints of abstract, layered, peach-toned forms mounted side by side on a dark wall.\n[180-210s] - Three vertically aligned framed artworks with textured surfaces (dark green, reddish-brown, yellow) are mounted on a white wall.  \n- A transparent display case with miniature figurines and decorative elements is positioned to the right of the artworks.  \n- Framed illustrations of stylized vehicles and a whimsical creature with floral adornments are visible on adjacent walls.\n[210-240s] - Abstract art with red tape elements mounted on dark wall, adjacent to gold-framed botanical prints.  \n- Leftward pan reveals a large sketch of a woman in a dress with flowing lines, framed in light wood.  \n- Further left, another sketch depicts a figure crouching on textured white paper, also in a light wooden frame.\n[240-270s] - Two framed artworks on a dark wall: top features a girl with a book and abstract white shapes, bottom shows a figure with a book and geometric forms.  \n- Adjacent to them, four black square shadow boxes mounted on a white wall, each containing a small circular object.  \n- A large white wall displays a single black-and-white drawing of an elephant walking on a thin red line.\n[270-300s] - A framed artwork depicts an elephant walking on a tightrope, suspended against a plain background.  \n- Below, a series of framed pieces show stylized, colorful scenes with animals and plants, arranged vertically on a white wall.  \n- A transparent display case holds a detailed diorama of palm trees and miniature figures, positioned on a shelf beneath the framed artworks.\n[300-330s] - A framed artwork depicts a child in a white dress holding a purple object, suspended in a glass case.  \n- Adjacent to it, another framed piece shows a figure with a large, tangled mass of white material resembling hair or wires.  \n- The camera pans right, revealing a series of colorful abstract paintings in wooden frames mounted on a dark wall.", "history_tokens": 937, "history_utf8_bytes": 4167, "recent_frame_times_s": [309.00266927083334, 310.00266927083334, 311.00266927083334, 312.00266927083334, 313.00266927083334, 314.00266927083334, 315.00266927083334, 316.00266927083334, 317.00266927083334, 318.00266927083334, 319.00266927083334, 320.00266927083334, 321.00266927083334, 322.00266927083334, 323.00266927083334, 324.00266927083334, 325.00266927083334, 326.00266927083334, 327.00266927083334, 328.00266927083334, 329.00266927083334, 330.00266927083334, 331.00266927083334, 332.00266927083334, 333.00266927083334, 334.00266927083334, 335.00266927083334, 336.00266927083334, 337.00266927083334, 338.00266927083334], "recent_frames_sha256": "cd682d81c0760dce60479f8d8afbdbbc62e6192f42983dcbdba029d1d6121b0a", "num_recent_frames": 30, "tq": 717626.333784691, "t1": 717637.572581435, "ta": 717637.572581435, "te": 717637.83475515, "first_response_s": 11.238796743913554, "answer_total_s": 11.500970458961092, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 478, "content_group": "3e7e5d84099eab5e8ce5cf289e8e735ccc5bd16fb24962935688c27feb6fd664", "question": {"question_id": "sample_478_a2068_q0", "video_id": 478, "video_path": "./videos/sample_478_real.mp4", "annotation_index": 2068, "question_index": 0, "question": "What additional information does the sign provide besides \"GALLERY 1261\"?", "options": ["A. Names of the artists.", "B. Room numbers and a location in Denver, CO.", "C. A description of the exhibition.", "D. Opening hours of the gallery."], "answer": "B", "time_stamp_s": 588, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [540, 588], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_478_a2068_q0", "video_id": 478, "time_stamp_s": 588, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "29e928c86d0f9ee1b59f93c1048ed84133512c5e2512e907ac1a96ea73d5bc43", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [558.0026692708333, 559.0026692708333, 560.0026692708333, 561.0026692708333, 562.0026692708333, 563.0026692708333, 564.0026692708333, 565.0026692708333, 566.0026692708333, 567.0026692708333, 568.0026692708333, 569.0026692708333, 570.0026692708333, 571.0026692708333, 572.0026692708333, 573.0026692708333, 574.0026692708333, 575.0026692708333, 576.0026692708333, 577.0026692708333, 578.0026692708333, 579.0026692708333, 580.0026692708333, 581.0026692708333, 582.0026692708333, 583.0026692708333, 584.0026692708333, 585.0026692708333, 586.0026692708333, 587.0026692708333], "recent_frames_sha256": "658c9b4b3b33c509828b0006a7330d6b614c6958291ac28fc44d74c067e7a5fd", "num_recent_frames": 30, "tq": 717510.172677035, "t1": 717517.395550555, "ta": 717517.395550555, "te": 717517.432739802, "first_response_s": 7.222873519989662, "answer_total_s": 7.260062767076306, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_478_a2068_q0", "video_id": 478, "time_stamp_s": 588, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b393a1fffb6cfef0bb4815a755ada657ee3ef45853567eae200421ef7a285737", "condition_order": ["recent", "notes"], "memory": "[240-270s] - Two framed artworks on a dark wall: top features a girl with a book and abstract white shapes, bottom shows a figure with a book and geometric forms.  \n- Adjacent to them, four black square shadow boxes mounted on a white wall, each containing a small circular object.  \n- A large white wall displays a single black-and-white drawing of an elephant walking on a thin red line.\n[270-300s] - A framed artwork depicts an elephant walking on a tightrope, suspended against a plain background.  \n- Below, a series of framed pieces show stylized, colorful scenes with animals and plants, arranged vertically on a white wall.  \n- A transparent display case holds a detailed diorama of palm trees and miniature figures, positioned on a shelf beneath the framed artworks.\n[300-330s] - A framed artwork depicts a child in a white dress holding a purple object, suspended in a glass case.  \n- Adjacent to it, another framed piece shows a figure with a large, tangled mass of white material resembling hair or wires.  \n- The camera pans right, revealing a series of colorful abstract paintings in wooden frames mounted on a dark wall.\n[330-360s] - Four abstract paintings with bold, layered colors are displayed in a grid on a dark wall.  \n- The camera pans left, revealing a gallery space with visitors seated at tables, observing art.  \n- Two framed paintings of stylized human figures on beige backgrounds are mounted side by side.\n[360-390s] - A large, colorful, hanging textile installation dominates the right side of the frame, with vibrant pink, purple, and green hues.  \n- A wall-mounted series of circular, intricately patterned artworks in warm tones (yellow, orange, brown) is displayed on the left wall.  \n- A person in dark clothing walks past the circular artworks, moving toward the right side of the frame.\n[390-420s] - A large, colorful, hanging textile installation dominates the central space, with vibrant green, red, and purple strands cascading down.  \n- The camera pans to reveal a blue sign displaying \"390.5\" and \"391.736\" near a white wall, indicating exhibit or room identifiers.  \n- Adjacent to the installation, framed paintings with golden borders are mounted on white walls, depicting abstract or stylized scenes.\n[420-450s] - A black abstract sculpture with colorful, wing-like extensions is displayed on a pedestal, casting shadows on the white wall behind it.  \n- Adjacent to it, a wall-mounted series of colorful, layered abstract sculptures in blues, greens, and yellows are arranged in a dynamic, overlapping pattern.  \n- A large, vibrant painting depicting a figure in a colorful, textured environment is visible to the left, partially obscured by the sculpture display.\n[450-480s] - A large, colorful abstract painting of a turtle is mounted on a white wall, surrounded by smaller framed artworks.  \n- Below the turtle painting, a series of small, square, abstract pieces with black figures on beige backgrounds are arranged in a grid.  \n- A large, geometric abstract piece with intersecting lines is positioned above the grid of small paintings.\n[480-510s] - A large, abstract wooden panel with dark, tangled lines is mounted on a white wall, positioned below a grid of smaller, framed black-and-white artworks.  \n- A tall, blue and green abstract sculpture stands centrally in the gallery, flanked by other artworks on adjacent walls.  \n- Visitors are seen walking through the space, observing the exhibits, with one person seated near the large wooden panel, appearing to be engaged with a tablet or phone.\n[510-540s] - A white, translucent, sculpted figure hangs from a black metal hook on a white wall.  \n- Red, felt-like pumpkins hang from strings, positioned below the figure and above a basket of colorful yarn balls.  \n- The camera pans right, revealing a wall of vibrant, abstract paintings in various frames.\n[540-570s] - A white shelf displays multiple painted busts, including one with a golden headdress and another with a red garment.  \n- The camera pans right, revealing tall, colorful abstract sculptures on black pedestals and a circular wall-mounted artwork.  \n- The space features white walls with framed artworks and a blue accent wall in the background.", "history_tokens": 949, "history_utf8_bytes": 4216, "recent_frame_times_s": [558.0026692708333, 559.0026692708333, 560.0026692708333, 561.0026692708333, 562.0026692708333, 563.0026692708333, 564.0026692708333, 565.0026692708333, 566.0026692708333, 567.0026692708333, 568.0026692708333, 569.0026692708333, 570.0026692708333, 571.0026692708333, 572.0026692708333, 573.0026692708333, 574.0026692708333, 575.0026692708333, 576.0026692708333, 577.0026692708333, 578.0026692708333, 579.0026692708333, 580.0026692708333, 581.0026692708333, 582.0026692708333, 583.0026692708333, 584.0026692708333, 585.0026692708333, 586.0026692708333, 587.0026692708333], "recent_frames_sha256": "658c9b4b3b33c509828b0006a7330d6b614c6958291ac28fc44d74c067e7a5fd", "num_recent_frames": 30, "tq": 717698.841911194, "t1": 717706.905780366, "ta": 717706.905780366, "te": 717706.947604609, "first_response_s": 8.063869172008708, "answer_total_s": 8.105693414923735, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 479, "content_group": "01bf39c34b39c8e744bae41c2caec1728f77ff6648f619af3fed92598cd97577", "question": {"question_id": "sample_479_a1887_q0", "video_id": 479, "video_path": "./videos/sample_479_real.mp4", "annotation_index": 1887, "question_index": 0, "question": "What best describes the paintings shown in the video?", "options": ["A. Abstract landscapes with vibrant colors.", "B. Portraits with light and pastel backgrounds.", "C. Still life paintings with intricate details.", "D. Surreal scenes with dark and moody tones."], "answer": "B", "time_stamp_s": 10, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_479_a1887_q0", "video_id": 479, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4e33d3e44c258f161177aecc65b19d80bf1f501b59e768de0aa934916bde30a4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03697916666666667, 1.0036458333333333, 2.003645833333333, 3.003645833333333, 4.003645833333334, 5.003645833333334, 6.003645833333334, 7.003645833333334, 8.003645833333334, 9.003645833333334], "recent_frames_sha256": "fa32b1e143291b59bd69c071c2ea76740423d6799e01a4333439a6edbd6c4986", "num_recent_frames": 10, "tq": 718004.749333863, "t1": 718005.716390698, "ta": 718005.716390698, "te": 718005.756182358, "first_response_s": 0.9670568349538371, "answer_total_s": 1.0068484949879348, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_479_a1887_q0", "video_id": 479, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0a73721352c0af4ce913f70deaf102559b131816285acb3a43776489046e61a8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03697916666666667, 1.0036458333333333, 2.003645833333333, 3.003645833333333, 4.003645833333334, 5.003645833333334, 6.003645833333334, 7.003645833333334, 8.003645833333334, 9.003645833333334], "recent_frames_sha256": "fa32b1e143291b59bd69c071c2ea76740423d6799e01a4333439a6edbd6c4986", "num_recent_frames": 10, "tq": 718047.509664851, "t1": 718058.851668002, "ta": 718058.851668002, "te": 718059.124262861, "first_response_s": 11.3420031509595, "answer_total_s": 11.614598009968176, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 479, "content_group": "01bf39c34b39c8e744bae41c2caec1728f77ff6648f619af3fed92598cd97577", "question": {"question_id": "sample_479_a1887_q1", "video_id": 479, "video_path": "./videos/sample_479_real.mp4", "annotation_index": 1887, "question_index": 1, "question": "How many paintings featuring woman are visible just now?", "options": ["A. One.", "B. Two.", "C. Three.", "D. Four."], "answer": "D", "time_stamp_s": 13, "task_type": "Counting", "required_ability": "episodic memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_479_a1887_q1", "video_id": 479, "time_stamp_s": 13, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "667691d559298051d1e5683c15373a5f3c00af1fa21ee766c076053e7947f17b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03697916666666667, 1.0036458333333333, 2.003645833333333, 3.003645833333333, 4.003645833333334, 5.003645833333334, 6.003645833333334, 7.003645833333334, 8.003645833333334, 9.003645833333334, 10.003645833333334, 11.003645833333334, 12.003645833333334], "recent_frames_sha256": "de3d1e1415ab331b01a057b8cf068e4ed01181ae52e1f1ee9bcb8f3de494c959", "num_recent_frames": 13, "tq": 718005.782908742, "t1": 718017.461091209, "ta": 718017.461091209, "te": 718017.503271728, "first_response_s": 11.678182467003353, "answer_total_s": 11.72036298608873, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_479_a1887_q1", "video_id": 479, "time_stamp_s": 13, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "0ecf5ae0ffbc03aeba10dcb1ec6e6ffddbb67b751542bd59b260bd7e76df30e9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.03697916666666667, 1.0036458333333333, 2.003645833333333, 3.003645833333333, 4.003645833333334, 5.003645833333334, 6.003645833333334, 7.003645833333334, 8.003645833333334, 9.003645833333334, 10.003645833333334, 11.003645833333334, 12.003645833333334], "recent_frames_sha256": "de3d1e1415ab331b01a057b8cf068e4ed01181ae52e1f1ee9bcb8f3de494c959", "num_recent_frames": 13, "tq": 718059.156717357, "t1": 718067.24589388, "ta": 718067.24589388, "te": 718067.562926191, "first_response_s": 8.08917652303353, "answer_total_s": 8.406208834028803, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 479, "content_group": "01bf39c34b39c8e744bae41c2caec1728f77ff6648f619af3fed92598cd97577", "question": {"question_id": "sample_479_a1888_q1", "video_id": 479, "video_path": "./videos/sample_479_real.mp4", "annotation_index": 1888, "question_index": 1, "question": "How is the background of the lower artwork described?", "options": ["A. Bright and clear with blue skies.", "B. Dark and slightly blurred with greenish and blue light effects.", "C. White and plain with no distractions.", "D. Vivid and colorful with red hues."], "answer": "B", "time_stamp_s": 324, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_479_a1888_q1", "video_id": 479, "time_stamp_s": 324, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c56fdf315cac7170f2ce88d08bc4455723db9ce9e6a3799bd19e4e9267029ccb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [294.00364583333334, 295.00364583333334, 296.00364583333334, 297.00364583333334, 298.00364583333334, 299.00364583333334, 300.00364583333334, 301.00364583333334, 302.00364583333334, 303.00364583333334, 304.00364583333334, 305.00364583333334, 306.00364583333334, 307.00364583333334, 308.00364583333334, 309.00364583333334, 310.00364583333334, 311.00364583333334, 312.00364583333334, 313.00364583333334, 314.00364583333334, 315.00364583333334, 316.00364583333334, 317.00364583333334, 318.00364583333334, 319.00364583333334, 320.00364583333334, 321.00364583333334, 322.00364583333334, 323.00364583333334], "recent_frames_sha256": "6fc205ebb352a52fc5f9527ada813330e5709f481c7fdcfc9bed16ca0b16b94f", "num_recent_frames": 30, "tq": 718017.523381294, "t1": 718027.980116642, "ta": 718027.980116642, "te": 718028.017821886, "first_response_s": 10.456735347979702, "answer_total_s": 10.494440592010505, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_479_a1888_q1", "video_id": 479, "time_stamp_s": 324, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "11e24f5a4b2bd61dfee83acf2eac3ab76bf20df8bc4284a61baf70c2300bf47c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Gallery walls display a series of framed artworks, including portraits of children and horse-themed paintings, arranged in a linear fashion.  \n- A visitor in a beige coat walks past the artworks, while another person with a green backpack is seen in the distance.  \n- The camera pans across the gallery, revealing different sections with varied art styles and sizes, including a large horse painting and smaller cowboy-themed pieces.\n[30-60s] - A large abstract painting with a red central form and white splatters is displayed on the right wall, partially obscured by a visitor's arm.  \n- A visitor in a black jacket and blue jeans stands near the painting, facing it, while another person in beige attire observes a different artwork nearby.  \n- The camera pans right, revealing more abstract and figurative artworks mounted on white walls, including a framed portrait of a woman with a red headband.\n[60-90s] - A framed display of assorted donuts in a glass case is shown, with varied toppings and glazes.  \n- To the left, a painting of a purple-flowered field is mounted on the wall.  \n- Below the donut display, a framed artwork of golden pears on a dark surface is visible.\n[90-120s] - A large framed painting of three horses (brown, white, and black) is centrally displayed on a white wall, with people walking nearby.  \n- To the left of the horse painting, a series of smaller framed artworks are mounted on the wall, including abstract and figurative pieces.  \n- The camera pans left, revealing a long hallway with more artworks and visitors, including a blue-painted wall section in the distance.\n[120-150s] - A blue sign reading \"SALON DE L'ART\" is mounted on a glass partition, indicating an art gallery or exhibition space.  \n- The camera pans across a wall displaying multiple framed paintings, including vibrant floral scenes and abstract landscapes.  \n- A visitor is seen walking past the artworks, observing the exhibits in the gallery.\n[150-180s] - A large, colorful, patchwork elephant sculpture is centrally displayed on a white pedestal, surrounded by framed portraits on the wall.  \n- The camera pans left, revealing a wall of four distinct portrait paintings, each with unique color schemes and expressions, mounted in a grid.  \n- Further left, a golden, ornate airplane sculpture is positioned on a gray pedestal, adjacent to a wall of abstract paintings featuring circular patterns and vibrant colors.\n[180-210s] - A red and silver robot figurine stands on a gray pedestal, centered below a framed painting of a deer in a forest.  \n- To the right of the robot, a colorful abstract painting is mounted on the wall, adjacent to a small framed photo.  \n- Above the robot, a circular plate with a rabbit illustration is mounted, positioned between two other circular plates featuring floral and animal designs.\n[210-240s] - A large framed painting of a child in a red coat gazing at an underwater scene with fish and coral dominates the right wall.  \n- To its left, three smaller floral paintings are displayed, with a larger painting of two zebras under palm trees adjacent to them.  \n- A circular, gold-framed painting of a figure in a hat is mounted above the child’s painting, with other circular artworks arranged around it.\n[240-270s] - A large painting with a blue window and objects on a ledge is displayed on the left wall.  \n- A series of smaller framed artworks, including a black crow on pink, a colorful bird, and floral pieces, are arranged vertically on the right wall.  \n- A wall-mounted display features circular objects with gold rims and QR codes, positioned above transparent cases holding colorful, abstract sculptures.\n[270-300s] - A blonde doll in a polka-dot dress floats horizontally in a transparent case, surrounded by a gray, smoky effect.  \n- A second doll in a blue outfit is submerged in a circular, swirling water-like medium within another transparent case.  \n- A third doll in a silver gown floats in a similar transparent case, with motion blur suggesting movement or rotation.", "history_tokens": 889, "history_utf8_bytes": 4045, "recent_frame_times_s": [294.00364583333334, 295.00364583333334, 296.00364583333334, 297.00364583333334, 298.00364583333334, 299.00364583333334, 300.00364583333334, 301.00364583333334, 302.00364583333334, 303.00364583333334, 304.00364583333334, 305.00364583333334, 306.00364583333334, 307.00364583333334, 308.00364583333334, 309.00364583333334, 310.00364583333334, 311.00364583333334, 312.00364583333334, 313.00364583333334, 314.00364583333334, 315.00364583333334, 316.00364583333334, 317.00364583333334, 318.00364583333334, 319.00364583333334, 320.00364583333334, 321.00364583333334, 322.00364583333334, 323.00364583333334], "recent_frames_sha256": "6fc205ebb352a52fc5f9527ada813330e5709f481c7fdcfc9bed16ca0b16b94f", "num_recent_frames": 30, "tq": 718143.231400482, "t1": 718145.089504227, "ta": 718145.089504227, "te": 718145.128240516, "first_response_s": 1.8581037450348958, "answer_total_s": 1.8968400339363143, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 479, "content_group": "01bf39c34b39c8e744bae41c2caec1728f77ff6648f619af3fed92598cd97577", "question": {"question_id": "sample_479_a1888_q0", "video_id": 479, "video_path": "./videos/sample_479_real.mp4", "annotation_index": 1888, "question_index": 0, "question": "What is positioned to the left of the artwork with the glowing sphere?", "options": ["A. A painting with a blue background.", "B. A painting with a green background.", "C. A painting with a white background.", "D. A painting with a red background."], "answer": "D", "time_stamp_s": 340, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_479_a1888_q0", "video_id": 479, "time_stamp_s": 340, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1a778dea8d210359b33b9edf19fddcc020c1728ec9609151ab79d47e925d0d81", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [310.00364583333334, 311.00364583333334, 312.00364583333334, 313.00364583333334, 314.00364583333334, 315.00364583333334, 316.00364583333334, 317.00364583333334, 318.00364583333334, 319.00364583333334, 320.00364583333334, 321.00364583333334, 322.00364583333334, 323.00364583333334, 324.00364583333334, 325.00364583333334, 326.00364583333334, 327.00364583333334, 328.00364583333334, 329.00364583333334, 330.00364583333334, 331.00364583333334, 332.00364583333334, 333.00364583333334, 334.00364583333334, 335.00364583333334, 336.00364583333334, 337.00364583333334, 338.00364583333334, 339.00364583333334], "recent_frames_sha256": "00837b47d3d2a0e70f72ad8fe4a428e11d02f37b21cca8ec4ac940725d4e91ac", "num_recent_frames": 30, "tq": 718028.031578521, "t1": 718035.784141565, "ta": 718035.784141565, "te": 718035.822568828, "first_response_s": 7.752563043963164, "answer_total_s": 7.790990306995809, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_479_a1888_q0", "video_id": 479, "time_stamp_s": 340, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1e0df0370eca91daa1e5cd617bdb0eeca8e107ac838b62f8dc5118c8101e3493", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Gallery walls display a series of framed artworks, including portraits of children and horse-themed paintings, arranged in a linear fashion.  \n- A visitor in a beige coat walks past the artworks, while another person with a green backpack is seen in the distance.  \n- The camera pans across the gallery, revealing different sections with varied art styles and sizes, including a large horse painting and smaller cowboy-themed pieces.\n[30-60s] - A large abstract painting with a red central form and white splatters is displayed on the right wall, partially obscured by a visitor's arm.  \n- A visitor in a black jacket and blue jeans stands near the painting, facing it, while another person in beige attire observes a different artwork nearby.  \n- The camera pans right, revealing more abstract and figurative artworks mounted on white walls, including a framed portrait of a woman with a red headband.\n[60-90s] - A framed display of assorted donuts in a glass case is shown, with varied toppings and glazes.  \n- To the left, a painting of a purple-flowered field is mounted on the wall.  \n- Below the donut display, a framed artwork of golden pears on a dark surface is visible.\n[90-120s] - A large framed painting of three horses (brown, white, and black) is centrally displayed on a white wall, with people walking nearby.  \n- To the left of the horse painting, a series of smaller framed artworks are mounted on the wall, including abstract and figurative pieces.  \n- The camera pans left, revealing a long hallway with more artworks and visitors, including a blue-painted wall section in the distance.\n[120-150s] - A blue sign reading \"SALON DE L'ART\" is mounted on a glass partition, indicating an art gallery or exhibition space.  \n- The camera pans across a wall displaying multiple framed paintings, including vibrant floral scenes and abstract landscapes.  \n- A visitor is seen walking past the artworks, observing the exhibits in the gallery.\n[150-180s] - A large, colorful, patchwork elephant sculpture is centrally displayed on a white pedestal, surrounded by framed portraits on the wall.  \n- The camera pans left, revealing a wall of four distinct portrait paintings, each with unique color schemes and expressions, mounted in a grid.  \n- Further left, a golden, ornate airplane sculpture is positioned on a gray pedestal, adjacent to a wall of abstract paintings featuring circular patterns and vibrant colors.\n[180-210s] - A red and silver robot figurine stands on a gray pedestal, centered below a framed painting of a deer in a forest.  \n- To the right of the robot, a colorful abstract painting is mounted on the wall, adjacent to a small framed photo.  \n- Above the robot, a circular plate with a rabbit illustration is mounted, positioned between two other circular plates featuring floral and animal designs.\n[210-240s] - A large framed painting of a child in a red coat gazing at an underwater scene with fish and coral dominates the right wall.  \n- To its left, three smaller floral paintings are displayed, with a larger painting of two zebras under palm trees adjacent to them.  \n- A circular, gold-framed painting of a figure in a hat is mounted above the child’s painting, with other circular artworks arranged around it.\n[240-270s] - A large painting with a blue window and objects on a ledge is displayed on the left wall.  \n- A series of smaller framed artworks, including a black crow on pink, a colorful bird, and floral pieces, are arranged vertically on the right wall.  \n- A wall-mounted display features circular objects with gold rims and QR codes, positioned above transparent cases holding colorful, abstract sculptures.\n[270-300s] - A blonde doll in a polka-dot dress floats horizontally in a transparent case, surrounded by a gray, smoky effect.  \n- A second doll in a blue outfit is submerged in a circular, swirling water-like medium within another transparent case.  \n- A third doll in a silver gown floats in a similar transparent case, with motion blur suggesting movement or rotation.\n[300-330s] - A circular, gold-rimmed plate with a small, colorful image is displayed in a black frame, mounted on a white wall.  \n- The plate is positioned below another similar plate, both framed identically, with a QR code and label visible to the right.  \n- The camera pans slightly to the right, revealing a white wall with multiple framed artworks, including portraits and abstract pieces.", "history_tokens": 979, "history_utf8_bytes": 4440, "recent_frame_times_s": [310.00364583333334, 311.00364583333334, 312.00364583333334, 313.00364583333334, 314.00364583333334, 315.00364583333334, 316.00364583333334, 317.00364583333334, 318.00364583333334, 319.00364583333334, 320.00364583333334, 321.00364583333334, 322.00364583333334, 323.00364583333334, 324.00364583333334, 325.00364583333334, 326.00364583333334, 327.00364583333334, 328.00364583333334, 329.00364583333334, 330.00364583333334, 331.00364583333334, 332.00364583333334, 333.00364583333334, 334.00364583333334, 335.00364583333334, 336.00364583333334, 337.00364583333334, 338.00364583333334, 339.00364583333334], "recent_frames_sha256": "00837b47d3d2a0e70f72ad8fe4a428e11d02f37b21cca8ec4ac940725d4e91ac", "num_recent_frames": 30, "tq": 718156.896972392, "t1": 718158.690648971, "ta": 718158.690648971, "te": 718158.892708691, "first_response_s": 1.7936765790218487, "answer_total_s": 1.9957362989662215, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 479, "content_group": "01bf39c34b39c8e744bae41c2caec1728f77ff6648f619af3fed92598cd97577", "question": {"question_id": "sample_479_a1889_q0", "video_id": 479, "video_path": "./videos/sample_479_real.mp4", "annotation_index": 1889, "question_index": 0, "question": "What are the features of the painting to the right of painting with a sheep's head?", "options": ["A. Geometric patterns and bold colors.", "B. A vibrant house on a street.", "C. A blue abstract piece with intricate line work.", "D. An expansive field under a muted sky."], "answer": "C", "time_stamp_s": 495, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_479_a1889_q0", "video_id": 479, "time_stamp_s": 495, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "34c7fcdc7a080e549ce976759229d5651eac9b08698617f6aadbea08f8bb6571", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [465.00364583333334, 466.00364583333334, 467.00364583333334, 468.00364583333334, 469.00364583333334, 470.00364583333334, 471.00364583333334, 472.00364583333334, 473.00364583333334, 474.00364583333334, 475.00364583333334, 476.00364583333334, 477.00364583333334, 478.00364583333334, 479.00364583333334, 480.00364583333334, 481.00364583333334, 482.00364583333334, 483.00364583333334, 484.00364583333334, 485.00364583333334, 486.00364583333334, 487.00364583333334, 488.00364583333334, 489.00364583333334, 490.00364583333334, 491.00364583333334, 492.00364583333334, 493.00364583333334, 494.00364583333334], "recent_frames_sha256": "cd3918e4e2c0adf84dbdcc168adb1360c8b071c091165f0fa26552f2a6def6f1", "num_recent_frames": 30, "tq": 718035.835589327, "t1": 718047.457601427, "ta": 718047.457601427, "te": 718047.499837693, "first_response_s": 11.622012099949643, "answer_total_s": 11.664248365908861, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_479_a1889_q0", "video_id": 479, "time_stamp_s": 495, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8969fd412f5037e8597e8f373cc5028e3f634dc05e0cc962769686fcbb547aa2", "condition_order": ["recent", "notes"], "memory": "[120-150s] - A blue sign reading \"SALON DE L'ART\" is mounted on a glass partition, indicating an art gallery or exhibition space.  \n- The camera pans across a wall displaying multiple framed paintings, including vibrant floral scenes and abstract landscapes.  \n- A visitor is seen walking past the artworks, observing the exhibits in the gallery.\n[150-180s] - A large, colorful, patchwork elephant sculpture is centrally displayed on a white pedestal, surrounded by framed portraits on the wall.  \n- The camera pans left, revealing a wall of four distinct portrait paintings, each with unique color schemes and expressions, mounted in a grid.  \n- Further left, a golden, ornate airplane sculpture is positioned on a gray pedestal, adjacent to a wall of abstract paintings featuring circular patterns and vibrant colors.\n[180-210s] - A red and silver robot figurine stands on a gray pedestal, centered below a framed painting of a deer in a forest.  \n- To the right of the robot, a colorful abstract painting is mounted on the wall, adjacent to a small framed photo.  \n- Above the robot, a circular plate with a rabbit illustration is mounted, positioned between two other circular plates featuring floral and animal designs.\n[210-240s] - A large framed painting of a child in a red coat gazing at an underwater scene with fish and coral dominates the right wall.  \n- To its left, three smaller floral paintings are displayed, with a larger painting of two zebras under palm trees adjacent to them.  \n- A circular, gold-framed painting of a figure in a hat is mounted above the child’s painting, with other circular artworks arranged around it.\n[240-270s] - A large painting with a blue window and objects on a ledge is displayed on the left wall.  \n- A series of smaller framed artworks, including a black crow on pink, a colorful bird, and floral pieces, are arranged vertically on the right wall.  \n- A wall-mounted display features circular objects with gold rims and QR codes, positioned above transparent cases holding colorful, abstract sculptures.\n[270-300s] - A blonde doll in a polka-dot dress floats horizontally in a transparent case, surrounded by a gray, smoky effect.  \n- A second doll in a blue outfit is submerged in a circular, swirling water-like medium within another transparent case.  \n- A third doll in a silver gown floats in a similar transparent case, with motion blur suggesting movement or rotation.\n[300-330s] - A circular, gold-rimmed plate with a small, colorful image is displayed in a black frame, mounted on a white wall.  \n- The plate is positioned below another similar plate, both framed identically, with a QR code and label visible to the right.  \n- The camera pans slightly to the right, revealing a white wall with multiple framed artworks, including portraits and abstract pieces.\n[330-360s] - A woman in a blue swimsuit holds a white ball above her head, centered in a black-framed painting.  \n- To her left, a painting depicts a figure in white robes against a fiery orange background.  \n- To the right, a large blue-toned abstract artwork with swirling patterns is partially visible.\n[360-390s] - A large circular painting of a crowned woman in red dress is mounted on the wall, positioned to the left of a purple abstract piece.  \n- A small orange and blue striped sculpture rests on the floor beneath the purple artwork.  \n- The camera pans right, revealing a series of black-framed sketches depicting landscapes and figures, arranged in a grid pattern.\n[390-420s] - A woman in a grey blazer walks past a wall of colorful paintings, holding a yellow object.  \n- A large vertical painting of a woman with a floral headdress dominates the right side of the wall.  \n- A series of small, vertically stacked floral paintings are mounted to the left of the large piece.\n[420-450s] - A large painting depicts two women dancing on a circular platform amidst a crowd, with yellow circular elements above them.  \n- To the left, a portrait of a woman with long hair and a patterned scarf hangs on the wall.  \n- A man in a gray suit is seated in a portrait below a larger portrait of a woman with a pink top, both framed and displayed on the same wall.\n[450-480s] - A blue digital display shows \"522\" above a white wall with framed art.  \n- A large black-and-white horse painting is prominently displayed, with dynamic brushstrokes and splatters.  \n- Adjacent to the horse, a textured, layered abstract piece in a wooden frame is mounted, with visible horizontal striations.", "history_tokens": 1023, "history_utf8_bytes": 4510, "recent_frame_times_s": [465.00364583333334, 466.00364583333334, 467.00364583333334, 468.00364583333334, 469.00364583333334, 470.00364583333334, 471.00364583333334, 472.00364583333334, 473.00364583333334, 474.00364583333334, 475.00364583333334, 476.00364583333334, 477.00364583333334, 478.00364583333334, 479.00364583333334, 480.00364583333334, 481.00364583333334, 482.00364583333334, 483.00364583333334, 484.00364583333334, 485.00364583333334, 486.00364583333334, 487.00364583333334, 488.00364583333334, 489.00364583333334, 490.00364583333334, 491.00364583333334, 492.00364583333334, 493.00364583333334, 494.00364583333334], "recent_frames_sha256": "cd3918e4e2c0adf84dbdcc168adb1360c8b071c091165f0fa26552f2a6def6f1", "num_recent_frames": 30, "tq": 718202.762782834, "t1": 718210.288159411, "ta": 718210.288159411, "te": 718210.329516989, "first_response_s": 7.5253765770467, "answer_total_s": 7.566734154941514, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 480, "content_group": "4af8405453752765de6da4ec0a718e7c09ba8824f4f4502d653b33c6fc96522e", "question": {"question_id": "sample_480_a2122_q0", "video_id": 480, "video_path": "./videos/sample_480_real.mp4", "annotation_index": 2122, "question_index": 0, "question": "What letters are mounted on the wall?", "options": ["A. PADO.", "B. GATO.", "C. LADO.", "D. FADO."], "answer": "A", "time_stamp_s": 7, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_480_a2122_q0", "video_id": 480, "time_stamp_s": 7, "ground_truth": "A", "raw_output": "A. PADO.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "bbb1e79c7900cc64593a356b65924cdf2044417ec3ad5f0d487e920d4b2b8a67", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0490234375, 1.0156901041666666, 2.0156901041666666, 3.0156901041666666, 4.015690104166667, 5.015690104166667, 6.015690104166667], "recent_frames_sha256": "11e21203c8e07e91113420e922dac36d03aafce6252d3a99365877b4f8b19ad7", "num_recent_frames": 7, "tq": 717213.433371975, "t1": 717219.193325713, "ta": 717219.193325713, "te": 717219.380760166, "first_response_s": 5.759953738073818, "answer_total_s": 5.94738819100894, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_480_a2122_q0", "video_id": 480, "time_stamp_s": 7, "ground_truth": "A", "raw_output": "A. PADO.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "f3e5598484149a40c1221b78b839a03b9db1cc08ae370b7bbb821195799d4cb6", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0490234375, 1.0156901041666666, 2.0156901041666666, 3.0156901041666666, 4.015690104166667, 5.015690104166667, 6.015690104166667], "recent_frames_sha256": "11e21203c8e07e91113420e922dac36d03aafce6252d3a99365877b4f8b19ad7", "num_recent_frames": 7, "tq": 717270.527254748, "t1": 717278.321657743, "ta": 717278.321657743, "te": 717278.525938338, "first_response_s": 7.79440299491398, "answer_total_s": 7.998683589976281, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 480, "content_group": "4af8405453752765de6da4ec0a718e7c09ba8824f4f4502d653b33c6fc96522e", "question": {"question_id": "sample_480_a2122_q1", "video_id": 480, "video_path": "./videos/sample_480_real.mp4", "annotation_index": 2122, "question_index": 1, "question": "Where is the fabric artwork depicting a tall tree located in relation to the letters \"PADO\"?", "options": ["A. To the right of the letters.", "B. Below the letters.", "C. To the left of the letters.", "D. Above the letters."], "answer": "B", "time_stamp_s": 10, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_480_a2122_q1", "video_id": 480, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "468b03b59817235cd0f6cb2e26a06ed04e7dc860ff6245fec59848eea4850c14", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0490234375, 1.0156901041666666, 2.0156901041666666, 3.0156901041666666, 4.015690104166667, 5.015690104166667, 6.015690104166667, 7.015690104166667, 8.015690104166667, 9.015690104166667], "recent_frames_sha256": "0c3613ab0eb6f8598900f3b5f6dbd5f3fe07145dc908c281eeebf39c4717594b", "num_recent_frames": 10, "tq": 717219.409466812, "t1": 717232.381694242, "ta": 717232.381694242, "te": 717232.423085841, "first_response_s": 12.972227429971099, "answer_total_s": 13.013619028963149, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_480_a2122_q1", "video_id": 480, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e14be5f571a3917528dcead330904dba79a45b6229e7d21744a3eaaa4aabb169", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0490234375, 1.0156901041666666, 2.0156901041666666, 3.0156901041666666, 4.015690104166667, 5.015690104166667, 6.015690104166667, 7.015690104166667, 8.015690104166667, 9.015690104166667], "recent_frames_sha256": "0c3613ab0eb6f8598900f3b5f6dbd5f3fe07145dc908c281eeebf39c4717594b", "num_recent_frames": 10, "tq": 717278.555352034, "t1": 717286.529109804, "ta": 717286.529109804, "te": 717286.5667604, "first_response_s": 7.973757769912481, "answer_total_s": 8.011408365913667, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 480, "content_group": "4af8405453752765de6da4ec0a718e7c09ba8824f4f4502d653b33c6fc96522e", "question": {"question_id": "sample_480_a2123_q0", "video_id": 480, "video_path": "./videos/sample_480_real.mp4", "annotation_index": 2123, "question_index": 0, "question": "What does the upper left painting feature?", "options": ["A. A large tree in bloom with pink flowers.", "B. A large tree with green foliage.", "C. A whimsical figure with flowers around its head.", "D. An abstract design with swirling shapes."], "answer": "A", "time_stamp_s": 222, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_480_a2123_q0", "video_id": 480, "time_stamp_s": 222, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a1af03cd957374f866a67ed8fda26e44038850b5664ab3b28e9db11968e92c49", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [192.01569010416668, 193.01569010416668, 194.01569010416668, 195.01569010416668, 196.01569010416668, 197.01569010416668, 198.01569010416668, 199.01569010416668, 200.01569010416668, 201.01569010416668, 202.01569010416668, 203.01569010416668, 204.01569010416668, 205.01569010416668, 206.01569010416668, 207.01569010416668, 208.01569010416668, 209.01569010416668, 210.01569010416668, 211.01569010416668, 212.01569010416668, 213.01569010416668, 214.01569010416668, 215.01569010416668, 216.01569010416668, 217.01569010416668, 218.01569010416668, 219.01569010416668, 220.01569010416668, 221.01569010416668], "recent_frames_sha256": "7649344eda1f12f45b243de636d8827b42dd0e6ac6db32cf9aaf02946a4cfb62", "num_recent_frames": 30, "tq": 717232.445990756, "t1": 717243.512540984, "ta": 717243.512540984, "te": 717243.551081207, "first_response_s": 11.066550227929838, "answer_total_s": 11.105090450961143, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_480_a2123_q0", "video_id": 480, "time_stamp_s": 222, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0881bcb24d49835717afaa7e232f3a14a12702e4cfeee082b99a3bf7d447ab13", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A white Porsche sports car is depicted in a painting against a blue sky with palm trees, mounted on a white wall.  \n- A large, textured, three-dimensional tree sculpture with blue-green foliage is displayed next to a framed painting of a person with a dog.  \n- A circular display table with a pink vinyl record center and illustrated figures around its edge is positioned on the floor, near a black tablecloth.\n[30-60s] - A wall displays multiple colorful, abstract paintings with vibrant patterns and figures, including a large red canvas with a tall green structure and a black animal.  \n- The camera pans across the wall, revealing various framed artworks with dynamic compositions, some featuring animals, geometric shapes, and surreal elements.  \n- A small black-framed piece labeled \"K. Adams\" is visible near the top left, while another labeled \"H. Lissaga\" appears on the wall to the left of a large green painting.\n[60-90s] - A black-and-white abstract painting with silhouetted figures and circular motifs is mounted on the wall, positioned below a yellow-framed artwork.  \n- To the right, a red-toned painting depicts stylized human figures with raised arms, adjacent to a smaller green-framed piece.  \n- A white wall with a small blue plaque labeled \"Music Room\" is visible above the black-and-white painting, indicating a section of the gallery.\n[90-120s] - A blue sign labeled \"STUDIO 518\" is mounted on a white wall, indicating an exhibition space.  \n- A series of abstract and stylized artworks, including a vibrant blue-purple swirl, a red radial burst, and a red cityscape with white cutouts, are displayed in a row.  \n- The camera pans right, revealing additional pieces: a black-and-white abstract figure, a colorful figure with yellow rays, and a red canvas with green tree-like forms.\n[120-150s] - A large circular artwork with white and brown textured elements is mounted on the wall, adjacent to smaller circular pieces with white floral-like embellishments.  \n- Two framed artworks, one blue and one beige with textured surfaces, are displayed side by side on the wall.  \n- A framed painting depicting a figure on horseback in a landscape is visible to the right of the textured artworks.\n[150-180s] - A framed abstract painting with blue, yellow, and purple hues is displayed on a white wall, featuring a signature at the bottom right.  \n- A large, detailed portrait of a white horse with a bridle is mounted on the wall, positioned to the right of the abstract painting.  \n- A series of three circular, textured sculptures are arranged vertically in recessed white display cases, each with a distinct color border (red, blue, and black) and varying surface textures.\n[180-210s] - A textured, brownish, raised relief sculpture is displayed in a clear acrylic case, positioned against a white wall.  \n- Adjacent to it, a circular, off-white, textured artwork is mounted on a red background within a dark frame.  \n- The camera pans right, revealing a row of framed artworks on white walls, including a colorful, patterned piece with a central owl figure.", "history_tokens": 691, "history_utf8_bytes": 3088, "recent_frame_times_s": [192.01569010416668, 193.01569010416668, 194.01569010416668, 195.01569010416668, 196.01569010416668, 197.01569010416668, 198.01569010416668, 199.01569010416668, 200.01569010416668, 201.01569010416668, 202.01569010416668, 203.01569010416668, 204.01569010416668, 205.01569010416668, 206.01569010416668, 207.01569010416668, 208.01569010416668, 209.01569010416668, 210.01569010416668, 211.01569010416668, 212.01569010416668, 213.01569010416668, 214.01569010416668, 215.01569010416668, 216.01569010416668, 217.01569010416668, 218.01569010416668, 219.01569010416668, 220.01569010416668, 221.01569010416668], "recent_frames_sha256": "7649344eda1f12f45b243de636d8827b42dd0e6ac6db32cf9aaf02946a4cfb62", "num_recent_frames": 30, "tq": 717348.344742338, "t1": 717354.611577407, "ta": 717354.611577407, "te": 717354.907406571, "first_response_s": 6.266835068934597, "answer_total_s": 6.562664232915267, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 480, "content_group": "4af8405453752765de6da4ec0a718e7c09ba8824f4f4502d653b33c6fc96522e", "question": {"question_id": "sample_480_a2124_q0", "video_id": 480, "video_path": "./videos/sample_480_real.mp4", "annotation_index": 2124, "question_index": 0, "question": "What is a common feature in the artworks by SungTae Kim?", "options": ["A. Bright colors and abstract shapes.", "B. Surreal pencil constructions.", "C. Ornate crowns.", "D. Reflective surfaces with water."], "answer": "B", "time_stamp_s": 457, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "art_show", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_480_a2124_q0", "video_id": 480, "time_stamp_s": 457, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "67cf6eed617d0f1062c3c487f8a118537fb1a8e97c2ac5057b0834d3756e621a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [427.01569010416665, 428.01569010416665, 429.01569010416665, 430.01569010416665, 431.01569010416665, 432.01569010416665, 433.01569010416665, 434.01569010416665, 435.01569010416665, 436.01569010416665, 437.01569010416665, 438.01569010416665, 439.01569010416665, 440.01569010416665, 441.01569010416665, 442.01569010416665, 443.01569010416665, 444.01569010416665, 445.01569010416665, 446.01569010416665, 447.01569010416665, 448.01569010416665, 449.01569010416665, 450.01569010416665, 451.01569010416665, 452.01569010416665, 453.01569010416665, 454.01569010416665, 455.01569010416665, 456.01569010416665], "recent_frames_sha256": "2990ae003c6fd7dc4ddb120b814354a0242ea9690c59672dff81f66746fe6078", "num_recent_frames": 30, "tq": 717243.563565811, "t1": 717255.358890924, "ta": 717255.358890924, "te": 717255.39610456, "first_response_s": 11.79532511299476, "answer_total_s": 11.832538748974912, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_480_a2124_q0", "video_id": 480, "time_stamp_s": 457, "ground_truth": "B", "raw_output": "A. Bright colors and abstract shapes.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "c7d9ef61763df21817cf46a53dce00144e00ebb104f7351bf42347a31c12c2a8", "condition_order": ["recent", "notes"], "memory": "[120-150s] - A large circular artwork with white and brown textured elements is mounted on the wall, adjacent to smaller circular pieces with white floral-like embellishments.  \n- Two framed artworks, one blue and one beige with textured surfaces, are displayed side by side on the wall.  \n- A framed painting depicting a figure on horseback in a landscape is visible to the right of the textured artworks.\n[150-180s] - A framed abstract painting with blue, yellow, and purple hues is displayed on a white wall, featuring a signature at the bottom right.  \n- A large, detailed portrait of a white horse with a bridle is mounted on the wall, positioned to the right of the abstract painting.  \n- A series of three circular, textured sculptures are arranged vertically in recessed white display cases, each with a distinct color border (red, blue, and black) and varying surface textures.\n[180-210s] - A textured, brownish, raised relief sculpture is displayed in a clear acrylic case, positioned against a white wall.  \n- Adjacent to it, a circular, off-white, textured artwork is mounted on a red background within a dark frame.  \n- The camera pans right, revealing a row of framed artworks on white walls, including a colorful, patterned piece with a central owl figure.\n[210-240s] - A large abstract painting with black background and colorful splatters dominates the wall, positioned to the right of two smaller framed artworks.  \n- A circular, vibrant, multicolored abstract piece hangs above a vertical striped canvas on the same wall.  \n- A person in a dark coat walks past the artworks, moving from left to right across the frame.\n[240-270s] - A woman in a beige coat gestures toward a large X-ray-style artwork depicting a human skeleton with wings.  \n- A neon sculpture with swirling pink, blue, and green lights is mounted on a wall to the right of the X-ray piece.  \n- The camera pans right, revealing a series of abstract paintings in a grid and a large textured purple artwork to the far right.\n[270-300s] - A large, abstract painting with vibrant blues, purples, and whites dominates the wall, featuring dynamic brushstrokes and layered textures.  \n- A metallic, silver-colored sculpture of a seated figure is displayed on a white pedestal, positioned near a projection screen showing a colorful abstract image.  \n- The gallery space includes other artworks, such as a framed painting of a woman in a red dress and a large, colorful mural with geometric and organic patterns.\n[300-330s] - A large abstract painting with yellow and black strokes dominates the left wall, adjacent to a blue and white abstract piece.  \n- The camera pans right, revealing a group of visitors walking through the gallery space, with a blue wall bearing the \"Citi\" logo visible on the right.  \n- A sign labeled \"SILVER MOUNTAIN GALLERY 513\" is mounted on a white wall, indicating the gallery's name and number.\n[330-360s] - A large framed black-and-white floral artwork is centered on the wall, with a smaller similar piece to its right.\n- The camera pans right, revealing a series of three vertical botanical artworks depicting leaves and stems.\n- A dark, smooth-faced sculpture appears in the foreground, positioned near the right edge of the frame.\n[360-390s] - A black matte bust sculpture is displayed on a white pedestal, facing forward with a neutral expression.\n- To its right, a wall-mounted installation of numerous small, leaf-shaped objects arranged in a radial pattern.\n- The camera pans to reveal a large, abstract, beige and blue draped sculpture on another pedestal, positioned between two framed botanical prints.\n[390-420s] - A brown textured artwork with purple abstract shapes is mounted on a white wall, labeled \"Park, Chul\" beneath it.\n- To its right, a grid of four colorful, textured panels (red, yellow, green, blue) is displayed, with \"Jeong, Mi Ha\" labeled below.\n- Further right, a framed painting of a mountainous landscape with green grass and white peaks is labeled \"Lee, HyangNam,\" positioned below a window-like frame containing a blue sky scene.\n[420-450s] - Artwork labeled \"Kim, Jin Sook\" features abstract, textured pieces with vibrant color gradients.\n- \"Song, Kyung\" displays serene water lily paintings with reflective surfaces and naturalistic tones.\n- \"Shin, Ye Jin\" presents framed artworks including a golden crown on pink background and a green circular piece with intricate patterns.", "history_tokens": 999, "history_utf8_bytes": 4421, "recent_frame_times_s": [427.01569010416665, 428.01569010416665, 429.01569010416665, 430.01569010416665, 431.01569010416665, 432.01569010416665, 433.01569010416665, 434.01569010416665, 435.01569010416665, 436.01569010416665, 437.01569010416665, 438.01569010416665, 439.01569010416665, 440.01569010416665, 441.01569010416665, 442.01569010416665, 443.01569010416665, 444.01569010416665, 445.01569010416665, 446.01569010416665, 447.01569010416665, 448.01569010416665, 449.01569010416665, 450.01569010416665, 451.01569010416665, 452.01569010416665, 453.01569010416665, 454.01569010416665, 455.01569010416665, 456.01569010416665], "recent_frames_sha256": "2990ae003c6fd7dc4ddb120b814354a0242ea9690c59672dff81f66746fe6078", "num_recent_frames": 30, "tq": 717408.931128647, "t1": 717415.225259062, "ta": 717415.225259062, "te": 717415.5209789, "first_response_s": 6.294130415073596, "answer_total_s": 6.589850253076293, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 480, "content_group": "4af8405453752765de6da4ec0a718e7c09ba8824f4f4502d653b33c6fc96522e", "question": {"question_id": "sample_480_a2125_q0", "video_id": 480, "video_path": "./videos/sample_480_real.mp4", "annotation_index": 2125, "question_index": 0, "question": "What is the main theme depicted in the painting just now?", "options": ["A. A cityscape with zebras.", "B. A giraffe family under a tree.", "C. An urban skyline at night.", "D. Animals in a forest."], "answer": "B", "time_stamp_s": 675, "task_type": "Attribute Recognition", "required_ability": "episodic memory", "video_category": "art_show", "reference_interval_s": [660, 720], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_480_a2125_q0", "video_id": 480, "time_stamp_s": 675, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "731abf41d944c8d14f4f90dca064a2bdd0b961a70ddf576004a803da52d348c0", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [645.0156901041667, 646.0156901041667, 647.0156901041667, 648.0156901041667, 649.0156901041667, 650.0156901041667, 651.0156901041667, 652.0156901041667, 653.0156901041667, 654.0156901041667, 655.0156901041667, 656.0156901041667, 657.0156901041667, 658.0156901041667, 659.0156901041667, 660.0156901041667, 661.0156901041667, 662.0156901041667, 663.0156901041667, 664.0156901041667, 665.0156901041667, 666.0156901041667, 667.0156901041667, 668.0156901041667, 669.0156901041667, 670.0156901041667, 671.0156901041667, 672.0156901041667, 673.0156901041667, 674.0156901041667], "recent_frames_sha256": "1951cc88b5aae0fbdaca7a9da62b9ecac1a93e991e000c6c9cd408f98598e552", "num_recent_frames": 30, "tq": 717255.410741328, "t1": 717270.477955794, "ta": 717270.477955794, "te": 717270.515374649, "first_response_s": 15.06721446593292, "answer_total_s": 15.104633320937864, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_480_a2125_q0", "video_id": 480, "time_stamp_s": 675, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "f9d89b06565ba459c87da1bac42ad52b966964461fb04f5346b14ddaa8b9c1f8", "condition_order": ["recent", "notes"], "memory": "[330-360s] - A large framed black-and-white floral artwork is centered on the wall, with a smaller similar piece to its right.\n- The camera pans right, revealing a series of three vertical botanical artworks depicting leaves and stems.\n- A dark, smooth-faced sculpture appears in the foreground, positioned near the right edge of the frame.\n[360-390s] - A black matte bust sculpture is displayed on a white pedestal, facing forward with a neutral expression.\n- To its right, a wall-mounted installation of numerous small, leaf-shaped objects arranged in a radial pattern.\n- The camera pans to reveal a large, abstract, beige and blue draped sculpture on another pedestal, positioned between two framed botanical prints.\n[390-420s] - A brown textured artwork with purple abstract shapes is mounted on a white wall, labeled \"Park, Chul\" beneath it.\n- To its right, a grid of four colorful, textured panels (red, yellow, green, blue) is displayed, with \"Jeong, Mi Ha\" labeled below.\n- Further right, a framed painting of a mountainous landscape with green grass and white peaks is labeled \"Lee, HyangNam,\" positioned below a window-like frame containing a blue sky scene.\n[420-450s] - Artwork labeled \"Kim, Jin Sook\" features abstract, textured pieces with vibrant color gradients.\n- \"Song, Kyung\" displays serene water lily paintings with reflective surfaces and naturalistic tones.\n- \"Shin, Ye Jin\" presents framed artworks including a golden crown on pink background and a green circular piece with intricate patterns.\n[450-480s] - A man in a blue suit gestures toward a wall of framed artworks, including a large black-and-white piece of a floating castle.  \n- The camera pans to reveal a colorful mural of a man in a uniform, surrounded by yellow and black patterns, next to a Mickey Mouse-themed artwork.  \n- A blue sign reading \"508\" is visible above the artworks, indicating an exhibit or gallery section number.\n[480-510s] - A framed \"Good Energy\" sign with a lightning bolt design is mounted on the wall, positioned above a large Buddha portrait.  \n- The Buddha portrait features green and orange hues with white butterflies scattered around it.  \n- To the right of the Buddha, a colorful painting of a swan and another abstract artwork are displayed on the same wall.\n[510-540s] - A black bronze sculpture of a bear in a dynamic, crouching pose is displayed on a pedestal near the center of the room.  \n- The wall behind the sculpture features a collection of colorful abstract and landscape paintings, including a prominent red and blue abstract piece.  \n- A blue sign labeled \"EXCLUSIVE FIRE ART 504\" is mounted on the ceiling above the artwork, indicating a specific gallery or exhibit section.\n[540-570s] - A large, textured painting of a forest with blue and green tones dominates the wall, flanked by other artworks.  \n- Below, a grid of smaller, colorful paintings depicting various scenes, including landscapes and abstract designs, is displayed.  \n- A sign reading \"Pollock's Paradigm An Educational Exhibition\" is visible, indicating the exhibit's theme and purpose.\n[570-600s] - A large abstract painting with splattered colors dominates the wall, framed and mounted above smaller pieces.  \n- The wall displays the \"Wyoming Working Group\" logo and website, indicating the art group's affiliation.  \n- A sign reading \"509\" is visible on the ceiling, likely denoting the booth or gallery number.\n[600-630s] - Four framed artworks by Kim Bong-sung (1988) are displayed, featuring abstract floral designs with green and red petals on textured backgrounds.  \n- Below the artworks, a descriptive plaque identifies the artist and provides context about the piece.  \n- The camera pans right, revealing adjacent artworks by Cho Youngman (1988), including a large floral arrangement in a blue vase and a smaller piece with a red flower in a patterned vase.\n[630-660s] - A framed digital artwork titled \"Jung Nam-Il\" depicting a blue aquatic scene with a boat and greenery is displayed on a white wall.  \n- Adjacent to it, a series of colorful, stylized portraits of children with vibrant patterns and accessories are arranged in a grid.  \n- Further along the wall, two red-framed artworks featuring whales against a red sky are mounted, followed by a horizontal series of four portraits of children with elaborate attire and accessories.", "history_tokens": 986, "history_utf8_bytes": 4346, "recent_frame_times_s": [645.0156901041667, 646.0156901041667, 647.0156901041667, 648.0156901041667, 649.0156901041667, 650.0156901041667, 651.0156901041667, 652.0156901041667, 653.0156901041667, 654.0156901041667, 655.0156901041667, 656.0156901041667, 657.0156901041667, 658.0156901041667, 659.0156901041667, 660.0156901041667, 661.0156901041667, 662.0156901041667, 663.0156901041667, 664.0156901041667, 665.0156901041667, 666.0156901041667, 667.0156901041667, 668.0156901041667, 669.0156901041667, 670.0156901041667, 671.0156901041667, 672.0156901041667, 673.0156901041667, 674.0156901041667], "recent_frames_sha256": "1951cc88b5aae0fbdaca7a9da62b9ecac1a93e991e000c6c9cd408f98598e552", "num_recent_frames": 30, "tq": 717466.968046188, "t1": 717473.818218029, "ta": 717473.818218029, "te": 717474.126979942, "first_response_s": 6.850171840982512, "answer_total_s": 7.1589337539626285, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 481, "content_group": "1dafb2d598a146273f8bf5398493bc069cd78e7ecfbd69e8ed70bbaf946d2c10", "question": {"question_id": "sample_481_a193_q0", "video_id": 481, "video_path": "./videos/sample_481_real.mp4", "annotation_index": 193, "question_index": 0, "question": "What color is the car parked near the Diner right now?", "options": ["A. Blue.", "B. Red.", "C. Yellow.", "D. Pink."], "answer": "D", "time_stamp_s": 4, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [0, 5], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_481_a193_q0", "video_id": 481, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e2102f8ec8fd7e56e0b1bda7212acaf3724f18e4b90da920414a069c092a33a8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0], "recent_frames_sha256": "c82b75ef7406c5a99dc9a21961c5d089a388583c7d0c77bf2e651edbc75ad325", "num_recent_frames": 5, "tq": 710235.25178116, "t1": 710246.444775297, "ta": 710246.444775297, "te": 710246.515528338, "first_response_s": 11.192994136945345, "answer_total_s": 11.263747178018093, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_481_a193_q0", "video_id": 481, "time_stamp_s": 4, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "119b53781ad5fdf90e334ab899610f8d84d7983275bc34c86af3c70e41a2b24b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0], "recent_frames_sha256": "c82b75ef7406c5a99dc9a21961c5d089a388583c7d0c77bf2e651edbc75ad325", "num_recent_frames": 5, "tq": 710284.527863848, "t1": 710291.251893003, "ta": 710291.251893003, "te": 710291.451039305, "first_response_s": 6.724029154982418, "answer_total_s": 6.923175456933677, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 481, "content_group": "1dafb2d598a146273f8bf5398493bc069cd78e7ecfbd69e8ed70bbaf946d2c10", "question": {"question_id": "sample_481_a194_q0", "video_id": 481, "video_path": "./videos/sample_481_real.mp4", "annotation_index": 194, "question_index": 0, "question": "What object is the track passing under right now?", "options": ["A. A chair.", "B. A table.", "C. A bed.", "D. A couch."], "answer": "C", "time_stamp_s": 48, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [45, 50], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_481_a194_q0", "video_id": 481, "time_stamp_s": 48, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "22ecd39f9172a0abf41d1258716c17bf8041a5702ff335a32997adbe91d9febd", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0, 27.0, 28.0, 29.0, 30.0, 31.0, 32.0, 33.0, 34.0, 35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0], "recent_frames_sha256": "2aa9bbbd61e4bd42e4ae14230d4f174056e25c278271b16f61f3d302edb6be37", "num_recent_frames": 30, "tq": 710246.556050445, "t1": 710253.673043745, "ta": 710253.673043745, "te": 710253.711404037, "first_response_s": 7.116993300034665, "answer_total_s": 7.155353592010215, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_481_a194_q0", "video_id": 481, "time_stamp_s": 48, "ground_truth": "C", "raw_output": "C. A bed.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "dc1ae0f4b66997b516ae198d9f783687b1a61e8e34d4a39ebc9091aa00a43525", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A LEGO train track system runs through a room with various LEGO buildings and vehicles, including a pink car and a white bus, positioned along the track.\n- The camera pans across the scene, revealing different sections of the track, including a curved path near a wooden cabinet and a long straight section leading to a bridge structure.\n- A text overlay appears at the end, reading \"PLEASE LIKE AND SUBSCRIBE,\" indicating a call to action for viewers.", "history_tokens": 97, "history_utf8_bytes": 462, "recent_frame_times_s": [19.0, 20.0, 21.0, 22.0, 23.0, 24.0, 25.0, 26.0, 27.0, 28.0, 29.0, 30.0, 31.0, 32.0, 33.0, 34.0, 35.0, 36.0, 37.0, 38.0, 39.0, 40.0, 41.0, 42.0, 43.0, 44.0, 45.0, 46.0, 47.0, 48.0], "recent_frames_sha256": "2aa9bbbd61e4bd42e4ae14230d4f174056e25c278271b16f61f3d302edb6be37", "num_recent_frames": 30, "tq": 710303.053248304, "t1": 710315.369030264, "ta": 710315.369030264, "te": 710315.559540493, "first_response_s": 12.315781960031018, "answer_total_s": 12.506292189005762, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 481, "content_group": "1dafb2d598a146273f8bf5398493bc069cd78e7ecfbd69e8ed70bbaf946d2c10", "question": {"question_id": "sample_481_a195_q0", "video_id": 481, "video_path": "./videos/sample_481_real.mp4", "annotation_index": 195, "question_index": 0, "question": "What color is the car on top of the cabinet right now?", "options": ["A. Red.", "B. Blue.", "C. Green.", "D. Yellow."], "answer": "B", "time_stamp_s": 90, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [90, 95], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_481_a195_q0", "video_id": 481, "time_stamp_s": 90, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "79fa01145678d9589040699d1628a1adc320c1ef3aa7c0414445d8cdfb0e3999", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0], "recent_frames_sha256": "07f3dc473ed8f266db3d38f289038615bb9b8b536218b27e9c1e1f23ec467508", "num_recent_frames": 30, "tq": 710253.725916107, "t1": 710260.612368492, "ta": 710260.612368492, "te": 710260.649826804, "first_response_s": 6.886452384991571, "answer_total_s": 6.923910696990788, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_481_a195_q0", "video_id": 481, "time_stamp_s": 90, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4486abd44692c36316c51ca73339a29204eecca735fd5b037d7af3d10560b079", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A LEGO train track system runs through a room with various LEGO buildings and vehicles, including a pink car and a white bus, positioned along the track.\n- The camera pans across the scene, revealing different sections of the track, including a curved path near a wooden cabinet and a long straight section leading to a bridge structure.\n- A text overlay appears at the end, reading \"PLEASE LIKE AND SUBSCRIBE,\" indicating a call to action for viewers.\n[30-60s] - LEGO train moves along tracks under a bed, passing a dresser and wall.\n- Train passes a large LEGO Ferris wheel structure with colorful gondolas.\n- Tracks curve and transition through various indoor room settings.\n[60-90s] - Train tracks extend through a room with a red bridge structure overhead, featuring white suspension cables.  \n- A toy train moves along the tracks, passing under the bridge and continuing toward a station area with miniature buildings.  \n- The camera angle shifts to show the train approaching a curved section near a bed, with the tracks curving around the room’s perimeter.", "history_tokens": 228, "history_utf8_bytes": 1076, "recent_frame_times_s": [61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0], "recent_frames_sha256": "07f3dc473ed8f266db3d38f289038615bb9b8b536218b27e9c1e1f23ec467508", "num_recent_frames": 30, "tq": 710331.298422097, "t1": 710342.448997139, "ta": 710342.448997139, "te": 710342.852057736, "first_response_s": 11.150575042003766, "answer_total_s": 11.553635639022104, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 481, "content_group": "1dafb2d598a146273f8bf5398493bc069cd78e7ecfbd69e8ed70bbaf946d2c10", "question": {"question_id": "sample_481_a196_q0", "video_id": 481, "video_path": "./videos/sample_481_real.mp4", "annotation_index": 196, "question_index": 0, "question": "What object is the track curving around right now?", "options": ["A. A couch.", "B. A table.", "C. A sofa.", "D. A window."], "answer": "C", "time_stamp_s": 139, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [135, 140], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_481_a196_q0", "video_id": 481, "time_stamp_s": 139, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "061f6ad3ae0c2054082efd8f3fdefe67fa46c498cf1598f3c2fd318e4fb9afdb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0], "recent_frames_sha256": "7157b4a08af6ad2a256fa71723083c8240f4aa1b79aaecb60007bc4bef30182a", "num_recent_frames": 30, "tq": 710260.659982281, "t1": 710272.898016295, "ta": 710272.898016295, "te": 710272.935181946, "first_response_s": 12.238034014008008, "answer_total_s": 12.275199664989486, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_481_a196_q0", "video_id": 481, "time_stamp_s": 139, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "7d79d89718d6042addd05645a2dca04bf5bf39796a22e231ad5289ffc2ef8080", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A LEGO train track system runs through a room with various LEGO buildings and vehicles, including a pink car and a white bus, positioned along the track.\n- The camera pans across the scene, revealing different sections of the track, including a curved path near a wooden cabinet and a long straight section leading to a bridge structure.\n- A text overlay appears at the end, reading \"PLEASE LIKE AND SUBSCRIBE,\" indicating a call to action for viewers.\n[30-60s] - LEGO train moves along tracks under a bed, passing a dresser and wall.\n- Train passes a large LEGO Ferris wheel structure with colorful gondolas.\n- Tracks curve and transition through various indoor room settings.\n[60-90s] - Train tracks extend through a room with a red bridge structure overhead, featuring white suspension cables.  \n- A toy train moves along the tracks, passing under the bridge and continuing toward a station area with miniature buildings.  \n- The camera angle shifts to show the train approaching a curved section near a bed, with the tracks curving around the room’s perimeter.\n[90-120s] - LEGO train tracks extend through a room, passing under a staircase and near wooden cabinets.\n- A red LEGO structure appears ahead on the tracks, possibly a station or bridge, with a train approaching.\n- The camera moves forward along the tracks, revealing more of the room’s layout, including a doorway and furniture.", "history_tokens": 300, "history_utf8_bytes": 1408, "recent_frame_times_s": [110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0, 131.0, 132.0, 133.0, 134.0, 135.0, 136.0, 137.0, 138.0, 139.0], "recent_frames_sha256": "7157b4a08af6ad2a256fa71723083c8240f4aa1b79aaecb60007bc4bef30182a", "num_recent_frames": 30, "tq": 710352.424412028, "t1": 710354.510104545, "ta": 710354.510104545, "te": 710354.771616787, "first_response_s": 2.0856925169937313, "answer_total_s": 2.3472047589020804, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 481, "content_group": "1dafb2d598a146273f8bf5398493bc069cd78e7ecfbd69e8ed70bbaf946d2c10", "question": {"question_id": "sample_481_a197_q0", "video_id": 481, "video_path": "./videos/sample_481_real.mp4", "annotation_index": 197, "question_index": 0, "question": "What is the color of the walls near the track right now?", "options": ["A. White.", "B. Beige.", "C. Blue.", "D. Green."], "answer": "B", "time_stamp_s": 180, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "driving", "reference_interval_s": [180, 185], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_481_a197_q0", "video_id": 481, "time_stamp_s": 180, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "49336833aff8c7b09059bdf182d989a97da732311d8eb630b8203180e0096895", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "00f2e853f3bec024bea731e4c3cb1bef2bbc9d8308470cbc425e7dbb0f147022", "num_recent_frames": 30, "tq": 710272.941233085, "t1": 710284.484144745, "ta": 710284.484144745, "te": 710284.521536484, "first_response_s": 11.542911660042591, "answer_total_s": 11.580303399008699, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_481_a197_q0", "video_id": 481, "time_stamp_s": 180, "ground_truth": "B", "raw_output": "C. Blue.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "3740b1c312441803217138e808f564f8d68af77a00135d8a1331812f47b27c7e", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A LEGO train track system runs through a room with various LEGO buildings and vehicles, including a pink car and a white bus, positioned along the track.\n- The camera pans across the scene, revealing different sections of the track, including a curved path near a wooden cabinet and a long straight section leading to a bridge structure.\n- A text overlay appears at the end, reading \"PLEASE LIKE AND SUBSCRIBE,\" indicating a call to action for viewers.\n[30-60s] - LEGO train moves along tracks under a bed, passing a dresser and wall.\n- Train passes a large LEGO Ferris wheel structure with colorful gondolas.\n- Tracks curve and transition through various indoor room settings.\n[60-90s] - Train tracks extend through a room with a red bridge structure overhead, featuring white suspension cables.  \n- A toy train moves along the tracks, passing under the bridge and continuing toward a station area with miniature buildings.  \n- The camera angle shifts to show the train approaching a curved section near a bed, with the tracks curving around the room’s perimeter.\n[90-120s] - LEGO train tracks extend through a room, passing under a staircase and near wooden cabinets.\n- A red LEGO structure appears ahead on the tracks, possibly a station or bridge, with a train approaching.\n- The camera moves forward along the tracks, revealing more of the room’s layout, including a doorway and furniture.\n[120-150s] - Train tracks curve under furniture legs, leading toward a doorway with a visible guitar stand nearby.  \n- A train engine moves along the tracks, passing a green train car and approaching a door at the end of the layout.  \n- The camera follows the train’s path, showing a transition from carpeted floor to a hallway with a staircase and a door.\n[150-180s] - A red toy train moves along a black track laid on carpet, passing under a bed and near a dresser.  \n- The train’s path curves around a room with blue walls, windows, and a white door, passing a red toy structure.  \n- A person in a green shirt is seen in the background, standing near a staircase with a railing.", "history_tokens": 464, "history_utf8_bytes": 2094, "recent_frame_times_s": [151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0], "recent_frames_sha256": "00f2e853f3bec024bea731e4c3cb1bef2bbc9d8308470cbc425e7dbb0f147022", "num_recent_frames": 30, "tq": 710371.521580775, "t1": 710372.735037934, "ta": 710372.735037934, "te": 710372.88997889, "first_response_s": 1.2134571589995176, "answer_total_s": 1.3683981149224564, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 482, "content_group": "c5f3bd7be9305b7e8a16e807fdf17dc78afb5a230d5ac778a40493bcaebdce83", "question": {"question_id": "sample_482_a110_q0", "video_id": 482, "video_path": "./videos/sample_482_real.mp4", "annotation_index": 110, "question_index": 0, "question": "Which RC car leads the race initially?", "options": ["A. White car.", "B. Green car.", "C. Red car.", "D. Black car."], "answer": "C", "time_stamp_s": 2, "task_type": "Attribute Recognition", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_482_a110_q0", "video_id": 482, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ec259144623bfe1149d9baeb0cf856f62d9d54e623e50ca14a269214ba736b52", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001], "recent_frames_sha256": "47aa0d96f0b835ea0ef8428aea058ce278ad5a55ab0c0ea6588c0fd6ead94b53", "num_recent_frames": 2, "tq": 710220.083174186, "t1": 710221.362050748, "ta": 710221.362050748, "te": 710221.402792724, "first_response_s": 1.2788765620207414, "answer_total_s": 1.3196185380220413, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_482_a110_q0", "video_id": 482, "time_stamp_s": 2, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7454943cd73eb2c3a59954e16010b9c0d37acd378c7a83ed14f80ee85477fdc1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001], "recent_frames_sha256": "47aa0d96f0b835ea0ef8428aea058ce278ad5a55ab0c0ea6588c0fd6ead94b53", "num_recent_frames": 2, "tq": 710253.722066674, "t1": 710260.01909596, "ta": 710260.01909596, "te": 710260.057784677, "first_response_s": 6.297029285924509, "answer_total_s": 6.335718002985232, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 482, "content_group": "c5f3bd7be9305b7e8a16e807fdf17dc78afb5a230d5ac778a40493bcaebdce83", "question": {"question_id": "sample_482_a111_q0", "video_id": 482, "video_path": "./videos/sample_482_real.mp4", "annotation_index": 111, "question_index": 0, "question": "What abnormal event just happened?", "options": ["A. A white racing car crashed into the obstacle beside the track.", "B. A blue racing car lost control and crashed into the barrier at the curve of the track.", "C. A red racing car skidded on the wet surface and collided with the guardrail on the straightaway.", "D. A yellow racing car spun out and hit the tire wall at the chicane."], "answer": "A", "time_stamp_s": 92, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_482_a111_q0", "video_id": 482, "time_stamp_s": 92, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3be3a9d82e9a02a2e4cee7f2577b3a9258ed8e0893b2732935e135454ca2ff62", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [62.01195, 63.01295, 64.01395, 65.01495, 66.01595, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333], "recent_frames_sha256": "eeea2cbe735a421b9e298e107299fe00f4e42226cbdc8f01aa970d083b6be93b", "num_recent_frames": 30, "tq": 710221.450205695, "t1": 710229.033619576, "ta": 710229.033619576, "te": 710229.073084919, "first_response_s": 7.583413881016895, "answer_total_s": 7.6228792240144685, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_482_a111_q0", "video_id": 482, "time_stamp_s": 92, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0e3ea15e9895e8b60664e56a5310839ac2a3217690218798d7b504d39b8efbfe", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Multiple RC cars race on a track with red and white barriers, some colliding or spinning out.  \n- Spectators and event staff are visible around the track, with banners like \"ZILKER\" and \"RC RC RC\" displayed.  \n- The track layout includes turns, straightaways, and obstacles, with cars navigating through them at varying speeds.\n[30-60s] - Green RC cars drift aggressively around a curved track, with one car overtaking another near the apex.  \n- A line of stationary RC cars, including red, yellow, and pink models, is positioned at the start/finish line, surrounded by orange cones.  \n- Spectators and banners (e.g., \"UD DRIFTING\") are visible behind barriers, indicating a live event setting.\n[60-90s] - White RC car with \"BDD\" branding navigates a turn, narrowly avoiding orange barriers.  \n- Orange confetti piles are scattered along the track’s edge, indicating a recent or ongoing event.  \n- The car’s trajectory suggests it is actively racing, with visible motion blur indicating speed.", "history_tokens": 236, "history_utf8_bytes": 1007, "recent_frame_times_s": [62.01195, 63.01295, 64.01395, 65.01495, 66.01595, 67.00026666666666, 68.00126666666667, 69.00226666666667, 70.00326666666666, 71.00426666666667, 72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333], "recent_frames_sha256": "eeea2cbe735a421b9e298e107299fe00f4e42226cbdc8f01aa970d083b6be93b", "num_recent_frames": 30, "tq": 710289.482763403, "t1": 710298.094722147, "ta": 710298.094722147, "te": 710298.131793145, "first_response_s": 8.611958744004369, "answer_total_s": 8.649029741995037, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 482, "content_group": "c5f3bd7be9305b7e8a16e807fdf17dc78afb5a230d5ac778a40493bcaebdce83", "question": {"question_id": "sample_482_a112_q0", "video_id": 482, "video_path": "./videos/sample_482_real.mp4", "annotation_index": 112, "question_index": 0, "question": "What unusual event just happened?", "options": ["A. A red and white car skidded and slammed into the blue barrier at the edge of the circuit.", "B. A green and silver car lost control and collided with the yellow obstacle beside the straight track.", "C. A blue and orange car spun out and crashed into the red barrier near the corner.", "D. A black and gold car crashed into the orange obstacle on the side of the track after drifting."], "answer": "D", "time_stamp_s": 134, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_482_a112_q0", "video_id": 482, "time_stamp_s": 134, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a0b469be3a832ce820bb3360a35baf1fb0a691453f6bc2b2c3d8b61e9142b037", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668], "recent_frames_sha256": "97587de987b7053dc3d748f94467f6d2fdba7f680a8505fbf16a6fc94d10d5b8", "num_recent_frames": 30, "tq": 710229.091989147, "t1": 710235.191555613, "ta": 710235.191555613, "te": 710235.23045464, "first_response_s": 6.099566465942189, "answer_total_s": 6.138465492986143, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_482_a112_q0", "video_id": 482, "time_stamp_s": 134, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6cf956518be701f30dccfebbf1b26aba29fafb81ce2e6a831477dab85c278a87", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Multiple RC cars race on a track with red and white barriers, some colliding or spinning out.  \n- Spectators and event staff are visible around the track, with banners like \"ZILKER\" and \"RC RC RC\" displayed.  \n- The track layout includes turns, straightaways, and obstacles, with cars navigating through them at varying speeds.\n[30-60s] - Green RC cars drift aggressively around a curved track, with one car overtaking another near the apex.  \n- A line of stationary RC cars, including red, yellow, and pink models, is positioned at the start/finish line, surrounded by orange cones.  \n- Spectators and banners (e.g., \"UD DRIFTING\") are visible behind barriers, indicating a live event setting.\n[60-90s] - White RC car with \"BDD\" branding navigates a turn, narrowly avoiding orange barriers.  \n- Orange confetti piles are scattered along the track’s edge, indicating a recent or ongoing event.  \n- The car’s trajectory suggests it is actively racing, with visible motion blur indicating speed.\n[90-120s] - White \"DDP\" car drifts past orange barriers while another white car follows closely behind.\n- Red car with black stripes overtakes a dark red car on a curved track section.\n- Multiple cars, including red and purple models, navigate a complex track layout with orange cones and white markings.", "history_tokens": 305, "history_utf8_bytes": 1312, "recent_frame_times_s": [104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667, 120.00321666666666, 121.00421666666666, 122.00521666666667, 123.00621666666666, 124.00721666666666, 125.00821666666667, 126.00921666666666, 127.01021666666666, 128.01121666666666, 129.01221666666666, 130.01321666666666, 131.01421666666667, 132.01521666666667, 133.01621666666668], "recent_frames_sha256": "97587de987b7053dc3d748f94467f6d2fdba7f680a8505fbf16a6fc94d10d5b8", "num_recent_frames": 30, "tq": 710308.502156847, "t1": 710315.369030264, "ta": 710315.369030264, "te": 710315.559540493, "first_response_s": 6.866873416933231, "answer_total_s": 7.057383645907976, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 482, "content_group": "c5f3bd7be9305b7e8a16e807fdf17dc78afb5a230d5ac778a40493bcaebdce83", "question": {"question_id": "sample_482_a113_q0", "video_id": 482, "video_path": "./videos/sample_482_real.mp4", "annotation_index": 113, "question_index": 0, "question": "What is the main color of the remote-controlled police car?", "options": ["A. Black.", "B. White.", "C. Blue.", "D. Red."], "answer": "A", "time_stamp_s": 242, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_482_a113_q0", "video_id": 482, "time_stamp_s": 242, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d6bd2e66883c7666c3ed50527db92b467d7bbaa7b7de3c4c97595b273e39df70", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666, 218.00111666666666, 219.00211666666667, 220.00311666666667, 221.00411666666668, 222.00511666666668, 223.00611666666666, 224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332], "recent_frames_sha256": "2b4daebc2a524e8cc61edcb23ac671705f302b7fe6f8bf7ed303385b3ee24d46", "num_recent_frames": 30, "tq": 710235.249983957, "t1": 710246.444775297, "ta": 710246.444775297, "te": 710246.515528338, "first_response_s": 11.194791339919902, "answer_total_s": 11.265544380992651, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_482_a113_q0", "video_id": 482, "time_stamp_s": 242, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "50c3864e7e5c399ec754edeac277310e1a43e7bcd077b8784aceffc445f7b725", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Multiple RC cars race on a track with red and white barriers, some colliding or spinning out.  \n- Spectators and event staff are visible around the track, with banners like \"ZILKER\" and \"RC RC RC\" displayed.  \n- The track layout includes turns, straightaways, and obstacles, with cars navigating through them at varying speeds.\n[30-60s] - Green RC cars drift aggressively around a curved track, with one car overtaking another near the apex.  \n- A line of stationary RC cars, including red, yellow, and pink models, is positioned at the start/finish line, surrounded by orange cones.  \n- Spectators and banners (e.g., \"UD DRIFTING\") are visible behind barriers, indicating a live event setting.\n[60-90s] - White RC car with \"BDD\" branding navigates a turn, narrowly avoiding orange barriers.  \n- Orange confetti piles are scattered along the track’s edge, indicating a recent or ongoing event.  \n- The car’s trajectory suggests it is actively racing, with visible motion blur indicating speed.\n[90-120s] - White \"DDP\" car drifts past orange barriers while another white car follows closely behind.\n- Red car with black stripes overtakes a dark red car on a curved track section.\n- Multiple cars, including red and purple models, navigate a complex track layout with orange cones and white markings.\n[120-150s] - Black RC car with gold rims and a cannabis leaf decal navigates a turn, passing a red-orange debris pile.\n- Red RC car with \"RC\" branding and gold rims is seen in the background, moving along the track.\n- The black car continues its path, approaching a section with orange cones and barriers, while the red car is further ahead.\n[150-180s] - Orange-and-white car (car #1) navigates a turn, colliding with a red barrier, then continues past orange cones.  \n- Red car (car #12) drives past the orange-and-white car, overtaking it on the track.  \n- White-and-orange car (car #1) veers into a corner, narrowly avoiding a red barrier, then continues straight.\n[180-210s] - Orange-and-white RC car navigates a turn, passing a red-and-white barrier while another car follows closely behind.\n- A green RC car overtakes a white RC car on a straight section of the track, with multiple cars visible in the background.\n- A blue RC car enters a turn under an archway marked \"Ultimate Drift,\" while other cars are seen in the distance.\n[210-240s] - A black police car with flashing blue lights navigates a track, overtaking other vehicles.  \n- A green car speeds past a silver sedan on a straight section of the track.  \n- A white car with red wheels drives near a red-and-white barrier, while a silver sedan follows closely behind.", "history_tokens": 638, "history_utf8_bytes": 2645, "recent_frame_times_s": [212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666, 218.00111666666666, 219.00211666666667, 220.00311666666667, 221.00411666666668, 222.00511666666668, 223.00611666666666, 224.00711666666666, 225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332], "recent_frames_sha256": "2b4daebc2a524e8cc61edcb23ac671705f302b7fe6f8bf7ed303385b3ee24d46", "num_recent_frames": 30, "tq": 710347.324878302, "t1": 710354.510104545, "ta": 710354.510104545, "te": 710354.771616787, "first_response_s": 7.185226242989302, "answer_total_s": 7.446738484897651, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 482, "content_group": "c5f3bd7be9305b7e8a16e807fdf17dc78afb5a230d5ac778a40493bcaebdce83", "question": {"question_id": "sample_482_a113_q1", "video_id": 482, "video_path": "./videos/sample_482_real.mp4", "annotation_index": 113, "question_index": 1, "question": "What happens just after the silver car moves ahead of the red car?", "options": ["A. The red car overtakes the silver car again.", "B. Both cars stop racing.", "C. The green car crashes into the silver car.", "D. The red car knocked the silver car off the track."], "answer": "D", "time_stamp_s": 255, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_482_a113_q1", "video_id": 482, "time_stamp_s": 255, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "dd49bc41658208643492d99beffe4983374ff0de8c608b54575c3d4da162a2be", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275, 254.00375], "recent_frames_sha256": "53e7bfba90cb863663d414e8e35827d79172c53c7b4c081d72dd51d5234280ad", "num_recent_frames": 30, "tq": 710246.551910938, "t1": 710253.673043745, "ta": 710253.673043745, "te": 710253.711404037, "first_response_s": 7.121132806991227, "answer_total_s": 7.159493098966777, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_482_a113_q1", "video_id": 482, "time_stamp_s": 255, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f9146a0831b3797ba35e87fb7334ec375a4594840abe9ad8f585f533f39fd350", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Multiple RC cars race on a track with red and white barriers, some colliding or spinning out.  \n- Spectators and event staff are visible around the track, with banners like \"ZILKER\" and \"RC RC RC\" displayed.  \n- The track layout includes turns, straightaways, and obstacles, with cars navigating through them at varying speeds.\n[30-60s] - Green RC cars drift aggressively around a curved track, with one car overtaking another near the apex.  \n- A line of stationary RC cars, including red, yellow, and pink models, is positioned at the start/finish line, surrounded by orange cones.  \n- Spectators and banners (e.g., \"UD DRIFTING\") are visible behind barriers, indicating a live event setting.\n[60-90s] - White RC car with \"BDD\" branding navigates a turn, narrowly avoiding orange barriers.  \n- Orange confetti piles are scattered along the track’s edge, indicating a recent or ongoing event.  \n- The car’s trajectory suggests it is actively racing, with visible motion blur indicating speed.\n[90-120s] - White \"DDP\" car drifts past orange barriers while another white car follows closely behind.\n- Red car with black stripes overtakes a dark red car on a curved track section.\n- Multiple cars, including red and purple models, navigate a complex track layout with orange cones and white markings.\n[120-150s] - Black RC car with gold rims and a cannabis leaf decal navigates a turn, passing a red-orange debris pile.\n- Red RC car with \"RC\" branding and gold rims is seen in the background, moving along the track.\n- The black car continues its path, approaching a section with orange cones and barriers, while the red car is further ahead.\n[150-180s] - Orange-and-white car (car #1) navigates a turn, colliding with a red barrier, then continues past orange cones.  \n- Red car (car #12) drives past the orange-and-white car, overtaking it on the track.  \n- White-and-orange car (car #1) veers into a corner, narrowly avoiding a red barrier, then continues straight.\n[180-210s] - Orange-and-white RC car navigates a turn, passing a red-and-white barrier while another car follows closely behind.\n- A green RC car overtakes a white RC car on a straight section of the track, with multiple cars visible in the background.\n- A blue RC car enters a turn under an archway marked \"Ultimate Drift,\" while other cars are seen in the distance.\n[210-240s] - A black police car with flashing blue lights navigates a track, overtaking other vehicles.  \n- A green car speeds past a silver sedan on a straight section of the track.  \n- A white car with red wheels drives near a red-and-white barrier, while a silver sedan follows closely behind.", "history_tokens": 638, "history_utf8_bytes": 2645, "recent_frame_times_s": [225.00811666666667, 226.00911666666667, 227.01011666666668, 228.01111666666668, 229.01211666666666, 230.01311666666666, 231.01411666666667, 232.01511666666667, 233.01611666666668, 234.00043333333332, 235.00143333333332, 236.00243333333333, 237.00343333333333, 238.00443333333334, 239.00543333333334, 240.00643333333332, 241.00743333333332, 242.00843333333333, 243.00943333333333, 244.01043333333334, 245.01143333333334, 246.01243333333332, 247.01343333333332, 248.01443333333333, 249.01543333333333, 250.01643333333334, 251.00075, 252.00175, 253.00275, 254.00375], "recent_frames_sha256": "53e7bfba90cb863663d414e8e35827d79172c53c7b4c081d72dd51d5234280ad", "num_recent_frames": 30, "tq": 710354.820627976, "t1": 710360.328122506, "ta": 710360.328122506, "te": 710360.366298366, "first_response_s": 5.507494530058466, "answer_total_s": 5.545670390012674, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 484, "content_group": "2c83a6b246f08c4697762543099b575af889e3f2a2d9aadcc85594e243af18a4", "question": {"question_id": "sample_484_a988_q0", "video_id": 484, "video_path": "./videos/sample_484_real.mp4", "annotation_index": 988, "question_index": 0, "question": "What is written on the green car in the race track scene?", "options": ["A. N2O COLA.", "B. Speedy Cola.", "C. Racing Fuel.", "D. Nitro Power."], "answer": "A", "time_stamp_s": 8, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_484_a988_q0", "video_id": 484, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "71eb4ecfc45fb8ea5779f0b9eebcae374bb792f347f8285bd88b7060f008ee30", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0], "recent_frames_sha256": "075eecc7297c174e973dc923bf0e9771329d173a2f2dcf315d5e63e83e6a79db", "num_recent_frames": 9, "tq": 717219.409820661, "t1": 717232.381694242, "ta": 717232.381694242, "te": 717232.423085841, "first_response_s": 12.971873581060208, "answer_total_s": 13.013265180052258, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_484_a988_q0", "video_id": 484, "time_stamp_s": 8, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "61cb41407edfb58a19fad2bbb1525511c80cacf9cc01b8484d98b20c1543053f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0], "recent_frames_sha256": "075eecc7297c174e973dc923bf0e9771329d173a2f2dcf315d5e63e83e6a79db", "num_recent_frames": 9, "tq": 717279.384345792, "t1": 717286.529109804, "ta": 717286.529109804, "te": 717286.5667604, "first_response_s": 7.144764011958614, "answer_total_s": 7.1824146079597995, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 484, "content_group": "2c83a6b246f08c4697762543099b575af889e3f2a2d9aadcc85594e243af18a4", "question": {"question_id": "sample_484_a988_q1", "video_id": 484, "video_path": "./videos/sample_484_real.mp4", "annotation_index": 988, "question_index": 1, "question": "What main event is depicted in the captions?", "options": ["A. A diecast car race victory lap.", "B. The beginning of a car model race.", "C. The construction of a race track.", "D. The final lap of a race."], "answer": "B", "time_stamp_s": 20, "task_type": "Clips Summarize", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_484_a988_q1", "video_id": 484, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "4cf59d3fc3f45cb585b7b1d814cd3bc097d0e25adbb6d6d0e7074d11bec1d994", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "23b71a6c1c02f7e448f6d7b5559b2d2f4656156b248ed2992580170ee4e5a738", "num_recent_frames": 21, "tq": 717232.447759835, "t1": 717243.512540984, "ta": 717243.512540984, "te": 717243.551081207, "first_response_s": 11.064781148917973, "answer_total_s": 11.103321371949278, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_484_a988_q1", "video_id": 484, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "378d93cccc8907bf3f01b80a051ee47549633de4df78c9788657e3ebd1780833", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "23b71a6c1c02f7e448f6d7b5559b2d2f4656156b248ed2992580170ee4e5a738", "num_recent_frames": 21, "tq": 717286.581014559, "t1": 717298.437176907, "ta": 717298.437176907, "te": 717298.474953951, "first_response_s": 11.856162347947247, "answer_total_s": 11.893939391942695, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 484, "content_group": "2c83a6b246f08c4697762543099b575af889e3f2a2d9aadcc85594e243af18a4", "question": {"question_id": "sample_484_a989_q0", "video_id": 484, "video_path": "./videos/sample_484_real.mp4", "annotation_index": 989, "question_index": 0, "question": "What happens to the green-purple car car when the racing car sprints?", "options": ["A. It falls behind other cars.", "B. It crashes into the pit stop area.", "C. It leaves the race track.", "D. It moves further ahead from the other cars."], "answer": "D", "time_stamp_s": 342, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_484_a989_q0", "video_id": 484, "time_stamp_s": 342, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d7c78fd0e5c99e455a769962561e5e6b76416749116121d5284d09339f571ca1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0], "recent_frames_sha256": "361cbf931e38637b80be84ff5117f9c3d76d993ddd6ba5ea14f5b85b552dab92", "num_recent_frames": 30, "tq": 717243.565637648, "t1": 717255.358890924, "ta": 717255.358890924, "te": 717255.39610456, "first_response_s": 11.793253276031464, "answer_total_s": 11.830466912011616, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_484_a989_q0", "video_id": 484, "time_stamp_s": 342, "ground_truth": "D", "raw_output": "A. It falls behind other cars.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "e9a48c0bf41a63f76b804fd2d0fdbece499e96fed79d14285d22222202d27536", "condition_order": ["recent", "notes"], "memory": "[30-60s] - A green and purple diecast car (#68 H.J. Hollis) is shown stationary on a track with text overlay indicating \"Race 1 Final\" and team name.\n- A replay sequence begins with multiple colorful diecast cars racing on a winding track, labeled \"Round 1 - Group 3\" and \"Replay.\"\n- The cars are seen speeding along a curving track with hills and advertising signs visible in the background.\n[60-90s] - A light gray race car with purple wheels and a red number \"57\" is stationary on the track, labeled \"Juniy\" and \"Team VCD132 Racing\" on screen.\n- The car is positioned on a straight section of the track near a checkered barrier, with no visible motion or interaction with other cars.\n- The background shows a grassy hillside and a garage area with parked vehicles, indicating a race track environment.\n[90-120s] - A light gray race car with purple accents and the number 57 is shown stationary on a track, labeled \"Jumpy\" and \"Team: VCD132 Racing\" in a final race display.\n- A replay sequence begins, showing multiple colorful race cars navigating a winding track with green hills and sponsor signs, including \"TDR\" and \"JBL.\"\n- The replay transitions to a different race segment, labeled \"Round 2 - Group 2,\" where cars race through a similar scenic track with visible pit areas and barriers.\n[120-150s] - Blue #39 Michael Rotor car, Team: Dom’s Tuner Shop, shown stationary on track with \"Race 1 Final\" label.\n- Group 4 race replay shows multiple cars racing on track, including blue #39 car, passing through a tunnel and approaching pit area.\n- Red car (possibly #39) is seen speeding past the pit area, with other cars in close proximity, indicating high-speed racing action.\n[150-180s] - Red car #123, Jonas Carvers, is shown stationary on the track with a \"Race 1 Final\" overlay, indicating completion of the race.  \n- The background features a chain-link fence and a garage area with other cars parked, suggesting a pit zone or finish line area.  \n- The scene transitions to a replay of a previous race, showing multiple cars racing on a track with a \"Round 2 - Group 2\" label.\n[180-210s] - Blue car leads red car through a turn, both near a \"TDR\" sign.  \n- Green car overtakes red car on a grassy section, then approaches a pit lane.  \n- Red car enters pit lane, while green car continues on track, passing a \"JBL\" sign.\n[210-240s] - Three toy race cars (red, blue, green) are positioned at the start line on a model track labeled \"Final - Heat 1\".  \n- The track curves upward with a backdrop of painted clouds and trees, and a \"BRENDA HONDA RACETRAK\" sign is visible.  \n- A scoreboard appears at 2:38 showing \"Rd 4.2 Final 18:00\" and driver times for #101, #102, and #103.\n[240-270s] - Instant replay shows cars racing on a winding track with sponsor banners and a pit area visible.  \n- A leaderboard overlay displays standings: #68 H.J. Hollis (1) in 1st, #57 Junyi in 2nd, #123 Jonas Carvers in 3rd, and #39 Michael Rotor in 4th.  \n- The track features a long straight section with a white line marking the finish line, bordered by grass and a fence.\n[270-300s] - Standings display shows #68 H.J. Hollis in 1st with 5 points, #57 Juniy 2nd with 3, #123 Jonas Carvers 3rd with 2, and #39 Michael Rotor 4th with 1.\n- Race scene transitions to \"Final - Heat 2\" with toy cars racing on a track featuring green grass, trees, and a blue sky backdrop.\n- Cars including blue, green, and white models are seen speeding along the track, passing under billboards and near garage structures.\n[300-330s] - Blue car overtakes white car on a curved track section.  \n- Red car follows closely behind the blue car, slightly trailing.  \n- Trackside signage for \"TDR\" and \"JBL\" is visible along the course.", "history_tokens": 1015, "history_utf8_bytes": 3703, "recent_frame_times_s": [313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0], "recent_frames_sha256": "361cbf931e38637b80be84ff5117f9c3d76d993ddd6ba5ea14f5b85b552dab92", "num_recent_frames": 30, "tq": 717384.30667194, "t1": 717390.137101016, "ta": 717390.137101016, "te": 717390.439507261, "first_response_s": 5.830429075984284, "answer_total_s": 6.132835321011953, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 484, "content_group": "2c83a6b246f08c4697762543099b575af889e3f2a2d9aadcc85594e243af18a4", "question": {"question_id": "sample_484_a990_q0", "video_id": 484, "video_path": "./videos/sample_484_real.mp4", "annotation_index": 990, "question_index": 0, "question": "Who is in first place in Race 1 - Final standings?", "options": ["A. Michael Rotor.", "B. Jay.", "C. H.J. Hollis.", "D. Jonas Carvers."], "answer": "C", "time_stamp_s": 499, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_484_a990_q0", "video_id": 484, "time_stamp_s": 499, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "89cb9e818f6386a9a918d1a9eba8221f071c7bb5a17cac70abe2f4b97730a29e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0], "recent_frames_sha256": "614e319170a35fbf54da85310158b1cfcf4e449c245d72c7bd4466c2c72e64ff", "num_recent_frames": 30, "tq": 717255.412634303, "t1": 717270.477955794, "ta": 717270.477955794, "te": 717270.515374649, "first_response_s": 15.065321490983479, "answer_total_s": 15.102740345988423, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_484_a990_q0", "video_id": 484, "time_stamp_s": 499, "ground_truth": "C", "raw_output": "C. H.J. Hollis.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "b76a98e98e5c3991e299fe61eae4c9b578dbd3004174cda1b35ee2f2b526fe3f", "condition_order": ["recent", "notes"], "memory": "[210-240s] - Three toy race cars (red, blue, green) are positioned at the start line on a model track labeled \"Final - Heat 1\".  \n- The track curves upward with a backdrop of painted clouds and trees, and a \"BRENDA HONDA RACETRAK\" sign is visible.  \n- A scoreboard appears at 2:38 showing \"Rd 4.2 Final 18:00\" and driver times for #101, #102, and #103.\n[240-270s] - Instant replay shows cars racing on a winding track with sponsor banners and a pit area visible.  \n- A leaderboard overlay displays standings: #68 H.J. Hollis (1) in 1st, #57 Junyi in 2nd, #123 Jonas Carvers in 3rd, and #39 Michael Rotor in 4th.  \n- The track features a long straight section with a white line marking the finish line, bordered by grass and a fence.\n[270-300s] - Standings display shows #68 H.J. Hollis in 1st with 5 points, #57 Juniy 2nd with 3, #123 Jonas Carvers 3rd with 2, and #39 Michael Rotor 4th with 1.\n- Race scene transitions to \"Final - Heat 2\" with toy cars racing on a track featuring green grass, trees, and a blue sky backdrop.\n- Cars including blue, green, and white models are seen speeding along the track, passing under billboards and near garage structures.\n[300-330s] - Blue car overtakes white car on a curved track section.  \n- Red car follows closely behind the blue car, slightly trailing.  \n- Trackside signage for \"TDR\" and \"JBL\" is visible along the course.\n[330-360s] - Instant replay overlay shows race cars speeding along a track with a grassy hillside and garage pit area visible.  \n- Cars, including blue, red, and orange models, race past a white barrier and approach a pit lane with visible sponsor banners.  \n- Standings overlay lists drivers: #68 H.J. Hollis (2nd), #39 Michael Rotor (4th), #123 Jonas Carvers (4th), and #57 Junyi (3rd).\n[360-390s] - Race cars (blue #10, green #2, orange #3) compete on a model track with \"Boulder Mountain Speedway\" signage.  \n- A leaderboard overlay shows positions 1–10 with names like \"F.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8\n[390-420s] - Instant replay shows race cars speeding along a winding track with billboards and grassy hills.  \n- A leaderboard overlay displays standings: #68 H.J. Hollis (11), #39 Michael Rotor (9), #123 Jonas Carvers (7), and #57 Junyi (5).  \n- Cars pass a pit lane area with garage doors and barriers, with some cars crossing a white finish line.\n[420-450s] - Standings overlay shows #68 H.J. Hollis in 1st, #39 Michael Rotor in 2nd, #123 Jonas Carvers in 3rd, and #57 Junyi in 4th.  \n- Final-Heat 4 title appears as three toy cars (blue, red, green) race on a track with trees and clouds in the background.  \n- Camera pans to show the track’s layout, including a TBR sign and a grassy area with sponsor banners.\n[450-480s] - Blue car overtakes green car near pit lane as both speed past white line.  \n- Green car briefly leads blue car before being overtaken again in the same section.  \n- Instant Replay overlay visible with \"TDR\" and \"TBR\" signage in background.", "history_tokens": 955, "history_utf8_bytes": 2999, "recent_frame_times_s": [470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0], "recent_frames_sha256": "614e319170a35fbf54da85310158b1cfcf4e449c245d72c7bd4466c2c72e64ff", "num_recent_frames": 30, "tq": 717426.448958973, "t1": 717427.905929856, "ta": 717427.905929856, "te": 717428.206310451, "first_response_s": 1.456970882951282, "answer_total_s": 1.7573514779796824, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 484, "content_group": "2c83a6b246f08c4697762543099b575af889e3f2a2d9aadcc85594e243af18a4", "question": {"question_id": "sample_484_a991_q0", "video_id": 484, "video_path": "./videos/sample_484_real.mp4", "annotation_index": 991, "question_index": 0, "question": "What is the sequence of the racecars when the racecars sprints?", "options": ["A. Red racecar followed by blue racecar.", "B. Blue racecar followed by green racecar.", "C. Purple racecar followed by blue racecar.", "D. Gray racecar followed by red racecar."], "answer": "A", "time_stamp_s": 585, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [540, 585], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_484_a991_q0", "video_id": 484, "time_stamp_s": 585, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e25968f184bd67864c7203145d87c4addb9bfdb30b21b052ffa8dd46904d612f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [556.0, 557.0, 558.0, 559.0, 560.0, 561.0, 562.0, 563.0, 564.0, 565.0, 566.0, 567.0, 568.0, 569.0, 570.0, 571.0, 572.0, 573.0, 574.0, 575.0, 576.0, 577.0, 578.0, 579.0, 580.0, 581.0, 582.0, 583.0, 584.0, 585.0], "recent_frames_sha256": "32048191073d00aef3fb0307fe162eda67f9c923ef6469080704ae25d5eb83f0", "num_recent_frames": 30, "tq": 717270.529206442, "t1": 717279.333213535, "ta": 717279.333213535, "te": 717279.375132819, "first_response_s": 8.804007093072869, "answer_total_s": 8.84592637710739, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_484_a991_q0", "video_id": 484, "time_stamp_s": 585, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "865d96fd42bc27f2c814bea65d9d78d87c7502fdc954bd8c31af357ed3baf531", "condition_order": ["recent", "notes"], "memory": "[300-330s] - Blue car overtakes white car on a curved track section.  \n- Red car follows closely behind the blue car, slightly trailing.  \n- Trackside signage for \"TDR\" and \"JBL\" is visible along the course.\n[330-360s] - Instant replay overlay shows race cars speeding along a track with a grassy hillside and garage pit area visible.  \n- Cars, including blue, red, and orange models, race past a white barrier and approach a pit lane with visible sponsor banners.  \n- Standings overlay lists drivers: #68 H.J. Hollis (2nd), #39 Michael Rotor (4th), #123 Jonas Carvers (4th), and #57 Junyi (3rd).\n[360-390s] - Race cars (blue #10, green #2, orange #3) compete on a model track with \"Boulder Mountain Speedway\" signage.  \n- A leaderboard overlay shows positions 1–10 with names like \"F.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8.8\n[390-420s] - Instant replay shows race cars speeding along a winding track with billboards and grassy hills.  \n- A leaderboard overlay displays standings: #68 H.J. Hollis (11), #39 Michael Rotor (9), #123 Jonas Carvers (7), and #57 Junyi (5).  \n- Cars pass a pit lane area with garage doors and barriers, with some cars crossing a white finish line.\n[420-450s] - Standings overlay shows #68 H.J. Hollis in 1st, #39 Michael Rotor in 2nd, #123 Jonas Carvers in 3rd, and #57 Junyi in 4th.  \n- Final-Heat 4 title appears as three toy cars (blue, red, green) race on a track with trees and clouds in the background.  \n- Camera pans to show the track’s layout, including a TBR sign and a grassy area with sponsor banners.\n[450-480s] - Blue car overtakes green car near pit lane as both speed past white line.  \n- Green car briefly leads blue car before being overtaken again in the same section.  \n- Instant Replay overlay visible with \"TDR\" and \"TBR\" signage in background.\n[480-510s] - Track times display for five cars: #39 Michael Rotor (8.103), #94 Jay (8.267), #35 Ronald (8.348), #28 Tim Treadless (8.417), and #123 Jonas Carvers (8.485).\n- Standings overlay shows rankings: #68 H.J. Hollis (13), #39 Michael Rotor (12), #123 Jonas Carvers (11), and #57 Junyi (6).\n- The leaderboard updates from track times\n[510-540s] - Driver standings list remains static, showing positions 1-11 with names, numbers, and points.\n- Background depicts a racetrack with green hills, trees, and a clear sky.\n- No changes or movements occur in the displayed standings or environment.\n[540-570s] - Team Standings overlay displays race 1 results with Don's Tuxedo Shop at 1st (111 points) and VCI 123 Racing at 2nd (78 points).  \n- Race track scene shows multiple cars racing on a winding road with sponsor signs (e.g., TEC, JLA) visible.  \n- Camera pans to reveal a pit area with crew members and equipment, then zooms out to show the full track layout.", "history_tokens": 903, "history_utf8_bytes": 2803, "recent_frame_times_s": [556.0, 557.0, 558.0, 559.0, 560.0, 561.0, 562.0, 563.0, 564.0, 565.0, 566.0, 567.0, 568.0, 569.0, 570.0, 571.0, 572.0, 573.0, 574.0, 575.0, 576.0, 577.0, 578.0, 579.0, 580.0, 581.0, 582.0, 583.0, 584.0, 585.0], "recent_frames_sha256": "32048191073d00aef3fb0307fe162eda67f9c923ef6469080704ae25d5eb83f0", "num_recent_frames": 30, "tq": 717454.046710251, "t1": 717460.440360337, "ta": 717460.440360337, "te": 717460.853091907, "first_response_s": 6.3936500860145316, "answer_total_s": 6.806381655973382, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 485, "content_group": "9c53f5138b5e4b279a97b097578c9af0762488a2981f2a6ab2d635e3e2155bc5", "question": {"question_id": "sample_485_a1741_q0", "video_id": 485, "video_path": "./videos/sample_485_real.mp4", "annotation_index": 1741, "question_index": 0, "question": "What is depicted on the container behind the toy car?", "options": ["A. \"NEXT GEN\".", "B. \"Walmart - Save money. Live better.\".", "C. \"DIECAST RACING\".", "D. \"NEXT-GEN PISTON CUP\"."], "answer": "B", "time_stamp_s": 12, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_485_a1741_q0", "video_id": 485, "time_stamp_s": 12, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1ebc09d333a85ae7efc762e951541c6f4ade3c644de3ef2fa83974e7d0949117", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0], "recent_frames_sha256": "43167f964990830195493d7ef5072b2c76c36f9709e174384ec3027489f29d2c", "num_recent_frames": 13, "tq": 715528.941572479, "t1": 715539.888573112, "ta": 715539.888573112, "te": 715539.926731666, "first_response_s": 10.947000632993877, "answer_total_s": 10.985159186995588, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_485_a1741_q0", "video_id": 485, "time_stamp_s": 12, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d05d798a948e115a614afdbdb47b3ec7db6cfcc3c00a23b483acb62262ed37a1", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0], "recent_frames_sha256": "43167f964990830195493d7ef5072b2c76c36f9709e174384ec3027489f29d2c", "num_recent_frames": 13, "tq": 715582.523557694, "t1": 715593.772531491, "ta": 715593.772531491, "te": 715593.815282065, "first_response_s": 11.248973796959035, "answer_total_s": 11.291724370908923, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 485, "content_group": "9c53f5138b5e4b279a97b097578c9af0762488a2981f2a6ab2d635e3e2155bc5", "question": {"question_id": "sample_485_a1742_q0", "video_id": 485, "video_path": "./videos/sample_485_real.mp4", "annotation_index": 1742, "question_index": 0, "question": "What number is displayed on Tom W.'s car on the scoreboard?", "options": ["A. 31.", "B. 61.", "C. 19.", "D. 76."], "answer": "B", "time_stamp_s": 209, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_485_a1742_q0", "video_id": 485, "time_stamp_s": 209, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8f77e041a6a58bc8cf29dbde31c9852632095cfea78d6c14bdb72f06b9cfaa6a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0], "recent_frames_sha256": "3eebfc2a83780cf74a4b0535d6df8677c736cef03b2b6268c2ff744eb7a29000", "num_recent_frames": 30, "tq": 715539.943793887, "t1": 715552.096254854, "ta": 715552.096254854, "te": 715552.134361427, "first_response_s": 12.152460966957733, "answer_total_s": 12.19056754000485, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_485_a1742_q0", "video_id": 485, "time_stamp_s": 209, "ground_truth": "B", "raw_output": "B. 61.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "60570b494a9fb3ae37e3ad06e7ce9e48fa89531d19cad9a3a46b771eeb8eaad1", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Blue #31 Cam Spinner car, Team: Wreckage Bluff Raceway, positioned 25th (9 pts) with 1 heat win and 1:467 fastest time, shown in Group 5.\n- Purple #12 car, Team: Wreckage Bluff Raceway, displayed in Group 5, with no stats visible.\n- Group 5 and 6 cars lined up at starting grid, with Group 5 cars in foreground and Group 6 cars behind, under a chain-link fence.\n[30-60s] - #19 Danny Swereez's purple car with gold accents is shown in a static display, positioned in 2nd place with a 10.481-second fastest time.\n- #76 Will Rusch's blue car with a checkered pattern is displayed, ranked 20th with a 9.033-second fastest time.\n- #61 Tom W.'s white car with blue wheels is shown, placed 9th with a 9.181-second fastest time, all within a track setting.\n[60-90s] - Blue car (#19 Danny Swervez) leads white car (#13 Cam Spinner) through a turn, both cars visibly close together.  \n- The track features a grassy area with trees and a distant \"TBR\" sign, indicating a scenic racing environment.  \n- A pit lane with parked vehicles and a red helicopter overhead suggests a race event setting.\n[90-120s] - Track times overlay shows #399 Michael Rotor with 8.103 seconds as fastest.\n- Standings display #76 Will Rusch in 1st position with 5 points, #46 Tom W. in 2nd with 3 points.\n- #31 Cam Spinner is in 4th place with 1 point, while #19 Danny Swereez is 3rd with 2 points.\n[120-150s] - Two toy cars, #76 Will Rusch and #131 Cam Spinner, race side-by-side on a track with \"TRINITY MOUNTAIN SPEEDWAY\" signage.  \n- The cars navigate a curved section of the track, passing a red and white barrier, with a pit area and helicopter visible in the background.  \n- A scoreboard displays standings for Group 5, Heat 2, showing #76 in 1st, #61 in 2nd, #19 in 3rd, and #31 in 4th.\n[150-180s] - Blue car (K13 Cam Spinner) overtakes another vehicle on the track, shown in motion blur.\n- A leaderboard overlay displays race standings with K76 Will Rusch in 1st place and K13 Cam Spinner in 4th.\n- The scene transitions to a replay view showing multiple cars racing on a curved track with green grass and billboards.", "history_tokens": 637, "history_utf8_bytes": 2102, "recent_frame_times_s": [180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0], "recent_frames_sha256": "3eebfc2a83780cf74a4b0535d6df8677c736cef03b2b6268c2ff744eb7a29000", "num_recent_frames": 30, "tq": 715671.861521694, "t1": 715678.176670063, "ta": 715678.176670063, "te": 715678.400133369, "first_response_s": 6.315148369059898, "answer_total_s": 6.538611675030552, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 485, "content_group": "9c53f5138b5e4b279a97b097578c9af0762488a2981f2a6ab2d635e3e2155bc5", "question": {"question_id": "sample_485_a1743_q0", "video_id": 485, "video_path": "./videos/sample_485_real.mp4", "annotation_index": 1743, "question_index": 0, "question": "What is the number on the grey toy race car shown right now?", "options": ["A. 117.", "B. 82.", "C. 035.", "D. 26."], "answer": "C", "time_stamp_s": 365, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_485_a1743_q0", "video_id": 485, "time_stamp_s": 365, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a0e74fa49457955d6b84e3dfe111a361ce5e941be38024b074013a6b24555702", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0], "recent_frames_sha256": "4a40f185dac12a493d3aa520fe5e0d1edc620daf688d865d7592e248cd2335dc", "num_recent_frames": 30, "tq": 715552.149200424, "t1": 715564.271178549, "ta": 715564.271178549, "te": 715564.314262964, "first_response_s": 12.12197812506929, "answer_total_s": 12.165062539977953, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_485_a1743_q0", "video_id": 485, "time_stamp_s": 365, "ground_truth": "C", "raw_output": "C. 035.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "63c5c7ddac4966b105e14f183e4fb87c41501122b8141e36d625564c54b0b090", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Track times overlay shows #399 Michael Rotor with 8.103 seconds as fastest.\n- Standings display #76 Will Rusch in 1st position with 5 points, #46 Tom W. in 2nd with 3 points.\n- #31 Cam Spinner is in 4th place with 1 point, while #19 Danny Swereez is 3rd with 2 points.\n[120-150s] - Two toy cars, #76 Will Rusch and #131 Cam Spinner, race side-by-side on a track with \"TRINITY MOUNTAIN SPEEDWAY\" signage.  \n- The cars navigate a curved section of the track, passing a red and white barrier, with a pit area and helicopter visible in the background.  \n- A scoreboard displays standings for Group 5, Heat 2, showing #76 in 1st, #61 in 2nd, #19 in 3rd, and #31 in 4th.\n[150-180s] - Blue car (K13 Cam Spinner) overtakes another vehicle on the track, shown in motion blur.\n- A leaderboard overlay displays race standings with K76 Will Rusch in 1st place and K13 Cam Spinner in 4th.\n- The scene transitions to a replay view showing multiple cars racing on a curved track with green grass and billboards.\n[180-210s] - Standings display shows #76 Will Rusch in 1st with 10 points, #61 Tom W. in 2nd with 6, #19 Danny S. in 3rd with 4, and #31 Cam Spinner in 4th with 2.\n- Group 5 - Heat 3 race begins with #31 Cam Spinner and #119 Danny S. in Row 1, followed by #76 Will Rusch and #61 Tom W. in Row 2.\n- Cars race along a track with \"BANDER WILLOW GATE\n[210-240s] - Blue race car overtakes another vehicle on a curved track section.  \n- Red and blue trucks are visible in the background near a pit area.  \n- A \"Replay\" indicator appears on screen, suggesting a rewind or slow-motion segment.\n[240-270s] - Blue car #76 Will Rusch (2) leads the race with 10 points, shown in standings overlay.\n- Purple car #19 Dainy Szwerez (1) holds 2nd place with 9 points.\n- Blue car #31 Cam Spinner is 4th with 5 points, trailing behind the top three.\n[270-300s] - Standings display shows #76 Will Rusch in 1st with 10 points, #19 Danny Swereez in 2nd with 9, #61 Tom W. in 3rd with 8, and #31 Cam Spinner in 4th with 5.\n- Group 5 - Heat 4 race begins with cars on a track labeled \"Boulder Mountain Speedway,\" featuring #19 Danny Swereez and #61 Tom W. in Row 1, and #31 Cam Spinner and #76 Will Rusch in Row 2.\n- Cars race along\n[300-330s] - Blue car overtakes silver car on straightaway near pit lane, with \"P14 S. Sweeney\" and \"P15 S. Sweeney\" displayed on screen.\n- Blue car crosses finish line, triggering a \"Replay\" overlay with race standings showing \"P14 S. Sweeney\" in 1st place.\n- Pit lane area visible with parked trucks and a red helicopter hovering above, while blue car speeds past the pit lane fence.\n[330-360s] - Standings display shows #19 Danny Swerves leading with 14 points, followed by #76 Will Rush (13), #66 Tom W. (10), and #31 Cam Spiner (6).  \n- A white race car with green accents and \"#33\" on its side is shown, labeled as belonging to \"Ronaldo Racing\" and \"Team VCD132.\"  \n- The car is positioned on a track with a pit garage visible in the background, indicating a racing environment.", "history_tokens": 964, "history_utf8_bytes": 3003, "recent_frame_times_s": [336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0], "recent_frames_sha256": "4a40f185dac12a493d3aa520fe5e0d1edc620daf688d865d7592e248cd2335dc", "num_recent_frames": 30, "tq": 715724.056502198, "t1": 715724.98066641, "ta": 715724.98066641, "te": 715725.23956413, "first_response_s": 0.9241642119595781, "answer_total_s": 1.1830619319807738, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 485, "content_group": "9c53f5138b5e4b279a97b097578c9af0762488a2981f2a6ab2d635e3e2155bc5", "question": {"question_id": "sample_485_a1743_q1", "video_id": 485, "video_path": "./videos/sample_485_real.mp4", "annotation_index": 1743, "question_index": 1, "question": "How many different toy race cars are shown right now?", "options": ["A. 2.", "B. 3.", "C. 4.", "D. 5."], "answer": "C", "time_stamp_s": 394, "task_type": "Counting", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_485_a1743_q1", "video_id": 485, "time_stamp_s": 394, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e20e29fff6e950c2d7530510ac9c67bc19b383003fd90c37e2715e414ea266a9", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0], "recent_frames_sha256": "49a3c81fc4a36c7a0eacd60f4fdae0235a0d9fb28907f45656ef46741069601c", "num_recent_frames": 30, "tq": 715564.329253417, "t1": 715575.725733842, "ta": 715575.725733842, "te": 715575.765102392, "first_response_s": 11.39648042502813, "answer_total_s": 11.435848974972032, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_485_a1743_q1", "video_id": 485, "time_stamp_s": 394, "ground_truth": "C", "raw_output": "B. 3.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "e613ed964cb5d23a48a0737b2dfc0793c4e30d2eb5eaae86070e3b75ebe58544", "condition_order": ["recent", "notes"], "memory": "[120-150s] - Two toy cars, #76 Will Rusch and #131 Cam Spinner, race side-by-side on a track with \"TRINITY MOUNTAIN SPEEDWAY\" signage.  \n- The cars navigate a curved section of the track, passing a red and white barrier, with a pit area and helicopter visible in the background.  \n- A scoreboard displays standings for Group 5, Heat 2, showing #76 in 1st, #61 in 2nd, #19 in 3rd, and #31 in 4th.\n[150-180s] - Blue car (K13 Cam Spinner) overtakes another vehicle on the track, shown in motion blur.\n- A leaderboard overlay displays race standings with K76 Will Rusch in 1st place and K13 Cam Spinner in 4th.\n- The scene transitions to a replay view showing multiple cars racing on a curved track with green grass and billboards.\n[180-210s] - Standings display shows #76 Will Rusch in 1st with 10 points, #61 Tom W. in 2nd with 6, #19 Danny S. in 3rd with 4, and #31 Cam Spinner in 4th with 2.\n- Group 5 - Heat 3 race begins with #31 Cam Spinner and #119 Danny S. in Row 1, followed by #76 Will Rusch and #61 Tom W. in Row 2.\n- Cars race along a track with \"BANDER WILLOW GATE\n[210-240s] - Blue race car overtakes another vehicle on a curved track section.  \n- Red and blue trucks are visible in the background near a pit area.  \n- A \"Replay\" indicator appears on screen, suggesting a rewind or slow-motion segment.\n[240-270s] - Blue car #76 Will Rusch (2) leads the race with 10 points, shown in standings overlay.\n- Purple car #19 Dainy Szwerez (1) holds 2nd place with 9 points.\n- Blue car #31 Cam Spinner is 4th with 5 points, trailing behind the top three.\n[270-300s] - Standings display shows #76 Will Rusch in 1st with 10 points, #19 Danny Swereez in 2nd with 9, #61 Tom W. in 3rd with 8, and #31 Cam Spinner in 4th with 5.\n- Group 5 - Heat 4 race begins with cars on a track labeled \"Boulder Mountain Speedway,\" featuring #19 Danny Swereez and #61 Tom W. in Row 1, and #31 Cam Spinner and #76 Will Rusch in Row 2.\n- Cars race along\n[300-330s] - Blue car overtakes silver car on straightaway near pit lane, with \"P14 S. Sweeney\" and \"P15 S. Sweeney\" displayed on screen.\n- Blue car crosses finish line, triggering a \"Replay\" overlay with race standings showing \"P14 S. Sweeney\" in 1st place.\n- Pit lane area visible with parked trucks and a red helicopter hovering above, while blue car speeds past the pit lane fence.\n[330-360s] - Standings display shows #19 Danny Swerves leading with 14 points, followed by #76 Will Rush (13), #66 Tom W. (10), and #31 Cam Spiner (6).  \n- A white race car with green accents and \"#33\" on its side is shown, labeled as belonging to \"Ronaldo Racing\" and \"Team VCD132.\"  \n- The car is positioned on a track with a pit garage visible in the background, indicating a racing environment.\n[360-390s] - #35 Ronald, white car with green accents, shown in Group 6, positioned 26th with a fastest time of 8.348.\n- #117 Spiky Fillups, blue car with yellow number 117, shown in Group 6, positioned 15th with a fastest time of 9.545.\n- #82 Conrad Camber, green and yellow car with number 82, shown in Group 6, positioned 14th with a fastest time of 10.317.", "history_tokens": 994, "history_utf8_bytes": 3083, "recent_frame_times_s": [365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0, 380.0, 381.0, 382.0, 383.0, 384.0, 385.0, 386.0, 387.0, 388.0, 389.0, 390.0, 391.0, 392.0, 393.0, 394.0], "recent_frames_sha256": "49a3c81fc4a36c7a0eacd60f4fdae0235a0d9fb28907f45656ef46741069601c", "num_recent_frames": 30, "tq": 715736.990879619, "t1": 715738.032316579, "ta": 715738.032316579, "te": 715738.253855938, "first_response_s": 1.041436959989369, "answer_total_s": 1.2629763189470395, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 485, "content_group": "9c53f5138b5e4b279a97b097578c9af0762488a2981f2a6ab2d635e3e2155bc5", "question": {"question_id": "sample_485_a1744_q0", "video_id": 485, "video_path": "./videos/sample_485_real.mp4", "annotation_index": 1744, "question_index": 0, "question": "Which car is labeled #117?", "options": ["A. Ronald.", "B. Conrad Camber.", "C. S.Fillups.", "D. Dan Carcia."], "answer": "C", "time_stamp_s": 560, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_485_a1744_q0", "video_id": 485, "time_stamp_s": 560, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8e5682895b782c16d1b4d5e2c4e1b26c20a2d01aee4148f86edbf8ba9d184f87", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0], "recent_frames_sha256": "f43b3fcf0a854c9926e9c385eab9f56728460554b4b78d4982c913987c8fd07f", "num_recent_frames": 30, "tq": 715575.778110012, "t1": 715582.480543973, "ta": 715582.480543973, "te": 715582.517491233, "first_response_s": 6.702433961094357, "answer_total_s": 6.739381221006624, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_485_a1744_q0", "video_id": 485, "time_stamp_s": 560, "ground_truth": "C", "raw_output": "C. S.Fillups.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "0709ad539e7af8fe862f77471e390dfd2bde879d814c6ab65c9ca1e293067738", "condition_order": ["recent", "notes"], "memory": "[270-300s] - Standings display shows #76 Will Rusch in 1st with 10 points, #19 Danny Swereez in 2nd with 9, #61 Tom W. in 3rd with 8, and #31 Cam Spinner in 4th with 5.\n- Group 5 - Heat 4 race begins with cars on a track labeled \"Boulder Mountain Speedway,\" featuring #19 Danny Swereez and #61 Tom W. in Row 1, and #31 Cam Spinner and #76 Will Rusch in Row 2.\n- Cars race along\n[300-330s] - Blue car overtakes silver car on straightaway near pit lane, with \"P14 S. Sweeney\" and \"P15 S. Sweeney\" displayed on screen.\n- Blue car crosses finish line, triggering a \"Replay\" overlay with race standings showing \"P14 S. Sweeney\" in 1st place.\n- Pit lane area visible with parked trucks and a red helicopter hovering above, while blue car speeds past the pit lane fence.\n[330-360s] - Standings display shows #19 Danny Swerves leading with 14 points, followed by #76 Will Rush (13), #66 Tom W. (10), and #31 Cam Spiner (6).  \n- A white race car with green accents and \"#33\" on its side is shown, labeled as belonging to \"Ronaldo Racing\" and \"Team VCD132.\"  \n- The car is positioned on a track with a pit garage visible in the background, indicating a racing environment.\n[360-390s] - #35 Ronald, white car with green accents, shown in Group 6, positioned 26th with a fastest time of 8.348.\n- #117 Spiky Fillups, blue car with yellow number 117, shown in Group 6, positioned 15th with a fastest time of 9.545.\n- #82 Conrad Camber, green and yellow car with number 82, shown in Group 6, positioned 14th with a fastest time of 10.317.\n[390-420s] - Blue race car #80 Dan Garcia leads #182 Conrad Camber on a downhill track with \"Hendrick Motorsports\" branding.\n- Cars navigate a curved section with green hills and trees, then enter a straightaway near a pit area with a red helicopter overhead.\n- On-screen text displays driver names and car numbers for Row 1 and Row 2, with a leaderboard showing \"Heat 1\" and \"Group 6\".\n[420-450s] - Blue car overtakes green car on a curved track section.  \n- White car speeds past blue car near the pit lane entrance.  \n- Red car is visible in the background near the pit garage.\n[450-480s] - Standings display shows #80 Dan Garcia (1st) with 5 points, #135 Ronald (2nd) with 3 points, #117 Spiky Fillups (3rd) with 2 points, and #82 Conrad Camber (4th) with 1 point.\n- Race track scene features cars on a winding track with green grass, trees, and a blue sky with clouds.\n- Cars #82 Conrad Camber and #135 Ronald are shown in a side-by-side position on the track, with #80 Dan Garcia and #117 Sp\n[480-510s] - A green car speeds down a long, straight track, passing a white barrier and approaching a pit area with a red helicopter overhead.  \n- A blue car is seen navigating a curved section of the track, with a scoreboard displaying race positions and times.  \n- The replay segment shows the green car overtaking the blue car near the pit area, with the camera angle shifting to highlight the overtaking maneuver.\n[510-540s] - Track times display for five drivers: #39 Michael Rotor, #35 Ronald, #494 Jay, #76 Will Rusch, and #28 Tim Treadless.\n- Standings list shows #35 Ronald in 1st place with 8 points, followed by #480 Dan Carcia (8 points), #62 Conzad Camber (3 points), and #117 Spiky Fillips (2 points).\n- Group 6 - Heat 3 race begins with #35 Ronald and #117 Spiky Fillips in Row ", "history_tokens": 1019, "history_utf8_bytes": 3316, "recent_frame_times_s": [531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0, 542.0, 543.0, 544.0, 545.0, 546.0, 547.0, 548.0, 549.0, 550.0, 551.0, 552.0, 553.0, 554.0, 555.0, 556.0, 557.0, 558.0, 559.0, 560.0], "recent_frames_sha256": "f43b3fcf0a854c9926e9c385eab9f56728460554b4b78d4982c913987c8fd07f", "num_recent_frames": 30, "tq": 715778.665934833, "t1": 715780.969493707, "ta": 715780.969493707, "te": 715781.196293474, "first_response_s": 2.3035588739439845, "answer_total_s": 2.5303586409427226, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 486, "content_group": "cfbe41f292e49db3043bb27a95295677045a50b3a79ce4ee71a42dd047f04b9e", "question": {"question_id": "sample_486_a1576_q0", "video_id": 486, "video_path": "./videos/sample_486_real.mp4", "annotation_index": 1576, "question_index": 0, "question": "What is announced over the image of the detailed miniature race setup right now?", "options": ["A. \"NEXT GEN PISTON CUP, Race 1 - Round 2\".", "B. \"NEXT GEN PISTON CUP, Race 2 - Round 1\".", "C. \"NEXT GEN TOY RACE, Round 2 - Race 1\".", "D. \"NEXT GEN TOY RACE, Race 1 - Round 2\"."], "answer": "B", "time_stamp_s": 14, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_486_a1576_q0", "video_id": 486, "time_stamp_s": 14, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "271328f1dee457dc33d41e4422a6a22c1999d245b5a0dbe1e3e2b7cecccf9466", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0], "recent_frames_sha256": "3f82f8cf8cb22e55cf78c8762006de9c5156373c53057a662ee70159d1231ee6", "num_recent_frames": 15, "tq": 716175.749196945, "t1": 716176.539119105, "ta": 716176.539119105, "te": 716176.576655794, "first_response_s": 0.7899221599800512, "answer_total_s": 0.8274588490603492, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_486_a1576_q0", "video_id": 486, "time_stamp_s": 14, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b25ff3d3b4a1363482e1dd7245e23eb9182998431a99f704821b2ef86c5b8954", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0], "recent_frames_sha256": "3f82f8cf8cb22e55cf78c8762006de9c5156373c53057a662ee70159d1231ee6", "num_recent_frames": 15, "tq": 715966.344082732, "t1": 715977.097102697, "ta": 715977.097102697, "te": 715977.136505326, "first_response_s": 10.75301996502094, "answer_total_s": 10.792422594036907, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 486, "content_group": "cfbe41f292e49db3043bb27a95295677045a50b3a79ce4ee71a42dd047f04b9e", "question": {"question_id": "sample_486_a1577_q0", "video_id": 486, "video_path": "./videos/sample_486_real.mp4", "annotation_index": 1577, "question_index": 0, "question": "What color is the car driven by Rich Mixon?", "options": ["A. Pink.", "B. Blue.", "C. Green.", "D. Orange."], "answer": "A", "time_stamp_s": 182, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_486_a1577_q0", "video_id": 486, "time_stamp_s": 182, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2f6ff4bff9f116c35051e5214b346e18167cbcd01678b1ee32ebfb9b86bec600", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0], "recent_frames_sha256": "88f91097f55fe9b825af1033c289ab2956896e508c868677a32717473aab441e", "num_recent_frames": 30, "tq": 716176.591199235, "t1": 716188.839733877, "ta": 716188.839733877, "te": 716188.877076798, "first_response_s": 12.248534642043523, "answer_total_s": 12.28587756305933, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_486_a1577_q0", "video_id": 486, "time_stamp_s": 182, "ground_truth": "A", "raw_output": "A. Pink.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "405d68ee8eaec2e289b770fd755a43f533eadb1f11cecec437bb74cee7c0b4bc", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pink diecast car #26 Rich Mixon, Team: Miniature Car Racing, positioned 1st in Group 3 with a 10.332-second fastest time.\n- Group 3 and 4 cars are lined up on a track with a Walmart truck and garage structures in the background.\n- On-screen text displays race details: \"NEXT-GEN PISTON CUP Race 2 - Round 1\" and \"Group 3 and 4\".\n[30-60s] - #36 Rich Mixon’s car (pink/green) is shown in Group 3 with a position of 1st (6 pts) and fastest time of 10.372.\n- #11 Chris Roamin’’s car (blue/green) is shown in Group 3 with a position of 28th (8 pts) and fastest time of 10.597.\n- #48 Aaron Clocker’s car (orange/purple) is shown in Group 3 with a position of 24th (9 pts) and fastest time of 9.\n[60-90s] - Blue car #20 Jackson Storm leads pink car #48 Aaron Clocker on a downhill track segment.  \n- The track curves past a grassy area with trees and a \"TIB\" sign, then transitions to a straight section with a pit lane visible.  \n- A scoreboard displays lap times for multiple cars, including #20 Jackson Storm at 8.903 seconds.\n[90-120s] - Race track replay shows cars speeding along a curved track with a pit area visible in the background.  \n- On-screen standings display: #20 Jackson Storm (1st, 5 points), #35 Rich Nixon (2nd, 3 points), #48 Aaron Clocker (3rd, 2 points), and #11 Chris Roamin (4th, 1 point).  \n- Cars are blurred due to high speed, indicating motion during the replay segment.\n[120-150s] - Pink car (#36 Rich Mixon) leads a group of three cars through a turn, with #48 Aaron Clocker and #20 Jackson Storm following closely behind.\n- The track features a grassy area, trees, and a pit lane with visible garage structures and a red helicopter hovering above.\n- A replay overlay appears at 1:29, showing the cars approaching the pit lane with on-screen data indicating lap times and driver names.\n[150-180s] - Pink car overtakes blue car on track, then exits the track near pit area.  \n- Blue car follows pink car, then passes a red car on the track.  \n- Standings overlay shows #36 Rich Mixon in 1st, #20 Jackson Storm in 2nd, and #48 Aaron Cocker in 3rd.", "history_tokens": 626, "history_utf8_bytes": 2088, "recent_frame_times_s": [153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0], "recent_frames_sha256": "88f91097f55fe9b825af1033c289ab2956896e508c868677a32717473aab441e", "num_recent_frames": 30, "tq": 716030.265662106, "t1": 716031.49607016, "ta": 716031.49607016, "te": 716031.681574712, "first_response_s": 1.2304080539615825, "answer_total_s": 1.415912606054917, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 486, "content_group": "cfbe41f292e49db3043bb27a95295677045a50b3a79ce4ee71a42dd047f04b9e", "question": {"question_id": "sample_486_a1577_q1", "video_id": 486, "video_path": "./videos/sample_486_real.mp4", "annotation_index": 1577, "question_index": 1, "question": "Which car is leading the race?", "options": ["A. #20 Jackson Storm.", "B. #48 Aaron Clocker.", "C. #11 Chris Roamin'.", "D. #36 Rich Mixon."], "answer": "D", "time_stamp_s": 200, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_486_a1577_q1", "video_id": 486, "time_stamp_s": 200, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b316324061915d6efbfc864c505b70269ca0be6f8ab5919a0419cf872543ee78", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0], "recent_frames_sha256": "8cce7fac3d0eada3d653f59500453590983e117542f72989166f927398961b45", "num_recent_frames": 30, "tq": 716188.896706016, "t1": 716199.707385751, "ta": 716199.707385751, "te": 716199.744447853, "first_response_s": 10.810679734917358, "answer_total_s": 10.847741836914793, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_486_a1577_q1", "video_id": 486, "time_stamp_s": 200, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "679830ccb9291cbadd03197f369ad3bebb01a7186978e9a28d6b13d3f5217e0d", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Pink diecast car #26 Rich Mixon, Team: Miniature Car Racing, positioned 1st in Group 3 with a 10.332-second fastest time.\n- Group 3 and 4 cars are lined up on a track with a Walmart truck and garage structures in the background.\n- On-screen text displays race details: \"NEXT-GEN PISTON CUP Race 2 - Round 1\" and \"Group 3 and 4\".\n[30-60s] - #36 Rich Mixon’s car (pink/green) is shown in Group 3 with a position of 1st (6 pts) and fastest time of 10.372.\n- #11 Chris Roamin’’s car (blue/green) is shown in Group 3 with a position of 28th (8 pts) and fastest time of 10.597.\n- #48 Aaron Clocker’s car (orange/purple) is shown in Group 3 with a position of 24th (9 pts) and fastest time of 9.\n[60-90s] - Blue car #20 Jackson Storm leads pink car #48 Aaron Clocker on a downhill track segment.  \n- The track curves past a grassy area with trees and a \"TIB\" sign, then transitions to a straight section with a pit lane visible.  \n- A scoreboard displays lap times for multiple cars, including #20 Jackson Storm at 8.903 seconds.\n[90-120s] - Race track replay shows cars speeding along a curved track with a pit area visible in the background.  \n- On-screen standings display: #20 Jackson Storm (1st, 5 points), #35 Rich Nixon (2nd, 3 points), #48 Aaron Clocker (3rd, 2 points), and #11 Chris Roamin (4th, 1 point).  \n- Cars are blurred due to high speed, indicating motion during the replay segment.\n[120-150s] - Pink car (#36 Rich Mixon) leads a group of three cars through a turn, with #48 Aaron Clocker and #20 Jackson Storm following closely behind.\n- The track features a grassy area, trees, and a pit lane with visible garage structures and a red helicopter hovering above.\n- A replay overlay appears at 1:29, showing the cars approaching the pit lane with on-screen data indicating lap times and driver names.\n[150-180s] - Pink car overtakes blue car on track, then exits the track near pit area.  \n- Blue car follows pink car, then passes a red car on the track.  \n- Standings overlay shows #36 Rich Mixon in 1st, #20 Jackson Storm in 2nd, and #48 Aaron Cocker in 3rd.", "history_tokens": 626, "history_utf8_bytes": 2088, "recent_frame_times_s": [171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0], "recent_frames_sha256": "8cce7fac3d0eada3d653f59500453590983e117542f72989166f927398961b45", "num_recent_frames": 30, "tq": 716031.695605336, "t1": 716043.961974015, "ta": 716043.961974015, "te": 716044.241724866, "first_response_s": 12.26636867900379, "answer_total_s": 12.546119529986754, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 486, "content_group": "cfbe41f292e49db3043bb27a95295677045a50b3a79ce4ee71a42dd047f04b9e", "question": {"question_id": "sample_486_a1578_q0", "video_id": 486, "video_path": "./videos/sample_486_real.mp4", "annotation_index": 1578, "question_index": 0, "question": "How are the race cars positioned right now?", "options": ["A. In a single line.", "B. Randomly scattered.", "C. In two rows.", "D. In a circle."], "answer": "C", "time_stamp_s": 360, "task_type": "Spatial Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_486_a1578_q0", "video_id": 486, "time_stamp_s": 360, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e5d09a34ff0d89840ea823a3749d4b89173f514b1aaba2618ea992201557dcee", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0], "recent_frames_sha256": "a1c69f3e6862eca4dd657a76b4b66c372d4e260628af7103eb8d3e4b285c27c5", "num_recent_frames": 30, "tq": 716199.758942619, "t1": 716207.413469216, "ta": 716207.413469216, "te": 716207.450836338, "first_response_s": 7.654526597005315, "answer_total_s": 7.6918937190203, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_486_a1578_q0", "video_id": 486, "time_stamp_s": 360, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "42bc248b3bd0b816edc2a43d43f4751a3e8570a8fcb56c2a0d1c8fb81a56b28d", "condition_order": ["notes", "recent"], "memory": "[60-90s] - Blue car #20 Jackson Storm leads pink car #48 Aaron Clocker on a downhill track segment.  \n- The track curves past a grassy area with trees and a \"TIB\" sign, then transitions to a straight section with a pit lane visible.  \n- A scoreboard displays lap times for multiple cars, including #20 Jackson Storm at 8.903 seconds.\n[90-120s] - Race track replay shows cars speeding along a curved track with a pit area visible in the background.  \n- On-screen standings display: #20 Jackson Storm (1st, 5 points), #35 Rich Nixon (2nd, 3 points), #48 Aaron Clocker (3rd, 2 points), and #11 Chris Roamin (4th, 1 point).  \n- Cars are blurred due to high speed, indicating motion during the replay segment.\n[120-150s] - Pink car (#36 Rich Mixon) leads a group of three cars through a turn, with #48 Aaron Clocker and #20 Jackson Storm following closely behind.\n- The track features a grassy area, trees, and a pit lane with visible garage structures and a red helicopter hovering above.\n- A replay overlay appears at 1:29, showing the cars approaching the pit lane with on-screen data indicating lap times and driver names.\n[150-180s] - Pink car overtakes blue car on track, then exits the track near pit area.  \n- Blue car follows pink car, then passes a red car on the track.  \n- Standings overlay shows #36 Rich Mixon in 1st, #20 Jackson Storm in 2nd, and #48 Aaron Cocker in 3rd.\n[180-210s] - Pink car (#36 Rich Mixon) leads orange car (#11 Chris Roamin') on a downhill track segment.  \n- Blue car (#48 Aaron Clocker) and green car (#20 Jackson Storm) follow closely behind, with #48 slightly ahead.  \n- The track curves right, with a pit area and garage visible in the background, and a red helicopter hovering above.\n[210-240s] - Race cars, including pink, blue, and orange models, speed along a winding track with grassy hills and advertising boards.  \n- A replay overlay shows the track’s layout, including a pit area with garages and a red helicopter hovering above.  \n- Standings display: #36 Rich Nixon (2nd, 13 points), #20 Jackson Storm (1st, 9 points), #48 Aaron Clocker (3rd, 6 points), and #11 Chris Roamin (4th, 5 points).\n[240-270s] - Race standings display: #36 Rich Mixon in 2nd, #20 Jackson Storm in 1st, #48 Aaron Clocker in 3rd, #11 Chris Roamin' in 4th.\n- Group 3 - Heat 4 race begins with #11 Chris Roamin' and #20 Jackson Storm on the track, followed by #36 Rich Mixon and #48 Aaron Clocker.\n- The track features a curved section with a grassy area and a pit stop zone visible in the background.\n[270-300s] - Pink car overtakes blue car on straightaway, passing a white barrier.  \n- Green car follows closely behind, approaching the same barrier.  \n- Race leaderboard shows #36 Rich Mison in 1st, #20 Jackson Storm in 2nd, and #11 Chris Roamin in 3rd.\n[300-330s] - Stands display: #36 Rich Mison (T2) in 1st place with 14 points, #20 Jackson Storm (T2) in 2nd with 14 points, #11 Chris Roamin in 3rd with 8 points, and #48 Aaron Clocker in 4th with 8 points.\n- Background: A race track with a pit area and a grassy area visible.\n- No visible action or movement of any entity during this segment.\n[330-360s] - #92 Sheldon Shifter (green/white) shown in 11th position with 9.417 fastest time.\n- #90 Paul Conrey (red/white) shown in 10th position with 8.760 fastest time.\n- #68 H.J. Hollis (purple/green) shown in 1st position with 8.335 fastest time.", "history_tokens": 1015, "history_utf8_bytes": 3374, "recent_frame_times_s": [331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0], "recent_frames_sha256": "a1c69f3e6862eca4dd657a76b4b66c372d4e260628af7103eb8d3e4b285c27c5", "num_recent_frames": 30, "tq": 716100.37798037, "t1": 716108.803631728, "ta": 716108.803631728, "te": 716108.844322858, "first_response_s": 8.425651358091272, "answer_total_s": 8.46634248807095, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 486, "content_group": "cfbe41f292e49db3043bb27a95295677045a50b3a79ce4ee71a42dd047f04b9e", "question": {"question_id": "sample_486_a1579_q0", "video_id": 486, "video_path": "./videos/sample_486_real.mp4", "annotation_index": 1579, "question_index": 0, "question": "Who is ranked first for Group 4 - Heat 3?", "options": ["A. #90 Paul Conrev.", "B. #92 Sheldon Shifter.", "C. #68 H.J. Hollis.", "D. #15 Harvey Rodcap."], "answer": "D", "time_stamp_s": 588, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_486_a1579_q0", "video_id": 486, "time_stamp_s": 588, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "067a0122ac1ab201e6588f1b1b0c17e7311e3dd0499eb4e5b876b45c83719776", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [559.0, 560.0, 561.0, 562.0, 563.0, 564.0, 565.0, 566.0, 567.0, 568.0, 569.0, 570.0, 571.0, 572.0, 573.0, 574.0, 575.0, 576.0, 577.0, 578.0, 579.0, 580.0, 581.0, 582.0, 583.0, 584.0, 585.0, 586.0, 587.0, 588.0], "recent_frames_sha256": "59e4d2c4900acb06222fd1e256888a8a463ed6aefb8add44235fd9db2765b827", "num_recent_frames": 30, "tq": 716207.465244542, "t1": 716214.893809049, "ta": 716214.893809049, "te": 716214.931446692, "first_response_s": 7.428564507048577, "answer_total_s": 7.466202149982564, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_486_a1579_q0", "video_id": 486, "time_stamp_s": 588, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "06edfb14a5116bee0b11a5f20f12000f4c43b73b6d6327711e3af1775e51cb59", "condition_order": ["notes", "recent"], "memory": "[300-330s] - Stands display: #36 Rich Mison (T2) in 1st place with 14 points, #20 Jackson Storm (T2) in 2nd with 14 points, #11 Chris Roamin in 3rd with 8 points, and #48 Aaron Clocker in 4th with 8 points.\n- Background: A race track with a pit area and a grassy area visible.\n- No visible action or movement of any entity during this segment.\n[330-360s] - #92 Sheldon Shifter (green/white) shown in 11th position with 9.417 fastest time.\n- #90 Paul Conrey (red/white) shown in 10th position with 8.760 fastest time.\n- #68 H.J. Hollis (purple/green) shown in 1st position with 8.335 fastest time.\n[360-390s] - #68 H.J. Hollis and #90 Paul Contrev race side-by-side on a track with trees and a blue sky backdrop.\n- #92 Sheldon Shifter and #15 Harvey Rodcap enter the race, with #92 Shifter slightly ahead of #15 Rodcap.\n- The race progresses through a turn, with cars navigating a grassy area and passing a sign for \"BR\" and \"Bridgestone.\"\n[390-420s] - A replay of a race on a model track with multiple cars speeding past a pit area.  \n- A leaderboard displays track times for five drivers: #39 Michael Rotor, #94 Jay, #35 Ronald, #28 Tim Treadless, and #90 Paul Conrey.  \n- Standings show #90 Paul Conrey in 5th, #488 H.J. Hollis in 3rd, #15 Harvey Rodsop in 2nd, and #92 Shelton Shifter in 1st.\n[420-450s] - Race standings display: #90 Paul Contrev (5), #68 H.J. Hollis (3), #15 Harvey Rodcap (2), #92 Sheldon Shifter (1).\n- Group 4 - Heat 2 race begins with #90 Paul Contrev and #15 Harvey Rodcap leading, followed by #68 H.J. Hollis and #92 Sheldon Shifter.\n- Track features: \"Tennessee Motor Speedway\" signage, green grass, trees, and a pit area with blue equipment visible.\n[450-480s] - A green and white race car overtakes a blue car on a black track near a pit lane.  \n- A red helicopter hovers above the pit area, stationary.  \n- On-screen text displays race data: \"F115 Rally 4.70\", \"WRT Group 11.07\", and \"N87 L. Salle 11.07\".\n[480-510s] - Race leaderboard shows #90 Paul Conrey (1) in 1st with 8 points, #15 Harvey Rodcap (1) in 2nd with 7 points, #92 Sheldon Shifter in 3rd with 7 points, and #68 H.J. Hollis in 4th with 3 points.\n- Group 4 - Heat 3 race begins with #15 Harvey Rodcap and #92 Sheldon Shifter on track, followed by #90 Paul Conrey and #68 H.J. Hollis entering the race.\n- Cars are shown racing on a\n[510-540s] - A green race car speeds along a straight section of the track, passing a pit lane with visible garage bays and equipment.  \n- A blue car is seen in the background, positioned near the pit area, while a red car is further ahead on the track.  \n- The camera pans to show a wide view of the track, including a grassy infield with sponsor banners and a distant hillside with trees.\n[540-570s] - A replay of a miniature race track with toy cars speeding around a curved track, featuring a central grassy area with sponsor banners and a pit lane.\n- On-screen leaderboard displays rankings for four drivers: #15 Harvey Rodcap, #40 Paul Conner, #22 Shelton Shifter, and #68 H.J. Hollis, with their respective positions and points.\n- The track layout includes a prominent blue banner with cartoon characters and a red and white checkered flag at the finish line, indicating a racing event.", "history_tokens": 1015, "history_utf8_bytes": 3220, "recent_frame_times_s": [559.0, 560.0, 561.0, 562.0, 563.0, 564.0, 565.0, 566.0, 567.0, 568.0, 569.0, 570.0, 571.0, 572.0, 573.0, 574.0, 575.0, 576.0, 577.0, 578.0, 579.0, 580.0, 581.0, 582.0, 583.0, 584.0, 585.0, 586.0, 587.0, 588.0], "recent_frames_sha256": "59e4d2c4900acb06222fd1e256888a8a463ed6aefb8add44235fd9db2765b827", "num_recent_frames": 30, "tq": 716168.508043012, "t1": 716175.694180624, "ta": 716175.694180624, "te": 716175.732272991, "first_response_s": 7.186137611977756, "answer_total_s": 7.224229978979565, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 487, "content_group": "647302c426a9b2a811d1643c8f9aa886d49a1b23fa01c39218b8e9f121645748", "question": {"question_id": "sample_487_a1847_q0", "video_id": 487, "video_path": "./videos/sample_487_real.mp4", "annotation_index": 1847, "question_index": 0, "question": "What is seen in the initial scene of the video?", "options": ["A. A red racing car is parked on the track.", "B. A green racing car in the pits.", "C. A blue racing car near a curve.", "D. A red racing car sped past on the track."], "answer": "D", "time_stamp_s": 20, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_487_a1847_q0", "video_id": 487, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9e15077d0a3cea9b39b0f1162e41a46a9fd320f8fd1558e41494530f9e30d50d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "6a7497335b93cd1fc90c0b89c94eb99d918f0ddf1957ad081d0ba958c81014f0", "num_recent_frames": 21, "tq": 718582.378995638, "t1": 718596.342345142, "ta": 718596.342345142, "te": 718596.379954141, "first_response_s": 13.963349504047073, "answer_total_s": 14.000958502991125, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_487_a1847_q0", "video_id": 487, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b9f7e1bd8331588a916836c33c6e486fd5e3eeb212f39eb557bb1ea67a586e0e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "6a7497335b93cd1fc90c0b89c94eb99d918f0ddf1957ad081d0ba958c81014f0", "num_recent_frames": 21, "tq": 718644.369076108, "t1": 718649.696954374, "ta": 718649.696954374, "te": 718649.734962236, "first_response_s": 5.327878265990876, "answer_total_s": 5.365886128041893, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 487, "content_group": "647302c426a9b2a811d1643c8f9aa886d49a1b23fa01c39218b8e9f121645748", "question": {"question_id": "sample_487_a1848_q1", "video_id": 487, "video_path": "./videos/sample_487_real.mp4", "annotation_index": 1848, "question_index": 1, "question": "Which racing car won first place in this competition?", "options": ["A. The purple car.", "B. The blue car.", "C. The yellow car.", "D. The red car."], "answer": "D", "time_stamp_s": 88, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_487_a1848_q1", "video_id": 487, "time_stamp_s": 88, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "510dbd639eac5b9bf20df45955e7fcc3bccccf39cef2e34a9e1eb25f17a74307", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0], "recent_frames_sha256": "1544246137c5a2356e687b6e56e23948c4314506ed37ab54c1f58cfe5ab7e998", "num_recent_frames": 30, "tq": 718596.390970726, "t1": 718609.141671204, "ta": 718609.141671204, "te": 718609.182247998, "first_response_s": 12.750700477976352, "answer_total_s": 12.791277271928266, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_487_a1848_q1", "video_id": 487, "time_stamp_s": 88, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "124f145431b99bf87ac266811d5e345076f383b0ea23745604ba80da26b2233c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Three diecast cars (blue #74, purple #79, yellow #33, red Lightning McQueen) line up on a track for \"Round 1 - Group 1\" race.  \n- The track curves through a miniature landscape with green hills, trees, and a \"Legacy Piston Cup\" banner overhead.  \n- A \"NEXT GEN DIECAST RACING\" title card appears briefly before the race scene.\n[30-60s] - Yellow #56 Brush Curber car shown in close-up, stationary on track with team name overlay.\n- Blue #70 Floyd McHill car displayed, stationary, with team name overlay.\n- Purple #79 Haul Inngas car shown, stationary, with team name overlay.\n- Red #95 Lightning McQueen car shown, stationary, with team name overlay.", "history_tokens": 183, "history_utf8_bytes": 660, "recent_frame_times_s": [59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0], "recent_frames_sha256": "1544246137c5a2356e687b6e56e23948c4314506ed37ab54c1f58cfe5ab7e998", "num_recent_frames": 30, "tq": 718666.301677133, "t1": 718673.913528182, "ta": 718673.913528182, "te": 718673.95103407, "first_response_s": 7.611851049005054, "answer_total_s": 7.649356937035918, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 487, "content_group": "647302c426a9b2a811d1643c8f9aa886d49a1b23fa01c39218b8e9f121645748", "question": {"question_id": "sample_487_a1848_q0", "video_id": 487, "video_path": "./videos/sample_487_real.mp4", "annotation_index": 1848, "question_index": 0, "question": "What was being advertised on the blue billboard?", "options": ["A. Speedy Cars.", "B. Toy Race.", "C. Crazy Cars.", "D. Miniature Motors."], "answer": "C", "time_stamp_s": 120, "task_type": "Text-Rich Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_487_a1848_q0", "video_id": 487, "time_stamp_s": 120, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "36a3102a08361136529de74485ada058b3babb65d7115bca5ad3e1fbe3052447", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0], "recent_frames_sha256": "681a6107aed20e1c950d1a64708c832950fb790d70ec57e9b6f58f562569ec85", "num_recent_frames": 30, "tq": 718609.195173543, "t1": 718619.020521106, "ta": 718619.020521106, "te": 718619.060111751, "first_response_s": 9.825347563019022, "answer_total_s": 9.86493820801843, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_487_a1848_q0", "video_id": 487, "time_stamp_s": 120, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "eb98eb74dfdcbada2edc25be234ec12ff9f5ea84622326b9cba4b273248594fc", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Three diecast cars (blue #74, purple #79, yellow #33, red Lightning McQueen) line up on a track for \"Round 1 - Group 1\" race.  \n- The track curves through a miniature landscape with green hills, trees, and a \"Legacy Piston Cup\" banner overhead.  \n- A \"NEXT GEN DIECAST RACING\" title card appears briefly before the race scene.\n[30-60s] - Yellow #56 Brush Curber car shown in close-up, stationary on track with team name overlay.\n- Blue #70 Floyd McHill car displayed, stationary, with team name overlay.\n- Purple #79 Haul Inngas car shown, stationary, with team name overlay.\n- Red #95 Lightning McQueen car shown, stationary, with team name overlay.\n[60-90s] - Race 2 cars (70 Floyd Mulvihill and 56 Brush Curber) are shown on the track, with 70 Floyd Mulvihill in front.  \n- The track features a grassy hillside and a pit area with parked vehicles and a helicopter overhead.  \n- A digital display shows \"Instant Replay\" as the race progresses, with cars speeding along the track.\n[90-120s] - Instant replay shows race cars speeding along a winding track with a pit area visible in the background.  \n- A leaderboard displays standings: #495 Lightning McQueen (1) leads, followed by #56 Brush Curber (3), #77 Floyd Mulvihill (2), and #79 Haul Inngas (0).  \n- The camera angle shifts between dynamic race views and static leaderboard displays.", "history_tokens": 371, "history_utf8_bytes": 1352, "recent_frame_times_s": [91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0], "recent_frames_sha256": "681a6107aed20e1c950d1a64708c832950fb790d70ec57e9b6f58f562569ec85", "num_recent_frames": 30, "tq": 718685.657646969, "t1": 718687.565771037, "ta": 718687.565771037, "te": 718687.975526645, "first_response_s": 1.9081240680534393, "answer_total_s": 2.3178796760039404, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 487, "content_group": "647302c426a9b2a811d1643c8f9aa886d49a1b23fa01c39218b8e9f121645748", "question": {"question_id": "sample_487_a1849_q0", "video_id": 487, "video_path": "./videos/sample_487_real.mp4", "annotation_index": 1849, "question_index": 0, "question": "What is the color of the car that leads the race right now?", "options": ["A. Red.", "B. Blue.", "C. Yellow.", "D. Purple."], "answer": "C", "time_stamp_s": 207, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_487_a1849_q0", "video_id": 487, "time_stamp_s": 207, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4a5a55fdc8737c7e025c45977d527d45d48d7786aec2d91d0ef8589cd3f50028", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0], "recent_frames_sha256": "abad5d5fec0d7f65fa67b1cd0b79cb7a4edcfc7507e120619a8f753704439f8e", "num_recent_frames": 30, "tq": 718619.073093436, "t1": 718631.513195687, "ta": 718631.513195687, "te": 718631.550499094, "first_response_s": 12.440102251013741, "answer_total_s": 12.477405657991767, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_487_a1849_q0", "video_id": 487, "time_stamp_s": 207, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2ba5afb344b8e4a99c71b4ef84349a5c520ea50876561c9c423ae2e3f6fe98fa", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Three diecast cars (blue #74, purple #79, yellow #33, red Lightning McQueen) line up on a track for \"Round 1 - Group 1\" race.  \n- The track curves through a miniature landscape with green hills, trees, and a \"Legacy Piston Cup\" banner overhead.  \n- A \"NEXT GEN DIECAST RACING\" title card appears briefly before the race scene.\n[30-60s] - Yellow #56 Brush Curber car shown in close-up, stationary on track with team name overlay.\n- Blue #70 Floyd McHill car displayed, stationary, with team name overlay.\n- Purple #79 Haul Inngas car shown, stationary, with team name overlay.\n- Red #95 Lightning McQueen car shown, stationary, with team name overlay.\n[60-90s] - Race 2 cars (70 Floyd Mulvihill and 56 Brush Curber) are shown on the track, with 70 Floyd Mulvihill in front.  \n- The track features a grassy hillside and a pit area with parked vehicles and a helicopter overhead.  \n- A digital display shows \"Instant Replay\" as the race progresses, with cars speeding along the track.\n[90-120s] - Instant replay shows race cars speeding along a winding track with a pit area visible in the background.  \n- A leaderboard displays standings: #495 Lightning McQueen (1) leads, followed by #56 Brush Curber (3), #77 Floyd Mulvihill (2), and #79 Haul Inngas (0).  \n- The camera angle shifts between dynamic race views and static leaderboard displays.\n[120-150s] - Race 2 begins with #179 Haul Inngas and #56 Brush Curber leading, followed by #95 Lightning McQueen and #70 Floyd Mulvihill.\n- Cars navigate a winding track with green hills, trees, and a blue sky backdrop, passing billboards and a pit area.\n- The camera pans to show the race progression, highlighting the cars' positions and movement along the track.\n[150-180s] - Orange car (F99 Lightning McQueen) leads the race, followed by blue car (F79 Haul Ingas) and yellow car (F70 Floyd Mulvihill) in second and third positions respectively.\n- The race track features a curved section with grassy areas and a pit lane with parked cars and a helicopter overhead.\n- A leaderboard overlay displays current standings with McQueen in first, Ingas in second, and Mulvihill in third, with a \"STANDINGS\" title visible.", "history_tokens": 588, "history_utf8_bytes": 2170, "recent_frame_times_s": [178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0], "recent_frames_sha256": "abad5d5fec0d7f65fa67b1cd0b79cb7a4edcfc7507e120619a8f753704439f8e", "num_recent_frames": 30, "tq": 718709.284618819, "t1": 718716.392139028, "ta": 718716.392139028, "te": 718716.436551591, "first_response_s": 7.107520208926871, "answer_total_s": 7.151932772016153, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 487, "content_group": "647302c426a9b2a811d1643c8f9aa886d49a1b23fa01c39218b8e9f121645748", "question": {"question_id": "sample_487_a1850_q0", "video_id": 487, "video_path": "./videos/sample_487_real.mp4", "annotation_index": 1850, "question_index": 0, "question": "What is the position of Lightning McQueen in the standings for the Group 1 final?", "options": ["A. First.", "B. Second.", "C. Third.", "D. Fourth."], "answer": "B", "time_stamp_s": 320, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [300, 354], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_487_a1850_q0", "video_id": 487, "time_stamp_s": 320, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5de53219115d6893e81bf35717e3ef1acab8043fc6a126963dfa576aec9c70bf", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0], "recent_frames_sha256": "acdd3e3c854e0b053c44a972c384c0c2fa2cf74ab0cb086350e03aabd9f96237", "num_recent_frames": 30, "tq": 718631.559348398, "t1": 718644.322199263, "ta": 718644.322199263, "te": 718644.360037536, "first_response_s": 12.76285086502321, "answer_total_s": 12.800689138006419, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_487_a1850_q0", "video_id": 487, "time_stamp_s": 320, "ground_truth": "B", "raw_output": "A. First.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "df63aa231aa6473ddf0b594dad08ae78bca54fc083dc53021ccbb23b0db6b64a", "condition_order": ["recent", "notes"], "memory": "[30-60s] - Yellow #56 Brush Curber car shown in close-up, stationary on track with team name overlay.\n- Blue #70 Floyd McHill car displayed, stationary, with team name overlay.\n- Purple #79 Haul Inngas car shown, stationary, with team name overlay.\n- Red #95 Lightning McQueen car shown, stationary, with team name overlay.\n[60-90s] - Race 2 cars (70 Floyd Mulvihill and 56 Brush Curber) are shown on the track, with 70 Floyd Mulvihill in front.  \n- The track features a grassy hillside and a pit area with parked vehicles and a helicopter overhead.  \n- A digital display shows \"Instant Replay\" as the race progresses, with cars speeding along the track.\n[90-120s] - Instant replay shows race cars speeding along a winding track with a pit area visible in the background.  \n- A leaderboard displays standings: #495 Lightning McQueen (1) leads, followed by #56 Brush Curber (3), #77 Floyd Mulvihill (2), and #79 Haul Inngas (0).  \n- The camera angle shifts between dynamic race views and static leaderboard displays.\n[120-150s] - Race 2 begins with #179 Haul Inngas and #56 Brush Curber leading, followed by #95 Lightning McQueen and #70 Floyd Mulvihill.\n- Cars navigate a winding track with green hills, trees, and a blue sky backdrop, passing billboards and a pit area.\n- The camera pans to show the race progression, highlighting the cars' positions and movement along the track.\n[150-180s] - Orange car (F99 Lightning McQueen) leads the race, followed by blue car (F79 Haul Ingas) and yellow car (F70 Floyd Mulvihill) in second and third positions respectively.\n- The race track features a curved section with grassy areas and a pit lane with parked cars and a helicopter overhead.\n- A leaderboard overlay displays current standings with McQueen in first, Ingas in second, and Mulvihill in third, with a \"STANDINGS\" title visible.\n[180-210s] - Standings display shows #95 Lightning McQueen in 1st, #179 Haul Ingas in 2nd, #70 Floyd Mulvihill in 3rd, and #56 Brush Curber in 4th.\n- Race 3 Group 1 scene features #56 Brush Curber and #70 Floyd Mulvihill racing closely on a track with grassy terrain and trees.\n- Race 3 Group 1 scene transitions to show #179 Haul Ingas and #95 Lightning McQueen racing on a track with a sign reading \"SOUTH B\n[210-240s] - Cars race on a track with a pit area visible in the background, including a red helicopter hovering above.\n- A leaderboard appears showing top 4 positions: #95 Lightning McQueen, #50 Brush Curber, #79 Haul Ingalls, and #70 Floyd Mulvihill.\n- The camera angle shifts between a side view of the track and a top-down view during the replay segment.\n[240-270s] - Standings overlay shows #95 Lightning McQueen in 1st place with 10 points, #56 Brush Curber in 2nd with 8 points, and #79 Haul Inngas in 3rd with 7 points.\n- Group 1 - Race 4 graphic appears with cars #70 Floyd Mulvihill and #95 Lightning McQueen positioned on the track.\n- Cars #70 Floyd Mulvihill and #95 Lightning McQueen are shown racing side-by-side on a track with grassy terrain and trees in the background.\n[270-300s] - Yellow car leads a pack of colorful toy cars on a winding track, with a blue car closely trailing.  \n- A purple car overtakes a yellow car near the pit area, with a red car following behind.  \n- The track features a grassy section with sponsor banners and a pit lane with parked cars and a helicopter overhead.", "history_tokens": 938, "history_utf8_bytes": 3354, "recent_frame_times_s": [291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0, 299.0, 300.0, 301.0, 302.0, 303.0, 304.0, 305.0, 306.0, 307.0, 308.0, 309.0, 310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0], "recent_frames_sha256": "acdd3e3c854e0b053c44a972c384c0c2fa2cf74ab0cb086350e03aabd9f96237", "num_recent_frames": 30, "tq": 718752.379982425, "t1": 718753.440869499, "ta": 718753.440869499, "te": 718753.592399622, "first_response_s": 1.0608870739815757, "answer_total_s": 1.2124171969480813, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 488, "content_group": "74b3094dd75472c952c8826b2dbf32af4e2897018588ad921fc0ac1b400ed0b4", "question": {"question_id": "sample_488_a2126_q0", "video_id": 488, "video_path": "./videos/sample_488_real.mp4", "annotation_index": 2126, "question_index": 0, "question": "What group numbers are displayed for the race participants?", "options": ["A. Group 1 and 2.", "B. Group 3 and 4.", "C. Group 5 and 6.", "D. Group 7 and 8."], "answer": "D", "time_stamp_s": 20, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_488_a2126_q0", "video_id": 488, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b0d1815cd6e7e39f59c30421f582826710350367f8a1e3f3cd662a57c04ab2d3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "71276e1d810fd37a8f143585a0e177850bfe0004a221ad54d251d3b3f7182984", "num_recent_frames": 21, "tq": 718384.898538805, "t1": 718390.500461205, "ta": 718390.500461205, "te": 718390.538110778, "first_response_s": 5.601922400062904, "answer_total_s": 5.639571973006241, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_488_a2126_q0", "video_id": 488, "time_stamp_s": 20, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e6feea2cc0e7d318e4a80b6f6e24cdf1101d44ed038c724ce0177dd27c1a5a84", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "71276e1d810fd37a8f143585a0e177850bfe0004a221ad54d251d3b3f7182984", "num_recent_frames": 21, "tq": 718432.880175456, "t1": 718438.97332018, "ta": 718438.97332018, "te": 718439.011235954, "first_response_s": 6.093144723912701, "answer_total_s": 6.131060497951694, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 488, "content_group": "74b3094dd75472c952c8826b2dbf32af4e2897018588ad921fc0ac1b400ed0b4", "question": {"question_id": "sample_488_a2127_q0", "video_id": 488, "video_path": "./videos/sample_488_real.mp4", "annotation_index": 2127, "question_index": 0, "question": "Which racing car won first place in this competition?", "options": ["A. The orange car.", "B. The blue car.", "C. The red car.", "D. The grey car."], "answer": "D", "time_stamp_s": 88, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_488_a2127_q0", "video_id": 488, "time_stamp_s": 88, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "14c0361debac106eb06c1ea001b4f38c6ec974163a2869b79426b0087bb4d64b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0], "recent_frames_sha256": "2342e23a3f167f875b9f2c41509112f9978469a405acb7ba1c45986c790cfdd3", "num_recent_frames": 30, "tq": 718390.554477122, "t1": 718402.269641055, "ta": 718402.269641055, "te": 718402.590154953, "first_response_s": 11.715163932996802, "answer_total_s": 12.035677830921486, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_488_a2127_q0", "video_id": 488, "time_stamp_s": 88, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e0ddecb0a6f48a9c03a7a661ca069d042e9b0d7e4b3d064aa6656ae15dd38585", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Orange diecast car #21, Bryan Laney, from Norm and Vern Racing, positioned 21st in 10 positions with a 9.301-second fastest time.  \n- Group 7 and 8 cars are lined up on a track with a Walmart garage backdrop, featuring various colored diecast vehicles.  \n- The scene transitions to a title screen for \"Next-Gen Diecast Racing\" with a racing track and cars in motion.\n[30-60s] - #21 Ryan Laney (orange car) is shown in Group 7, positioned 2nd with a fastest time of 9.201.\n- #28 Treadless (orange and silver car) is in 16th place with a heat time of 8.417.\n- #57 Junyi (white and purple car) is ranked 4th with a heat time of 8.553.", "history_tokens": 206, "history_utf8_bytes": 641, "recent_frame_times_s": [59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0], "recent_frames_sha256": "2342e23a3f167f875b9f2c41509112f9978469a405acb7ba1c45986c790cfdd3", "num_recent_frames": 30, "tq": 718457.702248415, "t1": 718459.196678682, "ta": 718459.196678682, "te": 718459.423117397, "first_response_s": 1.4944302670191973, "answer_total_s": 1.7208689820254222, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 488, "content_group": "74b3094dd75472c952c8826b2dbf32af4e2897018588ad921fc0ac1b400ed0b4", "question": {"question_id": "sample_488_a2130_q0", "video_id": 488, "video_path": "./videos/sample_488_real.mp4", "annotation_index": 2130, "question_index": 0, "question": "Which team won first place in Race 2 competition?", "options": ["A. Dom's Tuner Shop.", "B. VCD132 Racing.", "C. Krime Sindakit Racing.", "D. Elst Racing."], "answer": "A", "time_stamp_s": 88, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [600, 648], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_488_a2130_q0", "video_id": 488, "time_stamp_s": 88, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2fabd6e4429bd00d7d574a119b18f9cf13028c93c9ef48782a472f3b65cc85c2", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0], "recent_frames_sha256": "2342e23a3f167f875b9f2c41509112f9978469a405acb7ba1c45986c790cfdd3", "num_recent_frames": 30, "tq": 718402.604791833, "t1": 718414.465833676, "ta": 718414.465833676, "te": 718414.505505494, "first_response_s": 11.861041843076237, "answer_total_s": 11.900713660987094, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_488_a2130_q0", "video_id": 488, "time_stamp_s": 88, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fc47c2d1b8393e666baf43e863020fc85bf4496661fc8038bc02642126de5518", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Orange diecast car #21, Bryan Laney, from Norm and Vern Racing, positioned 21st in 10 positions with a 9.301-second fastest time.  \n- Group 7 and 8 cars are lined up on a track with a Walmart garage backdrop, featuring various colored diecast vehicles.  \n- The scene transitions to a title screen for \"Next-Gen Diecast Racing\" with a racing track and cars in motion.\n[30-60s] - #21 Ryan Laney (orange car) is shown in Group 7, positioned 2nd with a fastest time of 9.201.\n- #28 Treadless (orange and silver car) is in 16th place with a heat time of 8.417.\n- #57 Junyi (white and purple car) is ranked 4th with a heat time of 8.553.", "history_tokens": 206, "history_utf8_bytes": 641, "recent_frame_times_s": [59.0, 60.0, 61.0, 62.0, 63.0, 64.0, 65.0, 66.0, 67.0, 68.0, 69.0, 70.0, 71.0, 72.0, 73.0, 74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0], "recent_frames_sha256": "2342e23a3f167f875b9f2c41509112f9978469a405acb7ba1c45986c790cfdd3", "num_recent_frames": 30, "tq": 718459.45289694, "t1": 718469.978701399, "ta": 718469.978701399, "te": 718470.277013295, "first_response_s": 10.525804459000938, "answer_total_s": 10.824116354924627, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 488, "content_group": "74b3094dd75472c952c8826b2dbf32af4e2897018588ad921fc0ac1b400ed0b4", "question": {"question_id": "sample_488_a2128_q0", "video_id": 488, "video_path": "./videos/sample_488_real.mp4", "annotation_index": 2128, "question_index": 0, "question": "What is the fastest time achieved by Jay's car from team VCD132 Racing?", "options": ["A. 9.495 seconds.", "B. 9.791 seconds.", "C. 8.267 seconds.", "D. 8.999 seconds."], "answer": "C", "time_stamp_s": 339, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_488_a2128_q0", "video_id": 488, "time_stamp_s": 339, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "55a6362debfc6d0e3c7a2382287c8cf91da8b6ad3e9e027e2f77e6b5d5c4b3fa", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0], "recent_frames_sha256": "fcecdebd691f8521010943a3db3b8a2b4411bd39be7a0a0e24f304b5df0ed6c1", "num_recent_frames": 30, "tq": 718414.517147693, "t1": 718422.37148366, "ta": 718422.37148366, "te": 718422.40969982, "first_response_s": 7.854335966985673, "answer_total_s": 7.892552127013914, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_488_a2128_q0", "video_id": 488, "time_stamp_s": 339, "ground_truth": "C", "raw_output": "C. 8.267 seconds.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "513f40220b37841cb21021b61b48792a25f346e4313728f5406fb44275f15bac", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Orange car #123 Jonas Carvers leads the pack, followed closely by silver car #157 Junyi, both navigating a curved track section.  \n- A white car #121 Ryan Laney is positioned behind the orange car, while a red car #28 Tim Treadless trails further back.  \n- The track features green grass, trees, and a pit stop area with parked vehicles and a red helicopter overhead.\n[90-120s] - Race track with cars speeding past a pit area featuring blue and white vehicles under a clear sky.\n- On-screen leaderboard shows #57 Junyi (1) in 1st place, #123 Jonas Carvers (3) in 2nd, #21 Ryan Laney (2) in 3rd, and #28 Tim Treadless (1) in 4th.\n- Cars are positioned on a track with a grassy hillside and a red helicopter hovering above the pit area.\n[120-150s] - Orange car (#123 Jonas Carvers) leads white car (#128 Tim Treadless) through a turn, both near the track’s outer edge.  \n- A blue car (#121 Larry) is visible in the background, positioned behind the orange car.  \n- The track features a pit lane with parked cars and a red helicopter hovering above the pit area.\n[150-180s] - Orange car speeds through a curved track section, overtaking another vehicle.  \n- Red fire truck and blue-yellow truck are positioned near a pit lane, with the fire truck slightly ahead.  \n- Standings overlay displays top four drivers: #21 Ryan Laney (7), #123 Jonas Carvers (6), #57 Juney (5), and #28 Tim Treadless (3).\n[180-210s] - Standings display shows #21 Ryan Laney (1st, 7 points), #123 Jonas Carvers (2nd, 6 points), #57 Junyi (3rd, 5 points), and #28 Tim Treadless (4th, 3 points).\n- Group 7: Heat 3 starts with cars positioned on the track: #21 Ryan Laney (Row 1), #28 Tim Treadless (Row 1), #57 Junyi (Row 2), and #123 Jonas Carvers (Row 2).\n- Cars begin\n[210-240s] - Orange race car speeds along straight track past pit area with visible pit crew and parked cars.\n- Green grassy area with red and white barriers and sponsor signs (e.g., \"Volkswagen\") visible in background.\n- On-screen leaderboard shows #121 Ryan Lany, #457 Junny, #123 Jonas Carveis, and #28 Tim Treadless with their respective positions.\n[240-270s] - Standings display shows #21 Ryan Laney (12), #57 Junyi (7), #123 Jonas Carvers (6), and #28 Tim Treadless (6) with race positions.\n- Group 7, Heat 4 race begins with cars on a track labeled \"HUNTER MOTOR SPEEDWAY,\" featuring green grass, trees, and a blue sky.\n- Cars #28 Tim Treadless and #123 Jonas Carvers are in Row 1, while #21 Ryan Laney and #57 Junyi are in Row 2, positioned for the\n[270-300s] - A white car speeds along a black track, passing a white line marker near a pit area with parked cars and a red helicopter overhead.\n- The track is bordered by a fence with sponsor logos, and a grassy hillside is visible in the background.\n- A leaderboard overlay displays track times for five drivers, with #39 Michael Rotor leading at 8.103 seconds.\n[300-330s] - Track times display for 5 drivers, with #121 Ryan Laney leading at 13 points.\n- Standings show #121 Ryan Laney in 1st place with 13 points, followed by #123 Jonas Carvers in 2nd with 11 points.\n- #57 Junny and #28 Tim Treadless are in 3rd and 4th respectively, with 9 points each.", "history_tokens": 970, "history_utf8_bytes": 3168, "recent_frame_times_s": [310.0, 311.0, 312.0, 313.0, 314.0, 315.0, 316.0, 317.0, 318.0, 319.0, 320.0, 321.0, 322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0], "recent_frames_sha256": "fcecdebd691f8521010943a3db3b8a2b4411bd39be7a0a0e24f304b5df0ed6c1", "num_recent_frames": 30, "tq": 718543.547133165, "t1": 718544.542096624, "ta": 718544.542096624, "te": 718544.913209926, "first_response_s": 0.9949634590884671, "answer_total_s": 1.366076761041768, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 488, "content_group": "74b3094dd75472c952c8826b2dbf32af4e2897018588ad921fc0ac1b400ed0b4", "question": {"question_id": "sample_488_a2129_q0", "video_id": 488, "video_path": "./videos/sample_488_real.mp4", "annotation_index": 2129, "question_index": 0, "question": "Which racing car won first place in this competition?", "options": ["A. The orange car.", "B. The yellow car.", "C. The red car.", "D. The grey car."], "answer": "B", "time_stamp_s": 481, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_488_a2129_q0", "video_id": 488, "time_stamp_s": 481, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ccc6166e957e72b09a06eb200845ba9b0c26eb5a005e46dd0e06c52c2a5f4c8f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [452.0, 453.0, 454.0, 455.0, 456.0, 457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0], "recent_frames_sha256": "e6b95cf3aabd98d34c8f415273aef54a0e99b044f4e77c0245f54b98880d65de", "num_recent_frames": 30, "tq": 718422.420911649, "t1": 718432.835648519, "ta": 718432.835648519, "te": 718432.872409701, "first_response_s": 10.414736869977787, "answer_total_s": 10.451498051988892, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_488_a2129_q0", "video_id": 488, "time_stamp_s": 481, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c0c25954918c51ebcc5113d833dfceb2f7fd58c73f73b6b941ef5577c794287c", "condition_order": ["recent", "notes"], "memory": "[210-240s] - Orange race car speeds along straight track past pit area with visible pit crew and parked cars.\n- Green grassy area with red and white barriers and sponsor signs (e.g., \"Volkswagen\") visible in background.\n- On-screen leaderboard shows #121 Ryan Lany, #457 Junny, #123 Jonas Carveis, and #28 Tim Treadless with their respective positions.\n[240-270s] - Standings display shows #21 Ryan Laney (12), #57 Junyi (7), #123 Jonas Carvers (6), and #28 Tim Treadless (6) with race positions.\n- Group 7, Heat 4 race begins with cars on a track labeled \"HUNTER MOTOR SPEEDWAY,\" featuring green grass, trees, and a blue sky.\n- Cars #28 Tim Treadless and #123 Jonas Carvers are in Row 1, while #21 Ryan Laney and #57 Junyi are in Row 2, positioned for the\n[270-300s] - A white car speeds along a black track, passing a white line marker near a pit area with parked cars and a red helicopter overhead.\n- The track is bordered by a fence with sponsor logos, and a grassy hillside is visible in the background.\n- A leaderboard overlay displays track times for five drivers, with #39 Michael Rotor leading at 8.103 seconds.\n[300-330s] - Track times display for 5 drivers, with #121 Ryan Laney leading at 13 points.\n- Standings show #121 Ryan Laney in 1st place with 13 points, followed by #123 Jonas Carvers in 2nd with 11 points.\n- #57 Junny and #28 Tim Treadless are in 3rd and 4th respectively, with 9 points each.\n[330-360s] - #70 Richie Gunzit's blue and purple car is shown in a static display with a \"Group 8\" label and position details.\n- #94 Jay's white and blue car is displayed with \"Group 8\" and position details, including \"Heat 2\" and \"Fastest Time: 8.267\".\n- #39 Michael Rotor's blue car is shown with \"Group 8\" and position details, including \"Heat 4\" and \"Fastest Time: 8.103\".\n[360-390s] - Blue car speeds along track, overtaking yellow car near pit area.\n- Yellow car crosses finish line ahead of blue car, with \"Replay\" overlay indicating a rewind.\n- Standings display shows #70 Richie Gunnit \"11\" in 5th, #494 Jay in 3rd, and #52 George New-Win in 1st.\n[390-420s] - Standings overlay shows #170 Richie Gunzit with 5 points, #194 Jay with 3, #139 Michael Rotor with 2, and #152 George New-Win with 1.\n- Group 8 - Heat 2 race begins with #152 George New-Win and #194 Jay in Row 1, followed by #139 Michael Rotor and #170 Richie Gunzit in Row 2.\n- Race track features a sharp turn with a \"Bridgestone\" sign, then a straightaway leading to a\n[420-450s] - Blue car (FZ2 George New-Win) overtakes yellow car (F70 Richie Gunzit) on the track.\n- Yellow car (F70 Richie Gunzit) is positioned ahead of blue car (FZ2 George New-Win) in the standings.\n- Standings overlay shows FZ2 George New-Win in 4th place with 4 points, while F70 Richie Gunzit is in 2nd with 6 points.\n[450-480s] - Yellow #52 George New Win car leads a pack of three cars on a winding track, with #170 Richie Gunzit in second and #194 Jay in third.\n- The track features a grassy hillside, a \"Duke\" sign, and a pit area with a red helicopter overhead.\n- A scoreboard at 475 seconds shows #52 George New Win with 11.54 seconds, #194 Jay with 13.50, and #170 Richie Gunzit with 12.80.", "history_tokens": 1024, "history_utf8_bytes": 3159, "recent_frame_times_s": [452.0, 453.0, 454.0, 455.0, 456.0, 457.0, 458.0, 459.0, 460.0, 461.0, 462.0, 463.0, 464.0, 465.0, 466.0, 467.0, 468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0], "recent_frames_sha256": "e6b95cf3aabd98d34c8f415273aef54a0e99b044f4e77c0245f54b98880d65de", "num_recent_frames": 30, "tq": 718588.498401224, "t1": 718595.773688455, "ta": 718595.773688455, "te": 718595.814742536, "first_response_s": 7.27528723096475, "answer_total_s": 7.316341312020086, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 489, "content_group": "e62a34df413227a76396324a7e9c8a2a4dfd0d304473ffbf414b44e880ed5292", "question": {"question_id": "sample_489_a619_q0", "video_id": 489, "video_path": "./videos/sample_489_real.mp4", "annotation_index": 619, "question_index": 0, "question": "What does the subtitle below the title card read right now?", "options": ["A. \"The New Era of Toy Racing\".", "B. \"The Future of Car Racing\".", "C. \"The Next Generation of Diecast Racing\".", "D. \"Ultimate Toy Car Showdown\"."], "answer": "C", "time_stamp_s": 5, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_489_a619_q0", "video_id": 489, "time_stamp_s": 5, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "974c84b28169e9bcbc84b16026b8f91e593cab258f247c0cb97dadccb29149c5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "c5683b5538d8c0b3d76fa4be0421db401d34822e323612de069835e26eae1be0", "num_recent_frames": 6, "tq": 718197.213596101, "t1": 718198.086542919, "ta": 718198.086542919, "te": 718198.12635034, "first_response_s": 0.8729468180099502, "answer_total_s": 0.9127542389323935, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_489_a619_q0", "video_id": 489, "time_stamp_s": 5, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "7870a7875b998d518575764cc821e6efa04bd6aa3cb3698ca0eda6e63be59d60", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0], "recent_frames_sha256": "c5683b5538d8c0b3d76fa4be0421db401d34822e323612de069835e26eae1be0", "num_recent_frames": 6, "tq": 718232.479921357, "t1": 718238.863989258, "ta": 718238.863989258, "te": 718239.057082017, "first_response_s": 6.384067900944501, "answer_total_s": 6.577160659944639, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 489, "content_group": "e62a34df413227a76396324a7e9c8a2a4dfd0d304473ffbf414b44e880ed5292", "question": {"question_id": "sample_489_a620_q0", "video_id": 489, "video_path": "./videos/sample_489_real.mp4", "annotation_index": 620, "question_index": 0, "question": "Which car is in the front row along with car #2.0 at the start of the race?", "options": ["A. Car #21.", "B. Car #123.", "C. Car #94.", "D. Car #3."], "answer": "A", "time_stamp_s": 165, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_489_a620_q0", "video_id": 489, "time_stamp_s": 165, "ground_truth": "A", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a3ede3399f413271fab06c81452594daad4b19e242690053cc1abdd78e093735", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0], "recent_frames_sha256": "3a018b692a91550ed97c0e8095eed70ed173dd5aa24cd49b24d027732b99f6e3", "num_recent_frames": 30, "tq": 718198.148865386, "t1": 718208.384130818, "ta": 718208.384130818, "te": 718208.421270709, "first_response_s": 10.235265431925654, "answer_total_s": 10.27240532299038, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_489_a620_q0", "video_id": 489, "time_stamp_s": 165, "ground_truth": "A", "raw_output": "B. Car #123.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "9280132ca2596568a1427ddf9743f71eac57701af3a568eb8b5c3683714316d7", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Black diecast car #2.0 Jackson Storm, Team: Krime Sindakdt Racing, positioned 16th (24 pts) with 3 heat wins and 0.933 fastest time, shown in Group 1.\n- Orange diecast car #21 Ryan Langley, Team: Norm and Vern Racing, positioned 1st (32 pts) with 3 heat wins and 3.701 fastest time, shown in Group 1.\n- Both cars are displayed on a track with a Walmart backdrop and racing signage, indicating a diecast racing event setup.\n[30-60s] - #21 Ryan Laney (orange car) is shown in a close-up, positioned 11th with a heat time of 9.701.  \n- #123 Jonas Carvers (red car) is shown in a close-up, positioned 5th with a heat time of 8.183.  \n- #94 Jay (white car) is shown in a close-up, positioned 1st with a heat time of 8.267.\n[60-90s] - Cars race along a winding track with visible sponsor signs like \"TBR\" and \"DB\" on billboards.  \n- A blue car overtakes a red car near the track’s curve, with other cars following closely behind.  \n- The track features grassy areas, barriers, and pit stations with parked vehicles and equipment.\n[90-120s] - Race track view shows cars speeding along a curved section with a \"TBS\" sign visible in the background.\n- On-screen leaderboard displays standings for four drivers: #94 Jay '11' (5 points), #2.0 Jackson Storm (3 points), #123 Jonas Carvers (2 points), and #21 Ryan Laney (0 points).\n- Cars are positioned in rows on the track, with #123 Jonas Carvers and #2.0 Jackson Storm in Row 1, and #94 Jay '11' and #21 Ryan Laney in Row 2,\n[120-150s] - Race cars, including #23 O. Jackson Storm and #123 J. Carveis, are shown speeding along a track with visible pit areas and sponsor banners.\n- A \"Replay\" overlay appears, showing the same race sequence from a different angle, emphasizing the cars' positions and movements.\n- A leaderboard overlay displays current standings with car numbers, driver names, and lap counts, indicating #23 O. Jackson Storm leads with 8 laps completed.", "history_tokens": 562, "history_utf8_bytes": 1922, "recent_frame_times_s": [136.0, 137.0, 138.0, 139.0, 140.0, 141.0, 142.0, 143.0, 144.0, 145.0, 146.0, 147.0, 148.0, 149.0, 150.0, 151.0, 152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0], "recent_frames_sha256": "3a018b692a91550ed97c0e8095eed70ed173dd5aa24cd49b24d027732b99f6e3", "num_recent_frames": 30, "tq": 718277.662678646, "t1": 718285.059532794, "ta": 718285.059532794, "te": 718285.359480755, "first_response_s": 7.396854148013517, "answer_total_s": 7.696802109014243, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 489, "content_group": "e62a34df413227a76396324a7e9c8a2a4dfd0d304473ffbf414b44e880ed5292", "question": {"question_id": "sample_489_a621_q0", "video_id": 489, "video_path": "./videos/sample_489_real.mp4", "annotation_index": 621, "question_index": 0, "question": "Which racing car won first place in this competition?", "options": ["A. The pink car.", "B. The dark green car.", "C. The light green car.", "D. The blue car."], "answer": "B", "time_stamp_s": 351, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_489_a621_q0", "video_id": 489, "time_stamp_s": 351, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "46d57e1d8587783853239a19b10bebf0f3520fb9d9f7998812f70f3f0958884d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0], "recent_frames_sha256": "2abd1c2b81425f1e64c3f9f5ab3d4db404e76158925f2714a669bb6d867c93c1", "num_recent_frames": 30, "tq": 718208.440318569, "t1": 718217.329653284, "ta": 718217.329653284, "te": 718217.371909578, "first_response_s": 8.889334715087898, "answer_total_s": 8.931591009022668, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_489_a621_q0", "video_id": 489, "time_stamp_s": 351, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e4ed6e389d24964e3ac398052b4406f363cf530b032ed5325d366dd7212cab9b", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Cars race along a winding track with visible sponsor signs like \"TBR\" and \"DB\" on billboards.  \n- A blue car overtakes a red car near the track’s curve, with other cars following closely behind.  \n- The track features grassy areas, barriers, and pit stations with parked vehicles and equipment.\n[90-120s] - Race track view shows cars speeding along a curved section with a \"TBS\" sign visible in the background.\n- On-screen leaderboard displays standings for four drivers: #94 Jay '11' (5 points), #2.0 Jackson Storm (3 points), #123 Jonas Carvers (2 points), and #21 Ryan Laney (0 points).\n- Cars are positioned in rows on the track, with #123 Jonas Carvers and #2.0 Jackson Storm in Row 1, and #94 Jay '11' and #21 Ryan Laney in Row 2,\n[120-150s] - Race cars, including #23 O. Jackson Storm and #123 J. Carveis, are shown speeding along a track with visible pit areas and sponsor banners.\n- A \"Replay\" overlay appears, showing the same race sequence from a different angle, emphasizing the cars' positions and movements.\n- A leaderboard overlay displays current standings with car numbers, driver names, and lap counts, indicating #23 O. Jackson Storm leads with 8 laps completed.\n[150-180s] - Race standings display: #20 Jackson Storm (1st, 8 pts), #94 Jay (2nd, 6 pts), #123 Jonas Carvers (3rd, 5 pts), #21 Ryan Laney (4th, 2 pts).\n- Group 1 Heat 3 race: Cars #20 Jackson Storm and #21 Ryan Laney start in Row 1, followed by #123 Jonas Carvers and #94 Jay in Row 2.\n- Track layout: Cars navigate a winding track with grassy hills, trees, and a \"Budwe\n[180-210s] - Orange car #123 speeds down the track, overtaking others near the finish line.\n- Blue car #494 Jay \"1\" is in 2nd place, while #21 Ryan Lane \"1\" is 3rd.\n- Standings overlay shows #123 Jones Carvers in 4th, with #494 Jay \"1\" leading at 10 points.\n[210-240s] - Standings display shows #21 Ryan Laney (7) and #123 Jonas Carvers (6) in Group 1, Heat 4.\n- Cars #21 Ryan Laney and #123 Jonas Carvers are positioned in Row 1 and Row 2 respectively, ready for the race.\n- The track features a scenic layout with green hills, trees, and a pit area with parked vehicles.\n[240-270s] - Orange and blue cars race closely on a winding track, passing under a \"TB\" sign.  \n- A replay overlay shows multiple cars navigating turns and passing each other.  \n- Pit lane area with colorful cars parked and a \"DS\" sign visible in the background.\n[270-300s] - A pink toy car with \"Rich Mison\" written on its side is shown in a static position on a track, labeled as #36 Rich Mison from Team Miniature Car Racing.  \n- The car is positioned in Group 2, with a \"Position: 13th (28 pts)\" and \"Fastest Time: 8.650\" displayed on screen.  \n- The background features a miniature racing track with a pit area and other cars parked nearby.\n[300-330s] - Pink car #36 Rich Mixon is shown in Group 2, positioned 13th with a heat time of 8.650.\n- Blue car #19 Danny Swerez is shown in Group 2, positioned 12th with a heat time of 9.433.\n- Green car #54 Herb Curbler is shown in Group 2, positioned 9th with a heat time of 8.549.", "history_tokens": 935, "history_utf8_bytes": 3070, "recent_frame_times_s": [322.0, 323.0, 324.0, 325.0, 326.0, 327.0, 328.0, 329.0, 330.0, 331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0], "recent_frames_sha256": "2abd1c2b81425f1e64c3f9f5ab3d4db404e76158925f2714a669bb6d867c93c1", "num_recent_frames": 30, "tq": 718325.834367217, "t1": 718328.044503436, "ta": 718328.044503436, "te": 718328.235868288, "first_response_s": 2.2101362189278007, "answer_total_s": 2.401501070940867, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 489, "content_group": "e62a34df413227a76396324a7e9c8a2a4dfd0d304473ffbf414b44e880ed5292", "question": {"question_id": "sample_489_a622_q1", "video_id": 489, "video_path": "./videos/sample_489_real.mp4", "annotation_index": 622, "question_index": 1, "question": "How many points does the second-place racer in Heat 3 have?", "options": ["A. 4 points.", "B. 6 points.", "C. 10 points.", "D. 13 points."], "answer": "C", "time_stamp_s": 497, "task_type": "Counting", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_489_a622_q1", "video_id": 489, "time_stamp_s": 497, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "02318aed91804ea647d36850d748c581dca59a87d575e3669e4f5f004c44ed89", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0], "recent_frames_sha256": "701496cc45b6dee48c9aa904a6f0aea1293ece1339dd17821b66b86bea356978", "num_recent_frames": 30, "tq": 718217.394901383, "t1": 718224.372761554, "ta": 718224.372761554, "te": 718224.411837914, "first_response_s": 6.977860170998611, "answer_total_s": 7.016936531057581, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_489_a622_q1", "video_id": 489, "time_stamp_s": 497, "ground_truth": "C", "raw_output": "C. 10 points.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "87b9c3cb35184c475822281e450f9d01d95587fae880d74513229bfb423a5806", "condition_order": ["recent", "notes"], "memory": "[240-270s] - Orange and blue cars race closely on a winding track, passing under a \"TB\" sign.  \n- A replay overlay shows multiple cars navigating turns and passing each other.  \n- Pit lane area with colorful cars parked and a \"DS\" sign visible in the background.\n[270-300s] - A pink toy car with \"Rich Mison\" written on its side is shown in a static position on a track, labeled as #36 Rich Mison from Team Miniature Car Racing.  \n- The car is positioned in Group 2, with a \"Position: 13th (28 pts)\" and \"Fastest Time: 8.650\" displayed on screen.  \n- The background features a miniature racing track with a pit area and other cars parked nearby.\n[300-330s] - Pink car #36 Rich Mixon is shown in Group 2, positioned 13th with a heat time of 8.650.\n- Blue car #19 Danny Swerez is shown in Group 2, positioned 12th with a heat time of 9.433.\n- Green car #54 Herb Curbler is shown in Group 2, positioned 9th with a heat time of 8.549.\n[330-360s] - Blue car (168 H.J. Hollis) and green car (154 Herb Cumber) lead in Row 1, with pink car (119 Danny Svervez) and purple car (136 Rich Mixon) in Row 2, all racing on a track with grassy hills and trees.\n- The track features a sharp turn with a \"150\" sign, followed by a straight section with a pit stop area and a red helicopter parked nearby.\n- A replay view shows the cars navigating the track, with a scoreboard displaying lap times for cars 168, \n[360-390s] - Pink car speeds past a white line on the track, followed by a blue car, then a green car, and finally a purple car.  \n- A leaderboard overlay shows driver rankings: #54 Herb Curbler (1st, 5 points), #68 R.J. Hollis (2nd, 3 points), #136 Rich Mixon (3rd, 2 points), and #11 Danny Sweeney (4th, 1 point).  \n- The scene transitions to a different track segment with \"Group 2 - Heat 2\" displayed, showing two cars racing side-by-side.\n[390-420s] - Cars race along a winding track with green grass and trees, passing a \"DB\" sign and approaching a pit lane with garages and a red helicopter overhead.\n- A replay segment shows the same race from a higher angle, highlighting the cars' movement around the track and their approach to the pit lane.\n- On-screen text displays driver names and car numbers (e.g., #168 H.J. Hollis, #119 Danny Svervez) and pit times (e.g., 10.001, 10.004, 10.005) as the\n[420-450s] - A replay of a race shows three cars speeding along a track with a pit area and helicopter in the background.\n- The standings display shows #54 Herb Curbler in 1st place with 10 points, followed by #68 R.H. Hollis with 5 points, and #36 Rich Mixon and #19 Danny Sweeney with 5 and 2 points respectively.\n- The race is labeled \"Group 2 - Heat 3\" with cars #36 Rich Mixon and #19 Danny Sweeney visible on the track.\n[450-480s] - Pink car (168 H.J. Hollis) leads a close race with blue car (154 Herb Curbler) on a winding track.  \n- Green car (168 H.J. Hollis) overtakes pink car near the pit lane, with a red helicopter visible overhead.  \n- Standings display shows 154 Herb Curbler in 1st, 168 H.J. Hollis in 2nd, and 119 Danny Sweeney in 4th.", "history_tokens": 949, "history_utf8_bytes": 3052, "recent_frame_times_s": [468.0, 469.0, 470.0, 471.0, 472.0, 473.0, 474.0, 475.0, 476.0, 477.0, 478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0], "recent_frames_sha256": "701496cc45b6dee48c9aa904a6f0aea1293ece1339dd17821b66b86bea356978", "num_recent_frames": 30, "tq": 718369.499965357, "t1": 718370.98923859, "ta": 718370.98923859, "te": 718371.325567544, "first_response_s": 1.4892732329899445, "answer_total_s": 1.8256021869601682, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 489, "content_group": "e62a34df413227a76396324a7e9c8a2a4dfd0d304473ffbf414b44e880ed5292", "question": {"question_id": "sample_489_a622_q0", "video_id": 489, "video_path": "./videos/sample_489_real.mp4", "annotation_index": 622, "question_index": 0, "question": "What event is labeled \"Group 2 - Heat 4\" in the video?", "options": ["A. The finish line celebration.", "B. The cars at the starting line.", "C. The awards ceremony.", "D. The scoreboard update."], "answer": "B", "time_stamp_s": 507, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_489_a622_q0", "video_id": 489, "time_stamp_s": 507, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c8b63a59621755b04e24e7e934ad0f1f98d5961e1152281c49f5d58695656718", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0], "recent_frames_sha256": "5bd9684c6480e0cc31728be5823325f0d3d09d09b013f6518536e7d55c3dd72b", "num_recent_frames": 30, "tq": 718224.427921216, "t1": 718232.424358944, "ta": 718232.424358944, "te": 718232.460224012, "first_response_s": 7.9964377279393375, "answer_total_s": 8.03230279602576, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_489_a622_q0", "video_id": 489, "time_stamp_s": 507, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "48dc3b09c65967e6fa8f6a7a147e2b9951804fdd6cb68b995a13c845f32041e6", "condition_order": ["recent", "notes"], "memory": "[240-270s] - Orange and blue cars race closely on a winding track, passing under a \"TB\" sign.  \n- A replay overlay shows multiple cars navigating turns and passing each other.  \n- Pit lane area with colorful cars parked and a \"DS\" sign visible in the background.\n[270-300s] - A pink toy car with \"Rich Mison\" written on its side is shown in a static position on a track, labeled as #36 Rich Mison from Team Miniature Car Racing.  \n- The car is positioned in Group 2, with a \"Position: 13th (28 pts)\" and \"Fastest Time: 8.650\" displayed on screen.  \n- The background features a miniature racing track with a pit area and other cars parked nearby.\n[300-330s] - Pink car #36 Rich Mixon is shown in Group 2, positioned 13th with a heat time of 8.650.\n- Blue car #19 Danny Swerez is shown in Group 2, positioned 12th with a heat time of 9.433.\n- Green car #54 Herb Curbler is shown in Group 2, positioned 9th with a heat time of 8.549.\n[330-360s] - Blue car (168 H.J. Hollis) and green car (154 Herb Cumber) lead in Row 1, with pink car (119 Danny Svervez) and purple car (136 Rich Mixon) in Row 2, all racing on a track with grassy hills and trees.\n- The track features a sharp turn with a \"150\" sign, followed by a straight section with a pit stop area and a red helicopter parked nearby.\n- A replay view shows the cars navigating the track, with a scoreboard displaying lap times for cars 168, \n[360-390s] - Pink car speeds past a white line on the track, followed by a blue car, then a green car, and finally a purple car.  \n- A leaderboard overlay shows driver rankings: #54 Herb Curbler (1st, 5 points), #68 R.J. Hollis (2nd, 3 points), #136 Rich Mixon (3rd, 2 points), and #11 Danny Sweeney (4th, 1 point).  \n- The scene transitions to a different track segment with \"Group 2 - Heat 2\" displayed, showing two cars racing side-by-side.\n[390-420s] - Cars race along a winding track with green grass and trees, passing a \"DB\" sign and approaching a pit lane with garages and a red helicopter overhead.\n- A replay segment shows the same race from a higher angle, highlighting the cars' movement around the track and their approach to the pit lane.\n- On-screen text displays driver names and car numbers (e.g., #168 H.J. Hollis, #119 Danny Svervez) and pit times (e.g., 10.001, 10.004, 10.005) as the\n[420-450s] - A replay of a race shows three cars speeding along a track with a pit area and helicopter in the background.\n- The standings display shows #54 Herb Curbler in 1st place with 10 points, followed by #68 R.H. Hollis with 5 points, and #36 Rich Mixon and #19 Danny Sweeney with 5 and 2 points respectively.\n- The race is labeled \"Group 2 - Heat 3\" with cars #36 Rich Mixon and #19 Danny Sweeney visible on the track.\n[450-480s] - Pink car (168 H.J. Hollis) leads a close race with blue car (154 Herb Curbler) on a winding track.  \n- Green car (168 H.J. Hollis) overtakes pink car near the pit lane, with a red helicopter visible overhead.  \n- Standings display shows 154 Herb Curbler in 1st, 168 H.J. Hollis in 2nd, and 119 Danny Sweeney in 4th.", "history_tokens": 949, "history_utf8_bytes": 3052, "recent_frame_times_s": [478.0, 479.0, 480.0, 481.0, 482.0, 483.0, 484.0, 485.0, 486.0, 487.0, 488.0, 489.0, 490.0, 491.0, 492.0, 493.0, 494.0, 495.0, 496.0, 497.0, 498.0, 499.0, 500.0, 501.0, 502.0, 503.0, 504.0, 505.0, 506.0, 507.0], "recent_frames_sha256": "5bd9684c6480e0cc31728be5823325f0d3d09d09b013f6518536e7d55c3dd72b", "num_recent_frames": 30, "tq": 718371.345357716, "t1": 718384.484848761, "ta": 718384.484848761, "te": 718384.860995503, "first_response_s": 13.139491045032628, "answer_total_s": 13.51563778705895, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 490, "content_group": "1acf07556ffd63c3bab62fea6c675e173bc7ff9e8dca63ba3fa66d23c2ae71f2", "question": {"question_id": "sample_490_a1922_q0", "video_id": 490, "video_path": "./videos/sample_490_real.mp4", "annotation_index": 1922, "question_index": 0, "question": "What event is being depicted according to the text overlays?", "options": ["A. Local Race.", "B. Test Drive.", "C. World Grand Prix - Final Round.", "D. Exhibition Match."], "answer": "C", "time_stamp_s": 19, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_490_a1922_q0", "video_id": 490, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1fa76b8c552c673b64fac39a30948fb7d7b254d56ffacd1401d62b11ae0a1bfa", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "c763fa6099cb5b2cde2d99c732644ad5a46a2493fb1a2636d1d060abbf8d8e56", "num_recent_frames": 20, "tq": 718197.203762696, "t1": 718198.086542919, "ta": 718198.086542919, "te": 718198.12635034, "first_response_s": 0.8827802230371162, "answer_total_s": 0.9225876439595595, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_490_a1922_q0", "video_id": 490, "time_stamp_s": 19, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4deaf9d9f7573d6c718d52319c2d49eb09fc6349217029327f810d07fe492d3f", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0], "recent_frames_sha256": "c763fa6099cb5b2cde2d99c732644ad5a46a2493fb1a2636d1d060abbf8d8e56", "num_recent_frames": 20, "tq": 718004.749040981, "t1": 718016.606865697, "ta": 718016.606865697, "te": 718016.644330794, "first_response_s": 11.857824715902098, "answer_total_s": 11.895289812935516, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 490, "content_group": "1acf07556ffd63c3bab62fea6c675e173bc7ff9e8dca63ba3fa66d23c2ae71f2", "question": {"question_id": "sample_490_a1923_q0", "video_id": 490, "video_path": "./videos/sample_490_real.mp4", "annotation_index": 1923, "question_index": 0, "question": "Which racing car won first place in this competition?", "options": ["A. The pink car.", "B. The yellow car.", "C. The light green car.", "D. The blue car."], "answer": "B", "time_stamp_s": 181, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_490_a1923_q0", "video_id": 490, "time_stamp_s": 181, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b06d6fb40839603e79a65d1835bebc4ac38a1825ca727e3f51c1626291e55f3c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0], "recent_frames_sha256": "086d4ded26a559742d2b7f5330ce13f690ad7e6e06a1b6abb30af926af9d97a3", "num_recent_frames": 30, "tq": 718198.145037014, "t1": 718208.384130818, "ta": 718208.384130818, "te": 718208.421270709, "first_response_s": 10.239093803917058, "answer_total_s": 10.276233694981784, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_490_a1923_q0", "video_id": 490, "time_stamp_s": 181, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "aa57c07e0427947560e42b44059bf90878082f4dbc4816cc8c9f50ac8358da37", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Red and black diecast car #1 Francesco Bernoulli is shown on track with text overlay identifying its fan team as \"World Grand Prix TV\".\n- Dark gray diecast car #2 Lewis Hamilton is displayed on track with text overlay identifying its fan team as \"Dom's Tuner Shop\".\n- Both cars are positioned on a black track with a chain-link fence behind them, and other diecast cars are visible in the background.\n[30-60s] - Green car #9 Nigel Gearsley with white wheels and \"Green Engine Racing\" decals moves on track, positioned behind a chain-link fence.  \n- Yellow car #24 Jeff Gorvette with red and blue flame decals and \"Outlaw Racing\" text drives on track, slightly ahead of the green car.  \n- Red car #95 Lightning McQueen with yellow flame decals and \"Episodes\" text is shown in a close-up, positioned near the track's edge.\n[60-90s] - Orange #24 Jeff Gorette car leads the pack in Row 1, positioned ahead of green #9 Nigel Gearley and blue #2 Lewis Hamilton cars.\n- The track layout shows a sharp turn with a red-and-white barrier, and a pit area with a white building labeled \"HYUNDAI\" visible in the background.\n- Cars are shown speeding along the track, with the #24 car maintaining a lead position as the race progresses.\n[90-120s] - A replay sequence shows multiple toy cars racing on a track with a \"Replay\" label in the top right corner.\n- The track features a grassy area, barriers, and sponsor logos like \"TER\" and \"Mazda\" along the sides.\n- A leaderboard appears briefly, listing drivers such as \"J24 Jeff Gove\" and \"17 Thibaut McQueen\" with their respective positions.\n[120-150s] - Standings display shows Jeff Goveatte in 1st with 10 points, followed by Lightning McQueen in 2nd with 6 points.\n- Race 2 final scene shows cars lined up on Thunder Mountain Speedway, with Row 1 featuring Jeff Goveatte and Nigel Gearsley.\n- Row 2 and Row 3 show Francisco Bernoulli and Lewis Hamilton, and Carla Veloso and Lightning McQueen respectively, positioned for the race.\n[150-180s] - Yellow car overtakes green car on a straightaway, passing a pit building with \"TER\" signage.  \n- Blue car follows closely behind the yellow car, with a red car visible further back.  \n- A \"Replay\" overlay appears at 2:51, indicating a slow-motion review of the overtaking maneuver.", "history_tokens": 581, "history_utf8_bytes": 2274, "recent_frame_times_s": [152.0, 153.0, 154.0, 155.0, 156.0, 157.0, 158.0, 159.0, 160.0, 161.0, 162.0, 163.0, 164.0, 165.0, 166.0, 167.0, 168.0, 169.0, 170.0, 171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0], "recent_frames_sha256": "086d4ded26a559742d2b7f5330ce13f690ad7e6e06a1b6abb30af926af9d97a3", "num_recent_frames": 30, "tq": 718065.536759656, "t1": 718067.24589388, "ta": 718067.24589388, "te": 718067.562926191, "first_response_s": 1.7091342239873484, "answer_total_s": 2.0261665349826217, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 490, "content_group": "1acf07556ffd63c3bab62fea6c675e173bc7ff9e8dca63ba3fa66d23c2ae71f2", "question": {"question_id": "sample_490_a1923_q1", "video_id": 490, "video_path": "./videos/sample_490_real.mp4", "annotation_index": 1923, "question_index": 1, "question": "How many racers are listed in the standings for \"Race 2\"?", "options": ["A. Four.", "B. Five.", "C. Six.", "D. Seven."], "answer": "C", "time_stamp_s": 200, "task_type": "Counting", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_490_a1923_q1", "video_id": 490, "time_stamp_s": 200, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ea7f9a0f20a588ab4bf3cff8a2194b11fad6c4920459e3622aeebd8ab00e517a", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0], "recent_frames_sha256": "0dd39bdf631f567230d320567d75d7d9f051e00c50e16c413c36ca3a72fba7e0", "num_recent_frames": 30, "tq": 718208.436855017, "t1": 718217.329653284, "ta": 718217.329653284, "te": 718217.371909578, "first_response_s": 8.892798267072067, "answer_total_s": 8.935054561006837, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_490_a1923_q1", "video_id": 490, "time_stamp_s": 200, "ground_truth": "C", "raw_output": "C. Six.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "4ca545996b5808db41b7213b0f8e1723eac13ddcfd1365030615d23825d4c645", "condition_order": ["notes", "recent"], "memory": "[0-30s] - Red and black diecast car #1 Francesco Bernoulli is shown on track with text overlay identifying its fan team as \"World Grand Prix TV\".\n- Dark gray diecast car #2 Lewis Hamilton is displayed on track with text overlay identifying its fan team as \"Dom's Tuner Shop\".\n- Both cars are positioned on a black track with a chain-link fence behind them, and other diecast cars are visible in the background.\n[30-60s] - Green car #9 Nigel Gearsley with white wheels and \"Green Engine Racing\" decals moves on track, positioned behind a chain-link fence.  \n- Yellow car #24 Jeff Gorvette with red and blue flame decals and \"Outlaw Racing\" text drives on track, slightly ahead of the green car.  \n- Red car #95 Lightning McQueen with yellow flame decals and \"Episodes\" text is shown in a close-up, positioned near the track's edge.\n[60-90s] - Orange #24 Jeff Gorette car leads the pack in Row 1, positioned ahead of green #9 Nigel Gearley and blue #2 Lewis Hamilton cars.\n- The track layout shows a sharp turn with a red-and-white barrier, and a pit area with a white building labeled \"HYUNDAI\" visible in the background.\n- Cars are shown speeding along the track, with the #24 car maintaining a lead position as the race progresses.\n[90-120s] - A replay sequence shows multiple toy cars racing on a track with a \"Replay\" label in the top right corner.\n- The track features a grassy area, barriers, and sponsor logos like \"TER\" and \"Mazda\" along the sides.\n- A leaderboard appears briefly, listing drivers such as \"J24 Jeff Gove\" and \"17 Thibaut McQueen\" with their respective positions.\n[120-150s] - Standings display shows Jeff Goveatte in 1st with 10 points, followed by Lightning McQueen in 2nd with 6 points.\n- Race 2 final scene shows cars lined up on Thunder Mountain Speedway, with Row 1 featuring Jeff Goveatte and Nigel Gearsley.\n- Row 2 and Row 3 show Francisco Bernoulli and Lewis Hamilton, and Carla Veloso and Lightning McQueen respectively, positioned for the race.\n[150-180s] - Yellow car overtakes green car on a straightaway, passing a pit building with \"TER\" signage.  \n- Blue car follows closely behind the yellow car, with a red car visible further back.  \n- A \"Replay\" overlay appears at 2:51, indicating a slow-motion review of the overtaking maneuver.", "history_tokens": 581, "history_utf8_bytes": 2274, "recent_frame_times_s": [171.0, 172.0, 173.0, 174.0, 175.0, 176.0, 177.0, 178.0, 179.0, 180.0, 181.0, 182.0, 183.0, 184.0, 185.0, 186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0], "recent_frames_sha256": "0dd39bdf631f567230d320567d75d7d9f051e00c50e16c413c36ca3a72fba7e0", "num_recent_frames": 30, "tq": 718067.594497038, "t1": 718079.748833107, "ta": 718079.748833107, "te": 718079.939788476, "first_response_s": 12.154336068895645, "answer_total_s": 12.345291437930427, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 490, "content_group": "1acf07556ffd63c3bab62fea6c675e173bc7ff9e8dca63ba3fa66d23c2ae71f2", "question": {"question_id": "sample_490_a1924_q0", "video_id": 490, "video_path": "./videos/sample_490_real.mp4", "annotation_index": 1924, "question_index": 0, "question": "Which racing car won first place in this competition?", "options": ["A. The pink car.", "B. The yellow car.", "C. The red car.", "D. The blue car."], "answer": "C", "time_stamp_s": 419, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_490_a1924_q0", "video_id": 490, "time_stamp_s": 419, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4aa94f76e7e8144b6d545c6d745a87db888910a2a3611018abf46532312544cf", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0], "recent_frames_sha256": "cb7f68bca573110e9968960cef679cbd33b0cb331713052f76ffc5c01e49038f", "num_recent_frames": 30, "tq": 718217.391144907, "t1": 718224.372761554, "ta": 718224.372761554, "te": 718224.411837914, "first_response_s": 6.981616646982729, "answer_total_s": 7.0206930070417, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_490_a1924_q0", "video_id": 490, "time_stamp_s": 419, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fb8018836f22615c275cfe077703b1deb7e2b27e0ef66efb10d040d14df94869", "condition_order": ["notes", "recent"], "memory": "[90-120s] - A replay sequence shows multiple toy cars racing on a track with a \"Replay\" label in the top right corner.\n- The track features a grassy area, barriers, and sponsor logos like \"TER\" and \"Mazda\" along the sides.\n- A leaderboard appears briefly, listing drivers such as \"J24 Jeff Gove\" and \"17 Thibaut McQueen\" with their respective positions.\n[120-150s] - Standings display shows Jeff Goveatte in 1st with 10 points, followed by Lightning McQueen in 2nd with 6 points.\n- Race 2 final scene shows cars lined up on Thunder Mountain Speedway, with Row 1 featuring Jeff Goveatte and Nigel Gearsley.\n- Row 2 and Row 3 show Francisco Bernoulli and Lewis Hamilton, and Carla Veloso and Lightning McQueen respectively, positioned for the race.\n[150-180s] - Yellow car overtakes green car on a straightaway, passing a pit building with \"TER\" signage.  \n- Blue car follows closely behind the yellow car, with a red car visible further back.  \n- A \"Replay\" overlay appears at 2:51, indicating a slow-motion review of the overtaking maneuver.\n[180-210s] - Standings overlay shows J2 Jeff Govelette in 1st with 20 points, followed by F1 Francesco Bernoulli in 2nd with 10 points.\n- Race 3 scene displays three cars on a track: #99 Nigel Gearley, #11 Francesco Bernoulli, and #2 Lewis Hamilton.\n- Cars are positioned on a winding track with \"MOUNTAIN SPEEDWAY\" signage, indicating a race setting.\n[210-240s] - Cars in Row 2 (Lewis Hamilton, Jeff Veloso) and Row 3 (Lightning McQueen, Jeff Gorette) are positioned at the start line on a model track with \"Boulder Mountain Speedway\" signage.  \n- The camera pans to show the full track layout, including a grassy turn and pit area with sponsor banners like \"TER\" and \"Mazda.\"  \n- A leaderboard on the left displays driver names and lap times, with Gorette leading at 1:34.\n[240-270s] - A replay sequence shows toy cars racing on a curved track with green grass and trees in the background.  \n- The cars, including a red, yellow, and blue one, speed through turns and pass each other.  \n- A leaderboard overlay displays rankings with car models and numbers, such as \"Jef Gorette\" in 1st place.\n[270-300s] - Standings screen displays race positions with drivers' names, car numbers, and points; #24 Jeff Gorette leads with 22 points.\n- Race 4 final scene shows cars on a winding track with \"Brenner Mountain Speedway\" signage; #1 Francesco Bernoulli and #2 Lewis Hamilton are in Row 1.\n- Cars in Row 2 include #8 Carla Veloso and #95 Lightning McQueen, while Row 3 features #24 Jeff Gorette and #9 Nigel Gearsley.\n[300-330s] - Race cars, including #24 Jeff Govelette and #19 Nigel Gearles, are shown in close proximity on a model track, indicating a competitive moment.  \n- The track features a grassy hillside and a \"Bonneville Speedway\" sign, suggesting a specific race venue.  \n- A \"Replay\" indicator appears briefly, signaling a rewind or review of the race segment.\n[330-360s] - A green car speeds along a track, passing a red car and approaching a turn.  \n- A blue car overtakes a yellow car on the track, with both cars moving toward the right side of the frame.  \n- A leaderboard overlay displays standings with car numbers, names, and scores, including #24 Jeff Gorette and #17 Nigel Gearharts.\n[360-390s] - Standings overlay displays driver rankings with car icons and numbers (e.g., #24 Jeff Govelette, #17 Nigel Gearlays).\n- Background shows a model race track with a blue car on the left and a white car on the right.\n- No visible movement or changes in the standings or background elements during the segment.", "history_tokens": 961, "history_utf8_bytes": 3565, "recent_frame_times_s": [390.0, 391.0, 392.0, 393.0, 394.0, 395.0, 396.0, 397.0, 398.0, 399.0, 400.0, 401.0, 402.0, 403.0, 404.0, 405.0, 406.0, 407.0, 408.0, 409.0, 410.0, 411.0, 412.0, 413.0, 414.0, 415.0, 416.0, 417.0, 418.0, 419.0], "recent_frames_sha256": "cb7f68bca573110e9968960cef679cbd33b0cb331713052f76ffc5c01e49038f", "num_recent_frames": 30, "tq": 718137.96553432, "t1": 718145.089504227, "ta": 718145.089504227, "te": 718145.128240516, "first_response_s": 7.123969907057472, "answer_total_s": 7.16270619595889, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 490, "content_group": "1acf07556ffd63c3bab62fea6c675e173bc7ff9e8dca63ba3fa66d23c2ae71f2", "question": {"question_id": "sample_490_a1925_q0", "video_id": 490, "video_path": "./videos/sample_490_real.mp4", "annotation_index": 1925, "question_index": 0, "question": "Which racing car won first place in this competition?", "options": ["A. The pink car.", "B. The yellow car.", "C. The red car.", "D. The blue car."], "answer": "C", "time_stamp_s": 541, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [540, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_490_a1925_q0", "video_id": 490, "time_stamp_s": 541, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "302ec385be2a3100f8c8658d451046d03cb8f6bf077502421b6bd7bd15905daf", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0], "recent_frames_sha256": "a58348a6d984550982bbf51f693fda13a84dcbeab73797fb2961e768534fd4f4", "num_recent_frames": 30, "tq": 718224.424056612, "t1": 718232.424358944, "ta": 718232.424358944, "te": 718232.460224012, "first_response_s": 8.000302331987768, "answer_total_s": 8.036167400074191, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_490_a1925_q0", "video_id": 490, "time_stamp_s": 541, "ground_truth": "C", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "04148f9105dc82971758b4e7f404360a8c40ee0efb823e0a1f657e312e162815", "condition_order": ["notes", "recent"], "memory": "[240-270s] - A replay sequence shows toy cars racing on a curved track with green grass and trees in the background.  \n- The cars, including a red, yellow, and blue one, speed through turns and pass each other.  \n- A leaderboard overlay displays rankings with car models and numbers, such as \"Jef Gorette\" in 1st place.\n[270-300s] - Standings screen displays race positions with drivers' names, car numbers, and points; #24 Jeff Gorette leads with 22 points.\n- Race 4 final scene shows cars on a winding track with \"Brenner Mountain Speedway\" signage; #1 Francesco Bernoulli and #2 Lewis Hamilton are in Row 1.\n- Cars in Row 2 include #8 Carla Veloso and #95 Lightning McQueen, while Row 3 features #24 Jeff Gorette and #9 Nigel Gearsley.\n[300-330s] - Race cars, including #24 Jeff Govelette and #19 Nigel Gearles, are shown in close proximity on a model track, indicating a competitive moment.  \n- The track features a grassy hillside and a \"Bonneville Speedway\" sign, suggesting a specific race venue.  \n- A \"Replay\" indicator appears briefly, signaling a rewind or review of the race segment.\n[330-360s] - A green car speeds along a track, passing a red car and approaching a turn.  \n- A blue car overtakes a yellow car on the track, with both cars moving toward the right side of the frame.  \n- A leaderboard overlay displays standings with car numbers, names, and scores, including #24 Jeff Gorette and #17 Nigel Gearharts.\n[360-390s] - Standings overlay displays driver rankings with car icons and numbers (e.g., #24 Jeff Govelette, #17 Nigel Gearlays).\n- Background shows a model race track with a blue car on the left and a white car on the right.\n- No visible movement or changes in the standings or background elements during the segment.\n[390-420s] - Race grid shows cars positioned in rows with driver names and numbers (e.g., #2 Lewis Hamilton, #18 Carla Veloso) at the start line.\n- Cars begin racing on a winding track with visible sponsor banners and a pit area in the background.\n- Camera pans to show the full track layout, including a sharp turn and a straightaway with a pit building on the right.\n[420-450s] - A replay sequence shows toy cars racing on a miniature track with blurred motion indicating high speed.  \n- The track features a grassy area with sponsor banners and a building with \"TER\" signage along the side.  \n- Cars are seen navigating turns and straightaways, with some overtaking others in close proximity.\n[450-480s] - A replay of a diecast race shows multiple cars speeding along a track with blurred motion.  \n- The standings screen displays six drivers with their car numbers, names, and lap counts, including Jeff Govelette (27), Francesco Bernoulli (25), and Lewis Hamilton (23).  \n- The track features grassy areas, barriers, and sponsor logos like \"TER\" and \"MUCOFF\" along the sides.\n[480-510s] - Standings display shows #24 Jeff Goveatte in 1st with 27 points, followed by #1 Francisco Bernoulli (25), #95 Lightning McQueen (23), #2 Lewis Hamilton (23), #19 Nigel Gearsley (19), and #8 Carla Veloso (11).\n- Race 6 starts with cars lined up on a grassy hillside at Thunder Mountain Speedway, with #8 Carla Veloso and #95 Lightning McQueen in Row 1, #24 Jeff Goveatte and #19 Nigel Gearsley in Row\n[510-540s] - A yellow car speeds past a red car on a curved track section, with both vehicles near the outer edge of the track.  \n- A black car overtakes a blue car on a straight section, passing through a pit lane area with visible sponsor banners.  \n- The \"Replay\" label appears in the top right corner, indicating a slow-motion or repeated segment of the race.", "history_tokens": 951, "history_utf8_bytes": 3606, "recent_frame_times_s": [512.0, 513.0, 514.0, 515.0, 516.0, 517.0, 518.0, 519.0, 520.0, 521.0, 522.0, 523.0, 524.0, 525.0, 526.0, 527.0, 528.0, 529.0, 530.0, 531.0, 532.0, 533.0, 534.0, 535.0, 536.0, 537.0, 538.0, 539.0, 540.0, 541.0], "recent_frames_sha256": "a58348a6d984550982bbf51f693fda13a84dcbeab73797fb2961e768534fd4f4", "num_recent_frames": 30, "tq": 718190.506745364, "t1": 718196.919270125, "ta": 718196.919270125, "te": 718197.188089094, "first_response_s": 6.412524760933593, "answer_total_s": 6.681343729957007, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 491, "content_group": "5effafbda045ccdd753a238c44205acf1892f7557a506c5199ce684488579f25", "question": {"question_id": "sample_491_a1538_q0", "video_id": 491, "video_path": "./videos/sample_491_real.mp4", "annotation_index": 1538, "question_index": 0, "question": "What feature do some of the cars have turned on?", "options": ["A. Hazard lights.", "B. Headlights.", "C. Brake lights.", "D. Turn signals."], "answer": "B", "time_stamp_s": 3, "task_type": "Attribute Recognition", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_491_a1538_q0", "video_id": 491, "time_stamp_s": 3, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5040e85b4766e5f1fbe50b713ba44b6783b05351930b6e5141331934d44316aa", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002], "recent_frames_sha256": "8b422732df1d67a1d561070a17415c503f4eb5c55135339296946894ae7f679d", "num_recent_frames": 3, "tq": 715247.416040643, "t1": 715248.094340173, "ta": 715248.094340173, "te": 715248.13349058, "first_response_s": 0.6782995299436152, "answer_total_s": 0.7174499370157719, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_491_a1538_q0", "video_id": 491, "time_stamp_s": 3, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "affbe209d684ad2347a1f6f612f80e95a36deebd4caaacf4463a5f2a4ac2a461", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001, 2.002], "recent_frames_sha256": "8b422732df1d67a1d561070a17415c503f4eb5c55135339296946894ae7f679d", "num_recent_frames": 3, "tq": 715288.850249748, "t1": 715295.276806683, "ta": 715295.276806683, "te": 715295.484588093, "first_response_s": 6.42655693506822, "answer_total_s": 6.634338345029391, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 491, "content_group": "5effafbda045ccdd753a238c44205acf1892f7557a506c5199ce684488579f25", "question": {"question_id": "sample_491_a1539_q1", "video_id": 491, "video_path": "./videos/sample_491_real.mp4", "annotation_index": 1539, "question_index": 1, "question": "What are the people behind the barricade holding right now?", "options": ["A. Cameras.", "B. Drinks.", "C. Remote controls.", "D. Cell phones."], "answer": "C", "time_stamp_s": 102, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_491_a1539_q1", "video_id": 491, "time_stamp_s": 102, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a8c9da2ad20e75c27c2ebe8d36549fad53d5a3cb34036e847bc11a7a7634877f", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009], "recent_frames_sha256": "d001eb33b4b40d36d9b0ded1d5de4656c3f63a375327a737bd09cfa22a442a5b", "num_recent_frames": 30, "tq": 715248.15034726, "t1": 715261.07844818, "ta": 715261.07844818, "te": 715261.118916999, "first_response_s": 12.928100920049474, "answer_total_s": 12.968569739023224, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_491_a1539_q1", "video_id": 491, "time_stamp_s": 102, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c79aed25e3b7de897d2a7c08fb5dcd8cbbe78fd7a202ec3631575ffe9949bfd6", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Multiple RC cars race on a wet track, with a green car and a black car prominently visible in the foreground.  \n- Spectators stand behind barriers, watching the race as cars navigate turns and pass each other.  \n- A police booth and yellow construction barriers are visible along the track’s edge, indicating a controlled racing environment.\n[30-60s] - Red car with blue lights leads a pack of cars through a wet track, navigating a turn near a \"POLICE\" booth.  \n- White car with black decals and number \"2\" overtakes a red car during a sharp corner, while a green car follows closely behind.  \n- Spectators stand behind barriers, observing the race as cars maneuver around green grassy areas and red-and-white curbs.\n[60-90s] - Red car and black car collide near track’s inner curve, causing both to spin out.  \n- Yellow and blue car navigate a tight turn, with yellow car slightly ahead.  \n- Spectators stand behind barriers, observing the race from elevated positions.", "history_tokens": 224, "history_utf8_bytes": 985, "recent_frame_times_s": [72.00526666666667, 73.00626666666666, 74.00726666666667, 75.00826666666667, 76.00926666666666, 77.01026666666667, 78.01126666666667, 79.01226666666666, 80.01326666666667, 81.01426666666667, 82.01526666666666, 83.01626666666667, 84.00058333333334, 85.00158333333333, 86.00258333333333, 87.00358333333334, 88.00458333333333, 89.00558333333333, 90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009], "recent_frames_sha256": "d001eb33b4b40d36d9b0ded1d5de4656c3f63a375327a737bd09cfa22a442a5b", "num_recent_frames": 30, "tq": 715314.06372901, "t1": 715320.190721521, "ta": 715320.190721521, "te": 715320.386717607, "first_response_s": 6.1269925109809265, "answer_total_s": 6.322988596977666, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 491, "content_group": "5effafbda045ccdd753a238c44205acf1892f7557a506c5199ce684488579f25", "question": {"question_id": "sample_491_a1539_q0", "video_id": 491, "video_path": "./videos/sample_491_real.mp4", "annotation_index": 1539, "question_index": 0, "question": "What is the event taking place in the video?", "options": ["A. A car exhibition.", "B. A miniature track construction demonstration.", "C. A remote-controlled car sales event.", "D. A remote control car drifting competition."], "answer": "D", "time_stamp_s": 120, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_491_a1539_q0", "video_id": 491, "time_stamp_s": 120, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1034b195990ef7a0a66b6108f0ac8d614ed6200447a5c47cbe94c74d3b9725d7", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667], "recent_frames_sha256": "0353fe3a321d5ed55765dde58d7070e514bbb782ff8063212de79466560d2a0d", "num_recent_frames": 30, "tq": 715261.13810419, "t1": 715268.117564094, "ta": 715268.117564094, "te": 715268.159261048, "first_response_s": 6.979459904017858, "answer_total_s": 7.021156857954338, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_491_a1539_q0", "video_id": 491, "time_stamp_s": 120, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ee88dfa19445ed79cc3998079c01e07f084925b8bb1a7ef37b4f9ae1cff186f3", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Multiple RC cars race on a wet track, with a green car and a black car prominently visible in the foreground.  \n- Spectators stand behind barriers, watching the race as cars navigate turns and pass each other.  \n- A police booth and yellow construction barriers are visible along the track’s edge, indicating a controlled racing environment.\n[30-60s] - Red car with blue lights leads a pack of cars through a wet track, navigating a turn near a \"POLICE\" booth.  \n- White car with black decals and number \"2\" overtakes a red car during a sharp corner, while a green car follows closely behind.  \n- Spectators stand behind barriers, observing the race as cars maneuver around green grassy areas and red-and-white curbs.\n[60-90s] - Red car and black car collide near track’s inner curve, causing both to spin out.  \n- Yellow and blue car navigate a tight turn, with yellow car slightly ahead.  \n- Spectators stand behind barriers, observing the race from elevated positions.\n[90-120s] - Miniature cars race on a wet track, with a yellow car and a purple car colliding near a turn.  \n- Spectators watch from behind barriers, some holding remote controls, as the race progresses.  \n- A green car overtakes a red car during a straightaway, followed by a sharp turn where multiple cars jostle for position.", "history_tokens": 305, "history_utf8_bytes": 1313, "recent_frame_times_s": [90.00658333333334, 91.00758333333333, 92.00858333333333, 93.00958333333334, 94.01058333333333, 95.01158333333333, 96.01258333333334, 97.01358333333333, 98.01458333333333, 99.01558333333334, 100.01658333333333, 101.0009, 102.0019, 103.0029, 104.0039, 105.0049, 106.0059, 107.0069, 108.0079, 109.0089, 110.0099, 111.0109, 112.0119, 113.0129, 114.0139, 115.0149, 116.0159, 117.00021666666666, 118.00121666666666, 119.00221666666667], "recent_frames_sha256": "0353fe3a321d5ed55765dde58d7070e514bbb782ff8063212de79466560d2a0d", "num_recent_frames": 30, "tq": 715326.731802908, "t1": 715333.732495421, "ta": 715333.732495421, "te": 715333.939663923, "first_response_s": 7.000692512956448, "answer_total_s": 7.207861014991067, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 491, "content_group": "5effafbda045ccdd753a238c44205acf1892f7557a506c5199ce684488579f25", "question": {"question_id": "sample_491_a1540_q0", "video_id": 491, "video_path": "./videos/sample_491_real.mp4", "annotation_index": 1540, "question_index": 0, "question": "What do the two main RC cars do after making a sharp turn?", "options": ["A. Stop racing.", "B. Start moving in reverse.", "C. Swap lanes.", "D. Continue racing around a corner."], "answer": "D", "time_stamp_s": 218, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_491_a1540_q0", "video_id": 491, "time_stamp_s": 218, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "18f9f0af82446f588a7f433853bae32d521eb1f6f81420319011648449be7f2a", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666], "recent_frames_sha256": "f10c8bfb18fae8610a291f896f934184df4ccf510e7ea8fb637e1b07467a2199", "num_recent_frames": 30, "tq": 715268.171880607, "t1": 715280.812721673, "ta": 715280.812721673, "te": 715280.976882349, "first_response_s": 12.640841066022404, "answer_total_s": 12.805001741973683, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_491_a1540_q0", "video_id": 491, "time_stamp_s": 218, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5a52688cfb786aa855194e27ea99a369e7a05c9d06e90b23ce0475ff3789fd39", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Multiple RC cars race on a wet track, with a green car and a black car prominently visible in the foreground.  \n- Spectators stand behind barriers, watching the race as cars navigate turns and pass each other.  \n- A police booth and yellow construction barriers are visible along the track’s edge, indicating a controlled racing environment.\n[30-60s] - Red car with blue lights leads a pack of cars through a wet track, navigating a turn near a \"POLICE\" booth.  \n- White car with black decals and number \"2\" overtakes a red car during a sharp corner, while a green car follows closely behind.  \n- Spectators stand behind barriers, observing the race as cars maneuver around green grassy areas and red-and-white curbs.\n[60-90s] - Red car and black car collide near track’s inner curve, causing both to spin out.  \n- Yellow and blue car navigate a tight turn, with yellow car slightly ahead.  \n- Spectators stand behind barriers, observing the race from elevated positions.\n[90-120s] - Miniature cars race on a wet track, with a yellow car and a purple car colliding near a turn.  \n- Spectators watch from behind barriers, some holding remote controls, as the race progresses.  \n- A green car overtakes a red car during a straightaway, followed by a sharp turn where multiple cars jostle for position.\n[120-150s] - Red car and green car race closely on wet track, passing each other near turn.\n- White car and black car collide mid-race, causing both to spin out and skid across track.\n- Spectators watch from behind barriers as race continues with multiple cars navigating wet course.\n[150-180s] - White car overtakes black car on wet track, both navigating a turn with visible tire spray.  \n- Multiple cars, including orange and red, cluster ahead, indicating a tight pack during the race.  \n- Spectators stand behind barriers, observing the race from an elevated position.\n[180-210s] - A white car with black decals overtakes a black car with orange accents on a wet track.  \n- A red car with blue lights is seen ahead, followed by a silver car with a black roof.  \n- The cars navigate a turn with green grass and red-and-white curbs, while spectators watch from behind barriers.", "history_tokens": 515, "history_utf8_bytes": 2194, "recent_frame_times_s": [188.00448333333333, 189.00548333333333, 190.00648333333334, 191.00748333333334, 192.00848333333334, 193.00948333333332, 194.01048333333333, 195.01148333333333, 196.01248333333334, 197.01348333333334, 198.01448333333335, 199.01548333333332, 200.01648333333333, 201.0008, 202.0018, 203.0028, 204.0038, 205.0048, 206.0058, 207.0068, 208.0078, 209.0088, 210.0098, 211.0108, 212.0118, 213.0128, 214.0138, 215.0148, 216.0158, 217.00011666666666], "recent_frames_sha256": "f10c8bfb18fae8610a291f896f934184df4ccf510e7ea8fb637e1b07467a2199", "num_recent_frames": 30, "tq": 715351.666469176, "t1": 715353.374962573, "ta": 715353.374962573, "te": 715353.695504222, "first_response_s": 1.7084933971054852, "answer_total_s": 2.029035045998171, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 491, "content_group": "5effafbda045ccdd753a238c44205acf1892f7557a506c5199ce684488579f25", "question": {"question_id": "sample_491_a1541_q0", "video_id": 491, "video_path": "./videos/sample_491_real.mp4", "annotation_index": 1541, "question_index": 0, "question": "Which car is leading the race right now?", "options": ["A. Blue car.", "B. Red car.", "C. Yellow car.", "D. Green car."], "answer": "D", "time_stamp_s": 324, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [300, 360], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_491_a1541_q0", "video_id": 491, "time_stamp_s": 324, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "45e996369af8331ac6c6ec5fc800fc2fd01bf62b37d86fd7582e6387b1808221", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [294.0103833333333, 295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333, 300.01638333333335, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0000166666667, 318.00101666666666, 319.0020166666667, 320.00301666666667, 321.00401666666664, 322.0050166666667, 323.00601666666665], "recent_frames_sha256": "85ae4428e148eaaff345b131b55b017493c4e3fe21fb063cc5cc658dea74757f", "num_recent_frames": 30, "tq": 715280.991776329, "t1": 715288.58785044, "ta": 715288.58785044, "te": 715288.829652904, "first_response_s": 7.596074110944755, "answer_total_s": 7.837876574951224, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_491_a1541_q0", "video_id": 491, "time_stamp_s": 324, "ground_truth": "D", "raw_output": "C. Yellow car.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "55faeb4af25dd69b5c7d66c680bdc00fd16abdee8e2b9a29dc14d222e1d29074", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Multiple RC cars race on a wet track, with a green car and a black car prominently visible in the foreground.  \n- Spectators stand behind barriers, watching the race as cars navigate turns and pass each other.  \n- A police booth and yellow construction barriers are visible along the track’s edge, indicating a controlled racing environment.\n[30-60s] - Red car with blue lights leads a pack of cars through a wet track, navigating a turn near a \"POLICE\" booth.  \n- White car with black decals and number \"2\" overtakes a red car during a sharp corner, while a green car follows closely behind.  \n- Spectators stand behind barriers, observing the race as cars maneuver around green grassy areas and red-and-white curbs.\n[60-90s] - Red car and black car collide near track’s inner curve, causing both to spin out.  \n- Yellow and blue car navigate a tight turn, with yellow car slightly ahead.  \n- Spectators stand behind barriers, observing the race from elevated positions.\n[90-120s] - Miniature cars race on a wet track, with a yellow car and a purple car colliding near a turn.  \n- Spectators watch from behind barriers, some holding remote controls, as the race progresses.  \n- A green car overtakes a red car during a straightaway, followed by a sharp turn where multiple cars jostle for position.\n[120-150s] - Red car and green car race closely on wet track, passing each other near turn.\n- White car and black car collide mid-race, causing both to spin out and skid across track.\n- Spectators watch from behind barriers as race continues with multiple cars navigating wet course.\n[150-180s] - White car overtakes black car on wet track, both navigating a turn with visible tire spray.  \n- Multiple cars, including orange and red, cluster ahead, indicating a tight pack during the race.  \n- Spectators stand behind barriers, observing the race from an elevated position.\n[180-210s] - A white car with black decals overtakes a black car with orange accents on a wet track.  \n- A red car with blue lights is seen ahead, followed by a silver car with a black roof.  \n- The cars navigate a turn with green grass and red-and-white curbs, while spectators watch from behind barriers.\n[210-240s] - Red car and black-and-white car collide near a turn, with red car flipping over.  \n- Green car and white car navigate a straight section, with green car slightly ahead.  \n- Spectators visible behind barriers, watching the race unfold.\n[240-270s] - Yellow car with black decals leads a close group, overtaking a dark blue car on a curved track section.  \n- Dark blue car with rear spoiler follows closely, navigating the turn while maintaining proximity to the yellow car.  \n- A black car with white accents trails behind, positioned slightly lower on the track, avoiding collision with the leading cars.\n[270-300s] - Multiple RC cars race on a wet track, with a blue car and a black car visibly colliding near the center.  \n- Spectators stand behind barriers, watching the race from various angles.  \n- The track features green grass, red-and-white curbs, and small palm trees, with a yellow pit area visible on the right.", "history_tokens": 734, "history_utf8_bytes": 3130, "recent_frame_times_s": [294.0103833333333, 295.01138333333336, 296.01238333333333, 297.0133833333333, 298.01438333333334, 299.0153833333333, 300.01638333333335, 301.0007, 302.0017, 303.0027, 304.0037, 305.0047, 306.0057, 307.0067, 308.0077, 309.0087, 310.0097, 311.0107, 312.0117, 313.0127, 314.0137, 315.0147, 316.0157, 317.0000166666667, 318.00101666666666, 319.0020166666667, 320.00301666666667, 321.00401666666664, 322.0050166666667, 323.00601666666665], "recent_frames_sha256": "85ae4428e148eaaff345b131b55b017493c4e3fe21fb063cc5cc658dea74757f", "num_recent_frames": 30, "tq": 715375.858891376, "t1": 715381.833266126, "ta": 715381.833266126, "te": 715382.024409856, "first_response_s": 5.974374750046991, "answer_total_s": 6.165518480003811, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 492, "content_group": "86c5c3022a6c119f0c70d589505cf29d413850001d8368e333ad448bf642ac1c", "question": {"question_id": "sample_492_a666_q0", "video_id": 492, "video_path": "./videos/sample_492_real.mp4", "annotation_index": 666, "question_index": 0, "question": "What logo appears on the screen during the initial scene transition?", "options": ["A. GRAVITY THROTTLE RACING.", "B. RACING THUNDER.", "C. SPEED CIRCUIT.", "D. TRACK RUNNERS."], "answer": "A", "time_stamp_s": 10, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_492_a666_q0", "video_id": 492, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4d45450a90eaca4a7e6307e67f7c2d4da1cb2f61587100365829741672c9bc59", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001001001001001, 2.002002002002002, 3.003003003003003, 4.004004004004004, 5.005005005005005, 6.006006006006006, 7.007007007007007, 8.008008008008009, 9.00900900900901], "recent_frames_sha256": "2e39189fa1f80b09cea114e1560ce15cb42aa3e4a12010082872cc7d27dfe4cf", "num_recent_frames": 10, "tq": 718716.475320502, "t1": 718729.314485436, "ta": 718729.314485436, "te": 718729.35268376, "first_response_s": 12.839164934004657, "answer_total_s": 12.877363258041441, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_492_a666_q0", "video_id": 492, "time_stamp_s": 10, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "29bbed0aec58dbde120172c2850e01be13a6c3de87084b5b6fe52693165b99d2", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001001001001001, 2.002002002002002, 3.003003003003003, 4.004004004004004, 5.005005005005005, 6.006006006006006, 7.007007007007007, 8.008008008008009, 9.00900900900901], "recent_frames_sha256": "2e39189fa1f80b09cea114e1560ce15cb42aa3e4a12010082872cc7d27dfe4cf", "num_recent_frames": 10, "tq": 718470.291674418, "t1": 718481.104342625, "ta": 718481.104342625, "te": 718481.441540692, "first_response_s": 10.812668206985109, "answer_total_s": 11.149866273975931, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 492, "content_group": "86c5c3022a6c119f0c70d589505cf29d413850001d8368e333ad448bf642ac1c", "question": {"question_id": "sample_492_a666_q1", "video_id": 492, "video_path": "./videos/sample_492_real.mp4", "annotation_index": 666, "question_index": 1, "question": "What has been shown in the video so far?", "options": ["A. A series of scenes featuring a miniature diorama with various toy elements.", "B. A documentary on real-life racing events.", "C. A detailed explanation of a new racing game.", "D. A tutorial on setting up a model train track."], "answer": "A", "time_stamp_s": 21, "task_type": "Clips Summarize", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_492_a666_q1", "video_id": 492, "time_stamp_s": 21, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "88d77a91e5ebdfb326358c437b0b5e9295c52d9244728dba4b7fc108966e2d9c", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001001001001001, 2.002002002002002, 3.003003003003003, 4.004004004004004, 5.005005005005005, 6.006006006006006, 7.007007007007007, 8.008008008008009, 9.00900900900901, 10.01001001001001, 11.01101101101101, 12.012012012012011, 13.013013013013014, 14.014014014014014, 15.015015015015015, 16.016016016016017, 17.000333667000334, 18.001334668001334, 19.002335669002335, 20.003336670003335], "recent_frames_sha256": "753f9e654760faa03154738c8f2706857e9584de91d3b183198941b75b841a4b", "num_recent_frames": 21, "tq": 718729.361201527, "t1": 718742.275280427, "ta": 718742.275280427, "te": 718742.314844664, "first_response_s": 12.914078900008462, "answer_total_s": 12.95364313700702, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_492_a666_q1", "video_id": 492, "time_stamp_s": 21, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bf08ea832267b53577c578a814a1580576ebf25da11571f4974416c235f26941", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001001001001001, 2.002002002002002, 3.003003003003003, 4.004004004004004, 5.005005005005005, 6.006006006006006, 7.007007007007007, 8.008008008008009, 9.00900900900901, 10.01001001001001, 11.01101101101101, 12.012012012012011, 13.013013013013014, 14.014014014014014, 15.015015015015015, 16.016016016016017, 17.000333667000334, 18.001334668001334, 19.002335669002335, 20.003336670003335], "recent_frames_sha256": "753f9e654760faa03154738c8f2706857e9584de91d3b183198941b75b841a4b", "num_recent_frames": 21, "tq": 718481.452421415, "t1": 718494.325067827, "ta": 718494.325067827, "te": 718494.565280037, "first_response_s": 12.872646411997266, "answer_total_s": 13.112858621985652, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 492, "content_group": "86c5c3022a6c119f0c70d589505cf29d413850001d8368e333ad448bf642ac1c", "question": {"question_id": "sample_492_a667_q0", "video_id": 492, "video_path": "./videos/sample_492_real.mp4", "annotation_index": 667, "question_index": 0, "question": "What happens after the red car lands from the jump?", "options": ["A. It drives into a dense forest.", "B. It continued to move forward on the sandy ground.", "C. It stops at a rocky cliff.", "D. It enters a tunnel."], "answer": "B", "time_stamp_s": 420, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_492_a667_q0", "video_id": 492, "time_stamp_s": 420, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2c0c34cc0026a38b237f0267e2a17d5434a9636a54bb367a6bcfc1e852f2f7f4", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [390.00667334000667, 391.00767434100766, 392.0086753420087, 393.0096763430097, 394.0106773440107, 395.01167834501166, 396.0126793460127, 397.0136803470137, 398.0146813480147, 399.01568234901566, 400.0, 401.001001001001, 402.00200200200203, 403.003003003003, 404.004004004004, 405.005005005005, 406.00600600600603, 407.007007007007, 408.008008008008, 409.009009009009, 410.01001001001003, 411.011011011011, 412.012012012012, 413.013013013013, 414.01401401401404, 415.015015015015, 416.016016016016, 417.00033366700035, 418.00133466800133, 419.0023356690023], "recent_frames_sha256": "36c9eaa2aa9d3c61299be7b2888da6aa2870b806581845c96a23a4311d5b8906", "num_recent_frames": 30, "tq": 718742.324055311, "t1": 718754.292442687, "ta": 718754.292442687, "te": 718754.330704528, "first_response_s": 11.96838737593498, "answer_total_s": 12.006649216986261, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_492_a667_q0", "video_id": 492, "time_stamp_s": 420, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "11d836443dbf6e9ac8a9ddcbce96baabcf28e0d14342376e63b180c1c600b361", "condition_order": ["notes", "recent"], "memory": "[150-180s] - A digital scoreboard displays race team standings with \"Scooter\" leading in R1 and R2, while \"Maree Mapelli\" and \"Crazy Canuck\" follow with 3 points each.\n- Four toy vehicles (Greg, Crazy Canuck, Maree Mapelli, Scooter) are positioned on a snowy track, ready to race, with the track curving through snowy terrain and trees.\n- The camera pans to show the vehicles starting their race on a winding path, with one vehicle (Scooter) leading slightly ahead as they navigate the snowy course.\n[180-210s] - A black SUV drives along a winding road, passing under a tunnel and near a billboard displaying \"Baja 1000\" and \"MOTORSPORTS\".\n- A red and black race car speeds through a snowy section, with orange and white barriers lining the track.\n- A digital scoreboard shows \"LAP 10\" and \"TIME 0:00:00\" as the cars navigate a sharp turn.\n[210-240s] - A yellow truck navigates a curved road near a large rock formation, with other vehicles following behind.  \n- A scoreboard displays race results for four participants: Scooter, Maree Mapelli, Crazy Canuck, and Greg, with their respective scores across multiple laps.  \n- A snowy track scene shows five toy vehicles lined up at the start, including Crazy Canuck, Maree Mapelli, Scooter, and Greg, preparing for Race 3.\n[240-270s] - A yellow car drives along a paved road past a \"SUNSHINE\" sign and a digital display showing \"00:00:00\" as it approaches a checkpoint.  \n- A white car follows closely behind, passing a \"SUNSHINE\" sign and a digital display showing \"00:00:00\" as it approaches a checkpoint.  \n- A black car is seen driving on a separate road, passing a \"SUNSHINE\" sign and a digital display showing \"00:00:00\" as it approaches a checkpoint.\n[270-300s] - Race team scores displayed: \"Scooter\" (7), \"Maree Napelli\" (8), \"Crazy Canuck\" (9), \"Greg\" (6) with individual lap times.\n- Vehicles shown in the background: a yellow SUV, a red truck, and a black car on the track.\n- Road and railway tracks visible with a green sign and a tunnel entrance in the landscape.\n[300-330s] - Three toy trucks (Scooter, Marce Mapelli, Crazy Canuck) start a race on a snowy track, with Marce Mapelli in first, Scooter second, and Crazy Canuck third.  \n- The track features snow-covered terrain, a river crossing, and a tunnel, with the trucks navigating curves and obstacles.  \n- A scoreboard shows race results: Scooter (7), Marce Mapelli (8), Crazy Canuck (6), with Greg (6) also listed.\n[330-360s] - A silver car speeds along a desert road, passing a white truck and a yellow car on a winding track.  \n- A digital scoreboard displays \"1:00:00\" as a red car races past it, with \"MOTORSPORTS\" text visible below.  \n- The scene transitions to a snowy mountain road where two cars navigate a curve, with a \"REPLAY\" logo appearing in the corner.\n[360-390s] - Two toy cars, a red 1988 Ferrari F40 and a black Mitsubishi Lancer Evolution, are positioned side-by-side on a miniature track with snowy background.  \n- A scoreboard overlay shows race results for \"SCOOTER,\" \"MAREE MAPPELLI,\" \"CRAZY CARBON,\" and \"GREG,\" with \"HALFTIME SPECIAL\" title appearing.  \n- The scene transitions to a top-down view of a curved road with toy vehicles navigating around a central rock formation.\n[390-420s] - Red Ferrari model car shown with \"Ferrari\" logo and \"Polo Racing\" text, displaying weight breakdown (32.1g/55% and 25.8g/45%).\n- Car is positioned on a textured surface, with a blurred background featuring a blue water body and distant structures.\n- The car is later seen in a miniature desert race scene, navigating sandy tracks with other vehicles and obstacles.", "history_tokens": 982, "history_utf8_bytes": 3599, "recent_frame_times_s": [390.00667334000667, 391.00767434100766, 392.0086753420087, 393.0096763430097, 394.0106773440107, 395.01167834501166, 396.0126793460127, 397.0136803470137, 398.0146813480147, 399.01568234901566, 400.0, 401.001001001001, 402.00200200200203, 403.003003003003, 404.004004004004, 405.005005005005, 406.00600600600603, 407.007007007007, 408.008008008008, 409.009009009009, 410.01001001001003, 411.011011011011, 412.012012012012, 413.013013013013, 414.01401401401404, 415.015015015015, 416.016016016016, 417.00033366700035, 418.00133466800133, 419.0023356690023], "recent_frames_sha256": "36c9eaa2aa9d3c61299be7b2888da6aa2870b806581845c96a23a4311d5b8906", "num_recent_frames": 30, "tq": 718593.975433641, "t1": 718595.773688455, "ta": 718595.773688455, "te": 718595.814742536, "first_response_s": 1.7982548139989376, "answer_total_s": 1.8393088950542733, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 492, "content_group": "86c5c3022a6c119f0c70d589505cf29d413850001d8368e333ad448bf642ac1c", "question": {"question_id": "sample_492_a668_q0", "video_id": 492, "video_path": "./videos/sample_492_real.mp4", "annotation_index": 668, "question_index": 0, "question": "What is the track currently displayed in the video made up of?", "options": ["A. Asphalt.", "B. Sand.", "C. Grass.", "D. Snow."], "answer": "D", "time_stamp_s": 667, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [660, 720], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_492_a668_q0", "video_id": 492, "time_stamp_s": 667, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b91fc9325b233d16ccfa525a735cf348dc9848fde50ec389fa7f890860e37ce8", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [637.0036703370037, 638.0046713380046, 639.0056723390056, 640.0066733400067, 641.0076743410077, 642.0086753420087, 643.0096763430097, 644.0106773440107, 645.0116783450117, 646.0126793460126, 647.0136803470136, 648.0146813480147, 649.0156823490157, 650.0, 651.001001001001, 652.002002002002, 653.003003003003, 654.0040040040041, 655.005005005005, 656.006006006006, 657.007007007007, 658.008008008008, 659.009009009009, 660.01001001001, 661.011011011011, 662.0120120120121, 663.013013013013, 664.014014014014, 665.015015015015, 666.016016016016], "recent_frames_sha256": "432e77dfe66cafa2242266f1e843830192eb1bdc7d8faca1b00f931b0310c02f", "num_recent_frames": 30, "tq": 718754.340125273, "t1": 718768.205037737, "ta": 718768.205037737, "te": 718768.244618101, "first_response_s": 13.864912464050576, "answer_total_s": 13.904492828063667, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_492_a668_q0", "video_id": 492, "time_stamp_s": 667, "ground_truth": "D", "raw_output": "D. Snow.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "97fa2eb605fd79770faff3fb216a3bec2fd8a38348ea16286402607dca06621d", "condition_order": ["notes", "recent"], "memory": "[360-390s] - Two toy cars, a red 1988 Ferrari F40 and a black Mitsubishi Lancer Evolution, are positioned side-by-side on a miniature track with snowy background.  \n- A scoreboard overlay shows race results for \"SCOOTER,\" \"MAREE MAPPELLI,\" \"CRAZY CARBON,\" and \"GREG,\" with \"HALFTIME SPECIAL\" title appearing.  \n- The scene transitions to a top-down view of a curved road with toy vehicles navigating around a central rock formation.\n[390-420s] - Red Ferrari model car shown with \"Ferrari\" logo and \"Polo Racing\" text, displaying weight breakdown (32.1g/55% and 25.8g/45%).\n- Car is positioned on a textured surface, with a blurred background featuring a blue water body and distant structures.\n- The car is later seen in a miniature desert race scene, navigating sandy tracks with other vehicles and obstacles.\n[420-450s] - Orange car navigates a winding desert road, passing a signpost and a digital timer displaying \"0:00\" at 420.5s.  \n- At 428.5s, the car approaches a sand dune with a crane model nearby, then continues along a curving path.  \n- By 448.5s, the car is seen on a steep, rocky incline with trees and a signpost visible, indicating a challenging terrain.\n[450-480s] - Orange car navigates a winding mountain road, passing through a tunnel with a barrier arm overhead.\n- A green car and a black car are seen on a separate sandy track, with a snowplow and green vehicle parked nearby.\n- A digital display shows \"Race Time 20.100\" as the orange car speeds along a coastal road with billboards.\n[480-510s] - Two toy cars (black and orange) race along a sandy track, with the black car slightly ahead.  \n- The scene transitions to a wider view showing the cars navigating a curved road with sparse trees and a distant building.  \n- A blue digital display labeled \"RACE 5\" appears near a roadside structure, indicating a race segment.\n[510-540s] - Four toy cars (Scooter, Dreg, Crazy Canuck, Maree Mapelli) race on a snowy track, with the green car leading.  \n- The scene transitions to a desert road with toy cars navigating curves, passing a train and crossing a bridge.  \n- A white van and yellow taxis are seen on a winding road near a rock formation, with a train passing overhead.\n[540-570s] - A white and red car navigates a snowy, winding mountain road, closely followed by a dark-colored SUV.  \n- A yellow vehicle is seen ahead, approaching a sharp curve on the same road.  \n- A train with red and yellow cargo cars travels parallel to the road on an adjacent track.\n[570-600s] - Four toy trucks (Greg, Crazy Canuck, Marea Napelli, Scooter) start on a snowy track, with green lights indicating race commencement.  \n- The trucks navigate a winding, snow-covered course with small trees and a distant signpost visible.  \n- A yellow truck leads the pack, followed by others, as they descend a slope with visible tire tracks in the snow.\n[600-630s] - A yellow train with orange and yellow cargo cars moves along tracks beside a road, passing under a tunnel.  \n- A black SUV drives on a paved road, approaching a white vehicle parked near a tunnel entrance.  \n- A digital scoreboard displays \"1:00:00\" and \"1:00:00\" with \"REPLAY\" text, indicating a race or timed event.\n[630-660s] - Aerial view shows toy cars navigating a winding, snow-dusted mountain road with tunnels and bridges.  \n- A scoreboard displays race results for teams: Scooter (13 points), Marelle Mapelli (12 points), Crazy Canuck (20 points), and Grec (20 points).  \n- Toy vehicles, including a yellow truck and a green car, are seen moving along the track, with some near a tunnel entrance.", "history_tokens": 938, "history_utf8_bytes": 3573, "recent_frame_times_s": [637.0036703370037, 638.0046713380046, 639.0056723390056, 640.0066733400067, 641.0076743410077, 642.0086753420087, 643.0096763430097, 644.0106773440107, 645.0116783450117, 646.0126793460126, 647.0136803470136, 648.0146813480147, 649.0156823490157, 650.0, 651.001001001001, 652.002002002002, 653.003003003003, 654.0040040040041, 655.005005005005, 656.006006006006, 657.007007007007, 658.008008008008, 659.009009009009, 660.01001001001, 661.011011011011, 662.0120120120121, 663.013013013013, 664.014014014014, 665.015015015015, 666.016016016016], "recent_frames_sha256": "432e77dfe66cafa2242266f1e843830192eb1bdc7d8faca1b00f931b0310c02f", "num_recent_frames": 30, "tq": 718654.639955981, "t1": 718661.421396851, "ta": 718661.421396851, "te": 718661.570166757, "first_response_s": 6.781440869905055, "answer_total_s": 6.930210775928572, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 492, "content_group": "86c5c3022a6c119f0c70d589505cf29d413850001d8368e333ad448bf642ac1c", "question": {"question_id": "sample_492_a669_q0", "video_id": 492, "video_path": "./videos/sample_492_real.mp4", "annotation_index": 669, "question_index": 0, "question": "What is the green dinosaur holding on its head?", "options": ["A. A miniature human figure.", "B. A piece of railroad track.", "C. A toy truck.", "D. A toy car."], "answer": "D", "time_stamp_s": 840, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [780, 840], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_492_a669_q0", "video_id": 492, "time_stamp_s": 840, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "9db068ead5e0b6bd0dc5725224dffde7ee01ad343a55324584ddfb8d8dc40866", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [810.01001001001, 811.011011011011, 812.0120120120121, 813.013013013013, 814.014014014014, 815.015015015015, 816.016016016016, 817.0003336670003, 818.0013346680014, 819.0023356690024, 820.0033366700034, 821.0043376710044, 822.0053386720053, 823.0063396730063, 824.0073406740073, 825.0083416750083, 826.0093426760094, 827.0103436770104, 828.0113446780114, 829.0123456790124, 830.0133466800133, 831.0143476810143, 832.0153486820153, 833.0163496830163, 834.0006673340007, 835.0016683350017, 836.0026693360027, 837.0036703370037, 838.0046713380046, 839.0056723390056], "recent_frames_sha256": "7970d1fb51a2b8657a1738feb5544dd080c80fd4952d3fcd6df5451096625f96", "num_recent_frames": 30, "tq": 718768.264182761, "t1": 718779.456426325, "ta": 718779.456426325, "te": 718779.494961618, "first_response_s": 11.192243564059027, "answer_total_s": 11.230778857017867, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_492_a669_q0", "video_id": 492, "time_stamp_s": 840, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "006b5fc7ec120706983d74ac5fe0b245c9a9fc7e101bfbf67c5e0a0d41ab72fa", "condition_order": ["notes", "recent"], "memory": "[510-540s] - Four toy cars (Scooter, Dreg, Crazy Canuck, Maree Mapelli) race on a snowy track, with the green car leading.  \n- The scene transitions to a desert road with toy cars navigating curves, passing a train and crossing a bridge.  \n- A white van and yellow taxis are seen on a winding road near a rock formation, with a train passing overhead.\n[540-570s] - A white and red car navigates a snowy, winding mountain road, closely followed by a dark-colored SUV.  \n- A yellow vehicle is seen ahead, approaching a sharp curve on the same road.  \n- A train with red and yellow cargo cars travels parallel to the road on an adjacent track.\n[570-600s] - Four toy trucks (Greg, Crazy Canuck, Marea Napelli, Scooter) start on a snowy track, with green lights indicating race commencement.  \n- The trucks navigate a winding, snow-covered course with small trees and a distant signpost visible.  \n- A yellow truck leads the pack, followed by others, as they descend a slope with visible tire tracks in the snow.\n[600-630s] - A yellow train with orange and yellow cargo cars moves along tracks beside a road, passing under a tunnel.  \n- A black SUV drives on a paved road, approaching a white vehicle parked near a tunnel entrance.  \n- A digital scoreboard displays \"1:00:00\" and \"1:00:00\" with \"REPLAY\" text, indicating a race or timed event.\n[630-660s] - Aerial view shows toy cars navigating a winding, snow-dusted mountain road with tunnels and bridges.  \n- A scoreboard displays race results for teams: Scooter (13 points), Marelle Mapelli (12 points), Crazy Canuck (20 points), and Grec (20 points).  \n- Toy vehicles, including a yellow truck and a green car, are seen moving along the track, with some near a tunnel entrance.\n[660-690s] - Four toy cars (Crazy Canuck, Mares Mapelli, Scooter, Greg) start a race on a snowy track, with one car leading and others trailing.  \n- The track transitions from snow-covered to dirt roads, passing through a tunnel and alongside a train.  \n- A yellow train with \"Savvy\" branding and other freight cars pass by the race track, indicating a parallel railway system.\n[690-720s] - A black SUV with orange wheels speeds past a \"CRO\" sign and a digital display showing \"0:00\" and \"CRO\" as it navigates a desert track.  \n- A green and yellow off-road vehicle overtakes a dark-colored SUV on a winding mountain road, with snow-capped peaks and pine trees in the background.  \n- A white car drives along a complex, multi-lane road system with train tracks and tunnels, passing under an overpass while a freight train moves parallel to the road.\n[720-750s] - Three toy cars (green, black, and red) race down a snowy track, with the green car leading.  \n- A digital scoreboard displays race results for teams \"Scooter,\" \"Maree Mapelli,\" and \"Crazy Canuck.\"  \n- The track features snow-covered curves and a tunnel entrance ahead, with cars positioned for the next turn.\n[750-780s] - A digital scoreboard displays \"1:00\" and \"YOU TROPHY\" on a roadside structure near a desert road.  \n- A white car with red accents drives past the scoreboard, followed by a black SUV.  \n- The scene includes miniature trees, a dirt road, and distant mountains under a blue sky.\n[780-810s] - A yellow car speeds through a winding mountain road, passing a tunnel entrance marked \"WATER TUNNEL\".  \n- A white car follows closely behind, navigating the same curve.  \n- A leaderboard overlay displays race results for teams including \"SCOOTER\", \"MAREE MAPFEL\", \"CRAZY CARNES\", and \"GREG\", with their respective scores and positions.\n[810-840s] - A large, colorful, upside-down car model is suspended mid-air above a miniature track, with a yellow and orange slide-like structure beneath it.  \n- Several miniature figures are gathered around the scene, some standing near the car and others near a black police car on the right.  \n- The background features a detailed miniature landscape with mountains, buildings, and parked vehicles, all under a clear blue sky.", "history_tokens": 1002, "history_utf8_bytes": 3968, "recent_frame_times_s": [810.01001001001, 811.011011011011, 812.0120120120121, 813.013013013013, 814.014014014014, 815.015015015015, 816.016016016016, 817.0003336670003, 818.0013346680014, 819.0023356690024, 820.0033366700034, 821.0043376710044, 822.0053386720053, 823.0063396730063, 824.0073406740073, 825.0083416750083, 826.0093426760094, 827.0103436770104, 828.0113446780114, 829.0123456790124, 830.0133466800133, 831.0143476810143, 832.0153486820153, 833.0163496830163, 834.0006673340007, 835.0016683350017, 836.0026693360027, 837.0036703370037, 838.0046713380046, 839.0056723390056], "recent_frames_sha256": "7970d1fb51a2b8657a1738feb5544dd080c80fd4952d3fcd6df5451096625f96", "num_recent_frames": 30, "tq": 718709.323594174, "t1": 718716.392139028, "ta": 718716.392139028, "te": 718716.436551591, "first_response_s": 7.068544853944331, "answer_total_s": 7.112957417033613, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 494, "content_group": "4747844fe2c95e2e39ec94c41213577fa4ebbe884eb6c9024556386928e36286", "question": {"question_id": "sample_494_a187_q0", "video_id": 494, "video_path": "./videos/sample_494_real.mp4", "annotation_index": 187, "question_index": 0, "question": "What is the license plate number of the car currently shown in the video?", "options": ["A. 18.", "B. 197.", "C. 56.", "D. 46."], "answer": "D", "time_stamp_s": 30, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_494_a187_q0", "video_id": 494, "time_stamp_s": 30, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "de242b5f0982ef557ce3fb75b91698ceb92fe505ebcfa27587d113e01d1c5e31", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001001001001001, 2.002002002002002, 3.003003003003003, 4.004004004004004, 5.005005005005005, 6.006006006006006, 7.007007007007007, 8.008008008008009, 9.00900900900901, 10.01001001001001, 11.01101101101101, 12.012012012012011, 13.013013013013014, 14.014014014014014, 15.015015015015015, 16.016016016016017, 17.000333667000334, 18.001334668001334, 19.002335669002335, 20.003336670003335, 21.004337671004336, 22.00533867200534, 23.00633967300634, 24.00734067400734, 25.008341675008342, 26.009342676009343, 27.010343677010344, 28.011344678011344, 29.012345679012345], "recent_frames_sha256": "f2edc8e5b072bcff5f6d82c81ebf1e42954a17902add963d497dbd377e481d27", "num_recent_frames": 30, "tq": 718716.48816092, "t1": 718729.314485436, "ta": 718729.314485436, "te": 718729.35268376, "first_response_s": 12.826324515976012, "answer_total_s": 12.864522840012796, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_494_a187_q0", "video_id": 494, "time_stamp_s": 30, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "fc81a7626a4d3b431b7e9ad3d87f1d33aef9deb49a0c1cd487fc4de3c6c29d82", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Two men stand on a stage in front of a \"Gravity Throttle Racing\" backdrop, one holding a microphone and gesturing while the other holds a microphone and gestures toward the first.  \n- A lime green Audi RS6 Avant model car (Seed #12, Q Time: 25.392, WtDist: 41% / 59% front to rear) is displayed with text overlay detailing team, driver, and car specifications.  \n- The scene transitions from a dark, textured background to a bright, colorful desert-themed stage with cacti and birds, indicating a racing event", "history_tokens": 135, "history_utf8_bytes": 519, "recent_frame_times_s": [0.0, 1.001001001001001, 2.002002002002002, 3.003003003003003, 4.004004004004004, 5.005005005005005, 6.006006006006006, 7.007007007007007, 8.008008008008009, 9.00900900900901, 10.01001001001001, 11.01101101101101, 12.012012012012011, 13.013013013013014, 14.014014014014014, 15.015015015015015, 16.016016016016017, 17.000333667000334, 18.001334668001334, 19.002335669002335, 20.003336670003335, 21.004337671004336, 22.00533867200534, 23.00633967300634, 24.00734067400734, 25.008341675008342, 26.009342676009343, 27.010343677010344, 28.011344678011344, 29.012345679012345], "recent_frames_sha256": "f2edc8e5b072bcff5f6d82c81ebf1e42954a17902add963d497dbd377e481d27", "num_recent_frames": 30, "tq": 718793.460788744, "t1": 718799.448953849, "ta": 718799.448953849, "te": 718799.748071293, "first_response_s": 5.98816510499455, "answer_total_s": 6.28728254896123, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 494, "content_group": "4747844fe2c95e2e39ec94c41213577fa4ebbe884eb6c9024556386928e36286", "question": {"question_id": "sample_494_a188_q0", "video_id": 494, "video_path": "./videos/sample_494_real.mp4", "annotation_index": 188, "question_index": 0, "question": "What color is the car that is in the lead along with the green car?", "options": ["A. Blue.", "B. Red and black.", "C. Yellow and red.", "D. Black and blue."], "answer": "D", "time_stamp_s": 219, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_494_a188_q0", "video_id": 494, "time_stamp_s": 219, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f1468f9b5c31388d6b281d9db3d91c282a3d88bc812e1c5123f77aec9cd09649", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [189.00567233900568, 190.00667334000667, 191.0076743410077, 192.00867534200867, 193.0096763430097, 194.01067734401067, 195.0116783450117, 196.01267934601267, 197.0136803470137, 198.01468134801468, 199.0156823490157, 200.0, 201.00100100100101, 202.002002002002, 203.00300300300302, 204.004004004004, 205.00500500500502, 206.006006006006, 207.00700700700702, 208.008008008008, 209.00900900900902, 210.01001001001, 211.01101101101102, 212.012012012012, 213.01301301301302, 214.014014014014, 215.01501501501502, 216.016016016016, 217.00033366700035, 218.00133466800133], "recent_frames_sha256": "cb30784e95a9d1c92227918d665dc7f6f59a64738057be4d2f96649e513aeac7", "num_recent_frames": 30, "tq": 718729.365179065, "t1": 718742.275280427, "ta": 718742.275280427, "te": 718742.314844664, "first_response_s": 12.910101361921988, "answer_total_s": 12.949665598920546, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_494_a188_q0", "video_id": 494, "time_stamp_s": 219, "ground_truth": "D", "raw_output": "A. Blue.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "e6355f23460799eef680d7b91bb42996ad0b13eef65030badebd8c3cc1d5b1dc", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Two men stand on a stage in front of a \"Gravity Throttle Racing\" backdrop, one holding a microphone and gesturing while the other holds a microphone and gestures toward the first.  \n- A lime green Audi RS6 Avant model car (Seed #12, Q Time: 25.392, WtDist: 41% / 59% front to rear) is displayed with text overlay detailing team, driver, and car specifications.  \n- The scene transitions from a dark, textured background to a bright, colorful desert-themed stage with cacti and birds, indicating a racing event\n[30-60s] - A lime green 2017 Audi RS6 Avant model car with black racing stripes and number \"46\" is shown, with stats indicating Q Time: 26.392 and WtDist: 41%–59% (front to rear).\n- A blue and black 2017 Audi RS6 Avant model car with number \"18\" is displayed, with stats showing Q Time: 26.188 and WtDist: 42%–58% (front to rear).\n- A red and black 1971 D\n[60-90s] - Toy cars race along a winding, snow-covered track with a blue backdrop and small trees.  \n- A yellow school bus and a white van are visible on the track, navigating curves and hills.  \n- The track includes a bridge and a tunnel, with cars passing through them as the camera pans.\n[90-120s] - A blue car speeds along a paved path near a digital timer displaying \"TIME 0:00\" and \"300 TRICKS\" as it passes a \"RODDIN RACING\" sign.  \n- A green car follows, navigating a snowy mountain road with pine trees, while a \"REPLAY\" graphic appears in the corner.  \n- A blue car drives on a straight road beside train tracks, then veers onto a narrow path near a ladder, with a white car visible in the background.\n[120-150s] - A leaderboard overlay displays race results for \"2023-2024 Braggin' Wagon\" with teams like \"Bromman\" and \"Booknook\" ranked by total points.\n- Toy cars race on a snowy track, with a green car leading and others following, passing through a tunnel and navigating curves.\n- The track transitions from snowy terrain to a desert-like landscape with trees and hills, featuring a bridge over a canyon.\n[150-180s] - A green car and a black car race on a winding road, with the green car leading.  \n- A blue car follows closely behind, navigating a sharp turn near a rocky cliffside.  \n- A digital scoreboard displays \"1:00\" as the cars pass a checkpoint, indicating a timed race.\n[180-210s] - A green toy car speeds along a curved road, passing a blue car and approaching a ramp.  \n- A scoreboard overlay displays race results for \"2023-2024 DRAGGIN WAGON\" with entries for \"BOMMANN,\" \"BOOKBOOK,\" and \"PAPA DIVIDED.\"  \n- Toy vehicles are positioned on a snowy terrain, with a train track and a snow-covered hill in the background.", "history_tokens": 734, "history_utf8_bytes": 2627, "recent_frame_times_s": [189.00567233900568, 190.00667334000667, 191.0076743410077, 192.00867534200867, 193.0096763430097, 194.01067734401067, 195.0116783450117, 196.01267934601267, 197.0136803470137, 198.01468134801468, 199.0156823490157, 200.0, 201.00100100100101, 202.002002002002, 203.00300300300302, 204.004004004004, 205.00500500500502, 206.006006006006, 207.00700700700702, 208.008008008008, 209.00900900900902, 210.01001001001, 211.01101101101102, 212.012012012012, 213.01301301301302, 214.014014014014, 215.01501501501502, 216.016016016016, 217.00033366700035, 218.00133466800133], "recent_frames_sha256": "cb30784e95a9d1c92227918d665dc7f6f59a64738057be4d2f96649e513aeac7", "num_recent_frames": 30, "tq": 718854.658572242, "t1": 718861.203088091, "ta": 718861.203088091, "te": 718861.468106654, "first_response_s": 6.544515848974697, "answer_total_s": 6.809534411993809, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 494, "content_group": "4747844fe2c95e2e39ec94c41213577fa4ebbe884eb6c9024556386928e36286", "question": {"question_id": "sample_494_a188_q1", "video_id": 494, "video_path": "./videos/sample_494_real.mp4", "annotation_index": 188, "question_index": 1, "question": "Which racing car won first place in this competition?", "options": ["A. The pink car.", "B. The dark green car.", "C. The light green car.", "D. The green car."], "answer": "D", "time_stamp_s": 351, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_494_a188_q1", "video_id": 494, "time_stamp_s": 351, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "aff745d11dbb76b36fb921419b1ceade2ea433a743abefa19ee41b0f65548027", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [321.00433767100435, 322.00533867200534, 323.0063396730063, 324.00734067400737, 325.00834167500835, 326.00934267600934, 327.0103436770103, 328.01134467801137, 329.01234567901236, 330.01334668001334, 331.0143476810143, 332.0153486820154, 333.01634968301636, 334.0006673340007, 335.0016683350017, 336.00266933600267, 337.00367033700365, 338.0046713380047, 339.0056723390057, 340.00667334000667, 341.00767434100766, 342.0086753420087, 343.0096763430097, 344.0106773440107, 345.01167834501166, 346.0126793460127, 347.0136803470137, 348.0146813480147, 349.01568234901566, 350.0], "recent_frames_sha256": "8684e68df4b395f54671ee224534eb754709cbf295901739e7c548886382b081", "num_recent_frames": 30, "tq": 718742.327944721, "t1": 718754.292442687, "ta": 718754.292442687, "te": 718754.330704528, "first_response_s": 11.96449796599336, "answer_total_s": 12.00275980704464, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_494_a188_q1", "video_id": 494, "time_stamp_s": 351, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c30a04baace72ab7a2afafca42ccd14e44a14992495d1a2a2ed02347299fb7bd", "condition_order": ["recent", "notes"], "memory": "[30-60s] - A lime green 2017 Audi RS6 Avant model car with black racing stripes and number \"46\" is shown, with stats indicating Q Time: 26.392 and WtDist: 41%–59% (front to rear).\n- A blue and black 2017 Audi RS6 Avant model car with number \"18\" is displayed, with stats showing Q Time: 26.188 and WtDist: 42%–58% (front to rear).\n- A red and black 1971 D\n[60-90s] - Toy cars race along a winding, snow-covered track with a blue backdrop and small trees.  \n- A yellow school bus and a white van are visible on the track, navigating curves and hills.  \n- The track includes a bridge and a tunnel, with cars passing through them as the camera pans.\n[90-120s] - A blue car speeds along a paved path near a digital timer displaying \"TIME 0:00\" and \"300 TRICKS\" as it passes a \"RODDIN RACING\" sign.  \n- A green car follows, navigating a snowy mountain road with pine trees, while a \"REPLAY\" graphic appears in the corner.  \n- A blue car drives on a straight road beside train tracks, then veers onto a narrow path near a ladder, with a white car visible in the background.\n[120-150s] - A leaderboard overlay displays race results for \"2023-2024 Braggin' Wagon\" with teams like \"Bromman\" and \"Booknook\" ranked by total points.\n- Toy cars race on a snowy track, with a green car leading and others following, passing through a tunnel and navigating curves.\n- The track transitions from snowy terrain to a desert-like landscape with trees and hills, featuring a bridge over a canyon.\n[150-180s] - A green car and a black car race on a winding road, with the green car leading.  \n- A blue car follows closely behind, navigating a sharp turn near a rocky cliffside.  \n- A digital scoreboard displays \"1:00\" as the cars pass a checkpoint, indicating a timed race.\n[180-210s] - A green toy car speeds along a curved road, passing a blue car and approaching a ramp.  \n- A scoreboard overlay displays race results for \"2023-2024 DRAGGIN WAGON\" with entries for \"BOMMANN,\" \"BOOKBOOK,\" and \"PAPA DIVIDED.\"  \n- Toy vehicles are positioned on a snowy terrain, with a train track and a snow-covered hill in the background.\n[210-240s] - A green car navigates a snowy track with pine trees, passing a blue car ahead.  \n- A yellow truck drives on a desert track with a tunnel and a \"DSR\" sign nearby.  \n- A blue car speeds through a desert circuit with a \"REPLAY\" graphic overlay.\n[240-270s] - A white car navigates a winding road alongside a train track, passing under a bridge.  \n- A green car speeds along a narrow path near a ladder and a concrete barrier.  \n- A leaderboard overlay displays race results for \"2023-2024\" with entries for \"BRAZILIAN WAGON\" and \"WELL CLASSED\" among others.\n[270-300s] - A blue car drives along a paved path near a digital scoreboard displaying \"RACE TIME\" and \"1000 TRACKING\".  \n- A green car is seen on a separate track, approaching a tunnel entrance.  \n- A yellow truck is parked near a large rock formation, with a crane structure visible nearby.\n[300-330s] - A green toy car is positioned at the start of a paved track on a desert-themed miniature landscape.  \n- A digital display on the left shows \"0:00\" and \"REPLAY\" text, indicating a timing or replay function.  \n- The car begins to move forward along the track, which curves slightly to the right, with small bushes and a rocky backdrop.", "history_tokens": 920, "history_utf8_bytes": 3314, "recent_frame_times_s": [321.00433767100435, 322.00533867200534, 323.0063396730063, 324.00734067400737, 325.00834167500835, 326.00934267600934, 327.0103436770103, 328.01134467801137, 329.01234567901236, 330.01334668001334, 331.0143476810143, 332.0153486820154, 333.01634968301636, 334.0006673340007, 335.0016683350017, 336.00266933600267, 337.00367033700365, 338.0046713380047, 339.0056723390057, 340.00667334000667, 341.00767434100766, 342.0086753420087, 343.0096763430097, 344.0106773440107, 345.01167834501166, 346.0126793460127, 347.0136803470137, 348.0146813480147, 349.01568234901566, 350.0], "recent_frames_sha256": "8684e68df4b395f54671ee224534eb754709cbf295901739e7c548886382b081", "num_recent_frames": 30, "tq": 718898.467228146, "t1": 718900.297333752, "ta": 718900.297333752, "te": 718900.498340101, "first_response_s": 1.8301056060008705, "answer_total_s": 2.0311119549442083, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 494, "content_group": "4747844fe2c95e2e39ec94c41213577fa4ebbe884eb6c9024556386928e36286", "question": {"question_id": "sample_494_a189_q0", "video_id": 494, "video_path": "./videos/sample_494_real.mp4", "annotation_index": 189, "question_index": 0, "question": "Which racing car won first place in this competition?", "options": ["A. The pink car.", "B. The dark green car.", "C. The light green car.", "D. The brown car."], "answer": "D", "time_stamp_s": 396, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_494_a189_q0", "video_id": 494, "time_stamp_s": 396, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "542e469453a88f38b3d861e56db75cb34e6e6a04914f60b1b092b2241c11acd4", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [366.016016016016, 367.00033366700035, 368.00133466800133, 369.0023356690023, 370.00333667000336, 371.00433767100435, 372.00533867200534, 373.0063396730063, 374.00734067400737, 375.00834167500835, 376.00934267600934, 377.0103436770103, 378.01134467801137, 379.01234567901236, 380.01334668001334, 381.0143476810143, 382.0153486820154, 383.01634968301636, 384.0006673340007, 385.0016683350017, 386.00266933600267, 387.00367033700365, 388.0046713380047, 389.0056723390057, 390.00667334000667, 391.00767434100766, 392.0086753420087, 393.0096763430097, 394.0106773440107, 395.01167834501166], "recent_frames_sha256": "76d27582c3146dc2db90d04bf5fa3a4fcd4c1bff516fe49a3b063140192d17fc", "num_recent_frames": 30, "tq": 718754.344375437, "t1": 718768.205037737, "ta": 718768.205037737, "te": 718768.244618101, "first_response_s": 13.86066230002325, "answer_total_s": 13.900242664036341, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_494_a189_q0", "video_id": 494, "time_stamp_s": 396, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "d28d019e0e651ba5524d92d904e8575486e4ca2157f79979bb65416115d270c1", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Toy cars race along a winding, snow-covered track with a blue backdrop and small trees.  \n- A yellow school bus and a white van are visible on the track, navigating curves and hills.  \n- The track includes a bridge and a tunnel, with cars passing through them as the camera pans.\n[90-120s] - A blue car speeds along a paved path near a digital timer displaying \"TIME 0:00\" and \"300 TRICKS\" as it passes a \"RODDIN RACING\" sign.  \n- A green car follows, navigating a snowy mountain road with pine trees, while a \"REPLAY\" graphic appears in the corner.  \n- A blue car drives on a straight road beside train tracks, then veers onto a narrow path near a ladder, with a white car visible in the background.\n[120-150s] - A leaderboard overlay displays race results for \"2023-2024 Braggin' Wagon\" with teams like \"Bromman\" and \"Booknook\" ranked by total points.\n- Toy cars race on a snowy track, with a green car leading and others following, passing through a tunnel and navigating curves.\n- The track transitions from snowy terrain to a desert-like landscape with trees and hills, featuring a bridge over a canyon.\n[150-180s] - A green car and a black car race on a winding road, with the green car leading.  \n- A blue car follows closely behind, navigating a sharp turn near a rocky cliffside.  \n- A digital scoreboard displays \"1:00\" as the cars pass a checkpoint, indicating a timed race.\n[180-210s] - A green toy car speeds along a curved road, passing a blue car and approaching a ramp.  \n- A scoreboard overlay displays race results for \"2023-2024 DRAGGIN WAGON\" with entries for \"BOMMANN,\" \"BOOKBOOK,\" and \"PAPA DIVIDED.\"  \n- Toy vehicles are positioned on a snowy terrain, with a train track and a snow-covered hill in the background.\n[210-240s] - A green car navigates a snowy track with pine trees, passing a blue car ahead.  \n- A yellow truck drives on a desert track with a tunnel and a \"DSR\" sign nearby.  \n- A blue car speeds through a desert circuit with a \"REPLAY\" graphic overlay.\n[240-270s] - A white car navigates a winding road alongside a train track, passing under a bridge.  \n- A green car speeds along a narrow path near a ladder and a concrete barrier.  \n- A leaderboard overlay displays race results for \"2023-2024\" with entries for \"BRAZILIAN WAGON\" and \"WELL CLASSED\" among others.\n[270-300s] - A blue car drives along a paved path near a digital scoreboard displaying \"RACE TIME\" and \"1000 TRACKING\".  \n- A green car is seen on a separate track, approaching a tunnel entrance.  \n- A yellow truck is parked near a large rock formation, with a crane structure visible nearby.\n[300-330s] - A green toy car is positioned at the start of a paved track on a desert-themed miniature landscape.  \n- A digital display on the left shows \"0:00\" and \"REPLAY\" text, indicating a timing or replay function.  \n- The car begins to move forward along the track, which curves slightly to the right, with small bushes and a rocky backdrop.\n[330-360s] - A green toy car moves along a white track, passing under black metal structures.  \n- A leaderboard overlay displays race results for \"2023-2024 Blaggoo Wagon\" with driver names and scores.  \n- The scene transitions to a snowy landscape with toy figures and vehicles, including a white car with \"80\" and a train.\n[360-390s] - A black train with a menacing design and smoke effect moves along tracks, passing a blue car and a red pickup truck.  \n- The train is labeled \"THE BLOOD THIRSTY DEMON TRAIN\" in bold red text, indicating its role in the scene.  \n- The train and vehicles travel on a snowy landscape with mountains and trees, suggesting a rugged, remote setting.", "history_tokens": 956, "history_utf8_bytes": 3636, "recent_frame_times_s": [366.016016016016, 367.00033366700035, 368.00133466800133, 369.0023356690023, 370.00333667000336, 371.00433767100435, 372.00533867200534, 373.0063396730063, 374.00734067400737, 375.00834167500835, 376.00934267600934, 377.0103436770103, 378.01134467801137, 379.01234567901236, 380.01334668001334, 381.0143476810143, 382.0153486820154, 383.01634968301636, 384.0006673340007, 385.0016683350017, 386.00266933600267, 387.00367033700365, 388.0046713380047, 389.0056723390057, 390.00667334000667, 391.00767434100766, 392.0086753420087, 393.0096763430097, 394.0106773440107, 395.01167834501166], "recent_frames_sha256": "76d27582c3146dc2db90d04bf5fa3a4fcd4c1bff516fe49a3b063140192d17fc", "num_recent_frames": 30, "tq": 718947.39807043, "t1": 718956.230546355, "ta": 718956.230546355, "te": 718956.389687987, "first_response_s": 8.832475924980827, "answer_total_s": 8.991617557010613, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 494, "content_group": "4747844fe2c95e2e39ec94c41213577fa4ebbe884eb6c9024556386928e36286", "question": {"question_id": "sample_494_a190_q0", "video_id": 494, "video_path": "./videos/sample_494_real.mp4", "annotation_index": 190, "question_index": 0, "question": "Which racing car won first place in this competition?", "options": ["A. The green car.", "B. The dark green car.", "C. The light green car.", "D. The brown car."], "answer": "A", "time_stamp_s": 396, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [480, 600], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_494_a190_q0", "video_id": 494, "time_stamp_s": 396, "ground_truth": "A", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "a1976d997f8e09d9d02848db3e84e50d350944b813f385bca8d8d84b5250130c", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [366.016016016016, 367.00033366700035, 368.00133466800133, 369.0023356690023, 370.00333667000336, 371.00433767100435, 372.00533867200534, 373.0063396730063, 374.00734067400737, 375.00834167500835, 376.00934267600934, 377.0103436770103, 378.01134467801137, 379.01234567901236, 380.01334668001334, 381.0143476810143, 382.0153486820154, 383.01634968301636, 384.0006673340007, 385.0016683350017, 386.00266933600267, 387.00367033700365, 388.0046713380047, 389.0056723390057, 390.00667334000667, 391.00767434100766, 392.0086753420087, 393.0096763430097, 394.0106773440107, 395.01167834501166], "recent_frames_sha256": "76d27582c3146dc2db90d04bf5fa3a4fcd4c1bff516fe49a3b063140192d17fc", "num_recent_frames": 30, "tq": 718768.267927344, "t1": 718779.456426325, "ta": 718779.456426325, "te": 718779.494961618, "first_response_s": 11.188498981064186, "answer_total_s": 11.227034274023026, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_494_a190_q0", "video_id": 494, "time_stamp_s": 396, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d9633b81536c3377552192a596e479b03f1993365f33fc39123be34ee895c1d0", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Toy cars race along a winding, snow-covered track with a blue backdrop and small trees.  \n- A yellow school bus and a white van are visible on the track, navigating curves and hills.  \n- The track includes a bridge and a tunnel, with cars passing through them as the camera pans.\n[90-120s] - A blue car speeds along a paved path near a digital timer displaying \"TIME 0:00\" and \"300 TRICKS\" as it passes a \"RODDIN RACING\" sign.  \n- A green car follows, navigating a snowy mountain road with pine trees, while a \"REPLAY\" graphic appears in the corner.  \n- A blue car drives on a straight road beside train tracks, then veers onto a narrow path near a ladder, with a white car visible in the background.\n[120-150s] - A leaderboard overlay displays race results for \"2023-2024 Braggin' Wagon\" with teams like \"Bromman\" and \"Booknook\" ranked by total points.\n- Toy cars race on a snowy track, with a green car leading and others following, passing through a tunnel and navigating curves.\n- The track transitions from snowy terrain to a desert-like landscape with trees and hills, featuring a bridge over a canyon.\n[150-180s] - A green car and a black car race on a winding road, with the green car leading.  \n- A blue car follows closely behind, navigating a sharp turn near a rocky cliffside.  \n- A digital scoreboard displays \"1:00\" as the cars pass a checkpoint, indicating a timed race.\n[180-210s] - A green toy car speeds along a curved road, passing a blue car and approaching a ramp.  \n- A scoreboard overlay displays race results for \"2023-2024 DRAGGIN WAGON\" with entries for \"BOMMANN,\" \"BOOKBOOK,\" and \"PAPA DIVIDED.\"  \n- Toy vehicles are positioned on a snowy terrain, with a train track and a snow-covered hill in the background.\n[210-240s] - A green car navigates a snowy track with pine trees, passing a blue car ahead.  \n- A yellow truck drives on a desert track with a tunnel and a \"DSR\" sign nearby.  \n- A blue car speeds through a desert circuit with a \"REPLAY\" graphic overlay.\n[240-270s] - A white car navigates a winding road alongside a train track, passing under a bridge.  \n- A green car speeds along a narrow path near a ladder and a concrete barrier.  \n- A leaderboard overlay displays race results for \"2023-2024\" with entries for \"BRAZILIAN WAGON\" and \"WELL CLASSED\" among others.\n[270-300s] - A blue car drives along a paved path near a digital scoreboard displaying \"RACE TIME\" and \"1000 TRACKING\".  \n- A green car is seen on a separate track, approaching a tunnel entrance.  \n- A yellow truck is parked near a large rock formation, with a crane structure visible nearby.\n[300-330s] - A green toy car is positioned at the start of a paved track on a desert-themed miniature landscape.  \n- A digital display on the left shows \"0:00\" and \"REPLAY\" text, indicating a timing or replay function.  \n- The car begins to move forward along the track, which curves slightly to the right, with small bushes and a rocky backdrop.\n[330-360s] - A green toy car moves along a white track, passing under black metal structures.  \n- A leaderboard overlay displays race results for \"2023-2024 Blaggoo Wagon\" with driver names and scores.  \n- The scene transitions to a snowy landscape with toy figures and vehicles, including a white car with \"80\" and a train.\n[360-390s] - A black train with a menacing design and smoke effect moves along tracks, passing a blue car and a red pickup truck.  \n- The train is labeled \"THE BLOOD THIRSTY DEMON TRAIN\" in bold red text, indicating its role in the scene.  \n- The train and vehicles travel on a snowy landscape with mountains and trees, suggesting a rugged, remote setting.", "history_tokens": 956, "history_utf8_bytes": 3636, "recent_frame_times_s": [366.016016016016, 367.00033366700035, 368.00133466800133, 369.0023356690023, 370.00333667000336, 371.00433767100435, 372.00533867200534, 373.0063396730063, 374.00734067400737, 375.00834167500835, 376.00934267600934, 377.0103436770103, 378.01134467801137, 379.01234567901236, 380.01334668001334, 381.0143476810143, 382.0153486820154, 383.01634968301636, 384.0006673340007, 385.0016683350017, 386.00266933600267, 387.00367033700365, 388.0046713380047, 389.0056723390057, 390.00667334000667, 391.00767434100766, 392.0086753420087, 393.0096763430097, 394.0106773440107, 395.01167834501166], "recent_frames_sha256": "76d27582c3146dc2db90d04bf5fa3a4fcd4c1bff516fe49a3b063140192d17fc", "num_recent_frames": 30, "tq": 718956.418265562, "t1": 718963.41195675, "ta": 718963.41195675, "te": 718963.450476135, "first_response_s": 6.993691187934019, "answer_total_s": 7.032210572971962, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 495, "content_group": "5c9d4347c7ca50422a1cdab039018998dffbf68a769e37f69914bbbd768c3eb0", "question": {"question_id": "sample_495_a1856_q0", "video_id": 495, "video_path": "./videos/sample_495_real.mp4", "annotation_index": 1856, "question_index": 0, "question": "Which car won first place in this competition?", "options": ["A. The blue car.", "B. The dark purple car.", "C. The red car.", "D. The green and black car."], "answer": "D", "time_stamp_s": 102, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_495_a1856_q0", "video_id": 495, "time_stamp_s": 102, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2551efe30218cb1cf0fd1e0be0663686023509d65091adab84857530fb365b55", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [72.00533867200534, 73.00633967300634, 74.00734067400734, 75.00834167500834, 76.00934267600934, 77.01034367701034, 78.01134467801134, 79.01234567901234, 80.01334668001334, 81.01434768101434, 82.01534868201534, 83.01634968301634, 84.00066733400067, 85.00166833500167, 86.00266933600267, 87.00367033700367, 88.00467133800467, 89.00567233900567, 90.00667334000667, 91.00767434100767, 92.00867534200867, 93.00967634300967, 94.01067734401067, 95.01167834501167, 96.01267934601267, 97.01368034701368, 98.01468134801468, 99.01568234901568, 100.0, 101.001001001001], "recent_frames_sha256": "d9b579d2068ad3264bc0b4002fb08f32fde08e032db9f6fa8d7b89530bb4caf6", "num_recent_frames": 30, "tq": 719682.829632857, "t1": 719683.506727062, "ta": 719683.506727062, "te": 719683.546203185, "first_response_s": 0.6770942050497979, "answer_total_s": 0.7165703279897571, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_495_a1856_q0", "video_id": 495, "time_stamp_s": 102, "ground_truth": "D", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "2d14dc745d9c868b7bcd19e57d6fc51e2bb89f7b7600260652d76075a29d5f0a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - \"Gravity Throttle Racing\" logo appears on a textured background, followed by a desert-themed model railway scene with trains and cars.\n- A black locomotive pulls colorful freight cars across a bridge over a canyon, with a train station and signage visible nearby.\n- A lineup of model cars (blue, red, black, and green) is positioned on a curved track, ready for a race or display.\n[30-60s] - Red 2017 Audi R3S Avant (Seed #1) positioned at start line, ready to race.\n- Blue Nissan Maxima Wagon (Seed #2) with \"Hot Nuts Diecast\" label, positioned behind the red car.\n- Green 2017 Audi R3S Avant (Seed #3) with \"Dobious Diecast\" label, positioned further back, slightly to the left.\n[60-90s] - Cars race on a snowy track with a blue wall backdrop, including a purple car leading a green, red, and black car.  \n- The track transitions to a desert-like terrain with winding roads, trees, and a tunnel, where cars navigate curves and obstacles.  \n- A white car is seen driving on a separate road near train tracks, with a red and white striped barrier visible.", "history_tokens": 276, "history_utf8_bytes": 1065, "recent_frame_times_s": [72.00533867200534, 73.00633967300634, 74.00734067400734, 75.00834167500834, 76.00934267600934, 77.01034367701034, 78.01134467801134, 79.01234567901234, 80.01334668001334, 81.01434768101434, 82.01534868201534, 83.01634968301634, 84.00066733400067, 85.00166833500167, 86.00266933600267, 87.00367033700367, 88.00467133800467, 89.00567233900567, 90.00667334000667, 91.00767434100767, 92.00867534200867, 93.00967634300967, 94.01067734401067, 95.01167834501167, 96.01267934601267, 97.01368034701368, 98.01468134801468, 99.01568234901568, 100.0, 101.001001001001], "recent_frames_sha256": "d9b579d2068ad3264bc0b4002fb08f32fde08e032db9f6fa8d7b89530bb4caf6", "num_recent_frames": 30, "tq": 719483.591297284, "t1": 719486.032992815, "ta": 719486.032992815, "te": 719486.3979139, "first_response_s": 2.4416955310152844, "answer_total_s": 2.8066166159696877, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 495, "content_group": "5c9d4347c7ca50422a1cdab039018998dffbf68a769e37f69914bbbd768c3eb0", "question": {"question_id": "sample_495_a1857_q0", "video_id": 495, "video_path": "./videos/sample_495_real.mp4", "annotation_index": 1857, "question_index": 0, "question": "What color is the car that is in the lead in this competition right now?", "options": ["A. Black.", "B. Red and black.", "C. Yellow and red.", "D. Green."], "answer": "A", "time_stamp_s": 234, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_495_a1857_q0", "video_id": 495, "time_stamp_s": 234, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0b995f69950a57a02d4c9b837c1ac2e17858278fd141021f446e4c3366d82c39", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [204.004004004004, 205.00500500500502, 206.006006006006, 207.00700700700702, 208.008008008008, 209.00900900900902, 210.01001001001, 211.01101101101102, 212.012012012012, 213.01301301301302, 214.014014014014, 215.01501501501502, 216.016016016016, 217.00033366700035, 218.00133466800133, 219.00233566900235, 220.00333667000334, 221.00433767100435, 222.00533867200534, 223.00633967300635, 224.00734067400734, 225.00834167500835, 226.00934267600934, 227.01034367701035, 228.01134467801134, 229.01234567901236, 230.01334668001334, 231.01434768101436, 232.01534868201534, 233.01634968301636], "recent_frames_sha256": "2427797dd81363d85f66687cbabad0bec947faf262d83ba2971878af44c9eb67", "num_recent_frames": 30, "tq": 719683.562902345, "t1": 719690.521297242, "ta": 719690.521297242, "te": 719690.559561343, "first_response_s": 6.9583948970539495, "answer_total_s": 6.996658998075873, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_495_a1857_q0", "video_id": 495, "time_stamp_s": 234, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5395fbccc1b02f10d0b9f6c2b6ede3bbc2b7af9e6127f85c08361c63cb5241b2", "condition_order": ["notes", "recent"], "memory": "[0-30s] - \"Gravity Throttle Racing\" logo appears on a textured background, followed by a desert-themed model railway scene with trains and cars.\n- A black locomotive pulls colorful freight cars across a bridge over a canyon, with a train station and signage visible nearby.\n- A lineup of model cars (blue, red, black, and green) is positioned on a curved track, ready for a race or display.\n[30-60s] - Red 2017 Audi R3S Avant (Seed #1) positioned at start line, ready to race.\n- Blue Nissan Maxima Wagon (Seed #2) with \"Hot Nuts Diecast\" label, positioned behind the red car.\n- Green 2017 Audi R3S Avant (Seed #3) with \"Dobious Diecast\" label, positioned further back, slightly to the left.\n[60-90s] - Cars race on a snowy track with a blue wall backdrop, including a purple car leading a green, red, and black car.  \n- The track transitions to a desert-like terrain with winding roads, trees, and a tunnel, where cars navigate curves and obstacles.  \n- A white car is seen driving on a separate road near train tracks, with a red and white striped barrier visible.\n[90-120s] - A green car speeds along a desert-themed track, passing a yellow truck and a white van near a tunnel entrance.  \n- A blue car races on a paved road with a digital scoreboard displaying \"1:00\" and \"HERO\" text, alongside a red car.  \n- A red car navigates a snowy mountain road with pine trees, while a blue car follows, passing a sign with \"REPLAY\" text.\n[120-150s] - A blue car speeds down a snowy track, overtaking other cars in a race.  \n- The track transitions to a mountainous, rocky terrain with winding roads and trees.  \n- A train is visible on a parallel track, moving alongside the racing cars.\n[150-180s] - Red car descends a snowy slope, trailing behind a blue car and a green car, with a black car ahead of them.  \n- A digital scoreboard displays \"0:00:00\" and \"Brewery\" text, indicating a race or timed event.  \n- A red arrow points to a small object (possibly a toy) on the snowy slope, suggesting a point of interest or obstacle.\n[180-210s] - Toy cars race down a snowy slope with tracks, including red, blue, green, and black vehicles.  \n- A scoreboard displays race results for \"2023-2024 Brakes Racer\" with \"Hot Rods\" leading at 6 points.  \n- The scene transitions to a desert-like track with trucks and cars navigating a winding road around a rock formation.", "history_tokens": 621, "history_utf8_bytes": 2355, "recent_frame_times_s": [204.004004004004, 205.00500500500502, 206.006006006006, 207.00700700700702, 208.008008008008, 209.00900900900902, 210.01001001001, 211.01101101101102, 212.012012012012, 213.01301301301302, 214.014014014014, 215.01501501501502, 216.016016016016, 217.00033366700035, 218.00133466800133, 219.00233566900235, 220.00333667000334, 221.00433767100435, 222.00533867200534, 223.00633967300635, 224.00734067400734, 225.00834167500835, 226.00934267600934, 227.01034367701035, 228.01134467801134, 229.01234567901236, 230.01334668001334, 231.01434768101436, 232.01534868201534, 233.01634968301636], "recent_frames_sha256": "2427797dd81363d85f66687cbabad0bec947faf262d83ba2971878af44c9eb67", "num_recent_frames": 30, "tq": 719521.746704188, "t1": 719523.521520899, "ta": 719523.521520899, "te": 719523.890479568, "first_response_s": 1.7748167110839859, "answer_total_s": 2.1437753801001236, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 495, "content_group": "5c9d4347c7ca50422a1cdab039018998dffbf68a769e37f69914bbbd768c3eb0", "question": {"question_id": "sample_495_a1858_q0", "video_id": 495, "video_path": "./videos/sample_495_real.mp4", "annotation_index": 1858, "question_index": 0, "question": "What is the digital timer display showing right now?", "options": ["A. \"Race Time: 25.619\".", "B. \"Race Time: 24.874\".", "C. \"Race Time: 23.452\".", "D. \"Race Time: 24.824\"."], "answer": "D", "time_stamp_s": 449, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_495_a1858_q0", "video_id": 495, "time_stamp_s": 449, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e966d631a5662f5899647cef527eb7b7f25a8369281e3f16fdbb8c0d3f948b38", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [419.0023356690023, 420.00333667000336, 421.00433767100435, 422.00533867200534, 423.0063396730063, 424.00734067400737, 425.00834167500835, 426.00934267600934, 427.0103436770103, 428.01134467801137, 429.01234567901236, 430.01334668001334, 431.0143476810143, 432.0153486820154, 433.01634968301636, 434.0006673340007, 435.0016683350017, 436.00266933600267, 437.00367033700365, 438.0046713380047, 439.0056723390057, 440.00667334000667, 441.00767434100766, 442.0086753420087, 443.0096763430097, 444.0106773440107, 445.01167834501166, 446.0126793460127, 447.0136803470137, 448.0146813480147], "recent_frames_sha256": "e49564d196ac1f5a3b1621ceaf9ab51cc7ed85edf94f8abe3ff8c6f71c6b62ac", "num_recent_frames": 30, "tq": 719690.571897886, "t1": 719700.139940417, "ta": 719700.139940417, "te": 719700.180415517, "first_response_s": 9.568042531027459, "answer_total_s": 9.608517630957067, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_495_a1858_q0", "video_id": 495, "time_stamp_s": 449, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "4d59c6c37ba5721d204877c10d185e306f60ba7d06f39ed2a61e73011aaee6cc", "condition_order": ["notes", "recent"], "memory": "[120-150s] - A blue car speeds down a snowy track, overtaking other cars in a race.  \n- The track transitions to a mountainous, rocky terrain with winding roads and trees.  \n- A train is visible on a parallel track, moving alongside the racing cars.\n[150-180s] - Red car descends a snowy slope, trailing behind a blue car and a green car, with a black car ahead of them.  \n- A digital scoreboard displays \"0:00:00\" and \"Brewery\" text, indicating a race or timed event.  \n- A red arrow points to a small object (possibly a toy) on the snowy slope, suggesting a point of interest or obstacle.\n[180-210s] - Toy cars race down a snowy slope with tracks, including red, blue, green, and black vehicles.  \n- A scoreboard displays race results for \"2023-2024 Brakes Racer\" with \"Hot Rods\" leading at 6 points.  \n- The scene transitions to a desert-like track with trucks and cars navigating a winding road around a rock formation.\n[210-240s] - Red car overtakes black car on snowy slope, both moving downhill.  \n- Blue car follows behind, navigating a curve on the same snowy terrain.  \n- Scene transitions to a desert-like track with a bridge, where cars continue racing past roadside signs.\n[240-270s] - Four toy cars (green, purple, orange, teal) are positioned on a snowy track, ready to race, with a \"RACE 3\" label and driver names listed.\n- The track curves through a snowy landscape with trees and a tunnel, transitioning to a desert-like terrain with hills and a railway crossing.\n- A white truck and a yellow car are visible on the road, with the red car navigating a curve near a tunnel entrance.\n[270-300s] - A blue car speeds down a straight track past a \"Be a HERO\" billboard and a digital display showing \"1:00.00\" and \"100% TRACKING?\".\n- A red car races along a paved road beside railway tracks, with a \"REPLAY\" graphic appearing in the corner.\n- A scoreboard displays \"2023-2024 BRAGON WAGON\" results, listing four teams with their scores (e.g., \"NAMIBIAN WAGON\" with 3 points).\n[300-330s] - Scoreboard displays 2023-2024 Bragdon Wagon results with Norravall Racing leading at 8 points.\n- Race 4 setup shows four toy cars (orange, green, blue, purple) on a snowy track with a tunnel ahead.\n- Camera pans to reveal a wider view of the snowy landscape with trees and a blue sky background.\n[330-360s] - A blue car races along a desert track, passing a white van and a yellow truck.  \n- A red car follows closely behind, navigating a curve near a signpost.  \n- A black car speeds past a \"Be a HERO\" sign, approaching a pit stop area with a digital display.\n[360-390s] - Miniature cars race along a curved road near a large rock formation, with a yellow truck and white van parked nearby.  \n- A scoreboard displays race results for three teams: \"HARVEY MOE BILLY\" with 9 points, \"PASTOR'S DREAM\" with 11 points, and \"VAN WOODY\" with 10 points.  \n- The scene transitions to a \"HALF TIME\" screen, followed by a group of miniature cars and figures standing in front of a backdrop with the text \"HARVEY MOE BILLY.\"\n[390-420s] - Four toy cars (gray SUV, red sedan, white sedan, yellow station wagon) are parked on a sandy track with miniature figures standing beside them.  \n- The scene transitions to a race setup with the same cars now positioned on a track with a ramp and a red-and-black finish line structure in the background.  \n- A graphic overlay displays \"Shavano Mountain Raceway\" with race times for \"James Ironbeard\" and \"FLIP\" cars, indicating a competitive context.", "history_tokens": 934, "history_utf8_bytes": 3479, "recent_frame_times_s": [419.0023356690023, 420.00333667000336, 421.00433767100435, 422.00533867200534, 423.0063396730063, 424.00734067400737, 425.00834167500835, 426.00934267600934, 427.0103436770103, 428.01134467801137, 429.01234567901236, 430.01334668001334, 431.0143476810143, 432.0153486820154, 433.01634968301636, 434.0006673340007, 435.0016683350017, 436.00266933600267, 437.00367033700365, 438.0046713380047, 439.0056723390057, 440.00667334000667, 441.00767434100766, 442.0086753420087, 443.0096763430097, 444.0106773440107, 445.01167834501166, 446.0126793460127, 447.0136803470137, 448.0146813480147], "recent_frames_sha256": "e49564d196ac1f5a3b1621ceaf9ab51cc7ed85edf94f8abe3ff8c6f71c6b62ac", "num_recent_frames": 30, "tq": 719581.816505028, "t1": 719589.67579146, "ta": 719589.67579146, "te": 719589.718751425, "first_response_s": 7.859286431921646, "answer_total_s": 7.90224639698863, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 495, "content_group": "5c9d4347c7ca50422a1cdab039018998dffbf68a769e37f69914bbbd768c3eb0", "question": {"question_id": "sample_495_a1859_q0", "video_id": 495, "video_path": "./videos/sample_495_real.mp4", "annotation_index": 1859, "question_index": 0, "question": "Which team has the highest R4 score in the \"2023 - 2024 BRAGGIN' WAGON\" race results?", "options": ["A. NUMBSKULL Racing.", "B. DUBIOUS DIECAST.", "C. LIVE YOUNG DIECAST.", "D. HOT NUTS DIECAST."], "answer": "D", "time_stamp_s": 666, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [660, 720], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_495_a1859_q0", "video_id": 495, "time_stamp_s": 666, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b3f0547e8b64ac010c392adfb776d8e7995429d4d7a5eef2a72b970278213687", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [636.0026693360027, 637.0036703370037, 638.0046713380046, 639.0056723390056, 640.0066733400067, 641.0076743410077, 642.0086753420087, 643.0096763430097, 644.0106773440107, 645.0116783450117, 646.0126793460126, 647.0136803470136, 648.0146813480147, 649.0156823490157, 650.0, 651.001001001001, 652.002002002002, 653.003003003003, 654.0040040040041, 655.005005005005, 656.006006006006, 657.007007007007, 658.008008008008, 659.009009009009, 660.01001001001, 661.011011011011, 662.0120120120121, 663.013013013013, 664.014014014014, 665.015015015015], "recent_frames_sha256": "fd7b7218aef1d306cf3bd837200f7cc2a7211c74dc564d1f860d568de4715342", "num_recent_frames": 30, "tq": 719700.193024747, "t1": 719706.505288042, "ta": 719706.505288042, "te": 719706.543372308, "first_response_s": 6.312263295054436, "answer_total_s": 6.350347561063245, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_495_a1859_q0", "video_id": 495, "time_stamp_s": 666, "ground_truth": "D", "raw_output": "C. LIVE YOUNG DIECAST.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "29091285ef5e5a48d5823282cb142f035c5273643d3a515f65fbfb7313c81b57", "condition_order": ["notes", "recent"], "memory": "[360-390s] - Miniature cars race along a curved road near a large rock formation, with a yellow truck and white van parked nearby.  \n- A scoreboard displays race results for three teams: \"HARVEY MOE BILLY\" with 9 points, \"PASTOR'S DREAM\" with 11 points, and \"VAN WOODY\" with 10 points.  \n- The scene transitions to a \"HALF TIME\" screen, followed by a group of miniature cars and figures standing in front of a backdrop with the text \"HARVEY MOE BILLY.\"\n[390-420s] - Four toy cars (gray SUV, red sedan, white sedan, yellow station wagon) are parked on a sandy track with miniature figures standing beside them.  \n- The scene transitions to a race setup with the same cars now positioned on a track with a ramp and a red-and-black finish line structure in the background.  \n- A graphic overlay displays \"Shavano Mountain Raceway\" with race times for \"James Ironbeard\" and \"FLIP\" cars, indicating a competitive context.\n[420-450s] - Yellow car drives along a paved path near a digital sign displaying \"ARE YOU TRACKIN'?\" and \"20-20-100\".\n- Orange truck navigates a snowy, winding track with a \"GTR\" logo visible in the top-left corner.\n- Red car passes a billboard with \"Be a HERO\" text while the digital sign remains static.\n[450-480s] - Orange car drives along a paved road near a \"Be a HERO\" billboard and a digital sign displaying \"Race Time: 2:00\" and \"ARE YOU TRACKIN'?\".\n- White SUV approaches a similar digital sign with the same message, positioned on a dirt embankment beside the road.\n- The scene transitions to a snowy track with a \"GTR CUTOFF # 94-MARC D.\" graphic, showing a white SUV navigating a snow-covered course.\n[480-510s] - A digital timer displays \"23.568\" as a green and black toy car races along a track.  \n- The timer then shows \"23.661\" as a second green and black toy car passes the same point.  \n- A sign reading \"Be a HERO\" is visible above the timer, with a \"SPEED CHECKING\" label below it.\n[510-540s] - Four toy cars (red, blue, green, black) race on a snowy track, with names listed: Numbchull, Lonestar, Mr. Darq, Craigar Sr.\n- The track transitions from snow-covered to desert terrain with hills, trees, and a train crossing the road.\n- A yellow construction vehicle and a white car appear on the road, with a train passing by on adjacent tracks.\n[540-570s] - A purple car speeds along a desert-themed track, passing a \"BEN'S HERO\" billboard and a \"SPEED TRACKER\" digital display showing \"0:00.000\".  \n- A blue car follows, then a red car, both navigating a winding road with sparse vegetation.  \n- A \"REPLAY\" graphic appears as the scene shifts to a mountainous, forested track with multiple cars racing through curves.\n[570-600s] - A scoreboard displays 2023-2024 Bragan Wagon race results for three teams with total points: 11, 15, and 16.\n- Four toy cars (red, green, black, and orange) are positioned on a snowy track, preparing for Race 6.\n- The track features winding paths, a bridge, and a blue backdrop, with a yellow vehicle visible on a separate path.\n[600-630s] - A red car navigates a snowy, winding road with other cars and a yellow truck nearby.  \n- The scene transitions to a desert-like track with a black car approaching a GoPro billboard and digital display.  \n- A green car passes the billboard, while a black car is seen parked or stalled on the roadside.\n[630-660s] - A model train crosses a miniature railway bridge over a road, with a white and red train car visible.  \n- The train moves along a curved track that intersects with another road, passing under a bridge structure.  \n- The scene includes a detailed miniature landscape with rocky terrain, sparse vegetation, and a painted backdrop of mountains.", "history_tokens": 978, "history_utf8_bytes": 3663, "recent_frame_times_s": [636.0026693360027, 637.0036703370037, 638.0046713380046, 639.0056723390056, 640.0066733400067, 641.0076743410077, 642.0086753420087, 643.0096763430097, 644.0106773440107, 645.0116783450117, 646.0126793460126, 647.0136803470136, 648.0146813480147, 649.0156823490157, 650.0, 651.001001001001, 652.002002002002, 653.003003003003, 654.0040040040041, 655.005005005005, 656.006006006006, 657.007007007007, 658.008008008008, 659.009009009009, 660.01001001001, 661.011011011011, 662.0120120120121, 663.013013013013, 664.014014014014, 665.015015015015], "recent_frames_sha256": "fd7b7218aef1d306cf3bd837200f7cc2a7211c74dc564d1f860d568de4715342", "num_recent_frames": 30, "tq": 719650.494656955, "t1": 719656.722139754, "ta": 719656.722139754, "te": 719657.055281199, "first_response_s": 6.227482798974961, "answer_total_s": 6.56062424404081, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 495, "content_group": "5c9d4347c7ca50422a1cdab039018998dffbf68a769e37f69914bbbd768c3eb0", "question": {"question_id": "sample_495_a1860_q0", "video_id": 495, "video_path": "./videos/sample_495_real.mp4", "annotation_index": 1860, "question_index": 0, "question": "Which car won first place in this competition?", "options": ["A. The blue car.", "B. The dark purple car.", "C. The red car.", "D. The green and black car."], "answer": "C", "time_stamp_s": 778, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [720, 780], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_495_a1860_q0", "video_id": 495, "time_stamp_s": 778, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "0dccf64f349c9d8161df564bcd67fe909f3bd209036b4895986a604ffc2b69dc", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [748.0146813480147, 749.0156823490157, 750.0, 751.001001001001, 752.002002002002, 753.003003003003, 754.0040040040041, 755.005005005005, 756.006006006006, 757.007007007007, 758.008008008008, 759.009009009009, 760.01001001001, 761.011011011011, 762.0120120120121, 763.013013013013, 764.014014014014, 765.015015015015, 766.016016016016, 767.0003336670003, 768.0013346680014, 769.0023356690024, 770.0033366700034, 771.0043376710044, 772.0053386720053, 773.0063396730063, 774.0073406740073, 775.0083416750083, 776.0093426760094, 777.0103436770104], "recent_frames_sha256": "201dc78f56a7fa9f868f85d09cfc656f6fbc2e8591b6eb8c03ccb47143ffa9de", "num_recent_frames": 30, "tq": 719706.553834258, "t1": 719713.335230039, "ta": 719713.335230039, "te": 719713.368519964, "first_response_s": 6.7813957809703425, "answer_total_s": 6.814685706049204, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_495_a1860_q0", "video_id": 495, "time_stamp_s": 778, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8fe9613035670e13e52184710da439a2fec481a25d84b37692a4c5277dd509dc", "condition_order": ["notes", "recent"], "memory": "[450-480s] - Orange car drives along a paved road near a \"Be a HERO\" billboard and a digital sign displaying \"Race Time: 2:00\" and \"ARE YOU TRACKIN'?\".\n- White SUV approaches a similar digital sign with the same message, positioned on a dirt embankment beside the road.\n- The scene transitions to a snowy track with a \"GTR CUTOFF # 94-MARC D.\" graphic, showing a white SUV navigating a snow-covered course.\n[480-510s] - A digital timer displays \"23.568\" as a green and black toy car races along a track.  \n- The timer then shows \"23.661\" as a second green and black toy car passes the same point.  \n- A sign reading \"Be a HERO\" is visible above the timer, with a \"SPEED CHECKING\" label below it.\n[510-540s] - Four toy cars (red, blue, green, black) race on a snowy track, with names listed: Numbchull, Lonestar, Mr. Darq, Craigar Sr.\n- The track transitions from snow-covered to desert terrain with hills, trees, and a train crossing the road.\n- A yellow construction vehicle and a white car appear on the road, with a train passing by on adjacent tracks.\n[540-570s] - A purple car speeds along a desert-themed track, passing a \"BEN'S HERO\" billboard and a \"SPEED TRACKER\" digital display showing \"0:00.000\".  \n- A blue car follows, then a red car, both navigating a winding road with sparse vegetation.  \n- A \"REPLAY\" graphic appears as the scene shifts to a mountainous, forested track with multiple cars racing through curves.\n[570-600s] - A scoreboard displays 2023-2024 Bragan Wagon race results for three teams with total points: 11, 15, and 16.\n- Four toy cars (red, green, black, and orange) are positioned on a snowy track, preparing for Race 6.\n- The track features winding paths, a bridge, and a blue backdrop, with a yellow vehicle visible on a separate path.\n[600-630s] - A red car navigates a snowy, winding road with other cars and a yellow truck nearby.  \n- The scene transitions to a desert-like track with a black car approaching a GoPro billboard and digital display.  \n- A green car passes the billboard, while a black car is seen parked or stalled on the roadside.\n[630-660s] - A model train crosses a miniature railway bridge over a road, with a white and red train car visible.  \n- The train moves along a curved track that intersects with another road, passing under a bridge structure.  \n- The scene includes a detailed miniature landscape with rocky terrain, sparse vegetation, and a painted backdrop of mountains.\n[660-690s] - Scoreboard displays 2023-2024 Brakes Season results with three teams: \"Numbahs Wagon\" (15), \"Hot Nuts\" (15), and \"Low Towing\" (16) in R1-R8 totals.\n- Race 7 scene shows five toy cars on a snowy track with a blue sky backdrop, labeled with driver names and locations.\n- Camera pans to reveal a wider view of the track, including a train, trees, and a red-and-white barrier, indicating a complex, multi-level racing environment.\n[690-720s] - A red car drives along a paved road near a GoPro billboard and a digital scoreboard displaying \"0:00:00\" and \"0:00:00\" with \"SPEED TRACK\" text.\n- A train with red and black freight cars passes on a parallel track, moving alongside the road.\n- The scene transitions to a snowy mountainous landscape with cars navigating winding roads, and a \"REPLAY\" graphic appears in the corner.\n[720-750s] - Three toy cars (red, blue, green) race on a snowy track with a bridge overhead, positioned in staggered lanes.  \n- A leaderboard overlay displays 2023-2024 Bragson Wagon results for three teams, including their race positions and totals.  \n- The scene transitions to a close-up of the snowy track with cars lined up, preparing for Race 8, as indicated by on-screen text.", "history_tokens": 984, "history_utf8_bytes": 3657, "recent_frame_times_s": [748.0146813480147, 749.0156823490157, 750.0, 751.001001001001, 752.002002002002, 753.003003003003, 754.0040040040041, 755.005005005005, 756.006006006006, 757.007007007007, 758.008008008008, 759.009009009009, 760.01001001001, 761.011011011011, 762.0120120120121, 763.013013013013, 764.014014014014, 765.015015015015, 766.016016016016, 767.0003336670003, 768.0013346680014, 769.0023356690024, 770.0033366700034, 771.0043376710044, 772.0053386720053, 773.0063396730063, 774.0073406740073, 775.0083416750083, 776.0093426760094, 777.0103436770104], "recent_frames_sha256": "201dc78f56a7fa9f868f85d09cfc656f6fbc2e8591b6eb8c03ccb47143ffa9de", "num_recent_frames": 30, "tq": 719680.668145193, "t1": 719682.533197729, "ta": 719682.533197729, "te": 719682.774054086, "first_response_s": 1.8650525360135362, "answer_total_s": 2.105908892932348, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 496, "content_group": "7b5efa4253362d0b930ca77e827fb1459d81f9de205243eb310bc198639a86b6", "question": {"question_id": "sample_496_a935_q0", "video_id": 496, "video_path": "./videos/sample_496_real.mp4", "annotation_index": 935, "question_index": 0, "question": "What happens to the airplane as it aligns itself with the landing path?", "options": ["A. It takes off.", "B. It crashes.", "C. It lands on the runway.", "D. It continues to fly in circles."], "answer": "C", "time_stamp_s": 20, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_496_a935_q0", "video_id": 496, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "6432288ec9e1c3e8dc70ab32cc70da381ac076d7e8afa91713c1af212c677d74", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001001001001001, 2.002002002002002, 3.003003003003003, 4.004004004004004, 5.005005005005005, 6.006006006006006, 7.007007007007007, 8.008008008008009, 9.00900900900901, 10.01001001001001, 11.01101101101101, 12.012012012012011, 13.013013013013014, 14.014014014014014, 15.015015015015015, 16.016016016016017, 17.000333667000334, 18.001334668001334, 19.002335669002335], "recent_frames_sha256": "22509609eccd762581d6556b106b6194719db52b616306158a6907ba8382fd68", "num_recent_frames": 20, "tq": 719033.721141592, "t1": 719034.532677797, "ta": 719034.532677797, "te": 719034.569701575, "first_response_s": 0.8115362050011754, "answer_total_s": 0.8485599829582497, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_496_a935_q0", "video_id": 496, "time_stamp_s": 20, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "bd366e7fbfb5086c8c48c79de461641cd08951f9a44817424b2eab0b6c9b07ad", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001001001001001, 2.002002002002002, 3.003003003003003, 4.004004004004004, 5.005005005005005, 6.006006006006006, 7.007007007007007, 8.008008008008009, 9.00900900900901, 10.01001001001001, 11.01101101101101, 12.012012012012011, 13.013013013013014, 14.014014014014014, 15.015015015015015, 16.016016016016017, 17.000333667000334, 18.001334668001334, 19.002335669002335], "recent_frames_sha256": "22509609eccd762581d6556b106b6194719db52b616306158a6907ba8382fd68", "num_recent_frames": 20, "tq": 718779.516333642, "t1": 718787.111146201, "ta": 718787.111146201, "te": 718787.151749914, "first_response_s": 7.59481255908031, "answer_total_s": 7.635416272096336, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 496, "content_group": "7b5efa4253362d0b930ca77e827fb1459d81f9de205243eb310bc198639a86b6", "question": {"question_id": "sample_496_a936_q0", "video_id": 496, "video_path": "./videos/sample_496_real.mp4", "annotation_index": 936, "question_index": 0, "question": "Which car won first place in this competition?", "options": ["A. The blue car.", "B. The dark purple car.", "C. The green car.", "D. The red car."], "answer": "C", "time_stamp_s": 275, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_496_a936_q0", "video_id": 496, "time_stamp_s": 275, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f57d4e6bcdd5e6a591308e2def4f0484b6d54892781d2718e214087af00d8c20", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [245.0116783450117, 246.01267934601267, 247.0136803470137, 248.01468134801468, 249.0156823490157, 250.0, 251.00100100100101, 252.002002002002, 253.00300300300302, 254.004004004004, 255.00500500500502, 256.00600600600603, 257.007007007007, 258.008008008008, 259.009009009009, 260.01001001001003, 261.011011011011, 262.012012012012, 263.013013013013, 264.01401401401404, 265.015015015015, 266.016016016016, 267.00033366700035, 268.00133466800133, 269.0023356690023, 270.00333667000336, 271.00433767100435, 272.00533867200534, 273.0063396730063, 274.00734067400737], "recent_frames_sha256": "10acae363577196e82ca7b198711531d08b74cf0da856aeef54b2fc4876af126", "num_recent_frames": 30, "tq": 719034.59174178, "t1": 719046.337429882, "ta": 719046.337429882, "te": 719046.374654269, "first_response_s": 11.745688101975247, "answer_total_s": 11.78291248891037, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_496_a936_q0", "video_id": 496, "time_stamp_s": 275, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e02065a27cbfab5c7e9970004c7f5ed8c12ec1fc3a9b1819224fbdb46191a77a", "condition_order": ["notes", "recent"], "memory": "[0-30s] - A model train travels along a painted desert landscape track, passing over bridges and beside mountains.  \n- A white model airplane with orange wingtips moves along a paved runway, viewed from above.  \n- A line of colorful toy cars races down a snowy slope, with a large sand dune and a blue sky backdrop.\n[30-60s] - Toy cars are scattered across a snowy track after a crash, with some vehicles overturned or stuck in snowdrifts.  \n- A large black steam locomotive labeled \"HOT ROD TRACKS\" is stationary on a parallel track, positioned behind a line of toy cars.  \n- The scene transitions to a different setting where toy cars are lined up on a paved surface beside the train, suggesting a staged race or display.\n[60-90s] - Silver Audi Avant R2 (SEED #1) is shown on a track with its details displayed on screen.\n- Red R6 (SEED #4) is positioned behind the silver car, also with its details visible.\n- Blue AMC Eagle (SEED #3) is positioned further back, with its details displayed on screen.\n[90-120s] - Green car with \"35\" on side starts race on snowy track, positioned ahead of others.  \n- Blue car (Sneaky Bob) and red car (Mumbuskull) follow closely behind, navigating curves.  \n- Race track transitions from snowy terrain to desert-like landscape with tunnels and hills.\n[120-150s] - A red car navigates a winding road near a train track, passing a white van parked beside it.  \n- A silver car speeds along a straight path, approaching a digital scoreboard displaying \"BEN IS A HERO\" and \"REPLAY\" text.  \n- A blue car drives along a curving road adjacent to a rocky cliff, with a large billboard visible on the left.\n[150-180s] - A blue car drives along a curved road near a train track, passing a large rock formation.  \n- A scoreboard displays race results for \"2023-2024 BRAGGON WAGON\" with White Knuckle Motorsports leading with 4 points.  \n- A snowy track scene shows five toy cars lined up at the start of \"RACE 2,\" with names like Numbskull and Sneaky Bob listed on screen.\n[180-210s] - A silver car speeds past a GoPro billboard and a digital timer displaying \"00:00:00\" on a paved track.  \n- The track transitions from a paved surface to a dirt path with sparse vegetation, bordered by small trees.  \n- A green car enters the frame from the right, approaching the same timer and billboard as the silver car.\n[210-240s] - A GoPro-branded sign is visible in the background during a model race replay.  \n- A scoreboard displays race results for 2023-2024, showing White Wagon Motorsports with 7 points and AP Racing with 4 points.  \n- Model cars race on a winding track with miniature trees and terrain features, including a bridge and a train track.\n[240-270s] - Four toy cars (purple, green, silver, red) start a race on a snowy track, with names displayed on screen.  \n- The camera pans to reveal a wider, winding desert racetrack with multiple cars, including a blue car, navigating curves and hills.  \n- A train track runs parallel to the road, with a train visible on it, and a yellow truck appears on the road near the finish line.", "history_tokens": 781, "history_utf8_bytes": 3061, "recent_frame_times_s": [245.0116783450117, 246.01267934601267, 247.0136803470137, 248.01468134801468, 249.0156823490157, 250.0, 251.00100100100101, 252.002002002002, 253.00300300300302, 254.004004004004, 255.00500500500502, 256.00600600600603, 257.007007007007, 258.008008008008, 259.009009009009, 260.01001001001003, 261.011011011011, 262.012012012012, 263.013013013013, 264.01401401401404, 265.015015015015, 266.016016016016, 267.00033366700035, 268.00133466800133, 269.0023356690023, 270.00333667000336, 271.00433767100435, 272.00533867200534, 273.0063396730063, 274.00734067400737], "recent_frames_sha256": "10acae363577196e82ca7b198711531d08b74cf0da856aeef54b2fc4876af126", "num_recent_frames": 30, "tq": 718859.193690706, "t1": 718861.203088091, "ta": 718861.203088091, "te": 718861.468106654, "first_response_s": 2.0093973849434406, "answer_total_s": 2.2744159479625523, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 496, "content_group": "7b5efa4253362d0b930ca77e827fb1459d81f9de205243eb310bc198639a86b6", "question": {"question_id": "sample_496_a937_q0", "video_id": 496, "video_path": "./videos/sample_496_real.mp4", "annotation_index": 937, "question_index": 0, "question": "Which car won first place in this competition?", "options": ["A. The blue car.", "B. The dark purple car.", "C. The green car.", "D. The red car."], "answer": "D", "time_stamp_s": 503, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_496_a937_q0", "video_id": 496, "time_stamp_s": 503, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2735de2743a565f80e08019a26bef8a400bbaa75c30ddad89a6b3cabff86e901", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [473.0063396730063, 474.00734067400737, 475.00834167500835, 476.00934267600934, 477.0103436770103, 478.01134467801137, 479.01234567901236, 480.01334668001334, 481.0143476810143, 482.0153486820154, 483.01634968301636, 484.0006673340007, 485.0016683350017, 486.00266933600267, 487.00367033700365, 488.0046713380047, 489.0056723390057, 490.00667334000667, 491.00767434100766, 492.0086753420087, 493.0096763430097, 494.0106773440107, 495.01167834501166, 496.0126793460127, 497.0136803470137, 498.0146813480147, 499.01568234901566, 500.0, 501.001001001001, 502.00200200200203], "recent_frames_sha256": "b77082088aa1e9d19afb70111c68ee72a4d300325b1fd925c7a7025eeb66da14", "num_recent_frames": 30, "tq": 719046.385671447, "t1": 719089.190447965, "ta": 719089.190447965, "te": 719089.228117682, "first_response_s": 42.80477651802357, "answer_total_s": 42.84244623500854, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_496_a937_q0", "video_id": 496, "time_stamp_s": 503, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a5fc5dd2b206b4a074dc2f40892dd3a961276d82acaad8412533c1978dd16aba", "condition_order": ["notes", "recent"], "memory": "[180-210s] - A silver car speeds past a GoPro billboard and a digital timer displaying \"00:00:00\" on a paved track.  \n- The track transitions from a paved surface to a dirt path with sparse vegetation, bordered by small trees.  \n- A green car enters the frame from the right, approaching the same timer and billboard as the silver car.\n[210-240s] - A GoPro-branded sign is visible in the background during a model race replay.  \n- A scoreboard displays race results for 2023-2024, showing White Wagon Motorsports with 7 points and AP Racing with 4 points.  \n- Model cars race on a winding track with miniature trees and terrain features, including a bridge and a train track.\n[240-270s] - Four toy cars (purple, green, silver, red) start a race on a snowy track, with names displayed on screen.  \n- The camera pans to reveal a wider, winding desert racetrack with multiple cars, including a blue car, navigating curves and hills.  \n- A train track runs parallel to the road, with a train visible on it, and a yellow truck appears on the road near the finish line.\n[270-300s] - A red car drives along a paved road, passing a GoPro billboard and a digital display showing \"100% TRACKING\" and \"GO PRO\".\n- A blue car follows the red car, then a green car overtakes both, while a white car appears behind the blue car.\n- The scene transitions to a snowy mountain road with multiple cars racing, followed by an aerial view of a complex road network with trains and cars on parallel tracks.\n[300-330s] - A blue car speeds along a curved asphalt track, passing a yellow construction vehicle parked near a large rock formation.  \n- A white van with a blue roof is parked on the side of the track, near a group of people standing by a barrier.  \n- A scoreboard displays race results for the 2023-2024 Bragan Wagon, showing White Knuckle Motorsports with a total of 10 points.\n[330-360s] - Red car navigates a winding road near a snowy mountain backdrop, passing a blue truck and a red vehicle on a parallel track.  \n- A blue car drives along a straight path past a digital scoreboard displaying \"100% SPEED\" and a \"Cespro\" sign.  \n- A red car enters a tunnel-like structure, followed by a blue car, with a \"REPLAY\" sign visible in the background.\n[360-390s] - A white car navigates a sharp curve on a snowy mountain road, followed by a green car.  \n- A blue car speeds through a desert-like terrain, passing a tunnel and a billboard.  \n- A red car races along a winding road near a large rock formation, with other vehicles visible in the background.\n[390-420s] - A leaderboard displays race results for three teams: White Wagon, BP Racing, and Major Racing, with totals of 10, 10, and 6 respectively.\n- The scene transitions to a black screen with \"HALF TIME\" in white text.\n- Three illuminated hot air balloon-shaped signs for \"Gravity Through Racing\" appear, each highlighting different categories: \"Best Lap,\" \"Fastest Wagon,\" and \"Best Drift.\"\n[420-450s] - A white Porsche Cayman GT4 on a trailer is displayed under a \"Best In Show\" sign, with a person standing on a pedestal behind it.  \n- A dark gray station wagon is positioned on grass, surrounded by miniature figures pulling on its front, under a \"Fastest Wagon\" sign.  \n- A blue Dodge Challenger with \"Dodge\" and \"Sprint\" decals is shown near a \"Fastest Drift\" sign, with figures standing beside it.\n[450-480s] - Three illuminated \"Best Drift\" lamps glow in green, blue, and purple, positioned on a miniature landscape with toy vehicles and figures.  \n- A \"STARCORPS INDUSTRIES\" logo appears in the lower right corner, superimposed over the scene.  \n- The scene transitions to a snowy race track with toy cars (Crazy Canuck, Numbskull, Sneaky Bob, Sweeper Herb) lined up, ready to race.", "history_tokens": 959, "history_utf8_bytes": 3738, "recent_frame_times_s": [473.0063396730063, 474.00734067400737, 475.00834167500835, 476.00934267600934, 477.0103436770103, 478.01134467801137, 479.01234567901236, 480.01334668001334, 481.0143476810143, 482.0153486820154, 483.01634968301636, 484.0006673340007, 485.0016683350017, 486.00266933600267, 487.00367033700365, 488.0046713380047, 489.0056723390057, 490.00667334000667, 491.00767434100766, 492.0086753420087, 493.0096763430097, 494.0106773440107, 495.01167834501166, 496.0126793460127, 497.0136803470137, 498.0146813480147, 499.01568234901566, 500.0, 501.001001001001, 502.00200200200203], "recent_frames_sha256": "b77082088aa1e9d19afb70111c68ee72a4d300325b1fd925c7a7025eeb66da14", "num_recent_frames": 30, "tq": 718954.895984927, "t1": 718956.230546355, "ta": 718956.230546355, "te": 718956.389687987, "first_response_s": 1.3345614280551672, "answer_total_s": 1.493703060084954, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 496, "content_group": "7b5efa4253362d0b930ca77e827fb1459d81f9de205243eb310bc198639a86b6", "question": {"question_id": "sample_496_a938_q1", "video_id": 496, "video_path": "./videos/sample_496_real.mp4", "annotation_index": 938, "question_index": 1, "question": "What is surrounding the racetrack right now?", "options": ["A. Sand dunes.", "B. Tall grass.", "C. Snow banks.", "D. Rocky cliffs."], "answer": "C", "time_stamp_s": 723, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [720, 780], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_496_a938_q1", "video_id": 496, "time_stamp_s": 723, "ground_truth": "C", "raw_output": "C. Snow banks.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "1f3e6b16e034816f35ca49059e9382cf828e6a7ffb23ced25cf3d5f6db855313", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [693.0096763430097, 694.0106773440107, 695.0116783450117, 696.0126793460126, 697.0136803470136, 698.0146813480147, 699.0156823490157, 700.0, 701.001001001001, 702.002002002002, 703.003003003003, 704.0040040040041, 705.005005005005, 706.006006006006, 707.007007007007, 708.008008008008, 709.009009009009, 710.01001001001, 711.011011011011, 712.0120120120121, 713.013013013013, 714.014014014014, 715.015015015015, 716.016016016016, 717.0003336670003, 718.0013346680014, 719.0023356690024, 720.0033366700034, 721.0043376710044, 722.0053386720053], "recent_frames_sha256": "ba340eb1c3759837343cca17a11ffd123ecefa22bc378f25b9e2052e053d7c1f", "num_recent_frames": 30, "tq": 719089.236496468, "t1": 719099.904372561, "ta": 719099.904372561, "te": 719100.098499327, "first_response_s": 10.667876093066297, "answer_total_s": 10.862002859008498, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_496_a938_q1", "video_id": 496, "time_stamp_s": 723, "ground_truth": "C", "raw_output": "C. Snow banks.", "prediction": "C", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "3ab894bf05eee904cf6798227cdb021f4d3930bf24ef668b7826aef4c3bd83ad", "condition_order": ["notes", "recent"], "memory": "[420-450s] - A white Porsche Cayman GT4 on a trailer is displayed under a \"Best In Show\" sign, with a person standing on a pedestal behind it.  \n- A dark gray station wagon is positioned on grass, surrounded by miniature figures pulling on its front, under a \"Fastest Wagon\" sign.  \n- A blue Dodge Challenger with \"Dodge\" and \"Sprint\" decals is shown near a \"Fastest Drift\" sign, with figures standing beside it.\n[450-480s] - Three illuminated \"Best Drift\" lamps glow in green, blue, and purple, positioned on a miniature landscape with toy vehicles and figures.  \n- A \"STARCORPS INDUSTRIES\" logo appears in the lower right corner, superimposed over the scene.  \n- The scene transitions to a snowy race track with toy cars (Crazy Canuck, Numbskull, Sneaky Bob, Sweeper Herb) lined up, ready to race.\n[480-510s] - Red car navigates a snowy slope with other cars and a train on adjacent tracks.  \n- Blue car drives on a paved road near a digital scoreboard displaying \"Cape VARRON\" and \"GoTREK\".  \n- A train with \"Swift\" and \"BNSF\" cargo cars passes under a bridge, with a yellow truck and white van on the road nearby.\n[510-540s] - Toy cars race on a winding, snow-covered track with a backdrop of painted mountains and trees.  \n- A red car is seen speeding along a desert road with rocky formations and sparse vegetation.  \n- A scoreboard displays race results for \"White Wagon\" and other teams, showing their points across multiple rounds.\n[540-570s] - Race 6 scoreboard shows White Wagon's total of 15, AP Racing's 10, and Racing Racing's 4.  \n- Cars on snowy track (Numbukull, Sneaky Bob, Swervin' Herb, Crazy Gauze) are positioned at start line.  \n- Track transitions from snowy terrain to desert-like landscape with tunnels and cargo trains visible.\n[570-600s] - A blue car navigates a winding road near a snowy mountain landscape with pine trees.  \n- A yellow car is seen on a separate elevated road segment, crossing over a lower road with a train track below.  \n- A train with red and white cars travels along a track beneath the road, passing under a bridge structure.\n[600-630s] - A red car speeds along a winding road, passing a blue car and a white truck on a parallel track.  \n- A scoreboard displays race results for \"2023-2024 BRAGGON WAGON\" with teams like \"WHITE KNIGHTS\" and \"NAMORALL RACING\" ranked by lap times.  \n- A large rock formation and miniature trees are visible on the roadside, with a \"GoPro\" sign and a \"Hero\" logo in the background.\n[630-660s] - Five toy cars (Sneaky Bob, Swervin' Herb, Crazy Canuck, Numbskull, and a sixth partially visible) are positioned on a snowy track, ready to race.  \n- The track curves through a snowy landscape with a train station and a train on an adjacent track, suggesting a multi-track racing environment.  \n- The scene transitions to a wider view showing the cars racing on a winding road through a desert-like terrain with trees, hills, and a train passing by on a parallel track.\n[660-690s] - A green toy car speeds along a desert-themed track, passing a GoPro billboard and a \"SPEED TRUCK\" sign.  \n- A blue car follows, navigating a curved section of the track with a \"50\" speed limit sign nearby.  \n- The scene transitions to a snowy landscape with multiple cars racing on winding roads, including a red car and a green car.\n[690-720s] - A red car and a purple car race on a paved road, passing a train track with freight cars.\n- A blue car drives on a narrow concrete path near a concrete wall, with black metal structures nearby.\n- A leaderboard displays race results for three teams: White Wagon, AP Racing, and Racer Racing, with totals of 20, 18, and 12 respectively.", "history_tokens": 952, "history_utf8_bytes": 3642, "recent_frame_times_s": [693.0096763430097, 694.0106773440107, 695.0116783450117, 696.0126793460126, 697.0136803470136, 698.0146813480147, 699.0156823490157, 700.0, 701.001001001001, 702.002002002002, 703.003003003003, 704.0040040040041, 705.005005005005, 706.006006006006, 707.007007007007, 708.008008008008, 709.009009009009, 710.01001001001, 711.011011011011, 712.0120120120121, 713.013013013013, 714.014014014014, 715.015015015015, 716.016016016016, 717.0003336670003, 718.0013346680014, 719.0023356690024, 720.0033366700034, 721.0043376710044, 722.0053386720053], "recent_frames_sha256": "ba340eb1c3759837343cca17a11ffd123ecefa22bc378f25b9e2052e053d7c1f", "num_recent_frames": 30, "tq": 719011.647592836, "t1": 719018.282839298, "ta": 719018.282839298, "te": 719018.469332766, "first_response_s": 6.635246462072246, "answer_total_s": 6.821739930077456, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 496, "content_group": "7b5efa4253362d0b930ca77e827fb1459d81f9de205243eb310bc198639a86b6", "question": {"question_id": "sample_496_a938_q0", "video_id": 496, "video_path": "./videos/sample_496_real.mp4", "annotation_index": 938, "question_index": 0, "question": "Which racing car won first place in this competition?", "options": ["A. The blue car.", "B. The silver and red car.", "C. The green car.", "D. The red car."], "answer": "B", "time_stamp_s": 755, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [720, 780], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_496_a938_q0", "video_id": 496, "time_stamp_s": 755, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "75a2d93e3d2d0f5fdeb7322b6ae0d35aa98406adae649ee9857a6cb49a766461", "condition_order": ["notes", "recent"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [725.0083416750083, 726.0093426760094, 727.0103436770104, 728.0113446780114, 729.0123456790124, 730.0133466800133, 731.0143476810143, 732.0153486820153, 733.0163496830163, 734.0006673340007, 735.0016683350017, 736.0026693360027, 737.0036703370037, 738.0046713380046, 739.0056723390056, 740.0066733400067, 741.0076743410077, 742.0086753420087, 743.0096763430097, 744.0106773440107, 745.0116783450117, 746.0126793460126, 747.0136803470136, 748.0146813480147, 749.0156823490157, 750.0, 751.001001001001, 752.002002002002, 753.003003003003, 754.0040040040041], "recent_frames_sha256": "0ee277d8f232f9fac39668390a53cd1c4811e7ce75ed19a848d334fdd85c915a", "num_recent_frames": 30, "tq": 719100.107999648, "t1": 719111.519579865, "ta": 719111.519579865, "te": 719111.557698529, "first_response_s": 11.411580217070878, "answer_total_s": 11.449698881013319, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_496_a938_q0", "video_id": 496, "time_stamp_s": 755, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "c3c3fd73b212c1c9def47ae6e5b6fd0c404f1d1a008c72c4c906d623dfc35e2f", "condition_order": ["notes", "recent"], "memory": "[450-480s] - Three illuminated \"Best Drift\" lamps glow in green, blue, and purple, positioned on a miniature landscape with toy vehicles and figures.  \n- A \"STARCORPS INDUSTRIES\" logo appears in the lower right corner, superimposed over the scene.  \n- The scene transitions to a snowy race track with toy cars (Crazy Canuck, Numbskull, Sneaky Bob, Sweeper Herb) lined up, ready to race.\n[480-510s] - Red car navigates a snowy slope with other cars and a train on adjacent tracks.  \n- Blue car drives on a paved road near a digital scoreboard displaying \"Cape VARRON\" and \"GoTREK\".  \n- A train with \"Swift\" and \"BNSF\" cargo cars passes under a bridge, with a yellow truck and white van on the road nearby.\n[510-540s] - Toy cars race on a winding, snow-covered track with a backdrop of painted mountains and trees.  \n- A red car is seen speeding along a desert road with rocky formations and sparse vegetation.  \n- A scoreboard displays race results for \"White Wagon\" and other teams, showing their points across multiple rounds.\n[540-570s] - Race 6 scoreboard shows White Wagon's total of 15, AP Racing's 10, and Racing Racing's 4.  \n- Cars on snowy track (Numbukull, Sneaky Bob, Swervin' Herb, Crazy Gauze) are positioned at start line.  \n- Track transitions from snowy terrain to desert-like landscape with tunnels and cargo trains visible.\n[570-600s] - A blue car navigates a winding road near a snowy mountain landscape with pine trees.  \n- A yellow car is seen on a separate elevated road segment, crossing over a lower road with a train track below.  \n- A train with red and white cars travels along a track beneath the road, passing under a bridge structure.\n[600-630s] - A red car speeds along a winding road, passing a blue car and a white truck on a parallel track.  \n- A scoreboard displays race results for \"2023-2024 BRAGGON WAGON\" with teams like \"WHITE KNIGHTS\" and \"NAMORALL RACING\" ranked by lap times.  \n- A large rock formation and miniature trees are visible on the roadside, with a \"GoPro\" sign and a \"Hero\" logo in the background.\n[630-660s] - Five toy cars (Sneaky Bob, Swervin' Herb, Crazy Canuck, Numbskull, and a sixth partially visible) are positioned on a snowy track, ready to race.  \n- The track curves through a snowy landscape with a train station and a train on an adjacent track, suggesting a multi-track racing environment.  \n- The scene transitions to a wider view showing the cars racing on a winding road through a desert-like terrain with trees, hills, and a train passing by on a parallel track.\n[660-690s] - A green toy car speeds along a desert-themed track, passing a GoPro billboard and a \"SPEED TRUCK\" sign.  \n- A blue car follows, navigating a curved section of the track with a \"50\" speed limit sign nearby.  \n- The scene transitions to a snowy landscape with multiple cars racing on winding roads, including a red car and a green car.\n[690-720s] - A red car and a purple car race on a paved road, passing a train track with freight cars.\n- A blue car drives on a narrow concrete path near a concrete wall, with black metal structures nearby.\n- A leaderboard displays race results for three teams: White Wagon, AP Racing, and Racer Racing, with totals of 20, 18, and 12 respectively.\n[720-750s] - Four toy cars (green, silver, orange, purple) start a race on a snowy track, with a train passing overhead.  \n- The race transitions to a desert-like terrain with winding roads, trees, and a tunnel, where a white car overtakes a yellow one.  \n- A white car navigates a narrow path between tall black metal structures, with a red-and-white striped barrier visible nearby.", "history_tokens": 937, "history_utf8_bytes": 3613, "recent_frame_times_s": [725.0083416750083, 726.0093426760094, 727.0103436770104, 728.0113446780114, 729.0123456790124, 730.0133466800133, 731.0143476810143, 732.0153486820153, 733.0163496830163, 734.0006673340007, 735.0016683350017, 736.0026693360027, 737.0036703370037, 738.0046713380046, 739.0056723390056, 740.0066733400067, 741.0076743410077, 742.0086753420087, 743.0096763430097, 744.0106773440107, 745.0116783450117, 746.0126793460126, 747.0136803470136, 748.0146813480147, 749.0156823490157, 750.0, 751.001001001001, 752.002002002002, 753.003003003003, 754.0040040040041], "recent_frames_sha256": "0ee277d8f232f9fac39668390a53cd1c4811e7ce75ed19a848d334fdd85c915a", "num_recent_frames": 30, "tq": 719031.249822121, "t1": 719033.323021859, "ta": 719033.323021859, "te": 719033.671160443, "first_response_s": 2.0731997380498797, "answer_total_s": 2.4213383219903335, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 497, "content_group": "7dfd30498ff94fc7e5abcea8c5d07f16515acdb17464d325754b9b05aa6dbee0", "question": {"question_id": "sample_497_a1090_q0", "video_id": 497, "video_path": "./videos/sample_497_real.mp4", "annotation_index": 1090, "question_index": 0, "question": "What is depicted in the quadrants labeled \"Train1,\" \"Scrambler,\" \"Train2,\" and \"Big-U\"?", "options": ["A. Various miniature race tracks.", "B. Four different sections of the race track.", "C. A detailed map of a large city.", "D. A diagram of an amusement park."], "answer": "B", "time_stamp_s": 15, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_497_a1090_q0", "video_id": 497, "time_stamp_s": 15, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5de92a914dd438fba07be5e191c0ca3a9124c89eae8e466a7d02b8bde561b86b", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001001001001001, 2.002002002002002, 3.003003003003003, 4.004004004004004, 5.005005005005005, 6.006006006006006, 7.007007007007007, 8.008008008008009, 9.00900900900901, 10.01001001001001, 11.01101101101101, 12.012012012012011, 13.013013013013014, 14.014014014014014], "recent_frames_sha256": "f53f15dc5d3468e5f4dd5d86d5bf01539cd7aedba5f115aefc4695dbe594f43d", "num_recent_frames": 15, "tq": 715331.956820584, "t1": 715340.573009883, "ta": 715340.573009883, "te": 715340.614191602, "first_response_s": 8.616189299034886, "answer_total_s": 8.657371017965488, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_497_a1090_q0", "video_id": 497, "time_stamp_s": 15, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "e1cf77e5ef2d300ae7f40d0208e6ddcc446ca1f0e05f14394b07f64e6924145e", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001001001001001, 2.002002002002002, 3.003003003003003, 4.004004004004004, 5.005005005005005, 6.006006006006006, 7.007007007007007, 8.008008008008009, 9.00900900900901, 10.01001001001001, 11.01101101101101, 12.012012012012011, 13.013013013013014, 14.014014014014014], "recent_frames_sha256": "f53f15dc5d3468e5f4dd5d86d5bf01539cd7aedba5f115aefc4695dbe594f43d", "num_recent_frames": 15, "tq": 715382.927667632, "t1": 715392.062675603, "ta": 715392.062675603, "te": 715392.327248595, "first_response_s": 9.135007970966399, "answer_total_s": 9.399580962955952, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 497, "content_group": "7dfd30498ff94fc7e5abcea8c5d07f16515acdb17464d325754b9b05aa6dbee0", "question": {"question_id": "sample_497_a1091_q0", "video_id": 497, "video_path": "./videos/sample_497_real.mp4", "annotation_index": 1091, "question_index": 0, "question": "What does the scoreboard titled \"FINAL RACE\" show?", "options": ["A. The number of laps completed.", "B. The cars' performance in round 1 and round 2.", "C. The fastest lap time.", "D. The starting positions of the cars."], "answer": "B", "time_stamp_s": 261, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_497_a1091_q0", "video_id": 497, "time_stamp_s": 261, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "ead228a6dc8893e52e8b4026bb6e6b3916b0c1b2bc6b7d17a3073cb83fa20085", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [231.01434768101436, 232.01534868201534, 233.01634968301636, 234.00066733400067, 235.00166833500168, 236.00266933600267, 237.00367033700368, 238.00467133800467, 239.00567233900568, 240.00667334000667, 241.0076743410077, 242.00867534200867, 243.0096763430097, 244.01067734401067, 245.0116783450117, 246.01267934601267, 247.0136803470137, 248.01468134801468, 249.0156823490157, 250.0, 251.00100100100101, 252.002002002002, 253.00300300300302, 254.004004004004, 255.00500500500502, 256.00600600600603, 257.007007007007, 258.008008008008, 259.009009009009, 260.01001001001003], "recent_frames_sha256": "136106a2fa9726021c2c1e12b38685d73984ec972b32c05988a9dacbc073009b", "num_recent_frames": 30, "tq": 715340.631957637, "t1": 715347.197305383, "ta": 715347.197305383, "te": 715347.381142609, "first_response_s": 6.565347746014595, "answer_total_s": 6.749184972024523, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_497_a1091_q0", "video_id": 497, "time_stamp_s": 261, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "388d11d4eb783ac005b16468dd31303aa4a0b7b767b53e5734f63fb7e6b276b3", "condition_order": ["recent", "notes"], "memory": "[0-30s] - \"UNDER CONSTRUCTION TOURNAMENT\" title screen transitions to \"GRAVITY THROTTLE RACING\" logo.  \n- Four quadrant views show various track segments (Drone1, Drone2, Runway3, Drift Turn) with cardboard and plastic components.  \n- A split screen features host \"Munchy Crameris\" in a small inset while the main view displays a model train track with freight cars and airplanes on a desert-themed layout.\n[30-60s] - Sand dunes with smooth, curved ridges are shown, bordered by blue walls, suggesting a desert-like miniature landscape.  \n- A model train track with a black locomotive is laid out on cardboard, positioned near the dunes, indicating a miniature railway setup.  \n- Several toy cars are arranged on a circular track, with a scoring table overlay showing finish positions and points for rounds 1-4.\n[60-90s] - A static scoring table for Rounds 1-4 displays points for 1st, 2nd, 3rd, and DNF finishes against a desert race track backdrop.\n- The Gravity Throttle Racing logo appears briefly, indicating the racing series or team.\n- Toy cars are shown on a snowy track, with the blue car (Daddy 6) and white car (Boxer 5) positioned side-by-side, suggesting a race or pit stop scenario.\n[90-120s] - White/red #27 car (Olsen Racing) leads in a snowy track race, positioned ahead of a black #4 car.\n- Black #4 car (Force Racing) follows closely behind the white/red car, with a blue car visible further back.\n- A black #1 car (Monster Motorsports) is shown in a separate frame, indicating it's the top-ranked vehicle in the race.\n[120-150s] - Four toy cars race on a sandy track under a \"SEASON 3 - FINALS\" archway, with the white car leading.  \n- The track curves through desert terrain, passing a train crossing and a steep incline.  \n- Cars navigate a sharp turn and descend a ramp, with the black car trailing behind the white one.\n[150-180s] - A white toy car with red and blue markings races along a cardboard track, passing a flagpole with a red and white flag.  \n- A black toy car follows closely behind the white car, navigating a curved section of the track.  \n- The track features multiple lanes and turns, with cardboard walls and a blue background visible in the surrounding area.\n[180-210s] - A scoreboard displays \"FINAL RACE\" with race cars and their round-by-round scores, including a total of 2, 0, 4, and 3 points respectively.\n- Four toy cars are positioned at the start line on a sandy track, with a metal arch overhead and a blue wall in the background.\n- The cars begin racing down a winding sandy track, with the camera following their movement as they navigate curves and hills.\n[210-240s] - A white car navigates a curved track section with a blue surface, passing under a bridge structure.  \n- A black car follows closely behind, moving along a parallel track segment with a similar curvature.  \n- The track layout includes cardboard-like terrain with painted road markings and a backdrop of mountainous scenery.", "history_tokens": 722, "history_utf8_bytes": 2947, "recent_frame_times_s": [231.01434768101436, 232.01534868201534, 233.01634968301636, 234.00066733400067, 235.00166833500168, 236.00266933600267, 237.00367033700368, 238.00467133800467, 239.00567233900568, 240.00667334000667, 241.0076743410077, 242.00867534200867, 243.0096763430097, 244.01067734401067, 245.0116783450117, 246.01267934601267, 247.0136803470137, 248.01468134801468, 249.0156823490157, 250.0, 251.00100100100101, 252.002002002002, 253.00300300300302, 254.004004004004, 255.00500500500502, 256.00600600600603, 257.007007007007, 258.008008008008, 259.009009009009, 260.01001001001003], "recent_frames_sha256": "136106a2fa9726021c2c1e12b38685d73984ec972b32c05988a9dacbc073009b", "num_recent_frames": 30, "tq": 715449.692996444, "t1": 715456.795758668, "ta": 715456.795758668, "te": 715456.832917, "first_response_s": 7.102762224036269, "answer_total_s": 7.139920556102879, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 497, "content_group": "7dfd30498ff94fc7e5abcea8c5d07f16515acdb17464d325754b9b05aa6dbee0", "question": {"question_id": "sample_497_a1092_q0", "video_id": 497, "video_path": "./videos/sample_497_real.mp4", "annotation_index": 1092, "question_index": 0, "question": "Which car is leading right now?", "options": ["A. Black car.", "B. Red car.", "C. White car with red roof.", "D. Green car."], "answer": "C", "time_stamp_s": 509, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [480, 540], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_497_a1092_q0", "video_id": 497, "time_stamp_s": 509, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "5a5f021051e4adc2d9c3ffbc5cc287978e76b5983d45c241f85124e328348198", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [479.01234567901236, 480.01334668001334, 481.0143476810143, 482.0153486820154, 483.01634968301636, 484.0006673340007, 485.0016683350017, 486.00266933600267, 487.00367033700365, 488.0046713380047, 489.0056723390057, 490.00667334000667, 491.00767434100766, 492.0086753420087, 493.0096763430097, 494.0106773440107, 495.01167834501166, 496.0126793460127, 497.0136803470137, 498.0146813480147, 499.01568234901566, 500.0, 501.001001001001, 502.00200200200203, 503.003003003003, 504.004004004004, 505.005005005005, 506.00600600600603, 507.007007007007, 508.008008008008], "recent_frames_sha256": "2b44207f643871bf8c26c86f90b34e1b5f8fa53977d88a30169ad3b161fad846", "num_recent_frames": 30, "tq": 715347.395895883, "t1": 715359.32239296, "ta": 715359.32239296, "te": 715359.363141871, "first_response_s": 11.926497076987289, "answer_total_s": 11.96724598808214, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_497_a1092_q0", "video_id": 497, "time_stamp_s": 509, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d7d6ae19eb7d18bebbd82411af9129bbb6f53668da20c22629326a30375da069", "condition_order": ["recent", "notes"], "memory": "[120-150s] - Four toy cars race on a sandy track under a \"SEASON 3 - FINALS\" archway, with the white car leading.  \n- The track curves through desert terrain, passing a train crossing and a steep incline.  \n- Cars navigate a sharp turn and descend a ramp, with the black car trailing behind the white one.\n[150-180s] - A white toy car with red and blue markings races along a cardboard track, passing a flagpole with a red and white flag.  \n- A black toy car follows closely behind the white car, navigating a curved section of the track.  \n- The track features multiple lanes and turns, with cardboard walls and a blue background visible in the surrounding area.\n[180-210s] - A scoreboard displays \"FINAL RACE\" with race cars and their round-by-round scores, including a total of 2, 0, 4, and 3 points respectively.\n- Four toy cars are positioned at the start line on a sandy track, with a metal arch overhead and a blue wall in the background.\n- The cars begin racing down a winding sandy track, with the camera following their movement as they navigate curves and hills.\n[210-240s] - A white car navigates a curved track section with a blue surface, passing under a bridge structure.  \n- A black car follows closely behind, moving along a parallel track segment with a similar curvature.  \n- The track layout includes cardboard-like terrain with painted road markings and a backdrop of mountainous scenery.\n[240-270s] - Four toy cars are positioned side-by-side on a snowy track under a metal gantry, ready for a race.  \n- A scoreboard displays \"FINAL RACE\" with cumulative scores for each car across seven rounds, indicating race standings.  \n- The cars are static at the start line, with no visible movement or interaction between them.\n[270-300s] - A blue car is positioned on a straight track segment, approaching a set of white vertical barriers.  \n- The track surface is smooth and light-colored, bordered by cardboard walls with dark blue tape.  \n- A small flag with red and white markings is mounted on a stand near the track’s edge, slightly ahead of the car.\n[300-330s] - Four toy cars start from a sandy ramp under a \"SEASON 3 - FINALS\" arch, racing down separate lanes.  \n- The cars navigate a curved, multi-level track with sand-covered sections and cardboard barriers.  \n- One car (white with red stripes) veers off the track and crashes into a sand pile, while others continue.\n[330-360s] - A scoreboard displays \"FINAL RACE\" with race results for six cars across seven rounds, showing totals of 10, 4, 7, and 3 points respectively.\n- Four toy cars are positioned at the start line on a sandy track, with a white archway above them and a blue backdrop.\n- The cars begin racing down a winding, sandy track with curves and elevation changes, moving from left to right across the frame.\n[360-390s] - A white car with blue stripes races along a straight track segment, passing a small flagpole with a red and white banner.  \n- A black car follows closely behind, navigating a curved section of the track.  \n- A third car, also white with red and black markings, is seen further ahead, approaching a turn on the track.\n[390-420s] - Black car flips mid-air over sand dune, then lands on its side.  \n- White car with red stripes drives along a curved track, passing a blue wall.  \n- Red number \"4\" appears briefly over sand dune, then disappears.\n[420-450s] - A black train with multiple freight cars moves along a curved track, passing under a painted desert landscape backdrop.\n- The track features a marked \"EXIT\" area with a road intersection and a yellow signal light.\n- The train's movement is smooth, navigating the curve while maintaining alignment with the track's layout.\n[450-480s] - A model train set with multiple tracks curves around a cardboard landscape, featuring a tunnel and a bridge.  \n- A scoring table for rounds 5-8 is displayed, detailing point values for finish positions and train actions.  \n- Four model cars are positioned on a snowy track under a \"SEASON 3 - FINALS\" archway, ready for a race.", "history_tokens": 969, "history_utf8_bytes": 4035, "recent_frame_times_s": [479.01234567901236, 480.01334668001334, 481.0143476810143, 482.0153486820154, 483.01634968301636, 484.0006673340007, 485.0016683350017, 486.00266933600267, 487.00367033700365, 488.0046713380047, 489.0056723390057, 490.00667334000667, 491.00767434100766, 492.0086753420087, 493.0096763430097, 494.0106773440107, 495.01167834501166, 496.0126793460127, 497.0136803470137, 498.0146813480147, 499.01568234901566, 500.0, 501.001001001001, 502.00200200200203, 503.003003003003, 504.004004004004, 505.005005005005, 506.00600600600603, 507.007007007007, 508.008008008008], "recent_frames_sha256": "2b44207f643871bf8c26c86f90b34e1b5f8fa53977d88a30169ad3b161fad846", "num_recent_frames": 30, "tq": 715520.647795189, "t1": 715527.217257422, "ta": 715527.217257422, "te": 715527.434934947, "first_response_s": 6.56946223299019, "answer_total_s": 6.787139758002013, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 497, "content_group": "7dfd30498ff94fc7e5abcea8c5d07f16515acdb17464d325754b9b05aa6dbee0", "question": {"question_id": "sample_497_a1093_q0", "video_id": 497, "video_path": "./videos/sample_497_real.mp4", "annotation_index": 1093, "question_index": 0, "question": "Which car won first place in this competition?", "options": ["A. The blue car.", "B. The dark purple car.", "C. The blue and black car.", "D. The red car."], "answer": "C", "time_stamp_s": 700, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [660, 720], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_497_a1093_q0", "video_id": 497, "time_stamp_s": 700, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "5d1ee9ddbf9131503260eb2c1f75a1f27d4c4925a8f464944546a60378e04595", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [670.0033366700034, 671.0043376710044, 672.0053386720053, 673.0063396730063, 674.0073406740073, 675.0083416750083, 676.0093426760094, 677.0103436770104, 678.0113446780114, 679.0123456790124, 680.0133466800133, 681.0143476810143, 682.0153486820153, 683.0163496830163, 684.0006673340007, 685.0016683350017, 686.0026693360027, 687.0036703370037, 688.0046713380046, 689.0056723390056, 690.0066733400067, 691.0076743410077, 692.0086753420087, 693.0096763430097, 694.0106773440107, 695.0116783450117, 696.0126793460126, 697.0136803470136, 698.0146813480147, 699.0156823490157, 700.0], "recent_frames_sha256": "db4fcc80f86b0199f9057466135a1306f00ec3bcbb16ab50bd6dfe30f129f631", "num_recent_frames": 31, "tq": 715359.374150167, "t1": 715371.406688103, "ta": 715371.406688103, "te": 715371.636911716, "first_response_s": 12.032537936000153, "answer_total_s": 12.262761548976414, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_497_a1093_q0", "video_id": 497, "time_stamp_s": 700, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "077f877a6ffc2ec579f02f1f07a9f6a52fed3fe3122e86db2a2f0752f3f7ce2d", "condition_order": ["recent", "notes"], "memory": "[330-360s] - A scoreboard displays \"FINAL RACE\" with race results for six cars across seven rounds, showing totals of 10, 4, 7, and 3 points respectively.\n- Four toy cars are positioned at the start line on a sandy track, with a white archway above them and a blue backdrop.\n- The cars begin racing down a winding, sandy track with curves and elevation changes, moving from left to right across the frame.\n[360-390s] - A white car with blue stripes races along a straight track segment, passing a small flagpole with a red and white banner.  \n- A black car follows closely behind, navigating a curved section of the track.  \n- A third car, also white with red and black markings, is seen further ahead, approaching a turn on the track.\n[390-420s] - Black car flips mid-air over sand dune, then lands on its side.  \n- White car with red stripes drives along a curved track, passing a blue wall.  \n- Red number \"4\" appears briefly over sand dune, then disappears.\n[420-450s] - A black train with multiple freight cars moves along a curved track, passing under a painted desert landscape backdrop.\n- The track features a marked \"EXIT\" area with a road intersection and a yellow signal light.\n- The train's movement is smooth, navigating the curve while maintaining alignment with the track's layout.\n[450-480s] - A model train set with multiple tracks curves around a cardboard landscape, featuring a tunnel and a bridge.  \n- A scoring table for rounds 5-8 is displayed, detailing point values for finish positions and train actions.  \n- Four model cars are positioned on a snowy track under a \"SEASON 3 - FINALS\" archway, ready for a race.\n[480-510s] - A white toy car is seen racing along a curved track, passing a blue and white flag marker.  \n- The track is elevated on wooden supports and features a smooth, light-colored surface.  \n- The background includes painted desert landscapes and a blue sky, suggesting a model race environment.\n[510-540s] - A black toy car speeds along a curved cardboard track, passing a white and blue flag marker.  \n- A white toy car with red and black accents is seen further ahead on the same track, navigating a bend.  \n- The track features multiple curves and elevation changes, with cardboard structures and white foam padding visible.\n[540-570s] - A white race car speeds along a curved track, passing a painted desert landscape backdrop.  \n- A scoreboard displays \"FINAL RACE\" with driver rankings and totals, showing a white car in 15th place.  \n- The track features multiple turns and elevation changes, with a train visible on an adjacent track.\n[570-600s] - Scoreboard displays final race results with three cars and a total of 16, 13, and 15 points respectively.\n- Toy cars are positioned on a sandy track under a white archway, ready for the race.\n- The track features multiple curves and hills, with a painted desert landscape in the background.\n[600-630s] - A white toy car with red and blue markings drives along a curved cardboard track, passing a small flag banner.  \n- A black toy car follows behind, navigating a similar track with visible lane markings.  \n- The scene transitions to a sandy dune track where three toy cars (black, beige, and red) race down a sloped, undulating terrain.\n[630-660s] - A model race track with cars navigating curves and straightaways, surrounded by cardboard and white material.\n- A scoreboard displays \"FINAL RACE\" with car images and scores for multiple rounds, indicating race results.\n- Cars are shown in motion on the track, with some positioned at the start or end of segments.\n[660-690s] - Four toy race cars (white/red, black, black, white/red) start from a snowy pit lane under a gantry, positioned side-by-side.  \n- The cars accelerate down a sandy dune track, with the white/red car on the far left and the black car on the far right.  \n- The track features a curved section with a wooden ramp and a painted desert backdrop, with a \"Swift\" branded sign visible.", "history_tokens": 949, "history_utf8_bytes": 3956, "recent_frame_times_s": [670.0033366700034, 671.0043376710044, 672.0053386720053, 673.0063396730063, 674.0073406740073, 675.0083416750083, 676.0093426760094, 677.0103436770104, 678.0113446780114, 679.0123456790124, 680.0133466800133, 681.0143476810143, 682.0153486820153, 683.0163496830163, 684.0006673340007, 685.0016683350017, 686.0026693360027, 687.0036703370037, 688.0046713380046, 689.0056723390056, 690.0066733400067, 691.0076743410077, 692.0086753420087, 693.0096763430097, 694.0106773440107, 695.0116783450117, 696.0126793460126, 697.0136803470136, 698.0146813480147, 699.0156823490157, 700.0], "recent_frames_sha256": "db4fcc80f86b0199f9057466135a1306f00ec3bcbb16ab50bd6dfe30f129f631", "num_recent_frames": 31, "tq": 715575.058850828, "t1": 715581.921869431, "ta": 715581.921869431, "te": 715582.117701872, "first_response_s": 6.86301860306412, "answer_total_s": 7.058851044042967, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 497, "content_group": "7dfd30498ff94fc7e5abcea8c5d07f16515acdb17464d325754b9b05aa6dbee0", "question": {"question_id": "sample_497_a1094_q0", "video_id": 497, "video_path": "./videos/sample_497_real.mp4", "annotation_index": 1094, "question_index": 0, "question": "What does the scoreboard titled \"FINAL RACE\" show?", "options": ["A. The cars' performance from round 1 to round 7.", "B. The cars' performance in round 1 and round 2.", "C. The fastest lap time.", "D. The starting positions of the cars."], "answer": "A", "time_stamp_s": 758, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [720, 780], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_497_a1094_q0", "video_id": 497, "time_stamp_s": 758, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3a6e8aecbd315587ff7e032560219be3564db04a557298e007e0683cf870c2f3", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [728.0113446780114, 729.0123456790124, 730.0133466800133, 731.0143476810143, 732.0153486820153, 733.0163496830163, 734.0006673340007, 735.0016683350017, 736.0026693360027, 737.0036703370037, 738.0046713380046, 739.0056723390056, 740.0066733400067, 741.0076743410077, 742.0086753420087, 743.0096763430097, 744.0106773440107, 745.0116783450117, 746.0126793460126, 747.0136803470136, 748.0146813480147, 749.0156823490157, 750.0, 751.001001001001, 752.002002002002, 753.003003003003, 754.0040040040041, 755.005005005005, 756.006006006006, 757.007007007007], "recent_frames_sha256": "42eb6d725bd70752edb1fb56ce1c0bbbff434f078e76164fb8435a3481ed6a09", "num_recent_frames": 30, "tq": 715371.647811399, "t1": 715382.87623093, "ta": 715382.87623093, "te": 715382.916206524, "first_response_s": 11.228419531020336, "answer_total_s": 11.268395125051029, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_497_a1094_q0", "video_id": 497, "time_stamp_s": 758, "ground_truth": "A", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "38dd1766e9fd835240364fb9a674b1e7fc977f6408161fc8d05db90a7cdcf6de", "condition_order": ["recent", "notes"], "memory": "[390-420s] - Black car flips mid-air over sand dune, then lands on its side.  \n- White car with red stripes drives along a curved track, passing a blue wall.  \n- Red number \"4\" appears briefly over sand dune, then disappears.\n[420-450s] - A black train with multiple freight cars moves along a curved track, passing under a painted desert landscape backdrop.\n- The track features a marked \"EXIT\" area with a road intersection and a yellow signal light.\n- The train's movement is smooth, navigating the curve while maintaining alignment with the track's layout.\n[450-480s] - A model train set with multiple tracks curves around a cardboard landscape, featuring a tunnel and a bridge.  \n- A scoring table for rounds 5-8 is displayed, detailing point values for finish positions and train actions.  \n- Four model cars are positioned on a snowy track under a \"SEASON 3 - FINALS\" archway, ready for a race.\n[480-510s] - A white toy car is seen racing along a curved track, passing a blue and white flag marker.  \n- The track is elevated on wooden supports and features a smooth, light-colored surface.  \n- The background includes painted desert landscapes and a blue sky, suggesting a model race environment.\n[510-540s] - A black toy car speeds along a curved cardboard track, passing a white and blue flag marker.  \n- A white toy car with red and black accents is seen further ahead on the same track, navigating a bend.  \n- The track features multiple curves and elevation changes, with cardboard structures and white foam padding visible.\n[540-570s] - A white race car speeds along a curved track, passing a painted desert landscape backdrop.  \n- A scoreboard displays \"FINAL RACE\" with driver rankings and totals, showing a white car in 15th place.  \n- The track features multiple turns and elevation changes, with a train visible on an adjacent track.\n[570-600s] - Scoreboard displays final race results with three cars and a total of 16, 13, and 15 points respectively.\n- Toy cars are positioned on a sandy track under a white archway, ready for the race.\n- The track features multiple curves and hills, with a painted desert landscape in the background.\n[600-630s] - A white toy car with red and blue markings drives along a curved cardboard track, passing a small flag banner.  \n- A black toy car follows behind, navigating a similar track with visible lane markings.  \n- The scene transitions to a sandy dune track where three toy cars (black, beige, and red) race down a sloped, undulating terrain.\n[630-660s] - A model race track with cars navigating curves and straightaways, surrounded by cardboard and white material.\n- A scoreboard displays \"FINAL RACE\" with car images and scores for multiple rounds, indicating race results.\n- Cars are shown in motion on the track, with some positioned at the start or end of segments.\n[660-690s] - Four toy race cars (white/red, black, black, white/red) start from a snowy pit lane under a gantry, positioned side-by-side.  \n- The cars accelerate down a sandy dune track, with the white/red car on the far left and the black car on the far right.  \n- The track features a curved section with a wooden ramp and a painted desert backdrop, with a \"Swift\" branded sign visible.\n[690-720s] - A black toy car is seen moving along a curved cardboard track, passing a white barrier with a flag attached.  \n- A white toy car follows behind, navigating the same track, with a red-and-white checkered flag visible at the start line.  \n- The scene transitions to a sand dune environment where multiple toy cars (black, white, and red) are racing across undulating sand, with a blue backdrop.\n[720-750s] - A white toy car drives along a curved track with a painted mountain backdrop.  \n- The camera pans to reveal a scoreboard showing race results for three cars, with totals of 16, 19, and 20 points.  \n- The track features a mix of flat and elevated sections, with a white textured surface resembling snow or sand.", "history_tokens": 947, "history_utf8_bytes": 3950, "recent_frame_times_s": [728.0113446780114, 729.0123456790124, 730.0133466800133, 731.0143476810143, 732.0153486820153, 733.0163496830163, 734.0006673340007, 735.0016683350017, 736.0026693360027, 737.0036703370037, 738.0046713380046, 739.0056723390056, 740.0066733400067, 741.0076743410077, 742.0086753420087, 743.0096763430097, 744.0106773440107, 745.0116783450117, 746.0126793460126, 747.0136803470136, 748.0146813480147, 749.0156823490157, 750.0, 751.001001001001, 752.002002002002, 753.003003003003, 754.0040040040041, 755.005005005005, 756.006006006006, 757.007007007007], "recent_frames_sha256": "42eb6d725bd70752edb1fb56ce1c0bbbff434f078e76164fb8435a3481ed6a09", "num_recent_frames": 30, "tq": 715598.533217823, "t1": 715612.399032491, "ta": 715612.399032491, "te": 715612.712896724, "first_response_s": 13.865814668009989, "answer_total_s": 14.179678900982253, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 498, "content_group": "a0fdbc3f695b2e5091887eccd8bfc4fa7dbdf25c389374bd7fe7e6c12f84b99b", "question": {"question_id": "sample_498_a1170_q0", "video_id": 498, "video_path": "./videos/sample_498_real.mp4", "annotation_index": 1170, "question_index": 0, "question": "What is prominently displayed on the side of the green toy car?", "options": ["A. The number \"12\".", "B. The number \"24\".", "C. The number \"36\".", "D. The number \"48\"."], "answer": "B", "time_stamp_s": 20, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_498_a1170_q0", "video_id": 498, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8c5ba42a72df74e09fd73e6512e171cfb7eacc5d12fd16991ff5aff50e8f79b5", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "40101e9699440368c4aae6ed2529954f99a8ba1549583b003d1ecef3d9a2a9b8", "num_recent_frames": 21, "tq": 710360.387139562, "t1": 710366.329060174, "ta": 710366.329060174, "te": 710366.366856383, "first_response_s": 5.941920611890964, "answer_total_s": 5.979716820991598, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_498_a1170_q0", "video_id": 498, "time_stamp_s": 20, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c417f477b5b86da552df028955ac5f5f436b4ebe9b171a755370b5919b79a3bb", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0, 11.0, 12.0, 13.0, 14.0, 15.0, 16.0, 17.0, 18.0, 19.0, 20.0], "recent_frames_sha256": "40101e9699440368c4aae6ed2529954f99a8ba1549583b003d1ecef3d9a2a9b8", "num_recent_frames": 21, "tq": 710410.591551967, "t1": 710422.639812261, "ta": 710422.639812261, "te": 710422.679130061, "first_response_s": 12.048260294017382, "answer_total_s": 12.087578093982302, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 498, "content_group": "a0fdbc3f695b2e5091887eccd8bfc4fa7dbdf25c389374bd7fe7e6c12f84b99b", "question": {"question_id": "sample_498_a1171_q0", "video_id": 498, "video_path": "./videos/sample_498_real.mp4", "annotation_index": 1171, "question_index": 0, "question": "Which car has a green fin in the back?", "options": ["A. Car #24.", "B. Car #28.", "C. Car #35.", "D. Car #94."], "answer": "C", "time_stamp_s": 130, "task_type": "Object Recognition", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_498_a1171_q0", "video_id": 498, "time_stamp_s": 130, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "d232bc22259242c26d65f6fc60259f566ef38404da952ed5afaaf36d227e69ff", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0], "recent_frames_sha256": "7076c97e7477828bc429c79efb9bbd22ce4647c1ad0bfbcccb3110b66fe63947", "num_recent_frames": 30, "tq": 710366.386986603, "t1": 710377.470980935, "ta": 710377.470980935, "te": 710377.507412332, "first_response_s": 11.083994332002476, "answer_total_s": 11.12042572896462, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_498_a1171_q0", "video_id": 498, "time_stamp_s": 130, "ground_truth": "C", "raw_output": "A. Car #24.", "prediction": "A", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 0, "generation_id": "31056decb17c5bb685ace75c483171cbbc0d0ec593f6f0c62c2cc61ccf96f4b5", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Group 7 cars (Chase Racelott #24, Tim Treadless #28) are shown on a track with sponsor banners and a chain-link fence background.\n- Chase Racelott's lime green car with \"RACELOTT\" branding is highlighted, followed by Tim Treadless's silver/orange car with \"ELT RACING\" branding.\n- Both cars are stationary on the track, with their names and team affiliations displayed as text overlays.\n[30-60s] - #28 Tim Tireless (orange/gray) and #35 Ronald (light gray/green) are positioned side-by-side on a track, with #94 Jay (light gray/blue) slightly behind them.\n- The cars are shown on a miniature racetrack with green hills, trees, and a chain-link fence in the background, indicating a race setup.\n- The scene transitions to a wider view of the track, showing all three cars racing along a curved section with a \"30\" sign visible, suggesting a speed limit or checkpoint.\n[60-90s] - Green and white race car overtakes blue car on straightaway near pit lane.  \n- Orange car follows closely behind green car, both speeding along the track.  \n- Blue car in garage appears stationary, while other cars race past the pit area.\n[90-120s] - Track times displayed for five racers: #94 Jay (8.267), #35 Ronald (8.348), #39 Michael Rotor (8.416), #5 Eric Braker (8.685), and #90 Paul Conrey (8.760).\n- Standings shown with #94 Jay in 1st place (5 points), #35 Ronald in 2nd (3 points), #24 Chase Racelott in 3rd (2 points), and #28 Tim Treadless in 4th (", "history_tokens": 424, "history_utf8_bytes": 1449, "recent_frame_times_s": [101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0, 121.0, 122.0, 123.0, 124.0, 125.0, 126.0, 127.0, 128.0, 129.0, 130.0], "recent_frames_sha256": "7076c97e7477828bc429c79efb9bbd22ce4647c1ad0bfbcccb3110b66fe63947", "num_recent_frames": 30, "tq": 710455.745280539, "t1": 710463.462759465, "ta": 710463.462759465, "te": 710463.741539588, "first_response_s": 7.717478925944306, "answer_total_s": 7.996259048930369, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 498, "content_group": "a0fdbc3f695b2e5091887eccd8bfc4fa7dbdf25c389374bd7fe7e6c12f84b99b", "question": {"question_id": "sample_498_a1172_q0", "video_id": 498, "video_path": "./videos/sample_498_real.mp4", "annotation_index": 1172, "question_index": 0, "question": "What is displayed at the top right right now?", "options": ["A. Race results.", "B. Lap times.", "C. Instant Replay.", "D. Track map."], "answer": "C", "time_stamp_s": 246, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_498_a1172_q0", "video_id": 498, "time_stamp_s": 246, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1e3d214c4113bdea26ab84baca53db3b2cdc8bc3cf35911dce6b3b128553b1ab", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0], "recent_frames_sha256": "2b558e50a41c3ff862086483571803bf9f89234625aa5391ab5c63a8c44bbf47", "num_recent_frames": 30, "tq": 710377.516499647, "t1": 710390.906830433, "ta": 710390.906830433, "te": 710390.944370731, "first_response_s": 13.390330786001869, "answer_total_s": 13.427871083957143, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_498_a1172_q0", "video_id": 498, "time_stamp_s": 246, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "2356922259705ec7029eed7d09efc44adb4a2ed56e24b28ed1ce91de6b47c235", "condition_order": ["recent", "notes"], "memory": "[0-30s] - Group 7 cars (Chase Racelott #24, Tim Treadless #28) are shown on a track with sponsor banners and a chain-link fence background.\n- Chase Racelott's lime green car with \"RACELOTT\" branding is highlighted, followed by Tim Treadless's silver/orange car with \"ELT RACING\" branding.\n- Both cars are stationary on the track, with their names and team affiliations displayed as text overlays.\n[30-60s] - #28 Tim Tireless (orange/gray) and #35 Ronald (light gray/green) are positioned side-by-side on a track, with #94 Jay (light gray/blue) slightly behind them.\n- The cars are shown on a miniature racetrack with green hills, trees, and a chain-link fence in the background, indicating a race setup.\n- The scene transitions to a wider view of the track, showing all three cars racing along a curved section with a \"30\" sign visible, suggesting a speed limit or checkpoint.\n[60-90s] - Green and white race car overtakes blue car on straightaway near pit lane.  \n- Orange car follows closely behind green car, both speeding along the track.  \n- Blue car in garage appears stationary, while other cars race past the pit area.\n[90-120s] - Track times displayed for five racers: #94 Jay (8.267), #35 Ronald (8.348), #39 Michael Rotor (8.416), #5 Eric Braker (8.685), and #90 Paul Conrey (8.760).\n- Standings shown with #94 Jay in 1st place (5 points), #35 Ronald in 2nd (3 points), #24 Chase Racelott in 3rd (2 points), and #28 Tim Treadless in 4th (\n[120-150s] - Standings display shows #94 Jay with 5 points, #35 Ronald with 3, #24 Chase with 2, and #28 Tim with 1.\n- Group 7 - Heat 2 race begins with four cars on a track featuring green grass, trees, and a blue sky backdrop.\n- Cars race along a track with visible sponsor logos, passing a \"TBR\" sign and approaching a pit area with garage doors.\n[150-180s] - Green car overtakes white car on a curved track during instant replay.  \n- Blue car is visible in the background, positioned behind the green and white cars.  \n- Trackside barriers and sponsor signs (e.g., \"TDR\") are visible along the racing lane.\n[180-210s] - Instant replay shows a group of toy cars racing on a curved track with sponsor banners visible.  \n- Standings display: #94 Jay (1st, 7 points), #24 Chase Raccolt (2nd, 7 points), #35 Ronald (3rd, 6 points), #28 Tim Treadless (4th, 2 points).  \n- Group 7 - Heat 3 label appears as cars approach a turn on the track.\n[210-240s] - Green car leads a pack of racing cars on a track with trees and a blue sky backdrop.  \n- White and blue cars follow closely behind, with a white car veering off the track near a sign.  \n- Instant replay overlay appears as cars navigate a turn, with a garage and parked vehicles visible in the background.", "history_tokens": 779, "history_utf8_bytes": 2706, "recent_frame_times_s": [217.0, 218.0, 219.0, 220.0, 221.0, 222.0, 223.0, 224.0, 225.0, 226.0, 227.0, 228.0, 229.0, 230.0, 231.0, 232.0, 233.0, 234.0, 235.0, 236.0, 237.0, 238.0, 239.0, 240.0, 241.0, 242.0, 243.0, 244.0, 245.0, 246.0], "recent_frames_sha256": "2b558e50a41c3ff862086483571803bf9f89234625aa5391ab5c63a8c44bbf47", "num_recent_frames": 30, "tq": 710496.967442706, "t1": 710499.005872963, "ta": 710499.005872963, "te": 710499.225027274, "first_response_s": 2.0384302570018917, "answer_total_s": 2.2575845679966733, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 498, "content_group": "a0fdbc3f695b2e5091887eccd8bfc4fa7dbdf25c389374bd7fe7e6c12f84b99b", "question": {"question_id": "sample_498_a1173_q0", "video_id": 498, "video_path": "./videos/sample_498_real.mp4", "annotation_index": 1173, "question_index": 0, "question": "What colors are those two racing cars?", "options": ["A. Red and blue.", "B. Green and silver.", "C. Black and yellow.", "D. Blue and orange."], "answer": "B", "time_stamp_s": 360, "task_type": "Object Recognition", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_498_a1173_q0", "video_id": 498, "time_stamp_s": 360, "ground_truth": "B", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "71bc77303633ef24e179820f1dec6da7fc9e97d63391bb8d72b0ddaa6640a472", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0], "recent_frames_sha256": "1403d1eca393f0432ba774fb51695969b984b594cc553d796409b31f0a18dd58", "num_recent_frames": 30, "tq": 710390.954174222, "t1": 710398.563290593, "ta": 710398.563290593, "te": 710398.600812522, "first_response_s": 7.609116371022537, "answer_total_s": 7.6466383000370115, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_498_a1173_q0", "video_id": 498, "time_stamp_s": 360, "ground_truth": "B", "raw_output": "B. Green and silver.", "prediction": "B", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "c4a0acd627db46839d91963d5e990c2453a97fb07ead79c72b9637ac94adfb1d", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Green and white race car overtakes blue car on straightaway near pit lane.  \n- Orange car follows closely behind green car, both speeding along the track.  \n- Blue car in garage appears stationary, while other cars race past the pit area.\n[90-120s] - Track times displayed for five racers: #94 Jay (8.267), #35 Ronald (8.348), #39 Michael Rotor (8.416), #5 Eric Braker (8.685), and #90 Paul Conrey (8.760).\n- Standings shown with #94 Jay in 1st place (5 points), #35 Ronald in 2nd (3 points), #24 Chase Racelott in 3rd (2 points), and #28 Tim Treadless in 4th (\n[120-150s] - Standings display shows #94 Jay with 5 points, #35 Ronald with 3, #24 Chase with 2, and #28 Tim with 1.\n- Group 7 - Heat 2 race begins with four cars on a track featuring green grass, trees, and a blue sky backdrop.\n- Cars race along a track with visible sponsor logos, passing a \"TBR\" sign and approaching a pit area with garage doors.\n[150-180s] - Green car overtakes white car on a curved track during instant replay.  \n- Blue car is visible in the background, positioned behind the green and white cars.  \n- Trackside barriers and sponsor signs (e.g., \"TDR\") are visible along the racing lane.\n[180-210s] - Instant replay shows a group of toy cars racing on a curved track with sponsor banners visible.  \n- Standings display: #94 Jay (1st, 7 points), #24 Chase Raccolt (2nd, 7 points), #35 Ronald (3rd, 6 points), #28 Tim Treadless (4th, 2 points).  \n- Group 7 - Heat 3 label appears as cars approach a turn on the track.\n[210-240s] - Green car leads a pack of racing cars on a track with trees and a blue sky backdrop.  \n- White and blue cars follow closely behind, with a white car veering off the track near a sign.  \n- Instant replay overlay appears as cars navigate a turn, with a garage and parked vehicles visible in the background.\n[240-270s] - Cars race along a winding track with visible \"TDR\" and \"TES\" signage on barriers.  \n- A blue and white car overtakes an orange car near a pit lane entrance.  \n- The camera angle shifts to show a tunnel entrance ahead of the racers.\n[270-300s] - Track times leaderboard displayed with #1: #94 Jay (8.267), #2: #35 Ronald (8.348), #3: #39 Michael Rotor (8.416), #4: #28 Tim Treadless (8.417), #5: #24 Chase Raccolt (8.593).\n- Standings leaderboard shown with #1: #94 Jay (10 points), #2: #24 Chase Raccolt (9 points), #3: #28 Tim Treadless (9\n[300-330s] - Standings overlay shows #94 Jay (1) in 1st, #24 Chase Raccolt (1) in 2nd, #28 Tim Treadless (1) in 3rd, and #35 Ronald in 4th, with all tied at 7 points.\n- Group 7 - Heat 4 label appears on the trackside, indicating a specific race segment.\n- A green car speeds past the camera, with a blurred motion effect, suggesting high velocity on the track.\n[330-360s] - A green car overtakes a silver car on a track with a white line marking the boundary.  \n- The silver car is followed closely by an orange car as they race past a pit area with parked vehicles.  \n- A blue car is visible in the background near the pit area, stationary.", "history_tokens": 944, "history_utf8_bytes": 3025, "recent_frame_times_s": [331.0, 332.0, 333.0, 334.0, 335.0, 336.0, 337.0, 338.0, 339.0, 340.0, 341.0, 342.0, 343.0, 344.0, 345.0, 346.0, 347.0, 348.0, 349.0, 350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0], "recent_frames_sha256": "1403d1eca393f0432ba774fb51695969b984b594cc553d796409b31f0a18dd58", "num_recent_frames": 30, "tq": 710529.951303342, "t1": 710536.804283843, "ta": 710536.804283843, "te": 710537.066413937, "first_response_s": 6.852980501018465, "answer_total_s": 7.115110595012084, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 498, "content_group": "a0fdbc3f695b2e5091887eccd8bfc4fa7dbdf25c389374bd7fe7e6c12f84b99b", "question": {"question_id": "sample_498_a1173_q1", "video_id": 498, "video_path": "./videos/sample_498_real.mp4", "annotation_index": 1173, "question_index": 1, "question": "Who is in the first place in the Group 7 - Final standings?", "options": ["A. Tim Treadless.", "B. Chase Racelott.", "C. Ronald.", "D. Jay."], "answer": "D", "time_stamp_s": 379, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [360, 420], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_498_a1173_q1", "video_id": 498, "time_stamp_s": 379, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "000635b48b63fefab3ec91f88ba35566bf609db3777654f9d57a0aca231257cd", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0], "recent_frames_sha256": "be3e45384ff56a38cd62ae0a40cce0d23f09686e22b1aeab0a111468141be7c0", "num_recent_frames": 30, "tq": 710398.60926293, "t1": 710410.533193654, "ta": 710410.533193654, "te": 710410.573817156, "first_response_s": 11.923930724035017, "answer_total_s": 11.964554226025939, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_498_a1173_q1", "video_id": 498, "time_stamp_s": 379, "ground_truth": "D", "raw_output": "D. Jay.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "3b0463ce4befa0e7b7d52bd9113d2194d5782e5fb8704f91bfbdffa3be3a031c", "condition_order": ["recent", "notes"], "memory": "[60-90s] - Green and white race car overtakes blue car on straightaway near pit lane.  \n- Orange car follows closely behind green car, both speeding along the track.  \n- Blue car in garage appears stationary, while other cars race past the pit area.\n[90-120s] - Track times displayed for five racers: #94 Jay (8.267), #35 Ronald (8.348), #39 Michael Rotor (8.416), #5 Eric Braker (8.685), and #90 Paul Conrey (8.760).\n- Standings shown with #94 Jay in 1st place (5 points), #35 Ronald in 2nd (3 points), #24 Chase Racelott in 3rd (2 points), and #28 Tim Treadless in 4th (\n[120-150s] - Standings display shows #94 Jay with 5 points, #35 Ronald with 3, #24 Chase with 2, and #28 Tim with 1.\n- Group 7 - Heat 2 race begins with four cars on a track featuring green grass, trees, and a blue sky backdrop.\n- Cars race along a track with visible sponsor logos, passing a \"TBR\" sign and approaching a pit area with garage doors.\n[150-180s] - Green car overtakes white car on a curved track during instant replay.  \n- Blue car is visible in the background, positioned behind the green and white cars.  \n- Trackside barriers and sponsor signs (e.g., \"TDR\") are visible along the racing lane.\n[180-210s] - Instant replay shows a group of toy cars racing on a curved track with sponsor banners visible.  \n- Standings display: #94 Jay (1st, 7 points), #24 Chase Raccolt (2nd, 7 points), #35 Ronald (3rd, 6 points), #28 Tim Treadless (4th, 2 points).  \n- Group 7 - Heat 3 label appears as cars approach a turn on the track.\n[210-240s] - Green car leads a pack of racing cars on a track with trees and a blue sky backdrop.  \n- White and blue cars follow closely behind, with a white car veering off the track near a sign.  \n- Instant replay overlay appears as cars navigate a turn, with a garage and parked vehicles visible in the background.\n[240-270s] - Cars race along a winding track with visible \"TDR\" and \"TES\" signage on barriers.  \n- A blue and white car overtakes an orange car near a pit lane entrance.  \n- The camera angle shifts to show a tunnel entrance ahead of the racers.\n[270-300s] - Track times leaderboard displayed with #1: #94 Jay (8.267), #2: #35 Ronald (8.348), #3: #39 Michael Rotor (8.416), #4: #28 Tim Treadless (8.417), #5: #24 Chase Raccolt (8.593).\n- Standings leaderboard shown with #1: #94 Jay (10 points), #2: #24 Chase Raccolt (9 points), #3: #28 Tim Treadless (9\n[300-330s] - Standings overlay shows #94 Jay (1) in 1st, #24 Chase Raccolt (1) in 2nd, #28 Tim Treadless (1) in 3rd, and #35 Ronald in 4th, with all tied at 7 points.\n- Group 7 - Heat 4 label appears on the trackside, indicating a specific race segment.\n- A green car speeds past the camera, with a blurred motion effect, suggesting high velocity on the track.\n[330-360s] - A green car overtakes a silver car on a track with a white line marking the boundary.  \n- The silver car is followed closely by an orange car as they race past a pit area with parked vehicles.  \n- A blue car is visible in the background near the pit area, stationary.", "history_tokens": 944, "history_utf8_bytes": 3025, "recent_frame_times_s": [350.0, 351.0, 352.0, 353.0, 354.0, 355.0, 356.0, 357.0, 358.0, 359.0, 360.0, 361.0, 362.0, 363.0, 364.0, 365.0, 366.0, 367.0, 368.0, 369.0, 370.0, 371.0, 372.0, 373.0, 374.0, 375.0, 376.0, 377.0, 378.0, 379.0], "recent_frames_sha256": "be3e45384ff56a38cd62ae0a40cce0d23f09686e22b1aeab0a111468141be7c0", "num_recent_frames": 30, "tq": 710537.122438445, "t1": 710550.624117245, "ta": 710550.624117245, "te": 710550.81844336, "first_response_s": 13.501678799977526, "answer_total_s": 13.696004915051162, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 499, "content_group": "4a812752fbe2104ef3c896ea779108fca9e0f9ca856388efa1417979f76bcfdc", "question": {"question_id": "sample_499_a1277_q0", "video_id": 499, "video_path": "./videos/sample_499_real.mp4", "annotation_index": 1277, "question_index": 0, "question": "What happens right after the train moves out of the tunnel?", "options": ["A. The train stops.", "B. The logo \"Gravity Throttle Racing\" appears.", "C. A red and white boxcar appears.", "D. The steam locomotive number 765 becomes visible."], "answer": "D", "time_stamp_s": 15, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_499_a1277_q0", "video_id": 499, "time_stamp_s": 15, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "cd6cebaec67d319ac71a919178b286466bc7308f2938e569f04728f9acc45141", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001001001001001, 2.002002002002002, 3.003003003003003, 4.004004004004004, 5.005005005005005, 6.006006006006006, 7.007007007007007, 8.008008008008009, 9.00900900900901, 10.01001001001001, 11.01101101101101, 12.012012012012011, 13.013013013013014, 14.014014014014014], "recent_frames_sha256": "40308a21fd9122f8ce3d23171a8a8412ba3275b8b837e43992b59d9bb13cd16f", "num_recent_frames": 15, "tq": 718107.925850506, "t1": 718119.288091172, "ta": 718119.288091172, "te": 718119.325769373, "first_response_s": 11.3622406659415, "answer_total_s": 11.399918866925873, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_499_a1277_q0", "video_id": 499, "time_stamp_s": 15, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "a06b4c38d6da9e3876cc0474390bb4e561e46d2dad621e773b00cc23974dd806", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.001001001001001, 2.002002002002002, 3.003003003003003, 4.004004004004004, 5.005005005005005, 6.006006006006006, 7.007007007007007, 8.008008008008009, 9.00900900900901, 10.01001001001001, 11.01101101101101, 12.012012012012011, 13.013013013013014, 14.014014014014014], "recent_frames_sha256": "40308a21fd9122f8ce3d23171a8a8412ba3275b8b837e43992b59d9bb13cd16f", "num_recent_frames": 15, "tq": 718159.815918359, "t1": 718171.725021004, "ta": 718171.725021004, "te": 718171.951945163, "first_response_s": 11.909102645004168, "answer_total_s": 12.13602680398617, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 499, "content_group": "4a812752fbe2104ef3c896ea779108fca9e0f9ca856388efa1417979f76bcfdc", "question": {"question_id": "sample_499_a1278_q0", "video_id": 499, "video_path": "./videos/sample_499_real.mp4", "annotation_index": 1278, "question_index": 0, "question": "Which car has the fastest time displayed on the leaderboard right now?", "options": ["A. Flip.", "B. BLR.", "C. Jonabi.", "D. Fast Track."], "answer": "B", "time_stamp_s": 146, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_499_a1278_q0", "video_id": 499, "time_stamp_s": 146, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "b79bbf6d85cf1f1a1a3926a398d67fe6b52d520a6599d82b0822b8bb5791a8e8", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [116.01601601601601, 117.00033366700033, 118.00133466800133, 119.00233566900233, 120.00333667000334, 121.00433767100434, 122.00533867200534, 123.00633967300634, 124.00734067400734, 125.00834167500834, 126.00934267600934, 127.01034367701034, 128.01134467801134, 129.01234567901236, 130.01334668001334, 131.01434768101436, 132.01534868201534, 133.01634968301636, 134.00066733400067, 135.00166833500168, 136.00266933600267, 137.00367033700368, 138.00467133800467, 139.00567233900568, 140.00667334000667, 141.0076743410077, 142.00867534200867, 143.0096763430097, 144.01067734401067, 145.0116783450117], "recent_frames_sha256": "351c2774aef494c23711229c2894141c6d9517ac2f9697d864d5b719fadebb1c", "num_recent_frames": 30, "tq": 718119.33804022, "t1": 718133.356903115, "ta": 718133.356903115, "te": 718133.395226514, "first_response_s": 14.018862895085476, "answer_total_s": 14.057186293997802, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_499_a1278_q0", "video_id": 499, "time_stamp_s": 146, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "8c7e9bc61ec7eebd48c29fc4bab0cf1f34b290ae3d1f75bc00188bf1d70e907c", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A red vintage car is parked beside a railway track near a tunnel entrance, with a black steam locomotive emerging from the tunnel.  \n- Three miniature figures in white uniforms stand in front of a blurred gas station, with the \"ESSEX\" sign visible in the background.  \n- A model train with \"SOO LINE\" branding and \"Viking\" logos passes by, moving along the tracks adjacent to the red car.\n[30-60s] - Race 1 leaderboard shows drivers like Champagne Papi, Fat Dad, and Numbskull with their respective times and team affiliations.\n- Snow-covered track features multiple toy cars racing along winding paths, with a green car leading the pack.\n- A black car overtakes an orange car near the center of the track, indicating dynamic movement and competition.\n[60-90s] - A blue car drives along a paved road near a digital sign displaying \"SPEED LIMIT 60\" and \"SPEED 60\" with a \"REPLAY\" logo.\n- A red car is seen on a winding mountain road, passing by snow-capped peaks and pine trees.\n- A train with \"Soo Line\" branding travels on a track adjacent to a road, passing a sign with a \"Soo Line\" logo.\n[90-120s] - Blue car navigates a winding road near a tunnel, passing a yellow truck and another blue car.  \n- Yellow trucks maneuver around a large rock formation, with one approaching a tunnel entrance.  \n- A black car and a red car follow behind the yellow trucks, all moving along the same curved road.", "history_tokens": 344, "history_utf8_bytes": 1406, "recent_frame_times_s": [116.01601601601601, 117.00033366700033, 118.00133466800133, 119.00233566900233, 120.00333667000334, 121.00433767100434, 122.00533867200534, 123.00633967300634, 124.00734067400734, 125.00834167500834, 126.00934267600934, 127.01034367701034, 128.01134467801134, 129.01234567901236, 130.01334668001334, 131.01434768101436, 132.01534868201534, 133.01634968301636, 134.00066733400067, 135.00166833500168, 136.00266933600267, 137.00367033700368, 138.00467133800467, 139.00567233900568, 140.00667334000667, 141.0076743410077, 142.00867534200867, 143.0096763430097, 144.01067734401067, 145.0116783450117], "recent_frames_sha256": "351c2774aef494c23711229c2894141c6d9517ac2f9697d864d5b719fadebb1c", "num_recent_frames": 30, "tq": 718207.323504021, "t1": 718210.288159411, "ta": 718210.288159411, "te": 718210.329516989, "first_response_s": 2.964655390009284, "answer_total_s": 3.0060129679040983, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 499, "content_group": "4a812752fbe2104ef3c896ea779108fca9e0f9ca856388efa1417979f76bcfdc", "question": {"question_id": "sample_499_a1278_q1", "video_id": 499, "video_path": "./videos/sample_499_real.mp4", "annotation_index": 1278, "question_index": 1, "question": "Which of the following names is not listed as a contender in \"RACE 2\"?", "options": ["A. Fat Dad.", "B. Numbskull.", "C. Iceman.", "D. Flip."], "answer": "D", "time_stamp_s": 152, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [120, 180], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_499_a1278_q1", "video_id": 499, "time_stamp_s": 152, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "c8e07b8b1dd7a0486cfdadb0281c469d504220b67c24bfeb5d3d1c1a771ee356", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [122.00533867200534, 123.00633967300634, 124.00734067400734, 125.00834167500834, 126.00934267600934, 127.01034367701034, 128.01134467801134, 129.01234567901236, 130.01334668001334, 131.01434768101436, 132.01534868201534, 133.01634968301636, 134.00066733400067, 135.00166833500168, 136.00266933600267, 137.00367033700368, 138.00467133800467, 139.00567233900568, 140.00667334000667, 141.0076743410077, 142.00867534200867, 143.0096763430097, 144.01067734401067, 145.0116783450117, 146.01267934601267, 147.0136803470137, 148.01468134801468, 149.0156823490157, 150.0, 151.00100100100101], "recent_frames_sha256": "3290f7910a6d9a59213e34c90b80d7a82d4358fc1aecf90e6af4bd8859e7580b", "num_recent_frames": 30, "tq": 718133.407454356, "t1": 718143.929230778, "ta": 718143.929230778, "te": 718143.968393106, "first_response_s": 10.521776422043331, "answer_total_s": 10.560938750044443, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_499_a1278_q1", "video_id": 499, "time_stamp_s": 152, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "3296c4574d80ff61412b5ea44d429a5cd34943638f9b7e264ddc14d7b8998175", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A red vintage car is parked beside a railway track near a tunnel entrance, with a black steam locomotive emerging from the tunnel.  \n- Three miniature figures in white uniforms stand in front of a blurred gas station, with the \"ESSEX\" sign visible in the background.  \n- A model train with \"SOO LINE\" branding and \"Viking\" logos passes by, moving along the tracks adjacent to the red car.\n[30-60s] - Race 1 leaderboard shows drivers like Champagne Papi, Fat Dad, and Numbskull with their respective times and team affiliations.\n- Snow-covered track features multiple toy cars racing along winding paths, with a green car leading the pack.\n- A black car overtakes an orange car near the center of the track, indicating dynamic movement and competition.\n[60-90s] - A blue car drives along a paved road near a digital sign displaying \"SPEED LIMIT 60\" and \"SPEED 60\" with a \"REPLAY\" logo.\n- A red car is seen on a winding mountain road, passing by snow-capped peaks and pine trees.\n- A train with \"Soo Line\" branding travels on a track adjacent to a road, passing a sign with a \"Soo Line\" logo.\n[90-120s] - Blue car navigates a winding road near a tunnel, passing a yellow truck and another blue car.  \n- Yellow trucks maneuver around a large rock formation, with one approaching a tunnel entrance.  \n- A black car and a red car follow behind the yellow trucks, all moving along the same curved road.\n[120-150s] - A leaderboard displays race results for \"ULTIMATE EVO-STAGE 2\" with drivers like Champagne Papi, Iceman, and Fat Dad, showing their lap times and totals.\n- A blue car is shown on a track with a digital timer reading \"00:22:35\" as it approaches a sign that says \"YOU TRACKED\".\n- A \"SHAVANO MOUNTAIN RACEWAY\" graphic shows three cars (BLR, Flip, Jonabi) with their lap times, indicating a \"FAST TRACK!\" segment.", "history_tokens": 468, "history_utf8_bytes": 1829, "recent_frame_times_s": [122.00533867200534, 123.00633967300634, 124.00734067400734, 125.00834167500834, 126.00934267600934, 127.01034367701034, 128.01134467801134, 129.01234567901236, 130.01334668001334, 131.01434768101436, 132.01534868201534, 133.01634968301636, 134.00066733400067, 135.00166833500168, 136.00266933600267, 137.00367033700368, 138.00467133800467, 139.00567233900568, 140.00667334000667, 141.0076743410077, 142.00867534200867, 143.0096763430097, 144.01067734401067, 145.0116783450117, 146.01267934601267, 147.0136803470137, 148.01468134801468, 149.0156823490157, 150.0, 151.00100100100101], "recent_frames_sha256": "3290f7910a6d9a59213e34c90b80d7a82d4358fc1aecf90e6af4bd8859e7580b", "num_recent_frames": 30, "tq": 718216.316925122, "t1": 718218.78657583, "ta": 718218.78657583, "te": 718218.826176454, "first_response_s": 2.469650707906112, "answer_total_s": 2.509251331910491, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 499, "content_group": "4a812752fbe2104ef3c896ea779108fca9e0f9ca856388efa1417979f76bcfdc", "question": {"question_id": "sample_499_a1279_q0", "video_id": 499, "video_path": "./videos/sample_499_real.mp4", "annotation_index": 1279, "question_index": 0, "question": "Which car won first place in this competition?", "options": ["A. The blue car.", "B. The dark purple car.", "C. The white car with red decorations on it.", "D. The red car."], "answer": "C", "time_stamp_s": 291, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [240, 300], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_499_a1279_q0", "video_id": 499, "time_stamp_s": 291, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "ead30fc50e3f0afce37a34f93bcd32570459422388d997156b0b7ef941263bfd", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [261.011011011011, 262.012012012012, 263.013013013013, 264.01401401401404, 265.015015015015, 266.016016016016, 267.00033366700035, 268.00133466800133, 269.0023356690023, 270.00333667000336, 271.00433767100435, 272.00533867200534, 273.0063396730063, 274.00734067400737, 275.00834167500835, 276.00934267600934, 277.0103436770103, 278.01134467801137, 279.01234567901236, 280.01334668001334, 281.0143476810143, 282.0153486820154, 283.01634968301636, 284.0006673340007, 285.0016683350017, 286.00266933600267, 287.00367033700365, 288.0046713380047, 289.0056723390057, 290.00667334000667], "recent_frames_sha256": "d64790deb1d77d08c808da037ab134d15abf2432ef291eb41a9d5ed9a7881312", "num_recent_frames": 30, "tq": 718143.981966499, "t1": 718151.897138074, "ta": 718151.897138074, "te": 718151.93624282, "first_response_s": 7.915171575034037, "answer_total_s": 7.954276320990175, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_499_a1279_q0", "video_id": 499, "time_stamp_s": 291, "ground_truth": "C", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "f1e751bfae571b93dc35e0c64ac089e31d05caf3d927c2df98e87fa6e9ff5dfe", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A red vintage car is parked beside a railway track near a tunnel entrance, with a black steam locomotive emerging from the tunnel.  \n- Three miniature figures in white uniforms stand in front of a blurred gas station, with the \"ESSEX\" sign visible in the background.  \n- A model train with \"SOO LINE\" branding and \"Viking\" logos passes by, moving along the tracks adjacent to the red car.\n[30-60s] - Race 1 leaderboard shows drivers like Champagne Papi, Fat Dad, and Numbskull with their respective times and team affiliations.\n- Snow-covered track features multiple toy cars racing along winding paths, with a green car leading the pack.\n- A black car overtakes an orange car near the center of the track, indicating dynamic movement and competition.\n[60-90s] - A blue car drives along a paved road near a digital sign displaying \"SPEED LIMIT 60\" and \"SPEED 60\" with a \"REPLAY\" logo.\n- A red car is seen on a winding mountain road, passing by snow-capped peaks and pine trees.\n- A train with \"Soo Line\" branding travels on a track adjacent to a road, passing a sign with a \"Soo Line\" logo.\n[90-120s] - Blue car navigates a winding road near a tunnel, passing a yellow truck and another blue car.  \n- Yellow trucks maneuver around a large rock formation, with one approaching a tunnel entrance.  \n- A black car and a red car follow behind the yellow trucks, all moving along the same curved road.\n[120-150s] - A leaderboard displays race results for \"ULTIMATE EVO-STAGE 2\" with drivers like Champagne Papi, Iceman, and Fat Dad, showing their lap times and totals.\n- A blue car is shown on a track with a digital timer reading \"00:22:35\" as it approaches a sign that says \"YOU TRACKED\".\n- A \"SHAVANO MOUNTAIN RACEWAY\" graphic shows three cars (BLR, Flip, Jonabi) with their lap times, indicating a \"FAST TRACK!\" segment.\n[150-180s] - A red car races along a winding road, overtaking a black car and a blue car in a snowy landscape.  \n- A train with \"Soo Mine\" branding travels parallel to the road, passing under a bridge.  \n- A digital timer labeled \"Soo TRACKING\" is visible near a concrete path, indicating race timing.\n[180-210s] - A digital scoreboard displays \"Driver\" and \"Team\" columns with names like \"Hogan\" and \"Keanan Racing\" alongside race positions and times.\n- A red car and a white car race on a winding road, with a yellow car and a blue car also visible on the track.\n- The scene transitions to a wider view of a complex road network with multiple vehicles, including trucks and a plane, navigating through a desert-like landscape.\n[210-240s] - Scoreboard displays \"ULTIMATE EVO - STAGE 2\" with driver/team stats for Blue Line Racing, Iceman, Numbskull, and Fat Dad.\n- Race 3 setup shows four toy cars (orange, black, blue, silver) lined up on a snowy track with a blue wall backdrop.\n- Camera pans to reveal a wider view of the snowy track with multiple curves, trees, and a distant mountainous landscape.\n[240-270s] - A blue car drives along a paved road near a \"SPEED LIMIT\" sign with a digital display showing \"00:00:00\".\n- A red car and a black car race on a winding mountain road, with a \"REPLAY\" graphic overlay.\n- A train with red and silver cars travels on tracks alongside a highway, passing under an overpass.", "history_tokens": 837, "history_utf8_bytes": 3247, "recent_frame_times_s": [261.011011011011, 262.012012012012, 263.013013013013, 264.01401401401404, 265.015015015015, 266.016016016016, 267.00033366700035, 268.00133466800133, 269.0023356690023, 270.00333667000336, 271.00433767100435, 272.00533867200534, 273.0063396730063, 274.00734067400737, 275.00834167500835, 276.00934267600934, 277.0103436770103, 278.01134467801137, 279.01234567901236, 280.01334668001334, 281.0143476810143, 282.0153486820154, 283.01634968301636, 284.0006673340007, 285.0016683350017, 286.00266933600267, 287.00367033700365, 288.0046713380047, 289.0056723390057, 290.00667334000667], "recent_frames_sha256": "d64790deb1d77d08c808da037ab134d15abf2432ef291eb41a9d5ed9a7881312", "num_recent_frames": 30, "tq": 718256.807982843, "t1": 718264.409278805, "ta": 718264.409278805, "te": 718264.675837087, "first_response_s": 7.601295961998403, "answer_total_s": 7.8678542439593, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 499, "content_group": "4a812752fbe2104ef3c896ea779108fca9e0f9ca856388efa1417979f76bcfdc", "question": {"question_id": "sample_499_a1280_q0", "video_id": 499, "video_path": "./videos/sample_499_real.mp4", "annotation_index": 1280, "question_index": 0, "question": "How many different racing teams' names are displayed on the scoreboard?", "options": ["A. Three.", "B. Four.", "C. Five.", "D. Six."], "answer": "B", "time_stamp_s": 431, "task_type": "Counting", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [420, 480], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_499_a1280_q0", "video_id": 499, "time_stamp_s": 431, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1f20423cae6819e176053d9d35d42e60371ca2b69c1a60c7d3e13e370fea144d", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [401.001001001001, 402.00200200200203, 403.003003003003, 404.004004004004, 405.005005005005, 406.00600600600603, 407.007007007007, 408.008008008008, 409.009009009009, 410.01001001001003, 411.011011011011, 412.012012012012, 413.013013013013, 414.01401401401404, 415.015015015015, 416.016016016016, 417.00033366700035, 418.00133466800133, 419.0023356690023, 420.00333667000336, 421.00433767100435, 422.00533867200534, 423.0063396730063, 424.00734067400737, 425.00834167500835, 426.00934267600934, 427.0103436770103, 428.01134467801137, 429.01234567901236, 430.01334668001334], "recent_frames_sha256": "25d9aa24c94510ff38e5a68db4a9c00c05f4a71a5d611bba69a392e1d5bdcb76", "num_recent_frames": 30, "tq": 718151.948726612, "t1": 718159.759847457, "ta": 718159.759847457, "te": 718159.797575703, "first_response_s": 7.811120845028199, "answer_total_s": 7.848849090980366, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_499_a1280_q0", "video_id": 499, "time_stamp_s": 431, "ground_truth": "B", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "960020f2a90edccb2c95a6e88f4c3c187ad312e7254557b8cae50af83dbb93d6", "condition_order": ["recent", "notes"], "memory": "[90-120s] - Blue car navigates a winding road near a tunnel, passing a yellow truck and another blue car.  \n- Yellow trucks maneuver around a large rock formation, with one approaching a tunnel entrance.  \n- A black car and a red car follow behind the yellow trucks, all moving along the same curved road.\n[120-150s] - A leaderboard displays race results for \"ULTIMATE EVO-STAGE 2\" with drivers like Champagne Papi, Iceman, and Fat Dad, showing their lap times and totals.\n- A blue car is shown on a track with a digital timer reading \"00:22:35\" as it approaches a sign that says \"YOU TRACKED\".\n- A \"SHAVANO MOUNTAIN RACEWAY\" graphic shows three cars (BLR, Flip, Jonabi) with their lap times, indicating a \"FAST TRACK!\" segment.\n[150-180s] - A red car races along a winding road, overtaking a black car and a blue car in a snowy landscape.  \n- A train with \"Soo Mine\" branding travels parallel to the road, passing under a bridge.  \n- A digital timer labeled \"Soo TRACKING\" is visible near a concrete path, indicating race timing.\n[180-210s] - A digital scoreboard displays \"Driver\" and \"Team\" columns with names like \"Hogan\" and \"Keanan Racing\" alongside race positions and times.\n- A red car and a white car race on a winding road, with a yellow car and a blue car also visible on the track.\n- The scene transitions to a wider view of a complex road network with multiple vehicles, including trucks and a plane, navigating through a desert-like landscape.\n[210-240s] - Scoreboard displays \"ULTIMATE EVO - STAGE 2\" with driver/team stats for Blue Line Racing, Iceman, Numbskull, and Fat Dad.\n- Race 3 setup shows four toy cars (orange, black, blue, silver) lined up on a snowy track with a blue wall backdrop.\n- Camera pans to reveal a wider view of the snowy track with multiple curves, trees, and a distant mountainous landscape.\n[240-270s] - A blue car drives along a paved road near a \"SPEED LIMIT\" sign with a digital display showing \"00:00:00\".\n- A red car and a black car race on a winding mountain road, with a \"REPLAY\" graphic overlay.\n- A train with red and silver cars travels on tracks alongside a highway, passing under an overpass.\n[270-300s] - Orange car speeds along a desert road, passing other miniature vehicles.  \n- Blue car navigates a paved path near a water body, with a digital timer visible.  \n- Race leaderboard shows driver scores for \"Ultimate EVO Stage 2,\" including \"Champagne Papi\" and \"Fat Dad.\"\n[300-330s] - Orange car leads a line of three cars (black, blue, silver) navigating a snowy track toward a bridge.  \n- A train with \"SOUTHLAND\" and \"SANTA FE\" branding passes on parallel tracks near the cars.  \n- The scene transitions to a desert landscape with winding roads, rock formations, and a tunnel as the cars continue their journey.\n[330-360s] - A red car navigates a winding desert track, passing a large rock formation and a tunnel entrance.  \n- A train with multiple freight cars (including a white and a red container) travels along parallel tracks near the road.  \n- A blue car overtakes a black car on a curving road, with a \"REPLAY\" graphic appearing in the corner.\n[360-390s] - Four toy cars (black, blue, silver, orange) start a race on a snowy track with a green train passing nearby.  \n- The scene transitions to a desert racetrack with a blue car navigating curves, passing a red-and-white barrier.  \n- A train with \"SODA\" and \"MINE\" signs travels along a separate track adjacent to the road, with a \"500\" sign visible.\n[390-420s] - A blue car speeds along a desert-themed track, passing a digital timer displaying \"0:00\" and \"REAL TIME TRACKING\" text.\n- The track features a curved path with sparse vegetation and a large sign with a circular logo above the timer.\n- The scene transitions to a wider view showing multiple cars navigating a winding mountain road with snow-capped peaks and a train crossing overhead.", "history_tokens": 996, "history_utf8_bytes": 3867, "recent_frame_times_s": [401.001001001001, 402.00200200200203, 403.003003003003, 404.004004004004, 405.005005005005, 406.00600600600603, 407.007007007007, 408.008008008008, 409.009009009009, 410.01001001001003, 411.011011011011, 412.012012012012, 413.013013013013, 414.01401401401404, 415.015015015015, 416.016016016016, 417.00033366700035, 418.00133466800133, 419.0023356690023, 420.00333667000336, 421.00433767100435, 422.00533867200534, 423.0063396730063, 424.00734067400737, 425.00834167500835, 426.00934267600934, 427.0103436770103, 428.01134467801137, 429.01234567901236, 430.01334668001334], "recent_frames_sha256": "25d9aa24c94510ff38e5a68db4a9c00c05f4a71a5d611bba69a392e1d5bdcb76", "num_recent_frames": 30, "tq": 718297.211357053, "t1": 718298.793441624, "ta": 718298.793441624, "te": 718298.945733494, "first_response_s": 1.5820845710113645, "answer_total_s": 1.7343764409888536, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 500, "content_group": "4926ceeecef87ea713da6f0a62cafb635afa1d3b4c5c3f4f1cd168aa96219117", "question": {"question_id": "sample_500_a287_q0", "video_id": 500, "video_path": "./videos/sample_500_real.mp4", "annotation_index": 287, "question_index": 0, "question": "What does the additional text indicate about the \"3D BotMaker Diecast Racing League\"?", "options": ["A. It is the \"Final Race\".", "B. It is the \"Fiero Tournament, Race 1 of 3\".", "C. It is the \"Champion's Cup\".", "D. It is the \"Qualifying Round\"."], "answer": "B", "time_stamp_s": 10, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [0, 60], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_500_a287_q0", "video_id": 500, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "e9e4d3fc68da74075c131637ae0bed088aa3014a926996cbf52c037ce54a8f56", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "8d37d2a7011d6a98a2cc946a6ea8af9d5cbe5777c05011189fd1dd43fd04456c", "num_recent_frames": 11, "tq": 717826.110951827, "t1": 717861.655079343, "ta": 717861.655079343, "te": 717861.841581743, "first_response_s": 35.54412751598284, "answer_total_s": 35.730629915953614, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_500_a287_q0", "video_id": 500, "time_stamp_s": 10, "ground_truth": "B", "raw_output": "B", "prediction": "B", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "19c1c53958dc15215101ce68f3bb5f026377955aa86c3cd0f7c196f715f7af60", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [0.0, 1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0, 8.0, 9.0, 10.0], "recent_frames_sha256": "8d37d2a7011d6a98a2cc946a6ea8af9d5cbe5777c05011189fd1dd43fd04456c", "num_recent_frames": 11, "tq": 717890.350353622, "t1": 717892.003292199, "ta": 717892.003292199, "te": 717892.20161401, "first_response_s": 1.6529385769972578, "answer_total_s": 1.8512603880371898, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 500, "content_group": "4926ceeecef87ea713da6f0a62cafb635afa1d3b4c5c3f4f1cd168aa96219117", "question": {"question_id": "sample_500_a288_q0", "video_id": 500, "video_path": "./videos/sample_500_real.mp4", "annotation_index": 288, "question_index": 0, "question": "Which car is leading right now?", "options": ["A. Black car.", "B. Red car.", "C. Yello car.", "D. Green car."], "answer": "C", "time_stamp_s": 103, "task_type": "Event Understanding", "required_ability": "episodic memory", "video_category": "rc_model_competition", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_500_a288_q0", "video_id": 500, "time_stamp_s": 103, "ground_truth": "C", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "3fe71536bcf572eb9644b23808fab756e501a14a62bcaacf3eb2adfc73350c71", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0], "recent_frames_sha256": "3953cf0c7b4e43b87339facf17f13a2f30c18b0ad1e4301102a48a9834cbd9b2", "num_recent_frames": 30, "tq": 717861.862369193, "t1": 717870.162362062, "ta": 717870.162362062, "te": 717870.393729626, "first_response_s": 8.299992869026028, "answer_total_s": 8.531360432971269, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_500_a288_q0", "video_id": 500, "time_stamp_s": 103, "ground_truth": "C", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "13c364d2f6637f146b8f07248b50a7676036dbe712d94b365d97d5b12ed33fec", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A miniature race track with toy cars speeds past, flanked by grassy hills and a large metal archway at the end.  \n- A pit area with various vehicles, trailers, and miniature figures is shown, including a watchtower with two figures inside.  \n- The camera pans to reveal a detailed miniature landscape with trees, a watchtower, and spectators gathered near portable toilets and a camera rig.\n[30-60s] - A blue truck with a trailer is parked behind a green dumpster, positioned between two rows of cars.  \n- The camera pans right, revealing a red car with \"24\" on its hood, followed by a silver car with \"23\" and a black car with \"22\" parked in adjacent spots.  \n- A green car with a yellow roof is parked in the center, slightly ahead of the red car, with a silver car to its right.\n[60-90s] - A red toy car with \"CRAZY JIMMY\" text is parked in a lot, positioned next to a yellow car.  \n- A green toy car labeled \"RAD CUNNINGHAM\" is parked beside an orange car, both aligned in a row.  \n- The cars are stationary, with no visible movement or interaction between them.", "history_tokens": 271, "history_utf8_bytes": 1076, "recent_frame_times_s": [74.0, 75.0, 76.0, 77.0, 78.0, 79.0, 80.0, 81.0, 82.0, 83.0, 84.0, 85.0, 86.0, 87.0, 88.0, 89.0, 90.0, 91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0], "recent_frames_sha256": "3953cf0c7b4e43b87339facf17f13a2f30c18b0ad1e4301102a48a9834cbd9b2", "num_recent_frames": 30, "tq": 717915.23083409, "t1": 717926.316939172, "ta": 717926.316939172, "te": 717926.585516188, "first_response_s": 11.086105081951246, "answer_total_s": 11.354682097909972, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 500, "content_group": "4926ceeecef87ea713da6f0a62cafb635afa1d3b4c5c3f4f1cd168aa96219117", "question": {"question_id": "sample_500_a288_q1", "video_id": 500, "video_path": "./videos/sample_500_real.mp4", "annotation_index": 288, "question_index": 1, "question": "According to the race results displayed at the end, who is the driver of the red car?", "options": ["A. George Milidrag.", "B. Randy Ferrero.", "C. Crazy Jimmy.", "D. Rad Cunningham."], "answer": "B", "time_stamp_s": 120, "task_type": "Text-Rich Understanding", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [60, 120], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_500_a288_q1", "video_id": 500, "time_stamp_s": 120, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "daccb2c8cb6fd45ce2176c2d5a19a0aa865dfa9f81416a80e5d63b4bba5efa66", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0], "recent_frames_sha256": "f369cffbbecfb0c75fdee2e628177eb9bd43e761eb9d1136fa812ca77bf3b5a2", "num_recent_frames": 30, "tq": 717870.414269442, "t1": 717877.12159255, "ta": 717877.12159255, "te": 717877.159753538, "first_response_s": 6.707323107984848, "answer_total_s": 6.745484095998108, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_500_a288_q1", "video_id": 500, "time_stamp_s": 120, "ground_truth": "B", "raw_output": "C", "prediction": "C", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "6461ebe2922ffd9a2e7e638c5c6fa49cca7b060a2ca9e98a8d200afd18abbfb3", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A miniature race track with toy cars speeds past, flanked by grassy hills and a large metal archway at the end.  \n- A pit area with various vehicles, trailers, and miniature figures is shown, including a watchtower with two figures inside.  \n- The camera pans to reveal a detailed miniature landscape with trees, a watchtower, and spectators gathered near portable toilets and a camera rig.\n[30-60s] - A blue truck with a trailer is parked behind a green dumpster, positioned between two rows of cars.  \n- The camera pans right, revealing a red car with \"24\" on its hood, followed by a silver car with \"23\" and a black car with \"22\" parked in adjacent spots.  \n- A green car with a yellow roof is parked in the center, slightly ahead of the red car, with a silver car to its right.\n[60-90s] - A red toy car with \"CRAZY JIMMY\" text is parked in a lot, positioned next to a yellow car.  \n- A green toy car labeled \"RAD CUNNINGHAM\" is parked beside an orange car, both aligned in a row.  \n- The cars are stationary, with no visible movement or interaction between them.\n[90-120s] - Four brightly colored toy cars (yellow, red, orange, green) race on a miniature track, passing under a red-lit archway at 0:90, then a green-lit archway at 0:97.\n- The camera pans to reveal a wider track with multiple cars, including a white van and a blue car, navigating a curved section with red-and-white curbing at 0:99.\n- At 0:115, a digital timer displays \"TIME: 17.2262\" as an orange car speeds down a straight track, with a \"MODEL", "history_tokens": 408, "history_utf8_bytes": 1528, "recent_frame_times_s": [91.0, 92.0, 93.0, 94.0, 95.0, 96.0, 97.0, 98.0, 99.0, 100.0, 101.0, 102.0, 103.0, 104.0, 105.0, 106.0, 107.0, 108.0, 109.0, 110.0, 111.0, 112.0, 113.0, 114.0, 115.0, 116.0, 117.0, 118.0, 119.0, 120.0], "recent_frames_sha256": "f369cffbbecfb0c75fdee2e628177eb9bd43e761eb9d1136fa812ca77bf3b5a2", "num_recent_frames": 30, "tq": 717938.953691593, "t1": 717940.798892206, "ta": 717940.798892206, "te": 717941.044356915, "first_response_s": 1.8452006130246446, "answer_total_s": 2.090665322029963, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 500, "content_group": "4926ceeecef87ea713da6f0a62cafb635afa1d3b4c5c3f4f1cd168aa96219117", "question": {"question_id": "sample_500_a289_q0", "video_id": 500, "video_path": "./videos/sample_500_real.mp4", "annotation_index": 289, "question_index": 0, "question": "What colors are the four model cars lined up at the starting line?", "options": ["A. Blue, yellow, green, red.", "B. Red, blue, orange, green.", "C. Green, yellow, orange, blue.", "D. Red, green, orange, yellow."], "answer": "D", "time_stamp_s": 215, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [180, 240], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_500_a289_q0", "video_id": 500, "time_stamp_s": 215, "ground_truth": "D", "raw_output": "D", "prediction": "D", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 1, "generation_id": "1222418cbb8cf786e0d0c34bbdae5899f674b36f7ac0fe31c428d1dd57bbe860", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0], "recent_frames_sha256": "8b2cc10a01138d19b5d1290d459e77d4f3da741aad7990311458ce4d631edae2", "num_recent_frames": 30, "tq": 717877.178066171, "t1": 717883.465420767, "ta": 717883.465420767, "te": 717883.504823025, "first_response_s": 6.2873545959591866, "answer_total_s": 6.326756853959523, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_500_a289_q0", "video_id": 500, "time_stamp_s": 215, "ground_truth": "D", "raw_output": "D. Red, green, orange, yellow.", "prediction": "D", "status": "ok", "format": "explicit_option_prefix", "strict_format_valid": false, "correct": 1, "generation_id": "60ee5a669e39877fabb6546e6e69af836c90e0f5396e446b701ace9ad1463943", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A miniature race track with toy cars speeds past, flanked by grassy hills and a large metal archway at the end.  \n- A pit area with various vehicles, trailers, and miniature figures is shown, including a watchtower with two figures inside.  \n- The camera pans to reveal a detailed miniature landscape with trees, a watchtower, and spectators gathered near portable toilets and a camera rig.\n[30-60s] - A blue truck with a trailer is parked behind a green dumpster, positioned between two rows of cars.  \n- The camera pans right, revealing a red car with \"24\" on its hood, followed by a silver car with \"23\" and a black car with \"22\" parked in adjacent spots.  \n- A green car with a yellow roof is parked in the center, slightly ahead of the red car, with a silver car to its right.\n[60-90s] - A red toy car with \"CRAZY JIMMY\" text is parked in a lot, positioned next to a yellow car.  \n- A green toy car labeled \"RAD CUNNINGHAM\" is parked beside an orange car, both aligned in a row.  \n- The cars are stationary, with no visible movement or interaction between them.\n[90-120s] - Four brightly colored toy cars (yellow, red, orange, green) race on a miniature track, passing under a red-lit archway at 0:90, then a green-lit archway at 0:97.\n- The camera pans to reveal a wider track with multiple cars, including a white van and a blue car, navigating a curved section with red-and-white curbing at 0:99.\n- At 0:115, a digital timer displays \"TIME: 17.2262\" as an orange car speeds down a straight track, with a \"MODEL\n[120-150s] - Green car overtakes orange car on straight track segment.  \n- Yellow car leads pack as it approaches finish line arch.  \n- Red car trails behind, positioned near the rear of the group.\n[150-180s] - A yellow car leads a group of colorful toy cars navigating a winding track with green hills and trees.  \n- At 167 seconds, a digital scoreboard shows \"TIME: 17.7623\" and \"1234 100000000000000000000000000000000000000000000000000000000000000000000000000\n[180-210s] - Yellow car leads a pack of colorful model cars navigating a winding track with red-and-white curbing.  \n- A group of model spectators and vendor stalls appear along the track’s edge, with a large \"DIORAMA & FIGURES\" sign visible.  \n- The camera pans to show a detailed miniature landscape with trees, hills, and a small building near the track’s end.", "history_tokens": 686, "history_utf8_bytes": 2359, "recent_frame_times_s": [186.0, 187.0, 188.0, 189.0, 190.0, 191.0, 192.0, 193.0, 194.0, 195.0, 196.0, 197.0, 198.0, 199.0, 200.0, 201.0, 202.0, 203.0, 204.0, 205.0, 206.0, 207.0, 208.0, 209.0, 210.0, 211.0, 212.0, 213.0, 214.0, 215.0], "recent_frames_sha256": "8b2cc10a01138d19b5d1290d459e77d4f3da741aad7990311458ce4d631edae2", "num_recent_frames": 30, "tq": 717970.483466367, "t1": 717979.032945268, "ta": 717979.032945268, "te": 717979.436060009, "first_response_s": 8.549478900968097, "answer_total_s": 8.95259364193771, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}
{"video_id": 500, "content_group": "4926ceeecef87ea713da6f0a62cafb635afa1d3b4c5c3f4f1cd168aa96219117", "question": {"question_id": "sample_500_a290_q0", "video_id": 500, "video_path": "./videos/sample_500_real.mp4", "annotation_index": 290, "question_index": 0, "question": "What design is on the red car parked next to the yellow car right now?", "options": ["A. Flames.", "B. Stripes.", "C. Checkerboard.", "D. American flag."], "answer": "D", "time_stamp_s": 298, "task_type": "Attribute Recognition", "required_ability": "working memory", "video_category": "rc_model_competition", "reference_interval_s": [300, 347], "split": "test"}, "recent": {"method": "recent", "question_id": "sample_500_a290_q0", "video_id": 500, "time_stamp_s": 298, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "1848f6b9e74fa7f2f853236ea75bb262b38015a7cc7fab973e280d437063be10", "condition_order": ["recent", "notes"], "memory": "", "history_tokens": 0, "history_utf8_bytes": 0, "recent_frame_times_s": [269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0], "recent_frames_sha256": "f4ffaa9ed501f26a69b8554a9befe7c4660afd6b944e02bea9a1f8d04363fcf9", "num_recent_frames": 30, "tq": 717883.53407862, "t1": 717890.291748168, "ta": 717890.291748168, "te": 717890.329085743, "first_response_s": 6.757669547921978, "answer_total_s": 6.795007123029791, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}, "notes": {"method": "notes", "question_id": "sample_500_a290_q0", "video_id": 500, "time_stamp_s": 298, "ground_truth": "D", "raw_output": "A", "prediction": "A", "status": "ok", "format": "single_letter", "strict_format_valid": true, "correct": 0, "generation_id": "8cabc7c33f3109576df03eb4762584dd96fa9f354bf094e6a22f9e612bd1fc79", "condition_order": ["recent", "notes"], "memory": "[0-30s] - A miniature race track with toy cars speeds past, flanked by grassy hills and a large metal archway at the end.  \n- A pit area with various vehicles, trailers, and miniature figures is shown, including a watchtower with two figures inside.  \n- The camera pans to reveal a detailed miniature landscape with trees, a watchtower, and spectators gathered near portable toilets and a camera rig.\n[30-60s] - A blue truck with a trailer is parked behind a green dumpster, positioned between two rows of cars.  \n- The camera pans right, revealing a red car with \"24\" on its hood, followed by a silver car with \"23\" and a black car with \"22\" parked in adjacent spots.  \n- A green car with a yellow roof is parked in the center, slightly ahead of the red car, with a silver car to its right.\n[60-90s] - A red toy car with \"CRAZY JIMMY\" text is parked in a lot, positioned next to a yellow car.  \n- A green toy car labeled \"RAD CUNNINGHAM\" is parked beside an orange car, both aligned in a row.  \n- The cars are stationary, with no visible movement or interaction between them.\n[90-120s] - Four brightly colored toy cars (yellow, red, orange, green) race on a miniature track, passing under a red-lit archway at 0:90, then a green-lit archway at 0:97.\n- The camera pans to reveal a wider track with multiple cars, including a white van and a blue car, navigating a curved section with red-and-white curbing at 0:99.\n- At 0:115, a digital timer displays \"TIME: 17.2262\" as an orange car speeds down a straight track, with a \"MODEL\n[120-150s] - Green car overtakes orange car on straight track segment.  \n- Yellow car leads pack as it approaches finish line arch.  \n- Red car trails behind, positioned near the rear of the group.\n[150-180s] - A yellow car leads a group of colorful toy cars navigating a winding track with green hills and trees.  \n- At 167 seconds, a digital scoreboard shows \"TIME: 17.7623\" and \"1234 100000000000000000000000000000000000000000000000000000000000000000000000000\n[180-210s] - Yellow car leads a pack of colorful model cars navigating a winding track with red-and-white curbing.  \n- A group of model spectators and vendor stalls appear along the track’s edge, with a large \"DIORAMA & FIGURES\" sign visible.  \n- The camera pans to show a detailed miniature landscape with trees, hills, and a small building near the track’s end.\n[210-240s] - Four toy cars (green, orange, red, yellow) start a race on a track with a green light signal at the start gate.  \n- The cars accelerate down a hill, then navigate a curved section with red-and-white curbing, followed by a straightaway.  \n- A pit area with trucks and equipment is visible near the track’s end, with a digital timer showing \"TIME: 17.9167\" and \"1.232 MILE/1000M\" as the race progresses.\n[240-270s] - Red car crashes off track, flipping onto grass near a tree.  \n- Green car also veers off track, coming to rest on grass beside rocks.  \n- Top-down view shows multiple cars scattered across the track, with some still moving.", "history_tokens": 867, "history_utf8_bytes": 3013, "recent_frame_times_s": [269.0, 270.0, 271.0, 272.0, 273.0, 274.0, 275.0, 276.0, 277.0, 278.0, 279.0, 280.0, 281.0, 282.0, 283.0, 284.0, 285.0, 286.0, 287.0, 288.0, 289.0, 290.0, 291.0, 292.0, 293.0, 294.0, 295.0, 296.0, 297.0, 298.0], "recent_frames_sha256": "f4ffaa9ed501f26a69b8554a9befe7c4660afd6b944e02bea9a1f8d04363fcf9", "num_recent_frames": 30, "tq": 717997.060972428, "t1": 718004.440231309, "ta": 718004.440231309, "te": 718004.705132218, "first_response_s": 7.379258881090209, "answer_total_s": 7.644159790012054, "clock": "accelerated_sequential; no real-time arrival or backlog measurement", "timing_scope": "batched_request_wait; not isolated latency"}}